2024-09-13T04:58:25.224 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T04:58:25.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T04:58:25.337 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900849 branch: reef description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/rbd_fsx_copy_on_read} email: ceph-qa@ceph.com first_in_suite: false job_id: '7900849' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 30 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: reef ceph: conf: client: rbd cache: true rbd clone copy on read: true global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluefs allocator: hybrid bluestore allocator: hybrid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: 48a7de7e6e1701a88fd571c7e34908ac4b8ed412 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 48a7de7e6e1701a88fd571c7e34908ac4b8ed412 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 7a853b1706d076d58e0da7a5d3b9b9eb36276880 owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 248 sha1: 48a7de7e6e1701a88fd571c7e34908ac4b8ed412 sleep_before_teardown: 0 subset: 116/128 suite: rbd suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_7a853b1706d076d58e0da7a5d3b9b9eb36276880/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 7a853b1706d076d58e0da7a5d3b9b9eb36276880 targets: smithi120.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi137.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: null - ceph: null - thrashosds: timeout: 1200 - rbd_fsx: clients: - client.0 ops: 6000 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_22:16:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T04:58:25.337 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_7a853b1706d076d58e0da7a5d3b9b9eb36276880/qa; will attempt to use it 2024-09-13T04:58:25.338 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_7a853b1706d076d58e0da7a5d3b9b9eb36276880/qa/tasks 2024-09-13T04:58:25.338 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T04:58:25.339 INFO:teuthology.task.internal:Checking packages... 2024-09-13T04:58:25.363 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '48a7de7e6e1701a88fd571c7e34908ac4b8ed412' 2024-09-13T04:58:25.363 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T04:58:25.363 INFO:teuthology.packaging:ref: None 2024-09-13T04:58:25.363 INFO:teuthology.packaging:tag: None 2024-09-13T04:58:25.363 INFO:teuthology.packaging:branch: reef 2024-09-13T04:58:25.363 INFO:teuthology.packaging:sha1: 48a7de7e6e1701a88fd571c7e34908ac4b8ed412 2024-09-13T04:58:25.364 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=reef 2024-09-13T04:58:25.637 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-843-g2c01458a-1focal 2024-09-13T04:58:25.639 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T04:58:25.647 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T04:58:25.647 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T04:58:25.701 INFO:teuthology.task.internal:Saving configuration 2024-09-13T04:58:25.713 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T04:58:25.732 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T04:58:25.764 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900849', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 04:52:20.019706', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-13T04:58:25.796 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900849', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 04:52:20.021390', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-13T04:58:25.796 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T04:58:25.803 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-13T04:58:25.803 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-13T04:58:25.803 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T04:58:25.909 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f405a078d30>, signals=[15]) 2024-09-13T04:58:25.909 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T04:58:25.919 INFO:teuthology.task.internal:Opening connections... 2024-09-13T04:58:25.920 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi120.front.sepia.ceph.com 2024-09-13T04:58:25.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T04:58:26.016 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi137.front.sepia.ceph.com 2024-09-13T04:58:26.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T04:58:26.122 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T04:58:26.134 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2024-09-13T04:58:26.141 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2024-09-13T04:58:26.141 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-09-13T04:58:26.189 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Ubuntu" 2024-09-13T04:58:26.189 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-13T04:58:26.189 INFO:teuthology.orchestra.run.smithi120.stdout:ID=ubuntu 2024-09-13T04:58:26.189 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE=debian 2024-09-13T04:58:26.190 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-13T04:58:26.190 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="20.04" 2024-09-13T04:58:26.190 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T04:58:26.190 INFO:teuthology.orchestra.run.smithi120.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T04:58:26.190 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T04:58:26.190 INFO:teuthology.orchestra.run.smithi120.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T04:58:26.190 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_CODENAME=focal 2024-09-13T04:58:26.190 INFO:teuthology.orchestra.run.smithi120.stdout:UBUNTU_CODENAME=focal 2024-09-13T04:58:26.191 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-09-13T04:58:26.221 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2024-09-13T04:58:26.228 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2024-09-13T04:58:26.229 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-09-13T04:58:26.278 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Ubuntu" 2024-09-13T04:58:26.278 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-13T04:58:26.278 INFO:teuthology.orchestra.run.smithi137.stdout:ID=ubuntu 2024-09-13T04:58:26.278 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE=debian 2024-09-13T04:58:26.278 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-13T04:58:26.278 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="20.04" 2024-09-13T04:58:26.279 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T04:58:26.279 INFO:teuthology.orchestra.run.smithi137.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T04:58:26.279 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T04:58:26.279 INFO:teuthology.orchestra.run.smithi137.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T04:58:26.279 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_CODENAME=focal 2024-09-13T04:58:26.279 INFO:teuthology.orchestra.run.smithi137.stdout:UBUNTU_CODENAME=focal 2024-09-13T04:58:26.279 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-09-13T04:58:26.313 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T04:58:26.325 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T04:58:26.358 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T04:58:26.358 DEBUG:teuthology.orchestra.run.smithi120:> test '!' -e /home/ubuntu/cephtest 2024-09-13T04:58:26.360 DEBUG:teuthology.orchestra.run.smithi137:> test '!' -e /home/ubuntu/cephtest 2024-09-13T04:58:26.366 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T04:58:26.390 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T04:58:26.390 DEBUG:teuthology.orchestra.run.smithi120:> test -z $(ls -A /var/lib/ceph) 2024-09-13T04:58:26.392 DEBUG:teuthology.orchestra.run.smithi137:> test -z $(ls -A /var/lib/ceph) 2024-09-13T04:58:26.405 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T04:58:26.488 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T04:58:26.505 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T04:58:26.505 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T04:58:26.505 DEBUG:teuthology.orchestra.run.smithi120:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T04:58:26.506 DEBUG:teuthology.orchestra.run.smithi137:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T04:58:26.511 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T04:58:26.511 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-09-13T04:58:26.512 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T04:58:26.512 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-09-13T04:58:26.518 INFO:teuthology.orchestra.run.smithi120.stdout:5.4.0-124-generic 2024-09-13T04:58:26.518 INFO:teuthology.task.kernel:Running kernel on smithi120: 5.4.0-124-generic 2024-09-13T04:58:26.519 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get clean 2024-09-13T04:58:26.520 INFO:teuthology.orchestra.run.smithi137.stdout:5.4.0-124-generic 2024-09-13T04:58:26.520 INFO:teuthology.task.kernel:Running kernel on smithi137: 5.4.0-124-generic 2024-09-13T04:58:26.520 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-get clean 2024-09-13T04:58:26.649 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get update 2024-09-13T04:58:26.656 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-get update 2024-09-13T04:58:26.797 INFO:teuthology.orchestra.run.smithi120.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-09-13T04:58:26.830 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T04:58:26.830 INFO:teuthology.orchestra.run.smithi137.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-09-13T04:58:26.830 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-09-13T04:58:26.883 INFO:teuthology.orchestra.run.smithi137.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-09-13T04:58:26.913 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T04:58:26.995 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-09-13T04:58:27.099 INFO:teuthology.orchestra.run.smithi120.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [812 kB] 2024-09-13T04:58:27.190 INFO:teuthology.orchestra.run.smithi120.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,195 kB] 2024-09-13T04:58:27.235 INFO:teuthology.orchestra.run.smithi137.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,195 kB] 2024-09-13T04:58:27.236 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [472 kB] 2024-09-13T04:58:27.239 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.3 kB] 2024-09-13T04:58:27.240 INFO:teuthology.orchestra.run.smithi120.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.3 kB] 2024-09-13T04:58:27.240 INFO:teuthology.orchestra.run.smithi120.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,117 kB] 2024-09-13T04:58:27.261 INFO:teuthology.orchestra.run.smithi120.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [436 kB] 2024-09-13T04:58:27.263 INFO:teuthology.orchestra.run.smithi120.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [548 B] 2024-09-13T04:58:27.264 INFO:teuthology.orchestra.run.smithi120.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [1,011 kB] 2024-09-13T04:58:27.272 INFO:teuthology.orchestra.run.smithi120.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [681 kB] 2024-09-13T04:58:27.277 INFO:teuthology.orchestra.run.smithi120.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [213 kB] 2024-09-13T04:58:27.278 INFO:teuthology.orchestra.run.smithi120.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.2 kB] 2024-09-13T04:58:27.279 INFO:teuthology.orchestra.run.smithi120.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-09-13T04:58:27.279 INFO:teuthology.orchestra.run.smithi120.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-09-13T04:58:27.280 INFO:teuthology.orchestra.run.smithi120.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-09-13T04:58:27.289 INFO:teuthology.orchestra.run.smithi120.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-09-13T04:58:27.349 INFO:teuthology.orchestra.run.smithi120.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-09-13T04:58:27.393 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,030 kB] 2024-09-13T04:58:27.394 INFO:teuthology.orchestra.run.smithi137.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [812 kB] 2024-09-13T04:58:27.404 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [472 kB] 2024-09-13T04:58:27.410 INFO:teuthology.orchestra.run.smithi137.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.3 kB] 2024-09-13T04:58:27.410 INFO:teuthology.orchestra.run.smithi137.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,117 kB] 2024-09-13T04:58:27.434 INFO:teuthology.orchestra.run.smithi137.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.3 kB] 2024-09-13T04:58:27.435 INFO:teuthology.orchestra.run.smithi137.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [436 kB] 2024-09-13T04:58:27.438 INFO:teuthology.orchestra.run.smithi137.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [548 B] 2024-09-13T04:58:27.438 INFO:teuthology.orchestra.run.smithi137.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [1,011 kB] 2024-09-13T04:58:27.445 INFO:teuthology.orchestra.run.smithi137.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [681 kB] 2024-09-13T04:58:27.451 INFO:teuthology.orchestra.run.smithi137.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [213 kB] 2024-09-13T04:58:27.463 INFO:teuthology.orchestra.run.smithi137.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,563 kB] 2024-09-13T04:58:27.470 INFO:teuthology.orchestra.run.smithi137.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.2 kB] 2024-09-13T04:58:27.471 INFO:teuthology.orchestra.run.smithi137.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-09-13T04:58:27.471 INFO:teuthology.orchestra.run.smithi137.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-09-13T04:58:27.472 INFO:teuthology.orchestra.run.smithi137.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-09-13T04:58:27.472 INFO:teuthology.orchestra.run.smithi137.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-09-13T04:58:27.490 INFO:teuthology.orchestra.run.smithi120.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,563 kB] 2024-09-13T04:58:27.508 INFO:teuthology.orchestra.run.smithi137.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [550 kB] 2024-09-13T04:58:27.512 INFO:teuthology.orchestra.run.smithi137.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-09-13T04:58:27.512 INFO:teuthology.orchestra.run.smithi137.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.6 kB] 2024-09-13T04:58:27.512 INFO:teuthology.orchestra.run.smithi137.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,236 kB] 2024-09-13T04:58:27.533 INFO:teuthology.orchestra.run.smithi137.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [453 kB] 2024-09-13T04:58:27.536 INFO:teuthology.orchestra.run.smithi137.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [548 B] 2024-09-13T04:58:27.536 INFO:teuthology.orchestra.run.smithi137.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,230 kB] 2024-09-13T04:58:27.544 INFO:teuthology.orchestra.run.smithi137.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [807 kB] 2024-09-13T04:58:27.549 INFO:teuthology.orchestra.run.smithi137.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [295 kB] 2024-09-13T04:58:27.551 INFO:teuthology.orchestra.run.smithi137.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [28.0 kB] 2024-09-13T04:58:27.551 INFO:teuthology.orchestra.run.smithi137.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-09-13T04:58:27.552 INFO:teuthology.orchestra.run.smithi137.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-09-13T04:58:27.552 INFO:teuthology.orchestra.run.smithi137.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-09-13T04:58:27.561 INFO:teuthology.orchestra.run.smithi137.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-09-13T04:58:27.561 INFO:teuthology.orchestra.run.smithi137.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-09-13T04:58:27.562 INFO:teuthology.orchestra.run.smithi137.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-09-13T04:58:27.578 INFO:teuthology.orchestra.run.smithi137.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-09-13T04:58:27.578 INFO:teuthology.orchestra.run.smithi137.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-09-13T04:58:27.579 INFO:teuthology.orchestra.run.smithi137.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-09-13T04:58:27.579 INFO:teuthology.orchestra.run.smithi137.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-09-13T04:58:27.876 INFO:teuthology.orchestra.run.smithi120.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,030 kB] 2024-09-13T04:58:27.904 INFO:teuthology.orchestra.run.smithi120.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [550 kB] 2024-09-13T04:58:27.917 INFO:teuthology.orchestra.run.smithi120.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-09-13T04:58:27.917 INFO:teuthology.orchestra.run.smithi120.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,236 kB] 2024-09-13T04:58:28.012 INFO:teuthology.orchestra.run.smithi120.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.6 kB] 2024-09-13T04:58:28.012 INFO:teuthology.orchestra.run.smithi120.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [453 kB] 2024-09-13T04:58:28.028 INFO:teuthology.orchestra.run.smithi120.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [548 B] 2024-09-13T04:58:28.028 INFO:teuthology.orchestra.run.smithi120.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,230 kB] 2024-09-13T04:58:28.064 INFO:teuthology.orchestra.run.smithi120.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [807 kB] 2024-09-13T04:58:28.086 INFO:teuthology.orchestra.run.smithi120.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [295 kB] 2024-09-13T04:58:28.093 INFO:teuthology.orchestra.run.smithi120.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [28.0 kB] 2024-09-13T04:58:28.094 INFO:teuthology.orchestra.run.smithi120.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-09-13T04:58:28.094 INFO:teuthology.orchestra.run.smithi120.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-09-13T04:58:28.125 INFO:teuthology.orchestra.run.smithi120.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-09-13T04:58:28.126 INFO:teuthology.orchestra.run.smithi120.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-09-13T04:58:28.126 INFO:teuthology.orchestra.run.smithi120.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-09-13T04:58:28.127 INFO:teuthology.orchestra.run.smithi120.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-09-13T04:58:28.207 INFO:teuthology.orchestra.run.smithi120.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-09-13T04:58:28.207 INFO:teuthology.orchestra.run.smithi120.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-09-13T04:58:28.207 INFO:teuthology.orchestra.run.smithi120.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-09-13T04:58:28.208 INFO:teuthology.orchestra.run.smithi120.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-09-13T04:58:31.691 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 21.8 MB in 3s (7,508 kB/s) 2024-09-13T04:58:31.793 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 21.8 MB in 3s (7,065 kB/s) 2024-09-13T04:58:33.321 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-09-13T04:58:33.349 DEBUG:teuthology.orchestra.run.smithi137:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T04:58:33.356 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-13T04:58:33.384 DEBUG:teuthology.orchestra.run.smithi120:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T04:58:33.422 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-09-13T04:58:33.458 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-13T04:58:33.616 INFO:teuthology.orchestra.run.smithi137.stdout:Building dependency tree... 2024-09-13T04:58:33.616 INFO:teuthology.orchestra.run.smithi137.stdout:Reading state information... 2024-09-13T04:58:33.678 INFO:teuthology.orchestra.run.smithi120.stdout:Building dependency tree... 2024-09-13T04:58:33.679 INFO:teuthology.orchestra.run.smithi120.stdout:Reading state information... 2024-09-13T04:58:33.822 INFO:teuthology.orchestra.run.smithi137.stdout:The following additional packages will be installed: 2024-09-13T04:58:33.822 INFO:teuthology.orchestra.run.smithi137.stdout: linux-generic linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-13T04:58:33.822 INFO:teuthology.orchestra.run.smithi137.stdout: linux-headers-generic linux-image-5.4.0-195-generic 2024-09-13T04:58:33.822 INFO:teuthology.orchestra.run.smithi137.stdout: linux-modules-5.4.0-195-generic linux-modules-extra-5.4.0-195-generic 2024-09-13T04:58:33.823 INFO:teuthology.orchestra.run.smithi137.stdout:Suggested packages: 2024-09-13T04:58:33.824 INFO:teuthology.orchestra.run.smithi137.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-09-13T04:58:33.824 INFO:teuthology.orchestra.run.smithi137.stdout:Recommended packages: 2024-09-13T04:58:33.824 INFO:teuthology.orchestra.run.smithi137.stdout: thermald 2024-09-13T04:58:33.881 INFO:teuthology.orchestra.run.smithi120.stdout:The following additional packages will be installed: 2024-09-13T04:58:33.881 INFO:teuthology.orchestra.run.smithi120.stdout: linux-generic linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-13T04:58:33.881 INFO:teuthology.orchestra.run.smithi120.stdout: linux-headers-generic linux-image-5.4.0-195-generic 2024-09-13T04:58:33.882 INFO:teuthology.orchestra.run.smithi120.stdout: linux-modules-5.4.0-195-generic linux-modules-extra-5.4.0-195-generic 2024-09-13T04:58:33.883 INFO:teuthology.orchestra.run.smithi120.stdout:Suggested packages: 2024-09-13T04:58:33.883 INFO:teuthology.orchestra.run.smithi120.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-09-13T04:58:33.883 INFO:teuthology.orchestra.run.smithi120.stdout:Recommended packages: 2024-09-13T04:58:33.883 INFO:teuthology.orchestra.run.smithi120.stdout: thermald 2024-09-13T04:58:33.883 INFO:teuthology.orchestra.run.smithi137.stdout:The following NEW packages will be installed: 2024-09-13T04:58:33.883 INFO:teuthology.orchestra.run.smithi137.stdout: linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-13T04:58:33.884 INFO:teuthology.orchestra.run.smithi137.stdout: linux-image-5.4.0-195-generic linux-modules-5.4.0-195-generic 2024-09-13T04:58:33.884 INFO:teuthology.orchestra.run.smithi137.stdout: linux-modules-extra-5.4.0-195-generic 2024-09-13T04:58:33.885 INFO:teuthology.orchestra.run.smithi137.stdout:The following packages will be upgraded: 2024-09-13T04:58:33.886 INFO:teuthology.orchestra.run.smithi137.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T04:58:33.946 INFO:teuthology.orchestra.run.smithi120.stdout:The following NEW packages will be installed: 2024-09-13T04:58:33.947 INFO:teuthology.orchestra.run.smithi120.stdout: linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-13T04:58:33.947 INFO:teuthology.orchestra.run.smithi120.stdout: linux-image-5.4.0-195-generic linux-modules-5.4.0-195-generic 2024-09-13T04:58:33.947 INFO:teuthology.orchestra.run.smithi120.stdout: linux-modules-extra-5.4.0-195-generic 2024-09-13T04:58:33.948 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages will be upgraded: 2024-09-13T04:58:33.949 INFO:teuthology.orchestra.run.smithi120.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T04:58:34.002 INFO:teuthology.orchestra.run.smithi120.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-09-13T04:58:34.002 INFO:teuthology.orchestra.run.smithi120.stdout:Need to get 77.2 MB of archives. 2024-09-13T04:58:34.002 INFO:teuthology.orchestra.run.smithi120.stdout:After this operation, 381 MB of additional disk space will be used. 2024-09-13T04:58:34.003 INFO:teuthology.orchestra.run.smithi120.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-195-generic amd64 5.4.0-195.215 [15.0 MB] 2024-09-13T04:58:34.067 INFO:teuthology.orchestra.run.smithi137.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-09-13T04:58:34.067 INFO:teuthology.orchestra.run.smithi137.stdout:Need to get 77.2 MB of archives. 2024-09-13T04:58:34.068 INFO:teuthology.orchestra.run.smithi137.stdout:After this operation, 381 MB of additional disk space will be used. 2024-09-13T04:58:34.068 INFO:teuthology.orchestra.run.smithi137.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-195-generic amd64 5.4.0-195.215 [15.0 MB] 2024-09-13T04:58:34.339 INFO:teuthology.orchestra.run.smithi120.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-195-generic amd64 5.4.0-195.215 [10.5 MB] 2024-09-13T04:58:34.427 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-195-generic amd64 5.4.0-195.215 [39.2 MB] 2024-09-13T04:58:34.947 INFO:teuthology.orchestra.run.smithi120.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.195.193 [1,900 B] 2024-09-13T04:58:34.947 INFO:teuthology.orchestra.run.smithi120.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.195.193 [2,584 B] 2024-09-13T04:58:34.947 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195 all 5.4.0-195.215 [11.0 MB] 2024-09-13T04:58:35.042 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195-generic amd64 5.4.0-195.215 [1,386 kB] 2024-09-13T04:58:35.052 INFO:teuthology.orchestra.run.smithi120.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.195.193 [2,460 B] 2024-09-13T04:58:35.250 INFO:teuthology.orchestra.run.smithi137.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-195-generic amd64 5.4.0-195.215 [10.5 MB] 2024-09-13T04:58:35.524 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-195-generic amd64 5.4.0-195.215 [39.2 MB] 2024-09-13T04:58:35.751 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 77.2 MB in 1s (70.4 MB/s) 2024-09-13T04:58:35.943 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-modules-5.4.0-195-generic. 2024-09-13T04:58:36.848 INFO:teuthology.orchestra.run.smithi137.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.195.193 [1,900 B] 2024-09-13T04:58:36.849 INFO:teuthology.orchestra.run.smithi137.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.195.193 [2,584 B] 2024-09-13T04:58:36.849 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195 all 5.4.0-195.215 [11.0 MB] 2024-09-13T04:58:37.132 INFO:teuthology.orchestra.run.smithi137.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195-generic amd64 5.4.0-195.215 [1,386 kB] 2024-09-13T04:58:37.166 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.195.193 [2,460 B] 2024-09-13T04:58:37.674 INFO:teuthology.orchestra.run.smithi120.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-09-13T04:58:37.679 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../0-linux-modules-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T04:58:37.798 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T04:58:37.876 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 77.2 MB in 3s (23.6 MB/s) 2024-09-13T04:58:38.046 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package linux-modules-5.4.0-195-generic. 2024-09-13T04:58:39.764 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-image-5.4.0-195-generic. 2024-09-13T04:58:39.777 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../1-linux-image-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T04:58:39.850 INFO:teuthology.orchestra.run.smithi137.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-09-13T04:58:39.854 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../0-linux-modules-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T04:58:39.878 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T04:58:39.995 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T04:58:40.951 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-195-generic. 2024-09-13T04:58:40.964 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T04:58:41.001 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T04:58:41.962 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package linux-image-5.4.0-195-generic. 2024-09-13T04:58:41.975 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../1-linux-image-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T04:58:42.062 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T04:58:43.165 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-195-generic. 2024-09-13T04:58:43.178 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T04:58:43.214 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T04:58:45.976 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../3-linux-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T04:58:46.128 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T04:58:46.453 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T04:58:46.598 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-image-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T04:58:46.952 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-headers-5.4.0-195. 2024-09-13T04:58:46.967 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../5-linux-headers-5.4.0-195_5.4.0-195.215_all.deb ... 2024-09-13T04:58:47.009 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-13T04:58:48.168 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../3-linux-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T04:58:48.294 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T04:58:48.670 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T04:58:48.789 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-image-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T04:58:49.142 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package linux-headers-5.4.0-195. 2024-09-13T04:58:49.157 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../5-linux-headers-5.4.0-195_5.4.0-195.215_all.deb ... 2024-09-13T04:58:49.219 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-13T04:58:52.669 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-headers-5.4.0-195-generic. 2024-09-13T04:58:52.691 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../6-linux-headers-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T04:58:52.735 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T04:58:55.095 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package linux-headers-5.4.0-195-generic. 2024-09-13T04:58:55.118 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../6-linux-headers-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T04:58:55.177 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T04:58:55.457 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T04:58:55.578 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-headers-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T04:58:56.026 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T04:58:57.287 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T04:58:58.106 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T04:58:58.267 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-headers-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T04:58:58.434 INFO:teuthology.orchestra.run.smithi120.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-195-generic 2024-09-13T04:58:58.434 INFO:teuthology.orchestra.run.smithi120.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-195-generic 2024-09-13T04:58:58.564 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T04:58:58.611 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T04:58:59.724 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-13T04:58:59.830 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T04:58:59.870 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-image-generic (5.4.0.195.193) ... 2024-09-13T04:58:59.993 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T04:59:00.119 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-headers-generic (5.4.0.195.193) ... 2024-09-13T04:59:00.278 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-generic (5.4.0.195.193) ... 2024-09-13T04:59:00.405 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T04:59:00.470 INFO:teuthology.orchestra.run.smithi120.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T04:59:00.471 INFO:teuthology.orchestra.run.smithi120.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-195-generic 2024-09-13T04:59:00.989 INFO:teuthology.orchestra.run.smithi137.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-195-generic 2024-09-13T04:59:00.989 INFO:teuthology.orchestra.run.smithi137.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-195-generic 2024-09-13T04:59:02.033 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T04:59:03.559 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-13T04:59:03.685 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-image-generic (5.4.0.195.193) ... 2024-09-13T04:59:03.836 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T04:59:03.962 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-headers-generic (5.4.0.195.193) ... 2024-09-13T04:59:04.113 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-generic (5.4.0.195.193) ... 2024-09-13T04:59:04.239 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T04:59:04.316 INFO:teuthology.orchestra.run.smithi137.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T04:59:04.316 INFO:teuthology.orchestra.run.smithi137.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-195-generic 2024-09-13T04:59:23.249 INFO:teuthology.orchestra.run.smithi120.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T04:59:23.249 INFO:teuthology.orchestra.run.smithi120.stdout:Sourcing file `/etc/default/grub' 2024-09-13T04:59:23.268 INFO:teuthology.orchestra.run.smithi120.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T04:59:23.297 INFO:teuthology.orchestra.run.smithi120.stdout:Generating grub configuration file ... 2024-09-13T04:59:23.617 INFO:teuthology.orchestra.run.smithi120.stdout:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-13T04:59:23.642 INFO:teuthology.orchestra.run.smithi120.stdout:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-13T04:59:24.040 INFO:teuthology.orchestra.run.smithi120.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T04:59:24.051 INFO:teuthology.orchestra.run.smithi120.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T04:59:25.967 INFO:teuthology.orchestra.run.smithi120.stdout:done 2024-09-13T04:59:26.225 INFO:teuthology.orchestra.run.smithi137.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T04:59:26.225 INFO:teuthology.orchestra.run.smithi137.stdout:Sourcing file `/etc/default/grub' 2024-09-13T04:59:26.234 INFO:teuthology.orchestra.run.smithi137.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T04:59:26.254 INFO:teuthology.orchestra.run.smithi137.stdout:Generating grub configuration file ... 2024-09-13T04:59:26.395 DEBUG:teuthology.orchestra.run.smithi120:> dpkg -s linux-image-generic 2024-09-13T04:59:26.446 INFO:teuthology.orchestra.run.smithi120.stdout:Package: linux-image-generic 2024-09-13T04:59:26.447 INFO:teuthology.orchestra.run.smithi120.stdout:Status: install ok installed 2024-09-13T04:59:26.447 INFO:teuthology.orchestra.run.smithi120.stdout:Priority: optional 2024-09-13T04:59:26.447 INFO:teuthology.orchestra.run.smithi120.stdout:Section: kernel 2024-09-13T04:59:26.447 INFO:teuthology.orchestra.run.smithi120.stdout:Installed-Size: 20 2024-09-13T04:59:26.447 INFO:teuthology.orchestra.run.smithi120.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T04:59:26.447 INFO:teuthology.orchestra.run.smithi120.stdout:Architecture: amd64 2024-09-13T04:59:26.447 INFO:teuthology.orchestra.run.smithi120.stdout:Source: linux-meta 2024-09-13T04:59:26.447 INFO:teuthology.orchestra.run.smithi120.stdout:Version: 5.4.0.195.193 2024-09-13T04:59:26.447 INFO:teuthology.orchestra.run.smithi120.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-13T04:59:26.447 INFO:teuthology.orchestra.run.smithi120.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T04:59:26.447 INFO:teuthology.orchestra.run.smithi120.stdout:Recommends: thermald 2024-09-13T04:59:26.448 INFO:teuthology.orchestra.run.smithi120.stdout:Description: Generic Linux kernel image 2024-09-13T04:59:26.448 INFO:teuthology.orchestra.run.smithi120.stdout: This package will always depend on the latest generic kernel image 2024-09-13T04:59:26.448 INFO:teuthology.orchestra.run.smithi120.stdout: available. 2024-09-13T04:59:26.448 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-195-generic 2024-09-13T04:59:26.448 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T04:59:26.448 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T04:59:26.448 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-13T04:59:26.448 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi120.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T04:59:26.449 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get clean 2024-09-13T04:59:26.563 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get update 2024-09-13T04:59:26.644 INFO:teuthology.orchestra.run.smithi137.stdout:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-13T04:59:26.669 INFO:teuthology.orchestra.run.smithi137.stdout:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-13T04:59:26.824 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T04:59:26.825 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T04:59:26.895 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T04:59:26.976 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T04:59:27.121 INFO:teuthology.orchestra.run.smithi137.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T04:59:27.132 INFO:teuthology.orchestra.run.smithi137.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T04:59:28.680 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-13T04:59:28.706 DEBUG:teuthology.orchestra.run.smithi120:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T04:59:28.777 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-13T04:59:28.970 INFO:teuthology.orchestra.run.smithi120.stdout:Building dependency tree... 2024-09-13T04:59:28.970 INFO:teuthology.orchestra.run.smithi120.stdout:Reading state information... 2024-09-13T04:59:29.199 INFO:teuthology.orchestra.run.smithi137.stdout:done 2024-09-13T04:59:29.199 INFO:teuthology.orchestra.run.smithi120.stdout:linux-image-generic is already the newest version (5.4.0.195.193). 2024-09-13T04:59:29.199 INFO:teuthology.orchestra.run.smithi120.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-09-13T04:59:29.201 DEBUG:teuthology.orchestra.run.smithi120:> dpkg -s linux-image-generic 2024-09-13T04:59:29.221 INFO:teuthology.orchestra.run.smithi120.stdout:Package: linux-image-generic 2024-09-13T04:59:29.221 INFO:teuthology.orchestra.run.smithi120.stdout:Status: install ok installed 2024-09-13T04:59:29.221 INFO:teuthology.orchestra.run.smithi120.stdout:Priority: optional 2024-09-13T04:59:29.221 INFO:teuthology.orchestra.run.smithi120.stdout:Section: kernel 2024-09-13T04:59:29.221 INFO:teuthology.orchestra.run.smithi120.stdout:Installed-Size: 20 2024-09-13T04:59:29.221 INFO:teuthology.orchestra.run.smithi120.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T04:59:29.221 INFO:teuthology.orchestra.run.smithi120.stdout:Architecture: amd64 2024-09-13T04:59:29.221 INFO:teuthology.orchestra.run.smithi120.stdout:Source: linux-meta 2024-09-13T04:59:29.221 INFO:teuthology.orchestra.run.smithi120.stdout:Version: 5.4.0.195.193 2024-09-13T04:59:29.221 INFO:teuthology.orchestra.run.smithi120.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-13T04:59:29.221 INFO:teuthology.orchestra.run.smithi120.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T04:59:29.222 INFO:teuthology.orchestra.run.smithi120.stdout:Recommends: thermald 2024-09-13T04:59:29.222 INFO:teuthology.orchestra.run.smithi120.stdout:Description: Generic Linux kernel image 2024-09-13T04:59:29.222 INFO:teuthology.orchestra.run.smithi120.stdout: This package will always depend on the latest generic kernel image 2024-09-13T04:59:29.222 INFO:teuthology.orchestra.run.smithi120.stdout: available. 2024-09-13T04:59:29.222 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-09-13T04:59:29.228 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.bZbvqcGKpb 2024-09-13T04:59:29.228 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /boot/grub/grub.cfg /tmp/tmp.bZbvqcGKpb 2024-09-13T04:59:29.286 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.bZbvqcGKpb 2024-09-13T04:59:29.320 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.bZbvqcGKpb is 9KB 2024-09-13T04:59:29.333 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.bZbvqcGKpb 2024-09-13T04:59:29.338 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T04:59:29.394 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T04:59:29.395 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T04:59:29.395 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T04:59:29.423 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-195-generic 2024-09-13T04:59:29.423 DEBUG:teuthology.orchestra.run.smithi120:> sudo update-grub 2024-09-13T04:59:29.621 DEBUG:teuthology.orchestra.run.smithi137:> dpkg -s linux-image-generic 2024-09-13T04:59:29.675 INFO:teuthology.orchestra.run.smithi137.stdout:Package: linux-image-generic 2024-09-13T04:59:29.675 INFO:teuthology.orchestra.run.smithi137.stdout:Status: install ok installed 2024-09-13T04:59:29.676 INFO:teuthology.orchestra.run.smithi137.stdout:Priority: optional 2024-09-13T04:59:29.676 INFO:teuthology.orchestra.run.smithi137.stdout:Section: kernel 2024-09-13T04:59:29.676 INFO:teuthology.orchestra.run.smithi137.stdout:Installed-Size: 20 2024-09-13T04:59:29.676 INFO:teuthology.orchestra.run.smithi137.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T04:59:29.676 INFO:teuthology.orchestra.run.smithi137.stdout:Architecture: amd64 2024-09-13T04:59:29.676 INFO:teuthology.orchestra.run.smithi137.stdout:Source: linux-meta 2024-09-13T04:59:29.676 INFO:teuthology.orchestra.run.smithi137.stdout:Version: 5.4.0.195.193 2024-09-13T04:59:29.676 INFO:teuthology.orchestra.run.smithi137.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-13T04:59:29.676 INFO:teuthology.orchestra.run.smithi137.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T04:59:29.676 INFO:teuthology.orchestra.run.smithi137.stdout:Recommends: thermald 2024-09-13T04:59:29.676 INFO:teuthology.orchestra.run.smithi137.stdout:Description: Generic Linux kernel image 2024-09-13T04:59:29.676 INFO:teuthology.orchestra.run.smithi137.stdout: This package will always depend on the latest generic kernel image 2024-09-13T04:59:29.677 INFO:teuthology.orchestra.run.smithi137.stdout: available. 2024-09-13T04:59:29.677 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-195-generic 2024-09-13T04:59:29.677 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T04:59:29.677 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T04:59:29.677 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-13T04:59:29.677 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi137.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T04:59:29.677 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-get clean 2024-09-13T04:59:29.757 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-get update 2024-09-13T04:59:30.019 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T04:59:30.019 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T04:59:30.089 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-09-13T04:59:30.443 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T04:59:30.783 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 128 kB in 1s (156 kB/s) 2024-09-13T04:59:30.916 INFO:teuthology.orchestra.run.smithi120.stderr:Sourcing file `/etc/default/grub' 2024-09-13T04:59:30.922 INFO:teuthology.orchestra.run.smithi120.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T04:59:30.938 INFO:teuthology.orchestra.run.smithi120.stderr:Generating grub configuration file ... 2024-09-13T04:59:31.188 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-13T04:59:31.200 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-13T04:59:31.581 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T04:59:31.591 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T04:59:31.945 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-09-13T04:59:31.971 DEBUG:teuthology.orchestra.run.smithi137:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T04:59:32.041 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-09-13T04:59:32.240 INFO:teuthology.orchestra.run.smithi137.stdout:Building dependency tree... 2024-09-13T04:59:32.240 INFO:teuthology.orchestra.run.smithi137.stdout:Reading state information... 2024-09-13T04:59:32.357 INFO:teuthology.orchestra.run.smithi120.stderr:done 2024-09-13T04:59:32.359 DEBUG:teuthology.orchestra.run.smithi120:> sudo shutdown -r now 2024-09-13T04:59:32.468 INFO:teuthology.orchestra.run.smithi137.stdout:linux-image-generic is already the newest version (5.4.0.195.193). 2024-09-13T04:59:32.468 INFO:teuthology.orchestra.run.smithi137.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-09-13T04:59:32.470 DEBUG:teuthology.orchestra.run.smithi137:> dpkg -s linux-image-generic 2024-09-13T04:59:32.492 INFO:teuthology.orchestra.run.smithi137.stdout:Package: linux-image-generic 2024-09-13T04:59:32.492 INFO:teuthology.orchestra.run.smithi137.stdout:Status: install ok installed 2024-09-13T04:59:32.492 INFO:teuthology.orchestra.run.smithi137.stdout:Priority: optional 2024-09-13T04:59:32.492 INFO:teuthology.orchestra.run.smithi137.stdout:Section: kernel 2024-09-13T04:59:32.493 INFO:teuthology.orchestra.run.smithi137.stdout:Installed-Size: 20 2024-09-13T04:59:32.493 INFO:teuthology.orchestra.run.smithi137.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T04:59:32.493 INFO:teuthology.orchestra.run.smithi137.stdout:Architecture: amd64 2024-09-13T04:59:32.493 INFO:teuthology.orchestra.run.smithi137.stdout:Source: linux-meta 2024-09-13T04:59:32.493 INFO:teuthology.orchestra.run.smithi137.stdout:Version: 5.4.0.195.193 2024-09-13T04:59:32.493 INFO:teuthology.orchestra.run.smithi137.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-13T04:59:32.493 INFO:teuthology.orchestra.run.smithi137.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T04:59:32.493 INFO:teuthology.orchestra.run.smithi137.stdout:Recommends: thermald 2024-09-13T04:59:32.493 INFO:teuthology.orchestra.run.smithi137.stdout:Description: Generic Linux kernel image 2024-09-13T04:59:32.493 INFO:teuthology.orchestra.run.smithi137.stdout: This package will always depend on the latest generic kernel image 2024-09-13T04:59:32.493 INFO:teuthology.orchestra.run.smithi137.stdout: available. 2024-09-13T04:59:32.494 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-09-13T04:59:32.500 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.TekJ8zhRDT 2024-09-13T04:59:32.500 DEBUG:teuthology.orchestra.run.smithi137:> sudo cp /boot/grub/grub.cfg /tmp/tmp.TekJ8zhRDT 2024-09-13T04:59:32.513 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.TekJ8zhRDT 2024-09-13T04:59:32.594 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.TekJ8zhRDT is 9KB 2024-09-13T04:59:32.608 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.TekJ8zhRDT 2024-09-13T04:59:32.615 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T04:59:32.672 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-13T04:59:32.672 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T04:59:32.672 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T04:59:32.708 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-195-generic 2024-09-13T04:59:32.709 DEBUG:teuthology.orchestra.run.smithi137:> sudo update-grub 2024-09-13T04:59:34.139 INFO:teuthology.orchestra.run.smithi137.stderr:Sourcing file `/etc/default/grub' 2024-09-13T04:59:34.146 INFO:teuthology.orchestra.run.smithi137.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T04:59:34.161 INFO:teuthology.orchestra.run.smithi137.stderr:Generating grub configuration file ... 2024-09-13T04:59:34.529 INFO:teuthology.orchestra.run.smithi137.stderr:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-13T04:59:34.540 INFO:teuthology.orchestra.run.smithi137.stderr:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-13T04:59:34.958 INFO:teuthology.orchestra.run.smithi137.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T04:59:34.969 INFO:teuthology.orchestra.run.smithi137.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T04:59:36.019 INFO:teuthology.orchestra.run.smithi137.stderr:done 2024-09-13T04:59:36.021 DEBUG:teuthology.orchestra.run.smithi137:> sudo shutdown -r now 2024-09-13T05:00:02.385 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-13T05:00:02.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-13T05:00:02.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:00:06.025 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-13T05:00:06.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-13T05:00:06.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:00:20.925 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-09-13T05:00:24.509 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-09-13T05:00:29.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-13T05:00:29.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:00:33.021 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-09-13T05:00:33.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-13T05:00:33.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:00:36.577 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-09-13T05:00:45.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-13T05:00:45.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:00:48.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-13T05:00:48.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:01:03.433 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-09-13T05:01:07.009 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-09-13T05:01:18.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-13T05:01:18.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:01:18.724 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-09-13T05:01:19.297 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-13T05:01:19.297 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-195-generic"... 2024-09-13T05:01:19.297 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-09-13T05:01:19.303 INFO:teuthology.orchestra.run.smithi120.stdout:5.4.0-195-generic 2024-09-13T05:01:19.304 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-195-generic vs 5.4.0-195-generic 2024-09-13T05:01:19.304 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T05:01:19.304 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T05:01:20.304 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-13T05:01:20.305 DEBUG:teuthology.orchestra.run.smithi120:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T05:01:20.390 INFO:teuthology.orchestra.run.smithi120.stdout:ttyS1 2024-09-13T05:01:20.423 DEBUG:teuthology.parallel:result is None 2024-09-13T05:01:22.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-13T05:01:22.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:01:22.288 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-09-13T05:01:22.827 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-13T05:01:22.827 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-195-generic"... 2024-09-13T05:01:22.827 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-09-13T05:01:22.834 INFO:teuthology.orchestra.run.smithi137.stdout:5.4.0-195-generic 2024-09-13T05:01:22.834 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-195-generic vs 5.4.0-195-generic 2024-09-13T05:01:22.834 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T05:01:22.834 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T05:01:23.835 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-13T05:01:23.836 DEBUG:teuthology.orchestra.run.smithi137:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T05:01:23.933 INFO:teuthology.orchestra.run.smithi137.stdout:ttyS1 2024-09-13T05:01:23.966 DEBUG:teuthology.parallel:result is None 2024-09-13T05:01:23.966 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T05:01:23.976 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T05:01:23.976 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T05:01:23.979 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T05:01:23.986 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T05:01:24.018 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T05:01:24.054 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T05:01:24.054 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T05:01:24.057 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T05:01:24.087 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T05:01:24.098 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T05:01:24.099 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T05:01:24.118 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T05:01:24.132 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T05:01:24.142 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T05:01:24.153 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T05:01:24.164 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T05:01:24.166 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T05:01:24.178 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T05:01:24.178 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T05:01:24.180 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T05:01:24.225 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T05:01:24.236 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T05:01:24.236 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T05:01:24.239 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T05:01:24.247 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T05:01:24.291 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T05:01:24.298 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T05:01:24.298 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T05:01:24.322 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T05:01:24.329 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T05:01:24.378 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-13T05:01:24.378 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T05:01:24.398 DEBUG:teuthology.orchestra.run.smithi120:> sudo service rsyslog restart 2024-09-13T05:01:24.401 DEBUG:teuthology.orchestra.run.smithi137:> sudo service rsyslog restart 2024-09-13T05:01:24.450 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T05:01:24.458 INFO:teuthology.task.internal:Starting timer... 2024-09-13T05:01:24.458 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T05:01:24.509 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T05:01:24.543 DEBUG:teuthology.task.selinux:Excluding smithi120: OS 'ubuntu' does not support SELinux 2024-09-13T05:01:24.543 DEBUG:teuthology.task.selinux:Excluding smithi137: OS 'ubuntu' does not support SELinux 2024-09-13T05:01:24.543 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T05:01:24.543 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-13T05:01:24.543 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T05:01:24.543 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T05:01:24.575 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T05:01:24.587 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T05:01:24.588 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi120.front.sepia.ceph.com,smithi137.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T05:06:58.337 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi120.front.sepia.ceph.com'), Remote(name='ubuntu@smithi137.front.sepia.ceph.com')] 2024-09-13T05:06:58.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-13T05:06:58.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:06:58.440 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-09-13T05:06:58.567 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-13T05:06:58.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-13T05:06:58.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:06:58.669 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-09-13T05:06:58.795 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-13T05:06:58.795 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T05:06:58.805 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T05:06:58.806 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T05:06:58.806 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T05:06:58.809 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T05:06:58.809 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T05:06:58.841 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 05:06:58 ntpd[13685]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-13T05:06:58.841 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 05:06:58 ntpd[13685]: Command line: ntpd -gq 2024-09-13T05:06:58.842 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 05:06:58 ntpd[13685]: proto: precision = 0.234 usec (-22) 2024-09-13T05:06:58.842 INFO:teuthology.orchestra.run.smithi120.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T05:06:58.843 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 05:06:58 ntpd[13685]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T05:06:58.843 INFO:teuthology.orchestra.run.smithi120.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T05:06:58.845 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 05:06:58 ntpd[13685]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T05:06:58.845 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 05:06:58 ntpd[13685]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T05:06:58.845 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 05:06:58 ntpd[13685]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T05:06:58.845 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 05:06:58 ntpd[13685]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T05:06:58.845 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 05:06:58 ntpd[13685]: Listen normally on 3 enp3s0f1 172.21.15.120:123 2024-09-13T05:06:58.845 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 05:06:58 ntpd[13685]: Listen normally on 4 lo [::1]:123 2024-09-13T05:06:58.845 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 05:06:58 ntpd[13685]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:478f%5]:123 2024-09-13T05:06:58.845 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 05:06:58 ntpd[13685]: Listening on routing socket on fd #22 for interface updates 2024-09-13T05:06:58.846 INFO:teuthology.orchestra.run.smithi137.stdout:13 Sep 05:06:58 ntpd[13722]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-13T05:06:58.846 INFO:teuthology.orchestra.run.smithi137.stdout:13 Sep 05:06:58 ntpd[13722]: Command line: ntpd -gq 2024-09-13T05:06:58.846 INFO:teuthology.orchestra.run.smithi137.stdout:13 Sep 05:06:58 ntpd[13722]: proto: precision = 0.088 usec (-23) 2024-09-13T05:06:58.847 INFO:teuthology.orchestra.run.smithi137.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T05:06:58.847 INFO:teuthology.orchestra.run.smithi137.stdout:13 Sep 05:06:58 ntpd[13722]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T05:06:58.848 INFO:teuthology.orchestra.run.smithi137.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T05:06:58.849 INFO:teuthology.orchestra.run.smithi137.stdout:13 Sep 05:06:58 ntpd[13722]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T05:06:58.849 INFO:teuthology.orchestra.run.smithi137.stdout:13 Sep 05:06:58 ntpd[13722]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T05:06:58.849 INFO:teuthology.orchestra.run.smithi137.stdout:13 Sep 05:06:58 ntpd[13722]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T05:06:58.849 INFO:teuthology.orchestra.run.smithi137.stdout:13 Sep 05:06:58 ntpd[13722]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T05:06:58.850 INFO:teuthology.orchestra.run.smithi137.stdout:13 Sep 05:06:58 ntpd[13722]: Listen normally on 3 enp3s0f1 172.21.15.137:123 2024-09-13T05:06:58.850 INFO:teuthology.orchestra.run.smithi137.stdout:13 Sep 05:06:58 ntpd[13722]: Listen normally on 4 lo [::1]:123 2024-09-13T05:06:58.850 INFO:teuthology.orchestra.run.smithi137.stdout:13 Sep 05:06:58 ntpd[13722]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8137%5]:123 2024-09-13T05:06:58.850 INFO:teuthology.orchestra.run.smithi137.stdout:13 Sep 05:06:58 ntpd[13722]: Listening on routing socket on fd #22 for interface updates 2024-09-13T05:06:59.845 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:06:59 ntpd[13722]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:06:59.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:06:59 ntpd[13722]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:06:59.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:06:59 ntpd[13722]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:06:59.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:06:59 ntpd[13722]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:06:59.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:06:59 ntpd[13722]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:06:59.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:06:59 ntpd[13722]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:06:59.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:06:59 ntpd[13722]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:06:59.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:06:59 ntpd[13722]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:07:00.842 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:00 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:00.842 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:00 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:00.842 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:00 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:00.842 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:00 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:00.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:00 ntpd[13685]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:07:00.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:00 ntpd[13685]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:07:01.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:01 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:01.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:01 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:01.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:01 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:01.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:01 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:01.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:01 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:01.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:01 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:01.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:01 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:01.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:01 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:01.844 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:01 ntpd[13685]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:07:01.844 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:01 ntpd[13685]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:07:01.844 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:01 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:01.844 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:01 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:01.844 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:01 ntpd[13685]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:07:01.844 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:01 ntpd[13685]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:07:01.845 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:01 ntpd[13722]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:01.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:01 ntpd[13722]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:01.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:01 ntpd[13722]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:01.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:01 ntpd[13722]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:01.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:01 ntpd[13722]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:01.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:01 ntpd[13722]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:01.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:01 ntpd[13722]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:07:01.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:01 ntpd[13722]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:07:01.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:01 ntpd[13722]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:01.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:01 ntpd[13722]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:01.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:01 ntpd[13722]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:07:01.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:01 ntpd[13722]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:07:02.842 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:02 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:02.842 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:02 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:02.842 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:02 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:02.842 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:02 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:02.842 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:02 ntpd[13685]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:07:02.842 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:02 ntpd[13685]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:07:03.842 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:03 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:03.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:03 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:03.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:03 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:03.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:03 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:03.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:03 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:03.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:03 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:03.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:03 ntpd[13685]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:07:03.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:03 ntpd[13685]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:07:03.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:03 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:03.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:03 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:03.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:03 ntpd[13685]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:07:03.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:03 ntpd[13685]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:07:03.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:03 ntpd[13722]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:03.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:03 ntpd[13722]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:03.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:03 ntpd[13722]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:03.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:03 ntpd[13722]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:03.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:03 ntpd[13722]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:03.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:03 ntpd[13722]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:03.847 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:03 ntpd[13722]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:03.847 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:03 ntpd[13722]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:03.847 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:03 ntpd[13722]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:07:03.847 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:03 ntpd[13722]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:07:03.847 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:03 ntpd[13722]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:03.847 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:03 ntpd[13722]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:03.847 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:03 ntpd[13722]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:07:03.847 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:03 ntpd[13722]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:07:03.847 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:03 ntpd[13722]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:03.847 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:03 ntpd[13722]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:03.847 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:03 ntpd[13722]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:07:03.847 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:03 ntpd[13722]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:07:04.842 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:04 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:04.842 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:04 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:04.842 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:04 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:04.842 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:04 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:04.842 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:04 ntpd[13685]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:07:04.842 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:04 ntpd[13685]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:07:05.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:05 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:05.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:05 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:05.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:05 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:05.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:05 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:05.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:05 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:05.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:05 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:05.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:05 ntpd[13685]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:07:05.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:05 ntpd[13685]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:07:05.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:05 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:05.844 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:05 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:05.844 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:05 ntpd[13685]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:07:05.844 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:05 ntpd[13685]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:07:05.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:05 ntpd[13722]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:05.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:05 ntpd[13722]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:05.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:05 ntpd[13722]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:05.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:05 ntpd[13722]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:05.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:05 ntpd[13722]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:05.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:05 ntpd[13722]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:05.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:05 ntpd[13722]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:05.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:05 ntpd[13722]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:05.846 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:05 ntpd[13722]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:07:05.847 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:05 ntpd[13722]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:07:05.847 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:05 ntpd[13722]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:05.847 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:05 ntpd[13722]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:05.847 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:05 ntpd[13722]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:07:05.847 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:05 ntpd[13722]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:07:05.847 INFO:teuthology.orchestra.run.smithi137.stdout:13 Sep 05:07:05 ntpd[13722]: ntpd: time slew +0.001644 s 2024-09-13T05:07:05.847 INFO:teuthology.orchestra.run.smithi137.stdout:ntpd: time slew +0.001644s 2024-09-13T05:07:05.848 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:05 ntpd[13722]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T05:07:05.848 INFO:teuthology.orchestra.run.smithi137.stderr:13 Sep 05:07:05 ntpd[13722]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T05:07:05.917 INFO:teuthology.orchestra.run.smithi137.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T05:07:05.917 INFO:teuthology.orchestra.run.smithi137.stdout:============================================================================== 2024-09-13T05:07:05.917 INFO:teuthology.orchestra.run.smithi137.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T05:07:05.917 INFO:teuthology.orchestra.run.smithi137.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T05:07:05.918 INFO:teuthology.orchestra.run.smithi137.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T05:07:05.918 INFO:teuthology.orchestra.run.smithi137.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T05:07:06.842 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:06 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:06.842 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:06 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:06.842 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:06 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T05:07:06.842 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:06 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T05:07:06.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:06 ntpd[13685]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T05:07:06.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:06 ntpd[13685]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T05:07:06.843 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 05:07:06 ntpd[13685]: ntpd: time slew +0.000095 s 2024-09-13T05:07:06.843 INFO:teuthology.orchestra.run.smithi120.stdout:ntpd: time slew +0.000095s 2024-09-13T05:07:06.843 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:06 ntpd[13685]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T05:07:06.844 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 05:07:06 ntpd[13685]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T05:07:06.915 INFO:teuthology.orchestra.run.smithi120.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T05:07:06.915 INFO:teuthology.orchestra.run.smithi120.stdout:============================================================================== 2024-09-13T05:07:06.915 INFO:teuthology.orchestra.run.smithi120.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T05:07:06.915 INFO:teuthology.orchestra.run.smithi120.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T05:07:06.915 INFO:teuthology.orchestra.run.smithi120.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T05:07:06.915 INFO:teuthology.orchestra.run.smithi120.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T05:07:06.916 INFO:teuthology.run_tasks:Running task install... 2024-09-13T05:07:06.924 DEBUG:teuthology.task.install:project ceph 2024-09-13T05:07:06.925 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '48a7de7e6e1701a88fd571c7e34908ac4b8ed412'}} 2024-09-13T05:07:06.925 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '48a7de7e6e1701a88fd571c7e34908ac4b8ed412'} 2024-09-13T05:07:06.925 INFO:teuthology.task.install:Using flavor: default 2024-09-13T05:07:06.931 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T05:07:06.931 INFO:teuthology.task.install:extra packages: [] 2024-09-13T05:07:06.931 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-key list | grep Ceph 2024-09-13T05:07:06.932 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-key list | grep Ceph 2024-09-13T05:07:07.033 INFO:teuthology.orchestra.run.smithi137.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-13T05:07:07.045 INFO:teuthology.orchestra.run.smithi120.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-13T05:07:07.087 INFO:teuthology.orchestra.run.smithi137.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T05:07:07.087 INFO:teuthology.orchestra.run.smithi137.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T05:07:07.088 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-13T05:07:07.088 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=48a7de7e6e1701a88fd571c7e34908ac4b8ed412 2024-09-13T05:07:07.105 INFO:teuthology.orchestra.run.smithi120.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T05:07:07.106 INFO:teuthology.orchestra.run.smithi120.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T05:07:07.106 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-13T05:07:07.107 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=48a7de7e6e1701a88fd571c7e34908ac4b8ed412 2024-09-13T05:07:07.243 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default/ 2024-09-13T05:07:07.244 INFO:teuthology.task.install.deb:Package version is 18.2.4-820-g48a7de7e-1focal 2024-09-13T05:07:07.257 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default/ 2024-09-13T05:07:07.257 INFO:teuthology.task.install.deb:Package version is 18.2.4-820-g48a7de7e-1focal 2024-09-13T05:07:07.366 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-13T05:07:07.366 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T05:07:07.376 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T05:07:07.376 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T05:07:07.383 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-get update 2024-09-13T05:07:07.392 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get update 2024-09-13T05:07:07.526 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T05:07:07.532 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T05:07:07.580 INFO:teuthology.orchestra.run.smithi137.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal InRelease 2024-09-13T05:07:07.583 INFO:teuthology.orchestra.run.smithi120.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal InRelease 2024-09-13T05:07:07.601 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-13T05:07:07.604 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-13T05:07:07.625 INFO:teuthology.orchestra.run.smithi137.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal Release.gpg 2024-09-13T05:07:07.627 INFO:teuthology.orchestra.run.smithi120.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal Release.gpg 2024-09-13T05:07:07.642 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T05:07:07.646 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-09-13T05:07:07.648 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T05:07:07.649 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main i386 Packages [3,433 B] 2024-09-13T05:07:07.678 INFO:teuthology.orchestra.run.smithi137.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main i386 Packages [3,433 B] 2024-09-13T05:07:07.683 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-09-13T05:07:07.724 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T05:07:07.730 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T05:07:07.812 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T05:07:07.816 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T05:07:08.195 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 28.7 kB in 1s (44.3 kB/s) 2024-09-13T05:07:08.196 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 28.7 kB in 1s (45.0 kB/s) 2024-09-13T05:07:09.349 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-09-13T05:07:09.351 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-13T05:07:09.376 DEBUG:teuthology.orchestra.run.smithi120:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-820-g48a7de7e-1focal cephadm=18.2.4-820-g48a7de7e-1focal ceph-mds=18.2.4-820-g48a7de7e-1focal ceph-mgr=18.2.4-820-g48a7de7e-1focal ceph-common=18.2.4-820-g48a7de7e-1focal ceph-fuse=18.2.4-820-g48a7de7e-1focal ceph-test=18.2.4-820-g48a7de7e-1focal ceph-volume=18.2.4-820-g48a7de7e-1focal radosgw=18.2.4-820-g48a7de7e-1focal python3-rados=18.2.4-820-g48a7de7e-1focal python3-rgw=18.2.4-820-g48a7de7e-1focal python3-cephfs=18.2.4-820-g48a7de7e-1focal python3-rbd=18.2.4-820-g48a7de7e-1focal libcephfs2=18.2.4-820-g48a7de7e-1focal libcephfs-dev=18.2.4-820-g48a7de7e-1focal librados2=18.2.4-820-g48a7de7e-1focal librbd1=18.2.4-820-g48a7de7e-1focal rbd-fuse=18.2.4-820-g48a7de7e-1focal 2024-09-13T05:07:09.378 DEBUG:teuthology.orchestra.run.smithi137:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-820-g48a7de7e-1focal cephadm=18.2.4-820-g48a7de7e-1focal ceph-mds=18.2.4-820-g48a7de7e-1focal ceph-mgr=18.2.4-820-g48a7de7e-1focal ceph-common=18.2.4-820-g48a7de7e-1focal ceph-fuse=18.2.4-820-g48a7de7e-1focal ceph-test=18.2.4-820-g48a7de7e-1focal ceph-volume=18.2.4-820-g48a7de7e-1focal radosgw=18.2.4-820-g48a7de7e-1focal python3-rados=18.2.4-820-g48a7de7e-1focal python3-rgw=18.2.4-820-g48a7de7e-1focal python3-cephfs=18.2.4-820-g48a7de7e-1focal python3-rbd=18.2.4-820-g48a7de7e-1focal libcephfs2=18.2.4-820-g48a7de7e-1focal libcephfs-dev=18.2.4-820-g48a7de7e-1focal librados2=18.2.4-820-g48a7de7e-1focal librbd1=18.2.4-820-g48a7de7e-1focal rbd-fuse=18.2.4-820-g48a7de7e-1focal 2024-09-13T05:07:09.449 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-13T05:07:09.450 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-09-13T05:07:09.667 INFO:teuthology.orchestra.run.smithi137.stdout:Building dependency tree... 2024-09-13T05:07:09.667 INFO:teuthology.orchestra.run.smithi137.stdout:Reading state information... 2024-09-13T05:07:09.668 INFO:teuthology.orchestra.run.smithi120.stdout:Building dependency tree... 2024-09-13T05:07:09.669 INFO:teuthology.orchestra.run.smithi120.stdout:Reading state information... 2024-09-13T05:07:09.866 INFO:teuthology.orchestra.run.smithi137.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T05:07:09.867 INFO:teuthology.orchestra.run.smithi137.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T05:07:09.868 INFO:teuthology.orchestra.run.smithi137.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T05:07:09.868 INFO:teuthology.orchestra.run.smithi137.stdout:The following additional packages will be installed: 2024-09-13T05:07:09.868 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T05:07:09.870 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-13T05:07:09.870 INFO:teuthology.orchestra.run.smithi137.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-13T05:07:09.870 INFO:teuthology.orchestra.run.smithi137.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-13T05:07:09.870 INFO:teuthology.orchestra.run.smithi137.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-13T05:07:09.870 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-13T05:07:09.871 INFO:teuthology.orchestra.run.smithi137.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T05:07:09.871 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T05:07:09.871 INFO:teuthology.orchestra.run.smithi137.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T05:07:09.871 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2024-09-13T05:07:09.871 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-09-13T05:07:09.871 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-13T05:07:09.871 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-13T05:07:09.871 INFO:teuthology.orchestra.run.smithi137.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-13T05:07:09.871 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-13T05:07:09.872 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-09-13T05:07:09.872 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T05:07:09.872 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T05:07:09.872 INFO:teuthology.orchestra.run.smithi137.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T05:07:09.872 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T05:07:09.872 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T05:07:09.872 INFO:teuthology.orchestra.run.smithi137.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T05:07:09.873 INFO:teuthology.orchestra.run.smithi137.stdout:Suggested packages: 2024-09-13T05:07:09.873 INFO:teuthology.orchestra.run.smithi137.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-13T05:07:09.873 INFO:teuthology.orchestra.run.smithi137.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-13T05:07:09.873 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-13T05:07:09.873 INFO:teuthology.orchestra.run.smithi137.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-13T05:07:09.873 INFO:teuthology.orchestra.run.smithi137.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-13T05:07:09.873 INFO:teuthology.orchestra.run.smithi137.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-13T05:07:09.874 INFO:teuthology.orchestra.run.smithi137.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-13T05:07:09.874 INFO:teuthology.orchestra.run.smithi137.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T05:07:09.874 INFO:teuthology.orchestra.run.smithi137.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-13T05:07:09.874 INFO:teuthology.orchestra.run.smithi137.stdout:Recommended packages: 2024-09-13T05:07:09.874 INFO:teuthology.orchestra.run.smithi137.stdout: btrfs-tools 2024-09-13T05:07:09.875 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T05:07:09.875 INFO:teuthology.orchestra.run.smithi120.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T05:07:09.875 INFO:teuthology.orchestra.run.smithi120.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T05:07:09.875 INFO:teuthology.orchestra.run.smithi120.stdout:The following additional packages will be installed: 2024-09-13T05:07:09.875 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T05:07:09.875 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-13T05:07:09.875 INFO:teuthology.orchestra.run.smithi120.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-13T05:07:09.875 INFO:teuthology.orchestra.run.smithi120.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-13T05:07:09.875 INFO:teuthology.orchestra.run.smithi120.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-13T05:07:09.875 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-13T05:07:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T05:07:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T05:07:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T05:07:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2024-09-13T05:07:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-09-13T05:07:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-13T05:07:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-13T05:07:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-13T05:07:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-13T05:07:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-09-13T05:07:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T05:07:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T05:07:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T05:07:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T05:07:09.877 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T05:07:09.877 INFO:teuthology.orchestra.run.smithi120.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T05:07:09.877 INFO:teuthology.orchestra.run.smithi120.stdout:Suggested packages: 2024-09-13T05:07:09.877 INFO:teuthology.orchestra.run.smithi120.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-13T05:07:09.877 INFO:teuthology.orchestra.run.smithi120.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-13T05:07:09.877 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-13T05:07:09.877 INFO:teuthology.orchestra.run.smithi120.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-13T05:07:09.877 INFO:teuthology.orchestra.run.smithi120.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-13T05:07:09.878 INFO:teuthology.orchestra.run.smithi120.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-13T05:07:09.878 INFO:teuthology.orchestra.run.smithi120.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-13T05:07:09.878 INFO:teuthology.orchestra.run.smithi120.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T05:07:09.878 INFO:teuthology.orchestra.run.smithi120.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-13T05:07:09.878 INFO:teuthology.orchestra.run.smithi120.stdout:Recommended packages: 2024-09-13T05:07:09.878 INFO:teuthology.orchestra.run.smithi120.stdout: btrfs-tools 2024-09-13T05:07:09.990 INFO:teuthology.orchestra.run.smithi137.stdout:The following NEW packages will be installed: 2024-09-13T05:07:09.990 INFO:teuthology.orchestra.run.smithi137.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T05:07:09.990 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T05:07:09.990 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T05:07:09.990 INFO:teuthology.orchestra.run.smithi137.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-09-13T05:07:09.990 INFO:teuthology.orchestra.run.smithi137.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-09-13T05:07:09.990 INFO:teuthology.orchestra.run.smithi137.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-13T05:07:09.990 INFO:teuthology.orchestra.run.smithi137.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-09-13T05:07:09.992 INFO:teuthology.orchestra.run.smithi137.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2024-09-13T05:07:09.992 INFO:teuthology.orchestra.run.smithi137.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2024-09-13T05:07:09.992 INFO:teuthology.orchestra.run.smithi137.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-09-13T05:07:09.992 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-13T05:07:09.992 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-09-13T05:07:09.992 INFO:teuthology.orchestra.run.smithi137.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-09-13T05:07:09.992 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-13T05:07:09.992 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-13T05:07:09.993 INFO:teuthology.orchestra.run.smithi137.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-13T05:07:09.993 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-13T05:07:09.993 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-09-13T05:07:09.993 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-09-13T05:07:09.993 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-09-13T05:07:09.993 INFO:teuthology.orchestra.run.smithi137.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-13T05:07:09.993 INFO:teuthology.orchestra.run.smithi137.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-09-13T05:07:09.993 INFO:teuthology.orchestra.run.smithi137.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-09-13T05:07:09.993 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2024-09-13T05:07:09.993 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet 2024-09-13T05:07:09.993 INFO:teuthology.orchestra.run.smithi137.stdout:The following packages will be upgraded: 2024-09-13T05:07:09.994 INFO:teuthology.orchestra.run.smithi137.stdout: librados2 librbd1 2024-09-13T05:07:09.995 INFO:teuthology.orchestra.run.smithi120.stdout:The following NEW packages will be installed: 2024-09-13T05:07:09.995 INFO:teuthology.orchestra.run.smithi120.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T05:07:09.995 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T05:07:09.995 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T05:07:09.995 INFO:teuthology.orchestra.run.smithi120.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-09-13T05:07:09.996 INFO:teuthology.orchestra.run.smithi120.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-09-13T05:07:09.996 INFO:teuthology.orchestra.run.smithi120.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-13T05:07:09.996 INFO:teuthology.orchestra.run.smithi120.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-09-13T05:07:09.996 INFO:teuthology.orchestra.run.smithi120.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2024-09-13T05:07:09.996 INFO:teuthology.orchestra.run.smithi120.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2024-09-13T05:07:09.996 INFO:teuthology.orchestra.run.smithi120.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-09-13T05:07:09.996 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-13T05:07:09.996 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-09-13T05:07:09.996 INFO:teuthology.orchestra.run.smithi120.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-09-13T05:07:09.996 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-13T05:07:09.996 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-13T05:07:09.996 INFO:teuthology.orchestra.run.smithi120.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-13T05:07:09.996 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-13T05:07:09.996 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-09-13T05:07:09.997 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-09-13T05:07:09.997 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-09-13T05:07:09.997 INFO:teuthology.orchestra.run.smithi120.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-13T05:07:09.997 INFO:teuthology.orchestra.run.smithi120.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-09-13T05:07:09.997 INFO:teuthology.orchestra.run.smithi120.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-09-13T05:07:09.997 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2024-09-13T05:07:09.997 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet 2024-09-13T05:07:09.997 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages will be upgraded: 2024-09-13T05:07:09.997 INFO:teuthology.orchestra.run.smithi120.stdout: librados2 librbd1 2024-09-13T05:07:10.057 INFO:teuthology.orchestra.run.smithi137.stdout:2 upgraded, 110 newly installed, 0 to remove and 295 not upgraded. 2024-09-13T05:07:10.057 INFO:teuthology.orchestra.run.smithi137.stdout:Need to get 199 MB of archives. 2024-09-13T05:07:10.057 INFO:teuthology.orchestra.run.smithi137.stdout:After this operation, 977 MB of additional disk space will be used. 2024-09-13T05:07:10.057 INFO:teuthology.orchestra.run.smithi137.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-13T05:07:10.140 INFO:teuthology.orchestra.run.smithi137.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.4-820-g48a7de7e-1focal [3,456 kB] 2024-09-13T05:07:10.140 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-13T05:07:10.143 INFO:teuthology.orchestra.run.smithi137.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-13T05:07:10.144 INFO:teuthology.orchestra.run.smithi120.stdout:2 upgraded, 110 newly installed, 0 to remove and 295 not upgraded. 2024-09-13T05:07:10.144 INFO:teuthology.orchestra.run.smithi120.stdout:Need to get 199 MB of archives. 2024-09-13T05:07:10.144 INFO:teuthology.orchestra.run.smithi120.stdout:After this operation, 977 MB of additional disk space will be used. 2024-09-13T05:07:10.144 INFO:teuthology.orchestra.run.smithi120.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.4-820-g48a7de7e-1focal [3,456 kB] 2024-09-13T05:07:10.161 INFO:teuthology.orchestra.run.smithi137.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-13T05:07:10.188 INFO:teuthology.orchestra.run.smithi120.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-13T05:07:10.216 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-13T05:07:10.216 INFO:teuthology.orchestra.run.smithi137.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-13T05:07:10.222 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-13T05:07:10.224 INFO:teuthology.orchestra.run.smithi137.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-13T05:07:10.224 INFO:teuthology.orchestra.run.smithi137.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-13T05:07:10.225 INFO:teuthology.orchestra.run.smithi137.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-13T05:07:10.226 INFO:teuthology.orchestra.run.smithi137.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-13T05:07:10.229 INFO:teuthology.orchestra.run.smithi137.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-13T05:07:10.229 INFO:teuthology.orchestra.run.smithi137.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-13T05:07:10.231 INFO:teuthology.orchestra.run.smithi137.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-13T05:07:10.248 INFO:teuthology.orchestra.run.smithi137.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-13T05:07:10.248 INFO:teuthology.orchestra.run.smithi137.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-13T05:07:10.249 INFO:teuthology.orchestra.run.smithi137.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-13T05:07:10.250 INFO:teuthology.orchestra.run.smithi137.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T05:07:10.250 INFO:teuthology.orchestra.run.smithi137.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-13T05:07:10.251 INFO:teuthology.orchestra.run.smithi137.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-13T05:07:10.252 INFO:teuthology.orchestra.run.smithi137.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-13T05:07:10.253 INFO:teuthology.orchestra.run.smithi137.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-13T05:07:10.254 INFO:teuthology.orchestra.run.smithi137.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-13T05:07:10.266 INFO:teuthology.orchestra.run.smithi137.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-13T05:07:10.273 INFO:teuthology.orchestra.run.smithi137.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-13T05:07:10.278 INFO:teuthology.orchestra.run.smithi137.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-13T05:07:10.279 INFO:teuthology.orchestra.run.smithi137.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-13T05:07:10.279 INFO:teuthology.orchestra.run.smithi137.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-13T05:07:10.280 INFO:teuthology.orchestra.run.smithi137.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-13T05:07:10.281 INFO:teuthology.orchestra.run.smithi137.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-13T05:07:10.283 INFO:teuthology.orchestra.run.smithi137.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-13T05:07:10.284 INFO:teuthology.orchestra.run.smithi137.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-13T05:07:10.286 INFO:teuthology.orchestra.run.smithi137.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-13T05:07:10.301 INFO:teuthology.orchestra.run.smithi137.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-09-13T05:07:10.302 INFO:teuthology.orchestra.run.smithi137.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-13T05:07:10.303 INFO:teuthology.orchestra.run.smithi137.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-13T05:07:10.304 INFO:teuthology.orchestra.run.smithi137.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-13T05:07:10.304 INFO:teuthology.orchestra.run.smithi137.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-13T05:07:10.305 INFO:teuthology.orchestra.run.smithi137.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-13T05:07:10.318 INFO:teuthology.orchestra.run.smithi137.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.4-820-g48a7de7e-1focal [4,039 kB] 2024-09-13T05:07:10.318 INFO:teuthology.orchestra.run.smithi137.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-13T05:07:10.318 INFO:teuthology.orchestra.run.smithi137.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-13T05:07:10.319 INFO:teuthology.orchestra.run.smithi137.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-13T05:07:10.320 INFO:teuthology.orchestra.run.smithi137.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-13T05:07:10.335 INFO:teuthology.orchestra.run.smithi137.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T05:07:10.336 INFO:teuthology.orchestra.run.smithi137.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-13T05:07:10.337 INFO:teuthology.orchestra.run.smithi137.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-13T05:07:10.339 INFO:teuthology.orchestra.run.smithi137.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-13T05:07:10.340 INFO:teuthology.orchestra.run.smithi137.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-13T05:07:10.341 INFO:teuthology.orchestra.run.smithi137.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-13T05:07:10.353 INFO:teuthology.orchestra.run.smithi137.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-13T05:07:10.393 INFO:teuthology.orchestra.run.smithi137.stdout:Get:53 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.4-820-g48a7de7e-1focal [746 kB] 2024-09-13T05:07:10.408 INFO:teuthology.orchestra.run.smithi137.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.4-820-g48a7de7e-1focal [387 kB] 2024-09-13T05:07:10.415 INFO:teuthology.orchestra.run.smithi137.stdout:Get:55 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.4-820-g48a7de7e-1focal [31.9 kB] 2024-09-13T05:07:10.415 INFO:teuthology.orchestra.run.smithi137.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.4-820-g48a7de7e-1focal [200 kB] 2024-09-13T05:07:10.418 INFO:teuthology.orchestra.run.smithi137.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.4-820-g48a7de7e-1focal [62.5 kB] 2024-09-13T05:07:10.419 INFO:teuthology.orchestra.run.smithi137.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.4-820-g48a7de7e-1focal [367 kB] 2024-09-13T05:07:10.426 INFO:teuthology.orchestra.run.smithi137.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.4-820-g48a7de7e-1focal [6,628 kB] 2024-09-13T05:07:10.435 INFO:teuthology.orchestra.run.smithi137.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-13T05:07:10.452 INFO:teuthology.orchestra.run.smithi137.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-13T05:07:10.464 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.4-820-g48a7de7e-1focal [4,039 kB] 2024-09-13T05:07:10.520 INFO:teuthology.orchestra.run.smithi137.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-13T05:07:10.541 INFO:teuthology.orchestra.run.smithi137.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-13T05:07:10.541 INFO:teuthology.orchestra.run.smithi137.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-13T05:07:10.541 INFO:teuthology.orchestra.run.smithi137.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-13T05:07:10.541 INFO:teuthology.orchestra.run.smithi137.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-13T05:07:10.542 INFO:teuthology.orchestra.run.smithi137.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-13T05:07:10.543 INFO:teuthology.orchestra.run.smithi137.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-13T05:07:10.543 INFO:teuthology.orchestra.run.smithi137.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-13T05:07:10.543 INFO:teuthology.orchestra.run.smithi137.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-13T05:07:10.543 INFO:teuthology.orchestra.run.smithi137.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-13T05:07:10.558 INFO:teuthology.orchestra.run.smithi137.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-13T05:07:10.561 INFO:teuthology.orchestra.run.smithi137.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-13T05:07:10.567 INFO:teuthology.orchestra.run.smithi137.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.4-820-g48a7de7e-1focal [113 kB] 2024-09-13T05:07:10.569 INFO:teuthology.orchestra.run.smithi137.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.4-820-g48a7de7e-1focal [478 kB] 2024-09-13T05:07:10.575 INFO:teuthology.orchestra.run.smithi137.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-13T05:07:10.576 INFO:teuthology.orchestra.run.smithi137.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.4-820-g48a7de7e-1focal [25.2 MB] 2024-09-13T05:07:10.577 INFO:teuthology.orchestra.run.smithi137.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-13T05:07:10.577 INFO:teuthology.orchestra.run.smithi137.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-13T05:07:10.581 INFO:teuthology.orchestra.run.smithi137.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-13T05:07:10.584 INFO:teuthology.orchestra.run.smithi137.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-13T05:07:10.588 INFO:teuthology.orchestra.run.smithi120.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-13T05:07:10.601 INFO:teuthology.orchestra.run.smithi120.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-13T05:07:10.602 INFO:teuthology.orchestra.run.smithi137.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-13T05:07:10.605 INFO:teuthology.orchestra.run.smithi137.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-09-13T05:07:10.606 INFO:teuthology.orchestra.run.smithi137.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-13T05:07:10.647 INFO:teuthology.orchestra.run.smithi137.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-13T05:07:10.648 INFO:teuthology.orchestra.run.smithi137.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-13T05:07:10.648 INFO:teuthology.orchestra.run.smithi137.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-13T05:07:10.649 INFO:teuthology.orchestra.run.smithi137.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-13T05:07:10.660 INFO:teuthology.orchestra.run.smithi137.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T05:07:10.661 INFO:teuthology.orchestra.run.smithi137.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-13T05:07:10.662 INFO:teuthology.orchestra.run.smithi137.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-13T05:07:10.663 INFO:teuthology.orchestra.run.smithi137.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-13T05:07:10.663 INFO:teuthology.orchestra.run.smithi137.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-13T05:07:10.678 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.4-820-g48a7de7e-1focal [746 kB] 2024-09-13T05:07:10.686 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-13T05:07:10.741 INFO:teuthology.orchestra.run.smithi120.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.4-820-g48a7de7e-1focal [387 kB] 2024-09-13T05:07:10.747 INFO:teuthology.orchestra.run.smithi120.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.4-820-g48a7de7e-1focal [31.9 kB] 2024-09-13T05:07:10.748 INFO:teuthology.orchestra.run.smithi120.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.4-820-g48a7de7e-1focal [200 kB] 2024-09-13T05:07:10.802 INFO:teuthology.orchestra.run.smithi120.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.4-820-g48a7de7e-1focal [62.5 kB] 2024-09-13T05:07:10.803 INFO:teuthology.orchestra.run.smithi120.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.4-820-g48a7de7e-1focal [367 kB] 2024-09-13T05:07:10.809 INFO:teuthology.orchestra.run.smithi120.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.4-820-g48a7de7e-1focal [6,628 kB] 2024-09-13T05:07:10.928 INFO:teuthology.orchestra.run.smithi120.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-13T05:07:10.938 INFO:teuthology.orchestra.run.smithi120.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-13T05:07:10.966 INFO:teuthology.orchestra.run.smithi120.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-13T05:07:10.974 INFO:teuthology.orchestra.run.smithi120.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-13T05:07:10.975 INFO:teuthology.orchestra.run.smithi120.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-13T05:07:10.978 INFO:teuthology.orchestra.run.smithi120.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-13T05:07:10.980 INFO:teuthology.orchestra.run.smithi120.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-13T05:07:10.992 INFO:teuthology.orchestra.run.smithi120.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-13T05:07:10.993 INFO:teuthology.orchestra.run.smithi120.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-13T05:07:11.011 INFO:teuthology.orchestra.run.smithi120.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-13T05:07:11.084 INFO:teuthology.orchestra.run.smithi120.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-13T05:07:11.084 INFO:teuthology.orchestra.run.smithi120.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-13T05:07:11.085 INFO:teuthology.orchestra.run.smithi120.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-13T05:07:11.087 INFO:teuthology.orchestra.run.smithi120.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T05:07:11.087 INFO:teuthology.orchestra.run.smithi120.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-13T05:07:11.088 INFO:teuthology.orchestra.run.smithi120.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-13T05:07:11.091 INFO:teuthology.orchestra.run.smithi120.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-13T05:07:11.092 INFO:teuthology.orchestra.run.smithi120.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-13T05:07:11.094 INFO:teuthology.orchestra.run.smithi120.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-13T05:07:11.171 INFO:teuthology.orchestra.run.smithi120.stdout:Get:33 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.4-820-g48a7de7e-1focal [113 kB] 2024-09-13T05:07:11.173 INFO:teuthology.orchestra.run.smithi120.stdout:Get:34 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.4-820-g48a7de7e-1focal [478 kB] 2024-09-13T05:07:11.174 INFO:teuthology.orchestra.run.smithi120.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-13T05:07:11.174 INFO:teuthology.orchestra.run.smithi120.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-13T05:07:11.180 INFO:teuthology.orchestra.run.smithi120.stdout:Get:37 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.4-820-g48a7de7e-1focal [25.2 MB] 2024-09-13T05:07:11.184 INFO:teuthology.orchestra.run.smithi120.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-13T05:07:11.185 INFO:teuthology.orchestra.run.smithi120.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-13T05:07:11.185 INFO:teuthology.orchestra.run.smithi120.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-13T05:07:11.185 INFO:teuthology.orchestra.run.smithi120.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-13T05:07:11.186 INFO:teuthology.orchestra.run.smithi120.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-13T05:07:11.251 INFO:teuthology.orchestra.run.smithi137.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.4-820-g48a7de7e-1focal [9,612 kB] 2024-09-13T05:07:11.255 INFO:teuthology.orchestra.run.smithi120.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-13T05:07:11.256 INFO:teuthology.orchestra.run.smithi120.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-13T05:07:11.262 INFO:teuthology.orchestra.run.smithi120.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-13T05:07:11.337 INFO:teuthology.orchestra.run.smithi120.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-09-13T05:07:11.340 INFO:teuthology.orchestra.run.smithi120.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-13T05:07:11.343 INFO:teuthology.orchestra.run.smithi120.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-13T05:07:11.343 INFO:teuthology.orchestra.run.smithi120.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-13T05:07:11.345 INFO:teuthology.orchestra.run.smithi120.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-13T05:07:11.345 INFO:teuthology.orchestra.run.smithi120.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-13T05:07:11.348 INFO:teuthology.orchestra.run.smithi120.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-13T05:07:11.419 INFO:teuthology.orchestra.run.smithi120.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-13T05:07:11.419 INFO:teuthology.orchestra.run.smithi120.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-13T05:07:11.421 INFO:teuthology.orchestra.run.smithi120.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-13T05:07:11.486 INFO:teuthology.orchestra.run.smithi137.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.4-820-g48a7de7e-1focal [238 kB] 2024-09-13T05:07:11.488 INFO:teuthology.orchestra.run.smithi137.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.4-820-g48a7de7e-1focal [148 kB] 2024-09-13T05:07:11.489 INFO:teuthology.orchestra.run.smithi137.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.4-820-g48a7de7e-1focal [1,575 kB] 2024-09-13T05:07:11.500 INFO:teuthology.orchestra.run.smithi120.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T05:07:11.500 INFO:teuthology.orchestra.run.smithi120.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-13T05:07:11.504 INFO:teuthology.orchestra.run.smithi120.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-13T05:07:11.506 INFO:teuthology.orchestra.run.smithi120.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-13T05:07:11.509 INFO:teuthology.orchestra.run.smithi120.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-13T05:07:11.510 INFO:teuthology.orchestra.run.smithi120.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-13T05:07:11.511 INFO:teuthology.orchestra.run.smithi120.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-13T05:07:11.522 INFO:teuthology.orchestra.run.smithi137.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.4-820-g48a7de7e-1focal [6,640 kB] 2024-09-13T05:07:11.720 INFO:teuthology.orchestra.run.smithi137.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.4-820-g48a7de7e-1focal [24.5 MB] 2024-09-13T05:07:11.832 INFO:teuthology.orchestra.run.smithi120.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-13T05:07:11.864 INFO:teuthology.orchestra.run.smithi120.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-13T05:07:11.866 INFO:teuthology.orchestra.run.smithi120.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-13T05:07:11.933 INFO:teuthology.orchestra.run.smithi120.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-13T05:07:11.934 INFO:teuthology.orchestra.run.smithi120.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-13T05:07:11.934 INFO:teuthology.orchestra.run.smithi120.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-13T05:07:11.935 INFO:teuthology.orchestra.run.smithi120.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-13T05:07:11.935 INFO:teuthology.orchestra.run.smithi120.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-13T05:07:11.937 INFO:teuthology.orchestra.run.smithi120.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-13T05:07:11.937 INFO:teuthology.orchestra.run.smithi120.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-13T05:07:11.996 INFO:teuthology.orchestra.run.smithi120.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-13T05:07:11.997 INFO:teuthology.orchestra.run.smithi120.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-13T05:07:12.081 INFO:teuthology.orchestra.run.smithi120.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-13T05:07:12.087 INFO:teuthology.orchestra.run.smithi120.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-13T05:07:12.090 INFO:teuthology.orchestra.run.smithi120.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-13T05:07:12.094 INFO:teuthology.orchestra.run.smithi120.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-13T05:07:12.094 INFO:teuthology.orchestra.run.smithi120.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-13T05:07:12.097 INFO:teuthology.orchestra.run.smithi120.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-13T05:07:12.099 INFO:teuthology.orchestra.run.smithi120.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-13T05:07:12.193 INFO:teuthology.orchestra.run.smithi120.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-13T05:07:12.260 INFO:teuthology.orchestra.run.smithi120.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.4-820-g48a7de7e-1focal [9,612 kB] 2024-09-13T05:07:12.260 INFO:teuthology.orchestra.run.smithi120.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-09-13T05:07:12.264 INFO:teuthology.orchestra.run.smithi120.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-13T05:07:12.413 INFO:teuthology.orchestra.run.smithi120.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-13T05:07:12.415 INFO:teuthology.orchestra.run.smithi120.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-13T05:07:12.415 INFO:teuthology.orchestra.run.smithi120.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-13T05:07:12.416 INFO:teuthology.orchestra.run.smithi120.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-13T05:07:12.447 INFO:teuthology.orchestra.run.smithi120.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T05:07:12.447 INFO:teuthology.orchestra.run.smithi120.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-13T05:07:12.449 INFO:teuthology.orchestra.run.smithi120.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-13T05:07:12.449 INFO:teuthology.orchestra.run.smithi120.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-13T05:07:12.450 INFO:teuthology.orchestra.run.smithi120.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-13T05:07:12.497 INFO:teuthology.orchestra.run.smithi137.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.4-820-g48a7de7e-1focal [13.8 kB] 2024-09-13T05:07:12.497 INFO:teuthology.orchestra.run.smithi137.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.4-820-g48a7de7e-1focal [855 kB] 2024-09-13T05:07:12.502 INFO:teuthology.orchestra.run.smithi120.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.4-820-g48a7de7e-1focal [238 kB] 2024-09-13T05:07:12.505 INFO:teuthology.orchestra.run.smithi120.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.4-820-g48a7de7e-1focal [148 kB] 2024-09-13T05:07:12.507 INFO:teuthology.orchestra.run.smithi120.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.4-820-g48a7de7e-1focal [1,575 kB] 2024-09-13T05:07:12.510 INFO:teuthology.orchestra.run.smithi137.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.4-820-g48a7de7e-1focal [2,295 kB] 2024-09-13T05:07:12.526 INFO:teuthology.orchestra.run.smithi137.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.4-820-g48a7de7e-1focal [238 kB] 2024-09-13T05:07:12.528 INFO:teuthology.orchestra.run.smithi137.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.4-820-g48a7de7e-1focal [143 kB] 2024-09-13T05:07:12.529 INFO:teuthology.orchestra.run.smithi137.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.4-820-g48a7de7e-1focal [7,015 kB] 2024-09-13T05:07:12.552 INFO:teuthology.orchestra.run.smithi120.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.4-820-g48a7de7e-1focal [6,640 kB] 2024-09-13T05:07:12.722 INFO:teuthology.orchestra.run.smithi137.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.4-820-g48a7de7e-1focal [7,868 kB] 2024-09-13T05:07:12.812 INFO:teuthology.orchestra.run.smithi120.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.4-820-g48a7de7e-1focal [24.5 MB] 2024-09-13T05:07:12.939 INFO:teuthology.orchestra.run.smithi137.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.4-820-g48a7de7e-1focal [13.9 kB] 2024-09-13T05:07:12.939 INFO:teuthology.orchestra.run.smithi137.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.4-820-g48a7de7e-1focal [46.9 MB] 2024-09-13T05:07:13.859 INFO:teuthology.orchestra.run.smithi120.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.4-820-g48a7de7e-1focal [13.8 kB] 2024-09-13T05:07:13.860 INFO:teuthology.orchestra.run.smithi120.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.4-820-g48a7de7e-1focal [855 kB] 2024-09-13T05:07:13.875 INFO:teuthology.orchestra.run.smithi120.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.4-820-g48a7de7e-1focal [2,295 kB] 2024-09-13T05:07:13.899 INFO:teuthology.orchestra.run.smithi120.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.4-820-g48a7de7e-1focal [238 kB] 2024-09-13T05:07:13.925 INFO:teuthology.orchestra.run.smithi120.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.4-820-g48a7de7e-1focal [143 kB] 2024-09-13T05:07:13.928 INFO:teuthology.orchestra.run.smithi120.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.4-820-g48a7de7e-1focal [7,015 kB] 2024-09-13T05:07:14.218 INFO:teuthology.orchestra.run.smithi120.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.4-820-g48a7de7e-1focal [7,868 kB] 2024-09-13T05:07:14.428 INFO:teuthology.orchestra.run.smithi120.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.4-820-g48a7de7e-1focal [13.9 kB] 2024-09-13T05:07:14.428 INFO:teuthology.orchestra.run.smithi120.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.4-820-g48a7de7e-1focal [46.9 MB] 2024-09-13T05:07:14.457 INFO:teuthology.orchestra.run.smithi137.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.4-820-g48a7de7e-1focal [120 kB] 2024-09-13T05:07:14.460 INFO:teuthology.orchestra.run.smithi137.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.4-820-g48a7de7e-1focal [37.4 kB] 2024-09-13T05:07:14.461 INFO:teuthology.orchestra.run.smithi137.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.4-820-g48a7de7e-1focal [13.5 MB] 2024-09-13T05:07:14.804 INFO:teuthology.orchestra.run.smithi137.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.4-820-g48a7de7e-1focal [107 kB] 2024-09-13T05:07:15.456 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 199 MB in 5s (41.4 MB/s) 2024-09-13T05:07:15.580 INFO:teuthology.orchestra.run.smithi120.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.4-820-g48a7de7e-1focal [120 kB] 2024-09-13T05:07:15.582 INFO:teuthology.orchestra.run.smithi120.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.4-820-g48a7de7e-1focal [37.4 kB] 2024-09-13T05:07:15.583 INFO:teuthology.orchestra.run.smithi120.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.4-820-g48a7de7e-1focal [13.5 MB] 2024-09-13T05:07:15.593 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-13T05:07:15.648 INFO:teuthology.orchestra.run.smithi137.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141720 files and directories currently installed.) 2024-09-13T05:07:15.652 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-13T05:07:15.750 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T05:07:15.759 INFO:teuthology.orchestra.run.smithi120.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.4-820-g48a7de7e-1focal [107 kB] 2024-09-13T05:07:16.095 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T05:07:16.111 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-13T05:07:16.153 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T05:07:16.408 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 199 MB in 6s (34.6 MB/s) 2024-09-13T05:07:16.514 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T05:07:16.531 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-13T05:07:16.572 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T05:07:16.581 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-13T05:07:16.637 INFO:teuthology.orchestra.run.smithi120.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141720 files and directories currently installed.) 2024-09-13T05:07:16.641 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-13T05:07:16.723 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T05:07:17.009 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T05:07:17.029 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T05:07:17.058 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T05:07:17.075 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-13T05:07:17.078 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T05:07:17.117 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T05:07:17.461 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T05:07:17.479 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-13T05:07:17.511 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T05:07:17.570 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T05:07:17.588 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T05:07:17.653 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T05:07:17.965 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T05:07:17.973 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T05:07:17.983 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T05:07:17.991 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T05:07:18.023 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T05:07:18.034 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T05:07:18.410 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-13T05:07:18.429 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-13T05:07:18.468 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T05:07:18.535 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T05:07:18.552 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T05:07:18.593 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T05:07:18.837 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../007-librbd1_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:18.988 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librbd1 (18.2.4-820-g48a7de7e-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T05:07:18.997 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T05:07:19.013 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T05:07:19.047 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T05:07:19.467 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-13T05:07:19.484 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-13T05:07:19.525 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T05:07:19.645 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../008-librados2_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:19.742 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librados2 (18.2.4-820-g48a7de7e-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T05:07:19.886 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../007-librbd1_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:20.054 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librbd1 (18.2.4-820-g48a7de7e-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T05:07:20.454 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T05:07:20.473 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../009-libcephfs2_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:20.512 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libcephfs2 (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:20.774 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../008-librados2_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:20.882 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rados. 2024-09-13T05:07:20.897 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../010-python3-rados_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:20.900 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librados2 (18.2.4-820-g48a7de7e-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T05:07:20.940 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rados (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:21.276 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T05:07:21.292 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.4-820-g48a7de7e-1focal_all.deb ... 2024-09-13T05:07:21.351 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-ceph-argparse (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:21.562 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T05:07:21.577 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../012-python3-cephfs_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:21.611 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cephfs (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:21.663 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T05:07:21.680 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../009-libcephfs2_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:21.721 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libcephfs2 (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:21.923 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T05:07:21.942 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.4-820-g48a7de7e-1focal_all.deb ... 2024-09-13T05:07:22.006 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-ceph-common (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:22.066 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rados. 2024-09-13T05:07:22.085 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../010-python3-rados_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:22.124 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rados (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:22.326 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T05:07:22.343 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2024-09-13T05:07:22.384 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-13T05:07:22.469 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T05:07:22.484 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.4-820-g48a7de7e-1focal_all.deb ... 2024-09-13T05:07:22.527 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-ceph-argparse (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:22.669 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T05:07:22.686 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../015-python3-rbd_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:22.728 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rbd (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:22.831 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T05:07:22.845 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../012-python3-cephfs_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:22.888 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cephfs (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:23.039 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-13T05:07:23.055 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-13T05:07:23.089 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T05:07:23.241 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T05:07:23.259 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.4-820-g48a7de7e-1focal_all.deb ... 2024-09-13T05:07:23.299 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-ceph-common (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:23.467 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-13T05:07:23.483 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-13T05:07:23.525 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T05:07:23.611 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T05:07:23.630 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2024-09-13T05:07:23.669 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-13T05:07:23.894 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T05:07:23.911 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-13T05:07:23.953 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T05:07:23.964 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T05:07:23.981 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../015-python3-rbd_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:24.022 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rbd (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:24.297 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librgw2. 2024-09-13T05:07:24.315 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../019-librgw2_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:24.357 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librgw2 (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:24.367 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-13T05:07:24.384 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-13T05:07:24.425 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T05:07:24.769 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-13T05:07:24.785 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-13T05:07:24.819 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T05:07:25.165 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T05:07:25.183 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-13T05:07:25.223 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T05:07:25.225 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T05:07:25.242 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../020-python3-rgw_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:25.275 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rgw (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:25.551 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librgw2. 2024-09-13T05:07:25.570 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../019-librgw2_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:25.609 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librgw2 (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:25.610 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liboath0. 2024-09-13T05:07:25.627 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-13T05:07:25.694 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-13T05:07:25.996 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T05:07:26.014 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../022-libradosstriper1_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:26.055 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libradosstriper1 (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:26.492 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-common. 2024-09-13T05:07:26.507 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../023-ceph-common_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:26.537 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T05:07:26.541 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-common (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:26.554 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../020-python3-rgw_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:26.587 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rgw (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:26.940 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package liboath0. 2024-09-13T05:07:26.957 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-13T05:07:26.998 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-13T05:07:27.343 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T05:07:27.362 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../022-libradosstriper1_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:27.401 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libradosstriper1 (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:27.880 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-common. 2024-09-13T05:07:27.898 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../023-ceph-common_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:27.930 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-common (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:28.997 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-base. 2024-09-13T05:07:29.014 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../024-ceph-base_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:29.067 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-base (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:30.428 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T05:07:30.446 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-13T05:07:30.460 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-base. 2024-09-13T05:07:30.477 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../024-ceph-base_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:30.520 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-13T05:07:30.529 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-base (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:30.890 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T05:07:30.907 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2024-09-13T05:07:30.948 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-13T05:07:31.276 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T05:07:31.292 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2024-09-13T05:07:31.359 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-13T05:07:31.645 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T05:07:31.661 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-13T05:07:31.703 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-13T05:07:31.799 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T05:07:31.815 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-13T05:07:31.857 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-13T05:07:32.023 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-mako. 2024-09-13T05:07:32.040 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-13T05:07:32.081 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T05:07:32.208 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T05:07:32.227 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2024-09-13T05:07:32.269 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-13T05:07:32.410 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T05:07:32.425 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T05:07:32.468 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T05:07:32.564 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T05:07:32.580 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2024-09-13T05:07:32.614 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-13T05:07:32.796 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T05:07:32.811 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-13T05:07:32.854 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T05:07:32.875 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T05:07:32.891 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-13T05:07:32.925 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-13T05:07:33.140 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-webob. 2024-09-13T05:07:33.156 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-13T05:07:33.198 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T05:07:33.228 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-mako. 2024-09-13T05:07:33.247 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-13T05:07:33.286 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T05:07:33.526 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-13T05:07:33.546 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-13T05:07:33.584 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T05:07:33.665 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T05:07:33.683 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T05:07:33.715 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T05:07:33.895 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-bs4. 2024-09-13T05:07:33.914 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2024-09-13T05:07:33.953 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-13T05:07:34.018 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T05:07:34.038 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-13T05:07:34.076 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T05:07:34.298 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T05:07:34.318 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-13T05:07:34.359 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T05:07:34.387 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-webob. 2024-09-13T05:07:34.406 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-13T05:07:34.446 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T05:07:34.710 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T05:07:34.727 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2024-09-13T05:07:34.768 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-13T05:07:34.791 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-13T05:07:34.806 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-13T05:07:34.849 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T05:07:35.054 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-paste. 2024-09-13T05:07:35.074 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-13T05:07:35.101 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-bs4. 2024-09-13T05:07:35.119 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2024-09-13T05:07:35.129 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T05:07:35.152 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-13T05:07:35.424 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T05:07:35.442 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-13T05:07:35.482 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T05:07:35.522 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T05:07:35.541 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-13T05:07:35.583 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T05:07:35.815 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T05:07:35.831 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-13T05:07:35.874 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-13T05:07:35.883 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T05:07:35.902 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2024-09-13T05:07:35.941 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-13T05:07:36.177 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T05:07:36.197 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2024-09-13T05:07:36.235 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-13T05:07:36.270 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-paste. 2024-09-13T05:07:36.285 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-13T05:07:36.328 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T05:07:36.580 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T05:07:36.596 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-13T05:07:36.631 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T05:07:36.638 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T05:07:36.647 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-13T05:07:36.715 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T05:07:37.009 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T05:07:37.017 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T05:07:37.025 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-13T05:07:37.033 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-13T05:07:37.067 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T05:07:37.076 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-13T05:07:37.387 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T05:07:37.403 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.4-820-g48a7de7e-1focal_all.deb ... 2024-09-13T05:07:37.404 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T05:07:37.420 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2024-09-13T05:07:37.445 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-modules-core (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:37.462 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-13T05:07:37.774 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T05:07:37.789 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-13T05:07:37.832 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T05:07:37.876 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T05:07:37.892 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:37.934 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:38.195 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T05:07:38.214 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-13T05:07:38.246 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T05:07:38.278 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T05:07:38.294 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../045-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-13T05:07:38.336 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T05:07:38.532 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T05:07:38.548 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.4-820-g48a7de7e-1focal_all.deb ... 2024-09-13T05:07:38.615 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-modules-core (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:38.618 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cryptography. 2024-09-13T05:07:38.637 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../046-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-13T05:07:38.676 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T05:07:38.996 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T05:07:39.012 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:39.054 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:39.072 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T05:07:39.088 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../047-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-13T05:07:39.146 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-13T05:07:39.409 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T05:07:39.427 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../045-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-13T05:07:39.468 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T05:07:39.523 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T05:07:39.540 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../048-ceph-mgr_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:39.581 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:39.771 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cryptography. 2024-09-13T05:07:39.788 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../046-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-13T05:07:39.829 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T05:07:40.102 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T05:07:40.119 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../049-ceph-mon_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:40.160 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mon (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:40.200 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T05:07:40.219 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../047-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-13T05:07:40.258 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-13T05:07:40.628 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T05:07:40.644 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../048-ceph-mgr_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:40.686 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:41.097 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T05:07:41.115 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../050-ceph-osd_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:41.140 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T05:07:41.155 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-osd (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:41.158 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../049-ceph-mon_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:41.198 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mon (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:42.802 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T05:07:42.821 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../050-ceph-osd_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:42.862 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-osd (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:43.625 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph. 2024-09-13T05:07:43.645 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../051-ceph_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:43.692 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:44.044 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T05:07:44.060 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../052-ceph-fuse_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:44.102 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-fuse (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:44.514 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T05:07:44.531 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../053-ceph-mds_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:44.594 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mds (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:45.060 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph. 2024-09-13T05:07:45.076 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../051-ceph_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:45.108 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package cephadm. 2024-09-13T05:07:45.127 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../054-cephadm_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:45.143 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:45.166 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking cephadm (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:45.471 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T05:07:45.487 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../052-ceph-fuse_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:45.519 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T05:07:45.529 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-fuse (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:45.536 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../055-python3-asyncssh_1.12.2-1_all.deb ... 2024-09-13T05:07:45.577 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-09-13T05:07:45.947 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T05:07:45.957 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T05:07:45.963 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-13T05:07:45.973 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../053-ceph-mds_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:46.005 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T05:07:46.006 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mds (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:46.333 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T05:07:46.353 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_18.2.4-820-g48a7de7e-1focal_all.deb ... 2024-09-13T05:07:46.391 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-cephadm (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:46.527 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package cephadm. 2024-09-13T05:07:46.544 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../054-cephadm_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:07:46.585 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking cephadm (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:46.761 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jwt. 2024-09-13T05:07:46.777 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-13T05:07:46.819 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T05:07:46.905 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T05:07:46.920 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../055-python3-asyncssh_1.12.2-1_all.deb ... 2024-09-13T05:07:46.963 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-09-13T05:07:47.114 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-attr. 2024-09-13T05:07:47.133 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2024-09-13T05:07:47.197 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-13T05:07:47.333 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T05:07:47.349 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-13T05:07:47.391 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T05:07:47.525 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T05:07:47.541 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2024-09-13T05:07:47.583 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-13T05:07:47.778 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T05:07:47.794 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_18.2.4-820-g48a7de7e-1focal_all.deb ... 2024-09-13T05:07:47.836 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-cephadm (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:47.894 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-py. 2024-09-13T05:07:47.914 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-13T05:07:47.952 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T05:07:48.190 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jwt. 2024-09-13T05:07:48.205 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-13T05:07:48.248 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T05:07:48.272 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-13T05:07:48.288 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-13T05:07:48.330 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T05:07:48.576 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-attr. 2024-09-13T05:07:48.592 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2024-09-13T05:07:48.634 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-13T05:07:48.710 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-packaging. 2024-09-13T05:07:48.727 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2024-09-13T05:07:48.768 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-13T05:07:48.987 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T05:07:49.007 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2024-09-13T05:07:49.045 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-13T05:07:49.079 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T05:07:49.095 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-13T05:07:49.137 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T05:07:49.357 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-py. 2024-09-13T05:07:49.373 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-13T05:07:49.415 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T05:07:49.448 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T05:07:49.464 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2024-09-13T05:07:49.506 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-13T05:07:49.777 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-13T05:07:49.795 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-13T05:07:49.835 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T05:07:49.851 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T05:07:49.868 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T05:07:49.909 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T05:07:50.105 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-packaging. 2024-09-13T05:07:50.123 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2024-09-13T05:07:50.162 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libjs-underscore. 2024-09-13T05:07:50.163 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-13T05:07:50.180 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-13T05:07:50.220 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T05:07:50.491 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T05:07:50.508 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-13T05:07:50.514 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-13T05:07:50.534 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-13T05:07:50.549 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T05:07:50.572 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T05:07:50.817 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-routes. 2024-09-13T05:07:50.833 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2024-09-13T05:07:50.852 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T05:07:50.866 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-13T05:07:50.869 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2024-09-13T05:07:50.927 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-13T05:07:51.187 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T05:07:51.203 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.4-820-g48a7de7e-1focal_all.deb ... 2024-09-13T05:07:51.236 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-dashboard (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:51.264 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T05:07:51.280 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T05:07:51.322 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T05:07:51.600 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libjs-underscore. 2024-09-13T05:07:51.619 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-13T05:07:51.666 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T05:07:51.944 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-13T05:07:51.962 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-13T05:07:52.002 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T05:07:52.357 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-routes. 2024-09-13T05:07:52.375 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2024-09-13T05:07:52.415 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-13T05:07:52.616 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-decorator. 2024-09-13T05:07:52.633 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-13T05:07:52.675 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T05:07:52.735 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T05:07:52.752 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.4-820-g48a7de7e-1focal_all.deb ... 2024-09-13T05:07:52.817 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-dashboard (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:53.003 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-13T05:07:53.022 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-13T05:07:53.060 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T05:07:53.363 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-scipy. 2024-09-13T05:07:53.383 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-13T05:07:53.421 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-13T05:07:54.241 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-decorator. 2024-09-13T05:07:54.257 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-13T05:07:54.299 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T05:07:54.585 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-13T05:07:54.604 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-13T05:07:54.643 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T05:07:54.739 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-13T05:07:54.758 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-13T05:07:54.805 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T05:07:54.988 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-scipy. 2024-09-13T05:07:55.004 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-13T05:07:55.046 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-13T05:07:55.342 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T05:07:55.362 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2024-09-13T05:07:55.418 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-13T05:07:55.796 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T05:07:55.812 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-13T05:07:55.854 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T05:07:56.406 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-13T05:07:56.424 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-13T05:07:56.464 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T05:07:56.530 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T05:07:56.550 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.4-820-g48a7de7e-1focal_all.deb ... 2024-09-13T05:07:56.613 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:57.018 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T05:07:57.038 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2024-09-13T05:07:57.076 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-13T05:07:57.455 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T05:07:57.472 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-13T05:07:57.512 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T05:07:57.724 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T05:07:57.740 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2024-09-13T05:07:57.782 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-13T05:07:58.119 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T05:07:58.135 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-13T05:07:58.176 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T05:07:58.508 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T05:07:58.525 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-13T05:07:58.567 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T05:07:58.572 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T05:07:58.589 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.4-820-g48a7de7e-1focal_all.deb ... 2024-09-13T05:07:58.630 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:07:59.347 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T05:07:59.364 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2024-09-13T05:07:59.405 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-13T05:07:59.717 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T05:07:59.735 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2024-09-13T05:07:59.775 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-13T05:07:59.800 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T05:07:59.819 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2024-09-13T05:07:59.858 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-13T05:08:00.112 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-blinker. 2024-09-13T05:08:00.129 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-13T05:08:00.171 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T05:08:00.179 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T05:08:00.196 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-13T05:08:00.237 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T05:08:00.499 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-13T05:08:00.516 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-13T05:08:00.557 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T05:08:00.565 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T05:08:00.581 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-13T05:08:00.623 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T05:08:00.892 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T05:08:00.908 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-13T05:08:00.950 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T05:08:01.054 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T05:08:01.072 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2024-09-13T05:08:01.113 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-13T05:08:01.286 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T05:08:01.302 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-13T05:08:01.344 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T05:08:01.434 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T05:08:01.453 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2024-09-13T05:08:01.493 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-13T05:08:01.657 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T05:08:01.673 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-13T05:08:01.739 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T05:08:01.814 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-blinker. 2024-09-13T05:08:01.832 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-13T05:08:01.872 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T05:08:02.162 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-13T05:08:02.178 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-13T05:08:02.229 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T05:08:02.330 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T05:08:02.350 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.4-820-g48a7de7e-1focal_all.deb ... 2024-09-13T05:08:02.379 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:02.591 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T05:08:02.609 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-13T05:08:02.672 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T05:08:02.707 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T05:08:02.724 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2024-09-13T05:08:02.765 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-13T05:08:02.986 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T05:08:03.004 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-13T05:08:03.044 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T05:08:03.143 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T05:08:03.161 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T05:08:03.201 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T05:08:03.372 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T05:08:03.391 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-13T05:08:03.430 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T05:08:03.479 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package jq. 2024-09-13T05:08:03.497 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T05:08:03.537 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T05:08:03.807 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package socat. 2024-09-13T05:08:03.826 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2024-09-13T05:08:03.865 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-13T05:08:03.953 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T05:08:03.972 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.4-820-g48a7de7e-1focal_all.deb ... 2024-09-13T05:08:04.020 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:04.160 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T05:08:04.177 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-13T05:08:04.243 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-13T05:08:04.348 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T05:08:04.365 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2024-09-13T05:08:04.406 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-13T05:08:04.556 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-test. 2024-09-13T05:08:04.572 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../094-ceph-test_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:08:04.613 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-test (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:04.781 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T05:08:04.799 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T05:08:04.831 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T05:08:05.100 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package jq. 2024-09-13T05:08:05.118 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T05:08:05.158 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T05:08:05.420 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package socat. 2024-09-13T05:08:05.437 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2024-09-13T05:08:05.478 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-13T05:08:05.766 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T05:08:05.786 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-13T05:08:05.816 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-13T05:08:06.206 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-test. 2024-09-13T05:08:06.222 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../094-ceph-test_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:08:06.264 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-test (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:08.701 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T05:08:08.717 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../095-ceph-volume_18.2.4-820-g48a7de7e-1focal_all.deb ... 2024-09-13T05:08:08.751 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-volume (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:09.022 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-13T05:08:09.040 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T05:08:09.072 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T05:08:09.553 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T05:08:09.571 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:08:09.611 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libcephfs-dev (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:09.981 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T05:08:09.999 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-13T05:08:10.048 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T05:08:10.372 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T05:08:10.388 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-09-13T05:08:10.430 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-09-13T05:08:10.519 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T05:08:10.536 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../095-ceph-volume_18.2.4-820-g48a7de7e-1focal_all.deb ... 2024-09-13T05:08:10.577 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-volume (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:10.850 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-13T05:08:10.865 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-13T05:08:10.868 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T05:08:10.884 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T05:08:10.908 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T05:08:10.923 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T05:08:11.385 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T05:08:11.403 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:08:11.443 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libcephfs-dev (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:11.855 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T05:08:11.871 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-13T05:08:11.930 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T05:08:12.235 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T05:08:12.251 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-09-13T05:08:12.293 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-09-13T05:08:12.512 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-13T05:08:12.530 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-13T05:08:12.570 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-13T05:08:12.671 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-13T05:08:12.689 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T05:08:12.729 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T05:08:12.898 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-webencodings. 2024-09-13T05:08:12.919 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-13T05:08:12.956 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T05:08:13.284 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-html5lib. 2024-09-13T05:08:13.302 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2024-09-13T05:08:13.342 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-13T05:08:13.670 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-13T05:08:13.687 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-13T05:08:13.744 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T05:08:14.193 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T05:08:14.209 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T05:08:14.250 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T05:08:14.292 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-13T05:08:14.310 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-13T05:08:14.350 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-13T05:08:14.596 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T05:08:14.612 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-13T05:08:14.654 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T05:08:14.703 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-webencodings. 2024-09-13T05:08:14.721 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-13T05:08:14.761 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T05:08:15.007 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T05:08:15.027 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-13T05:08:15.047 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-html5lib. 2024-09-13T05:08:15.065 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T05:08:15.067 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2024-09-13T05:08:15.121 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-13T05:08:15.368 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T05:08:15.387 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-13T05:08:15.426 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T05:08:15.467 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-13T05:08:15.484 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-13T05:08:15.524 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T05:08:15.695 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T05:08:15.715 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-13T05:08:15.745 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T05:08:15.994 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T05:08:16.013 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T05:08:16.052 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T05:08:16.397 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T05:08:16.414 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-13T05:08:16.443 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package radosgw. 2024-09-13T05:08:16.455 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T05:08:16.463 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../110-radosgw_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:08:16.501 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking radosgw (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:16.775 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T05:08:16.796 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-13T05:08:16.833 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T05:08:17.169 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T05:08:17.186 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-13T05:08:17.227 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T05:08:17.505 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T05:08:17.522 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-13T05:08:17.562 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T05:08:17.904 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T05:08:17.922 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../111-rbd-fuse_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:08:17.962 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking rbd-fuse (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:18.286 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package radosgw. 2024-09-13T05:08:18.300 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-13T05:08:18.307 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../110-radosgw_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:08:18.349 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking radosgw (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:18.584 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T05:08:18.735 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T05:08:18.860 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T05:08:19.063 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up cephadm (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:19.598 INFO:teuthology.orchestra.run.smithi137.stdout:Adding system user cephadm....done 2024-09-13T05:08:19.761 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T05:08:19.805 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T05:08:19.822 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../111-rbd-fuse_18.2.4-820-g48a7de7e-1focal_amd64.deb ... 2024-09-13T05:08:19.863 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking rbd-fuse (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:19.912 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T05:08:20.160 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-13T05:08:20.272 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T05:08:20.468 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T05:08:20.573 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T05:08:20.594 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T05:08:20.699 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-13T05:08:20.720 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T05:08:20.825 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T05:08:20.938 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up cephadm (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:21.143 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-13T05:08:21.524 INFO:teuthology.orchestra.run.smithi120.stdout:Adding system user cephadm....done 2024-09-13T05:08:21.579 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T05:08:21.688 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T05:08:21.814 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T05:08:21.872 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-13T05:08:22.165 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T05:08:22.182 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T05:08:22.466 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T05:08:22.466 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T05:08:22.584 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-13T05:08:22.710 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T05:08:22.758 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-ceph-argparse (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:23.034 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T05:08:23.062 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-13T05:08:23.185 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-13T05:08:23.478 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T05:08:23.489 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T05:08:23.762 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T05:08:23.783 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-13T05:08:23.888 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T05:08:24.076 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T05:08:24.256 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-13T05:08:24.352 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T05:08:24.549 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T05:08:24.661 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-ceph-argparse (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:24.825 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T05:08:24.979 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T05:08:25.105 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-13T05:08:25.168 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T05:08:25.406 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T05:08:25.452 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T05:08:25.699 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T05:08:25.770 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-13T05:08:25.825 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T05:08:26.063 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-13T05:08:26.184 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-13T05:08:26.364 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T05:08:26.477 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T05:08:26.490 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T05:08:26.616 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T05:08:26.753 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T05:08:26.892 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T05:08:27.112 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T05:08:27.294 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T05:08:27.396 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T05:08:27.653 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T05:08:27.731 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-13T05:08:28.021 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-13T05:08:28.024 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-13T05:08:28.173 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-ceph-common (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:28.308 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T05:08:28.434 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T05:08:28.508 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T05:08:28.585 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T05:08:28.642 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-13T05:08:29.018 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T05:08:29.144 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-13T05:08:29.219 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T05:08:29.270 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-13T05:08:29.596 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T05:08:29.596 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T05:08:29.973 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T05:08:30.214 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T05:08:30.340 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T05:08:30.361 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-13T05:08:30.466 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T05:08:30.503 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-ceph-common (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:30.801 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T05:08:30.835 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T05:08:30.969 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-13T05:08:31.085 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-13T05:08:31.329 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T05:08:31.386 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T05:08:31.454 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-13T05:08:31.512 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T05:08:31.589 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-13T05:08:31.796 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-13T05:08:31.873 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T05:08:32.114 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T05:08:32.183 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T05:08:32.309 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T05:08:32.424 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T05:08:32.460 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T05:08:32.786 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T05:08:32.797 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-13T05:08:33.034 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-13T05:08:33.087 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-13T05:08:33.185 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T05:08:33.380 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T05:08:33.481 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T05:08:33.495 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-13T05:08:33.740 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-13T05:08:33.854 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T05:08:33.999 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T05:08:34.025 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T05:08:34.125 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T05:08:34.367 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T05:08:34.451 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T05:08:34.736 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-13T05:08:34.764 INFO:teuthology.orchestra.run.smithi120.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-13T05:08:35.028 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-13T05:08:35.154 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T05:08:35.481 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-13T05:08:35.815 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T05:08:35.933 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T05:08:36.059 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T05:08:36.200 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T05:08:36.334 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-13T05:08:36.393 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T05:08:36.686 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-13T05:08:36.694 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-13T05:08:36.995 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-13T05:08:37.288 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T05:08:37.413 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-13T05:08:37.790 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T05:08:38.145 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T05:08:38.158 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-09-13T05:08:38.292 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-13T05:08:38.518 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T05:08:38.677 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-13T05:08:38.844 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T05:08:38.979 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-13T05:08:39.279 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T05:08:39.422 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-13T05:08:39.765 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T05:08:39.891 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T05:08:40.034 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-13T05:08:40.075 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-09-13T05:08:40.143 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T05:08:40.269 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-13T05:08:40.493 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T05:08:40.570 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T05:08:40.721 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-13T05:08:40.819 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T05:08:41.022 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T05:08:41.331 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T05:08:41.650 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T05:08:41.858 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T05:08:41.984 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-13T05:08:42.018 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librados2 (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:42.135 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T05:08:42.136 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-09-13T05:08:42.261 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-13T05:08:42.262 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librgw2 (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:42.388 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libsqlite3-mod-ceph (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:42.562 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T05:08:42.616 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libcephfs2 (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:42.721 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-13T05:08:42.742 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-13T05:08:43.023 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T05:08:43.035 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libradosstriper1 (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:43.153 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-13T05:08:43.299 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T05:08:43.463 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librbd1 (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:43.589 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-modules-core (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:43.642 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T05:08:43.715 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-fuse (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:43.939 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T05:08:43.940 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T05:08:44.010 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librados2 (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:44.136 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-09-13T05:08:44.262 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librgw2 (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:44.392 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libcephfs-dev (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:44.405 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libsqlite3-mod-ceph (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:44.542 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rados (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:44.600 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libcephfs2 (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:44.668 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T05:08:44.759 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-13T05:08:45.052 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libradosstriper1 (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:45.178 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-13T05:08:45.479 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librbd1 (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:45.581 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rbd (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:45.606 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-modules-core (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:45.715 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-fuse (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:45.731 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up rbd-fuse (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:45.858 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rgw (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:45.926 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T05:08:45.926 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T05:08:45.984 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cephfs (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:46.110 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-common (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:46.358 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libcephfs-dev (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:46.459 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rados (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:46.593 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T05:08:46.662 INFO:teuthology.orchestra.run.smithi137.stdout:Adding group ceph....done 2024-09-13T05:08:47.072 INFO:teuthology.orchestra.run.smithi137.stdout:Adding system user ceph....done 2024-09-13T05:08:47.240 INFO:teuthology.orchestra.run.smithi137.stdout:Setting system user ceph properties....done 2024-09-13T05:08:47.260 INFO:teuthology.orchestra.run.smithi137.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T05:08:47.409 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T05:08:47.480 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rbd (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:47.606 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up rbd-fuse (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:47.732 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rgw (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:47.738 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T05:08:47.883 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cephfs (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:47.992 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-common (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:48.211 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-test (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:48.370 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up radosgw (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:48.543 INFO:teuthology.orchestra.run.smithi120.stdout:Adding group ceph....done 2024-09-13T05:08:48.847 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T05:08:48.847 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T05:08:48.930 INFO:teuthology.orchestra.run.smithi120.stdout:Adding system user ceph....done 2024-09-13T05:08:49.097 INFO:teuthology.orchestra.run.smithi120.stdout:Setting system user ceph properties....done 2024-09-13T05:08:49.122 INFO:teuthology.orchestra.run.smithi120.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T05:08:49.278 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T05:08:49.297 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-base (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:49.584 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T05:08:49.681 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T05:08:50.052 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-test (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:50.149 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mds (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:50.161 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up radosgw (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:50.391 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T05:08:50.391 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T05:08:50.609 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T05:08:50.609 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T05:08:50.843 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:51.046 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-base (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:51.066 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T05:08:51.066 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T05:08:51.475 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T05:08:51.637 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-osd (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:51.923 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mds (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:52.122 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T05:08:52.122 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T05:08:52.165 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T05:08:52.165 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T05:08:52.563 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-k8sevents (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:52.591 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:52.664 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:52.815 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mon (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:52.818 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T05:08:52.818 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T05:08:53.039 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T05:08:53.040 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T05:08:53.301 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-osd (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:53.500 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-cephadm (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:53.634 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:53.752 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-dashboard (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:53.767 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T05:08:53.767 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T05:08:53.895 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-volume (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:54.211 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-k8sevents (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:54.297 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T05:08:54.362 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:54.457 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T05:08:54.504 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mon (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:54.742 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T05:08:54.826 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T05:08:54.826 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T05:08:55.274 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-cephadm (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:55.416 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:55.517 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-dashboard (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:55.660 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-volume (18.2.4-820-g48a7de7e-1focal) ... 2024-09-13T05:08:55.996 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T05:08:56.156 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T05:08:56.466 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T05:08:57.587 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-13T05:08:58.217 INFO:teuthology.orchestra.run.smithi137.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T05:08:58.225 DEBUG:teuthology.parallel:result is None 2024-09-13T05:08:59.285 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-13T05:08:59.869 INFO:teuthology.orchestra.run.smithi120.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T05:08:59.873 DEBUG:teuthology.parallel:result is None 2024-09-13T05:08:59.874 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=48a7de7e6e1701a88fd571c7e34908ac4b8ed412 2024-09-13T05:09:00.028 DEBUG:teuthology.orchestra.run.smithi120:> dpkg-query -W -f '${Version}' ceph 2024-09-13T05:09:00.053 INFO:teuthology.orchestra.run.smithi120.stdout:18.2.4-820-g48a7de7e-1focal 2024-09-13T05:09:00.054 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-820-g48a7de7e-1focal 2024-09-13T05:09:00.054 INFO:teuthology.task.install:The correct ceph version 18.2.4-820-g48a7de7e-1focal is installed. 2024-09-13T05:09:00.056 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=48a7de7e6e1701a88fd571c7e34908ac4b8ed412 2024-09-13T05:09:00.199 DEBUG:teuthology.orchestra.run.smithi137:> dpkg-query -W -f '${Version}' ceph 2024-09-13T05:09:00.222 INFO:teuthology.orchestra.run.smithi137.stdout:18.2.4-820-g48a7de7e-1focal 2024-09-13T05:09:00.223 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-820-g48a7de7e-1focal 2024-09-13T05:09:00.223 INFO:teuthology.task.install:The correct ceph version 18.2.4-820-g48a7de7e-1focal is installed. 2024-09-13T05:09:00.225 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T05:09:00.225 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T05:09:00.225 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T05:09:00.242 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-13T05:09:00.242 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T05:09:00.280 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T05:09:00.280 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T05:09:00.280 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T05:09:00.295 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T05:09:00.351 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-13T05:09:00.351 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T05:09:00.367 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T05:09:00.377 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T05:09:00.377 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T05:09:00.377 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T05:09:00.391 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T05:09:00.403 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-13T05:09:00.403 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T05:09:00.436 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T05:09:00.445 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T05:09:00.445 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T05:09:00.446 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T05:09:00.461 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T05:09:00.519 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-13T05:09:00.519 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T05:09:00.535 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T05:09:00.590 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T05:09:00.670 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T05:09:00.670 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 777 /var/log/ceph 2024-09-13T05:09:00.672 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 777 /var/log/ceph 2024-09-13T05:09:00.688 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T05:09:00.689 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T05:09:00.730 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T05:09:00.745 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T05:09:00.745 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T05:09:00.747 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T05:09:00.811 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T05:09:00.811 INFO:tasks.ceph:config {'conf': {'client': {'rbd cache': True, 'rbd clone copy on read': True}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T05:09:00.811 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900849', 'branch': 'reef', 'description': 'rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/rbd_fsx_copy_on_read}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7900849', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client': {'rbd cache': True, 'rbd clone copy on read': True}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '48a7de7e6e1701a88fd571c7e34908ac4b8ed412'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '48a7de7e6e1701a88fd571c7e34908ac4b8ed412'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7a853b1706d076d58e0da7a5d3b9b9eb36276880'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 248, 'sha1': '48a7de7e6e1701a88fd571c7e34908ac4b8ed412', 'sleep_before_teardown': 0, 'subset': '116/128', 'suite': 'rbd', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_7a853b1706d076d58e0da7a5d3b9b9eb36276880/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '7a853b1706d076d58e0da7a5d3b9b9eb36276880', 'targets': {'smithi120.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi137.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'thrashosds': {'timeout': 1200}}, {'rbd_fsx': {'clients': ['client.0'], 'ops': 6000}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_22:16:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T05:09:00.812 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T05:09:00.814 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T05:09:00.821 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T05:09:00.862 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T05:09:00.879 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T05:09:00.879 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T05:09:00.883 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T05:09:00.883 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_1 2024-09-13T05:09:00.889 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T05:09:00.889 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T05:09:00.889 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 6h/6d Inode: 370 Links: 1 2024-09-13T05:09:00.889 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T05:09:00.890 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-13 05:05:32.889054012 +0000 2024-09-13T05:09:00.890 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-13 05:05:32.885054103 +0000 2024-09-13T05:09:00.890 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-13 05:05:32.885054103 +0000 2024-09-13T05:09:00.890 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2024-09-13T05:09:00.890 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T05:09:00.947 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-13T05:09:00.947 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-13T05:09:00.947 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000431457 s, 1.2 MB/s 2024-09-13T05:09:00.948 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T05:09:00.955 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_2 2024-09-13T05:09:00.961 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T05:09:00.961 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T05:09:00.961 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 6h/6d Inode: 376 Links: 1 2024-09-13T05:09:00.961 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T05:09:00.961 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-13 05:05:33.497039997 +0000 2024-09-13T05:09:00.961 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-13 05:05:33.281044976 +0000 2024-09-13T05:09:00.962 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-13 05:05:33.281044976 +0000 2024-09-13T05:09:00.962 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2024-09-13T05:09:00.962 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T05:09:00.973 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-13T05:09:00.973 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-13T05:09:00.973 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000398514 s, 1.3 MB/s 2024-09-13T05:09:00.974 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T05:09:01.025 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_3 2024-09-13T05:09:01.032 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T05:09:01.032 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T05:09:01.032 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 6h/6d Inode: 381 Links: 1 2024-09-13T05:09:01.032 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T05:09:01.032 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-13 05:05:33.957029394 +0000 2024-09-13T05:09:01.032 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-13 05:05:33.757034004 +0000 2024-09-13T05:09:01.032 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-13 05:05:33.757034004 +0000 2024-09-13T05:09:01.032 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2024-09-13T05:09:01.032 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T05:09:01.044 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-13T05:09:01.044 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-13T05:09:01.044 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000411344 s, 1.2 MB/s 2024-09-13T05:09:01.045 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T05:09:01.097 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_4 2024-09-13T05:09:01.105 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T05:09:01.105 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T05:09:01.105 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 6h/6d Inode: 387 Links: 1 2024-09-13T05:09:01.105 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T05:09:01.105 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-13 05:05:34.381019622 +0000 2024-09-13T05:09:01.105 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-13 05:05:34.169024507 +0000 2024-09-13T05:09:01.105 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-13 05:05:34.169024507 +0000 2024-09-13T05:09:01.105 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2024-09-13T05:09:01.105 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T05:09:01.116 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-13T05:09:01.116 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-13T05:09:01.116 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000382537 s, 1.3 MB/s 2024-09-13T05:09:01.117 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T05:09:01.125 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T05:09:01.125 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-13T05:09:01.125 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T05:09:01.132 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T05:09:01.132 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_1 2024-09-13T05:09:01.139 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T05:09:01.140 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T05:09:01.140 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 368 Links: 1 2024-09-13T05:09:01.140 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T05:09:01.140 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-13 05:05:33.076471724 +0000 2024-09-13T05:09:01.140 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-13 05:05:32.912475498 +0000 2024-09-13T05:09:01.140 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-13 05:05:32.912475498 +0000 2024-09-13T05:09:01.140 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2024-09-13T05:09:01.140 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T05:09:01.192 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-13T05:09:01.192 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-13T05:09:01.193 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000329203 s, 1.6 MB/s 2024-09-13T05:09:01.194 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T05:09:01.202 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_2 2024-09-13T05:09:01.208 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T05:09:01.208 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T05:09:01.208 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 375 Links: 1 2024-09-13T05:09:01.208 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T05:09:01.208 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-13 05:05:33.292466753 +0000 2024-09-13T05:09:01.208 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-13 05:05:33.288466845 +0000 2024-09-13T05:09:01.209 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-13 05:05:33.288466845 +0000 2024-09-13T05:09:01.209 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2024-09-13T05:09:01.209 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T05:09:01.264 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-13T05:09:01.265 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-13T05:09:01.265 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000396225 s, 1.3 MB/s 2024-09-13T05:09:01.266 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T05:09:01.275 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_3 2024-09-13T05:09:01.281 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T05:09:01.281 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T05:09:01.281 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 381 Links: 1 2024-09-13T05:09:01.281 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T05:09:01.281 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-13 05:05:33.888453037 +0000 2024-09-13T05:09:01.281 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-13 05:05:33.704457271 +0000 2024-09-13T05:09:01.281 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-13 05:05:33.704457271 +0000 2024-09-13T05:09:01.281 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2024-09-13T05:09:01.281 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T05:09:01.336 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-13T05:09:01.337 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-13T05:09:01.337 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000392592 s, 1.3 MB/s 2024-09-13T05:09:01.338 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T05:09:01.347 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_4 2024-09-13T05:09:01.353 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T05:09:01.353 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T05:09:01.353 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 388 Links: 1 2024-09-13T05:09:01.353 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T05:09:01.353 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-13 05:05:34.304443465 +0000 2024-09-13T05:09:01.353 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-13 05:05:34.104448067 +0000 2024-09-13T05:09:01.354 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-13 05:05:34.104448067 +0000 2024-09-13T05:09:01.354 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2024-09-13T05:09:01.354 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T05:09:01.408 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-13T05:09:01.409 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-13T05:09:01.409 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.00035183 s, 1.5 MB/s 2024-09-13T05:09:01.410 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T05:09:01.419 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T05:09:01.419 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T05:09:01.419 INFO:tasks.ceph:Generating config... 2024-09-13T05:09:01.420 INFO:tasks.ceph:[client] rbd cache = True 2024-09-13T05:09:01.420 INFO:tasks.ceph:[client] rbd clone copy on read = True 2024-09-13T05:09:01.420 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-13T05:09:01.420 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-13T05:09:01.420 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-13T05:09:01.421 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T05:09:01.421 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T05:09:01.421 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T05:09:01.421 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T05:09:01.421 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T05:09:01.421 INFO:tasks.ceph:[osd] bluefs allocator = hybrid 2024-09-13T05:09:01.421 INFO:tasks.ceph:[osd] bluestore allocator = hybrid 2024-09-13T05:09:01.421 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T05:09:01.421 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T05:09:01.421 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-13T05:09:01.421 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-13T05:09:01.421 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T05:09:01.421 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T05:09:01.421 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-13T05:09:01.422 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T05:09:01.422 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T05:09:01.422 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T05:09:01.422 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-13T05:09:01.422 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T05:09:01.422 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-13T05:09:01.422 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T05:09:01.422 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-13T05:09:01.422 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T05:09:01.422 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T05:09:01.463 INFO:teuthology.orchestra.run.smithi120.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T05:09:01.473 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T05:09:01.510 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T05:09:01.524 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.120'), ('mon.c', '[v2:172.21.15.120:3301,v1:172.21.15.120:6790]'), ('mon.b', '172.21.15.137')] 2024-09-13T05:09:01.525 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.120,[v2:172.21.15.120:3301,v1:172.21.15.120:6790],172.21.15.137', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd cache': True, 'rbd clone copy on read': True}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-13T05:09:01.525 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T05:09:01.525 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T05:09:01.571 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.120 --addv c '[v2:172.21.15.120:3301,v1:172.21.15.120:6790]' --add b 172.21.15.137 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T05:09:01.615 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T05:09:01.615 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: generated fsid 0a3759da-62bd-4704-8a4a-7c20eb3fc816 2024-09-13T05:09:01.615 INFO:teuthology.orchestra.run.smithi120.stdout:setting min_mon_release = pacific 2024-09-13T05:09:01.615 INFO:teuthology.orchestra.run.smithi120.stdout:epoch 0 2024-09-13T05:09:01.615 INFO:teuthology.orchestra.run.smithi120.stdout:fsid 0a3759da-62bd-4704-8a4a-7c20eb3fc816 2024-09-13T05:09:01.615 INFO:teuthology.orchestra.run.smithi120.stdout:last_changed 2024-09-13T05:09:01.615097+0000 2024-09-13T05:09:01.615 INFO:teuthology.orchestra.run.smithi120.stdout:created 2024-09-13T05:09:01.615097+0000 2024-09-13T05:09:01.616 INFO:teuthology.orchestra.run.smithi120.stdout:min_mon_release 16 (pacific) 2024-09-13T05:09:01.616 INFO:teuthology.orchestra.run.smithi120.stdout:election_strategy: 1 2024-09-13T05:09:01.616 INFO:teuthology.orchestra.run.smithi120.stdout:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-13T05:09:01.616 INFO:teuthology.orchestra.run.smithi120.stdout:1: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.b 2024-09-13T05:09:01.616 INFO:teuthology.orchestra.run.smithi120.stdout:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-13T05:09:01.616 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-13T05:09:01.617 DEBUG:teuthology.orchestra.run.smithi120:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T05:09:01.622 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0a3759da-62bd-4704-8a4a-7c20eb3fc816... 2024-09-13T05:09:01.623 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T05:09:01.625 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T05:09:01.654 INFO:teuthology.orchestra.run.smithi120.stdout:[global] 2024-09-13T05:09:01.654 INFO:teuthology.orchestra.run.smithi120.stdout: chdir = "" 2024-09-13T05:09:01.654 INFO:teuthology.orchestra.run.smithi120.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T05:09:01.654 INFO:teuthology.orchestra.run.smithi120.stdout: auth supported = cephx 2024-09-13T05:09:01.654 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.654 INFO:teuthology.orchestra.run.smithi120.stdout: filestore xattr use omap = true 2024-09-13T05:09:01.654 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.654 INFO:teuthology.orchestra.run.smithi120.stdout: mon clock drift allowed = 1.000 2024-09-13T05:09:01.654 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.654 INFO:teuthology.orchestra.run.smithi120.stdout: osd crush chooseleaf type = 0 2024-09-13T05:09:01.654 INFO:teuthology.orchestra.run.smithi120.stdout: auth debug = true 2024-09-13T05:09:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on old message = true 2024-09-13T05:09:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on bug = true 2024-09-13T05:09:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T05:09:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: mon pg warn max object skew = 0 2024-09-13T05:09:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T05:09:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T05:09:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default size = 2 2024-09-13T05:09:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow primary affinity = true 2024-09-13T05:09:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow pg remap = true 2024-09-13T05:09:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on legacy crush tunables = false 2024-09-13T05:09:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on crush straw calc version zero = false 2024-09-13T05:09:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on no sortbitwise = false 2024-09-13T05:09:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on osd down out interval zero = false 2024-09-13T05:09:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on too few osds = false 2024-09-13T05:09:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T05:09:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T05:09:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: mon_allow_pool_size_one = true 2024-09-13T05:09:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T05:09:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: osd default data pool replay window = 5 2024-09-13T05:09:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: mon allow pool delete = true 2024-09-13T05:09:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: mon cluster log file level = debug 2024-09-13T05:09:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: debug asserts on shutdown = true 2024-09-13T05:09:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: mon health detail to clog = false 2024-09-13T05:09:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: mon host = "172.21.15.120,[v2:172.21.15.120:3301,v1:172.21.15.120:6790],172.21.15.137" 2024-09-13T05:09:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: mon client directed command retry = 5 2024-09-13T05:09:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on pool no app = False 2024-09-13T05:09:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: ms inject socket failures = 5000 2024-09-13T05:09:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: fsid = 0a3759da-62bd-4704-8a4a-7c20eb3fc816 2024-09-13T05:09:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.657 INFO:teuthology.orchestra.run.smithi120.stdout:[osd] 2024-09-13T05:09:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: osd journal size = 100 2024-09-13T05:09:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub load threshold = 5.0 2024-09-13T05:09:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub max interval = 600 2024-09-13T05:09:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: osd mclock profile = high_recovery_ops 2024-09-13T05:09:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: osd recover clone overlap = true 2024-09-13T05:09:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: osd recovery max chunk = 1048576 2024-09-13T05:09:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug shutdown = true 2024-09-13T05:09:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug op order = true 2024-09-13T05:09:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug verify stray on activate = true 2024-09-13T05:09:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: osd open classes on start = true 2024-09-13T05:09:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug pg log writeout = true 2024-09-13T05:09:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: osd deep scrub update digest min age = 30 2024-09-13T05:09:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: osd map max advance = 10 2024-09-13T05:09:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: journal zero on create = true 2024-09-13T05:09:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: filestore ondisk finisher threads = 3 2024-09-13T05:09:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: filestore apply finisher threads = 3 2024-09-13T05:09:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: bdev debug aio = true 2024-09-13T05:09:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug misdirected ops = true 2024-09-13T05:09:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: bluefs allocator = hybrid 2024-09-13T05:09:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore allocator = hybrid 2024-09-13T05:09:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore block size = 96636764160 2024-09-13T05:09:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore fsck on mount = True 2024-09-13T05:09:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluefs = 1/20 2024-09-13T05:09:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluestore = 1/20 2024-09-13T05:09:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-13T05:09:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: debug osd = 20 2024-09-13T05:09:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: debug rocksdb = 4/10 2024-09-13T05:09:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T05:09:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd full ratio = 0.9 2024-09-13T05:09:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd nearfull ratio = 0.8 2024-09-13T05:09:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: osd blocked scrub grace period = 3600 2024-09-13T05:09:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: osd failsafe full ratio = 0.95 2024-09-13T05:09:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: osd max markdown count = 1000 2024-09-13T05:09:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: osd objectstore = bluestore 2024-09-13T05:09:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: osd shutdown pgref assert = True 2024-09-13T05:09:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.661 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr] 2024-09-13T05:09:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-13T05:09:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: debug mgr = 20 2024-09-13T05:09:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2024-09-13T05:09:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2024-09-13T05:09:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2024-09-13T05:09:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2024-09-13T05:09:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: mgr/telemetry/nag = false 2024-09-13T05:09:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.662 INFO:teuthology.orchestra.run.smithi120.stdout:[mon] 2024-09-13T05:09:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-13T05:09:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2024-09-13T05:09:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: debug paxos = 20 2024-09-13T05:09:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2024-09-13T05:09:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: mon data avail warn = 5 2024-09-13T05:09:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: mon mgr mkfs grace = 240 2024-09-13T05:09:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2024-09-13T05:09:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd reporter subtree level = osd 2024-09-13T05:09:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd prime pg temp = true 2024-09-13T05:09:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2024-09-13T05:09:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T05:09:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T05:09:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T05:09:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T05:09:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T05:09:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T05:09:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: # 1m isn't quite enough 2024-09-13T05:09:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: mon_down_mkfs_grace = 2m 2024-09-13T05:09:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_filestore_osds = false 2024-09-13T05:09:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:01.663 INFO:teuthology.orchestra.run.smithi120.stdout:[client] 2024-09-13T05:09:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: rgw cache enabled = true 2024-09-13T05:09:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable ops log = true 2024-09-13T05:09:01.664 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable usage log = true 2024-09-13T05:09:01.664 INFO:teuthology.orchestra.run.smithi120.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T05:09:01.664 INFO:teuthology.orchestra.run.smithi120.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T05:09:01.664 INFO:teuthology.orchestra.run.smithi120.stdout: rbd cache = True 2024-09-13T05:09:01.664 INFO:teuthology.orchestra.run.smithi120.stdout: rbd clone copy on read = True 2024-09-13T05:09:01.664 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.a] 2024-09-13T05:09:01.664 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.c] 2024-09-13T05:09:01.664 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.b] 2024-09-13T05:09:01.665 INFO:teuthology.orchestra.run.smithi137.stdout:[global] 2024-09-13T05:09:01.665 INFO:teuthology.orchestra.run.smithi137.stdout: chdir = "" 2024-09-13T05:09:01.665 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T05:09:01.665 INFO:teuthology.orchestra.run.smithi137.stdout: auth supported = cephx 2024-09-13T05:09:01.665 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.665 INFO:teuthology.orchestra.run.smithi137.stdout: filestore xattr use omap = true 2024-09-13T05:09:01.665 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.665 INFO:teuthology.orchestra.run.smithi137.stdout: mon clock drift allowed = 1.000 2024-09-13T05:09:01.665 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.665 INFO:teuthology.orchestra.run.smithi137.stdout: osd crush chooseleaf type = 0 2024-09-13T05:09:01.665 INFO:teuthology.orchestra.run.smithi137.stdout: auth debug = true 2024-09-13T05:09:01.665 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.666 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on old message = true 2024-09-13T05:09:01.666 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on bug = true 2024-09-13T05:09:01.666 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.666 INFO:teuthology.orchestra.run.smithi137.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T05:09:01.666 INFO:teuthology.orchestra.run.smithi137.stdout: mon pg warn max object skew = 0 2024-09-13T05:09:01.666 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.666 INFO:teuthology.orchestra.run.smithi137.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T05:09:01.666 INFO:teuthology.orchestra.run.smithi137.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T05:09:01.666 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.666 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default size = 2 2024-09-13T05:09:01.666 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.666 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow primary affinity = true 2024-09-13T05:09:01.666 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow pg remap = true 2024-09-13T05:09:01.666 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on legacy crush tunables = false 2024-09-13T05:09:01.667 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on crush straw calc version zero = false 2024-09-13T05:09:01.667 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on no sortbitwise = false 2024-09-13T05:09:01.667 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on osd down out interval zero = false 2024-09-13T05:09:01.667 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on too few osds = false 2024-09-13T05:09:01.667 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T05:09:01.667 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T05:09:01.667 INFO:teuthology.orchestra.run.smithi137.stdout: mon_allow_pool_size_one = true 2024-09-13T05:09:01.667 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.667 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T05:09:01.667 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.667 INFO:teuthology.orchestra.run.smithi137.stdout: osd default data pool replay window = 5 2024-09-13T05:09:01.667 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.667 INFO:teuthology.orchestra.run.smithi137.stdout: mon allow pool delete = true 2024-09-13T05:09:01.667 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.667 INFO:teuthology.orchestra.run.smithi137.stdout: mon cluster log file level = debug 2024-09-13T05:09:01.668 INFO:teuthology.orchestra.run.smithi137.stdout: debug asserts on shutdown = true 2024-09-13T05:09:01.668 INFO:teuthology.orchestra.run.smithi137.stdout: mon health detail to clog = false 2024-09-13T05:09:01.668 INFO:teuthology.orchestra.run.smithi137.stdout: mon host = "172.21.15.120,[v2:172.21.15.120:3301,v1:172.21.15.120:6790],172.21.15.137" 2024-09-13T05:09:01.668 INFO:teuthology.orchestra.run.smithi137.stdout: mon client directed command retry = 5 2024-09-13T05:09:01.668 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on pool no app = False 2024-09-13T05:09:01.668 INFO:teuthology.orchestra.run.smithi137.stdout: ms inject socket failures = 5000 2024-09-13T05:09:01.668 INFO:teuthology.orchestra.run.smithi137.stdout: fsid = 0a3759da-62bd-4704-8a4a-7c20eb3fc816 2024-09-13T05:09:01.668 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.668 INFO:teuthology.orchestra.run.smithi137.stdout:[osd] 2024-09-13T05:09:01.668 INFO:teuthology.orchestra.run.smithi137.stdout: osd journal size = 100 2024-09-13T05:09:01.668 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.668 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub load threshold = 5.0 2024-09-13T05:09:01.668 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub max interval = 600 2024-09-13T05:09:01.668 INFO:teuthology.orchestra.run.smithi137.stdout: osd mclock profile = high_recovery_ops 2024-09-13T05:09:01.669 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.669 INFO:teuthology.orchestra.run.smithi137.stdout: osd recover clone overlap = true 2024-09-13T05:09:01.669 INFO:teuthology.orchestra.run.smithi137.stdout: osd recovery max chunk = 1048576 2024-09-13T05:09:01.669 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.669 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug shutdown = true 2024-09-13T05:09:01.669 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug op order = true 2024-09-13T05:09:01.669 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug verify stray on activate = true 2024-09-13T05:09:01.669 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.669 INFO:teuthology.orchestra.run.smithi137.stdout: osd open classes on start = true 2024-09-13T05:09:01.669 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug pg log writeout = true 2024-09-13T05:09:01.669 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.669 INFO:teuthology.orchestra.run.smithi137.stdout: osd deep scrub update digest min age = 30 2024-09-13T05:09:01.669 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.669 INFO:teuthology.orchestra.run.smithi137.stdout: osd map max advance = 10 2024-09-13T05:09:01.670 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.670 INFO:teuthology.orchestra.run.smithi137.stdout: journal zero on create = true 2024-09-13T05:09:01.670 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.670 INFO:teuthology.orchestra.run.smithi137.stdout: filestore ondisk finisher threads = 3 2024-09-13T05:09:01.670 INFO:teuthology.orchestra.run.smithi137.stdout: filestore apply finisher threads = 3 2024-09-13T05:09:01.670 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.670 INFO:teuthology.orchestra.run.smithi137.stdout: bdev debug aio = true 2024-09-13T05:09:01.670 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug misdirected ops = true 2024-09-13T05:09:01.670 INFO:teuthology.orchestra.run.smithi137.stdout: bluefs allocator = hybrid 2024-09-13T05:09:01.670 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore allocator = hybrid 2024-09-13T05:09:01.670 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore block size = 96636764160 2024-09-13T05:09:01.670 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore fsck on mount = True 2024-09-13T05:09:01.670 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluefs = 1/20 2024-09-13T05:09:01.670 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluestore = 1/20 2024-09-13T05:09:01.670 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-09-13T05:09:01.671 INFO:teuthology.orchestra.run.smithi137.stdout: debug osd = 20 2024-09-13T05:09:01.671 INFO:teuthology.orchestra.run.smithi137.stdout: debug rocksdb = 4/10 2024-09-13T05:09:01.671 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T05:09:01.671 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd full ratio = 0.9 2024-09-13T05:09:01.671 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd nearfull ratio = 0.8 2024-09-13T05:09:01.671 INFO:teuthology.orchestra.run.smithi137.stdout: osd blocked scrub grace period = 3600 2024-09-13T05:09:01.671 INFO:teuthology.orchestra.run.smithi137.stdout: osd failsafe full ratio = 0.95 2024-09-13T05:09:01.671 INFO:teuthology.orchestra.run.smithi137.stdout: osd max markdown count = 1000 2024-09-13T05:09:01.671 INFO:teuthology.orchestra.run.smithi137.stdout: osd objectstore = bluestore 2024-09-13T05:09:01.671 INFO:teuthology.orchestra.run.smithi137.stdout: osd shutdown pgref assert = True 2024-09-13T05:09:01.671 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.671 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr] 2024-09-13T05:09:01.671 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-09-13T05:09:01.671 INFO:teuthology.orchestra.run.smithi137.stdout: debug mgr = 20 2024-09-13T05:09:01.672 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-09-13T05:09:01.672 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-09-13T05:09:01.672 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-09-13T05:09:01.672 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-09-13T05:09:01.672 INFO:teuthology.orchestra.run.smithi137.stdout: mgr/telemetry/nag = false 2024-09-13T05:09:01.672 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.672 INFO:teuthology.orchestra.run.smithi137.stdout:[mon] 2024-09-13T05:09:01.672 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-09-13T05:09:01.672 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-09-13T05:09:01.672 INFO:teuthology.orchestra.run.smithi137.stdout: debug paxos = 20 2024-09-13T05:09:01.672 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-09-13T05:09:01.672 INFO:teuthology.orchestra.run.smithi137.stdout: mon data avail warn = 5 2024-09-13T05:09:01.672 INFO:teuthology.orchestra.run.smithi137.stdout: mon mgr mkfs grace = 240 2024-09-13T05:09:01.672 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-09-13T05:09:01.672 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd reporter subtree level = osd 2024-09-13T05:09:01.673 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd prime pg temp = true 2024-09-13T05:09:01.673 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-09-13T05:09:01.673 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.673 INFO:teuthology.orchestra.run.smithi137.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T05:09:01.673 INFO:teuthology.orchestra.run.smithi137.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T05:09:01.673 INFO:teuthology.orchestra.run.smithi137.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T05:09:01.673 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.673 INFO:teuthology.orchestra.run.smithi137.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T05:09:01.673 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T05:09:01.673 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T05:09:01.673 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.673 INFO:teuthology.orchestra.run.smithi137.stdout: # 1m isn't quite enough 2024-09-13T05:09:01.673 INFO:teuthology.orchestra.run.smithi137.stdout: mon_down_mkfs_grace = 2m 2024-09-13T05:09:01.673 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.674 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_filestore_osds = false 2024-09-13T05:09:01.674 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-13T05:09:01.674 INFO:teuthology.orchestra.run.smithi137.stdout:[client] 2024-09-13T05:09:01.674 INFO:teuthology.orchestra.run.smithi137.stdout: rgw cache enabled = true 2024-09-13T05:09:01.674 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable ops log = true 2024-09-13T05:09:01.674 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable usage log = true 2024-09-13T05:09:01.674 INFO:teuthology.orchestra.run.smithi137.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T05:09:01.674 INFO:teuthology.orchestra.run.smithi137.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T05:09:01.674 INFO:teuthology.orchestra.run.smithi137.stdout: rbd cache = True 2024-09-13T05:09:01.674 INFO:teuthology.orchestra.run.smithi137.stdout: rbd clone copy on read = True 2024-09-13T05:09:01.674 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.a] 2024-09-13T05:09:01.674 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.c] 2024-09-13T05:09:01.674 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.b] 2024-09-13T05:09:01.676 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T05:09:01.676 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T05:09:01.731 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T05:09:01.731 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T05:09:01.731 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T05:09:01.736 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T05:09:01.736 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T05:09:01.740 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi120.front.sepia.ceph.com 2024-09-13T05:09:01.740 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T05:09:01.740 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T05:09:01.740 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T05:09:01.765 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T05:09:01.765 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T05:09:01.770 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi137.front.sepia.ceph.com 2024-09-13T05:09:01.770 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-13T05:09:01.770 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T05:09:01.770 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T05:09:01.797 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-13T05:09:01.797 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T05:09:01.802 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T05:09:01.802 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T05:09:01.803 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T05:09:01.850 INFO:teuthology.orchestra.run.smithi120.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T05:09:01.853 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T05:09:01.903 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T05:09:01.919 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T05:09:01.919 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T05:09:01.919 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T05:09:01.960 INFO:teuthology.orchestra.run.smithi120.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T05:09:01.973 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T05:09:02.015 INFO:teuthology.orchestra.run.smithi137.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-13T05:09:02.028 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T05:09:02.028 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T05:09:02.029 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T05:09:02.045 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T05:09:02.045 INFO:tasks.ceph:role: osd.0 2024-09-13T05:09:02.045 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-13T05:09:02.045 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T05:09:02.599 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T05:09:02.599 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T05:09:02.599 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T05:09:02.599 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 2024-09-13T05:09:02.599 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T05:09:02.599 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-09-13T05:09:02.600 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T05:09:02.600 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T05:09:02.600 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T05:09:02.600 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T05:09:02.601 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-09-13T05:09:02.601 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T05:09:02.670 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T05:09:02.682 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T05:09:02.682 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T05:09:02.683 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T05:09:02.694 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T05:09:02.694 INFO:tasks.ceph:role: osd.1 2024-09-13T05:09:02.694 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-13T05:09:02.694 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T05:09:03.230 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T05:09:03.230 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T05:09:03.230 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T05:09:03.230 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 2024-09-13T05:09:03.230 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T05:09:03.230 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-09-13T05:09:03.230 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T05:09:03.230 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T05:09:03.230 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T05:09:03.230 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T05:09:03.232 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-09-13T05:09:03.232 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-13T05:09:03.301 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T05:09:03.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T05:09:03.314 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T05:09:03.314 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T05:09:03.325 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T05:09:03.325 INFO:tasks.ceph:role: osd.2 2024-09-13T05:09:03.325 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-13T05:09:03.325 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T05:09:03.848 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T05:09:03.848 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T05:09:03.848 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T05:09:03.849 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 2024-09-13T05:09:03.849 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T05:09:03.849 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-09-13T05:09:03.849 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T05:09:03.849 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T05:09:03.849 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T05:09:03.849 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T05:09:03.850 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-09-13T05:09:03.850 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-13T05:09:03.907 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T05:09:03.919 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T05:09:03.919 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T05:09:03.920 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T05:09:03.929 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T05:09:03.929 INFO:tasks.ceph:role: osd.3 2024-09-13T05:09:03.930 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-13T05:09:03.930 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T05:09:04.445 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T05:09:04.445 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T05:09:04.445 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T05:09:04.445 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 2024-09-13T05:09:04.445 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T05:09:04.445 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-09-13T05:09:04.445 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T05:09:04.445 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T05:09:04.445 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T05:09:04.445 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T05:09:04.446 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-09-13T05:09:04.447 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-13T05:09:04.507 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T05:09:04.518 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T05:09:04.519 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T05:09:04.519 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T05:09:04.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:09:04.648+0000 7fb3a201f880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T05:09:04.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:09:04.652+0000 7fb3a201f880 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T05:09:04.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:09:04.652+0000 7fb3a201f880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T05:09:04.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:09:04.652+0000 7fb3a201f880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T05:09:04.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:09:04.652+0000 7fb3a201f880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T05:09:04.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:09:04.656+0000 7fb3a201f880 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T05:09:07.697 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T05:09:07.713 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T05:09:07.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:09:07.752+0000 7fd21ce47880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T05:09:07.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:09:07.752+0000 7fd21ce47880 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T05:09:07.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:09:07.752+0000 7fd21ce47880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T05:09:07.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:09:07.752+0000 7fd21ce47880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T05:09:07.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:09:07.752+0000 7fd21ce47880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T05:09:07.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:09:07.752+0000 7fd21ce47880 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T05:09:10.740 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T05:09:10.754 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T05:09:10.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:09:10.836+0000 7feabc658880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T05:09:10.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:09:10.836+0000 7feabc658880 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T05:09:10.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:09:10.836+0000 7feabc658880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T05:09:10.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:09:10.836+0000 7feabc658880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T05:09:10.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:09:10.836+0000 7feabc658880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T05:09:10.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:09:10.840+0000 7feabc658880 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T05:09:13.848 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T05:09:13.861 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T05:09:13.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:09:13.900+0000 7f32456aa880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T05:09:13.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:09:13.900+0000 7f32456aa880 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T05:09:13.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:09:13.900+0000 7f32456aa880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T05:09:13.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:09:13.900+0000 7f32456aa880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T05:09:13.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:09:13.900+0000 7f32456aa880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T05:09:13.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:09:13.900+0000 7f32456aa880 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T05:09:16.884 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T05:09:16.899 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-13T05:09:16.916 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T05:09:16.916 INFO:tasks.ceph:role: osd.4 2024-09-13T05:09:16.916 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-13T05:09:16.917 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T05:09:17.450 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T05:09:17.451 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T05:09:17.451 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T05:09:17.451 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 2024-09-13T05:09:17.451 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T05:09:17.451 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-09-13T05:09:17.451 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T05:09:17.451 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T05:09:17.451 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T05:09:17.451 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T05:09:17.452 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-09-13T05:09:17.453 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-13T05:09:17.552 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-13T05:09:17.565 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T05:09:17.565 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T05:09:17.565 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-13T05:09:17.575 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T05:09:17.575 INFO:tasks.ceph:role: osd.5 2024-09-13T05:09:17.575 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-13T05:09:17.575 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T05:09:18.084 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T05:09:18.084 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T05:09:18.084 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T05:09:18.084 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 2024-09-13T05:09:18.084 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T05:09:18.084 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-09-13T05:09:18.084 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T05:09:18.084 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T05:09:18.084 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T05:09:18.084 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T05:09:18.085 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-09-13T05:09:18.086 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-13T05:09:18.144 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-13T05:09:18.153 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T05:09:18.154 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T05:09:18.154 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-13T05:09:18.170 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T05:09:18.171 INFO:tasks.ceph:role: osd.6 2024-09-13T05:09:18.171 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-13T05:09:18.171 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T05:09:18.644 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T05:09:18.645 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T05:09:18.645 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T05:09:18.645 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 2024-09-13T05:09:18.645 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T05:09:18.645 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-09-13T05:09:18.645 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T05:09:18.646 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T05:09:18.646 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T05:09:18.646 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T05:09:18.647 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-09-13T05:09:18.648 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-13T05:09:18.692 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-13T05:09:18.747 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T05:09:18.748 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T05:09:18.748 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-13T05:09:18.760 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T05:09:18.760 INFO:tasks.ceph:role: osd.7 2024-09-13T05:09:18.760 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-13T05:09:18.761 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T05:09:19.270 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T05:09:19.270 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T05:09:19.270 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T05:09:19.270 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 2024-09-13T05:09:19.270 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T05:09:19.270 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-09-13T05:09:19.270 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T05:09:19.270 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T05:09:19.270 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T05:09:19.270 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T05:09:19.272 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-09-13T05:09:19.272 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-13T05:09:19.333 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-13T05:09:19.344 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T05:09:19.344 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T05:09:19.345 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T05:09:19.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:19.432+0000 7f66284d0880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-13T05:09:19.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:19.436+0000 7f66284d0880 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-13T05:09:19.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:19.436+0000 7f66284d0880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T05:09:19.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:19.436+0000 7f66284d0880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T05:09:19.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:19.436+0000 7f66284d0880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T05:09:19.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:19.440+0000 7f66284d0880 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-13T05:09:22.444 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T05:09:22.461 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T05:09:22.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:22.500+0000 7f457a39e880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-13T05:09:22.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:22.500+0000 7f457a39e880 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-13T05:09:22.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:22.500+0000 7f457a39e880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T05:09:22.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:22.500+0000 7f457a39e880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T05:09:22.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:22.500+0000 7f457a39e880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T05:09:22.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:22.500+0000 7f457a39e880 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-13T05:09:25.496 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T05:09:25.513 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T05:09:25.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:25.600+0000 7ff9d51db880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-13T05:09:25.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:25.600+0000 7ff9d51db880 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-13T05:09:25.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:25.600+0000 7ff9d51db880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T05:09:25.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:25.600+0000 7ff9d51db880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T05:09:25.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:25.600+0000 7ff9d51db880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T05:09:25.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:25.604+0000 7ff9d51db880 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-13T05:09:28.583 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-13T05:09:28.601 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T05:09:28.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:28.644+0000 7f96bd504880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-13T05:09:28.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:28.644+0000 7f96bd504880 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-13T05:09:28.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:28.644+0000 7f96bd504880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T05:09:28.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:28.644+0000 7f96bd504880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T05:09:28.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:28.644+0000 7f96bd504880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T05:09:28.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:28.644+0000 7f96bd504880 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-13T05:09:31.635 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-13T05:09:31.871 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T05:09:31.871 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T05:09:31.871 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-13T05:09:31.889 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T05:09:31.889 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T05:09:31.949 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T05:09:31.949 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T05:09:31.960 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T05:09:31.960 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T05:09:31.972 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T05:09:31.972 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T05:09:32.034 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-13T05:09:32.034 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T05:09:32.051 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-13T05:09:32.051 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-13T05:09:32.063 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-13T05:09:32.064 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-13T05:09:32.075 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-13T05:09:32.075 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-13T05:09:32.130 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-13T05:09:32.130 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-13T05:09:32.144 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T05:09:32.145 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T05:09:32.150 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-13T05:09:32.151 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-13T05:09:32.157 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T05:09:32.157 DEBUG:teuthology.orchestra.run.smithi120:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T05:09:32.159 DEBUG:teuthology.orchestra.run.smithi137:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T05:09:32.203 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr.y] 2024-09-13T05:09:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDtyONm5qWsMhAAFjinIziPkaiZ+FpZFpbyJA== 2024-09-13T05:09:32.203 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.0] 2024-09-13T05:09:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDwyONmKorYJhAAzhuWO8oRvLo2zI+VOwO7rA== 2024-09-13T05:09:32.203 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.1] 2024-09-13T05:09:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDzyONmH7j7LBAAUPmsjcT6wRjdd8GlG59ddg== 2024-09-13T05:09:32.203 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.2] 2024-09-13T05:09:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQD2yONm7scPMhAAyDmxKt5228gdeo8ga/rEJQ== 2024-09-13T05:09:32.203 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.3] 2024-09-13T05:09:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQD5yONmbZrBNRAASaO4pzkJxFMhdpZYWlpeBA== 2024-09-13T05:09:32.204 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr.x] 2024-09-13T05:09:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDtyONmza/cNRAAlx1tkkqBZ6Zqy6kJKKqlcA== 2024-09-13T05:09:32.204 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.4] 2024-09-13T05:09:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQD/yONmeMXSGRAAq/38mEniT9wHrBHGweKQ+Q== 2024-09-13T05:09:32.204 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.5] 2024-09-13T05:09:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQACyeNmc3PrHRAApquDT3juGpkvUPwzD8RbWg== 2024-09-13T05:09:32.204 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.6] 2024-09-13T05:09:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQAFyeNmog4HJBAAn7S6+WYUSx29OHQx7L2HgQ== 2024-09-13T05:09:32.204 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.7] 2024-09-13T05:09:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQAIyeNm51OJJhAAX7lsPSFeEB6uKETHFcQFCA== 2024-09-13T05:09:32.204 INFO:teuthology.orchestra.run.smithi120.stdout:[client.0] 2024-09-13T05:09:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDtyONmZVlEORAAB++xsbnFyMfwXZK+83AGXw== 2024-09-13T05:09:32.204 INFO:teuthology.orchestra.run.smithi120.stdout:[client.1] 2024-09-13T05:09:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDuyONmsL3yABAAcsPtH5u0MYEFOaInH+lkiA== 2024-09-13T05:09:32.214 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr.y] 2024-09-13T05:09:32.214 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDtyONm5qWsMhAAFjinIziPkaiZ+FpZFpbyJA== 2024-09-13T05:09:32.214 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.0] 2024-09-13T05:09:32.214 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDwyONmKorYJhAAzhuWO8oRvLo2zI+VOwO7rA== 2024-09-13T05:09:32.214 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.1] 2024-09-13T05:09:32.215 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDzyONmH7j7LBAAUPmsjcT6wRjdd8GlG59ddg== 2024-09-13T05:09:32.215 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.2] 2024-09-13T05:09:32.215 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQD2yONm7scPMhAAyDmxKt5228gdeo8ga/rEJQ== 2024-09-13T05:09:32.215 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.3] 2024-09-13T05:09:32.215 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQD5yONmbZrBNRAASaO4pzkJxFMhdpZYWlpeBA== 2024-09-13T05:09:32.215 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr.x] 2024-09-13T05:09:32.215 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDtyONmza/cNRAAlx1tkkqBZ6Zqy6kJKKqlcA== 2024-09-13T05:09:32.215 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.4] 2024-09-13T05:09:32.215 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQD/yONmeMXSGRAAq/38mEniT9wHrBHGweKQ+Q== 2024-09-13T05:09:32.215 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.5] 2024-09-13T05:09:32.215 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQACyeNmc3PrHRAApquDT3juGpkvUPwzD8RbWg== 2024-09-13T05:09:32.215 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.6] 2024-09-13T05:09:32.215 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAFyeNmog4HJBAAn7S6+WYUSx29OHQx7L2HgQ== 2024-09-13T05:09:32.216 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.7] 2024-09-13T05:09:32.216 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAIyeNm51OJJhAAX7lsPSFeEB6uKETHFcQFCA== 2024-09-13T05:09:32.216 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-09-13T05:09:32.216 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDtyONmZVlEORAAB++xsbnFyMfwXZK+83AGXw== 2024-09-13T05:09:32.216 INFO:teuthology.orchestra.run.smithi137.stdout:[client.1] 2024-09-13T05:09:32.216 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDuyONmsL3yABAAcsPtH5u0MYEFOaInH+lkiA== 2024-09-13T05:09:32.217 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T05:09:32.250 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T05:09:32.301 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T05:09:32.303 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T05:09:32.390 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T05:09:32.392 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T05:09:32.463 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T05:09:32.465 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T05:09:32.550 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T05:09:32.553 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T05:09:32.675 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T05:09:32.677 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T05:09:32.729 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T05:09:32.731 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T05:09:32.779 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T05:09:32.781 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T05:09:32.829 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T05:09:32.831 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T05:09:32.876 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T05:09:32.879 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T05:09:32.927 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T05:09:32.929 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T05:09:32.978 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T05:09:32.980 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T05:09:33.033 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T05:09:33.033 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T05:09:33.046 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T05:09:33.139 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T05:09:33.155 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-13T05:09:33.169 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T05:09:33.256 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-13T05:09:33.270 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-13T05:09:33.286 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T05:09:33.426 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-13T05:09:33.443 DEBUG:teuthology.orchestra.run.smithi120:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T05:09:33.446 DEBUG:teuthology.orchestra.run.smithi137:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T05:09:33.450 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T05:09:33.451 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T05:09:33.451 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T05:09:33.494 INFO:tasks.ceph.mon.a:Started 2024-09-13T05:09:33.495 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T05:09:33.495 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T05:09:33.497 INFO:tasks.ceph.mon.c:Started 2024-09-13T05:09:33.497 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T05:09:33.497 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T05:09:33.500 INFO:tasks.ceph.mon.b:Started 2024-09-13T05:09:33.500 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T05:09:33.500 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-13T05:09:33.500 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-13T05:09:33.503 INFO:tasks.ceph.mgr.y:Started 2024-09-13T05:09:33.503 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T05:09:33.503 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T05:09:33.505 INFO:tasks.ceph.mgr.x:Started 2024-09-13T05:09:33.505 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T05:09:33.505 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T05:09:39.100 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:39.096+0000 7fd1984a22c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T05:09:39.724 INFO:teuthology.orchestra.run.smithi120.stderr:adjusted tunables profile to default 2024-09-13T05:09:39.735 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T05:09:39.736 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T05:09:39.736 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T05:09:39.736 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T05:09:39.750 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T05:09:39.750 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T05:09:39.762 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T05:09:39.762 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T05:09:39.771 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T05:09:39.771 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T05:09:39.827 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-13T05:09:39.827 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-13T05:09:39.843 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-13T05:09:39.844 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-13T05:09:39.849 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-09-13T05:09:39.847+0000 7f5ea7a3f2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T05:09:39.886 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:39.884+0000 7fd1984a22c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T05:09:39.900 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-13T05:09:39.900 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-13T05:09:39.908 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-13T05:09:39.908 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-13T05:09:39.918 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new b304ec03-bb00-4b13-bf2d-71017b8a70a3 0 2024-09-13T05:09:39.944 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:39.940+0000 7fd1984a22c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T05:09:40.117 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:40.116+0000 7fd1984a22c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T05:09:40.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-13T05:09:40.264+0000 7fdf5e9ab700 0 --2- 172.21.15.137:0/1611831672 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdf5813e020 0x7fdf581440c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-13T05:09:40.349 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:40.348+0000 7fd1984a22c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T05:09:40.371 INFO:teuthology.orchestra.run.smithi137.stdout:0 2024-09-13T05:09:40.386 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new c09e84f3-3a70-46a4-b67b-c9bb52c887b7 1 2024-09-13T05:09:40.405 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:40.404+0000 7fd1984a22c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T05:09:40.583 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:40.580+0000 7fd1984a22c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T05:09:40.589 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-09-13T05:09:40.600 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-09-13T05:09:40.595+0000 7f5ea7a3f2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T05:09:40.604 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 3c2a0458-369c-4dac-90a3-fb20cb70d53f 2 2024-09-13T05:09:40.648 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:40.644+0000 7fd1984a22c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T05:09:40.658 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-09-13T05:09:40.655+0000 7f5ea7a3f2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T05:09:40.714 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:40.712+0000 7fd1984a22c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T05:09:40.810 INFO:teuthology.orchestra.run.smithi137.stdout:2 2024-09-13T05:09:40.824 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new edce3757-5e9d-4221-a1f1-3f356bb5218b 3 2024-09-13T05:09:40.828 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-09-13T05:09:40.823+0000 7f5ea7a3f2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T05:09:41.030 INFO:teuthology.orchestra.run.smithi137.stdout:3 2024-09-13T05:09:41.044 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 5fe378d2-578f-41ea-980a-4673a8b376df 4 2024-09-13T05:09:41.066 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-09-13T05:09:41.063+0000 7f5ea7a3f2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T05:09:41.114 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:41.112+0000 7fd1984a22c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T05:09:41.120 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-09-13T05:09:41.115+0000 7f5ea7a3f2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T05:09:41.241 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:41.240+0000 7fd1984a22c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T05:09:41.248 INFO:teuthology.orchestra.run.smithi137.stdout:4 2024-09-13T05:09:41.266 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 6e6f7499-ae9e-4cb1-9db7-4d9f8fd9b257 5 2024-09-13T05:09:41.317 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-09-13T05:09:41.315+0000 7f5ea7a3f2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T05:09:41.386 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-09-13T05:09:41.383+0000 7f5ea7a3f2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T05:09:41.455 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-09-13T05:09:41.451+0000 7f5ea7a3f2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T05:09:41.471 INFO:teuthology.orchestra.run.smithi137.stdout:5 2024-09-13T05:09:41.484 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new e4c519e5-5df4-4d55-b12e-fbcfb1b0555c 6 2024-09-13T05:09:41.604 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:41.600+0000 7fd1984a22c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T05:09:41.696 INFO:teuthology.orchestra.run.smithi137.stdout:6 2024-09-13T05:09:41.709 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 914648c2-7a6c-4e66-811d-936e250638db 7 2024-09-13T05:09:41.796 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:41.792+0000 7fd1984a22c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T05:09:41.860 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:41.856+0000 7fd1984a22c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T05:09:41.869 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-09-13T05:09:41.867+0000 7f5ea7a3f2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T05:09:41.904 INFO:teuthology.orchestra.run.smithi137.stdout:7 2024-09-13T05:09:41.917 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T05:09:41.917 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T05:09:41.919 INFO:tasks.ceph.osd.0:Started 2024-09-13T05:09:41.919 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T05:09:41.920 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T05:09:41.922 INFO:tasks.ceph.osd.1:Started 2024-09-13T05:09:41.922 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T05:09:41.922 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T05:09:41.924 INFO:tasks.ceph.osd.2:Started 2024-09-13T05:09:41.924 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T05:09:41.924 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T05:09:41.927 INFO:tasks.ceph.osd.3:Started 2024-09-13T05:09:41.927 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-13T05:09:41.927 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-13T05:09:41.929 INFO:tasks.ceph.osd.4:Started 2024-09-13T05:09:41.929 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-13T05:09:41.929 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-13T05:09:41.931 INFO:tasks.ceph.osd.5:Started 2024-09-13T05:09:41.931 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-13T05:09:41.931 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-13T05:09:41.934 INFO:tasks.ceph.osd.6:Started 2024-09-13T05:09:41.935 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-13T05:09:41.935 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-13T05:09:41.937 INFO:tasks.ceph.osd.7:Started 2024-09-13T05:09:41.937 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T05:09:42.036 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-09-13T05:09:42.031+0000 7f5ea7a3f2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T05:09:42.050 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:42.048+0000 7fd1984a22c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T05:09:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:09:42.133 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":10,"fsid":"0a3759da-62bd-4704-8a4a-7c20eb3fc816","created":"2024-09-13T05:09:38.849186+0000","modified":"2024-09-13T05:09:41.898990+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T05:09:41.898990+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b304ec03-bb00-4b13-bf2d-71017b8a70a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c09e84f3-3a70-46a4-b67b-c9bb52c887b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3c2a0458-369c-4dac-90a3-fb20cb70d53f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"edce3757-5e9d-4221-a1f1-3f356bb5218b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5fe378d2-578f-41ea-980a-4673a8b376df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6e6f7499-ae9e-4cb1-9db7-4d9f8fd9b257","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e4c519e5-5df4-4d55-b12e-fbcfb1b0555c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"914648c2-7a6c-4e66-811d-936e250638db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T05:09:42.146 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T05:09:42.147 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T05:09:42.286 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:09:42.283+0000 7f8fcbb51880 -1 Falling back to public interface 2024-09-13T05:09:42.302 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:09:42.300+0000 7f1325016880 -1 Falling back to public interface 2024-09-13T05:09:42.310 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:09:42.308+0000 7f18022fb880 -1 Falling back to public interface 2024-09-13T05:09:42.338 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:09:42.336+0000 7fb3ff5bb880 -1 Falling back to public interface 2024-09-13T05:09:42.401 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-09-13T05:09:42.395+0000 7f5ea7a3f2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T05:09:42.534 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:09:42.532+0000 7f2bb0399880 -1 Falling back to public interface 2024-09-13T05:09:42.542 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:09:42.539+0000 7febfe12a880 -1 Falling back to public interface 2024-09-13T05:09:42.546 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:09:42.543+0000 7fc2541f4880 -1 Falling back to public interface 2024-09-13T05:09:42.570 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:09:42.567+0000 7f785b3c4880 -1 Falling back to public interface 2024-09-13T05:09:42.588 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-09-13T05:09:42.583+0000 7f5ea7a3f2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T05:09:42.654 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-09-13T05:09:42.651+0000 7f5ea7a3f2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T05:09:42.745 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:42.744+0000 7fd1984a22c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T05:09:42.812 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:42.808+0000 7fd1984a22c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T05:09:42.812 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-09-13T05:09:42.807+0000 7f5ea7a3f2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T05:09:42.953 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T05:09:42.973 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:42.972+0000 7fd1984a22c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T05:09:43.038 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:43.036+0000 7fd1984a22c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T05:09:43.109 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:43.108+0000 7fd1984a22c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T05:09:43.134 INFO:teuthology.misc.health.smithi120.stdout: 2024-09-13T05:09:43.134 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":10,"fsid":"0a3759da-62bd-4704-8a4a-7c20eb3fc816","created":"2024-09-13T05:09:38.849186+0000","modified":"2024-09-13T05:09:41.898990+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T05:09:41.898990+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b304ec03-bb00-4b13-bf2d-71017b8a70a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c09e84f3-3a70-46a4-b67b-c9bb52c887b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3c2a0458-369c-4dac-90a3-fb20cb70d53f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"edce3757-5e9d-4221-a1f1-3f356bb5218b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5fe378d2-578f-41ea-980a-4673a8b376df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6e6f7499-ae9e-4cb1-9db7-4d9f8fd9b257","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e4c519e5-5df4-4d55-b12e-fbcfb1b0555c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"914648c2-7a6c-4e66-811d-936e250638db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T05:09:43.145 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T05:09:43.404 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:43.400+0000 7fd1984a22c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T05:09:43.475 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:43.472+0000 7fd1984a22c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T05:09:43.535 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-09-13T05:09:43.531+0000 7f5ea7a3f2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T05:09:43.604 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-09-13T05:09:43.599+0000 7f5ea7a3f2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T05:09:43.774 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-09-13T05:09:43.771+0000 7f5ea7a3f2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T05:09:43.840 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-09-13T05:09:43.835+0000 7f5ea7a3f2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T05:09:43.913 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-09-13T05:09:43.907+0000 7f5ea7a3f2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T05:09:44.127 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:44.124+0000 7fd1984a22c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T05:09:44.241 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-09-13T05:09:44.235+0000 7f5ea7a3f2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T05:09:44.316 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-09-13T05:09:44.311+0000 7f5ea7a3f2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T05:09:44.989 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-09-13T05:09:44.983+0000 7f5ea7a3f2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T05:09:45.170 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:45.168+0000 7fd17f019700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T05:09:45.172 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-13T05:09:45.168+0000 7fd17f019700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-13T05:09:45.959 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:09:45.955+0000 7f8fcbb51880 -1 osd.0 0 log_to_monitors true 2024-09-13T05:09:45.987 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:09:45.984+0000 7f18022fb880 -1 osd.7 0 log_to_monitors true 2024-09-13T05:09:46.168 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:09:46.163+0000 7fc2541f4880 -1 osd.2 0 log_to_monitors true 2024-09-13T05:09:46.169 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:09:46.168+0000 7f1325016880 -1 osd.5 0 log_to_monitors true 2024-09-13T05:09:46.206 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:09:46.204+0000 7fb3ff5bb880 -1 osd.6 0 log_to_monitors true 2024-09-13T05:09:46.365 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:09:46.363+0000 7febfe12a880 -1 osd.1 0 log_to_monitors true 2024-09-13T05:09:46.407 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:09:46.404+0000 7f2bb0399880 -1 osd.4 0 log_to_monitors true 2024-09-13T05:09:46.470 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:09:46.467+0000 7f785b3c4880 -1 osd.3 0 log_to_monitors true 2024-09-13T05:09:49.955 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T05:09:50.271 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:09:50.267+0000 7fc250033700 -1 osd.2 0 waiting for initial osdmap 2024-09-13T05:09:50.282 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:09:50.280+0000 7f1320e55700 -1 osd.5 0 waiting for initial osdmap 2024-09-13T05:09:50.283 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:09:50.279+0000 7fc247ae2700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T05:09:50.286 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:09:50.284+0000 7f1318904700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T05:09:50.286 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:09:50.284+0000 7f2bac1d8700 -1 osd.4 0 waiting for initial osdmap 2024-09-13T05:09:50.293 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:09:50.292+0000 7f2ba3c87700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T05:09:50.300 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:09:50.296+0000 7fb3fbd81700 -1 osd.6 0 waiting for initial osdmap 2024-09-13T05:09:50.300 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:09:50.295+0000 7f7857b8a700 -1 osd.3 0 waiting for initial osdmap 2024-09-13T05:09:50.309 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:09:50.307+0000 7f784ecb2700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T05:09:50.311 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:09:50.308+0000 7fb3f2ea9700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T05:09:50.320 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:09:50.316+0000 7f17fe13a700 -1 osd.7 0 waiting for initial osdmap 2024-09-13T05:09:50.326 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:09:50.324+0000 7f17f5be9700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T05:09:50.329 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:09:50.327+0000 7f8fc7990700 -1 osd.0 0 waiting for initial osdmap 2024-09-13T05:09:50.339 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:09:50.335+0000 7f8fbf43f700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T05:09:50.357 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:09:50.351+0000 7febfa8f0700 -1 osd.1 0 waiting for initial osdmap 2024-09-13T05:09:50.364 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:09:50.359+0000 7febf1a18700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T05:09:50.383 INFO:teuthology.misc.health.smithi120.stdout: 2024-09-13T05:09:50.383 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":12,"fsid":"0a3759da-62bd-4704-8a4a-7c20eb3fc816","created":"2024-09-13T05:09:38.849186+0000","modified":"2024-09-13T05:09:47.892167+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T05:09:41.898990+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b304ec03-bb00-4b13-bf2d-71017b8a70a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c09e84f3-3a70-46a4-b67b-c9bb52c887b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3c2a0458-369c-4dac-90a3-fb20cb70d53f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"edce3757-5e9d-4221-a1f1-3f356bb5218b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5fe378d2-578f-41ea-980a-4673a8b376df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6e6f7499-ae9e-4cb1-9db7-4d9f8fd9b257","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e4c519e5-5df4-4d55-b12e-fbcfb1b0555c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"914648c2-7a6c-4e66-811d-936e250638db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T05:09:50.396 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T05:09:57.204 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T05:09:57.509 INFO:teuthology.misc.health.smithi120.stdout: 2024-09-13T05:09:57.509 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":16,"fsid":"0a3759da-62bd-4704-8a4a-7c20eb3fc816","created":"2024-09-13T05:09:38.849186+0000","modified":"2024-09-13T05:09:54.322370+0000","last_up_change":"2024-09-13T05:09:51.283212+0000","last_in_change":"2024-09-13T05:09:41.898990+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T05:09:52.225455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b304ec03-bb00-4b13-bf2d-71017b8a70a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":3487103682},{"type":"v1","addr":"172.21.15.120:6801","nonce":3487103682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":3487103682},{"type":"v1","addr":"172.21.15.120:6803","nonce":3487103682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3487103682},{"type":"v1","addr":"172.21.15.120:6807","nonce":3487103682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3487103682},{"type":"v1","addr":"172.21.15.120:6805","nonce":3487103682}]},"public_addr":"172.21.15.120:6801/3487103682","cluster_addr":"172.21.15.120:6803/3487103682","heartbeat_back_addr":"172.21.15.120:6807/3487103682","heartbeat_front_addr":"172.21.15.120:6805/3487103682","state":["exists","up"]},{"osd":1,"uuid":"c09e84f3-3a70-46a4-b67b-c9bb52c887b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1023532100},{"type":"v1","addr":"172.21.15.120:6809","nonce":1023532100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1023532100},{"type":"v1","addr":"172.21.15.120:6811","nonce":1023532100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1023532100},{"type":"v1","addr":"172.21.15.120:6815","nonce":1023532100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1023532100},{"type":"v1","addr":"172.21.15.120:6813","nonce":1023532100}]},"public_addr":"172.21.15.120:6809/1023532100","cluster_addr":"172.21.15.120:6811/1023532100","heartbeat_back_addr":"172.21.15.120:6815/1023532100","heartbeat_front_addr":"172.21.15.120:6813/1023532100","state":["exists","up"]},{"osd":2,"uuid":"3c2a0458-369c-4dac-90a3-fb20cb70d53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":592498012},{"type":"v1","addr":"172.21.15.120:6817","nonce":592498012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":592498012},{"type":"v1","addr":"172.21.15.120:6819","nonce":592498012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":592498012},{"type":"v1","addr":"172.21.15.120:6823","nonce":592498012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":592498012},{"type":"v1","addr":"172.21.15.120:6821","nonce":592498012}]},"public_addr":"172.21.15.120:6817/592498012","cluster_addr":"172.21.15.120:6819/592498012","heartbeat_back_addr":"172.21.15.120:6823/592498012","heartbeat_front_addr":"172.21.15.120:6821/592498012","state":["exists","up"]},{"osd":3,"uuid":"edce3757-5e9d-4221-a1f1-3f356bb5218b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1939753938},{"type":"v1","addr":"172.21.15.120:6825","nonce":1939753938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1939753938},{"type":"v1","addr":"172.21.15.120:6827","nonce":1939753938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1939753938},{"type":"v1","addr":"172.21.15.120:6831","nonce":1939753938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1939753938},{"type":"v1","addr":"172.21.15.120:6829","nonce":1939753938}]},"public_addr":"172.21.15.120:6825/1939753938","cluster_addr":"172.21.15.120:6827/1939753938","heartbeat_back_addr":"172.21.15.120:6831/1939753938","heartbeat_front_addr":"172.21.15.120:6829/1939753938","state":["exists","up"]},{"osd":4,"uuid":"5fe378d2-578f-41ea-980a-4673a8b376df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3005075615},{"type":"v1","addr":"172.21.15.137:6825","nonce":3005075615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3005075615},{"type":"v1","addr":"172.21.15.137:6827","nonce":3005075615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3005075615},{"type":"v1","addr":"172.21.15.137:6831","nonce":3005075615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3005075615},{"type":"v1","addr":"172.21.15.137:6829","nonce":3005075615}]},"public_addr":"172.21.15.137:6825/3005075615","cluster_addr":"172.21.15.137:6827/3005075615","heartbeat_back_addr":"172.21.15.137:6831/3005075615","heartbeat_front_addr":"172.21.15.137:6829/3005075615","state":["exists","up"]},{"osd":5,"uuid":"6e6f7499-ae9e-4cb1-9db7-4d9f8fd9b257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1108177522},{"type":"v1","addr":"172.21.15.137:6801","nonce":1108177522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1108177522},{"type":"v1","addr":"172.21.15.137:6803","nonce":1108177522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1108177522},{"type":"v1","addr":"172.21.15.137:6807","nonce":1108177522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1108177522},{"type":"v1","addr":"172.21.15.137:6805","nonce":1108177522}]},"public_addr":"172.21.15.137:6801/1108177522","cluster_addr":"172.21.15.137:6803/1108177522","heartbeat_back_addr":"172.21.15.137:6807/1108177522","heartbeat_front_addr":"172.21.15.137:6805/1108177522","state":["exists","up"]},{"osd":6,"uuid":"e4c519e5-5df4-4d55-b12e-fbcfb1b0555c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2667039053},{"type":"v1","addr":"172.21.15.137:6817","nonce":2667039053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2667039053},{"type":"v1","addr":"172.21.15.137:6819","nonce":2667039053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2667039053},{"type":"v1","addr":"172.21.15.137:6823","nonce":2667039053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2667039053},{"type":"v1","addr":"172.21.15.137:6821","nonce":2667039053}]},"public_addr":"172.21.15.137:6817/2667039053","cluster_addr":"172.21.15.137:6819/2667039053","heartbeat_back_addr":"172.21.15.137:6823/2667039053","heartbeat_front_addr":"172.21.15.137:6821/2667039053","state":["exists","up"]},{"osd":7,"uuid":"914648c2-7a6c-4e66-811d-936e250638db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":993764921},{"type":"v1","addr":"172.21.15.137:6809","nonce":993764921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":993764921},{"type":"v1","addr":"172.21.15.137:6811","nonce":993764921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":993764921},{"type":"v1","addr":"172.21.15.137:6815","nonce":993764921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":993764921},{"type":"v1","addr":"172.21.15.137:6813","nonce":993764921}]},"public_addr":"172.21.15.137:6809/993764921","cluster_addr":"172.21.15.137:6811/993764921","heartbeat_back_addr":"172.21.15.137:6815/993764921","heartbeat_front_addr":"172.21.15.137:6813/993764921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:46.914820+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.326286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.147193+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.478655+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.388938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.127175+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.187286+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:46.962119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T05:09:57.522 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-13T05:09:57.522 INFO:tasks.ceph:Creating RBD pool 2024-09-13T05:09:57.522 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-13T05:09:58.370 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'rbd' created 2024-09-13T05:09:58.382 DEBUG:teuthology.orchestra.run.smithi120:> rbd --cluster ceph pool init rbd 2024-09-13T05:10:01.401 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T05:10:01.401 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T05:10:01.402 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T05:10:01.402 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T05:10:01.402 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T05:10:01.746 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:10:01.758 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2622689414},{"type":"v1","addr":"172.21.15.137:6833","nonce":2622689414}]},"active_addr":"172.21.15.137:6833/2622689414","active_change":"2024-09-13T05:09:44.147918+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":1917849937}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":3057712918}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":1981398575}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":3135073971}]}]} 2024-09-13T05:10:01.763 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T05:10:01.763 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T05:10:01.764 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T05:10:02.053 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:10:02.053 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"0a3759da-62bd-4704-8a4a-7c20eb3fc816","created":"2024-09-13T05:09:38.849186+0000","modified":"2024-09-13T05:10:01.373473+0000","last_up_change":"2024-09-13T05:09:51.283212+0000","last_in_change":"2024-09-13T05:09:41.898990+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T05:09:52.225455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T05:09:57.858552+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b304ec03-bb00-4b13-bf2d-71017b8a70a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":3487103682},{"type":"v1","addr":"172.21.15.120:6801","nonce":3487103682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":3487103682},{"type":"v1","addr":"172.21.15.120:6803","nonce":3487103682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3487103682},{"type":"v1","addr":"172.21.15.120:6807","nonce":3487103682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3487103682},{"type":"v1","addr":"172.21.15.120:6805","nonce":3487103682}]},"public_addr":"172.21.15.120:6801/3487103682","cluster_addr":"172.21.15.120:6803/3487103682","heartbeat_back_addr":"172.21.15.120:6807/3487103682","heartbeat_front_addr":"172.21.15.120:6805/3487103682","state":["exists","up"]},{"osd":1,"uuid":"c09e84f3-3a70-46a4-b67b-c9bb52c887b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1023532100},{"type":"v1","addr":"172.21.15.120:6809","nonce":1023532100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1023532100},{"type":"v1","addr":"172.21.15.120:6811","nonce":1023532100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1023532100},{"type":"v1","addr":"172.21.15.120:6815","nonce":1023532100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1023532100},{"type":"v1","addr":"172.21.15.120:6813","nonce":1023532100}]},"public_addr":"172.21.15.120:6809/1023532100","cluster_addr":"172.21.15.120:6811/1023532100","heartbeat_back_addr":"172.21.15.120:6815/1023532100","heartbeat_front_addr":"172.21.15.120:6813/1023532100","state":["exists","up"]},{"osd":2,"uuid":"3c2a0458-369c-4dac-90a3-fb20cb70d53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":592498012},{"type":"v1","addr":"172.21.15.120:6817","nonce":592498012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":592498012},{"type":"v1","addr":"172.21.15.120:6819","nonce":592498012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":592498012},{"type":"v1","addr":"172.21.15.120:6823","nonce":592498012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":592498012},{"type":"v1","addr":"172.21.15.120:6821","nonce":592498012}]},"public_addr":"172.21.15.120:6817/592498012","cluster_addr":"172.21.15.120:6819/592498012","heartbeat_back_addr":"172.21.15.120:6823/592498012","heartbeat_front_addr":"172.21.15.120:6821/592498012","state":["exists","up"]},{"osd":3,"uuid":"edce3757-5e9d-4221-a1f1-3f356bb5218b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1939753938},{"type":"v1","addr":"172.21.15.120:6825","nonce":1939753938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1939753938},{"type":"v1","addr":"172.21.15.120:6827","nonce":1939753938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1939753938},{"type":"v1","addr":"172.21.15.120:6831","nonce":1939753938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1939753938},{"type":"v1","addr":"172.21.15.120:6829","nonce":1939753938}]},"public_addr":"172.21.15.120:6825/1939753938","cluster_addr":"172.21.15.120:6827/1939753938","heartbeat_back_addr":"172.21.15.120:6831/1939753938","heartbeat_front_addr":"172.21.15.120:6829/1939753938","state":["exists","up"]},{"osd":4,"uuid":"5fe378d2-578f-41ea-980a-4673a8b376df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3005075615},{"type":"v1","addr":"172.21.15.137:6825","nonce":3005075615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3005075615},{"type":"v1","addr":"172.21.15.137:6827","nonce":3005075615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3005075615},{"type":"v1","addr":"172.21.15.137:6831","nonce":3005075615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3005075615},{"type":"v1","addr":"172.21.15.137:6829","nonce":3005075615}]},"public_addr":"172.21.15.137:6825/3005075615","cluster_addr":"172.21.15.137:6827/3005075615","heartbeat_back_addr":"172.21.15.137:6831/3005075615","heartbeat_front_addr":"172.21.15.137:6829/3005075615","state":["exists","up"]},{"osd":5,"uuid":"6e6f7499-ae9e-4cb1-9db7-4d9f8fd9b257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1108177522},{"type":"v1","addr":"172.21.15.137:6801","nonce":1108177522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1108177522},{"type":"v1","addr":"172.21.15.137:6803","nonce":1108177522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1108177522},{"type":"v1","addr":"172.21.15.137:6807","nonce":1108177522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1108177522},{"type":"v1","addr":"172.21.15.137:6805","nonce":1108177522}]},"public_addr":"172.21.15.137:6801/1108177522","cluster_addr":"172.21.15.137:6803/1108177522","heartbeat_back_addr":"172.21.15.137:6807/1108177522","heartbeat_front_addr":"172.21.15.137:6805/1108177522","state":["exists","up"]},{"osd":6,"uuid":"e4c519e5-5df4-4d55-b12e-fbcfb1b0555c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2667039053},{"type":"v1","addr":"172.21.15.137:6817","nonce":2667039053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2667039053},{"type":"v1","addr":"172.21.15.137:6819","nonce":2667039053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2667039053},{"type":"v1","addr":"172.21.15.137:6823","nonce":2667039053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2667039053},{"type":"v1","addr":"172.21.15.137:6821","nonce":2667039053}]},"public_addr":"172.21.15.137:6817/2667039053","cluster_addr":"172.21.15.137:6819/2667039053","heartbeat_back_addr":"172.21.15.137:6823/2667039053","heartbeat_front_addr":"172.21.15.137:6821/2667039053","state":["exists","up"]},{"osd":7,"uuid":"914648c2-7a6c-4e66-811d-936e250638db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":993764921},{"type":"v1","addr":"172.21.15.137:6809","nonce":993764921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":993764921},{"type":"v1","addr":"172.21.15.137:6811","nonce":993764921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":993764921},{"type":"v1","addr":"172.21.15.137:6815","nonce":993764921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":993764921},{"type":"v1","addr":"172.21.15.137:6813","nonce":993764921}]},"public_addr":"172.21.15.137:6809/993764921","cluster_addr":"172.21.15.137:6811/993764921","heartbeat_back_addr":"172.21.15.137:6815/993764921","heartbeat_front_addr":"172.21.15.137:6813/993764921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:46.914820+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.326286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.147193+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.478655+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.388938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.127175+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.187286+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:46.962119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T05:10:02.066 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T05:10:02.066 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T05:10:02.366 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:10:02.694 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"0a3759da-62bd-4704-8a4a-7c20eb3fc816","created":"2024-09-13T05:09:38.849186+0000","modified":"2024-09-13T05:10:01.373473+0000","last_up_change":"2024-09-13T05:09:51.283212+0000","last_in_change":"2024-09-13T05:09:41.898990+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T05:09:52.225455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T05:09:57.858552+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b304ec03-bb00-4b13-bf2d-71017b8a70a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":3487103682},{"type":"v1","addr":"172.21.15.120:6801","nonce":3487103682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":3487103682},{"type":"v1","addr":"172.21.15.120:6803","nonce":3487103682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3487103682},{"type":"v1","addr":"172.21.15.120:6807","nonce":3487103682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3487103682},{"type":"v1","addr":"172.21.15.120:6805","nonce":3487103682}]},"public_addr":"172.21.15.120:6801/3487103682","cluster_addr":"172.21.15.120:6803/3487103682","heartbeat_back_addr":"172.21.15.120:6807/3487103682","heartbeat_front_addr":"172.21.15.120:6805/3487103682","state":["exists","up"]},{"osd":1,"uuid":"c09e84f3-3a70-46a4-b67b-c9bb52c887b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1023532100},{"type":"v1","addr":"172.21.15.120:6809","nonce":1023532100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1023532100},{"type":"v1","addr":"172.21.15.120:6811","nonce":1023532100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1023532100},{"type":"v1","addr":"172.21.15.120:6815","nonce":1023532100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1023532100},{"type":"v1","addr":"172.21.15.120:6813","nonce":1023532100}]},"public_addr":"172.21.15.120:6809/1023532100","cluster_addr":"172.21.15.120:6811/1023532100","heartbeat_back_addr":"172.21.15.120:6815/1023532100","heartbeat_front_addr":"172.21.15.120:6813/1023532100","state":["exists","up"]},{"osd":2,"uuid":"3c2a0458-369c-4dac-90a3-fb20cb70d53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":592498012},{"type":"v1","addr":"172.21.15.120:6817","nonce":592498012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":592498012},{"type":"v1","addr":"172.21.15.120:6819","nonce":592498012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":592498012},{"type":"v1","addr":"172.21.15.120:6823","nonce":592498012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":592498012},{"type":"v1","addr":"172.21.15.120:6821","nonce":592498012}]},"public_addr":"172.21.15.120:6817/592498012","cluster_addr":"172.21.15.120:6819/592498012","heartbeat_back_addr":"172.21.15.120:6823/592498012","heartbeat_front_addr":"172.21.15.120:6821/592498012","state":["exists","up"]},{"osd":3,"uuid":"edce3757-5e9d-4221-a1f1-3f356bb5218b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1939753938},{"type":"v1","addr":"172.21.15.120:6825","nonce":1939753938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1939753938},{"type":"v1","addr":"172.21.15.120:6827","nonce":1939753938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1939753938},{"type":"v1","addr":"172.21.15.120:6831","nonce":1939753938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1939753938},{"type":"v1","addr":"172.21.15.120:6829","nonce":1939753938}]},"public_addr":"172.21.15.120:6825/1939753938","cluster_addr":"172.21.15.120:6827/1939753938","heartbeat_back_addr":"172.21.15.120:6831/1939753938","heartbeat_front_addr":"172.21.15.120:6829/1939753938","state":["exists","up"]},{"osd":4,"uuid":"5fe378d2-578f-41ea-980a-4673a8b376df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3005075615},{"type":"v1","addr":"172.21.15.137:6825","nonce":3005075615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3005075615},{"type":"v1","addr":"172.21.15.137:6827","nonce":3005075615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3005075615},{"type":"v1","addr":"172.21.15.137:6831","nonce":3005075615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3005075615},{"type":"v1","addr":"172.21.15.137:6829","nonce":3005075615}]},"public_addr":"172.21.15.137:6825/3005075615","cluster_addr":"172.21.15.137:6827/3005075615","heartbeat_back_addr":"172.21.15.137:6831/3005075615","heartbeat_front_addr":"172.21.15.137:6829/3005075615","state":["exists","up"]},{"osd":5,"uuid":"6e6f7499-ae9e-4cb1-9db7-4d9f8fd9b257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1108177522},{"type":"v1","addr":"172.21.15.137:6801","nonce":1108177522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1108177522},{"type":"v1","addr":"172.21.15.137:6803","nonce":1108177522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1108177522},{"type":"v1","addr":"172.21.15.137:6807","nonce":1108177522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1108177522},{"type":"v1","addr":"172.21.15.137:6805","nonce":1108177522}]},"public_addr":"172.21.15.137:6801/1108177522","cluster_addr":"172.21.15.137:6803/1108177522","heartbeat_back_addr":"172.21.15.137:6807/1108177522","heartbeat_front_addr":"172.21.15.137:6805/1108177522","state":["exists","up"]},{"osd":6,"uuid":"e4c519e5-5df4-4d55-b12e-fbcfb1b0555c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2667039053},{"type":"v1","addr":"172.21.15.137:6817","nonce":2667039053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2667039053},{"type":"v1","addr":"172.21.15.137:6819","nonce":2667039053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2667039053},{"type":"v1","addr":"172.21.15.137:6823","nonce":2667039053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2667039053},{"type":"v1","addr":"172.21.15.137:6821","nonce":2667039053}]},"public_addr":"172.21.15.137:6817/2667039053","cluster_addr":"172.21.15.137:6819/2667039053","heartbeat_back_addr":"172.21.15.137:6823/2667039053","heartbeat_front_addr":"172.21.15.137:6821/2667039053","state":["exists","up"]},{"osd":7,"uuid":"914648c2-7a6c-4e66-811d-936e250638db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":993764921},{"type":"v1","addr":"172.21.15.137:6809","nonce":993764921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":993764921},{"type":"v1","addr":"172.21.15.137:6811","nonce":993764921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":993764921},{"type":"v1","addr":"172.21.15.137:6815","nonce":993764921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":993764921},{"type":"v1","addr":"172.21.15.137:6813","nonce":993764921}]},"public_addr":"172.21.15.137:6809/993764921","cluster_addr":"172.21.15.137:6811/993764921","heartbeat_back_addr":"172.21.15.137:6815/993764921","heartbeat_front_addr":"172.21.15.137:6813/993764921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:46.914820+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.326286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.147193+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.478655+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.388938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.127175+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.187286+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:46.962119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T05:10:02.696 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T05:10:02.696 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T05:10:02.697 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T05:10:02.697 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T05:10:02.698 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-13T05:10:02.698 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-13T05:10:02.698 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-13T05:10:02.699 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-13T05:10:02.915 INFO:teuthology.orchestra.run.smithi120.stdout:55834574853 2024-09-13T05:10:02.916 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T05:10:02.919 INFO:teuthology.orchestra.run.smithi120.stdout:55834574854 2024-09-13T05:10:02.919 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T05:10:02.922 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2024-09-13T05:10:02.923 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T05:10:02.923 INFO:teuthology.orchestra.run.smithi120.stdout:55834574852 2024-09-13T05:10:02.924 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T05:10:02.925 INFO:teuthology.orchestra.run.smithi120.stdout:55834574853 2024-09-13T05:10:02.925 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T05:10:02.936 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2024-09-13T05:10:02.937 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T05:10:02.937 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2024-09-13T05:10:02.938 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T05:10:02.938 INFO:teuthology.orchestra.run.smithi120.stdout:55834574854 2024-09-13T05:10:02.939 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T05:10:03.373 INFO:teuthology.orchestra.run.smithi120.stdout:55834574854 2024-09-13T05:10:03.376 INFO:teuthology.orchestra.run.smithi120.stdout:55834574851 2024-09-13T05:10:03.377 INFO:teuthology.orchestra.run.smithi120.stdout:55834574853 2024-09-13T05:10:03.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.2 2024-09-13T05:10:03.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2024-09-13T05:10:03.401 INFO:teuthology.orchestra.run.smithi120.stdout:55834574852 2024-09-13T05:10:03.404 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-09-13T05:10:03.405 INFO:teuthology.orchestra.run.smithi120.stdout:55834574852 2024-09-13T05:10:03.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-09-13T05:10:03.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2024-09-13T05:10:03.443 INFO:teuthology.orchestra.run.smithi120.stdout:55834574854 2024-09-13T05:10:03.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2024-09-13T05:10:03.467 INFO:teuthology.orchestra.run.smithi120.stdout:55834574853 2024-09-13T05:10:03.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-09-13T05:10:03.484 INFO:teuthology.orchestra.run.smithi120.stdout:55834574854 2024-09-13T05:10:03.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2024-09-13T05:10:04.394 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T05:10:04.397 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T05:10:04.405 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T05:10:04.417 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T05:10:04.418 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T05:10:04.457 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T05:10:04.480 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T05:10:04.496 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T05:10:04.820 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2024-09-13T05:10:04.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-09-13T05:10:04.838 DEBUG:teuthology.parallel:result is None 2024-09-13T05:10:04.864 INFO:teuthology.orchestra.run.smithi120.stdout:55834574854 2024-09-13T05:10:04.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-09-13T05:10:04.882 DEBUG:teuthology.parallel:result is None 2024-09-13T05:10:04.887 INFO:teuthology.orchestra.run.smithi120.stdout:55834574853 2024-09-13T05:10:04.894 INFO:teuthology.orchestra.run.smithi120.stdout:55834574852 2024-09-13T05:10:04.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-09-13T05:10:04.900 DEBUG:teuthology.parallel:result is None 2024-09-13T05:10:04.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2024-09-13T05:10:04.911 DEBUG:teuthology.parallel:result is None 2024-09-13T05:10:04.919 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2024-09-13T05:10:04.924 INFO:teuthology.orchestra.run.smithi120.stdout:55834574854 2024-09-13T05:10:04.930 INFO:teuthology.orchestra.run.smithi120.stdout:55834574853 2024-09-13T05:10:04.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-09-13T05:10:04.939 DEBUG:teuthology.parallel:result is None 2024-09-13T05:10:04.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-09-13T05:10:04.939 DEBUG:teuthology.parallel:result is None 2024-09-13T05:10:04.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2024-09-13T05:10:04.942 DEBUG:teuthology.parallel:result is None 2024-09-13T05:10:04.969 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2024-09-13T05:10:04.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-09-13T05:10:04.982 DEBUG:teuthology.parallel:result is None 2024-09-13T05:10:04.982 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T05:10:04.983 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:10:05.265 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:10:05.268 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:10:05.280 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-13T05:10:04.163681+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218944,"kb_used_data":2768,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755776,"statfs":{"total":773094113280,"available":772869914624,"internally_reserved":0,"allocated":2834432,"data_stored":1731654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.804795"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.383891+0000","last_change":"2024-09-13T05:10:01.383891+0000","last_active":"2024-09-13T05:10:01.383891+0000","last_peered":"2024-09-13T05:10:01.383891+0000","last_clean":"2024-09-13T05:10:01.383891+0000","last_became_active":"2024-09-13T05:09:59.374793+0000","last_became_peered":"2024-09-13T05:09:59.374793+0000","last_unstale":"2024-09-13T05:10:01.383891+0000","last_undegraded":"2024-09-13T05:10:01.383891+0000","last_fullsized":"2024-09-13T05:10:01.383891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:02.499446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065068999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.395323+0000","last_change":"2024-09-13T05:10:01.395323+0000","last_active":"2024-09-13T05:10:01.395323+0000","last_peered":"2024-09-13T05:10:01.395323+0000","last_clean":"2024-09-13T05:10:01.395323+0000","last_became_active":"2024-09-13T05:09:59.367228+0000","last_became_peered":"2024-09-13T05:09:59.367228+0000","last_unstale":"2024-09-13T05:10:01.395323+0000","last_undegraded":"2024-09-13T05:10:01.395323+0000","last_fullsized":"2024-09-13T05:10:01.395323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:11.958489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086759100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.574786+0000","last_change":"2024-09-13T05:10:01.574786+0000","last_active":"2024-09-13T05:10:01.574786+0000","last_peered":"2024-09-13T05:10:01.574786+0000","last_clean":"2024-09-13T05:10:01.574786+0000","last_became_active":"2024-09-13T05:09:59.371791+0000","last_became_peered":"2024-09-13T05:09:59.371791+0000","last_unstale":"2024-09-13T05:10:01.574786+0000","last_undegraded":"2024-09-13T05:10:01.574786+0000","last_fullsized":"2024-09-13T05:10:01.574786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:48:51.447413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.395167+0000","last_change":"2024-09-13T05:10:01.395167+0000","last_active":"2024-09-13T05:10:01.395167+0000","last_peered":"2024-09-13T05:10:01.395167+0000","last_clean":"2024-09-13T05:10:01.395167+0000","last_became_active":"2024-09-13T05:09:59.366839+0000","last_became_peered":"2024-09-13T05:09:59.366839+0000","last_unstale":"2024-09-13T05:10:01.395167+0000","last_undegraded":"2024-09-13T05:10:01.395167+0000","last_fullsized":"2024-09-13T05:10:01.395167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:14.896875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070030299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.394211+0000","last_change":"2024-09-13T05:10:01.392650+0000","last_active":"2024-09-13T05:10:01.394211+0000","last_peered":"2024-09-13T05:10:01.394211+0000","last_clean":"2024-09-13T05:10:01.394211+0000","last_became_active":"2024-09-13T05:09:59.370866+0000","last_became_peered":"2024-09-13T05:09:59.370866+0000","last_unstale":"2024-09-13T05:10:01.394211+0000","last_undegraded":"2024-09-13T05:10:01.394211+0000","last_fullsized":"2024-09-13T05:10:01.394211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:24:45.980712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.384329+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:10:01.384329+0000","last_peered":"2024-09-13T05:10:01.384329+0000","last_clean":"2024-09-13T05:10:01.384329+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:10:01.384329+0000","last_undegraded":"2024-09-13T05:10:01.384329+0000","last_fullsized":"2024-09-13T05:10:01.384329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.574798+0000","last_change":"2024-09-13T05:10:01.574798+0000","last_active":"2024-09-13T05:10:01.574798+0000","last_peered":"2024-09-13T05:10:01.574798+0000","last_clean":"2024-09-13T05:10:01.574798+0000","last_became_active":"2024-09-13T05:09:59.374482+0000","last_became_peered":"2024-09-13T05:09:59.374482+0000","last_unstale":"2024-09-13T05:10:01.574798+0000","last_undegraded":"2024-09-13T05:10:01.574798+0000","last_fullsized":"2024-09-13T05:10:01.574798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:41:39.894258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.392404+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:10:01.392404+0000","last_peered":"2024-09-13T05:10:01.392404+0000","last_clean":"2024-09-13T05:10:01.392404+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:10:01.392404+0000","last_undegraded":"2024-09-13T05:10:01.392404+0000","last_fullsized":"2024-09-13T05:10:01.392404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T05:10:00.382609+0000","last_change":"2024-09-13T05:09:53.327385+0000","last_active":"2024-09-13T05:10:00.382609+0000","last_peered":"2024-09-13T05:10:00.382609+0000","last_clean":"2024-09-13T05:10:00.382609+0000","last_became_active":"2024-09-13T05:09:53.326660+0000","last_became_peered":"2024-09-13T05:09:53.326660+0000","last_unstale":"2024-09-13T05:10:00.382609+0000","last_undegraded":"2024-09-13T05:10:00.382609+0000","last_fullsized":"2024-09-13T05:10:00.382609+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:25:16.790290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":659228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":68879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":68879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":659228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:10:05.281 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:10:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:10:05.576 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:10:05.586 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-13T05:10:04.163681+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218944,"kb_used_data":2768,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755776,"statfs":{"total":773094113280,"available":772869914624,"internally_reserved":0,"allocated":2834432,"data_stored":1731654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.804795"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.383891+0000","last_change":"2024-09-13T05:10:01.383891+0000","last_active":"2024-09-13T05:10:01.383891+0000","last_peered":"2024-09-13T05:10:01.383891+0000","last_clean":"2024-09-13T05:10:01.383891+0000","last_became_active":"2024-09-13T05:09:59.374793+0000","last_became_peered":"2024-09-13T05:09:59.374793+0000","last_unstale":"2024-09-13T05:10:01.383891+0000","last_undegraded":"2024-09-13T05:10:01.383891+0000","last_fullsized":"2024-09-13T05:10:01.383891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:02.499446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065068999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.395323+0000","last_change":"2024-09-13T05:10:01.395323+0000","last_active":"2024-09-13T05:10:01.395323+0000","last_peered":"2024-09-13T05:10:01.395323+0000","last_clean":"2024-09-13T05:10:01.395323+0000","last_became_active":"2024-09-13T05:09:59.367228+0000","last_became_peered":"2024-09-13T05:09:59.367228+0000","last_unstale":"2024-09-13T05:10:01.395323+0000","last_undegraded":"2024-09-13T05:10:01.395323+0000","last_fullsized":"2024-09-13T05:10:01.395323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:11.958489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086759100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.574786+0000","last_change":"2024-09-13T05:10:01.574786+0000","last_active":"2024-09-13T05:10:01.574786+0000","last_peered":"2024-09-13T05:10:01.574786+0000","last_clean":"2024-09-13T05:10:01.574786+0000","last_became_active":"2024-09-13T05:09:59.371791+0000","last_became_peered":"2024-09-13T05:09:59.371791+0000","last_unstale":"2024-09-13T05:10:01.574786+0000","last_undegraded":"2024-09-13T05:10:01.574786+0000","last_fullsized":"2024-09-13T05:10:01.574786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:48:51.447413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.395167+0000","last_change":"2024-09-13T05:10:01.395167+0000","last_active":"2024-09-13T05:10:01.395167+0000","last_peered":"2024-09-13T05:10:01.395167+0000","last_clean":"2024-09-13T05:10:01.395167+0000","last_became_active":"2024-09-13T05:09:59.366839+0000","last_became_peered":"2024-09-13T05:09:59.366839+0000","last_unstale":"2024-09-13T05:10:01.395167+0000","last_undegraded":"2024-09-13T05:10:01.395167+0000","last_fullsized":"2024-09-13T05:10:01.395167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:14.896875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070030299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.394211+0000","last_change":"2024-09-13T05:10:01.392650+0000","last_active":"2024-09-13T05:10:01.394211+0000","last_peered":"2024-09-13T05:10:01.394211+0000","last_clean":"2024-09-13T05:10:01.394211+0000","last_became_active":"2024-09-13T05:09:59.370866+0000","last_became_peered":"2024-09-13T05:09:59.370866+0000","last_unstale":"2024-09-13T05:10:01.394211+0000","last_undegraded":"2024-09-13T05:10:01.394211+0000","last_fullsized":"2024-09-13T05:10:01.394211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:24:45.980712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.384329+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:10:01.384329+0000","last_peered":"2024-09-13T05:10:01.384329+0000","last_clean":"2024-09-13T05:10:01.384329+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:10:01.384329+0000","last_undegraded":"2024-09-13T05:10:01.384329+0000","last_fullsized":"2024-09-13T05:10:01.384329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.574798+0000","last_change":"2024-09-13T05:10:01.574798+0000","last_active":"2024-09-13T05:10:01.574798+0000","last_peered":"2024-09-13T05:10:01.574798+0000","last_clean":"2024-09-13T05:10:01.574798+0000","last_became_active":"2024-09-13T05:09:59.374482+0000","last_became_peered":"2024-09-13T05:09:59.374482+0000","last_unstale":"2024-09-13T05:10:01.574798+0000","last_undegraded":"2024-09-13T05:10:01.574798+0000","last_fullsized":"2024-09-13T05:10:01.574798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:41:39.894258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.392404+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:10:01.392404+0000","last_peered":"2024-09-13T05:10:01.392404+0000","last_clean":"2024-09-13T05:10:01.392404+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:10:01.392404+0000","last_undegraded":"2024-09-13T05:10:01.392404+0000","last_fullsized":"2024-09-13T05:10:01.392404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T05:10:00.382609+0000","last_change":"2024-09-13T05:09:53.327385+0000","last_active":"2024-09-13T05:10:00.382609+0000","last_peered":"2024-09-13T05:10:00.382609+0000","last_clean":"2024-09-13T05:10:00.382609+0000","last_became_active":"2024-09-13T05:09:53.326660+0000","last_became_peered":"2024-09-13T05:09:53.326660+0000","last_unstale":"2024-09-13T05:10:00.382609+0000","last_undegraded":"2024-09-13T05:10:00.382609+0000","last_fullsized":"2024-09-13T05:10:00.382609+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:25:16.790290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":659228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":68879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":68879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":659228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:10:05.587 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T05:10:05.587 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T05:10:05.588 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T05:10:05.588 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T05:10:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:10:05.897 INFO:teuthology.orchestra.run.smithi120.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T05:10:05.911 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T05:10:05.912 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-13T05:10:05.924 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-13T05:10:05.924 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client': {'rbd cache': True, 'rbd clone copy on read': True}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '48a7de7e6e1701a88fd571c7e34908ac4b8ed412'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '48a7de7e6e1701a88fd571c7e34908ac4b8ed412'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7a853b1706d076d58e0da7a5d3b9b9eb36276880'}} 2024-09-13T05:10:05.924 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-13T05:10:05.925 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-13T05:10:06.230 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-13T05:10:06.230 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T05:10:06.231 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:10:06.531 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:10:06.534 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:10:06.546 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-13T05:10:06.164254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218944,"kb_used_data":2768,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755776,"statfs":{"total":773094113280,"available":772869914624,"internally_reserved":0,"allocated":2834432,"data_stored":1731654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001721"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.383891+0000","last_change":"2024-09-13T05:10:01.383891+0000","last_active":"2024-09-13T05:10:01.383891+0000","last_peered":"2024-09-13T05:10:01.383891+0000","last_clean":"2024-09-13T05:10:01.383891+0000","last_became_active":"2024-09-13T05:09:59.374793+0000","last_became_peered":"2024-09-13T05:09:59.374793+0000","last_unstale":"2024-09-13T05:10:01.383891+0000","last_undegraded":"2024-09-13T05:10:01.383891+0000","last_fullsized":"2024-09-13T05:10:01.383891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:02.499446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065068999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.395323+0000","last_change":"2024-09-13T05:10:01.395323+0000","last_active":"2024-09-13T05:10:01.395323+0000","last_peered":"2024-09-13T05:10:01.395323+0000","last_clean":"2024-09-13T05:10:01.395323+0000","last_became_active":"2024-09-13T05:09:59.367228+0000","last_became_peered":"2024-09-13T05:09:59.367228+0000","last_unstale":"2024-09-13T05:10:01.395323+0000","last_undegraded":"2024-09-13T05:10:01.395323+0000","last_fullsized":"2024-09-13T05:10:01.395323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:11.958489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086759100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.574786+0000","last_change":"2024-09-13T05:10:01.574786+0000","last_active":"2024-09-13T05:10:01.574786+0000","last_peered":"2024-09-13T05:10:01.574786+0000","last_clean":"2024-09-13T05:10:01.574786+0000","last_became_active":"2024-09-13T05:09:59.371791+0000","last_became_peered":"2024-09-13T05:09:59.371791+0000","last_unstale":"2024-09-13T05:10:01.574786+0000","last_undegraded":"2024-09-13T05:10:01.574786+0000","last_fullsized":"2024-09-13T05:10:01.574786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:48:51.447413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.395167+0000","last_change":"2024-09-13T05:10:01.395167+0000","last_active":"2024-09-13T05:10:01.395167+0000","last_peered":"2024-09-13T05:10:01.395167+0000","last_clean":"2024-09-13T05:10:01.395167+0000","last_became_active":"2024-09-13T05:09:59.366839+0000","last_became_peered":"2024-09-13T05:09:59.366839+0000","last_unstale":"2024-09-13T05:10:01.395167+0000","last_undegraded":"2024-09-13T05:10:01.395167+0000","last_fullsized":"2024-09-13T05:10:01.395167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:14.896875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070030299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.394211+0000","last_change":"2024-09-13T05:10:01.392650+0000","last_active":"2024-09-13T05:10:01.394211+0000","last_peered":"2024-09-13T05:10:01.394211+0000","last_clean":"2024-09-13T05:10:01.394211+0000","last_became_active":"2024-09-13T05:09:59.370866+0000","last_became_peered":"2024-09-13T05:09:59.370866+0000","last_unstale":"2024-09-13T05:10:01.394211+0000","last_undegraded":"2024-09-13T05:10:01.394211+0000","last_fullsized":"2024-09-13T05:10:01.394211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:24:45.980712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.384329+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:10:01.384329+0000","last_peered":"2024-09-13T05:10:01.384329+0000","last_clean":"2024-09-13T05:10:01.384329+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:10:01.384329+0000","last_undegraded":"2024-09-13T05:10:01.384329+0000","last_fullsized":"2024-09-13T05:10:01.384329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.574798+0000","last_change":"2024-09-13T05:10:01.574798+0000","last_active":"2024-09-13T05:10:01.574798+0000","last_peered":"2024-09-13T05:10:01.574798+0000","last_clean":"2024-09-13T05:10:01.574798+0000","last_became_active":"2024-09-13T05:09:59.374482+0000","last_became_peered":"2024-09-13T05:09:59.374482+0000","last_unstale":"2024-09-13T05:10:01.574798+0000","last_undegraded":"2024-09-13T05:10:01.574798+0000","last_fullsized":"2024-09-13T05:10:01.574798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:41:39.894258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.392404+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:10:01.392404+0000","last_peered":"2024-09-13T05:10:01.392404+0000","last_clean":"2024-09-13T05:10:01.392404+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:10:01.392404+0000","last_undegraded":"2024-09-13T05:10:01.392404+0000","last_fullsized":"2024-09-13T05:10:01.392404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T05:10:00.382609+0000","last_change":"2024-09-13T05:09:53.327385+0000","last_active":"2024-09-13T05:10:00.382609+0000","last_peered":"2024-09-13T05:10:00.382609+0000","last_clean":"2024-09-13T05:10:00.382609+0000","last_became_active":"2024-09-13T05:09:53.326660+0000","last_became_peered":"2024-09-13T05:09:53.326660+0000","last_unstale":"2024-09-13T05:10:00.382609+0000","last_undegraded":"2024-09-13T05:10:00.382609+0000","last_fullsized":"2024-09-13T05:10:00.382609+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:25:16.790290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":659228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":68879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":68879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":659228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:10:06.548 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:10:06.841 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:10:06.844 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:10:06.856 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-13T05:10:06.164254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218944,"kb_used_data":2768,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755776,"statfs":{"total":773094113280,"available":772869914624,"internally_reserved":0,"allocated":2834432,"data_stored":1731654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001721"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.383891+0000","last_change":"2024-09-13T05:10:01.383891+0000","last_active":"2024-09-13T05:10:01.383891+0000","last_peered":"2024-09-13T05:10:01.383891+0000","last_clean":"2024-09-13T05:10:01.383891+0000","last_became_active":"2024-09-13T05:09:59.374793+0000","last_became_peered":"2024-09-13T05:09:59.374793+0000","last_unstale":"2024-09-13T05:10:01.383891+0000","last_undegraded":"2024-09-13T05:10:01.383891+0000","last_fullsized":"2024-09-13T05:10:01.383891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:02.499446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065068999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.395323+0000","last_change":"2024-09-13T05:10:01.395323+0000","last_active":"2024-09-13T05:10:01.395323+0000","last_peered":"2024-09-13T05:10:01.395323+0000","last_clean":"2024-09-13T05:10:01.395323+0000","last_became_active":"2024-09-13T05:09:59.367228+0000","last_became_peered":"2024-09-13T05:09:59.367228+0000","last_unstale":"2024-09-13T05:10:01.395323+0000","last_undegraded":"2024-09-13T05:10:01.395323+0000","last_fullsized":"2024-09-13T05:10:01.395323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:11.958489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086759100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.574786+0000","last_change":"2024-09-13T05:10:01.574786+0000","last_active":"2024-09-13T05:10:01.574786+0000","last_peered":"2024-09-13T05:10:01.574786+0000","last_clean":"2024-09-13T05:10:01.574786+0000","last_became_active":"2024-09-13T05:09:59.371791+0000","last_became_peered":"2024-09-13T05:09:59.371791+0000","last_unstale":"2024-09-13T05:10:01.574786+0000","last_undegraded":"2024-09-13T05:10:01.574786+0000","last_fullsized":"2024-09-13T05:10:01.574786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:48:51.447413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.395167+0000","last_change":"2024-09-13T05:10:01.395167+0000","last_active":"2024-09-13T05:10:01.395167+0000","last_peered":"2024-09-13T05:10:01.395167+0000","last_clean":"2024-09-13T05:10:01.395167+0000","last_became_active":"2024-09-13T05:09:59.366839+0000","last_became_peered":"2024-09-13T05:09:59.366839+0000","last_unstale":"2024-09-13T05:10:01.395167+0000","last_undegraded":"2024-09-13T05:10:01.395167+0000","last_fullsized":"2024-09-13T05:10:01.395167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:14.896875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070030299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.394211+0000","last_change":"2024-09-13T05:10:01.392650+0000","last_active":"2024-09-13T05:10:01.394211+0000","last_peered":"2024-09-13T05:10:01.394211+0000","last_clean":"2024-09-13T05:10:01.394211+0000","last_became_active":"2024-09-13T05:09:59.370866+0000","last_became_peered":"2024-09-13T05:09:59.370866+0000","last_unstale":"2024-09-13T05:10:01.394211+0000","last_undegraded":"2024-09-13T05:10:01.394211+0000","last_fullsized":"2024-09-13T05:10:01.394211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:24:45.980712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.384329+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:10:01.384329+0000","last_peered":"2024-09-13T05:10:01.384329+0000","last_clean":"2024-09-13T05:10:01.384329+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:10:01.384329+0000","last_undegraded":"2024-09-13T05:10:01.384329+0000","last_fullsized":"2024-09-13T05:10:01.384329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.574798+0000","last_change":"2024-09-13T05:10:01.574798+0000","last_active":"2024-09-13T05:10:01.574798+0000","last_peered":"2024-09-13T05:10:01.574798+0000","last_clean":"2024-09-13T05:10:01.574798+0000","last_became_active":"2024-09-13T05:09:59.374482+0000","last_became_peered":"2024-09-13T05:09:59.374482+0000","last_unstale":"2024-09-13T05:10:01.574798+0000","last_undegraded":"2024-09-13T05:10:01.574798+0000","last_fullsized":"2024-09-13T05:10:01.574798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:41:39.894258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T05:10:01.392404+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:10:01.392404+0000","last_peered":"2024-09-13T05:10:01.392404+0000","last_clean":"2024-09-13T05:10:01.392404+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:10:01.392404+0000","last_undegraded":"2024-09-13T05:10:01.392404+0000","last_fullsized":"2024-09-13T05:10:01.392404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T05:10:00.382609+0000","last_change":"2024-09-13T05:09:53.327385+0000","last_active":"2024-09-13T05:10:00.382609+0000","last_peered":"2024-09-13T05:10:00.382609+0000","last_clean":"2024-09-13T05:10:00.382609+0000","last_became_active":"2024-09-13T05:09:53.326660+0000","last_became_peered":"2024-09-13T05:09:53.326660+0000","last_unstale":"2024-09-13T05:10:00.382609+0000","last_undegraded":"2024-09-13T05:10:00.382609+0000","last_fullsized":"2024-09-13T05:10:00.382609+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:25:16.790290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":659228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":68879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":68879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":659228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:10:06.858 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T05:10:06.858 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-13T05:10:07.159 INFO:teuthology.orchestra.run.smithi120.stdout:epoch 21 2024-09-13T05:10:07.159 INFO:teuthology.orchestra.run.smithi120.stdout:fsid 0a3759da-62bd-4704-8a4a-7c20eb3fc816 2024-09-13T05:10:07.160 INFO:teuthology.orchestra.run.smithi120.stdout:created 2024-09-13T05:09:38.849186+0000 2024-09-13T05:10:07.160 INFO:teuthology.orchestra.run.smithi120.stdout:modified 2024-09-13T05:10:03.589304+0000 2024-09-13T05:10:07.160 INFO:teuthology.orchestra.run.smithi120.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-13T05:10:07.160 INFO:teuthology.orchestra.run.smithi120.stdout:crush_version 4 2024-09-13T05:10:07.160 INFO:teuthology.orchestra.run.smithi120.stdout:full_ratio 0.95 2024-09-13T05:10:07.160 INFO:teuthology.orchestra.run.smithi120.stdout:backfillfull_ratio 0.9 2024-09-13T05:10:07.160 INFO:teuthology.orchestra.run.smithi120.stdout:nearfull_ratio 0.85 2024-09-13T05:10:07.160 INFO:teuthology.orchestra.run.smithi120.stdout:require_min_compat_client luminous 2024-09-13T05:10:07.160 INFO:teuthology.orchestra.run.smithi120.stdout:min_compat_client jewel 2024-09-13T05:10:07.160 INFO:teuthology.orchestra.run.smithi120.stdout:require_osd_release reef 2024-09-13T05:10:07.160 INFO:teuthology.orchestra.run.smithi120.stdout:stretch_mode_enabled false 2024-09-13T05:10:07.160 INFO:teuthology.orchestra.run.smithi120.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 16 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-13T05:10:07.160 INFO:teuthology.orchestra.run.smithi120.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 20 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.99 2024-09-13T05:10:07.161 INFO:teuthology.orchestra.run.smithi120.stdout:max_osd 8 2024-09-13T05:10:07.161 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6800/3487103682,v1:172.21.15.120:6801/3487103682] [v2:172.21.15.120:6802/3487103682,v1:172.21.15.120:6803/3487103682] exists,up b304ec03-bb00-4b13-bf2d-71017b8a70a3 2024-09-13T05:10:07.161 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6808/1023532100,v1:172.21.15.120:6809/1023532100] [v2:172.21.15.120:6810/1023532100,v1:172.21.15.120:6811/1023532100] exists,up c09e84f3-3a70-46a4-b67b-c9bb52c887b7 2024-09-13T05:10:07.161 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6816/592498012,v1:172.21.15.120:6817/592498012] [v2:172.21.15.120:6818/592498012,v1:172.21.15.120:6819/592498012] exists,up 3c2a0458-369c-4dac-90a3-fb20cb70d53f 2024-09-13T05:10:07.161 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6824/1939753938,v1:172.21.15.120:6825/1939753938] [v2:172.21.15.120:6826/1939753938,v1:172.21.15.120:6827/1939753938] exists,up edce3757-5e9d-4221-a1f1-3f356bb5218b 2024-09-13T05:10:07.161 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.137:6824/3005075615,v1:172.21.15.137:6825/3005075615] [v2:172.21.15.137:6826/3005075615,v1:172.21.15.137:6827/3005075615] exists,up 5fe378d2-578f-41ea-980a-4673a8b376df 2024-09-13T05:10:07.161 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.137:6800/1108177522,v1:172.21.15.137:6801/1108177522] [v2:172.21.15.137:6802/1108177522,v1:172.21.15.137:6803/1108177522] exists,up 6e6f7499-ae9e-4cb1-9db7-4d9f8fd9b257 2024-09-13T05:10:07.161 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.137:6816/2667039053,v1:172.21.15.137:6817/2667039053] [v2:172.21.15.137:6818/2667039053,v1:172.21.15.137:6819/2667039053] exists,up e4c519e5-5df4-4d55-b12e-fbcfb1b0555c 2024-09-13T05:10:07.161 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.137:6808/993764921,v1:172.21.15.137:6809/993764921] [v2:172.21.15.137:6810/993764921,v1:172.21.15.137:6811/993764921] exists,up 914648c2-7a6c-4e66-811d-936e250638db 2024-09-13T05:10:07.174 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6800/3487103682,v1:172.21.15.120:6801/3487103682] [v2:172.21.15.120:6802/3487103682,v1:172.21.15.120:6803/3487103682] exists,up b304ec03-bb00-4b13-bf2d-71017b8a70a3', 'osd.1 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6808/1023532100,v1:172.21.15.120:6809/1023532100] [v2:172.21.15.120:6810/1023532100,v1:172.21.15.120:6811/1023532100] exists,up c09e84f3-3a70-46a4-b67b-c9bb52c887b7', 'osd.2 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6816/592498012,v1:172.21.15.120:6817/592498012] [v2:172.21.15.120:6818/592498012,v1:172.21.15.120:6819/592498012] exists,up 3c2a0458-369c-4dac-90a3-fb20cb70d53f', 'osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6824/1939753938,v1:172.21.15.120:6825/1939753938] [v2:172.21.15.120:6826/1939753938,v1:172.21.15.120:6827/1939753938] exists,up edce3757-5e9d-4221-a1f1-3f356bb5218b', 'osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.137:6824/3005075615,v1:172.21.15.137:6825/3005075615] [v2:172.21.15.137:6826/3005075615,v1:172.21.15.137:6827/3005075615] exists,up 5fe378d2-578f-41ea-980a-4673a8b376df', 'osd.5 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.137:6800/1108177522,v1:172.21.15.137:6801/1108177522] [v2:172.21.15.137:6802/1108177522,v1:172.21.15.137:6803/1108177522] exists,up 6e6f7499-ae9e-4cb1-9db7-4d9f8fd9b257', 'osd.6 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.137:6816/2667039053,v1:172.21.15.137:6817/2667039053] [v2:172.21.15.137:6818/2667039053,v1:172.21.15.137:6819/2667039053] exists,up e4c519e5-5df4-4d55-b12e-fbcfb1b0555c', 'osd.7 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.137:6808/993764921,v1:172.21.15.137:6809/993764921] [v2:172.21.15.137:6810/993764921,v1:172.21.15.137:6811/993764921] exists,up 914648c2-7a6c-4e66-811d-936e250638db'] 2024-09-13T05:10:07.174 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-13T05:10:07.276 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:07.277 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mon.a", 2024-09-13T05:10:07.277 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster": "ceph", 2024-09-13T05:10:07.277 INFO:teuthology.orchestra.run.smithi120.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-13T05:10:07.277 INFO:teuthology.orchestra.run.smithi120.stdout: "admin_socket_mode": "", 2024-09-13T05:10:07.277 INFO:teuthology.orchestra.run.smithi120.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-13T05:10:07.277 INFO:teuthology.orchestra.run.smithi120.stdout: "auth_client_required": "cephx, none", 2024-09-13T05:10:07.277 INFO:teuthology.orchestra.run.smithi120.stdout: "auth_cluster_required": "cephx", 2024-09-13T05:10:07.277 INFO:teuthology.orchestra.run.smithi120.stdout: "auth_debug": "true", 2024-09-13T05:10:07.277 INFO:teuthology.orchestra.run.smithi120.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-13T05:10:07.277 INFO:teuthology.orchestra.run.smithi120.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-13T05:10:07.277 INFO:teuthology.orchestra.run.smithi120.stdout: "auth_service_required": "cephx", 2024-09-13T05:10:07.277 INFO:teuthology.orchestra.run.smithi120.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-13T05:10:07.278 INFO:teuthology.orchestra.run.smithi120.stdout: "auth_supported": "cephx", 2024-09-13T05:10:07.278 INFO:teuthology.orchestra.run.smithi120.stdout: "bdev_aio": "true", 2024-09-13T05:10:07.278 INFO:teuthology.orchestra.run.smithi120.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-13T05:10:07.278 INFO:teuthology.orchestra.run.smithi120.stdout: "bdev_aio_poll_ms": "250", 2024-09-13T05:10:07.278 INFO:teuthology.orchestra.run.smithi120.stdout: "bdev_aio_reap_max": "16", 2024-09-13T05:10:07.278 INFO:teuthology.orchestra.run.smithi120.stdout: "bdev_async_discard": "false", 2024-09-13T05:10:07.278 INFO:teuthology.orchestra.run.smithi120.stdout: "bdev_block_size": "4096", 2024-09-13T05:10:07.278 INFO:teuthology.orchestra.run.smithi120.stdout: "bdev_debug_aio": "false", 2024-09-13T05:10:07.278 INFO:teuthology.orchestra.run.smithi120.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-13T05:10:07.278 INFO:teuthology.orchestra.run.smithi120.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-13T05:10:07.278 INFO:teuthology.orchestra.run.smithi120.stdout: "bdev_debug_inflight_ios": "false", 2024-09-13T05:10:07.278 INFO:teuthology.orchestra.run.smithi120.stdout: "bdev_enable_discard": "false", 2024-09-13T05:10:07.278 INFO:teuthology.orchestra.run.smithi120.stdout: "bdev_flock_retry": "3", 2024-09-13T05:10:07.278 INFO:teuthology.orchestra.run.smithi120.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-13T05:10:07.279 INFO:teuthology.orchestra.run.smithi120.stdout: "bdev_inject_crash": "0", 2024-09-13T05:10:07.279 INFO:teuthology.orchestra.run.smithi120.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-13T05:10:07.279 INFO:teuthology.orchestra.run.smithi120.stdout: "bdev_ioring": "false", 2024-09-13T05:10:07.279 INFO:teuthology.orchestra.run.smithi120.stdout: "bdev_ioring_hipri": "false", 2024-09-13T05:10:07.279 INFO:teuthology.orchestra.run.smithi120.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-13T05:10:07.279 INFO:teuthology.orchestra.run.smithi120.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-13T05:10:07.279 INFO:teuthology.orchestra.run.smithi120.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-13T05:10:07.279 INFO:teuthology.orchestra.run.smithi120.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-13T05:10:07.279 INFO:teuthology.orchestra.run.smithi120.stdout: "bdev_type": "", 2024-09-13T05:10:07.279 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_alloc_size": "1048576", 2024-09-13T05:10:07.279 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_allocator": "hybrid", 2024-09-13T05:10:07.279 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_buffered_io": "true", 2024-09-13T05:10:07.279 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_check_for_zeros": "false", 2024-09-13T05:10:07.280 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-13T05:10:07.280 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-13T05:10:07.280 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_compact_log_sync": "false", 2024-09-13T05:10:07.280 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-13T05:10:07.280 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-13T05:10:07.280 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-13T05:10:07.280 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-13T05:10:07.280 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_max_log_runway": "4194304", 2024-09-13T05:10:07.280 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_max_prefetch": "1048576", 2024-09-13T05:10:07.280 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_min_flush_size": "524288", 2024-09-13T05:10:07.280 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_min_log_runway": "1048576", 2024-09-13T05:10:07.280 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_replay_recovery": "false", 2024-09-13T05:10:07.280 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-13T05:10:07.280 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-13T05:10:07.281 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_sync_write": "false", 2024-09-13T05:10:07.281 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-13T05:10:07.281 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-13T05:10:07.281 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-13T05:10:07.281 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_allocation_from_file": "true", 2024-09-13T05:10:07.281 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_allocator": "hybrid", 2024-09-13T05:10:07.281 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-13T05:10:07.281 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-13T05:10:07.281 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-13T05:10:07.281 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-13T05:10:07.281 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-13T05:10:07.281 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-13T05:10:07.281 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-13T05:10:07.282 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_block_create": "true", 2024-09-13T05:10:07.282 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_block_db_create": "false", 2024-09-13T05:10:07.282 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_block_db_path": "", 2024-09-13T05:10:07.282 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_block_db_size": "0", 2024-09-13T05:10:07.282 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_block_path": "", 2024-09-13T05:10:07.282 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_block_preallocate_file": "false", 2024-09-13T05:10:07.282 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_block_size": "107374182400", 2024-09-13T05:10:07.282 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_block_wal_create": "false", 2024-09-13T05:10:07.282 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_block_wal_path": "", 2024-09-13T05:10:07.282 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_block_wal_size": "100663296", 2024-09-13T05:10:07.282 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_bluefs": "true", 2024-09-13T05:10:07.282 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-13T05:10:07.282 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-13T05:10:07.282 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-13T05:10:07.283 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-13T05:10:07.283 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-13T05:10:07.283 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-13T05:10:07.283 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-13T05:10:07.283 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-13T05:10:07.283 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_autotune": "true", 2024-09-13T05:10:07.283 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-13T05:10:07.283 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-13T05:10:07.283 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-13T05:10:07.283 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-13T05:10:07.283 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_size": "0", 2024-09-13T05:10:07.283 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-13T05:10:07.283 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-13T05:10:07.283 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-13T05:10:07.284 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-13T05:10:07.284 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_type": "2q", 2024-09-13T05:10:07.284 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-13T05:10:07.284 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_clone_cow": "true", 2024-09-13T05:10:07.284 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-13T05:10:07.284 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-13T05:10:07.284 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-13T05:10:07.284 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-13T05:10:07.284 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-13T05:10:07.284 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-13T05:10:07.284 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-13T05:10:07.284 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_compression_mode": "none", 2024-09-13T05:10:07.284 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-13T05:10:07.285 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_csum_type": "crc32c", 2024-09-13T05:10:07.285 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-13T05:10:07.285 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_debug_freelist": "false", 2024-09-13T05:10:07.285 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-13T05:10:07.285 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-13T05:10:07.285 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_debug_inject_bug21040": "false", 2024-09-13T05:10:07.285 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-13T05:10:07.285 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-13T05:10:07.285 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-13T05:10:07.285 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-13T05:10:07.285 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-13T05:10:07.285 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-13T05:10:07.285 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-13T05:10:07.285 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_debug_prefill": "0.000000", 2024-09-13T05:10:07.286 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-13T05:10:07.286 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-13T05:10:07.286 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-13T05:10:07.286 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_debug_small_allocations": "0", 2024-09-13T05:10:07.286 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-13T05:10:07.286 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_default_buffered_read": "true", 2024-09-13T05:10:07.286 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_default_buffered_write": "false", 2024-09-13T05:10:07.286 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-13T05:10:07.286 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-13T05:10:07.286 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-13T05:10:07.286 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-13T05:10:07.286 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-13T05:10:07.286 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-13T05:10:07.287 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-13T05:10:07.287 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-13T05:10:07.287 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fail_eio": "false", 2024-09-13T05:10:07.287 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-13T05:10:07.287 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-13T05:10:07.287 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-13T05:10:07.288 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-13T05:10:07.288 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-13T05:10:07.288 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-13T05:10:07.288 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_on_mount": "false", 2024-09-13T05:10:07.288 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-13T05:10:07.288 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_on_umount": "false", 2024-09-13T05:10:07.288 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-13T05:10:07.288 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-13T05:10:07.288 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-13T05:10:07.288 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-13T05:10:07.288 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-13T05:10:07.288 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-13T05:10:07.288 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-13T05:10:07.289 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-13T05:10:07.289 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_ignore_data_csum": "false", 2024-09-13T05:10:07.289 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-13T05:10:07.289 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-13T05:10:07.289 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-13T05:10:07.289 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-13T05:10:07.289 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_log_op_age": "5.000000", 2024-09-13T05:10:07.289 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_max_alloc_size": "0", 2024-09-13T05:10:07.289 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_max_blob_size": "0", 2024-09-13T05:10:07.289 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-13T05:10:07.289 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-13T05:10:07.289 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-13T05:10:07.289 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_max_deferred_txc": "32", 2024-09-13T05:10:07.290 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_min_alloc_size": "0", 2024-09-13T05:10:07.290 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-13T05:10:07.290 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-13T05:10:07.290 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_nid_prealloc": "1024", 2024-09-13T05:10:07.290 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-13T05:10:07.290 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-13T05:10:07.290 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-13T05:10:07.290 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-13T05:10:07.290 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_retry_disk_reads": "3", 2024-09-13T05:10:07.290 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_rocksdb_cf": "true", 2024-09-13T05:10:07.290 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-13T05:10:07.290 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-13T05:10:07.290 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-13T05:10:07.291 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-13T05:10:07.291 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-13T05:10:07.291 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-13T05:10:07.291 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_spdk_mem": "512", 2024-09-13T05:10:07.291 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-13T05:10:07.291 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-13T05:10:07.291 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-13T05:10:07.291 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-13T05:10:07.291 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-13T05:10:07.291 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-13T05:10:07.291 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-13T05:10:07.291 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_tracing": "false", 2024-09-13T05:10:07.291 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-13T05:10:07.291 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-13T05:10:07.292 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-13T05:10:07.292 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-13T05:10:07.292 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-13T05:10:07.292 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-13T05:10:07.292 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-13T05:10:07.292 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-13T05:10:07.292 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-13T05:10:07.292 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_zero_block_detection": "false", 2024-09-13T05:10:07.292 INFO:teuthology.orchestra.run.smithi120.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-13T05:10:07.292 INFO:teuthology.orchestra.run.smithi120.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-13T05:10:07.292 INFO:teuthology.orchestra.run.smithi120.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-13T05:10:07.292 INFO:teuthology.orchestra.run.smithi120.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-13T05:10:07.293 INFO:teuthology.orchestra.run.smithi120.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-13T05:10:07.293 INFO:teuthology.orchestra.run.smithi120.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-13T05:10:07.293 INFO:teuthology.orchestra.run.smithi120.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-13T05:10:07.293 INFO:teuthology.orchestra.run.smithi120.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-13T05:10:07.293 INFO:teuthology.orchestra.run.smithi120.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-13T05:10:07.294 INFO:teuthology.orchestra.run.smithi120.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-13T05:10:07.294 INFO:teuthology.orchestra.run.smithi120.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-13T05:10:07.294 INFO:teuthology.orchestra.run.smithi120.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-13T05:10:07.294 INFO:teuthology.orchestra.run.smithi120.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-13T05:10:07.294 INFO:teuthology.orchestra.run.smithi120.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-13T05:10:07.294 INFO:teuthology.orchestra.run.smithi120.stdout: "cephx_cluster_require_signatures": "false", 2024-09-13T05:10:07.294 INFO:teuthology.orchestra.run.smithi120.stdout: "cephx_cluster_require_version": "2", 2024-09-13T05:10:07.294 INFO:teuthology.orchestra.run.smithi120.stdout: "cephx_require_signatures": "false", 2024-09-13T05:10:07.294 INFO:teuthology.orchestra.run.smithi120.stdout: "cephx_require_version": "2", 2024-09-13T05:10:07.294 INFO:teuthology.orchestra.run.smithi120.stdout: "cephx_service_require_signatures": "false", 2024-09-13T05:10:07.295 INFO:teuthology.orchestra.run.smithi120.stdout: "cephx_service_require_version": "2", 2024-09-13T05:10:07.295 INFO:teuthology.orchestra.run.smithi120.stdout: "cephx_sign_messages": "true", 2024-09-13T05:10:07.295 INFO:teuthology.orchestra.run.smithi120.stdout: "chdir": "", 2024-09-13T05:10:07.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_acl_type": "", 2024-09-13T05:10:07.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_asio_thread_count": "2", 2024-09-13T05:10:07.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_cache_mid": "0.750000", 2024-09-13T05:10:07.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_cache_size": "16384", 2024-09-13T05:10:07.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_caps_release_delay": "5", 2024-09-13T05:10:07.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_check_pool_perm": "true", 2024-09-13T05:10:07.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-13T05:10:07.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_debug_force_sync_read": "false", 2024-09-13T05:10:07.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_debug_getattr_caps": "false", 2024-09-13T05:10:07.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_debug_inject_features": "", 2024-09-13T05:10:07.296 INFO:teuthology.orchestra.run.smithi120.stdout: "client_debug_inject_tick_delay": "0", 2024-09-13T05:10:07.296 INFO:teuthology.orchestra.run.smithi120.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-13T05:10:07.296 INFO:teuthology.orchestra.run.smithi120.stdout: "client_die_on_failed_remount": "false", 2024-09-13T05:10:07.296 INFO:teuthology.orchestra.run.smithi120.stdout: "client_dirsize_rbytes": "true", 2024-09-13T05:10:07.296 INFO:teuthology.orchestra.run.smithi120.stdout: "client_force_lazyio": "false", 2024-09-13T05:10:07.296 INFO:teuthology.orchestra.run.smithi120.stdout: "client_fs": "", 2024-09-13T05:10:07.296 INFO:teuthology.orchestra.run.smithi120.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-13T05:10:07.296 INFO:teuthology.orchestra.run.smithi120.stdout: "client_inject_release_failure": "false", 2024-09-13T05:10:07.296 INFO:teuthology.orchestra.run.smithi120.stdout: "client_max_inline_size": "4096", 2024-09-13T05:10:07.296 INFO:teuthology.orchestra.run.smithi120.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-13T05:10:07.296 INFO:teuthology.orchestra.run.smithi120.stdout: "client_mds_namespace": "", 2024-09-13T05:10:07.296 INFO:teuthology.orchestra.run.smithi120.stdout: "client_metadata": "", 2024-09-13T05:10:07.296 INFO:teuthology.orchestra.run.smithi120.stdout: "client_mount_gid": "-1", 2024-09-13T05:10:07.296 INFO:teuthology.orchestra.run.smithi120.stdout: "client_mount_timeout": "300", 2024-09-13T05:10:07.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_mount_uid": "-1", 2024-09-13T05:10:07.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_mountpoint": "/", 2024-09-13T05:10:07.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_notify_timeout": "10", 2024-09-13T05:10:07.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_oc": "true", 2024-09-13T05:10:07.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_oc_max_dirty": "104857600", 2024-09-13T05:10:07.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-13T05:10:07.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_oc_max_objects": "1000", 2024-09-13T05:10:07.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_oc_size": "209715200", 2024-09-13T05:10:07.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_oc_target_dirty": "8388608", 2024-09-13T05:10:07.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_permissions": "true", 2024-09-13T05:10:07.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_quota": "true", 2024-09-13T05:10:07.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_quota_df": "true", 2024-09-13T05:10:07.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_readahead_max_bytes": "0", 2024-09-13T05:10:07.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client_readahead_max_periods": "4", 2024-09-13T05:10:07.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client_readahead_min": "131072", 2024-09-13T05:10:07.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client_reconnect_stale": "false", 2024-09-13T05:10:07.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client_shutdown_timeout": "30", 2024-09-13T05:10:07.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client_snapdir": ".snap", 2024-09-13T05:10:07.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client_tick_interval": "1", 2024-09-13T05:10:07.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client_trace": "", 2024-09-13T05:10:07.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client_try_dentry_invalidate": "false", 2024-09-13T05:10:07.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client_use_faked_inos": "false", 2024-09-13T05:10:07.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client_use_random_mds": "false", 2024-09-13T05:10:07.298 INFO:teuthology.orchestra.run.smithi120.stdout: "clog_to_graylog": "false", 2024-09-13T05:10:07.299 INFO:teuthology.orchestra.run.smithi120.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-13T05:10:07.299 INFO:teuthology.orchestra.run.smithi120.stdout: "clog_to_graylog_port": "12201", 2024-09-13T05:10:07.299 INFO:teuthology.orchestra.run.smithi120.stdout: "clog_to_monitors": "default=true", 2024-09-13T05:10:07.299 INFO:teuthology.orchestra.run.smithi120.stdout: "clog_to_syslog": "false", 2024-09-13T05:10:07.299 INFO:teuthology.orchestra.run.smithi120.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-13T05:10:07.299 INFO:teuthology.orchestra.run.smithi120.stdout: "clog_to_syslog_level": "info", 2024-09-13T05:10:07.299 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "-", 2024-09-13T05:10:07.299 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_network": "", 2024-09-13T05:10:07.299 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_network_interface": "", 2024-09-13T05:10:07.299 INFO:teuthology.orchestra.run.smithi120.stdout: "compressor_zlib_isal": "false", 2024-09-13T05:10:07.299 INFO:teuthology.orchestra.run.smithi120.stdout: "compressor_zlib_level": "5", 2024-09-13T05:10:07.299 INFO:teuthology.orchestra.run.smithi120.stdout: "compressor_zlib_winsize": "-15", 2024-09-13T05:10:07.299 INFO:teuthology.orchestra.run.smithi120.stdout: "compressor_zstd_level": "1", 2024-09-13T05:10:07.300 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-13T05:10:07.300 INFO:teuthology.orchestra.run.smithi120.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-13T05:10:07.300 INFO:teuthology.orchestra.run.smithi120.stdout: "crimson_alien_op_num_threads": "6", 2024-09-13T05:10:07.300 INFO:teuthology.orchestra.run.smithi120.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-13T05:10:07.300 INFO:teuthology.orchestra.run.smithi120.stdout: "crimson_osd_obc_lru_size": "10", 2024-09-13T05:10:07.300 INFO:teuthology.orchestra.run.smithi120.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-13T05:10:07.300 INFO:teuthology.orchestra.run.smithi120.stdout: "crimson_seastar_smp": "1", 2024-09-13T05:10:07.300 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_location": "", 2024-09-13T05:10:07.300 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_location_hook": "", 2024-09-13T05:10:07.300 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_location_hook_timeout": "10", 2024-09-13T05:10:07.300 INFO:teuthology.orchestra.run.smithi120.stdout: "daemonize": "false", 2024-09-13T05:10:07.300 INFO:teuthology.orchestra.run.smithi120.stdout: "daos_pool": "tank", 2024-09-13T05:10:07.300 INFO:teuthology.orchestra.run.smithi120.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-13T05:10:07.301 INFO:teuthology.orchestra.run.smithi120.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-13T05:10:07.301 INFO:teuthology.orchestra.run.smithi120.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-13T05:10:07.301 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_alienstore": "0/5", 2024-09-13T05:10:07.301 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_allow_any_pool_priority": "false", 2024-09-13T05:10:07.301 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_asok": "1/5", 2024-09-13T05:10:07.301 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_asok_assert_abort": "false", 2024-09-13T05:10:07.301 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_asserts_on_shutdown": "true", 2024-09-13T05:10:07.301 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_auth": "20/20", 2024-09-13T05:10:07.301 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_bdev": "1/3", 2024-09-13T05:10:07.301 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_bluefs": "1/5", 2024-09-13T05:10:07.301 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_bluestore": "1/5", 2024-09-13T05:10:07.301 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_buffer": "0/1", 2024-09-13T05:10:07.301 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_ceph_exporter": "1/5", 2024-09-13T05:10:07.301 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_cephfs_mirror": "0/5", 2024-09-13T05:10:07.302 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_cephsqlite": "0/5", 2024-09-13T05:10:07.302 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_client": "0/5", 2024-09-13T05:10:07.302 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_compressor": "1/5", 2024-09-13T05:10:07.302 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_context": "0/1", 2024-09-13T05:10:07.302 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_crush": "1/1", 2024-09-13T05:10:07.302 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_crypto": "1/5", 2024-09-13T05:10:07.302 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_cyanstore": "0/5", 2024-09-13T05:10:07.302 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_deliberately_leak_memory": "false", 2024-09-13T05:10:07.302 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_disable_randomized_ping": "false", 2024-09-13T05:10:07.302 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_dpdk": "1/5", 2024-09-13T05:10:07.302 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_eventtrace": "1/5", 2024-09-13T05:10:07.302 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_filer": "0/1", 2024-09-13T05:10:07.302 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_filestore": "1/3", 2024-09-13T05:10:07.302 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_finisher": "1/1", 2024-09-13T05:10:07.303 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_fuse": "1/5", 2024-09-13T05:10:07.303 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_heartbeat_testing_span": "0", 2024-09-13T05:10:07.303 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_heartbeatmap": "1/5", 2024-09-13T05:10:07.303 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-13T05:10:07.303 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_javaclient": "1/5", 2024-09-13T05:10:07.303 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_journal": "1/3", 2024-09-13T05:10:07.303 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_journaler": "0/5", 2024-09-13T05:10:07.303 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_kstore": "1/5", 2024-09-13T05:10:07.303 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_leveldb": "4/5", 2024-09-13T05:10:07.303 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_lockdep": "0/1", 2024-09-13T05:10:07.303 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_mclock": "1/5", 2024-09-13T05:10:07.303 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_mds": "1/5", 2024-09-13T05:10:07.303 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_mds_balancer": "1/5", 2024-09-13T05:10:07.304 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_mds_locker": "1/5", 2024-09-13T05:10:07.304 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_mds_log": "1/5", 2024-09-13T05:10:07.304 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_mds_log_expire": "1/5", 2024-09-13T05:10:07.304 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_mds_migrator": "1/5", 2024-09-13T05:10:07.304 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_memstore": "1/5", 2024-09-13T05:10:07.304 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_mgr": "2/5", 2024-09-13T05:10:07.304 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_mgrc": "1/5", 2024-09-13T05:10:07.304 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_mon": "20/20", 2024-09-13T05:10:07.304 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_monc": "0/10", 2024-09-13T05:10:07.304 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_ms": "1/1", 2024-09-13T05:10:07.304 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_none": "0/5", 2024-09-13T05:10:07.304 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_objclass": "0/5", 2024-09-13T05:10:07.304 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_objectcacher": "0/5", 2024-09-13T05:10:07.305 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_objecter": "0/1", 2024-09-13T05:10:07.305 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_optracker": "0/5", 2024-09-13T05:10:07.305 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_osd": "1/5", 2024-09-13T05:10:07.305 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_paxos": "20/20", 2024-09-13T05:10:07.305 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_perfcounter": "1/5", 2024-09-13T05:10:07.305 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_prioritycache": "1/5", 2024-09-13T05:10:07.305 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_rados": "0/5", 2024-09-13T05:10:07.305 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_rbd": "0/5", 2024-09-13T05:10:07.305 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_rbd_mirror": "0/5", 2024-09-13T05:10:07.305 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_rbd_pwl": "0/5", 2024-09-13T05:10:07.305 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_rbd_replay": "0/5", 2024-09-13T05:10:07.305 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_refs": "0/0", 2024-09-13T05:10:07.305 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_reserver": "1/1", 2024-09-13T05:10:07.306 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_rgw": "1/5", 2024-09-13T05:10:07.306 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_rgw_access": "1/5", 2024-09-13T05:10:07.306 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_rgw_datacache": "1/5", 2024-09-13T05:10:07.306 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_rgw_dbstore": "1/5", 2024-09-13T05:10:07.306 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_rgw_flight": "1/5", 2024-09-13T05:10:07.306 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_rgw_sync": "1/5", 2024-09-13T05:10:07.306 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_rocksdb": "4/5", 2024-09-13T05:10:07.306 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_seastore": "0/5", 2024-09-13T05:10:07.306 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_seastore_backref": "0/5", 2024-09-13T05:10:07.306 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_seastore_cache": "0/5", 2024-09-13T05:10:07.306 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_seastore_cleaner": "0/5", 2024-09-13T05:10:07.306 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_seastore_device": "0/5", 2024-09-13T05:10:07.306 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_seastore_epm": "0/5", 2024-09-13T05:10:07.306 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-13T05:10:07.307 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_seastore_journal": "0/5", 2024-09-13T05:10:07.307 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_seastore_lba": "0/5", 2024-09-13T05:10:07.307 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_seastore_odata": "0/5", 2024-09-13T05:10:07.307 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_seastore_omap": "0/5", 2024-09-13T05:10:07.307 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_seastore_onode": "0/5", 2024-09-13T05:10:07.307 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_seastore_t": "0/5", 2024-09-13T05:10:07.307 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_seastore_tm": "0/5", 2024-09-13T05:10:07.307 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_striper": "0/1", 2024-09-13T05:10:07.307 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_test": "0/5", 2024-09-13T05:10:07.307 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_throttle": "1/1", 2024-09-13T05:10:07.307 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_timer": "0/1", 2024-09-13T05:10:07.307 INFO:teuthology.orchestra.run.smithi120.stdout: "debug_tp": "0/5", 2024-09-13T05:10:07.307 INFO:teuthology.orchestra.run.smithi120.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-13T05:10:07.307 INFO:teuthology.orchestra.run.smithi120.stdout: "device_failure_prediction_mode": "none", 2024-09-13T05:10:07.308 INFO:teuthology.orchestra.run.smithi120.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-13T05:10:07.308 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-13T05:10:07.308 INFO:teuthology.orchestra.run.smithi120.stdout: "err_to_graylog": "false", 2024-09-13T05:10:07.308 INFO:teuthology.orchestra.run.smithi120.stdout: "err_to_journald": "false", 2024-09-13T05:10:07.308 INFO:teuthology.orchestra.run.smithi120.stdout: "err_to_stderr": "true", 2024-09-13T05:10:07.308 INFO:teuthology.orchestra.run.smithi120.stdout: "err_to_syslog": "false", 2024-09-13T05:10:07.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event_tracing": "false", 2024-09-13T05:10:07.308 INFO:teuthology.orchestra.run.smithi120.stdout: "exporter_addr": "0.0.0.0", 2024-09-13T05:10:07.308 INFO:teuthology.orchestra.run.smithi120.stdout: "exporter_http_port": "9926", 2024-09-13T05:10:07.308 INFO:teuthology.orchestra.run.smithi120.stdout: "exporter_prio_limit": "5", 2024-09-13T05:10:07.308 INFO:teuthology.orchestra.run.smithi120.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-13T05:10:07.308 INFO:teuthology.orchestra.run.smithi120.stdout: "exporter_sort_metrics": "true", 2024-09-13T05:10:07.308 INFO:teuthology.orchestra.run.smithi120.stdout: "exporter_stats_period": "5", 2024-09-13T05:10:07.309 INFO:teuthology.orchestra.run.smithi120.stdout: "fake_statfs_for_testing": "0", 2024-09-13T05:10:07.309 INFO:teuthology.orchestra.run.smithi120.stdout: "fatal_signal_handlers": "true", 2024-09-13T05:10:07.309 INFO:teuthology.orchestra.run.smithi120.stdout: "filer_max_purge_ops": "10", 2024-09-13T05:10:07.309 INFO:teuthology.orchestra.run.smithi120.stdout: "filer_max_truncate_ops": "128", 2024-09-13T05:10:07.309 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_apply_finisher_threads": "1", 2024-09-13T05:10:07.309 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_blackhole": "false", 2024-09-13T05:10:07.309 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_btrfs_clone_range": "true", 2024-09-13T05:10:07.309 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_btrfs_snap": "true", 2024-09-13T05:10:07.309 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_caller_concurrency": "10", 2024-09-13T05:10:07.309 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_collect_device_partition_information": "true", 2024-09-13T05:10:07.309 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_commit_timeout": "600.000000", 2024-09-13T05:10:07.309 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_debug_inject_read_err": "false", 2024-09-13T05:10:07.309 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_debug_omap_check": "false", 2024-09-13T05:10:07.310 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-13T05:10:07.310 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_debug_verify_split": "false", 2024-09-13T05:10:07.310 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_dump_file": "", 2024-09-13T05:10:07.310 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-13T05:10:07.310 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-13T05:10:07.310 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_fadvise": "true", 2024-09-13T05:10:07.310 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_fail_eio": "true", 2024-09-13T05:10:07.310 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_fd_cache_shards": "16", 2024-09-13T05:10:07.310 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_fd_cache_size": "128", 2024-09-13T05:10:07.310 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_fiemap": "false", 2024-09-13T05:10:07.310 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_fiemap_threshold": "4096", 2024-09-13T05:10:07.310 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-13T05:10:07.310 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-13T05:10:07.311 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_inject_stall": "0", 2024-09-13T05:10:07.311 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_journal_parallel": "false", 2024-09-13T05:10:07.311 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_journal_trailing": "false", 2024-09-13T05:10:07.311 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_journal_writeahead": "false", 2024-09-13T05:10:07.311 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_kill_at": "0", 2024-09-13T05:10:07.311 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-13T05:10:07.311 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-13T05:10:07.311 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-13T05:10:07.311 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-13T05:10:07.311 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-13T05:10:07.311 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_max_inline_xattrs": "0", 2024-09-13T05:10:07.311 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-13T05:10:07.311 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-13T05:10:07.312 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-13T05:10:07.312 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-13T05:10:07.312 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_max_xattr_value_size": "0", 2024-09-13T05:10:07.312 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-13T05:10:07.312 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-13T05:10:07.312 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-13T05:10:07.312 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_merge_threshold": "-10", 2024-09-13T05:10:07.312 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-13T05:10:07.312 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_odsync_write": "false", 2024-09-13T05:10:07.312 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_omap_backend": "rocksdb", 2024-09-13T05:10:07.312 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_omap_backend_path": "", 2024-09-13T05:10:07.312 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-13T05:10:07.312 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-13T05:10:07.313 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-13T05:10:07.313 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_op_thread_timeout": "60", 2024-09-13T05:10:07.313 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_op_threads": "2", 2024-09-13T05:10:07.313 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_punch_hole": "false", 2024-09-13T05:10:07.313 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-13T05:10:07.313 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-13T05:10:07.313 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-13T05:10:07.313 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-13T05:10:07.313 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-13T05:10:07.313 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-13T05:10:07.313 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-13T05:10:07.313 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-13T05:10:07.313 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-13T05:10:07.313 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_queue_max_ops": "50", 2024-09-13T05:10:07.314 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-13T05:10:07.314 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_seek_data_hole": "false", 2024-09-13T05:10:07.314 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_sloppy_crc": "false", 2024-09-13T05:10:07.314 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-13T05:10:07.314 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_splice": "false", 2024-09-13T05:10:07.314 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_split_multiple": "2", 2024-09-13T05:10:07.314 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_split_rand_factor": "20", 2024-09-13T05:10:07.314 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_update_to": "1000", 2024-09-13T05:10:07.314 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-13T05:10:07.314 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-13T05:10:07.314 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-13T05:10:07.314 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-13T05:10:07.314 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-13T05:10:07.315 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-13T05:10:07.315 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_wbthrottle_enable": "true", 2024-09-13T05:10:07.315 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-13T05:10:07.315 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-13T05:10:07.315 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-13T05:10:07.315 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-13T05:10:07.315 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-13T05:10:07.315 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-13T05:10:07.315 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_xfs_extsize": "false", 2024-09-13T05:10:07.315 INFO:teuthology.orchestra.run.smithi120.stdout: "filestore_zfs_snap": "false", 2024-09-13T05:10:07.315 INFO:teuthology.orchestra.run.smithi120.stdout: "fio_dir": "/tmp/fio", 2024-09-13T05:10:07.315 INFO:teuthology.orchestra.run.smithi120.stdout: "fsid": "0a3759da-62bd-4704-8a4a-7c20eb3fc816", 2024-09-13T05:10:07.315 INFO:teuthology.orchestra.run.smithi120.stdout: "fuse_allow_other": "true", 2024-09-13T05:10:07.316 INFO:teuthology.orchestra.run.smithi120.stdout: "fuse_atomic_o_trunc": "true", 2024-09-13T05:10:07.316 INFO:teuthology.orchestra.run.smithi120.stdout: "fuse_big_writes": "true", 2024-09-13T05:10:07.316 INFO:teuthology.orchestra.run.smithi120.stdout: "fuse_debug": "false", 2024-09-13T05:10:07.316 INFO:teuthology.orchestra.run.smithi120.stdout: "fuse_default_permissions": "false", 2024-09-13T05:10:07.316 INFO:teuthology.orchestra.run.smithi120.stdout: "fuse_disable_pagecache": "false", 2024-09-13T05:10:07.316 INFO:teuthology.orchestra.run.smithi120.stdout: "fuse_max_write": "0", 2024-09-13T05:10:07.316 INFO:teuthology.orchestra.run.smithi120.stdout: "fuse_multithreaded": "true", 2024-09-13T05:10:07.316 INFO:teuthology.orchestra.run.smithi120.stdout: "fuse_require_active_mds": "true", 2024-09-13T05:10:07.316 INFO:teuthology.orchestra.run.smithi120.stdout: "fuse_set_user_groups": "true", 2024-09-13T05:10:07.316 INFO:teuthology.orchestra.run.smithi120.stdout: "fuse_splice_move": "true", 2024-09-13T05:10:07.316 INFO:teuthology.orchestra.run.smithi120.stdout: "fuse_splice_read": "true", 2024-09-13T05:10:07.316 INFO:teuthology.orchestra.run.smithi120.stdout: "fuse_splice_write": "true", 2024-09-13T05:10:07.316 INFO:teuthology.orchestra.run.smithi120.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-13T05:10:07.316 INFO:teuthology.orchestra.run.smithi120.stdout: "fuse_use_invalidate_cb": "true", 2024-09-13T05:10:07.317 INFO:teuthology.orchestra.run.smithi120.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-13T05:10:07.317 INFO:teuthology.orchestra.run.smithi120.stdout: "gss_target_name": "ceph", 2024-09-13T05:10:07.317 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_file": "", 2024-09-13T05:10:07.317 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_inject_failure": "0", 2024-09-13T05:10:07.317 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_interval": "5", 2024-09-13T05:10:07.317 INFO:teuthology.orchestra.run.smithi120.stdout: "host": "smithi120", 2024-09-13T05:10:07.317 INFO:teuthology.orchestra.run.smithi120.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-13T05:10:07.317 INFO:teuthology.orchestra.run.smithi120.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-13T05:10:07.317 INFO:teuthology.orchestra.run.smithi120.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-13T05:10:07.317 INFO:teuthology.orchestra.run.smithi120.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-13T05:10:07.317 INFO:teuthology.orchestra.run.smithi120.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-13T05:10:07.317 INFO:teuthology.orchestra.run.smithi120.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-13T05:10:07.317 INFO:teuthology.orchestra.run.smithi120.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-13T05:10:07.318 INFO:teuthology.orchestra.run.smithi120.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-13T05:10:07.318 INFO:teuthology.orchestra.run.smithi120.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-13T05:10:07.318 INFO:teuthology.orchestra.run.smithi120.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-13T05:10:07.318 INFO:teuthology.orchestra.run.smithi120.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-13T05:10:07.318 INFO:teuthology.orchestra.run.smithi120.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-13T05:10:07.318 INFO:teuthology.orchestra.run.smithi120.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-13T05:10:07.318 INFO:teuthology.orchestra.run.smithi120.stdout: "inject_early_sigterm": "false", 2024-09-13T05:10:07.318 INFO:teuthology.orchestra.run.smithi120.stdout: "jaeger_agent_port": "6799", 2024-09-13T05:10:07.318 INFO:teuthology.orchestra.run.smithi120.stdout: "jaeger_tracing_enable": "false", 2024-09-13T05:10:07.318 INFO:teuthology.orchestra.run.smithi120.stdout: "journal_aio": "true", 2024-09-13T05:10:07.318 INFO:teuthology.orchestra.run.smithi120.stdout: "journal_align_min_size": "65536", 2024-09-13T05:10:07.318 INFO:teuthology.orchestra.run.smithi120.stdout: "journal_block_align": "true", 2024-09-13T05:10:07.318 INFO:teuthology.orchestra.run.smithi120.stdout: "journal_block_size": "4096", 2024-09-13T05:10:07.319 INFO:teuthology.orchestra.run.smithi120.stdout: "journal_dio": "true", 2024-09-13T05:10:07.319 INFO:teuthology.orchestra.run.smithi120.stdout: "journal_discard": "false", 2024-09-13T05:10:07.319 INFO:teuthology.orchestra.run.smithi120.stdout: "journal_force_aio": "false", 2024-09-13T05:10:07.319 INFO:teuthology.orchestra.run.smithi120.stdout: "journal_ignore_corruption": "false", 2024-09-13T05:10:07.319 INFO:teuthology.orchestra.run.smithi120.stdout: "journal_max_write_bytes": "10485760", 2024-09-13T05:10:07.319 INFO:teuthology.orchestra.run.smithi120.stdout: "journal_max_write_entries": "100", 2024-09-13T05:10:07.319 INFO:teuthology.orchestra.run.smithi120.stdout: "journal_replay_from": "0", 2024-09-13T05:10:07.319 INFO:teuthology.orchestra.run.smithi120.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-13T05:10:07.319 INFO:teuthology.orchestra.run.smithi120.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-13T05:10:07.319 INFO:teuthology.orchestra.run.smithi120.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-13T05:10:07.320 INFO:teuthology.orchestra.run.smithi120.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-13T05:10:07.320 INFO:teuthology.orchestra.run.smithi120.stdout: "journal_write_header_frequency": "0", 2024-09-13T05:10:07.320 INFO:teuthology.orchestra.run.smithi120.stdout: "journal_zero_on_create": "false", 2024-09-13T05:10:07.320 INFO:teuthology.orchestra.run.smithi120.stdout: "journaler_prefetch_periods": "10", 2024-09-13T05:10:07.320 INFO:teuthology.orchestra.run.smithi120.stdout: "journaler_prezero_periods": "5", 2024-09-13T05:10:07.320 INFO:teuthology.orchestra.run.smithi120.stdout: "journaler_write_head_interval": "15", 2024-09-13T05:10:07.320 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "", 2024-09-13T05:10:07.320 INFO:teuthology.orchestra.run.smithi120.stdout: "keyfile": "", 2024-09-13T05:10:07.320 INFO:teuthology.orchestra.run.smithi120.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-13T05:10:07.320 INFO:teuthology.orchestra.run.smithi120.stdout: "kstore_backend": "rocksdb", 2024-09-13T05:10:07.320 INFO:teuthology.orchestra.run.smithi120.stdout: "kstore_default_stripe_size": "65536", 2024-09-13T05:10:07.320 INFO:teuthology.orchestra.run.smithi120.stdout: "kstore_fsck_on_mount": "false", 2024-09-13T05:10:07.320 INFO:teuthology.orchestra.run.smithi120.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-13T05:10:07.320 INFO:teuthology.orchestra.run.smithi120.stdout: "kstore_max_bytes": "67108864", 2024-09-13T05:10:07.321 INFO:teuthology.orchestra.run.smithi120.stdout: "kstore_max_ops": "512", 2024-09-13T05:10:07.321 INFO:teuthology.orchestra.run.smithi120.stdout: "kstore_nid_prealloc": "1024", 2024-09-13T05:10:07.321 INFO:teuthology.orchestra.run.smithi120.stdout: "kstore_onode_map_size": "1024", 2024-09-13T05:10:07.321 INFO:teuthology.orchestra.run.smithi120.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-13T05:10:07.321 INFO:teuthology.orchestra.run.smithi120.stdout: "kstore_sync_submit_transaction": "false", 2024-09-13T05:10:07.321 INFO:teuthology.orchestra.run.smithi120.stdout: "kstore_sync_transaction": "false", 2024-09-13T05:10:07.321 INFO:teuthology.orchestra.run.smithi120.stdout: "leveldb_block_size": "65536", 2024-09-13T05:10:07.321 INFO:teuthology.orchestra.run.smithi120.stdout: "leveldb_bloom_size": "0", 2024-09-13T05:10:07.321 INFO:teuthology.orchestra.run.smithi120.stdout: "leveldb_cache_size": "536870912", 2024-09-13T05:10:07.321 INFO:teuthology.orchestra.run.smithi120.stdout: "leveldb_compact_on_mount": "false", 2024-09-13T05:10:07.321 INFO:teuthology.orchestra.run.smithi120.stdout: "leveldb_compression": "false", 2024-09-13T05:10:07.321 INFO:teuthology.orchestra.run.smithi120.stdout: "leveldb_log": "", 2024-09-13T05:10:07.321 INFO:teuthology.orchestra.run.smithi120.stdout: "leveldb_log_to_ceph_log": "true", 2024-09-13T05:10:07.322 INFO:teuthology.orchestra.run.smithi120.stdout: "leveldb_max_open_files": "0", 2024-09-13T05:10:07.322 INFO:teuthology.orchestra.run.smithi120.stdout: "leveldb_paranoid": "false", 2024-09-13T05:10:07.322 INFO:teuthology.orchestra.run.smithi120.stdout: "leveldb_write_buffer_size": "33554432", 2024-09-13T05:10:07.322 INFO:teuthology.orchestra.run.smithi120.stdout: "librados_thread_count": "2", 2024-09-13T05:10:07.322 INFO:teuthology.orchestra.run.smithi120.stdout: "lockdep": "false", 2024-09-13T05:10:07.322 INFO:teuthology.orchestra.run.smithi120.stdout: "lockdep_force_backtrace": "false", 2024-09-13T05:10:07.322 INFO:teuthology.orchestra.run.smithi120.stdout: "log_coarse_timestamps": "true", 2024-09-13T05:10:07.322 INFO:teuthology.orchestra.run.smithi120.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-13T05:10:07.322 INFO:teuthology.orchestra.run.smithi120.stdout: "log_flush_on_exit": "false", 2024-09-13T05:10:07.322 INFO:teuthology.orchestra.run.smithi120.stdout: "log_graylog_host": "127.0.0.1", 2024-09-13T05:10:07.322 INFO:teuthology.orchestra.run.smithi120.stdout: "log_graylog_port": "12201", 2024-09-13T05:10:07.322 INFO:teuthology.orchestra.run.smithi120.stdout: "log_max_new": "1000", 2024-09-13T05:10:07.322 INFO:teuthology.orchestra.run.smithi120.stdout: "log_max_recent": "10000", 2024-09-13T05:10:07.322 INFO:teuthology.orchestra.run.smithi120.stdout: "log_stderr_prefix": "", 2024-09-13T05:10:07.323 INFO:teuthology.orchestra.run.smithi120.stdout: "log_stop_at_utilization": "0.970000", 2024-09-13T05:10:07.323 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": "true", 2024-09-13T05:10:07.323 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_graylog": "false", 2024-09-13T05:10:07.323 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_journald": "false", 2024-09-13T05:10:07.323 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_stderr": "false", 2024-09-13T05:10:07.323 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_syslog": "false", 2024-09-13T05:10:07.323 INFO:teuthology.orchestra.run.smithi120.stdout: "max_rotating_auth_attempts": "10", 2024-09-13T05:10:07.323 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-13T05:10:07.323 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_action_on_write_error": "1", 2024-09-13T05:10:07.323 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_alternate_name_max": "8192", 2024-09-13T05:10:07.323 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_asio_thread_count": "2", 2024-09-13T05:10:07.323 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_export_pin": "true", 2024-09-13T05:10:07.323 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_fragment_dirs": "true", 2024-09-13T05:10:07.323 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-13T05:10:07.324 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_fragment_interval": "5", 2024-09-13T05:10:07.324 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-13T05:10:07.324 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-13T05:10:07.324 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_interval": "10", 2024-09-13T05:10:07.324 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_max": "-1", 2024-09-13T05:10:07.324 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_max_until": "-1", 2024-09-13T05:10:07.324 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_merge_size": "50", 2024-09-13T05:10:07.324 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_midchunk": "0.300000", 2024-09-13T05:10:07.324 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-13T05:10:07.324 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_min_start": "0.200000", 2024-09-13T05:10:07.324 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_minchunk": "0.001000", 2024-09-13T05:10:07.324 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_mode": "0", 2024-09-13T05:10:07.324 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_need_max": "1.200000", 2024-09-13T05:10:07.325 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_need_min": "0.800000", 2024-09-13T05:10:07.325 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-13T05:10:07.325 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-13T05:10:07.325 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_split_bits": "3", 2024-09-13T05:10:07.325 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-13T05:10:07.325 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_split_size": "10000", 2024-09-13T05:10:07.325 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-13T05:10:07.325 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_target_decay": "10.000000", 2024-09-13T05:10:07.325 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-13T05:10:07.325 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_beacon_grace": "15.000000", 2024-09-13T05:10:07.325 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_beacon_interval": "4.000000", 2024-09-13T05:10:07.325 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-13T05:10:07.326 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-13T05:10:07.326 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_cache_mid": "0.700000", 2024-09-13T05:10:07.326 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_cache_release_free_interval": "10", 2024-09-13T05:10:07.326 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_cache_reservation": "0.050000", 2024-09-13T05:10:07.326 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-13T05:10:07.326 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_cache_trim_interval": "1", 2024-09-13T05:10:07.326 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_cache_trim_threshold": "262144", 2024-09-13T05:10:07.326 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-13T05:10:07.326 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-13T05:10:07.326 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-13T05:10:07.326 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_client_prealloc_inos": "1000", 2024-09-13T05:10:07.326 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-13T05:10:07.326 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_connect_bootstrapping": "false", 2024-09-13T05:10:07.326 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_damage_table_max_entries": "10000", 2024-09-13T05:10:07.327 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-13T05:10:07.327 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_debug_auth_pins": "false", 2024-09-13T05:10:07.327 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_debug_frag": "false", 2024-09-13T05:10:07.327 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_debug_scatterstat": "false", 2024-09-13T05:10:07.327 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_debug_subtrees": "false", 2024-09-13T05:10:07.327 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_decay_halflife": "5.000000", 2024-09-13T05:10:07.327 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_default_dir_hash": "2", 2024-09-13T05:10:07.327 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_defer_session_stale": "true", 2024-09-13T05:10:07.327 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_deny_all_reconnect": "false", 2024-09-13T05:10:07.327 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_dir_keys_per_op": "16384", 2024-09-13T05:10:07.327 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_dir_max_commit_size": "10", 2024-09-13T05:10:07.327 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_dir_max_entries": "0", 2024-09-13T05:10:07.327 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_dir_prefetch": "true", 2024-09-13T05:10:07.328 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-13T05:10:07.328 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-13T05:10:07.328 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_dump_cache_on_map": "false", 2024-09-13T05:10:07.328 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-13T05:10:07.328 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-13T05:10:07.328 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_early_reply": "true", 2024-09-13T05:10:07.328 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_enable_op_tracker": "true", 2024-09-13T05:10:07.328 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_enforce_unique_name": "true", 2024-09-13T05:10:07.328 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-13T05:10:07.328 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-13T05:10:07.328 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_export_ephemeral_random": "true", 2024-09-13T05:10:07.328 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-13T05:10:07.328 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-13T05:10:07.329 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-13T05:10:07.329 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-13T05:10:07.329 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-13T05:10:07.329 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-13T05:10:07.329 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-13T05:10:07.329 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-13T05:10:07.329 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_health_summarize_threshold": "10", 2024-09-13T05:10:07.329 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-13T05:10:07.329 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-13T05:10:07.329 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_inject_health_dummy": "false", 2024-09-13T05:10:07.329 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-13T05:10:07.329 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_inject_migrator_session_race": "false", 2024-09-13T05:10:07.330 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-13T05:10:07.330 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-13T05:10:07.330 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-13T05:10:07.330 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_join_fs": "", 2024-09-13T05:10:07.330 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_journal_format": "1", 2024-09-13T05:10:07.330 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-13T05:10:07.330 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_kill_create_at": "0", 2024-09-13T05:10:07.330 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_kill_export_at": "0", 2024-09-13T05:10:07.330 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_kill_import_at": "0", 2024-09-13T05:10:07.330 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_kill_journal_at": "0", 2024-09-13T05:10:07.330 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_kill_journal_expire_at": "0", 2024-09-13T05:10:07.330 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_kill_journal_replay_at": "0", 2024-09-13T05:10:07.330 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_kill_link_at": "0", 2024-09-13T05:10:07.331 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_kill_mdstable_at": "0", 2024-09-13T05:10:07.331 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_kill_openc_at": "0", 2024-09-13T05:10:07.331 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_kill_rename_at": "0", 2024-09-13T05:10:07.331 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_log_events_per_segment": "1024", 2024-09-13T05:10:07.331 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_log_max_events": "-1", 2024-09-13T05:10:07.331 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_log_max_segments": "128", 2024-09-13T05:10:07.331 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_log_pause": "false", 2024-09-13T05:10:07.331 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_log_segment_size": "0", 2024-09-13T05:10:07.331 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-13T05:10:07.331 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_log_warn_factor": "2.000000", 2024-09-13T05:10:07.331 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_max_caps_per_client": "1048576", 2024-09-13T05:10:07.331 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_max_completed_flushes": "100000", 2024-09-13T05:10:07.331 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_max_completed_requests": "100000", 2024-09-13T05:10:07.332 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_max_export_size": "20971520", 2024-09-13T05:10:07.332 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_max_file_recover": "32", 2024-09-13T05:10:07.332 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_max_purge_files": "64", 2024-09-13T05:10:07.332 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_max_purge_ops": "8192", 2024-09-13T05:10:07.332 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-13T05:10:07.332 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-13T05:10:07.332 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_max_snaps_per_dir": "100", 2024-09-13T05:10:07.332 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_metrics_update_interval": "2", 2024-09-13T05:10:07.332 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_min_caps_per_client": "100", 2024-09-13T05:10:07.332 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_min_caps_working_set": "10000", 2024-09-13T05:10:07.332 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-13T05:10:07.332 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_numa_node": "-1", 2024-09-13T05:10:07.332 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-13T05:10:07.332 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_op_complaint_time": "30.000000", 2024-09-13T05:10:07.333 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_op_history_duration": "600", 2024-09-13T05:10:07.333 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_op_history_size": "20", 2024-09-13T05:10:07.333 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_op_history_slow_op_size": "20", 2024-09-13T05:10:07.333 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-13T05:10:07.333 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_op_log_threshold": "5", 2024-09-13T05:10:07.333 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_ping_grace": "15", 2024-09-13T05:10:07.333 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_ping_interval": "5", 2024-09-13T05:10:07.333 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-13T05:10:07.333 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-13T05:10:07.333 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_recall_max_caps": "30000", 2024-09-13T05:10:07.333 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-13T05:10:07.333 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-13T05:10:07.333 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-13T05:10:07.334 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_recall_warning_threshold": "262144", 2024-09-13T05:10:07.334 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-13T05:10:07.334 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_replay_interval": "1.000000", 2024-09-13T05:10:07.334 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-13T05:10:07.334 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-13T05:10:07.334 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_root_ino_gid": "0", 2024-09-13T05:10:07.334 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_root_ino_uid": "0", 2024-09-13T05:10:07.334 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-13T05:10:07.334 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-13T05:10:07.334 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-13T05:10:07.334 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-13T05:10:07.334 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-13T05:10:07.334 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-13T05:10:07.334 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-13T05:10:07.335 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-13T05:10:07.335 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-13T05:10:07.335 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-13T05:10:07.335 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_shutdown_check": "0", 2024-09-13T05:10:07.335 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_skip_ino": "0", 2024-09-13T05:10:07.335 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-13T05:10:07.335 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_snap_max_uid": "4294967294", 2024-09-13T05:10:07.335 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_snap_min_uid": "0", 2024-09-13T05:10:07.335 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_snap_rstat": "false", 2024-09-13T05:10:07.335 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_standby_replay_damaged": "false", 2024-09-13T05:10:07.335 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_symlink_recovery": "true", 2024-09-13T05:10:07.335 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-13T05:10:07.335 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_thrash_exports": "0", 2024-09-13T05:10:07.335 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_thrash_fragments": "0", 2024-09-13T05:10:07.336 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_tick_interval": "5.000000", 2024-09-13T05:10:07.336 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_valgrind_exit": "false", 2024-09-13T05:10:07.336 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_verify_backtrace": "1", 2024-09-13T05:10:07.336 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_verify_scatter": "false", 2024-09-13T05:10:07.336 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-13T05:10:07.336 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_wipe_sessions": "false", 2024-09-13T05:10:07.336 INFO:teuthology.orchestra.run.smithi120.stdout: "mempool_debug": "false", 2024-09-13T05:10:07.336 INFO:teuthology.orchestra.run.smithi120.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-13T05:10:07.336 INFO:teuthology.orchestra.run.smithi120.stdout: "memstore_device_bytes": "1073741824", 2024-09-13T05:10:07.336 INFO:teuthology.orchestra.run.smithi120.stdout: "memstore_page_set": "false", 2024-09-13T05:10:07.336 INFO:teuthology.orchestra.run.smithi120.stdout: "memstore_page_size": "65536", 2024-09-13T05:10:07.336 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_client_bytes": "134217728", 2024-09-13T05:10:07.337 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_client_messages": "512", 2024-09-13T05:10:07.337 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-13T05:10:07.337 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-13T05:10:07.337 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-13T05:10:07.337 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-13T05:10:07.337 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_disabled_modules": "", 2024-09-13T05:10:07.337 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-13T05:10:07.337 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_max_pg_num_change": "128", 2024-09-13T05:10:07.337 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_mds_bytes": "134217728", 2024-09-13T05:10:07.337 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_mds_messages": "128", 2024-09-13T05:10:07.337 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-13T05:10:07.337 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_mon_bytes": "134217728", 2024-09-13T05:10:07.337 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_mon_messages": "128", 2024-09-13T05:10:07.337 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_osd_bytes": "536870912", 2024-09-13T05:10:07.338 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_osd_messages": "8192", 2024-09-13T05:10:07.338 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_pool": "true", 2024-09-13T05:10:07.338 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-13T05:10:07.338 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_standby_modules": "true", 2024-09-13T05:10:07.338 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_stats_period": "5", 2024-09-13T05:10:07.338 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_stats_threshold": "5", 2024-09-13T05:10:07.338 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_tick_period": "2", 2024-09-13T05:10:07.338 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-13T05:10:07.338 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-13T05:10:07.338 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_allow_pool_delete": "true", 2024-09-13T05:10:07.338 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_allow_pool_size_one": "true", 2024-09-13T05:10:07.338 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_auth_validate_all_caps": "true", 2024-09-13T05:10:07.338 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-13T05:10:07.339 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-13T05:10:07.339 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_client_bytes": "104857600", 2024-09-13T05:10:07.339 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_client_directed_command_retry": "5", 2024-09-13T05:10:07.339 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-13T05:10:07.339 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-13T05:10:07.339 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-13T05:10:07.339 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-13T05:10:07.339 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_client_hunt_parallel": "3", 2024-09-13T05:10:07.339 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_client_log_interval": "1.000000", 2024-09-13T05:10:07.339 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-13T05:10:07.339 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_client_ping_interval": "10.000000", 2024-09-13T05:10:07.339 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-13T05:10:07.339 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-13T05:10:07.339 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-13T05:10:07.340 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-13T05:10:07.340 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_cluster_log_file_level": "debug", 2024-09-13T05:10:07.340 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_cluster_log_to_file": "true", 2024-09-13T05:10:07.340 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-13T05:10:07.340 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-13T05:10:07.340 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-13T05:10:07.340 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_cluster_log_to_journald": "false", 2024-09-13T05:10:07.340 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-13T05:10:07.340 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-13T05:10:07.340 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-13T05:10:07.340 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-13T05:10:07.340 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_compact_on_bootstrap": "false", 2024-09-13T05:10:07.340 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_compact_on_start": "false", 2024-09-13T05:10:07.341 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_compact_on_trim": "true", 2024-09-13T05:10:07.341 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-13T05:10:07.341 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-13T05:10:07.341 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-13T05:10:07.341 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_cpu_threads": "4", 2024-09-13T05:10:07.341 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_crush_min_required_version": "hammer", 2024-09-13T05:10:07.341 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_daemon_bytes": "419430400", 2024-09-13T05:10:07.341 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-13T05:10:07.341 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_data_avail_crit": "5", 2024-09-13T05:10:07.341 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_data_avail_warn": "5", 2024-09-13T05:10:07.341 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_data_size_warn": "16106127360", 2024-09-13T05:10:07.341 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-13T05:10:07.341 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-13T05:10:07.341 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_debug_dump_json": "false", 2024-09-13T05:10:07.342 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-13T05:10:07.342 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_debug_dump_transactions": "false", 2024-09-13T05:10:07.342 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_debug_extra_checks": "false", 2024-09-13T05:10:07.342 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-13T05:10:07.342 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-13T05:10:07.342 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_debug_no_require_quincy": "false", 2024-09-13T05:10:07.342 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_debug_no_require_reef": "false", 2024-09-13T05:10:07.342 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-13T05:10:07.342 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-13T05:10:07.342 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-13T05:10:07.342 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_down_mkfs_grace": "120", 2024-09-13T05:10:07.342 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_election_default_strategy": "1", 2024-09-13T05:10:07.342 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_election_timeout": "5.000000", 2024-09-13T05:10:07.342 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-13T05:10:07.343 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_elector_ping_divisor": "2", 2024-09-13T05:10:07.343 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-13T05:10:07.343 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_enable_op_tracker": "true", 2024-09-13T05:10:07.343 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_fake_pool_delete": "false", 2024-09-13T05:10:07.343 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_force_quorum_join": "false", 2024-09-13T05:10:07.343 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_globalid_prealloc": "10000", 2024-09-13T05:10:07.343 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_health_detail_to_clog": "false", 2024-09-13T05:10:07.343 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_health_log_update_period": "5", 2024-09-13T05:10:07.343 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_health_max_detail": "50", 2024-09-13T05:10:07.343 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_health_to_clog": "true", 2024-09-13T05:10:07.343 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_health_to_clog_interval": "600", 2024-09-13T05:10:07.343 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-13T05:10:07.343 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_host": "172.21.15.120,[v2:172.21.15.120:3301,v1:172.21.15.120:6790],172.21.15.137", 2024-09-13T05:10:07.344 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_host_override": "", 2024-09-13T05:10:07.344 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_initial_members": "", 2024-09-13T05:10:07.344 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-13T05:10:07.344 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-13T05:10:07.344 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-13T05:10:07.344 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-13T05:10:07.344 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-13T05:10:07.344 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_lease": "5.000000", 2024-09-13T05:10:07.344 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-13T05:10:07.344 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-13T05:10:07.344 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_log_full_interval": "50", 2024-09-13T05:10:07.344 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_log_max": "10000", 2024-09-13T05:10:07.344 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_log_max_summary": "50", 2024-09-13T05:10:07.345 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-13T05:10:07.345 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_max_log_epochs": "500", 2024-09-13T05:10:07.345 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-13T05:10:07.345 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-13T05:10:07.345 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_max_osd": "10000", 2024-09-13T05:10:07.345 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_max_pg_per_osd": "10000", 2024-09-13T05:10:07.345 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_max_pool_pg_num": "65536", 2024-09-13T05:10:07.345 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-13T05:10:07.345 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-13T05:10:07.345 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_mds_force_trim_to": "0", 2024-09-13T05:10:07.345 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_mds_skip_sanity": "false", 2024-09-13T05:10:07.345 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_memory_autotune": "true", 2024-09-13T05:10:07.345 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_memory_target": "2147483648", 2024-09-13T05:10:07.345 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_mgr_beacon_grace": "30", 2024-09-13T05:10:07.346 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-13T05:10:07.346 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_mgr_digest_period": "5", 2024-09-13T05:10:07.346 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_mgr_inactive_grace": "60", 2024-09-13T05:10:07.346 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-13T05:10:07.346 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-13T05:10:07.346 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_min_osdmap_epochs": "500", 2024-09-13T05:10:07.346 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_op_complaint_time": "30", 2024-09-13T05:10:07.346 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_op_history_duration": "600", 2024-09-13T05:10:07.346 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_op_history_size": "20", 2024-09-13T05:10:07.346 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_op_history_slow_op_size": "20", 2024-09-13T05:10:07.346 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-13T05:10:07.346 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_op_log_threshold": "5", 2024-09-13T05:10:07.346 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-13T05:10:07.347 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-13T05:10:07.347 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-13T05:10:07.347 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_auto_mark_in": "false", 2024-09-13T05:10:07.347 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-13T05:10:07.347 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-13T05:10:07.347 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-13T05:10:07.347 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_cache_size": "500", 2024-09-13T05:10:07.347 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-13T05:10:07.347 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-13T05:10:07.347 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-13T05:10:07.347 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_down_out_interval": "600", 2024-09-13T05:10:07.347 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-13T05:10:07.347 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-13T05:10:07.348 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_force_trim_to": "0", 2024-09-13T05:10:07.348 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-13T05:10:07.348 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-13T05:10:07.348 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-13T05:10:07.348 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-13T05:10:07.348 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-13T05:10:07.348 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-13T05:10:07.348 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-13T05:10:07.348 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-13T05:10:07.348 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_min_down_reporters": "2", 2024-09-13T05:10:07.348 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-13T05:10:07.348 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-13T05:10:07.348 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-13T05:10:07.349 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-13T05:10:07.349 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-13T05:10:07.349 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-13T05:10:07.349 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_report_timeout": "900", 2024-09-13T05:10:07.349 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-13T05:10:07.349 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-13T05:10:07.349 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-13T05:10:07.349 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-13T05:10:07.349 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-13T05:10:07.349 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-13T05:10:07.349 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-13T05:10:07.349 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-13T05:10:07.349 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-13T05:10:07.349 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_pg_stuck_threshold": "60", 2024-09-13T05:10:07.350 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-13T05:10:07.350 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-13T05:10:07.350 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-13T05:10:07.350 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-13T05:10:07.350 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-13T05:10:07.350 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-13T05:10:07.350 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_probe_timeout": "2.000000", 2024-09-13T05:10:07.350 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_reweight_max_change": "0.050000", 2024-09-13T05:10:07.350 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_reweight_max_osds": "4", 2024-09-13T05:10:07.350 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-13T05:10:07.351 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-13T05:10:07.351 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-13T05:10:07.351 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-13T05:10:07.351 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-13T05:10:07.351 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_scrub_interval": "86400", 2024-09-13T05:10:07.351 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_scrub_max_keys": "100", 2024-09-13T05:10:07.351 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_scrub_timeout": "300", 2024-09-13T05:10:07.351 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_session_timeout": "300", 2024-09-13T05:10:07.351 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_smart_report_timeout": "5", 2024-09-13T05:10:07.351 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_stat_smooth_intervals": "6", 2024-09-13T05:10:07.351 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-13T05:10:07.351 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_stretch_pool_min_size": "2", 2024-09-13T05:10:07.351 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_stretch_pool_size": "4", 2024-09-13T05:10:07.351 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-13T05:10:07.352 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-13T05:10:07.352 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_sync_debug": "false", 2024-09-13T05:10:07.352 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-13T05:10:07.352 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-13T05:10:07.352 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_sync_provider_kill_at": "0", 2024-09-13T05:10:07.352 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_sync_requester_kill_at": "0", 2024-09-13T05:10:07.352 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_sync_timeout": "60.000000", 2024-09-13T05:10:07.352 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_target_pg_per_osd": "100", 2024-09-13T05:10:07.352 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_tick_interval": "5", 2024-09-13T05:10:07.352 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_timecheck_interval": "300.000000", 2024-09-13T05:10:07.352 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-13T05:10:07.352 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_use_min_delay_socket": "false", 2024-09-13T05:10:07.352 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_warn_older_version_delay": "604800", 2024-09-13T05:10:07.353 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-13T05:10:07.353 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-13T05:10:07.353 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-13T05:10:07.353 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-13T05:10:07.353 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-13T05:10:07.353 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-13T05:10:07.353 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-13T05:10:07.353 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_warn_on_misplaced": "false", 2024-09-13T05:10:07.353 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-13T05:10:07.353 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_warn_on_older_version": "true", 2024-09-13T05:10:07.353 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-13T05:10:07.353 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_warn_on_pool_no_app": "false", 2024-09-13T05:10:07.353 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-13T05:10:07.353 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-13T05:10:07.354 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-13T05:10:07.354 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-13T05:10:07.354 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-13T05:10:07.354 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-13T05:10:07.354 INFO:teuthology.orchestra.run.smithi120.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-13T05:10:07.354 INFO:teuthology.orchestra.run.smithi120.stdout: "monmap": "", 2024-09-13T05:10:07.354 INFO:teuthology.orchestra.run.smithi120.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-13T05:10:07.354 INFO:teuthology.orchestra.run.smithi120.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-13T05:10:07.354 INFO:teuthology.orchestra.run.smithi120.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-13T05:10:07.354 INFO:teuthology.orchestra.run.smithi120.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-13T05:10:07.354 INFO:teuthology.orchestra.run.smithi120.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-13T05:10:07.354 INFO:teuthology.orchestra.run.smithi120.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-13T05:10:07.354 INFO:teuthology.orchestra.run.smithi120.stdout: "motr_tracing_enabled": "false", 2024-09-13T05:10:07.355 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_async_op_threads": "3", 2024-09-13T05:10:07.355 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-13T05:10:07.355 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_async_rdma_cm": "false", 2024-09-13T05:10:07.355 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_async_rdma_device_name": "", 2024-09-13T05:10:07.355 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_async_rdma_dscp": "96", 2024-09-13T05:10:07.355 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-13T05:10:07.355 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-13T05:10:07.355 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_async_rdma_local_gid": "", 2024-09-13T05:10:07.355 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-13T05:10:07.355 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_async_rdma_port_num": "1", 2024-09-13T05:10:07.355 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-13T05:10:07.355 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-13T05:10:07.355 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-13T05:10:07.356 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-13T05:10:07.356 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_async_rdma_sl": "3", 2024-09-13T05:10:07.356 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_async_rdma_support_srq": "true", 2024-09-13T05:10:07.356 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_async_rdma_type": "ib", 2024-09-13T05:10:07.356 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_async_reap_threshold": "5", 2024-09-13T05:10:07.356 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_bind_before_connect": "false", 2024-09-13T05:10:07.356 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_bind_ipv4": "true", 2024-09-13T05:10:07.356 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_bind_ipv6": "false", 2024-09-13T05:10:07.356 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_bind_msgr1": "true", 2024-09-13T05:10:07.356 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_bind_msgr2": "true", 2024-09-13T05:10:07.356 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_bind_port_max": "7568", 2024-09-13T05:10:07.356 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_bind_port_min": "6800", 2024-09-13T05:10:07.356 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-13T05:10:07.356 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_bind_retry_count": "3", 2024-09-13T05:10:07.357 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_bind_retry_delay": "5", 2024-09-13T05:10:07.357 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_blackhole_client": "false", 2024-09-13T05:10:07.357 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_blackhole_mds": "false", 2024-09-13T05:10:07.357 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_blackhole_mgr": "false", 2024-09-13T05:10:07.357 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_blackhole_mon": "false", 2024-09-13T05:10:07.357 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_blackhole_osd": "false", 2024-09-13T05:10:07.357 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_client_mode": "crc secure", 2024-09-13T05:10:07.357 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_cluster_mode": "crc secure", 2024-09-13T05:10:07.357 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_cluster_type": "", 2024-09-13T05:10:07.357 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_compress_secure": "false", 2024-09-13T05:10:07.357 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_connection_idle_timeout": "900", 2024-09-13T05:10:07.357 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_connection_ready_timeout": "10", 2024-09-13T05:10:07.357 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_crc_data": "true", 2024-09-13T05:10:07.357 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_crc_header": "true", 2024-09-13T05:10:07.358 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_die_on_bad_msg": "false", 2024-09-13T05:10:07.358 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_die_on_bug": "true", 2024-09-13T05:10:07.358 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_die_on_old_message": "true", 2024-09-13T05:10:07.358 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_die_on_skipped_message": "false", 2024-09-13T05:10:07.358 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-13T05:10:07.358 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-13T05:10:07.358 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_dpdk_coremask": "0xF", 2024-09-13T05:10:07.358 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-13T05:10:07.358 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-13T05:10:07.358 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_dpdk_enable_tso": "true", 2024-09-13T05:10:07.358 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-13T05:10:07.358 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-13T05:10:07.358 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_dpdk_hugepages": "", 2024-09-13T05:10:07.359 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-13T05:10:07.359 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-13T05:10:07.359 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_dpdk_lro": "true", 2024-09-13T05:10:07.359 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_dpdk_memory_channel": "4", 2024-09-13T05:10:07.359 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-13T05:10:07.359 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_dpdk_pmd": "", 2024-09-13T05:10:07.359 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_dpdk_port_id": "0", 2024-09-13T05:10:07.359 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-13T05:10:07.359 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-13T05:10:07.359 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_dump_on_send": "false", 2024-09-13T05:10:07.359 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_initial_backoff": "0.200000", 2024-09-13T05:10:07.359 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_inject_delay_max": "1.000000", 2024-09-13T05:10:07.359 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-13T05:10:07.359 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_inject_delay_type": "", 2024-09-13T05:10:07.360 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-13T05:10:07.360 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_inject_network_congestion": "0", 2024-09-13T05:10:07.360 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_inject_socket_failures": "5000", 2024-09-13T05:10:07.360 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_learn_addr_from_peer": "true", 2024-09-13T05:10:07.360 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_max_accept_failures": "4", 2024-09-13T05:10:07.360 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_max_backoff": "15.000000", 2024-09-13T05:10:07.360 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_mon_client_mode": "secure crc", 2024-09-13T05:10:07.360 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-13T05:10:07.360 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_mon_service_mode": "secure crc", 2024-09-13T05:10:07.360 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_osd_compress_min_size": "1024", 2024-09-13T05:10:07.360 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_osd_compress_mode": "none", 2024-09-13T05:10:07.360 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-13T05:10:07.360 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-13T05:10:07.361 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_pq_min_cost": "65536", 2024-09-13T05:10:07.361 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_public_type": "", 2024-09-13T05:10:07.361 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_service_mode": "crc secure", 2024-09-13T05:10:07.361 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_tcp_listen_backlog": "512", 2024-09-13T05:10:07.361 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_tcp_nodelay": "true", 2024-09-13T05:10:07.361 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-13T05:10:07.361 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_tcp_rcvbuf": "0", 2024-09-13T05:10:07.361 INFO:teuthology.orchestra.run.smithi120.stdout: "ms_type": "async+posix", 2024-09-13T05:10:07.361 INFO:teuthology.orchestra.run.smithi120.stdout: "no_config_file": "false", 2024-09-13T05:10:07.361 INFO:teuthology.orchestra.run.smithi120.stdout: "objecter_completion_locks_per_session": "32", 2024-09-13T05:10:07.361 INFO:teuthology.orchestra.run.smithi120.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-13T05:10:07.361 INFO:teuthology.orchestra.run.smithi120.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-13T05:10:07.361 INFO:teuthology.orchestra.run.smithi120.stdout: "objecter_inflight_ops": "1024", 2024-09-13T05:10:07.361 INFO:teuthology.orchestra.run.smithi120.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-13T05:10:07.362 INFO:teuthology.orchestra.run.smithi120.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-13T05:10:07.362 INFO:teuthology.orchestra.run.smithi120.stdout: "objecter_tick_interval": "5.000000", 2024-09-13T05:10:07.362 INFO:teuthology.orchestra.run.smithi120.stdout: "objecter_timeout": "10.000000", 2024-09-13T05:10:07.362 INFO:teuthology.orchestra.run.smithi120.stdout: "objectstore_blackhole": "false", 2024-09-13T05:10:07.362 INFO:teuthology.orchestra.run.smithi120.stdout: "openssl_engine_opts": "", 2024-09-13T05:10:07.362 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_agent_delay_time": "5.000000", 2024-09-13T05:10:07.362 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_agent_hist_halflife": "1000", 2024-09-13T05:10:07.362 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_agent_max_low_ops": "2", 2024-09-13T05:10:07.362 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_agent_max_ops": "4", 2024-09-13T05:10:07.362 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-13T05:10:07.362 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-13T05:10:07.362 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_agent_slop": "0.020000", 2024-09-13T05:10:07.362 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-13T05:10:07.362 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-13T05:10:07.363 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_asio_thread_count": "2", 2024-09-13T05:10:07.363 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_async_recovery_min_cost": "100", 2024-09-13T05:10:07.363 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-13T05:10:07.363 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-13T05:10:07.363 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_backfill_scan_max": "512", 2024-09-13T05:10:07.363 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_backfill_scan_min": "64", 2024-09-13T05:10:07.363 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_backoff_on_degraded": "false", 2024-09-13T05:10:07.363 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_backoff_on_peering": "false", 2024-09-13T05:10:07.363 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_backoff_on_unfound": "true", 2024-09-13T05:10:07.363 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_beacon_report_interval": "300", 2024-09-13T05:10:07.363 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_bench_duration": "30", 2024-09-13T05:10:07.363 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-13T05:10:07.363 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_bench_max_block_size": "67108864", 2024-09-13T05:10:07.364 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-13T05:10:07.364 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_blkin_trace_all": "false", 2024-09-13T05:10:07.364 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-13T05:10:07.364 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-13T05:10:07.364 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-13T05:10:07.364 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-13T05:10:07.364 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_check_for_log_corruption": "false", 2024-09-13T05:10:07.364 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-13T05:10:07.364 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-13T05:10:07.364 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-13T05:10:07.364 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-13T05:10:07.364 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_class_update_on_start": "true", 2024-09-13T05:10:07.364 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_client_message_cap": "256", 2024-09-13T05:10:07.364 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_client_message_size_cap": "524288000", 2024-09-13T05:10:07.365 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_client_op_priority": "63", 2024-09-13T05:10:07.365 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_client_watch_timeout": "30", 2024-09-13T05:10:07.365 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_command_max_records": "256", 2024-09-13T05:10:07.365 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_compact_on_start": "false", 2024-09-13T05:10:07.365 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-13T05:10:07.365 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-13T05:10:07.365 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-13T05:10:07.365 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_crush_update_on_start": "true", 2024-09-13T05:10:07.365 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_crush_update_weight_set": "true", 2024-09-13T05:10:07.365 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-13T05:10:07.365 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-13T05:10:07.365 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-13T05:10:07.365 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-13T05:10:07.365 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-13T05:10:07.366 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_debug_feed_pullee": "-1", 2024-09-13T05:10:07.366 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-13T05:10:07.366 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-13T05:10:07.366 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-13T05:10:07.366 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_debug_misdirected_ops": "false", 2024-09-13T05:10:07.366 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_debug_no_acting_change": "false", 2024-09-13T05:10:07.366 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_debug_no_purge_strays": "false", 2024-09-13T05:10:07.366 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_debug_op_order": "false", 2024-09-13T05:10:07.366 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-13T05:10:07.366 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-13T05:10:07.366 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-13T05:10:07.366 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-13T05:10:07.366 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_debug_shutdown": "false", 2024-09-13T05:10:07.367 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-13T05:10:07.367 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-13T05:10:07.367 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-13T05:10:07.367 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-13T05:10:07.367 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_debug_verify_snaps": "false", 2024-09-13T05:10:07.367 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-13T05:10:07.367 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-13T05:10:07.367 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_deep_scrub_keys": "1024", 2024-09-13T05:10:07.367 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-13T05:10:07.367 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-13T05:10:07.367 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-13T05:10:07.367 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_deep_scrub_stride": "524288", 2024-09-13T05:10:07.367 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-13T05:10:07.367 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-13T05:10:07.368 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_default_notify_timeout": "30", 2024-09-13T05:10:07.368 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_delete_sleep": "0.000000", 2024-09-13T05:10:07.368 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-13T05:10:07.368 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-13T05:10:07.368 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-13T05:10:07.368 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_discard_disconnected_ops": "true", 2024-09-13T05:10:07.368 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_enable_op_tracker": "true", 2024-09-13T05:10:07.368 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-13T05:10:07.368 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-13T05:10:07.368 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-13T05:10:07.368 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-13T05:10:07.368 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_fast_info": "true", 2024-09-13T05:10:07.368 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_fast_shutdown": "true", 2024-09-13T05:10:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-13T05:10:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-13T05:10:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-13T05:10:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-13T05:10:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-13T05:10:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_function_tracing": "false", 2024-09-13T05:10:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_heartbeat_grace": "20", 2024-09-13T05:10:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_heartbeat_interval": "6", 2024-09-13T05:10:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-13T05:10:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_heartbeat_min_peers": "10", 2024-09-13T05:10:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_heartbeat_min_size": "2000", 2024-09-13T05:10:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_heartbeat_stale": "600", 2024-09-13T05:10:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-13T05:10:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_hit_set_max_size": "100000", 2024-09-13T05:10:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_hit_set_min_size": "1000", 2024-09-13T05:10:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-13T05:10:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-13T05:10:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-13T05:10:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-13T05:10:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-13T05:10:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-13T05:10:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_journal_size": "5120", 2024-09-13T05:10:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_kill_backfill_at": "0", 2024-09-13T05:10:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-13T05:10:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_map_cache_size": "50", 2024-09-13T05:10:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_map_dedup": "true", 2024-09-13T05:10:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_map_message_max": "40", 2024-09-13T05:10:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-13T05:10:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_map_share_max_epochs": "40", 2024-09-13T05:10:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_max_attr_name_len": "100", 2024-09-13T05:10:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_max_attr_size": "0", 2024-09-13T05:10:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_max_backfills": "1", 2024-09-13T05:10:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_max_markdown_count": "5", 2024-09-13T05:10:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_max_markdown_period": "600", 2024-09-13T05:10:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_max_object_name_len": "2048", 2024-09-13T05:10:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_max_object_namespace_len": "256", 2024-09-13T05:10:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_max_object_size": "134217728", 2024-09-13T05:10:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-13T05:10:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-13T05:10:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_max_pg_blocked_by": "16", 2024-09-13T05:10:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_max_pg_log_entries": "10000", 2024-09-13T05:10:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-13T05:10:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_max_pgls": "1024", 2024-09-13T05:10:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_max_push_cost": "8388608", 2024-09-13T05:10:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_max_push_objects": "10", 2024-09-13T05:10:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_max_scrubs": "3", 2024-09-13T05:10:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-13T05:10:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_max_trimming_pgs": "2", 2024-09-13T05:10:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_max_write_op_reply_len": "64", 2024-09-13T05:10:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_max_write_size": "90", 2024-09-13T05:10:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-13T05:10:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-13T05:10:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-13T05:10:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-13T05:10:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-13T05:10:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-13T05:10:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-13T05:10:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-13T05:10:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mclock_profile": "balanced", 2024-09-13T05:10:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-13T05:10:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-13T05:10:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-13T05:10:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-13T05:10:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-13T05:10:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-13T05:10:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-13T05:10:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-13T05:10:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-13T05:10:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-13T05:10:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-13T05:10:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_memory_base": "805306368", 2024-09-13T05:10:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_memory_cache_min": "134217728", 2024-09-13T05:10:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-13T05:10:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-13T05:10:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_memory_target": "4294967296", 2024-09-13T05:10:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_memory_target_autotune": "false", 2024-09-13T05:10:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-13T05:10:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_min_pg_log_entries": "250", 2024-09-13T05:10:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_min_recovery_priority": "0", 2024-09-13T05:10:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-13T05:10:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-13T05:10:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mon_report_interval": "5", 2024-09-13T05:10:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-13T05:10:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-13T05:10:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_num_cache_shards": "32", 2024-09-13T05:10:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_num_op_tracker_shard": "32", 2024-09-13T05:10:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_numa_auto_affinity": "true", 2024-09-13T05:10:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_numa_node": "-1", 2024-09-13T05:10:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_numa_prefer_iface": "true", 2024-09-13T05:10:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-13T05:10:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_objecter_finishers": "1", 2024-09-13T05:10:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_objectstore": "bluestore", 2024-09-13T05:10:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_objectstore_fuse": "false", 2024-09-13T05:10:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_objectstore_tracing": "false", 2024-09-13T05:10:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_op_complaint_time": "30.000000", 2024-09-13T05:10:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_op_history_duration": "600", 2024-09-13T05:10:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_op_history_size": "20", 2024-09-13T05:10:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_op_history_slow_op_size": "20", 2024-09-13T05:10:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-13T05:10:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_op_log_threshold": "5", 2024-09-13T05:10:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_op_num_shards": "0", 2024-09-13T05:10:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_op_num_shards_hdd": "5", 2024-09-13T05:10:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_op_num_shards_ssd": "8", 2024-09-13T05:10:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-13T05:10:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-13T05:10:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-13T05:10:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-13T05:10:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_op_pq_min_cost": "65536", 2024-09-13T05:10:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-13T05:10:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_op_queue_cut_off": "high", 2024-09-13T05:10:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-13T05:10:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_op_thread_timeout": "15", 2024-09-13T05:10:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_open_classes_on_start": "true", 2024-09-13T05:10:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_os_flags": "0", 2024-09-13T05:10:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_peering_op_priority": "255", 2024-09-13T05:10:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pg_delete_cost": "1048576", 2024-09-13T05:10:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pg_delete_priority": "5", 2024-09-13T05:10:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-13T05:10:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-13T05:10:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-13T05:10:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pg_log_trim_max": "10000", 2024-09-13T05:10:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pg_log_trim_min": "100", 2024-09-13T05:10:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-13T05:10:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-13T05:10:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pg_stat_report_interval_max": "500", 2024-09-13T05:10:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-13T05:10:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-13T05:10:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-13T05:10:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-13T05:10:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-13T05:10:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-13T05:10:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_default_crimson": "false", 2024-09-13T05:10:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-13T05:10:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-13T05:10:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-13T05:10:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-13T05:10:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-13T05:10:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-13T05:10:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-13T05:10:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-13T05:10:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_default_flags": "0", 2024-09-13T05:10:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-13T05:10:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_default_min_size": "0", 2024-09-13T05:10:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-13T05:10:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_default_pg_num": "32", 2024-09-13T05:10:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_default_pgp_num": "0", 2024-09-13T05:10:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-13T05:10:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_default_size": "2", 2024-09-13T05:10:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_default_type": "replicated", 2024-09-13T05:10:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-13T05:10:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-13T05:10:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_push_per_object_cost": "1000", 2024-09-13T05:10:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-13T05:10:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_recover_clone_overlap": "true", 2024-09-13T05:10:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-13T05:10:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_recovery_cost": "20971520", 2024-09-13T05:10:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-13T05:10:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_recovery_max_active": "0", 2024-09-13T05:10:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-13T05:10:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-13T05:10:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-13T05:10:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-13T05:10:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_recovery_max_single_start": "1", 2024-09-13T05:10:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_recovery_op_priority": "3", 2024-09-13T05:10:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-13T05:10:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_recovery_priority": "5", 2024-09-13T05:10:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-13T05:10:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_recovery_sleep": "0.000000", 2024-09-13T05:10:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-13T05:10:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-13T05:10:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-13T05:10:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_repair_during_recovery": "false", 2024-09-13T05:10:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_requested_scrub_priority": "120", 2024-09-13T05:10:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-13T05:10:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-13T05:10:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_scrub_auto_repair": "false", 2024-09-13T05:10:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-13T05:10:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-13T05:10:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_scrub_begin_hour": "0", 2024-09-13T05:10:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_scrub_begin_week_day": "0", 2024-09-13T05:10:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_scrub_chunk_max": "25", 2024-09-13T05:10:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_scrub_chunk_min": "5", 2024-09-13T05:10:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_scrub_cost": "52428800", 2024-09-13T05:10:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_scrub_during_recovery": "false", 2024-09-13T05:10:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_scrub_end_hour": "0", 2024-09-13T05:10:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_scrub_end_week_day": "0", 2024-09-13T05:10:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_scrub_event_cost": "4096", 2024-09-13T05:10:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-13T05:10:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-13T05:10:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_scrub_invalid_stats": "true", 2024-09-13T05:10:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-13T05:10:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-13T05:10:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_scrub_max_preemptions": "5", 2024-09-13T05:10:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-13T05:10:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_scrub_priority": "5", 2024-09-13T05:10:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_scrub_reservation_timeout": "5000", 2024-09-13T05:10:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_scrub_sleep": "0.000000", 2024-09-13T05:10:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_scrub_slow_reservation_response": "2200", 2024-09-13T05:10:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-13T05:10:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-13T05:10:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-13T05:10:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_skip_data_digest": "false", 2024-09-13T05:10:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_smart_report_timeout": "5", 2024-09-13T05:10:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_snap_trim_cost": "1048576", 2024-09-13T05:10:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_snap_trim_priority": "5", 2024-09-13T05:10:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-13T05:10:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-13T05:10:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-13T05:10:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-13T05:10:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-13T05:10:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-13T05:10:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-13T05:10:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_target_transaction_size": "30", 2024-09-13T05:10:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-13T05:10:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-13T05:10:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-13T05:10:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-13T05:10:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-13T05:10:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-13T05:10:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-13T05:10:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-13T05:10:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-13T05:10:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-13T05:10:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_tracing": "false", 2024-09-13T05:10:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_use_stale_snap": "false", 2024-09-13T05:10:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T05:10:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: "osdc_blkin_trace_all": "false", 2024-09-13T05:10:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: "paxos_kill_at": "0", 2024-09-13T05:10:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: "paxos_max_join_drift": "10", 2024-09-13T05:10:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: "paxos_min": "500", 2024-09-13T05:10:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: "paxos_min_wait": "0.050000", 2024-09-13T05:10:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: "paxos_propose_interval": "1.000000", 2024-09-13T05:10:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: "paxos_service_trim_max": "500", 2024-09-13T05:10:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-13T05:10:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: "paxos_service_trim_min": "250", 2024-09-13T05:10:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: "paxos_stash_full_interval": "25", 2024-09-13T05:10:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: "paxos_trim_max": "500", 2024-09-13T05:10:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: "paxos_trim_min": "250", 2024-09-13T05:10:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: "perf": "true", 2024-09-13T05:10:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-13T05:10:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-13T05:10:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-13T05:10:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "-", 2024-09-13T05:10:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrv": "", 2024-09-13T05:10:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: "public_bind_addr": "-", 2024-09-13T05:10:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: "public_network": "", 2024-09-13T05:10:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: "public_network_interface": "", 2024-09-13T05:10:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: "qat_compressor_enabled": "false", 2024-09-13T05:10:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: "qat_compressor_session_max_number": "256", 2024-09-13T05:10:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: "rados_mon_op_timeout": "0", 2024-09-13T05:10:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: "rados_osd_op_timeout": "0", 2024-09-13T05:10:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: "rados_tracing": "false", 2024-09-13T05:10:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_atime_update_interval": "60", 2024-09-13T05:10:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-13T05:10:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_balance_parent_reads": "false", 2024-09-13T05:10:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_balance_snap_reads": "false", 2024-09-13T05:10:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_blkin_trace_all": "false", 2024-09-13T05:10:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-13T05:10:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-13T05:10:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_cache": "true", 2024-09-13T05:10:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-13T05:10:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-13T05:10:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-13T05:10:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-13T05:10:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_cache_policy": "writearound", 2024-09-13T05:10:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_cache_size": "33554432", 2024-09-13T05:10:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-13T05:10:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-13T05:10:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_clone_copy_on_read": "false", 2024-09-13T05:10:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_compression_hint": "none", 2024-09-13T05:10:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_concurrent_management_ops": "10", 2024-09-13T05:10:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-13T05:10:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_default_clone_format": "auto", 2024-09-13T05:10:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_default_data_pool": "", 2024-09-13T05:10:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_default_features": "61", 2024-09-13T05:10:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_default_format": "2", 2024-09-13T05:10:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_default_map_options": "", 2024-09-13T05:10:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_default_order": "22", 2024-09-13T05:10:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_default_pool": "rbd", 2024-09-13T05:10:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-13T05:10:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_default_stripe_count": "0", 2024-09-13T05:10:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_default_stripe_unit": "0", 2024-09-13T05:10:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-13T05:10:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-13T05:10:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-13T05:10:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_enable_alloc_hint": "true", 2024-09-13T05:10:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-13T05:10:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_io_scheduler": "simple", 2024-09-13T05:10:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-13T05:10:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-13T05:10:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-13T05:10:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-13T05:10:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-13T05:10:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-13T05:10:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-13T05:10:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-13T05:10:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-13T05:10:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_journal_order": "24", 2024-09-13T05:10:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_journal_pool": "", 2024-09-13T05:10:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_journal_splay_width": "4", 2024-09-13T05:10:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_localize_parent_reads": "false", 2024-09-13T05:10:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_localize_snap_reads": "false", 2024-09-13T05:10:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-13T05:10:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-13T05:10:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-13T05:10:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-13T05:10:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-13T05:10:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-13T05:10:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-13T05:10:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-13T05:10:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-13T05:10:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-13T05:10:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-13T05:10:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-13T05:10:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-13T05:10:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-13T05:10:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-13T05:10:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-13T05:10:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-13T05:10:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-13T05:10:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-13T05:10:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-13T05:10:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-13T05:10:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-13T05:10:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-13T05:10:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-13T05:10:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-13T05:10:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-13T05:10:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-13T05:10:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-13T05:10:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-13T05:10:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-13T05:10:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-13T05:10:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_mtime_update_interval": "60", 2024-09-13T05:10:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_non_blocking_aio": "true", 2024-09-13T05:10:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_op_thread_timeout": "60", 2024-09-13T05:10:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_op_threads": "1", 2024-09-13T05:10:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_parent_cache_enabled": "false", 2024-09-13T05:10:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-13T05:10:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-13T05:10:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-13T05:10:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_plugins": "", 2024-09-13T05:10:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_qos_bps_burst": "0", 2024-09-13T05:10:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-13T05:10:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_qos_bps_limit": "0", 2024-09-13T05:10:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_qos_exclude_ops": "0", 2024-09-13T05:10:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_qos_iops_burst": "0", 2024-09-13T05:10:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-13T05:10:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_qos_iops_limit": "0", 2024-09-13T05:10:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-13T05:10:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-13T05:10:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-13T05:10:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-13T05:10:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-13T05:10:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-13T05:10:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-13T05:10:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-13T05:10:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-13T05:10:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-13T05:10:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-13T05:10:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-13T05:10:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-13T05:10:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-13T05:10:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_read_from_replica_policy": "default", 2024-09-13T05:10:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-13T05:10:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-13T05:10:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-13T05:10:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-13T05:10:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_skip_partial_discard": "true", 2024-09-13T05:10:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-13T05:10:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_tracing": "false", 2024-09-13T05:10:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_validate_names": "true", 2024-09-13T05:10:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_validate_pool": "true", 2024-09-13T05:10:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: "restapi_base_url": "", 2024-09-13T05:10:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: "restapi_log_level": "", 2024-09-13T05:10:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_acl_grants_max_num": "100", 2024-09-13T05:10:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_admin_entry": "admin", 2024-09-13T05:10:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-13T05:10:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_backend_store": "rados", 2024-09-13T05:10:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_barbican_url": "", 2024-09-13T05:10:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_beast_enable_async": "true", 2024-09-13T05:10:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-13T05:10:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-13T05:10:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-13T05:10:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-13T05:10:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-13T05:10:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-13T05:10:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-13T05:10:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_cache_enabled": "true", 2024-09-13T05:10:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_cache_expiry_interval": "900", 2024-09-13T05:10:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_cache_lru_size": "10000", 2024-09-13T05:10:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_config_store": "rados", 2024-09-13T05:10:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_content_length_compat": "false", 2024-09-13T05:10:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_copy_obj_progress": "true", 2024-09-13T05:10:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-13T05:10:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_cors_rules_max_num": "100", 2024-09-13T05:10:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_cross_domain_policy": "", 2024-09-13T05:10:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-13T05:10:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_kmip_addr": "", 2024-09-13T05:10:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-13T05:10:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-13T05:10:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-13T05:10:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-13T05:10:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_kmip_password": "", 2024-09-13T05:10:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-13T05:10:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_kmip_username": "", 2024-09-13T05:10:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_require_ssl": "true", 2024-09-13T05:10:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-13T05:10:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-13T05:10:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-13T05:10:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-13T05:10:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-13T05:10:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-13T05:10:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-13T05:10:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-13T05:10:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-13T05:10:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-13T05:10:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-13T05:10:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-13T05:10:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-13T05:10:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-13T05:10:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-13T05:10:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_vault_addr": "", 2024-09-13T05:10:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_vault_auth": "token", 2024-09-13T05:10:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_vault_namespace": "", 2024-09-13T05:10:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_vault_prefix": "", 2024-09-13T05:10:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-13T05:10:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-13T05:10:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-13T05:10:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-13T05:10:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_vault_token_file": "", 2024-09-13T05:10:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-13T05:10:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_curl_buffersize": "524288", 2024-09-13T05:10:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-13T05:10:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_curl_low_speed_time": "300", 2024-09-13T05:10:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-13T05:10:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-13T05:10:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-13T05:10:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-13T05:10:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-13T05:10:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-13T05:10:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-13T05:10:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-13T05:10:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-13T05:10:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-13T05:10:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-13T05:10:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_data_log_changes_size": "1000", 2024-09-13T05:10:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_data_log_num_shards": "128", 2024-09-13T05:10:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-13T05:10:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_data_log_window": "30", 2024-09-13T05:10:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-13T05:10:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-13T05:10:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-13T05:10:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-13T05:10:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-13T05:10:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-13T05:10:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-13T05:10:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-13T05:10:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-13T05:10:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-13T05:10:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-13T05:10:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-13T05:10:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-13T05:10:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-13T05:10:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-13T05:10:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-13T05:10:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-13T05:10:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-13T05:10:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-13T05:10:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-13T05:10:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-13T05:10:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-13T05:10:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-13T05:10:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-13T05:10:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_dns_name": "", 2024-09-13T05:10:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_dns_s3website_name": "", 2024-09-13T05:10:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_dynamic_resharding": "true", 2024-09-13T05:10:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-13T05:10:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_enable_gc_threads": "true", 2024-09-13T05:10:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_enable_lc_threads": "true", 2024-09-13T05:10:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_enable_ops_log": "false", 2024-09-13T05:10:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_enable_quota_threads": "true", 2024-09-13T05:10:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_enable_static_website": "false", 2024-09-13T05:10:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_enable_usage_log": "false", 2024-09-13T05:10:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_enforce_swift_acls": "true", 2024-09-13T05:10:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_exit_timeout_secs": "120", 2024-09-13T05:10:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_expose_bucket": "false", 2024-09-13T05:10:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_extended_http_attrs": "", 2024-09-13T05:10:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_filter": "none", 2024-09-13T05:10:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-13T05:10:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_frontends": "beast port=7480", 2024-09-13T05:10:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-13T05:10:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_gc_max_deferred": "50", 2024-09-13T05:10:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-13T05:10:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_gc_max_objs": "32", 2024-09-13T05:10:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-13T05:10:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-13T05:10:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-13T05:10:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-13T05:10:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_gc_processor_period": "3600", 2024-09-13T05:10:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-13T05:10:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-13T05:10:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-13T05:10:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-13T05:10:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_init_timeout": "300", 2024-09-13T05:10:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-13T05:10:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-13T05:10:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-13T05:10:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-13T05:10:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_keystone_admin_domain": "", 2024-09-13T05:10:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_keystone_admin_password": "", 2024-09-13T05:10:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_keystone_admin_password_path": "", 2024-09-13T05:10:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_keystone_admin_project": "", 2024-09-13T05:10:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_keystone_admin_tenant": "", 2024-09-13T05:10:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_keystone_admin_token": "", 2024-09-13T05:10:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_keystone_admin_token_path": "", 2024-09-13T05:10:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_keystone_admin_user": "", 2024-09-13T05:10:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_keystone_api_version": "2", 2024-09-13T05:10:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_keystone_barbican_domain": "", 2024-09-13T05:10:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_keystone_barbican_password": "", 2024-09-13T05:10:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_keystone_barbican_project": "", 2024-09-13T05:10:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-13T05:10:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_keystone_barbican_user": "", 2024-09-13T05:10:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-13T05:10:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-13T05:10:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-13T05:10:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-13T05:10:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-13T05:10:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_keystone_url": "", 2024-09-13T05:10:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-13T05:10:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_lc_debug_interval": "-1", 2024-09-13T05:10:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_lc_lock_max_time": "90", 2024-09-13T05:10:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_lc_max_objs": "32", 2024-09-13T05:10:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_lc_max_rules": "1000", 2024-09-13T05:10:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_lc_max_worker": "3", 2024-09-13T05:10:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-13T05:10:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_lc_thread_delay": "0", 2024-09-13T05:10:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-13T05:10:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_ldap_dnattr": "uid", 2024-09-13T05:10:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-13T05:10:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_ldap_searchfilter": "", 2024-09-13T05:10:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-13T05:10:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_ldap_uri": "ldaps://", 2024-09-13T05:10:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-13T05:10:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-13T05:10:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-13T05:10:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_log_http_headers": "", 2024-09-13T05:10:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-13T05:10:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-13T05:10:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_log_object_name_utc": "false", 2024-09-13T05:10:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-09-13T05:10:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_max_attr_name_len": "0", 2024-09-13T05:10:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_max_attr_size": "0", 2024-09-13T05:10:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-13T05:10:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_max_chunk_size": "4194304", 2024-09-13T05:10:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-13T05:10:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-13T05:10:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-13T05:10:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_max_listing_results": "1000", 2024-09-13T05:10:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_max_notify_retries": "10", 2024-09-13T05:10:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-13T05:10:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_max_put_param_size": "1048576", 2024-09-13T05:10:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_max_put_size": "5368709120", 2024-09-13T05:10:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_max_slo_entries": "1000", 2024-09-13T05:10:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_md_log_max_shards": "64", 2024-09-13T05:10:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-13T05:10:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-13T05:10:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-13T05:10:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-13T05:10:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_mp_lock_max_time": "600", 2024-09-13T05:10:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-13T05:10:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-13T05:10:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-13T05:10:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-13T05:10:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-13T05:10:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-13T05:10:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-13T05:10:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-13T05:10:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_nfs_max_gc": "300", 2024-09-13T05:10:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-13T05:10:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-13T05:10:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-13T05:10:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-13T05:10:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-13T05:10:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-13T05:10:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-13T05:10:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_num_async_rados_threads": "32", 2024-09-13T05:10:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_num_control_oids": "8", 2024-09-13T05:10:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_numa_node": "-1", 2024-09-13T05:10:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-13T05:10:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-13T05:10:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_objexp_chunk_size": "100", 2024-09-13T05:10:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_objexp_gc_interval": "600", 2024-09-13T05:10:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-13T05:10:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-13T05:10:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-13T05:10:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_op_thread_timeout": "600", 2024-09-13T05:10:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_op_tracing": "false", 2024-09-13T05:10:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_opa_token": "", 2024-09-13T05:10:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_opa_url": "", 2024-09-13T05:10:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_opa_verify_ssl": "true", 2024-09-13T05:10:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-13T05:10:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-13T05:10:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_ops_log_rados": "false", 2024-09-13T05:10:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_ops_log_socket_path": "", 2024-09-13T05:10:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-13T05:10:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-13T05:10:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-13T05:10:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_period_push_interval": "2.000000", 2024-09-13T05:10:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-13T05:10:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-13T05:10:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-13T05:10:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_print_continue": "true", 2024-09-13T05:10:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-13T05:10:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-13T05:10:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-13T05:10:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-13T05:10:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-13T05:10:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_rados_tracing": "false", 2024-09-13T05:10:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_realm": "", 2024-09-13T05:10:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_realm_id": "", 2024-09-13T05:10:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-13T05:10:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_region": "", 2024-09-13T05:10:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-13T05:10:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-13T05:10:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-13T05:10:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-13T05:10:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_request_uri": "", 2024-09-13T05:10:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_reshard_batch_size": "64", 2024-09-13T05:10:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-13T05:10:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_reshard_max_aio": "128", 2024-09-13T05:10:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_reshard_num_logs": "16", 2024-09-13T05:10:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_reshard_thread_interval": "600", 2024-09-13T05:10:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_resolve_cname": "false", 2024-09-13T05:10:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-13T05:10:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_run_sync_thread": "true", 2024-09-13T05:10:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-13T05:10:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-13T05:10:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-13T05:10:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-13T05:10:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-13T05:10:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-13T05:10:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-13T05:10:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-13T05:10:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_scheduler_type": "throttler", 2024-09-13T05:10:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_script_uri": "", 2024-09-13T05:10:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_service_provider_name": "", 2024-09-13T05:10:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-13T05:10:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_sts_client_id": "", 2024-09-13T05:10:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_sts_client_secret": "", 2024-09-13T05:10:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_sts_entry": "sts", 2024-09-13T05:10:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_sts_key": "sts", 2024-09-13T05:10:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-13T05:10:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_sts_min_session_duration": "900", 2024-09-13T05:10:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_sts_token_introspection_url": "", 2024-09-13T05:10:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_swift_account_in_url": "false", 2024-09-13T05:10:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_swift_auth_entry": "auth", 2024-09-13T05:10:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_swift_auth_url": "", 2024-09-13T05:10:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_swift_custom_header": "", 2024-09-13T05:10:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-13T05:10:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_swift_need_stats": "true", 2024-09-13T05:10:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_swift_tenant_name": "", 2024-09-13T05:10:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_swift_token_expiration": "86400", 2024-09-13T05:10:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_swift_url": "", 2024-09-13T05:10:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_swift_url_prefix": "swift", 2024-09-13T05:10:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-13T05:10:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-13T05:10:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-13T05:10:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_sync_lease_period": "120", 2024-09-13T05:10:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-13T05:10:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-13T05:10:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-13T05:10:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-13T05:10:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-13T05:10:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-13T05:10:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-13T05:10:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-13T05:10:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-13T05:10:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_thread_pool_size": "512", 2024-09-13T05:10:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_torrent_comment": "", 2024-09-13T05:10:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_torrent_createby": "", 2024-09-13T05:10:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_torrent_encoding": "", 2024-09-13T05:10:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_torrent_flag": "false", 2024-09-13T05:10:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_torrent_origin": "", 2024-09-13T05:10:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-13T05:10:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_torrent_tracker": "", 2024-09-13T05:10:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_trust_forwarded_https": "false", 2024-09-13T05:10:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-13T05:10:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-13T05:10:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_usage_max_shards": "32", 2024-09-13T05:10:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_usage_max_user_shards": "1", 2024-09-13T05:10:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_use_opa_authz": "false", 2024-09-13T05:10:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-13T05:10:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-13T05:10:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_user_max_buckets": "1000", 2024-09-13T05:10:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_user_policies_max_num": "100", 2024-09-13T05:10:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-13T05:10:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-13T05:10:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-13T05:10:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-13T05:10:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_user_unique_email": "true", 2024-09-13T05:10:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_verify_ssl": "true", 2024-09-13T05:10:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-13T05:10:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_zone": "", 2024-09-13T05:10:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_zone_id": "", 2024-09-13T05:10:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-13T05:10:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_zonegroup": "", 2024-09-13T05:10:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_zonegroup_id": "", 2024-09-13T05:10:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-13T05:10:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "rgwlc_auto_session_clear": "true", 2024-09-13T05:10:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-13T05:10:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "rocksdb_block_size": "4096", 2024-09-13T05:10:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-13T05:10:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-13T05:10:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-13T05:10:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-13T05:10:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-13T05:10:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "rocksdb_cache_size": "536870912", 2024-09-13T05:10:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-13T05:10:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-13T05:10:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-13T05:10:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-13T05:10:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-13T05:10:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-13T05:10:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-13T05:10:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-13T05:10:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "rocksdb_index_type": "binary_search", 2024-09-13T05:10:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-13T05:10:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-13T05:10:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "rocksdb_partition_filters": "false", 2024-09-13T05:10:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "rocksdb_perf": "false", 2024-09-13T05:10:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-13T05:10:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-13T05:10:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-13T05:10:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "run_dir": "/var/run/ceph", 2024-09-13T05:10:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "seastore_block_create": "true", 2024-09-13T05:10:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "seastore_cache_lru_size": "67108864", 2024-09-13T05:10:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-13T05:10:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "seastore_default_max_object_size": "16777216", 2024-09-13T05:10:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-13T05:10:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "seastore_device_size": "53687091200", 2024-09-13T05:10:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "seastore_journal_batch_capacity": "16", 2024-09-13T05:10:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-13T05:10:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-13T05:10:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-13T05:10:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "seastore_main_device_type": "SSD", 2024-09-13T05:10:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-13T05:10:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-13T05:10:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-13T05:10:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-13T05:10:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-13T05:10:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "seastore_segment_size": "67108864", 2024-09-13T05:10:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "set_keepcaps": "false", 2024-09-13T05:10:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "setgroup": "", 2024-09-13T05:10:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "setuser": "", 2024-09-13T05:10:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "setuser_match_path": "", 2024-09-13T05:10:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-13T05:10:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "thp": "false", 2024-09-13T05:10:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "threadpool_default_timeout": "60", 2024-09-13T05:10:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-13T05:10:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "throttler_perf_counter": "true" 2024-09-13T05:10:07.425 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:07.427 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-13T05:10:07.569 INFO:teuthology.orchestra.run.smithi120.stdout:mon.a: {} 2024-09-13T05:10:07.583 INFO:teuthology.orchestra.run.smithi120.stdout:mon.b: {} 2024-09-13T05:10:07.601 INFO:teuthology.orchestra.run.smithi120.stdout:mon.c: {} 2024-09-13T05:10:07.603 INFO:teuthology.orchestra.run.smithi120.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-13T05:10:07.603 INFO:teuthology.orchestra.run.smithi120.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-13T05:10:07.604 INFO:teuthology.orchestra.run.smithi120.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-13T05:10:07.615 DEBUG:teuthology.orchestra.run.smithi120:> type ceph-objectstore-tool 2024-09-13T05:10:07.618 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-13T05:10:07.619 DEBUG:teuthology.orchestra.run.smithi137:> type ceph-objectstore-tool 2024-09-13T05:10:07.624 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-13T05:10:07.625 INFO:teuthology.run_tasks:Running task rbd_fsx... 2024-09-13T05:10:07.638 INFO:tasks.rbd_fsx:starting rbd_fsx... 2024-09-13T05:10:07.638 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-13T05:10:07.638 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T05:10:07.638 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:10:07.638 INFO:tasks.thrashosds.thrasher:Removing osd 4, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T05:10:07.639 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 4 2024-09-13T05:10:07.639 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-13T05:10:07.640 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-13T05:10:07.640 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:10:07.640 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-13T05:10:07.641 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:10:07.641 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-13T05:10:07.642 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T05:10:07.642 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 pool_client.0 image_client.0 2024-09-13T05:10:07.669 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:07.667+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:07.676 INFO:teuthology.orchestra.run.smithi120.stdout:mapped writes DISABLED 2024-09-13T05:10:07.677 INFO:teuthology.orchestra.run.smithi120.stdout:mapped reads DISABLED 2024-09-13T05:10:07.677 INFO:teuthology.orchestra.run.smithi120.stdout:Seed set to 9402 2024-09-13T05:10:07.741 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:07.739+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:07.786 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:10:07.786 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:07.786 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:07.798 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:10:07.810 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:10:07.828 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:10:07.843 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:07.838+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:07.852 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:10:07.875 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:10:07.895 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:07.895 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:07.896 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:10:07.904 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:10:07.918 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:10:07.942 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:10:07.943 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:07.938+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:07.943 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:10:07.944 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:10:07.944 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:10:07.944 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:10:07.944 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:10:07.944 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:10:07.944 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:10:07.944 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:10:07.998 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:07.998 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:08.008 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:10:08.014 INFO:tasks.ceph.mon.a.smithi120.stderr:2024-09-13T05:10:08.010+0000 7fa8b7b30700 -1 mon.a@0(leader).osd e21 definitely_dead 0 2024-09-13T05:10:08.045 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:08.043+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:08.108 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:08.108 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:08.118 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:10:08.146 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:08.143+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:08.246 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:08.243+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:08.269 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:08.269 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:08.278 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:10:08.347 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:08.342+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:08.388 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:08.388 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:08.399 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:10:08.449 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:08.443+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:08.509 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:08.510 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:08.519 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:10:08.549 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:08.546+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:08.632 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:08.633 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:08.638 INFO:teuthology.orchestra.run.smithi120.stderr:marked out osd.4. 2024-09-13T05:10:08.639 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is set 2024-09-13T05:10:08.646 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:10:08.649 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:08.646+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:08.741 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:08.741 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:08.751 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:10:08.751 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:08.746+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:08.852 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:08.846+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:08.864 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:08.864 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:08.872 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:10:08.953 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:08.946+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:08.976 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:08.976 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:08.985 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:10:09.054 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:09.050+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:09.134 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:09.134 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:09.143 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:10:09.154 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:09.150+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:09.255 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:09.251+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:09.260 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:09.260 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:09.270 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:10:09.356 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:09.354+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:09.373 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:09.373 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:09.382 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:10:09.457 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:09.455+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:09.489 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:09.489 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:09.501 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:10:09.559 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:09.554+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:09.603 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:09.603 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:09.613 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:10:09.659 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:09.654+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:09.722 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:09.722 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:09.732 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:10:09.761 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:09.759+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:09.834 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:09.834 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:09.844 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:10:09.889 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:09.887+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:09.952 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:09.952 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:09.954 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:10:09.961 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:10:10.001 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:09.998+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:10.064 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:10.058+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:10.069 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:10.069 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:10.079 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:10:10.112 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:10:10.131 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:10:10.149 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:10:10.165 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:10.163+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:10.169 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:10:10.182 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:10.183 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:10.190 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:10:10.192 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:10:10.211 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:10:10.234 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:10:10.254 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:10:10.256 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:10:10.256 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:10:10.257 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:10:10.257 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:10:10.257 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:10:10.257 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:10:10.257 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:10:10.257 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:10:10.266 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:10.262+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:10.301 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:10.301 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:10.301 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:10.301 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:10.311 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:10:10.368 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:10.362+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:10.418 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:10.418 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:10.418 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:10.418 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:10.418 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:10.428 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:10:10.468 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:10.462+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:10.539 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:10.539 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:10.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:10:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.451581+0000", 2024-09-13T05:10:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 17.083571063000001, 2024-09-13T05:10:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010684878, 2024-09-13T05:10:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 70 2024-09-13T05:10:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.451581+0000", 2024-09-13T05:10:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.451581+0000", 2024-09-13T05:10:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.451579+0000", 2024-09-13T05:10:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.451589+0000", 2024-09-13T05:10:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7489999999999993e-06 2024-09-13T05:10:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.451622+0000", 2024-09-13T05:10:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2651000000000003e-05 2024-09-13T05:10:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.451640+0000", 2024-09-13T05:10:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8238999999999999e-05 2024-09-13T05:10:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.455669+0000", 2024-09-13T05:10:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0040290530000000003 2024-09-13T05:10:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.455863+0000", 2024-09-13T05:10:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000194379 2024-09-13T05:10:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.456103+0000", 2024-09-13T05:10:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00023963500000000001 2024-09-13T05:10:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.458065+0000", 2024-09-13T05:10:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001961735 2024-09-13T05:10:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.462113+0000", 2024-09-13T05:10:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0040486640000000004 2024-09-13T05:10:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.462192+0000", 2024-09-13T05:10:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9043999999999997e-05 2024-09-13T05:10:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.462265+0000", 2024-09-13T05:10:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3034999999999994e-05 2024-09-13T05:10:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.546 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:10.546 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.546 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:10.546 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.688597+0000", 2024-09-13T05:10:10.546 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 16.846555018, 2024-09-13T05:10:10.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013348512, 2024-09-13T05:10:10.547 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:10.547 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:10.547 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:10.547 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:10.547 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:10.547 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 109 2024-09-13T05:10:10.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.547 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:10.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688597+0000", 2024-09-13T05:10:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688597+0000", 2024-09-13T05:10:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688596+0000", 2024-09-13T05:10:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688775+0000", 2024-09-13T05:10:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017898999999999999 2024-09-13T05:10:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688814+0000", 2024-09-13T05:10:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9499000000000002e-05 2024-09-13T05:10:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688853+0000", 2024-09-13T05:10:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8976000000000001e-05 2024-09-13T05:10:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.695018+0000", 2024-09-13T05:10:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0061651079999999999 2024-09-13T05:10:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.695182+0000", 2024-09-13T05:10:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000163723 2024-09-13T05:10:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.695407+0000", 2024-09-13T05:10:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00022512399999999999 2024-09-13T05:10:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698875+0000", 2024-09-13T05:10:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0034678069999999998 2024-09-13T05:10:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701846+0000", 2024-09-13T05:10:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002970692 2024-09-13T05:10:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:10.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701903+0000", 2024-09-13T05:10:10.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7944e-05 2024-09-13T05:10:10.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:10.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701945+0000", 2024-09-13T05:10:10.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1656000000000002e-05 2024-09-13T05:10:10.552 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.688881+0000", 2024-09-13T05:10:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 16.846270497999999, 2024-09-13T05:10:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013592653, 2024-09-13T05:10:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 110 2024-09-13T05:10:10.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.554 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:10.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:10.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688881+0000", 2024-09-13T05:10:10.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:10.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688881+0000", 2024-09-13T05:10:10.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:10.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688880+0000", 2024-09-13T05:10:10.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:10.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:10.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688891+0000", 2024-09-13T05:10:10.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0727000000000001e-05 2024-09-13T05:10:10.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688908+0000", 2024-09-13T05:10:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7390000000000001e-05 2024-09-13T05:10:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688926+0000", 2024-09-13T05:10:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8216e-05 2024-09-13T05:10:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.696278+0000", 2024-09-13T05:10:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0073520929999999996 2024-09-13T05:10:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.696360+0000", 2024-09-13T05:10:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1934999999999994e-05 2024-09-13T05:10:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.696541+0000", 2024-09-13T05:10:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018114800000000001 2024-09-13T05:10:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:10.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698879+0000", 2024-09-13T05:10:10.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023370650000000001 2024-09-13T05:10:10.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:10.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702421+0000", 2024-09-13T05:10:10.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0035420500000000001 2024-09-13T05:10:10.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702452+0000", 2024-09-13T05:10:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1588999999999999e-05 2024-09-13T05:10:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702474+0000", 2024-09-13T05:10:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1650000000000001e-05 2024-09-13T05:10:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.688941+0000", 2024-09-13T05:10:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 16.846210978999999, 2024-09-13T05:10:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013667653, 2024-09-13T05:10:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 111 2024-09-13T05:10:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:10.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688941+0000", 2024-09-13T05:10:10.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:10.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688941+0000", 2024-09-13T05:10:10.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:10.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688940+0000", 2024-09-13T05:10:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688949+0000", 2024-09-13T05:10:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7629999999999995e-06 2024-09-13T05:10:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688982+0000", 2024-09-13T05:10:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2446000000000001e-05 2024-09-13T05:10:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:10.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688995+0000", 2024-09-13T05:10:10.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3305999999999999e-05 2024-09-13T05:10:10.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:10.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.697295+0000", 2024-09-13T05:10:10.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0083001519999999999 2024-09-13T05:10:10.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:10.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.697352+0000", 2024-09-13T05:10:10.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6563e-05 2024-09-13T05:10:10.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:10.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.697439+0000", 2024-09-13T05:10:10.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7410000000000005e-05 2024-09-13T05:10:10.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:10.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698884+0000", 2024-09-13T05:10:10.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0014450419999999999 2024-09-13T05:10:10.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:10.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702524+0000", 2024-09-13T05:10:10.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0036397109999999999 2024-09-13T05:10:10.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:10.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702570+0000", 2024-09-13T05:10:10.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5608000000000001e-05 2024-09-13T05:10:10.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:10.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702608+0000", 2024-09-13T05:10:10.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8608e-05 2024-09-13T05:10:10.567 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.567 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:10.567 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.567 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:10.567 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.689011+0000", 2024-09-13T05:10:10.568 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 16.846140767000001, 2024-09-13T05:10:10.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013716103, 2024-09-13T05:10:10.568 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:10.568 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:10.568 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:10.568 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:10.568 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:10.568 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 112 2024-09-13T05:10:10.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.568 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:10.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:10.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689011+0000", 2024-09-13T05:10:10.569 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:10.569 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689011+0000", 2024-09-13T05:10:10.569 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:10.569 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689010+0000", 2024-09-13T05:10:10.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:10.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.570 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:10.570 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689225+0000", 2024-09-13T05:10:10.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021534899999999999 2024-09-13T05:10:10.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.570 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:10.570 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689247+0000", 2024-09-13T05:10:10.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1766000000000001e-05 2024-09-13T05:10:10.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.570 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:10.571 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689262+0000", 2024-09-13T05:10:10.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4769e-05 2024-09-13T05:10:10.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.571 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.571 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:10.571 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.697818+0000", 2024-09-13T05:10:10.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0085563710000000001 2024-09-13T05:10:10.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.571 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.571 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:10.571 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.697909+0000", 2024-09-13T05:10:10.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1434000000000006e-05 2024-09-13T05:10:10.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.571 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:10.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698035+0000", 2024-09-13T05:10:10.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000125971 2024-09-13T05:10:10.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:10.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701127+0000", 2024-09-13T05:10:10.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0030915389999999999 2024-09-13T05:10:10.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:10.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702664+0000", 2024-09-13T05:10:10.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001536684 2024-09-13T05:10:10.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.573 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:10.573 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702702+0000", 2024-09-13T05:10:10.573 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8617e-05 2024-09-13T05:10:10.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.573 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:10.573 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702727+0000", 2024-09-13T05:10:10.573 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4726e-05 2024-09-13T05:10:10.573 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.573 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:10.573 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.574 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:10.574 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.689282+0000", 2024-09-13T05:10:10.574 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 16.845869426, 2024-09-13T05:10:10.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013657832999999999, 2024-09-13T05:10:10.574 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:10.574 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:10.574 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:10.574 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:10.574 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:10.574 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 113 2024-09-13T05:10:10.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.575 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:10.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.575 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:10.575 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689282+0000", 2024-09-13T05:10:10.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.575 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:10.575 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689282+0000", 2024-09-13T05:10:10.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.575 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:10.576 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689281+0000", 2024-09-13T05:10:10.576 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:10.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.576 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.576 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:10.576 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689291+0000", 2024-09-13T05:10:10.576 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0349999999999999e-05 2024-09-13T05:10:10.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.576 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.576 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:10.576 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689308+0000", 2024-09-13T05:10:10.576 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6469000000000001e-05 2024-09-13T05:10:10.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.576 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:10.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689321+0000", 2024-09-13T05:10:10.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.31e-05 2024-09-13T05:10:10.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.577 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:10.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698510+0000", 2024-09-13T05:10:10.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0091895410000000007 2024-09-13T05:10:10.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.577 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:10.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698566+0000", 2024-09-13T05:10:10.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6008999999999999e-05 2024-09-13T05:10:10.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:10.578 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698649+0000", 2024-09-13T05:10:10.578 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2562e-05 2024-09-13T05:10:10.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:10.578 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701957+0000", 2024-09-13T05:10:10.578 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033086029999999998 2024-09-13T05:10:10.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:10.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702878+0000", 2024-09-13T05:10:10.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00092051000000000003 2024-09-13T05:10:10.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:10.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702911+0000", 2024-09-13T05:10:10.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3327999999999997e-05 2024-09-13T05:10:10.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:10.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702940+0000", 2024-09-13T05:10:10.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8744000000000001e-05 2024-09-13T05:10:10.579 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.580 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:10.580 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.580 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.580 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.580 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:10.580 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.689333+0000", 2024-09-13T05:10:10.580 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 16.8458182, 2024-09-13T05:10:10.580 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013692216, 2024-09-13T05:10:10.580 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:10.580 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:10.580 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:10.580 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:10.580 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:10.580 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 114 2024-09-13T05:10:10.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.581 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:10.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:10.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689333+0000", 2024-09-13T05:10:10.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:10.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689333+0000", 2024-09-13T05:10:10.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:10.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689332+0000", 2024-09-13T05:10:10.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:10.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:10.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689342+0000", 2024-09-13T05:10:10.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5629999999999998e-06 2024-09-13T05:10:10.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:10.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689358+0000", 2024-09-13T05:10:10.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.552e-05 2024-09-13T05:10:10.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.583 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:10.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689375+0000", 2024-09-13T05:10:10.583 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7180000000000002e-05 2024-09-13T05:10:10.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.583 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:10.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698905+0000", 2024-09-13T05:10:10.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0095304499999999993 2024-09-13T05:10:10.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.584 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.584 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:10.584 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698954+0000", 2024-09-13T05:10:10.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8702999999999998e-05 2024-09-13T05:10:10.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.584 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.584 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:10.584 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.699029+0000", 2024-09-13T05:10:10.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.4857000000000005e-05 2024-09-13T05:10:10.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.584 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.584 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:10.585 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701965+0000", 2024-09-13T05:10:10.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002936059 2024-09-13T05:10:10.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:10.585 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702983+0000", 2024-09-13T05:10:10.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0010183169999999999 2024-09-13T05:10:10.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:10.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.703007+0000", 2024-09-13T05:10:10.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4100999999999998e-05 2024-09-13T05:10:10.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.587 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:10.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.703026+0000", 2024-09-13T05:10:10.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8473000000000001e-05 2024-09-13T05:10:10.587 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.587 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:10.587 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.588 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.588 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:10.588 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.689416+0000", 2024-09-13T05:10:10.588 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 16.845735982000001, 2024-09-13T05:10:10.588 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013724638000000001, 2024-09-13T05:10:10.588 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:10.588 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:10.588 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:10.588 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:10.588 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:10.588 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 115 2024-09-13T05:10:10.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.588 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:10.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:10.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689416+0000", 2024-09-13T05:10:10.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:10.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689416+0000", 2024-09-13T05:10:10.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:10.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689414+0000", 2024-09-13T05:10:10.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:10.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:10.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689603+0000", 2024-09-13T05:10:10.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018881599999999999 2024-09-13T05:10:10.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:10.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689626+0000", 2024-09-13T05:10:10.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3025999999999999e-05 2024-09-13T05:10:10.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:10.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689646+0000", 2024-09-13T05:10:10.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9585999999999998e-05 2024-09-13T05:10:10.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:10.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.699361+0000", 2024-09-13T05:10:10.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0097155249999999992 2024-09-13T05:10:10.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:10.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.699460+0000", 2024-09-13T05:10:10.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8339999999999997e-05 2024-09-13T05:10:10.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:10.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.699627+0000", 2024-09-13T05:10:10.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000166992 2024-09-13T05:10:10.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.592 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:10.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701970+0000", 2024-09-13T05:10:10.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023433569999999999 2024-09-13T05:10:10.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.592 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:10.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.703072+0000", 2024-09-13T05:10:10.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00110228 2024-09-13T05:10:10.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.593 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:10.593 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.703110+0000", 2024-09-13T05:10:10.593 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7385999999999997e-05 2024-09-13T05:10:10.593 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.593 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.593 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:10.593 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.703140+0000", 2024-09-13T05:10:10.593 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0530000000000001e-05 2024-09-13T05:10:10.593 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.593 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:10.594 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.594 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.594 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:10.594 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.689662+0000", 2024-09-13T05:10:10.594 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 16.845489756999999, 2024-09-13T05:10:10.594 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013592956, 2024-09-13T05:10:10.594 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:10.594 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:10.594 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:10.594 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:10.594 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:10.594 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 116 2024-09-13T05:10:10.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.595 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:10.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.595 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:10.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689662+0000", 2024-09-13T05:10:10.595 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:10.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689662+0000", 2024-09-13T05:10:10.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:10.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689661+0000", 2024-09-13T05:10:10.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:10.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.597 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.597 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:10.597 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689672+0000", 2024-09-13T05:10:10.597 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0672999999999999e-05 2024-09-13T05:10:10.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.597 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.597 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:10.597 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689687+0000", 2024-09-13T05:10:10.597 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5588999999999999e-05 2024-09-13T05:10:10.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.597 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.597 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:10.597 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689702+0000", 2024-09-13T05:10:10.598 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.447e-05 2024-09-13T05:10:10.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.598 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.598 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:10.598 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.700376+0000", 2024-09-13T05:10:10.598 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010673945000000001 2024-09-13T05:10:10.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.598 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.598 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:10.598 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.700498+0000", 2024-09-13T05:10:10.598 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012220699999999999 2024-09-13T05:10:10.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:10.599 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.700666+0000", 2024-09-13T05:10:10.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016788400000000001 2024-09-13T05:10:10.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:10.599 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701979+0000", 2024-09-13T05:10:10.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0013135530000000001 2024-09-13T05:10:10.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:10.599 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.703182+0000", 2024-09-13T05:10:10.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00120235 2024-09-13T05:10:10.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.600 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:10.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.703229+0000", 2024-09-13T05:10:10.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7966000000000001e-05 2024-09-13T05:10:10.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.600 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:10.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.703255+0000", 2024-09-13T05:10:10.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5361999999999999e-05 2024-09-13T05:10:10.600 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.600 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:10.600 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.601 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:10.601 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.689785+0000", 2024-09-13T05:10:10.601 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 16.845366179999999, 2024-09-13T05:10:10.601 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.015287752999999999, 2024-09-13T05:10:10.601 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:10.601 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:10.601 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:10.601 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:10.601 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:10.601 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 117 2024-09-13T05:10:10.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.601 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:10.601 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.601 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:10.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689785+0000", 2024-09-13T05:10:10.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:10.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689785+0000", 2024-09-13T05:10:10.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:10.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689784+0000", 2024-09-13T05:10:10.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:10.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.603 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:10.603 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689795+0000", 2024-09-13T05:10:10.603 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1014e-05 2024-09-13T05:10:10.603 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.603 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.603 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:10.603 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689812+0000", 2024-09-13T05:10:10.603 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6186000000000001e-05 2024-09-13T05:10:10.603 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.603 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.603 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:10.603 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689826+0000", 2024-09-13T05:10:10.603 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4003e-05 2024-09-13T05:10:10.603 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.604 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:10.604 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701187+0000", 2024-09-13T05:10:10.604 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.011361509000000001 2024-09-13T05:10:10.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.604 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:10.604 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701291+0000", 2024-09-13T05:10:10.604 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010432 2024-09-13T05:10:10.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.604 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:10.604 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701443+0000", 2024-09-13T05:10:10.604 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00015149599999999999 2024-09-13T05:10:10.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.605 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:10.605 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702218+0000", 2024-09-13T05:10:10.605 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00077520900000000001 2024-09-13T05:10:10.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.605 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:10.605 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.705010+0000", 2024-09-13T05:10:10.605 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0027916909999999998 2024-09-13T05:10:10.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.605 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:10.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.705050+0000", 2024-09-13T05:10:10.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0080000000000003e-05 2024-09-13T05:10:10.606 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:10.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.705073+0000", 2024-09-13T05:10:10.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3402000000000001e-05 2024-09-13T05:10:10.606 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.606 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:10.606 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.606 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.607 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:10.607 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:54.247728+0000", 2024-09-13T05:10:10.607 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 16.287424021, 2024-09-13T05:10:10.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010677212, 2024-09-13T05:10:10.607 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:10.607 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:10.607 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:10.607 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:10.607 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:10.607 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 134 2024-09-13T05:10:10.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.607 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:10.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.608 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:10.608 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247728+0000", 2024-09-13T05:10:10.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.608 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:10.608 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247728+0000", 2024-09-13T05:10:10.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.608 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:10.608 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247727+0000", 2024-09-13T05:10:10.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:10.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:10.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247801+0000", 2024-09-13T05:10:10.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3881999999999995e-05 2024-09-13T05:10:10.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:10.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247820+0000", 2024-09-13T05:10:10.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8709999999999999e-05 2024-09-13T05:10:10.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:10.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247826+0000", 2024-09-13T05:10:10.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8109999999999997e-06 2024-09-13T05:10:10.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:10.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.250826+0000", 2024-09-13T05:10:10.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002999182 2024-09-13T05:10:10.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:10.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.250909+0000", 2024-09-13T05:10:10.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.3876999999999997e-05 2024-09-13T05:10:10.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:10.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.251006+0000", 2024-09-13T05:10:10.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6100999999999994e-05 2024-09-13T05:10:10.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:10.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.255154+0000", 2024-09-13T05:10:10.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0041481060000000004 2024-09-13T05:10:10.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:10.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.258281+0000", 2024-09-13T05:10:10.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0031276530000000002 2024-09-13T05:10:10.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:10.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.258345+0000", 2024-09-13T05:10:10.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3898000000000004e-05 2024-09-13T05:10:10.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:10.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.258405+0000", 2024-09-13T05:10:10.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9626999999999997e-05 2024-09-13T05:10:10.612 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.612 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:10.612 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.612 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:10.613 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:54.247851+0000", 2024-09-13T05:10:10.613 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 16.287300195, 2024-09-13T05:10:10.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010771443, 2024-09-13T05:10:10.613 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:10.613 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:10.613 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:10.613 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:10.613 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:10.613 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 135 2024-09-13T05:10:10.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.613 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:10.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.613 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:10.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247851+0000", 2024-09-13T05:10:10.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:10.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247851+0000", 2024-09-13T05:10:10.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:10.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247851+0000", 2024-09-13T05:10:10.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:10.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:10.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247855+0000", 2024-09-13T05:10:10.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3000000000000003e-06 2024-09-13T05:10:10.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:10.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247863+0000", 2024-09-13T05:10:10.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3599999999999998e-06 2024-09-13T05:10:10.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:10.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247867+0000", 2024-09-13T05:10:10.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4059999999999998e-06 2024-09-13T05:10:10.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:10.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.251631+0000", 2024-09-13T05:10:10.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0037639240000000001 2024-09-13T05:10:10.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:10.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.251697+0000", 2024-09-13T05:10:10.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6330999999999999e-05 2024-09-13T05:10:10.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:10.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.251794+0000", 2024-09-13T05:10:10.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6967999999999997e-05 2024-09-13T05:10:10.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:10.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.255160+0000", 2024-09-13T05:10:10.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033660249999999999 2024-09-13T05:10:10.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.618 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:10.618 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.258485+0000", 2024-09-13T05:10:10.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003325106 2024-09-13T05:10:10.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.618 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:10.618 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.258564+0000", 2024-09-13T05:10:10.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8312999999999994e-05 2024-09-13T05:10:10.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.618 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:10.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.258623+0000", 2024-09-13T05:10:10.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9200000000000002e-05 2024-09-13T05:10:10.619 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.619 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:10.619 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.619 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:10.619 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:54.247871+0000", 2024-09-13T05:10:10.619 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 16.287280231, 2024-09-13T05:10:10.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012387007, 2024-09-13T05:10:10.620 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:10.620 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:10.620 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:10.620 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:10.620 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:10.620 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 136 2024-09-13T05:10:10.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.620 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:10.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:10.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247871+0000", 2024-09-13T05:10:10.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:10.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247871+0000", 2024-09-13T05:10:10.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:10.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247871+0000", 2024-09-13T05:10:10.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:10.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:10.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247874+0000", 2024-09-13T05:10:10.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1939999999999998e-06 2024-09-13T05:10:10.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:10.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247881+0000", 2024-09-13T05:10:10.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.348e-06 2024-09-13T05:10:10.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:10.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247885+0000", 2024-09-13T05:10:10.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.493e-06 2024-09-13T05:10:10.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:10.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.252194+0000", 2024-09-13T05:10:10.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.004309205 2024-09-13T05:10:10.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:10.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.252288+0000", 2024-09-13T05:10:10.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3493999999999996e-05 2024-09-13T05:10:10.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:10.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.252390+0000", 2024-09-13T05:10:10.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010268900000000001 2024-09-13T05:10:10.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:10.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.257654+0000", 2024-09-13T05:10:10.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0052632629999999998 2024-09-13T05:10:10.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:10.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260190+0000", 2024-09-13T05:10:10.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025365129999999998 2024-09-13T05:10:10.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:10.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260227+0000", 2024-09-13T05:10:10.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6786999999999999e-05 2024-09-13T05:10:10.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:10.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260258+0000", 2024-09-13T05:10:10.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1390999999999998e-05 2024-09-13T05:10:10.625 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.625 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:10.625 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.625 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:10.625 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:54.247889+0000", 2024-09-13T05:10:10.625 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 16.287262388999999, 2024-09-13T05:10:10.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012593038000000001, 2024-09-13T05:10:10.625 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:10.625 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:10.625 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:10.626 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:10.626 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:10.626 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137 2024-09-13T05:10:10.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.626 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:10.626 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.626 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:10.626 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247889+0000", 2024-09-13T05:10:10.626 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.626 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.626 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:10.626 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247889+0000", 2024-09-13T05:10:10.626 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.627 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:10.627 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247889+0000", 2024-09-13T05:10:10.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:10.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.627 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:10.627 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247982+0000", 2024-09-13T05:10:10.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3286000000000001e-05 2024-09-13T05:10:10.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.627 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:10.627 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247995+0000", 2024-09-13T05:10:10.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2785e-05 2024-09-13T05:10:10.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.628 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:10.628 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248003+0000", 2024-09-13T05:10:10.628 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7400000000000004e-06 2024-09-13T05:10:10.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.628 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:10.628 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.252911+0000", 2024-09-13T05:10:10.628 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0049082259999999999 2024-09-13T05:10:10.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.628 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:10.628 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.252987+0000", 2024-09-13T05:10:10.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5841999999999997e-05 2024-09-13T05:10:10.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.629 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:10.629 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.253076+0000", 2024-09-13T05:10:10.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8790999999999997e-05 2024-09-13T05:10:10.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.629 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:10.629 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.257669+0000", 2024-09-13T05:10:10.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0045932810000000003 2024-09-13T05:10:10.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.629 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:10.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260344+0000", 2024-09-13T05:10:10.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0026755500000000001 2024-09-13T05:10:10.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.630 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.630 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:10.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260419+0000", 2024-09-13T05:10:10.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.4344999999999994e-05 2024-09-13T05:10:10.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.630 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.630 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:10.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260482+0000", 2024-09-13T05:10:10.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3571999999999994e-05 2024-09-13T05:10:10.630 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.630 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:10.631 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.631 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.631 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:10.631 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:54.248017+0000", 2024-09-13T05:10:10.631 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 16.28713492, 2024-09-13T05:10:10.631 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012591819000000001, 2024-09-13T05:10:10.631 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:10.631 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:10.631 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:10.631 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:10.631 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:10.631 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 138 2024-09-13T05:10:10.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.631 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:10.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.632 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:10.632 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248017+0000", 2024-09-13T05:10:10.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.632 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:10.632 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248017+0000", 2024-09-13T05:10:10.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.632 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:10.633 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248016+0000", 2024-09-13T05:10:10.633 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:10.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.633 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:10.633 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248022+0000", 2024-09-13T05:10:10.633 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9290000000000003e-06 2024-09-13T05:10:10.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.633 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:10.633 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248032+0000", 2024-09-13T05:10:10.633 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0067e-05 2024-09-13T05:10:10.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.633 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:10.634 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248039+0000", 2024-09-13T05:10:10.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.131e-06 2024-09-13T05:10:10.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.634 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:10.634 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.253989+0000", 2024-09-13T05:10:10.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.005949953 2024-09-13T05:10:10.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.634 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:10.634 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.254066+0000", 2024-09-13T05:10:10.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6835999999999994e-05 2024-09-13T05:10:10.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.635 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.635 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:10.635 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.254173+0000", 2024-09-13T05:10:10.635 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107392 2024-09-13T05:10:10.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.635 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.635 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:10.635 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.257699+0000", 2024-09-13T05:10:10.635 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003525622 2024-09-13T05:10:10.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.635 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.635 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:10.635 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260545+0000", 2024-09-13T05:10:10.635 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0028464240000000002 2024-09-13T05:10:10.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.636 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.636 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:10.636 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260579+0000", 2024-09-13T05:10:10.636 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3559999999999997e-05 2024-09-13T05:10:10.636 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.636 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.636 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:10.636 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260609+0000", 2024-09-13T05:10:10.636 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9773000000000001e-05 2024-09-13T05:10:10.636 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.636 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:10.636 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.636 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.637 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.637 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:10.637 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:54.248046+0000", 2024-09-13T05:10:10.637 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 16.287105333, 2024-09-13T05:10:10.637 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012766753, 2024-09-13T05:10:10.637 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:10.637 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:10.637 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:10.637 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:10.637 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:10.637 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 139 2024-09-13T05:10:10.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.637 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:10.637 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:10.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248046+0000", 2024-09-13T05:10:10.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:10.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248046+0000", 2024-09-13T05:10:10.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:10.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248046+0000", 2024-09-13T05:10:10.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:10.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.639 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.639 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:10.639 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248051+0000", 2024-09-13T05:10:10.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9060000000000001e-06 2024-09-13T05:10:10.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.639 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.639 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:10.639 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248060+0000", 2024-09-13T05:10:10.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8799999999999997e-06 2024-09-13T05:10:10.640 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.640 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.640 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:10.640 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248068+0000", 2024-09-13T05:10:10.640 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1880000000000002e-06 2024-09-13T05:10:10.640 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.640 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.640 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:10.640 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.254569+0000", 2024-09-13T05:10:10.640 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0065017749999999996 2024-09-13T05:10:10.640 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.640 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.640 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:10.640 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.254633+0000", 2024-09-13T05:10:10.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3781000000000005e-05 2024-09-13T05:10:10.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:10.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.254731+0000", 2024-09-13T05:10:10.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8078000000000005e-05 2024-09-13T05:10:10.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:10.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.257720+0000", 2024-09-13T05:10:10.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0029886859999999999 2024-09-13T05:10:10.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:10.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260684+0000", 2024-09-13T05:10:10.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0029637999999999999 2024-09-13T05:10:10.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.642 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:10.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260759+0000", 2024-09-13T05:10:10.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.4840999999999997e-05 2024-09-13T05:10:10.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.642 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:10.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260813+0000", 2024-09-13T05:10:10.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4404000000000003e-05 2024-09-13T05:10:10.642 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.643 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:10.643 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.643 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.643 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.643 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:10.643 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:54.248075+0000", 2024-09-13T05:10:10.643 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 16.287076951, 2024-09-13T05:10:10.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012859842999999999, 2024-09-13T05:10:10.643 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:10.643 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:10.643 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:10.643 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:10.644 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:10.644 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 140 2024-09-13T05:10:10.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.644 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:10.644 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.644 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:10.644 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248075+0000", 2024-09-13T05:10:10.644 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.644 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.644 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:10.644 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248075+0000", 2024-09-13T05:10:10.644 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.645 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:10.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248074+0000", 2024-09-13T05:10:10.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:10.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.645 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:10.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248203+0000", 2024-09-13T05:10:10.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012832300000000001 2024-09-13T05:10:10.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.645 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:10.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248214+0000", 2024-09-13T05:10:10.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1472e-05 2024-09-13T05:10:10.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.646 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.646 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:10.646 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248223+0000", 2024-09-13T05:10:10.646 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7110000000000001e-06 2024-09-13T05:10:10.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.646 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.646 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:10.646 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.255480+0000", 2024-09-13T05:10:10.646 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0072569890000000001 2024-09-13T05:10:10.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.646 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.646 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:10.646 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.255544+0000", 2024-09-13T05:10:10.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4790999999999997e-05 2024-09-13T05:10:10.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.647 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:10.647 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.255641+0000", 2024-09-13T05:10:10.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6411999999999998e-05 2024-09-13T05:10:10.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.647 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:10.647 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.258650+0000", 2024-09-13T05:10:10.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003008925 2024-09-13T05:10:10.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.647 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:10.648 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260873+0000", 2024-09-13T05:10:10.648 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002223334 2024-09-13T05:10:10.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.648 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.648 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:10.648 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260907+0000", 2024-09-13T05:10:10.648 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4267999999999998e-05 2024-09-13T05:10:10.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.648 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.648 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:10.648 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260935+0000", 2024-09-13T05:10:10.648 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7138e-05 2024-09-13T05:10:10.648 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.649 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:10.649 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.649 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.649 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.649 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:10.649 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:54.248235+0000", 2024-09-13T05:10:10.649 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 16.286916387000002, 2024-09-13T05:10:10.649 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012905777, 2024-09-13T05:10:10.649 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:10.649 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:10.649 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:10.649 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:10.649 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:10.649 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 141 2024-09-13T05:10:10.650 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.650 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:10.650 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.650 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:10.650 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248235+0000", 2024-09-13T05:10:10.650 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.650 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.650 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.650 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:10.650 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248235+0000", 2024-09-13T05:10:10.650 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.651 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.651 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:10.651 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248234+0000", 2024-09-13T05:10:10.651 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:10.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.651 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.651 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:10.651 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248241+0000", 2024-09-13T05:10:10.651 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1229999999999997e-06 2024-09-13T05:10:10.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.651 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.652 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:10.652 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248248+0000", 2024-09-13T05:10:10.652 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6690000000000006e-06 2024-09-13T05:10:10.652 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.652 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.652 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:10.652 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248255+0000", 2024-09-13T05:10:10.652 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3040000000000001e-06 2024-09-13T05:10:10.652 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.652 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.652 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:10.652 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.256428+0000", 2024-09-13T05:10:10.652 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.008173909 2024-09-13T05:10:10.653 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.653 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.653 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:10.653 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.256571+0000", 2024-09-13T05:10:10.653 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014262500000000001 2024-09-13T05:10:10.653 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.653 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.653 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:10.653 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.256745+0000", 2024-09-13T05:10:10.653 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017362700000000001 2024-09-13T05:10:10.653 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.653 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.653 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:10.653 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.258854+0000", 2024-09-13T05:10:10.654 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002109695 2024-09-13T05:10:10.654 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.654 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:10.654 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.261007+0000", 2024-09-13T05:10:10.654 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002152583 2024-09-13T05:10:10.654 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.654 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:10.654 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.261083+0000", 2024-09-13T05:10:10.654 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6002999999999997e-05 2024-09-13T05:10:10.654 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.654 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:10.655 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.261141+0000", 2024-09-13T05:10:10.655 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8057000000000003e-05 2024-09-13T05:10:10.655 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.655 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:10.655 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.655 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.655 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.655 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-13T05:10:10.655 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:55.053986+0000", 2024-09-13T05:10:10.655 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 15.481165532, 2024-09-13T05:10:10.655 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.011038081, 2024-09-13T05:10:10.655 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:10.655 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:10.655 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:10.656 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:10.656 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:10.656 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 158 2024-09-13T05:10:10.656 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.656 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:10.656 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.656 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:10.656 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.053986+0000", 2024-09-13T05:10:10.656 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.656 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.656 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.656 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:10.656 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.053986+0000", 2024-09-13T05:10:10.656 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.657 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.657 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.657 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:10.657 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.053985+0000", 2024-09-13T05:10:10.657 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:10.657 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.657 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.657 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:10.657 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054089+0000", 2024-09-13T05:10:10.657 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000103755 2024-09-13T05:10:10.657 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.657 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.657 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:10.657 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054125+0000", 2024-09-13T05:10:10.658 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5831000000000003e-05 2024-09-13T05:10:10.658 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.658 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.658 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:10.658 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054133+0000", 2024-09-13T05:10:10.658 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7139999999999993e-06 2024-09-13T05:10:10.658 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.658 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.658 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:10.658 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.061270+0000", 2024-09-13T05:10:10.658 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0071370490000000003 2024-09-13T05:10:10.658 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.658 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.658 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:10.658 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.061478+0000", 2024-09-13T05:10:10.659 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020772600000000001 2024-09-13T05:10:10.659 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.659 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.659 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:10.659 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.061704+0000", 2024-09-13T05:10:10.659 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00022674300000000001 2024-09-13T05:10:10.659 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.659 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.659 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:10.659 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.064234+0000", 2024-09-13T05:10:10.659 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025300990000000001 2024-09-13T05:10:10.659 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.659 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.659 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:10.660 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.064930+0000", 2024-09-13T05:10:10.660 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00069559000000000005 2024-09-13T05:10:10.660 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.660 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.660 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:10.660 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.064989+0000", 2024-09-13T05:10:10.660 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9240999999999997e-05 2024-09-13T05:10:10.660 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.660 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.660 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:10.661 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.065024+0000", 2024-09-13T05:10:10.661 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4987000000000002e-05 2024-09-13T05:10:10.661 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.661 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:10.661 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.661 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.661 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.661 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-13T05:10:10.661 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:55.054145+0000", 2024-09-13T05:10:10.661 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 15.481006454999999, 2024-09-13T05:10:10.661 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.011611452, 2024-09-13T05:10:10.661 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:10.661 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:10.661 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:10.662 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:10.662 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:10.662 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 159 2024-09-13T05:10:10.662 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.662 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:10.662 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.662 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:10.662 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054145+0000", 2024-09-13T05:10:10.662 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.662 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.662 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.662 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:10.662 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054145+0000", 2024-09-13T05:10:10.662 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:10.663 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.663 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.663 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:10.663 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054145+0000", 2024-09-13T05:10:10.663 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:10.663 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.663 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.663 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:10.663 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054154+0000", 2024-09-13T05:10:10.663 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1619999999999997e-06 2024-09-13T05:10:10.663 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.663 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.663 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:10.664 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054164+0000", 2024-09-13T05:10:10.664 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8740000000000007e-06 2024-09-13T05:10:10.664 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.664 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.664 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:10.664 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054170+0000", 2024-09-13T05:10:10.665 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3029999999999996e-06 2024-09-13T05:10:10.665 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.665 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.665 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:10.665 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.062773+0000", 2024-09-13T05:10:10.665 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0086030220000000001 2024-09-13T05:10:10.665 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.665 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.665 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:10.665 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.062998+0000", 2024-09-13T05:10:10.665 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00022516100000000001 2024-09-13T05:10:10.665 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.665 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.665 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:10.666 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.063265+0000", 2024-09-13T05:10:10.666 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00026744300000000002 2024-09-13T05:10:10.666 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.666 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.666 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:10.666 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.064693+0000", 2024-09-13T05:10:10.666 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001427537 2024-09-13T05:10:10.666 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.666 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.666 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:10.666 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.065665+0000", 2024-09-13T05:10:10.666 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00097195500000000004 2024-09-13T05:10:10.666 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.666 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.666 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:10.667 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.065725+0000", 2024-09-13T05:10:10.667 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0025000000000002e-05 2024-09-13T05:10:10.667 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:10.667 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:10.667 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:10.667 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.065757+0000", 2024-09-13T05:10:10.667 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1664e-05 2024-09-13T05:10:10.667 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.667 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:10.667 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.667 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:10.667 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:10.668 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:10.668 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T05:10:10.669 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:10.666+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:10.670 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:10:10.771 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:10.767+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:10.827 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:10.827 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:10.827 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:10:10.827 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:10.837 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:10:10.872 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:10.866+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:10.943 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:10.944 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:10.953 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:10:10.973 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:10.971+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:11.073 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:11.071+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:11.105 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4213.0:69 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'43, mlcod=15'39)", 2024-09-13T05:10:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:53.454450+0000", 2024-09-13T05:10:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.647002743000002, 2024-09-13T05:10:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042460509999999998, 2024-09-13T05:10:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.454450+0000", 2024-09-13T05:10:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.454450+0000", 2024-09-13T05:10:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.454448+0000", 2024-09-13T05:10:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.454502+0000", 2024-09-13T05:10:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4515999999999998e-05 2024-09-13T05:10:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.454530+0000", 2024-09-13T05:10:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7503000000000001e-05 2024-09-13T05:10:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.454542+0000", 2024-09-13T05:10:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2299e-05 2024-09-13T05:10:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.454633+0000", 2024-09-13T05:10:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0692000000000005e-05 2024-09-13T05:10:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.454664+0000", 2024-09-13T05:10:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1328999999999998e-05 2024-09-13T05:10:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.458644+0000", 2024-09-13T05:10:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039801999999999997 2024-09-13T05:10:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.458696+0000", 2024-09-13T05:10:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1239000000000002e-05 2024-09-13T05:10:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4213.0:70 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'44, mlcod=15'39)", 2024-09-13T05:10:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:53.455962+0000", 2024-09-13T05:10:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.645490731999999, 2024-09-13T05:10:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055315329999999999, 2024-09-13T05:10:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.455962+0000", 2024-09-13T05:10:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.455962+0000", 2024-09-13T05:10:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.455960+0000", 2024-09-13T05:10:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.455974+0000", 2024-09-13T05:10:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3548e-05 2024-09-13T05:10:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.455994+0000", 2024-09-13T05:10:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0642e-05 2024-09-13T05:10:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.456005+0000", 2024-09-13T05:10:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1075e-05 2024-09-13T05:10:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.456254+0000", 2024-09-13T05:10:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024868500000000001 2024-09-13T05:10:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.456286+0000", 2024-09-13T05:10:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2317000000000002e-05 2024-09-13T05:10:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.461411+0000", 2024-09-13T05:10:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005124656 2024-09-13T05:10:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.461493+0000", 2024-09-13T05:10:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2237999999999994e-05 2024-09-13T05:10:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4213.0:109 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'71, mlcod=15'67)", 2024-09-13T05:10:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:53.695240+0000", 2024-09-13T05:10:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.406212160999999, 2024-09-13T05:10:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052457240000000002, 2024-09-13T05:10:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.695240+0000", 2024-09-13T05:10:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.695240+0000", 2024-09-13T05:10:11.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.695239+0000", 2024-09-13T05:10:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.695359+0000", 2024-09-13T05:10:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119418 2024-09-13T05:10:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.695371+0000", 2024-09-13T05:10:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2088e-05 2024-09-13T05:10:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.695383+0000", 2024-09-13T05:10:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2029e-05 2024-09-13T05:10:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.695483+0000", 2024-09-13T05:10:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100105 2024-09-13T05:10:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.695520+0000", 2024-09-13T05:10:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6730999999999998e-05 2024-09-13T05:10:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.700385+0000", 2024-09-13T05:10:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048658219999999997 2024-09-13T05:10:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.700486+0000", 2024-09-13T05:10:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100634 2024-09-13T05:10:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4213.0:110 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'72, mlcod=15'67)", 2024-09-13T05:10:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:53.696344+0000", 2024-09-13T05:10:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.405108849000001, 2024-09-13T05:10:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055477299999999998, 2024-09-13T05:10:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.696344+0000", 2024-09-13T05:10:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.696344+0000", 2024-09-13T05:10:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.696343+0000", 2024-09-13T05:10:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.696357+0000", 2024-09-13T05:10:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4037e-05 2024-09-13T05:10:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.696395+0000", 2024-09-13T05:10:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8241999999999997e-05 2024-09-13T05:10:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.696406+0000", 2024-09-13T05:10:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0862e-05 2024-09-13T05:10:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.696468+0000", 2024-09-13T05:10:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2656000000000005e-05 2024-09-13T05:10:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.696493+0000", 2024-09-13T05:10:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4933e-05 2024-09-13T05:10:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.701799+0000", 2024-09-13T05:10:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053060980000000004 2024-09-13T05:10:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.701891+0000", 2024-09-13T05:10:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1932e-05 2024-09-13T05:10:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4213.0:111 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'73, mlcod=15'69)", 2024-09-13T05:10:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:53.697275+0000", 2024-09-13T05:10:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.404177625999999, 2024-09-13T05:10:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046484710000000004, 2024-09-13T05:10:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.697275+0000", 2024-09-13T05:10:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.697275+0000", 2024-09-13T05:10:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.697274+0000", 2024-09-13T05:10:11.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:11.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.697288+0000", 2024-09-13T05:10:11.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4465e-05 2024-09-13T05:10:11.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.697305+0000", 2024-09-13T05:10:11.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7275e-05 2024-09-13T05:10:11.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.697320+0000", 2024-09-13T05:10:11.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4545999999999999e-05 2024-09-13T05:10:11.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.697369+0000", 2024-09-13T05:10:11.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9296999999999999e-05 2024-09-13T05:10:11.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.697395+0000", 2024-09-13T05:10:11.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5522999999999999e-05 2024-09-13T05:10:11.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.701894+0000", 2024-09-13T05:10:11.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044989390000000004 2024-09-13T05:10:11.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.701923+0000", 2024-09-13T05:10:11.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9451e-05 2024-09-13T05:10:11.128 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.128 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.129 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.129 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4213.0:112 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'74, mlcod=15'69)", 2024-09-13T05:10:11.129 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:53.697842+0000", 2024-09-13T05:10:11.129 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.403610203, 2024-09-13T05:10:11.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041292519999999999, 2024-09-13T05:10:11.129 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.129 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.129 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.697842+0000", 2024-09-13T05:10:11.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.697842+0000", 2024-09-13T05:10:11.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.697841+0000", 2024-09-13T05:10:11.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:11.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.697925+0000", 2024-09-13T05:10:11.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4011999999999995e-05 2024-09-13T05:10:11.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.697943+0000", 2024-09-13T05:10:11.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7578999999999999e-05 2024-09-13T05:10:11.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.697951+0000", 2024-09-13T05:10:11.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9049999999999997e-06 2024-09-13T05:10:11.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.698002+0000", 2024-09-13T05:10:11.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1159000000000003e-05 2024-09-13T05:10:11.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.698025+0000", 2024-09-13T05:10:11.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3019000000000001e-05 2024-09-13T05:10:11.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.701927+0000", 2024-09-13T05:10:11.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039026579999999998 2024-09-13T05:10:11.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.701971+0000", 2024-09-13T05:10:11.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4016e-05 2024-09-13T05:10:11.133 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.133 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.133 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.133 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4213.0:113 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'75, mlcod=15'69)", 2024-09-13T05:10:11.133 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:53.698433+0000", 2024-09-13T05:10:11.133 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.403019376, 2024-09-13T05:10:11.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039723329999999998, 2024-09-13T05:10:11.134 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.134 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.134 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.698433+0000", 2024-09-13T05:10:11.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.698433+0000", 2024-09-13T05:10:11.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.698432+0000", 2024-09-13T05:10:11.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:11.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.698443+0000", 2024-09-13T05:10:11.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1542999999999999e-05 2024-09-13T05:10:11.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.698460+0000", 2024-09-13T05:10:11.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6639000000000001e-05 2024-09-13T05:10:11.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.698478+0000", 2024-09-13T05:10:11.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8346e-05 2024-09-13T05:10:11.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.698652+0000", 2024-09-13T05:10:11.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000173747 2024-09-13T05:10:11.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.698683+0000", 2024-09-13T05:10:11.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0800000000000003e-05 2024-09-13T05:10:11.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.702368+0000", 2024-09-13T05:10:11.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036849059999999999 2024-09-13T05:10:11.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:53.702405+0000", 2024-09-13T05:10:11.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7623999999999998e-05 2024-09-13T05:10:11.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.138 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.138 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.138 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4213.0:129 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'87, mlcod=15'85)", 2024-09-13T05:10:11.138 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:54.247310+0000", 2024-09-13T05:10:11.138 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.854142251999999, 2024-09-13T05:10:11.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048128329999999999, 2024-09-13T05:10:11.138 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.138 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.138 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.247310+0000", 2024-09-13T05:10:11.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.247310+0000", 2024-09-13T05:10:11.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.247308+0000", 2024-09-13T05:10:11.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:11.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.247322+0000", 2024-09-13T05:10:11.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.349e-05 2024-09-13T05:10:11.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.247346+0000", 2024-09-13T05:10:11.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4066e-05 2024-09-13T05:10:11.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.247367+0000", 2024-09-13T05:10:11.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0526e-05 2024-09-13T05:10:11.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.247472+0000", 2024-09-13T05:10:11.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105221 2024-09-13T05:10:11.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.247507+0000", 2024-09-13T05:10:11.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5722000000000001e-05 2024-09-13T05:10:11.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.252008+0000", 2024-09-13T05:10:11.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045006639999999997 2024-09-13T05:10:11.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.252123+0000", 2024-09-13T05:10:11.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114824 2024-09-13T05:10:11.142 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.142 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.142 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.142 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4213.0:130 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'88, mlcod=15'85)", 2024-09-13T05:10:11.143 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:54.248160+0000", 2024-09-13T05:10:11.143 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.853292061000001, 2024-09-13T05:10:11.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057665260000000001, 2024-09-13T05:10:11.143 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.143 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.143 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.248160+0000", 2024-09-13T05:10:11.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.248160+0000", 2024-09-13T05:10:11.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.248159+0000", 2024-09-13T05:10:11.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:11.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.248174+0000", 2024-09-13T05:10:11.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5140000000000001e-05 2024-09-13T05:10:11.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.248211+0000", 2024-09-13T05:10:11.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7391999999999997e-05 2024-09-13T05:10:11.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.248226+0000", 2024-09-13T05:10:11.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4673e-05 2024-09-13T05:10:11.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.248324+0000", 2024-09-13T05:10:11.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8128000000000006e-05 2024-09-13T05:10:11.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.248351+0000", 2024-09-13T05:10:11.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7613000000000001e-05 2024-09-13T05:10:11.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.253861+0000", 2024-09-13T05:10:11.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055099909999999997 2024-09-13T05:10:11.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.253927+0000", 2024-09-13T05:10:11.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5388999999999993e-05 2024-09-13T05:10:11.146 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.147 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.147 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.147 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4213.0:131 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'89, mlcod=15'85)", 2024-09-13T05:10:11.147 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:54.248910+0000", 2024-09-13T05:10:11.147 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.852542590999999, 2024-09-13T05:10:11.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050824570000000003, 2024-09-13T05:10:11.147 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.147 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.147 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.248910+0000", 2024-09-13T05:10:11.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.248910+0000", 2024-09-13T05:10:11.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.248908+0000", 2024-09-13T05:10:11.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:11.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.249122+0000", 2024-09-13T05:10:11.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021419200000000001 2024-09-13T05:10:11.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.249144+0000", 2024-09-13T05:10:11.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2016999999999999e-05 2024-09-13T05:10:11.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.249171+0000", 2024-09-13T05:10:11.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6571999999999999e-05 2024-09-13T05:10:11.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.249261+0000", 2024-09-13T05:10:11.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.009e-05 2024-09-13T05:10:11.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.249316+0000", 2024-09-13T05:10:11.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5482000000000002e-05 2024-09-13T05:10:11.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.253936+0000", 2024-09-13T05:10:11.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046195630000000001 2024-09-13T05:10:11.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.253992+0000", 2024-09-13T05:10:11.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6437999999999997e-05 2024-09-13T05:10:11.151 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.151 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.151 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.151 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4213.0:132 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'90, mlcod=15'85)", 2024-09-13T05:10:11.151 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:54.249776+0000", 2024-09-13T05:10:11.151 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.85167612, 2024-09-13T05:10:11.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060806219999999999, 2024-09-13T05:10:11.152 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.152 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.152 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.249776+0000", 2024-09-13T05:10:11.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.249776+0000", 2024-09-13T05:10:11.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.249775+0000", 2024-09-13T05:10:11.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:11.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.249788+0000", 2024-09-13T05:10:11.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3903000000000001e-05 2024-09-13T05:10:11.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.249837+0000", 2024-09-13T05:10:11.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8418999999999998e-05 2024-09-13T05:10:11.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.249850+0000", 2024-09-13T05:10:11.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2833000000000001e-05 2024-09-13T05:10:11.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.250472+0000", 2024-09-13T05:10:11.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062226899999999995 2024-09-13T05:10:11.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.250517+0000", 2024-09-13T05:10:11.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5402999999999999e-05 2024-09-13T05:10:11.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.255789+0000", 2024-09-13T05:10:11.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005271413 2024-09-13T05:10:11.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.255857+0000", 2024-09-13T05:10:11.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8069000000000002e-05 2024-09-13T05:10:11.155 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.155 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.155 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.156 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4213.0:133 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'91, mlcod=15'85)", 2024-09-13T05:10:11.156 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:54.250380+0000", 2024-09-13T05:10:11.156 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.851072244000001, 2024-09-13T05:10:11.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070360809999999996, 2024-09-13T05:10:11.156 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.156 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.156 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.250380+0000", 2024-09-13T05:10:11.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.250380+0000", 2024-09-13T05:10:11.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.250378+0000", 2024-09-13T05:10:11.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:11.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.250398+0000", 2024-09-13T05:10:11.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9547000000000001e-05 2024-09-13T05:10:11.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.250419+0000", 2024-09-13T05:10:11.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0551999999999999e-05 2024-09-13T05:10:11.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.250430+0000", 2024-09-13T05:10:11.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1559999999999999e-05 2024-09-13T05:10:11.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.251414+0000", 2024-09-13T05:10:11.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00098380499999999992 2024-09-13T05:10:11.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.251464+0000", 2024-09-13T05:10:11.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9965e-05 2024-09-13T05:10:11.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.257351+0000", 2024-09-13T05:10:11.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058866040000000001 2024-09-13T05:10:11.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.257416+0000", 2024-09-13T05:10:11.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5728000000000005e-05 2024-09-13T05:10:11.160 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.160 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.160 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.160 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4213.0:134 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'92, mlcod=15'85)", 2024-09-13T05:10:11.160 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:54.250943+0000", 2024-09-13T05:10:11.160 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.850509432999999, 2024-09-13T05:10:11.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065131590000000001, 2024-09-13T05:10:11.161 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.161 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.161 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.250943+0000", 2024-09-13T05:10:11.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.250943+0000", 2024-09-13T05:10:11.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.250941+0000", 2024-09-13T05:10:11.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:11.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.251001+0000", 2024-09-13T05:10:11.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9769000000000003e-05 2024-09-13T05:10:11.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.251036+0000", 2024-09-13T05:10:11.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5076000000000001e-05 2024-09-13T05:10:11.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.251048+0000", 2024-09-13T05:10:11.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.201e-05 2024-09-13T05:10:11.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.252173+0000", 2024-09-13T05:10:11.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011253509999999999 2024-09-13T05:10:11.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.252207+0000", 2024-09-13T05:10:11.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4066000000000002e-05 2024-09-13T05:10:11.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.257423+0000", 2024-09-13T05:10:11.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052157810000000001 2024-09-13T05:10:11.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.257456+0000", 2024-09-13T05:10:11.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2945999999999999e-05 2024-09-13T05:10:11.164 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.164 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.165 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.165 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4213.0:135 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'93, mlcod=15'85)", 2024-09-13T05:10:11.165 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:54.251620+0000", 2024-09-13T05:10:11.165 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.849832621000001, 2024-09-13T05:10:11.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058652330000000001, 2024-09-13T05:10:11.165 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.165 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.165 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.251620+0000", 2024-09-13T05:10:11.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.251620+0000", 2024-09-13T05:10:11.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.251618+0000", 2024-09-13T05:10:11.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:11.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.251633+0000", 2024-09-13T05:10:11.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4843e-05 2024-09-13T05:10:11.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.251688+0000", 2024-09-13T05:10:11.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4928e-05 2024-09-13T05:10:11.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.251705+0000", 2024-09-13T05:10:11.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6646999999999998e-05 2024-09-13T05:10:11.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.253272+0000", 2024-09-13T05:10:11.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001566961 2024-09-13T05:10:11.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.253302+0000", 2024-09-13T05:10:11.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0193e-05 2024-09-13T05:10:11.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.257462+0000", 2024-09-13T05:10:11.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041602180000000002 2024-09-13T05:10:11.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.257485+0000", 2024-09-13T05:10:11.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2895999999999999e-05 2024-09-13T05:10:11.169 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.169 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.169 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.169 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4213.0:136 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'94, mlcod=15'85)", 2024-09-13T05:10:11.169 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:54.252220+0000", 2024-09-13T05:10:11.169 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.849231924000001, 2024-09-13T05:10:11.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0074452040000000004, 2024-09-13T05:10:11.170 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.170 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.170 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.252220+0000", 2024-09-13T05:10:11.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.252220+0000", 2024-09-13T05:10:11.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.252219+0000", 2024-09-13T05:10:11.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:11.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.252231+0000", 2024-09-13T05:10:11.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1545999999999999e-05 2024-09-13T05:10:11.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.252263+0000", 2024-09-13T05:10:11.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1819999999999997e-05 2024-09-13T05:10:11.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.252278+0000", 2024-09-13T05:10:11.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5553000000000002e-05 2024-09-13T05:10:11.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.254067+0000", 2024-09-13T05:10:11.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017887020000000001 2024-09-13T05:10:11.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.254114+0000", 2024-09-13T05:10:11.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7539e-05 2024-09-13T05:10:11.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.259603+0000", 2024-09-13T05:10:11.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054890759999999999 2024-09-13T05:10:11.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.259666+0000", 2024-09-13T05:10:11.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2201999999999998e-05 2024-09-13T05:10:11.174 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.174 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.174 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.174 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4213.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'85)", 2024-09-13T05:10:11.174 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:54.253017+0000", 2024-09-13T05:10:11.174 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.848435741999999, 2024-09-13T05:10:11.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066770839999999998, 2024-09-13T05:10:11.174 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.175 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.175 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.253017+0000", 2024-09-13T05:10:11.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.253017+0000", 2024-09-13T05:10:11.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.253014+0000", 2024-09-13T05:10:11.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:10:11.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.253088+0000", 2024-09-13T05:10:11.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3777999999999997e-05 2024-09-13T05:10:11.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.253127+0000", 2024-09-13T05:10:11.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9348999999999999e-05 2024-09-13T05:10:11.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.253167+0000", 2024-09-13T05:10:11.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913000000000002e-05 2024-09-13T05:10:11.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.254698+0000", 2024-09-13T05:10:11.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015305360000000001 2024-09-13T05:10:11.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.254735+0000", 2024-09-13T05:10:11.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7579000000000001e-05 2024-09-13T05:10:11.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.259669+0000", 2024-09-13T05:10:11.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00493327 2024-09-13T05:10:11.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.259694+0000", 2024-09-13T05:10:11.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5148999999999999e-05 2024-09-13T05:10:11.178 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.178 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.178 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.179 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4213.0:138 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'96, mlcod=15'86)", 2024-09-13T05:10:11.179 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:54.254056+0000", 2024-09-13T05:10:11.179 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.847396698000001, 2024-09-13T05:10:11.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056944090000000001, 2024-09-13T05:10:11.179 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.179 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.179 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.254056+0000", 2024-09-13T05:10:11.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.254056+0000", 2024-09-13T05:10:11.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.254054+0000", 2024-09-13T05:10:11.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:11.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.254070+0000", 2024-09-13T05:10:11.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5573000000000002e-05 2024-09-13T05:10:11.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.254108+0000", 2024-09-13T05:10:11.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.858e-05 2024-09-13T05:10:11.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.254125+0000", 2024-09-13T05:10:11.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6782e-05 2024-09-13T05:10:11.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.255934+0000", 2024-09-13T05:10:11.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00180923 2024-09-13T05:10:11.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.255963+0000", 2024-09-13T05:10:11.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9156999999999999e-05 2024-09-13T05:10:11.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.259698+0000", 2024-09-13T05:10:11.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037350560000000001 2024-09-13T05:10:11.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.259750+0000", 2024-09-13T05:10:11.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1615e-05 2024-09-13T05:10:11.183 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.183 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.183 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.183 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4213.0:139 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'97, mlcod=15'86)", 2024-09-13T05:10:11.183 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:54.254551+0000", 2024-09-13T05:10:11.183 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.846901016, 2024-09-13T05:10:11.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052681960000000002, 2024-09-13T05:10:11.183 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.183 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.183 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.254551+0000", 2024-09-13T05:10:11.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.254551+0000", 2024-09-13T05:10:11.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.254551+0000", 2024-09-13T05:10:11.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:11.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.254560+0000", 2024-09-13T05:10:11.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6630000000000005e-06 2024-09-13T05:10:11.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.254577+0000", 2024-09-13T05:10:11.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6869000000000001e-05 2024-09-13T05:10:11.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.254585+0000", 2024-09-13T05:10:11.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2500000000000006e-06 2024-09-13T05:10:11.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.256637+0000", 2024-09-13T05:10:11.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020520920000000002 2024-09-13T05:10:11.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.256678+0000", 2024-09-13T05:10:11.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0921999999999999e-05 2024-09-13T05:10:11.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.259752+0000", 2024-09-13T05:10:11.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003073798 2024-09-13T05:10:11.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.259820+0000", 2024-09-13T05:10:11.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7461999999999999e-05 2024-09-13T05:10:11.187 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.187 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.187 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.188 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4213.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'88)", 2024-09-13T05:10:11.188 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:54.255506+0000", 2024-09-13T05:10:11.188 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.845946866999999, 2024-09-13T05:10:11.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043617120000000002, 2024-09-13T05:10:11.188 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.188 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.188 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.255506+0000", 2024-09-13T05:10:11.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.255506+0000", 2024-09-13T05:10:11.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.255503+0000", 2024-09-13T05:10:11.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:11.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.255589+0000", 2024-09-13T05:10:11.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5754000000000006e-05 2024-09-13T05:10:11.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.255613+0000", 2024-09-13T05:10:11.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4182999999999999e-05 2024-09-13T05:10:11.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.255639+0000", 2024-09-13T05:10:11.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5953e-05 2024-09-13T05:10:11.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.257555+0000", 2024-09-13T05:10:11.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019161270000000001 2024-09-13T05:10:11.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.257592+0000", 2024-09-13T05:10:11.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6834e-05 2024-09-13T05:10:11.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.259822+0000", 2024-09-13T05:10:11.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022293690000000001 2024-09-13T05:10:11.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.259867+0000", 2024-09-13T05:10:11.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5624999999999998e-05 2024-09-13T05:10:11.192 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.192 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.192 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.192 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4213.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'88)", 2024-09-13T05:10:11.192 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:54.256578+0000", 2024-09-13T05:10:11.193 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.844874558000001, 2024-09-13T05:10:11.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003800239, 2024-09-13T05:10:11.193 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.193 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.193 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.256578+0000", 2024-09-13T05:10:11.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.256578+0000", 2024-09-13T05:10:11.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.256576+0000", 2024-09-13T05:10:11.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:11.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.256593+0000", 2024-09-13T05:10:11.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6552999999999999e-05 2024-09-13T05:10:11.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.256615+0000", 2024-09-13T05:10:11.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2106000000000001e-05 2024-09-13T05:10:11.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.256630+0000", 2024-09-13T05:10:11.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5299999999999999e-05 2024-09-13T05:10:11.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.258953+0000", 2024-09-13T05:10:11.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023225559999999999 2024-09-13T05:10:11.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.258982+0000", 2024-09-13T05:10:11.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9434e-05 2024-09-13T05:10:11.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.260328+0000", 2024-09-13T05:10:11.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001346234 2024-09-13T05:10:11.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.260378+0000", 2024-09-13T05:10:11.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9679000000000003e-05 2024-09-13T05:10:11.197 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.197 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.197 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.197 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.197 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.197 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:11.198 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:10:11.199 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:11.195+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:11.299 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:11.294+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:11.308 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:11.308 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:11.308 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:10:11.308 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:11.317 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:10:11.400 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:11.394+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:11.473 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:11.473 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:11.473 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:11.473 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:11.473 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:11.482 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:10:11.501 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:11.499+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:11.585 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:11.585 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4275.0:5 2.2 e19/17 2:5cea7035:::rbd_info:head v 19'1, mlcod=0'0)", 2024-09-13T05:10:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:00.383370+0000", 2024-09-13T05:10:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.201105783999999, 2024-09-13T05:10:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001185443, 2024-09-13T05:10:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:00.383370+0000", 2024-09-13T05:10:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:00.383370+0000", 2024-09-13T05:10:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:00.383370+0000", 2024-09-13T05:10:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:00.383379+0000", 2024-09-13T05:10:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3000000000000007e-06 2024-09-13T05:10:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:00.383399+0000", 2024-09-13T05:10:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9933e-05 2024-09-13T05:10:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:00.383418+0000", 2024-09-13T05:10:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9185999999999999e-05 2024-09-13T05:10:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:00.383487+0000", 2024-09-13T05:10:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8802999999999998e-05 2024-09-13T05:10:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:00.383505+0000", 2024-09-13T05:10:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8060999999999999e-05 2024-09-13T05:10:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:00.384484+0000", 2024-09-13T05:10:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00097902899999999997 2024-09-13T05:10:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:00.384556+0000", 2024-09-13T05:10:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1693999999999995e-05 2024-09-13T05:10:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4275.0:7 2.2 e20/17 2:5cea7035:::rbd_info:head v 20'2, mlcod=0'0)", 2024-09-13T05:10:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:01.391858+0000", 2024-09-13T05:10:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.19261844, 2024-09-13T05:10:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001636532, 2024-09-13T05:10:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:01.391858+0000", 2024-09-13T05:10:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:01.391858+0000", 2024-09-13T05:10:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:01.391857+0000", 2024-09-13T05:10:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:01.391865+0000", 2024-09-13T05:10:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3459999999999996e-06 2024-09-13T05:10:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:01.391894+0000", 2024-09-13T05:10:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8907e-05 2024-09-13T05:10:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:01.391917+0000", 2024-09-13T05:10:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2955999999999998e-05 2024-09-13T05:10:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:01.392027+0000", 2024-09-13T05:10:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110822 2024-09-13T05:10:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:01.392076+0000", 2024-09-13T05:10:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9004e-05 2024-09-13T05:10:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:01.393423+0000", 2024-09-13T05:10:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001346224 2024-09-13T05:10:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:01.393494+0000", 2024-09-13T05:10:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1608999999999998e-05 2024-09-13T05:10:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:7 3.1a 3:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-13T05:10:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:10.645608+0000", 2024-09-13T05:10:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.93886800999999998, 2024-09-13T05:10:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024183529999999998, 2024-09-13T05:10:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7 2024-09-13T05:10:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.645608+0000", 2024-09-13T05:10:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.645608+0000", 2024-09-13T05:10:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.645606+0000", 2024-09-13T05:10:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:10:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.645620+0000", 2024-09-13T05:10:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4528e-05 2024-09-13T05:10:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.645639+0000", 2024-09-13T05:10:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8627999999999999e-05 2024-09-13T05:10:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.645652+0000", 2024-09-13T05:10:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3505e-05 2024-09-13T05:10:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.645721+0000", 2024-09-13T05:10:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8899999999999994e-05 2024-09-13T05:10:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.645867+0000", 2024-09-13T05:10:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014599700000000001 2024-09-13T05:10:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-13T05:10:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.645992+0000", 2024-09-13T05:10:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012439499999999999 2024-09-13T05:10:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.647111+0000", 2024-09-13T05:10:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001119028 2024-09-13T05:10:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.647965+0000", 2024-09-13T05:10:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00085449099999999997 2024-09-13T05:10:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.648001+0000", 2024-09-13T05:10:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6062999999999997e-05 2024-09-13T05:10:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.648026+0000", 2024-09-13T05:10:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5239999999999999e-05 2024-09-13T05:10:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4397.0:7 3.1a e23/22 ondisk, result = 0)", 2024-09-13T05:10:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:10.647892+0000", 2024-09-13T05:10:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.93658401599999996, 2024-09-13T05:10:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014003099999999999, 2024-09-13T05:10:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.647892+0000", 2024-09-13T05:10:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.647892+0000", 2024-09-13T05:10:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.647891+0000", 2024-09-13T05:10:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.647899+0000", 2024-09-13T05:10:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8890000000000002e-06 2024-09-13T05:10:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.647913+0000", 2024-09-13T05:10:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4806e-05 2024-09-13T05:10:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.647920+0000", 2024-09-13T05:10:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3060000000000003e-06 2024-09-13T05:10:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.647956+0000", 2024-09-13T05:10:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6216e-05 2024-09-13T05:10:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.647962+0000", 2024-09-13T05:10:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8710000000000002e-06 2024-09-13T05:10:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.648032+0000", 2024-09-13T05:10:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0408999999999996e-05 2024-09-13T05:10:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.605 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.605 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.605 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:11.606 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:10:11.607 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:11.602+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:11.653 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is set 2024-09-13T05:10:11.709 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:11.706+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:11.750 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:11.750 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:11.750 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:10:11.750 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:11.760 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:10:11.809 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:11.807+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:11.864 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:11.864 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:11.864 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:11.864 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:11.865 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:11.874 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:10:11.909 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:11.906+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:11.976 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4275.0:1 2.3 e18/17 2:c4c92e5a:::rbd_trash:head v 18'1, mlcod=0'0)", 2024-09-13T05:10:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:59.372565+0000", 2024-09-13T05:10:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.603515127, 2024-09-13T05:10:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00065873600000000004, 2024-09-13T05:10:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:59.372565+0000", 2024-09-13T05:10:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:59.372565+0000", 2024-09-13T05:10:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:59.372565+0000", 2024-09-13T05:10:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:59.372572+0000", 2024-09-13T05:10:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1550000000000001e-06 2024-09-13T05:10:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:59.372591+0000", 2024-09-13T05:10:11.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8683000000000001e-05 2024-09-13T05:10:11.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:59.372603+0000", 2024-09-13T05:10:11.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2509e-05 2024-09-13T05:10:11.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:59.372644+0000", 2024-09-13T05:10:11.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0426999999999998e-05 2024-09-13T05:10:11.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:59.372670+0000", 2024-09-13T05:10:11.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6122000000000002e-05 2024-09-13T05:10:11.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:59.373194+0000", 2024-09-13T05:10:11.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00052383900000000001 2024-09-13T05:10:11.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:59.373224+0000", 2024-09-13T05:10:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0239999999999998e-05 2024-09-13T05:10:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:7 3.1a e24/22 3:5cea7035:::rbd_info:head v 24'1, mlcod=0'0)", 2024-09-13T05:10:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:10.646211+0000", 2024-09-13T05:10:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.3298690739999999, 2024-09-13T05:10:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016111330000000001, 2024-09-13T05:10:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.646211+0000", 2024-09-13T05:10:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.646211+0000", 2024-09-13T05:10:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.646211+0000", 2024-09-13T05:10:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.646220+0000", 2024-09-13T05:10:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9000000000000001e-06 2024-09-13T05:10:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.646242+0000", 2024-09-13T05:10:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1365999999999998e-05 2024-09-13T05:10:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.646277+0000", 2024-09-13T05:10:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5009000000000003e-05 2024-09-13T05:10:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.646377+0000", 2024-09-13T05:10:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010064300000000001 2024-09-13T05:10:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.646408+0000", 2024-09-13T05:10:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0263000000000001e-05 2024-09-13T05:10:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.647767+0000", 2024-09-13T05:10:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001359227 2024-09-13T05:10:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.647822+0000", 2024-09-13T05:10:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5340999999999998e-05 2024-09-13T05:10:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:9 3.1a e25/22 3:5cea7035:::rbd_info:head v 25'2, mlcod=0'0)", 2024-09-13T05:10:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:11.656060+0000", 2024-09-13T05:10:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.32001998500000001, 2024-09-13T05:10:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028724660000000002, 2024-09-13T05:10:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.656060+0000", 2024-09-13T05:10:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.656060+0000", 2024-09-13T05:10:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.656059+0000", 2024-09-13T05:10:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.656070+0000", 2024-09-13T05:10:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1240000000000001e-05 2024-09-13T05:10:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.656087+0000", 2024-09-13T05:10:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7235e-05 2024-09-13T05:10:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.656098+0000", 2024-09-13T05:10:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0699999999999999e-05 2024-09-13T05:10:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.656178+0000", 2024-09-13T05:10:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9668999999999999e-05 2024-09-13T05:10:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.656216+0000", 2024-09-13T05:10:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7812999999999999e-05 2024-09-13T05:10:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.658880+0000", 2024-09-13T05:10:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026647590000000001 2024-09-13T05:10:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.658933+0000", 2024-09-13T05:10:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2324000000000003e-05 2024-09-13T05:10:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:11.993 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:11.993 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:11.994 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:10:12.010 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:12.007+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:12.111 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:12.107+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:12.144 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:12.145 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:12.145 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:10:12.145 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:12.154 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:10:12.213 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:12.211+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:12.254 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:12.254 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:12.254 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:12.254 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:12.255 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:12.263 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:10:12.268 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:10:12.314 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:12.311+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:12.364 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:12.364 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:12.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:12.364 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [] 2024-09-13T05:10:12.365 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:12.374 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:10:12.390 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:10:12.410 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:10:12.414 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:12.410+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:12.428 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:10:12.448 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:10:12.469 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:10:12.491 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:12.491 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:12.492 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:10:12.501 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:10:12.514 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:10:12.515 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:12.510+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:12.534 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:10:12.536 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:10:12.536 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:10:12.536 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:10:12.536 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:10:12.536 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:10:12.537 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:10:12.537 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:10:12.537 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:10:12.602 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:12.603 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:12.612 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:10:12.616 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:12.611+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:12.716 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:12.711+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:12.719 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:12.719 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:12.729 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:10:12.818 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:12.815+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:12.837 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:12.837 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:12.847 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:10:12.918 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:12.915+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:12.949 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:12.949 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:12.959 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:10:13.020 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:13.014+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:13.065 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:13.065 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:13.075 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:10:13.121 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:13.119+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:13.179 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:13.179 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:13.189 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:10:13.222 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:13.218+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:13.297 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:13.297 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:13.306 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:10:13.322 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:13.318+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:13.415 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:13.415 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:13.423 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:13.419+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:13.425 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:10:13.525 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:13.518+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:13.578 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:13.578 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:13.588 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:10:13.619 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:13.625 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:13.622+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:13.635 INFO:teuthology.orchestra.run.smithi120.stdout:2 write 0x29ad5f3 thru 0x29b0110 (0x2b1e bytes) 2024-09-13T05:10:13.642 INFO:teuthology.orchestra.run.smithi120.stdout:4 punch from 0x1cd845a to 0x1cdfbfc, (0x77a2 bytes) 2024-09-13T05:10:13.642 INFO:teuthology.orchestra.run.smithi120.stdout:truncating to largest ever: 0x6e601de 2024-09-13T05:10:13.650 INFO:teuthology.orchestra.run.smithi120.stdout:5 trunc from 0x29b0111 to 0x6e601de 2024-09-13T05:10:13.651 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7] out_osds: [4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T05:10:13.652 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:10:13.652 INFO:tasks.thrashosds.thrasher:Setting full ratio to .001 2024-09-13T05:10:13.652 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .001 2024-09-13T05:10:13.665 INFO:teuthology.orchestra.run.smithi120.stdout:6 read 0x1441bd5 thru 0x14458a6 (0x3cd2 bytes) 2024-09-13T05:10:13.665 INFO:teuthology.orchestra.run.smithi120.stdout:7 read 0x46e1fe8 thru 0x46e4eec (0x2f05 bytes) 2024-09-13T05:10:13.665 INFO:teuthology.orchestra.run.smithi120.stdout:8 read 0x1b0e005 thru 0x1b137ae (0x57aa bytes) 2024-09-13T05:10:13.666 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:13.666 INFO:teuthology.orchestra.run.smithi120.stdout:11 write 0x3d852e3 thru 0x3d8bbf0 (0x690e bytes) 2024-09-13T05:10:13.667 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T05:10:13.671 INFO:teuthology.orchestra.run.smithi120.stdout:12 trunc from 0x6e601de to 0x6baffd1 2024-09-13T05:10:13.682 INFO:teuthology.orchestra.run.smithi120.stdout:13 write 0xb89e6a thru 0xb95624 (0xb7bb bytes) 2024-09-13T05:10:13.697 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:13.697 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:13.705 INFO:teuthology.orchestra.run.smithi120.stdout:14 write 0xac5474b thru 0xac5c21b (0x7ad1 bytes) 2024-09-13T05:10:13.709 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:10:13.713 INFO:teuthology.orchestra.run.smithi120.stdout:15 read 0xe51fb2 thru 0xe55eef (0x3f3e bytes) 2024-09-13T05:10:13.713 INFO:teuthology.orchestra.run.smithi120.stdout:16 punch from 0x6fb47f7 to 0x6fb7b6e, (0x3377 bytes) 2024-09-13T05:10:13.727 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:13.722+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:13.729 INFO:teuthology.orchestra.run.smithi120.stdout:17 write 0xb379a4f thru 0xb388ce7 (0xf299 bytes) 2024-09-13T05:10:13.736 INFO:teuthology.orchestra.run.smithi120.stdout:truncating to largest ever: 0xd717224 2024-09-13T05:10:13.740 INFO:teuthology.orchestra.run.smithi120.stdout:18 trunc from 0xb388ce8 to 0xd717224 2024-09-13T05:10:13.750 INFO:teuthology.orchestra.run.smithi120.stdout:21 writesame 0x2fb67b8 thru 0x2fb7c12 data_size 0x9(0x145b bytes) 2024-09-13T05:10:13.772 INFO:teuthology.orchestra.run.smithi120.stdout:25 trunc from 0xd717224 to 0x1534d07 2024-09-13T05:10:13.790 INFO:teuthology.orchestra.run.smithi120.stdout:27 punch from 0x502aa6 to 0x50888a, (0x5de4 bytes) 2024-09-13T05:10:13.790 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:13.808 INFO:teuthology.orchestra.run.smithi120.stdout:30 write 0x8a03c3a thru 0x8a041c4 (0x58b bytes) 2024-09-13T05:10:13.813 INFO:teuthology.orchestra.run.smithi120.stdout:31 writesame 0xab3d66 thru 0xabde34 data_size 0x1(0xa0cf bytes) 2024-09-13T05:10:13.821 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:13.821 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:13.828 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:13.823+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:13.831 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:10:13.846 INFO:teuthology.orchestra.run.smithi120.stdout:32 punch from 0x4e7a58c to 0x4e86bf4, (0xc668 bytes) 2024-09-13T05:10:13.859 INFO:teuthology.orchestra.run.smithi120.stdout:33 trunc from 0x8a041c5 to 0x11c9cd1 2024-09-13T05:10:13.900 INFO:teuthology.orchestra.run.smithi120.stdout:34 write 0xbf3831c thru 0xbf3eac1 (0x67a6 bytes) 2024-09-13T05:10:13.921 INFO:teuthology.orchestra.run.smithi120.stdout:35 trunc from 0xbf3eac2 to 0x1ad1d0b 2024-09-13T05:10:13.928 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:13.922+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:13.948 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:13.948 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:13.957 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:10:13.957 INFO:teuthology.orchestra.run.smithi120.stdout:37 write 0x6a6d8cb thru 0x6a7d042 (0xf778 bytes) 2024-09-13T05:10:13.963 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:13.963 INFO:teuthology.orchestra.run.smithi120.stdout:45 read 0x172b1d0 thru 0x173b163 (0xff94 bytes) 2024-09-13T05:10:13.963 INFO:teuthology.orchestra.run.smithi120.stdout:46 punch from 0x1f18e32 to 0x1f1afc9, (0x2197 bytes) 2024-09-13T05:10:13.963 INFO:teuthology.orchestra.run.smithi120.stdout:48 read 0x891f4b thru 0x89a3f9 (0x84af bytes) 2024-09-13T05:10:13.964 INFO:teuthology.orchestra.run.smithi120.stdout:49 read 0xb82670 thru 0xb8339b (0xd2c bytes) 2024-09-13T05:10:13.964 INFO:teuthology.orchestra.run.smithi120.stdout:50 write 0x388ebf thru 0x394f4c (0xc08e bytes) 2024-09-13T05:10:13.989 INFO:teuthology.orchestra.run.smithi120.stdout:53 write 0xcbf1f21 thru 0xcc006c8 (0xe7a8 bytes) 2024-09-13T05:10:13.998 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:14.013 INFO:teuthology.orchestra.run.smithi120.stdout:55 trunc from 0xcc006c9 to 0x9d30b5 2024-09-13T05:10:14.029 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:14.026+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:14.059 INFO:teuthology.orchestra.run.smithi120.stdout:56 write 0x94b96c7 thru 0x94bc617 (0x2f51 bytes) 2024-09-13T05:10:14.066 INFO:teuthology.orchestra.run.smithi120.stdout:57 write 0x2bc8bb thru 0x2c3e5f (0x75a5 bytes) 2024-09-13T05:10:14.073 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:14.073 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:14.081 INFO:teuthology.orchestra.run.smithi120.stdout:58 trunc from 0x94bc618 to 0xf450b4 2024-09-13T05:10:14.086 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:10:14.105 INFO:teuthology.orchestra.run.smithi120.stdout:59 read 0x74e24f thru 0x753fe2 (0x5d94 bytes) 2024-09-13T05:10:14.105 INFO:teuthology.orchestra.run.smithi120.stdout:60 punch from 0x730156 to 0x73d678, (0xd522 bytes) 2024-09-13T05:10:14.142 INFO:teuthology.orchestra.run.smithi120.stdout:61 write 0xe58b7d6 thru 0xe58e667 (0x2e92 bytes) 2024-09-13T05:10:14.142 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:14.138+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:14.148 INFO:teuthology.orchestra.run.smithi120.stdout:63 read 0x8f3d025 thru 0x8f4b4c7 (0xe4a3 bytes) 2024-09-13T05:10:14.148 INFO:teuthology.orchestra.run.smithi120.stdout:64 read 0x34eb7e0 thru 0x34f1418 (0x5c39 bytes) 2024-09-13T05:10:14.148 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:14.148 INFO:teuthology.orchestra.run.smithi120.stdout:66 writesame 0x96944b1 thru 0x96a226c data_size 0x2e(0xddbc bytes) 2024-09-13T05:10:14.155 INFO:teuthology.orchestra.run.smithi120.stdout:67 read 0x36e5c thru 0x3faaf (0x8c54 bytes) 2024-09-13T05:10:14.169 INFO:teuthology.orchestra.run.smithi120.stdout:68 trunc from 0xe58e668 to 0x58abd4a 2024-09-13T05:10:14.192 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:14.192 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:14.198 INFO:teuthology.orchestra.run.smithi120.stdout:71 trunc from 0x58abd4a to 0xa038eb5 2024-09-13T05:10:14.226 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:14.226 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:14.231 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:14.227+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:14.232 INFO:teuthology.orchestra.run.smithi120.stdout:72 writesame 0xe5405b6 thru 0xe54fe53 data_size 0x16(0xf89e bytes) 2024-09-13T05:10:14.232 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:14.232 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:14.238 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:10:14.239 INFO:teuthology.orchestra.run.smithi120.stdout:79 trunc from 0xe54fe54 to 0xa664bfd 2024-09-13T05:10:14.251 INFO:teuthology.orchestra.run.smithi120.stdout:80 writesame 0xade34f thru 0xae72c6 data_size 0x4(0x8f78 bytes) 2024-09-13T05:10:14.263 INFO:teuthology.orchestra.run.smithi120.stdout:81 read 0x55ee153 thru 0x55f7e54 (0x9d02 bytes) 2024-09-13T05:10:14.263 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:14.278 INFO:teuthology.orchestra.run.smithi120.stdout:83 writesame 0xbebdd82 thru 0xbebf587 data_size 0x32(0x1806 bytes) 2024-09-13T05:10:14.278 INFO:teuthology.orchestra.run.smithi120.stdout:84 write 0x73313ab thru 0x733522c (0x3e82 bytes) 2024-09-13T05:10:14.284 INFO:teuthology.orchestra.run.smithi120.stdout:85 write 0x1d8c6f thru 0x1e56a0 (0xca32 bytes) 2024-09-13T05:10:14.287 INFO:teuthology.orchestra.run.smithi120.stdout:87 read 0xb043bb8 thru 0xb04f665 (0xbaae bytes) 2024-09-13T05:10:14.301 INFO:teuthology.orchestra.run.smithi120.stdout:89 write 0xcfb5301 thru 0xcfb691a (0x161a bytes) 2024-09-13T05:10:14.318 INFO:teuthology.orchestra.run.smithi120.stdout:91 trunc from 0xcfb691b to 0x69af54c 2024-09-13T05:10:14.333 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:14.326+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:14.343 INFO:teuthology.orchestra.run.smithi120.stdout:92 read 0x5708330 thru 0x57168e5 (0xe5b6 bytes) 2024-09-13T05:10:14.343 INFO:teuthology.orchestra.run.smithi120.stdout:96 punch from 0x32b383c to 0x32b54da, (0x1c9e bytes) 2024-09-13T05:10:14.343 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:14.343 INFO:teuthology.orchestra.run.smithi120.stdout:98 writesame 0x67fe9ec thru 0x6805e38 data_size 0x1(0x744d bytes) 2024-09-13T05:10:14.366 INFO:teuthology.orchestra.run.smithi120.stdout:99 read 0x264b03c thru 0x2657176 (0xc13b bytes) 2024-09-13T05:10:14.376 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:14.376 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:14.386 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:10:14.389 INFO:teuthology.orchestra.run.smithi120.stdout:100 write 0xbf3c3c2 thru 0xbf49be3 (0xd822 bytes) 2024-09-13T05:10:14.395 INFO:teuthology.orchestra.run.smithi120.stdout:101 writesame 0xb5cfef1 thru 0xb5ddb92 data_size 0x1f(0xdca2 bytes) 2024-09-13T05:10:14.403 INFO:teuthology.orchestra.run.smithi120.stdout:102 trunc from 0xbf49be4 to 0xbb1e035 2024-09-13T05:10:14.423 INFO:teuthology.orchestra.run.smithi120.stdout:103 read 0x93725cc thru 0x937a2cb (0x7d00 bytes) 2024-09-13T05:10:14.424 INFO:teuthology.orchestra.run.smithi120.stdout:105 punch from 0x3ae0ff to 0x3bbd2f, (0xdc30 bytes) 2024-09-13T05:10:14.424 INFO:teuthology.orchestra.run.smithi120.stdout:106 read 0x32c8ff8 thru 0x32cba46 (0x2a4f bytes) 2024-09-13T05:10:14.424 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:14.424 INFO:teuthology.orchestra.run.smithi120.stdout:108 write 0xb25218 thru 0xb26d15 (0x1afe bytes) 2024-09-13T05:10:14.427 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:14.427 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:14.427 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:14.427 INFO:teuthology.orchestra.run.smithi120.stdout:112 read 0x1180625 thru 0x11830fd (0x2ad9 bytes) 2024-09-13T05:10:14.427 INFO:teuthology.orchestra.run.smithi120.stdout:113 write 0x9735832 thru 0x973aa52 (0x5221 bytes) 2024-09-13T05:10:14.433 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:14.431+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:14.434 INFO:teuthology.orchestra.run.smithi120.stdout:114 read 0x48ea761 thru 0x48f7acb (0xd36b bytes) 2024-09-13T05:10:14.435 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:14.435 INFO:teuthology.orchestra.run.smithi120.stdout:116 trunc from 0xbb1e035 to 0xba12e93 2024-09-13T05:10:14.447 INFO:teuthology.orchestra.run.smithi120.stdout:117 write 0x5dfdd6e thru 0x5e04aa5 (0x6d38 bytes) 2024-09-13T05:10:14.455 INFO:teuthology.orchestra.run.smithi120.stdout:118 writesame 0x9d4c7c5 thru 0x9d54de6 data_size 0x6(0x8622 bytes) 2024-09-13T05:10:14.467 INFO:teuthology.orchestra.run.smithi120.stdout:119 read 0x1e657d thru 0x1f03b4 (0x9e38 bytes) 2024-09-13T05:10:14.468 INFO:teuthology.orchestra.run.smithi120.stdout:120 punch from 0x4c39c89 to 0x4c40ed5, (0x724c bytes) 2024-09-13T05:10:14.468 INFO:teuthology.orchestra.run.smithi120.stdout:121 read 0xa682315 thru 0xa68b333 (0x901f bytes) 2024-09-13T05:10:14.468 INFO:teuthology.orchestra.run.smithi120.stdout:122 write 0x245b970 thru 0x245bd86 (0x417 bytes) 2024-09-13T05:10:14.475 INFO:teuthology.orchestra.run.smithi120.stdout:124 write 0x6a12895 thru 0x6a1345a (0xbc6 bytes) 2024-09-13T05:10:14.479 INFO:teuthology.orchestra.run.smithi120.stdout:125 write 0x993b6e2 thru 0x9945e9c (0xa7bb bytes) 2024-09-13T05:10:14.485 INFO:teuthology.orchestra.run.smithi120.stdout:126 punch from 0x9612445 to 0x961dbff, (0xb7ba bytes) 2024-09-13T05:10:14.485 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:14.485 INFO:teuthology.orchestra.run.smithi120.stdout:128 punch from 0x1500f7 to 0x15c1a0, (0xc0a9 bytes) 2024-09-13T05:10:14.485 INFO:teuthology.orchestra.run.smithi120.stdout:129 read 0x377ef2f thru 0x3786caa (0x7d7c bytes) 2024-09-13T05:10:14.485 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:14.486 INFO:teuthology.orchestra.run.smithi120.stdout:132 read 0x73b53 thru 0x7e108 (0xa5b6 bytes) 2024-09-13T05:10:14.486 INFO:teuthology.orchestra.run.smithi120.stdout:133 read 0x3ced60 thru 0x3ddd4a (0xefeb bytes) 2024-09-13T05:10:14.487 INFO:teuthology.orchestra.run.smithi120.stdout:134 read 0x811d5b8 thru 0x8127551 (0x9f9a bytes) 2024-09-13T05:10:14.487 INFO:teuthology.orchestra.run.smithi120.stdout:136 read 0x5f821dc thru 0x5f91e04 (0xfc29 bytes) 2024-09-13T05:10:14.488 INFO:teuthology.orchestra.run.smithi120.stdout:137 punch from 0x70c5623 to 0x70d032b, (0xad08 bytes) 2024-09-13T05:10:14.488 INFO:teuthology.orchestra.run.smithi120.stdout:138 punch from 0x32eca70 to 0x32f1251, (0x47e1 bytes) 2024-09-13T05:10:14.498 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:14.499 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:14.507 INFO:teuthology.orchestra.run.smithi120.stdout:139 write 0xec418e6 thru 0xec4d634 (0xbd4f bytes) 2024-09-13T05:10:14.509 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:10:14.514 INFO:teuthology.orchestra.run.smithi120.stdout:140 write 0x1b7d937 thru 0x1b81522 (0x3bec bytes) 2024-09-13T05:10:14.522 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:14.525 INFO:teuthology.orchestra.run.smithi120.stdout:142 trunc from 0xec4d635 to 0xcf391bd 2024-09-13T05:10:14.534 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:14.531+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:14.545 INFO:teuthology.orchestra.run.smithi120.stdout:144 write 0x58d736b thru 0x58de3ca (0x7060 bytes) 2024-09-13T05:10:14.547 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:10:14.551 INFO:teuthology.orchestra.run.smithi120.stdout:146 punch from 0x52e158c to 0x52e5a12, (0x4486 bytes) 2024-09-13T05:10:14.551 INFO:teuthology.orchestra.run.smithi120.stdout:147 punch from 0x54e1aaf to 0x54e48f8, (0x2e49 bytes) 2024-09-13T05:10:14.565 INFO:teuthology.orchestra.run.smithi120.stdout:148 writesame 0xdc4e106 thru 0xdc5ab08 data_size 0x1(0xca03 bytes) 2024-09-13T05:10:14.579 INFO:teuthology.orchestra.run.smithi120.stdout:149 trunc from 0xdc5ab09 to 0x4e18555 2024-09-13T05:10:14.621 INFO:teuthology.orchestra.run.smithi120.stdout:150 write 0xa25bb10 thru 0xa25d677 (0x1b68 bytes) 2024-09-13T05:10:14.635 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:14.631+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:14.638 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:14.638 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:14.640 INFO:teuthology.orchestra.run.smithi120.stdout:152 trunc from 0xa25d678 to 0x1fffe3b 2024-09-13T05:10:14.650 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:10:14.664 INFO:tasks.ceph.mon.a.smithi120.stderr:2024-09-13T05:10:14.658+0000 7fa8ba335700 -1 log_channel(cluster) log [ERR] : Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL) 2024-09-13T05:10:14.681 INFO:teuthology.orchestra.run.smithi120.stderr:osd set-full-ratio 0.001 2024-09-13T05:10:14.682 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is unset 2024-09-13T05:10:14.682 INFO:teuthology.orchestra.run.smithi120.stdout:153 trunc from 0x1fffe3b to 0xc4c1257 2024-09-13T05:10:14.696 INFO:teuthology.orchestra.run.smithi120.stdout:155 punch from 0x8303830 to 0x8309eb0, (0x6680 bytes) 2024-09-13T05:10:14.707 INFO:teuthology.orchestra.run.smithi120.stdout:156 write 0xc681a0d thru 0xc68dc5a (0xc24e bytes) 2024-09-13T05:10:14.708 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:10:14.714 INFO:teuthology.orchestra.run.smithi120.stdout:157 read 0x86e7c0a thru 0x86e9e3e (0x2235 bytes) 2024-09-13T05:10:14.714 INFO:teuthology.orchestra.run.smithi120.stdout:158 write 0xbead24f thru 0xbeb4e22 (0x7bd4 bytes) 2024-09-13T05:10:14.721 INFO:teuthology.orchestra.run.smithi120.stdout:159 write 0x2e583d6 thru 0x2e5b263 (0x2e8e bytes) 2024-09-13T05:10:14.729 INFO:teuthology.orchestra.run.smithi120.stdout:160 read 0x6c26859 thru 0x6c2f6d4 (0x8e7c bytes) 2024-09-13T05:10:14.729 INFO:teuthology.orchestra.run.smithi120.stdout:161 write 0x89197fe thru 0x892395f (0xa162 bytes) 2024-09-13T05:10:14.730 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:10:14.736 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:14.730+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:14.740 INFO:teuthology.orchestra.run.smithi120.stdout:162 punch from 0xa904938 to 0xa91298d, (0xe055 bytes) 2024-09-13T05:10:14.753 INFO:teuthology.orchestra.run.smithi120.stdout:163 write 0xcc491fb thru 0xcc4ccbe (0x3ac4 bytes) 2024-09-13T05:10:14.754 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:10:14.759 INFO:teuthology.orchestra.run.smithi120.stdout:164 read 0x1c34052 thru 0x1c3b44a (0x73f9 bytes) 2024-09-13T05:10:14.759 INFO:teuthology.orchestra.run.smithi120.stdout:165 write 0x3367478 thru 0x3375b4d (0xe6d6 bytes) 2024-09-13T05:10:14.767 INFO:teuthology.orchestra.run.smithi120.stdout:166 writesame 0xaf100d4 thru 0xaf1db50 data_size 0x1(0xda7d bytes) 2024-09-13T05:10:14.772 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:10:14.783 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:10:14.783 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:14.792 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:10:14.793 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:10:14.813 INFO:teuthology.orchestra.run.smithi120.stdout:167 read 0xb56cb08 thru 0xb5716f0 (0x4be9 bytes) 2024-09-13T05:10:14.813 INFO:teuthology.orchestra.run.smithi120.stdout:168 write 0x3a9404c thru 0x3a99864 (0x5819 bytes) 2024-09-13T05:10:14.815 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:10:14.820 INFO:teuthology.orchestra.run.smithi120.stdout:169 write 0x1e2ff46 thru 0x1e3d5d3 (0xd68e bytes) 2024-09-13T05:10:14.826 INFO:teuthology.orchestra.run.smithi120.stdout:170 write 0xb3442e3 thru 0xb35128d (0xcfab bytes) 2024-09-13T05:10:14.832 INFO:teuthology.orchestra.run.smithi120.stdout:171 writesame 0x600ed5a thru 0x6018854 data_size 0x4b(0x9afb bytes) 2024-09-13T05:10:14.837 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:10:14.837 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:14.834+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:14.850 INFO:teuthology.orchestra.run.smithi120.stdout:173 write 0xe29de01 thru 0xe2a41e5 (0x63e5 bytes) 2024-09-13T05:10:14.858 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:10:14.859 INFO:teuthology.orchestra.run.smithi120.stdout:174 read 0xb0ad93c thru 0xb0b0ab6 (0x317b bytes) 2024-09-13T05:10:14.860 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:14.860 INFO:teuthology.orchestra.run.smithi120.stdout:176 writesame 0xbbfd32e thru 0xbc01fc8 data_size 0x3(0x4c9b bytes) 2024-09-13T05:10:14.860 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:10:14.860 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:10:14.860 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:10:14.860 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:10:14.860 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:10:14.860 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:10:14.861 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:10:14.861 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:10:14.869 INFO:teuthology.orchestra.run.smithi120.stdout:178 read 0x70576ce thru 0x70617bb (0xa0ee bytes) 2024-09-13T05:10:14.869 INFO:teuthology.orchestra.run.smithi120.stdout:179 read 0x4637c59 thru 0x46445b7 (0xc95f bytes) 2024-09-13T05:10:14.869 INFO:teuthology.orchestra.run.smithi120.stdout:180 write 0x9a037ef thru 0x9a0a0c9 (0x68db bytes) 2024-09-13T05:10:14.874 INFO:teuthology.orchestra.run.smithi120.stdout:181 write 0xb630c70 thru 0xb6408b9 (0xfc4a bytes) 2024-09-13T05:10:14.880 INFO:teuthology.orchestra.run.smithi120.stdout:182 read 0x9768aa8 thru 0x9769a77 (0xfd0 bytes) 2024-09-13T05:10:14.880 INFO:teuthology.orchestra.run.smithi120.stdout:183 read 0x2f694bb thru 0x2f765a0 (0xd0e6 bytes) 2024-09-13T05:10:14.881 INFO:teuthology.orchestra.run.smithi120.stdout:184 clone 1 order 24 su 524288 sc 4 2024-09-13T05:10:14.917 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:14.917 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:14.917 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:14.917 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:14.917 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:14.926 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:10:14.969 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:14.966+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:15.038 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:15.035+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:15.077 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4275.0:1 2.3 e18/17 2:c4c92e5a:::rbd_trash:head v 18'1, mlcod=0'0)", 2024-09-13T05:10:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:59.372565+0000", 2024-09-13T05:10:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.702711572, 2024-09-13T05:10:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00065873600000000004, 2024-09-13T05:10:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:59.372565+0000", 2024-09-13T05:10:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:59.372565+0000", 2024-09-13T05:10:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:59.372565+0000", 2024-09-13T05:10:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:59.372572+0000", 2024-09-13T05:10:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1550000000000001e-06 2024-09-13T05:10:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:59.372591+0000", 2024-09-13T05:10:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8683000000000001e-05 2024-09-13T05:10:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:59.372603+0000", 2024-09-13T05:10:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2509e-05 2024-09-13T05:10:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:59.372644+0000", 2024-09-13T05:10:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0426999999999998e-05 2024-09-13T05:10:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:59.372670+0000", 2024-09-13T05:10:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6122000000000002e-05 2024-09-13T05:10:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:59.373194+0000", 2024-09-13T05:10:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00052383900000000001 2024-09-13T05:10:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:59.373224+0000", 2024-09-13T05:10:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0239999999999998e-05 2024-09-13T05:10:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:7 3.1a e24/22 3:5cea7035:::rbd_info:head v 24'1, mlcod=0'0)", 2024-09-13T05:10:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:10.646211+0000", 2024-09-13T05:10:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.4290655189999999, 2024-09-13T05:10:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016111330000000001, 2024-09-13T05:10:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.646211+0000", 2024-09-13T05:10:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.646211+0000", 2024-09-13T05:10:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.646211+0000", 2024-09-13T05:10:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.646220+0000", 2024-09-13T05:10:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9000000000000001e-06 2024-09-13T05:10:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.646242+0000", 2024-09-13T05:10:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1365999999999998e-05 2024-09-13T05:10:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.646277+0000", 2024-09-13T05:10:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5009000000000003e-05 2024-09-13T05:10:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.646377+0000", 2024-09-13T05:10:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010064300000000001 2024-09-13T05:10:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.646408+0000", 2024-09-13T05:10:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0263000000000001e-05 2024-09-13T05:10:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.647767+0000", 2024-09-13T05:10:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001359227 2024-09-13T05:10:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:10.647822+0000", 2024-09-13T05:10:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5340999999999998e-05 2024-09-13T05:10:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:9 3.1a e25/22 3:5cea7035:::rbd_info:head v 25'2, mlcod=0'0)", 2024-09-13T05:10:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:11.656060+0000", 2024-09-13T05:10:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.4192164300000001, 2024-09-13T05:10:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028724660000000002, 2024-09-13T05:10:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.656060+0000", 2024-09-13T05:10:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.656060+0000", 2024-09-13T05:10:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.656059+0000", 2024-09-13T05:10:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.656070+0000", 2024-09-13T05:10:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1240000000000001e-05 2024-09-13T05:10:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.656087+0000", 2024-09-13T05:10:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7235e-05 2024-09-13T05:10:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.656098+0000", 2024-09-13T05:10:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0699999999999999e-05 2024-09-13T05:10:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.656178+0000", 2024-09-13T05:10:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9668999999999999e-05 2024-09-13T05:10:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.656216+0000", 2024-09-13T05:10:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7812999999999999e-05 2024-09-13T05:10:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.658880+0000", 2024-09-13T05:10:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026647590000000001 2024-09-13T05:10:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.658933+0000", 2024-09-13T05:10:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2324000000000003e-05 2024-09-13T05:10:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:528 3.9 3:95f52cb4:::rbd_data.112d65d6a1c8.000000000000002c:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3424995~53163] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-13T05:10:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:14.829425+0000", 2024-09-13T05:10:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.24585126299999999, 2024-09-13T05:10:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024202540000000002, 2024-09-13T05:10:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 528 2024-09-13T05:10:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.829425+0000", 2024-09-13T05:10:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.829425+0000", 2024-09-13T05:10:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.829422+0000", 2024-09-13T05:10:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999962 2024-09-13T05:10:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.829509+0000", 2024-09-13T05:10:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6794999999999998e-05 2024-09-13T05:10:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.829539+0000", 2024-09-13T05:10:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0165e-05 2024-09-13T05:10:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.829553+0000", 2024-09-13T05:10:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4334e-05 2024-09-13T05:10:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.829632+0000", 2024-09-13T05:10:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9250000000000002e-05 2024-09-13T05:10:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.829764+0000", 2024-09-13T05:10:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013180900000000001 2024-09-13T05:10:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:10:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.829926+0000", 2024-09-13T05:10:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000161733 2024-09-13T05:10:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.831365+0000", 2024-09-13T05:10:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00143922 2024-09-13T05:10:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.831741+0000", 2024-09-13T05:10:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037553700000000001 2024-09-13T05:10:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.831798+0000", 2024-09-13T05:10:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7525999999999998e-05 2024-09-13T05:10:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.831846+0000", 2024-09-13T05:10:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7531000000000003e-05 2024-09-13T05:10:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4397.0:528 3.9 e26/22 ondisk, result = 0)", 2024-09-13T05:10:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:14.831641+0000", 2024-09-13T05:10:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.24363604799999999, 2024-09-13T05:10:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022367099999999999, 2024-09-13T05:10:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.831641+0000", 2024-09-13T05:10:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.831641+0000", 2024-09-13T05:10:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.831639+0000", 2024-09-13T05:10:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.831648+0000", 2024-09-13T05:10:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4190000000000002e-06 2024-09-13T05:10:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.831665+0000", 2024-09-13T05:10:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6880000000000001e-05 2024-09-13T05:10:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.831674+0000", 2024-09-13T05:10:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9029999999999993e-06 2024-09-13T05:10:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.831725+0000", 2024-09-13T05:10:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1128000000000002e-05 2024-09-13T05:10:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.831735+0000", 2024-09-13T05:10:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0000000000000001e-05 2024-09-13T05:10:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.831864+0000", 2024-09-13T05:10:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012961099999999999 2024-09-13T05:10:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:542 3.9 3:95f52cb4:::rbd_data.112d65d6a1c8.000000000000002c:head [read 710972~12667] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-13T05:10:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:14.859265+0000", 2024-09-13T05:10:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.21601125400000001, 2024-09-13T05:10:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00051107300000000002, 2024-09-13T05:10:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 542 2024-09-13T05:10:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.859265+0000", 2024-09-13T05:10:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.859265+0000", 2024-09-13T05:10:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.859262+0000", 2024-09-13T05:10:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999967 2024-09-13T05:10:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.859281+0000", 2024-09-13T05:10:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8845999999999999e-05 2024-09-13T05:10:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.859312+0000", 2024-09-13T05:10:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0753000000000002e-05 2024-09-13T05:10:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.859334+0000", 2024-09-13T05:10:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2535999999999999e-05 2024-09-13T05:10:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.859447+0000", 2024-09-13T05:10:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011321 2024-09-13T05:10:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.859590+0000", 2024-09-13T05:10:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142177 2024-09-13T05:10:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.859776+0000", 2024-09-13T05:10:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018688400000000001 2024-09-13T05:10:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:545 3.13 e26/22 3:c808ca0c:::rbd_data.112d65d6a1c8.000000000000002e:head v 26'3, mlcod=25'1)", 2024-09-13T05:10:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:14.866663+0000", 2024-09-13T05:10:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.208613772, 2024-09-13T05:10:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001497314, 2024-09-13T05:10:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.866663+0000", 2024-09-13T05:10:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.866663+0000", 2024-09-13T05:10:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.866660+0000", 2024-09-13T05:10:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:10:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.866701+0000", 2024-09-13T05:10:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0305999999999997e-05 2024-09-13T05:10:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.866741+0000", 2024-09-13T05:10:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0284999999999998e-05 2024-09-13T05:10:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.866762+0000", 2024-09-13T05:10:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1206e-05 2024-09-13T05:10:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.866839+0000", 2024-09-13T05:10:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6698000000000003e-05 2024-09-13T05:10:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.866868+0000", 2024-09-13T05:10:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9142999999999999e-05 2024-09-13T05:10:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.868113+0000", 2024-09-13T05:10:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012453830000000001 2024-09-13T05:10:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.868160+0000", 2024-09-13T05:10:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6819e-05 2024-09-13T05:10:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:15.109 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:15.110 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:10:15.139 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:15.135+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:15.218 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:15.218 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:15.219 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:10:15.219 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:15.228 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:10:15.240 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:15.235+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:15.333 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:15.334 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:15.334 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:15.334 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:15.334 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:15.340 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:15.335+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:15.343 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:10:15.441 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:15.438+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:15.452 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:15.452 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:15.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:15.452 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:15.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.452 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:526 3.18 3:1a4389a9:::rbd_data.112d65d6a1c8.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2293574~54926] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-13T05:10:15.452 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:14.823490+0000", 2024-09-13T05:10:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.62790946299999995, 2024-09-13T05:10:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027723159999999999, 2024-09-13T05:10:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 526 2024-09-13T05:10:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:15.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.823490+0000", 2024-09-13T05:10:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.823490+0000", 2024-09-13T05:10:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.823487+0000", 2024-09-13T05:10:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999967 2024-09-13T05:10:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.823573+0000", 2024-09-13T05:10:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5743999999999998e-05 2024-09-13T05:10:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.823608+0000", 2024-09-13T05:10:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4999000000000002e-05 2024-09-13T05:10:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.823631+0000", 2024-09-13T05:10:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2833999999999999e-05 2024-09-13T05:10:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.823765+0000", 2024-09-13T05:10:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134203 2024-09-13T05:10:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.823947+0000", 2024-09-13T05:10:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018163200000000001 2024-09-13T05:10:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.824106+0000", 2024-09-13T05:10:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015985399999999999 2024-09-13T05:10:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.825566+0000", 2024-09-13T05:10:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014596559999999999 2024-09-13T05:10:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.826161+0000", 2024-09-13T05:10:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00059511999999999998 2024-09-13T05:10:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.826215+0000", 2024-09-13T05:10:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3918000000000001e-05 2024-09-13T05:10:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.826263+0000", 2024-09-13T05:10:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7525999999999999e-05 2024-09-13T05:10:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4397.0:526 3.18 e26/22 ondisk, result = 0)", 2024-09-13T05:10:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:14.826025+0000", 2024-09-13T05:10:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.62537492100000003, 2024-09-13T05:10:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000288984, 2024-09-13T05:10:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.826025+0000", 2024-09-13T05:10:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.826025+0000", 2024-09-13T05:10:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.826023+0000", 2024-09-13T05:10:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.826035+0000", 2024-09-13T05:10:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2388999999999999e-05 2024-09-13T05:10:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.826068+0000", 2024-09-13T05:10:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2061999999999999e-05 2024-09-13T05:10:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.826083+0000", 2024-09-13T05:10:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5094e-05 2024-09-13T05:10:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.826142+0000", 2024-09-13T05:10:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9456000000000001e-05 2024-09-13T05:10:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.826155+0000", 2024-09-13T05:10:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3012e-05 2024-09-13T05:10:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.826314+0000", 2024-09-13T05:10:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015874800000000001 2024-09-13T05:10:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:550 3.7 3:e7f451b6:::rbd_data.112d65d6a1c8.000000000000000b:head [read 3577019~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-13T05:10:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:14.880573+0000", 2024-09-13T05:10:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.57082713699999998, 2024-09-13T05:10:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000327549, 2024-09-13T05:10:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 550 2024-09-13T05:10:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.880573+0000", 2024-09-13T05:10:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.880573+0000", 2024-09-13T05:10:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.880571+0000", 2024-09-13T05:10:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.880579+0000", 2024-09-13T05:10:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2320000000000004e-06 2024-09-13T05:10:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.880594+0000", 2024-09-13T05:10:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5111e-05 2024-09-13T05:10:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.880601+0000", 2024-09-13T05:10:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8549999999999996e-06 2024-09-13T05:10:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.880677+0000", 2024-09-13T05:10:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6630000000000003e-05 2024-09-13T05:10:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.880791+0000", 2024-09-13T05:10:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011329500000000001 2024-09-13T05:10:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.880900+0000", 2024-09-13T05:10:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109642 2024-09-13T05:10:15.467 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:15.467 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:15.467 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:15.467 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:15.467 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:15.467 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:15.468 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:10:15.542 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:15.538+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:15.582 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:15.583 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:15.583 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:15.583 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:15.593 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:10:15.643 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:15.639+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:15.695 INFO:tasks.thrashosds.thrasher:Setting full ratio back to .95 2024-09-13T05:10:15.695 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .95 2024-09-13T05:10:15.699 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:15.699 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:15.699 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:15.699 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:15.699 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:15.710 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:10:15.744 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:15.738+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:15.813 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:15.813 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:15.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:15.813 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [] 2024-09-13T05:10:15.813 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:15.823 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:10:15.845 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:15.838+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:15.929 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:15.929 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:15.929 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:15.929 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:15.939 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:10:15.945 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:15.942+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:15.960 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:15.979 INFO:teuthology.orchestra.run.smithi120.stdout:186 trunc from 0xe2a41e6 to 0x3a67a52 2024-09-13T05:10:16.016 INFO:teuthology.orchestra.run.smithi120.stdout:187 trunc from 0x3a67a52 to 0x6300441 2024-09-13T05:10:16.036 INFO:teuthology.orchestra.run.smithi120.stdout:188 write 0x7b0bc88 thru 0x7b162c7 (0xa640 bytes) 2024-09-13T05:10:16.048 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:16.043+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:16.050 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:16.050 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:16.050 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:16.050 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:16.050 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:16.058 INFO:teuthology.orchestra.run.smithi120.stdout:189 write 0xbe7b66c thru 0xbe83e29 (0x87be bytes) 2024-09-13T05:10:16.060 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:10:16.064 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:16.064 INFO:teuthology.orchestra.run.smithi120.stdout:193 write 0x2484c07 thru 0x2487b0a (0x2f04 bytes) 2024-09-13T05:10:16.067 INFO:teuthology.orchestra.run.smithi120.stdout:195 write 0x1dacfcc thru 0x1db2d68 (0x5d9d bytes) 2024-09-13T05:10:16.072 INFO:teuthology.orchestra.run.smithi120.stdout:196 punch from 0x8ff49ec to 0x8ff97d6, (0x4dea bytes) 2024-09-13T05:10:16.072 INFO:teuthology.orchestra.run.smithi120.stdout:197 read 0xcfee92 thru 0xcff31f (0x48e bytes) 2024-09-13T05:10:16.073 INFO:teuthology.orchestra.run.smithi120.stdout:201 writesame 0xb94c667 thru 0xb9502fa data_size 0x2(0x3c94 bytes) 2024-09-13T05:10:16.096 INFO:teuthology.orchestra.run.smithi120.stdout:202 trunc from 0xbe83e2a to 0x6ec3cfc 2024-09-13T05:10:16.117 INFO:teuthology.orchestra.run.smithi120.stdout:205 read 0x661bb51 thru 0x6627643 (0xbaf3 bytes) 2024-09-13T05:10:16.117 INFO:teuthology.orchestra.run.smithi120.stdout:206 read 0x121ec69 thru 0x122cecf (0xe267 bytes) 2024-09-13T05:10:16.118 INFO:teuthology.orchestra.run.smithi120.stdout:208 punch from 0x6c3b04 to 0x6d08c9, (0xcdc5 bytes) 2024-09-13T05:10:16.118 INFO:teuthology.orchestra.run.smithi120.stdout:209 writesame 0x15a4e7 thru 0x161b26 data_size 0x58(0x7640 bytes) 2024-09-13T05:10:16.122 INFO:teuthology.orchestra.run.smithi120.stdout:211 read 0xe9cd8d thru 0xea88e9 (0xbb5d bytes) 2024-09-13T05:10:16.123 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:16.123 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:16.123 INFO:teuthology.orchestra.run.smithi120.stdout:214 read 0x55d5e2d thru 0x55dddc4 (0x7f98 bytes) 2024-09-13T05:10:16.129 INFO:teuthology.orchestra.run.smithi120.stdout:216 trunc from 0x6ec3cfc to 0x98cb4e5 2024-09-13T05:10:16.141 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:16.141 INFO:teuthology.orchestra.run.smithi120.stdout:218 punch from 0x5fbf421 to 0x5fbfb0f, (0x6ee bytes) 2024-09-13T05:10:16.141 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:16.142 INFO:teuthology.orchestra.run.smithi120.stdout:222 write 0x36f95cb thru 0x3703205 (0x9c3b bytes) 2024-09-13T05:10:16.147 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:16.143+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:16.166 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:16.166 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:16.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:16.166 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:10:16.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.166 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4275.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T05:10:16.167 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:59.369854+0000", 2024-09-13T05:10:16.167 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 16.794334579000001, 2024-09-13T05:10:16.167 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.007257538, 2024-09-13T05:10:16.167 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.167 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.167 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.167 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4275", 2024-09-13T05:10:16.167 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/2023483490", 2024-09-13T05:10:16.167 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 1 2024-09-13T05:10:16.167 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.167 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.168 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.168 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.168 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.369854+0000", 2024-09-13T05:10:16.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.168 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.168 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.168 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.369854+0000", 2024-09-13T05:10:16.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.369853+0000", 2024-09-13T05:10:16.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:16.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.369862+0000", 2024-09-13T05:10:16.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.533e-06 2024-09-13T05:10:16.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.369872+0000", 2024-09-13T05:10:16.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9210000000000004e-06 2024-09-13T05:10:16.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.369896+0000", 2024-09-13T05:10:16.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4187999999999999e-05 2024-09-13T05:10:16.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.370111+0000", 2024-09-13T05:10:16.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000214983 2024-09-13T05:10:16.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.171 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:16.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.370165+0000", 2024-09-13T05:10:16.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3699999999999997e-05 2024-09-13T05:10:16.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.171 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.372317+0000", 2024-09-13T05:10:16.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021521629999999999 2024-09-13T05:10:16.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.372516+0000", 2024-09-13T05:10:16.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00019910800000000001 2024-09-13T05:10:16.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 2", 2024-09-13T05:10:16.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.372694+0000", 2024-09-13T05:10:16.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000177641 2024-09-13T05:10:16.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:16.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.373640+0000", 2024-09-13T05:10:16.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00094634799999999996 2024-09-13T05:10:16.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:16.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.377029+0000", 2024-09-13T05:10:16.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033891730000000001 2024-09-13T05:10:16.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.377080+0000", 2024-09-13T05:10:16.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0531000000000001e-05 2024-09-13T05:10:16.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.377111+0000", 2024-09-13T05:10:16.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1594000000000003e-05 2024-09-13T05:10:16.174 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.174 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.174 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.175 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4275.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-13T05:10:16.175 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:00.379251+0000", 2024-09-13T05:10:16.175 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 15.784937414, 2024-09-13T05:10:16.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0059671969999999996, 2024-09-13T05:10:16.175 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.176 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.176 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.176 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4275", 2024-09-13T05:10:16.176 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/2023483490", 2024-09-13T05:10:16.176 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 5 2024-09-13T05:10:16.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.176 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.379251+0000", 2024-09-13T05:10:16.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.379251+0000", 2024-09-13T05:10:16.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.379248+0000", 2024-09-13T05:10:16.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999967 2024-09-13T05:10:16.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.179 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.379270+0000", 2024-09-13T05:10:16.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2076e-05 2024-09-13T05:10:16.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.179 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.379319+0000", 2024-09-13T05:10:16.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9539000000000001e-05 2024-09-13T05:10:16.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.179 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.379343+0000", 2024-09-13T05:10:16.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4263000000000001e-05 2024-09-13T05:10:16.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.379502+0000", 2024-09-13T05:10:16.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000158937 2024-09-13T05:10:16.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op must wait for map", 2024-09-13T05:10:16.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.379512+0000", 2024-09-13T05:10:16.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6260000000000007e-06 2024-09-13T05:10:16.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.382913+0000", 2024-09-13T05:10:16.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0034014050000000001 2024-09-13T05:10:16.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.383135+0000", 2024-09-13T05:10:16.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00022176499999999999 2024-09-13T05:10:16.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:16.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.383339+0000", 2024-09-13T05:10:16.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020416299999999999 2024-09-13T05:10:16.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:16.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.384745+0000", 2024-09-13T05:10:16.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0014061 2024-09-13T05:10:16.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:16.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.385079+0000", 2024-09-13T05:10:16.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00033349600000000002 2024-09-13T05:10:16.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.385152+0000", 2024-09-13T05:10:16.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2982e-05 2024-09-13T05:10:16.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.385218+0000", 2024-09-13T05:10:16.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6395000000000004e-05 2024-09-13T05:10:16.183 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.183 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.183 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.183 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4275.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-13T05:10:16.183 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:01.385843+0000", 2024-09-13T05:10:16.184 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.778345157, 2024-09-13T05:10:16.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0084301770000000005, 2024-09-13T05:10:16.184 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.184 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.184 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.184 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4275", 2024-09-13T05:10:16.184 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/2023483490", 2024-09-13T05:10:16.184 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 7 2024-09-13T05:10:16.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.185 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.185 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.385843+0000", 2024-09-13T05:10:16.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.185 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.385843+0000", 2024-09-13T05:10:16.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.385841+0000", 2024-09-13T05:10:16.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:10:16.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.385855+0000", 2024-09-13T05:10:16.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4749000000000001e-05 2024-09-13T05:10:16.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.385891+0000", 2024-09-13T05:10:16.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5352999999999998e-05 2024-09-13T05:10:16.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.187 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.385912+0000", 2024-09-13T05:10:16.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0886e-05 2024-09-13T05:10:16.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.187 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.386045+0000", 2024-09-13T05:10:16.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013285400000000001 2024-09-13T05:10:16.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op must wait for map", 2024-09-13T05:10:16.187 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.386055+0000", 2024-09-13T05:10:16.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.023e-05 2024-09-13T05:10:16.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.391624+0000", 2024-09-13T05:10:16.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0055689800000000003 2024-09-13T05:10:16.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.391712+0000", 2024-09-13T05:10:16.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7929999999999993e-05 2024-09-13T05:10:16.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:16.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.391845+0000", 2024-09-13T05:10:16.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000132998 2024-09-13T05:10:16.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:16.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.394106+0000", 2024-09-13T05:10:16.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022609399999999999 2024-09-13T05:10:16.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:16.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.394125+0000", 2024-09-13T05:10:16.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8887999999999999e-05 2024-09-13T05:10:16.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.394209+0000", 2024-09-13T05:10:16.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4436000000000003e-05 2024-09-13T05:10:16.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.394273+0000", 2024-09-13T05:10:16.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4512999999999997e-05 2024-09-13T05:10:16.191 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.191 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.191 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.191 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:10 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-13T05:10:16.191 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:11.665589+0000", 2024-09-13T05:10:16.191 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.4985992340000003, 2024-09-13T05:10:16.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002460378, 2024-09-13T05:10:16.191 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.191 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.191 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.192 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:16.192 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:16.192 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 10 2024-09-13T05:10:16.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.192 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.665589+0000", 2024-09-13T05:10:16.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.665589+0000", 2024-09-13T05:10:16.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.665587+0000", 2024-09-13T05:10:16.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:10:16.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.665612+0000", 2024-09-13T05:10:16.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5307999999999999e-05 2024-09-13T05:10:16.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.665632+0000", 2024-09-13T05:10:16.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9242e-05 2024-09-13T05:10:16.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.665644+0000", 2024-09-13T05:10:16.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2208000000000001e-05 2024-09-13T05:10:16.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.195 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.195 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.665769+0000", 2024-09-13T05:10:16.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012505599999999999 2024-09-13T05:10:16.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.196 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.666002+0000", 2024-09-13T05:10:16.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000232952 2024-09-13T05:10:16.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.196 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:16.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.666324+0000", 2024-09-13T05:10:16.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00032276100000000002 2024-09-13T05:10:16.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:16.197 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.667498+0000", 2024-09-13T05:10:16.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001173337 2024-09-13T05:10:16.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:16.198 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.667859+0000", 2024-09-13T05:10:16.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00036118499999999998 2024-09-13T05:10:16.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.198 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.198 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.667954+0000", 2024-09-13T05:10:16.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4574999999999995e-05 2024-09-13T05:10:16.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.199 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.199 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.668050+0000", 2024-09-13T05:10:16.199 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6031000000000003e-05 2024-09-13T05:10:16.199 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.199 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.199 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.199 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.199 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.199 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:11 3.1f e25/22 3:fa654f18:::rbd_id.image_client.0:head v 25'1, mlcod=0'0)", 2024-09-13T05:10:16.200 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:11.671938+0000", 2024-09-13T05:10:16.200 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.4922501009999998, 2024-09-13T05:10:16.200 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0040651380000000003, 2024-09-13T05:10:16.200 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.200 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.200 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.200 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.200 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.671938+0000", 2024-09-13T05:10:16.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.671938+0000", 2024-09-13T05:10:16.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.202 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.202 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.671938+0000", 2024-09-13T05:10:16.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:16.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.202 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.202 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.671948+0000", 2024-09-13T05:10:16.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0910000000000001e-05 2024-09-13T05:10:16.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.203 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.203 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.671965+0000", 2024-09-13T05:10:16.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6273000000000002e-05 2024-09-13T05:10:16.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.203 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.203 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.671981+0000", 2024-09-13T05:10:16.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5957e-05 2024-09-13T05:10:16.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.672071+0000", 2024-09-13T05:10:16.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0638999999999997e-05 2024-09-13T05:10:16.204 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.204 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.672110+0000", 2024-09-13T05:10:16.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8461000000000003e-05 2024-09-13T05:10:16.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.205 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.205 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.675930+0000", 2024-09-13T05:10:16.205 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003820277 2024-09-13T05:10:16.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.205 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.205 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.676004+0000", 2024-09-13T05:10:16.205 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3487999999999998e-05 2024-09-13T05:10:16.205 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.205 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.205 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.206 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:549 3.1f e26/22 3:fb3ea134:::rbd_data.112d65d6a1c8.000000000000002d:head v 26'4, mlcod=25'2)", 2024-09-13T05:10:16.206 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:14.878208+0000", 2024-09-13T05:10:16.206 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.2859800080000001, 2024-09-13T05:10:16.206 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0019604790000000002, 2024-09-13T05:10:16.206 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.206 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.206 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.206 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.206 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.878208+0000", 2024-09-13T05:10:16.206 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.207 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.207 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.878208+0000", 2024-09-13T05:10:16.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.207 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.207 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.878208+0000", 2024-09-13T05:10:16.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:16.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.207 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.207 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.878335+0000", 2024-09-13T05:10:16.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000126947 2024-09-13T05:10:16.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.208 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.878361+0000", 2024-09-13T05:10:16.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6216000000000001e-05 2024-09-13T05:10:16.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.208 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.878381+0000", 2024-09-13T05:10:16.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9707e-05 2024-09-13T05:10:16.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.209 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.209 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.878506+0000", 2024-09-13T05:10:16.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012485 2024-09-13T05:10:16.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.209 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.209 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.878551+0000", 2024-09-13T05:10:16.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5139000000000003e-05 2024-09-13T05:10:16.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.209 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.210 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.880108+0000", 2024-09-13T05:10:16.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0015568209999999999 2024-09-13T05:10:16.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.210 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.210 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.210 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.880169+0000", 2024-09-13T05:10:16.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1304999999999997e-05 2024-09-13T05:10:16.210 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.210 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.210 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.210 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.210 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:571 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:16.210 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:15.701856+0000", 2024-09-13T05:10:16.211 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.462332617, 2024-09-13T05:10:16.211 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033787470000000001, 2024-09-13T05:10:16.211 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.211 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:16.211 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.211 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:16.211 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:16.211 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 571 2024-09-13T05:10:16.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.211 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.211 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.701856+0000", 2024-09-13T05:10:16.212 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.212 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.212 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.212 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.212 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.701856+0000", 2024-09-13T05:10:16.212 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.212 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.212 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.212 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.212 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.701853+0000", 2024-09-13T05:10:16.212 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:10:16.212 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.213 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.213 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.213 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.701870+0000", 2024-09-13T05:10:16.213 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7306e-05 2024-09-13T05:10:16.213 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.213 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.213 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.213 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.701902+0000", 2024-09-13T05:10:16.213 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1304999999999999e-05 2024-09-13T05:10:16.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.214 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.214 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.214 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.701915+0000", 2024-09-13T05:10:16.214 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3671e-05 2024-09-13T05:10:16.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.214 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.214 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.214 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.702004+0000", 2024-09-13T05:10:16.214 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8749e-05 2024-09-13T05:10:16.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.215 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op must wait for map", 2024-09-13T05:10:16.215 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.702017+0000", 2024-09-13T05:10:16.215 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3030999999999999e-05 2024-09-13T05:10:16.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.216 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.216 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.216 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.705010+0000", 2024-09-13T05:10:16.216 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002992883 2024-09-13T05:10:16.216 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.216 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.216 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.216 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.705090+0000", 2024-09-13T05:10:16.216 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9930000000000002e-05 2024-09-13T05:10:16.216 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.216 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.216 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.217 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.705235+0000", 2024-09-13T05:10:16.217 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000144709 2024-09-13T05:10:16.217 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.217 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.217 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.217 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.217 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.217 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:588 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:16.217 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:15.725725+0000", 2024-09-13T05:10:16.217 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.43846396799999998, 2024-09-13T05:10:16.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024591999999999999, 2024-09-13T05:10:16.218 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.218 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.218 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.218 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:16.218 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:16.218 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 588 2024-09-13T05:10:16.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.218 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.218 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.218 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.725725+0000", 2024-09-13T05:10:16.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.219 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.219 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.219 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.725725+0000", 2024-09-13T05:10:16.219 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.219 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.219 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.219 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.219 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.725723+0000", 2024-09-13T05:10:16.219 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:16.219 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.219 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.219 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.219 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.725736+0000", 2024-09-13T05:10:16.220 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3054000000000001e-05 2024-09-13T05:10:16.220 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.220 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.220 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.220 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.725766+0000", 2024-09-13T05:10:16.220 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9756000000000001e-05 2024-09-13T05:10:16.220 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.220 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.220 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.220 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.725784+0000", 2024-09-13T05:10:16.220 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8757e-05 2024-09-13T05:10:16.220 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.221 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.221 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.725874+0000", 2024-09-13T05:10:16.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9722999999999995e-05 2024-09-13T05:10:16.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.221 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.221 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.725988+0000", 2024-09-13T05:10:16.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011409299999999999 2024-09-13T05:10:16.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.222 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.222 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:16.222 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.726290+0000", 2024-09-13T05:10:16.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000301448 2024-09-13T05:10:16.222 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.222 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.222 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:16.222 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.727247+0000", 2024-09-13T05:10:16.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00095739700000000002 2024-09-13T05:10:16.222 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.222 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.222 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:16.222 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.728033+0000", 2024-09-13T05:10:16.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00078599500000000005 2024-09-13T05:10:16.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.728114+0000", 2024-09-13T05:10:16.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0780999999999998e-05 2024-09-13T05:10:16.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.728184+0000", 2024-09-13T05:10:16.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9975999999999995e-05 2024-09-13T05:10:16.223 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.224 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.224 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.224 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.224 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:589 3.2 e27/22 3:4550e1e5:::rbd_id.image_client.0-clone1:head v 27'1, mlcod=0'0)", 2024-09-13T05:10:16.224 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:15.729470+0000", 2024-09-13T05:10:16.224 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.43471864999999998, 2024-09-13T05:10:16.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0015312209999999999, 2024-09-13T05:10:16.224 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.224 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.224 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.225 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.225 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.729470+0000", 2024-09-13T05:10:16.225 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.225 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.225 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.225 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.225 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.729470+0000", 2024-09-13T05:10:16.225 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.225 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.225 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.225 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.225 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.729469+0000", 2024-09-13T05:10:16.225 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:16.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.729478+0000", 2024-09-13T05:10:16.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9479999999999997e-06 2024-09-13T05:10:16.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.729493+0000", 2024-09-13T05:10:16.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4440000000000001e-05 2024-09-13T05:10:16.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.729502+0000", 2024-09-13T05:10:16.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1889999999999996e-06 2024-09-13T05:10:16.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.729602+0000", 2024-09-13T05:10:16.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010009900000000001 2024-09-13T05:10:16.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.729634+0000", 2024-09-13T05:10:16.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1687999999999999e-05 2024-09-13T05:10:16.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.228 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.228 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.730943+0000", 2024-09-13T05:10:16.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0013091419999999999 2024-09-13T05:10:16.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.228 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.228 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.731001+0000", 2024-09-13T05:10:16.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8136e-05 2024-09-13T05:10:16.229 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.229 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.229 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.229 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.229 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.229 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:672 3.1c 3:3e23b187:::rbd_data.112d65d6a1c8.0000000000000000:4 [sparse-read 2621440~30117] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:16.229 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:15.986898+0000", 2024-09-13T05:10:16.229 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.17729092499999999, 2024-09-13T05:10:16.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0016057440000000001, 2024-09-13T05:10:16.229 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.229 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:16.229 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.229 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:16.229 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:16.229 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 672 2024-09-13T05:10:16.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.230 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.230 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.986898+0000", 2024-09-13T05:10:16.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.230 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.986898+0000", 2024-09-13T05:10:16.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.986896+0000", 2024-09-13T05:10:16.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:16.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.986903+0000", 2024-09-13T05:10:16.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8739999999999997e-06 2024-09-13T05:10:16.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.232 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.232 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.986937+0000", 2024-09-13T05:10:16.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3698999999999997e-05 2024-09-13T05:10:16.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.232 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.232 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.232 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.986949+0000", 2024-09-13T05:10:16.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1771e-05 2024-09-13T05:10:16.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.232 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.232 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.232 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987753+0000", 2024-09-13T05:10:16.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00080451299999999997 2024-09-13T05:10:16.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987842+0000", 2024-09-13T05:10:16.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8325999999999994e-05 2024-09-13T05:10:16.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.988503+0000", 2024-09-13T05:10:16.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00066172799999999999 2024-09-13T05:10:16.233 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.233 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.233 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.234 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.234 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:686 3.1c 3:3e23b187:::rbd_data.112d65d6a1c8.0000000000000000:4 [sparse-read 1048576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:16.234 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:15.987206+0000", 2024-09-13T05:10:16.234 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.17698248899999999, 2024-09-13T05:10:16.234 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0016950750000000001, 2024-09-13T05:10:16.234 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.234 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:16.234 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.234 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:16.234 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:16.234 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 686 2024-09-13T05:10:16.234 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.234 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.235 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987206+0000", 2024-09-13T05:10:16.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.235 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987206+0000", 2024-09-13T05:10:16.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987204+0000", 2024-09-13T05:10:16.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:16.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987215+0000", 2024-09-13T05:10:16.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0869999999999999e-05 2024-09-13T05:10:16.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987231+0000", 2024-09-13T05:10:16.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5662e-05 2024-09-13T05:10:16.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.238 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.238 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987243+0000", 2024-09-13T05:10:16.238 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.17e-05 2024-09-13T05:10:16.238 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.238 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.238 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.238 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.988538+0000", 2024-09-13T05:10:16.238 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001295046 2024-09-13T05:10:16.238 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.238 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.238 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.239 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.988647+0000", 2024-09-13T05:10:16.239 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000109554 2024-09-13T05:10:16.239 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.239 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.239 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.239 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.988901+0000", 2024-09-13T05:10:16.239 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025384499999999999 2024-09-13T05:10:16.239 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.239 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.239 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.239 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.240 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.240 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:687 3.1c 3:3e23b187:::rbd_data.112d65d6a1c8.0000000000000000:4 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:16.240 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:15.987278+0000", 2024-09-13T05:10:16.240 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.1769107, 2024-09-13T05:10:16.240 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021208189999999999, 2024-09-13T05:10:16.240 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.240 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:16.240 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.240 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:16.240 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:16.240 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 687 2024-09-13T05:10:16.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.240 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.240 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987278+0000", 2024-09-13T05:10:16.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987278+0000", 2024-09-13T05:10:16.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987277+0000", 2024-09-13T05:10:16.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:16.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987281+0000", 2024-09-13T05:10:16.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:10:16.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987292+0000", 2024-09-13T05:10:16.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1032e-05 2024-09-13T05:10:16.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987298+0000", 2024-09-13T05:10:16.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1859999999999997e-06 2024-09-13T05:10:16.243 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.243 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.243 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.243 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.989002+0000", 2024-09-13T05:10:16.243 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001703934 2024-09-13T05:10:16.243 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.243 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.243 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.243 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.989189+0000", 2024-09-13T05:10:16.243 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018705600000000001 2024-09-13T05:10:16.243 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.243 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.243 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.244 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.989399+0000", 2024-09-13T05:10:16.244 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020944599999999999 2024-09-13T05:10:16.244 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.244 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.244 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.244 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.244 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.244 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:700 3.1c 3:3e23b187:::rbd_data.112d65d6a1c8.0000000000000000:4 [sparse-read 1572864~51762] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:16.244 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:15.987566+0000", 2024-09-13T05:10:16.245 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.176622578, 2024-09-13T05:10:16.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0028503389999999999, 2024-09-13T05:10:16.245 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.245 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:16.245 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.245 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:16.245 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:16.245 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 700 2024-09-13T05:10:16.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.245 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987566+0000", 2024-09-13T05:10:16.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987566+0000", 2024-09-13T05:10:16.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987565+0000", 2024-09-13T05:10:16.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:16.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987572+0000", 2024-09-13T05:10:16.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5069999999999997e-06 2024-09-13T05:10:16.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987586+0000", 2024-09-13T05:10:16.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4175999999999999e-05 2024-09-13T05:10:16.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.248 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.248 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987603+0000", 2024-09-13T05:10:16.248 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7416000000000001e-05 2024-09-13T05:10:16.248 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.248 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.248 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.989451+0000", 2024-09-13T05:10:16.248 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0018476289999999999 2024-09-13T05:10:16.248 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.248 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.249 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.989598+0000", 2024-09-13T05:10:16.249 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000147174 2024-09-13T05:10:16.249 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.249 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.249 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.249 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.990416+0000", 2024-09-13T05:10:16.249 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00081829500000000002 2024-09-13T05:10:16.249 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.249 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.249 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.250 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:701 3.1c 3:3e23b187:::rbd_data.112d65d6a1c8.0000000000000000:4 [sparse-read 3670016~49294] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:16.250 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:15.987621+0000", 2024-09-13T05:10:16.250 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.17656745400000001, 2024-09-13T05:10:16.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0041053510000000001, 2024-09-13T05:10:16.250 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.250 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:16.250 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.250 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:16.250 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:16.250 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 701 2024-09-13T05:10:16.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.251 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987621+0000", 2024-09-13T05:10:16.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987621+0000", 2024-09-13T05:10:16.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.252 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.252 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.252 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.252 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987620+0000", 2024-09-13T05:10:16.252 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:16.252 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.252 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.252 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.252 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987624+0000", 2024-09-13T05:10:16.252 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9299999999999996e-06 2024-09-13T05:10:16.252 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.252 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.253 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.253 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987631+0000", 2024-09-13T05:10:16.253 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9369999999999998e-06 2024-09-13T05:10:16.253 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.253 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.253 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.253 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987637+0000", 2024-09-13T05:10:16.253 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3460000000000001e-06 2024-09-13T05:10:16.253 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.254 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.254 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.254 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.990518+0000", 2024-09-13T05:10:16.254 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0028809930000000001 2024-09-13T05:10:16.254 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.254 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.254 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.254 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.990749+0000", 2024-09-13T05:10:16.254 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000231105 2024-09-13T05:10:16.254 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.256 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.257 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.257 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.991726+0000", 2024-09-13T05:10:16.257 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00097766299999999993 2024-09-13T05:10:16.257 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.257 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.257 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.257 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.257 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.258 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:719 3.c 3:33565b4d:::rbd_data.112dac7a9dca.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,truncate 15204352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:16.258 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:15.998339+0000", 2024-09-13T05:10:16.258 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.16584939200000001, 2024-09-13T05:10:16.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0032567360000000001, 2024-09-13T05:10:16.258 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.258 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.259 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.259 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:16.259 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:16.259 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 719 2024-09-13T05:10:16.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.259 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.259 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.259 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.998339+0000", 2024-09-13T05:10:16.259 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.260 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.260 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.260 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.260 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.998339+0000", 2024-09-13T05:10:16.260 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.260 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.260 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.260 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.260 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.998337+0000", 2024-09-13T05:10:16.260 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:16.260 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.261 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.261 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.261 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.998481+0000", 2024-09-13T05:10:16.261 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014407100000000001 2024-09-13T05:10:16.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.261 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.261 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.261 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.998507+0000", 2024-09-13T05:10:16.261 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.582e-05 2024-09-13T05:10:16.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.261 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.261 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.261 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.998524+0000", 2024-09-13T05:10:16.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6356999999999999e-05 2024-09-13T05:10:16.262 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.262 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.262 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.262 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.998615+0000", 2024-09-13T05:10:16.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1662000000000004e-05 2024-09-13T05:10:16.262 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.262 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.262 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.263 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.998853+0000", 2024-09-13T05:10:16.263 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00023767499999999999 2024-09-13T05:10:16.263 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.263 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.263 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:16.263 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.999119+0000", 2024-09-13T05:10:16.263 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00026550500000000003 2024-09-13T05:10:16.263 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.263 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.263 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:16.263 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.000728+0000", 2024-09-13T05:10:16.263 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00160928 2024-09-13T05:10:16.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:16.264 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.001477+0000", 2024-09-13T05:10:16.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00074893599999999996 2024-09-13T05:10:16.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.264 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.001538+0000", 2024-09-13T05:10:16.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0791000000000001e-05 2024-09-13T05:10:16.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.265 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.265 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.001596+0000", 2024-09-13T05:10:16.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8306e-05 2024-09-13T05:10:16.265 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.265 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.265 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.265 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:752 3.17 e27/22 3:ed69f8ff:::rbd_header.112dac7a9dca:head v 27'12, mlcod=27'10)", 2024-09-13T05:10:16.265 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.053715+0000", 2024-09-13T05:10:16.265 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.110473693, 2024-09-13T05:10:16.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0016035730000000001, 2024-09-13T05:10:16.265 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.266 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.266 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.266 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.266 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.053715+0000", 2024-09-13T05:10:16.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.266 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.266 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.266 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.053715+0000", 2024-09-13T05:10:16.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.266 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.266 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.267 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.053714+0000", 2024-09-13T05:10:16.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:16.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.267 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.267 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.267 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.053724+0000", 2024-09-13T05:10:16.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9979999999999998e-06 2024-09-13T05:10:16.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.267 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.267 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.267 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.053743+0000", 2024-09-13T05:10:16.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9089e-05 2024-09-13T05:10:16.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.267 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.267 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.268 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.053753+0000", 2024-09-13T05:10:16.268 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0185e-05 2024-09-13T05:10:16.268 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.268 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.268 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.268 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.053887+0000", 2024-09-13T05:10:16.268 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000133719 2024-09-13T05:10:16.268 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.268 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.268 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.269 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.053946+0000", 2024-09-13T05:10:16.269 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9796000000000001e-05 2024-09-13T05:10:16.269 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.269 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.269 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.269 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.055247+0000", 2024-09-13T05:10:16.269 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001300676 2024-09-13T05:10:16.270 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.270 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.270 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.270 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.055318+0000", 2024-09-13T05:10:16.270 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1191000000000003e-05 2024-09-13T05:10:16.270 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.270 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.271 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.271 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.271 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.271 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:764 3.c 3:33565b4d:::rbd_data.112dac7a9dca.0000000000000001:head [stat,write 9456647~12036] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:16.271 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.064862+0000", 2024-09-13T05:10:16.271 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.099326680000000001, 2024-09-13T05:10:16.271 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0027621410000000001, 2024-09-13T05:10:16.271 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.271 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.272 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.272 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:16.272 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:16.272 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 764 2024-09-13T05:10:16.272 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.272 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.273 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.273 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.273 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.064862+0000", 2024-09-13T05:10:16.273 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.273 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.273 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.274 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.274 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.064862+0000", 2024-09-13T05:10:16.274 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.274 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.274 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.274 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.274 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.064859+0000", 2024-09-13T05:10:16.274 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:10:16.274 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.274 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.274 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.275 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.064898+0000", 2024-09-13T05:10:16.275 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8912000000000003e-05 2024-09-13T05:10:16.275 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.275 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.275 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.275 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.064933+0000", 2024-09-13T05:10:16.275 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5235999999999999e-05 2024-09-13T05:10:16.275 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.275 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.275 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.275 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.064978+0000", 2024-09-13T05:10:16.275 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4932000000000003e-05 2024-09-13T05:10:16.275 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.275 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.276 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.276 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.065100+0000", 2024-09-13T05:10:16.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012183799999999999 2024-09-13T05:10:16.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.276 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.276 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.276 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.065268+0000", 2024-09-13T05:10:16.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000167706 2024-09-13T05:10:16.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.276 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.276 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:16.276 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.065493+0000", 2024-09-13T05:10:16.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00022564500000000001 2024-09-13T05:10:16.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.277 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.277 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:16.277 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.066956+0000", 2024-09-13T05:10:16.277 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001462503 2024-09-13T05:10:16.277 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.277 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.277 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:16.277 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.067490+0000", 2024-09-13T05:10:16.277 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00053381200000000005 2024-09-13T05:10:16.277 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.277 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.277 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.277 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.067566+0000", 2024-09-13T05:10:16.277 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6272000000000004e-05 2024-09-13T05:10:16.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.278 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.278 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.278 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.067624+0000", 2024-09-13T05:10:16.278 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7887999999999999e-05 2024-09-13T05:10:16.278 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.278 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.278 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.278 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.278 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:788 3.17 e27/22 3:ed69f8ff:::rbd_header.112dac7a9dca:head v 27'14, mlcod=27'12)", 2024-09-13T05:10:16.278 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.134578+0000", 2024-09-13T05:10:16.278 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.029610910000000001, 2024-09-13T05:10:16.278 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0015226059999999999, 2024-09-13T05:10:16.279 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.279 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.279 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.279 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.279 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.279 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.134578+0000", 2024-09-13T05:10:16.279 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.279 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.279 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.279 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.279 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.134578+0000", 2024-09-13T05:10:16.279 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.279 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.279 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.280 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.280 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.134576+0000", 2024-09-13T05:10:16.280 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:16.280 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.280 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.280 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.280 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.134586+0000", 2024-09-13T05:10:16.280 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0066e-05 2024-09-13T05:10:16.280 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.280 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.280 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.280 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.134596+0000", 2024-09-13T05:10:16.281 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4339999999999998e-06 2024-09-13T05:10:16.281 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.281 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.281 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.281 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.134604+0000", 2024-09-13T05:10:16.281 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2320000000000001e-06 2024-09-13T05:10:16.281 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.281 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.281 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.282 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.134714+0000", 2024-09-13T05:10:16.282 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000109564 2024-09-13T05:10:16.282 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.282 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.282 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.282 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.134755+0000", 2024-09-13T05:10:16.282 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1292999999999999e-05 2024-09-13T05:10:16.282 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.282 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.282 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.282 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.136035+0000", 2024-09-13T05:10:16.282 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0012803529999999999 2024-09-13T05:10:16.282 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.282 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.283 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.283 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.136100+0000", 2024-09-13T05:10:16.283 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4882000000000007e-05 2024-09-13T05:10:16.283 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.283 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.283 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.283 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.283 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.283 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:796 3.c 3:33565b4d:::rbd_data.112dac7a9dca.0000000000000001:head [stat,write 14652875~27189] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:16.283 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.141841+0000", 2024-09-13T05:10:16.283 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.022347325000000001, 2024-09-13T05:10:16.283 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002793462, 2024-09-13T05:10:16.284 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.284 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.284 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.284 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:16.284 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:16.284 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 796 2024-09-13T05:10:16.284 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.284 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.284 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.284 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.284 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.141841+0000", 2024-09-13T05:10:16.284 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.284 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.285 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.285 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.141841+0000", 2024-09-13T05:10:16.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.285 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.285 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.141838+0000", 2024-09-13T05:10:16.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:10:16.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.285 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.285 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.141904+0000", 2024-09-13T05:10:16.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5839000000000004e-05 2024-09-13T05:10:16.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.286 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.286 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.286 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.141934+0000", 2024-09-13T05:10:16.286 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9788999999999999e-05 2024-09-13T05:10:16.286 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.286 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.286 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.286 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.141949+0000", 2024-09-13T05:10:16.286 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4725999999999999e-05 2024-09-13T05:10:16.286 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.286 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.287 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.287 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.142041+0000", 2024-09-13T05:10:16.287 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2482e-05 2024-09-13T05:10:16.287 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.287 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.287 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.287 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.142193+0000", 2024-09-13T05:10:16.287 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00015157300000000001 2024-09-13T05:10:16.287 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.287 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.287 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:16.288 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.142421+0000", 2024-09-13T05:10:16.288 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00022869200000000001 2024-09-13T05:10:16.288 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.288 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.288 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:16.288 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.144214+0000", 2024-09-13T05:10:16.288 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0017925300000000001 2024-09-13T05:10:16.288 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.288 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.288 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:16.289 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.144488+0000", 2024-09-13T05:10:16.289 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00027434399999999999 2024-09-13T05:10:16.289 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.289 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.289 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.289 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.144575+0000", 2024-09-13T05:10:16.289 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6798000000000005e-05 2024-09-13T05:10:16.289 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.289 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.289 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.289 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.144635+0000", 2024-09-13T05:10:16.290 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9509000000000002e-05 2024-09-13T05:10:16.290 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.290 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.290 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.290 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.290 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.290 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:799 3.17 e27/22 3:ed69f8ff:::rbd_header.112dac7a9dca:head v 27'15, mlcod=27'13)", 2024-09-13T05:10:16.290 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.158335+0000", 2024-09-13T05:10:16.290 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0058530830000000002, 2024-09-13T05:10:16.291 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001400103, 2024-09-13T05:10:16.291 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.291 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.291 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.291 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.291 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.292 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.158335+0000", 2024-09-13T05:10:16.292 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.292 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.292 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.292 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.293 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.158335+0000", 2024-09-13T05:10:16.293 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.293 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.293 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.293 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.293 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.158334+0000", 2024-09-13T05:10:16.293 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:16.293 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.293 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.293 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.293 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.158343+0000", 2024-09-13T05:10:16.293 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1689999999999992e-06 2024-09-13T05:10:16.293 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.293 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.294 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.294 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.158359+0000", 2024-09-13T05:10:16.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6300999999999999e-05 2024-09-13T05:10:16.294 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.294 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.294 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.294 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.158375+0000", 2024-09-13T05:10:16.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6558999999999998e-05 2024-09-13T05:10:16.294 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.294 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.294 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.294 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.158449+0000", 2024-09-13T05:10:16.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3114000000000005e-05 2024-09-13T05:10:16.295 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.295 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.295 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.295 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.158480+0000", 2024-09-13T05:10:16.295 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1622999999999999e-05 2024-09-13T05:10:16.295 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.295 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.295 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.295 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.159662+0000", 2024-09-13T05:10:16.296 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0011816649999999999 2024-09-13T05:10:16.296 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.296 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.296 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.296 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.159735+0000", 2024-09-13T05:10:16.296 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3609000000000006e-05 2024-09-13T05:10:16.297 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.297 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.297 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.297 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.297 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.297 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:16.300 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:10:16.300 INFO:teuthology.orchestra.run.smithi120.stdout:223 writesame 0xdd7cd0b thru 0xdd86d75 data_size 0x1b(0xa06b bytes) 2024-09-13T05:10:16.301 INFO:teuthology.orchestra.run.smithi120.stdout:224 punch from 0xa326156 to 0xa32f5f4, (0x949e bytes) 2024-09-13T05:10:16.301 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:16.301 INFO:teuthology.orchestra.run.smithi120.stdout:226 trunc from 0xdd86d76 to 0x9556240 2024-09-13T05:10:16.301 INFO:teuthology.orchestra.run.smithi120.stdout:227 trunc from 0x9556240 to 0x19c803b 2024-09-13T05:10:16.301 INFO:teuthology.orchestra.run.smithi120.stdout:228 read 0x14dd97c thru 0x14e7691 (0x9d16 bytes) 2024-09-13T05:10:16.301 INFO:teuthology.orchestra.run.smithi120.stdout:229 punch from 0x1152dc5 to 0x115871a, (0x5955 bytes) 2024-09-13T05:10:16.301 INFO:teuthology.orchestra.run.smithi120.stdout:230 read 0x15c6ee9 thru 0x15c8ce2 (0x1dfa bytes) 2024-09-13T05:10:16.301 INFO:teuthology.orchestra.run.smithi120.stdout:232 clone 2 order 25 su 1048576 sc 4 2024-09-13T05:10:16.301 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:16.294+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:16.400 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:16.398+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:16.456 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:16.456 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:16.456 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:16.456 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:16.466 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:10:16.501 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:16.498+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:16.571 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:16.571 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:16.572 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:16.572 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:16.572 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:16.581 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:10:16.602 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:16.599+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:16.689 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:10:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:13 3.a 3:54eb35e9:::rbd_object_map.112d65d6a1c8:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-13T05:10:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:11.688058+0000", 2024-09-13T05:10:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.9967771089999999, 2024-09-13T05:10:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002540077, 2024-09-13T05:10:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 13 2024-09-13T05:10:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.688058+0000", 2024-09-13T05:10:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.688058+0000", 2024-09-13T05:10:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.688056+0000", 2024-09-13T05:10:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.688068+0000", 2024-09-13T05:10:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1600000000000001e-05 2024-09-13T05:10:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.692 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.692 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.688086+0000", 2024-09-13T05:10:16.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7549000000000001e-05 2024-09-13T05:10:16.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.692 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.692 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.688107+0000", 2024-09-13T05:10:16.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1250000000000002e-05 2024-09-13T05:10:16.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.692 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.692 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.688206+0000", 2024-09-13T05:10:16.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9401000000000006e-05 2024-09-13T05:10:16.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.688481+0000", 2024-09-13T05:10:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000274837 2024-09-13T05:10:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.688745+0000", 2024-09-13T05:10:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00026447100000000001 2024-09-13T05:10:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.689923+0000", 2024-09-13T05:10:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0011772880000000001 2024-09-13T05:10:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.690435+0000", 2024-09-13T05:10:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00051181299999999996 2024-09-13T05:10:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.690524+0000", 2024-09-13T05:10:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9464999999999998e-05 2024-09-13T05:10:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.690598+0000", 2024-09-13T05:10:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.4185999999999997e-05 2024-09-13T05:10:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:531 3.a 3:54eb35e9:::rbd_object_map.112d65d6a1c8:head [call lock.assert_locked in=17b,call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-13T05:10:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:14.839458+0000", 2024-09-13T05:10:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.8453772499999999, 2024-09-13T05:10:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023896949999999998, 2024-09-13T05:10:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 531 2024-09-13T05:10:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.839458+0000", 2024-09-13T05:10:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.839458+0000", 2024-09-13T05:10:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.839457+0000", 2024-09-13T05:10:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.839466+0000", 2024-09-13T05:10:16.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2410000000000001e-06 2024-09-13T05:10:16.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.839488+0000", 2024-09-13T05:10:16.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1909999999999999e-05 2024-09-13T05:10:16.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.699 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.839499+0000", 2024-09-13T05:10:16.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0835999999999999e-05 2024-09-13T05:10:16.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.699 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.839596+0000", 2024-09-13T05:10:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7085999999999998e-05 2024-09-13T05:10:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.839755+0000", 2024-09-13T05:10:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00015964399999999999 2024-09-13T05:10:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.840181+0000", 2024-09-13T05:10:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00042515899999999999 2024-09-13T05:10:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.841334+0000", 2024-09-13T05:10:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0011539219999999999 2024-09-13T05:10:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.841746+0000", 2024-09-13T05:10:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000411278 2024-09-13T05:10:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.841804+0000", 2024-09-13T05:10:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8078000000000002e-05 2024-09-13T05:10:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.841848+0000", 2024-09-13T05:10:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3888999999999999e-05 2024-09-13T05:10:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:540 3.a 3:54eb35e9:::rbd_object_map.112d65d6a1c8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-13T05:10:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:14.850832+0000", 2024-09-13T05:10:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.8340032150000001, 2024-09-13T05:10:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0053449279999999997, 2024-09-13T05:10:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.703 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.703 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.703 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:16.703 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:16.703 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 540 2024-09-13T05:10:16.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.703 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.850832+0000", 2024-09-13T05:10:16.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.850832+0000", 2024-09-13T05:10:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.850830+0000", 2024-09-13T05:10:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.850842+0000", 2024-09-13T05:10:16.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1756000000000001e-05 2024-09-13T05:10:16.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.705 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.850870+0000", 2024-09-13T05:10:16.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8274000000000001e-05 2024-09-13T05:10:16.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.705 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.850882+0000", 2024-09-13T05:10:16.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1654999999999999e-05 2024-09-13T05:10:16.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.706 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.850993+0000", 2024-09-13T05:10:16.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011087200000000001 2024-09-13T05:10:16.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.706 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.851176+0000", 2024-09-13T05:10:16.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018281999999999999 2024-09-13T05:10:16.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.706 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:16.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.851872+0000", 2024-09-13T05:10:16.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00069598900000000005 2024-09-13T05:10:16.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:16.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.853497+0000", 2024-09-13T05:10:16.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0016250119999999999 2024-09-13T05:10:16.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:16.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856056+0000", 2024-09-13T05:10:16.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002559576 2024-09-13T05:10:16.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856123+0000", 2024-09-13T05:10:16.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6721e-05 2024-09-13T05:10:16.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856177+0000", 2024-09-13T05:10:16.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4015999999999999e-05 2024-09-13T05:10:16.708 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.708 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.708 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.708 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:541 3.10 3:0951d16d:::rbd_data.112d65d6a1c8.0000000000000038:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2743809~25573] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-13T05:10:16.708 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:14.856355+0000", 2024-09-13T05:10:16.708 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.8284798499999999, 2024-09-13T05:10:16.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0028844579999999999, 2024-09-13T05:10:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 541 2024-09-13T05:10:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856355+0000", 2024-09-13T05:10:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856355+0000", 2024-09-13T05:10:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856354+0000", 2024-09-13T05:10:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856393+0000", 2024-09-13T05:10:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9570000000000002e-05 2024-09-13T05:10:16.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.711 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.711 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856427+0000", 2024-09-13T05:10:16.711 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3976000000000001e-05 2024-09-13T05:10:16.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.711 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.711 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856440+0000", 2024-09-13T05:10:16.711 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2631e-05 2024-09-13T05:10:16.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.711 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.711 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856517+0000", 2024-09-13T05:10:16.712 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6811999999999996e-05 2024-09-13T05:10:16.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.712 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.712 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.712 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856656+0000", 2024-09-13T05:10:16.712 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000138999 2024-09-13T05:10:16.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.712 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.712 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:16.712 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856781+0000", 2024-09-13T05:10:16.712 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000125692 2024-09-13T05:10:16.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.712 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.712 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:16.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.858361+0000", 2024-09-13T05:10:16.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00157957 2024-09-13T05:10:16.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:16.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.859082+0000", 2024-09-13T05:10:16.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00072114399999999995 2024-09-13T05:10:16.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.859177+0000", 2024-09-13T05:10:16.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4605000000000006e-05 2024-09-13T05:10:16.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.859240+0000", 2024-09-13T05:10:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3145000000000006e-05 2024-09-13T05:10:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:543 3.a 3:54eb35e9:::rbd_object_map.112d65d6a1c8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-13T05:10:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:14.860892+0000", 2024-09-13T05:10:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.8239434829999999, 2024-09-13T05:10:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003048584, 2024-09-13T05:10:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 543 2024-09-13T05:10:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.860892+0000", 2024-09-13T05:10:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.860892+0000", 2024-09-13T05:10:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.860890+0000", 2024-09-13T05:10:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.860900+0000", 2024-09-13T05:10:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3000000000000007e-06 2024-09-13T05:10:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.860918+0000", 2024-09-13T05:10:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8349e-05 2024-09-13T05:10:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.860927+0000", 2024-09-13T05:10:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.02e-06 2024-09-13T05:10:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.861030+0000", 2024-09-13T05:10:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010278 2024-09-13T05:10:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.861167+0000", 2024-09-13T05:10:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013675499999999999 2024-09-13T05:10:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.861666+0000", 2024-09-13T05:10:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000499352 2024-09-13T05:10:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.863093+0000", 2024-09-13T05:10:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001426734 2024-09-13T05:10:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.863765+0000", 2024-09-13T05:10:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00067251799999999999 2024-09-13T05:10:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.863877+0000", 2024-09-13T05:10:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011195499999999999 2024-09-13T05:10:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.863940+0000", 2024-09-13T05:10:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3194999999999994e-05 2024-09-13T05:10:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:544 3.10 3:0b075cce:::rbd_data.112d65d6a1c8.000000000000002f:head [write 0~8137] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-13T05:10:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:14.862724+0000", 2024-09-13T05:10:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.8221111460000001, 2024-09-13T05:10:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025853690000000001, 2024-09-13T05:10:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 544 2024-09-13T05:10:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.862724+0000", 2024-09-13T05:10:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.862724+0000", 2024-09-13T05:10:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.862723+0000", 2024-09-13T05:10:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.862864+0000", 2024-09-13T05:10:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014113900000000001 2024-09-13T05:10:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.862880+0000", 2024-09-13T05:10:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5608e-05 2024-09-13T05:10:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.862888+0000", 2024-09-13T05:10:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8219999999999996e-06 2024-09-13T05:10:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.862977+0000", 2024-09-13T05:10:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8651000000000002e-05 2024-09-13T05:10:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.863195+0000", 2024-09-13T05:10:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021795300000000001 2024-09-13T05:10:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.863500+0000", 2024-09-13T05:10:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00030549599999999999 2024-09-13T05:10:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.864970+0000", 2024-09-13T05:10:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0014697620000000001 2024-09-13T05:10:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.865155+0000", 2024-09-13T05:10:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018510099999999999 2024-09-13T05:10:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.865226+0000", 2024-09-13T05:10:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0698000000000006e-05 2024-09-13T05:10:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.865309+0000", 2024-09-13T05:10:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.3453000000000002e-05 2024-09-13T05:10:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:546 3.a 3:54eb35e9:::rbd_object_map.112d65d6a1c8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-13T05:10:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:14.869532+0000", 2024-09-13T05:10:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.815303688, 2024-09-13T05:10:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022131619999999999, 2024-09-13T05:10:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 546 2024-09-13T05:10:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.869532+0000", 2024-09-13T05:10:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.869532+0000", 2024-09-13T05:10:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.869530+0000", 2024-09-13T05:10:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.869541+0000", 2024-09-13T05:10:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1302e-05 2024-09-13T05:10:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.869568+0000", 2024-09-13T05:10:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7334e-05 2024-09-13T05:10:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.869581+0000", 2024-09-13T05:10:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2857000000000001e-05 2024-09-13T05:10:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.869647+0000", 2024-09-13T05:10:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5319000000000003e-05 2024-09-13T05:10:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.869732+0000", 2024-09-13T05:10:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5198000000000007e-05 2024-09-13T05:10:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.870043+0000", 2024-09-13T05:10:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000311339 2024-09-13T05:10:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.871421+0000", 2024-09-13T05:10:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0013783440000000001 2024-09-13T05:10:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.871646+0000", 2024-09-13T05:10:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000224928 2024-09-13T05:10:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.871710+0000", 2024-09-13T05:10:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3596000000000006e-05 2024-09-13T05:10:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.871745+0000", 2024-09-13T05:10:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4730999999999997e-05 2024-09-13T05:10:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:547 3.10 3:0ffd905d:::rbd_data.112d65d6a1c8.0000000000000026:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2111471~26843] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-13T05:10:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:14.872101+0000", 2024-09-13T05:10:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.812734396, 2024-09-13T05:10:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021482760000000002, 2024-09-13T05:10:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 547 2024-09-13T05:10:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.872101+0000", 2024-09-13T05:10:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.872101+0000", 2024-09-13T05:10:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.872099+0000", 2024-09-13T05:10:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.872138+0000", 2024-09-13T05:10:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8665000000000003e-05 2024-09-13T05:10:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.872162+0000", 2024-09-13T05:10:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3904999999999999e-05 2024-09-13T05:10:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.872179+0000", 2024-09-13T05:10:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7728999999999999e-05 2024-09-13T05:10:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.872238+0000", 2024-09-13T05:10:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8671000000000001e-05 2024-09-13T05:10:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.872312+0000", 2024-09-13T05:10:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3789999999999997e-05 2024-09-13T05:10:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.872431+0000", 2024-09-13T05:10:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011929099999999999 2024-09-13T05:10:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.873640+0000", 2024-09-13T05:10:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0012090670000000001 2024-09-13T05:10:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.874131+0000", 2024-09-13T05:10:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00049122599999999999 2024-09-13T05:10:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.874190+0000", 2024-09-13T05:10:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8251000000000002e-05 2024-09-13T05:10:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.874249+0000", 2024-09-13T05:10:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9378e-05 2024-09-13T05:10:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:548 3.a 3:54eb35e9:::rbd_object_map.112d65d6a1c8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-13T05:10:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:14.874676+0000", 2024-09-13T05:10:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.8101587989999999, 2024-09-13T05:10:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024035910000000001, 2024-09-13T05:10:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 548 2024-09-13T05:10:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.874676+0000", 2024-09-13T05:10:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.874676+0000", 2024-09-13T05:10:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.874674+0000", 2024-09-13T05:10:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.874690+0000", 2024-09-13T05:10:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5633000000000001e-05 2024-09-13T05:10:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.874720+0000", 2024-09-13T05:10:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9505999999999998e-05 2024-09-13T05:10:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.874740+0000", 2024-09-13T05:10:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0863e-05 2024-09-13T05:10:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.874834+0000", 2024-09-13T05:10:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3461000000000005e-05 2024-09-13T05:10:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.874985+0000", 2024-09-13T05:10:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00015108999999999999 2024-09-13T05:10:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.875600+0000", 2024-09-13T05:10:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00061490600000000002 2024-09-13T05:10:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.876949+0000", 2024-09-13T05:10:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001348978 2024-09-13T05:10:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.877006+0000", 2024-09-13T05:10:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6952e-05 2024-09-13T05:10:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.877049+0000", 2024-09-13T05:10:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3643000000000002e-05 2024-09-13T05:10:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.877080+0000", 2024-09-13T05:10:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0589000000000001e-05 2024-09-13T05:10:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:557 3.a 3:54eb35e9:::rbd_object_map.112d65d6a1c8:head [call lock.assert_locked in=17b,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:15.689161+0000", 2024-09-13T05:10:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.99567388599999995, 2024-09-13T05:10:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0027458830000000002, 2024-09-13T05:10:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 557 2024-09-13T05:10:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.689161+0000", 2024-09-13T05:10:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.689161+0000", 2024-09-13T05:10:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.689160+0000", 2024-09-13T05:10:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.689167+0000", 2024-09-13T05:10:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.105e-06 2024-09-13T05:10:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.689180+0000", 2024-09-13T05:10:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3369e-05 2024-09-13T05:10:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.689186+0000", 2024-09-13T05:10:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4489999999999996e-06 2024-09-13T05:10:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.689256+0000", 2024-09-13T05:10:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0097000000000003e-05 2024-09-13T05:10:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.689365+0000", 2024-09-13T05:10:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010832000000000001 2024-09-13T05:10:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.689671+0000", 2024-09-13T05:10:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00030588300000000001 2024-09-13T05:10:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.690741+0000", 2024-09-13T05:10:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0010707659999999999 2024-09-13T05:10:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.691812+0000", 2024-09-13T05:10:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001070377 2024-09-13T05:10:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.691867+0000", 2024-09-13T05:10:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5637000000000003e-05 2024-09-13T05:10:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.691907+0000", 2024-09-13T05:10:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9835000000000001e-05 2024-09-13T05:10:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:607 3.a 3:535385f0:::rbd_children:head [call rbd.add_child in=12b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:15.758133+0000", 2024-09-13T05:10:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.92670235400000001, 2024-09-13T05:10:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0027661769999999999, 2024-09-13T05:10:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 607 2024-09-13T05:10:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.758133+0000", 2024-09-13T05:10:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.758133+0000", 2024-09-13T05:10:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.758130+0000", 2024-09-13T05:10:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:10:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.758148+0000", 2024-09-13T05:10:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7773000000000001e-05 2024-09-13T05:10:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.758186+0000", 2024-09-13T05:10:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7518999999999998e-05 2024-09-13T05:10:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.758208+0000", 2024-09-13T05:10:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2024000000000001e-05 2024-09-13T05:10:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.758298+0000", 2024-09-13T05:10:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0163999999999999e-05 2024-09-13T05:10:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.758510+0000", 2024-09-13T05:10:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021195299999999999 2024-09-13T05:10:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.758729+0000", 2024-09-13T05:10:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021891400000000001 2024-09-13T05:10:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.759868+0000", 2024-09-13T05:10:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0011391559999999999 2024-09-13T05:10:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.760792+0000", 2024-09-13T05:10:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00092416500000000001 2024-09-13T05:10:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.760859+0000", 2024-09-13T05:10:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7154000000000001e-05 2024-09-13T05:10:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.760899+0000", 2024-09-13T05:10:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9799000000000003e-05 2024-09-13T05:10:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:622 3.a 3:54eb35e9:::rbd_object_map.112d65d6a1c8:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:15.926862+0000", 2024-09-13T05:10:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.75797365000000005, 2024-09-13T05:10:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023120839999999998, 2024-09-13T05:10:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 622 2024-09-13T05:10:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.926862+0000", 2024-09-13T05:10:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.926862+0000", 2024-09-13T05:10:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.926859+0000", 2024-09-13T05:10:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:10:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.926895+0000", 2024-09-13T05:10:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6350000000000003e-05 2024-09-13T05:10:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.926933+0000", 2024-09-13T05:10:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7985999999999998e-05 2024-09-13T05:10:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.926957+0000", 2024-09-13T05:10:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4019000000000002e-05 2024-09-13T05:10:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.927057+0000", 2024-09-13T05:10:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9959999999999998e-05 2024-09-13T05:10:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.927194+0000", 2024-09-13T05:10:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013688799999999999 2024-09-13T05:10:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.927411+0000", 2024-09-13T05:10:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021703 2024-09-13T05:10:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.928551+0000", 2024-09-13T05:10:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001140262 2024-09-13T05:10:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:16.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.929074+0000", 2024-09-13T05:10:16.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00052245500000000001 2024-09-13T05:10:16.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.929130+0000", 2024-09-13T05:10:16.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6861000000000003e-05 2024-09-13T05:10:16.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.929174+0000", 2024-09-13T05:10:16.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3306000000000002e-05 2024-09-13T05:10:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:720 3.1e e27/22 3:79d098b4:::rbd_data.112dac7a9dca.0000000000000002:head v 27'7, mlcod=25'5)", 2024-09-13T05:10:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.002085+0000", 2024-09-13T05:10:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.68275068299999997, 2024-09-13T05:10:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002777687, 2024-09-13T05:10:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.002085+0000", 2024-09-13T05:10:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.002085+0000", 2024-09-13T05:10:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.002084+0000", 2024-09-13T05:10:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.002258+0000", 2024-09-13T05:10:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017429699999999999 2024-09-13T05:10:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.002272+0000", 2024-09-13T05:10:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4032999999999999e-05 2024-09-13T05:10:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.002279+0000", 2024-09-13T05:10:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7159999999999997e-06 2024-09-13T05:10:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.002333+0000", 2024-09-13T05:10:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3773999999999997e-05 2024-09-13T05:10:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.002357+0000", 2024-09-13T05:10:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4023999999999999e-05 2024-09-13T05:10:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.004799+0000", 2024-09-13T05:10:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002441543 2024-09-13T05:10:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.004862+0000", 2024-09-13T05:10:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3696999999999997e-05 2024-09-13T05:10:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:721 3.1e e27/22 3:7a30826b:::rbd_data.112dac7a9dca.0000000000000003:head v 27'8, mlcod=25'5)", 2024-09-13T05:10:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.003124+0000", 2024-09-13T05:10:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.68171146699999996, 2024-09-13T05:10:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020861260000000002, 2024-09-13T05:10:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.003124+0000", 2024-09-13T05:10:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.003124+0000", 2024-09-13T05:10:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.003123+0000", 2024-09-13T05:10:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.003276+0000", 2024-09-13T05:10:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000152795 2024-09-13T05:10:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.003284+0000", 2024-09-13T05:10:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6420000000000007e-06 2024-09-13T05:10:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.003291+0000", 2024-09-13T05:10:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.4089999999999997e-06 2024-09-13T05:10:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.003365+0000", 2024-09-13T05:10:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3845999999999997e-05 2024-09-13T05:10:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.003414+0000", 2024-09-13T05:10:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8887999999999997e-05 2024-09-13T05:10:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.005167+0000", 2024-09-13T05:10:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0017527980000000001 2024-09-13T05:10:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.005210+0000", 2024-09-13T05:10:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3306000000000002e-05 2024-09-13T05:10:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:768 3.14 e27/22 3:28f6a674:::rbd_data.112dac7a9dca.000000000000000a:head v 27'2, mlcod=0'0)", 2024-09-13T05:10:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.082153+0000", 2024-09-13T05:10:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.60268194600000002, 2024-09-13T05:10:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001798663, 2024-09-13T05:10:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.773 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.082153+0000", 2024-09-13T05:10:16.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.082153+0000", 2024-09-13T05:10:16.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.082152+0000", 2024-09-13T05:10:16.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:16.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.082197+0000", 2024-09-13T05:10:16.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5195999999999999e-05 2024-09-13T05:10:16.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.082223+0000", 2024-09-13T05:10:16.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5888e-05 2024-09-13T05:10:16.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.082239+0000", 2024-09-13T05:10:16.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5764999999999999e-05 2024-09-13T05:10:16.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.082351+0000", 2024-09-13T05:10:16.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000111842 2024-09-13T05:10:16.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.082393+0000", 2024-09-13T05:10:16.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2151999999999999e-05 2024-09-13T05:10:16.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.083874+0000", 2024-09-13T05:10:16.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0014814800000000001 2024-09-13T05:10:16.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.083952+0000", 2024-09-13T05:10:16.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7742000000000002e-05 2024-09-13T05:10:16.776 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.776 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.776 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.777 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:785 3.1e e27/22 3:79d098b4:::rbd_data.112dac7a9dca.0000000000000002:head v 27'10, mlcod=27'8)", 2024-09-13T05:10:16.777 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.119524+0000", 2024-09-13T05:10:16.777 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.56531119799999996, 2024-09-13T05:10:16.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022930089999999999, 2024-09-13T05:10:16.777 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.777 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.777 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.119524+0000", 2024-09-13T05:10:16.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.119524+0000", 2024-09-13T05:10:16.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.119522+0000", 2024-09-13T05:10:16.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:16.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.119561+0000", 2024-09-13T05:10:16.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9082999999999998e-05 2024-09-13T05:10:16.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.119593+0000", 2024-09-13T05:10:16.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1652999999999997e-05 2024-09-13T05:10:16.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.119607+0000", 2024-09-13T05:10:16.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4652e-05 2024-09-13T05:10:16.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.119735+0000", 2024-09-13T05:10:16.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012778799999999999 2024-09-13T05:10:16.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.119799+0000", 2024-09-13T05:10:16.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3411999999999995e-05 2024-09-13T05:10:16.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.121726+0000", 2024-09-13T05:10:16.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001926973 2024-09-13T05:10:16.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.121817+0000", 2024-09-13T05:10:16.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1397999999999995e-05 2024-09-13T05:10:16.781 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.781 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.781 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.781 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:797 3.1e e27/22 3:79d098b4:::rbd_data.112dac7a9dca.0000000000000002:head v 27'11, mlcod=27'9)", 2024-09-13T05:10:16.781 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.142479+0000", 2024-09-13T05:10:16.781 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.54235660699999999, 2024-09-13T05:10:16.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022740690000000001, 2024-09-13T05:10:16.782 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.782 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.782 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.142479+0000", 2024-09-13T05:10:16.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.142479+0000", 2024-09-13T05:10:16.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.142477+0000", 2024-09-13T05:10:16.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:16.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.142506+0000", 2024-09-13T05:10:16.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9669999999999999e-05 2024-09-13T05:10:16.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.142540+0000", 2024-09-13T05:10:16.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3151999999999997e-05 2024-09-13T05:10:16.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.142558+0000", 2024-09-13T05:10:16.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8280000000000001e-05 2024-09-13T05:10:16.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.142679+0000", 2024-09-13T05:10:16.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012115100000000001 2024-09-13T05:10:16.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.142743+0000", 2024-09-13T05:10:16.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3699000000000001e-05 2024-09-13T05:10:16.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.144666+0000", 2024-09-13T05:10:16.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001923562 2024-09-13T05:10:16.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.144753+0000", 2024-09-13T05:10:16.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6462e-05 2024-09-13T05:10:16.785 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.786 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.786 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.786 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:822 3.1e e27/22 3:79d098b4:::rbd_data.112dac7a9dca.0000000000000002:head v 27'12, mlcod=27'10)", 2024-09-13T05:10:16.786 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.208255+0000", 2024-09-13T05:10:16.786 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.47658049600000002, 2024-09-13T05:10:16.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022768689999999999, 2024-09-13T05:10:16.786 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.786 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.786 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.786 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208255+0000", 2024-09-13T05:10:16.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208255+0000", 2024-09-13T05:10:16.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208253+0000", 2024-09-13T05:10:16.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:16.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208270+0000", 2024-09-13T05:10:16.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7606999999999999e-05 2024-09-13T05:10:16.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208302+0000", 2024-09-13T05:10:16.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1729000000000001e-05 2024-09-13T05:10:16.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208321+0000", 2024-09-13T05:10:16.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8425999999999999e-05 2024-09-13T05:10:16.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208446+0000", 2024-09-13T05:10:16.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012494399999999999 2024-09-13T05:10:16.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208489+0000", 2024-09-13T05:10:16.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3219000000000001e-05 2024-09-13T05:10:16.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.210447+0000", 2024-09-13T05:10:16.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0019585570000000001 2024-09-13T05:10:16.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.210532+0000", 2024-09-13T05:10:16.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4307000000000004e-05 2024-09-13T05:10:16.790 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.790 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.790 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.790 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:820 3.3 e27/22 3:c6fd6387:::rbd_data.112dac7a9dca.0000000000000000:head v 27'4, mlcod=25'2)", 2024-09-13T05:10:16.790 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.208622+0000", 2024-09-13T05:10:16.790 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.47621342999999999, 2024-09-13T05:10:16.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0026078220000000001, 2024-09-13T05:10:16.791 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.791 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.791 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208622+0000", 2024-09-13T05:10:16.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208622+0000", 2024-09-13T05:10:16.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.792 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.792 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208620+0000", 2024-09-13T05:10:16.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:16.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.792 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.792 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208639+0000", 2024-09-13T05:10:16.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9443e-05 2024-09-13T05:10:16.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.792 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.792 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208669+0000", 2024-09-13T05:10:16.793 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9388999999999999e-05 2024-09-13T05:10:16.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.793 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208693+0000", 2024-09-13T05:10:16.793 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3822999999999999e-05 2024-09-13T05:10:16.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.793 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208827+0000", 2024-09-13T05:10:16.793 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013459400000000001 2024-09-13T05:10:16.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208882+0000", 2024-09-13T05:10:16.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5318999999999997e-05 2024-09-13T05:10:16.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.211155+0000", 2024-09-13T05:10:16.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022722459999999999 2024-09-13T05:10:16.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.211230+0000", 2024-09-13T05:10:16.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.4938000000000007e-05 2024-09-13T05:10:16.794 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.794 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.795 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.795 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:823 3.1e e27/22 3:7a30826b:::rbd_data.112dac7a9dca.0000000000000003:head v 27'13, mlcod=27'10)", 2024-09-13T05:10:16.795 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.209065+0000", 2024-09-13T05:10:16.795 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.47577029300000001, 2024-09-13T05:10:16.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021918979999999998, 2024-09-13T05:10:16.795 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:16.795 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:16.795 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:16.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:16.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.209065+0000", 2024-09-13T05:10:16.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:16.796 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.209065+0000", 2024-09-13T05:10:16.796 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:16.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:16.796 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.209064+0000", 2024-09-13T05:10:16.796 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:16.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:16.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.209078+0000", 2024-09-13T05:10:16.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4174e-05 2024-09-13T05:10:16.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:16.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.209105+0000", 2024-09-13T05:10:16.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7345999999999999e-05 2024-09-13T05:10:16.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:16.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.209121+0000", 2024-09-13T05:10:16.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5662999999999999e-05 2024-09-13T05:10:16.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.798 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:16.798 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.209691+0000", 2024-09-13T05:10:16.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00057030399999999999 2024-09-13T05:10:16.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.798 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:16.798 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.209750+0000", 2024-09-13T05:10:16.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8856e-05 2024-09-13T05:10:16.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.799 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.799 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:16.799 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.211196+0000", 2024-09-13T05:10:16.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001446513 2024-09-13T05:10:16.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:16.799 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:16.799 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:16.799 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.211257+0000", 2024-09-13T05:10:16.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0489000000000003e-05 2024-09-13T05:10:16.799 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.799 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.799 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.800 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:16.800 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:16.800 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:16.800 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T05:10:16.802 INFO:teuthology.orchestra.run.smithi120.stderr:osd set-full-ratio 0.95 2024-09-13T05:10:16.802 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:10:16.803 INFO:teuthology.orchestra.run.smithi120.stdout:leaving image image_client.0-clone1 intact 2024-09-13T05:10:16.803 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:16.798+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:16.876 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:10:16.880 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #0, image image_client.0 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent1 2024-09-13T05:10:16.903 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:16.899+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:16.919 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:16.919 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:16.919 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:16.919 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:16.930 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:10:17.003 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:16.999+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:17.032 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:10:17.033 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:17.033 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:17.033 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:17.033 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:17.033 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:17.043 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:10:17.054 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:10:17.075 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:10:17.093 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:10:17.104 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:17.098+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:17.114 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:10:17.137 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:10:17.150 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:17.151 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:17.151 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:17.151 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:10:17.151 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.151 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:17.151 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.451581+0000", 2024-09-13T05:10:17.151 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.695495964999999, 2024-09-13T05:10:17.151 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010684878, 2024-09-13T05:10:17.151 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:17.151 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:17.151 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:17.152 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:17.152 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:17.152 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 70 2024-09-13T05:10:17.152 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.152 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:17.152 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.152 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:17.152 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.451581+0000", 2024-09-13T05:10:17.152 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.152 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.152 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.152 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:17.152 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.451581+0000", 2024-09-13T05:10:17.153 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.153 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.153 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.153 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:17.153 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.451579+0000", 2024-09-13T05:10:17.153 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:17.153 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.153 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.153 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:17.153 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.451589+0000", 2024-09-13T05:10:17.153 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7489999999999993e-06 2024-09-13T05:10:17.153 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.153 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.153 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:17.154 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.451622+0000", 2024-09-13T05:10:17.154 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2651000000000003e-05 2024-09-13T05:10:17.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.154 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.154 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:17.154 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.451640+0000", 2024-09-13T05:10:17.154 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8238999999999999e-05 2024-09-13T05:10:17.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.154 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.154 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:17.154 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.455669+0000", 2024-09-13T05:10:17.154 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0040290530000000003 2024-09-13T05:10:17.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.154 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:17.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.455863+0000", 2024-09-13T05:10:17.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000194379 2024-09-13T05:10:17.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:17.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.456103+0000", 2024-09-13T05:10:17.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00023963500000000001 2024-09-13T05:10:17.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:17.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.458065+0000", 2024-09-13T05:10:17.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001961735 2024-09-13T05:10:17.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.156 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.156 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:17.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.462113+0000", 2024-09-13T05:10:17.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0040486640000000004 2024-09-13T05:10:17.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.156 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.156 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:17.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.462192+0000", 2024-09-13T05:10:17.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9043999999999997e-05 2024-09-13T05:10:17.157 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.157 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:17.157 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.462265+0000", 2024-09-13T05:10:17.157 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3034999999999994e-05 2024-09-13T05:10:17.157 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.157 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:17.157 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.157 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.157 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:17.157 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.688597+0000", 2024-09-13T05:10:17.157 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.458479919999998, 2024-09-13T05:10:17.158 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013348512, 2024-09-13T05:10:17.158 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:17.158 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:17.158 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:17.158 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:17.158 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:17.158 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 109 2024-09-13T05:10:17.158 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.158 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:17.158 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.158 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:17.158 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688597+0000", 2024-09-13T05:10:17.158 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.159 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.159 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:17.159 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688597+0000", 2024-09-13T05:10:17.159 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.159 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.159 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:17.159 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688596+0000", 2024-09-13T05:10:17.159 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:17.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.159 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.159 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:17.159 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688775+0000", 2024-09-13T05:10:17.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017898999999999999 2024-09-13T05:10:17.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:17.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688814+0000", 2024-09-13T05:10:17.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9499000000000002e-05 2024-09-13T05:10:17.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:17.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688853+0000", 2024-09-13T05:10:17.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8976000000000001e-05 2024-09-13T05:10:17.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.161 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:17.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.695018+0000", 2024-09-13T05:10:17.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0061651079999999999 2024-09-13T05:10:17.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.161 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:17.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.695182+0000", 2024-09-13T05:10:17.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000163723 2024-09-13T05:10:17.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.161 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:17.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.695407+0000", 2024-09-13T05:10:17.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00022512399999999999 2024-09-13T05:10:17.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.162 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.162 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:17.162 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698875+0000", 2024-09-13T05:10:17.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0034678069999999998 2024-09-13T05:10:17.162 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.162 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.162 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:17.162 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701846+0000", 2024-09-13T05:10:17.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002970692 2024-09-13T05:10:17.162 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.162 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.162 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:17.162 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701903+0000", 2024-09-13T05:10:17.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7944e-05 2024-09-13T05:10:17.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.163 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:17.163 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701945+0000", 2024-09-13T05:10:17.163 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1656000000000002e-05 2024-09-13T05:10:17.163 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.163 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:17.163 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.163 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:17.163 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.688881+0000", 2024-09-13T05:10:17.163 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.458195400000001, 2024-09-13T05:10:17.163 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013592653, 2024-09-13T05:10:17.164 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:17.164 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:17.164 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:17.164 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:17.164 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:17.164 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 110 2024-09-13T05:10:17.164 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.164 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:17.164 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.164 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:17.164 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688881+0000", 2024-09-13T05:10:17.164 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.164 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.165 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.165 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:17.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688881+0000", 2024-09-13T05:10:17.165 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.165 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.165 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:17.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688880+0000", 2024-09-13T05:10:17.165 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:17.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.165 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.165 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:17.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688891+0000", 2024-09-13T05:10:17.165 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0727000000000001e-05 2024-09-13T05:10:17.166 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.166 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:17.166 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688908+0000", 2024-09-13T05:10:17.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7390000000000001e-05 2024-09-13T05:10:17.166 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.166 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:17.166 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688926+0000", 2024-09-13T05:10:17.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8216e-05 2024-09-13T05:10:17.166 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.166 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:17.166 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.696278+0000", 2024-09-13T05:10:17.167 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0073520929999999996 2024-09-13T05:10:17.167 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.167 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:17.167 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.696360+0000", 2024-09-13T05:10:17.167 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1934999999999994e-05 2024-09-13T05:10:17.167 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.167 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:17.167 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.696541+0000", 2024-09-13T05:10:17.167 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018114800000000001 2024-09-13T05:10:17.167 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.168 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:17.168 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698879+0000", 2024-09-13T05:10:17.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023370650000000001 2024-09-13T05:10:17.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.168 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.168 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:17.168 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702421+0000", 2024-09-13T05:10:17.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0035420500000000001 2024-09-13T05:10:17.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.168 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.168 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:17.168 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702452+0000", 2024-09-13T05:10:17.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1588999999999999e-05 2024-09-13T05:10:17.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:17.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702474+0000", 2024-09-13T05:10:17.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1650000000000001e-05 2024-09-13T05:10:17.169 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.169 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:17.169 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.169 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:17.169 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.688941+0000", 2024-09-13T05:10:17.169 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.458135881, 2024-09-13T05:10:17.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013667653, 2024-09-13T05:10:17.170 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:17.170 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:17.170 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:17.170 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:17.170 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:17.170 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 111 2024-09-13T05:10:17.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.170 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:17.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:17.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688941+0000", 2024-09-13T05:10:17.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.171 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:17.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688941+0000", 2024-09-13T05:10:17.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.171 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:17.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688940+0000", 2024-09-13T05:10:17.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:17.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.171 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:17.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688949+0000", 2024-09-13T05:10:17.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7629999999999995e-06 2024-09-13T05:10:17.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:17.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688982+0000", 2024-09-13T05:10:17.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2446000000000001e-05 2024-09-13T05:10:17.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:17.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688995+0000", 2024-09-13T05:10:17.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3305999999999999e-05 2024-09-13T05:10:17.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:17.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.697295+0000", 2024-09-13T05:10:17.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0083001519999999999 2024-09-13T05:10:17.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:17.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.697352+0000", 2024-09-13T05:10:17.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6563e-05 2024-09-13T05:10:17.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:17.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.697439+0000", 2024-09-13T05:10:17.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7410000000000005e-05 2024-09-13T05:10:17.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:17.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698884+0000", 2024-09-13T05:10:17.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0014450419999999999 2024-09-13T05:10:17.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:17.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702524+0000", 2024-09-13T05:10:17.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0036397109999999999 2024-09-13T05:10:17.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:17.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702570+0000", 2024-09-13T05:10:17.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5608000000000001e-05 2024-09-13T05:10:17.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.175 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:17.175 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702608+0000", 2024-09-13T05:10:17.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8608e-05 2024-09-13T05:10:17.175 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.175 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:17.175 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.175 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:17.175 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.689011+0000", 2024-09-13T05:10:17.175 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.458065669, 2024-09-13T05:10:17.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013716103, 2024-09-13T05:10:17.175 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:17.175 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:17.176 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:17.176 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:17.176 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:17.176 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 112 2024-09-13T05:10:17.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.176 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:17.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:17.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689011+0000", 2024-09-13T05:10:17.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:17.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689011+0000", 2024-09-13T05:10:17.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:17.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689010+0000", 2024-09-13T05:10:17.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:17.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:17.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689225+0000", 2024-09-13T05:10:17.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021534899999999999 2024-09-13T05:10:17.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:17.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689247+0000", 2024-09-13T05:10:17.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1766000000000001e-05 2024-09-13T05:10:17.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:17.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689262+0000", 2024-09-13T05:10:17.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4769e-05 2024-09-13T05:10:17.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.179 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:17.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.697818+0000", 2024-09-13T05:10:17.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0085563710000000001 2024-09-13T05:10:17.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.179 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:17.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.697909+0000", 2024-09-13T05:10:17.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1434000000000006e-05 2024-09-13T05:10:17.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.179 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:17.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698035+0000", 2024-09-13T05:10:17.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000125971 2024-09-13T05:10:17.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:17.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701127+0000", 2024-09-13T05:10:17.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0030915389999999999 2024-09-13T05:10:17.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:17.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702664+0000", 2024-09-13T05:10:17.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001536684 2024-09-13T05:10:17.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:17.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702702+0000", 2024-09-13T05:10:17.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8617e-05 2024-09-13T05:10:17.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:17.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702727+0000", 2024-09-13T05:10:17.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4726e-05 2024-09-13T05:10:17.181 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.181 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:17.181 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.181 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:17.181 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.689282+0000", 2024-09-13T05:10:17.181 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.457794327999999, 2024-09-13T05:10:17.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013657832999999999, 2024-09-13T05:10:17.181 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:17.182 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:17.182 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:17.182 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:17.182 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:17.182 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 113 2024-09-13T05:10:17.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.182 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:17.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:17.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689282+0000", 2024-09-13T05:10:17.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:17.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689282+0000", 2024-09-13T05:10:17.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:17.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689281+0000", 2024-09-13T05:10:17.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:17.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:17.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689291+0000", 2024-09-13T05:10:17.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0349999999999999e-05 2024-09-13T05:10:17.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.184 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:17.184 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689308+0000", 2024-09-13T05:10:17.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6469000000000001e-05 2024-09-13T05:10:17.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.184 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:17.184 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689321+0000", 2024-09-13T05:10:17.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.31e-05 2024-09-13T05:10:17.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.184 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:17.184 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698510+0000", 2024-09-13T05:10:17.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0091895410000000007 2024-09-13T05:10:17.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:17.185 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698566+0000", 2024-09-13T05:10:17.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6008999999999999e-05 2024-09-13T05:10:17.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:17.185 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698649+0000", 2024-09-13T05:10:17.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2562e-05 2024-09-13T05:10:17.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:17.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701957+0000", 2024-09-13T05:10:17.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033086029999999998 2024-09-13T05:10:17.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:17.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702878+0000", 2024-09-13T05:10:17.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00092051000000000003 2024-09-13T05:10:17.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:17.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702911+0000", 2024-09-13T05:10:17.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3327999999999997e-05 2024-09-13T05:10:17.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:17.187 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702940+0000", 2024-09-13T05:10:17.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8744000000000001e-05 2024-09-13T05:10:17.187 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.187 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:17.187 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.187 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:17.187 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.689333+0000", 2024-09-13T05:10:17.187 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.457743101999998, 2024-09-13T05:10:17.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013692216, 2024-09-13T05:10:17.187 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:17.187 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:17.188 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:17.188 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:17.188 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:17.188 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 114 2024-09-13T05:10:17.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.188 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:17.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:17.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689333+0000", 2024-09-13T05:10:17.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:17.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689333+0000", 2024-09-13T05:10:17.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:17.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689332+0000", 2024-09-13T05:10:17.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:17.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:17.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689342+0000", 2024-09-13T05:10:17.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5629999999999998e-06 2024-09-13T05:10:17.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:17.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689358+0000", 2024-09-13T05:10:17.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.552e-05 2024-09-13T05:10:17.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:17.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689375+0000", 2024-09-13T05:10:17.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7180000000000002e-05 2024-09-13T05:10:17.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:17.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698905+0000", 2024-09-13T05:10:17.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0095304499999999993 2024-09-13T05:10:17.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:17.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698954+0000", 2024-09-13T05:10:17.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8702999999999998e-05 2024-09-13T05:10:17.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:17.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.699029+0000", 2024-09-13T05:10:17.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.4857000000000005e-05 2024-09-13T05:10:17.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:17.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701965+0000", 2024-09-13T05:10:17.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002936059 2024-09-13T05:10:17.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:17.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702983+0000", 2024-09-13T05:10:17.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0010183169999999999 2024-09-13T05:10:17.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:17.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.703007+0000", 2024-09-13T05:10:17.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4100999999999998e-05 2024-09-13T05:10:17.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:17.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.703026+0000", 2024-09-13T05:10:17.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8473000000000001e-05 2024-09-13T05:10:17.192 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.193 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:17.193 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.193 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:17.193 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.689416+0000", 2024-09-13T05:10:17.193 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.457660883999999, 2024-09-13T05:10:17.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013724638000000001, 2024-09-13T05:10:17.193 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:17.193 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:17.194 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:17.194 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:17.194 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:17.194 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 115 2024-09-13T05:10:17.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.194 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:17.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:17.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689416+0000", 2024-09-13T05:10:17.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:17.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689416+0000", 2024-09-13T05:10:17.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.195 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:17.195 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689414+0000", 2024-09-13T05:10:17.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:17.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.195 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:17.195 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689603+0000", 2024-09-13T05:10:17.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018881599999999999 2024-09-13T05:10:17.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.195 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:17.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689626+0000", 2024-09-13T05:10:17.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3025999999999999e-05 2024-09-13T05:10:17.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.196 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:17.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689646+0000", 2024-09-13T05:10:17.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9585999999999998e-05 2024-09-13T05:10:17.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.196 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:17.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.699361+0000", 2024-09-13T05:10:17.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0097155249999999992 2024-09-13T05:10:17.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:17.197 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.699460+0000", 2024-09-13T05:10:17.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8339999999999997e-05 2024-09-13T05:10:17.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:17.197 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.699627+0000", 2024-09-13T05:10:17.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000166992 2024-09-13T05:10:17.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:17.197 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701970+0000", 2024-09-13T05:10:17.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023433569999999999 2024-09-13T05:10:17.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.198 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:17.198 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.703072+0000", 2024-09-13T05:10:17.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00110228 2024-09-13T05:10:17.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.198 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:17.198 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.703110+0000", 2024-09-13T05:10:17.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7385999999999997e-05 2024-09-13T05:10:17.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.198 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:17.198 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.703140+0000", 2024-09-13T05:10:17.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0530000000000001e-05 2024-09-13T05:10:17.199 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.199 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:17.199 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.199 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.199 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.199 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:17.199 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.689662+0000", 2024-09-13T05:10:17.199 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.457414659000001, 2024-09-13T05:10:17.199 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013592956, 2024-09-13T05:10:17.199 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:17.199 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:17.199 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:17.199 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:17.199 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:17.200 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 116 2024-09-13T05:10:17.200 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.200 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:17.200 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.200 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:17.200 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689662+0000", 2024-09-13T05:10:17.200 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.200 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.200 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.200 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:17.200 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689662+0000", 2024-09-13T05:10:17.200 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.200 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.200 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:17.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689661+0000", 2024-09-13T05:10:17.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:17.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:17.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689672+0000", 2024-09-13T05:10:17.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0672999999999999e-05 2024-09-13T05:10:17.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:17.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689687+0000", 2024-09-13T05:10:17.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5588999999999999e-05 2024-09-13T05:10:17.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.202 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:17.202 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689702+0000", 2024-09-13T05:10:17.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.447e-05 2024-09-13T05:10:17.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.202 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:17.202 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.700376+0000", 2024-09-13T05:10:17.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010673945000000001 2024-09-13T05:10:17.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.202 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:17.202 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.700498+0000", 2024-09-13T05:10:17.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012220699999999999 2024-09-13T05:10:17.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.203 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:17.203 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.700666+0000", 2024-09-13T05:10:17.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016788400000000001 2024-09-13T05:10:17.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.203 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:17.203 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701979+0000", 2024-09-13T05:10:17.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0013135530000000001 2024-09-13T05:10:17.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.203 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:17.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.703182+0000", 2024-09-13T05:10:17.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00120235 2024-09-13T05:10:17.204 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.204 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:17.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.703229+0000", 2024-09-13T05:10:17.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7966000000000001e-05 2024-09-13T05:10:17.204 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.204 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:17.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.703255+0000", 2024-09-13T05:10:17.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5361999999999999e-05 2024-09-13T05:10:17.204 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.204 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:17.205 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.205 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:17.205 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.689785+0000", 2024-09-13T05:10:17.205 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.457291082000001, 2024-09-13T05:10:17.205 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.015287752999999999, 2024-09-13T05:10:17.205 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:17.205 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:17.205 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:17.205 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:17.205 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:17.205 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 117 2024-09-13T05:10:17.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.206 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:17.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.206 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:17.206 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689785+0000", 2024-09-13T05:10:17.206 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.206 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:17.206 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689785+0000", 2024-09-13T05:10:17.206 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.206 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:17.206 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689784+0000", 2024-09-13T05:10:17.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:17.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.207 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:17.207 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689795+0000", 2024-09-13T05:10:17.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1014e-05 2024-09-13T05:10:17.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.207 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:17.207 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689812+0000", 2024-09-13T05:10:17.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6186000000000001e-05 2024-09-13T05:10:17.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.207 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:17.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689826+0000", 2024-09-13T05:10:17.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4003e-05 2024-09-13T05:10:17.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.208 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:17.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701187+0000", 2024-09-13T05:10:17.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.011361509000000001 2024-09-13T05:10:17.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.208 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:17.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701291+0000", 2024-09-13T05:10:17.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010432 2024-09-13T05:10:17.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.209 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:17.209 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701443+0000", 2024-09-13T05:10:17.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00015149599999999999 2024-09-13T05:10:17.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.209 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:17.209 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702218+0000", 2024-09-13T05:10:17.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00077520900000000001 2024-09-13T05:10:17.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.209 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:17.209 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.705010+0000", 2024-09-13T05:10:17.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0027916909999999998 2024-09-13T05:10:17.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.210 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.210 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:17.210 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.705050+0000", 2024-09-13T05:10:17.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0080000000000003e-05 2024-09-13T05:10:17.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.210 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.210 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:17.210 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.705073+0000", 2024-09-13T05:10:17.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3402000000000001e-05 2024-09-13T05:10:17.210 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.210 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:17.210 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.210 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.211 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:17.211 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:54.247728+0000", 2024-09-13T05:10:17.211 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 22.899348923000002, 2024-09-13T05:10:17.211 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010677212, 2024-09-13T05:10:17.211 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:17.211 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:17.211 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:17.211 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:17.211 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:17.211 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 134 2024-09-13T05:10:17.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.211 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:17.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:17.212 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247728+0000", 2024-09-13T05:10:17.212 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.212 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.212 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.212 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:17.212 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247728+0000", 2024-09-13T05:10:17.212 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.212 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.212 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.212 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:17.212 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247727+0000", 2024-09-13T05:10:17.212 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:17.212 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.212 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.213 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:17.213 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247801+0000", 2024-09-13T05:10:17.213 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3881999999999995e-05 2024-09-13T05:10:17.213 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.213 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.213 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:17.213 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247820+0000", 2024-09-13T05:10:17.213 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8709999999999999e-05 2024-09-13T05:10:17.213 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.213 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.213 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:17.213 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247826+0000", 2024-09-13T05:10:17.213 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8109999999999997e-06 2024-09-13T05:10:17.213 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.214 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.214 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:17.214 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.250826+0000", 2024-09-13T05:10:17.214 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002999182 2024-09-13T05:10:17.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.214 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.214 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:17.214 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.250909+0000", 2024-09-13T05:10:17.214 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.3876999999999997e-05 2024-09-13T05:10:17.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.214 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.214 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:17.214 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.251006+0000", 2024-09-13T05:10:17.214 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6100999999999994e-05 2024-09-13T05:10:17.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.215 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:17.215 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.255154+0000", 2024-09-13T05:10:17.215 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0041481060000000004 2024-09-13T05:10:17.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.215 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:17.215 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.258281+0000", 2024-09-13T05:10:17.215 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0031276530000000002 2024-09-13T05:10:17.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.215 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:17.215 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.258345+0000", 2024-09-13T05:10:17.216 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3898000000000004e-05 2024-09-13T05:10:17.216 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.216 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.216 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:17.216 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.258405+0000", 2024-09-13T05:10:17.216 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9626999999999997e-05 2024-09-13T05:10:17.216 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.216 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:17.216 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.216 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.216 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.216 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:17.216 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:54.247851+0000", 2024-09-13T05:10:17.216 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 22.899225096999999, 2024-09-13T05:10:17.217 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010771443, 2024-09-13T05:10:17.217 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:17.217 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:17.217 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:17.217 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:17.217 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:17.217 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 135 2024-09-13T05:10:17.217 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.217 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:17.217 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.217 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:17.217 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247851+0000", 2024-09-13T05:10:17.217 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.217 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.217 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.218 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:17.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247851+0000", 2024-09-13T05:10:17.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.218 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.218 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:17.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247851+0000", 2024-09-13T05:10:17.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:17.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.218 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.218 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:17.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247855+0000", 2024-09-13T05:10:17.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3000000000000003e-06 2024-09-13T05:10:17.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.219 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.219 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:17.219 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247863+0000", 2024-09-13T05:10:17.219 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3599999999999998e-06 2024-09-13T05:10:17.219 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.219 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.219 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:17.219 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247867+0000", 2024-09-13T05:10:17.219 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4059999999999998e-06 2024-09-13T05:10:17.219 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.219 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.219 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:17.219 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.251631+0000", 2024-09-13T05:10:17.219 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0037639240000000001 2024-09-13T05:10:17.219 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.220 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.220 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:17.220 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.251697+0000", 2024-09-13T05:10:17.220 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6330999999999999e-05 2024-09-13T05:10:17.220 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.220 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.220 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:17.220 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.251794+0000", 2024-09-13T05:10:17.220 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6967999999999997e-05 2024-09-13T05:10:17.220 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.220 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.220 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:17.220 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.255160+0000", 2024-09-13T05:10:17.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033660249999999999 2024-09-13T05:10:17.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.221 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:17.221 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.258485+0000", 2024-09-13T05:10:17.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003325106 2024-09-13T05:10:17.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.221 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:17.221 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.258564+0000", 2024-09-13T05:10:17.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8312999999999994e-05 2024-09-13T05:10:17.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.221 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:17.222 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.258623+0000", 2024-09-13T05:10:17.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9200000000000002e-05 2024-09-13T05:10:17.222 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.222 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:17.222 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.222 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.222 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.222 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:17.222 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:54.247871+0000", 2024-09-13T05:10:17.222 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 22.899205132999999, 2024-09-13T05:10:17.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012387007, 2024-09-13T05:10:17.222 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:17.222 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:17.222 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:17.223 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:17.223 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:17.223 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 136 2024-09-13T05:10:17.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.223 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:17.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:17.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247871+0000", 2024-09-13T05:10:17.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:17.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247871+0000", 2024-09-13T05:10:17.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.224 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:17.224 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247871+0000", 2024-09-13T05:10:17.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:17.224 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.224 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:17.224 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247874+0000", 2024-09-13T05:10:17.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1939999999999998e-06 2024-09-13T05:10:17.224 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.224 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:17.224 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247881+0000", 2024-09-13T05:10:17.225 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.348e-06 2024-09-13T05:10:17.225 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.225 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.225 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:17.225 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247885+0000", 2024-09-13T05:10:17.225 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.493e-06 2024-09-13T05:10:17.225 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.225 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.225 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:17.225 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.252194+0000", 2024-09-13T05:10:17.225 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.004309205 2024-09-13T05:10:17.225 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.225 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.225 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:17.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.252288+0000", 2024-09-13T05:10:17.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3493999999999996e-05 2024-09-13T05:10:17.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:17.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.252390+0000", 2024-09-13T05:10:17.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010268900000000001 2024-09-13T05:10:17.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:17.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.257654+0000", 2024-09-13T05:10:17.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0052632629999999998 2024-09-13T05:10:17.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:17.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260190+0000", 2024-09-13T05:10:17.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025365129999999998 2024-09-13T05:10:17.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:17.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260227+0000", 2024-09-13T05:10:17.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6786999999999999e-05 2024-09-13T05:10:17.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:17.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260258+0000", 2024-09-13T05:10:17.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1390999999999998e-05 2024-09-13T05:10:17.227 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.228 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:17.228 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.228 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:17.228 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:54.247889+0000", 2024-09-13T05:10:17.228 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 22.899187291, 2024-09-13T05:10:17.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012593038000000001, 2024-09-13T05:10:17.228 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:17.228 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:17.228 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:17.228 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:17.228 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:17.228 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137 2024-09-13T05:10:17.229 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.229 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:17.229 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.229 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:17.229 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247889+0000", 2024-09-13T05:10:17.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.229 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.229 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.229 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:17.229 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247889+0000", 2024-09-13T05:10:17.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.229 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.229 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:17.230 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247889+0000", 2024-09-13T05:10:17.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:17.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:17.230 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247982+0000", 2024-09-13T05:10:17.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3286000000000001e-05 2024-09-13T05:10:17.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:17.230 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247995+0000", 2024-09-13T05:10:17.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2785e-05 2024-09-13T05:10:17.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:17.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248003+0000", 2024-09-13T05:10:17.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7400000000000004e-06 2024-09-13T05:10:17.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:17.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.252911+0000", 2024-09-13T05:10:17.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0049082259999999999 2024-09-13T05:10:17.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:17.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.252987+0000", 2024-09-13T05:10:17.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5841999999999997e-05 2024-09-13T05:10:17.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.232 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.232 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:17.232 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.253076+0000", 2024-09-13T05:10:17.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8790999999999997e-05 2024-09-13T05:10:17.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.232 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.232 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:17.232 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.257669+0000", 2024-09-13T05:10:17.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0045932810000000003 2024-09-13T05:10:17.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.232 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.232 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:17.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260344+0000", 2024-09-13T05:10:17.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0026755500000000001 2024-09-13T05:10:17.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:17.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260419+0000", 2024-09-13T05:10:17.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.4344999999999994e-05 2024-09-13T05:10:17.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:17.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260482+0000", 2024-09-13T05:10:17.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3571999999999994e-05 2024-09-13T05:10:17.233 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.233 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:17.234 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.234 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.234 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.234 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:17.234 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:54.248017+0000", 2024-09-13T05:10:17.234 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 22.899059822000002, 2024-09-13T05:10:17.234 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012591819000000001, 2024-09-13T05:10:17.234 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:17.234 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:17.234 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:17.234 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:17.234 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:17.234 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 138 2024-09-13T05:10:17.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.235 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:17.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:17.235 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248017+0000", 2024-09-13T05:10:17.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:17.235 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248017+0000", 2024-09-13T05:10:17.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:17.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248016+0000", 2024-09-13T05:10:17.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:17.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:17.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248022+0000", 2024-09-13T05:10:17.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9290000000000003e-06 2024-09-13T05:10:17.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:17.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248032+0000", 2024-09-13T05:10:17.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0067e-05 2024-09-13T05:10:17.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:17.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248039+0000", 2024-09-13T05:10:17.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.131e-06 2024-09-13T05:10:17.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:17.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.253989+0000", 2024-09-13T05:10:17.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.005949953 2024-09-13T05:10:17.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:17.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.254066+0000", 2024-09-13T05:10:17.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6835999999999994e-05 2024-09-13T05:10:17.238 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.238 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.238 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:17.238 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.254173+0000", 2024-09-13T05:10:17.238 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107392 2024-09-13T05:10:17.238 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.238 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.238 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:17.238 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.257699+0000", 2024-09-13T05:10:17.238 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003525622 2024-09-13T05:10:17.238 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.238 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.238 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:17.238 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260545+0000", 2024-09-13T05:10:17.239 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0028464240000000002 2024-09-13T05:10:17.239 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.239 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.239 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:17.239 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260579+0000", 2024-09-13T05:10:17.239 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3559999999999997e-05 2024-09-13T05:10:17.239 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.239 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.239 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:17.239 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260609+0000", 2024-09-13T05:10:17.240 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9773000000000001e-05 2024-09-13T05:10:17.240 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.240 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:17.240 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.240 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.240 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:17.240 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:54.248046+0000", 2024-09-13T05:10:17.240 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 22.899030235000001, 2024-09-13T05:10:17.240 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012766753, 2024-09-13T05:10:17.240 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:17.240 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:17.240 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:17.241 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:17.241 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:17.241 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 139 2024-09-13T05:10:17.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.241 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:17.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:17.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248046+0000", 2024-09-13T05:10:17.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:17.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248046+0000", 2024-09-13T05:10:17.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:17.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248046+0000", 2024-09-13T05:10:17.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:17.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:17.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248051+0000", 2024-09-13T05:10:17.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9060000000000001e-06 2024-09-13T05:10:17.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:17.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248060+0000", 2024-09-13T05:10:17.243 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8799999999999997e-06 2024-09-13T05:10:17.243 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.243 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.243 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:17.243 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248068+0000", 2024-09-13T05:10:17.243 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1880000000000002e-06 2024-09-13T05:10:17.243 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.243 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.243 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:17.243 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.254569+0000", 2024-09-13T05:10:17.243 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0065017749999999996 2024-09-13T05:10:17.243 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.243 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.243 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:17.244 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.254633+0000", 2024-09-13T05:10:17.244 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3781000000000005e-05 2024-09-13T05:10:17.244 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.244 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.244 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:17.244 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.254731+0000", 2024-09-13T05:10:17.244 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8078000000000005e-05 2024-09-13T05:10:17.244 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.244 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.244 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:17.244 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.257720+0000", 2024-09-13T05:10:17.244 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0029886859999999999 2024-09-13T05:10:17.244 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.245 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.245 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:17.245 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260684+0000", 2024-09-13T05:10:17.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0029637999999999999 2024-09-13T05:10:17.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.245 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.245 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:17.245 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260759+0000", 2024-09-13T05:10:17.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.4840999999999997e-05 2024-09-13T05:10:17.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.245 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.245 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:17.245 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260813+0000", 2024-09-13T05:10:17.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4404000000000003e-05 2024-09-13T05:10:17.246 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.246 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:17.246 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.246 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:17.246 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:54.248075+0000", 2024-09-13T05:10:17.246 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 22.899001853000001, 2024-09-13T05:10:17.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012859842999999999, 2024-09-13T05:10:17.246 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:17.246 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:17.246 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:17.246 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:17.247 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:17.247 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 140 2024-09-13T05:10:17.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.247 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:17.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:17.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248075+0000", 2024-09-13T05:10:17.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:17.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248075+0000", 2024-09-13T05:10:17.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.248 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:17.248 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248074+0000", 2024-09-13T05:10:17.248 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:17.248 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.248 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:17.248 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248203+0000", 2024-09-13T05:10:17.248 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012832300000000001 2024-09-13T05:10:17.248 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.248 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:17.248 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248214+0000", 2024-09-13T05:10:17.248 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1472e-05 2024-09-13T05:10:17.249 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.249 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.249 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:17.249 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248223+0000", 2024-09-13T05:10:17.249 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7110000000000001e-06 2024-09-13T05:10:17.249 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.249 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.249 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:17.249 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.255480+0000", 2024-09-13T05:10:17.249 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0072569890000000001 2024-09-13T05:10:17.249 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.249 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.249 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:17.249 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.255544+0000", 2024-09-13T05:10:17.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4790999999999997e-05 2024-09-13T05:10:17.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:17.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.255641+0000", 2024-09-13T05:10:17.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6411999999999998e-05 2024-09-13T05:10:17.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:17.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.258650+0000", 2024-09-13T05:10:17.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003008925 2024-09-13T05:10:17.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:17.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260873+0000", 2024-09-13T05:10:17.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002223334 2024-09-13T05:10:17.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:17.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260907+0000", 2024-09-13T05:10:17.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4267999999999998e-05 2024-09-13T05:10:17.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:17.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260935+0000", 2024-09-13T05:10:17.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7138e-05 2024-09-13T05:10:17.251 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.252 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:17.252 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.252 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.252 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.252 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:17.252 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:54.248235+0000", 2024-09-13T05:10:17.252 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 22.898841289, 2024-09-13T05:10:17.252 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012905777, 2024-09-13T05:10:17.252 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:17.252 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:17.252 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:17.252 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:17.252 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:17.252 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 141 2024-09-13T05:10:17.253 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.253 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:17.253 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.253 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:17.253 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248235+0000", 2024-09-13T05:10:17.253 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.253 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.253 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.253 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:17.253 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248235+0000", 2024-09-13T05:10:17.253 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.253 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.253 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.253 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:17.254 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248234+0000", 2024-09-13T05:10:17.254 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:17.254 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.254 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.254 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:17.254 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248241+0000", 2024-09-13T05:10:17.254 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1229999999999997e-06 2024-09-13T05:10:17.254 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.254 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.254 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:17.254 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248248+0000", 2024-09-13T05:10:17.254 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6690000000000006e-06 2024-09-13T05:10:17.254 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.254 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.255 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:17.255 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248255+0000", 2024-09-13T05:10:17.255 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3040000000000001e-06 2024-09-13T05:10:17.255 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.255 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.255 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:17.255 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.256428+0000", 2024-09-13T05:10:17.255 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.008173909 2024-09-13T05:10:17.255 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.255 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.255 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:17.255 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.256571+0000", 2024-09-13T05:10:17.255 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014262500000000001 2024-09-13T05:10:17.255 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.256 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.256 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:17.256 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.256745+0000", 2024-09-13T05:10:17.256 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017362700000000001 2024-09-13T05:10:17.256 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.256 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.256 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:17.256 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.258854+0000", 2024-09-13T05:10:17.256 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002109695 2024-09-13T05:10:17.256 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.256 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.256 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:17.256 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.261007+0000", 2024-09-13T05:10:17.256 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002152583 2024-09-13T05:10:17.257 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.257 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.257 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:17.257 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.261083+0000", 2024-09-13T05:10:17.257 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6002999999999997e-05 2024-09-13T05:10:17.257 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.257 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.257 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:17.257 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.261141+0000", 2024-09-13T05:10:17.257 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8057000000000003e-05 2024-09-13T05:10:17.257 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.257 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:17.257 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.257 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.258 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.258 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-13T05:10:17.258 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:55.053986+0000", 2024-09-13T05:10:17.258 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 22.093090434, 2024-09-13T05:10:17.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.011038081, 2024-09-13T05:10:17.258 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:17.258 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:17.258 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:17.258 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:17.258 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:17.258 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 158 2024-09-13T05:10:17.258 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.258 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:17.258 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.259 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:17.259 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.053986+0000", 2024-09-13T05:10:17.259 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.259 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:17.259 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.053986+0000", 2024-09-13T05:10:17.259 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.259 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:17.259 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.053985+0000", 2024-09-13T05:10:17.259 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:17.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.260 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:17.260 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054089+0000", 2024-09-13T05:10:17.260 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000103755 2024-09-13T05:10:17.260 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.260 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.260 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:17.260 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054125+0000", 2024-09-13T05:10:17.260 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5831000000000003e-05 2024-09-13T05:10:17.260 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.260 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.260 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:17.260 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054133+0000", 2024-09-13T05:10:17.260 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7139999999999993e-06 2024-09-13T05:10:17.260 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.261 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.261 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:17.261 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.061270+0000", 2024-09-13T05:10:17.261 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0071370490000000003 2024-09-13T05:10:17.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.261 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.261 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:17.261 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.061478+0000", 2024-09-13T05:10:17.261 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020772600000000001 2024-09-13T05:10:17.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.261 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.261 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:17.261 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.061704+0000", 2024-09-13T05:10:17.261 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00022674300000000001 2024-09-13T05:10:17.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.262 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.262 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:17.262 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.064234+0000", 2024-09-13T05:10:17.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025300990000000001 2024-09-13T05:10:17.262 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.262 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.262 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:17.262 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.064930+0000", 2024-09-13T05:10:17.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00069559000000000005 2024-09-13T05:10:17.262 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.262 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.262 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:17.262 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.064989+0000", 2024-09-13T05:10:17.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9240999999999997e-05 2024-09-13T05:10:17.263 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.263 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.263 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:17.263 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.065024+0000", 2024-09-13T05:10:17.263 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4987000000000002e-05 2024-09-13T05:10:17.263 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.263 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:17.263 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.263 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.263 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.263 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-13T05:10:17.263 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:55.054145+0000", 2024-09-13T05:10:17.263 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 22.092931357000001, 2024-09-13T05:10:17.263 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.011611452, 2024-09-13T05:10:17.264 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:17.264 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:17.264 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:17.264 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:17.264 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:17.264 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 159 2024-09-13T05:10:17.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.264 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:17.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:17.264 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054145+0000", 2024-09-13T05:10:17.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.265 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:17.265 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054145+0000", 2024-09-13T05:10:17.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:17.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.265 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:17.265 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054145+0000", 2024-09-13T05:10:17.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:17.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.265 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:17.265 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054154+0000", 2024-09-13T05:10:17.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1619999999999997e-06 2024-09-13T05:10:17.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.266 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:17.266 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054164+0000", 2024-09-13T05:10:17.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8740000000000007e-06 2024-09-13T05:10:17.266 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.266 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:17.266 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054170+0000", 2024-09-13T05:10:17.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3029999999999996e-06 2024-09-13T05:10:17.266 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.266 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:17.266 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.062773+0000", 2024-09-13T05:10:17.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0086030220000000001 2024-09-13T05:10:17.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.267 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.267 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:17.267 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.062998+0000", 2024-09-13T05:10:17.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00022516100000000001 2024-09-13T05:10:17.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.267 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.267 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:17.267 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.063265+0000", 2024-09-13T05:10:17.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00026744300000000002 2024-09-13T05:10:17.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.267 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.267 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:17.267 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.064693+0000", 2024-09-13T05:10:17.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001427537 2024-09-13T05:10:17.268 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.268 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.268 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:17.268 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.065665+0000", 2024-09-13T05:10:17.268 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00097195500000000004 2024-09-13T05:10:17.268 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.268 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.268 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:17.268 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.065725+0000", 2024-09-13T05:10:17.268 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0025000000000002e-05 2024-09-13T05:10:17.268 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:17.268 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:17.268 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:17.268 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.065757+0000", 2024-09-13T05:10:17.269 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1664e-05 2024-09-13T05:10:17.269 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.269 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:17.269 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.269 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:17.269 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:17.269 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:17.270 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:10:17.270 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:10:17.271 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:10:17.272 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:10:17.272 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:10:17.272 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:10:17.272 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:10:17.272 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:10:17.272 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:10:17.272 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:10:17.272 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:10:17.273 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:17.266+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:17.299 INFO:teuthology.orchestra.run.smithi120.stdout:233 punch from 0x174f3d1 to 0x174feb5, (0xae4 bytes) 2024-09-13T05:10:17.308 INFO:teuthology.orchestra.run.smithi120.stdout:234 writesame 0x1918897 thru 0x1919622 data_size 0x11(0xd8c bytes) 2024-09-13T05:10:17.324 INFO:teuthology.orchestra.run.smithi120.stdout:238 punch from 0xa04a63 to 0xa05060, (0x5fd bytes) 2024-09-13T05:10:17.324 INFO:teuthology.orchestra.run.smithi120.stdout:239 read 0x99d584 thru 0x9ac574 (0xeff1 bytes) 2024-09-13T05:10:17.325 INFO:teuthology.orchestra.run.smithi120.stdout:241 read 0x14537e4 thru 0x146034b (0xcb68 bytes) 2024-09-13T05:10:17.346 INFO:teuthology.orchestra.run.smithi120.stdout:244 write 0x4c53282 thru 0x4c553db (0x215a bytes) 2024-09-13T05:10:17.348 INFO:teuthology.orchestra.run.smithi120.stdout:245 read 0x3f605c9 thru 0x3f64414 (0x3e4c bytes) 2024-09-13T05:10:17.348 INFO:teuthology.orchestra.run.smithi120.stdout:246 read 0x4339763 thru 0x4344be8 (0xb486 bytes) 2024-09-13T05:10:17.348 INFO:teuthology.orchestra.run.smithi120.stdout:247 read 0x949485 thru 0x956787 (0xd303 bytes) 2024-09-13T05:10:17.349 INFO:teuthology.orchestra.run.smithi120.stdout:249 read 0x1836e95 thru 0x1843d44 (0xceb0 bytes) 2024-09-13T05:10:17.350 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:17.350 INFO:teuthology.orchestra.run.smithi120.stdout:252 read 0x12fd411 thru 0x12feceb (0x18db bytes) 2024-09-13T05:10:17.351 INFO:teuthology.orchestra.run.smithi120.stdout:253 punch from 0x2415dfc to 0x2418ca4, (0x2ea8 bytes) 2024-09-13T05:10:17.371 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:17.366+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:17.373 INFO:teuthology.orchestra.run.smithi120.stdout:254 writesame 0x79b27df thru 0x79b8f08 data_size 0x26(0x672a bytes) 2024-09-13T05:10:17.388 INFO:teuthology.orchestra.run.smithi120.stdout:255 write 0x8785101 thru 0x8792f6d (0xde6d bytes) 2024-09-13T05:10:17.415 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:17.415 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:17.416 INFO:teuthology.orchestra.run.smithi120.stdout:256 writesame 0xe2e1ba9 thru 0xe2e2b86 data_size 0x3(0xfde bytes) 2024-09-13T05:10:17.416 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:17.417 INFO:teuthology.orchestra.run.smithi120.stdout:258 writesame 0xa3b634b thru 0xa3c3701 data_size 0x1(0xd3b7 bytes) 2024-09-13T05:10:17.425 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:10:17.450 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:17.451 INFO:teuthology.orchestra.run.smithi120.stdout:260 write 0xcf56eb8 thru 0xcf65b67 (0xecb0 bytes) 2024-09-13T05:10:17.453 INFO:teuthology.orchestra.run.smithi120.stdout:261 read 0x6ca648c thru 0x6ca8179 (0x1cee bytes) 2024-09-13T05:10:17.454 INFO:teuthology.orchestra.run.smithi120.stdout:266 punch from 0x59da03c to 0x59e1a9d, (0x7a61 bytes) 2024-09-13T05:10:17.454 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:17.454 INFO:teuthology.orchestra.run.smithi120.stdout:270 write 0xdf871b5 thru 0xdf8d80c (0x6658 bytes) 2024-09-13T05:10:17.457 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:17.457 INFO:teuthology.orchestra.run.smithi120.stdout:272 read 0xd2c0cde thru 0xd2c43e2 (0x3705 bytes) 2024-09-13T05:10:17.467 INFO:teuthology.orchestra.run.smithi120.stdout:274 writesame 0xeb32c7e thru 0xeb3c79c data_size 0x5d(0x9b1f bytes) 2024-09-13T05:10:17.470 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:17.470 INFO:teuthology.orchestra.run.smithi120.stdout:277 write 0x55c06d3 thru 0x55c1f2f (0x185d bytes) 2024-09-13T05:10:17.472 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:17.467+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:17.480 INFO:teuthology.orchestra.run.smithi120.stdout:278 trunc from 0xeb3c79d to 0xae15ad7 2024-09-13T05:10:17.492 INFO:teuthology.orchestra.run.smithi120.stdout:279 punch from 0x4ee5476 to 0x4ee788c, (0x2416 bytes) 2024-09-13T05:10:17.506 INFO:teuthology.orchestra.run.smithi120.stdout:280 write 0xcd9a17a thru 0xcda2a21 (0x88a8 bytes) 2024-09-13T05:10:17.517 INFO:teuthology.orchestra.run.smithi120.stdout:281 read 0xb581035 thru 0xb587287 (0x6253 bytes) 2024-09-13T05:10:17.518 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:17.518 INFO:teuthology.orchestra.run.smithi120.stdout:283 write 0x4d21348 thru 0x4d25607 (0x42c0 bytes) 2024-09-13T05:10:17.521 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:17.534 INFO:teuthology.orchestra.run.smithi120.stdout:285 writesame 0xe12251b thru 0xe123bf1 data_size 0x1(0x16d7 bytes) 2024-09-13T05:10:17.536 INFO:teuthology.orchestra.run.smithi120.stdout:286 writesame 0xb7cd66f thru 0xb7d83f9 data_size 0x3b(0xad8b bytes) 2024-09-13T05:10:17.540 INFO:teuthology.orchestra.run.smithi120.stdout:287 writesame 0x472d595 thru 0x473d203 data_size 0xd(0xfc6f bytes) 2024-09-13T05:10:17.556 INFO:teuthology.orchestra.run.smithi120.stdout:288 punch from 0x95fbab3 to 0x96076ec, (0xbc39 bytes) 2024-09-13T05:10:17.556 INFO:teuthology.orchestra.run.smithi120.stdout:289 read 0xd2a1f14 thru 0xd2a4871 (0x295e bytes) 2024-09-13T05:10:17.556 INFO:teuthology.orchestra.run.smithi120.stdout:290 read 0xd7c450 thru 0xd89ecc (0xda7d bytes) 2024-09-13T05:10:17.558 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:17.559 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:17.572 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:10:17.574 INFO:teuthology.orchestra.run.smithi120.stdout:291 trunc from 0xe123bf2 to 0x32bf9ce 2024-09-13T05:10:17.574 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:17.571+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:17.599 INFO:teuthology.orchestra.run.smithi120.stdout:292 punch from 0x17c060d to 0x17c36c2, (0x30b5 bytes) 2024-09-13T05:10:17.599 INFO:teuthology.orchestra.run.smithi120.stdout:294 read 0xf6eff3 thru 0xf7463c (0x564a bytes) 2024-09-13T05:10:17.600 INFO:teuthology.orchestra.run.smithi120.stdout:296 trunc from 0x32bf9ce to 0x351470c 2024-09-13T05:10:17.639 INFO:teuthology.orchestra.run.smithi120.stdout:297 write 0xdc24629 thru 0xdc302e7 (0xbcbf bytes) 2024-09-13T05:10:17.645 INFO:teuthology.orchestra.run.smithi120.stdout:300 read 0x303e4a1 thru 0x3045a53 (0x75b3 bytes) 2024-09-13T05:10:17.661 INFO:teuthology.orchestra.run.smithi120.stdout:301 trunc from 0xdc302e8 to 0x575b534 2024-09-13T05:10:17.674 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:17.671+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:17.684 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:17.684 INFO:teuthology.orchestra.run.smithi120.stdout:303 write 0x4f353a3 thru 0x4f433af (0xe00d bytes) 2024-09-13T05:10:17.687 INFO:teuthology.orchestra.run.smithi120.stdout:304 punch from 0x1291e08 to 0x1299e00, (0x7ff8 bytes) 2024-09-13T05:10:17.688 INFO:teuthology.orchestra.run.smithi120.stdout:305 read 0x99583b thru 0x99c379 (0x6b3f bytes) 2024-09-13T05:10:17.689 INFO:teuthology.orchestra.run.smithi120.stdout:306 writesame 0x3993d0c thru 0x399eed8 data_size 0x1(0xb1cd bytes) 2024-09-13T05:10:17.696 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is unset 2024-09-13T05:10:17.714 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:17.714 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:17.724 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:10:17.727 INFO:teuthology.orchestra.run.smithi120.stdout:308 read 0x28d6c2c thru 0x28e1986 (0xad5b bytes) 2024-09-13T05:10:17.728 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:17.732 INFO:teuthology.orchestra.run.smithi120.stdout:311 trunc from 0x575b534 to 0x32002e6 2024-09-13T05:10:17.772 INFO:teuthology.orchestra.run.smithi120.stdout:313 write 0xc5e7f13 thru 0xc5e99f4 (0x1ae2 bytes) 2024-09-13T05:10:17.774 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:17.771+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:17.779 INFO:teuthology.orchestra.run.smithi120.stdout:315 write 0x82814e thru 0x82a4ac (0x235f bytes) 2024-09-13T05:10:17.782 INFO:teuthology.orchestra.run.smithi120.stdout:316 trunc from 0xc5e99f5 to 0xbd0981f 2024-09-13T05:10:17.796 INFO:teuthology.orchestra.run.smithi120.stdout:318 read 0x97632fe thru 0x9765977 (0x267a bytes) 2024-09-13T05:10:17.796 INFO:teuthology.orchestra.run.smithi120.stdout:319 punch from 0x72092f3 to 0x72100a4, (0x6db1 bytes) 2024-09-13T05:10:17.796 INFO:teuthology.orchestra.run.smithi120.stdout:321 punch from 0x64ced6e to 0x64dab63, (0xbdf5 bytes) 2024-09-13T05:10:17.796 INFO:teuthology.orchestra.run.smithi120.stdout:322 writesame 0x68f8aea thru 0x6906eb4 data_size 0x6b(0xe3cb bytes) 2024-09-13T05:10:17.799 INFO:teuthology.orchestra.run.smithi120.stdout:323 read 0x5d7c3a5 thru 0x5d80760 (0x43bc bytes) 2024-09-13T05:10:17.809 INFO:teuthology.orchestra.run.smithi120.stdout:324 trunc from 0xbd0981f to 0x814a491 2024-09-13T05:10:17.824 INFO:teuthology.orchestra.run.smithi120.stdout:326 read 0x58e5e35 thru 0x58f4323 (0xe4ef bytes) 2024-09-13T05:10:17.825 INFO:teuthology.orchestra.run.smithi120.stdout:327 read 0x5d2b4e1 thru 0x5d35e4b (0xa96b bytes) 2024-09-13T05:10:17.825 INFO:teuthology.orchestra.run.smithi120.stdout:328 punch from 0x4525b7 to 0x45648a, (0x3ed3 bytes) 2024-09-13T05:10:17.837 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:17.838 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:17.838 INFO:teuthology.orchestra.run.smithi120.stdout:329 writesame 0x8cc6448 thru 0x8cccceb data_size 0x4a(0x68a4 bytes) 2024-09-13T05:10:17.838 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:17.850 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:10:17.853 INFO:teuthology.orchestra.run.smithi120.stdout:331 write 0xa25eaa7 thru 0xa264209 (0x5763 bytes) 2024-09-13T05:10:17.875 INFO:teuthology.orchestra.run.smithi120.stdout:334 write 0xcd572a7 thru 0xcd67060 (0xfdba bytes) 2024-09-13T05:10:17.876 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:17.871+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:17.880 INFO:teuthology.orchestra.run.smithi120.stdout:335 trunc from 0xcd67061 to 0xd51327f 2024-09-13T05:10:17.890 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:17.890 INFO:teuthology.orchestra.run.smithi120.stdout:338 write 0x40defa thru 0x412b05 (0x4c0c bytes) 2024-09-13T05:10:17.893 INFO:teuthology.orchestra.run.smithi120.stdout:339 write 0xac1ed5f thru 0xac2034e (0x15f0 bytes) 2024-09-13T05:10:17.900 INFO:teuthology.orchestra.run.smithi120.stdout:340 write 0x151096e thru 0x151a2a6 (0x9939 bytes) 2024-09-13T05:10:17.904 INFO:teuthology.orchestra.run.smithi120.stdout:341 read 0x721d3c3 thru 0x721e91a (0x1558 bytes) 2024-09-13T05:10:17.904 INFO:teuthology.orchestra.run.smithi120.stdout:342 read 0xbd19eff thru 0xbd20830 (0x6932 bytes) 2024-09-13T05:10:17.919 INFO:teuthology.orchestra.run.smithi120.stdout:343 trunc from 0xd51327f to 0x59860fd 2024-09-13T05:10:17.964 INFO:teuthology.orchestra.run.smithi120.stdout:344 write 0xcd43384 thru 0xcd50959 (0xd5d6 bytes) 2024-09-13T05:10:17.967 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:17.968 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:17.971 INFO:teuthology.orchestra.run.smithi120.stdout:345 writesame 0x9e7d106 thru 0x9e7f0e8 data_size 0x3(0x1fe3 bytes) 2024-09-13T05:10:17.976 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:17.970+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:17.978 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:10:17.980 INFO:teuthology.orchestra.run.smithi120.stdout:346 read 0x2ad00b9 thru 0x2ad66a2 (0x65ea bytes) 2024-09-13T05:10:17.981 INFO:teuthology.orchestra.run.smithi120.stdout:347 write 0xc8b2427 thru 0xc8b56d2 (0x32ac bytes) 2024-09-13T05:10:17.987 INFO:teuthology.orchestra.run.smithi120.stdout:348 write 0x1544314 thru 0x155419d (0xfe8a bytes) 2024-09-13T05:10:18.002 INFO:teuthology.orchestra.run.smithi120.stdout:349 write 0xcd57733 thru 0xcd5f3ff (0x7ccd bytes) 2024-09-13T05:10:18.005 INFO:teuthology.orchestra.run.smithi120.stdout:351 punch from 0x286d093 to 0x287c72e, (0xf69b bytes) 2024-09-13T05:10:18.005 INFO:teuthology.orchestra.run.smithi120.stdout:352 read 0x91510b thru 0x9244cd (0xf3c3 bytes) 2024-09-13T05:10:18.020 INFO:teuthology.orchestra.run.smithi120.stdout:353 writesame 0xe9b195a thru 0xe9bc3d3 data_size 0x1(0xaa7a bytes) 2024-09-13T05:10:18.023 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:18.023 INFO:teuthology.orchestra.run.smithi120.stdout:357 writesame 0xd13f955 thru 0xd1443e3 data_size 0x1(0x4a8f bytes) 2024-09-13T05:10:18.045 INFO:teuthology.orchestra.run.smithi120.stdout:358 read 0xd1721d8 thru 0xd17a057 (0x7e80 bytes) 2024-09-13T05:10:18.046 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:18.065 INFO:teuthology.orchestra.run.smithi120.stdout:360 trunc from 0xe9bc3d4 to 0x3c6fab4 2024-09-13T05:10:18.077 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:18.070+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:18.091 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:18.091 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:18.102 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:10:18.103 INFO:teuthology.orchestra.run.smithi120.stdout:361 write 0x642f005 thru 0x6434ee8 (0x5ee4 bytes) 2024-09-13T05:10:18.114 INFO:teuthology.orchestra.run.smithi120.stdout:362 trunc from 0x6434ee9 to 0xc1c3f0 2024-09-13T05:10:18.151 INFO:teuthology.orchestra.run.smithi120.stdout:363 write 0x852123d thru 0x85251a5 (0x3f69 bytes) 2024-09-13T05:10:18.158 INFO:teuthology.orchestra.run.smithi120.stdout:364 read 0x4c2c201 thru 0x4c39701 (0xd501 bytes) 2024-09-13T05:10:18.159 INFO:teuthology.orchestra.run.smithi120.stdout:365 read 0x1bcf022 thru 0x1bd2aa2 (0x3a81 bytes) 2024-09-13T05:10:18.177 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:18.174+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:18.178 INFO:teuthology.orchestra.run.smithi120.stdout:367 write 0xd810d07 thru 0xd81312c (0x2426 bytes) 2024-09-13T05:10:18.188 INFO:teuthology.orchestra.run.smithi120.stdout:368 write 0x14cc9d1 thru 0x14d9536 (0xcb66 bytes) 2024-09-13T05:10:18.192 INFO:teuthology.orchestra.run.smithi120.stdout:369 trunc from 0xd81312d to 0xd1bfa86 2024-09-13T05:10:18.220 INFO:teuthology.orchestra.run.smithi120.stdout:372 write 0xec91fc3 thru 0xec9da44 (0xba82 bytes) 2024-09-13T05:10:18.222 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:18.222 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:18.223 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:18.223 INFO:teuthology.orchestra.run.smithi120.stdout:374 write 0xb73c7b9 thru 0xb746ad6 (0xa31e bytes) 2024-09-13T05:10:18.231 INFO:teuthology.orchestra.run.smithi120.stdout:375 read 0xdc85005 thru 0xdc904b3 (0xb4af bytes) 2024-09-13T05:10:18.233 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:10:18.233 INFO:teuthology.orchestra.run.smithi120.stdout:truncating to largest ever: 0xe10a56a 2024-09-13T05:10:18.234 INFO:teuthology.orchestra.run.smithi120.stdout:376 trunc from 0xec9da45 to 0xe10a56a 2024-09-13T05:10:18.247 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:18.248 INFO:teuthology.orchestra.run.smithi120.stdout:378 write 0x589ba05 thru 0x58a5e2a (0xa426 bytes) 2024-09-13T05:10:18.251 INFO:teuthology.orchestra.run.smithi120.stdout:379 punch from 0x5d7ece9 to 0x5d8b265, (0xc57c bytes) 2024-09-13T05:10:18.251 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:18.251 INFO:teuthology.orchestra.run.smithi120.stdout:381 writesame 0xcfb929e thru 0xcfbd6b2 data_size 0x1(0x4415 bytes) 2024-09-13T05:10:18.266 INFO:teuthology.orchestra.run.smithi120.stdout:383 write 0x65bc753 thru 0x65c64be (0x9d6c bytes) 2024-09-13T05:10:18.270 INFO:teuthology.orchestra.run.smithi120.stdout:385 punch from 0xc970c5d to 0xc971c1e, (0xfc1 bytes) 2024-09-13T05:10:18.270 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:18.271 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:18.271 INFO:teuthology.orchestra.run.smithi120.stdout:393 write 0x115f51 thru 0x11c801 (0x68b1 bytes) 2024-09-13T05:10:18.273 INFO:teuthology.orchestra.run.smithi120.stdout:394 read 0x8190b01 thru 0x8194a28 (0x3f28 bytes) 2024-09-13T05:10:18.274 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:18.274 INFO:teuthology.orchestra.run.smithi120.stdout:398 read 0xabe05d thru 0xac4269 (0x620d bytes) 2024-09-13T05:10:18.279 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:18.274+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:18.294 INFO:teuthology.orchestra.run.smithi120.stdout:399 trunc from 0xe10a56a to 0x1c4ddab 2024-09-13T05:10:18.318 INFO:teuthology.orchestra.run.smithi120.stdout:400 read 0x7c1066 thru 0x7cb431 (0xa3cc bytes) 2024-09-13T05:10:18.318 INFO:teuthology.orchestra.run.smithi120.stdout:401 read 0xc2dc83 thru 0xc331fb (0x5579 bytes) 2024-09-13T05:10:18.319 INFO:teuthology.orchestra.run.smithi120.stdout:402 read 0x2cb416 thru 0x2d4228 (0x8e13 bytes) 2024-09-13T05:10:18.319 INFO:teuthology.orchestra.run.smithi120.stdout:403 read 0x174c0f3 thru 0x1755a05 (0x9913 bytes) 2024-09-13T05:10:18.323 INFO:teuthology.orchestra.run.smithi120.stdout:404 trunc from 0x1c4ddab to 0x343e826 2024-09-13T05:10:18.343 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:18.344 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:18.345 INFO:teuthology.orchestra.run.smithi120.stdout:405 trunc from 0x343e826 to 0xaf7e05d 2024-09-13T05:10:18.354 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:10:18.370 INFO:teuthology.orchestra.run.smithi120.stdout:406 write 0xe447023 thru 0xe449622 (0x2600 bytes) 2024-09-13T05:10:18.377 INFO:teuthology.orchestra.run.smithi120.stdout:407 read 0x7f7bade thru 0x7f8a924 (0xee47 bytes) 2024-09-13T05:10:18.377 INFO:teuthology.orchestra.run.smithi120.stdout:408 read 0x5ab22e2 thru 0x5abd58e (0xb2ad bytes) 2024-09-13T05:10:18.378 INFO:teuthology.orchestra.run.smithi120.stdout:409 write 0x61b8915 thru 0x61c3372 (0xaa5e bytes) 2024-09-13T05:10:18.380 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:18.374+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:18.381 INFO:teuthology.orchestra.run.smithi120.stdout:410 read 0x7c5b568 thru 0x7c6829e (0xcd37 bytes) 2024-09-13T05:10:18.382 INFO:teuthology.orchestra.run.smithi120.stdout:412 punch from 0x7a95f4c to 0x7aa185d, (0xb911 bytes) 2024-09-13T05:10:18.382 INFO:teuthology.orchestra.run.smithi120.stdout:414 punch from 0xa9c55ad to 0xa9d39d7, (0xe42a bytes) 2024-09-13T05:10:18.382 INFO:teuthology.orchestra.run.smithi120.stdout:415 writesame 0xdb6f953 thru 0xdb7d368 data_size 0xa(0xda16 bytes) 2024-09-13T05:10:18.392 INFO:teuthology.orchestra.run.smithi120.stdout:417 writesame 0x4899970 thru 0x48a58c3 data_size 0x7c(0xbf54 bytes) 2024-09-13T05:10:18.394 INFO:teuthology.orchestra.run.smithi120.stdout:418 read 0x10bbce1 thru 0x10c533a (0x965a bytes) 2024-09-13T05:10:18.395 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:18.395 INFO:teuthology.orchestra.run.smithi120.stdout:420 punch from 0x4766331 to 0x4768862, (0x2531 bytes) 2024-09-13T05:10:18.395 INFO:teuthology.orchestra.run.smithi120.stdout:423 punch from 0xb0fc666 to 0xb101b7a, (0x5514 bytes) 2024-09-13T05:10:18.395 INFO:teuthology.orchestra.run.smithi120.stdout:424 read 0xe88e96 thru 0xe9419f (0xb30a bytes) 2024-09-13T05:10:18.395 INFO:teuthology.orchestra.run.smithi120.stdout:425 write 0xe2d86b8 thru 0xe2e4014 (0xb95d bytes) 2024-09-13T05:10:18.403 INFO:teuthology.orchestra.run.smithi120.stdout:427 punch from 0x97f449 to 0x98eacc, (0xf683 bytes) 2024-09-13T05:10:18.403 INFO:teuthology.orchestra.run.smithi120.stdout:428 writesame 0xad51f25 thru 0xad60815 data_size 0x7(0xe8f1 bytes) 2024-09-13T05:10:18.417 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:18.417 INFO:teuthology.orchestra.run.smithi120.stdout:431 punch from 0xb4ca43 to 0xb4fe1d, (0x33da bytes) 2024-09-13T05:10:18.418 INFO:teuthology.orchestra.run.smithi120.stdout:432 writesame 0x45fd915 thru 0x4607c81 data_size 0x17(0xa36d bytes) 2024-09-13T05:10:18.421 INFO:teuthology.orchestra.run.smithi120.stdout:433 punch from 0x8d30667 to 0x8d3d219, (0xcbb2 bytes) 2024-09-13T05:10:18.422 INFO:teuthology.orchestra.run.smithi120.stdout:434 trunc from 0xe449623 to 0xdfc1d36 2024-09-13T05:10:18.440 INFO:teuthology.orchestra.run.smithi120.stdout:435 write 0xb0803b2 thru 0xb087b66 (0x77b5 bytes) 2024-09-13T05:10:18.443 INFO:teuthology.orchestra.run.smithi120.stdout:436 punch from 0x48d4600 to 0x48d5ae9, (0x14e9 bytes) 2024-09-13T05:10:18.443 INFO:teuthology.orchestra.run.smithi120.stdout:437 write 0xce6b160 thru 0xce6f75a (0x45fb bytes) 2024-09-13T05:10:18.445 INFO:teuthology.orchestra.run.smithi120.stdout:440 read 0x5bbc55b thru 0x5bcb160 (0xec06 bytes) 2024-09-13T05:10:18.446 INFO:teuthology.orchestra.run.smithi120.stdout:441 write 0xa175868 thru 0xa17aadb (0x5274 bytes) 2024-09-13T05:10:18.450 INFO:teuthology.orchestra.run.smithi120.stdout:442 punch from 0x30b2b2d to 0x30c1d62, (0xf235 bytes) 2024-09-13T05:10:18.450 INFO:teuthology.orchestra.run.smithi120.stdout:443 write 0x995ff64 thru 0x996ec60 (0xecfd bytes) 2024-09-13T05:10:18.453 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:18.455 INFO:teuthology.orchestra.run.smithi120.stdout:445 trunc from 0xdfc1d36 to 0xd34245b 2024-09-13T05:10:18.471 INFO:teuthology.orchestra.run.smithi120.stdout:446 read 0x518192 thru 0x51f131 (0x6fa0 bytes) 2024-09-13T05:10:18.471 INFO:teuthology.orchestra.run.smithi120.stdout:447 write 0x3bdc45b thru 0x3be73c9 (0xaf6f bytes) 2024-09-13T05:10:18.481 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:18.479+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:18.488 INFO:teuthology.orchestra.run.smithi120.stdout:448 trunc from 0xd34245b to 0x5cb66f7 2024-09-13T05:10:18.491 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:18.491 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:18.502 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:10:18.516 INFO:teuthology.orchestra.run.smithi120.stdout:450 read 0x5b18cf4 thru 0x5b2328d (0xa59a bytes) 2024-09-13T05:10:18.516 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:18.517 INFO:teuthology.orchestra.run.smithi120.stdout:452 punch from 0x14cbf49 to 0x14d4528, (0x85df bytes) 2024-09-13T05:10:18.517 INFO:teuthology.orchestra.run.smithi120.stdout:453 read 0x51980bb thru 0x51a366f (0xb5b5 bytes) 2024-09-13T05:10:18.517 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:18.517 INFO:teuthology.orchestra.run.smithi120.stdout:456 read 0x234f96a thru 0x2357dd7 (0x846e bytes) 2024-09-13T05:10:18.518 INFO:teuthology.orchestra.run.smithi120.stdout:457 read 0x55da2a7 thru 0x55e6556 (0xc2b0 bytes) 2024-09-13T05:10:18.518 INFO:teuthology.orchestra.run.smithi120.stdout:458 punch from 0x7dd7ca to 0x7e0b27, (0x335d bytes) 2024-09-13T05:10:18.518 INFO:teuthology.orchestra.run.smithi120.stdout:459 read 0x327251b thru 0x3276178 (0x3c5e bytes) 2024-09-13T05:10:18.529 INFO:teuthology.orchestra.run.smithi120.stdout:460 trunc from 0x5cb66f7 to 0xb599ade 2024-09-13T05:10:18.540 INFO:teuthology.orchestra.run.smithi120.stdout:461 read 0x814a173 thru 0x814e042 (0x3ed0 bytes) 2024-09-13T05:10:18.540 INFO:teuthology.orchestra.run.smithi120.stdout:463 read 0xadb03e thru 0xae3d2b (0x8cee bytes) 2024-09-13T05:10:18.556 INFO:teuthology.orchestra.run.smithi120.stdout:464 writesame 0xd2c3c27 thru 0xd2d08e4 data_size 0x2(0xccbe bytes) 2024-09-13T05:10:18.556 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:18.556 INFO:teuthology.orchestra.run.smithi120.stdout:466 write 0x37636b6 thru 0x3767540 (0x3e8b bytes) 2024-09-13T05:10:18.559 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:18.574 INFO:teuthology.orchestra.run.smithi120.stdout:469 trunc from 0xd2d08e5 to 0x54acb9b 2024-09-13T05:10:18.581 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:18.578+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:18.591 INFO:teuthology.orchestra.run.smithi120.stdout:471 write 0x25c3d69 thru 0x25ca04c (0x62e4 bytes) 2024-09-13T05:10:18.594 INFO:teuthology.orchestra.run.smithi120.stdout:472 punch from 0x2be0bef to 0x2be2d02, (0x2113 bytes) 2024-09-13T05:10:18.594 INFO:teuthology.orchestra.run.smithi120.stdout:473 read 0x4f7fb76 thru 0x4f889ca (0x8e55 bytes) 2024-09-13T05:10:18.595 INFO:teuthology.orchestra.run.smithi120.stdout:474 punch from 0x3ea3050 to 0x3eadb28, (0xaad8 bytes) 2024-09-13T05:10:18.622 INFO:teuthology.orchestra.run.smithi120.stdout:475 write 0xde9bc6b thru 0xde9c8fe (0xc94 bytes) 2024-09-13T05:10:18.628 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:18.632 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:18.632 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:18.635 INFO:teuthology.orchestra.run.smithi120.stdout:477 trunc from 0xde9c8ff to 0x9fc1a29 2024-09-13T05:10:18.644 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:10:18.649 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:18.649 INFO:teuthology.orchestra.run.smithi120.stdout:482 read 0x35f85a1 thru 0x35fc2b2 (0x3d12 bytes) 2024-09-13T05:10:18.650 INFO:teuthology.orchestra.run.smithi120.stdout:483 read 0x8703189 thru 0x8704591 (0x1409 bytes) 2024-09-13T05:10:18.650 INFO:teuthology.orchestra.run.smithi120.stdout:484 writesame 0x7e44256 thru 0x7e4a493 data_size 0x19(0x623e bytes) 2024-09-13T05:10:18.656 INFO:teuthology.orchestra.run.smithi120.stdout:485 trunc from 0x9fc1a29 to 0x8b20303 2024-09-13T05:10:18.669 INFO:teuthology.orchestra.run.smithi120.stdout:486 write 0xbf36d thru 0xcd63b (0xe2cf bytes) 2024-09-13T05:10:18.671 INFO:teuthology.orchestra.run.smithi120.stdout:487 write 0x5eb3957 thru 0x5eb4778 (0xe22 bytes) 2024-09-13T05:10:18.674 INFO:teuthology.orchestra.run.smithi120.stdout:488 writesame 0x2472050 thru 0x2476cc1 data_size 0x5f(0x4c72 bytes) 2024-09-13T05:10:18.677 INFO:teuthology.orchestra.run.smithi120.stdout:490 read 0x878f37f thru 0x879c86a (0xd4ec bytes) 2024-09-13T05:10:18.677 INFO:teuthology.orchestra.run.smithi120.stdout:491 write 0x16e1ef3 thru 0x16e66d0 (0x47de bytes) 2024-09-13T05:10:18.681 INFO:teuthology.orchestra.run.smithi120.stdout:492 write 0x4df340b thru 0x4dfefd8 (0xbbce bytes) 2024-09-13T05:10:18.682 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:18.679+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:18.691 INFO:teuthology.orchestra.run.smithi120.stdout:493 trunc from 0x8b20303 to 0xbcdb670 2024-09-13T05:10:18.715 INFO:teuthology.orchestra.run.smithi120.stdout:494 write 0xc867629 thru 0xc870f70 (0x9948 bytes) 2024-09-13T05:10:18.721 INFO:teuthology.orchestra.run.smithi120.stdout:495 writesame 0x5b87c3f thru 0x5b96b24 data_size 0x3(0xeee6 bytes) 2024-09-13T05:10:18.739 INFO:teuthology.orchestra.run.smithi120.stdout:497 punch from 0x8dde03d to 0x8de8630, (0xa5f3 bytes) 2024-09-13T05:10:18.739 INFO:teuthology.orchestra.run.smithi120.stdout:498 read 0x68a547a thru 0x68a9b8d (0x4714 bytes) 2024-09-13T05:10:18.739 INFO:teuthology.orchestra.run.smithi120.stdout:499 read 0xc2a6674 thru 0xc2a88d2 (0x225f bytes) 2024-09-13T05:10:18.740 INFO:teuthology.orchestra.run.smithi120.stdout:500 write 0xb02d765 thru 0xb031cc2 (0x455e bytes) 2024-09-13T05:10:18.743 INFO:teuthology.orchestra.run.smithi120.stdout:502 clone 3 order 19 su 65536 sc 8 2024-09-13T05:10:18.758 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:18.758 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:18.768 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:10:18.809 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:18.806+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:18.884 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:18.879+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:18.915 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:18.915 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:18.925 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:10:18.985 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:18.978+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:19.042 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:19.042 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:19.052 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:10:19.085 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:19.082+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:19.160 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:19.160 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:19.169 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:10:19.185 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:19.183+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:19.274 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:10:19.276 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:19.276 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:19.286 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:10:19.287 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:19.283+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:19.388 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:19.383+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:19.388 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:19.389 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:19.398 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:10:19.431 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:10:19.451 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:10:19.468 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:10:19.486 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:10:19.488 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:19.482+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:19.511 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:10:19.534 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:10:19.554 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:19.554 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:19.555 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:19.555 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:19.555 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:19.555 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:10:19.564 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:10:19.578 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:10:19.581 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:10:19.581 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:10:19.581 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:10:19.581 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:10:19.581 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:10:19.581 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:10:19.581 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:10:19.581 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:10:19.588 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:19.582+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:19.673 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:19.673 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:19.673 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:19.673 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:10:19.673 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.673 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4275.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T05:10:19.674 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:59.369854+0000", 2024-09-13T05:10:19.674 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 20.299384734, 2024-09-13T05:10:19.674 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.007257538, 2024-09-13T05:10:19.674 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:19.674 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:19.674 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:19.674 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4275", 2024-09-13T05:10:19.674 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/2023483490", 2024-09-13T05:10:19.674 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 1 2024-09-13T05:10:19.674 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.674 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:19.675 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.675 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:19.675 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.369854+0000", 2024-09-13T05:10:19.675 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.675 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.675 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.675 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:19.675 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.369854+0000", 2024-09-13T05:10:19.675 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.675 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.675 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.675 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:19.675 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.369853+0000", 2024-09-13T05:10:19.676 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:19.676 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.676 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.676 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:19.676 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.369862+0000", 2024-09-13T05:10:19.676 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.533e-06 2024-09-13T05:10:19.676 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.676 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.676 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:19.676 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.369872+0000", 2024-09-13T05:10:19.676 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9210000000000004e-06 2024-09-13T05:10:19.676 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.676 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.677 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:19.677 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.369896+0000", 2024-09-13T05:10:19.677 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4187999999999999e-05 2024-09-13T05:10:19.677 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.677 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.677 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:19.677 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.370111+0000", 2024-09-13T05:10:19.677 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000214983 2024-09-13T05:10:19.677 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.677 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.677 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:19.677 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.370165+0000", 2024-09-13T05:10:19.677 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3699999999999997e-05 2024-09-13T05:10:19.678 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.678 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:19.678 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.372317+0000", 2024-09-13T05:10:19.678 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021521629999999999 2024-09-13T05:10:19.678 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.678 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:19.678 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.372516+0000", 2024-09-13T05:10:19.678 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00019910800000000001 2024-09-13T05:10:19.678 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.678 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 2", 2024-09-13T05:10:19.678 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.372694+0000", 2024-09-13T05:10:19.679 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000177641 2024-09-13T05:10:19.679 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.679 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.679 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:19.679 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.373640+0000", 2024-09-13T05:10:19.679 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00094634799999999996 2024-09-13T05:10:19.679 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.679 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.679 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:19.679 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.377029+0000", 2024-09-13T05:10:19.679 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033891730000000001 2024-09-13T05:10:19.679 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.679 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.680 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:19.680 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.377080+0000", 2024-09-13T05:10:19.680 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0531000000000001e-05 2024-09-13T05:10:19.680 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.680 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.680 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:19.680 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:59.377111+0000", 2024-09-13T05:10:19.680 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1594000000000003e-05 2024-09-13T05:10:19.680 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.680 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:19.680 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.680 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.680 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.680 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4275.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-13T05:10:19.681 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:00.379251+0000", 2024-09-13T05:10:19.681 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.289987569000001, 2024-09-13T05:10:19.681 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0059671969999999996, 2024-09-13T05:10:19.681 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:19.681 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:19.681 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:19.681 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4275", 2024-09-13T05:10:19.681 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/2023483490", 2024-09-13T05:10:19.681 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 5 2024-09-13T05:10:19.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.681 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:19.681 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:19.682 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.379251+0000", 2024-09-13T05:10:19.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.682 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:19.682 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.379251+0000", 2024-09-13T05:10:19.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.682 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:19.682 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.379248+0000", 2024-09-13T05:10:19.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999967 2024-09-13T05:10:19.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.683 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.683 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:19.683 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.379270+0000", 2024-09-13T05:10:19.683 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2076e-05 2024-09-13T05:10:19.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.683 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.683 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:19.683 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.379319+0000", 2024-09-13T05:10:19.683 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9539000000000001e-05 2024-09-13T05:10:19.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.683 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.683 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:19.683 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.379343+0000", 2024-09-13T05:10:19.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4263000000000001e-05 2024-09-13T05:10:19.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.684 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:19.684 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.379502+0000", 2024-09-13T05:10:19.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000158937 2024-09-13T05:10:19.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.684 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op must wait for map", 2024-09-13T05:10:19.684 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.379512+0000", 2024-09-13T05:10:19.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6260000000000007e-06 2024-09-13T05:10:19.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.685 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:19.685 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.382913+0000", 2024-09-13T05:10:19.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0034014050000000001 2024-09-13T05:10:19.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.685 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:19.685 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.383135+0000", 2024-09-13T05:10:19.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00022176499999999999 2024-09-13T05:10:19.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.685 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:19.685 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.383339+0000", 2024-09-13T05:10:19.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020416299999999999 2024-09-13T05:10:19.686 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.686 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.686 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:19.686 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.384745+0000", 2024-09-13T05:10:19.686 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0014061 2024-09-13T05:10:19.686 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.686 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.686 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:19.686 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.385079+0000", 2024-09-13T05:10:19.686 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00033349600000000002 2024-09-13T05:10:19.686 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.686 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.686 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:19.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.385152+0000", 2024-09-13T05:10:19.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2982e-05 2024-09-13T05:10:19.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:19.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:00.385218+0000", 2024-09-13T05:10:19.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6395000000000004e-05 2024-09-13T05:10:19.687 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.687 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:19.687 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.687 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4275.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-13T05:10:19.687 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:01.385843+0000", 2024-09-13T05:10:19.688 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.283395312, 2024-09-13T05:10:19.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0084301770000000005, 2024-09-13T05:10:19.688 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:19.688 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:19.688 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:19.688 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4275", 2024-09-13T05:10:19.688 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/2023483490", 2024-09-13T05:10:19.688 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 7 2024-09-13T05:10:19.688 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.688 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:19.688 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.688 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:19.688 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.385843+0000", 2024-09-13T05:10:19.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.689 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.689 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:19.689 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.385843+0000", 2024-09-13T05:10:19.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.689 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.689 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:19.689 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.385841+0000", 2024-09-13T05:10:19.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:10:19.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:19.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.385855+0000", 2024-09-13T05:10:19.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4749000000000001e-05 2024-09-13T05:10:19.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:19.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.385891+0000", 2024-09-13T05:10:19.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5352999999999998e-05 2024-09-13T05:10:19.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:19.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.385912+0000", 2024-09-13T05:10:19.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0886e-05 2024-09-13T05:10:19.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:19.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.386045+0000", 2024-09-13T05:10:19.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013285400000000001 2024-09-13T05:10:19.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op must wait for map", 2024-09-13T05:10:19.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.386055+0000", 2024-09-13T05:10:19.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.023e-05 2024-09-13T05:10:19.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.692 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:19.692 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.391624+0000", 2024-09-13T05:10:19.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0055689800000000003 2024-09-13T05:10:19.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.692 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:19.692 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.391712+0000", 2024-09-13T05:10:19.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7929999999999993e-05 2024-09-13T05:10:19.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.692 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:19.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.391845+0000", 2024-09-13T05:10:19.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000132998 2024-09-13T05:10:19.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:19.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.394106+0000", 2024-09-13T05:10:19.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022609399999999999 2024-09-13T05:10:19.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:19.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.394125+0000", 2024-09-13T05:10:19.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8887999999999999e-05 2024-09-13T05:10:19.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:19.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.394209+0000", 2024-09-13T05:10:19.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4436000000000003e-05 2024-09-13T05:10:19.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:19.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:01.394273+0000", 2024-09-13T05:10:19.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4512999999999997e-05 2024-09-13T05:10:19.694 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.694 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:19.694 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.695 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:10 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-13T05:10:19.695 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:11.665589+0000", 2024-09-13T05:10:19.695 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.0036493889999996, 2024-09-13T05:10:19.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002460378, 2024-09-13T05:10:19.695 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:19.695 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:19.695 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:19.695 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:19.695 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:19.695 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 10 2024-09-13T05:10:19.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.695 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:19.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.696 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:19.696 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.665589+0000", 2024-09-13T05:10:19.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.696 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.696 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:19.696 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.665589+0000", 2024-09-13T05:10:19.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.696 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.696 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:19.696 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.665587+0000", 2024-09-13T05:10:19.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:10:19.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:19.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.665612+0000", 2024-09-13T05:10:19.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5307999999999999e-05 2024-09-13T05:10:19.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:19.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.665632+0000", 2024-09-13T05:10:19.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9242e-05 2024-09-13T05:10:19.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:19.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.665644+0000", 2024-09-13T05:10:19.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2208000000000001e-05 2024-09-13T05:10:19.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:19.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.665769+0000", 2024-09-13T05:10:19.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012505599999999999 2024-09-13T05:10:19.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:19.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.666002+0000", 2024-09-13T05:10:19.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000232952 2024-09-13T05:10:19.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:19.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.666324+0000", 2024-09-13T05:10:19.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00032276100000000002 2024-09-13T05:10:19.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.699 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:19.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.667498+0000", 2024-09-13T05:10:19.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001173337 2024-09-13T05:10:19.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.699 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:19.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.667859+0000", 2024-09-13T05:10:19.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00036118499999999998 2024-09-13T05:10:19.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.699 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:19.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.667954+0000", 2024-09-13T05:10:19.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4574999999999995e-05 2024-09-13T05:10:19.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.700 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:19.700 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.668050+0000", 2024-09-13T05:10:19.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6031000000000003e-05 2024-09-13T05:10:19.700 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.700 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:19.700 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.701 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:11 3.1f e25/22 3:fa654f18:::rbd_id.image_client.0:head v 25'1, mlcod=0'0)", 2024-09-13T05:10:19.701 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:11.671938+0000", 2024-09-13T05:10:19.701 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 7.9973002559999999, 2024-09-13T05:10:19.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0040651380000000003, 2024-09-13T05:10:19.701 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:19.701 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:19.701 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:19.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:19.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.671938+0000", 2024-09-13T05:10:19.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.702 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:19.702 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.671938+0000", 2024-09-13T05:10:19.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.702 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:19.702 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.671938+0000", 2024-09-13T05:10:19.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:19.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:19.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.671948+0000", 2024-09-13T05:10:19.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0910000000000001e-05 2024-09-13T05:10:19.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:19.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.671965+0000", 2024-09-13T05:10:19.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6273000000000002e-05 2024-09-13T05:10:19.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:19.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.671981+0000", 2024-09-13T05:10:19.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5957e-05 2024-09-13T05:10:19.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:19.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.672071+0000", 2024-09-13T05:10:19.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0638999999999997e-05 2024-09-13T05:10:19.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:19.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.672110+0000", 2024-09-13T05:10:19.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8461000000000003e-05 2024-09-13T05:10:19.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:19.705 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.675930+0000", 2024-09-13T05:10:19.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003820277 2024-09-13T05:10:19.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:19.705 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.676004+0000", 2024-09-13T05:10:19.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3487999999999998e-05 2024-09-13T05:10:19.705 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.705 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:19.705 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.706 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:549 3.1f e26/22 3:fb3ea134:::rbd_data.112d65d6a1c8.000000000000002d:head v 26'4, mlcod=25'2)", 2024-09-13T05:10:19.706 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:14.878208+0000", 2024-09-13T05:10:19.706 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.7910301630000003, 2024-09-13T05:10:19.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0019604790000000002, 2024-09-13T05:10:19.706 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:19.706 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:19.707 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:19.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:19.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.878208+0000", 2024-09-13T05:10:19.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:19.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.878208+0000", 2024-09-13T05:10:19.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:19.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.878208+0000", 2024-09-13T05:10:19.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:19.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:19.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.878335+0000", 2024-09-13T05:10:19.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000126947 2024-09-13T05:10:19.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:19.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.878361+0000", 2024-09-13T05:10:19.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6216000000000001e-05 2024-09-13T05:10:19.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.709 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:19.709 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.878381+0000", 2024-09-13T05:10:19.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9707e-05 2024-09-13T05:10:19.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:19.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.878506+0000", 2024-09-13T05:10:19.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012485 2024-09-13T05:10:19.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:19.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.878551+0000", 2024-09-13T05:10:19.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5139000000000003e-05 2024-09-13T05:10:19.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:19.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.880108+0000", 2024-09-13T05:10:19.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0015568209999999999 2024-09-13T05:10:19.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.711 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:19.711 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.880169+0000", 2024-09-13T05:10:19.711 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1304999999999997e-05 2024-09-13T05:10:19.711 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.711 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:19.711 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.711 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:571 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:19.712 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:15.701856+0000", 2024-09-13T05:10:19.712 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.9673827720000001, 2024-09-13T05:10:19.712 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033787470000000001, 2024-09-13T05:10:19.712 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:19.712 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:19.712 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:19.712 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:19.712 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:19.712 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 571 2024-09-13T05:10:19.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.712 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:19.712 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:19.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.701856+0000", 2024-09-13T05:10:19.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:19.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.701856+0000", 2024-09-13T05:10:19.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:19.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.701853+0000", 2024-09-13T05:10:19.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:10:19.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:19.714 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.701870+0000", 2024-09-13T05:10:19.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7306e-05 2024-09-13T05:10:19.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:19.714 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.701902+0000", 2024-09-13T05:10:19.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1304999999999999e-05 2024-09-13T05:10:19.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:19.714 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.701915+0000", 2024-09-13T05:10:19.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3671e-05 2024-09-13T05:10:19.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.715 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:19.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.702004+0000", 2024-09-13T05:10:19.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8749e-05 2024-09-13T05:10:19.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.715 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op must wait for map", 2024-09-13T05:10:19.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.702017+0000", 2024-09-13T05:10:19.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3030999999999999e-05 2024-09-13T05:10:19.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.715 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:19.716 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.705010+0000", 2024-09-13T05:10:19.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002992883 2024-09-13T05:10:19.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.716 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.716 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:19.716 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.705090+0000", 2024-09-13T05:10:19.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9930000000000002e-05 2024-09-13T05:10:19.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.716 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.716 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:19.716 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.705235+0000", 2024-09-13T05:10:19.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000144709 2024-09-13T05:10:19.717 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.717 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:19.717 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.717 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:588 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:19.717 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:15.725725+0000", 2024-09-13T05:10:19.718 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.9435141229999999, 2024-09-13T05:10:19.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024591999999999999, 2024-09-13T05:10:19.718 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:19.718 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:19.718 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:19.718 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:19.719 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:19.719 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 588 2024-09-13T05:10:19.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.719 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:19.719 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.719 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:19.720 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.725725+0000", 2024-09-13T05:10:19.720 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.720 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.720 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:19.720 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.725725+0000", 2024-09-13T05:10:19.721 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.721 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.721 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:19.721 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.725723+0000", 2024-09-13T05:10:19.721 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:19.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.721 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.721 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:19.721 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.725736+0000", 2024-09-13T05:10:19.721 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3054000000000001e-05 2024-09-13T05:10:19.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:19.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.725766+0000", 2024-09-13T05:10:19.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9756000000000001e-05 2024-09-13T05:10:19.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:19.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.725784+0000", 2024-09-13T05:10:19.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8757e-05 2024-09-13T05:10:19.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:19.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.725874+0000", 2024-09-13T05:10:19.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9722999999999995e-05 2024-09-13T05:10:19.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.723 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:19.723 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.725988+0000", 2024-09-13T05:10:19.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011409299999999999 2024-09-13T05:10:19.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.723 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:19.723 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.726290+0000", 2024-09-13T05:10:19.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000301448 2024-09-13T05:10:19.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:19.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.727247+0000", 2024-09-13T05:10:19.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00095739700000000002 2024-09-13T05:10:19.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:19.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.728033+0000", 2024-09-13T05:10:19.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00078599500000000005 2024-09-13T05:10:19.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:19.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.728114+0000", 2024-09-13T05:10:19.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0780999999999998e-05 2024-09-13T05:10:19.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.725 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:19.725 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.728184+0000", 2024-09-13T05:10:19.725 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9975999999999995e-05 2024-09-13T05:10:19.725 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.725 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:19.725 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.725 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:672 3.1c 3:3e23b187:::rbd_data.112d65d6a1c8.0000000000000000:4 [sparse-read 2621440~30117] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:19.725 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:15.986898+0000", 2024-09-13T05:10:19.725 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.68234108, 2024-09-13T05:10:19.725 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0016057440000000001, 2024-09-13T05:10:19.726 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:19.726 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:19.726 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:19.726 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:19.726 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:19.726 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 672 2024-09-13T05:10:19.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.726 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:19.726 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.726 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:19.726 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.986898+0000", 2024-09-13T05:10:19.726 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.726 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.727 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:19.727 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.986898+0000", 2024-09-13T05:10:19.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.727 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:19.727 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.986896+0000", 2024-09-13T05:10:19.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:19.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.727 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:19.727 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.986903+0000", 2024-09-13T05:10:19.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8739999999999997e-06 2024-09-13T05:10:19.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:19.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.986937+0000", 2024-09-13T05:10:19.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3698999999999997e-05 2024-09-13T05:10:19.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:19.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.986949+0000", 2024-09-13T05:10:19.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1771e-05 2024-09-13T05:10:19.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:19.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987753+0000", 2024-09-13T05:10:19.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00080451299999999997 2024-09-13T05:10:19.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:19.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987842+0000", 2024-09-13T05:10:19.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8325999999999994e-05 2024-09-13T05:10:19.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:19.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.988503+0000", 2024-09-13T05:10:19.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00066172799999999999 2024-09-13T05:10:19.729 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.729 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:19.729 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.730 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.730 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.730 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:686 3.1c 3:3e23b187:::rbd_data.112d65d6a1c8.0000000000000000:4 [sparse-read 1048576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:19.730 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:15.987206+0000", 2024-09-13T05:10:19.730 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.682032644, 2024-09-13T05:10:19.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0016950750000000001, 2024-09-13T05:10:19.730 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:19.730 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:19.730 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:19.730 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:19.730 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:19.730 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 686 2024-09-13T05:10:19.730 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.731 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:19.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:19.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987206+0000", 2024-09-13T05:10:19.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:19.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987206+0000", 2024-09-13T05:10:19.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:19.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987204+0000", 2024-09-13T05:10:19.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:19.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:19.732 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987215+0000", 2024-09-13T05:10:19.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0869999999999999e-05 2024-09-13T05:10:19.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:19.732 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987231+0000", 2024-09-13T05:10:19.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5662e-05 2024-09-13T05:10:19.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:19.733 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987243+0000", 2024-09-13T05:10:19.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.17e-05 2024-09-13T05:10:19.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.733 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:19.733 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.988538+0000", 2024-09-13T05:10:19.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001295046 2024-09-13T05:10:19.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.733 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:19.733 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.988647+0000", 2024-09-13T05:10:19.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000109554 2024-09-13T05:10:19.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:19.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.988901+0000", 2024-09-13T05:10:19.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025384499999999999 2024-09-13T05:10:19.734 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.734 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:19.734 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.734 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:687 3.1c 3:3e23b187:::rbd_data.112d65d6a1c8.0000000000000000:4 [sparse-read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:19.734 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:15.987278+0000", 2024-09-13T05:10:19.734 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.6819608549999998, 2024-09-13T05:10:19.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021208189999999999, 2024-09-13T05:10:19.734 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:19.734 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:19.735 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:19.735 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:19.735 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:19.735 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 687 2024-09-13T05:10:19.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.735 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:19.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:19.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987278+0000", 2024-09-13T05:10:19.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:19.736 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987278+0000", 2024-09-13T05:10:19.736 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.736 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:19.736 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987277+0000", 2024-09-13T05:10:19.736 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:19.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.736 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:19.736 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987281+0000", 2024-09-13T05:10:19.736 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:10:19.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:19.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987292+0000", 2024-09-13T05:10:19.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1032e-05 2024-09-13T05:10:19.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:19.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987298+0000", 2024-09-13T05:10:19.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1859999999999997e-06 2024-09-13T05:10:19.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:19.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.989002+0000", 2024-09-13T05:10:19.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001703934 2024-09-13T05:10:19.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:19.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.989189+0000", 2024-09-13T05:10:19.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018705600000000001 2024-09-13T05:10:19.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:19.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.989399+0000", 2024-09-13T05:10:19.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020944599999999999 2024-09-13T05:10:19.738 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.738 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:19.741 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.741 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:700 3.1c 3:3e23b187:::rbd_data.112d65d6a1c8.0000000000000000:4 [sparse-read 1572864~51762] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:19.741 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:15.987566+0000", 2024-09-13T05:10:19.741 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.6816727330000001, 2024-09-13T05:10:19.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0028503389999999999, 2024-09-13T05:10:19.741 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:19.741 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:19.741 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:19.741 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:19.742 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:19.742 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 700 2024-09-13T05:10:19.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.742 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:19.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:19.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987566+0000", 2024-09-13T05:10:19.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:19.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987566+0000", 2024-09-13T05:10:19.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:19.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987565+0000", 2024-09-13T05:10:19.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:19.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:19.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987572+0000", 2024-09-13T05:10:19.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5069999999999997e-06 2024-09-13T05:10:19.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:19.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987586+0000", 2024-09-13T05:10:19.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4175999999999999e-05 2024-09-13T05:10:19.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.744 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:19.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987603+0000", 2024-09-13T05:10:19.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7416000000000001e-05 2024-09-13T05:10:19.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.744 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:19.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.989451+0000", 2024-09-13T05:10:19.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0018476289999999999 2024-09-13T05:10:19.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.745 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:19.745 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.989598+0000", 2024-09-13T05:10:19.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000147174 2024-09-13T05:10:19.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.745 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.745 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:19.745 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.990416+0000", 2024-09-13T05:10:19.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00081829500000000002 2024-09-13T05:10:19.745 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.745 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:19.745 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.745 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.746 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:701 3.1c 3:3e23b187:::rbd_data.112d65d6a1c8.0000000000000000:4 [sparse-read 3670016~49294] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:19.746 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:15.987621+0000", 2024-09-13T05:10:19.746 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.6816176089999999, 2024-09-13T05:10:19.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0041053510000000001, 2024-09-13T05:10:19.746 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:19.746 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:19.746 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:19.746 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:19.746 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:19.746 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 701 2024-09-13T05:10:19.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.746 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:19.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:19.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987621+0000", 2024-09-13T05:10:19.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:19.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987621+0000", 2024-09-13T05:10:19.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:19.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987620+0000", 2024-09-13T05:10:19.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:19.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:19.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987624+0000", 2024-09-13T05:10:19.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9299999999999996e-06 2024-09-13T05:10:19.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:19.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987631+0000", 2024-09-13T05:10:19.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9369999999999998e-06 2024-09-13T05:10:19.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:19.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.987637+0000", 2024-09-13T05:10:19.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3460000000000001e-06 2024-09-13T05:10:19.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:19.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.990518+0000", 2024-09-13T05:10:19.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0028809930000000001 2024-09-13T05:10:19.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:19.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.990749+0000", 2024-09-13T05:10:19.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000231105 2024-09-13T05:10:19.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:19.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.991726+0000", 2024-09-13T05:10:19.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00097766299999999993 2024-09-13T05:10:19.750 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.750 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:19.750 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.750 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:719 3.c 3:33565b4d:::rbd_data.112dac7a9dca.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,truncate 15204352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:19.750 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:15.998339+0000", 2024-09-13T05:10:19.750 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.6708995469999999, 2024-09-13T05:10:19.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0032567360000000001, 2024-09-13T05:10:19.750 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:19.750 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:19.751 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:19.751 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:19.751 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:19.751 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 719 2024-09-13T05:10:19.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.751 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:19.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:19.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.998339+0000", 2024-09-13T05:10:19.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:19.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.998339+0000", 2024-09-13T05:10:19.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:19.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.998337+0000", 2024-09-13T05:10:19.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:19.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:19.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.998481+0000", 2024-09-13T05:10:19.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014407100000000001 2024-09-13T05:10:19.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:19.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.998507+0000", 2024-09-13T05:10:19.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.582e-05 2024-09-13T05:10:19.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:19.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.998524+0000", 2024-09-13T05:10:19.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6356999999999999e-05 2024-09-13T05:10:19.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:19.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.998615+0000", 2024-09-13T05:10:19.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1662000000000004e-05 2024-09-13T05:10:19.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:19.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.998853+0000", 2024-09-13T05:10:19.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00023767499999999999 2024-09-13T05:10:19.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:19.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.999119+0000", 2024-09-13T05:10:19.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00026550500000000003 2024-09-13T05:10:19.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:19.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.000728+0000", 2024-09-13T05:10:19.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00160928 2024-09-13T05:10:19.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:19.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.001477+0000", 2024-09-13T05:10:19.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00074893599999999996 2024-09-13T05:10:19.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:19.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.001538+0000", 2024-09-13T05:10:19.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0791000000000001e-05 2024-09-13T05:10:19.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:19.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.001596+0000", 2024-09-13T05:10:19.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8306e-05 2024-09-13T05:10:19.756 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.756 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:19.756 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.756 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:764 3.c 3:33565b4d:::rbd_data.112dac7a9dca.0000000000000001:head [stat,write 9456647~12036] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:19.756 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.064862+0000", 2024-09-13T05:10:19.756 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.6043768350000001, 2024-09-13T05:10:19.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0027621410000000001, 2024-09-13T05:10:19.756 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:19.756 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:19.756 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:19.756 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:19.757 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:19.757 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 764 2024-09-13T05:10:19.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.757 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:19.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:19.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.064862+0000", 2024-09-13T05:10:19.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:19.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.064862+0000", 2024-09-13T05:10:19.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:19.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.064859+0000", 2024-09-13T05:10:19.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:10:19.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:19.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.064898+0000", 2024-09-13T05:10:19.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8912000000000003e-05 2024-09-13T05:10:19.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:19.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.064933+0000", 2024-09-13T05:10:19.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5235999999999999e-05 2024-09-13T05:10:19.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:19.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.064978+0000", 2024-09-13T05:10:19.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4932000000000003e-05 2024-09-13T05:10:19.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:19.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.065100+0000", 2024-09-13T05:10:19.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012183799999999999 2024-09-13T05:10:19.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:19.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.065268+0000", 2024-09-13T05:10:19.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000167706 2024-09-13T05:10:19.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:19.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.065493+0000", 2024-09-13T05:10:19.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00022564500000000001 2024-09-13T05:10:19.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:19.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.066956+0000", 2024-09-13T05:10:19.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001462503 2024-09-13T05:10:19.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:19.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.067490+0000", 2024-09-13T05:10:19.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00053381200000000005 2024-09-13T05:10:19.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:19.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.067566+0000", 2024-09-13T05:10:19.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6272000000000004e-05 2024-09-13T05:10:19.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:19.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.067624+0000", 2024-09-13T05:10:19.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7887999999999999e-05 2024-09-13T05:10:19.762 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.762 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:19.762 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.762 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:796 3.c 3:33565b4d:::rbd_data.112dac7a9dca.0000000000000001:head [stat,write 14652875~27189] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:19.762 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.141841+0000", 2024-09-13T05:10:19.762 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.5273974799999999, 2024-09-13T05:10:19.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002793462, 2024-09-13T05:10:19.762 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:19.762 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:19.762 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:19.762 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:19.763 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:19.763 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 796 2024-09-13T05:10:19.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.763 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:19.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.763 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:19.763 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.141841+0000", 2024-09-13T05:10:19.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.763 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:19.763 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.141841+0000", 2024-09-13T05:10:19.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:19.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.141838+0000", 2024-09-13T05:10:19.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:10:19.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:19.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.141904+0000", 2024-09-13T05:10:19.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5839000000000004e-05 2024-09-13T05:10:19.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:19.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.141934+0000", 2024-09-13T05:10:19.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9788999999999999e-05 2024-09-13T05:10:19.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:19.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.141949+0000", 2024-09-13T05:10:19.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4725999999999999e-05 2024-09-13T05:10:19.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:19.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.142041+0000", 2024-09-13T05:10:19.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2482e-05 2024-09-13T05:10:19.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:19.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.142193+0000", 2024-09-13T05:10:19.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00015157300000000001 2024-09-13T05:10:19.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:19.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.142421+0000", 2024-09-13T05:10:19.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00022869200000000001 2024-09-13T05:10:19.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:19.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.144214+0000", 2024-09-13T05:10:19.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0017925300000000001 2024-09-13T05:10:19.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:19.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.144488+0000", 2024-09-13T05:10:19.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00027434399999999999 2024-09-13T05:10:19.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:19.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.144575+0000", 2024-09-13T05:10:19.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6798000000000005e-05 2024-09-13T05:10:19.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:19.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.144635+0000", 2024-09-13T05:10:19.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9509000000000002e-05 2024-09-13T05:10:19.768 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.768 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:19.768 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.768 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:821 3.c 3:33565b4d:::rbd_data.112dac7a9dca.0000000000000001:head [stat,truncate 6815744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:19.768 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.207722+0000", 2024-09-13T05:10:19.768 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.4615168039999999, 2024-09-13T05:10:19.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024950969999999999, 2024-09-13T05:10:19.768 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:19.768 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:19.768 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:19.768 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:19.769 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:19.769 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 821 2024-09-13T05:10:19.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.769 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:19.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.769 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:19.769 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.207722+0000", 2024-09-13T05:10:19.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:19.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.207722+0000", 2024-09-13T05:10:19.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:19.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.207719+0000", 2024-09-13T05:10:19.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:10:19.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:19.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.207733+0000", 2024-09-13T05:10:19.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3783e-05 2024-09-13T05:10:19.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:19.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.207767+0000", 2024-09-13T05:10:19.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3788999999999998e-05 2024-09-13T05:10:19.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:19.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.207781+0000", 2024-09-13T05:10:19.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.453e-05 2024-09-13T05:10:19.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:19.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.207862+0000", 2024-09-13T05:10:19.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0487000000000004e-05 2024-09-13T05:10:19.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:19.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.207995+0000", 2024-09-13T05:10:19.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013334600000000001 2024-09-13T05:10:19.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:19.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208173+0000", 2024-09-13T05:10:19.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017828200000000001 2024-09-13T05:10:19.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:19.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.209518+0000", 2024-09-13T05:10:19.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001344966 2024-09-13T05:10:19.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:19.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.210100+0000", 2024-09-13T05:10:19.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00058156199999999999 2024-09-13T05:10:19.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:19.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.210164+0000", 2024-09-13T05:10:19.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3795999999999997e-05 2024-09-13T05:10:19.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:19.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.210217+0000", 2024-09-13T05:10:19.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3176e-05 2024-09-13T05:10:19.774 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.774 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:19.774 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.774 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:838 3.17 e28/22 3:ed69f8ff:::rbd_header.112dac7a9dca:head v 28'19, mlcod=27'17)", 2024-09-13T05:10:19.774 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.688586+0000", 2024-09-13T05:10:19.774 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 2.9806522279999998, 2024-09-13T05:10:19.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025487800000000001, 2024-09-13T05:10:19.775 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:19.775 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:19.775 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:19.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:19.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.688586+0000", 2024-09-13T05:10:19.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:19.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.688586+0000", 2024-09-13T05:10:19.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:19.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.688586+0000", 2024-09-13T05:10:19.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:19.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:19.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.688602+0000", 2024-09-13T05:10:19.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.592e-05 2024-09-13T05:10:19.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:19.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.688652+0000", 2024-09-13T05:10:19.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0249e-05 2024-09-13T05:10:19.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:19.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.688673+0000", 2024-09-13T05:10:19.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1172999999999999e-05 2024-09-13T05:10:19.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:19.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.688748+0000", 2024-09-13T05:10:19.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5499000000000003e-05 2024-09-13T05:10:19.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:19.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.688773+0000", 2024-09-13T05:10:19.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4485e-05 2024-09-13T05:10:19.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:19.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.690997+0000", 2024-09-13T05:10:19.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022244029999999998 2024-09-13T05:10:19.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:19.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.691135+0000", 2024-09-13T05:10:19.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000137801 2024-09-13T05:10:19.778 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.778 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:19.778 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.779 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:885 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-13T05:10:19.779 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.740284+0000", 2024-09-13T05:10:19.779 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 2.9289545979999998, 2024-09-13T05:10:19.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022388130000000001, 2024-09-13T05:10:19.779 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:19.779 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:19.779 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:19.779 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:19.779 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:19.779 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 885 2024-09-13T05:10:19.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.779 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:19.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:19.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.740284+0000", 2024-09-13T05:10:19.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:19.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.740284+0000", 2024-09-13T05:10:19.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:19.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.740283+0000", 2024-09-13T05:10:19.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:19.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:19.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.740291+0000", 2024-09-13T05:10:19.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.422e-06 2024-09-13T05:10:19.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:19.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.740310+0000", 2024-09-13T05:10:19.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8957000000000002e-05 2024-09-13T05:10:19.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:19.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.740319+0000", 2024-09-13T05:10:19.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5979999999999997e-06 2024-09-13T05:10:19.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:19.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.740371+0000", 2024-09-13T05:10:19.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2491000000000003e-05 2024-09-13T05:10:19.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:19.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.740453+0000", 2024-09-13T05:10:19.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1426000000000003e-05 2024-09-13T05:10:19.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:19.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.740674+0000", 2024-09-13T05:10:19.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00022178200000000001 2024-09-13T05:10:19.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:19.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.741710+0000", 2024-09-13T05:10:19.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001035766 2024-09-13T05:10:19.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:19.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.742415+0000", 2024-09-13T05:10:19.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00070468699999999996 2024-09-13T05:10:19.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:19.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.742473+0000", 2024-09-13T05:10:19.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8084000000000002e-05 2024-09-13T05:10:19.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:19.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.742523+0000", 2024-09-13T05:10:19.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9866e-05 2024-09-13T05:10:19.784 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.784 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:19.784 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.785 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:889 3.d e28/22 3:b75e3ee8:::rbd_object_map.112d318cd671:head v 28'6, mlcod=25'4)", 2024-09-13T05:10:19.785 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.752488+0000", 2024-09-13T05:10:19.785 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 2.9167501869999999, 2024-09-13T05:10:19.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0019098279999999999, 2024-09-13T05:10:19.785 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:19.785 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:19.785 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:19.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:19.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.752488+0000", 2024-09-13T05:10:19.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:19.786 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.752488+0000", 2024-09-13T05:10:19.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:19.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.786 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:19.786 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.752488+0000", 2024-09-13T05:10:19.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:19.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.786 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:19.786 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.752497+0000", 2024-09-13T05:10:19.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4739999999999994e-06 2024-09-13T05:10:19.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.786 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:19.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.752523+0000", 2024-09-13T05:10:19.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5395e-05 2024-09-13T05:10:19.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:19.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.752537+0000", 2024-09-13T05:10:19.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4273999999999999e-05 2024-09-13T05:10:19.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:19.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.752653+0000", 2024-09-13T05:10:19.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000115758 2024-09-13T05:10:19.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:19.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.752714+0000", 2024-09-13T05:10:19.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0887999999999997e-05 2024-09-13T05:10:19.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:19.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.754317+0000", 2024-09-13T05:10:19.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001603183 2024-09-13T05:10:19.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:19.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:19.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:19.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.754398+0000", 2024-09-13T05:10:19.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1378000000000006e-05 2024-09-13T05:10:19.789 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.789 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:19.789 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.789 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:19.789 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:19.789 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:19.789 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T05:10:19.791 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:19.786+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:19.791 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:10:19.856 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone2 from 0xc870f71 (overlap 0xc1c3f0) to 0x60e1f8 2024-09-13T05:10:19.891 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:19.886+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:19.913 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:19.913 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:19.913 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:19.913 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:19.923 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:10:19.965 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #1, image image_client.0-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent2 2024-09-13T05:10:19.991 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:19.986+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:20.029 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:20.029 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:20.029 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:20.029 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:20.029 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:20.039 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:10:20.041 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:20.041 INFO:teuthology.orchestra.run.smithi120.stdout:506 write 0xccf4a thru 0xd5668 (0x871f bytes) 2024-09-13T05:10:20.057 INFO:teuthology.orchestra.run.smithi120.stdout:507 write 0x52de96f thru 0x52e37e4 (0x4e76 bytes) 2024-09-13T05:10:20.064 INFO:teuthology.orchestra.run.smithi120.stdout:509 write 0x9517f6c thru 0x9519fc9 (0x205e bytes) 2024-09-13T05:10:20.069 INFO:teuthology.orchestra.run.smithi120.stdout:510 write 0x83b929d thru 0x83c5f47 (0xccab bytes) 2024-09-13T05:10:20.078 INFO:teuthology.orchestra.run.smithi120.stdout:511 trunc from 0xc870f71 to 0xd1d5f75 2024-09-13T05:10:20.085 INFO:teuthology.orchestra.run.smithi120.stdout:512 read 0x2ff19c6 thru 0x2ff9f0d (0x8548 bytes) 2024-09-13T05:10:20.086 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:20.086 INFO:teuthology.orchestra.run.smithi120.stdout:515 writesame 0x31cab31 thru 0x31d21ba data_size 0x1(0x768a bytes) 2024-09-13T05:10:20.093 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:20.091+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:20.105 INFO:teuthology.orchestra.run.smithi120.stdout:516 writesame 0x1fb1618 thru 0x1fb9fcd data_size 0x1(0x89b6 bytes) 2024-09-13T05:10:20.126 INFO:teuthology.orchestra.run.smithi120.stdout:517 read 0x22484a4 thru 0x2249e6d (0x19ca bytes) 2024-09-13T05:10:20.127 INFO:teuthology.orchestra.run.smithi120.stdout:518 punch from 0x7b0b057 to 0x7b12229, (0x71d2 bytes) 2024-09-13T05:10:20.127 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:20.127 INFO:teuthology.orchestra.run.smithi120.stdout:522 write 0xccbd207 thru 0xccc78be (0xa6b8 bytes) 2024-09-13T05:10:20.137 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:20.137 INFO:teuthology.orchestra.run.smithi120.stdout:527 read 0x5c3988c thru 0x5c48176 (0xe8eb bytes) 2024-09-13T05:10:20.138 INFO:teuthology.orchestra.run.smithi120.stdout:528 write 0xaa7468e thru 0xaa757ab (0x111e bytes) 2024-09-13T05:10:20.150 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:20.150 INFO:teuthology.orchestra.run.smithi120.stdout:531 punch from 0x2df4e28 to 0x2dffbcc, (0xada4 bytes) 2024-09-13T05:10:20.150 INFO:teuthology.orchestra.run.smithi120.stdout:532 punch from 0x7334b69 to 0x7337ed3, (0x336a bytes) 2024-09-13T05:10:20.150 INFO:teuthology.orchestra.run.smithi120.stdout:533 write 0x4d36820 thru 0x4d46483 (0xfc64 bytes) 2024-09-13T05:10:20.152 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:20.152 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:20.152 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:20.153 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:10:20.153 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.153 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:13 3.a 3:54eb35e9:::rbd_object_map.112d65d6a1c8:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-13T05:10:20.153 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:11.688058+0000", 2024-09-13T05:10:20.153 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.4604112839999992, 2024-09-13T05:10:20.153 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002540077, 2024-09-13T05:10:20.153 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.153 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.153 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.153 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:20.153 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:20.154 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 13 2024-09-13T05:10:20.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.154 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.154 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.154 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.154 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.688058+0000", 2024-09-13T05:10:20.154 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.154 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.154 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.154 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.688058+0000", 2024-09-13T05:10:20.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.688056+0000", 2024-09-13T05:10:20.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:20.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.688068+0000", 2024-09-13T05:10:20.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1600000000000001e-05 2024-09-13T05:10:20.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.688086+0000", 2024-09-13T05:10:20.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7549000000000001e-05 2024-09-13T05:10:20.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.156 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.156 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.688107+0000", 2024-09-13T05:10:20.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1250000000000002e-05 2024-09-13T05:10:20.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.156 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.156 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.688206+0000", 2024-09-13T05:10:20.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9401000000000006e-05 2024-09-13T05:10:20.157 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.157 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.157 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.688481+0000", 2024-09-13T05:10:20.157 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000274837 2024-09-13T05:10:20.157 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.157 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:20.157 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.688745+0000", 2024-09-13T05:10:20.157 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00026447100000000001 2024-09-13T05:10:20.157 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.157 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.157 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.689923+0000", 2024-09-13T05:10:20.158 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0011772880000000001 2024-09-13T05:10:20.158 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.158 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.158 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.158 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.690435+0000", 2024-09-13T05:10:20.158 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00051181299999999996 2024-09-13T05:10:20.158 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.158 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.158 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.158 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.690524+0000", 2024-09-13T05:10:20.158 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9464999999999998e-05 2024-09-13T05:10:20.158 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.158 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.158 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.159 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:11.690598+0000", 2024-09-13T05:10:20.159 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.4185999999999997e-05 2024-09-13T05:10:20.159 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.159 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.159 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.159 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.159 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:531 3.a 3:54eb35e9:::rbd_object_map.112d65d6a1c8:head [call lock.assert_locked in=17b,call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-13T05:10:20.159 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:14.839458+0000", 2024-09-13T05:10:20.159 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.3090114249999996, 2024-09-13T05:10:20.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023896949999999998, 2024-09-13T05:10:20.160 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.160 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.160 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.160 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:20.160 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:20.160 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 531 2024-09-13T05:10:20.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.160 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.839458+0000", 2024-09-13T05:10:20.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.161 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.839458+0000", 2024-09-13T05:10:20.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.162 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.162 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.839457+0000", 2024-09-13T05:10:20.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:20.162 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.162 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.162 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.162 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.839466+0000", 2024-09-13T05:10:20.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2410000000000001e-06 2024-09-13T05:10:20.162 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.162 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.162 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.162 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.839488+0000", 2024-09-13T05:10:20.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1909999999999999e-05 2024-09-13T05:10:20.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.163 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.163 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.839499+0000", 2024-09-13T05:10:20.163 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0835999999999999e-05 2024-09-13T05:10:20.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.163 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.163 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.839596+0000", 2024-09-13T05:10:20.163 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7085999999999998e-05 2024-09-13T05:10:20.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.163 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.163 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.839755+0000", 2024-09-13T05:10:20.164 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00015964399999999999 2024-09-13T05:10:20.164 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.164 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.164 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:20.164 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.840181+0000", 2024-09-13T05:10:20.164 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00042515899999999999 2024-09-13T05:10:20.164 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.164 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.164 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.164 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.841334+0000", 2024-09-13T05:10:20.164 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0011539219999999999 2024-09-13T05:10:20.164 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.164 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.165 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.841746+0000", 2024-09-13T05:10:20.165 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000411278 2024-09-13T05:10:20.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.165 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.165 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.841804+0000", 2024-09-13T05:10:20.165 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8078000000000002e-05 2024-09-13T05:10:20.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.165 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.165 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.841848+0000", 2024-09-13T05:10:20.165 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3888999999999999e-05 2024-09-13T05:10:20.165 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.166 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.166 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.166 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.166 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:540 3.a 3:54eb35e9:::rbd_object_map.112d65d6a1c8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-13T05:10:20.166 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:14.850832+0000", 2024-09-13T05:10:20.166 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.2976373900000002, 2024-09-13T05:10:20.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0053449279999999997, 2024-09-13T05:10:20.166 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.166 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.166 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.167 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:20.167 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:20.167 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 540 2024-09-13T05:10:20.167 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.167 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.167 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.167 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.850832+0000", 2024-09-13T05:10:20.167 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.167 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.167 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.167 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.850832+0000", 2024-09-13T05:10:20.167 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.168 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.168 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.168 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.850830+0000", 2024-09-13T05:10:20.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:20.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.168 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.168 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.168 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.850842+0000", 2024-09-13T05:10:20.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1756000000000001e-05 2024-09-13T05:10:20.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.168 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.850870+0000", 2024-09-13T05:10:20.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8274000000000001e-05 2024-09-13T05:10:20.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.850882+0000", 2024-09-13T05:10:20.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1654999999999999e-05 2024-09-13T05:10:20.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.850993+0000", 2024-09-13T05:10:20.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011087200000000001 2024-09-13T05:10:20.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.851176+0000", 2024-09-13T05:10:20.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018281999999999999 2024-09-13T05:10:20.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:20.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.851872+0000", 2024-09-13T05:10:20.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00069598900000000005 2024-09-13T05:10:20.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.853497+0000", 2024-09-13T05:10:20.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0016250119999999999 2024-09-13T05:10:20.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.171 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856056+0000", 2024-09-13T05:10:20.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002559576 2024-09-13T05:10:20.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.171 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856123+0000", 2024-09-13T05:10:20.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6721e-05 2024-09-13T05:10:20.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856177+0000", 2024-09-13T05:10:20.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4015999999999999e-05 2024-09-13T05:10:20.172 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.172 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.172 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.172 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:541 3.10 3:0951d16d:::rbd_data.112d65d6a1c8.0000000000000038:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2743809~25573] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-13T05:10:20.172 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:14.856355+0000", 2024-09-13T05:10:20.172 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.2921140250000001, 2024-09-13T05:10:20.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0028844579999999999, 2024-09-13T05:10:20.173 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.173 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.173 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.173 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:20.173 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:20.173 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 541 2024-09-13T05:10:20.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.173 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856355+0000", 2024-09-13T05:10:20.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856355+0000", 2024-09-13T05:10:20.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856354+0000", 2024-09-13T05:10:20.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:20.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856393+0000", 2024-09-13T05:10:20.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9570000000000002e-05 2024-09-13T05:10:20.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.175 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.175 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856427+0000", 2024-09-13T05:10:20.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3976000000000001e-05 2024-09-13T05:10:20.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.175 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.175 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856440+0000", 2024-09-13T05:10:20.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2631e-05 2024-09-13T05:10:20.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856517+0000", 2024-09-13T05:10:20.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6811999999999996e-05 2024-09-13T05:10:20.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856656+0000", 2024-09-13T05:10:20.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000138999 2024-09-13T05:10:20.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:20.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856781+0000", 2024-09-13T05:10:20.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000125692 2024-09-13T05:10:20.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.858361+0000", 2024-09-13T05:10:20.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00157957 2024-09-13T05:10:20.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.859082+0000", 2024-09-13T05:10:20.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00072114399999999995 2024-09-13T05:10:20.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.859177+0000", 2024-09-13T05:10:20.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4605000000000006e-05 2024-09-13T05:10:20.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.859240+0000", 2024-09-13T05:10:20.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3145000000000006e-05 2024-09-13T05:10:20.178 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.178 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.178 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.179 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:543 3.a 3:54eb35e9:::rbd_object_map.112d65d6a1c8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-13T05:10:20.179 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:14.860892+0000", 2024-09-13T05:10:20.179 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.287577658, 2024-09-13T05:10:20.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003048584, 2024-09-13T05:10:20.179 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.179 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.179 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.179 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:20.179 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:20.179 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 543 2024-09-13T05:10:20.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.179 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.860892+0000", 2024-09-13T05:10:20.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.860892+0000", 2024-09-13T05:10:20.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.860890+0000", 2024-09-13T05:10:20.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:20.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.860900+0000", 2024-09-13T05:10:20.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3000000000000007e-06 2024-09-13T05:10:20.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.860918+0000", 2024-09-13T05:10:20.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8349e-05 2024-09-13T05:10:20.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.860927+0000", 2024-09-13T05:10:20.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.02e-06 2024-09-13T05:10:20.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.861030+0000", 2024-09-13T05:10:20.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010278 2024-09-13T05:10:20.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.861167+0000", 2024-09-13T05:10:20.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013675499999999999 2024-09-13T05:10:20.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:20.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.861666+0000", 2024-09-13T05:10:20.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000499352 2024-09-13T05:10:20.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.863093+0000", 2024-09-13T05:10:20.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001426734 2024-09-13T05:10:20.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.863765+0000", 2024-09-13T05:10:20.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00067251799999999999 2024-09-13T05:10:20.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.184 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.184 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.863877+0000", 2024-09-13T05:10:20.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011195499999999999 2024-09-13T05:10:20.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.184 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.184 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.863940+0000", 2024-09-13T05:10:20.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3194999999999994e-05 2024-09-13T05:10:20.184 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.184 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.184 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.185 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:544 3.10 3:0b075cce:::rbd_data.112d65d6a1c8.000000000000002f:head [write 0~8137] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-13T05:10:20.185 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:14.862724+0000", 2024-09-13T05:10:20.185 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.2857453210000003, 2024-09-13T05:10:20.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025853690000000001, 2024-09-13T05:10:20.185 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.185 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.185 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.185 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:20.185 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:20.185 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 544 2024-09-13T05:10:20.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.185 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.862724+0000", 2024-09-13T05:10:20.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.862724+0000", 2024-09-13T05:10:20.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.862723+0000", 2024-09-13T05:10:20.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:20.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.187 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.862864+0000", 2024-09-13T05:10:20.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014113900000000001 2024-09-13T05:10:20.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.187 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.862880+0000", 2024-09-13T05:10:20.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5608e-05 2024-09-13T05:10:20.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.862888+0000", 2024-09-13T05:10:20.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8219999999999996e-06 2024-09-13T05:10:20.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.862977+0000", 2024-09-13T05:10:20.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8651000000000002e-05 2024-09-13T05:10:20.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.863195+0000", 2024-09-13T05:10:20.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021795300000000001 2024-09-13T05:10:20.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:20.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.863500+0000", 2024-09-13T05:10:20.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00030549599999999999 2024-09-13T05:10:20.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.864970+0000", 2024-09-13T05:10:20.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0014697620000000001 2024-09-13T05:10:20.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.865155+0000", 2024-09-13T05:10:20.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018510099999999999 2024-09-13T05:10:20.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.865226+0000", 2024-09-13T05:10:20.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0698000000000006e-05 2024-09-13T05:10:20.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.865309+0000", 2024-09-13T05:10:20.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.3453000000000002e-05 2024-09-13T05:10:20.191 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.191 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.191 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.191 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:548 3.a 3:54eb35e9:::rbd_object_map.112d65d6a1c8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-13T05:10:20.191 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:14.874676+0000", 2024-09-13T05:10:20.191 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.273792974, 2024-09-13T05:10:20.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024035910000000001, 2024-09-13T05:10:20.191 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.191 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.191 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.191 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:20.192 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:20.192 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 548 2024-09-13T05:10:20.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.192 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.874676+0000", 2024-09-13T05:10:20.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.874676+0000", 2024-09-13T05:10:20.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.874674+0000", 2024-09-13T05:10:20.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:20.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.874690+0000", 2024-09-13T05:10:20.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5633000000000001e-05 2024-09-13T05:10:20.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.874720+0000", 2024-09-13T05:10:20.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9505999999999998e-05 2024-09-13T05:10:20.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.874740+0000", 2024-09-13T05:10:20.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0863e-05 2024-09-13T05:10:20.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.874834+0000", 2024-09-13T05:10:20.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3461000000000005e-05 2024-09-13T05:10:20.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.195 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.195 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.874985+0000", 2024-09-13T05:10:20.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00015108999999999999 2024-09-13T05:10:20.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.195 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:20.195 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.875600+0000", 2024-09-13T05:10:20.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00061490600000000002 2024-09-13T05:10:20.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.195 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.195 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.876949+0000", 2024-09-13T05:10:20.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001348978 2024-09-13T05:10:20.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.196 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.877006+0000", 2024-09-13T05:10:20.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6952e-05 2024-09-13T05:10:20.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.196 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.877049+0000", 2024-09-13T05:10:20.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3643000000000002e-05 2024-09-13T05:10:20.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.197 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.877080+0000", 2024-09-13T05:10:20.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0589000000000001e-05 2024-09-13T05:10:20.197 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.197 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.197 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.197 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:557 3.a 3:54eb35e9:::rbd_object_map.112d65d6a1c8:head [call lock.assert_locked in=17b,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:20.197 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:15.689161+0000", 2024-09-13T05:10:20.197 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.4593080609999998, 2024-09-13T05:10:20.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0027458830000000002, 2024-09-13T05:10:20.197 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.198 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.198 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.198 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:20.198 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:20.198 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 557 2024-09-13T05:10:20.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.198 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.198 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.198 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.689161+0000", 2024-09-13T05:10:20.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.198 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.199 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.689161+0000", 2024-09-13T05:10:20.199 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.199 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.199 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.199 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.199 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.689160+0000", 2024-09-13T05:10:20.199 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:20.199 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.199 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.199 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.199 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.689167+0000", 2024-09-13T05:10:20.199 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.105e-06 2024-09-13T05:10:20.199 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.199 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.200 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.200 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.689180+0000", 2024-09-13T05:10:20.200 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3369e-05 2024-09-13T05:10:20.200 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.200 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.200 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.200 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.689186+0000", 2024-09-13T05:10:20.200 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4489999999999996e-06 2024-09-13T05:10:20.200 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.200 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.200 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.200 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.689256+0000", 2024-09-13T05:10:20.200 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0097000000000003e-05 2024-09-13T05:10:20.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.689365+0000", 2024-09-13T05:10:20.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010832000000000001 2024-09-13T05:10:20.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:20.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.689671+0000", 2024-09-13T05:10:20.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00030588300000000001 2024-09-13T05:10:20.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.690741+0000", 2024-09-13T05:10:20.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0010707659999999999 2024-09-13T05:10:20.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.202 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.202 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.691812+0000", 2024-09-13T05:10:20.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001070377 2024-09-13T05:10:20.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.202 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.202 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.691867+0000", 2024-09-13T05:10:20.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5637000000000003e-05 2024-09-13T05:10:20.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.202 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.203 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.691907+0000", 2024-09-13T05:10:20.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9835000000000001e-05 2024-09-13T05:10:20.203 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.203 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.203 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.203 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:607 3.a 3:535385f0:::rbd_children:head [call rbd.add_child in=12b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:20.203 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:15.758133+0000", 2024-09-13T05:10:20.203 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.3903365289999998, 2024-09-13T05:10:20.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0027661769999999999, 2024-09-13T05:10:20.203 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.203 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.203 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.204 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:20.204 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:20.204 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 607 2024-09-13T05:10:20.204 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.204 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.204 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.758133+0000", 2024-09-13T05:10:20.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.204 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.204 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.758133+0000", 2024-09-13T05:10:20.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.205 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.205 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.758130+0000", 2024-09-13T05:10:20.205 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:10:20.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.205 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.205 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.758148+0000", 2024-09-13T05:10:20.205 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7773000000000001e-05 2024-09-13T05:10:20.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.205 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.206 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.758186+0000", 2024-09-13T05:10:20.206 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7518999999999998e-05 2024-09-13T05:10:20.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.206 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.206 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.758208+0000", 2024-09-13T05:10:20.206 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2024000000000001e-05 2024-09-13T05:10:20.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.206 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.206 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.758298+0000", 2024-09-13T05:10:20.206 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0163999999999999e-05 2024-09-13T05:10:20.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.206 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.207 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.758510+0000", 2024-09-13T05:10:20.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021195299999999999 2024-09-13T05:10:20.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.207 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:20.207 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.758729+0000", 2024-09-13T05:10:20.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021891400000000001 2024-09-13T05:10:20.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.207 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.207 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.759868+0000", 2024-09-13T05:10:20.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0011391559999999999 2024-09-13T05:10:20.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.760792+0000", 2024-09-13T05:10:20.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00092416500000000001 2024-09-13T05:10:20.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.208 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.760859+0000", 2024-09-13T05:10:20.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7154000000000001e-05 2024-09-13T05:10:20.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.208 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.760899+0000", 2024-09-13T05:10:20.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9799000000000003e-05 2024-09-13T05:10:20.208 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.209 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.209 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.209 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:622 3.a 3:54eb35e9:::rbd_object_map.112d65d6a1c8:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:20.209 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:15.926862+0000", 2024-09-13T05:10:20.209 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.2216078250000004, 2024-09-13T05:10:20.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023120839999999998, 2024-09-13T05:10:20.209 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.209 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.209 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.209 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:20.209 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:20.209 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 622 2024-09-13T05:10:20.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.210 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.210 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.210 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.210 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.926862+0000", 2024-09-13T05:10:20.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.210 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.210 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.210 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.926862+0000", 2024-09-13T05:10:20.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.210 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.211 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.926859+0000", 2024-09-13T05:10:20.211 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:10:20.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.211 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.926895+0000", 2024-09-13T05:10:20.211 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6350000000000003e-05 2024-09-13T05:10:20.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.211 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.926933+0000", 2024-09-13T05:10:20.211 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7985999999999998e-05 2024-09-13T05:10:20.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.212 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.212 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.212 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.926957+0000", 2024-09-13T05:10:20.212 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4019000000000002e-05 2024-09-13T05:10:20.212 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.212 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.212 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.212 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.927057+0000", 2024-09-13T05:10:20.212 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9959999999999998e-05 2024-09-13T05:10:20.212 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.212 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.212 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.212 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.927194+0000", 2024-09-13T05:10:20.212 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013688799999999999 2024-09-13T05:10:20.213 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.213 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.213 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:20.213 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.927411+0000", 2024-09-13T05:10:20.213 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021703 2024-09-13T05:10:20.213 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.213 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.213 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.213 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.928551+0000", 2024-09-13T05:10:20.213 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001140262 2024-09-13T05:10:20.213 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.213 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.213 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.213 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.929074+0000", 2024-09-13T05:10:20.214 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00052245500000000001 2024-09-13T05:10:20.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.214 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.214 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.214 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.929130+0000", 2024-09-13T05:10:20.214 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6861000000000003e-05 2024-09-13T05:10:20.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.214 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.214 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.214 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:15.929174+0000", 2024-09-13T05:10:20.214 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3306000000000002e-05 2024-09-13T05:10:20.214 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.214 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.214 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.215 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:720 3.1e e27/22 3:79d098b4:::rbd_data.112dac7a9dca.0000000000000002:head v 27'7, mlcod=25'5)", 2024-09-13T05:10:20.215 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.002085+0000", 2024-09-13T05:10:20.215 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.1463848580000002, 2024-09-13T05:10:20.215 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002777687, 2024-09-13T05:10:20.215 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.215 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.215 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.215 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.215 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.002085+0000", 2024-09-13T05:10:20.215 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.216 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.216 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.216 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.002085+0000", 2024-09-13T05:10:20.216 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.216 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.216 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.216 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.216 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.002084+0000", 2024-09-13T05:10:20.216 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:20.216 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.216 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.216 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.216 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.002258+0000", 2024-09-13T05:10:20.216 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017429699999999999 2024-09-13T05:10:20.217 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.217 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.217 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.217 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.002272+0000", 2024-09-13T05:10:20.217 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4032999999999999e-05 2024-09-13T05:10:20.217 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.217 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.217 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.217 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.002279+0000", 2024-09-13T05:10:20.217 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7159999999999997e-06 2024-09-13T05:10:20.217 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.217 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.217 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.217 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.002333+0000", 2024-09-13T05:10:20.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3773999999999997e-05 2024-09-13T05:10:20.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.218 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.218 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.002357+0000", 2024-09-13T05:10:20.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4023999999999999e-05 2024-09-13T05:10:20.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.218 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.218 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.004799+0000", 2024-09-13T05:10:20.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002441543 2024-09-13T05:10:20.219 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.219 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.219 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.219 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.004862+0000", 2024-09-13T05:10:20.219 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3696999999999997e-05 2024-09-13T05:10:20.219 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.219 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.219 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.219 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.219 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.219 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:785 3.1e e27/22 3:79d098b4:::rbd_data.112dac7a9dca.0000000000000002:head v 27'10, mlcod=27'8)", 2024-09-13T05:10:20.219 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.119524+0000", 2024-09-13T05:10:20.219 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.028945373, 2024-09-13T05:10:20.219 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022930089999999999, 2024-09-13T05:10:20.220 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.220 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.220 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.220 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.220 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.220 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.119524+0000", 2024-09-13T05:10:20.220 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.220 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.220 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.220 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.220 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.119524+0000", 2024-09-13T05:10:20.220 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.220 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.220 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.221 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.119522+0000", 2024-09-13T05:10:20.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:20.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.221 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.221 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.119561+0000", 2024-09-13T05:10:20.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9082999999999998e-05 2024-09-13T05:10:20.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.221 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.221 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.119593+0000", 2024-09-13T05:10:20.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1652999999999997e-05 2024-09-13T05:10:20.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.222 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.222 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.222 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.119607+0000", 2024-09-13T05:10:20.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4652e-05 2024-09-13T05:10:20.222 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.222 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.222 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.222 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.119735+0000", 2024-09-13T05:10:20.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012778799999999999 2024-09-13T05:10:20.222 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.222 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.222 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.222 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.119799+0000", 2024-09-13T05:10:20.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3411999999999995e-05 2024-09-13T05:10:20.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.121726+0000", 2024-09-13T05:10:20.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001926973 2024-09-13T05:10:20.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.121817+0000", 2024-09-13T05:10:20.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1397999999999995e-05 2024-09-13T05:10:20.223 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.223 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.223 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.224 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.224 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:797 3.1e e27/22 3:79d098b4:::rbd_data.112dac7a9dca.0000000000000002:head v 27'11, mlcod=27'9)", 2024-09-13T05:10:20.224 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.142479+0000", 2024-09-13T05:10:20.224 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.0059907819999996, 2024-09-13T05:10:20.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022740690000000001, 2024-09-13T05:10:20.224 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.224 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.224 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.224 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.224 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.142479+0000", 2024-09-13T05:10:20.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.224 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.225 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.225 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.225 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.142479+0000", 2024-09-13T05:10:20.225 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.225 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.225 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.225 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.225 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.142477+0000", 2024-09-13T05:10:20.225 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:20.225 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.225 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.225 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.225 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.142506+0000", 2024-09-13T05:10:20.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9669999999999999e-05 2024-09-13T05:10:20.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.142540+0000", 2024-09-13T05:10:20.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3151999999999997e-05 2024-09-13T05:10:20.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.142558+0000", 2024-09-13T05:10:20.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8280000000000001e-05 2024-09-13T05:10:20.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.142679+0000", 2024-09-13T05:10:20.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012115100000000001 2024-09-13T05:10:20.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.142743+0000", 2024-09-13T05:10:20.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3699000000000001e-05 2024-09-13T05:10:20.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.144666+0000", 2024-09-13T05:10:20.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001923562 2024-09-13T05:10:20.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.228 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.228 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.144753+0000", 2024-09-13T05:10:20.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6462e-05 2024-09-13T05:10:20.228 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.228 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.228 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.228 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:822 3.1e e27/22 3:79d098b4:::rbd_data.112dac7a9dca.0000000000000002:head v 27'12, mlcod=27'10)", 2024-09-13T05:10:20.228 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.208255+0000", 2024-09-13T05:10:20.228 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.9402146710000001, 2024-09-13T05:10:20.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022768689999999999, 2024-09-13T05:10:20.229 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.229 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.229 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.229 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.229 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.229 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208255+0000", 2024-09-13T05:10:20.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.229 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.229 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.229 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.229 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208255+0000", 2024-09-13T05:10:20.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.229 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.230 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208253+0000", 2024-09-13T05:10:20.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:20.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.230 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208270+0000", 2024-09-13T05:10:20.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7606999999999999e-05 2024-09-13T05:10:20.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208302+0000", 2024-09-13T05:10:20.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1729000000000001e-05 2024-09-13T05:10:20.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208321+0000", 2024-09-13T05:10:20.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8425999999999999e-05 2024-09-13T05:10:20.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208446+0000", 2024-09-13T05:10:20.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012494399999999999 2024-09-13T05:10:20.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.232 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.232 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.232 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208489+0000", 2024-09-13T05:10:20.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3219000000000001e-05 2024-09-13T05:10:20.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.232 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.232 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.210447+0000", 2024-09-13T05:10:20.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0019585570000000001 2024-09-13T05:10:20.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.210532+0000", 2024-09-13T05:10:20.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4307000000000004e-05 2024-09-13T05:10:20.233 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.233 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.233 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.233 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:820 3.3 e27/22 3:c6fd6387:::rbd_data.112dac7a9dca.0000000000000000:head v 27'4, mlcod=25'2)", 2024-09-13T05:10:20.234 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.208622+0000", 2024-09-13T05:10:20.234 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.9398476049999998, 2024-09-13T05:10:20.234 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0026078220000000001, 2024-09-13T05:10:20.234 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.234 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.234 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.234 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.234 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.234 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208622+0000", 2024-09-13T05:10:20.234 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.234 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.234 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.234 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.234 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208622+0000", 2024-09-13T05:10:20.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.235 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208620+0000", 2024-09-13T05:10:20.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:20.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.235 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208639+0000", 2024-09-13T05:10:20.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9443e-05 2024-09-13T05:10:20.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208669+0000", 2024-09-13T05:10:20.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9388999999999999e-05 2024-09-13T05:10:20.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208693+0000", 2024-09-13T05:10:20.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3822999999999999e-05 2024-09-13T05:10:20.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208827+0000", 2024-09-13T05:10:20.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013459400000000001 2024-09-13T05:10:20.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.208882+0000", 2024-09-13T05:10:20.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5318999999999997e-05 2024-09-13T05:10:20.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.211155+0000", 2024-09-13T05:10:20.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022722459999999999 2024-09-13T05:10:20.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.211230+0000", 2024-09-13T05:10:20.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.4938000000000007e-05 2024-09-13T05:10:20.237 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.238 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.238 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.238 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.238 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.238 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:904 3.a 3:535385f0:::rbd_children:head [call rbd.add_child in=12b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-13T05:10:20.238 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.775484+0000", 2024-09-13T05:10:20.238 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.3729855300000002, 2024-09-13T05:10:20.238 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002504311, 2024-09-13T05:10:20.238 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.238 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.238 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.238 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:20.238 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:20.239 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 904 2024-09-13T05:10:20.239 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.239 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.239 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.239 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.239 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.775484+0000", 2024-09-13T05:10:20.239 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.239 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.239 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.239 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.239 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.775484+0000", 2024-09-13T05:10:20.239 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.239 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.240 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.240 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.240 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.775481+0000", 2024-09-13T05:10:20.240 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:10:20.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.240 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.240 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.240 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.775495+0000", 2024-09-13T05:10:20.240 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3332999999999999e-05 2024-09-13T05:10:20.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.240 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.240 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.240 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.775527+0000", 2024-09-13T05:10:20.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2369000000000001e-05 2024-09-13T05:10:20.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.775543+0000", 2024-09-13T05:10:20.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5460000000000001e-05 2024-09-13T05:10:20.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.775662+0000", 2024-09-13T05:10:20.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000119801 2024-09-13T05:10:20.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.775812+0000", 2024-09-13T05:10:20.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000150063 2024-09-13T05:10:20.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:20.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.776145+0000", 2024-09-13T05:10:20.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00033283 2024-09-13T05:10:20.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.777543+0000", 2024-09-13T05:10:20.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0013976139999999999 2024-09-13T05:10:20.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.243 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.243 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.243 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.777780+0000", 2024-09-13T05:10:20.243 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000237505 2024-09-13T05:10:20.243 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.243 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.243 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.243 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.777861+0000", 2024-09-13T05:10:20.243 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1118000000000005e-05 2024-09-13T05:10:20.243 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.243 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.243 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.243 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.777988+0000", 2024-09-13T05:10:20.244 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012670800000000001 2024-09-13T05:10:20.244 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.244 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.244 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.244 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.244 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.244 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:998 3.10 3:0951d16d:::rbd_data.112d65d6a1c8.0000000000000038:head [sparse-read 0~25573] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-13T05:10:20.244 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:16.997415+0000", 2024-09-13T05:10:20.244 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.1510545539999999, 2024-09-13T05:10:20.244 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0028586530000000001, 2024-09-13T05:10:20.244 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.244 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:20.244 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.245 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:20.245 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:20.245 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 998 2024-09-13T05:10:20.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.245 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.245 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.245 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.245 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.997415+0000", 2024-09-13T05:10:20.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.245 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.245 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.245 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.997415+0000", 2024-09-13T05:10:20.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.997414+0000", 2024-09-13T05:10:20.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:20.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.997421+0000", 2024-09-13T05:10:20.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8419999999999999e-06 2024-09-13T05:10:20.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.997434+0000", 2024-09-13T05:10:20.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2945999999999999e-05 2024-09-13T05:10:20.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.997446+0000", 2024-09-13T05:10:20.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1874e-05 2024-09-13T05:10:20.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.999042+0000", 2024-09-13T05:10:20.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0015959710000000001 2024-09-13T05:10:20.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:16.999282+0000", 2024-09-13T05:10:20.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024006799999999999 2024-09-13T05:10:20.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.248 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.248 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:17.000274+0000", 2024-09-13T05:10:20.248 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0009918119999999999 2024-09-13T05:10:20.248 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.248 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.248 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.248 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.248 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:1789 3.a 3:535385f0:::rbd_children:head [call rbd.add_child in=12b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:20.248 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:19.835787+0000", 2024-09-13T05:10:20.248 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.31268192900000003, 2024-09-13T05:10:20.248 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0063379300000000003, 2024-09-13T05:10:20.248 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.249 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.249 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.249 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:20.249 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:20.249 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 1789 2024-09-13T05:10:20.249 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.249 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.249 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.249 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.249 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.835787+0000", 2024-09-13T05:10:20.249 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.249 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.249 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.249 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.835787+0000", 2024-09-13T05:10:20.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.835785+0000", 2024-09-13T05:10:20.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:10:20.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.835802+0000", 2024-09-13T05:10:20.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7555999999999999e-05 2024-09-13T05:10:20.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.835841+0000", 2024-09-13T05:10:20.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8943000000000003e-05 2024-09-13T05:10:20.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.835857+0000", 2024-09-13T05:10:20.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5936000000000001e-05 2024-09-13T05:10:20.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.836006+0000", 2024-09-13T05:10:20.252 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014938000000000001 2024-09-13T05:10:20.252 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.252 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.252 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op must wait for map", 2024-09-13T05:10:20.252 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.836023+0000", 2024-09-13T05:10:20.252 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6986999999999998e-05 2024-09-13T05:10:20.252 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.252 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.252 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.252 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.839686+0000", 2024-09-13T05:10:20.252 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003662603 2024-09-13T05:10:20.252 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.253 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.253 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.253 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.839887+0000", 2024-09-13T05:10:20.253 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020116599999999999 2024-09-13T05:10:20.253 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.253 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.253 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:20.253 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.840256+0000", 2024-09-13T05:10:20.253 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00036894500000000003 2024-09-13T05:10:20.253 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.253 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.253 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.253 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.841605+0000", 2024-09-13T05:10:20.253 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0013488650000000001 2024-09-13T05:10:20.254 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.254 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.254 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.254 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.841992+0000", 2024-09-13T05:10:20.254 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000387198 2024-09-13T05:10:20.254 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.254 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.254 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.254 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.842070+0000", 2024-09-13T05:10:20.255 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7489000000000003e-05 2024-09-13T05:10:20.255 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.255 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.255 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.255 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.842125+0000", 2024-09-13T05:10:20.255 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5748999999999998e-05 2024-09-13T05:10:20.255 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.255 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.255 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.255 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.255 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.256 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:1815 3.3 e30/22 3:c4c358af:::rbd_data.112d318cd671.0000000000000002:head v 30'20, mlcod=29'17)", 2024-09-13T05:10:20.256 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:19.875050+0000", 2024-09-13T05:10:20.256 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.27341893299999998, 2024-09-13T05:10:20.256 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025628109999999999, 2024-09-13T05:10:20.256 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.256 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.256 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.256 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.256 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.256 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.875050+0000", 2024-09-13T05:10:20.256 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.256 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.256 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.256 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.257 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.875050+0000", 2024-09-13T05:10:20.257 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.257 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.257 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.257 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.257 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.875050+0000", 2024-09-13T05:10:20.257 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:20.257 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.257 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.257 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.257 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.875061+0000", 2024-09-13T05:10:20.257 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.111e-05 2024-09-13T05:10:20.257 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.875090+0000", 2024-09-13T05:10:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9116999999999999e-05 2024-09-13T05:10:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.875104+0000", 2024-09-13T05:10:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4239e-05 2024-09-13T05:10:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.258 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.875223+0000", 2024-09-13T05:10:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011901 2024-09-13T05:10:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.875259+0000", 2024-09-13T05:10:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5482999999999999e-05 2024-09-13T05:10:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.877560+0000", 2024-09-13T05:10:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023011009999999998 2024-09-13T05:10:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.259 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.260 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.877613+0000", 2024-09-13T05:10:20.260 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3236000000000003e-05 2024-09-13T05:10:20.260 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.260 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.260 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.260 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.260 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.260 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:1968 3.a 3:5205849f:::rbd_data.112d872fd67a.00000000000000a5:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 387439~5777] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:20.260 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:20.061586+0000", 2024-09-13T05:10:20.260 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.086883504, 2024-09-13T05:10:20.260 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024079819999999999, 2024-09-13T05:10:20.260 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.260 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.260 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.261 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:20.261 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:20.261 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 1968 2024-09-13T05:10:20.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.261 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.261 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.261 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.261 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.061586+0000", 2024-09-13T05:10:20.261 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.261 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.261 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.261 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.061586+0000", 2024-09-13T05:10:20.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.262 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.262 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.262 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.262 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.061584+0000", 2024-09-13T05:10:20.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:20.262 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.262 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.262 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.262 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.061599+0000", 2024-09-13T05:10:20.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5474000000000001e-05 2024-09-13T05:10:20.262 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.262 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.263 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.263 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.061619+0000", 2024-09-13T05:10:20.263 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9680000000000001e-05 2024-09-13T05:10:20.263 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.263 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.263 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.263 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.061628+0000", 2024-09-13T05:10:20.263 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8119999999999997e-06 2024-09-13T05:10:20.263 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.263 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.263 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.263 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.061724+0000", 2024-09-13T05:10:20.263 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6292999999999994e-05 2024-09-13T05:10:20.263 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.264 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.061961+0000", 2024-09-13T05:10:20.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00023690300000000001 2024-09-13T05:10:20.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:20.264 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.062219+0000", 2024-09-13T05:10:20.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025756200000000003 2024-09-13T05:10:20.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.264 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.063800+0000", 2024-09-13T05:10:20.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0015809940000000001 2024-09-13T05:10:20.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.265 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.265 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.063833+0000", 2024-09-13T05:10:20.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3640999999999999e-05 2024-09-13T05:10:20.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.265 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.265 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.063927+0000", 2024-09-13T05:10:20.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4093999999999997e-05 2024-09-13T05:10:20.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.265 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.265 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.063994+0000", 2024-09-13T05:10:20.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6555000000000002e-05 2024-09-13T05:10:20.266 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.266 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.266 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.266 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.266 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.266 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:20.268 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:10:20.269 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:20.263+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:20.269 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:20.269 INFO:teuthology.orchestra.run.smithi120.stdout:535 read 0x9b28e83 thru 0x9b2f319 (0x6497 bytes) 2024-09-13T05:10:20.269 INFO:teuthology.orchestra.run.smithi120.stdout:536 write 0x54c01f8 thru 0x54c5203 (0x500c bytes) 2024-09-13T05:10:20.269 INFO:teuthology.orchestra.run.smithi120.stdout:537 punch from 0x70c436f to 0x70cf9ce, (0xb65f bytes) 2024-09-13T05:10:20.269 INFO:teuthology.orchestra.run.smithi120.stdout:538 write 0xc4e0860 thru 0xc4ef211 (0xe9b2 bytes) 2024-09-13T05:10:20.269 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:20.270 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:20.270 INFO:teuthology.orchestra.run.smithi120.stdout:542 write 0x7fcaea7 thru 0x7fd5c60 (0xadba bytes) 2024-09-13T05:10:20.270 INFO:teuthology.orchestra.run.smithi120.stdout:543 trunc from 0xd1d5f75 to 0x5cb3f77 2024-09-13T05:10:20.270 INFO:teuthology.orchestra.run.smithi120.stdout:545 read 0x30f585a thru 0x30fa540 (0x4ce7 bytes) 2024-09-13T05:10:20.270 INFO:teuthology.orchestra.run.smithi120.stdout:546 write 0x6168250 thru 0x6173101 (0xaeb2 bytes) 2024-09-13T05:10:20.274 INFO:teuthology.orchestra.run.smithi120.stdout:549 write 0x7821192 thru 0x78223d0 (0x123f bytes) 2024-09-13T05:10:20.280 INFO:teuthology.orchestra.run.smithi120.stdout:550 read 0xfafd55 thru 0xfb87b5 (0x8a61 bytes) 2024-09-13T05:10:20.290 INFO:teuthology.orchestra.run.smithi120.stdout:551 trunc from 0x78223d1 to 0x3ede7b5 2024-09-13T05:10:20.341 INFO:teuthology.orchestra.run.smithi120.stdout:552 write 0x1a44a6d thru 0x1a46635 (0x1bc9 bytes) 2024-09-13T05:10:20.348 INFO:teuthology.orchestra.run.smithi120.stdout:553 punch from 0x22e0f81 to 0x22e5514, (0x4593 bytes) 2024-09-13T05:10:20.348 INFO:teuthology.orchestra.run.smithi120.stdout:555 read 0x1abb521 thru 0x1ac1653 (0x6133 bytes) 2024-09-13T05:10:20.348 INFO:teuthology.orchestra.run.smithi120.stdout:562 read 0x36ee26c thru 0x36fcaf5 (0xe88a bytes) 2024-09-13T05:10:20.353 INFO:teuthology.orchestra.run.smithi120.stdout:563 read 0x2c89428 thru 0x2c9660a (0xd1e3 bytes) 2024-09-13T05:10:20.368 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:20.363+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:20.380 INFO:teuthology.orchestra.run.smithi120.stdout:566 write 0xc043e59 thru 0xc04c41b (0x85c3 bytes) 2024-09-13T05:10:20.385 INFO:teuthology.orchestra.run.smithi120.stdout:567 punch from 0x12f0efe to 0x1300949, (0xfa4b bytes) 2024-09-13T05:10:20.385 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:20.385 INFO:teuthology.orchestra.run.smithi120.stdout:569 write 0x740ee08 thru 0x7416597 (0x7790 bytes) 2024-09-13T05:10:20.392 INFO:teuthology.orchestra.run.smithi120.stdout:570 write 0x7134f50 thru 0x713c020 (0x70d1 bytes) 2024-09-13T05:10:20.397 INFO:teuthology.orchestra.run.smithi120.stdout:572 read 0xba08ed2 thru 0xba16ce4 (0xde13 bytes) 2024-09-13T05:10:20.397 INFO:teuthology.orchestra.run.smithi120.stdout:574 read 0x6134cbe thru 0x613f8ed (0xac30 bytes) 2024-09-13T05:10:20.397 INFO:teuthology.orchestra.run.smithi120.stdout:576 read 0xf0cac9 thru 0xf15dcd (0x9305 bytes) 2024-09-13T05:10:20.398 INFO:teuthology.orchestra.run.smithi120.stdout:577 write 0xa5bdc3c thru 0xa5c6122 (0x84e7 bytes) 2024-09-13T05:10:20.407 INFO:teuthology.orchestra.run.smithi120.stdout:578 clone 4 order 19 su 16384 sc 12 2024-09-13T05:10:20.427 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:20.427 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:20.428 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:20.428 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:20.438 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:10:20.468 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:20.463+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:20.546 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:20.546 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:20.546 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:20.546 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:20.546 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:20.556 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:10:20.597 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:20.595+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:20.671 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:20.670+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:20.707 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:20.707 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:20.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:20.707 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:10:20.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.707 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:20.707 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.451581+0000", 2024-09-13T05:10:20.708 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 27.253173792999998, 2024-09-13T05:10:20.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010684878, 2024-09-13T05:10:20.708 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.708 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.708 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.708 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:20.708 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:20.708 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 70 2024-09-13T05:10:20.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.708 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.451581+0000", 2024-09-13T05:10:20.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.709 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.709 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.451581+0000", 2024-09-13T05:10:20.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.709 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.709 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.451579+0000", 2024-09-13T05:10:20.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:20.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.451589+0000", 2024-09-13T05:10:20.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7489999999999993e-06 2024-09-13T05:10:20.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.711 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.711 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.451622+0000", 2024-09-13T05:10:20.711 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2651000000000003e-05 2024-09-13T05:10:20.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.712 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.712 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.712 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.451640+0000", 2024-09-13T05:10:20.712 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8238999999999999e-05 2024-09-13T05:10:20.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.455669+0000", 2024-09-13T05:10:20.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0040290530000000003 2024-09-13T05:10:20.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.714 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.455863+0000", 2024-09-13T05:10:20.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000194379 2024-09-13T05:10:20.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.715 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:20.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.456103+0000", 2024-09-13T05:10:20.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00023963500000000001 2024-09-13T05:10:20.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.716 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.716 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.458065+0000", 2024-09-13T05:10:20.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001961735 2024-09-13T05:10:20.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.716 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.716 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.717 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.462113+0000", 2024-09-13T05:10:20.717 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0040486640000000004 2024-09-13T05:10:20.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.717 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.718 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.462192+0000", 2024-09-13T05:10:20.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9043999999999997e-05 2024-09-13T05:10:20.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.718 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.718 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.462265+0000", 2024-09-13T05:10:20.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3034999999999994e-05 2024-09-13T05:10:20.718 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.718 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.718 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.719 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:20.719 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.688597+0000", 2024-09-13T05:10:20.719 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 27.016157748000001, 2024-09-13T05:10:20.719 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013348512, 2024-09-13T05:10:20.719 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.719 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.719 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.719 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:20.719 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:20.719 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 109 2024-09-13T05:10:20.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.719 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.719 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.720 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.720 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688597+0000", 2024-09-13T05:10:20.720 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.720 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.720 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.720 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688597+0000", 2024-09-13T05:10:20.720 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.720 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.720 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.720 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688596+0000", 2024-09-13T05:10:20.720 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:20.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.721 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.721 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.721 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688775+0000", 2024-09-13T05:10:20.721 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017898999999999999 2024-09-13T05:10:20.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.721 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.721 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.721 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688814+0000", 2024-09-13T05:10:20.721 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9499000000000002e-05 2024-09-13T05:10:20.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.721 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.721 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688853+0000", 2024-09-13T05:10:20.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8976000000000001e-05 2024-09-13T05:10:20.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.695018+0000", 2024-09-13T05:10:20.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0061651079999999999 2024-09-13T05:10:20.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.695182+0000", 2024-09-13T05:10:20.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000163723 2024-09-13T05:10:20.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.723 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:20.723 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.695407+0000", 2024-09-13T05:10:20.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00022512399999999999 2024-09-13T05:10:20.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.723 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.723 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698875+0000", 2024-09-13T05:10:20.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0034678069999999998 2024-09-13T05:10:20.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701846+0000", 2024-09-13T05:10:20.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002970692 2024-09-13T05:10:20.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701903+0000", 2024-09-13T05:10:20.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7944e-05 2024-09-13T05:10:20.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701945+0000", 2024-09-13T05:10:20.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1656000000000002e-05 2024-09-13T05:10:20.725 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.725 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.725 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.725 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:20.725 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.688881+0000", 2024-09-13T05:10:20.725 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 27.015873228, 2024-09-13T05:10:20.725 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013592653, 2024-09-13T05:10:20.725 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.725 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.725 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.725 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:20.726 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:20.726 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 110 2024-09-13T05:10:20.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.726 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.726 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.726 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.726 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688881+0000", 2024-09-13T05:10:20.726 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.727 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.727 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688881+0000", 2024-09-13T05:10:20.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.727 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.727 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688880+0000", 2024-09-13T05:10:20.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:20.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.727 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688891+0000", 2024-09-13T05:10:20.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0727000000000001e-05 2024-09-13T05:10:20.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688908+0000", 2024-09-13T05:10:20.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7390000000000001e-05 2024-09-13T05:10:20.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688926+0000", 2024-09-13T05:10:20.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8216e-05 2024-09-13T05:10:20.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.696278+0000", 2024-09-13T05:10:20.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0073520929999999996 2024-09-13T05:10:20.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.696360+0000", 2024-09-13T05:10:20.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1934999999999994e-05 2024-09-13T05:10:20.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:20.730 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.696541+0000", 2024-09-13T05:10:20.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018114800000000001 2024-09-13T05:10:20.730 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.730 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.730 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.730 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698879+0000", 2024-09-13T05:10:20.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023370650000000001 2024-09-13T05:10:20.730 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.730 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.730 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.730 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702421+0000", 2024-09-13T05:10:20.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0035420500000000001 2024-09-13T05:10:20.730 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.730 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702452+0000", 2024-09-13T05:10:20.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1588999999999999e-05 2024-09-13T05:10:20.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702474+0000", 2024-09-13T05:10:20.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1650000000000001e-05 2024-09-13T05:10:20.731 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.731 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.731 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.731 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:20.732 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.688941+0000", 2024-09-13T05:10:20.732 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 27.015813709, 2024-09-13T05:10:20.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013667653, 2024-09-13T05:10:20.732 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.732 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.732 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.732 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:20.732 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:20.732 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 111 2024-09-13T05:10:20.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.732 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.733 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.733 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688941+0000", 2024-09-13T05:10:20.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.733 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.733 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688941+0000", 2024-09-13T05:10:20.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.733 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.733 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688940+0000", 2024-09-13T05:10:20.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:20.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688949+0000", 2024-09-13T05:10:20.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7629999999999995e-06 2024-09-13T05:10:20.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688982+0000", 2024-09-13T05:10:20.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2446000000000001e-05 2024-09-13T05:10:20.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.688995+0000", 2024-09-13T05:10:20.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3305999999999999e-05 2024-09-13T05:10:20.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.697295+0000", 2024-09-13T05:10:20.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0083001519999999999 2024-09-13T05:10:20.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.697352+0000", 2024-09-13T05:10:20.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6563e-05 2024-09-13T05:10:20.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.736 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:20.736 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.697439+0000", 2024-09-13T05:10:20.736 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7410000000000005e-05 2024-09-13T05:10:20.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.736 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.736 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698884+0000", 2024-09-13T05:10:20.736 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0014450419999999999 2024-09-13T05:10:20.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.736 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.736 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702524+0000", 2024-09-13T05:10:20.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0036397109999999999 2024-09-13T05:10:20.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702570+0000", 2024-09-13T05:10:20.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5608000000000001e-05 2024-09-13T05:10:20.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702608+0000", 2024-09-13T05:10:20.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8608e-05 2024-09-13T05:10:20.738 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.738 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.738 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.738 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:20.738 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.689011+0000", 2024-09-13T05:10:20.738 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 27.015743496999999, 2024-09-13T05:10:20.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013716103, 2024-09-13T05:10:20.738 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.738 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.738 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.738 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:20.738 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:20.739 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 112 2024-09-13T05:10:20.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.739 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689011+0000", 2024-09-13T05:10:20.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689011+0000", 2024-09-13T05:10:20.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.740 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.740 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689010+0000", 2024-09-13T05:10:20.740 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:20.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.740 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.740 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689225+0000", 2024-09-13T05:10:20.740 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021534899999999999 2024-09-13T05:10:20.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.740 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.740 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689247+0000", 2024-09-13T05:10:20.740 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1766000000000001e-05 2024-09-13T05:10:20.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.741 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689262+0000", 2024-09-13T05:10:20.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4769e-05 2024-09-13T05:10:20.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.741 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.697818+0000", 2024-09-13T05:10:20.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0085563710000000001 2024-09-13T05:10:20.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.741 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.697909+0000", 2024-09-13T05:10:20.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1434000000000006e-05 2024-09-13T05:10:20.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:20.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698035+0000", 2024-09-13T05:10:20.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000125971 2024-09-13T05:10:20.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701127+0000", 2024-09-13T05:10:20.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0030915389999999999 2024-09-13T05:10:20.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702664+0000", 2024-09-13T05:10:20.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001536684 2024-09-13T05:10:20.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702702+0000", 2024-09-13T05:10:20.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8617e-05 2024-09-13T05:10:20.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702727+0000", 2024-09-13T05:10:20.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4726e-05 2024-09-13T05:10:20.744 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.744 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.744 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.744 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:20.744 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.689282+0000", 2024-09-13T05:10:20.744 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 27.015472156000001, 2024-09-13T05:10:20.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013657832999999999, 2024-09-13T05:10:20.744 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.744 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.745 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.745 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:20.745 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:20.745 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 113 2024-09-13T05:10:20.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.745 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.745 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.745 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.745 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689282+0000", 2024-09-13T05:10:20.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.745 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.745 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.745 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689282+0000", 2024-09-13T05:10:20.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.746 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689281+0000", 2024-09-13T05:10:20.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:20.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.746 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689291+0000", 2024-09-13T05:10:20.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0349999999999999e-05 2024-09-13T05:10:20.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689308+0000", 2024-09-13T05:10:20.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6469000000000001e-05 2024-09-13T05:10:20.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689321+0000", 2024-09-13T05:10:20.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.31e-05 2024-09-13T05:10:20.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698510+0000", 2024-09-13T05:10:20.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0091895410000000007 2024-09-13T05:10:20.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698566+0000", 2024-09-13T05:10:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6008999999999999e-05 2024-09-13T05:10:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698649+0000", 2024-09-13T05:10:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2562e-05 2024-09-13T05:10:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701957+0000", 2024-09-13T05:10:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033086029999999998 2024-09-13T05:10:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702878+0000", 2024-09-13T05:10:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00092051000000000003 2024-09-13T05:10:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702911+0000", 2024-09-13T05:10:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3327999999999997e-05 2024-09-13T05:10:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702940+0000", 2024-09-13T05:10:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8744000000000001e-05 2024-09-13T05:10:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.689333+0000", 2024-09-13T05:10:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 27.015420930000001, 2024-09-13T05:10:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013692216, 2024-09-13T05:10:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 114 2024-09-13T05:10:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689333+0000", 2024-09-13T05:10:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689333+0000", 2024-09-13T05:10:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689332+0000", 2024-09-13T05:10:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689342+0000", 2024-09-13T05:10:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5629999999999998e-06 2024-09-13T05:10:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689358+0000", 2024-09-13T05:10:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.552e-05 2024-09-13T05:10:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689375+0000", 2024-09-13T05:10:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7180000000000002e-05 2024-09-13T05:10:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698905+0000", 2024-09-13T05:10:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0095304499999999993 2024-09-13T05:10:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.698954+0000", 2024-09-13T05:10:20.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8702999999999998e-05 2024-09-13T05:10:20.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:20.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.699029+0000", 2024-09-13T05:10:20.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.4857000000000005e-05 2024-09-13T05:10:20.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701965+0000", 2024-09-13T05:10:20.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002936059 2024-09-13T05:10:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702983+0000", 2024-09-13T05:10:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0010183169999999999 2024-09-13T05:10:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.703007+0000", 2024-09-13T05:10:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4100999999999998e-05 2024-09-13T05:10:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.703026+0000", 2024-09-13T05:10:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8473000000000001e-05 2024-09-13T05:10:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.689416+0000", 2024-09-13T05:10:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 27.015338711999998, 2024-09-13T05:10:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013724638000000001, 2024-09-13T05:10:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 115 2024-09-13T05:10:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689416+0000", 2024-09-13T05:10:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689416+0000", 2024-09-13T05:10:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689414+0000", 2024-09-13T05:10:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689603+0000", 2024-09-13T05:10:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018881599999999999 2024-09-13T05:10:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689626+0000", 2024-09-13T05:10:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3025999999999999e-05 2024-09-13T05:10:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689646+0000", 2024-09-13T05:10:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9585999999999998e-05 2024-09-13T05:10:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.699361+0000", 2024-09-13T05:10:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0097155249999999992 2024-09-13T05:10:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.699460+0000", 2024-09-13T05:10:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8339999999999997e-05 2024-09-13T05:10:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.699627+0000", 2024-09-13T05:10:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000166992 2024-09-13T05:10:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701970+0000", 2024-09-13T05:10:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023433569999999999 2024-09-13T05:10:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.703072+0000", 2024-09-13T05:10:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00110228 2024-09-13T05:10:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.703110+0000", 2024-09-13T05:10:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7385999999999997e-05 2024-09-13T05:10:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.703140+0000", 2024-09-13T05:10:20.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0530000000000001e-05 2024-09-13T05:10:20.762 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.762 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.762 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.762 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:20.762 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.689662+0000", 2024-09-13T05:10:20.762 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 27.015092487, 2024-09-13T05:10:20.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013592956, 2024-09-13T05:10:20.763 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.763 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.763 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.763 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:20.763 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:20.763 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 116 2024-09-13T05:10:20.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.764 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689662+0000", 2024-09-13T05:10:20.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.769 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.769 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689662+0000", 2024-09-13T05:10:20.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689661+0000", 2024-09-13T05:10:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689672+0000", 2024-09-13T05:10:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0672999999999999e-05 2024-09-13T05:10:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689687+0000", 2024-09-13T05:10:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5588999999999999e-05 2024-09-13T05:10:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689702+0000", 2024-09-13T05:10:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.447e-05 2024-09-13T05:10:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.700376+0000", 2024-09-13T05:10:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010673945000000001 2024-09-13T05:10:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.700498+0000", 2024-09-13T05:10:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012220699999999999 2024-09-13T05:10:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.700666+0000", 2024-09-13T05:10:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016788400000000001 2024-09-13T05:10:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701979+0000", 2024-09-13T05:10:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0013135530000000001 2024-09-13T05:10:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.703182+0000", 2024-09-13T05:10:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00120235 2024-09-13T05:10:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.703229+0000", 2024-09-13T05:10:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7966000000000001e-05 2024-09-13T05:10:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.703255+0000", 2024-09-13T05:10:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5361999999999999e-05 2024-09-13T05:10:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:53.689785+0000", 2024-09-13T05:10:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 27.01496891, 2024-09-13T05:10:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.015287752999999999, 2024-09-13T05:10:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 117 2024-09-13T05:10:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689785+0000", 2024-09-13T05:10:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689785+0000", 2024-09-13T05:10:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689784+0000", 2024-09-13T05:10:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689795+0000", 2024-09-13T05:10:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1014e-05 2024-09-13T05:10:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689812+0000", 2024-09-13T05:10:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6186000000000001e-05 2024-09-13T05:10:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.689826+0000", 2024-09-13T05:10:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4003e-05 2024-09-13T05:10:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701187+0000", 2024-09-13T05:10:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.011361509000000001 2024-09-13T05:10:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701291+0000", 2024-09-13T05:10:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010432 2024-09-13T05:10:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.701443+0000", 2024-09-13T05:10:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00015149599999999999 2024-09-13T05:10:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.702218+0000", 2024-09-13T05:10:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00077520900000000001 2024-09-13T05:10:20.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.705010+0000", 2024-09-13T05:10:20.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0027916909999999998 2024-09-13T05:10:20.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.705050+0000", 2024-09-13T05:10:20.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0080000000000003e-05 2024-09-13T05:10:20.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:53.705073+0000", 2024-09-13T05:10:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3402000000000001e-05 2024-09-13T05:10:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:54.247728+0000", 2024-09-13T05:10:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 26.457026751000001, 2024-09-13T05:10:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010677212, 2024-09-13T05:10:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:20.781 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:20.781 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 134 2024-09-13T05:10:20.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.781 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247728+0000", 2024-09-13T05:10:20.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247728+0000", 2024-09-13T05:10:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247727+0000", 2024-09-13T05:10:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247801+0000", 2024-09-13T05:10:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3881999999999995e-05 2024-09-13T05:10:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247820+0000", 2024-09-13T05:10:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8709999999999999e-05 2024-09-13T05:10:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247826+0000", 2024-09-13T05:10:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8109999999999997e-06 2024-09-13T05:10:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.250826+0000", 2024-09-13T05:10:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002999182 2024-09-13T05:10:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.250909+0000", 2024-09-13T05:10:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.3876999999999997e-05 2024-09-13T05:10:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.251006+0000", 2024-09-13T05:10:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6100999999999994e-05 2024-09-13T05:10:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.255154+0000", 2024-09-13T05:10:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0041481060000000004 2024-09-13T05:10:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.258281+0000", 2024-09-13T05:10:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0031276530000000002 2024-09-13T05:10:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.258345+0000", 2024-09-13T05:10:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3898000000000004e-05 2024-09-13T05:10:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.258405+0000", 2024-09-13T05:10:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9626999999999997e-05 2024-09-13T05:10:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:54.247851+0000", 2024-09-13T05:10:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 26.456902925000001, 2024-09-13T05:10:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010771443, 2024-09-13T05:10:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 135 2024-09-13T05:10:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247851+0000", 2024-09-13T05:10:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247851+0000", 2024-09-13T05:10:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247851+0000", 2024-09-13T05:10:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247855+0000", 2024-09-13T05:10:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3000000000000003e-06 2024-09-13T05:10:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247863+0000", 2024-09-13T05:10:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3599999999999998e-06 2024-09-13T05:10:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247867+0000", 2024-09-13T05:10:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4059999999999998e-06 2024-09-13T05:10:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.251631+0000", 2024-09-13T05:10:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0037639240000000001 2024-09-13T05:10:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.251697+0000", 2024-09-13T05:10:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6330999999999999e-05 2024-09-13T05:10:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.251794+0000", 2024-09-13T05:10:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6967999999999997e-05 2024-09-13T05:10:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.255160+0000", 2024-09-13T05:10:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033660249999999999 2024-09-13T05:10:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.258485+0000", 2024-09-13T05:10:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003325106 2024-09-13T05:10:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.258564+0000", 2024-09-13T05:10:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8312999999999994e-05 2024-09-13T05:10:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.258623+0000", 2024-09-13T05:10:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9200000000000002e-05 2024-09-13T05:10:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:54.247871+0000", 2024-09-13T05:10:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 26.456882961000002, 2024-09-13T05:10:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012387007, 2024-09-13T05:10:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 136 2024-09-13T05:10:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247871+0000", 2024-09-13T05:10:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247871+0000", 2024-09-13T05:10:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247871+0000", 2024-09-13T05:10:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247874+0000", 2024-09-13T05:10:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1939999999999998e-06 2024-09-13T05:10:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247881+0000", 2024-09-13T05:10:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.348e-06 2024-09-13T05:10:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247885+0000", 2024-09-13T05:10:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.493e-06 2024-09-13T05:10:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.252194+0000", 2024-09-13T05:10:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.004309205 2024-09-13T05:10:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.252288+0000", 2024-09-13T05:10:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3493999999999996e-05 2024-09-13T05:10:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.252390+0000", 2024-09-13T05:10:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010268900000000001 2024-09-13T05:10:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.257654+0000", 2024-09-13T05:10:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0052632629999999998 2024-09-13T05:10:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260190+0000", 2024-09-13T05:10:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025365129999999998 2024-09-13T05:10:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260227+0000", 2024-09-13T05:10:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6786999999999999e-05 2024-09-13T05:10:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260258+0000", 2024-09-13T05:10:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1390999999999998e-05 2024-09-13T05:10:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:54.247889+0000", 2024-09-13T05:10:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 26.456865119, 2024-09-13T05:10:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012593038000000001, 2024-09-13T05:10:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137 2024-09-13T05:10:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247889+0000", 2024-09-13T05:10:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247889+0000", 2024-09-13T05:10:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247889+0000", 2024-09-13T05:10:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247982+0000", 2024-09-13T05:10:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3286000000000001e-05 2024-09-13T05:10:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.247995+0000", 2024-09-13T05:10:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2785e-05 2024-09-13T05:10:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248003+0000", 2024-09-13T05:10:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7400000000000004e-06 2024-09-13T05:10:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.252911+0000", 2024-09-13T05:10:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0049082259999999999 2024-09-13T05:10:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.252987+0000", 2024-09-13T05:10:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5841999999999997e-05 2024-09-13T05:10:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.253076+0000", 2024-09-13T05:10:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8790999999999997e-05 2024-09-13T05:10:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.257669+0000", 2024-09-13T05:10:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0045932810000000003 2024-09-13T05:10:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260344+0000", 2024-09-13T05:10:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0026755500000000001 2024-09-13T05:10:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260419+0000", 2024-09-13T05:10:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.4344999999999994e-05 2024-09-13T05:10:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260482+0000", 2024-09-13T05:10:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3571999999999994e-05 2024-09-13T05:10:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:54.248017+0000", 2024-09-13T05:10:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 26.456737650000001, 2024-09-13T05:10:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012591819000000001, 2024-09-13T05:10:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 138 2024-09-13T05:10:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248017+0000", 2024-09-13T05:10:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248017+0000", 2024-09-13T05:10:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248016+0000", 2024-09-13T05:10:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248022+0000", 2024-09-13T05:10:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9290000000000003e-06 2024-09-13T05:10:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248032+0000", 2024-09-13T05:10:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0067e-05 2024-09-13T05:10:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248039+0000", 2024-09-13T05:10:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.131e-06 2024-09-13T05:10:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.253989+0000", 2024-09-13T05:10:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.005949953 2024-09-13T05:10:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.254066+0000", 2024-09-13T05:10:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6835999999999994e-05 2024-09-13T05:10:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.254173+0000", 2024-09-13T05:10:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107392 2024-09-13T05:10:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.257699+0000", 2024-09-13T05:10:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003525622 2024-09-13T05:10:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260545+0000", 2024-09-13T05:10:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0028464240000000002 2024-09-13T05:10:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260579+0000", 2024-09-13T05:10:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3559999999999997e-05 2024-09-13T05:10:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260609+0000", 2024-09-13T05:10:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9773000000000001e-05 2024-09-13T05:10:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:54.248046+0000", 2024-09-13T05:10:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 26.456708063000001, 2024-09-13T05:10:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012766753, 2024-09-13T05:10:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 139 2024-09-13T05:10:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248046+0000", 2024-09-13T05:10:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248046+0000", 2024-09-13T05:10:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248046+0000", 2024-09-13T05:10:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248051+0000", 2024-09-13T05:10:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9060000000000001e-06 2024-09-13T05:10:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248060+0000", 2024-09-13T05:10:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8799999999999997e-06 2024-09-13T05:10:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248068+0000", 2024-09-13T05:10:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1880000000000002e-06 2024-09-13T05:10:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.254569+0000", 2024-09-13T05:10:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0065017749999999996 2024-09-13T05:10:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.254633+0000", 2024-09-13T05:10:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3781000000000005e-05 2024-09-13T05:10:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.254731+0000", 2024-09-13T05:10:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8078000000000005e-05 2024-09-13T05:10:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.257720+0000", 2024-09-13T05:10:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0029886859999999999 2024-09-13T05:10:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260684+0000", 2024-09-13T05:10:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0029637999999999999 2024-09-13T05:10:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260759+0000", 2024-09-13T05:10:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.4840999999999997e-05 2024-09-13T05:10:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260813+0000", 2024-09-13T05:10:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4404000000000003e-05 2024-09-13T05:10:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:54.248075+0000", 2024-09-13T05:10:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 26.456679681000001, 2024-09-13T05:10:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012859842999999999, 2024-09-13T05:10:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 140 2024-09-13T05:10:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248075+0000", 2024-09-13T05:10:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248075+0000", 2024-09-13T05:10:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248074+0000", 2024-09-13T05:10:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248203+0000", 2024-09-13T05:10:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012832300000000001 2024-09-13T05:10:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248214+0000", 2024-09-13T05:10:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1472e-05 2024-09-13T05:10:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248223+0000", 2024-09-13T05:10:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7110000000000001e-06 2024-09-13T05:10:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.255480+0000", 2024-09-13T05:10:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0072569890000000001 2024-09-13T05:10:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.255544+0000", 2024-09-13T05:10:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4790999999999997e-05 2024-09-13T05:10:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.255641+0000", 2024-09-13T05:10:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6411999999999998e-05 2024-09-13T05:10:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.258650+0000", 2024-09-13T05:10:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003008925 2024-09-13T05:10:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260873+0000", 2024-09-13T05:10:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002223334 2024-09-13T05:10:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260907+0000", 2024-09-13T05:10:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4267999999999998e-05 2024-09-13T05:10:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.260935+0000", 2024-09-13T05:10:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7138e-05 2024-09-13T05:10:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T05:10:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:54.248235+0000", 2024-09-13T05:10:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 26.456519116999999, 2024-09-13T05:10:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012905777, 2024-09-13T05:10:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 141 2024-09-13T05:10:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248235+0000", 2024-09-13T05:10:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248235+0000", 2024-09-13T05:10:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248234+0000", 2024-09-13T05:10:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248241+0000", 2024-09-13T05:10:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1229999999999997e-06 2024-09-13T05:10:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248248+0000", 2024-09-13T05:10:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6690000000000006e-06 2024-09-13T05:10:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.248255+0000", 2024-09-13T05:10:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3040000000000001e-06 2024-09-13T05:10:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.256428+0000", 2024-09-13T05:10:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.008173909 2024-09-13T05:10:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.256571+0000", 2024-09-13T05:10:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014262500000000001 2024-09-13T05:10:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.256745+0000", 2024-09-13T05:10:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017362700000000001 2024-09-13T05:10:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.258854+0000", 2024-09-13T05:10:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002109695 2024-09-13T05:10:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.261007+0000", 2024-09-13T05:10:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002152583 2024-09-13T05:10:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.261083+0000", 2024-09-13T05:10:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6002999999999997e-05 2024-09-13T05:10:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:54.261141+0000", 2024-09-13T05:10:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8057000000000003e-05 2024-09-13T05:10:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-13T05:10:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:55.053986+0000", 2024-09-13T05:10:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 25.650768262, 2024-09-13T05:10:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.011038081, 2024-09-13T05:10:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 158 2024-09-13T05:10:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.053986+0000", 2024-09-13T05:10:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.053986+0000", 2024-09-13T05:10:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.053985+0000", 2024-09-13T05:10:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054089+0000", 2024-09-13T05:10:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000103755 2024-09-13T05:10:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054125+0000", 2024-09-13T05:10:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5831000000000003e-05 2024-09-13T05:10:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054133+0000", 2024-09-13T05:10:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7139999999999993e-06 2024-09-13T05:10:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.061270+0000", 2024-09-13T05:10:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0071370490000000003 2024-09-13T05:10:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.061478+0000", 2024-09-13T05:10:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020772600000000001 2024-09-13T05:10:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.061704+0000", 2024-09-13T05:10:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00022674300000000001 2024-09-13T05:10:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.064234+0000", 2024-09-13T05:10:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025300990000000001 2024-09-13T05:10:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.064930+0000", 2024-09-13T05:10:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00069559000000000005 2024-09-13T05:10:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.064989+0000", 2024-09-13T05:10:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9240999999999997e-05 2024-09-13T05:10:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.065024+0000", 2024-09-13T05:10:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4987000000000002e-05 2024-09-13T05:10:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4213.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-13T05:10:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:09:55.054145+0000", 2024-09-13T05:10:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 25.650609185, 2024-09-13T05:10:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.011611452, 2024-09-13T05:10:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4213", 2024-09-13T05:10:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.137:0/3057712918", 2024-09-13T05:10:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 159 2024-09-13T05:10:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054145+0000", 2024-09-13T05:10:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054145+0000", 2024-09-13T05:10:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054145+0000", 2024-09-13T05:10:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054154+0000", 2024-09-13T05:10:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1619999999999997e-06 2024-09-13T05:10:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054164+0000", 2024-09-13T05:10:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8740000000000007e-06 2024-09-13T05:10:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.054170+0000", 2024-09-13T05:10:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3029999999999996e-06 2024-09-13T05:10:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.062773+0000", 2024-09-13T05:10:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0086030220000000001 2024-09-13T05:10:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.062998+0000", 2024-09-13T05:10:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00022516100000000001 2024-09-13T05:10:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.063265+0000", 2024-09-13T05:10:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00026744300000000002 2024-09-13T05:10:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.064693+0000", 2024-09-13T05:10:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001427537 2024-09-13T05:10:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.065665+0000", 2024-09-13T05:10:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00097195500000000004 2024-09-13T05:10:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.065725+0000", 2024-09-13T05:10:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0025000000000002e-05 2024-09-13T05:10:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:09:55.065757+0000", 2024-09-13T05:10:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1664e-05 2024-09-13T05:10:20.838 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.838 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.838 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.838 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:20.838 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:20.838 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:20.840 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is set 2024-09-13T05:10:20.840 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:20.834+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:20.840 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:10:20.870 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone3 from 0xc04c41c (overlap 0x3ede7b5) to 0x1f6f3da 2024-09-13T05:10:20.940 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:20.935+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:21.001 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:21.002 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:21.002 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:10:21.002 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:21.012 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:10:21.041 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:21.038+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:21.119 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #2, image image_client.0-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent3 2024-09-13T05:10:21.120 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:21.120 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:21.120 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:21.121 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:21.121 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:21.130 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:10:21.142 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:21.138+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:21.154 INFO:teuthology.orchestra.run.smithi120.stdout:579 punch from 0x1796d06 to 0x17a6a70, (0xfd6a bytes) 2024-09-13T05:10:21.163 INFO:teuthology.orchestra.run.smithi120.stdout:581 writesame 0x6d63225 thru 0x6d68e80 data_size 0x2(0x5c5c bytes) 2024-09-13T05:10:21.183 INFO:teuthology.orchestra.run.smithi120.stdout:583 write 0x2396c86 thru 0x239c889 (0x5c04 bytes) 2024-09-13T05:10:21.200 INFO:teuthology.orchestra.run.smithi120.stdout:584 write 0x290d827 thru 0x291cfc5 (0xf79f bytes) 2024-09-13T05:10:21.221 INFO:teuthology.orchestra.run.smithi120.stdout:585 writesame 0x27ea10d thru 0x27f96d2 data_size 0x2(0xf5c6 bytes) 2024-09-13T05:10:21.243 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:21.238+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:21.246 INFO:teuthology.orchestra.run.smithi120.stdout:586 read 0x6247051 thru 0x6255d1b (0xeccb bytes) 2024-09-13T05:10:21.247 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:21.247 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:21.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:21.247 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:21.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.247 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4213.0:133 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'91, mlcod=15'85)", 2024-09-13T05:10:21.247 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:54.250380+0000", 2024-09-13T05:10:21.248 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.994843793000001, 2024-09-13T05:10:21.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070360809999999996, 2024-09-13T05:10:21.248 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.248 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.248 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.250380+0000", 2024-09-13T05:10:21.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.250380+0000", 2024-09-13T05:10:21.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.250378+0000", 2024-09-13T05:10:21.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:21.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.250398+0000", 2024-09-13T05:10:21.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9547000000000001e-05 2024-09-13T05:10:21.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.250419+0000", 2024-09-13T05:10:21.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0551999999999999e-05 2024-09-13T05:10:21.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.250430+0000", 2024-09-13T05:10:21.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1559999999999999e-05 2024-09-13T05:10:21.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.251414+0000", 2024-09-13T05:10:21.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00098380499999999992 2024-09-13T05:10:21.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.251464+0000", 2024-09-13T05:10:21.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9965e-05 2024-09-13T05:10:21.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.257351+0000", 2024-09-13T05:10:21.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058866040000000001 2024-09-13T05:10:21.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.257416+0000", 2024-09-13T05:10:21.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5728000000000005e-05 2024-09-13T05:10:21.252 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.252 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.252 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.252 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4213.0:134 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'92, mlcod=15'85)", 2024-09-13T05:10:21.252 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:54.250943+0000", 2024-09-13T05:10:21.252 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.994280981999999, 2024-09-13T05:10:21.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065131590000000001, 2024-09-13T05:10:21.252 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.252 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.252 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.250943+0000", 2024-09-13T05:10:21.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.250943+0000", 2024-09-13T05:10:21.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.250941+0000", 2024-09-13T05:10:21.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:21.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.251001+0000", 2024-09-13T05:10:21.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9769000000000003e-05 2024-09-13T05:10:21.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.251036+0000", 2024-09-13T05:10:21.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5076000000000001e-05 2024-09-13T05:10:21.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.251048+0000", 2024-09-13T05:10:21.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.201e-05 2024-09-13T05:10:21.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.252173+0000", 2024-09-13T05:10:21.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011253509999999999 2024-09-13T05:10:21.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.252207+0000", 2024-09-13T05:10:21.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4066000000000002e-05 2024-09-13T05:10:21.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.257423+0000", 2024-09-13T05:10:21.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052157810000000001 2024-09-13T05:10:21.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.257456+0000", 2024-09-13T05:10:21.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2945999999999999e-05 2024-09-13T05:10:21.256 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.256 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.256 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.256 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4213.0:136 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'94, mlcod=15'85)", 2024-09-13T05:10:21.257 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:54.252220+0000", 2024-09-13T05:10:21.257 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.993003473000002, 2024-09-13T05:10:21.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0074452040000000004, 2024-09-13T05:10:21.257 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.257 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.257 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.252220+0000", 2024-09-13T05:10:21.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.252220+0000", 2024-09-13T05:10:21.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.252219+0000", 2024-09-13T05:10:21.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:21.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.252231+0000", 2024-09-13T05:10:21.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1545999999999999e-05 2024-09-13T05:10:21.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.252263+0000", 2024-09-13T05:10:21.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1819999999999997e-05 2024-09-13T05:10:21.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.252278+0000", 2024-09-13T05:10:21.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5553000000000002e-05 2024-09-13T05:10:21.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.254067+0000", 2024-09-13T05:10:21.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017887020000000001 2024-09-13T05:10:21.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.254114+0000", 2024-09-13T05:10:21.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7539e-05 2024-09-13T05:10:21.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.259603+0000", 2024-09-13T05:10:21.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054890759999999999 2024-09-13T05:10:21.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.259666+0000", 2024-09-13T05:10:21.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2201999999999998e-05 2024-09-13T05:10:21.261 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.261 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.261 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.261 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4213.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'85)", 2024-09-13T05:10:21.261 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:09:54.253017+0000", 2024-09-13T05:10:21.261 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.992207291, 2024-09-13T05:10:21.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066770839999999998, 2024-09-13T05:10:21.261 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.261 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.261 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.253017+0000", 2024-09-13T05:10:21.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.253017+0000", 2024-09-13T05:10:21.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.253014+0000", 2024-09-13T05:10:21.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:10:21.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.253088+0000", 2024-09-13T05:10:21.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3777999999999997e-05 2024-09-13T05:10:21.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.253127+0000", 2024-09-13T05:10:21.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9348999999999999e-05 2024-09-13T05:10:21.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.253167+0000", 2024-09-13T05:10:21.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9913000000000002e-05 2024-09-13T05:10:21.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.254698+0000", 2024-09-13T05:10:21.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015305360000000001 2024-09-13T05:10:21.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.254735+0000", 2024-09-13T05:10:21.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7579000000000001e-05 2024-09-13T05:10:21.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.259669+0000", 2024-09-13T05:10:21.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00493327 2024-09-13T05:10:21.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:09:54.259694+0000", 2024-09-13T05:10:21.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5148999999999999e-05 2024-09-13T05:10:21.265 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.265 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.265 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.265 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-13T05:10:21.265 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:11.667898+0000", 2024-09-13T05:10:21.265 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.5773257209999993, 2024-09-13T05:10:21.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.008082657, 2024-09-13T05:10:21.266 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.266 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.266 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.266 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.266 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.266 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11 2024-09-13T05:10:21.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.266 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.667898+0000", 2024-09-13T05:10:21.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.667898+0000", 2024-09-13T05:10:21.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.667896+0000", 2024-09-13T05:10:21.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:21.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.667909+0000", 2024-09-13T05:10:21.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2808e-05 2024-09-13T05:10:21.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.667928+0000", 2024-09-13T05:10:21.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9153000000000001e-05 2024-09-13T05:10:21.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.667938+0000", 2024-09-13T05:10:21.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0990000000000005e-06 2024-09-13T05:10:21.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.667990+0000", 2024-09-13T05:10:21.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2546999999999997e-05 2024-09-13T05:10:21.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-13T05:10:21.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.667994+0000", 2024-09-13T05:10:21.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9539999999999998e-06 2024-09-13T05:10:21.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.671064+0000", 2024-09-13T05:10:21.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030704650000000001 2024-09-13T05:10:21.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.671232+0000", 2024-09-13T05:10:21.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016773299999999999 2024-09-13T05:10:21.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:10:21.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.671436+0000", 2024-09-13T05:10:21.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020358 2024-09-13T05:10:21.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:21.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.673340+0000", 2024-09-13T05:10:21.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001903821 2024-09-13T05:10:21.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:21.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.675901+0000", 2024-09-13T05:10:21.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025612429999999999 2024-09-13T05:10:21.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.675948+0000", 2024-09-13T05:10:21.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7456000000000001e-05 2024-09-13T05:10:21.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.675981+0000", 2024-09-13T05:10:21.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2570999999999997e-05 2024-09-13T05:10:21.271 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.271 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.271 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.271 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:838 3.17 3:ed69f8ff:::rbd_header.112dac7a9dca:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-13T05:10:21.271 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:16.683379+0000", 2024-09-13T05:10:21.272 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.5618446559999999, 2024-09-13T05:10:21.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007722685, 2024-09-13T05:10:21.272 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.272 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.272 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.272 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.272 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.272 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 838 2024-09-13T05:10:21.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.272 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.683379+0000", 2024-09-13T05:10:21.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.683379+0000", 2024-09-13T05:10:21.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.683376+0000", 2024-09-13T05:10:21.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999967 2024-09-13T05:10:21.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.683395+0000", 2024-09-13T05:10:21.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9303000000000001e-05 2024-09-13T05:10:21.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.683431+0000", 2024-09-13T05:10:21.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5746e-05 2024-09-13T05:10:21.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.683448+0000", 2024-09-13T05:10:21.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7350000000000002e-05 2024-09-13T05:10:21.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.683582+0000", 2024-09-13T05:10:21.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013308999999999999 2024-09-13T05:10:21.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-13T05:10:21.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.683592+0000", 2024-09-13T05:10:21.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.045e-05 2024-09-13T05:10:21.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.687692+0000", 2024-09-13T05:10:21.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041004140000000001 2024-09-13T05:10:21.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.687772+0000", 2024-09-13T05:10:21.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9291999999999999e-05 2024-09-13T05:10:21.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:10:21.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.688112+0000", 2024-09-13T05:10:21.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00034046899999999998 2024-09-13T05:10:21.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:21.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.688879+0000", 2024-09-13T05:10:21.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00076715500000000005 2024-09-13T05:10:21.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:21.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.691031+0000", 2024-09-13T05:10:21.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021517569999999998 2024-09-13T05:10:21.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.691075+0000", 2024-09-13T05:10:21.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3615999999999997e-05 2024-09-13T05:10:21.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.691102+0000", 2024-09-13T05:10:21.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7310000000000001e-05 2024-09-13T05:10:21.277 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.277 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.278 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.278 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:1710 3.12 3:4a994a25:::rbd_header.112d318cd671:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:21.278 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:19.711454+0000", 2024-09-13T05:10:21.278 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.533769519, 2024-09-13T05:10:21.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083770449999999996, 2024-09-13T05:10:21.278 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.278 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.278 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1710 2024-09-13T05:10:21.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.279 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.711454+0000", 2024-09-13T05:10:21.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.711454+0000", 2024-09-13T05:10:21.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.711450+0000", 2024-09-13T05:10:21.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999957 2024-09-13T05:10:21.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.711474+0000", 2024-09-13T05:10:21.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4309999999999999e-05 2024-09-13T05:10:21.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.711518+0000", 2024-09-13T05:10:21.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3902000000000001e-05 2024-09-13T05:10:21.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.711536+0000", 2024-09-13T05:10:21.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7920000000000001e-05 2024-09-13T05:10:21.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.711697+0000", 2024-09-13T05:10:21.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016134299999999999 2024-09-13T05:10:21.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-13T05:10:21.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.711715+0000", 2024-09-13T05:10:21.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7606000000000001e-05 2024-09-13T05:10:21.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.717654+0000", 2024-09-13T05:10:21.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005938886 2024-09-13T05:10:21.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.717741+0000", 2024-09-13T05:10:21.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6652999999999999e-05 2024-09-13T05:10:21.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:10:21.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.718064+0000", 2024-09-13T05:10:21.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032323600000000002 2024-09-13T05:10:21.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:21.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.718853+0000", 2024-09-13T05:10:21.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00078914100000000004 2024-09-13T05:10:21.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:21.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.719769+0000", 2024-09-13T05:10:21.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00091599400000000005 2024-09-13T05:10:21.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.719804+0000", 2024-09-13T05:10:21.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5380999999999999e-05 2024-09-13T05:10:21.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.719831+0000", 2024-09-13T05:10:21.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7117000000000001e-05 2024-09-13T05:10:21.284 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.284 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.284 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.285 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2299 3.1f 3:fcf22bd6:::rbd_data.112d872fd67a.00000000000000c7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:21.285 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.299333+0000", 2024-09-13T05:10:21.285 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.94589100699999995, 2024-09-13T05:10:21.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006640773, 2024-09-13T05:10:21.285 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.285 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.285 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.285 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.285 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.285 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2299 2024-09-13T05:10:21.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.286 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.299333+0000", 2024-09-13T05:10:21.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.299333+0000", 2024-09-13T05:10:21.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.299331+0000", 2024-09-13T05:10:21.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:21.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.299339+0000", 2024-09-13T05:10:21.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1140000000000006e-06 2024-09-13T05:10:21.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.299354+0000", 2024-09-13T05:10:21.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.472e-05 2024-09-13T05:10:21.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.299365+0000", 2024-09-13T05:10:21.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1028e-05 2024-09-13T05:10:21.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.299582+0000", 2024-09-13T05:10:21.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000217307 2024-09-13T05:10:21.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.299710+0000", 2024-09-13T05:10:21.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000127019 2024-09-13T05:10:21.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:10:21.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.299923+0000", 2024-09-13T05:10:21.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021322999999999999 2024-09-13T05:10:21.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:21.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.304339+0000", 2024-09-13T05:10:21.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044157770000000001 2024-09-13T05:10:21.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:21.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.305898+0000", 2024-09-13T05:10:21.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015590350000000001 2024-09-13T05:10:21.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.305941+0000", 2024-09-13T05:10:21.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3571e-05 2024-09-13T05:10:21.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.305974+0000", 2024-09-13T05:10:21.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2589999999999998e-05 2024-09-13T05:10:21.290 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.290 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.290 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.290 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2722 3.1f 3:fdd42d2d:::rbd_data.112d872fd67a.000000000000004f:head [stat,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:21.290 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.888236+0000", 2024-09-13T05:10:21.291 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.35698824600000001, 2024-09-13T05:10:21.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064937329999999998, 2024-09-13T05:10:21.291 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.291 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:21.291 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.291 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.291 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.291 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2722 2024-09-13T05:10:21.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.291 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.888236+0000", 2024-09-13T05:10:21.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.888236+0000", 2024-09-13T05:10:21.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.888235+0000", 2024-09-13T05:10:21.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:21.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.888241+0000", 2024-09-13T05:10:21.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9209999999999997e-06 2024-09-13T05:10:21.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.888253+0000", 2024-09-13T05:10:21.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2850000000000001e-05 2024-09-13T05:10:21.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.888261+0000", 2024-09-13T05:10:21.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7910000000000005e-06 2024-09-13T05:10:21.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.888317+0000", 2024-09-13T05:10:21.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5708000000000003e-05 2024-09-13T05:10:21.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.888446+0000", 2024-09-13T05:10:21.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000129228 2024-09-13T05:10:21.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.894729+0000", 2024-09-13T05:10:21.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062832850000000004 2024-09-13T05:10:21.294 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.294 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.295 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.295 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2831 3.17 3:ea513804:::rbd_data.112d872fd67a.0000000000000052:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:21.295 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.903990+0000", 2024-09-13T05:10:21.295 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.34123442199999998, 2024-09-13T05:10:21.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063590599999999997, 2024-09-13T05:10:21.295 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.295 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.295 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2831 2024-09-13T05:10:21.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.296 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.903990+0000", 2024-09-13T05:10:21.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.903990+0000", 2024-09-13T05:10:21.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.903989+0000", 2024-09-13T05:10:21.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:21.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.903993+0000", 2024-09-13T05:10:21.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9400000000000004e-06 2024-09-13T05:10:21.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.903999+0000", 2024-09-13T05:10:21.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9279999999999998e-06 2024-09-13T05:10:21.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.904004+0000", 2024-09-13T05:10:21.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.011e-06 2024-09-13T05:10:21.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.904680+0000", 2024-09-13T05:10:21.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00067638400000000003 2024-09-13T05:10:21.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.905643+0000", 2024-09-13T05:10:21.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00096313799999999999 2024-09-13T05:10:21.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:10:21.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.905829+0000", 2024-09-13T05:10:21.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000185217 2024-09-13T05:10:21.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:21.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.907994+0000", 2024-09-13T05:10:21.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002165635 2024-09-13T05:10:21.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:21.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.910276+0000", 2024-09-13T05:10:21.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002281267 2024-09-13T05:10:21.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.910315+0000", 2024-09-13T05:10:21.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9393e-05 2024-09-13T05:10:21.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.910349+0000", 2024-09-13T05:10:21.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3649000000000003e-05 2024-09-13T05:10:21.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.300 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.301 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2841 3.6 3:60b915a0:::rbd_data.112d872fd67a.0000000000000057:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:21.301 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.905488+0000", 2024-09-13T05:10:21.301 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.33973609100000002, 2024-09-13T05:10:21.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078414980000000006, 2024-09-13T05:10:21.301 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.301 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.301 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2841 2024-09-13T05:10:21.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.301 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.905488+0000", 2024-09-13T05:10:21.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.302 INFO:teuthology.orchestra.run.smithi120.stdout:587 write 0xb27f8b3 thru 0xb28c0ac (0xc7fa bytes) 2024-09-13T05:10:21.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.905488+0000", 2024-09-13T05:10:21.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.905486+0000", 2024-09-13T05:10:21.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:21.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.905497+0000", 2024-09-13T05:10:21.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166000000000001e-05 2024-09-13T05:10:21.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.905510+0000", 2024-09-13T05:10:21.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3555e-05 2024-09-13T05:10:21.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.905519+0000", 2024-09-13T05:10:21.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4400000000000005e-06 2024-09-13T05:10:21.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.905580+0000", 2024-09-13T05:10:21.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1186000000000007e-05 2024-09-13T05:10:21.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.905655+0000", 2024-09-13T05:10:21.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5680999999999996e-05 2024-09-13T05:10:21.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:21.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.905843+0000", 2024-09-13T05:10:21.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018795199999999999 2024-09-13T05:10:21.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:21.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.910302+0000", 2024-09-13T05:10:21.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044588910000000004 2024-09-13T05:10:21.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:21.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.913235+0000", 2024-09-13T05:10:21.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029328319999999998 2024-09-13T05:10:21.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.913288+0000", 2024-09-13T05:10:21.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2562000000000003e-05 2024-09-13T05:10:21.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.913329+0000", 2024-09-13T05:10:21.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1640000000000001e-05 2024-09-13T05:10:21.308 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.308 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.308 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.308 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2883 3.6 3:6081175a:::rbd_data.112d872fd67a.000000000000005b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:21.308 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.912522+0000", 2024-09-13T05:10:21.308 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.33270195699999999, 2024-09-13T05:10:21.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083975969999999997, 2024-09-13T05:10:21.308 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.308 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.308 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.308 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.308 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.309 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2883 2024-09-13T05:10:21.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.309 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912522+0000", 2024-09-13T05:10:21.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912522+0000", 2024-09-13T05:10:21.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912521+0000", 2024-09-13T05:10:21.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:21.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912528+0000", 2024-09-13T05:10:21.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2540000000000003e-06 2024-09-13T05:10:21.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912538+0000", 2024-09-13T05:10:21.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7399999999999999e-06 2024-09-13T05:10:21.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912545+0000", 2024-09-13T05:10:21.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-09-13T05:10:21.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912591+0000", 2024-09-13T05:10:21.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5918000000000003e-05 2024-09-13T05:10:21.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912685+0000", 2024-09-13T05:10:21.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3610999999999995e-05 2024-09-13T05:10:21.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:21.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912873+0000", 2024-09-13T05:10:21.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018814600000000001 2024-09-13T05:10:21.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:21.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.918430+0000", 2024-09-13T05:10:21.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055577389999999999 2024-09-13T05:10:21.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:21.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.920808+0000", 2024-09-13T05:10:21.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023773240000000001 2024-09-13T05:10:21.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.920863+0000", 2024-09-13T05:10:21.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5099999999999998e-05 2024-09-13T05:10:21.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.920920+0000", 2024-09-13T05:10:21.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6671e-05 2024-09-13T05:10:21.313 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.313 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.313 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.314 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2885 3.17 3:e9b465a6:::rbd_data.112d872fd67a.000000000000005a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:21.314 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.912800+0000", 2024-09-13T05:10:21.314 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.33242353000000002, 2024-09-13T05:10:21.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081647930000000001, 2024-09-13T05:10:21.314 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.314 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.314 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.314 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.314 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.314 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2885 2024-09-13T05:10:21.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.315 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912800+0000", 2024-09-13T05:10:21.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912800+0000", 2024-09-13T05:10:21.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912799+0000", 2024-09-13T05:10:21.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:21.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912807+0000", 2024-09-13T05:10:21.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1769999999999998e-06 2024-09-13T05:10:21.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912822+0000", 2024-09-13T05:10:21.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4501999999999999e-05 2024-09-13T05:10:21.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912830+0000", 2024-09-13T05:10:21.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2279999999999998e-06 2024-09-13T05:10:21.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912909+0000", 2024-09-13T05:10:21.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8910000000000002e-05 2024-09-13T05:10:21.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912991+0000", 2024-09-13T05:10:21.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2454999999999996e-05 2024-09-13T05:10:21.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:10:21.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.913204+0000", 2024-09-13T05:10:21.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000212303 2024-09-13T05:10:21.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:21.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.914487+0000", 2024-09-13T05:10:21.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012830540000000001 2024-09-13T05:10:21.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:21.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.920887+0000", 2024-09-13T05:10:21.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063999319999999997 2024-09-13T05:10:21.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.920923+0000", 2024-09-13T05:10:21.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6619000000000003e-05 2024-09-13T05:10:21.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.920965+0000", 2024-09-13T05:10:21.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1904999999999999e-05 2024-09-13T05:10:21.319 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.319 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.320 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.320 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "pg_update_log_missing(3.b epoch 31/22 rep_tid 125 entries 31'9 (0'0) error 3:d32df763:::rbd_data.112d872fd67a.000000000000006b:head by client.4397.0:2947 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 30'5)", 2024-09-13T05:10:21.320 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.921713+0000", 2024-09-13T05:10:21.320 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.32351054000000001, 2024-09-13T05:10:21.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088039680000000006, 2024-09-13T05:10:21.320 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.320 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:10:21.320 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921713+0000", 2024-09-13T05:10:21.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921713+0000", 2024-09-13T05:10:21.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921712+0000", 2024-09-13T05:10:21.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:21.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921722+0000", 2024-09-13T05:10:21.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6500000000000008e-06 2024-09-13T05:10:21.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921735+0000", 2024-09-13T05:10:21.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3273e-05 2024-09-13T05:10:21.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921745+0000", 2024-09-13T05:10:21.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9839999999999996e-06 2024-09-13T05:10:21.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.922375+0000", 2024-09-13T05:10:21.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062995800000000002 2024-09-13T05:10:21.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.930517+0000", 2024-09-13T05:10:21.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081421150000000001 2024-09-13T05:10:21.323 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.323 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.323 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.323 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:2959 3.10 e31/22 3:0f6f02a0:::rbd_data.112d872fd67a.000000000000006f:head v 31'20, mlcod=31'16)", 2024-09-13T05:10:21.323 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.922687+0000", 2024-09-13T05:10:21.324 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.32253732899999998, 2024-09-13T05:10:21.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078221469999999998, 2024-09-13T05:10:21.324 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.324 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.324 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.922687+0000", 2024-09-13T05:10:21.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.922687+0000", 2024-09-13T05:10:21.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.922686+0000", 2024-09-13T05:10:21.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:21.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.922694+0000", 2024-09-13T05:10:21.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2209999999999997e-06 2024-09-13T05:10:21.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.922707+0000", 2024-09-13T05:10:21.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3273e-05 2024-09-13T05:10:21.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.922714+0000", 2024-09-13T05:10:21.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8009999999999998e-06 2024-09-13T05:10:21.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.922768+0000", 2024-09-13T05:10:21.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4348999999999998e-05 2024-09-13T05:10:21.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.922789+0000", 2024-09-13T05:10:21.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0319999999999999e-05 2024-09-13T05:10:21.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.930477+0000", 2024-09-13T05:10:21.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076886350000000001 2024-09-13T05:10:21.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.930509+0000", 2024-09-13T05:10:21.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1454000000000001e-05 2024-09-13T05:10:21.327 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.328 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.328 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.328 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:3016 3.1 3:84643180:::rbd_data.112d872fd67a.0000000000000072:head [stat,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:21.328 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.928447+0000", 2024-09-13T05:10:21.328 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.31677675399999999, 2024-09-13T05:10:21.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076306830000000001, 2024-09-13T05:10:21.328 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.328 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:21.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.329 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 3016 2024-09-13T05:10:21.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.329 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.928447+0000", 2024-09-13T05:10:21.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.928447+0000", 2024-09-13T05:10:21.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.928446+0000", 2024-09-13T05:10:21.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:21.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.928452+0000", 2024-09-13T05:10:21.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5350000000000004e-06 2024-09-13T05:10:21.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.928459+0000", 2024-09-13T05:10:21.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6310000000000003e-06 2024-09-13T05:10:21.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.928464+0000", 2024-09-13T05:10:21.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.746e-06 2024-09-13T05:10:21.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.928511+0000", 2024-09-13T05:10:21.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7011000000000001e-05 2024-09-13T05:10:21.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.928630+0000", 2024-09-13T05:10:21.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118763 2024-09-13T05:10:21.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.936078+0000", 2024-09-13T05:10:21.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0074479170000000001 2024-09-13T05:10:21.332 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.332 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.332 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.332 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "pg_update_log_missing(3.18 epoch 31/22 rep_tid 130 entries 31'20 (0'0) error 3:18199c26:::rbd_data.112d872fd67a.0000000000000071:head by client.4397.0:3015 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 31'18)", 2024-09-13T05:10:21.332 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.928956+0000", 2024-09-13T05:10:21.332 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.31626844199999998, 2024-09-13T05:10:21.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070674980000000002, 2024-09-13T05:10:21.332 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.332 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:10:21.332 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.928956+0000", 2024-09-13T05:10:21.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.928956+0000", 2024-09-13T05:10:21.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.928955+0000", 2024-09-13T05:10:21.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:21.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.928965+0000", 2024-09-13T05:10:21.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8439999999999993e-06 2024-09-13T05:10:21.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.928981+0000", 2024-09-13T05:10:21.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6629999999999998e-05 2024-09-13T05:10:21.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.928995+0000", 2024-09-13T05:10:21.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.349e-05 2024-09-13T05:10:21.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.929064+0000", 2024-09-13T05:10:21.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9690999999999994e-05 2024-09-13T05:10:21.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.936023+0000", 2024-09-13T05:10:21.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0069586279999999997 2024-09-13T05:10:21.335 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.335 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.335 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.336 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:3027 3.3 3:c20efd71:::rbd_data.112d872fd67a.0000000000000076:head [stat,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:21.336 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.931515+0000", 2024-09-13T05:10:21.336 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.31370928199999998, 2024-09-13T05:10:21.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079073319999999996, 2024-09-13T05:10:21.336 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.336 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:21.336 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.336 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.336 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.336 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 3027 2024-09-13T05:10:21.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.336 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.931515+0000", 2024-09-13T05:10:21.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.931515+0000", 2024-09-13T05:10:21.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.931514+0000", 2024-09-13T05:10:21.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:21.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.931519+0000", 2024-09-13T05:10:21.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1830000000000002e-06 2024-09-13T05:10:21.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.931530+0000", 2024-09-13T05:10:21.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0688e-05 2024-09-13T05:10:21.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.931537+0000", 2024-09-13T05:10:21.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-13T05:10:21.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.931791+0000", 2024-09-13T05:10:21.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025405499999999999 2024-09-13T05:10:21.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.931891+0000", 2024-09-13T05:10:21.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010012 2024-09-13T05:10:21.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.939422+0000", 2024-09-13T05:10:21.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0075306599999999998 2024-09-13T05:10:21.340 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.340 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.340 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.340 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:3085 3.12 3:4d689744:::rbd_data.112d872fd67a.000000000000007b:head [stat,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:21.340 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.937989+0000", 2024-09-13T05:10:21.340 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.30723497900000002, 2024-09-13T05:10:21.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071113010000000004, 2024-09-13T05:10:21.340 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.340 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.340 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.340 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.341 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.341 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 3085 2024-09-13T05:10:21.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.341 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.937989+0000", 2024-09-13T05:10:21.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.937989+0000", 2024-09-13T05:10:21.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.937989+0000", 2024-09-13T05:10:21.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:21.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.937992+0000", 2024-09-13T05:10:21.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.976e-06 2024-09-13T05:10:21.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.938598+0000", 2024-09-13T05:10:21.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00060678999999999996 2024-09-13T05:10:21.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.938606+0000", 2024-09-13T05:10:21.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5320000000000001e-06 2024-09-13T05:10:21.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.938663+0000", 2024-09-13T05:10:21.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7145999999999998e-05 2024-09-13T05:10:21.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.938740+0000", 2024-09-13T05:10:21.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6947999999999996e-05 2024-09-13T05:10:21.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:10:21.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.938929+0000", 2024-09-13T05:10:21.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000189462 2024-09-13T05:10:21.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:21.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.940587+0000", 2024-09-13T05:10:21.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001657679 2024-09-13T05:10:21.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:21.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.945000+0000", 2024-09-13T05:10:21.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004412577 2024-09-13T05:10:21.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.945068+0000", 2024-09-13T05:10:21.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8116999999999999e-05 2024-09-13T05:10:21.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.945100+0000", 2024-09-13T05:10:21.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2478000000000003e-05 2024-09-13T05:10:21.345 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.345 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.345 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.346 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:3087 3.1 3:84643180:::rbd_data.112d872fd67a.0000000000000072:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:21.346 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.938626+0000", 2024-09-13T05:10:21.346 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.30659778500000001, 2024-09-13T05:10:21.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064318329999999996, 2024-09-13T05:10:21.346 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.346 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.346 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 3087 2024-09-13T05:10:21.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.346 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.938626+0000", 2024-09-13T05:10:21.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.938626+0000", 2024-09-13T05:10:21.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.938625+0000", 2024-09-13T05:10:21.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:21.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.938631+0000", 2024-09-13T05:10:21.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.173e-06 2024-09-13T05:10:21.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.938639+0000", 2024-09-13T05:10:21.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4549999999999998e-06 2024-09-13T05:10:21.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.938644+0000", 2024-09-13T05:10:21.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2190000000000003e-06 2024-09-13T05:10:21.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.938685+0000", 2024-09-13T05:10:21.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0759000000000001e-05 2024-09-13T05:10:21.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.938769+0000", 2024-09-13T05:10:21.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3981999999999997e-05 2024-09-13T05:10:21.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:21.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.938941+0000", 2024-09-13T05:10:21.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017227900000000001 2024-09-13T05:10:21.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:21.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.944781+0000", 2024-09-13T05:10:21.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058393860000000002 2024-09-13T05:10:21.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:21.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.944792+0000", 2024-09-13T05:10:21.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1592e-05 2024-09-13T05:10:21.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.945029+0000", 2024-09-13T05:10:21.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023672 2024-09-13T05:10:21.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.945058+0000", 2024-09-13T05:10:21.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9173e-05 2024-09-13T05:10:21.351 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.351 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.351 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.351 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.351 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.351 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:21.352 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:10:21.353 INFO:teuthology.orchestra.run.smithi120.stdout:588 write 0x9f028b1 thru 0x9f0baea (0x923a bytes) 2024-09-13T05:10:21.353 INFO:teuthology.orchestra.run.smithi120.stdout:590 write 0x7dd249d thru 0x7dde458 (0xbfbc bytes) 2024-09-13T05:10:21.353 INFO:teuthology.orchestra.run.smithi120.stdout:595 punch from 0x2a61856 to 0x2a6aaa8, (0x9252 bytes) 2024-09-13T05:10:21.353 INFO:teuthology.orchestra.run.smithi120.stdout:596 read 0x62b2d69 thru 0x62bf198 (0xc430 bytes) 2024-09-13T05:10:21.353 INFO:teuthology.orchestra.run.smithi120.stdout:597 read 0x516ce52 thru 0x517a928 (0xdad7 bytes) 2024-09-13T05:10:21.353 INFO:teuthology.orchestra.run.smithi120.stdout:598 trunc from 0xc04c41c to 0x9f40001 2024-09-13T05:10:21.355 INFO:teuthology.orchestra.run.smithi120.stdout:600 trunc from 0x9f40001 to 0x7c27269 2024-09-13T05:10:21.355 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:21.351+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:21.391 INFO:teuthology.orchestra.run.smithi120.stdout:601 read 0x512266b thru 0x513043d (0xddd3 bytes) 2024-09-13T05:10:21.391 INFO:teuthology.orchestra.run.smithi120.stdout:602 write 0x7879a07 thru 0x787c598 (0x2b92 bytes) 2024-09-13T05:10:21.394 INFO:teuthology.orchestra.run.smithi120.stdout:603 read 0x734e189 thru 0x735b164 (0xcfdc bytes) 2024-09-13T05:10:21.409 INFO:teuthology.orchestra.run.smithi120.stdout:604 trunc from 0x7c27269 to 0x1d1332e 2024-09-13T05:10:21.455 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:21.451+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:21.483 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:21.484 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:21.484 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:10:21.484 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:21.490 INFO:teuthology.orchestra.run.smithi120.stdout:605 write 0x6d587ca thru 0x6d5e446 (0x5c7d bytes) 2024-09-13T05:10:21.494 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:10:21.498 INFO:teuthology.orchestra.run.smithi120.stdout:606 write 0x1e283f6 thru 0x1e29947 (0x1552 bytes) 2024-09-13T05:10:21.503 INFO:teuthology.orchestra.run.smithi120.stdout:607 write 0x9d2810 thru 0x9d62c4 (0x3ab5 bytes) 2024-09-13T05:10:21.517 INFO:teuthology.orchestra.run.smithi120.stdout:608 writesame 0x1d3b22e thru 0x1d3b341 data_size 0x6(0x114 bytes) 2024-09-13T05:10:21.519 INFO:teuthology.orchestra.run.smithi120.stdout:610 write 0x383a882 thru 0x3844c30 (0xa3af bytes) 2024-09-13T05:10:21.539 INFO:teuthology.orchestra.run.smithi120.stdout:613 write 0x6d94505 thru 0x6d9767f (0x317b bytes) 2024-09-13T05:10:21.545 INFO:teuthology.orchestra.run.smithi120.stdout:615 read 0x17c9b3b thru 0x17cbc77 (0x213d bytes) 2024-09-13T05:10:21.545 INFO:teuthology.orchestra.run.smithi120.stdout:616 punch from 0x25ec7ce to 0x25f2d89, (0x65bb bytes) 2024-09-13T05:10:21.548 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:21.556 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:21.550+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:21.563 INFO:teuthology.orchestra.run.smithi120.stdout:619 writesame 0x77b9cac thru 0x77bc75b data_size 0x8(0x2ab0 bytes) 2024-09-13T05:10:21.563 INFO:teuthology.orchestra.run.smithi120.stdout:620 punch from 0x508d10b to 0x509b68c, (0xe581 bytes) 2024-09-13T05:10:21.563 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:21.564 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:21.564 INFO:teuthology.orchestra.run.smithi120.stdout:623 read 0x32910c3 thru 0x329ed4e (0xdc8c bytes) 2024-09-13T05:10:21.580 INFO:teuthology.orchestra.run.smithi120.stdout:624 write 0xb6d3c4a thru 0xb6d45cb (0x982 bytes) 2024-09-13T05:10:21.587 INFO:teuthology.orchestra.run.smithi120.stdout:625 writesame 0x691b117 thru 0x692aa86 data_size 0x68(0xf970 bytes) 2024-09-13T05:10:21.593 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:10:21.608 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:21.609 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:21.609 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:21.609 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:21.609 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:21.612 INFO:teuthology.orchestra.run.smithi120.stdout:626 write 0xbc3c61b thru 0xbc3f89e (0x3284 bytes) 2024-09-13T05:10:21.617 INFO:teuthology.orchestra.run.smithi120.stdout:630 write 0x2c99ca0 thru 0x2c9a1e9 (0x54a bytes) 2024-09-13T05:10:21.622 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:10:21.623 INFO:teuthology.orchestra.run.smithi120.stdout:631 read 0x9aaee76 thru 0x9ab5730 (0x68bb bytes) 2024-09-13T05:10:21.623 INFO:teuthology.orchestra.run.smithi120.stdout:632 write 0x6bb68e2 thru 0x6bc481e (0xdf3d bytes) 2024-09-13T05:10:21.630 INFO:teuthology.orchestra.run.smithi120.stdout:633 punch from 0x337b512 to 0x3389572, (0xe060 bytes) 2024-09-13T05:10:21.630 INFO:teuthology.orchestra.run.smithi120.stdout:635 write 0x9b624d2 thru 0x9b65475 (0x2fa4 bytes) 2024-09-13T05:10:21.637 INFO:teuthology.orchestra.run.smithi120.stdout:637 write 0xa4c3e4f thru 0xa4cea9e (0xac50 bytes) 2024-09-13T05:10:21.648 INFO:teuthology.orchestra.run.smithi120.stdout:638 write 0x59da183 thru 0x59e0ef4 (0x6d72 bytes) 2024-09-13T05:10:21.656 INFO:teuthology.orchestra.run.smithi120.stdout:639 read 0x428dd18 thru 0x4293684 (0x596d bytes) 2024-09-13T05:10:21.656 INFO:teuthology.orchestra.run.smithi120.stdout:641 write 0x3f03d9b thru 0x3f0651a (0x2780 bytes) 2024-09-13T05:10:21.657 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:21.655+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:21.661 INFO:teuthology.orchestra.run.smithi120.stdout:642 write 0x5348249 thru 0x534b951 (0x3709 bytes) 2024-09-13T05:10:21.667 INFO:teuthology.orchestra.run.smithi120.stdout:643 read 0x71861b thru 0x72148e (0x8e74 bytes) 2024-09-13T05:10:21.670 INFO:teuthology.orchestra.run.smithi120.stdout:644 writesame 0x60df931 thru 0x60eaa33 data_size 0x39(0xb103 bytes) 2024-09-13T05:10:21.695 INFO:teuthology.orchestra.run.smithi120.stdout:645 write 0xe9b4b04 thru 0xe9b57da (0xcd7 bytes) 2024-09-13T05:10:21.701 INFO:teuthology.orchestra.run.smithi120.stdout:646 writesame 0x503b26c thru 0x503c427 data_size 0x2(0x11bc bytes) 2024-09-13T05:10:21.708 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:21.708 INFO:teuthology.orchestra.run.smithi120.stdout:649 read 0xb28c491 thru 0xb2941bf (0x7d2f bytes) 2024-09-13T05:10:21.708 INFO:teuthology.orchestra.run.smithi120.stdout:650 write 0x7bfbaf5 thru 0x7bff8c4 (0x3dd0 bytes) 2024-09-13T05:10:21.713 INFO:teuthology.orchestra.run.smithi120.stdout:651 punch from 0x12665b4 to 0x1275899, (0xf2e5 bytes) 2024-09-13T05:10:21.713 INFO:teuthology.orchestra.run.smithi120.stdout:652 write 0x173d93d thru 0x1749da1 (0xc465 bytes) 2024-09-13T05:10:21.738 INFO:teuthology.orchestra.run.smithi120.stdout:653 punch from 0xc5407c4 to 0xc54a5ad, (0x9de9 bytes) 2024-09-13T05:10:21.738 INFO:teuthology.orchestra.run.smithi120.stdout:655 read 0xcebd418 thru 0xcec7eb4 (0xaa9d bytes) 2024-09-13T05:10:21.745 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:10:21.746 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:21.746 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:21.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:21.747 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:21.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.747 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:9 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-13T05:10:21.747 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:11.649922+0000", 2024-09-13T05:10:21.747 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.094024705000001, 2024-09-13T05:10:21.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014163614, 2024-09-13T05:10:21.747 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.747 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.747 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.747 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.747 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.747 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 9 2024-09-13T05:10:21.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.747 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.649922+0000", 2024-09-13T05:10:21.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.649922+0000", 2024-09-13T05:10:21.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.649919+0000", 2024-09-13T05:10:21.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:10:21.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.649933+0000", 2024-09-13T05:10:21.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3506000000000001e-05 2024-09-13T05:10:21.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.649955+0000", 2024-09-13T05:10:21.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2436999999999999e-05 2024-09-13T05:10:21.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.649968+0000", 2024-09-13T05:10:21.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3236e-05 2024-09-13T05:10:21.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.650049+0000", 2024-09-13T05:10:21.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1007999999999994e-05 2024-09-13T05:10:21.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-13T05:10:21.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.650064+0000", 2024-09-13T05:10:21.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.413e-05 2024-09-13T05:10:21.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.655249+0000", 2024-09-13T05:10:21.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005185879 2024-09-13T05:10:21.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.655361+0000", 2024-09-13T05:10:21.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111218 2024-09-13T05:10:21.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-13T05:10:21.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.655591+0000", 2024-09-13T05:10:21.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023008300000000001 2024-09-13T05:10:21.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:21.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.661052+0000", 2024-09-13T05:10:21.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005461741 2024-09-13T05:10:21.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:21.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.664003+0000", 2024-09-13T05:10:21.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029500450000000001 2024-09-13T05:10:21.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.664045+0000", 2024-09-13T05:10:21.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2885e-05 2024-09-13T05:10:21.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.664085+0000", 2024-09-13T05:10:21.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9953999999999997e-05 2024-09-13T05:10:21.753 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.753 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.754 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.754 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2048 3.19 3:9f06d4f2:::rbd_object_map.112d872fd67a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:21.754 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.126640+0000", 2024-09-13T05:10:21.754 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.6173059599999999, 2024-09-13T05:10:21.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086123469999999994, 2024-09-13T05:10:21.754 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.754 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.754 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.754 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.754 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.754 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2048 2024-09-13T05:10:21.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.755 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.126640+0000", 2024-09-13T05:10:21.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.126640+0000", 2024-09-13T05:10:21.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.126640+0000", 2024-09-13T05:10:21.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:21.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.126644+0000", 2024-09-13T05:10:21.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9369999999999997e-06 2024-09-13T05:10:21.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.126647+0000", 2024-09-13T05:10:21.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1489999999999998e-06 2024-09-13T05:10:21.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.126651+0000", 2024-09-13T05:10:21.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3919999999999999e-06 2024-09-13T05:10:21.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.128852+0000", 2024-09-13T05:10:21.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022012690000000001 2024-09-13T05:10:21.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.129058+0000", 2024-09-13T05:10:21.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000205966 2024-09-13T05:10:21.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:21.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.130062+0000", 2024-09-13T05:10:21.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001004537 2024-09-13T05:10:21.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:21.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.134830+0000", 2024-09-13T05:10:21.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047672540000000003 2024-09-13T05:10:21.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:21.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.135140+0000", 2024-09-13T05:10:21.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031038499999999999 2024-09-13T05:10:21.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.135182+0000", 2024-09-13T05:10:21.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1814999999999999e-05 2024-09-13T05:10:21.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.135253+0000", 2024-09-13T05:10:21.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0940999999999997e-05 2024-09-13T05:10:21.759 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.759 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.759 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.759 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2209 3.19 3:9f06d4f2:::rbd_object_map.112d872fd67a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:21.760 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.213379+0000", 2024-09-13T05:10:21.760 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.530567155, 2024-09-13T05:10:21.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088867800000000004, 2024-09-13T05:10:21.760 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.760 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.760 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2209 2024-09-13T05:10:21.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.760 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.213379+0000", 2024-09-13T05:10:21.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.213379+0000", 2024-09-13T05:10:21.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.213378+0000", 2024-09-13T05:10:21.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:21.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.213388+0000", 2024-09-13T05:10:21.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0762e-05 2024-09-13T05:10:21.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.213410+0000", 2024-09-13T05:10:21.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2095000000000001e-05 2024-09-13T05:10:21.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.213421+0000", 2024-09-13T05:10:21.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0756e-05 2024-09-13T05:10:21.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.217698+0000", 2024-09-13T05:10:21.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042767029999999998 2024-09-13T05:10:21.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.217879+0000", 2024-09-13T05:10:21.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000180834 2024-09-13T05:10:21.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:21.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.218267+0000", 2024-09-13T05:10:21.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038789 2024-09-13T05:10:21.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:21.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.222139+0000", 2024-09-13T05:10:21.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038724929999999999 2024-09-13T05:10:21.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:21.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.222148+0000", 2024-09-13T05:10:21.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4039999999999995e-06 2024-09-13T05:10:21.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.222200+0000", 2024-09-13T05:10:21.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2519999999999999e-05 2024-09-13T05:10:21.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.222266+0000", 2024-09-13T05:10:21.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5996999999999998e-05 2024-09-13T05:10:21.765 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.765 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.765 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.765 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2210 3.19 3:9f06d4f2:::rbd_object_map.112d872fd67a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:21.765 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.213840+0000", 2024-09-13T05:10:21.766 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.5301059829999999, 2024-09-13T05:10:21.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091858870000000002, 2024-09-13T05:10:21.766 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.766 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.766 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.766 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.766 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.766 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2210 2024-09-13T05:10:21.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.766 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.213840+0000", 2024-09-13T05:10:21.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.213840+0000", 2024-09-13T05:10:21.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.213839+0000", 2024-09-13T05:10:21.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:21.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.213849+0000", 2024-09-13T05:10:21.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8959999999999998e-06 2024-09-13T05:10:21.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.213873+0000", 2024-09-13T05:10:21.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4601e-05 2024-09-13T05:10:21.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.213888+0000", 2024-09-13T05:10:21.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.437e-05 2024-09-13T05:10:21.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.219068+0000", 2024-09-13T05:10:21.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051797029999999999 2024-09-13T05:10:21.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.219198+0000", 2024-09-13T05:10:21.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130085 2024-09-13T05:10:21.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:21.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.219644+0000", 2024-09-13T05:10:21.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044589599999999999 2024-09-13T05:10:21.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:21.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.222554+0000", 2024-09-13T05:10:21.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029106620000000001 2024-09-13T05:10:21.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:21.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.222930+0000", 2024-09-13T05:10:21.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037544400000000001 2024-09-13T05:10:21.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.222992+0000", 2024-09-13T05:10:21.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1960999999999998e-05 2024-09-13T05:10:21.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.223026+0000", 2024-09-13T05:10:21.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4756999999999999e-05 2024-09-13T05:10:21.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.771 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.771 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2211 3.19 3:9f06d4f2:::rbd_object_map.112d872fd67a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:21.771 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.214248+0000", 2024-09-13T05:10:21.772 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.5296989160000001, 2024-09-13T05:10:21.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089209219999999995, 2024-09-13T05:10:21.772 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.772 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.772 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2211 2024-09-13T05:10:21.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.772 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.214248+0000", 2024-09-13T05:10:21.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.214248+0000", 2024-09-13T05:10:21.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.214246+0000", 2024-09-13T05:10:21.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:21.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.214255+0000", 2024-09-13T05:10:21.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8400000000000001e-06 2024-09-13T05:10:21.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.214269+0000", 2024-09-13T05:10:21.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3540000000000001e-05 2024-09-13T05:10:21.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.214279+0000", 2024-09-13T05:10:21.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0481e-05 2024-09-13T05:10:21.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.219971+0000", 2024-09-13T05:10:21.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056922680000000003 2024-09-13T05:10:21.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.220025+0000", 2024-09-13T05:10:21.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3944999999999999e-05 2024-09-13T05:10:21.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:21.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.220233+0000", 2024-09-13T05:10:21.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020790699999999999 2024-09-13T05:10:21.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:21.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.222561+0000", 2024-09-13T05:10:21.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002327516 2024-09-13T05:10:21.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:21.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.223083+0000", 2024-09-13T05:10:21.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00052253200000000003 2024-09-13T05:10:21.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.223138+0000", 2024-09-13T05:10:21.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4827000000000002e-05 2024-09-13T05:10:21.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.223168+0000", 2024-09-13T05:10:21.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.042e-05 2024-09-13T05:10:21.777 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.777 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.777 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.778 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2367 3.19 3:9f06d4f2:::rbd_object_map.112d872fd67a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:21.778 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.311337+0000", 2024-09-13T05:10:21.778 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.4326093979999999, 2024-09-13T05:10:21.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095340119999999997, 2024-09-13T05:10:21.778 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.778 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.778 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.778 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.778 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.778 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2367 2024-09-13T05:10:21.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.779 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.311337+0000", 2024-09-13T05:10:21.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.311337+0000", 2024-09-13T05:10:21.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.311336+0000", 2024-09-13T05:10:21.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:21.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.311344+0000", 2024-09-13T05:10:21.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.729e-06 2024-09-13T05:10:21.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.311355+0000", 2024-09-13T05:10:21.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1618e-05 2024-09-13T05:10:21.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.311365+0000", 2024-09-13T05:10:21.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1740000000000006e-06 2024-09-13T05:10:21.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.316447+0000", 2024-09-13T05:10:21.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050823350000000003 2024-09-13T05:10:21.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.316613+0000", 2024-09-13T05:10:21.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016607300000000001 2024-09-13T05:10:21.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:21.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.317068+0000", 2024-09-13T05:10:21.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045456799999999998 2024-09-13T05:10:21.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:21.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.319496+0000", 2024-09-13T05:10:21.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024286920000000001 2024-09-13T05:10:21.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:21.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.320808+0000", 2024-09-13T05:10:21.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00131164 2024-09-13T05:10:21.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.320839+0000", 2024-09-13T05:10:21.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1384000000000003e-05 2024-09-13T05:10:21.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.320871+0000", 2024-09-13T05:10:21.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1823999999999999e-05 2024-09-13T05:10:21.783 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.783 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.783 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2368 3.19 3:9f06d4f2:::rbd_object_map.112d872fd67a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.311562+0000", 2024-09-13T05:10:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.432384221, 2024-09-13T05:10:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010285025, 2024-09-13T05:10:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2368 2024-09-13T05:10:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.784 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.311562+0000", 2024-09-13T05:10:21.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.311562+0000", 2024-09-13T05:10:21.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.311561+0000", 2024-09-13T05:10:21.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:21.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.311569+0000", 2024-09-13T05:10:21.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5839999999999997e-06 2024-09-13T05:10:21.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.311580+0000", 2024-09-13T05:10:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1559999999999999e-05 2024-09-13T05:10:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.311590+0000", 2024-09-13T05:10:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0142e-05 2024-09-13T05:10:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.317563+0000", 2024-09-13T05:10:21.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059722009999999999 2024-09-13T05:10:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.317686+0000", 2024-09-13T05:10:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012313299999999999 2024-09-13T05:10:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.318044+0000", 2024-09-13T05:10:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035809200000000001 2024-09-13T05:10:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.321785+0000", 2024-09-13T05:10:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037407999999999999 2024-09-13T05:10:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.321794+0000", 2024-09-13T05:10:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9180000000000006e-06 2024-09-13T05:10:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.321824+0000", 2024-09-13T05:10:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9431999999999999e-05 2024-09-13T05:10:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.321847+0000", 2024-09-13T05:10:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3380999999999999e-05 2024-09-13T05:10:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2369 3.19 3:9f06d4f2:::rbd_object_map.112d872fd67a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.313228+0000", 2024-09-13T05:10:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.430718669, 2024-09-13T05:10:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010661133, 2024-09-13T05:10:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.790 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.791 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.791 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2369 2024-09-13T05:10:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313228+0000", 2024-09-13T05:10:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313228+0000", 2024-09-13T05:10:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313227+0000", 2024-09-13T05:10:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313235+0000", 2024-09-13T05:10:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1470000000000001e-06 2024-09-13T05:10:21.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313247+0000", 2024-09-13T05:10:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2663000000000001e-05 2024-09-13T05:10:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313255+0000", 2024-09-13T05:10:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.875e-06 2024-09-13T05:10:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.318663+0000", 2024-09-13T05:10:21.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054081939999999998 2024-09-13T05:10:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.318743+0000", 2024-09-13T05:10:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9151000000000002e-05 2024-09-13T05:10:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.318960+0000", 2024-09-13T05:10:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021711300000000001 2024-09-13T05:10:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:21.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.323715+0000", 2024-09-13T05:10:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047557379999999998 2024-09-13T05:10:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.323772+0000", 2024-09-13T05:10:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6923999999999999e-05 2024-09-13T05:10:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.323838+0000", 2024-09-13T05:10:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5810999999999997e-05 2024-09-13T05:10:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.323889+0000", 2024-09-13T05:10:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0806000000000001e-05 2024-09-13T05:10:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2370 3.19 3:9f06d4f2:::rbd_object_map.112d872fd67a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.313262+0000", 2024-09-13T05:10:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.4306839739999999, 2024-09-13T05:10:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015026678999999999, 2024-09-13T05:10:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2370 2024-09-13T05:10:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313262+0000", 2024-09-13T05:10:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313262+0000", 2024-09-13T05:10:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313262+0000", 2024-09-13T05:10:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313265+0000", 2024-09-13T05:10:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3289999999999998e-06 2024-09-13T05:10:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313270+0000", 2024-09-13T05:10:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8420000000000004e-06 2024-09-13T05:10:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313274+0000", 2024-09-13T05:10:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9870000000000001e-06 2024-09-13T05:10:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.319541+0000", 2024-09-13T05:10:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062673390000000002 2024-09-13T05:10:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.319652+0000", 2024-09-13T05:10:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111042 2024-09-13T05:10:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.320127+0000", 2024-09-13T05:10:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047452900000000001 2024-09-13T05:10:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.325719+0000", 2024-09-13T05:10:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055915330000000001 2024-09-13T05:10:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.328211+0000", 2024-09-13T05:10:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024922999999999998 2024-09-13T05:10:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.328253+0000", 2024-09-13T05:10:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1927e-05 2024-09-13T05:10:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.328289+0000", 2024-09-13T05:10:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6380000000000001e-05 2024-09-13T05:10:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2371 3.19 3:9f06d4f2:::rbd_object_map.112d872fd67a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.313785+0000", 2024-09-13T05:10:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.430161883, 2024-09-13T05:10:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014663126, 2024-09-13T05:10:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2371 2024-09-13T05:10:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313785+0000", 2024-09-13T05:10:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313785+0000", 2024-09-13T05:10:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313783+0000", 2024-09-13T05:10:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313841+0000", 2024-09-13T05:10:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7735000000000002e-05 2024-09-13T05:10:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313872+0000", 2024-09-13T05:10:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1299e-05 2024-09-13T05:10:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313886+0000", 2024-09-13T05:10:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.383e-05 2024-09-13T05:10:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.320899+0000", 2024-09-13T05:10:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007012997 2024-09-13T05:10:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.320970+0000", 2024-09-13T05:10:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1175999999999998e-05 2024-09-13T05:10:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.321232+0000", 2024-09-13T05:10:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026188900000000001 2024-09-13T05:10:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.325740+0000", 2024-09-13T05:10:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004508265 2024-09-13T05:10:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.328354+0000", 2024-09-13T05:10:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026132310000000001 2024-09-13T05:10:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.328404+0000", 2024-09-13T05:10:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0705000000000003e-05 2024-09-13T05:10:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.328448+0000", 2024-09-13T05:10:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3417999999999997e-05 2024-09-13T05:10:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2372 3.19 3:9f06d4f2:::rbd_object_map.112d872fd67a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.314896+0000", 2024-09-13T05:10:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.429050422, 2024-09-13T05:10:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013702265, 2024-09-13T05:10:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2372 2024-09-13T05:10:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.314896+0000", 2024-09-13T05:10:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.314896+0000", 2024-09-13T05:10:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.314894+0000", 2024-09-13T05:10:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.314904+0000", 2024-09-13T05:10:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5920000000000007e-06 2024-09-13T05:10:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.314917+0000", 2024-09-13T05:10:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2948e-05 2024-09-13T05:10:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.314928+0000", 2024-09-13T05:10:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0645000000000001e-05 2024-09-13T05:10:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.321886+0000", 2024-09-13T05:10:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0069579869999999997 2024-09-13T05:10:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.321970+0000", 2024-09-13T05:10:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3996e-05 2024-09-13T05:10:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.322206+0000", 2024-09-13T05:10:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023609600000000001 2024-09-13T05:10:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.325761+0000", 2024-09-13T05:10:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003555557 2024-09-13T05:10:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.328518+0000", 2024-09-13T05:10:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027568240000000002 2024-09-13T05:10:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.328562+0000", 2024-09-13T05:10:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3741e-05 2024-09-13T05:10:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.328598+0000", 2024-09-13T05:10:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6457e-05 2024-09-13T05:10:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2373 3.19 3:9f06d4f2:::rbd_object_map.112d872fd67a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.315578+0000", 2024-09-13T05:10:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.428368844, 2024-09-13T05:10:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014022922, 2024-09-13T05:10:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2373 2024-09-13T05:10:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.315578+0000", 2024-09-13T05:10:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.315578+0000", 2024-09-13T05:10:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.315576+0000", 2024-09-13T05:10:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.315584+0000", 2024-09-13T05:10:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3579999999999997e-06 2024-09-13T05:10:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.315596+0000", 2024-09-13T05:10:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2576e-05 2024-09-13T05:10:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.315614+0000", 2024-09-13T05:10:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7244999999999998e-05 2024-09-13T05:10:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.322698+0000", 2024-09-13T05:10:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070847769999999996 2024-09-13T05:10:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.322755+0000", 2024-09-13T05:10:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6910000000000002e-05 2024-09-13T05:10:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.323060+0000", 2024-09-13T05:10:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000305004 2024-09-13T05:10:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.329093+0000", 2024-09-13T05:10:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060325559999999997 2024-09-13T05:10:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.329516+0000", 2024-09-13T05:10:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042357799999999998 2024-09-13T05:10:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.329566+0000", 2024-09-13T05:10:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9869e-05 2024-09-13T05:10:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.329601+0000", 2024-09-13T05:10:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4226000000000001e-05 2024-09-13T05:10:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4231 3.19 3:99402f11:::rbd_data.112d318cd671.0000000000000000:6 [read 6471680~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.439412+0000", 2024-09-13T05:10:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.30453469100000002, 2024-09-13T05:10:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084150600000000002, 2024-09-13T05:10:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4231 2024-09-13T05:10:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439412+0000", 2024-09-13T05:10:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439412+0000", 2024-09-13T05:10:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439411+0000", 2024-09-13T05:10:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439413+0000", 2024-09-13T05:10:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.542e-06 2024-09-13T05:10:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439416+0000", 2024-09-13T05:10:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8270000000000002e-06 2024-09-13T05:10:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439418+0000", 2024-09-13T05:10:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4849999999999999e-06 2024-09-13T05:10:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.447693+0000", 2024-09-13T05:10:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082743039999999997 2024-09-13T05:10:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.447763+0000", 2024-09-13T05:10:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9955000000000004e-05 2024-09-13T05:10:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.447827+0000", 2024-09-13T05:10:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4299000000000002e-05 2024-09-13T05:10:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4234 3.19 3:99402f11:::rbd_data.112d318cd671.0000000000000000:6 [read 6668288~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.439437+0000", 2024-09-13T05:10:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.304509321, 2024-09-13T05:10:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0085032259999999991, 2024-09-13T05:10:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4234 2024-09-13T05:10:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439437+0000", 2024-09-13T05:10:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439437+0000", 2024-09-13T05:10:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439437+0000", 2024-09-13T05:10:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439439+0000", 2024-09-13T05:10:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0379999999999998e-06 2024-09-13T05:10:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439443+0000", 2024-09-13T05:10:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6030000000000001e-06 2024-09-13T05:10:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439446+0000", 2024-09-13T05:10:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2030000000000001e-06 2024-09-13T05:10:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.447846+0000", 2024-09-13T05:10:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084002780000000006 2024-09-13T05:10:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.447888+0000", 2024-09-13T05:10:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2182999999999999e-05 2024-09-13T05:10:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.447940+0000", 2024-09-13T05:10:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2154000000000002e-05 2024-09-13T05:10:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4237 3.19 3:99402f11:::rbd_data.112d318cd671.0000000000000000:6 [read 7258112~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.439466+0000", 2024-09-13T05:10:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.30448054299999999, 2024-09-13T05:10:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086165300000000007, 2024-09-13T05:10:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4237 2024-09-13T05:10:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439466+0000", 2024-09-13T05:10:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439466+0000", 2024-09-13T05:10:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439466+0000", 2024-09-13T05:10:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439488+0000", 2024-09-13T05:10:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2507999999999999e-05 2024-09-13T05:10:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439495+0000", 2024-09-13T05:10:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9670000000000004e-06 2024-09-13T05:10:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439500+0000", 2024-09-13T05:10:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1580000000000004e-06 2024-09-13T05:10:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.447973+0000", 2024-09-13T05:10:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084724859999999996 2024-09-13T05:10:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448026+0000", 2024-09-13T05:10:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3003000000000001e-05 2024-09-13T05:10:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448082+0000", 2024-09-13T05:10:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6808000000000002e-05 2024-09-13T05:10:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4243 3.19 3:99402f11:::rbd_data.112d318cd671.0000000000000000:6 [read 7454720~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.439505+0000", 2024-09-13T05:10:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.30444133400000001, 2024-09-13T05:10:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0087311209999999997, 2024-09-13T05:10:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4243 2024-09-13T05:10:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439505+0000", 2024-09-13T05:10:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439505+0000", 2024-09-13T05:10:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439505+0000", 2024-09-13T05:10:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439507+0000", 2024-09-13T05:10:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7190000000000001e-06 2024-09-13T05:10:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439513+0000", 2024-09-13T05:10:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8019999999999997e-06 2024-09-13T05:10:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439517+0000", 2024-09-13T05:10:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2119999999999997e-06 2024-09-13T05:10:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448109+0000", 2024-09-13T05:10:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0085918650000000006 2024-09-13T05:10:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448162+0000", 2024-09-13T05:10:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3078999999999998e-05 2024-09-13T05:10:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448236+0000", 2024-09-13T05:10:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3905999999999993e-05 2024-09-13T05:10:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4245 3.19 3:99402f11:::rbd_data.112d318cd671.0000000000000000:6 [read 8044544~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.439522+0000", 2024-09-13T05:10:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.304424627, 2024-09-13T05:10:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088690709999999992, 2024-09-13T05:10:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4245 2024-09-13T05:10:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439522+0000", 2024-09-13T05:10:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439522+0000", 2024-09-13T05:10:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439522+0000", 2024-09-13T05:10:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439524+0000", 2024-09-13T05:10:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4880000000000001e-06 2024-09-13T05:10:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439529+0000", 2024-09-13T05:10:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1769999999999997e-06 2024-09-13T05:10:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439533+0000", 2024-09-13T05:10:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2200000000000003e-06 2024-09-13T05:10:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448272+0000", 2024-09-13T05:10:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0087390950000000005 2024-09-13T05:10:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448333+0000", 2024-09-13T05:10:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0511999999999999e-05 2024-09-13T05:10:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448391+0000", 2024-09-13T05:10:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899000000000002e-05 2024-09-13T05:10:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4246 3.19 3:99402f11:::rbd_data.112d318cd671.0000000000000000:6 [read 7651328~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.439538+0000", 2024-09-13T05:10:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.30440888500000002, 2024-09-13T05:10:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091169930000000003, 2024-09-13T05:10:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4246 2024-09-13T05:10:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439538+0000", 2024-09-13T05:10:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439538+0000", 2024-09-13T05:10:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439537+0000", 2024-09-13T05:10:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439540+0000", 2024-09-13T05:10:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5950000000000001e-06 2024-09-13T05:10:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439545+0000", 2024-09-13T05:10:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2000000000000002e-06 2024-09-13T05:10:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439549+0000", 2024-09-13T05:10:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8859999999999997e-06 2024-09-13T05:10:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448433+0000", 2024-09-13T05:10:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088846289999999998 2024-09-13T05:10:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448527+0000", 2024-09-13T05:10:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3614000000000002e-05 2024-09-13T05:10:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448655+0000", 2024-09-13T05:10:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012762 2024-09-13T05:10:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4248 3.19 3:99402f11:::rbd_data.112d318cd671.0000000000000000:6 [read 8241152~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.439551+0000", 2024-09-13T05:10:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.30439539100000002, 2024-09-13T05:10:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093856660000000008, 2024-09-13T05:10:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4248 2024-09-13T05:10:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439551+0000", 2024-09-13T05:10:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439551+0000", 2024-09-13T05:10:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439551+0000", 2024-09-13T05:10:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439552+0000", 2024-09-13T05:10:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5379999999999999e-06 2024-09-13T05:10:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439555+0000", 2024-09-13T05:10:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8310000000000001e-06 2024-09-13T05:10:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439558+0000", 2024-09-13T05:10:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.678e-06 2024-09-13T05:10:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448692+0000", 2024-09-13T05:10:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.009134517 2024-09-13T05:10:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448859+0000", 2024-09-13T05:10:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016646200000000001 2024-09-13T05:10:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448937+0000", 2024-09-13T05:10:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7886000000000006e-05 2024-09-13T05:10:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4250 3.19 3:99402f11:::rbd_data.112d318cd671.0000000000000000:6 [read 7847936~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.439560+0000", 2024-09-13T05:10:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.30438638600000001, 2024-09-13T05:10:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096008870000000007, 2024-09-13T05:10:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4250 2024-09-13T05:10:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439560+0000", 2024-09-13T05:10:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439560+0000", 2024-09-13T05:10:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439560+0000", 2024-09-13T05:10:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439561+0000", 2024-09-13T05:10:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4720000000000001e-06 2024-09-13T05:10:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439564+0000", 2024-09-13T05:10:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7530000000000002e-06 2024-09-13T05:10:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439566+0000", 2024-09-13T05:10:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3829999999999999e-06 2024-09-13T05:10:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.449046+0000", 2024-09-13T05:10:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094795039999999997 2024-09-13T05:10:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.449099+0000", 2024-09-13T05:10:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3078000000000002e-05 2024-09-13T05:10:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.449161+0000", 2024-09-13T05:10:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2045999999999995e-05 2024-09-13T05:10:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:21.865 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:21.865 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7] out_osds: [4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T05:10:21.865 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-13T05:10:21.866 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:21.863+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:21.867 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:10:21.867 INFO:teuthology.orchestra.run.smithi120.stdout:656 trunc from 0xe9b57db to 0xac5be2 2024-09-13T05:10:21.868 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:10:21.868 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:10:21.868 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:10:21.868 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:10:21.869 INFO:teuthology.orchestra.run.smithi120.stdout:657 writesame 0xe728e08 thru 0xe72d3ae data_size 0x1(0x45a7 bytes) 2024-09-13T05:10:21.869 INFO:teuthology.orchestra.run.smithi120.stdout:658 write 0x65677cb thru 0x6570729 (0x8f5f bytes) 2024-09-13T05:10:21.869 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:10:21.870 INFO:teuthology.orchestra.run.smithi120.stdout:659 read 0xbc1ce thru 0xc07d3 (0x4606 bytes) 2024-09-13T05:10:21.870 INFO:teuthology.orchestra.run.smithi120.stdout:660 punch from 0x6824ffc to 0x6828d4b, (0x3d4f bytes) 2024-09-13T05:10:21.870 INFO:teuthology.orchestra.run.smithi120.stdout:662 read 0x18d58da thru 0x18d9cb9 (0x43e0 bytes) 2024-09-13T05:10:21.870 INFO:teuthology.orchestra.run.smithi120.stdout:664 punch from 0xd108587 to 0xd11341a, (0xae93 bytes) 2024-09-13T05:10:21.871 INFO:teuthology.orchestra.run.smithi120.stdout:665 punch from 0x9d0107b to 0x9d062d6, (0x525b bytes) 2024-09-13T05:10:21.872 INFO:teuthology.orchestra.run.smithi120.stdout:668 writesame 0xc8ad01c thru 0xc8b8a64 data_size 0x1(0xba49 bytes) 2024-09-13T05:10:21.902 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:10:21.904 INFO:teuthology.orchestra.run.smithi120.stdout:670 writesame 0x7a58059 thru 0x7a5b96d data_size 0x1(0x3915 bytes) 2024-09-13T05:10:21.917 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:21.917 INFO:teuthology.orchestra.run.smithi120.stdout:674 write 0x26b07e0 thru 0x26b3d1c (0x353d bytes) 2024-09-13T05:10:21.925 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:10:21.925 INFO:teuthology.orchestra.run.smithi120.stdout:675 write 0xbcd0abb thru 0xbcd649d (0x59e3 bytes) 2024-09-13T05:10:21.925 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:10:21.926 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:10:21.926 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:10:21.926 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:10:21.926 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:10:21.926 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:10:21.926 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:10:21.926 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:10:21.933 INFO:teuthology.orchestra.run.smithi120.stdout:677 write 0x6445e1b thru 0x6445ee5 (0xcb bytes) 2024-09-13T05:10:21.933 INFO:teuthology.orchestra.run.smithi120.stdout:678 punch from 0x27fd396 to 0x280a484, (0xd0ee bytes) 2024-09-13T05:10:21.933 INFO:teuthology.orchestra.run.smithi120.stdout:679 write 0x99549c2 thru 0x995dfe9 (0x9628 bytes) 2024-09-13T05:10:21.966 INFO:teuthology.orchestra.run.smithi120.stdout:680 trunc from 0xe72d3af to 0x5f6fe8 2024-09-13T05:10:21.967 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:21.963+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:21.992 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:21.992 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:22.006 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:10:22.007 INFO:teuthology.orchestra.run.smithi120.stdout:682 punch from 0x20ddd9 to 0x215435, (0x765c bytes) 2024-09-13T05:10:22.021 INFO:teuthology.orchestra.run.smithi120.stdout:683 write 0x4baefab thru 0x4bb3708 (0x475e bytes) 2024-09-13T05:10:22.029 INFO:teuthology.orchestra.run.smithi120.stdout:684 read 0x24639a thru 0x24f312 (0x8f79 bytes) 2024-09-13T05:10:22.032 INFO:teuthology.orchestra.run.smithi120.stdout:685 read 0x1713a3b thru 0x1719cb0 (0x6276 bytes) 2024-09-13T05:10:22.032 INFO:teuthology.orchestra.run.smithi120.stdout:686 read 0x25f14a6 thru 0x2600d29 (0xf884 bytes) 2024-09-13T05:10:22.032 INFO:teuthology.orchestra.run.smithi120.stdout:687 read 0x195af9 thru 0x1a1f53 (0xc45b bytes) 2024-09-13T05:10:22.044 INFO:teuthology.orchestra.run.smithi120.stdout:688 read 0x338080f thru 0x3387008 (0x67fa bytes) 2024-09-13T05:10:22.044 INFO:teuthology.orchestra.run.smithi120.stdout:690 punch from 0x3301444 to 0x3309bbd, (0x8779 bytes) 2024-09-13T05:10:22.049 INFO:teuthology.orchestra.run.smithi120.stdout:691 trunc from 0x4bb3709 to 0x83ad447 2024-09-13T05:10:22.066 INFO:teuthology.orchestra.run.smithi120.stdout:693 read 0x646450 thru 0x6524ed (0xc09e bytes) 2024-09-13T05:10:22.066 INFO:teuthology.orchestra.run.smithi120.stdout:694 read 0x3bb903d thru 0x3bc5ea9 (0xce6d bytes) 2024-09-13T05:10:22.066 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:22.066 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:22.066 INFO:teuthology.orchestra.run.smithi120.stdout:698 write 0x18866d thru 0x18cd7d (0x4711 bytes) 2024-09-13T05:10:22.067 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:22.063+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:22.081 INFO:teuthology.orchestra.run.smithi120.stdout:699 trunc from 0x83ad447 to 0x135de2a 2024-09-13T05:10:22.109 INFO:teuthology.orchestra.run.smithi120.stdout:700 trunc from 0x135de2a to 0x7a30f08 2024-09-13T05:10:22.117 INFO:teuthology.orchestra.run.smithi120.stdout:701 punch from 0x615ae0f to 0x615c2ee, (0x14df bytes) 2024-09-13T05:10:22.129 INFO:teuthology.orchestra.run.smithi120.stdout:702 write 0xb08f348 thru 0xb09bdc2 (0xca7b bytes) 2024-09-13T05:10:22.142 INFO:teuthology.orchestra.run.smithi120.stdout:703 read 0x9266be thru 0x92fa0e (0x9351 bytes) 2024-09-13T05:10:22.142 INFO:teuthology.orchestra.run.smithi120.stdout:704 write 0x700d303 thru 0x701a4c1 (0xd1bf bytes) 2024-09-13T05:10:22.151 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:22.151 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:22.155 INFO:teuthology.orchestra.run.smithi120.stdout:705 read 0x6a64d16 thru 0x6a6b80c (0x6af7 bytes) 2024-09-13T05:10:22.155 INFO:teuthology.orchestra.run.smithi120.stdout:707 write 0x768c8c4 thru 0x769187f (0x4fbc bytes) 2024-09-13T05:10:22.162 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:10:22.162 INFO:teuthology.orchestra.run.smithi120.stdout:708 write 0x9e8001c thru 0x9e843f6 (0x43db bytes) 2024-09-13T05:10:22.169 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:22.167+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:22.181 INFO:teuthology.orchestra.run.smithi120.stdout:709 trunc from 0xb09bdc3 to 0x44ccb25 2024-09-13T05:10:22.201 INFO:teuthology.orchestra.run.smithi120.stdout:710 write 0x3803a91 thru 0x38054d7 (0x1a47 bytes) 2024-09-13T05:10:22.206 INFO:teuthology.orchestra.run.smithi120.stdout:711 read 0x3b97bf0 thru 0x3ba1685 (0x9a96 bytes) 2024-09-13T05:10:22.223 INFO:teuthology.orchestra.run.smithi120.stdout:713 write 0x942817a thru 0x942c361 (0x41e8 bytes) 2024-09-13T05:10:22.235 INFO:teuthology.orchestra.run.smithi120.stdout:715 trunc from 0x942c362 to 0x782d2fb 2024-09-13T05:10:22.259 INFO:teuthology.orchestra.run.smithi120.stdout:717 trunc from 0x782d2fb to 0x2d96988 2024-09-13T05:10:22.270 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:22.267+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:22.289 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:22.289 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:22.293 INFO:teuthology.orchestra.run.smithi120.stdout:718 trunc from 0x2d96988 to 0xbd70e2a 2024-09-13T05:10:22.301 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:10:22.303 INFO:teuthology.orchestra.run.smithi120.stdout:719 write 0x337f338 thru 0x338e7d3 (0xf49c bytes) 2024-09-13T05:10:22.318 INFO:teuthology.orchestra.run.smithi120.stdout:721 punch from 0xb68e69d to 0xb692198, (0x3afb bytes) 2024-09-13T05:10:22.318 INFO:teuthology.orchestra.run.smithi120.stdout:722 read 0x221e7c7 thru 0x222a072 (0xb8ac bytes) 2024-09-13T05:10:22.320 INFO:teuthology.orchestra.run.smithi120.stdout:723 trunc from 0xbd70e2a to 0xd0c439a 2024-09-13T05:10:22.328 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:22.328 INFO:teuthology.orchestra.run.smithi120.stdout:725 punch from 0x59d22b9 to 0x59d94e7, (0x722e bytes) 2024-09-13T05:10:22.329 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:22.329 INFO:teuthology.orchestra.run.smithi120.stdout:728 read 0xb935b32 thru 0xb93ff9a (0xa469 bytes) 2024-09-13T05:10:22.329 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:22.340 INFO:teuthology.orchestra.run.smithi120.stdout:731 write 0xe8237f3 thru 0xe8324f0 (0xecfe bytes) 2024-09-13T05:10:22.354 INFO:teuthology.orchestra.run.smithi120.stdout:732 read 0x11d950d thru 0x11e0933 (0x7427 bytes) 2024-09-13T05:10:22.354 INFO:teuthology.orchestra.run.smithi120.stdout:733 write 0x5af94c1 thru 0x5afe809 (0x5349 bytes) 2024-09-13T05:10:22.359 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:22.359 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:22.359 INFO:teuthology.orchestra.run.smithi120.stdout:737 write 0x452f58b thru 0x45304fe (0xf74 bytes) 2024-09-13T05:10:22.366 INFO:teuthology.orchestra.run.smithi120.stdout:738 read 0xbe0a5b7 thru 0xbe1173e (0x7188 bytes) 2024-09-13T05:10:22.366 INFO:teuthology.orchestra.run.smithi120.stdout:739 read 0x2d47371 thru 0x2d5027d (0x8f0d bytes) 2024-09-13T05:10:22.366 INFO:teuthology.orchestra.run.smithi120.stdout:740 writesame 0x53d94f4 thru 0x53e4f67 data_size 0x2(0xba74 bytes) 2024-09-13T05:10:22.370 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:22.367+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:22.381 INFO:teuthology.orchestra.run.smithi120.stdout:741 read 0x755e521 thru 0x7564351 (0x5e31 bytes) 2024-09-13T05:10:22.383 INFO:teuthology.orchestra.run.smithi120.stdout:742 trunc from 0xe8324f1 to 0xca7f3ee 2024-09-13T05:10:22.399 INFO:teuthology.orchestra.run.smithi120.stdout:744 read 0x771da0 thru 0x77b1d1 (0x9432 bytes) 2024-09-13T05:10:22.399 INFO:teuthology.orchestra.run.smithi120.stdout:745 read 0x2f18733 thru 0x2f1e864 (0x6132 bytes) 2024-09-13T05:10:22.414 INFO:teuthology.orchestra.run.smithi120.stdout:747 trunc from 0xca7f3ee to 0x4eab426 2024-09-13T05:10:22.423 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:22.423 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:22.434 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:10:22.442 INFO:teuthology.orchestra.run.smithi120.stdout:748 trunc from 0x4eab426 to 0x21711ad 2024-09-13T05:10:22.471 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:22.467+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:22.493 INFO:teuthology.orchestra.run.smithi120.stdout:750 write 0xd785559 thru 0xd787952 (0x23fa bytes) 2024-09-13T05:10:22.498 INFO:teuthology.orchestra.run.smithi120.stdout:751 write 0x4c1b95a thru 0x4c1c337 (0x9de bytes) 2024-09-13T05:10:22.506 INFO:teuthology.orchestra.run.smithi120.stdout:752 read 0x67f98d1 thru 0x67fd0f5 (0x3825 bytes) 2024-09-13T05:10:22.506 INFO:teuthology.orchestra.run.smithi120.stdout:753 punch from 0xb9cdeaa to 0xb9cfa6c, (0x1bc2 bytes) 2024-09-13T05:10:22.517 INFO:teuthology.orchestra.run.smithi120.stdout:754 write 0xdcc6187 thru 0xdccb99e (0x5818 bytes) 2024-09-13T05:10:22.525 INFO:teuthology.orchestra.run.smithi120.stdout:756 read 0x358a320 thru 0x3593e11 (0x9af2 bytes) 2024-09-13T05:10:22.527 INFO:teuthology.orchestra.run.smithi120.stdout:757 trunc from 0xdccb99f to 0xcccf3a5 2024-09-13T05:10:22.546 INFO:teuthology.orchestra.run.smithi120.stdout:759 read 0x9189d05 thru 0x9197669 (0xd965 bytes) 2024-09-13T05:10:22.546 INFO:teuthology.orchestra.run.smithi120.stdout:761 read 0xc833d88 thru 0xc834d5b (0xfd4 bytes) 2024-09-13T05:10:22.546 INFO:teuthology.orchestra.run.smithi120.stdout:762 write 0x4caae76 thru 0x4cb962f (0xe7ba bytes) 2024-09-13T05:10:22.557 INFO:teuthology.orchestra.run.smithi120.stdout:763 write 0x5650dcb thru 0x5652ecf (0x2105 bytes) 2024-09-13T05:10:22.559 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:22.559 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:22.562 INFO:teuthology.orchestra.run.smithi120.stdout:764 punch from 0x6b8f92 to 0x6bbd95, (0x2e03 bytes) 2024-09-13T05:10:22.564 INFO:teuthology.orchestra.run.smithi120.stdout:765 trunc from 0xcccf3a5 to 0xd59ae5a 2024-09-13T05:10:22.571 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:10:22.572 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:22.567+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:22.574 INFO:teuthology.orchestra.run.smithi120.stdout:766 writesame 0x8b3f88c thru 0x8b4babc data_size 0x49(0xc231 bytes) 2024-09-13T05:10:22.585 INFO:teuthology.orchestra.run.smithi120.stdout:769 write 0xbb02ce5 thru 0xbb11fb4 (0xf2d0 bytes) 2024-09-13T05:10:22.601 INFO:teuthology.orchestra.run.smithi120.stdout:770 write 0x129d328 thru 0x12a3aef (0x67c8 bytes) 2024-09-13T05:10:22.616 INFO:teuthology.orchestra.run.smithi120.stdout:771 trunc from 0xd59ae5a to 0x981a39b 2024-09-13T05:10:22.637 INFO:teuthology.orchestra.run.smithi120.stdout:772 trunc from 0x981a39b to 0x8898a5e 2024-09-13T05:10:22.655 INFO:teuthology.orchestra.run.smithi120.stdout:773 punch from 0x23f0d10 to 0x23f542d, (0x471d bytes) 2024-09-13T05:10:22.661 INFO:teuthology.orchestra.run.smithi120.stdout:774 trunc from 0x8898a5e to 0xc38e448 2024-09-13T05:10:22.672 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:22.672 INFO:teuthology.orchestra.run.smithi120.stdout:778 writesame 0x6110af8 thru 0x6113bc2 data_size 0x1(0x30cb bytes) 2024-09-13T05:10:22.673 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:22.670+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:22.685 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:22.685 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:22.697 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:10:22.700 INFO:teuthology.orchestra.run.smithi120.stdout:779 write 0xd1fb2d0 thru 0xd203e4f (0x8b80 bytes) 2024-09-13T05:10:22.708 INFO:teuthology.orchestra.run.smithi120.stdout:781 writesame 0x902c5d8 thru 0x903711f data_size 0x57(0xab48 bytes) 2024-09-13T05:10:22.719 INFO:teuthology.orchestra.run.smithi120.stdout:782 read 0xc64646c thru 0xc64e80f (0x83a4 bytes) 2024-09-13T05:10:22.719 INFO:teuthology.orchestra.run.smithi120.stdout:783 writesame 0x685cd81 thru 0x685ec84 data_size 0xa(0x1f04 bytes) 2024-09-13T05:10:22.725 INFO:teuthology.orchestra.run.smithi120.stdout:787 read 0x5077135 thru 0x507c5fd (0x54c9 bytes) 2024-09-13T05:10:22.725 INFO:teuthology.orchestra.run.smithi120.stdout:789 punch from 0x517cc22 to 0x518ca30, (0xfe0e bytes) 2024-09-13T05:10:22.725 INFO:teuthology.orchestra.run.smithi120.stdout:790 write 0xc24a8c2 thru 0xc24b6ab (0xdea bytes) 2024-09-13T05:10:22.731 INFO:teuthology.orchestra.run.smithi120.stdout:791 writesame 0xa24e873 thru 0xa259389 data_size 0x1(0xab17 bytes) 2024-09-13T05:10:22.739 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.0 to 1 (10000) 2024-09-13T05:10:22.753 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-13T05:10:22.756 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:22.756 INFO:teuthology.orchestra.run.smithi120.stdout:794 write 0xd1c503f thru 0xd1d2af9 (0xdabb bytes) 2024-09-13T05:10:22.764 INFO:teuthology.orchestra.run.smithi120.stdout:795 trunc from 0xd203e50 to 0xc9c4303 2024-09-13T05:10:22.774 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:22.770+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:22.778 INFO:teuthology.orchestra.run.smithi120.stdout:796 write 0x975b940 thru 0x975ba9a (0x15b bytes) 2024-09-13T05:10:22.795 INFO:teuthology.orchestra.run.smithi120.stdout:797 write 0xe3b9644 thru 0xe3bb7cf (0x218c bytes) 2024-09-13T05:10:22.801 INFO:teuthology.orchestra.run.smithi120.stdout:798 read 0xcf49db0 thru 0xcf4b174 (0x13c5 bytes) 2024-09-13T05:10:22.814 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:22.814 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:22.820 INFO:teuthology.orchestra.run.smithi120.stdout:799 trunc from 0xe3bb7d0 to 0x2dcb5d2 2024-09-13T05:10:22.824 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:10:22.841 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T05:10:22.844 INFO:teuthology.orchestra.run.smithi120.stdout:800 read 0x15eee2 thru 0x162e54 (0x3f73 bytes) 2024-09-13T05:10:22.845 INFO:teuthology.orchestra.run.smithi120.stdout:801 punch from 0xdf102f to 0xdf9d96, (0x8d67 bytes) 2024-09-13T05:10:22.864 INFO:teuthology.orchestra.run.smithi120.stdout:802 write 0x831f80d thru 0x83271fd (0x79f1 bytes) 2024-09-13T05:10:22.873 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:22.875 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:22.871+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:22.884 INFO:teuthology.orchestra.run.smithi120.stdout:806 writesame 0xb40009e thru 0xb40c5cc data_size 0xd(0xc52f bytes) 2024-09-13T05:10:22.884 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:22.885 INFO:teuthology.orchestra.run.smithi120.stdout:808 clone 5 order 18 su 32768 sc 2 2024-09-13T05:10:22.921 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:22.921 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:22.933 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:10:22.977 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:22.974+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:23.036 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:23.037 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:23.046 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:10:23.078 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:23.075+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:23.150 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:23.150 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:23.160 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:10:23.209 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:23.207+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:23.273 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:23.273 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:23.280 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:23.278+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:23.282 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:10:23.381 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:23.378+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:23.387 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:23.387 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:23.397 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:10:23.482 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:23.478+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:23.508 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:23.508 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:23.518 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:10:23.583 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:23.578+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:23.612 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.1 to 1 (10000) 2024-09-13T05:10:23.613 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is set 2024-09-13T05:10:23.626 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-13T05:10:23.628 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:23.629 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:23.639 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:10:23.689 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:23.687+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:23.751 INFO:teuthology.orchestra.run.smithi120.stdout:leaving image image_client.0-clone4 intact 2024-09-13T05:10:23.752 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:23.752 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:23.762 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:10:23.785 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:23.779+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:23.864 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:23.864 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:23.874 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:10:23.885 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:23.882+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:23.941 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:10:23.980 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:23.981 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:23.986 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:23.983+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:23.990 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:10:23.994 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #3, image image_client.0-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent4 2024-09-13T05:10:24.087 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:24.083+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:24.099 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:10:24.124 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:10:24.142 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:24.142 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:24.143 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:10:24.147 INFO:teuthology.orchestra.run.smithi120.stdout:809 read 0x8ea0b4b thru 0x8eadaf6 (0xcfac bytes) 2024-09-13T05:10:24.152 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:10:24.155 INFO:teuthology.orchestra.run.smithi120.stdout:810 trunc from 0xb40c5cd to 0xb138b91 2024-09-13T05:10:24.163 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:10:24.178 INFO:teuthology.orchestra.run.smithi120.stdout:811 read 0x744ec99 thru 0x745c2c1 (0xd629 bytes) 2024-09-13T05:10:24.178 INFO:teuthology.orchestra.run.smithi120.stdout:812 write 0x965bf11 thru 0x9660e8a (0x4f7a bytes) 2024-09-13T05:10:24.188 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:24.183+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:24.189 INFO:teuthology.orchestra.run.smithi120.stdout:813 write 0xa8b6c9e thru 0xa8bc2c6 (0x5629 bytes) 2024-09-13T05:10:24.195 INFO:teuthology.orchestra.run.smithi120.stdout:814 writesame 0x4e3302f thru 0x4e37a1d data_size 0x9(0x49ef bytes) 2024-09-13T05:10:24.200 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:10:24.202 INFO:teuthology.orchestra.run.smithi120.stdout:815 read 0x42b8612 thru 0x42c2f00 (0xa8ef bytes) 2024-09-13T05:10:24.202 INFO:teuthology.orchestra.run.smithi120.stdout:816 write 0x31cf321 thru 0x31ded32 (0xfa12 bytes) 2024-09-13T05:10:24.211 INFO:teuthology.orchestra.run.smithi120.stdout:818 write 0x4458b9b thru 0x445d8bc (0x4d22 bytes) 2024-09-13T05:10:24.215 INFO:teuthology.orchestra.run.smithi120.stdout:819 read 0x3e11df3 thru 0x3e155af (0x37bd bytes) 2024-09-13T05:10:24.215 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:24.228 INFO:teuthology.orchestra.run.smithi120.stdout:822 trunc from 0xb138b91 to 0x3919dfc 2024-09-13T05:10:24.235 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:10:24.257 INFO:teuthology.orchestra.run.smithi120.stdout:823 punch from 0x17a094 to 0x18a042, (0xffae bytes) 2024-09-13T05:10:24.270 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:10:24.278 INFO:teuthology.orchestra.run.smithi120.stdout:824 writesame 0xb2a699c thru 0xb2b57bc data_size 0x1(0xee21 bytes) 2024-09-13T05:10:24.278 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:24.289 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:24.287+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:24.292 INFO:teuthology.orchestra.run.smithi120.stdout:827 write 0xd8c15b5 thru 0xd8c438f (0x2ddb bytes) 2024-09-13T05:10:24.299 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:24.299 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:24.299 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:10:24.299 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:24.300 INFO:teuthology.orchestra.run.smithi120.stdout:828 trunc from 0xd8c4390 to 0xbc7c3d4 2024-09-13T05:10:24.304 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:10:24.307 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:10:24.307 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:10:24.307 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:10:24.307 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:10:24.307 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:10:24.307 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:10:24.308 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:10:24.308 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:10:24.310 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:10:24.321 INFO:teuthology.orchestra.run.smithi120.stdout:830 writesame 0x9653877 thru 0x965d1cd data_size 0x5(0x9957 bytes) 2024-09-13T05:10:24.331 INFO:teuthology.orchestra.run.smithi120.stdout:831 writesame 0x1debdd4 thru 0x1df3180 data_size 0x1(0x73ad bytes) 2024-09-13T05:10:24.352 INFO:teuthology.orchestra.run.smithi120.stdout:832 writesame 0xe8f67e thru 0xe91902 data_size 0x1(0x2285 bytes) 2024-09-13T05:10:24.364 INFO:teuthology.orchestra.run.smithi120.stdout:833 write 0x95772b thru 0x959575 (0x1e4b bytes) 2024-09-13T05:10:24.371 INFO:teuthology.orchestra.run.smithi120.stdout:834 clone 6 order 22 su 524288 sc 3 2024-09-13T05:10:24.390 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:24.387+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:24.417 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:24.417 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:24.418 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:24.418 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:24.418 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:24.427 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:10:24.490 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:24.487+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:24.533 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:24.533 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:24.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:24.533 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:24.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.533 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-13T05:10:24.533 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:11.667898+0000", 2024-09-13T05:10:24.533 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.861396941000001, 2024-09-13T05:10:24.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.008082657, 2024-09-13T05:10:24.534 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:24.534 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:24.534 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:24.534 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:24.534 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:24.534 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11 2024-09-13T05:10:24.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.534 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:24.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:24.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.667898+0000", 2024-09-13T05:10:24.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:24.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.667898+0000", 2024-09-13T05:10:24.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:24.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.667896+0000", 2024-09-13T05:10:24.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:24.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:24.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.667909+0000", 2024-09-13T05:10:24.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2808e-05 2024-09-13T05:10:24.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:24.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.667928+0000", 2024-09-13T05:10:24.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9153000000000001e-05 2024-09-13T05:10:24.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:24.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.667938+0000", 2024-09-13T05:10:24.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0990000000000005e-06 2024-09-13T05:10:24.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:24.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.667990+0000", 2024-09-13T05:10:24.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2546999999999997e-05 2024-09-13T05:10:24.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-13T05:10:24.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.667994+0000", 2024-09-13T05:10:24.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9539999999999998e-06 2024-09-13T05:10:24.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:24.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.671064+0000", 2024-09-13T05:10:24.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030704650000000001 2024-09-13T05:10:24.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:24.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.671232+0000", 2024-09-13T05:10:24.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016773299999999999 2024-09-13T05:10:24.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:10:24.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.671436+0000", 2024-09-13T05:10:24.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020358 2024-09-13T05:10:24.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:24.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.673340+0000", 2024-09-13T05:10:24.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001903821 2024-09-13T05:10:24.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:24.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.675901+0000", 2024-09-13T05:10:24.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025612429999999999 2024-09-13T05:10:24.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:24.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.675948+0000", 2024-09-13T05:10:24.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7456000000000001e-05 2024-09-13T05:10:24.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:24.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.675981+0000", 2024-09-13T05:10:24.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2570999999999997e-05 2024-09-13T05:10:24.541 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.541 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:24.541 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.541 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:1710 3.12 3:4a994a25:::rbd_header.112d318cd671:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:24.541 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:19.711454+0000", 2024-09-13T05:10:24.541 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.8178407390000002, 2024-09-13T05:10:24.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083770449999999996, 2024-09-13T05:10:24.541 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:24.541 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:24.541 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:24.541 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:24.541 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:24.542 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1710 2024-09-13T05:10:24.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.542 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:24.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:24.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.711454+0000", 2024-09-13T05:10:24.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:24.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.711454+0000", 2024-09-13T05:10:24.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:24.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.711450+0000", 2024-09-13T05:10:24.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999957 2024-09-13T05:10:24.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:24.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.711474+0000", 2024-09-13T05:10:24.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4309999999999999e-05 2024-09-13T05:10:24.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:24.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.711518+0000", 2024-09-13T05:10:24.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3902000000000001e-05 2024-09-13T05:10:24.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:24.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.711536+0000", 2024-09-13T05:10:24.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7920000000000001e-05 2024-09-13T05:10:24.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:24.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.711697+0000", 2024-09-13T05:10:24.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016134299999999999 2024-09-13T05:10:24.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-13T05:10:24.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.711715+0000", 2024-09-13T05:10:24.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7606000000000001e-05 2024-09-13T05:10:24.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:24.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.717654+0000", 2024-09-13T05:10:24.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005938886 2024-09-13T05:10:24.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:24.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.717741+0000", 2024-09-13T05:10:24.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6652999999999999e-05 2024-09-13T05:10:24.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:10:24.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.718064+0000", 2024-09-13T05:10:24.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032323600000000002 2024-09-13T05:10:24.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:24.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.718853+0000", 2024-09-13T05:10:24.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00078914100000000004 2024-09-13T05:10:24.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:24.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.719769+0000", 2024-09-13T05:10:24.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00091599400000000005 2024-09-13T05:10:24.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:24.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.719804+0000", 2024-09-13T05:10:24.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5380999999999999e-05 2024-09-13T05:10:24.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:24.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.719831+0000", 2024-09-13T05:10:24.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7117000000000001e-05 2024-09-13T05:10:24.548 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.548 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:24.548 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.549 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2841 3.6 3:60b915a0:::rbd_data.112d872fd67a.0000000000000057:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:24.549 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.905488+0000", 2024-09-13T05:10:24.549 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.6238073110000002, 2024-09-13T05:10:24.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078414980000000006, 2024-09-13T05:10:24.549 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:24.549 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:24.549 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:24.549 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:24.549 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:24.549 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2841 2024-09-13T05:10:24.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.550 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:24.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:24.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.905488+0000", 2024-09-13T05:10:24.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:24.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.905488+0000", 2024-09-13T05:10:24.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:24.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.905486+0000", 2024-09-13T05:10:24.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:24.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:24.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.905497+0000", 2024-09-13T05:10:24.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166000000000001e-05 2024-09-13T05:10:24.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:24.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.905510+0000", 2024-09-13T05:10:24.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3555e-05 2024-09-13T05:10:24.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:24.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.905519+0000", 2024-09-13T05:10:24.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4400000000000005e-06 2024-09-13T05:10:24.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:24.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.905580+0000", 2024-09-13T05:10:24.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1186000000000007e-05 2024-09-13T05:10:24.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:24.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.905655+0000", 2024-09-13T05:10:24.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5680999999999996e-05 2024-09-13T05:10:24.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:24.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.905843+0000", 2024-09-13T05:10:24.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018795199999999999 2024-09-13T05:10:24.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:24.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.910302+0000", 2024-09-13T05:10:24.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044588910000000004 2024-09-13T05:10:24.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:24.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.913235+0000", 2024-09-13T05:10:24.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029328319999999998 2024-09-13T05:10:24.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:24.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.913288+0000", 2024-09-13T05:10:24.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2562000000000003e-05 2024-09-13T05:10:24.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:24.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.913329+0000", 2024-09-13T05:10:24.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1640000000000001e-05 2024-09-13T05:10:24.555 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.555 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:24.555 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.555 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2883 3.6 3:6081175a:::rbd_data.112d872fd67a.000000000000005b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:24.555 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.912522+0000", 2024-09-13T05:10:24.555 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.6167731769999998, 2024-09-13T05:10:24.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083975969999999997, 2024-09-13T05:10:24.556 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:24.556 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:24.556 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:24.556 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:24.556 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:24.556 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2883 2024-09-13T05:10:24.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.556 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:24.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:24.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912522+0000", 2024-09-13T05:10:24.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:24.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912522+0000", 2024-09-13T05:10:24.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:24.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912521+0000", 2024-09-13T05:10:24.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:24.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:24.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912528+0000", 2024-09-13T05:10:24.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2540000000000003e-06 2024-09-13T05:10:24.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:24.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912538+0000", 2024-09-13T05:10:24.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7399999999999999e-06 2024-09-13T05:10:24.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:24.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912545+0000", 2024-09-13T05:10:24.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-09-13T05:10:24.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:24.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912591+0000", 2024-09-13T05:10:24.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5918000000000003e-05 2024-09-13T05:10:24.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:24.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912685+0000", 2024-09-13T05:10:24.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3610999999999995e-05 2024-09-13T05:10:24.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:24.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912873+0000", 2024-09-13T05:10:24.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018814600000000001 2024-09-13T05:10:24.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:24.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.918430+0000", 2024-09-13T05:10:24.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055577389999999999 2024-09-13T05:10:24.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:24.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.920808+0000", 2024-09-13T05:10:24.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023773240000000001 2024-09-13T05:10:24.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:24.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.920863+0000", 2024-09-13T05:10:24.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5099999999999998e-05 2024-09-13T05:10:24.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:24.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.920920+0000", 2024-09-13T05:10:24.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6671e-05 2024-09-13T05:10:24.561 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.561 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:24.561 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.561 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2885 3.17 3:e9b465a6:::rbd_data.112d872fd67a.000000000000005a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:24.561 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.912800+0000", 2024-09-13T05:10:24.561 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.6164947500000002, 2024-09-13T05:10:24.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081647930000000001, 2024-09-13T05:10:24.562 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:24.562 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:24.562 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:24.562 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:24.562 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:24.562 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2885 2024-09-13T05:10:24.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.562 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:24.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:24.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912800+0000", 2024-09-13T05:10:24.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:24.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912800+0000", 2024-09-13T05:10:24.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:24.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912799+0000", 2024-09-13T05:10:24.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:24.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:24.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912807+0000", 2024-09-13T05:10:24.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1769999999999998e-06 2024-09-13T05:10:24.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:24.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912822+0000", 2024-09-13T05:10:24.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4501999999999999e-05 2024-09-13T05:10:24.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:24.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912830+0000", 2024-09-13T05:10:24.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2279999999999998e-06 2024-09-13T05:10:24.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:24.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912909+0000", 2024-09-13T05:10:24.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8910000000000002e-05 2024-09-13T05:10:24.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:24.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.912991+0000", 2024-09-13T05:10:24.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2454999999999996e-05 2024-09-13T05:10:24.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:10:24.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.913204+0000", 2024-09-13T05:10:24.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000212303 2024-09-13T05:10:24.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:24.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.914487+0000", 2024-09-13T05:10:24.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012830540000000001 2024-09-13T05:10:24.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:24.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.920887+0000", 2024-09-13T05:10:24.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063999319999999997 2024-09-13T05:10:24.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:24.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.920923+0000", 2024-09-13T05:10:24.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6619000000000003e-05 2024-09-13T05:10:24.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:24.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.920965+0000", 2024-09-13T05:10:24.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1904999999999999e-05 2024-09-13T05:10:24.567 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.567 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:24.567 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.567 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "pg_update_log_missing(3.b epoch 31/22 rep_tid 125 entries 31'9 (0'0) error 3:d32df763:::rbd_data.112d872fd67a.000000000000006b:head by client.4397.0:2947 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 30'5)", 2024-09-13T05:10:24.567 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.921713+0000", 2024-09-13T05:10:24.567 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.60758176, 2024-09-13T05:10:24.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088039680000000006, 2024-09-13T05:10:24.567 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:24.568 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:10:24.568 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:24.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:24.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921713+0000", 2024-09-13T05:10:24.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:24.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921713+0000", 2024-09-13T05:10:24.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:24.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921712+0000", 2024-09-13T05:10:24.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:24.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:24.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921722+0000", 2024-09-13T05:10:24.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6500000000000008e-06 2024-09-13T05:10:24.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:24.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921735+0000", 2024-09-13T05:10:24.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3273e-05 2024-09-13T05:10:24.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:24.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921745+0000", 2024-09-13T05:10:24.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9839999999999996e-06 2024-09-13T05:10:24.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:24.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.922375+0000", 2024-09-13T05:10:24.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062995800000000002 2024-09-13T05:10:24.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:24.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.930517+0000", 2024-09-13T05:10:24.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081421150000000001 2024-09-13T05:10:24.571 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.571 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:24.571 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.571 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:2959 3.10 e31/22 3:0f6f02a0:::rbd_data.112d872fd67a.000000000000006f:head v 31'20, mlcod=31'16)", 2024-09-13T05:10:24.571 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.922687+0000", 2024-09-13T05:10:24.572 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.6066085490000002, 2024-09-13T05:10:24.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078221469999999998, 2024-09-13T05:10:24.572 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:24.572 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:24.572 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:24.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:24.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.922687+0000", 2024-09-13T05:10:24.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:24.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.922687+0000", 2024-09-13T05:10:24.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:24.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.922686+0000", 2024-09-13T05:10:24.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:24.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:24.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.922694+0000", 2024-09-13T05:10:24.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2209999999999997e-06 2024-09-13T05:10:24.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:24.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.922707+0000", 2024-09-13T05:10:24.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3273e-05 2024-09-13T05:10:24.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:24.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.922714+0000", 2024-09-13T05:10:24.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8009999999999998e-06 2024-09-13T05:10:24.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:24.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.922768+0000", 2024-09-13T05:10:24.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4348999999999998e-05 2024-09-13T05:10:24.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:24.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.922789+0000", 2024-09-13T05:10:24.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0319999999999999e-05 2024-09-13T05:10:24.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:24.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.930477+0000", 2024-09-13T05:10:24.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076886350000000001 2024-09-13T05:10:24.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:24.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.930509+0000", 2024-09-13T05:10:24.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1454000000000001e-05 2024-09-13T05:10:24.575 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.576 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:24.576 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.576 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:3027 3.3 3:c20efd71:::rbd_data.112d872fd67a.0000000000000076:head [stat,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:24.576 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.931515+0000", 2024-09-13T05:10:24.576 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.597780502, 2024-09-13T05:10:24.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079073319999999996, 2024-09-13T05:10:24.576 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:24.576 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:24.576 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:24.576 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:24.576 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:24.577 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 3027 2024-09-13T05:10:24.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.577 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:24.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:24.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.931515+0000", 2024-09-13T05:10:24.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:24.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.931515+0000", 2024-09-13T05:10:24.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:24.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.931514+0000", 2024-09-13T05:10:24.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:24.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:24.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.931519+0000", 2024-09-13T05:10:24.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1830000000000002e-06 2024-09-13T05:10:24.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:24.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.931530+0000", 2024-09-13T05:10:24.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0688e-05 2024-09-13T05:10:24.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:24.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.931537+0000", 2024-09-13T05:10:24.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3839999999999999e-06 2024-09-13T05:10:24.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:24.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.931791+0000", 2024-09-13T05:10:24.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025405499999999999 2024-09-13T05:10:24.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:24.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.931891+0000", 2024-09-13T05:10:24.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010012 2024-09-13T05:10:24.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:24.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.939422+0000", 2024-09-13T05:10:24.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0075306599999999998 2024-09-13T05:10:24.580 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.580 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:24.580 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.580 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4722 3.3 3:c4c358af:::rbd_data.112d318cd671.0000000000000002:6 [read 6193152~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:24.580 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.714899+0000", 2024-09-13T05:10:24.580 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.8143959139999999, 2024-09-13T05:10:24.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078163629999999998, 2024-09-13T05:10:24.581 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:24.581 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:24.581 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:24.581 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:24.581 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:24.581 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4722 2024-09-13T05:10:24.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.581 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:24.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:24.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714899+0000", 2024-09-13T05:10:24.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:24.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714899+0000", 2024-09-13T05:10:24.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:24.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714899+0000", 2024-09-13T05:10:24.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:24.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:24.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714902+0000", 2024-09-13T05:10:24.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1360000000000001e-06 2024-09-13T05:10:24.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:24.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714908+0000", 2024-09-13T05:10:24.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6649999999999997e-06 2024-09-13T05:10:24.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:24.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714914+0000", 2024-09-13T05:10:24.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1019999999999996e-06 2024-09-13T05:10:24.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:24.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.722564+0000", 2024-09-13T05:10:24.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076509409999999996 2024-09-13T05:10:24.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:24.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.722638+0000", 2024-09-13T05:10:24.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3545000000000001e-05 2024-09-13T05:10:24.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:24.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.722716+0000", 2024-09-13T05:10:24.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7619000000000003e-05 2024-09-13T05:10:24.584 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.585 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:24.585 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.585 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4726 3.3 3:c4c358af:::rbd_data.112d318cd671.0000000000000002:6 [read 4767744~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:24.585 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.714920+0000", 2024-09-13T05:10:24.585 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.8143753299999998, 2024-09-13T05:10:24.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079747570000000007, 2024-09-13T05:10:24.585 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:24.585 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:24.585 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:24.585 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:24.585 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:24.586 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4726 2024-09-13T05:10:24.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.586 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:24.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:24.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714920+0000", 2024-09-13T05:10:24.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:24.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714920+0000", 2024-09-13T05:10:24.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:24.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714919+0000", 2024-09-13T05:10:24.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:24.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:24.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714924+0000", 2024-09-13T05:10:24.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3850000000000004e-06 2024-09-13T05:10:24.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:24.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714930+0000", 2024-09-13T05:10:24.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8869999999999997e-06 2024-09-13T05:10:24.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:24.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714934+0000", 2024-09-13T05:10:24.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7500000000000003e-06 2024-09-13T05:10:24.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:24.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.722741+0000", 2024-09-13T05:10:24.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078064040000000003 2024-09-13T05:10:24.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:24.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.722815+0000", 2024-09-13T05:10:24.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4136999999999998e-05 2024-09-13T05:10:24.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:24.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.722895+0000", 2024-09-13T05:10:24.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9684000000000005e-05 2024-09-13T05:10:24.589 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.589 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:24.589 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.590 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4728 3.3 3:c4c358af:::rbd_data.112d318cd671.0000000000000002:6 [read 4374528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:24.590 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.714952+0000", 2024-09-13T05:10:24.590 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.814343579, 2024-09-13T05:10:24.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081893299999999999, 2024-09-13T05:10:24.590 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:24.590 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:24.590 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:24.590 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:24.590 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:24.590 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4728 2024-09-13T05:10:24.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.590 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:24.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:24.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714952+0000", 2024-09-13T05:10:24.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:24.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714952+0000", 2024-09-13T05:10:24.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:24.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714951+0000", 2024-09-13T05:10:24.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:24.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:24.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714954+0000", 2024-09-13T05:10:24.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.304e-06 2024-09-13T05:10:24.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:24.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714961+0000", 2024-09-13T05:10:24.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.832e-06 2024-09-13T05:10:24.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:24.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714966+0000", 2024-09-13T05:10:24.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1950000000000002e-06 2024-09-13T05:10:24.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:24.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.722929+0000", 2024-09-13T05:10:24.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007962729 2024-09-13T05:10:24.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:24.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.723027+0000", 2024-09-13T05:10:24.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8176000000000003e-05 2024-09-13T05:10:24.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:24.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.723141+0000", 2024-09-13T05:10:24.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113634 2024-09-13T05:10:24.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.594 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:24.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.594 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4730 3.3 3:c4c358af:::rbd_data.112d318cd671.0000000000000002:6 [read 4964352~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:24.594 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.714971+0000", 2024-09-13T05:10:24.594 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.814324101, 2024-09-13T05:10:24.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084342770000000004, 2024-09-13T05:10:24.594 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:24.595 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:24.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:24.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:24.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:24.595 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4730 2024-09-13T05:10:24.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.595 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:24.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:24.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714971+0000", 2024-09-13T05:10:24.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:24.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714971+0000", 2024-09-13T05:10:24.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:24.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714971+0000", 2024-09-13T05:10:24.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:24.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:24.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714973+0000", 2024-09-13T05:10:24.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5550000000000001e-06 2024-09-13T05:10:24.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:24.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714978+0000", 2024-09-13T05:10:24.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2079999999999999e-06 2024-09-13T05:10:24.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:24.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714983+0000", 2024-09-13T05:10:24.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0039999999999999e-06 2024-09-13T05:10:24.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:24.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.723172+0000", 2024-09-13T05:10:24.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081880530000000007 2024-09-13T05:10:24.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:24.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.723279+0000", 2024-09-13T05:10:24.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107131 2024-09-13T05:10:24.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:24.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.723405+0000", 2024-09-13T05:10:24.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126699 2024-09-13T05:10:24.599 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.599 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:24.599 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.599 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4732 3.3 3:c4c358af:::rbd_data.112d318cd671.0000000000000002:6 [read 4571136~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:24.600 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.714988+0000", 2024-09-13T05:10:24.600 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.8143074869999998, 2024-09-13T05:10:24.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0085869420000000002, 2024-09-13T05:10:24.600 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:24.600 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:24.600 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:24.600 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:24.600 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:24.600 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4732 2024-09-13T05:10:24.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.600 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:24.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:24.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714988+0000", 2024-09-13T05:10:24.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:24.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714988+0000", 2024-09-13T05:10:24.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:24.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714987+0000", 2024-09-13T05:10:24.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:24.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:24.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714990+0000", 2024-09-13T05:10:24.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4930000000000001e-06 2024-09-13T05:10:24.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:24.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.714995+0000", 2024-09-13T05:10:24.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5500000000000002e-06 2024-09-13T05:10:24.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:24.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715000+0000", 2024-09-13T05:10:24.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.656e-06 2024-09-13T05:10:24.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:24.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.723447+0000", 2024-09-13T05:10:24.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084468679999999997 2024-09-13T05:10:24.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:24.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.723506+0000", 2024-09-13T05:10:24.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8814000000000003e-05 2024-09-13T05:10:24.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:24.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.723575+0000", 2024-09-13T05:10:24.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8931999999999997e-05 2024-09-13T05:10:24.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.604 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:24.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.604 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4734 3.3 3:c4c358af:::rbd_data.112d318cd671.0000000000000002:6 [read 5160960~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:24.604 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.715004+0000", 2024-09-13T05:10:24.604 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.8142907660000001, 2024-09-13T05:10:24.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088439759999999999, 2024-09-13T05:10:24.604 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:24.605 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:24.605 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:24.605 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:24.605 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:24.605 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4734 2024-09-13T05:10:24.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.605 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:24.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:24.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715004+0000", 2024-09-13T05:10:24.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:24.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715004+0000", 2024-09-13T05:10:24.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:24.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715004+0000", 2024-09-13T05:10:24.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:24.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:24.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715007+0000", 2024-09-13T05:10:24.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.745e-06 2024-09-13T05:10:24.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:24.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715012+0000", 2024-09-13T05:10:24.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5439999999999998e-06 2024-09-13T05:10:24.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:24.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715017+0000", 2024-09-13T05:10:24.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5530000000000003e-06 2024-09-13T05:10:24.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:24.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.723625+0000", 2024-09-13T05:10:24.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.008608213 2024-09-13T05:10:24.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:24.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.723728+0000", 2024-09-13T05:10:24.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102946 2024-09-13T05:10:24.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:24.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.723848+0000", 2024-09-13T05:10:24.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012032999999999999 2024-09-13T05:10:24.608 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.608 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:24.608 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.609 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4740 3.3 3:c4c358af:::rbd_data.112d318cd671.0000000000000002:6 [read 5357568~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:24.609 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.715033+0000", 2024-09-13T05:10:24.609 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.8142622519999998, 2024-09-13T05:10:24.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091019550000000001, 2024-09-13T05:10:24.609 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:24.609 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:24.609 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:24.609 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:24.609 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:24.609 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4740 2024-09-13T05:10:24.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.609 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:24.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:24.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715033+0000", 2024-09-13T05:10:24.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:24.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715033+0000", 2024-09-13T05:10:24.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:24.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715032+0000", 2024-09-13T05:10:24.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:24.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:24.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715036+0000", 2024-09-13T05:10:24.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4120000000000001e-06 2024-09-13T05:10:24.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:24.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715042+0000", 2024-09-13T05:10:24.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5660000000000003e-06 2024-09-13T05:10:24.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:24.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715048+0000", 2024-09-13T05:10:24.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:10:24.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:24.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.723895+0000", 2024-09-13T05:10:24.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088470900000000002 2024-09-13T05:10:24.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:24.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.724004+0000", 2024-09-13T05:10:24.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109652 2024-09-13T05:10:24.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:24.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.724135+0000", 2024-09-13T05:10:24.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013053699999999999 2024-09-13T05:10:24.613 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.613 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:24.613 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.613 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4743 3.3 3:c4c358af:::rbd_data.112d318cd671.0000000000000002:6 [read 5947392~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:24.613 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.715054+0000", 2024-09-13T05:10:24.613 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.814241123, 2024-09-13T05:10:24.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092341709999999994, 2024-09-13T05:10:24.613 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:24.613 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:24.614 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:24.614 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:24.614 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:24.614 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4743 2024-09-13T05:10:24.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.614 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:24.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:24.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715054+0000", 2024-09-13T05:10:24.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:24.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715054+0000", 2024-09-13T05:10:24.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:24.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715054+0000", 2024-09-13T05:10:24.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:24.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:24.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715056+0000", 2024-09-13T05:10:24.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.694e-06 2024-09-13T05:10:24.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:24.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715063+0000", 2024-09-13T05:10:24.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1500000000000004e-06 2024-09-13T05:10:24.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:24.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715067+0000", 2024-09-13T05:10:24.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7260000000000002e-06 2024-09-13T05:10:24.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:24.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.724185+0000", 2024-09-13T05:10:24.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.009117333 2024-09-13T05:10:24.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:24.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.724234+0000", 2024-09-13T05:10:24.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9143e-05 2024-09-13T05:10:24.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:24.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.724288+0000", 2024-09-13T05:10:24.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4506999999999998e-05 2024-09-13T05:10:24.617 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.617 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:24.617 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.618 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4748 3.3 3:c4c358af:::rbd_data.112d318cd671.0000000000000002:6 [read 5554176~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:24.618 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.715103+0000", 2024-09-13T05:10:24.618 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.8141923439999998, 2024-09-13T05:10:24.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.009313867, 2024-09-13T05:10:24.618 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:24.618 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:24.618 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:24.618 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:24.618 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:24.618 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4748 2024-09-13T05:10:24.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.618 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:24.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:24.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715103+0000", 2024-09-13T05:10:24.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:24.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715103+0000", 2024-09-13T05:10:24.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:24.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715102+0000", 2024-09-13T05:10:24.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:24.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:24.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715106+0000", 2024-09-13T05:10:24.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6799999999999999e-06 2024-09-13T05:10:24.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:24.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715113+0000", 2024-09-13T05:10:24.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3420000000000002e-06 2024-09-13T05:10:24.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:24.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715119+0000", 2024-09-13T05:10:24.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5879999999999997e-06 2024-09-13T05:10:24.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:24.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.724310+0000", 2024-09-13T05:10:24.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091913429999999994 2024-09-13T05:10:24.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:24.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.724352+0000", 2024-09-13T05:10:24.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1659999999999998e-05 2024-09-13T05:10:24.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:24.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.724417+0000", 2024-09-13T05:10:24.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4802999999999996e-05 2024-09-13T05:10:24.622 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.622 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:24.622 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.622 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4751 3.3 3:c4c358af:::rbd_data.112d318cd671.0000000000000002:6 [read 6144000~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:24.622 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.715166+0000", 2024-09-13T05:10:24.622 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.8141289650000001, 2024-09-13T05:10:24.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095193350000000003, 2024-09-13T05:10:24.622 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:24.622 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:24.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:24.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:24.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:24.623 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4751 2024-09-13T05:10:24.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.623 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:24.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:24.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715166+0000", 2024-09-13T05:10:24.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:24.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715166+0000", 2024-09-13T05:10:24.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:24.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715165+0000", 2024-09-13T05:10:24.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:24.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:24.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715169+0000", 2024-09-13T05:10:24.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8160000000000004e-06 2024-09-13T05:10:24.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:24.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715177+0000", 2024-09-13T05:10:24.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9449999999999993e-06 2024-09-13T05:10:24.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:24.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715183+0000", 2024-09-13T05:10:24.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5659999999999997e-06 2024-09-13T05:10:24.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:24.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.724458+0000", 2024-09-13T05:10:24.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092750190000000007 2024-09-13T05:10:24.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:24.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.724557+0000", 2024-09-13T05:10:24.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9549000000000005e-05 2024-09-13T05:10:24.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:24.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.724686+0000", 2024-09-13T05:10:24.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012817899999999999 2024-09-13T05:10:24.626 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.626 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:24.626 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.626 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4756 3.3 3:c4c358af:::rbd_data.112d318cd671.0000000000000002:6 [read 5750784~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:24.627 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.715221+0000", 2024-09-13T05:10:24.627 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.81407418, 2024-09-13T05:10:24.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096460350000000007, 2024-09-13T05:10:24.627 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:24.627 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:24.627 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:24.627 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:24.627 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:24.627 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4756 2024-09-13T05:10:24.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.627 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:24.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:24.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715221+0000", 2024-09-13T05:10:24.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:24.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715221+0000", 2024-09-13T05:10:24.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:24.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715220+0000", 2024-09-13T05:10:24.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:24.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:24.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715224+0000", 2024-09-13T05:10:24.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6289999999999999e-06 2024-09-13T05:10:24.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:24.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715232+0000", 2024-09-13T05:10:24.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6890000000000004e-06 2024-09-13T05:10:24.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:24.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715238+0000", 2024-09-13T05:10:24.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9139999999999996e-06 2024-09-13T05:10:24.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:24.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.724735+0000", 2024-09-13T05:10:24.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094977489999999998 2024-09-13T05:10:24.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:24.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.724795+0000", 2024-09-13T05:10:24.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9528000000000003e-05 2024-09-13T05:10:24.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:24.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.724867+0000", 2024-09-13T05:10:24.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2087000000000003e-05 2024-09-13T05:10:24.631 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.631 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:24.631 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.631 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4758 3.3 3:c4c358af:::rbd_data.112d318cd671.0000000000000002:6 [read 4816896~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:24.631 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.715243+0000", 2024-09-13T05:10:24.631 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.814052475, 2024-09-13T05:10:24.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0098811790000000004, 2024-09-13T05:10:24.631 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:24.631 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:24.631 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:24.631 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:24.631 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:24.632 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4758 2024-09-13T05:10:24.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.632 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:24.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:24.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715243+0000", 2024-09-13T05:10:24.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:24.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715243+0000", 2024-09-13T05:10:24.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:24.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:24.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715242+0000", 2024-09-13T05:10:24.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:24.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:24.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715251+0000", 2024-09-13T05:10:24.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0969999999999995e-06 2024-09-13T05:10:24.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:24.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715258+0000", 2024-09-13T05:10:24.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0750000000000003e-06 2024-09-13T05:10:24.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:24.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.715262+0000", 2024-09-13T05:10:24.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6859999999999997e-06 2024-09-13T05:10:24.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:24.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.724896+0000", 2024-09-13T05:10:24.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096340230000000002 2024-09-13T05:10:24.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:24.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.725015+0000", 2024-09-13T05:10:24.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118492 2024-09-13T05:10:24.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:24.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:24.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:24.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.725124+0000", 2024-09-13T05:10:24.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109133 2024-09-13T05:10:24.635 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.635 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:24.635 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.635 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:24.635 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:24.635 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:24.637 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:10:24.637 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:24.635+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:24.738 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:24.735+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:24.750 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.2 to 1 (10000) 2024-09-13T05:10:24.754 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:24.754 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:24.754 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:10:24.754 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:24.761 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-13T05:10:24.764 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:10:24.838 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:24.834+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:24.897 INFO:teuthology.orchestra.run.smithi120.stdout:leaving image image_client.0-clone5 intact 2024-09-13T05:10:24.911 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:24.911 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:24.911 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:24.911 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:24.911 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:24.922 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:10:24.940 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:24.935+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:25.034 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:25.035 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:25.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:25.035 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:25.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.035 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:9 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-13T05:10:25.035 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:11.649922+0000", 2024-09-13T05:10:25.035 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.381135054, 2024-09-13T05:10:25.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014163614, 2024-09-13T05:10:25.035 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.035 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.035 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.036 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.036 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.036 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 9 2024-09-13T05:10:25.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.036 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.649922+0000", 2024-09-13T05:10:25.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.649922+0000", 2024-09-13T05:10:25.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.649919+0000", 2024-09-13T05:10:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:10:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.649933+0000", 2024-09-13T05:10:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3506000000000001e-05 2024-09-13T05:10:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.649955+0000", 2024-09-13T05:10:25.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2436999999999999e-05 2024-09-13T05:10:25.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.649968+0000", 2024-09-13T05:10:25.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3236e-05 2024-09-13T05:10:25.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.650049+0000", 2024-09-13T05:10:25.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1007999999999994e-05 2024-09-13T05:10:25.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-13T05:10:25.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.650064+0000", 2024-09-13T05:10:25.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.413e-05 2024-09-13T05:10:25.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.655249+0000", 2024-09-13T05:10:25.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005185879 2024-09-13T05:10:25.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.655361+0000", 2024-09-13T05:10:25.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111218 2024-09-13T05:10:25.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-13T05:10:25.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.655591+0000", 2024-09-13T05:10:25.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023008300000000001 2024-09-13T05:10:25.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:25.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.661052+0000", 2024-09-13T05:10:25.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005461741 2024-09-13T05:10:25.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:25.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.664003+0000", 2024-09-13T05:10:25.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029500450000000001 2024-09-13T05:10:25.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.664045+0000", 2024-09-13T05:10:25.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2885e-05 2024-09-13T05:10:25.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.664085+0000", 2024-09-13T05:10:25.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9953999999999997e-05 2024-09-13T05:10:25.041 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.041 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.041 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.042 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2048 3.19 3:9f06d4f2:::rbd_object_map.112d872fd67a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:25.042 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.126640+0000", 2024-09-13T05:10:25.042 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.9044163090000001, 2024-09-13T05:10:25.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086123469999999994, 2024-09-13T05:10:25.042 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.042 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.042 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.042 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.042 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.042 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2048 2024-09-13T05:10:25.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.042 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.126640+0000", 2024-09-13T05:10:25.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.126640+0000", 2024-09-13T05:10:25.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.126640+0000", 2024-09-13T05:10:25.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:25.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.126644+0000", 2024-09-13T05:10:25.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9369999999999997e-06 2024-09-13T05:10:25.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.126647+0000", 2024-09-13T05:10:25.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1489999999999998e-06 2024-09-13T05:10:25.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.126651+0000", 2024-09-13T05:10:25.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3919999999999999e-06 2024-09-13T05:10:25.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.128852+0000", 2024-09-13T05:10:25.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022012690000000001 2024-09-13T05:10:25.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.129058+0000", 2024-09-13T05:10:25.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000205966 2024-09-13T05:10:25.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:25.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.130062+0000", 2024-09-13T05:10:25.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001004537 2024-09-13T05:10:25.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:25.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.134830+0000", 2024-09-13T05:10:25.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047672540000000003 2024-09-13T05:10:25.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:25.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.135140+0000", 2024-09-13T05:10:25.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031038499999999999 2024-09-13T05:10:25.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.135182+0000", 2024-09-13T05:10:25.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1814999999999999e-05 2024-09-13T05:10:25.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.135253+0000", 2024-09-13T05:10:25.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0940999999999997e-05 2024-09-13T05:10:25.047 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.047 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.047 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.047 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2209 3.19 3:9f06d4f2:::rbd_object_map.112d872fd67a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:25.047 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.213379+0000", 2024-09-13T05:10:25.048 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.8176775039999997, 2024-09-13T05:10:25.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088867800000000004, 2024-09-13T05:10:25.048 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.048 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.048 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.048 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.048 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.048 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2209 2024-09-13T05:10:25.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.048 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.213379+0000", 2024-09-13T05:10:25.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.213379+0000", 2024-09-13T05:10:25.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.213378+0000", 2024-09-13T05:10:25.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:25.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.213388+0000", 2024-09-13T05:10:25.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0762e-05 2024-09-13T05:10:25.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.213410+0000", 2024-09-13T05:10:25.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2095000000000001e-05 2024-09-13T05:10:25.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.213421+0000", 2024-09-13T05:10:25.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0756e-05 2024-09-13T05:10:25.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.217698+0000", 2024-09-13T05:10:25.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042767029999999998 2024-09-13T05:10:25.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.217879+0000", 2024-09-13T05:10:25.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000180834 2024-09-13T05:10:25.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:25.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.218267+0000", 2024-09-13T05:10:25.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038789 2024-09-13T05:10:25.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:25.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.222139+0000", 2024-09-13T05:10:25.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038724929999999999 2024-09-13T05:10:25.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:25.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.222148+0000", 2024-09-13T05:10:25.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4039999999999995e-06 2024-09-13T05:10:25.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.222200+0000", 2024-09-13T05:10:25.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2519999999999999e-05 2024-09-13T05:10:25.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.222266+0000", 2024-09-13T05:10:25.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5996999999999998e-05 2024-09-13T05:10:25.053 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.053 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.053 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.053 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2210 3.19 3:9f06d4f2:::rbd_object_map.112d872fd67a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:25.053 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.213840+0000", 2024-09-13T05:10:25.053 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.8172163320000001, 2024-09-13T05:10:25.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091858870000000002, 2024-09-13T05:10:25.054 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.054 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.054 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.054 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.054 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.054 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2210 2024-09-13T05:10:25.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.054 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.213840+0000", 2024-09-13T05:10:25.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.213840+0000", 2024-09-13T05:10:25.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.213839+0000", 2024-09-13T05:10:25.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:25.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.213849+0000", 2024-09-13T05:10:25.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8959999999999998e-06 2024-09-13T05:10:25.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.213873+0000", 2024-09-13T05:10:25.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4601e-05 2024-09-13T05:10:25.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.213888+0000", 2024-09-13T05:10:25.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.437e-05 2024-09-13T05:10:25.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.219068+0000", 2024-09-13T05:10:25.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051797029999999999 2024-09-13T05:10:25.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.219198+0000", 2024-09-13T05:10:25.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130085 2024-09-13T05:10:25.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:25.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.219644+0000", 2024-09-13T05:10:25.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044589599999999999 2024-09-13T05:10:25.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:25.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.222554+0000", 2024-09-13T05:10:25.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029106620000000001 2024-09-13T05:10:25.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:25.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.222930+0000", 2024-09-13T05:10:25.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037544400000000001 2024-09-13T05:10:25.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.222992+0000", 2024-09-13T05:10:25.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1960999999999998e-05 2024-09-13T05:10:25.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.223026+0000", 2024-09-13T05:10:25.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4756999999999999e-05 2024-09-13T05:10:25.059 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.059 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.059 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.059 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2211 3.19 3:9f06d4f2:::rbd_object_map.112d872fd67a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:25.059 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.214248+0000", 2024-09-13T05:10:25.059 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.8168092649999998, 2024-09-13T05:10:25.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089209219999999995, 2024-09-13T05:10:25.059 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.059 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.059 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.059 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.060 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.060 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2211 2024-09-13T05:10:25.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.060 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.214248+0000", 2024-09-13T05:10:25.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.214248+0000", 2024-09-13T05:10:25.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.214246+0000", 2024-09-13T05:10:25.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:25.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.214255+0000", 2024-09-13T05:10:25.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8400000000000001e-06 2024-09-13T05:10:25.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.214269+0000", 2024-09-13T05:10:25.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3540000000000001e-05 2024-09-13T05:10:25.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.214279+0000", 2024-09-13T05:10:25.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0481e-05 2024-09-13T05:10:25.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.219971+0000", 2024-09-13T05:10:25.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056922680000000003 2024-09-13T05:10:25.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.220025+0000", 2024-09-13T05:10:25.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3944999999999999e-05 2024-09-13T05:10:25.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:25.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.220233+0000", 2024-09-13T05:10:25.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020790699999999999 2024-09-13T05:10:25.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:25.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.222561+0000", 2024-09-13T05:10:25.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002327516 2024-09-13T05:10:25.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:25.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.223083+0000", 2024-09-13T05:10:25.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00052253200000000003 2024-09-13T05:10:25.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.223138+0000", 2024-09-13T05:10:25.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4827000000000002e-05 2024-09-13T05:10:25.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.223168+0000", 2024-09-13T05:10:25.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.042e-05 2024-09-13T05:10:25.064 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.065 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.065 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.065 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2367 3.19 3:9f06d4f2:::rbd_object_map.112d872fd67a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:25.065 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.311337+0000", 2024-09-13T05:10:25.065 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7197197470000001, 2024-09-13T05:10:25.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095340119999999997, 2024-09-13T05:10:25.065 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.065 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.065 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.065 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.065 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.065 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2367 2024-09-13T05:10:25.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.066 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.311337+0000", 2024-09-13T05:10:25.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.311337+0000", 2024-09-13T05:10:25.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.311336+0000", 2024-09-13T05:10:25.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:25.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.311344+0000", 2024-09-13T05:10:25.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.729e-06 2024-09-13T05:10:25.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.311355+0000", 2024-09-13T05:10:25.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1618e-05 2024-09-13T05:10:25.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.311365+0000", 2024-09-13T05:10:25.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1740000000000006e-06 2024-09-13T05:10:25.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.316447+0000", 2024-09-13T05:10:25.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050823350000000003 2024-09-13T05:10:25.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.316613+0000", 2024-09-13T05:10:25.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016607300000000001 2024-09-13T05:10:25.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:25.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.317068+0000", 2024-09-13T05:10:25.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045456799999999998 2024-09-13T05:10:25.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:25.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.319496+0000", 2024-09-13T05:10:25.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024286920000000001 2024-09-13T05:10:25.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:25.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.320808+0000", 2024-09-13T05:10:25.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00131164 2024-09-13T05:10:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.320839+0000", 2024-09-13T05:10:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1384000000000003e-05 2024-09-13T05:10:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.320871+0000", 2024-09-13T05:10:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1823999999999999e-05 2024-09-13T05:10:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2368 3.19 3:9f06d4f2:::rbd_object_map.112d872fd67a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.311562+0000", 2024-09-13T05:10:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7194945700000002, 2024-09-13T05:10:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010285025, 2024-09-13T05:10:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2368 2024-09-13T05:10:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.311562+0000", 2024-09-13T05:10:25.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.311562+0000", 2024-09-13T05:10:25.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.311561+0000", 2024-09-13T05:10:25.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:25.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.311569+0000", 2024-09-13T05:10:25.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5839999999999997e-06 2024-09-13T05:10:25.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.311580+0000", 2024-09-13T05:10:25.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1559999999999999e-05 2024-09-13T05:10:25.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.311590+0000", 2024-09-13T05:10:25.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0142e-05 2024-09-13T05:10:25.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.317563+0000", 2024-09-13T05:10:25.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059722009999999999 2024-09-13T05:10:25.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.317686+0000", 2024-09-13T05:10:25.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012313299999999999 2024-09-13T05:10:25.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:25.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.318044+0000", 2024-09-13T05:10:25.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035809200000000001 2024-09-13T05:10:25.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:25.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.321785+0000", 2024-09-13T05:10:25.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037407999999999999 2024-09-13T05:10:25.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:25.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.321794+0000", 2024-09-13T05:10:25.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9180000000000006e-06 2024-09-13T05:10:25.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.321824+0000", 2024-09-13T05:10:25.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9431999999999999e-05 2024-09-13T05:10:25.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.321847+0000", 2024-09-13T05:10:25.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3380999999999999e-05 2024-09-13T05:10:25.076 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.077 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.077 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.077 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2369 3.19 3:9f06d4f2:::rbd_object_map.112d872fd67a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:25.077 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.313228+0000", 2024-09-13T05:10:25.077 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7178290179999998, 2024-09-13T05:10:25.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010661133, 2024-09-13T05:10:25.077 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.077 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.077 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.077 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.077 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.077 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2369 2024-09-13T05:10:25.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.078 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313228+0000", 2024-09-13T05:10:25.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313228+0000", 2024-09-13T05:10:25.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313227+0000", 2024-09-13T05:10:25.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:25.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313235+0000", 2024-09-13T05:10:25.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1470000000000001e-06 2024-09-13T05:10:25.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313247+0000", 2024-09-13T05:10:25.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2663000000000001e-05 2024-09-13T05:10:25.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313255+0000", 2024-09-13T05:10:25.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.875e-06 2024-09-13T05:10:25.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.318663+0000", 2024-09-13T05:10:25.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054081939999999998 2024-09-13T05:10:25.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.318743+0000", 2024-09-13T05:10:25.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9151000000000002e-05 2024-09-13T05:10:25.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:25.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.318960+0000", 2024-09-13T05:10:25.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021711300000000001 2024-09-13T05:10:25.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:25.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.323715+0000", 2024-09-13T05:10:25.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047557379999999998 2024-09-13T05:10:25.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:25.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.323772+0000", 2024-09-13T05:10:25.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6923999999999999e-05 2024-09-13T05:10:25.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.323838+0000", 2024-09-13T05:10:25.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5810999999999997e-05 2024-09-13T05:10:25.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.323889+0000", 2024-09-13T05:10:25.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0806000000000001e-05 2024-09-13T05:10:25.082 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.082 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.082 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.083 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2370 3.19 3:9f06d4f2:::rbd_object_map.112d872fd67a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:25.083 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.313262+0000", 2024-09-13T05:10:25.083 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7177943229999997, 2024-09-13T05:10:25.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015026678999999999, 2024-09-13T05:10:25.083 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.083 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.083 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2370 2024-09-13T05:10:25.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.083 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313262+0000", 2024-09-13T05:10:25.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313262+0000", 2024-09-13T05:10:25.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313262+0000", 2024-09-13T05:10:25.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:25.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313265+0000", 2024-09-13T05:10:25.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3289999999999998e-06 2024-09-13T05:10:25.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313270+0000", 2024-09-13T05:10:25.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8420000000000004e-06 2024-09-13T05:10:25.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313274+0000", 2024-09-13T05:10:25.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9870000000000001e-06 2024-09-13T05:10:25.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.319541+0000", 2024-09-13T05:10:25.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062673390000000002 2024-09-13T05:10:25.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.319652+0000", 2024-09-13T05:10:25.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111042 2024-09-13T05:10:25.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:25.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.320127+0000", 2024-09-13T05:10:25.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047452900000000001 2024-09-13T05:10:25.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:25.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.325719+0000", 2024-09-13T05:10:25.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055915330000000001 2024-09-13T05:10:25.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:25.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.328211+0000", 2024-09-13T05:10:25.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024922999999999998 2024-09-13T05:10:25.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.328253+0000", 2024-09-13T05:10:25.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1927e-05 2024-09-13T05:10:25.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.328289+0000", 2024-09-13T05:10:25.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6380000000000001e-05 2024-09-13T05:10:25.088 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.088 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.089 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.089 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2371 3.19 3:9f06d4f2:::rbd_object_map.112d872fd67a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:25.089 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.313785+0000", 2024-09-13T05:10:25.089 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.717272232, 2024-09-13T05:10:25.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014663126, 2024-09-13T05:10:25.089 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.089 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.089 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.089 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.089 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.089 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2371 2024-09-13T05:10:25.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.090 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313785+0000", 2024-09-13T05:10:25.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313785+0000", 2024-09-13T05:10:25.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313783+0000", 2024-09-13T05:10:25.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:25.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313841+0000", 2024-09-13T05:10:25.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7735000000000002e-05 2024-09-13T05:10:25.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313872+0000", 2024-09-13T05:10:25.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1299e-05 2024-09-13T05:10:25.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.313886+0000", 2024-09-13T05:10:25.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.383e-05 2024-09-13T05:10:25.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.320899+0000", 2024-09-13T05:10:25.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007012997 2024-09-13T05:10:25.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.320970+0000", 2024-09-13T05:10:25.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1175999999999998e-05 2024-09-13T05:10:25.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:25.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.321232+0000", 2024-09-13T05:10:25.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026188900000000001 2024-09-13T05:10:25.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:25.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.325740+0000", 2024-09-13T05:10:25.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004508265 2024-09-13T05:10:25.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:25.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.328354+0000", 2024-09-13T05:10:25.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026132310000000001 2024-09-13T05:10:25.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.328404+0000", 2024-09-13T05:10:25.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0705000000000003e-05 2024-09-13T05:10:25.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.328448+0000", 2024-09-13T05:10:25.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3417999999999997e-05 2024-09-13T05:10:25.095 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.095 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.095 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.095 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2372 3.19 3:9f06d4f2:::rbd_object_map.112d872fd67a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:25.095 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.314896+0000", 2024-09-13T05:10:25.095 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7161607710000002, 2024-09-13T05:10:25.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013702265, 2024-09-13T05:10:25.096 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.096 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.096 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.096 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.096 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.096 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2372 2024-09-13T05:10:25.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.096 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.314896+0000", 2024-09-13T05:10:25.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.314896+0000", 2024-09-13T05:10:25.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.314894+0000", 2024-09-13T05:10:25.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:25.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.314904+0000", 2024-09-13T05:10:25.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5920000000000007e-06 2024-09-13T05:10:25.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.314917+0000", 2024-09-13T05:10:25.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2948e-05 2024-09-13T05:10:25.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.314928+0000", 2024-09-13T05:10:25.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0645000000000001e-05 2024-09-13T05:10:25.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.321886+0000", 2024-09-13T05:10:25.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0069579869999999997 2024-09-13T05:10:25.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.321970+0000", 2024-09-13T05:10:25.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3996e-05 2024-09-13T05:10:25.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:25.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.322206+0000", 2024-09-13T05:10:25.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023609600000000001 2024-09-13T05:10:25.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:25.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.325761+0000", 2024-09-13T05:10:25.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003555557 2024-09-13T05:10:25.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:25.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.328518+0000", 2024-09-13T05:10:25.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027568240000000002 2024-09-13T05:10:25.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.328562+0000", 2024-09-13T05:10:25.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3741e-05 2024-09-13T05:10:25.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.328598+0000", 2024-09-13T05:10:25.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6457e-05 2024-09-13T05:10:25.102 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.102 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.102 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.102 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2373 3.19 3:9f06d4f2:::rbd_object_map.112d872fd67a:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:25.102 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.315578+0000", 2024-09-13T05:10:25.102 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7154791930000002, 2024-09-13T05:10:25.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014022922, 2024-09-13T05:10:25.102 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.102 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.103 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.103 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2373 2024-09-13T05:10:25.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.103 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.315578+0000", 2024-09-13T05:10:25.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.315578+0000", 2024-09-13T05:10:25.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.315576+0000", 2024-09-13T05:10:25.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:25.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.315584+0000", 2024-09-13T05:10:25.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3579999999999997e-06 2024-09-13T05:10:25.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.315596+0000", 2024-09-13T05:10:25.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2576e-05 2024-09-13T05:10:25.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.315614+0000", 2024-09-13T05:10:25.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7244999999999998e-05 2024-09-13T05:10:25.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.322698+0000", 2024-09-13T05:10:25.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070847769999999996 2024-09-13T05:10:25.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.322755+0000", 2024-09-13T05:10:25.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6910000000000002e-05 2024-09-13T05:10:25.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-13T05:10:25.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.323060+0000", 2024-09-13T05:10:25.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000305004 2024-09-13T05:10:25.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:25.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.329093+0000", 2024-09-13T05:10:25.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060325559999999997 2024-09-13T05:10:25.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:25.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.329516+0000", 2024-09-13T05:10:25.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042357799999999998 2024-09-13T05:10:25.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.329566+0000", 2024-09-13T05:10:25.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9869e-05 2024-09-13T05:10:25.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.329601+0000", 2024-09-13T05:10:25.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4226000000000001e-05 2024-09-13T05:10:25.108 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.108 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.108 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.108 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4231 3.19 3:99402f11:::rbd_data.112d318cd671.0000000000000000:6 [read 6471680~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:25.108 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.439412+0000", 2024-09-13T05:10:25.108 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.59164504, 2024-09-13T05:10:25.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084150600000000002, 2024-09-13T05:10:25.108 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.108 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:25.108 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.108 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.109 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.109 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4231 2024-09-13T05:10:25.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.109 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439412+0000", 2024-09-13T05:10:25.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439412+0000", 2024-09-13T05:10:25.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439411+0000", 2024-09-13T05:10:25.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:25.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439413+0000", 2024-09-13T05:10:25.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.542e-06 2024-09-13T05:10:25.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439416+0000", 2024-09-13T05:10:25.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8270000000000002e-06 2024-09-13T05:10:25.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439418+0000", 2024-09-13T05:10:25.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4849999999999999e-06 2024-09-13T05:10:25.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.447693+0000", 2024-09-13T05:10:25.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082743039999999997 2024-09-13T05:10:25.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.447763+0000", 2024-09-13T05:10:25.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9955000000000004e-05 2024-09-13T05:10:25.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.447827+0000", 2024-09-13T05:10:25.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4299000000000002e-05 2024-09-13T05:10:25.112 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.112 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.112 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.113 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4234 3.19 3:99402f11:::rbd_data.112d318cd671.0000000000000000:6 [read 6668288~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:25.113 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.439437+0000", 2024-09-13T05:10:25.113 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.59161967, 2024-09-13T05:10:25.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0085032259999999991, 2024-09-13T05:10:25.113 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.113 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:25.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.114 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4234 2024-09-13T05:10:25.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.114 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439437+0000", 2024-09-13T05:10:25.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439437+0000", 2024-09-13T05:10:25.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439437+0000", 2024-09-13T05:10:25.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:25.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439439+0000", 2024-09-13T05:10:25.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0379999999999998e-06 2024-09-13T05:10:25.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439443+0000", 2024-09-13T05:10:25.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6030000000000001e-06 2024-09-13T05:10:25.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439446+0000", 2024-09-13T05:10:25.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2030000000000001e-06 2024-09-13T05:10:25.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.447846+0000", 2024-09-13T05:10:25.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084002780000000006 2024-09-13T05:10:25.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.447888+0000", 2024-09-13T05:10:25.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2182999999999999e-05 2024-09-13T05:10:25.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.447940+0000", 2024-09-13T05:10:25.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2154000000000002e-05 2024-09-13T05:10:25.117 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.118 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.118 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.118 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4237 3.19 3:99402f11:::rbd_data.112d318cd671.0000000000000000:6 [read 7258112~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:25.118 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.439466+0000", 2024-09-13T05:10:25.118 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.5915908920000001, 2024-09-13T05:10:25.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086165300000000007, 2024-09-13T05:10:25.118 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.118 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:25.118 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.118 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.118 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.118 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4237 2024-09-13T05:10:25.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.119 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439466+0000", 2024-09-13T05:10:25.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439466+0000", 2024-09-13T05:10:25.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439466+0000", 2024-09-13T05:10:25.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:25.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439488+0000", 2024-09-13T05:10:25.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2507999999999999e-05 2024-09-13T05:10:25.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439495+0000", 2024-09-13T05:10:25.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9670000000000004e-06 2024-09-13T05:10:25.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439500+0000", 2024-09-13T05:10:25.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1580000000000004e-06 2024-09-13T05:10:25.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.447973+0000", 2024-09-13T05:10:25.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084724859999999996 2024-09-13T05:10:25.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448026+0000", 2024-09-13T05:10:25.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3003000000000001e-05 2024-09-13T05:10:25.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448082+0000", 2024-09-13T05:10:25.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6808000000000002e-05 2024-09-13T05:10:25.122 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.122 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.122 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.122 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4243 3.19 3:99402f11:::rbd_data.112d318cd671.0000000000000000:6 [read 7454720~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:25.122 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.439505+0000", 2024-09-13T05:10:25.123 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.5915516830000001, 2024-09-13T05:10:25.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0087311209999999997, 2024-09-13T05:10:25.123 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.123 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:25.123 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.123 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.123 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.123 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4243 2024-09-13T05:10:25.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.123 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439505+0000", 2024-09-13T05:10:25.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439505+0000", 2024-09-13T05:10:25.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439505+0000", 2024-09-13T05:10:25.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:25.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439507+0000", 2024-09-13T05:10:25.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7190000000000001e-06 2024-09-13T05:10:25.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439513+0000", 2024-09-13T05:10:25.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8019999999999997e-06 2024-09-13T05:10:25.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439517+0000", 2024-09-13T05:10:25.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2119999999999997e-06 2024-09-13T05:10:25.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448109+0000", 2024-09-13T05:10:25.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0085918650000000006 2024-09-13T05:10:25.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448162+0000", 2024-09-13T05:10:25.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3078999999999998e-05 2024-09-13T05:10:25.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448236+0000", 2024-09-13T05:10:25.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3905999999999993e-05 2024-09-13T05:10:25.128 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.128 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.128 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.128 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4245 3.19 3:99402f11:::rbd_data.112d318cd671.0000000000000000:6 [read 8044544~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:25.128 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.439522+0000", 2024-09-13T05:10:25.129 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.5915349760000002, 2024-09-13T05:10:25.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088690709999999992, 2024-09-13T05:10:25.129 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.129 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:25.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.130 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.130 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4245 2024-09-13T05:10:25.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.130 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439522+0000", 2024-09-13T05:10:25.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439522+0000", 2024-09-13T05:10:25.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439522+0000", 2024-09-13T05:10:25.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:25.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439524+0000", 2024-09-13T05:10:25.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4880000000000001e-06 2024-09-13T05:10:25.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439529+0000", 2024-09-13T05:10:25.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1769999999999997e-06 2024-09-13T05:10:25.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439533+0000", 2024-09-13T05:10:25.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2200000000000003e-06 2024-09-13T05:10:25.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448272+0000", 2024-09-13T05:10:25.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0087390950000000005 2024-09-13T05:10:25.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448333+0000", 2024-09-13T05:10:25.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0511999999999999e-05 2024-09-13T05:10:25.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448391+0000", 2024-09-13T05:10:25.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899000000000002e-05 2024-09-13T05:10:25.138 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.138 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.138 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.138 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4246 3.19 3:99402f11:::rbd_data.112d318cd671.0000000000000000:6 [read 7651328~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:25.138 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.439538+0000", 2024-09-13T05:10:25.139 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.5915192339999997, 2024-09-13T05:10:25.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091169930000000003, 2024-09-13T05:10:25.139 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.139 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:25.139 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.140 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.140 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.140 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4246 2024-09-13T05:10:25.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.140 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439538+0000", 2024-09-13T05:10:25.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439538+0000", 2024-09-13T05:10:25.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439537+0000", 2024-09-13T05:10:25.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:25.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439540+0000", 2024-09-13T05:10:25.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5950000000000001e-06 2024-09-13T05:10:25.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439545+0000", 2024-09-13T05:10:25.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2000000000000002e-06 2024-09-13T05:10:25.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439549+0000", 2024-09-13T05:10:25.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8859999999999997e-06 2024-09-13T05:10:25.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448433+0000", 2024-09-13T05:10:25.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088846289999999998 2024-09-13T05:10:25.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448527+0000", 2024-09-13T05:10:25.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3614000000000002e-05 2024-09-13T05:10:25.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448655+0000", 2024-09-13T05:10:25.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012762 2024-09-13T05:10:25.145 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.145 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.145 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.145 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4248 3.19 3:99402f11:::rbd_data.112d318cd671.0000000000000000:6 [read 8241152~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:25.145 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.439551+0000", 2024-09-13T05:10:25.145 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.5915057400000001, 2024-09-13T05:10:25.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093856660000000008, 2024-09-13T05:10:25.146 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.146 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:25.146 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.146 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.146 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.146 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4248 2024-09-13T05:10:25.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.146 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439551+0000", 2024-09-13T05:10:25.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439551+0000", 2024-09-13T05:10:25.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439551+0000", 2024-09-13T05:10:25.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:25.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439552+0000", 2024-09-13T05:10:25.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5379999999999999e-06 2024-09-13T05:10:25.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439555+0000", 2024-09-13T05:10:25.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8310000000000001e-06 2024-09-13T05:10:25.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439558+0000", 2024-09-13T05:10:25.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.678e-06 2024-09-13T05:10:25.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448692+0000", 2024-09-13T05:10:25.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.009134517 2024-09-13T05:10:25.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448859+0000", 2024-09-13T05:10:25.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016646200000000001 2024-09-13T05:10:25.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.448937+0000", 2024-09-13T05:10:25.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7886000000000006e-05 2024-09-13T05:10:25.149 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.149 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.150 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.150 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4250 3.19 3:99402f11:::rbd_data.112d318cd671.0000000000000000:6 [read 7847936~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:25.150 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.439560+0000", 2024-09-13T05:10:25.150 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.5914967349999998, 2024-09-13T05:10:25.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096008870000000007, 2024-09-13T05:10:25.150 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.150 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:25.150 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.150 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.150 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.150 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4250 2024-09-13T05:10:25.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.151 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439560+0000", 2024-09-13T05:10:25.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439560+0000", 2024-09-13T05:10:25.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439560+0000", 2024-09-13T05:10:25.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:25.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439561+0000", 2024-09-13T05:10:25.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4720000000000001e-06 2024-09-13T05:10:25.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439564+0000", 2024-09-13T05:10:25.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7530000000000002e-06 2024-09-13T05:10:25.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.439566+0000", 2024-09-13T05:10:25.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3829999999999999e-06 2024-09-13T05:10:25.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.449046+0000", 2024-09-13T05:10:25.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094795039999999997 2024-09-13T05:10:25.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.449099+0000", 2024-09-13T05:10:25.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3078000000000002e-05 2024-09-13T05:10:25.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.449161+0000", 2024-09-13T05:10:25.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2045999999999995e-05 2024-09-13T05:10:25.154 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.154 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.154 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.154 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.154 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.154 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:25.156 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:10:25.156 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:25.150+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:25.183 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #4, image image_client.0-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent5 2024-09-13T05:10:25.256 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:25.250+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:25.316 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:25.316 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:25.316 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:10:25.316 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:25.326 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:10:25.358 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:25.355+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:25.432 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:25.432 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:25.432 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:25.432 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:25.432 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:25.442 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:10:25.458 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:25.454+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:25.545 INFO:teuthology.orchestra.run.smithi120.stdout:835 write 0x447c032 thru 0x44894e9 (0xd4b8 bytes) 2024-09-13T05:10:25.556 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:25.556 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:25.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:25.557 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:25.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.557 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:9 3.1a e25/22 3:5cea7035:::rbd_info:head v 25'2, mlcod=0'0)", 2024-09-13T05:10:25.557 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:11.656060+0000", 2024-09-13T05:10:25.557 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.895148885999999, 2024-09-13T05:10:25.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028724660000000002, 2024-09-13T05:10:25.557 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.557 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.557 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.656060+0000", 2024-09-13T05:10:25.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.656060+0000", 2024-09-13T05:10:25.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.656059+0000", 2024-09-13T05:10:25.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:25.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.656070+0000", 2024-09-13T05:10:25.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1240000000000001e-05 2024-09-13T05:10:25.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.656087+0000", 2024-09-13T05:10:25.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7235e-05 2024-09-13T05:10:25.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.656098+0000", 2024-09-13T05:10:25.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0699999999999999e-05 2024-09-13T05:10:25.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.656178+0000", 2024-09-13T05:10:25.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9668999999999999e-05 2024-09-13T05:10:25.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.656216+0000", 2024-09-13T05:10:25.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7812999999999999e-05 2024-09-13T05:10:25.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.658880+0000", 2024-09-13T05:10:25.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026647590000000001 2024-09-13T05:10:25.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:11.658933+0000", 2024-09-13T05:10:25.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2324000000000003e-05 2024-09-13T05:10:25.561 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.561 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.561 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.561 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:528 3.9 3:95f52cb4:::rbd_data.112d65d6a1c8.000000000000002c:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3424995~53163] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-13T05:10:25.561 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:14.829425+0000", 2024-09-13T05:10:25.561 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.721783718999999, 2024-09-13T05:10:25.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024202540000000002, 2024-09-13T05:10:25.561 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.561 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.562 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.562 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.562 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.562 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 528 2024-09-13T05:10:25.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.562 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.829425+0000", 2024-09-13T05:10:25.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.829425+0000", 2024-09-13T05:10:25.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.829422+0000", 2024-09-13T05:10:25.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999962 2024-09-13T05:10:25.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.829509+0000", 2024-09-13T05:10:25.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6794999999999998e-05 2024-09-13T05:10:25.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.829539+0000", 2024-09-13T05:10:25.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0165e-05 2024-09-13T05:10:25.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.829553+0000", 2024-09-13T05:10:25.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4334e-05 2024-09-13T05:10:25.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.829632+0000", 2024-09-13T05:10:25.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9250000000000002e-05 2024-09-13T05:10:25.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.829764+0000", 2024-09-13T05:10:25.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013180900000000001 2024-09-13T05:10:25.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:10:25.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.829926+0000", 2024-09-13T05:10:25.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000161733 2024-09-13T05:10:25.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:25.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.831365+0000", 2024-09-13T05:10:25.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00143922 2024-09-13T05:10:25.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:25.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.831741+0000", 2024-09-13T05:10:25.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037553700000000001 2024-09-13T05:10:25.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.831798+0000", 2024-09-13T05:10:25.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7525999999999998e-05 2024-09-13T05:10:25.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:14.831846+0000", 2024-09-13T05:10:25.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7531000000000003e-05 2024-09-13T05:10:25.566 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.567 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.567 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.567 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:1772 3.9 3:97198325:::rbd_header.112d872fd67a:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:25.567 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:19.803882+0000", 2024-09-13T05:10:25.567 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.7473269489999996, 2024-09-13T05:10:25.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071359179999999998, 2024-09-13T05:10:25.567 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.567 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.567 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.567 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.567 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.567 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1772 2024-09-13T05:10:25.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.568 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.803882+0000", 2024-09-13T05:10:25.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.803882+0000", 2024-09-13T05:10:25.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.803879+0000", 2024-09-13T05:10:25.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999967 2024-09-13T05:10:25.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.803901+0000", 2024-09-13T05:10:25.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1957e-05 2024-09-13T05:10:25.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.803935+0000", 2024-09-13T05:10:25.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4499000000000003e-05 2024-09-13T05:10:25.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.803951+0000", 2024-09-13T05:10:25.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5824999999999998e-05 2024-09-13T05:10:25.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.804103+0000", 2024-09-13T05:10:25.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000151228 2024-09-13T05:10:25.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-13T05:10:25.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.804113+0000", 2024-09-13T05:10:25.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0383e-05 2024-09-13T05:10:25.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.808141+0000", 2024-09-13T05:10:25.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040281329999999997 2024-09-13T05:10:25.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.808368+0000", 2024-09-13T05:10:25.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022666099999999999 2024-09-13T05:10:25.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:10:25.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.808921+0000", 2024-09-13T05:10:25.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00055340100000000002 2024-09-13T05:10:25.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:25.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.810462+0000", 2024-09-13T05:10:25.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001540769 2024-09-13T05:10:25.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:25.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.810810+0000", 2024-09-13T05:10:25.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00034848499999999999 2024-09-13T05:10:25.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.810939+0000", 2024-09-13T05:10:25.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000128138 2024-09-13T05:10:25.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.811018+0000", 2024-09-13T05:10:25.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9575999999999998e-05 2024-09-13T05:10:25.573 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.573 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.573 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.573 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:1773 3.9 3:97198325:::rbd_header.112d872fd67a:head [call rbd.set_stripe_unit_count in=24b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:25.573 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:19.811158+0000", 2024-09-13T05:10:25.573 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.7400513650000002, 2024-09-13T05:10:25.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002613195, 2024-09-13T05:10:25.573 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.573 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.574 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1773 2024-09-13T05:10:25.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.574 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.811158+0000", 2024-09-13T05:10:25.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.811158+0000", 2024-09-13T05:10:25.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.811155+0000", 2024-09-13T05:10:25.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:10:25.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.811183+0000", 2024-09-13T05:10:25.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7623e-05 2024-09-13T05:10:25.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.811209+0000", 2024-09-13T05:10:25.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5782000000000002e-05 2024-09-13T05:10:25.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.811227+0000", 2024-09-13T05:10:25.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.859e-05 2024-09-13T05:10:25.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.811290+0000", 2024-09-13T05:10:25.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2965000000000004e-05 2024-09-13T05:10:25.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.811372+0000", 2024-09-13T05:10:25.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1118000000000005e-05 2024-09-13T05:10:25.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:10:25.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.811759+0000", 2024-09-13T05:10:25.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038716800000000002 2024-09-13T05:10:25.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:25.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.812816+0000", 2024-09-13T05:10:25.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001056916 2024-09-13T05:10:25.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:25.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.813569+0000", 2024-09-13T05:10:25.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075296399999999996 2024-09-13T05:10:25.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.813685+0000", 2024-09-13T05:10:25.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116014 2024-09-13T05:10:25.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:19.813771+0000", 2024-09-13T05:10:25.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6367999999999997e-05 2024-09-13T05:10:25.578 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.578 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.578 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.579 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2026 3.9 3:946e48fe:::rbd_data.112d872fd67a.0000000000000064:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:25.579 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.091818+0000", 2024-09-13T05:10:25.579 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4593915849999997, 2024-09-13T05:10:25.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013636232, 2024-09-13T05:10:25.579 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.579 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.579 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.579 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.579 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.579 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2026 2024-09-13T05:10:25.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.579 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.091818+0000", 2024-09-13T05:10:25.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.091818+0000", 2024-09-13T05:10:25.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.091816+0000", 2024-09-13T05:10:25.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:25.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.091824+0000", 2024-09-13T05:10:25.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1200000000000002e-06 2024-09-13T05:10:25.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.091841+0000", 2024-09-13T05:10:25.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7127000000000001e-05 2024-09-13T05:10:25.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.091850+0000", 2024-09-13T05:10:25.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.225e-06 2024-09-13T05:10:25.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.091902+0000", 2024-09-13T05:10:25.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2278000000000003e-05 2024-09-13T05:10:25.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.092014+0000", 2024-09-13T05:10:25.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011212100000000001 2024-09-13T05:10:25.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:10:25.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.094746+0000", 2024-09-13T05:10:25.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027318540000000001 2024-09-13T05:10:25.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:25.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.105318+0000", 2024-09-13T05:10:25.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010572195 2024-09-13T05:10:25.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:25.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.105333+0000", 2024-09-13T05:10:25.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5228000000000001e-05 2024-09-13T05:10:25.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.105407+0000", 2024-09-13T05:10:25.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3379000000000003e-05 2024-09-13T05:10:25.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.105454+0000", 2024-09-13T05:10:25.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.702e-05 2024-09-13T05:10:25.584 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.584 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.584 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.584 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4397.0:2026 3.9 e30/22 ondisk, result = 0)", 2024-09-13T05:10:25.584 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.101596+0000", 2024-09-13T05:10:25.584 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4496133359999996, 2024-09-13T05:10:25.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037265599999999999, 2024-09-13T05:10:25.585 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.585 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:25.585 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.101596+0000", 2024-09-13T05:10:25.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.101596+0000", 2024-09-13T05:10:25.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.101594+0000", 2024-09-13T05:10:25.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:25.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.101600+0000", 2024-09-13T05:10:25.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1539999999999999e-06 2024-09-13T05:10:25.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.101618+0000", 2024-09-13T05:10:25.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7042e-05 2024-09-13T05:10:25.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.101626+0000", 2024-09-13T05:10:25.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.028e-06 2024-09-13T05:10:25.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.105298+0000", 2024-09-13T05:10:25.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036726950000000001 2024-09-13T05:10:25.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.105310+0000", 2024-09-13T05:10:25.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1422e-05 2024-09-13T05:10:25.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.105322+0000", 2024-09-13T05:10:25.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2677000000000001e-05 2024-09-13T05:10:25.589 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.589 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.589 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.589 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2116 3.9 3:97198325:::rbd_header.112d872fd67a:head [watch reconnect cookie 140458450888304 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:25.589 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.162303+0000", 2024-09-13T05:10:25.589 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.3889061759999999, 2024-09-13T05:10:25.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025073370000000001, 2024-09-13T05:10:25.589 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.589 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:25.589 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.589 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.590 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.590 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2116 2024-09-13T05:10:25.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.590 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.162303+0000", 2024-09-13T05:10:25.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.162303+0000", 2024-09-13T05:10:25.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.162302+0000", 2024-09-13T05:10:25.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:25.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.162307+0000", 2024-09-13T05:10:25.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.702e-06 2024-09-13T05:10:25.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.162317+0000", 2024-09-13T05:10:25.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8130000000000007e-06 2024-09-13T05:10:25.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.162326+0000", 2024-09-13T05:10:25.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2099999999999999e-06 2024-09-13T05:10:25.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.162855+0000", 2024-09-13T05:10:25.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00052869500000000003 2024-09-13T05:10:25.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.162958+0000", 2024-09-13T05:10:25.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103114 2024-09-13T05:10:25.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.164810+0000", 2024-09-13T05:10:25.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018525919999999999 2024-09-13T05:10:25.593 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.593 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.593 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.594 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2150 3.9 3:91373b27:::rbd_data.112d872fd67a.0000000000000132:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:25.594 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.197223+0000", 2024-09-13T05:10:25.594 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.3539856190000004, 2024-09-13T05:10:25.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032108359999999999, 2024-09-13T05:10:25.594 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.594 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.594 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.594 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.594 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.594 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2150 2024-09-13T05:10:25.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.594 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.197223+0000", 2024-09-13T05:10:25.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.197223+0000", 2024-09-13T05:10:25.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.197220+0000", 2024-09-13T05:10:25.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999971 2024-09-13T05:10:25.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.197237+0000", 2024-09-13T05:10:25.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6154000000000002e-05 2024-09-13T05:10:25.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.197274+0000", 2024-09-13T05:10:25.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7218999999999997e-05 2024-09-13T05:10:25.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.197294+0000", 2024-09-13T05:10:25.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0667999999999999e-05 2024-09-13T05:10:25.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.197405+0000", 2024-09-13T05:10:25.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110095 2024-09-13T05:10:25.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.197596+0000", 2024-09-13T05:10:25.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000191313 2024-09-13T05:10:25.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:10:25.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.197817+0000", 2024-09-13T05:10:25.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022097800000000001 2024-09-13T05:10:25.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:25.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.199281+0000", 2024-09-13T05:10:25.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014645649999999999 2024-09-13T05:10:25.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:25.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.200302+0000", 2024-09-13T05:10:25.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010206810000000001 2024-09-13T05:10:25.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.200361+0000", 2024-09-13T05:10:25.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9199e-05 2024-09-13T05:10:25.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.200434+0000", 2024-09-13T05:10:25.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3013e-05 2024-09-13T05:10:25.600 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.600 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.600 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.600 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2152 3.9 3:951466d1:::rbd_data.112d872fd67a.000000000000018e:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:25.600 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.197330+0000", 2024-09-13T05:10:25.600 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.353879493, 2024-09-13T05:10:25.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079104450000000003, 2024-09-13T05:10:25.600 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.600 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.601 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.601 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.601 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.601 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2152 2024-09-13T05:10:25.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.601 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.197330+0000", 2024-09-13T05:10:25.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.197330+0000", 2024-09-13T05:10:25.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.197328+0000", 2024-09-13T05:10:25.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:25.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.197337+0000", 2024-09-13T05:10:25.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6049999999999998e-06 2024-09-13T05:10:25.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.197356+0000", 2024-09-13T05:10:25.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9168999999999999e-05 2024-09-13T05:10:25.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.197373+0000", 2024-09-13T05:10:25.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6874000000000001e-05 2024-09-13T05:10:25.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.198493+0000", 2024-09-13T05:10:25.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00111962 2024-09-13T05:10:25.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.198658+0000", 2024-09-13T05:10:25.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016491699999999999 2024-09-13T05:10:25.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:10:25.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.198820+0000", 2024-09-13T05:10:25.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000162862 2024-09-13T05:10:25.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:25.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.201340+0000", 2024-09-13T05:10:25.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025196139999999999 2024-09-13T05:10:25.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:25.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.205131+0000", 2024-09-13T05:10:25.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037914089999999999 2024-09-13T05:10:25.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.205193+0000", 2024-09-13T05:10:25.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1595999999999998e-05 2024-09-13T05:10:25.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.205240+0000", 2024-09-13T05:10:25.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6981999999999998e-05 2024-09-13T05:10:25.606 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.606 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.606 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.606 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:2154 3.0 e30/22 3:06bceb38:::rbd_data.112d872fd67a.000000000000019c:head v 30'3, mlcod=28'1)", 2024-09-13T05:10:25.606 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.198319+0000", 2024-09-13T05:10:25.606 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.3528898180000004, 2024-09-13T05:10:25.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037910769999999999, 2024-09-13T05:10:25.607 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.607 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.607 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.198319+0000", 2024-09-13T05:10:25.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.198319+0000", 2024-09-13T05:10:25.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.198317+0000", 2024-09-13T05:10:25.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:25.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.198333+0000", 2024-09-13T05:10:25.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5736999999999999e-05 2024-09-13T05:10:25.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.198352+0000", 2024-09-13T05:10:25.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8647999999999998e-05 2024-09-13T05:10:25.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.198363+0000", 2024-09-13T05:10:25.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1568e-05 2024-09-13T05:10:25.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.198447+0000", 2024-09-13T05:10:25.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3454000000000004e-05 2024-09-13T05:10:25.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.198499+0000", 2024-09-13T05:10:25.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1799999999999999e-05 2024-09-13T05:10:25.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.202057+0000", 2024-09-13T05:10:25.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035588799999999999 2024-09-13T05:10:25.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.202110+0000", 2024-09-13T05:10:25.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2883999999999997e-05 2024-09-13T05:10:25.610 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.610 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.611 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.611 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2252 3.9 3:97198325:::rbd_header.112d872fd67a:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:25.611 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.267496+0000", 2024-09-13T05:10:25.611 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.2837126770000005, 2024-09-13T05:10:25.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002477515, 2024-09-13T05:10:25.611 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.611 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.611 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2252 2024-09-13T05:10:25.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.612 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.267496+0000", 2024-09-13T05:10:25.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.267496+0000", 2024-09-13T05:10:25.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.267494+0000", 2024-09-13T05:10:25.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999971 2024-09-13T05:10:25.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.267510+0000", 2024-09-13T05:10:25.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.624e-05 2024-09-13T05:10:25.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.267545+0000", 2024-09-13T05:10:25.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5092999999999998e-05 2024-09-13T05:10:25.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.267560+0000", 2024-09-13T05:10:25.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4969e-05 2024-09-13T05:10:25.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.267646+0000", 2024-09-13T05:10:25.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6403000000000006e-05 2024-09-13T05:10:25.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.267759+0000", 2024-09-13T05:10:25.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011312 2024-09-13T05:10:25.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:10:25.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.267993+0000", 2024-09-13T05:10:25.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000233601 2024-09-13T05:10:25.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:25.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.269015+0000", 2024-09-13T05:10:25.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010217690000000001 2024-09-13T05:10:25.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:25.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.269877+0000", 2024-09-13T05:10:25.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00086277900000000004 2024-09-13T05:10:25.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.269933+0000", 2024-09-13T05:10:25.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5309999999999997e-05 2024-09-13T05:10:25.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.269974+0000", 2024-09-13T05:10:25.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1171000000000003e-05 2024-09-13T05:10:25.617 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.617 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.617 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.617 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:2286 3.13 e30/22 3:cf0e8a58:::rbd_data.112d872fd67a.000000000000009c:head v 30'8, mlcod=30'6)", 2024-09-13T05:10:25.617 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.296072+0000", 2024-09-13T05:10:25.617 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.2551366670000004, 2024-09-13T05:10:25.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027255700000000001, 2024-09-13T05:10:25.618 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.618 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.618 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.296072+0000", 2024-09-13T05:10:25.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.296072+0000", 2024-09-13T05:10:25.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.296071+0000", 2024-09-13T05:10:25.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:25.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.296083+0000", 2024-09-13T05:10:25.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2386e-05 2024-09-13T05:10:25.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.296100+0000", 2024-09-13T05:10:25.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6714e-05 2024-09-13T05:10:25.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.296110+0000", 2024-09-13T05:10:25.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6709999999999994e-06 2024-09-13T05:10:25.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.296189+0000", 2024-09-13T05:10:25.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9066000000000005e-05 2024-09-13T05:10:25.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.296222+0000", 2024-09-13T05:10:25.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2957000000000003e-05 2024-09-13T05:10:25.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.298738+0000", 2024-09-13T05:10:25.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002515864 2024-09-13T05:10:25.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.298798+0000", 2024-09-13T05:10:25.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0346999999999997e-05 2024-09-13T05:10:25.622 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.622 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.622 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.622 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:2379 3.4 e30/22 3:2072027a:::rbd_data.112d872fd67a.000000000000007d:head v 30'3, mlcod=30'1)", 2024-09-13T05:10:25.622 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.329062+0000", 2024-09-13T05:10:25.622 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.2221466210000003, 2024-09-13T05:10:25.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032369899999999999, 2024-09-13T05:10:25.622 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.622 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.622 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.329062+0000", 2024-09-13T05:10:25.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.329062+0000", 2024-09-13T05:10:25.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.329060+0000", 2024-09-13T05:10:25.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:25.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.329076+0000", 2024-09-13T05:10:25.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5142e-05 2024-09-13T05:10:25.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.329106+0000", 2024-09-13T05:10:25.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0514e-05 2024-09-13T05:10:25.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.329119+0000", 2024-09-13T05:10:25.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2621e-05 2024-09-13T05:10:25.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.329189+0000", 2024-09-13T05:10:25.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0669999999999999e-05 2024-09-13T05:10:25.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.329212+0000", 2024-09-13T05:10:25.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2955e-05 2024-09-13T05:10:25.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.332219+0000", 2024-09-13T05:10:25.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030071730000000001 2024-09-13T05:10:25.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.332299+0000", 2024-09-13T05:10:25.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0010000000000001e-05 2024-09-13T05:10:25.627 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.627 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.627 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.627 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2503 3.9 3:97198325:::rbd_header.112d872fd67a:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:25.627 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.726300+0000", 2024-09-13T05:10:25.627 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.8249087849999999, 2024-09-13T05:10:25.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047809740000000003, 2024-09-13T05:10:25.627 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.628 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.628 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.628 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.628 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.628 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2503 2024-09-13T05:10:25.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.628 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.726300+0000", 2024-09-13T05:10:25.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.726300+0000", 2024-09-13T05:10:25.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.726297+0000", 2024-09-13T05:10:25.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999967 2024-09-13T05:10:25.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.726318+0000", 2024-09-13T05:10:25.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1185000000000001e-05 2024-09-13T05:10:25.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.726355+0000", 2024-09-13T05:10:25.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6565e-05 2024-09-13T05:10:25.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.726372+0000", 2024-09-13T05:10:25.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7377e-05 2024-09-13T05:10:25.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.726462+0000", 2024-09-13T05:10:25.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9797999999999996e-05 2024-09-13T05:10:25.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-13T05:10:25.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.726468+0000", 2024-09-13T05:10:25.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0769999999999996e-06 2024-09-13T05:10:25.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.728923+0000", 2024-09-13T05:10:25.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002454758 2024-09-13T05:10:25.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.729054+0000", 2024-09-13T05:10:25.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130729 2024-09-13T05:10:25.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:10:25.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.729356+0000", 2024-09-13T05:10:25.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030267 2024-09-13T05:10:25.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:25.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.730173+0000", 2024-09-13T05:10:25.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00081696000000000004 2024-09-13T05:10:25.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:25.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.730941+0000", 2024-09-13T05:10:25.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00076791900000000005 2024-09-13T05:10:25.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.731032+0000", 2024-09-13T05:10:25.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0418000000000001e-05 2024-09-13T05:10:25.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.731081+0000", 2024-09-13T05:10:25.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9657999999999998e-05 2024-09-13T05:10:25.634 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.634 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.634 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.635 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2697 3.9 3:95da7a65:::rbd_data.112d872fd67a.000000000000004b:head [stat,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:25.635 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.883756+0000", 2024-09-13T05:10:25.635 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.6674529930000004, 2024-09-13T05:10:25.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027506470000000002, 2024-09-13T05:10:25.635 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.635 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:25.635 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.635 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.635 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.635 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2697 2024-09-13T05:10:25.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.635 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.883756+0000", 2024-09-13T05:10:25.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.883756+0000", 2024-09-13T05:10:25.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.883753+0000", 2024-09-13T05:10:25.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999971 2024-09-13T05:10:25.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.883765+0000", 2024-09-13T05:10:25.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1488000000000001e-05 2024-09-13T05:10:25.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.883788+0000", 2024-09-13T05:10:25.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2986999999999999e-05 2024-09-13T05:10:25.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.883799+0000", 2024-09-13T05:10:25.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1395e-05 2024-09-13T05:10:25.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.883867+0000", 2024-09-13T05:10:25.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7255999999999994e-05 2024-09-13T05:10:25.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.884040+0000", 2024-09-13T05:10:25.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017372899999999999 2024-09-13T05:10:25.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.886507+0000", 2024-09-13T05:10:25.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024664650000000002 2024-09-13T05:10:25.639 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.639 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.639 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.639 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:3006 3.4 e31/22 3:2474c591:::rbd_data.112d872fd67a.0000000000000070:head v 31'7, mlcod=31'5)", 2024-09-13T05:10:25.640 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.927464+0000", 2024-09-13T05:10:25.640 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.6237447820000002, 2024-09-13T05:10:25.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031872350000000001, 2024-09-13T05:10:25.640 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.640 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.640 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.927464+0000", 2024-09-13T05:10:25.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.927464+0000", 2024-09-13T05:10:25.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.927463+0000", 2024-09-13T05:10:25.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:25.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.927474+0000", 2024-09-13T05:10:25.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0844e-05 2024-09-13T05:10:25.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.927491+0000", 2024-09-13T05:10:25.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6745999999999999e-05 2024-09-13T05:10:25.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.927498+0000", 2024-09-13T05:10:25.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.554e-06 2024-09-13T05:10:25.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.927557+0000", 2024-09-13T05:10:25.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9106e-05 2024-09-13T05:10:25.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.927586+0000", 2024-09-13T05:10:25.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8714999999999999e-05 2024-09-13T05:10:25.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.930496+0000", 2024-09-13T05:10:25.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029100110000000001 2024-09-13T05:10:25.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.930652+0000", 2024-09-13T05:10:25.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000155475 2024-09-13T05:10:25.644 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.644 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.644 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.645 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:3699 3.4 e31/22 3:24959f8a:::rbd_data.112d265b2a09.000000000000015f:head v 31'14, mlcod=31'12)", 2024-09-13T05:10:25.645 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.310615+0000", 2024-09-13T05:10:25.645 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2405938770000002, 2024-09-13T05:10:25.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038568819999999998, 2024-09-13T05:10:25.645 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.645 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.645 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.310615+0000", 2024-09-13T05:10:25.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.310615+0000", 2024-09-13T05:10:25.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.310614+0000", 2024-09-13T05:10:25.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:25.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.310626+0000", 2024-09-13T05:10:25.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1990999999999999e-05 2024-09-13T05:10:25.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.310641+0000", 2024-09-13T05:10:25.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5628e-05 2024-09-13T05:10:25.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.310650+0000", 2024-09-13T05:10:25.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8799999999999997e-06 2024-09-13T05:10:25.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.310729+0000", 2024-09-13T05:10:25.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8596000000000004e-05 2024-09-13T05:10:25.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.310755+0000", 2024-09-13T05:10:25.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5695e-05 2024-09-13T05:10:25.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.314416+0000", 2024-09-13T05:10:25.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036611930000000001 2024-09-13T05:10:25.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.314472+0000", 2024-09-13T05:10:25.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6298999999999997e-05 2024-09-13T05:10:25.649 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.649 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.649 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.650 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:4818 3.1a e31/22 3:5d1b3efb:::rbd_data.112d265b2a09.000000000000014e:head v 31'12, mlcod=31'10)", 2024-09-13T05:10:25.650 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.781570+0000", 2024-09-13T05:10:25.650 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.769639277, 2024-09-13T05:10:25.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031256579999999999, 2024-09-13T05:10:25.650 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.650 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.650 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.781570+0000", 2024-09-13T05:10:25.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.781570+0000", 2024-09-13T05:10:25.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.781569+0000", 2024-09-13T05:10:25.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:25.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.781578+0000", 2024-09-13T05:10:25.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8410000000000006e-06 2024-09-13T05:10:25.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.781589+0000", 2024-09-13T05:10:25.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1837e-05 2024-09-13T05:10:25.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.781598+0000", 2024-09-13T05:10:25.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2330000000000006e-06 2024-09-13T05:10:25.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.781707+0000", 2024-09-13T05:10:25.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108909 2024-09-13T05:10:25.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.781734+0000", 2024-09-13T05:10:25.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7294999999999999e-05 2024-09-13T05:10:25.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.784640+0000", 2024-09-13T05:10:25.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029063270000000002 2024-09-13T05:10:25.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.784695+0000", 2024-09-13T05:10:25.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5312000000000002e-05 2024-09-13T05:10:25.654 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.654 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.654 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.654 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:7281 3.9 3:91570cf9:::rbd_data.112d1304fe95.00000000000002a3:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write 98304~17095] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-13T05:10:25.654 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:24.192733+0000", 2024-09-13T05:10:25.654 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.358476045, 2024-09-13T05:10:25.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026604210000000001, 2024-09-13T05:10:25.655 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.655 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.655 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7281 2024-09-13T05:10:25.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.655 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.192733+0000", 2024-09-13T05:10:25.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.192733+0000", 2024-09-13T05:10:25.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.192732+0000", 2024-09-13T05:10:25.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:25.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.192759+0000", 2024-09-13T05:10:25.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7101999999999999e-05 2024-09-13T05:10:25.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.192775+0000", 2024-09-13T05:10:25.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6019e-05 2024-09-13T05:10:25.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.192782+0000", 2024-09-13T05:10:25.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4819999999999997e-06 2024-09-13T05:10:25.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.192858+0000", 2024-09-13T05:10:25.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5928999999999998e-05 2024-09-13T05:10:25.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.193081+0000", 2024-09-13T05:10:25.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022264499999999999 2024-09-13T05:10:25.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:10:25.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.193377+0000", 2024-09-13T05:10:25.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029631599999999997 2024-09-13T05:10:25.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:25.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.194683+0000", 2024-09-13T05:10:25.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013063879999999999 2024-09-13T05:10:25.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:25.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.195336+0000", 2024-09-13T05:10:25.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00065300500000000001 2024-09-13T05:10:25.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.195369+0000", 2024-09-13T05:10:25.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2836999999999997e-05 2024-09-13T05:10:25.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.195393+0000", 2024-09-13T05:10:25.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4196999999999999e-05 2024-09-13T05:10:25.663 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.664 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.664 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.664 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:7309 3.9 3:91570cf9:::rbd_data.112d1304fe95.00000000000002a3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-13T05:10:25.664 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:24.235020+0000", 2024-09-13T05:10:25.665 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.3161894199999999, 2024-09-13T05:10:25.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00350673, 2024-09-13T05:10:25.665 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:25.665 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:25.665 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:25.665 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:25.666 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:25.666 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7309 2024-09-13T05:10:25.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.666 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:25.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:25.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.235020+0000", 2024-09-13T05:10:25.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:25.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.235020+0000", 2024-09-13T05:10:25.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:25.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:25.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.235017+0000", 2024-09-13T05:10:25.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999971 2024-09-13T05:10:25.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:25.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.235030+0000", 2024-09-13T05:10:25.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3441999999999999e-05 2024-09-13T05:10:25.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:25.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.235060+0000", 2024-09-13T05:10:25.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9573999999999998e-05 2024-09-13T05:10:25.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:25.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.235076+0000", 2024-09-13T05:10:25.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6103000000000002e-05 2024-09-13T05:10:25.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:25.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.235163+0000", 2024-09-13T05:10:25.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7264999999999999e-05 2024-09-13T05:10:25.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:25.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.235319+0000", 2024-09-13T05:10:25.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000155227 2024-09-13T05:10:25.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:10:25.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.235527+0000", 2024-09-13T05:10:25.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000207999 2024-09-13T05:10:25.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:25.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.236521+0000", 2024-09-13T05:10:25.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00099443199999999995 2024-09-13T05:10:25.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:25.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.238471+0000", 2024-09-13T05:10:25.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001949845 2024-09-13T05:10:25.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:25.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.238505+0000", 2024-09-13T05:10:25.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4272e-05 2024-09-13T05:10:25.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:25.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:25.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:25.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.238526+0000", 2024-09-13T05:10:25.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1256000000000001e-05 2024-09-13T05:10:25.679 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.679 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.679 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.679 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:25.679 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:25.680 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:25.680 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T05:10:25.682 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:25.679+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:25.683 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:10:25.686 INFO:teuthology.orchestra.run.smithi120.stdout:836 trunc from 0xbc7c3d4 to 0x59eeda8 2024-09-13T05:10:25.686 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:25.686 INFO:teuthology.orchestra.run.smithi120.stdout:838 punch from 0x5962904 to 0x596506e, (0x276a bytes) 2024-09-13T05:10:25.686 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:25.687 INFO:teuthology.orchestra.run.smithi120.stdout:840 read 0x3d492e5 thru 0x3d4d0b7 (0x3dd3 bytes) 2024-09-13T05:10:25.687 INFO:teuthology.orchestra.run.smithi120.stdout:841 write 0xd033f09 thru 0xd03bcb6 (0x7dae bytes) 2024-09-13T05:10:25.687 INFO:teuthology.orchestra.run.smithi120.stdout:843 trunc from 0xd03bcb7 to 0x7360808 2024-09-13T05:10:25.687 INFO:teuthology.orchestra.run.smithi120.stdout:844 write 0x26df491 thru 0x26dfccc (0x83c bytes) 2024-09-13T05:10:25.687 INFO:teuthology.orchestra.run.smithi120.stdout:848 read 0xf0b17b thru 0xf17e53 (0xccd9 bytes) 2024-09-13T05:10:25.687 INFO:teuthology.orchestra.run.smithi120.stdout:849 write 0x903da22 thru 0x90460fd (0x86dc bytes) 2024-09-13T05:10:25.706 INFO:teuthology.orchestra.run.smithi120.stdout:850 write 0xac597b7 thru 0xac5a52e (0xd78 bytes) 2024-09-13T05:10:25.712 INFO:teuthology.orchestra.run.smithi120.stdout:852 write 0x18e9440 thru 0x18eb600 (0x21c1 bytes) 2024-09-13T05:10:25.719 INFO:teuthology.orchestra.run.smithi120.stdout:854 read 0x921c7f2 thru 0x922a107 (0xd916 bytes) 2024-09-13T05:10:25.720 INFO:teuthology.orchestra.run.smithi120.stdout:855 trunc from 0xac5a52f to 0xb33285c 2024-09-13T05:10:25.731 INFO:teuthology.orchestra.run.smithi120.stdout:856 trunc from 0xb33285c to 0xb90b9d6 2024-09-13T05:10:25.741 INFO:teuthology.orchestra.run.smithi120.stdout:857 trunc from 0xb90b9d6 to 0xba2c409 2024-09-13T05:10:25.753 INFO:teuthology.orchestra.run.smithi120.stdout:859 read 0x7128acd thru 0x712c9d1 (0x3f05 bytes) 2024-09-13T05:10:25.753 INFO:teuthology.orchestra.run.smithi120.stdout:860 punch from 0x3997f73 to 0x399d12f, (0x51bc bytes) 2024-09-13T05:10:25.753 INFO:teuthology.orchestra.run.smithi120.stdout:861 read 0x4f2526a thru 0x4f2ccd8 (0x7a6f bytes) 2024-09-13T05:10:25.753 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:25.753 INFO:teuthology.orchestra.run.smithi120.stdout:864 write 0x5f4807d thru 0x5f4881e (0x7a2 bytes) 2024-09-13T05:10:25.757 INFO:teuthology.orchestra.run.smithi120.stdout:865 writesame 0xb4facdc thru 0xb507a9c data_size 0x1(0xcdc1 bytes) 2024-09-13T05:10:25.765 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.3 to 1 (10000) 2024-09-13T05:10:25.776 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-13T05:10:25.799 INFO:teuthology.orchestra.run.smithi120.stdout:866 trunc from 0xba2c409 to 0xde7171b 2024-09-13T05:10:25.799 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:25.794+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:25.809 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:25.809 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:25.809 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:10:25.809 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:25.827 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:10:25.833 INFO:teuthology.orchestra.run.smithi120.stdout:868 trunc from 0xde7171b to 0x19a7995 2024-09-13T05:10:25.867 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:25.867 INFO:teuthology.orchestra.run.smithi120.stdout:871 punch from 0x9013f6 to 0x90dee0, (0xcaea bytes) 2024-09-13T05:10:25.867 INFO:teuthology.orchestra.run.smithi120.stdout:873 read 0xd6ae7c thru 0xd75efc (0xb081 bytes) 2024-09-13T05:10:25.868 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:25.885 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:25.883+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:25.906 INFO:teuthology.orchestra.run.smithi120.stdout:875 write 0xaf8a28c thru 0xaf8f9da (0x574f bytes) 2024-09-13T05:10:25.911 INFO:teuthology.orchestra.run.smithi120.stdout:877 read 0x24b1080 thru 0x24b5a5e (0x49df bytes) 2024-09-13T05:10:25.922 INFO:teuthology.orchestra.run.smithi120.stdout:878 trunc from 0xaf8f9db to 0x37029ce 2024-09-13T05:10:25.953 INFO:teuthology.orchestra.run.smithi120.stdout:879 write 0x4cdd14c thru 0x4ce52d4 (0x8189 bytes) 2024-09-13T05:10:25.963 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:25.963 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:25.964 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:25.964 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:25.964 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:25.964 INFO:teuthology.orchestra.run.smithi120.stdout:880 trunc from 0x4ce52d5 to 0x810044d 2024-09-13T05:10:25.974 INFO:teuthology.orchestra.run.smithi120.stdout:882 write 0x38bcaa4 thru 0x38c1881 (0x4dde bytes) 2024-09-13T05:10:25.975 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:10:25.980 INFO:teuthology.orchestra.run.smithi120.stdout:884 punch from 0x67c3e33 to 0x67d1a07, (0xdbd4 bytes) 2024-09-13T05:10:25.980 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:25.980 INFO:teuthology.orchestra.run.smithi120.stdout:886 write 0x67b6ea8 thru 0x67c3336 (0xc48f bytes) 2024-09-13T05:10:25.985 INFO:teuthology.orchestra.run.smithi120.stdout:889 punch from 0x534736a to 0x53499c1, (0x2657 bytes) 2024-09-13T05:10:25.985 INFO:teuthology.orchestra.run.smithi120.stdout:890 write 0x39ef252 thru 0x39f66fb (0x74aa bytes) 2024-09-13T05:10:25.986 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:25.983+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:25.989 INFO:teuthology.orchestra.run.smithi120.stdout:892 read 0x1f7ba61 thru 0x1f80f82 (0x5522 bytes) 2024-09-13T05:10:25.990 INFO:teuthology.orchestra.run.smithi120.stdout:893 write 0x20ed2f2 thru 0x20f48f0 (0x75ff bytes) 2024-09-13T05:10:25.993 INFO:teuthology.orchestra.run.smithi120.stdout:894 punch from 0x3546fd7 to 0x354d5ec, (0x6615 bytes) 2024-09-13T05:10:26.011 INFO:teuthology.orchestra.run.smithi120.stdout:896 write 0xd9ca842 thru 0xd9cbdb7 (0x1576 bytes) 2024-09-13T05:10:26.015 INFO:teuthology.orchestra.run.smithi120.stdout:898 writesame 0x53c4085 thru 0x53c6195 data_size 0x1(0x2111 bytes) 2024-09-13T05:10:26.030 INFO:teuthology.orchestra.run.smithi120.stdout:899 read 0x217ce00 thru 0x218b0d1 (0xe2d2 bytes) 2024-09-13T05:10:26.042 INFO:teuthology.orchestra.run.smithi120.stdout:901 write 0xe9878d4 thru 0xe98ab9b (0x32c8 bytes) 2024-09-13T05:10:26.048 INFO:teuthology.orchestra.run.smithi120.stdout:truncating to largest ever: 0xec02ca5 2024-09-13T05:10:26.048 INFO:teuthology.orchestra.run.smithi120.stdout:903 trunc from 0xe98ab9c to 0xec02ca5 2024-09-13T05:10:26.058 INFO:teuthology.orchestra.run.smithi120.stdout:904 write 0x5acc00b thru 0x5ad322b (0x7221 bytes) 2024-09-13T05:10:26.064 INFO:teuthology.orchestra.run.smithi120.stdout:905 write 0x7731ee1 thru 0x77373f6 (0x5516 bytes) 2024-09-13T05:10:26.070 INFO:teuthology.orchestra.run.smithi120.stdout:906 writesame 0xde1f8ba thru 0xde2e733 data_size 0x4b(0xee7a bytes) 2024-09-13T05:10:26.074 INFO:teuthology.orchestra.run.smithi120.stdout:907 writesame 0xb336332 thru 0xb344cb6 data_size 0x1(0xe985 bytes) 2024-09-13T05:10:26.087 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:26.083+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:26.093 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:716 3.7 3:e36464e2:::rbd_object_map.112dac7a9dca:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:15.991960+0000", 2024-09-13T05:10:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.095322933, 2024-09-13T05:10:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091896310000000002, 2024-09-13T05:10:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 716 2024-09-13T05:10:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.991960+0000", 2024-09-13T05:10:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.991960+0000", 2024-09-13T05:10:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.991959+0000", 2024-09-13T05:10:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.991966+0000", 2024-09-13T05:10:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8940000000000004e-06 2024-09-13T05:10:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.991983+0000", 2024-09-13T05:10:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7506000000000001e-05 2024-09-13T05:10:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.991992+0000", 2024-09-13T05:10:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6680000000000007e-06 2024-09-13T05:10:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.993862+0000", 2024-09-13T05:10:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018696019999999999 2024-09-13T05:10:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.993962+0000", 2024-09-13T05:10:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100566 2024-09-13T05:10:26.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:10:26.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.994363+0000", 2024-09-13T05:10:26.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040053000000000002 2024-09-13T05:10:26.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:26.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.995982+0000", 2024-09-13T05:10:26.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001619424 2024-09-13T05:10:26.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:26.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.001091+0000", 2024-09-13T05:10:26.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051089339999999999 2024-09-13T05:10:26.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:26.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.001125+0000", 2024-09-13T05:10:26.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3739999999999999e-05 2024-09-13T05:10:26.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:26.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.001150+0000", 2024-09-13T05:10:26.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4732999999999999e-05 2024-09-13T05:10:26.099 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.099 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:26.100 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.100 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:717 3.7 3:e36464e2:::rbd_object_map.112dac7a9dca:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:26.100 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:15.992405+0000", 2024-09-13T05:10:26.100 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.094878053, 2024-09-13T05:10:26.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088926649999999993, 2024-09-13T05:10:26.100 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:26.100 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:26.100 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:26.100 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:26.100 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:26.100 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 717 2024-09-13T05:10:26.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.101 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:26.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:26.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.992405+0000", 2024-09-13T05:10:26.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:26.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.992405+0000", 2024-09-13T05:10:26.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:26.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.992404+0000", 2024-09-13T05:10:26.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:26.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:26.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.992410+0000", 2024-09-13T05:10:26.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8900000000000004e-06 2024-09-13T05:10:26.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:26.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.992422+0000", 2024-09-13T05:10:26.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1867e-05 2024-09-13T05:10:26.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:26.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.992434+0000", 2024-09-13T05:10:26.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.27e-05 2024-09-13T05:10:26.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:26.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.994942+0000", 2024-09-13T05:10:26.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025075229999999998 2024-09-13T05:10:26.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:26.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.995059+0000", 2024-09-13T05:10:26.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011668200000000001 2024-09-13T05:10:26.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:10:26.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.995387+0000", 2024-09-13T05:10:26.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032890600000000001 2024-09-13T05:10:26.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:26.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.996169+0000", 2024-09-13T05:10:26.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00078193100000000003 2024-09-13T05:10:26.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:26.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.001203+0000", 2024-09-13T05:10:26.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050336280000000001 2024-09-13T05:10:26.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:26.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.001257+0000", 2024-09-13T05:10:26.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3770000000000002e-05 2024-09-13T05:10:26.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:26.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.001297+0000", 2024-09-13T05:10:26.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0633999999999998e-05 2024-09-13T05:10:26.106 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.106 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:26.106 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.106 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2037 3.8 3:1349be29:::rbd_data.112d872fd67a.000000000000003b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:26.106 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.108522+0000", 2024-09-13T05:10:26.106 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9787606889999996, 2024-09-13T05:10:26.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016880821000000001, 2024-09-13T05:10:26.106 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:26.106 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:26.106 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:26.106 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:26.107 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:26.107 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2037 2024-09-13T05:10:26.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.107 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:26.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:26.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108522+0000", 2024-09-13T05:10:26.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:26.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108522+0000", 2024-09-13T05:10:26.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:26.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108521+0000", 2024-09-13T05:10:26.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:26.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:26.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108527+0000", 2024-09-13T05:10:26.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0460000000000002e-06 2024-09-13T05:10:26.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:26.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108538+0000", 2024-09-13T05:10:26.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0891e-05 2024-09-13T05:10:26.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:26.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108548+0000", 2024-09-13T05:10:26.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9159999999999996e-06 2024-09-13T05:10:26.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:26.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108595+0000", 2024-09-13T05:10:26.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7107000000000001e-05 2024-09-13T05:10:26.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:26.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108692+0000", 2024-09-13T05:10:26.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6824999999999995e-05 2024-09-13T05:10:26.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:26.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.111425+0000", 2024-09-13T05:10:26.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027337110000000002 2024-09-13T05:10:26.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:26.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125249+0000", 2024-09-13T05:10:26.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013823521 2024-09-13T05:10:26.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:26.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125265+0000", 2024-09-13T05:10:26.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6257e-05 2024-09-13T05:10:26.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:26.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125347+0000", 2024-09-13T05:10:26.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1321000000000003e-05 2024-09-13T05:10:26.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:26.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125403+0000", 2024-09-13T05:10:26.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6362e-05 2024-09-13T05:10:26.112 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.112 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:26.112 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.113 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2947 3.b 3:d32df763:::rbd_data.112d872fd67a.000000000000006b:head [stat,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:26.113 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.921206+0000", 2024-09-13T05:10:26.113 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.1660764749999997, 2024-09-13T05:10:26.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095406580000000005, 2024-09-13T05:10:26.113 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:26.113 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:26.113 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:26.113 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:26.113 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:26.113 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2947 2024-09-13T05:10:26.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.113 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:26.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:26.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921206+0000", 2024-09-13T05:10:26.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:26.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921206+0000", 2024-09-13T05:10:26.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:26.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921205+0000", 2024-09-13T05:10:26.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:26.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:26.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921212+0000", 2024-09-13T05:10:26.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3300000000000001e-06 2024-09-13T05:10:26.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:26.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921232+0000", 2024-09-13T05:10:26.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9601000000000001e-05 2024-09-13T05:10:26.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:26.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921241+0000", 2024-09-13T05:10:26.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3230000000000004e-06 2024-09-13T05:10:26.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:26.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921297+0000", 2024-09-13T05:10:26.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5849e-05 2024-09-13T05:10:26.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:26.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921456+0000", 2024-09-13T05:10:26.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015864899999999999 2024-09-13T05:10:26.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:26.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.930747+0000", 2024-09-13T05:10:26.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092911450000000007 2024-09-13T05:10:26.117 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.117 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:26.117 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.117 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4911 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2801664~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:26.117 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.800434+0000", 2024-09-13T05:10:26.117 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2868487670000004, 2024-09-13T05:10:26.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096311120000000007, 2024-09-13T05:10:26.117 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:26.117 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:26.117 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:26.118 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:26.118 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:26.118 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4911 2024-09-13T05:10:26.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.118 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:26.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:26.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800434+0000", 2024-09-13T05:10:26.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:26.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800434+0000", 2024-09-13T05:10:26.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:26.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800433+0000", 2024-09-13T05:10:26.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:26.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:26.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800441+0000", 2024-09-13T05:10:26.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4699999999999996e-06 2024-09-13T05:10:26.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:26.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800450+0000", 2024-09-13T05:10:26.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6030000000000005e-06 2024-09-13T05:10:26.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:26.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800455+0000", 2024-09-13T05:10:26.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6019999999999999e-06 2024-09-13T05:10:26.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:26.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802738+0000", 2024-09-13T05:10:26.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022825089999999998 2024-09-13T05:10:26.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:26.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802849+0000", 2024-09-13T05:10:26.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110849 2024-09-13T05:10:26.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:26.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810065+0000", 2024-09-13T05:10:26.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072166419999999997 2024-09-13T05:10:26.121 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.121 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:26.121 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.121 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5012 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2883584~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:26.121 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.801394+0000", 2024-09-13T05:10:26.122 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2858887640000001, 2024-09-13T05:10:26.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086210910000000009, 2024-09-13T05:10:26.122 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:26.122 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:26.122 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:26.122 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:26.122 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:26.122 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5012 2024-09-13T05:10:26.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.122 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:26.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:26.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801394+0000", 2024-09-13T05:10:26.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:26.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801394+0000", 2024-09-13T05:10:26.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:26.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801394+0000", 2024-09-13T05:10:26.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:26.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:26.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801396+0000", 2024-09-13T05:10:26.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.345e-06 2024-09-13T05:10:26.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:26.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801401+0000", 2024-09-13T05:10:26.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4330000000000003e-06 2024-09-13T05:10:26.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:26.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801406+0000", 2024-09-13T05:10:26.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4819999999999996e-06 2024-09-13T05:10:26.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:26.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.809836+0000", 2024-09-13T05:10:26.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084304670000000005 2024-09-13T05:10:26.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:26.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.809909+0000", 2024-09-13T05:10:26.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2447000000000006e-05 2024-09-13T05:10:26.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:26.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810015+0000", 2024-09-13T05:10:26.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106304 2024-09-13T05:10:26.126 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.126 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:26.126 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.126 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5017 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2490368~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:26.126 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.801410+0000", 2024-09-13T05:10:26.126 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.285872865, 2024-09-13T05:10:26.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088072180000000003, 2024-09-13T05:10:26.126 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:26.126 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:26.126 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:26.127 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:26.127 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:26.127 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5017 2024-09-13T05:10:26.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.127 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:26.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:26.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801410+0000", 2024-09-13T05:10:26.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:26.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801410+0000", 2024-09-13T05:10:26.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:26.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801410+0000", 2024-09-13T05:10:26.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:26.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:26.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801412+0000", 2024-09-13T05:10:26.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2919999999999998e-06 2024-09-13T05:10:26.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:26.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801418+0000", 2024-09-13T05:10:26.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7139999999999998e-06 2024-09-13T05:10:26.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:26.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801422+0000", 2024-09-13T05:10:26.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7330000000000003e-06 2024-09-13T05:10:26.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:26.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810037+0000", 2024-09-13T05:10:26.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086144470000000008 2024-09-13T05:10:26.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:26.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810156+0000", 2024-09-13T05:10:26.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011961800000000001 2024-09-13T05:10:26.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:26.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810217+0000", 2024-09-13T05:10:26.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0767000000000003e-05 2024-09-13T05:10:26.130 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.130 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:26.130 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.131 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5020 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 3080192~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:26.131 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.801427+0000", 2024-09-13T05:10:26.131 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2858562999999998, 2024-09-13T05:10:26.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089605129999999998, 2024-09-13T05:10:26.131 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:26.131 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:26.131 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:26.131 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:26.131 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:26.131 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5020 2024-09-13T05:10:26.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.131 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:26.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:26.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801427+0000", 2024-09-13T05:10:26.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:26.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801427+0000", 2024-09-13T05:10:26.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:26.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801426+0000", 2024-09-13T05:10:26.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:26.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:26.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801434+0000", 2024-09-13T05:10:26.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2179999999999999e-06 2024-09-13T05:10:26.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:26.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801441+0000", 2024-09-13T05:10:26.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2580000000000001e-06 2024-09-13T05:10:26.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:26.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801446+0000", 2024-09-13T05:10:26.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0769999999999998e-06 2024-09-13T05:10:26.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:26.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810249+0000", 2024-09-13T05:10:26.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088031619999999998 2024-09-13T05:10:26.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:26.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810297+0000", 2024-09-13T05:10:26.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8189999999999998e-05 2024-09-13T05:10:26.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:26.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810387+0000", 2024-09-13T05:10:26.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9983999999999998e-05 2024-09-13T05:10:26.134 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.135 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:26.135 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.135 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5022 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 1130496~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:26.135 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.801450+0000", 2024-09-13T05:10:26.135 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2858329849999999, 2024-09-13T05:10:26.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091281130000000002, 2024-09-13T05:10:26.135 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:26.135 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:26.135 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:26.135 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:26.135 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:26.135 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5022 2024-09-13T05:10:26.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.136 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:26.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:26.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801450+0000", 2024-09-13T05:10:26.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:26.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801450+0000", 2024-09-13T05:10:26.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:26.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801449+0000", 2024-09-13T05:10:26.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:26.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:26.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801452+0000", 2024-09-13T05:10:26.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4339999999999999e-06 2024-09-13T05:10:26.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:26.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801457+0000", 2024-09-13T05:10:26.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2279999999999998e-06 2024-09-13T05:10:26.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:26.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801461+0000", 2024-09-13T05:10:26.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.206e-06 2024-09-13T05:10:26.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:26.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810421+0000", 2024-09-13T05:10:26.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089597519999999996 2024-09-13T05:10:26.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:26.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810508+0000", 2024-09-13T05:10:26.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6793999999999996e-05 2024-09-13T05:10:26.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:26.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810578+0000", 2024-09-13T05:10:26.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0106999999999998e-05 2024-09-13T05:10:26.139 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.139 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:26.139 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.139 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5024 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 1720320~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:26.139 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.801465+0000", 2024-09-13T05:10:26.139 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2858173370000001, 2024-09-13T05:10:26.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092671309999999996, 2024-09-13T05:10:26.140 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:26.140 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:26.140 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:26.140 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:26.140 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:26.140 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5024 2024-09-13T05:10:26.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.140 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:26.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:26.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801465+0000", 2024-09-13T05:10:26.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:26.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801465+0000", 2024-09-13T05:10:26.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:26.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801465+0000", 2024-09-13T05:10:26.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:26.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:26.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801467+0000", 2024-09-13T05:10:26.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.255e-06 2024-09-13T05:10:26.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:26.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801473+0000", 2024-09-13T05:10:26.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8699999999999997e-06 2024-09-13T05:10:26.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:26.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801483+0000", 2024-09-13T05:10:26.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6169999999999996e-06 2024-09-13T05:10:26.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:26.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810610+0000", 2024-09-13T05:10:26.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091271389999999994 2024-09-13T05:10:26.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:26.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810673+0000", 2024-09-13T05:10:26.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2973999999999997e-05 2024-09-13T05:10:26.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:26.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810733+0000", 2024-09-13T05:10:26.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9602999999999998e-05 2024-09-13T05:10:26.144 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.144 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:26.144 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.144 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5026 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 1327104~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:26.144 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.801949+0000", 2024-09-13T05:10:26.145 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2853337390000004, 2024-09-13T05:10:26.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089378559999999992, 2024-09-13T05:10:26.145 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:26.145 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:26.145 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:26.145 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:26.145 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:26.145 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5026 2024-09-13T05:10:26.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.145 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:26.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:26.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801949+0000", 2024-09-13T05:10:26.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:26.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801949+0000", 2024-09-13T05:10:26.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:26.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801948+0000", 2024-09-13T05:10:26.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:26.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:26.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801953+0000", 2024-09-13T05:10:26.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2239999999999997e-06 2024-09-13T05:10:26.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:26.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801963+0000", 2024-09-13T05:10:26.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0317e-05 2024-09-13T05:10:26.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:26.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801971+0000", 2024-09-13T05:10:26.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2150000000000001e-06 2024-09-13T05:10:26.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:26.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810769+0000", 2024-09-13T05:10:26.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0087978480000000005 2024-09-13T05:10:26.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:26.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810833+0000", 2024-09-13T05:10:26.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4280000000000001e-05 2024-09-13T05:10:26.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:26.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810887+0000", 2024-09-13T05:10:26.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3570999999999999e-05 2024-09-13T05:10:26.148 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.148 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:26.149 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.149 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5028 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 1916928~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:26.149 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.801977+0000", 2024-09-13T05:10:26.149 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2853062250000002, 2024-09-13T05:10:26.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092754559999999996, 2024-09-13T05:10:26.149 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:26.149 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:26.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:26.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:26.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:26.149 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5028 2024-09-13T05:10:26.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.150 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:26.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:26.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801977+0000", 2024-09-13T05:10:26.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:26.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801977+0000", 2024-09-13T05:10:26.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:26.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801976+0000", 2024-09-13T05:10:26.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:26.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:26.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801979+0000", 2024-09-13T05:10:26.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.813e-06 2024-09-13T05:10:26.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:26.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801985+0000", 2024-09-13T05:10:26.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6640000000000003e-06 2024-09-13T05:10:26.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:26.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801989+0000", 2024-09-13T05:10:26.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5759999999999999e-06 2024-09-13T05:10:26.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:26.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810910+0000", 2024-09-13T05:10:26.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089204430000000001 2024-09-13T05:10:26.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:26.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811176+0000", 2024-09-13T05:10:26.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026676100000000002 2024-09-13T05:10:26.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:26.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811252+0000", 2024-09-13T05:10:26.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5655000000000007e-05 2024-09-13T05:10:26.153 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.153 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:26.153 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.153 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5030 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 1523712~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:26.153 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.801994+0000", 2024-09-13T05:10:26.153 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2852890749999997, 2024-09-13T05:10:26.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094030090000000004, 2024-09-13T05:10:26.153 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:26.153 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:26.154 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:26.154 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:26.154 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:26.154 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5030 2024-09-13T05:10:26.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.154 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:26.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:26.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801994+0000", 2024-09-13T05:10:26.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:26.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801994+0000", 2024-09-13T05:10:26.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:26.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801993+0000", 2024-09-13T05:10:26.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:26.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:26.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801997+0000", 2024-09-13T05:10:26.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2650000000000001e-06 2024-09-13T05:10:26.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:26.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802002+0000", 2024-09-13T05:10:26.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7389999999999996e-06 2024-09-13T05:10:26.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:26.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802007+0000", 2024-09-13T05:10:26.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5419999999999999e-06 2024-09-13T05:10:26.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:26.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811276+0000", 2024-09-13T05:10:26.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092691330000000006 2024-09-13T05:10:26.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:26.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811341+0000", 2024-09-13T05:10:26.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5028000000000001e-05 2024-09-13T05:10:26.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:26.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811397+0000", 2024-09-13T05:10:26.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5699000000000003e-05 2024-09-13T05:10:26.157 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.157 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:26.157 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.158 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5033 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2113536~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:26.158 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802011+0000", 2024-09-13T05:10:26.158 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2852717269999996, 2024-09-13T05:10:26.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095360380000000002, 2024-09-13T05:10:26.158 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:26.158 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:26.158 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:26.158 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:26.158 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:26.158 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5033 2024-09-13T05:10:26.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.158 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:26.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:26.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802011+0000", 2024-09-13T05:10:26.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:26.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802011+0000", 2024-09-13T05:10:26.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:26.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802011+0000", 2024-09-13T05:10:26.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:26.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:26.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802013+0000", 2024-09-13T05:10:26.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.131e-06 2024-09-13T05:10:26.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:26.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802019+0000", 2024-09-13T05:10:26.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8799999999999996e-06 2024-09-13T05:10:26.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:26.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802023+0000", 2024-09-13T05:10:26.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6829999999999999e-06 2024-09-13T05:10:26.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:26.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811423+0000", 2024-09-13T05:10:26.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093992139999999995 2024-09-13T05:10:26.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:26.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811475+0000", 2024-09-13T05:10:26.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2000999999999999e-05 2024-09-13T05:10:26.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:26.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811547+0000", 2024-09-13T05:10:26.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2465000000000005e-05 2024-09-13T05:10:26.162 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.162 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:26.162 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.162 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5036 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2703360~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:26.162 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802028+0000", 2024-09-13T05:10:26.162 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2852552739999998, 2024-09-13T05:10:26.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096685629999999998, 2024-09-13T05:10:26.162 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:26.162 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:26.162 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:26.162 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:26.162 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:26.163 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5036 2024-09-13T05:10:26.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.163 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:26.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:26.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802028+0000", 2024-09-13T05:10:26.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:26.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802028+0000", 2024-09-13T05:10:26.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:26.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802027+0000", 2024-09-13T05:10:26.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:26.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:26.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802030+0000", 2024-09-13T05:10:26.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3329999999999999e-06 2024-09-13T05:10:26.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:26.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802036+0000", 2024-09-13T05:10:26.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5610000000000004e-06 2024-09-13T05:10:26.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:26.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802041+0000", 2024-09-13T05:10:26.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9309999999999999e-06 2024-09-13T05:10:26.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:26.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811568+0000", 2024-09-13T05:10:26.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095272369999999992 2024-09-13T05:10:26.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:26.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811624+0000", 2024-09-13T05:10:26.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5673e-05 2024-09-13T05:10:26.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:26.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811696+0000", 2024-09-13T05:10:26.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2187999999999994e-05 2024-09-13T05:10:26.166 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.166 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:26.166 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.166 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5041 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2310144~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:26.166 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802046+0000", 2024-09-13T05:10:26.166 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2852371409999996, 2024-09-13T05:10:26.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097718389999999992, 2024-09-13T05:10:26.167 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:26.167 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:26.167 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:26.167 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:26.167 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:26.167 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5041 2024-09-13T05:10:26.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.167 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:26.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:26.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802046+0000", 2024-09-13T05:10:26.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:26.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802046+0000", 2024-09-13T05:10:26.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:26.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802045+0000", 2024-09-13T05:10:26.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:26.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:26.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802047+0000", 2024-09-13T05:10:26.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1799999999999999e-06 2024-09-13T05:10:26.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:26.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802053+0000", 2024-09-13T05:10:26.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.507e-06 2024-09-13T05:10:26.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:26.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802057+0000", 2024-09-13T05:10:26.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3590000000000001e-06 2024-09-13T05:10:26.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:26.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811713+0000", 2024-09-13T05:10:26.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096553400000000001 2024-09-13T05:10:26.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:26.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811763+0000", 2024-09-13T05:10:26.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0050999999999999e-05 2024-09-13T05:10:26.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:26.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811818+0000", 2024-09-13T05:10:26.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4777000000000001e-05 2024-09-13T05:10:26.170 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.170 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:26.170 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.171 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5044 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2899968~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:26.171 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802062+0000", 2024-09-13T05:10:26.171 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2852211569999996, 2024-09-13T05:10:26.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0099015260000000008, 2024-09-13T05:10:26.171 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:26.171 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:26.171 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:26.171 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:26.171 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:26.171 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5044 2024-09-13T05:10:26.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.171 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:26.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:26.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802062+0000", 2024-09-13T05:10:26.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:26.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802062+0000", 2024-09-13T05:10:26.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:26.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802061+0000", 2024-09-13T05:10:26.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:26.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:26.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802064+0000", 2024-09-13T05:10:26.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0740000000000001e-06 2024-09-13T05:10:26.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:26.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802070+0000", 2024-09-13T05:10:26.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8560000000000003e-06 2024-09-13T05:10:26.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:26.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802075+0000", 2024-09-13T05:10:26.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6360000000000002e-06 2024-09-13T05:10:26.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:26.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811834+0000", 2024-09-13T05:10:26.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097588710000000006 2024-09-13T05:10:26.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:26.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811878+0000", 2024-09-13T05:10:26.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3937999999999998e-05 2024-09-13T05:10:26.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:26.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811963+0000", 2024-09-13T05:10:26.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5505000000000002e-05 2024-09-13T05:10:26.175 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.175 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:26.175 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.175 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5049 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2506752~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:26.175 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802080+0000", 2024-09-13T05:10:26.175 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2852032729999996, 2024-09-13T05:10:26.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010051279, 2024-09-13T05:10:26.176 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:26.176 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:26.176 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:26.176 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:26.176 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:26.176 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5049 2024-09-13T05:10:26.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.176 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:26.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:26.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802080+0000", 2024-09-13T05:10:26.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:26.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802080+0000", 2024-09-13T05:10:26.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:26.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802079+0000", 2024-09-13T05:10:26.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:26.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:26.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802081+0000", 2024-09-13T05:10:26.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2740000000000002e-06 2024-09-13T05:10:26.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:26.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802088+0000", 2024-09-13T05:10:26.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.567e-06 2024-09-13T05:10:26.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:26.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802093+0000", 2024-09-13T05:10:26.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8609999999999997e-06 2024-09-13T05:10:26.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:26.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811989+0000", 2024-09-13T05:10:26.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0098961840000000006 2024-09-13T05:10:26.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:26.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812069+0000", 2024-09-13T05:10:26.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9534000000000001e-05 2024-09-13T05:10:26.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:26.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812131+0000", 2024-09-13T05:10:26.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2206999999999996e-05 2024-09-13T05:10:26.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.180 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:26.180 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.180 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5052 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 3096576~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:26.180 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802097+0000", 2024-09-13T05:10:26.180 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2851860430000004, 2024-09-13T05:10:26.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010227615000000001, 2024-09-13T05:10:26.180 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:26.180 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:26.180 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:26.180 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:26.180 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:26.180 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5052 2024-09-13T05:10:26.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.181 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:26.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:26.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802097+0000", 2024-09-13T05:10:26.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:26.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802097+0000", 2024-09-13T05:10:26.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:26.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802096+0000", 2024-09-13T05:10:26.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:26.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:26.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802099+0000", 2024-09-13T05:10:26.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3539999999999998e-06 2024-09-13T05:10:26.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:26.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802105+0000", 2024-09-13T05:10:26.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8440000000000003e-06 2024-09-13T05:10:26.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:26.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802109+0000", 2024-09-13T05:10:26.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6800000000000001e-06 2024-09-13T05:10:26.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:26.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812155+0000", 2024-09-13T05:10:26.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010045691000000001 2024-09-13T05:10:26.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:26.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812238+0000", 2024-09-13T05:10:26.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2855000000000005e-05 2024-09-13T05:10:26.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:26.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812324+0000", 2024-09-13T05:10:26.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6621999999999998e-05 2024-09-13T05:10:26.184 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.184 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:26.184 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.184 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:7377 3.1e 3:7d4eb93d:::rbd_header.112d1304fe95:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-13T05:10:26.184 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:24.742504+0000", 2024-09-13T05:10:26.184 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.34477892, 2024-09-13T05:10:26.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01013406, 2024-09-13T05:10:26.185 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:26.185 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:26.185 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:26.185 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:26.185 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:26.185 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7377 2024-09-13T05:10:26.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.185 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:26.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:26.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742504+0000", 2024-09-13T05:10:26.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:26.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742504+0000", 2024-09-13T05:10:26.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:26.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:26.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742500+0000", 2024-09-13T05:10:26.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999962 2024-09-13T05:10:26.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:26.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742522+0000", 2024-09-13T05:10:26.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2310000000000002e-05 2024-09-13T05:10:26.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:26.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742572+0000", 2024-09-13T05:10:26.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9872e-05 2024-09-13T05:10:26.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:26.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742597+0000", 2024-09-13T05:10:26.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4363e-05 2024-09-13T05:10:26.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:26.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742678+0000", 2024-09-13T05:10:26.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1370000000000002e-05 2024-09-13T05:10:26.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-13T05:10:26.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742686+0000", 2024-09-13T05:10:26.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5259999999999993e-06 2024-09-13T05:10:26.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:26.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.749024+0000", 2024-09-13T05:10:26.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006337372 2024-09-13T05:10:26.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:26.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.749278+0000", 2024-09-13T05:10:26.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025436399999999998 2024-09-13T05:10:26.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:10:26.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.750557+0000", 2024-09-13T05:10:26.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012787129999999999 2024-09-13T05:10:26.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:26.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.751774+0000", 2024-09-13T05:10:26.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001217054 2024-09-13T05:10:26.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:26.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.752530+0000", 2024-09-13T05:10:26.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075635999999999998 2024-09-13T05:10:26.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:26.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.752592+0000", 2024-09-13T05:10:26.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1486000000000001e-05 2024-09-13T05:10:26.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:26.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:26.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:26.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.752638+0000", 2024-09-13T05:10:26.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6140000000000002e-05 2024-09-13T05:10:26.190 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.190 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:26.191 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.191 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:26.191 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:26.191 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:26.192 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:10:26.193 INFO:teuthology.orchestra.run.smithi120.stdout:908 trunc from 0xec02ca5 to 0xbce6f1c 2024-09-13T05:10:26.193 INFO:teuthology.orchestra.run.smithi120.stdout:909 writesame 0xb013161 thru 0xb02073e data_size 0x96(0xd5de bytes) 2024-09-13T05:10:26.193 INFO:teuthology.orchestra.run.smithi120.stdout:910 trunc from 0xbce6f1c to 0xa6588dc 2024-09-13T05:10:26.193 INFO:teuthology.orchestra.run.smithi120.stdout:911 punch from 0x8ce8f53 to 0x8cead69, (0x1e16 bytes) 2024-09-13T05:10:26.193 INFO:teuthology.orchestra.run.smithi120.stdout:912 trunc from 0xa6588dc to 0x119f5c5 2024-09-13T05:10:26.194 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:26.187+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:26.208 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:26.208 INFO:teuthology.orchestra.run.smithi120.stdout:915 punch from 0x10f082b to 0x10f5874, (0x5049 bytes) 2024-09-13T05:10:26.208 INFO:teuthology.orchestra.run.smithi120.stdout:917 write 0xac3e24 thru 0xac4552 (0x72f bytes) 2024-09-13T05:10:26.255 INFO:teuthology.orchestra.run.smithi120.stdout:918 write 0x6a6f23b thru 0x6a78864 (0x962a bytes) 2024-09-13T05:10:26.269 INFO:teuthology.orchestra.run.smithi120.stdout:920 trunc from 0x6a78865 to 0xb8f128b 2024-09-13T05:10:26.282 INFO:teuthology.orchestra.run.smithi120.stdout:921 read 0x2f81293 thru 0x2f89ee3 (0x8c51 bytes) 2024-09-13T05:10:26.282 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:26.283 INFO:teuthology.orchestra.run.smithi120.stdout:925 read 0x909caea thru 0x909e6ed (0x1c04 bytes) 2024-09-13T05:10:26.288 INFO:teuthology.orchestra.run.smithi120.stdout:926 trunc from 0xb8f128b to 0xe91ded1 2024-09-13T05:10:26.293 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:26.290+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:26.301 INFO:teuthology.orchestra.run.smithi120.stdout:927 write 0xccbe547 thru 0xcccada0 (0xc85a bytes) 2024-09-13T05:10:26.307 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:26.308 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:26.308 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:26.308 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:26.310 INFO:teuthology.orchestra.run.smithi120.stdout:928 punch from 0xbdb441 to 0xbde23e, (0x2dfd bytes) 2024-09-13T05:10:26.310 INFO:teuthology.orchestra.run.smithi120.stdout:929 punch from 0xb487910 to 0xb494f24, (0xd614 bytes) 2024-09-13T05:10:26.310 INFO:teuthology.orchestra.run.smithi120.stdout:930 read 0x6ff4a97 thru 0x7003eb9 (0xf423 bytes) 2024-09-13T05:10:26.310 INFO:teuthology.orchestra.run.smithi120.stdout:931 read 0xc112059 thru 0xc11bfdf (0x9f87 bytes) 2024-09-13T05:10:26.310 INFO:teuthology.orchestra.run.smithi120.stdout:934 writesame 0xa112b86 thru 0xa12235b data_size 0x1(0xf7d6 bytes) 2024-09-13T05:10:26.317 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:10:26.325 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:10:26.374 INFO:teuthology.orchestra.run.smithi120.stdout:935 trunc from 0xe91ded1 to 0x655921 2024-09-13T05:10:26.395 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:26.391+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:26.413 INFO:teuthology.orchestra.run.smithi120.stdout:936 read 0x1b7eca thru 0x1be038 (0x616f bytes) 2024-09-13T05:10:26.427 INFO:teuthology.orchestra.run.smithi120.stdout:937 writesame 0x3034744 thru 0x304218f data_size 0x6(0xda4c bytes) 2024-09-13T05:10:26.427 INFO:teuthology.orchestra.run.smithi120.stdout:938 read 0xa15370 thru 0xa20b49 (0xb7da bytes) 2024-09-13T05:10:26.428 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:26.428 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:26.428 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:26.428 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:26.429 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:26.438 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:10:26.456 INFO:teuthology.orchestra.run.smithi120.stdout:939 write 0xdd8b1fc thru 0xdd94d0d (0x9b12 bytes) 2024-09-13T05:10:26.462 INFO:teuthology.orchestra.run.smithi120.stdout:941 read 0xbae03f3 thru 0xbaeb91f (0xb52d bytes) 2024-09-13T05:10:26.462 INFO:teuthology.orchestra.run.smithi120.stdout:942 write 0x9aea70d thru 0x9af66a5 (0xbf99 bytes) 2024-09-13T05:10:26.466 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:10:26.468 INFO:teuthology.orchestra.run.smithi120.stdout:944 punch from 0x36c169f to 0x36cb9bf, (0xa320 bytes) 2024-09-13T05:10:26.468 INFO:teuthology.orchestra.run.smithi120.stdout:945 read 0x868bbd3 thru 0x8698570 (0xc99e bytes) 2024-09-13T05:10:26.469 INFO:teuthology.orchestra.run.smithi120.stdout:946 write 0x4e9569c thru 0x4ea0330 (0xac95 bytes) 2024-09-13T05:10:26.473 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:26.474 INFO:teuthology.orchestra.run.smithi120.stdout:950 read 0x6b78c8f thru 0x6b87f62 (0xf2d4 bytes) 2024-09-13T05:10:26.474 INFO:teuthology.orchestra.run.smithi120.stdout:951 write 0xb4c5050 thru 0xb4cb1c4 (0x6175 bytes) 2024-09-13T05:10:26.480 INFO:teuthology.orchestra.run.smithi120.stdout:952 write 0x893e866 thru 0x8947eca (0x9665 bytes) 2024-09-13T05:10:26.485 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:26.488 INFO:teuthology.orchestra.run.smithi120.stdout:954 trunc from 0xdd94d0e to 0xc44ee47 2024-09-13T05:10:26.492 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:10:26.495 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:26.490+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:26.508 INFO:teuthology.orchestra.run.smithi120.stdout:955 write 0x65b54f9 thru 0x65bda89 (0x8591 bytes) 2024-09-13T05:10:26.512 INFO:teuthology.orchestra.run.smithi120.stdout:956 write 0xaeb5990 thru 0xaeb9c31 (0x42a2 bytes) 2024-09-13T05:10:26.517 INFO:teuthology.orchestra.run.smithi120.stdout:957 writesame 0xbcba636 thru 0xbcc11e5 data_size 0x8(0x6bb0 bytes) 2024-09-13T05:10:26.519 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:10:26.524 INFO:teuthology.orchestra.run.smithi120.stdout:959 read 0x42735be thru 0x4278e60 (0x58a3 bytes) 2024-09-13T05:10:26.537 INFO:teuthology.orchestra.run.smithi120.stdout:960 write 0xd9b5292 thru 0xd9c222c (0xcf9b bytes) 2024-09-13T05:10:26.540 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:10:26.540 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:26.540 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:26.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:26.541 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [] 2024-09-13T05:10:26.541 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:26.541 INFO:teuthology.orchestra.run.smithi120.stdout:961 writesame 0x968b08c thru 0x968b956 data_size 0x1(0x8cb bytes) 2024-09-13T05:10:26.548 INFO:teuthology.orchestra.run.smithi120.stdout:962 read 0xd8e12e6 thru 0xd8ef227 (0xdf42 bytes) 2024-09-13T05:10:26.548 INFO:teuthology.orchestra.run.smithi120.stdout:963 read 0x53b65bb thru 0x53c5b94 (0xf5da bytes) 2024-09-13T05:10:26.548 INFO:teuthology.orchestra.run.smithi120.stdout:964 write 0x1ef9b0f thru 0x1f05481 (0xb973 bytes) 2024-09-13T05:10:26.550 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:10:26.556 INFO:teuthology.orchestra.run.smithi120.stdout:966 write 0x26d6190 thru 0x26e4df4 (0xec65 bytes) 2024-09-13T05:10:26.562 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:10:26.573 INFO:teuthology.orchestra.run.smithi120.stdout:967 trunc from 0xd9c222d to 0x61ebd9a 2024-09-13T05:10:26.590 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:10:26.597 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:26.590+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:26.609 INFO:teuthology.orchestra.run.smithi120.stdout:969 writesame 0x7e48695 thru 0x7e489f4 data_size 0x18(0x360 bytes) 2024-09-13T05:10:26.609 INFO:teuthology.orchestra.run.smithi120.stdout:971 read 0x1ec9271 thru 0x1ecdf4b (0x4cdb bytes) 2024-09-13T05:10:26.615 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:10:26.622 INFO:teuthology.orchestra.run.smithi120.stdout:972 trunc from 0x7e489f5 to 0x8d0f8b 2024-09-13T05:10:26.641 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:10:26.642 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:10:26.642 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:10:26.642 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:10:26.642 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:10:26.643 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:10:26.643 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:10:26.643 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:10:26.643 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:10:26.645 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:26.645 INFO:teuthology.orchestra.run.smithi120.stdout:974 punch from 0x60469 to 0x6a1fe, (0x9d95 bytes) 2024-09-13T05:10:26.656 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:26.656 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:26.666 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:10:26.676 INFO:teuthology.orchestra.run.smithi120.stdout:975 writesame 0x98da874 thru 0x98e838f data_size 0x4(0xdb1c bytes) 2024-09-13T05:10:26.676 INFO:teuthology.orchestra.run.smithi120.stdout:976 read 0x8bb028f thru 0x8bb9094 (0x8e06 bytes) 2024-09-13T05:10:26.676 INFO:teuthology.orchestra.run.smithi120.stdout:977 read 0x29404e thru 0x294734 (0x6e7 bytes) 2024-09-13T05:10:26.677 INFO:teuthology.orchestra.run.smithi120.stdout:978 writesame 0x3058630 thru 0x306644b data_size 0xa(0xde1c bytes) 2024-09-13T05:10:26.687 INFO:teuthology.orchestra.run.smithi120.stdout:979 write 0x17c02d9 thru 0x17c67c9 (0x64f1 bytes) 2024-09-13T05:10:26.693 INFO:teuthology.orchestra.run.smithi120.stdout:980 write 0x33ffe48 thru 0x3401d36 (0x1eef bytes) 2024-09-13T05:10:26.697 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:26.695+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:26.700 INFO:teuthology.orchestra.run.smithi120.stdout:981 write 0x17a5808 thru 0x17ae4bd (0x8cb6 bytes) 2024-09-13T05:10:26.716 INFO:teuthology.orchestra.run.smithi120.stdout:982 write 0x9e63f9e thru 0x9e70fd4 (0xd037 bytes) 2024-09-13T05:10:26.722 INFO:teuthology.orchestra.run.smithi120.stdout:983 read 0x894a213 thru 0x8959e8d (0xfc7b bytes) 2024-09-13T05:10:26.722 INFO:teuthology.orchestra.run.smithi120.stdout:984 write 0x39cb48e thru 0x39d746e (0xbfe1 bytes) 2024-09-13T05:10:26.724 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:26.725 INFO:teuthology.orchestra.run.smithi120.stdout:987 punch from 0x4c49b07 to 0x4c4de09, (0x4302 bytes) 2024-09-13T05:10:26.730 INFO:teuthology.orchestra.run.smithi120.stdout:988 trunc from 0x9e70fd5 to 0x7a651c4 2024-09-13T05:10:26.751 INFO:teuthology.orchestra.run.smithi120.stdout:991 write 0x7659f49 thru 0x766018b (0x6243 bytes) 2024-09-13T05:10:26.771 INFO:teuthology.orchestra.run.smithi120.stdout:993 trunc from 0x7a651c4 to 0x120c1f0 2024-09-13T05:10:26.772 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.5 to 1 (10000) 2024-09-13T05:10:26.773 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is unset 2024-09-13T05:10:26.778 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:26.778 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:26.784 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-13T05:10:26.788 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:10:26.817 INFO:teuthology.orchestra.run.smithi120.stdout:994 writesame 0x7199b98 thru 0x71a9498 data_size 0x13(0xf901 bytes) 2024-09-13T05:10:26.832 INFO:teuthology.orchestra.run.smithi120.stdout:995 write 0xa5d5905 thru 0xa5d5f1a (0x616 bytes) 2024-09-13T05:10:26.833 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:26.831+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:26.837 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:26.847 INFO:teuthology.orchestra.run.smithi120.stdout:997 trunc from 0xa5d5f1b to 0x596db58 2024-09-13T05:10:26.879 INFO:teuthology.orchestra.run.smithi120.stdout:998 trunc from 0x596db58 to 0xdfa0819 2024-09-13T05:10:26.891 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:26.891 INFO:teuthology.orchestra.run.smithi120.stdout:1000 writesame 0xb47f285 thru 0xb486b1e data_size 0x2b(0x789a bytes) 2024-09-13T05:10:26.896 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:26.896 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:26.898 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:26.894+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:26.903 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:26.903 INFO:teuthology.orchestra.run.smithi120.stdout:1003 punch from 0x7250328 to 0x7258e79, (0x8b51 bytes) 2024-09-13T05:10:26.903 INFO:teuthology.orchestra.run.smithi120.stdout:1004 read 0x10c93d6 thru 0x10d8f86 (0xfbb1 bytes) 2024-09-13T05:10:26.903 INFO:teuthology.orchestra.run.smithi120.stdout:1005 writesame 0x6fe6dda thru 0x6ff63e7 data_size 0x5(0xf60e bytes) 2024-09-13T05:10:26.907 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:10:26.917 INFO:teuthology.orchestra.run.smithi120.stdout:1006 punch from 0x27940ef to 0x279be4a, (0x7d5b bytes) 2024-09-13T05:10:26.917 INFO:teuthology.orchestra.run.smithi120.stdout:1007 punch from 0x469636c to 0x46a57f7, (0xf48b bytes) 2024-09-13T05:10:26.917 INFO:teuthology.orchestra.run.smithi120.stdout:1009 write 0xc3591fb thru 0xc35a271 (0x1077 bytes) 2024-09-13T05:10:26.923 INFO:teuthology.orchestra.run.smithi120.stdout:1011 read 0x7573b23 thru 0x7574f26 (0x1404 bytes) 2024-09-13T05:10:26.923 INFO:teuthology.orchestra.run.smithi120.stdout:1012 write 0xaf2fa39 thru 0xaf3e26f (0xe837 bytes) 2024-09-13T05:10:26.928 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:26.928 INFO:teuthology.orchestra.run.smithi120.stdout:1014 read 0xb8d5ed4 thru 0xb8d7338 (0x1465 bytes) 2024-09-13T05:10:26.938 INFO:teuthology.orchestra.run.smithi120.stdout:1017 writesame 0xe25016b thru 0xe258fff data_size 0x17(0x8e95 bytes) 2024-09-13T05:10:26.938 INFO:teuthology.orchestra.run.smithi120.stdout:1019 writesame 0x919a8e8 thru 0x91a6d92 data_size 0x17(0xc4ab bytes) 2024-09-13T05:10:26.944 INFO:teuthology.orchestra.run.smithi120.stdout:1020 writesame 0xd7bf3fb thru 0xd7c6e4d data_size 0x1(0x7a53 bytes) 2024-09-13T05:10:26.973 INFO:teuthology.orchestra.run.smithi120.stdout:1021 write 0x78f721a thru 0x7902e43 (0xbc2a bytes) 2024-09-13T05:10:26.980 INFO:teuthology.orchestra.run.smithi120.stdout:1022 writesame 0x4e8c92a thru 0x4e8e94f data_size 0x2(0x2026 bytes) 2024-09-13T05:10:26.987 INFO:teuthology.orchestra.run.smithi120.stdout:1025 punch from 0x29d3e50 to 0x29d7db0, (0x3f60 bytes) 2024-09-13T05:10:26.988 INFO:teuthology.orchestra.run.smithi120.stdout:1027 writesame 0xafcfc4e thru 0xafd2b3f data_size 0x3(0x2ef2 bytes) 2024-09-13T05:10:26.995 INFO:teuthology.orchestra.run.smithi120.stdout:1028 write 0xb0f33e3 thru 0xb0ff5d9 (0xc1f7 bytes) 2024-09-13T05:10:27.000 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:26.994+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:27.013 INFO:teuthology.orchestra.run.smithi120.stdout:1029 trunc from 0xe259000 to 0x6337756 2024-09-13T05:10:27.015 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:27.015 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:27.026 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:10:27.031 INFO:teuthology.orchestra.run.smithi120.stdout:1032 write 0xaadd53 thru 0xab34ec (0x579a bytes) 2024-09-13T05:10:27.046 INFO:teuthology.orchestra.run.smithi120.stdout:1033 writesame 0x79a418a thru 0x79ad14f data_size 0x4d(0x8fc6 bytes) 2024-09-13T05:10:27.069 INFO:teuthology.orchestra.run.smithi120.stdout:1034 writesame 0xd49691c thru 0xd49d923 data_size 0x3c(0x7008 bytes) 2024-09-13T05:10:27.069 INFO:teuthology.orchestra.run.smithi120.stdout:1035 write 0x9364e57 thru 0x936def2 (0x909c bytes) 2024-09-13T05:10:27.075 INFO:teuthology.orchestra.run.smithi120.stdout:1036 writesame 0xb3b9229 thru 0xb3ba6a1 data_size 0x1(0x1479 bytes) 2024-09-13T05:10:27.084 INFO:teuthology.orchestra.run.smithi120.stdout:1037 write 0x75e051d thru 0x75e79b2 (0x7496 bytes) 2024-09-13T05:10:27.090 INFO:teuthology.orchestra.run.smithi120.stdout:1038 read 0x19c68b thru 0x1a11e1 (0x4b57 bytes) 2024-09-13T05:10:27.091 INFO:teuthology.orchestra.run.smithi120.stdout:1039 read 0xb59fb54 thru 0xb5a0a1c (0xec9 bytes) 2024-09-13T05:10:27.091 INFO:teuthology.orchestra.run.smithi120.stdout:1041 writesame 0x2b30e87 thru 0x2b3c7bb data_size 0x1(0xb935 bytes) 2024-09-13T05:10:27.100 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:27.094+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:27.131 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:27.131 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:27.132 INFO:teuthology.orchestra.run.smithi120.stdout:1042 clone 7 order 20 su 262144 sc 3 2024-09-13T05:10:27.141 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:10:27.202 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:27.198+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:27.244 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:27.244 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:27.254 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:10:27.303 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:27.298+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:27.357 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:27.357 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:27.367 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:10:27.404 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:27.399+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:27.469 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:27.469 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:27.479 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:10:27.505 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:27.498+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:27.606 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:27.603+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:27.634 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:27.634 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:27.643 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:10:27.707 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:27.703+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:27.758 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:27.758 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:27.768 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:10:27.785 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.6 to 1 (10000) 2024-09-13T05:10:27.797 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-13T05:10:27.807 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:27.803+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:27.872 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:27.872 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:27.883 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:10:27.908 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:27.903+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:27.947 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone6 from 0xd49d924 (overlap 0x655921) to 0x51141a 2024-09-13T05:10:27.990 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:27.990 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:28.001 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:10:28.009 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:28.006+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:28.107 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:28.107 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:28.110 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:28.107+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:28.117 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:10:28.163 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #5, image image_client.0-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent6 2024-09-13T05:10:28.211 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:28.206+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:28.219 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:28.219 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:28.230 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:10:28.312 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:28.307+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:28.368 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:28.368 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:28.382 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:10:28.412 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:28.407+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:28.499 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:28.500 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:28.513 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:28.510+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:28.514 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:10:28.615 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:28.611+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:28.617 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:28.617 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:28.628 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:10:28.665 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:10:28.700 INFO:teuthology.orchestra.run.smithi120.stdout:1043 read 0x1185c9f thru 0x118c903 (0x6c65 bytes) 2024-09-13T05:10:28.715 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:28.710+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:28.726 INFO:teuthology.orchestra.run.smithi120.stdout:1044 trunc from 0xd49d924 to 0x245ac7c 2024-09-13T05:10:28.765 INFO:teuthology.orchestra.run.smithi120.stdout:1045 write 0x63002e4 thru 0x6301e0c (0x1b29 bytes) 2024-09-13T05:10:28.765 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:28.765 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:28.768 INFO:teuthology.orchestra.run.smithi120.stdout:1047 read 0x528e2fd thru 0x529b56b (0xd26f bytes) 2024-09-13T05:10:28.768 INFO:teuthology.orchestra.run.smithi120.stdout:1048 read 0x2cfab57 thru 0x2cfce99 (0x2343 bytes) 2024-09-13T05:10:28.769 INFO:teuthology.orchestra.run.smithi120.stdout:1049 write 0x1ad3a73 thru 0x1ae01ae (0xc73c bytes) 2024-09-13T05:10:28.779 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:10:28.787 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T05:10:28.794 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.7 to 1 (10000) 2024-09-13T05:10:28.796 INFO:teuthology.orchestra.run.smithi120.stdout:1050 write 0x650feb1 thru 0x6516594 (0x66e4 bytes) 2024-09-13T05:10:28.804 INFO:teuthology.orchestra.run.smithi120.stdout:1051 write 0x690006 thru 0x692f5d (0x2f58 bytes) 2024-09-13T05:10:28.808 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-13T05:10:28.808 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:10:28.812 INFO:teuthology.orchestra.run.smithi120.stdout:1052 punch from 0x10339e4 to 0x103ff1d, (0xc539 bytes) 2024-09-13T05:10:28.812 INFO:teuthology.orchestra.run.smithi120.stdout:1053 punch from 0x5fac9f8 to 0x5fb279f, (0x5da7 bytes) 2024-09-13T05:10:28.812 INFO:teuthology.orchestra.run.smithi120.stdout:1054 read 0x37f98ae thru 0x3803251 (0x99a4 bytes) 2024-09-13T05:10:28.812 INFO:teuthology.orchestra.run.smithi120.stdout:1055 read 0x1e2742e thru 0x1e30891 (0x9464 bytes) 2024-09-13T05:10:28.812 INFO:teuthology.orchestra.run.smithi120.stdout:1056 read 0x5f83b88 thru 0x5f88459 (0x48d2 bytes) 2024-09-13T05:10:28.813 INFO:teuthology.orchestra.run.smithi120.stdout:1057 trunc from 0x6516595 to 0x7a65e2c 2024-09-13T05:10:28.815 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:28.811+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:28.830 INFO:teuthology.orchestra.run.smithi120.stdout:1058 trunc from 0x7a65e2c to 0xbdd188b 2024-09-13T05:10:28.843 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:28.843 INFO:teuthology.orchestra.run.smithi120.stdout:truncating to largest ever: 0xedaedbe 2024-09-13T05:10:28.848 INFO:teuthology.orchestra.run.smithi120.stdout:1060 trunc from 0xbdd188b to 0xedaedbe 2024-09-13T05:10:28.858 INFO:teuthology.orchestra.run.smithi120.stdout:1061 read 0x49677db thru 0x496aeea (0x3710 bytes) 2024-09-13T05:10:28.858 INFO:teuthology.orchestra.run.smithi120.stdout:1062 write 0x5fa8c99 thru 0x5fb7a56 (0xedbe bytes) 2024-09-13T05:10:28.879 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:10:28.888 INFO:teuthology.orchestra.run.smithi120.stdout:1065 trunc from 0xedaedbe to 0x131b6c2 2024-09-13T05:10:28.915 INFO:teuthology.orchestra.run.smithi120.stdout:1066 read 0x1069cdb thru 0x10779d7 (0xdcfd bytes) 2024-09-13T05:10:28.915 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:10:28.916 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:28.916 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:28.917 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:28.911+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:28.931 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:10:28.931 INFO:teuthology.orchestra.run.smithi120.stdout:1067 write 0x26a666c thru 0x26a758a (0xf1f bytes) 2024-09-13T05:10:28.936 INFO:teuthology.orchestra.run.smithi120.stdout:1068 trunc from 0x26a758b to 0x1aa664f 2024-09-13T05:10:28.948 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:10:28.952 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:28.952 INFO:teuthology.orchestra.run.smithi120.stdout:1070 read 0x161028a thru 0x161f1cd (0xef44 bytes) 2024-09-13T05:10:28.980 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:10:28.982 INFO:teuthology.orchestra.run.smithi120.stdout:1071 write 0xe0a2973 thru 0xe0b20d8 (0xf766 bytes) 2024-09-13T05:10:28.993 INFO:teuthology.orchestra.run.smithi120.stdout:1072 punch from 0x65e4dcb to 0x65eabf5, (0x5e2a bytes) 2024-09-13T05:10:28.994 INFO:teuthology.orchestra.run.smithi120.stdout:1073 read 0x2685547 thru 0x2694059 (0xeb13 bytes) 2024-09-13T05:10:28.994 INFO:teuthology.orchestra.run.smithi120.stdout:1074 clone 8 order 18 su 1024 sc 9 2024-09-13T05:10:29.005 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:10:29.017 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:29.014+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:29.038 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:29.038 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:29.039 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:29.039 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:29.039 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:29.039 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:10:29.048 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:10:29.066 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:10:29.092 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:10:29.094 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:10:29.094 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:10:29.094 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:10:29.094 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:10:29.094 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:10:29.094 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:10:29.094 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:10:29.095 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:10:29.119 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:29.115+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:29.187 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:10:29.190 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:10:29.192 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:29.192 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:29.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:29.192 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:29.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.192 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:716 3.7 3:e36464e2:::rbd_object_map.112dac7a9dca:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:29.192 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:15.991960+0000", 2024-09-13T05:10:29.192 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.196575978, 2024-09-13T05:10:29.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091896310000000002, 2024-09-13T05:10:29.192 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:29.193 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:29.193 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:29.193 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:29.193 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:29.193 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 716 2024-09-13T05:10:29.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.193 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:29.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:29.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.991960+0000", 2024-09-13T05:10:29.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:29.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.991960+0000", 2024-09-13T05:10:29.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:29.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.991959+0000", 2024-09-13T05:10:29.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:29.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:29.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.991966+0000", 2024-09-13T05:10:29.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8940000000000004e-06 2024-09-13T05:10:29.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:29.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.991983+0000", 2024-09-13T05:10:29.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7506000000000001e-05 2024-09-13T05:10:29.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:29.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.991992+0000", 2024-09-13T05:10:29.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6680000000000007e-06 2024-09-13T05:10:29.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:29.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.993862+0000", 2024-09-13T05:10:29.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018696019999999999 2024-09-13T05:10:29.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:29.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.993962+0000", 2024-09-13T05:10:29.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100566 2024-09-13T05:10:29.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:10:29.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.994363+0000", 2024-09-13T05:10:29.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040053000000000002 2024-09-13T05:10:29.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:29.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.995982+0000", 2024-09-13T05:10:29.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001619424 2024-09-13T05:10:29.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:29.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.001091+0000", 2024-09-13T05:10:29.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051089339999999999 2024-09-13T05:10:29.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:29.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.001125+0000", 2024-09-13T05:10:29.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3739999999999999e-05 2024-09-13T05:10:29.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:29.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.001150+0000", 2024-09-13T05:10:29.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4732999999999999e-05 2024-09-13T05:10:29.198 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.198 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:29.198 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.198 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2037 3.8 3:1349be29:::rbd_data.112d872fd67a.000000000000003b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:29.198 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.108522+0000", 2024-09-13T05:10:29.198 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.0800137339999996, 2024-09-13T05:10:29.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016880821000000001, 2024-09-13T05:10:29.199 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:29.199 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:29.199 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:29.199 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:29.199 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:29.199 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2037 2024-09-13T05:10:29.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.199 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:29.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:29.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108522+0000", 2024-09-13T05:10:29.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:29.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108522+0000", 2024-09-13T05:10:29.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:29.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108521+0000", 2024-09-13T05:10:29.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:29.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:29.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108527+0000", 2024-09-13T05:10:29.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0460000000000002e-06 2024-09-13T05:10:29.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:29.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108538+0000", 2024-09-13T05:10:29.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0891e-05 2024-09-13T05:10:29.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:29.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108548+0000", 2024-09-13T05:10:29.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9159999999999996e-06 2024-09-13T05:10:29.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:29.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108595+0000", 2024-09-13T05:10:29.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7107000000000001e-05 2024-09-13T05:10:29.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:29.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108692+0000", 2024-09-13T05:10:29.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6824999999999995e-05 2024-09-13T05:10:29.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:29.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.111425+0000", 2024-09-13T05:10:29.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027337110000000002 2024-09-13T05:10:29.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:29.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125249+0000", 2024-09-13T05:10:29.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013823521 2024-09-13T05:10:29.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:29.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125265+0000", 2024-09-13T05:10:29.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6257e-05 2024-09-13T05:10:29.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:29.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125347+0000", 2024-09-13T05:10:29.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1321000000000003e-05 2024-09-13T05:10:29.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:29.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125403+0000", 2024-09-13T05:10:29.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6362e-05 2024-09-13T05:10:29.204 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.204 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:29.204 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.204 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2947 3.b 3:d32df763:::rbd_data.112d872fd67a.000000000000006b:head [stat,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:29.204 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.921206+0000", 2024-09-13T05:10:29.204 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.2673295200000005, 2024-09-13T05:10:29.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095406580000000005, 2024-09-13T05:10:29.204 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:29.204 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:29.205 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:29.205 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:29.205 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:29.205 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2947 2024-09-13T05:10:29.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.205 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:29.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:29.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921206+0000", 2024-09-13T05:10:29.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:29.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921206+0000", 2024-09-13T05:10:29.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:29.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921205+0000", 2024-09-13T05:10:29.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:29.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:29.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921212+0000", 2024-09-13T05:10:29.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3300000000000001e-06 2024-09-13T05:10:29.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:29.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921232+0000", 2024-09-13T05:10:29.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9601000000000001e-05 2024-09-13T05:10:29.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:29.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921241+0000", 2024-09-13T05:10:29.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3230000000000004e-06 2024-09-13T05:10:29.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:29.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921297+0000", 2024-09-13T05:10:29.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5849e-05 2024-09-13T05:10:29.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:29.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921456+0000", 2024-09-13T05:10:29.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015864899999999999 2024-09-13T05:10:29.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:29.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.930747+0000", 2024-09-13T05:10:29.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092911450000000007 2024-09-13T05:10:29.208 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.208 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:29.208 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.208 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4911 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2801664~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:29.209 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.800434+0000", 2024-09-13T05:10:29.209 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.3881018120000004, 2024-09-13T05:10:29.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096311120000000007, 2024-09-13T05:10:29.209 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:29.209 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:29.209 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:29.209 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:29.209 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:29.209 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4911 2024-09-13T05:10:29.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.209 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:29.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:29.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800434+0000", 2024-09-13T05:10:29.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:29.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800434+0000", 2024-09-13T05:10:29.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:29.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800433+0000", 2024-09-13T05:10:29.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:29.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:29.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800441+0000", 2024-09-13T05:10:29.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4699999999999996e-06 2024-09-13T05:10:29.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:29.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800450+0000", 2024-09-13T05:10:29.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6030000000000005e-06 2024-09-13T05:10:29.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:29.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800455+0000", 2024-09-13T05:10:29.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6019999999999999e-06 2024-09-13T05:10:29.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:29.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802738+0000", 2024-09-13T05:10:29.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022825089999999998 2024-09-13T05:10:29.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:29.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802849+0000", 2024-09-13T05:10:29.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110849 2024-09-13T05:10:29.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:29.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810065+0000", 2024-09-13T05:10:29.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072166419999999997 2024-09-13T05:10:29.212 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.212 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:29.213 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.213 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5020 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 3080192~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:29.213 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.801427+0000", 2024-09-13T05:10:29.213 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.3871093449999998, 2024-09-13T05:10:29.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089605129999999998, 2024-09-13T05:10:29.213 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:29.213 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:29.213 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:29.213 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:29.213 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:29.213 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5020 2024-09-13T05:10:29.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.214 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:29.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:29.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801427+0000", 2024-09-13T05:10:29.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:29.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801427+0000", 2024-09-13T05:10:29.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:29.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801426+0000", 2024-09-13T05:10:29.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:29.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:29.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801434+0000", 2024-09-13T05:10:29.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2179999999999999e-06 2024-09-13T05:10:29.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:29.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801441+0000", 2024-09-13T05:10:29.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2580000000000001e-06 2024-09-13T05:10:29.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:29.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801446+0000", 2024-09-13T05:10:29.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0769999999999998e-06 2024-09-13T05:10:29.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:29.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810249+0000", 2024-09-13T05:10:29.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088031619999999998 2024-09-13T05:10:29.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:29.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810297+0000", 2024-09-13T05:10:29.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8189999999999998e-05 2024-09-13T05:10:29.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:29.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810387+0000", 2024-09-13T05:10:29.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9983999999999998e-05 2024-09-13T05:10:29.217 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.217 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:29.217 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.218 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5022 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 1130496~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:29.218 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.801450+0000", 2024-09-13T05:10:29.218 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.3870860299999999, 2024-09-13T05:10:29.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091281130000000002, 2024-09-13T05:10:29.218 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:29.218 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:29.218 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:29.218 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:29.218 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:29.218 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5022 2024-09-13T05:10:29.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.218 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:29.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:29.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801450+0000", 2024-09-13T05:10:29.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:29.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801450+0000", 2024-09-13T05:10:29.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:29.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801449+0000", 2024-09-13T05:10:29.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:29.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:29.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801452+0000", 2024-09-13T05:10:29.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4339999999999999e-06 2024-09-13T05:10:29.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:29.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801457+0000", 2024-09-13T05:10:29.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2279999999999998e-06 2024-09-13T05:10:29.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:29.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801461+0000", 2024-09-13T05:10:29.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.206e-06 2024-09-13T05:10:29.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:29.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810421+0000", 2024-09-13T05:10:29.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089597519999999996 2024-09-13T05:10:29.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:29.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810508+0000", 2024-09-13T05:10:29.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6793999999999996e-05 2024-09-13T05:10:29.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:29.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810578+0000", 2024-09-13T05:10:29.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0106999999999998e-05 2024-09-13T05:10:29.222 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.222 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:29.222 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.222 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5024 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 1720320~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:29.222 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.801465+0000", 2024-09-13T05:10:29.222 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.3870703820000001, 2024-09-13T05:10:29.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092671309999999996, 2024-09-13T05:10:29.222 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:29.222 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:29.222 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:29.223 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:29.223 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:29.223 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5024 2024-09-13T05:10:29.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.223 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:29.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:29.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801465+0000", 2024-09-13T05:10:29.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:29.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801465+0000", 2024-09-13T05:10:29.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:29.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801465+0000", 2024-09-13T05:10:29.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:29.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:29.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801467+0000", 2024-09-13T05:10:29.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.255e-06 2024-09-13T05:10:29.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:29.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801473+0000", 2024-09-13T05:10:29.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8699999999999997e-06 2024-09-13T05:10:29.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:29.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801483+0000", 2024-09-13T05:10:29.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6169999999999996e-06 2024-09-13T05:10:29.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:29.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810610+0000", 2024-09-13T05:10:29.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091271389999999994 2024-09-13T05:10:29.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:29.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810673+0000", 2024-09-13T05:10:29.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2973999999999997e-05 2024-09-13T05:10:29.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:29.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810733+0000", 2024-09-13T05:10:29.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9602999999999998e-05 2024-09-13T05:10:29.226 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.226 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:29.226 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.226 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5028 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 1916928~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:29.227 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.801977+0000", 2024-09-13T05:10:29.227 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.3865592700000002, 2024-09-13T05:10:29.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092754559999999996, 2024-09-13T05:10:29.227 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:29.227 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:29.227 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:29.227 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:29.227 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:29.227 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5028 2024-09-13T05:10:29.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.227 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:29.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:29.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801977+0000", 2024-09-13T05:10:29.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:29.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801977+0000", 2024-09-13T05:10:29.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:29.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801976+0000", 2024-09-13T05:10:29.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:29.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:29.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801979+0000", 2024-09-13T05:10:29.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.813e-06 2024-09-13T05:10:29.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:29.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801985+0000", 2024-09-13T05:10:29.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6640000000000003e-06 2024-09-13T05:10:29.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:29.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801989+0000", 2024-09-13T05:10:29.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5759999999999999e-06 2024-09-13T05:10:29.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:29.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810910+0000", 2024-09-13T05:10:29.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089204430000000001 2024-09-13T05:10:29.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:29.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811176+0000", 2024-09-13T05:10:29.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026676100000000002 2024-09-13T05:10:29.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:29.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811252+0000", 2024-09-13T05:10:29.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5655000000000007e-05 2024-09-13T05:10:29.230 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.230 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:29.230 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.231 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5030 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 1523712~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:29.231 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.801994+0000", 2024-09-13T05:10:29.231 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.3865421199999997, 2024-09-13T05:10:29.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094030090000000004, 2024-09-13T05:10:29.231 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:29.231 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:29.231 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:29.231 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:29.231 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:29.231 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5030 2024-09-13T05:10:29.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.231 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:29.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:29.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801994+0000", 2024-09-13T05:10:29.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:29.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801994+0000", 2024-09-13T05:10:29.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:29.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801993+0000", 2024-09-13T05:10:29.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:29.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:29.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801997+0000", 2024-09-13T05:10:29.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2650000000000001e-06 2024-09-13T05:10:29.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:29.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802002+0000", 2024-09-13T05:10:29.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7389999999999996e-06 2024-09-13T05:10:29.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:29.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802007+0000", 2024-09-13T05:10:29.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5419999999999999e-06 2024-09-13T05:10:29.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:29.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811276+0000", 2024-09-13T05:10:29.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092691330000000006 2024-09-13T05:10:29.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:29.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811341+0000", 2024-09-13T05:10:29.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5028000000000001e-05 2024-09-13T05:10:29.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:29.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811397+0000", 2024-09-13T05:10:29.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5699000000000003e-05 2024-09-13T05:10:29.235 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.235 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:29.235 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.235 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5033 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2113536~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:29.235 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802011+0000", 2024-09-13T05:10:29.235 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.3865247719999996, 2024-09-13T05:10:29.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095360380000000002, 2024-09-13T05:10:29.235 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:29.236 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:29.236 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:29.236 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:29.236 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:29.236 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5033 2024-09-13T05:10:29.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.236 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:29.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:29.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802011+0000", 2024-09-13T05:10:29.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:29.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802011+0000", 2024-09-13T05:10:29.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:29.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802011+0000", 2024-09-13T05:10:29.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:29.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:29.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802013+0000", 2024-09-13T05:10:29.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.131e-06 2024-09-13T05:10:29.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:29.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802019+0000", 2024-09-13T05:10:29.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8799999999999996e-06 2024-09-13T05:10:29.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:29.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802023+0000", 2024-09-13T05:10:29.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6829999999999999e-06 2024-09-13T05:10:29.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:29.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811423+0000", 2024-09-13T05:10:29.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093992139999999995 2024-09-13T05:10:29.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:29.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811475+0000", 2024-09-13T05:10:29.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2000999999999999e-05 2024-09-13T05:10:29.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:29.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811547+0000", 2024-09-13T05:10:29.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2465000000000005e-05 2024-09-13T05:10:29.239 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.239 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:29.239 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.240 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5036 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2703360~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:29.240 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802028+0000", 2024-09-13T05:10:29.240 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.3865083189999998, 2024-09-13T05:10:29.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096685629999999998, 2024-09-13T05:10:29.240 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:29.240 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:29.240 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:29.240 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:29.240 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:29.240 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5036 2024-09-13T05:10:29.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.240 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:29.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:29.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802028+0000", 2024-09-13T05:10:29.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:29.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802028+0000", 2024-09-13T05:10:29.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:29.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802027+0000", 2024-09-13T05:10:29.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:29.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:29.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802030+0000", 2024-09-13T05:10:29.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3329999999999999e-06 2024-09-13T05:10:29.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:29.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802036+0000", 2024-09-13T05:10:29.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5610000000000004e-06 2024-09-13T05:10:29.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:29.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802041+0000", 2024-09-13T05:10:29.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9309999999999999e-06 2024-09-13T05:10:29.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:29.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811568+0000", 2024-09-13T05:10:29.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095272369999999992 2024-09-13T05:10:29.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:29.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811624+0000", 2024-09-13T05:10:29.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5673e-05 2024-09-13T05:10:29.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:29.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811696+0000", 2024-09-13T05:10:29.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2187999999999994e-05 2024-09-13T05:10:29.244 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.244 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:29.244 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.244 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5041 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2310144~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:29.244 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802046+0000", 2024-09-13T05:10:29.244 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.3864901859999996, 2024-09-13T05:10:29.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097718389999999992, 2024-09-13T05:10:29.244 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:29.244 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:29.244 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:29.245 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:29.245 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:29.245 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5041 2024-09-13T05:10:29.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.245 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:29.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:29.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802046+0000", 2024-09-13T05:10:29.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:29.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802046+0000", 2024-09-13T05:10:29.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:29.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802045+0000", 2024-09-13T05:10:29.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:29.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:29.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802047+0000", 2024-09-13T05:10:29.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1799999999999999e-06 2024-09-13T05:10:29.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:29.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802053+0000", 2024-09-13T05:10:29.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.507e-06 2024-09-13T05:10:29.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:29.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802057+0000", 2024-09-13T05:10:29.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3590000000000001e-06 2024-09-13T05:10:29.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:29.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811713+0000", 2024-09-13T05:10:29.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096553400000000001 2024-09-13T05:10:29.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:29.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811763+0000", 2024-09-13T05:10:29.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0050999999999999e-05 2024-09-13T05:10:29.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:29.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811818+0000", 2024-09-13T05:10:29.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4777000000000001e-05 2024-09-13T05:10:29.248 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.248 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:29.248 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.248 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5044 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2899968~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:29.248 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802062+0000", 2024-09-13T05:10:29.249 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.3864742019999996, 2024-09-13T05:10:29.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0099015260000000008, 2024-09-13T05:10:29.249 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:29.249 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:29.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:29.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:29.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:29.249 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5044 2024-09-13T05:10:29.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.249 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:29.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:29.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802062+0000", 2024-09-13T05:10:29.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:29.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802062+0000", 2024-09-13T05:10:29.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:29.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802061+0000", 2024-09-13T05:10:29.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:29.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:29.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802064+0000", 2024-09-13T05:10:29.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0740000000000001e-06 2024-09-13T05:10:29.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:29.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802070+0000", 2024-09-13T05:10:29.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8560000000000003e-06 2024-09-13T05:10:29.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:29.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802075+0000", 2024-09-13T05:10:29.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6360000000000002e-06 2024-09-13T05:10:29.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:29.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811834+0000", 2024-09-13T05:10:29.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097588710000000006 2024-09-13T05:10:29.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:29.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811878+0000", 2024-09-13T05:10:29.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3937999999999998e-05 2024-09-13T05:10:29.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:29.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811963+0000", 2024-09-13T05:10:29.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5505000000000002e-05 2024-09-13T05:10:29.253 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.253 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:29.253 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.253 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5049 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2506752~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:29.253 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802080+0000", 2024-09-13T05:10:29.253 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.3864563180000005, 2024-09-13T05:10:29.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010051279, 2024-09-13T05:10:29.253 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:29.253 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:29.253 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:29.253 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:29.253 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:29.254 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5049 2024-09-13T05:10:29.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.254 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:29.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:29.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802080+0000", 2024-09-13T05:10:29.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:29.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802080+0000", 2024-09-13T05:10:29.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:29.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802079+0000", 2024-09-13T05:10:29.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:29.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:29.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802081+0000", 2024-09-13T05:10:29.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2740000000000002e-06 2024-09-13T05:10:29.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:29.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802088+0000", 2024-09-13T05:10:29.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.567e-06 2024-09-13T05:10:29.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:29.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802093+0000", 2024-09-13T05:10:29.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8609999999999997e-06 2024-09-13T05:10:29.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:29.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811989+0000", 2024-09-13T05:10:29.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0098961840000000006 2024-09-13T05:10:29.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:29.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812069+0000", 2024-09-13T05:10:29.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9534000000000001e-05 2024-09-13T05:10:29.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:29.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812131+0000", 2024-09-13T05:10:29.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2206999999999996e-05 2024-09-13T05:10:29.257 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.257 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:29.257 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.257 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5052 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 3096576~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:29.257 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802097+0000", 2024-09-13T05:10:29.257 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.3864390880000004, 2024-09-13T05:10:29.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010227615000000001, 2024-09-13T05:10:29.258 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:29.258 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:29.258 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:29.258 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:29.258 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:29.258 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5052 2024-09-13T05:10:29.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.258 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:29.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:29.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802097+0000", 2024-09-13T05:10:29.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:29.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802097+0000", 2024-09-13T05:10:29.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:29.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802096+0000", 2024-09-13T05:10:29.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:29.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:29.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802099+0000", 2024-09-13T05:10:29.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3539999999999998e-06 2024-09-13T05:10:29.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:29.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802105+0000", 2024-09-13T05:10:29.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8440000000000003e-06 2024-09-13T05:10:29.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:29.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802109+0000", 2024-09-13T05:10:29.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6800000000000001e-06 2024-09-13T05:10:29.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:29.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812155+0000", 2024-09-13T05:10:29.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010045691000000001 2024-09-13T05:10:29.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:29.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812238+0000", 2024-09-13T05:10:29.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2855000000000005e-05 2024-09-13T05:10:29.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:29.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812324+0000", 2024-09-13T05:10:29.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6621999999999998e-05 2024-09-13T05:10:29.261 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.261 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:29.261 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.262 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:7377 3.1e 3:7d4eb93d:::rbd_header.112d1304fe95:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-13T05:10:29.262 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:24.742504+0000", 2024-09-13T05:10:29.262 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.4460319649999995, 2024-09-13T05:10:29.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01013406, 2024-09-13T05:10:29.262 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:29.262 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:29.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:29.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:29.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:29.262 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7377 2024-09-13T05:10:29.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.262 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:29.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:29.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742504+0000", 2024-09-13T05:10:29.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:29.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742504+0000", 2024-09-13T05:10:29.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:29.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742500+0000", 2024-09-13T05:10:29.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999962 2024-09-13T05:10:29.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:29.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742522+0000", 2024-09-13T05:10:29.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2310000000000002e-05 2024-09-13T05:10:29.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:29.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742572+0000", 2024-09-13T05:10:29.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9872e-05 2024-09-13T05:10:29.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:29.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742597+0000", 2024-09-13T05:10:29.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4363e-05 2024-09-13T05:10:29.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:29.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742678+0000", 2024-09-13T05:10:29.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1370000000000002e-05 2024-09-13T05:10:29.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-13T05:10:29.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742686+0000", 2024-09-13T05:10:29.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5259999999999993e-06 2024-09-13T05:10:29.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:29.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.749024+0000", 2024-09-13T05:10:29.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006337372 2024-09-13T05:10:29.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:29.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.749278+0000", 2024-09-13T05:10:29.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025436399999999998 2024-09-13T05:10:29.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:10:29.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.750557+0000", 2024-09-13T05:10:29.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012787129999999999 2024-09-13T05:10:29.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:29.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.751774+0000", 2024-09-13T05:10:29.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001217054 2024-09-13T05:10:29.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:29.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.752530+0000", 2024-09-13T05:10:29.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075635999999999998 2024-09-13T05:10:29.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:29.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.752592+0000", 2024-09-13T05:10:29.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1486000000000001e-05 2024-09-13T05:10:29.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:29.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.752638+0000", 2024-09-13T05:10:29.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6140000000000002e-05 2024-09-13T05:10:29.268 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.268 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:29.268 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.269 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:7961 3.18 3:184d9aea:::rbd_data.112db57f3a18.000000000000002b:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-13T05:10:29.269 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:10:29.269 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.1115307460000001, 2024-09-13T05:10:29.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.040271084999999998, 2024-09-13T05:10:29.269 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:29.269 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:29.269 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:29.269 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:29.269 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:29.269 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7961 2024-09-13T05:10:29.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.269 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:29.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:29.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:10:29.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:29.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:10:29.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:29.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077003+0000", 2024-09-13T05:10:29.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:29.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:29.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077013+0000", 2024-09-13T05:10:29.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6870000000000006e-06 2024-09-13T05:10:29.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:29.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077029+0000", 2024-09-13T05:10:29.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6314e-05 2024-09-13T05:10:29.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:29.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077038+0000", 2024-09-13T05:10:29.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5019999999999992e-06 2024-09-13T05:10:29.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:29.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077099+0000", 2024-09-13T05:10:29.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1444000000000003e-05 2024-09-13T05:10:29.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:29.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077234+0000", 2024-09-13T05:10:29.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013461300000000001 2024-09-13T05:10:29.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:29.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.085202+0000", 2024-09-13T05:10:29.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079680140000000007 2024-09-13T05:10:29.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:29.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116860+0000", 2024-09-13T05:10:29.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.031658190000000003 2024-09-13T05:10:29.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:29.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116995+0000", 2024-09-13T05:10:29.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000135601 2024-09-13T05:10:29.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:29.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117152+0000", 2024-09-13T05:10:29.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015681700000000001 2024-09-13T05:10:29.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:29.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117276+0000", 2024-09-13T05:10:29.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012392699999999999 2024-09-13T05:10:29.274 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.274 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:29.274 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.274 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4397.0:7961 3.18 e35/22 ondisk, result = 0)", 2024-09-13T05:10:29.275 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.104860+0000", 2024-09-13T05:10:29.275 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.0836757280000002, 2024-09-13T05:10:29.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012435735999999999, 2024-09-13T05:10:29.275 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:29.275 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:29.275 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:29.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:29.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104860+0000", 2024-09-13T05:10:29.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:29.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104860+0000", 2024-09-13T05:10:29.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:29.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104859+0000", 2024-09-13T05:10:29.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:29.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:29.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104866+0000", 2024-09-13T05:10:29.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0840000000000003e-06 2024-09-13T05:10:29.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:29.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104882+0000", 2024-09-13T05:10:29.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5705e-05 2024-09-13T05:10:29.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:29.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104890+0000", 2024-09-13T05:10:29.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5110000000000003e-06 2024-09-13T05:10:29.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:29.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116937+0000", 2024-09-13T05:10:29.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012046563999999999 2024-09-13T05:10:29.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:29.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116975+0000", 2024-09-13T05:10:29.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8243e-05 2024-09-13T05:10:29.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:29.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117296+0000", 2024-09-13T05:10:29.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032082299999999997 2024-09-13T05:10:29.278 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.278 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:29.278 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.279 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:8105 3.b 3:d2ae8f7b:::rbd_data.112db57f3a18.0000000000000028:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-13T05:10:29.279 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:10:29.279 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.8764349400000002, 2024-09-13T05:10:29.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.040653913, 2024-09-13T05:10:29.279 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:29.279 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:29.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:29.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:29.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:29.279 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 8105 2024-09-13T05:10:29.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.279 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:29.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:29.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:10:29.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:29.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:10:29.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:29.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312099+0000", 2024-09-13T05:10:29.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:29.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:29.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312109+0000", 2024-09-13T05:10:29.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0244999999999999e-05 2024-09-13T05:10:29.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:29.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312129+0000", 2024-09-13T05:10:29.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9751000000000001e-05 2024-09-13T05:10:29.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:29.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312141+0000", 2024-09-13T05:10:29.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2201999999999999e-05 2024-09-13T05:10:29.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:29.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312230+0000", 2024-09-13T05:10:29.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9092999999999996e-05 2024-09-13T05:10:29.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:29.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312433+0000", 2024-09-13T05:10:29.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020240500000000001 2024-09-13T05:10:29.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:29.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.320357+0000", 2024-09-13T05:10:29.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079242630000000008 2024-09-13T05:10:29.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:29.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352488+0000", 2024-09-13T05:10:29.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032131588000000003 2024-09-13T05:10:29.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:29.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352533+0000", 2024-09-13T05:10:29.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4601999999999997e-05 2024-09-13T05:10:29.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:29.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352636+0000", 2024-09-13T05:10:29.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103041 2024-09-13T05:10:29.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:29.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352755+0000", 2024-09-13T05:10:29.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118814 2024-09-13T05:10:29.284 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.284 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:29.284 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.284 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4397.0:8105 3.b e35/22 ondisk, result = 0)", 2024-09-13T05:10:29.285 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.342777+0000", 2024-09-13T05:10:29.285 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.8457587320000002, 2024-09-13T05:10:29.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097182480000000005, 2024-09-13T05:10:29.285 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:29.285 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:29.285 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:29.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:29.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342777+0000", 2024-09-13T05:10:29.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:29.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342777+0000", 2024-09-13T05:10:29.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:29.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:29.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342776+0000", 2024-09-13T05:10:29.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:29.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:29.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342786+0000", 2024-09-13T05:10:29.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0298e-05 2024-09-13T05:10:29.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:29.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342809+0000", 2024-09-13T05:10:29.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3346999999999999e-05 2024-09-13T05:10:29.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:29.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342822+0000", 2024-09-13T05:10:29.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2717e-05 2024-09-13T05:10:29.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:29.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352456+0000", 2024-09-13T05:10:29.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096335659999999997 2024-09-13T05:10:29.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:29.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352474+0000", 2024-09-13T05:10:29.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8776000000000001e-05 2024-09-13T05:10:29.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:29.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:29.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:29.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352495+0000", 2024-09-13T05:10:29.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.107e-05 2024-09-13T05:10:29.288 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.288 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:29.288 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.288 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:29.288 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:29.288 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:29.290 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:10:29.291 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-09-13T05:10:28.782809+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":235010536,"num_objects":266,"num_object_clones":34,"num_object_copies":532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":266,"num_whiteouts":72,"num_read":15113,"num_read_kb":49139,"num_write":3058,"num_write_kb":34160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2483,"ondisk_log_size":2483,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":246864,"kb_used_data":28956,"kb_used_omap":10,"kb_used_meta":217717,"kb_avail":660356016,"statfs":{"total":676457349120,"available":676204560384,"internally_reserved":0,"allocated":29650944,"data_stored":27702682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11150,"internal_metadata":222942322},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16761035,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":6187,"num_read_kb":20647,"num_write":1190,"num_write_kb":19354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.044732"},"pg_stats":[{"pgid":"3.1f","version":"35'41","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.785217+0000","last_change":"2024-09-13T05:10:11.672209+0000","last_active":"2024-09-13T05:10:26.785217+0000","last_peered":"2024-09-13T05:10:26.785217+0000","last_clean":"2024-09-13T05:10:26.785217+0000","last_became_active":"2024-09-13T05:10:09.645680+0000","last_became_peered":"2024-09-13T05:10:09.645680+0000","last_unstale":"2024-09-13T05:10:26.785217+0000","last_undegraded":"2024-09-13T05:10:26.785217+0000","last_fullsized":"2024-09-13T05:10:26.785217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:44.411687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011835439999999999,"stat_sum":{"num_bytes":2389388,"num_objects":7,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":2,"num_read":35,"num_read_kb":66,"num_write":35,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"35'46","reported_seq":201,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.840913+0000","last_change":"2024-09-13T05:10:12.076857+0000","last_active":"2024-09-13T05:10:25.840913+0000","last_peered":"2024-09-13T05:10:25.840913+0000","last_clean":"2024-09-13T05:10:25.840913+0000","last_became_active":"2024-09-13T05:10:09.644293+0000","last_became_peered":"2024-09-13T05:10:09.644293+0000","last_unstale":"2024-09-13T05:10:25.840913+0000","last_undegraded":"2024-09-13T05:10:25.840913+0000","last_fullsized":"2024-09-13T05:10:25.840913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:45:32.561793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225439,"stat_sum":{"num_bytes":13402171,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":338,"num_read_kb":546,"num_write":50,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"35'13","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.846528+0000","last_change":"2024-09-13T05:10:11.645342+0000","last_active":"2024-09-13T05:10:25.846528+0000","last_peered":"2024-09-13T05:10:25.846528+0000","last_clean":"2024-09-13T05:10:25.846528+0000","last_became_active":"2024-09-13T05:10:09.645791+0000","last_became_peered":"2024-09-13T05:10:09.645791+0000","last_unstale":"2024-09-13T05:10:25.846528+0000","last_undegraded":"2024-09-13T05:10:25.846528+0000","last_fullsized":"2024-09-13T05:10:25.846528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:49.028553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072691800000000001,"stat_sum":{"num_bytes":983040,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":8,"num_read_kb":0,"num_write":13,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"36'41","reported_seq":140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.764996+0000","last_change":"2024-09-13T05:10:11.647034+0000","last_active":"2024-09-13T05:10:26.764996+0000","last_peered":"2024-09-13T05:10:26.764996+0000","last_clean":"2024-09-13T05:10:26.764996+0000","last_became_active":"2024-09-13T05:10:09.649662+0000","last_became_peered":"2024-09-13T05:10:09.649662+0000","last_unstale":"2024-09-13T05:10:26.764996+0000","last_undegraded":"2024-09-13T05:10:26.764996+0000","last_fullsized":"2024-09-13T05:10:26.764996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:53.144763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078437299999999999,"stat_sum":{"num_bytes":6246221,"num_objects":7,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":100,"num_read_kb":449,"num_write":42,"num_write_kb":4867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"35'40","reported_seq":101,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.389108+0000","last_change":"2024-09-13T05:10:11.671316+0000","last_active":"2024-09-13T05:10:26.389108+0000","last_peered":"2024-09-13T05:10:26.389108+0000","last_clean":"2024-09-13T05:10:26.389108+0000","last_became_active":"2024-09-13T05:10:09.653434+0000","last_became_peered":"2024-09-13T05:10:09.653434+0000","last_unstale":"2024-09-13T05:10:26.389108+0000","last_undegraded":"2024-09-13T05:10:26.389108+0000","last_fullsized":"2024-09-13T05:10:26.389108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:06:22.026411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065808499999999999,"stat_sum":{"num_bytes":4109364,"num_objects":12,"num_object_clones":2,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":5,"num_read":48,"num_read_kb":1105,"num_write":37,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"35'37","reported_seq":378,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.864715+0000","last_change":"2024-09-13T05:10:11.656859+0000","last_active":"2024-09-13T05:10:26.864715+0000","last_peered":"2024-09-13T05:10:26.864715+0000","last_clean":"2024-09-13T05:10:26.864715+0000","last_became_active":"2024-09-13T05:10:09.644554+0000","last_became_peered":"2024-09-13T05:10:09.644554+0000","last_unstale":"2024-09-13T05:10:26.864715+0000","last_undegraded":"2024-09-13T05:10:26.864715+0000","last_fullsized":"2024-09-13T05:10:26.864715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:16:21.249537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027226559999999999,"stat_sum":{"num_bytes":803212,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":323,"num_read_kb":1350,"num_write":37,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"36'358","reported_seq":1522,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.896535+0000","last_change":"2024-09-13T05:10:11.654637+0000","last_active":"2024-09-13T05:10:26.896535+0000","last_peered":"2024-09-13T05:10:26.896535+0000","last_clean":"2024-09-13T05:10:26.896535+0000","last_became_active":"2024-09-13T05:10:09.646488+0000","last_became_peered":"2024-09-13T05:10:09.646488+0000","last_unstale":"2024-09-13T05:10:26.896535+0000","last_undegraded":"2024-09-13T05:10:26.896535+0000","last_fullsized":"2024-09-13T05:10:26.896535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:43:12.751419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067403999999999999,"stat_sum":{"num_bytes":23301151,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":2,"num_read":3174,"num_read_kb":8713,"num_write":554,"num_write_kb":901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"36'68","reported_seq":139,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.767388+0000","last_change":"2024-09-13T05:10:12.075882+0000","last_active":"2024-09-13T05:10:26.767388+0000","last_peered":"2024-09-13T05:10:26.767388+0000","last_clean":"2024-09-13T05:10:26.767388+0000","last_became_active":"2024-09-13T05:10:09.645568+0000","last_became_peered":"2024-09-13T05:10:09.645568+0000","last_unstale":"2024-09-13T05:10:26.767388+0000","last_undegraded":"2024-09-13T05:10:26.767388+0000","last_fullsized":"2024-09-13T05:10:26.767388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:54:35.467574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087399999999998,"stat_sum":{"num_bytes":3397208,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":3,"num_read":147,"num_read_kb":2148,"num_write":83,"num_write_kb":1934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"33'63","reported_seq":355,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.786942+0000","last_change":"2024-09-13T05:10:11.672161+0000","last_active":"2024-09-13T05:10:25.786942+0000","last_peered":"2024-09-13T05:10:25.786942+0000","last_clean":"2024-09-13T05:10:25.786942+0000","last_became_active":"2024-09-13T05:10:09.646308+0000","last_became_peered":"2024-09-13T05:10:09.646308+0000","last_unstale":"2024-09-13T05:10:25.786942+0000","last_undegraded":"2024-09-13T05:10:25.786942+0000","last_fullsized":"2024-09-13T05:10:25.786942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:12:07.516442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096598599999999995,"stat_sum":{"num_bytes":3675463,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":4,"num_read":807,"num_read_kb":699,"num_write":51,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"35'74","reported_seq":928,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.380730+0000","last_change":"2024-09-13T05:10:11.645211+0000","last_active":"2024-09-13T05:10:26.380730+0000","last_peered":"2024-09-13T05:10:26.380730+0000","last_clean":"2024-09-13T05:10:26.380730+0000","last_became_active":"2024-09-13T05:10:09.647763+0000","last_became_peered":"2024-09-13T05:10:09.647763+0000","last_unstale":"2024-09-13T05:10:26.380730+0000","last_undegraded":"2024-09-13T05:10:26.380730+0000","last_fullsized":"2024-09-13T05:10:26.380730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:43.426871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072236499999999999,"stat_sum":{"num_bytes":23502965,"num_objects":9,"num_object_clones":2,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":3,"num_read":876,"num_read_kb":7242,"num_write":66,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"35'36","reported_seq":94,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.629219+0000","last_change":"2024-09-13T05:10:11.681217+0000","last_active":"2024-09-13T05:10:26.629219+0000","last_peered":"2024-09-13T05:10:26.629219+0000","last_clean":"2024-09-13T05:10:26.629219+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:10:26.629219+0000","last_undegraded":"2024-09-13T05:10:26.629219+0000","last_fullsized":"2024-09-13T05:10:26.629219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:40.457636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095533399999999996,"stat_sum":{"num_bytes":986741,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":62,"num_read_kb":1000,"num_write":36,"num_write_kb":703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"33'57","reported_seq":102,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.762597+0000","last_change":"2024-09-13T05:10:11.681365+0000","last_active":"2024-09-13T05:10:25.762597+0000","last_peered":"2024-09-13T05:10:25.762597+0000","last_clean":"2024-09-13T05:10:25.762597+0000","last_became_active":"2024-09-13T05:10:09.645823+0000","last_became_peered":"2024-09-13T05:10:09.645823+0000","last_unstale":"2024-09-13T05:10:25.762597+0000","last_undegraded":"2024-09-13T05:10:25.762597+0000","last_fullsized":"2024-09-13T05:10:25.762597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:24.367358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011047369999999999,"stat_sum":{"num_bytes":4086622,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":2,"num_read":36,"num_read_kb":186,"num_write":48,"num_write_kb":1102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.759500+0000","last_change":"2024-09-13T05:10:01.383891+0000","last_active":"2024-09-13T05:10:25.759500+0000","last_peered":"2024-09-13T05:10:25.759500+0000","last_clean":"2024-09-13T05:10:25.759500+0000","last_became_active":"2024-09-13T05:09:59.374793+0000","last_became_peered":"2024-09-13T05:09:59.374793+0000","last_unstale":"2024-09-13T05:10:25.759500+0000","last_undegraded":"2024-09-13T05:10:25.759500+0000","last_fullsized":"2024-09-13T05:10:25.759500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:02.499446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065068999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"35'27","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.634341+0000","last_change":"2024-09-13T05:10:11.671855+0000","last_active":"2024-09-13T05:10:26.634341+0000","last_peered":"2024-09-13T05:10:26.634341+0000","last_clean":"2024-09-13T05:10:26.634341+0000","last_became_active":"2024-09-13T05:10:09.644753+0000","last_became_peered":"2024-09-13T05:10:09.644753+0000","last_unstale":"2024-09-13T05:10:26.634341+0000","last_undegraded":"2024-09-13T05:10:26.634341+0000","last_fullsized":"2024-09-13T05:10:26.634341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:37:35.314729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099899699999999995,"stat_sum":{"num_bytes":5834593,"num_objects":9,"num_object_clones":1,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":3,"num_read":15,"num_read_kb":74,"num_write":25,"num_write_kb":3781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.761664+0000","last_change":"2024-09-13T05:10:01.395323+0000","last_active":"2024-09-13T05:10:25.761664+0000","last_peered":"2024-09-13T05:10:25.761664+0000","last_clean":"2024-09-13T05:10:25.761664+0000","last_became_active":"2024-09-13T05:09:59.367228+0000","last_became_peered":"2024-09-13T05:09:59.367228+0000","last_unstale":"2024-09-13T05:10:25.761664+0000","last_undegraded":"2024-09-13T05:10:25.761664+0000","last_fullsized":"2024-09-13T05:10:25.761664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:11.958489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086759100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"33'82","reported_seq":891,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.388887+0000","last_change":"2024-09-13T05:10:12.077111+0000","last_active":"2024-09-13T05:10:26.388887+0000","last_peered":"2024-09-13T05:10:26.388887+0000","last_clean":"2024-09-13T05:10:26.388887+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:10:26.388887+0000","last_undegraded":"2024-09-13T05:10:26.388887+0000","last_fullsized":"2024-09-13T05:10:26.388887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:37.976147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001460444,"stat_sum":{"num_bytes":30035318,"num_objects":13,"num_object_clones":2,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":5,"num_read":919,"num_read_kb":7066,"num_write":91,"num_write_kb":1003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.762838+0000","last_change":"2024-09-13T05:10:01.574786+0000","last_active":"2024-09-13T05:10:25.762838+0000","last_peered":"2024-09-13T05:10:25.762838+0000","last_clean":"2024-09-13T05:10:25.762838+0000","last_became_active":"2024-09-13T05:09:59.371791+0000","last_became_peered":"2024-09-13T05:09:59.371791+0000","last_unstale":"2024-09-13T05:10:25.762838+0000","last_undegraded":"2024-09-13T05:10:25.762838+0000","last_fullsized":"2024-09-13T05:10:25.762838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:48:51.447413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"35'40","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.629041+0000","last_change":"2024-09-13T05:10:11.654918+0000","last_active":"2024-09-13T05:10:26.629041+0000","last_peered":"2024-09-13T05:10:26.629041+0000","last_clean":"2024-09-13T05:10:26.629041+0000","last_became_active":"2024-09-13T05:10:09.641916+0000","last_became_peered":"2024-09-13T05:10:09.641916+0000","last_unstale":"2024-09-13T05:10:26.629041+0000","last_undegraded":"2024-09-13T05:10:26.629041+0000","last_fullsized":"2024-09-13T05:10:26.629041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:46.685948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076234800000000004,"stat_sum":{"num_bytes":976821,"num_objects":9,"num_object_clones":1,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":4,"num_read":15,"num_read_kb":0,"num_write":34,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.761552+0000","last_change":"2024-09-13T05:10:01.395167+0000","last_active":"2024-09-13T05:10:25.761552+0000","last_peered":"2024-09-13T05:10:25.761552+0000","last_clean":"2024-09-13T05:10:25.761552+0000","last_became_active":"2024-09-13T05:09:59.366839+0000","last_became_peered":"2024-09-13T05:09:59.366839+0000","last_unstale":"2024-09-13T05:10:25.761552+0000","last_undegraded":"2024-09-13T05:10:25.761552+0000","last_fullsized":"2024-09-13T05:10:25.761552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:14.896875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070030299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"36'92","reported_seq":398,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.889213+0000","last_change":"2024-09-13T05:10:11.645960+0000","last_active":"2024-09-13T05:10:26.889213+0000","last_peered":"2024-09-13T05:10:26.889213+0000","last_clean":"2024-09-13T05:10:26.889213+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:10:26.889213+0000","last_undegraded":"2024-09-13T05:10:26.889213+0000","last_fullsized":"2024-09-13T05:10:26.889213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:40.372741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001054028,"stat_sum":{"num_bytes":1373178,"num_objects":10,"num_object_clones":1,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":2,"num_read":752,"num_read_kb":1610,"num_write":92,"num_write_kb":714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"33'42","reported_seq":812,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.389249+0000","last_change":"2024-09-13T05:10:11.671929+0000","last_active":"2024-09-13T05:10:26.389249+0000","last_peered":"2024-09-13T05:10:26.389249+0000","last_clean":"2024-09-13T05:10:26.389249+0000","last_became_active":"2024-09-13T05:10:09.637394+0000","last_became_peered":"2024-09-13T05:10:09.637394+0000","last_unstale":"2024-09-13T05:10:26.389249+0000","last_undegraded":"2024-09-13T05:10:26.389249+0000","last_fullsized":"2024-09-13T05:10:26.389249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:33:48.414221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099335200000000008,"stat_sum":{"num_bytes":40343646,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":2,"num_read":773,"num_read_kb":5743,"num_write":42,"num_write_kb":1311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.804589+0000","last_change":"2024-09-13T05:10:01.392650+0000","last_active":"2024-09-13T05:10:25.804589+0000","last_peered":"2024-09-13T05:10:25.804589+0000","last_clean":"2024-09-13T05:10:25.804589+0000","last_became_active":"2024-09-13T05:09:59.370866+0000","last_became_peered":"2024-09-13T05:09:59.370866+0000","last_unstale":"2024-09-13T05:10:25.804589+0000","last_undegraded":"2024-09-13T05:10:25.804589+0000","last_fullsized":"2024-09-13T05:10:25.804589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:24:45.980712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"35'39","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.629769+0000","last_change":"2024-09-13T05:10:11.654113+0000","last_active":"2024-09-13T05:10:26.629769+0000","last_peered":"2024-09-13T05:10:26.629769+0000","last_clean":"2024-09-13T05:10:26.629769+0000","last_became_active":"2024-09-13T05:10:09.644624+0000","last_became_peered":"2024-09-13T05:10:09.644624+0000","last_unstale":"2024-09-13T05:10:26.629769+0000","last_undegraded":"2024-09-13T05:10:26.629769+0000","last_fullsized":"2024-09-13T05:10:26.629769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:01:36.283307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045163499999999998,"stat_sum":{"num_bytes":550625,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":22,"num_read_kb":3,"num_write":36,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.765103+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:10:25.765103+0000","last_peered":"2024-09-13T05:10:25.765103+0000","last_clean":"2024-09-13T05:10:25.765103+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:10:25.765103+0000","last_undegraded":"2024-09-13T05:10:25.765103+0000","last_fullsized":"2024-09-13T05:10:25.765103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"35'45","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.784382+0000","last_change":"2024-09-13T05:10:11.671057+0000","last_active":"2024-09-13T05:10:26.784382+0000","last_peered":"2024-09-13T05:10:26.784382+0000","last_clean":"2024-09-13T05:10:26.784382+0000","last_became_active":"2024-09-13T05:10:09.647726+0000","last_became_peered":"2024-09-13T05:10:09.647726+0000","last_unstale":"2024-09-13T05:10:26.784382+0000","last_undegraded":"2024-09-13T05:10:26.784382+0000","last_fullsized":"2024-09-13T05:10:26.784382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:38.473605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048152600000000002,"stat_sum":{"num_bytes":893823,"num_objects":8,"num_object_clones":1,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":2,"num_read":13,"num_read_kb":26,"num_write":40,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.762395+0000","last_change":"2024-09-13T05:10:01.574798+0000","last_active":"2024-09-13T05:10:25.762395+0000","last_peered":"2024-09-13T05:10:25.762395+0000","last_clean":"2024-09-13T05:10:25.762395+0000","last_became_active":"2024-09-13T05:09:59.374482+0000","last_became_peered":"2024-09-13T05:09:59.374482+0000","last_unstale":"2024-09-13T05:10:25.762395+0000","last_undegraded":"2024-09-13T05:10:25.762395+0000","last_fullsized":"2024-09-13T05:10:25.762395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:41:39.894258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"33'19","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.758910+0000","last_change":"2024-09-13T05:10:12.075510+0000","last_active":"2024-09-13T05:10:25.758910+0000","last_peered":"2024-09-13T05:10:25.758910+0000","last_clean":"2024-09-13T05:10:25.758910+0000","last_became_active":"2024-09-13T05:10:09.646353+0000","last_became_peered":"2024-09-13T05:10:09.646353+0000","last_unstale":"2024-09-13T05:10:25.758910+0000","last_undegraded":"2024-09-13T05:10:25.758910+0000","last_fullsized":"2024-09-13T05:10:25.758910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:54:58.706032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059320200000000003,"stat_sum":{"num_bytes":103751,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":2,"num_read":20,"num_read_kb":3,"num_write":13,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.804565+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:10:25.804565+0000","last_peered":"2024-09-13T05:10:25.804565+0000","last_clean":"2024-09-13T05:10:25.804565+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:10:25.804565+0000","last_undegraded":"2024-09-13T05:10:25.804565+0000","last_fullsized":"2024-09-13T05:10:25.804565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.762451+0000","last_change":"2024-09-13T05:09:53.327385+0000","last_active":"2024-09-13T05:10:25.762451+0000","last_peered":"2024-09-13T05:10:25.762451+0000","last_clean":"2024-09-13T05:10:25.762451+0000","last_became_active":"2024-09-13T05:09:53.326660+0000","last_became_peered":"2024-09-13T05:09:53.326660+0000","last_unstale":"2024-09-13T05:10:25.762451+0000","last_undegraded":"2024-09-13T05:10:25.762451+0000","last_fullsized":"2024-09-13T05:10:25.762451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:25:16.790290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"35'36","reported_seq":93,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.629276+0000","last_change":"2024-09-13T05:10:12.076107+0000","last_active":"2024-09-13T05:10:26.629276+0000","last_peered":"2024-09-13T05:10:26.629276+0000","last_clean":"2024-09-13T05:10:26.629276+0000","last_became_active":"2024-09-13T05:10:09.648535+0000","last_became_peered":"2024-09-13T05:10:09.648535+0000","last_unstale":"2024-09-13T05:10:26.629276+0000","last_undegraded":"2024-09-13T05:10:26.629276+0000","last_fullsized":"2024-09-13T05:10:26.629276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:10:38.739142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000500144,"stat_sum":{"num_bytes":1548379,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":3,"num_read":53,"num_read_kb":312,"num_write":29,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"35'51","reported_seq":255,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.634818+0000","last_change":"2024-09-13T05:10:11.648218+0000","last_active":"2024-09-13T05:10:26.634818+0000","last_peered":"2024-09-13T05:10:26.634818+0000","last_clean":"2024-09-13T05:10:26.634818+0000","last_became_active":"2024-09-13T05:10:09.645408+0000","last_became_peered":"2024-09-13T05:10:09.645408+0000","last_unstale":"2024-09-13T05:10:26.634818+0000","last_undegraded":"2024-09-13T05:10:26.634818+0000","last_fullsized":"2024-09-13T05:10:26.634818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:59.846981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097828900000000002,"stat_sum":{"num_bytes":7765924,"num_objects":8,"num_object_clones":1,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":2,"num_read":552,"num_read_kb":540,"num_write":48,"num_write_kb":2360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"35'151","reported_seq":184,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.677132+0000","last_change":"2024-09-13T05:10:11.647406+0000","last_active":"2024-09-13T05:10:26.677132+0000","last_peered":"2024-09-13T05:10:26.677132+0000","last_clean":"2024-09-13T05:10:26.677132+0000","last_became_active":"2024-09-13T05:10:09.648280+0000","last_became_peered":"2024-09-13T05:10:09.648280+0000","last_unstale":"2024-09-13T05:10:26.677132+0000","last_undegraded":"2024-09-13T05:10:26.677132+0000","last_fullsized":"2024-09-13T05:10:26.677132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:38:05.938002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013204619999999999,"stat_sum":{"num_bytes":3425951,"num_objects":9,"num_object_clones":1,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":3,"num_read":557,"num_read_kb":449,"num_write":223,"num_write_kb":3244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"36'41","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.836955+0000","last_change":"2024-09-13T05:10:12.075733+0000","last_active":"2024-09-13T05:10:26.836955+0000","last_peered":"2024-09-13T05:10:26.836955+0000","last_clean":"2024-09-13T05:10:26.836955+0000","last_became_active":"2024-09-13T05:10:09.645472+0000","last_became_peered":"2024-09-13T05:10:09.645472+0000","last_unstale":"2024-09-13T05:10:26.836955+0000","last_undegraded":"2024-09-13T05:10:26.836955+0000","last_fullsized":"2024-09-13T05:10:26.836955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:56.317729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055343700000000005,"stat_sum":{"num_bytes":205278,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":39,"num_read_kb":14,"num_write":35,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"33'14","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.388193+0000","last_change":"2024-09-13T05:10:11.647302+0000","last_active":"2024-09-13T05:10:26.388193+0000","last_peered":"2024-09-13T05:10:26.388193+0000","last_clean":"2024-09-13T05:10:26.388193+0000","last_became_active":"2024-09-13T05:10:09.647037+0000","last_became_peered":"2024-09-13T05:10:09.647037+0000","last_unstale":"2024-09-13T05:10:26.388193+0000","last_undegraded":"2024-09-13T05:10:26.388193+0000","last_fullsized":"2024-09-13T05:10:26.388193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:54:17.061326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069994199999999995,"stat_sum":{"num_bytes":7509366,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":43,"num_read_kb":1231,"num_write":17,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"32'120","reported_seq":176,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.762864+0000","last_change":"2024-09-13T05:10:11.682463+0000","last_active":"2024-09-13T05:10:25.762864+0000","last_peered":"2024-09-13T05:10:25.762864+0000","last_clean":"2024-09-13T05:10:25.762864+0000","last_became_active":"2024-09-13T05:10:09.647600+0000","last_became_peered":"2024-09-13T05:10:09.647600+0000","last_unstale":"2024-09-13T05:10:25.762864+0000","last_undegraded":"2024-09-13T05:10:25.762864+0000","last_fullsized":"2024-09-13T05:10:25.762864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:20:16.632365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019283150000000001,"stat_sum":{"num_bytes":3870086,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":2,"num_read":430,"num_read_kb":524,"num_write":156,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"36'121","reported_seq":587,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.899551+0000","last_change":"2024-09-13T05:10:11.682343+0000","last_active":"2024-09-13T05:10:26.899551+0000","last_peered":"2024-09-13T05:10:26.899551+0000","last_clean":"2024-09-13T05:10:26.899551+0000","last_became_active":"2024-09-13T05:10:09.648765+0000","last_became_peered":"2024-09-13T05:10:09.648765+0000","last_unstale":"2024-09-13T05:10:26.899551+0000","last_undegraded":"2024-09-13T05:10:26.899551+0000","last_fullsized":"2024-09-13T05:10:26.899551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:40:39.836627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018982339999999999,"stat_sum":{"num_bytes":2249210,"num_objects":8,"num_object_clones":1,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":2,"num_read":1556,"num_read_kb":1340,"num_write":145,"num_write_kb":760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"35'324","reported_seq":355,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.580900+0000","last_change":"2024-09-13T05:10:11.682853+0000","last_active":"2024-09-13T05:10:26.580900+0000","last_peered":"2024-09-13T05:10:26.580900+0000","last_clean":"2024-09-13T05:10:26.580900+0000","last_became_active":"2024-09-13T05:10:09.645362+0000","last_became_peered":"2024-09-13T05:10:09.645362+0000","last_unstale":"2024-09-13T05:10:26.580900+0000","last_undegraded":"2024-09-13T05:10:26.580900+0000","last_fullsized":"2024-09-13T05:10:26.580900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:52.729940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001164273,"stat_sum":{"num_bytes":937930,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1733,"num_read_kb":1418,"num_write":591,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"35'43","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.579957+0000","last_change":"2024-09-13T05:10:11.647061+0000","last_active":"2024-09-13T05:10:26.579957+0000","last_peered":"2024-09-13T05:10:26.579957+0000","last_clean":"2024-09-13T05:10:26.579957+0000","last_became_active":"2024-09-13T05:10:09.637573+0000","last_became_peered":"2024-09-13T05:10:09.637573+0000","last_unstale":"2024-09-13T05:10:26.579957+0000","last_undegraded":"2024-09-13T05:10:26.579957+0000","last_fullsized":"2024-09-13T05:10:26.579957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:47:47.078242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009951719999999999,"stat_sum":{"num_bytes":9105619,"num_objects":11,"num_object_clones":1,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":3,"num_read":33,"num_read_kb":1053,"num_write":39,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"35'46","reported_seq":122,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.581547+0000","last_change":"2024-09-13T05:10:11.680757+0000","last_active":"2024-09-13T05:10:26.581547+0000","last_peered":"2024-09-13T05:10:26.581547+0000","last_clean":"2024-09-13T05:10:26.581547+0000","last_became_active":"2024-09-13T05:10:09.653444+0000","last_became_peered":"2024-09-13T05:10:09.653444+0000","last_unstale":"2024-09-13T05:10:26.581547+0000","last_undegraded":"2024-09-13T05:10:26.581547+0000","last_fullsized":"2024-09-13T05:10:26.581547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:17:06.303008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000625977,"stat_sum":{"num_bytes":4987313,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":4,"num_read":68,"num_read_kb":1518,"num_write":42,"num_write_kb":892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"36'116","reported_seq":652,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.785280+0000","last_change":"2024-09-13T05:10:11.671062+0000","last_active":"2024-09-13T05:10:26.785280+0000","last_peered":"2024-09-13T05:10:26.785280+0000","last_clean":"2024-09-13T05:10:26.785280+0000","last_became_active":"2024-09-13T05:10:09.653452+0000","last_became_peered":"2024-09-13T05:10:09.653452+0000","last_unstale":"2024-09-13T05:10:26.785280+0000","last_undegraded":"2024-09-13T05:10:26.785280+0000","last_fullsized":"2024-09-13T05:10:26.785280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:26.805137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048307200000000003,"stat_sum":{"num_bytes":21466993,"num_objects":11,"num_object_clones":2,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":2,"num_read":1385,"num_read_kb":2507,"num_write":114,"num_write_kb":951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"36'40","reported_seq":122,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.899414+0000","last_change":"2024-09-13T05:10:11.680877+0000","last_active":"2024-09-13T05:10:26.899414+0000","last_peered":"2024-09-13T05:10:26.899414+0000","last_clean":"2024-09-13T05:10:26.899414+0000","last_became_active":"2024-09-13T05:10:09.649053+0000","last_became_peered":"2024-09-13T05:10:09.649053+0000","last_unstale":"2024-09-13T05:10:26.899414+0000","last_undegraded":"2024-09-13T05:10:26.899414+0000","last_fullsized":"2024-09-13T05:10:26.899414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:14.770260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062821800000000005,"stat_sum":{"num_bytes":4352799,"num_objects":10,"num_object_clones":1,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":65,"num_read_kb":104,"num_write":33,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":234420149,"num_objects":262,"num_object_clones":34,"num_object_copies":524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":262,"num_whiteouts":72,"num_read":14997,"num_read_kb":49039,"num_write":2897,"num_write_kb":31742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":30359552,"data_stored":30044606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2363,"ondisk_log_size":2363,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37936,"kb_used_data":6752,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94333904,"statfs":{"total":96636764160,"available":96597917696,"internally_reserved":0,"allocated":6914048,"data_stored":6670076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33268,"kb_used_data":2148,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338572,"statfs":{"total":96636764160,"available":96602697728,"internally_reserved":0,"allocated":2199552,"data_stored":1905323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33240,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2174976,"data_stored":1933304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]}]},{"osd":4,"up_from":0,"seq":55834574860,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35452,"kb_used_data":4336,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94336388,"statfs":{"total":96636764160,"available":96600461312,"internally_reserved":0,"allocated":4440064,"data_stored":4158966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34300,"kb_used_data":3184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94337540,"statfs":{"total":96636764160,"available":96601640960,"internally_reserved":0,"allocated":3260416,"data_stored":2988317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37212,"kb_used_data":6100,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94334628,"statfs":{"total":96636764160,"available":96598659072,"internally_reserved":0,"allocated":6246400,"data_stored":5970265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35456,"kb_used_data":4312,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94336384,"statfs":{"total":96636764160,"available":96600457216,"internally_reserved":0,"allocated":4415488,"data_stored":4076431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5885952,"data_stored":5778130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5922816,"data_stored":5874214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2899968,"data_stored":2856707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3940352,"data_stored":3911963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1774252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3895296,"data_stored":3834801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6033408,"data_stored":6014539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:10:29.293 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:10:29.294 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:29.286+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:29.391 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:29.386+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:29.407 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:29.408 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:29.408 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:29.408 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:29.417 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:10:29.492 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:29.487+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:29.525 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:29.525 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:29.526 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:29.526 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:29.526 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:29.535 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:10:29.593 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:29.590+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:29.605 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:10:29.608 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:10:29.620 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-09-13T05:10:28.782809+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":235010536,"num_objects":266,"num_object_clones":34,"num_object_copies":532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":266,"num_whiteouts":72,"num_read":15113,"num_read_kb":49139,"num_write":3058,"num_write_kb":34160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2483,"ondisk_log_size":2483,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":246864,"kb_used_data":28956,"kb_used_omap":10,"kb_used_meta":217717,"kb_avail":660356016,"statfs":{"total":676457349120,"available":676204560384,"internally_reserved":0,"allocated":29650944,"data_stored":27702682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11150,"internal_metadata":222942322},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16761035,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":6187,"num_read_kb":20647,"num_write":1190,"num_write_kb":19354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.044732"},"pg_stats":[{"pgid":"3.1f","version":"35'41","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.785217+0000","last_change":"2024-09-13T05:10:11.672209+0000","last_active":"2024-09-13T05:10:26.785217+0000","last_peered":"2024-09-13T05:10:26.785217+0000","last_clean":"2024-09-13T05:10:26.785217+0000","last_became_active":"2024-09-13T05:10:09.645680+0000","last_became_peered":"2024-09-13T05:10:09.645680+0000","last_unstale":"2024-09-13T05:10:26.785217+0000","last_undegraded":"2024-09-13T05:10:26.785217+0000","last_fullsized":"2024-09-13T05:10:26.785217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:44.411687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011835439999999999,"stat_sum":{"num_bytes":2389388,"num_objects":7,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":2,"num_read":35,"num_read_kb":66,"num_write":35,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"35'46","reported_seq":201,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.840913+0000","last_change":"2024-09-13T05:10:12.076857+0000","last_active":"2024-09-13T05:10:25.840913+0000","last_peered":"2024-09-13T05:10:25.840913+0000","last_clean":"2024-09-13T05:10:25.840913+0000","last_became_active":"2024-09-13T05:10:09.644293+0000","last_became_peered":"2024-09-13T05:10:09.644293+0000","last_unstale":"2024-09-13T05:10:25.840913+0000","last_undegraded":"2024-09-13T05:10:25.840913+0000","last_fullsized":"2024-09-13T05:10:25.840913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:45:32.561793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225439,"stat_sum":{"num_bytes":13402171,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":338,"num_read_kb":546,"num_write":50,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"35'13","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.846528+0000","last_change":"2024-09-13T05:10:11.645342+0000","last_active":"2024-09-13T05:10:25.846528+0000","last_peered":"2024-09-13T05:10:25.846528+0000","last_clean":"2024-09-13T05:10:25.846528+0000","last_became_active":"2024-09-13T05:10:09.645791+0000","last_became_peered":"2024-09-13T05:10:09.645791+0000","last_unstale":"2024-09-13T05:10:25.846528+0000","last_undegraded":"2024-09-13T05:10:25.846528+0000","last_fullsized":"2024-09-13T05:10:25.846528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:49.028553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072691800000000001,"stat_sum":{"num_bytes":983040,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":8,"num_read_kb":0,"num_write":13,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"36'41","reported_seq":140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.764996+0000","last_change":"2024-09-13T05:10:11.647034+0000","last_active":"2024-09-13T05:10:26.764996+0000","last_peered":"2024-09-13T05:10:26.764996+0000","last_clean":"2024-09-13T05:10:26.764996+0000","last_became_active":"2024-09-13T05:10:09.649662+0000","last_became_peered":"2024-09-13T05:10:09.649662+0000","last_unstale":"2024-09-13T05:10:26.764996+0000","last_undegraded":"2024-09-13T05:10:26.764996+0000","last_fullsized":"2024-09-13T05:10:26.764996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:53.144763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078437299999999999,"stat_sum":{"num_bytes":6246221,"num_objects":7,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":100,"num_read_kb":449,"num_write":42,"num_write_kb":4867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"35'40","reported_seq":101,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.389108+0000","last_change":"2024-09-13T05:10:11.671316+0000","last_active":"2024-09-13T05:10:26.389108+0000","last_peered":"2024-09-13T05:10:26.389108+0000","last_clean":"2024-09-13T05:10:26.389108+0000","last_became_active":"2024-09-13T05:10:09.653434+0000","last_became_peered":"2024-09-13T05:10:09.653434+0000","last_unstale":"2024-09-13T05:10:26.389108+0000","last_undegraded":"2024-09-13T05:10:26.389108+0000","last_fullsized":"2024-09-13T05:10:26.389108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:06:22.026411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065808499999999999,"stat_sum":{"num_bytes":4109364,"num_objects":12,"num_object_clones":2,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":5,"num_read":48,"num_read_kb":1105,"num_write":37,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"35'37","reported_seq":378,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.864715+0000","last_change":"2024-09-13T05:10:11.656859+0000","last_active":"2024-09-13T05:10:26.864715+0000","last_peered":"2024-09-13T05:10:26.864715+0000","last_clean":"2024-09-13T05:10:26.864715+0000","last_became_active":"2024-09-13T05:10:09.644554+0000","last_became_peered":"2024-09-13T05:10:09.644554+0000","last_unstale":"2024-09-13T05:10:26.864715+0000","last_undegraded":"2024-09-13T05:10:26.864715+0000","last_fullsized":"2024-09-13T05:10:26.864715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:16:21.249537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027226559999999999,"stat_sum":{"num_bytes":803212,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":323,"num_read_kb":1350,"num_write":37,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"36'358","reported_seq":1522,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.896535+0000","last_change":"2024-09-13T05:10:11.654637+0000","last_active":"2024-09-13T05:10:26.896535+0000","last_peered":"2024-09-13T05:10:26.896535+0000","last_clean":"2024-09-13T05:10:26.896535+0000","last_became_active":"2024-09-13T05:10:09.646488+0000","last_became_peered":"2024-09-13T05:10:09.646488+0000","last_unstale":"2024-09-13T05:10:26.896535+0000","last_undegraded":"2024-09-13T05:10:26.896535+0000","last_fullsized":"2024-09-13T05:10:26.896535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:43:12.751419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067403999999999999,"stat_sum":{"num_bytes":23301151,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":2,"num_read":3174,"num_read_kb":8713,"num_write":554,"num_write_kb":901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"36'68","reported_seq":139,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.767388+0000","last_change":"2024-09-13T05:10:12.075882+0000","last_active":"2024-09-13T05:10:26.767388+0000","last_peered":"2024-09-13T05:10:26.767388+0000","last_clean":"2024-09-13T05:10:26.767388+0000","last_became_active":"2024-09-13T05:10:09.645568+0000","last_became_peered":"2024-09-13T05:10:09.645568+0000","last_unstale":"2024-09-13T05:10:26.767388+0000","last_undegraded":"2024-09-13T05:10:26.767388+0000","last_fullsized":"2024-09-13T05:10:26.767388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:54:35.467574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087399999999998,"stat_sum":{"num_bytes":3397208,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":3,"num_read":147,"num_read_kb":2148,"num_write":83,"num_write_kb":1934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"33'63","reported_seq":355,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.786942+0000","last_change":"2024-09-13T05:10:11.672161+0000","last_active":"2024-09-13T05:10:25.786942+0000","last_peered":"2024-09-13T05:10:25.786942+0000","last_clean":"2024-09-13T05:10:25.786942+0000","last_became_active":"2024-09-13T05:10:09.646308+0000","last_became_peered":"2024-09-13T05:10:09.646308+0000","last_unstale":"2024-09-13T05:10:25.786942+0000","last_undegraded":"2024-09-13T05:10:25.786942+0000","last_fullsized":"2024-09-13T05:10:25.786942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:12:07.516442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096598599999999995,"stat_sum":{"num_bytes":3675463,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":4,"num_read":807,"num_read_kb":699,"num_write":51,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"35'74","reported_seq":928,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.380730+0000","last_change":"2024-09-13T05:10:11.645211+0000","last_active":"2024-09-13T05:10:26.380730+0000","last_peered":"2024-09-13T05:10:26.380730+0000","last_clean":"2024-09-13T05:10:26.380730+0000","last_became_active":"2024-09-13T05:10:09.647763+0000","last_became_peered":"2024-09-13T05:10:09.647763+0000","last_unstale":"2024-09-13T05:10:26.380730+0000","last_undegraded":"2024-09-13T05:10:26.380730+0000","last_fullsized":"2024-09-13T05:10:26.380730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:43.426871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072236499999999999,"stat_sum":{"num_bytes":23502965,"num_objects":9,"num_object_clones":2,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":3,"num_read":876,"num_read_kb":7242,"num_write":66,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"35'36","reported_seq":94,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.629219+0000","last_change":"2024-09-13T05:10:11.681217+0000","last_active":"2024-09-13T05:10:26.629219+0000","last_peered":"2024-09-13T05:10:26.629219+0000","last_clean":"2024-09-13T05:10:26.629219+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:10:26.629219+0000","last_undegraded":"2024-09-13T05:10:26.629219+0000","last_fullsized":"2024-09-13T05:10:26.629219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:40.457636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095533399999999996,"stat_sum":{"num_bytes":986741,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":62,"num_read_kb":1000,"num_write":36,"num_write_kb":703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"33'57","reported_seq":102,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.762597+0000","last_change":"2024-09-13T05:10:11.681365+0000","last_active":"2024-09-13T05:10:25.762597+0000","last_peered":"2024-09-13T05:10:25.762597+0000","last_clean":"2024-09-13T05:10:25.762597+0000","last_became_active":"2024-09-13T05:10:09.645823+0000","last_became_peered":"2024-09-13T05:10:09.645823+0000","last_unstale":"2024-09-13T05:10:25.762597+0000","last_undegraded":"2024-09-13T05:10:25.762597+0000","last_fullsized":"2024-09-13T05:10:25.762597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:24.367358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011047369999999999,"stat_sum":{"num_bytes":4086622,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":2,"num_read":36,"num_read_kb":186,"num_write":48,"num_write_kb":1102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.759500+0000","last_change":"2024-09-13T05:10:01.383891+0000","last_active":"2024-09-13T05:10:25.759500+0000","last_peered":"2024-09-13T05:10:25.759500+0000","last_clean":"2024-09-13T05:10:25.759500+0000","last_became_active":"2024-09-13T05:09:59.374793+0000","last_became_peered":"2024-09-13T05:09:59.374793+0000","last_unstale":"2024-09-13T05:10:25.759500+0000","last_undegraded":"2024-09-13T05:10:25.759500+0000","last_fullsized":"2024-09-13T05:10:25.759500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:02.499446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065068999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"35'27","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.634341+0000","last_change":"2024-09-13T05:10:11.671855+0000","last_active":"2024-09-13T05:10:26.634341+0000","last_peered":"2024-09-13T05:10:26.634341+0000","last_clean":"2024-09-13T05:10:26.634341+0000","last_became_active":"2024-09-13T05:10:09.644753+0000","last_became_peered":"2024-09-13T05:10:09.644753+0000","last_unstale":"2024-09-13T05:10:26.634341+0000","last_undegraded":"2024-09-13T05:10:26.634341+0000","last_fullsized":"2024-09-13T05:10:26.634341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:37:35.314729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099899699999999995,"stat_sum":{"num_bytes":5834593,"num_objects":9,"num_object_clones":1,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":3,"num_read":15,"num_read_kb":74,"num_write":25,"num_write_kb":3781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.761664+0000","last_change":"2024-09-13T05:10:01.395323+0000","last_active":"2024-09-13T05:10:25.761664+0000","last_peered":"2024-09-13T05:10:25.761664+0000","last_clean":"2024-09-13T05:10:25.761664+0000","last_became_active":"2024-09-13T05:09:59.367228+0000","last_became_peered":"2024-09-13T05:09:59.367228+0000","last_unstale":"2024-09-13T05:10:25.761664+0000","last_undegraded":"2024-09-13T05:10:25.761664+0000","last_fullsized":"2024-09-13T05:10:25.761664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:11.958489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086759100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"33'82","reported_seq":891,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.388887+0000","last_change":"2024-09-13T05:10:12.077111+0000","last_active":"2024-09-13T05:10:26.388887+0000","last_peered":"2024-09-13T05:10:26.388887+0000","last_clean":"2024-09-13T05:10:26.388887+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:10:26.388887+0000","last_undegraded":"2024-09-13T05:10:26.388887+0000","last_fullsized":"2024-09-13T05:10:26.388887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:37.976147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001460444,"stat_sum":{"num_bytes":30035318,"num_objects":13,"num_object_clones":2,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":5,"num_read":919,"num_read_kb":7066,"num_write":91,"num_write_kb":1003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.762838+0000","last_change":"2024-09-13T05:10:01.574786+0000","last_active":"2024-09-13T05:10:25.762838+0000","last_peered":"2024-09-13T05:10:25.762838+0000","last_clean":"2024-09-13T05:10:25.762838+0000","last_became_active":"2024-09-13T05:09:59.371791+0000","last_became_peered":"2024-09-13T05:09:59.371791+0000","last_unstale":"2024-09-13T05:10:25.762838+0000","last_undegraded":"2024-09-13T05:10:25.762838+0000","last_fullsized":"2024-09-13T05:10:25.762838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:48:51.447413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"35'40","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.629041+0000","last_change":"2024-09-13T05:10:11.654918+0000","last_active":"2024-09-13T05:10:26.629041+0000","last_peered":"2024-09-13T05:10:26.629041+0000","last_clean":"2024-09-13T05:10:26.629041+0000","last_became_active":"2024-09-13T05:10:09.641916+0000","last_became_peered":"2024-09-13T05:10:09.641916+0000","last_unstale":"2024-09-13T05:10:26.629041+0000","last_undegraded":"2024-09-13T05:10:26.629041+0000","last_fullsized":"2024-09-13T05:10:26.629041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:46.685948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076234800000000004,"stat_sum":{"num_bytes":976821,"num_objects":9,"num_object_clones":1,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":4,"num_read":15,"num_read_kb":0,"num_write":34,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.761552+0000","last_change":"2024-09-13T05:10:01.395167+0000","last_active":"2024-09-13T05:10:25.761552+0000","last_peered":"2024-09-13T05:10:25.761552+0000","last_clean":"2024-09-13T05:10:25.761552+0000","last_became_active":"2024-09-13T05:09:59.366839+0000","last_became_peered":"2024-09-13T05:09:59.366839+0000","last_unstale":"2024-09-13T05:10:25.761552+0000","last_undegraded":"2024-09-13T05:10:25.761552+0000","last_fullsized":"2024-09-13T05:10:25.761552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:14.896875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070030299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"36'92","reported_seq":398,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.889213+0000","last_change":"2024-09-13T05:10:11.645960+0000","last_active":"2024-09-13T05:10:26.889213+0000","last_peered":"2024-09-13T05:10:26.889213+0000","last_clean":"2024-09-13T05:10:26.889213+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:10:26.889213+0000","last_undegraded":"2024-09-13T05:10:26.889213+0000","last_fullsized":"2024-09-13T05:10:26.889213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:40.372741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001054028,"stat_sum":{"num_bytes":1373178,"num_objects":10,"num_object_clones":1,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":2,"num_read":752,"num_read_kb":1610,"num_write":92,"num_write_kb":714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"33'42","reported_seq":812,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.389249+0000","last_change":"2024-09-13T05:10:11.671929+0000","last_active":"2024-09-13T05:10:26.389249+0000","last_peered":"2024-09-13T05:10:26.389249+0000","last_clean":"2024-09-13T05:10:26.389249+0000","last_became_active":"2024-09-13T05:10:09.637394+0000","last_became_peered":"2024-09-13T05:10:09.637394+0000","last_unstale":"2024-09-13T05:10:26.389249+0000","last_undegraded":"2024-09-13T05:10:26.389249+0000","last_fullsized":"2024-09-13T05:10:26.389249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:33:48.414221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099335200000000008,"stat_sum":{"num_bytes":40343646,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":2,"num_read":773,"num_read_kb":5743,"num_write":42,"num_write_kb":1311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.804589+0000","last_change":"2024-09-13T05:10:01.392650+0000","last_active":"2024-09-13T05:10:25.804589+0000","last_peered":"2024-09-13T05:10:25.804589+0000","last_clean":"2024-09-13T05:10:25.804589+0000","last_became_active":"2024-09-13T05:09:59.370866+0000","last_became_peered":"2024-09-13T05:09:59.370866+0000","last_unstale":"2024-09-13T05:10:25.804589+0000","last_undegraded":"2024-09-13T05:10:25.804589+0000","last_fullsized":"2024-09-13T05:10:25.804589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:24:45.980712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"35'39","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.629769+0000","last_change":"2024-09-13T05:10:11.654113+0000","last_active":"2024-09-13T05:10:26.629769+0000","last_peered":"2024-09-13T05:10:26.629769+0000","last_clean":"2024-09-13T05:10:26.629769+0000","last_became_active":"2024-09-13T05:10:09.644624+0000","last_became_peered":"2024-09-13T05:10:09.644624+0000","last_unstale":"2024-09-13T05:10:26.629769+0000","last_undegraded":"2024-09-13T05:10:26.629769+0000","last_fullsized":"2024-09-13T05:10:26.629769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:01:36.283307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045163499999999998,"stat_sum":{"num_bytes":550625,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":22,"num_read_kb":3,"num_write":36,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.765103+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:10:25.765103+0000","last_peered":"2024-09-13T05:10:25.765103+0000","last_clean":"2024-09-13T05:10:25.765103+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:10:25.765103+0000","last_undegraded":"2024-09-13T05:10:25.765103+0000","last_fullsized":"2024-09-13T05:10:25.765103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"35'45","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.784382+0000","last_change":"2024-09-13T05:10:11.671057+0000","last_active":"2024-09-13T05:10:26.784382+0000","last_peered":"2024-09-13T05:10:26.784382+0000","last_clean":"2024-09-13T05:10:26.784382+0000","last_became_active":"2024-09-13T05:10:09.647726+0000","last_became_peered":"2024-09-13T05:10:09.647726+0000","last_unstale":"2024-09-13T05:10:26.784382+0000","last_undegraded":"2024-09-13T05:10:26.784382+0000","last_fullsized":"2024-09-13T05:10:26.784382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:38.473605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048152600000000002,"stat_sum":{"num_bytes":893823,"num_objects":8,"num_object_clones":1,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":2,"num_read":13,"num_read_kb":26,"num_write":40,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.762395+0000","last_change":"2024-09-13T05:10:01.574798+0000","last_active":"2024-09-13T05:10:25.762395+0000","last_peered":"2024-09-13T05:10:25.762395+0000","last_clean":"2024-09-13T05:10:25.762395+0000","last_became_active":"2024-09-13T05:09:59.374482+0000","last_became_peered":"2024-09-13T05:09:59.374482+0000","last_unstale":"2024-09-13T05:10:25.762395+0000","last_undegraded":"2024-09-13T05:10:25.762395+0000","last_fullsized":"2024-09-13T05:10:25.762395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:41:39.894258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"33'19","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.758910+0000","last_change":"2024-09-13T05:10:12.075510+0000","last_active":"2024-09-13T05:10:25.758910+0000","last_peered":"2024-09-13T05:10:25.758910+0000","last_clean":"2024-09-13T05:10:25.758910+0000","last_became_active":"2024-09-13T05:10:09.646353+0000","last_became_peered":"2024-09-13T05:10:09.646353+0000","last_unstale":"2024-09-13T05:10:25.758910+0000","last_undegraded":"2024-09-13T05:10:25.758910+0000","last_fullsized":"2024-09-13T05:10:25.758910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:54:58.706032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059320200000000003,"stat_sum":{"num_bytes":103751,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":2,"num_read":20,"num_read_kb":3,"num_write":13,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.804565+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:10:25.804565+0000","last_peered":"2024-09-13T05:10:25.804565+0000","last_clean":"2024-09-13T05:10:25.804565+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:10:25.804565+0000","last_undegraded":"2024-09-13T05:10:25.804565+0000","last_fullsized":"2024-09-13T05:10:25.804565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.762451+0000","last_change":"2024-09-13T05:09:53.327385+0000","last_active":"2024-09-13T05:10:25.762451+0000","last_peered":"2024-09-13T05:10:25.762451+0000","last_clean":"2024-09-13T05:10:25.762451+0000","last_became_active":"2024-09-13T05:09:53.326660+0000","last_became_peered":"2024-09-13T05:09:53.326660+0000","last_unstale":"2024-09-13T05:10:25.762451+0000","last_undegraded":"2024-09-13T05:10:25.762451+0000","last_fullsized":"2024-09-13T05:10:25.762451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:25:16.790290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"35'36","reported_seq":93,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.629276+0000","last_change":"2024-09-13T05:10:12.076107+0000","last_active":"2024-09-13T05:10:26.629276+0000","last_peered":"2024-09-13T05:10:26.629276+0000","last_clean":"2024-09-13T05:10:26.629276+0000","last_became_active":"2024-09-13T05:10:09.648535+0000","last_became_peered":"2024-09-13T05:10:09.648535+0000","last_unstale":"2024-09-13T05:10:26.629276+0000","last_undegraded":"2024-09-13T05:10:26.629276+0000","last_fullsized":"2024-09-13T05:10:26.629276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:10:38.739142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000500144,"stat_sum":{"num_bytes":1548379,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":3,"num_read":53,"num_read_kb":312,"num_write":29,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"35'51","reported_seq":255,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.634818+0000","last_change":"2024-09-13T05:10:11.648218+0000","last_active":"2024-09-13T05:10:26.634818+0000","last_peered":"2024-09-13T05:10:26.634818+0000","last_clean":"2024-09-13T05:10:26.634818+0000","last_became_active":"2024-09-13T05:10:09.645408+0000","last_became_peered":"2024-09-13T05:10:09.645408+0000","last_unstale":"2024-09-13T05:10:26.634818+0000","last_undegraded":"2024-09-13T05:10:26.634818+0000","last_fullsized":"2024-09-13T05:10:26.634818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:59.846981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097828900000000002,"stat_sum":{"num_bytes":7765924,"num_objects":8,"num_object_clones":1,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":2,"num_read":552,"num_read_kb":540,"num_write":48,"num_write_kb":2360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"35'151","reported_seq":184,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.677132+0000","last_change":"2024-09-13T05:10:11.647406+0000","last_active":"2024-09-13T05:10:26.677132+0000","last_peered":"2024-09-13T05:10:26.677132+0000","last_clean":"2024-09-13T05:10:26.677132+0000","last_became_active":"2024-09-13T05:10:09.648280+0000","last_became_peered":"2024-09-13T05:10:09.648280+0000","last_unstale":"2024-09-13T05:10:26.677132+0000","last_undegraded":"2024-09-13T05:10:26.677132+0000","last_fullsized":"2024-09-13T05:10:26.677132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:38:05.938002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013204619999999999,"stat_sum":{"num_bytes":3425951,"num_objects":9,"num_object_clones":1,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":3,"num_read":557,"num_read_kb":449,"num_write":223,"num_write_kb":3244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"36'41","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.836955+0000","last_change":"2024-09-13T05:10:12.075733+0000","last_active":"2024-09-13T05:10:26.836955+0000","last_peered":"2024-09-13T05:10:26.836955+0000","last_clean":"2024-09-13T05:10:26.836955+0000","last_became_active":"2024-09-13T05:10:09.645472+0000","last_became_peered":"2024-09-13T05:10:09.645472+0000","last_unstale":"2024-09-13T05:10:26.836955+0000","last_undegraded":"2024-09-13T05:10:26.836955+0000","last_fullsized":"2024-09-13T05:10:26.836955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:56.317729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055343700000000005,"stat_sum":{"num_bytes":205278,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":39,"num_read_kb":14,"num_write":35,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"33'14","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.388193+0000","last_change":"2024-09-13T05:10:11.647302+0000","last_active":"2024-09-13T05:10:26.388193+0000","last_peered":"2024-09-13T05:10:26.388193+0000","last_clean":"2024-09-13T05:10:26.388193+0000","last_became_active":"2024-09-13T05:10:09.647037+0000","last_became_peered":"2024-09-13T05:10:09.647037+0000","last_unstale":"2024-09-13T05:10:26.388193+0000","last_undegraded":"2024-09-13T05:10:26.388193+0000","last_fullsized":"2024-09-13T05:10:26.388193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:54:17.061326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069994199999999995,"stat_sum":{"num_bytes":7509366,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":43,"num_read_kb":1231,"num_write":17,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"32'120","reported_seq":176,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:25.762864+0000","last_change":"2024-09-13T05:10:11.682463+0000","last_active":"2024-09-13T05:10:25.762864+0000","last_peered":"2024-09-13T05:10:25.762864+0000","last_clean":"2024-09-13T05:10:25.762864+0000","last_became_active":"2024-09-13T05:10:09.647600+0000","last_became_peered":"2024-09-13T05:10:09.647600+0000","last_unstale":"2024-09-13T05:10:25.762864+0000","last_undegraded":"2024-09-13T05:10:25.762864+0000","last_fullsized":"2024-09-13T05:10:25.762864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:20:16.632365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019283150000000001,"stat_sum":{"num_bytes":3870086,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":2,"num_read":430,"num_read_kb":524,"num_write":156,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"36'121","reported_seq":587,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.899551+0000","last_change":"2024-09-13T05:10:11.682343+0000","last_active":"2024-09-13T05:10:26.899551+0000","last_peered":"2024-09-13T05:10:26.899551+0000","last_clean":"2024-09-13T05:10:26.899551+0000","last_became_active":"2024-09-13T05:10:09.648765+0000","last_became_peered":"2024-09-13T05:10:09.648765+0000","last_unstale":"2024-09-13T05:10:26.899551+0000","last_undegraded":"2024-09-13T05:10:26.899551+0000","last_fullsized":"2024-09-13T05:10:26.899551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:40:39.836627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018982339999999999,"stat_sum":{"num_bytes":2249210,"num_objects":8,"num_object_clones":1,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":2,"num_read":1556,"num_read_kb":1340,"num_write":145,"num_write_kb":760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"35'324","reported_seq":355,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.580900+0000","last_change":"2024-09-13T05:10:11.682853+0000","last_active":"2024-09-13T05:10:26.580900+0000","last_peered":"2024-09-13T05:10:26.580900+0000","last_clean":"2024-09-13T05:10:26.580900+0000","last_became_active":"2024-09-13T05:10:09.645362+0000","last_became_peered":"2024-09-13T05:10:09.645362+0000","last_unstale":"2024-09-13T05:10:26.580900+0000","last_undegraded":"2024-09-13T05:10:26.580900+0000","last_fullsized":"2024-09-13T05:10:26.580900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:52.729940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001164273,"stat_sum":{"num_bytes":937930,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1733,"num_read_kb":1418,"num_write":591,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"35'43","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.579957+0000","last_change":"2024-09-13T05:10:11.647061+0000","last_active":"2024-09-13T05:10:26.579957+0000","last_peered":"2024-09-13T05:10:26.579957+0000","last_clean":"2024-09-13T05:10:26.579957+0000","last_became_active":"2024-09-13T05:10:09.637573+0000","last_became_peered":"2024-09-13T05:10:09.637573+0000","last_unstale":"2024-09-13T05:10:26.579957+0000","last_undegraded":"2024-09-13T05:10:26.579957+0000","last_fullsized":"2024-09-13T05:10:26.579957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:47:47.078242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009951719999999999,"stat_sum":{"num_bytes":9105619,"num_objects":11,"num_object_clones":1,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":3,"num_read":33,"num_read_kb":1053,"num_write":39,"num_write_kb":792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"35'46","reported_seq":122,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.581547+0000","last_change":"2024-09-13T05:10:11.680757+0000","last_active":"2024-09-13T05:10:26.581547+0000","last_peered":"2024-09-13T05:10:26.581547+0000","last_clean":"2024-09-13T05:10:26.581547+0000","last_became_active":"2024-09-13T05:10:09.653444+0000","last_became_peered":"2024-09-13T05:10:09.653444+0000","last_unstale":"2024-09-13T05:10:26.581547+0000","last_undegraded":"2024-09-13T05:10:26.581547+0000","last_fullsized":"2024-09-13T05:10:26.581547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:17:06.303008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000625977,"stat_sum":{"num_bytes":4987313,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":4,"num_read":68,"num_read_kb":1518,"num_write":42,"num_write_kb":892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"36'116","reported_seq":652,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.785280+0000","last_change":"2024-09-13T05:10:11.671062+0000","last_active":"2024-09-13T05:10:26.785280+0000","last_peered":"2024-09-13T05:10:26.785280+0000","last_clean":"2024-09-13T05:10:26.785280+0000","last_became_active":"2024-09-13T05:10:09.653452+0000","last_became_peered":"2024-09-13T05:10:09.653452+0000","last_unstale":"2024-09-13T05:10:26.785280+0000","last_undegraded":"2024-09-13T05:10:26.785280+0000","last_fullsized":"2024-09-13T05:10:26.785280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:26.805137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048307200000000003,"stat_sum":{"num_bytes":21466993,"num_objects":11,"num_object_clones":2,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":2,"num_read":1385,"num_read_kb":2507,"num_write":114,"num_write_kb":951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"36'40","reported_seq":122,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T05:10:26.899414+0000","last_change":"2024-09-13T05:10:11.680877+0000","last_active":"2024-09-13T05:10:26.899414+0000","last_peered":"2024-09-13T05:10:26.899414+0000","last_clean":"2024-09-13T05:10:26.899414+0000","last_became_active":"2024-09-13T05:10:09.649053+0000","last_became_peered":"2024-09-13T05:10:09.649053+0000","last_unstale":"2024-09-13T05:10:26.899414+0000","last_undegraded":"2024-09-13T05:10:26.899414+0000","last_fullsized":"2024-09-13T05:10:26.899414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:14.770260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062821800000000005,"stat_sum":{"num_bytes":4352799,"num_objects":10,"num_object_clones":1,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":65,"num_read_kb":104,"num_write":33,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":234420149,"num_objects":262,"num_object_clones":34,"num_object_copies":524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":262,"num_whiteouts":72,"num_read":14997,"num_read_kb":49039,"num_write":2897,"num_write_kb":31742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":30359552,"data_stored":30044606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2363,"ondisk_log_size":2363,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37936,"kb_used_data":6752,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94333904,"statfs":{"total":96636764160,"available":96597917696,"internally_reserved":0,"allocated":6914048,"data_stored":6670076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33268,"kb_used_data":2148,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338572,"statfs":{"total":96636764160,"available":96602697728,"internally_reserved":0,"allocated":2199552,"data_stored":1905323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33240,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2174976,"data_stored":1933304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]}]},{"osd":4,"up_from":0,"seq":55834574860,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35452,"kb_used_data":4336,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94336388,"statfs":{"total":96636764160,"available":96600461312,"internally_reserved":0,"allocated":4440064,"data_stored":4158966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34300,"kb_used_data":3184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94337540,"statfs":{"total":96636764160,"available":96601640960,"internally_reserved":0,"allocated":3260416,"data_stored":2988317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37212,"kb_used_data":6100,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94334628,"statfs":{"total":96636764160,"available":96598659072,"internally_reserved":0,"allocated":6246400,"data_stored":5970265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35456,"kb_used_data":4312,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94336384,"statfs":{"total":96636764160,"available":96600457216,"internally_reserved":0,"allocated":4415488,"data_stored":4076431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5885952,"data_stored":5778130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5922816,"data_stored":5874214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2899968,"data_stored":2856707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3940352,"data_stored":3911963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1774252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3895296,"data_stored":3834801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6033408,"data_stored":6014539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:10:29.623 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-13T05:10:29.623 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:10:29.623 INFO:tasks.thrashosds.thrasher:Removing osd 1, in_osds are: [0, 1, 2, 3, 5, 6, 7] 2024-09-13T05:10:29.623 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 1 2024-09-13T05:10:29.641 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:29.641 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:29.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:29.641 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [] 2024-09-13T05:10:29.641 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:29.650 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:10:29.694 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:29.690+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:29.755 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:29.755 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:29.755 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:29.755 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:29.764 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:10:29.794 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:29.790+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:29.805 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is unset 2024-09-13T05:10:29.876 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:29.876 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:29.876 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:29.876 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:29.877 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:29.886 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:10:29.895 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:29.891+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:29.983 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone7 from 0xe0b20d9 (overlap 0x131b6c2) to 0xf49234 2024-09-13T05:10:29.995 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:29.990+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:29.996 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:29.997 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:29.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:29.997 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:10:29.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:29.997 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4200 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 8339456~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:29.997 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436145+0000", 2024-09-13T05:10:29.997 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.5569703189999995, 2024-09-13T05:10:29.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.018953309000000002, 2024-09-13T05:10:29.997 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:29.997 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:29.997 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:29.997 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:29.997 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:29.998 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4200 2024-09-13T05:10:29.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:29.998 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:29.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:29.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:29.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436145+0000", 2024-09-13T05:10:29.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:29.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:29.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:29.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:29.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436145+0000", 2024-09-13T05:10:29.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:29.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:29.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:29.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:29.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436145+0000", 2024-09-13T05:10:29.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:29.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:29.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:29.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:29.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436146+0000", 2024-09-13T05:10:29.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:10:29.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:29.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:29.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:29.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436149+0000", 2024-09-13T05:10:30.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1300000000000001e-06 2024-09-13T05:10:30.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.000 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436152+0000", 2024-09-13T05:10:30.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:10:30.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.000 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.454932+0000", 2024-09-13T05:10:30.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.018780429000000001 2024-09-13T05:10:30.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.001 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455039+0000", 2024-09-13T05:10:30.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000106925 2024-09-13T05:10:30.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.001 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.001 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455098+0000", 2024-09-13T05:10:30.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8983000000000001e-05 2024-09-13T05:10:30.001 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.001 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.002 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.002 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4206 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 6979584~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.002 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436154+0000", 2024-09-13T05:10:30.003 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.5569609940000007, 2024-09-13T05:10:30.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019108791, 2024-09-13T05:10:30.003 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.003 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:30.003 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.003 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.003 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.003 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4206 2024-09-13T05:10:30.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.003 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.004 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.004 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436154+0000", 2024-09-13T05:10:30.004 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.004 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.004 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436154+0000", 2024-09-13T05:10:30.004 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.004 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.004 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436154+0000", 2024-09-13T05:10:30.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:30.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.005 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436159+0000", 2024-09-13T05:10:30.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.536e-06 2024-09-13T05:10:30.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.005 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436163+0000", 2024-09-13T05:10:30.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5030000000000002e-06 2024-09-13T05:10:30.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436166+0000", 2024-09-13T05:10:30.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3239999999999999e-06 2024-09-13T05:10:30.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455124+0000", 2024-09-13T05:10:30.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.018957489000000001 2024-09-13T05:10:30.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455186+0000", 2024-09-13T05:10:30.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2497999999999997e-05 2024-09-13T05:10:30.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455263+0000", 2024-09-13T05:10:30.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6675999999999996e-05 2024-09-13T05:10:30.007 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.007 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.007 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.007 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4209 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 6389760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.007 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436169+0000", 2024-09-13T05:10:30.007 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.5569460189999997, 2024-09-13T05:10:30.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019313255000000001, 2024-09-13T05:10:30.007 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.007 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:30.008 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.008 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.008 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.008 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4209 2024-09-13T05:10:30.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.008 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.008 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.008 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436169+0000", 2024-09-13T05:10:30.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.008 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.009 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436169+0000", 2024-09-13T05:10:30.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.009 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.009 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436169+0000", 2024-09-13T05:10:30.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:30.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.009 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.009 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436170+0000", 2024-09-13T05:10:30.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.739e-06 2024-09-13T05:10:30.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.010 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436174+0000", 2024-09-13T05:10:30.010 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1200000000000004e-06 2024-09-13T05:10:30.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.010 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436178+0000", 2024-09-13T05:10:30.010 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2499999999999998e-06 2024-09-13T05:10:30.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.010 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455311+0000", 2024-09-13T05:10:30.010 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019133407000000002 2024-09-13T05:10:30.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.011 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.011 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455366+0000", 2024-09-13T05:10:30.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4982999999999999e-05 2024-09-13T05:10:30.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.011 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.011 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455482+0000", 2024-09-13T05:10:30.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000116333 2024-09-13T05:10:30.011 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.011 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.011 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.012 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4214 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 6782976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.012 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436194+0000", 2024-09-13T05:10:30.012 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.5569213360000003, 2024-09-13T05:10:30.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019632325999999999, 2024-09-13T05:10:30.012 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.012 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:30.012 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.012 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.012 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.012 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4214 2024-09-13T05:10:30.012 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.012 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436194+0000", 2024-09-13T05:10:30.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436194+0000", 2024-09-13T05:10:30.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436193+0000", 2024-09-13T05:10:30.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:30.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.014 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.014 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436195+0000", 2024-09-13T05:10:30.014 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9400000000000001e-06 2024-09-13T05:10:30.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.014 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.014 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436199+0000", 2024-09-13T05:10:30.014 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.014e-06 2024-09-13T05:10:30.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436203+0000", 2024-09-13T05:10:30.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3069999999999998e-06 2024-09-13T05:10:30.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455557+0000", 2024-09-13T05:10:30.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019354018000000001 2024-09-13T05:10:30.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455694+0000", 2024-09-13T05:10:30.016 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000137188 2024-09-13T05:10:30.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.016 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.016 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455826+0000", 2024-09-13T05:10:30.016 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013213 2024-09-13T05:10:30.016 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.016 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.016 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.016 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4216 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 7372800~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.016 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436212+0000", 2024-09-13T05:10:30.017 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.5569027159999997, 2024-09-13T05:10:30.017 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019812019, 2024-09-13T05:10:30.017 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.017 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:30.017 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.017 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.017 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.017 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4216 2024-09-13T05:10:30.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.017 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436212+0000", 2024-09-13T05:10:30.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436212+0000", 2024-09-13T05:10:30.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436212+0000", 2024-09-13T05:10:30.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:30.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.020 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.020 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436220+0000", 2024-09-13T05:10:30.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.622e-06 2024-09-13T05:10:30.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.021 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.021 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436225+0000", 2024-09-13T05:10:30.021 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7989999999999999e-06 2024-09-13T05:10:30.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.021 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436229+0000", 2024-09-13T05:10:30.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5439999999999999e-06 2024-09-13T05:10:30.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455883+0000", 2024-09-13T05:10:30.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019654482000000001 2024-09-13T05:10:30.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455954+0000", 2024-09-13T05:10:30.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0439999999999996e-05 2024-09-13T05:10:30.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.024 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456024+0000", 2024-09-13T05:10:30.024 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0635000000000004e-05 2024-09-13T05:10:30.024 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.024 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.024 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.025 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4218 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 7962624~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.025 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436232+0000", 2024-09-13T05:10:30.025 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.5568831070000009, 2024-09-13T05:10:30.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019955836000000001, 2024-09-13T05:10:30.025 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.026 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:30.026 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.026 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.026 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.026 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4218 2024-09-13T05:10:30.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.027 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.027 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.027 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436232+0000", 2024-09-13T05:10:30.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.027 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.027 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436232+0000", 2024-09-13T05:10:30.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.028 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436232+0000", 2024-09-13T05:10:30.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:30.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.028 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436233+0000", 2024-09-13T05:10:30.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.564e-06 2024-09-13T05:10:30.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436237+0000", 2024-09-13T05:10:30.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2909999999999999e-06 2024-09-13T05:10:30.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436240+0000", 2024-09-13T05:10:30.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8639999999999998e-06 2024-09-13T05:10:30.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456053+0000", 2024-09-13T05:10:30.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019812729000000001 2024-09-13T05:10:30.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.030 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456111+0000", 2024-09-13T05:10:30.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8108e-05 2024-09-13T05:10:30.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.030 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456188+0000", 2024-09-13T05:10:30.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6550000000000004e-05 2024-09-13T05:10:30.030 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.031 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.031 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.031 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4221 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 8159232~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.031 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436245+0000", 2024-09-13T05:10:30.031 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.5568699329999998, 2024-09-13T05:10:30.031 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020134613999999999, 2024-09-13T05:10:30.031 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.031 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:30.031 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.031 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.031 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.031 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4221 2024-09-13T05:10:30.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.032 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436245+0000", 2024-09-13T05:10:30.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436245+0000", 2024-09-13T05:10:30.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436245+0000", 2024-09-13T05:10:30.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:30.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436246+0000", 2024-09-13T05:10:30.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.519e-06 2024-09-13T05:10:30.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436252+0000", 2024-09-13T05:10:30.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2220000000000001e-06 2024-09-13T05:10:30.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436256+0000", 2024-09-13T05:10:30.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0690000000000003e-06 2024-09-13T05:10:30.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456249+0000", 2024-09-13T05:10:30.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019992942 2024-09-13T05:10:30.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.035 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456303+0000", 2024-09-13T05:10:30.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4366000000000001e-05 2024-09-13T05:10:30.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.035 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456380+0000", 2024-09-13T05:10:30.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6761000000000006e-05 2024-09-13T05:10:30.035 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.035 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.035 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.036 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.036 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.036 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4223 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 7766016~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.036 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436336+0000", 2024-09-13T05:10:30.036 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.55677953, 2024-09-13T05:10:30.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020232878999999999, 2024-09-13T05:10:30.036 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.036 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:30.036 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.036 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.036 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.036 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4223 2024-09-13T05:10:30.036 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.037 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.037 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.037 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436336+0000", 2024-09-13T05:10:30.037 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.037 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.037 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436336+0000", 2024-09-13T05:10:30.037 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.037 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436335+0000", 2024-09-13T05:10:30.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:30.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436338+0000", 2024-09-13T05:10:30.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0970000000000002e-06 2024-09-13T05:10:30.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436345+0000", 2024-09-13T05:10:30.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6120000000000004e-06 2024-09-13T05:10:30.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436349+0000", 2024-09-13T05:10:30.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0879999999999997e-06 2024-09-13T05:10:30.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456416+0000", 2024-09-13T05:10:30.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020067806000000001 2024-09-13T05:10:30.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456487+0000", 2024-09-13T05:10:30.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0766000000000007e-05 2024-09-13T05:10:30.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456568+0000", 2024-09-13T05:10:30.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1186999999999994e-05 2024-09-13T05:10:30.040 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.040 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.040 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.040 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4225 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 8355840~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.041 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436354+0000", 2024-09-13T05:10:30.041 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.5567610520000006, 2024-09-13T05:10:30.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020354098000000001, 2024-09-13T05:10:30.041 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.041 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:30.041 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.041 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.041 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.041 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4225 2024-09-13T05:10:30.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.041 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.041 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.041 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436354+0000", 2024-09-13T05:10:30.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436354+0000", 2024-09-13T05:10:30.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436354+0000", 2024-09-13T05:10:30.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:30.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436356+0000", 2024-09-13T05:10:30.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8610000000000001e-06 2024-09-13T05:10:30.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436359+0000", 2024-09-13T05:10:30.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3739999999999998e-06 2024-09-13T05:10:30.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436362+0000", 2024-09-13T05:10:30.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2839999999999998e-06 2024-09-13T05:10:30.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456594+0000", 2024-09-13T05:10:30.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020231438000000001 2024-09-13T05:10:30.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456644+0000", 2024-09-13T05:10:30.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0424999999999999e-05 2024-09-13T05:10:30.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456708+0000", 2024-09-13T05:10:30.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3987999999999998e-05 2024-09-13T05:10:30.045 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.045 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.045 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.045 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4229 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 6406144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.045 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436702+0000", 2024-09-13T05:10:30.045 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.5564128060000009, 2024-09-13T05:10:30.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020157143999999998, 2024-09-13T05:10:30.045 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.045 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:30.045 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.045 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.045 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.046 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4229 2024-09-13T05:10:30.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.046 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.046 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.046 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436702+0000", 2024-09-13T05:10:30.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.046 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.046 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436702+0000", 2024-09-13T05:10:30.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436701+0000", 2024-09-13T05:10:30.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:30.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436705+0000", 2024-09-13T05:10:30.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7979999999999999e-06 2024-09-13T05:10:30.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436712+0000", 2024-09-13T05:10:30.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.516e-06 2024-09-13T05:10:30.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436716+0000", 2024-09-13T05:10:30.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0169999999999998e-06 2024-09-13T05:10:30.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456741+0000", 2024-09-13T05:10:30.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020025672000000001 2024-09-13T05:10:30.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.049 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456790+0000", 2024-09-13T05:10:30.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8894000000000003e-05 2024-09-13T05:10:30.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.049 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456859+0000", 2024-09-13T05:10:30.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9221999999999996e-05 2024-09-13T05:10:30.049 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.049 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.049 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.049 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4232 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 6995968~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.050 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436911+0000", 2024-09-13T05:10:30.050 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.5562039080000005, 2024-09-13T05:10:30.050 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020106577, 2024-09-13T05:10:30.050 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.050 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:30.050 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.050 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.050 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.050 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4232 2024-09-13T05:10:30.050 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.051 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436911+0000", 2024-09-13T05:10:30.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436911+0000", 2024-09-13T05:10:30.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436910+0000", 2024-09-13T05:10:30.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:30.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436914+0000", 2024-09-13T05:10:30.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6260000000000001e-06 2024-09-13T05:10:30.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436920+0000", 2024-09-13T05:10:30.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2419999999999997e-06 2024-09-13T05:10:30.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.053 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.053 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436924+0000", 2024-09-13T05:10:30.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9899999999999999e-06 2024-09-13T05:10:30.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.053 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.053 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456888+0000", 2024-09-13T05:10:30.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019964161000000001 2024-09-13T05:10:30.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.053 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.053 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456938+0000", 2024-09-13T05:10:30.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9505999999999997e-05 2024-09-13T05:10:30.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457018+0000", 2024-09-13T05:10:30.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9908999999999997e-05 2024-09-13T05:10:30.054 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.054 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.054 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.054 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4235 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 7192576~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.054 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436962+0000", 2024-09-13T05:10:30.055 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.5561528130000006, 2024-09-13T05:10:30.055 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020327004999999999, 2024-09-13T05:10:30.055 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.055 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:30.055 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.055 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.055 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.055 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4235 2024-09-13T05:10:30.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.055 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.055 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.055 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436962+0000", 2024-09-13T05:10:30.055 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.056 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.056 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.056 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436962+0000", 2024-09-13T05:10:30.056 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.056 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.056 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.056 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436962+0000", 2024-09-13T05:10:30.056 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:30.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.056 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.056 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436978+0000", 2024-09-13T05:10:30.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6699999999999999e-05 2024-09-13T05:10:30.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436984+0000", 2024-09-13T05:10:30.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0809999999999999e-06 2024-09-13T05:10:30.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436999+0000", 2024-09-13T05:10:30.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4790000000000001e-05 2024-09-13T05:10:30.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457058+0000", 2024-09-13T05:10:30.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020058498000000001 2024-09-13T05:10:30.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457168+0000", 2024-09-13T05:10:30.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011000799999999999 2024-09-13T05:10:30.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.059 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.059 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457289+0000", 2024-09-13T05:10:30.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000121641 2024-09-13T05:10:30.059 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.059 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.059 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.059 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.059 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4240 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 6799360~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.059 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.437091+0000", 2024-09-13T05:10:30.059 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.5560245199999994, 2024-09-13T05:10:30.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020515418000000001, 2024-09-13T05:10:30.059 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.060 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:30.060 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.060 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.060 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.060 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4240 2024-09-13T05:10:30.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.060 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.060 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.060 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.060 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437091+0000", 2024-09-13T05:10:30.060 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.060 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437091+0000", 2024-09-13T05:10:30.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437090+0000", 2024-09-13T05:10:30.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:30.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437094+0000", 2024-09-13T05:10:30.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5580000000000002e-06 2024-09-13T05:10:30.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437101+0000", 2024-09-13T05:10:30.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2060000000000001e-06 2024-09-13T05:10:30.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437106+0000", 2024-09-13T05:10:30.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7899999999999999e-06 2024-09-13T05:10:30.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457332+0000", 2024-09-13T05:10:30.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020226361000000002 2024-09-13T05:10:30.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.063 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.063 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.063 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457436+0000", 2024-09-13T05:10:30.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000103799 2024-09-13T05:10:30.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.063 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.063 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.063 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457606+0000", 2024-09-13T05:10:30.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016975399999999999 2024-09-13T05:10:30.063 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.063 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.063 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.064 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.064 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4242 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 7389184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.064 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.437304+0000", 2024-09-13T05:10:30.064 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.5558106190000007, 2024-09-13T05:10:30.064 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020577726000000001, 2024-09-13T05:10:30.064 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.064 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:30.064 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.064 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.064 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.064 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4242 2024-09-13T05:10:30.064 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.064 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.064 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.065 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.065 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437304+0000", 2024-09-13T05:10:30.065 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.065 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.065 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.065 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.065 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437304+0000", 2024-09-13T05:10:30.065 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.065 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.065 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.065 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.065 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437304+0000", 2024-09-13T05:10:30.066 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:30.066 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.066 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.066 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.066 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437307+0000", 2024-09-13T05:10:30.066 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.817e-06 2024-09-13T05:10:30.067 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.067 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.067 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.067 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437314+0000", 2024-09-13T05:10:30.067 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8689999999999998e-06 2024-09-13T05:10:30.067 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.068 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.068 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.068 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437319+0000", 2024-09-13T05:10:30.068 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5220000000000001e-06 2024-09-13T05:10:30.068 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.068 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.068 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.069 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457646+0000", 2024-09-13T05:10:30.069 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020327293999999999 2024-09-13T05:10:30.069 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.069 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.069 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.069 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457768+0000", 2024-09-13T05:10:30.070 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000121705 2024-09-13T05:10:30.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.070 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.070 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.070 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457882+0000", 2024-09-13T05:10:30.070 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000114409 2024-09-13T05:10:30.071 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.071 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.071 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.071 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.071 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4244 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 7979008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.072 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.437361+0000", 2024-09-13T05:10:30.072 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.5557539709999997, 2024-09-13T05:10:30.072 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020766765999999999, 2024-09-13T05:10:30.072 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.072 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:30.072 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.073 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.073 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.073 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4244 2024-09-13T05:10:30.073 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.073 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.073 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.074 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.074 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437361+0000", 2024-09-13T05:10:30.074 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.074 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.074 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.075 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437361+0000", 2024-09-13T05:10:30.075 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.075 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.075 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437360+0000", 2024-09-13T05:10:30.076 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:30.076 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.076 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.076 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.076 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437363+0000", 2024-09-13T05:10:30.076 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9160000000000001e-06 2024-09-13T05:10:30.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.077 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.077 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.077 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437370+0000", 2024-09-13T05:10:30.077 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2859999999999996e-06 2024-09-13T05:10:30.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.078 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.078 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437375+0000", 2024-09-13T05:10:30.078 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3619999999999997e-06 2024-09-13T05:10:30.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.079 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.079 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457918+0000", 2024-09-13T05:10:30.079 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020542826 2024-09-13T05:10:30.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.079 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.079 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.080 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458008+0000", 2024-09-13T05:10:30.080 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9862000000000001e-05 2024-09-13T05:10:30.080 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.080 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.080 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.080 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458128+0000", 2024-09-13T05:10:30.081 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000120202 2024-09-13T05:10:30.081 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.081 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.081 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.081 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.081 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.081 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4247 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 8175616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.082 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.437466+0000", 2024-09-13T05:10:30.082 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.5556492540000004, 2024-09-13T05:10:30.082 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020852763, 2024-09-13T05:10:30.082 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.082 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:30.082 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.082 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.083 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.083 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4247 2024-09-13T05:10:30.083 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.083 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.083 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.083 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.083 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437466+0000", 2024-09-13T05:10:30.083 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.083 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.084 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.084 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.084 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437466+0000", 2024-09-13T05:10:30.084 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.084 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.084 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.084 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.084 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437465+0000", 2024-09-13T05:10:30.084 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:30.084 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.084 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.084 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.084 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437468+0000", 2024-09-13T05:10:30.085 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1990000000000002e-06 2024-09-13T05:10:30.085 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.085 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.085 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.085 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437474+0000", 2024-09-13T05:10:30.085 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.113e-06 2024-09-13T05:10:30.085 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.085 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.085 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.085 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437479+0000", 2024-09-13T05:10:30.085 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.13e-06 2024-09-13T05:10:30.085 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.086 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.086 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.086 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458172+0000", 2024-09-13T05:10:30.086 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020692954 2024-09-13T05:10:30.086 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.086 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.086 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.086 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458237+0000", 2024-09-13T05:10:30.086 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5434999999999999e-05 2024-09-13T05:10:30.086 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.086 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.086 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.086 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458319+0000", 2024-09-13T05:10:30.087 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1542e-05 2024-09-13T05:10:30.087 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.087 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.087 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.087 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.087 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4249 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 7782400~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.087 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.437538+0000", 2024-09-13T05:10:30.087 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.5555768089999997, 2024-09-13T05:10:30.087 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020997966, 2024-09-13T05:10:30.087 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.087 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:30.087 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.087 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.088 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.088 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4249 2024-09-13T05:10:30.088 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.088 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.088 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.088 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.088 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437538+0000", 2024-09-13T05:10:30.088 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.088 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.088 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.088 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.088 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437538+0000", 2024-09-13T05:10:30.088 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.088 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.088 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.089 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.089 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437537+0000", 2024-09-13T05:10:30.089 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:30.089 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.089 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.089 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.089 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437548+0000", 2024-09-13T05:10:30.089 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0713999999999999e-05 2024-09-13T05:10:30.089 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.089 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.089 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.089 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437564+0000", 2024-09-13T05:10:30.089 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5644000000000001e-05 2024-09-13T05:10:30.090 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.090 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.090 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.090 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437569+0000", 2024-09-13T05:10:30.090 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7910000000000001e-06 2024-09-13T05:10:30.090 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.090 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.090 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.090 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458360+0000", 2024-09-13T05:10:30.090 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020790854000000001 2024-09-13T05:10:30.090 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.090 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.090 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.090 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458466+0000", 2024-09-13T05:10:30.091 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010558 2024-09-13T05:10:30.091 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.091 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.091 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.091 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458536+0000", 2024-09-13T05:10:30.091 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0408999999999996e-05 2024-09-13T05:10:30.091 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.091 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.091 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.091 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.091 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.091 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4251 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 8372224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.091 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.437628+0000", 2024-09-13T05:10:30.091 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.5554869169999996, 2024-09-13T05:10:30.091 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.021109941, 2024-09-13T05:10:30.092 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.092 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:30.092 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.092 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.092 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.092 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4251 2024-09-13T05:10:30.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.092 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.092 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.092 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.092 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437628+0000", 2024-09-13T05:10:30.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437628+0000", 2024-09-13T05:10:30.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437627+0000", 2024-09-13T05:10:30.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:30.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437631+0000", 2024-09-13T05:10:30.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8099999999999999e-06 2024-09-13T05:10:30.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.094 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437637+0000", 2024-09-13T05:10:30.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5720000000000002e-06 2024-09-13T05:10:30.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.094 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437641+0000", 2024-09-13T05:10:30.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0010000000000003e-06 2024-09-13T05:10:30.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.094 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458561+0000", 2024-09-13T05:10:30.095 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.02091991 2024-09-13T05:10:30.095 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.095 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.095 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.095 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458623+0000", 2024-09-13T05:10:30.095 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2855999999999996e-05 2024-09-13T05:10:30.095 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.095 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.095 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.095 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458738+0000", 2024-09-13T05:10:30.095 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000114751 2024-09-13T05:10:30.095 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.095 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.095 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.095 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.095 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.096 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4254 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 7176192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.096 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.439888+0000", 2024-09-13T05:10:30.096 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.5532269129999996, 2024-09-13T05:10:30.096 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019045896999999999, 2024-09-13T05:10:30.096 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.096 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:30.096 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.096 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.096 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.096 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4254 2024-09-13T05:10:30.096 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.096 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.096 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.096 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.097 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.439888+0000", 2024-09-13T05:10:30.097 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.097 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.097 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.097 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.097 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.439888+0000", 2024-09-13T05:10:30.097 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.097 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.097 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.097 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.097 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.439887+0000", 2024-09-13T05:10:30.097 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:30.097 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.097 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.098 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.098 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.439894+0000", 2024-09-13T05:10:30.098 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6890000000000004e-06 2024-09-13T05:10:30.098 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.098 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.098 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.098 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.439909+0000", 2024-09-13T05:10:30.098 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4433000000000001e-05 2024-09-13T05:10:30.098 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.098 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.098 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.098 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.439918+0000", 2024-09-13T05:10:30.099 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2969999999999992e-06 2024-09-13T05:10:30.099 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.099 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.099 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.099 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458762+0000", 2024-09-13T05:10:30.099 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.018843407999999999 2024-09-13T05:10:30.099 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.099 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.099 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.099 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458866+0000", 2024-09-13T05:10:30.099 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000104314 2024-09-13T05:10:30.099 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.099 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.100 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.100 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458934+0000", 2024-09-13T05:10:30.100 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8165999999999998e-05 2024-09-13T05:10:30.100 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.100 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.100 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.100 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.100 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.100 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:7867 3.1c 3:3af80b2f:::rbd_data.112db57f3a18.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-13T05:10:30.100 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:25.873439+0000", 2024-09-13T05:10:30.100 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.1196765099999997, 2024-09-13T05:10:30.100 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.021501498000000001, 2024-09-13T05:10:30.101 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.101 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:30.101 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.101 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.101 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.101 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 7867 2024-09-13T05:10:30.101 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.101 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.101 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.101 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.102 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.873439+0000", 2024-09-13T05:10:30.102 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.102 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.102 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.102 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.102 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.873439+0000", 2024-09-13T05:10:30.102 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.102 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.102 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.102 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.102 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.873437+0000", 2024-09-13T05:10:30.102 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:30.102 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.103 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.103 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.103 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.878315+0000", 2024-09-13T05:10:30.103 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0048783530000000002 2024-09-13T05:10:30.103 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.103 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.103 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.103 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.878348+0000", 2024-09-13T05:10:30.103 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3420000000000002e-05 2024-09-13T05:10:30.103 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.103 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.103 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.104 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.878362+0000", 2024-09-13T05:10:30.104 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3784999999999999e-05 2024-09-13T05:10:30.104 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.104 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.104 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.104 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.878510+0000", 2024-09-13T05:10:30.104 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014806699999999999 2024-09-13T05:10:30.104 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.104 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.104 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.104 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.878727+0000", 2024-09-13T05:10:30.104 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000216935 2024-09-13T05:10:30.104 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.105 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.105 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:30.105 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.879100+0000", 2024-09-13T05:10:30.105 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00037323800000000002 2024-09-13T05:10:30.105 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.105 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.105 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:30.105 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.892006+0000", 2024-09-13T05:10:30.105 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012905585000000001 2024-09-13T05:10:30.105 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.105 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.105 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:30.105 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.894853+0000", 2024-09-13T05:10:30.105 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002846711 2024-09-13T05:10:30.106 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.106 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.106 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:30.106 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.894901+0000", 2024-09-13T05:10:30.106 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8758999999999999e-05 2024-09-13T05:10:30.106 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.106 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.106 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.106 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.894940+0000", 2024-09-13T05:10:30.106 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8708000000000003e-05 2024-09-13T05:10:30.106 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.106 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.106 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.106 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.107 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.107 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:30.107 INFO:tasks.ceph.mon.a.smithi120.stderr:2024-09-13T05:10:29.994+0000 7fa8b7b30700 -1 mon.a@0(leader).osd e39 definitely_dead 0 2024-09-13T05:10:30.108 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:10:30.109 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:30.103+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:30.209 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:30.207+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:30.226 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:30.226 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:30.226 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:30.226 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:30.236 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:10:30.288 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #6, image image_client.0-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent7 2024-09-13T05:10:30.310 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:30.307+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:30.336 INFO:teuthology.orchestra.run.smithi120.stdout:1076 trunc from 0xe0b20d9 to 0x9471afc 2024-09-13T05:10:30.345 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:30.345 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:30.345 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:30.345 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:30.345 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:30.357 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:10:30.377 INFO:teuthology.orchestra.run.smithi120.stdout:1078 read 0x1a2090a thru 0x1a20e77 (0x56e bytes) 2024-09-13T05:10:30.378 INFO:teuthology.orchestra.run.smithi120.stdout:1079 writesame 0x141e05e thru 0x1429346 data_size 0x15(0xb2e9 bytes) 2024-09-13T05:10:30.410 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:30.407+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:30.511 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:30.507+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:30.517 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:30.517 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:30.517 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:30.517 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:10:30.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.518 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:540 3.a 3:54eb35e9:::rbd_object_map.112d65d6a1c8:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-13T05:10:30.518 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:14.850832+0000", 2024-09-13T05:10:30.518 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 15.664393066000001, 2024-09-13T05:10:30.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0053449279999999997, 2024-09-13T05:10:30.518 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.518 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:30.518 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.518 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.518 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.518 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 540 2024-09-13T05:10:30.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.518 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.519 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.850832+0000", 2024-09-13T05:10:30.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.519 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.850832+0000", 2024-09-13T05:10:30.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.519 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.850830+0000", 2024-09-13T05:10:30.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:30.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.520 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.520 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.850842+0000", 2024-09-13T05:10:30.520 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1756000000000001e-05 2024-09-13T05:10:30.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.520 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.520 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.850870+0000", 2024-09-13T05:10:30.520 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8274000000000001e-05 2024-09-13T05:10:30.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.520 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.520 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.850882+0000", 2024-09-13T05:10:30.520 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1654999999999999e-05 2024-09-13T05:10:30.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.521 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.521 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.850993+0000", 2024-09-13T05:10:30.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011087200000000001 2024-09-13T05:10:30.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.521 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.521 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.851176+0000", 2024-09-13T05:10:30.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018281999999999999 2024-09-13T05:10:30.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:30.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.851872+0000", 2024-09-13T05:10:30.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00069598900000000005 2024-09-13T05:10:30.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:30.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.853497+0000", 2024-09-13T05:10:30.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0016250119999999999 2024-09-13T05:10:30.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.523 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:30.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856056+0000", 2024-09-13T05:10:30.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002559576 2024-09-13T05:10:30.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:30.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856123+0000", 2024-09-13T05:10:30.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6721e-05 2024-09-13T05:10:30.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:14.856177+0000", 2024-09-13T05:10:30.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4015999999999999e-05 2024-09-13T05:10:30.525 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.525 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.525 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.525 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:1789 3.a 3:535385f0:::rbd_children:head [call rbd.add_child in=12b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:30.525 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:19.835787+0000", 2024-09-13T05:10:30.526 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 10.679437605, 2024-09-13T05:10:30.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0063379300000000003, 2024-09-13T05:10:30.526 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.526 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:30.526 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.526 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.526 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.527 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 1789 2024-09-13T05:10:30.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.527 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.835787+0000", 2024-09-13T05:10:30.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.528 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.528 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.835787+0000", 2024-09-13T05:10:30.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.529 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.529 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.835785+0000", 2024-09-13T05:10:30.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:10:30.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.530 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.530 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.835802+0000", 2024-09-13T05:10:30.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7555999999999999e-05 2024-09-13T05:10:30.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.530 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.530 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.835841+0000", 2024-09-13T05:10:30.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8943000000000003e-05 2024-09-13T05:10:30.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.530 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.835857+0000", 2024-09-13T05:10:30.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5936000000000001e-05 2024-09-13T05:10:30.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.836006+0000", 2024-09-13T05:10:30.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014938000000000001 2024-09-13T05:10:30.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op must wait for map", 2024-09-13T05:10:30.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.836023+0000", 2024-09-13T05:10:30.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6986999999999998e-05 2024-09-13T05:10:30.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.839686+0000", 2024-09-13T05:10:30.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003662603 2024-09-13T05:10:30.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.839887+0000", 2024-09-13T05:10:30.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020116599999999999 2024-09-13T05:10:30.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:30.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.840256+0000", 2024-09-13T05:10:30.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00036894500000000003 2024-09-13T05:10:30.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:30.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.841605+0000", 2024-09-13T05:10:30.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0013488650000000001 2024-09-13T05:10:30.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:30.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.841992+0000", 2024-09-13T05:10:30.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000387198 2024-09-13T05:10:30.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:30.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.842070+0000", 2024-09-13T05:10:30.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7489000000000003e-05 2024-09-13T05:10:30.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:19.842125+0000", 2024-09-13T05:10:30.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5748999999999998e-05 2024-09-13T05:10:30.534 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.534 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.534 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.535 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:2614 3.a 3:53a7bfb4:::rbd_data.112d872fd67a.0000000000000042:head [stat,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.535 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:20.874114+0000", 2024-09-13T05:10:30.535 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.64111078, 2024-09-13T05:10:30.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0050811759999999997, 2024-09-13T05:10:30.535 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.535 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:30.535 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.535 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.535 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.535 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 2614 2024-09-13T05:10:30.535 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.535 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.535 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.874114+0000", 2024-09-13T05:10:30.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.874114+0000", 2024-09-13T05:10:30.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.874112+0000", 2024-09-13T05:10:30.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:30.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.874124+0000", 2024-09-13T05:10:30.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2223e-05 2024-09-13T05:10:30.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.874171+0000", 2024-09-13T05:10:30.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6439e-05 2024-09-13T05:10:30.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.874192+0000", 2024-09-13T05:10:30.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0968999999999999e-05 2024-09-13T05:10:30.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.874402+0000", 2024-09-13T05:10:30.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021035300000000001 2024-09-13T05:10:30.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.874906+0000", 2024-09-13T05:10:30.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00050350199999999996 2024-09-13T05:10:30.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.539 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.879195+0000", 2024-09-13T05:10:30.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00428978 2024-09-13T05:10:30.539 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.539 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.539 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.539 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:2621 3.10 3:0be52a84:::rbd_data.112d872fd67a.0000000000000049:head [stat,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.539 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:20.874269+0000", 2024-09-13T05:10:30.539 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.6409564769999996, 2024-09-13T05:10:30.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.004860278, 2024-09-13T05:10:30.540 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.540 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:30.540 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.540 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.540 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.540 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 2621 2024-09-13T05:10:30.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.540 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.540 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.874269+0000", 2024-09-13T05:10:30.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.874269+0000", 2024-09-13T05:10:30.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.874267+0000", 2024-09-13T05:10:30.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:30.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.874280+0000", 2024-09-13T05:10:30.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2556e-05 2024-09-13T05:10:30.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.874339+0000", 2024-09-13T05:10:30.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9052000000000003e-05 2024-09-13T05:10:30.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.874355+0000", 2024-09-13T05:10:30.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5654e-05 2024-09-13T05:10:30.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.874516+0000", 2024-09-13T05:10:30.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016124600000000001 2024-09-13T05:10:30.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.874978+0000", 2024-09-13T05:10:30.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00046214999999999998 2024-09-13T05:10:30.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.879129+0000", 2024-09-13T05:10:30.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0041509629999999997 2024-09-13T05:10:30.544 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.544 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.544 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.544 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "pg_update_log_missing(3.14 epoch 31/22 rep_tid 331 entries 31'29 (0'0) error 3:2956f184:::rbd_data.112d872fd67a.0000000000000051:head by client.4397.0:2724 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 30'27)", 2024-09-13T05:10:30.544 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:20.889836+0000", 2024-09-13T05:10:30.544 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.625388933, 2024-09-13T05:10:30.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0051091080000000002, 2024-09-13T05:10:30.544 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.544 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:30.544 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.545 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.889836+0000", 2024-09-13T05:10:30.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.545 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.889836+0000", 2024-09-13T05:10:30.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.545 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.889836+0000", 2024-09-13T05:10:30.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:30.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.889844+0000", 2024-09-13T05:10:30.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7960000000000001e-06 2024-09-13T05:10:30.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.889857+0000", 2024-09-13T05:10:30.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2897999999999999e-05 2024-09-13T05:10:30.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.889871+0000", 2024-09-13T05:10:30.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.384e-05 2024-09-13T05:10:30.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.889980+0000", 2024-09-13T05:10:30.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010836 2024-09-13T05:10:30.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.894945+0000", 2024-09-13T05:10:30.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0049657130000000001 2024-09-13T05:10:30.547 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.547 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.548 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.548 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:2756 3.1d e31/22 3:bd37c5f3:::rbd_data.112d872fd67a.000000000000004e:head v 31'2, mlcod=0'0)", 2024-09-13T05:10:30.548 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:20.894730+0000", 2024-09-13T05:10:30.548 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.6204950549999992, 2024-09-13T05:10:30.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0049634639999999999, 2024-09-13T05:10:30.548 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.548 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:30.548 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.894730+0000", 2024-09-13T05:10:30.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.894730+0000", 2024-09-13T05:10:30.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.894729+0000", 2024-09-13T05:10:30.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:30.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.894743+0000", 2024-09-13T05:10:30.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4543e-05 2024-09-13T05:10:30.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.894759+0000", 2024-09-13T05:10:30.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6286e-05 2024-09-13T05:10:30.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.894773+0000", 2024-09-13T05:10:30.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3817e-05 2024-09-13T05:10:30.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.894833+0000", 2024-09-13T05:10:30.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9573e-05 2024-09-13T05:10:30.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.894857+0000", 2024-09-13T05:10:30.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3779000000000001e-05 2024-09-13T05:10:30.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:30.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.899644+0000", 2024-09-13T05:10:30.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0047878340000000004 2024-09-13T05:10:30.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.899694+0000", 2024-09-13T05:10:30.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9076999999999998e-05 2024-09-13T05:10:30.552 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.552 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.552 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.553 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:2931 3.a 3:56405b48:::rbd_data.112d872fd67a.0000000000000066:head [stat,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.553 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:20.916487+0000", 2024-09-13T05:10:30.553 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.5987382009999997, 2024-09-13T05:10:30.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0047821230000000001, 2024-09-13T05:10:30.553 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.553 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:30.553 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.553 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.553 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.553 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 2931 2024-09-13T05:10:30.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.553 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.916487+0000", 2024-09-13T05:10:30.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.916487+0000", 2024-09-13T05:10:30.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.916485+0000", 2024-09-13T05:10:30.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:30.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.916494+0000", 2024-09-13T05:10:30.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4449999999999996e-06 2024-09-13T05:10:30.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.916525+0000", 2024-09-13T05:10:30.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1463e-05 2024-09-13T05:10:30.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.916537+0000", 2024-09-13T05:10:30.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1568e-05 2024-09-13T05:10:30.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.916617+0000", 2024-09-13T05:10:30.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0792999999999997e-05 2024-09-13T05:10:30.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.916792+0000", 2024-09-13T05:10:30.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017511600000000001 2024-09-13T05:10:30.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.921269+0000", 2024-09-13T05:10:30.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0044765359999999997 2024-09-13T05:10:30.557 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.557 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.557 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.557 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:2946 3.10 3:0951070a:::rbd_data.112d872fd67a.000000000000006a:head [stat,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.557 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:20.921349+0000", 2024-09-13T05:10:30.557 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.5938761239999995, 2024-09-13T05:10:30.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0067915839999999998, 2024-09-13T05:10:30.558 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.558 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:30.558 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.558 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.558 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.558 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 2946 2024-09-13T05:10:30.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.559 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.921349+0000", 2024-09-13T05:10:30.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.921349+0000", 2024-09-13T05:10:30.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.921348+0000", 2024-09-13T05:10:30.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:30.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.921355+0000", 2024-09-13T05:10:30.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1690000000000003e-06 2024-09-13T05:10:30.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.921371+0000", 2024-09-13T05:10:30.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6299000000000001e-05 2024-09-13T05:10:30.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.921379+0000", 2024-09-13T05:10:30.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0150000000000003e-06 2024-09-13T05:10:30.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.562 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.921438+0000", 2024-09-13T05:10:30.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9091000000000001e-05 2024-09-13T05:10:30.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.921650+0000", 2024-09-13T05:10:30.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021183399999999999 2024-09-13T05:10:30.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.928141+0000", 2024-09-13T05:10:30.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0064904719999999997 2024-09-13T05:10:30.564 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.564 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.564 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.565 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:2959 3.10 3:0f6f02a0:::rbd_data.112d872fd67a.000000000000006f:head [stat,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.565 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:20.922126+0000", 2024-09-13T05:10:30.565 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.5930991680000002, 2024-09-13T05:10:30.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0092986330000000006, 2024-09-13T05:10:30.565 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.565 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:30.566 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.566 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.566 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.566 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 2959 2024-09-13T05:10:30.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.566 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.922126+0000", 2024-09-13T05:10:30.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.922126+0000", 2024-09-13T05:10:30.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.922125+0000", 2024-09-13T05:10:30.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:30.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.569 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.922132+0000", 2024-09-13T05:10:30.569 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2860000000000002e-06 2024-09-13T05:10:30.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.570 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.570 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.922159+0000", 2024-09-13T05:10:30.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.73e-05 2024-09-13T05:10:30.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.570 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.570 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.922168+0000", 2024-09-13T05:10:30.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.568e-06 2024-09-13T05:10:30.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.571 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.571 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.571 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.922248+0000", 2024-09-13T05:10:30.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9642999999999996e-05 2024-09-13T05:10:30.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.571 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.922345+0000", 2024-09-13T05:10:30.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7016999999999996e-05 2024-09-13T05:10:30.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:30.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.922525+0000", 2024-09-13T05:10:30.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018055799999999999 2024-09-13T05:10:30.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.573 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:30.573 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.923873+0000", 2024-09-13T05:10:30.573 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0013478089999999999 2024-09-13T05:10:30.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.574 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.574 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:30.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.931312+0000", 2024-09-13T05:10:30.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0074389749999999996 2024-09-13T05:10:30.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.574 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.574 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:30.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.931375+0000", 2024-09-13T05:10:30.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2934000000000004e-05 2024-09-13T05:10:30.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.575 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.575 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.931425+0000", 2024-09-13T05:10:30.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9721e-05 2024-09-13T05:10:30.576 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.576 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.576 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.576 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.576 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:3017 3.10 3:0951070a:::rbd_data.112d872fd67a.000000000000006a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.577 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:20.929571+0000", 2024-09-13T05:10:30.577 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.5856536900000009, 2024-09-13T05:10:30.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0074058489999999999, 2024-09-13T05:10:30.577 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.577 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:30.578 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.578 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.578 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.578 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 3017 2024-09-13T05:10:30.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.578 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.929571+0000", 2024-09-13T05:10:30.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.929571+0000", 2024-09-13T05:10:30.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.580 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.580 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.580 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.580 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.929570+0000", 2024-09-13T05:10:30.580 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:30.580 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.580 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.580 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.929579+0000", 2024-09-13T05:10:30.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8640000000000002e-06 2024-09-13T05:10:30.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.929594+0000", 2024-09-13T05:10:30.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5429000000000001e-05 2024-09-13T05:10:30.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.929602+0000", 2024-09-13T05:10:30.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5920000000000003e-06 2024-09-13T05:10:30.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.929659+0000", 2024-09-13T05:10:30.583 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6997000000000003e-05 2024-09-13T05:10:30.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.583 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.929740+0000", 2024-09-13T05:10:30.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1594000000000005e-05 2024-09-13T05:10:30.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.584 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.584 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:30.584 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.929897+0000", 2024-09-13T05:10:30.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000156498 2024-09-13T05:10:30.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:30.585 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.930594+0000", 2024-09-13T05:10:30.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00069744100000000003 2024-09-13T05:10:30.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:30.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.936800+0000", 2024-09-13T05:10:30.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0062056949999999998 2024-09-13T05:10:30.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:30.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.936884+0000", 2024-09-13T05:10:30.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.3580999999999998e-05 2024-09-13T05:10:30.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.587 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:20.936977+0000", 2024-09-13T05:10:30.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3610000000000007e-05 2024-09-13T05:10:30.587 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.587 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.587 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.587 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:3605 3.10 3:0b3733f7:::rbd_data.112d265b2a09.0000000000000048:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 442368~16384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.587 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.214365+0000", 2024-09-13T05:10:30.587 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.3008599190000005, 2024-09-13T05:10:30.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0062011080000000003, 2024-09-13T05:10:30.588 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.588 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:30.588 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.588 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.588 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.588 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 3605 2024-09-13T05:10:30.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.588 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.588 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.588 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.588 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.214365+0000", 2024-09-13T05:10:30.588 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.214365+0000", 2024-09-13T05:10:30.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.214362+0000", 2024-09-13T05:10:30.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:10:30.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.214461+0000", 2024-09-13T05:10:30.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8564e-05 2024-09-13T05:10:30.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.214491+0000", 2024-09-13T05:10:30.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0108e-05 2024-09-13T05:10:30.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.214505+0000", 2024-09-13T05:10:30.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4418e-05 2024-09-13T05:10:30.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.214600+0000", 2024-09-13T05:10:30.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4554000000000003e-05 2024-09-13T05:10:30.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.214875+0000", 2024-09-13T05:10:30.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000275109 2024-09-13T05:10:30.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:30.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.215276+0000", 2024-09-13T05:10:30.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00040039699999999998 2024-09-13T05:10:30.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.592 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:30.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.216698+0000", 2024-09-13T05:10:30.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0014227899999999999 2024-09-13T05:10:30.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.592 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:30.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.220439+0000", 2024-09-13T05:10:30.593 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003740387 2024-09-13T05:10:30.593 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.593 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.593 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:30.593 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.220497+0000", 2024-09-13T05:10:30.593 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8598999999999999e-05 2024-09-13T05:10:30.593 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.593 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.593 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.594 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.220566+0000", 2024-09-13T05:10:30.594 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8974999999999996e-05 2024-09-13T05:10:30.594 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.594 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.594 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.594 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.594 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:3737 3.10 3:08b25002:::rbd_data.112d265b2a09.000000000000013c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.594 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.358357+0000", 2024-09-13T05:10:30.594 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.156868137, 2024-09-13T05:10:30.594 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0051195640000000001, 2024-09-13T05:10:30.594 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.594 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:30.594 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.595 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.595 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.595 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 3737 2024-09-13T05:10:30.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.595 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.595 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.358357+0000", 2024-09-13T05:10:30.595 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.595 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.358357+0000", 2024-09-13T05:10:30.595 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.358355+0000", 2024-09-13T05:10:30.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:30.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.597 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.597 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.358367+0000", 2024-09-13T05:10:30.597 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1973999999999999e-05 2024-09-13T05:10:30.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.597 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.597 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.597 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.358396+0000", 2024-09-13T05:10:30.597 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8626999999999999e-05 2024-09-13T05:10:30.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.597 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.597 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.597 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.358411+0000", 2024-09-13T05:10:30.597 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4960000000000001e-05 2024-09-13T05:10:30.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.598 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.598 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.598 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.358541+0000", 2024-09-13T05:10:30.598 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013028700000000001 2024-09-13T05:10:30.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.598 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.598 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.598 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.358782+0000", 2024-09-13T05:10:30.598 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000240743 2024-09-13T05:10:30.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.598 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.598 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:30.598 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.359068+0000", 2024-09-13T05:10:30.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00028664000000000001 2024-09-13T05:10:30.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:30.599 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.360329+0000", 2024-09-13T05:10:30.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001260256 2024-09-13T05:10:30.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:30.599 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.363378+0000", 2024-09-13T05:10:30.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003049665 2024-09-13T05:10:30.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:30.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.363437+0000", 2024-09-13T05:10:30.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8301000000000003e-05 2024-09-13T05:10:30.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.600 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.363477+0000", 2024-09-13T05:10:30.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0021000000000002e-05 2024-09-13T05:10:30.600 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.600 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.600 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.600 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4258 3.a 3:57684fd0:::rbd_data.112d265b2a09.0000000000000031:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,truncate 442368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.600 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.443872+0000", 2024-09-13T05:10:30.601 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.0713529820000005, 2024-09-13T05:10:30.601 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.005713999, 2024-09-13T05:10:30.605 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.605 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:30.605 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.605 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.605 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.605 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4258 2024-09-13T05:10:30.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.605 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.605 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.605 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.443872+0000", 2024-09-13T05:10:30.605 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.443872+0000", 2024-09-13T05:10:30.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.606 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.443870+0000", 2024-09-13T05:10:30.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:10:30.606 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.607 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.607 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.444838+0000", 2024-09-13T05:10:30.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00096816299999999997 2024-09-13T05:10:30.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.607 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.607 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.444859+0000", 2024-09-13T05:10:30.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1012000000000001e-05 2024-09-13T05:10:30.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.608 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.608 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.444868+0000", 2024-09-13T05:10:30.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7579999999999998e-06 2024-09-13T05:10:30.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.608 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.608 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.444942+0000", 2024-09-13T05:10:30.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.4098999999999996e-05 2024-09-13T05:10:30.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.608 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.608 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.445158+0000", 2024-09-13T05:10:30.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021602500000000001 2024-09-13T05:10:30.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:30.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.445415+0000", 2024-09-13T05:10:30.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025716500000000001 2024-09-13T05:10:30.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:30.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.448314+0000", 2024-09-13T05:10:30.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0028993920000000002 2024-09-13T05:10:30.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:30.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.449453+0000", 2024-09-13T05:10:30.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0011392010000000001 2024-09-13T05:10:30.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:30.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.449527+0000", 2024-09-13T05:10:30.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3906999999999996e-05 2024-09-13T05:10:30.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.449586+0000", 2024-09-13T05:10:30.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8746999999999998e-05 2024-09-13T05:10:30.610 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.610 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.610 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.611 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4774 3.a 3:57684fd0:::rbd_data.112d265b2a09.0000000000000031:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.611 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.762903+0000", 2024-09-13T05:10:30.611 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.7523221860000007, 2024-09-13T05:10:30.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0079689860000000008, 2024-09-13T05:10:30.611 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.611 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:30.611 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.611 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.611 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.611 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4774 2024-09-13T05:10:30.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.611 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.762903+0000", 2024-09-13T05:10:30.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.762903+0000", 2024-09-13T05:10:30.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.762902+0000", 2024-09-13T05:10:30.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:30.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.613 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.613 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.762909+0000", 2024-09-13T05:10:30.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8469999999999996e-06 2024-09-13T05:10:30.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.613 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.613 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.762936+0000", 2024-09-13T05:10:30.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6325e-05 2024-09-13T05:10:30.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.613 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.613 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.762950+0000", 2024-09-13T05:10:30.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4487e-05 2024-09-13T05:10:30.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.764448+0000", 2024-09-13T05:10:30.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0014979220000000001 2024-09-13T05:10:30.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.764632+0000", 2024-09-13T05:10:30.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018416999999999999 2024-09-13T05:10:30.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:30.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.764933+0000", 2024-09-13T05:10:30.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00030066499999999998 2024-09-13T05:10:30.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:30.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.766777+0000", 2024-09-13T05:10:30.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001843545 2024-09-13T05:10:30.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:30.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.770715+0000", 2024-09-13T05:10:30.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0039386780000000001 2024-09-13T05:10:30.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:30.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.770811+0000", 2024-09-13T05:10:30.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5931e-05 2024-09-13T05:10:30.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.770872+0000", 2024-09-13T05:10:30.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0715999999999999e-05 2024-09-13T05:10:30.616 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.616 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.616 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.617 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:4779 3.1d e31/22 3:be409230:::rbd_data.112d265b2a09.0000000000000036:head v 31'5, mlcod=31'3)", 2024-09-13T05:10:30.617 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.765741+0000", 2024-09-13T05:10:30.617 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.7494840150000002, 2024-09-13T05:10:30.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0051940500000000004, 2024-09-13T05:10:30.617 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.617 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:30.617 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.618 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.618 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.765741+0000", 2024-09-13T05:10:30.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.618 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.618 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.765741+0000", 2024-09-13T05:10:30.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.618 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.618 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.765740+0000", 2024-09-13T05:10:30.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:30.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.765755+0000", 2024-09-13T05:10:30.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5342999999999999e-05 2024-09-13T05:10:30.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.765784+0000", 2024-09-13T05:10:30.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9572000000000001e-05 2024-09-13T05:10:30.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.765798+0000", 2024-09-13T05:10:30.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.382e-05 2024-09-13T05:10:30.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.765899+0000", 2024-09-13T05:10:30.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000101179 2024-09-13T05:10:30.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.765947+0000", 2024-09-13T05:10:30.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7481999999999997e-05 2024-09-13T05:10:30.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:30.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.770892+0000", 2024-09-13T05:10:30.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0049449710000000003 2024-09-13T05:10:30.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.770935+0000", 2024-09-13T05:10:30.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3241000000000002e-05 2024-09-13T05:10:30.621 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.621 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.621 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.622 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:4800 3.11 e31/22 3:89be53e0:::rbd_data.112d265b2a09.00000000000000c8:head v 31'22, mlcod=31'20)", 2024-09-13T05:10:30.622 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.773732+0000", 2024-09-13T05:10:30.622 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.7414926550000001, 2024-09-13T05:10:30.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0048155569999999998, 2024-09-13T05:10:30.622 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.622 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:30.622 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.773732+0000", 2024-09-13T05:10:30.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.773732+0000", 2024-09-13T05:10:30.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.773731+0000", 2024-09-13T05:10:30.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:30.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.773743+0000", 2024-09-13T05:10:30.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1516e-05 2024-09-13T05:10:30.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.773759+0000", 2024-09-13T05:10:30.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6171000000000002e-05 2024-09-13T05:10:30.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.773767+0000", 2024-09-13T05:10:30.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6410000000000002e-06 2024-09-13T05:10:30.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.773823+0000", 2024-09-13T05:10:30.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5931999999999999e-05 2024-09-13T05:10:30.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.773850+0000", 2024-09-13T05:10:30.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7121999999999999e-05 2024-09-13T05:10:30.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:30.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.778503+0000", 2024-09-13T05:10:30.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0046532240000000001 2024-09-13T05:10:30.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.626 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.626 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.626 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.778548+0000", 2024-09-13T05:10:30.626 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4907000000000002e-05 2024-09-13T05:10:30.626 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.626 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.626 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.626 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.626 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4813 3.a 3:52fc83f3:::rbd_data.112d265b2a09.00000000000000f3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:30.626 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.779210+0000", 2024-09-13T05:10:30.626 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.7360153870000001, 2024-09-13T05:10:30.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0087956579999999996, 2024-09-13T05:10:30.627 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.627 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:30.627 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.627 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.627 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.627 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4813 2024-09-13T05:10:30.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.627 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.627 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.627 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.779210+0000", 2024-09-13T05:10:30.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.628 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.628 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.779210+0000", 2024-09-13T05:10:30.628 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.628 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.629 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.779208+0000", 2024-09-13T05:10:30.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:30.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.629 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.629 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.779216+0000", 2024-09-13T05:10:30.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3409999999999997e-06 2024-09-13T05:10:30.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.629 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.629 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.779244+0000", 2024-09-13T05:10:30.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8513e-05 2024-09-13T05:10:30.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.630 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.630 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.779252+0000", 2024-09-13T05:10:30.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3889999999999999e-06 2024-09-13T05:10:30.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.630 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.630 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.779303+0000", 2024-09-13T05:10:30.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1603e-05 2024-09-13T05:10:30.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.630 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.630 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.631 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.779381+0000", 2024-09-13T05:10:30.631 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7628999999999998e-05 2024-09-13T05:10:30.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.631 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.631 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:30.631 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.779449+0000", 2024-09-13T05:10:30.631 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8300999999999995e-05 2024-09-13T05:10:30.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.631 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.631 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:30.632 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.783557+0000", 2024-09-13T05:10:30.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0041082139999999998 2024-09-13T05:10:30.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.632 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:30.632 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.787925+0000", 2024-09-13T05:10:30.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0043682019999999998 2024-09-13T05:10:30.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.632 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:30.632 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.787974+0000", 2024-09-13T05:10:30.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8405999999999997e-05 2024-09-13T05:10:30.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.633 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.633 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.788005+0000", 2024-09-13T05:10:30.633 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1470000000000002e-05 2024-09-13T05:10:30.633 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.633 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.633 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.633 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:7835 3.11 e35/22 3:894f9a60:::rbd_data.112db57f3a18.0000000000000024:head v 35'40, mlcod=34'37)", 2024-09-13T05:10:30.633 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:25.839612+0000", 2024-09-13T05:10:30.633 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.67561334, 2024-09-13T05:10:30.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.006096377, 2024-09-13T05:10:30.634 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.634 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:30.634 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.634 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.634 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.839612+0000", 2024-09-13T05:10:30.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.634 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.634 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.839612+0000", 2024-09-13T05:10:30.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.635 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.635 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.635 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.839610+0000", 2024-09-13T05:10:30.635 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:30.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.635 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.635 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.635 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.839627+0000", 2024-09-13T05:10:30.635 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6549999999999999e-05 2024-09-13T05:10:30.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.635 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.635 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.635 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.839667+0000", 2024-09-13T05:10:30.636 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0039000000000001e-05 2024-09-13T05:10:30.636 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.636 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.636 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.636 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.839683+0000", 2024-09-13T05:10:30.636 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6623e-05 2024-09-13T05:10:30.636 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.636 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.636 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.636 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.839793+0000", 2024-09-13T05:10:30.636 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010954 2024-09-13T05:10:30.636 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.636 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.636 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.637 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.839841+0000", 2024-09-13T05:10:30.637 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7852999999999997e-05 2024-09-13T05:10:30.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.637 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.637 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:30.637 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.845646+0000", 2024-09-13T05:10:30.637 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0058050630000000001 2024-09-13T05:10:30.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.637 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.637 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.637 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.845708+0000", 2024-09-13T05:10:30.637 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2508999999999994e-05 2024-09-13T05:10:30.637 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.638 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.638 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.638 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:7836 3.1d e35/22 3:bddee28b:::rbd_data.112db57f3a18.000000000000002c:head v 35'13, mlcod=34'10)", 2024-09-13T05:10:30.638 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:25.839713+0000", 2024-09-13T05:10:30.638 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.6755120559999996, 2024-09-13T05:10:30.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0065870369999999996, 2024-09-13T05:10:30.638 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.638 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:30.638 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.639 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.639 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.839713+0000", 2024-09-13T05:10:30.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.639 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.639 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.639 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.839713+0000", 2024-09-13T05:10:30.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.639 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.639 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.640 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.839711+0000", 2024-09-13T05:10:30.640 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:30.640 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.640 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.640 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.640 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.839724+0000", 2024-09-13T05:10:30.640 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2153e-05 2024-09-13T05:10:30.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.839741+0000", 2024-09-13T05:10:30.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7096e-05 2024-09-13T05:10:30.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.839752+0000", 2024-09-13T05:10:30.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.136e-05 2024-09-13T05:10:30.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.839950+0000", 2024-09-13T05:10:30.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00019841300000000001 2024-09-13T05:10:30.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.642 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.839979+0000", 2024-09-13T05:10:30.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9082999999999999e-05 2024-09-13T05:10:30.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.642 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:30.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.846223+0000", 2024-09-13T05:10:30.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.006243284 2024-09-13T05:10:30.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.642 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.846300+0000", 2024-09-13T05:10:30.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7300999999999997e-05 2024-09-13T05:10:30.643 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.643 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.643 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.643 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.643 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.643 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:8213 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,truncate 2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-13T05:10:30.643 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:26.393112+0000", 2024-09-13T05:10:30.643 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.1221134959999999, 2024-09-13T05:10:30.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010632777, 2024-09-13T05:10:30.643 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:30.643 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:30.643 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:30.644 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:30.644 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:30.644 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 8213 2024-09-13T05:10:30.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.644 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:30.644 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.644 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:30.644 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:26.393112+0000", 2024-09-13T05:10:30.644 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.644 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.645 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:30.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:26.393112+0000", 2024-09-13T05:10:30.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:30.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.645 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:30.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:26.393110+0000", 2024-09-13T05:10:30.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:30.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.645 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:30.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:26.397442+0000", 2024-09-13T05:10:30.646 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0043320839999999999 2024-09-13T05:10:30.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.646 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.646 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:30.646 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:26.397477+0000", 2024-09-13T05:10:30.646 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4987000000000002e-05 2024-09-13T05:10:30.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.646 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.646 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:30.646 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:26.397487+0000", 2024-09-13T05:10:30.646 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4679999999999998e-06 2024-09-13T05:10:30.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.646 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.646 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:30.646 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:26.397558+0000", 2024-09-13T05:10:30.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0877999999999995e-05 2024-09-13T05:10:30.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.647 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:30.647 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:26.397750+0000", 2024-09-13T05:10:30.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00019283599999999999 2024-09-13T05:10:30.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.647 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:30.647 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:26.398096+0000", 2024-09-13T05:10:30.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00034595399999999999 2024-09-13T05:10:30.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.647 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:30.647 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:26.403047+0000", 2024-09-13T05:10:30.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0049502469999999996 2024-09-13T05:10:30.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.648 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.648 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:30.648 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:26.403637+0000", 2024-09-13T05:10:30.648 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00059003799999999998 2024-09-13T05:10:30.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.648 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.648 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:30.648 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:26.403697+0000", 2024-09-13T05:10:30.648 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0148000000000001e-05 2024-09-13T05:10:30.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:30.648 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:30.648 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:30.648 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:26.403744+0000", 2024-09-13T05:10:30.649 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7641e-05 2024-09-13T05:10:30.649 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.649 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.649 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.649 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:30.649 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:30.649 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:30.651 INFO:teuthology.orchestra.run.smithi120.stdout:1080 trunc from 0x9471afc to 0xe51b9a2 2024-09-13T05:10:30.651 INFO:teuthology.orchestra.run.smithi120.stdout:1083 write 0x1a685ff thru 0x1a76148 (0xdb4a bytes) 2024-09-13T05:10:30.651 INFO:teuthology.orchestra.run.smithi120.stdout:1085 trunc from 0xe51b9a2 to 0x24921ef 2024-09-13T05:10:30.651 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:30.646+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:30.652 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:10:30.653 INFO:teuthology.orchestra.run.smithi120.stdout:1086 read 0x17dac26 thru 0x17e2fe1 (0x83bc bytes) 2024-09-13T05:10:30.656 INFO:teuthology.orchestra.run.smithi120.stdout:1088 read 0x5a961a thru 0x5afd76 (0x675d bytes) 2024-09-13T05:10:30.684 INFO:teuthology.orchestra.run.smithi120.stdout:1089 read 0x23973ae thru 0x239f957 (0x85aa bytes) 2024-09-13T05:10:30.751 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:30.746+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:30.808 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:30.809 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:30.809 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:30.809 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:30.821 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:10:30.823 INFO:teuthology.orchestra.run.smithi120.stderr:marked out osd.1. 2024-09-13T05:10:30.877 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:30.874+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:30.918 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:30.918 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:30.918 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:30.918 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:30.918 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:30.928 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:10:30.973 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:30.971+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:31.035 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:31.035 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:31.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:31.036 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:10:31.036 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.036 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11814 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 598016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.036 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.424372+0000", 2024-09-13T05:10:31.036 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.60743146699999995, 2024-09-13T05:10:31.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040676889000000001, 2024-09-13T05:10:31.036 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:31.036 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:31.036 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:31.036 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:31.036 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.036 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11814 2024-09-13T05:10:31.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.037 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:31.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.037 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:31.037 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424372+0000", 2024-09-13T05:10:31.037 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.037 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:31.037 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424372+0000", 2024-09-13T05:10:31.037 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:31.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424371+0000", 2024-09-13T05:10:31.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:31.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:31.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424377+0000", 2024-09-13T05:10:31.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3619999999999997e-06 2024-09-13T05:10:31.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:31.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424387+0000", 2024-09-13T05:10:31.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0526999999999999e-05 2024-09-13T05:10:31.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424395+0000", 2024-09-13T05:10:31.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3599999999999998e-06 2024-09-13T05:10:31.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:31.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.464922+0000", 2024-09-13T05:10:31.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040527101000000003 2024-09-13T05:10:31.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:31.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.464999+0000", 2024-09-13T05:10:31.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7279000000000003e-05 2024-09-13T05:10:31.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:31.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465049+0000", 2024-09-13T05:10:31.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0237e-05 2024-09-13T05:10:31.040 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.040 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:31.040 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.040 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11815 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 607232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.040 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.424515+0000", 2024-09-13T05:10:31.041 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.60728827900000004, 2024-09-13T05:10:31.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040712652000000002, 2024-09-13T05:10:31.041 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:31.041 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:31.041 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:31.041 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:31.041 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.041 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11815 2024-09-13T05:10:31.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.041 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:31.041 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.041 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:31.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424515+0000", 2024-09-13T05:10:31.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:31.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424515+0000", 2024-09-13T05:10:31.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:31.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424514+0000", 2024-09-13T05:10:31.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:31.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:31.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424520+0000", 2024-09-13T05:10:31.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8680000000000004e-06 2024-09-13T05:10:31.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:31.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424537+0000", 2024-09-13T05:10:31.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6591000000000001e-05 2024-09-13T05:10:31.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424553+0000", 2024-09-13T05:10:31.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5820000000000001e-05 2024-09-13T05:10:31.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:31.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465084+0000", 2024-09-13T05:10:31.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040531840999999999 2024-09-13T05:10:31.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:31.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465146+0000", 2024-09-13T05:10:31.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1291000000000007e-05 2024-09-13T05:10:31.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:31.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465228+0000", 2024-09-13T05:10:31.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2398000000000006e-05 2024-09-13T05:10:31.045 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.045 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:31.045 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.046 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11816 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 616448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.046 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.424719+0000", 2024-09-13T05:10:31.046 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.60708433299999998, 2024-09-13T05:10:31.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040708561999999997, 2024-09-13T05:10:31.046 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:31.046 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:31.046 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:31.046 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:31.046 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.046 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11816 2024-09-13T05:10:31.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.046 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:31.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:31.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424719+0000", 2024-09-13T05:10:31.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:31.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424719+0000", 2024-09-13T05:10:31.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:31.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424718+0000", 2024-09-13T05:10:31.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:31.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:31.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424725+0000", 2024-09-13T05:10:31.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3339999999999998e-06 2024-09-13T05:10:31.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:31.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424738+0000", 2024-09-13T05:10:31.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3799e-05 2024-09-13T05:10:31.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424766+0000", 2024-09-13T05:10:31.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7953000000000002e-05 2024-09-13T05:10:31.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.049 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:31.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465267+0000", 2024-09-13T05:10:31.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040500586999999998 2024-09-13T05:10:31.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.049 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:31.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465349+0000", 2024-09-13T05:10:31.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1854999999999995e-05 2024-09-13T05:10:31.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.050 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.050 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:31.050 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465428+0000", 2024-09-13T05:10:31.050 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9246000000000007e-05 2024-09-13T05:10:31.050 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.050 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:31.050 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.050 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.050 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.050 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11817 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 625664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.050 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.424896+0000", 2024-09-13T05:10:31.050 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.60690818400000002, 2024-09-13T05:10:31.050 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040676439000000002, 2024-09-13T05:10:31.051 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:31.051 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:31.051 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:31.051 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:31.051 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.051 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11817 2024-09-13T05:10:31.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.051 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:31.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:31.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424896+0000", 2024-09-13T05:10:31.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:31.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424896+0000", 2024-09-13T05:10:31.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:31.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424894+0000", 2024-09-13T05:10:31.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:31.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:31.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424901+0000", 2024-09-13T05:10:31.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9070000000000001e-06 2024-09-13T05:10:31.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.053 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:31.053 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424918+0000", 2024-09-13T05:10:31.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7249e-05 2024-09-13T05:10:31.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.053 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.053 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424936+0000", 2024-09-13T05:10:31.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7241e-05 2024-09-13T05:10:31.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.053 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:31.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465460+0000", 2024-09-13T05:10:31.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040524866999999999 2024-09-13T05:10:31.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:31.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465521+0000", 2024-09-13T05:10:31.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0909000000000002e-05 2024-09-13T05:10:31.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:31.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465572+0000", 2024-09-13T05:10:31.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0568000000000001e-05 2024-09-13T05:10:31.054 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.054 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:31.055 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.055 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11818 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 634880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.055 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.425122+0000", 2024-09-13T05:10:31.055 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.60668169800000005, 2024-09-13T05:10:31.055 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040642338, 2024-09-13T05:10:31.055 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:31.055 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:31.056 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:31.056 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:31.056 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.056 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11818 2024-09-13T05:10:31.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.056 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:31.056 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.056 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:31.056 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425122+0000", 2024-09-13T05:10:31.056 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.056 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:31.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425122+0000", 2024-09-13T05:10:31.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:31.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425121+0000", 2024-09-13T05:10:31.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:31.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:31.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425127+0000", 2024-09-13T05:10:31.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4699999999999999e-06 2024-09-13T05:10:31.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:31.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425165+0000", 2024-09-13T05:10:31.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8118999999999999e-05 2024-09-13T05:10:31.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425176+0000", 2024-09-13T05:10:31.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0295000000000001e-05 2024-09-13T05:10:31.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:31.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465610+0000", 2024-09-13T05:10:31.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040434111000000002 2024-09-13T05:10:31.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.059 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.059 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:31.059 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465692+0000", 2024-09-13T05:10:31.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2138000000000005e-05 2024-09-13T05:10:31.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.059 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.059 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:31.059 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465764+0000", 2024-09-13T05:10:31.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2362999999999998e-05 2024-09-13T05:10:31.059 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.059 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:31.059 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.060 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.060 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11820 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 653312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.060 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.425506+0000", 2024-09-13T05:10:31.060 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.60629814800000004, 2024-09-13T05:10:31.060 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040887996000000003, 2024-09-13T05:10:31.060 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:31.060 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:31.060 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:31.061 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:31.061 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.061 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11820 2024-09-13T05:10:31.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.061 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:31.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:31.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425506+0000", 2024-09-13T05:10:31.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:31.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425506+0000", 2024-09-13T05:10:31.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:31.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425504+0000", 2024-09-13T05:10:31.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:31.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:31.063 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425511+0000", 2024-09-13T05:10:31.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4629999999999998e-06 2024-09-13T05:10:31.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.063 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.063 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:31.063 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425525+0000", 2024-09-13T05:10:31.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3871e-05 2024-09-13T05:10:31.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.063 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.063 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.063 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425552+0000", 2024-09-13T05:10:31.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7334999999999998e-05 2024-09-13T05:10:31.064 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.064 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.064 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:31.064 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465972+0000", 2024-09-13T05:10:31.064 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040420353999999999 2024-09-13T05:10:31.064 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.064 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.064 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:31.065 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466173+0000", 2024-09-13T05:10:31.065 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020061600000000001 2024-09-13T05:10:31.065 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.065 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.065 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:31.065 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466394+0000", 2024-09-13T05:10:31.065 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00022045499999999999 2024-09-13T05:10:31.065 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.065 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:31.065 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.065 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.065 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.066 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11821 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 662528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.066 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.425687+0000", 2024-09-13T05:10:31.066 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.60611660499999997, 2024-09-13T05:10:31.066 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040854453999999998, 2024-09-13T05:10:31.066 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:31.066 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:31.066 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:31.066 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:31.066 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.066 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11821 2024-09-13T05:10:31.067 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.067 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:31.067 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.067 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:31.067 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425687+0000", 2024-09-13T05:10:31.067 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.067 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.067 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.067 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:31.068 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425687+0000", 2024-09-13T05:10:31.068 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.068 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.068 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.068 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:31.068 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425686+0000", 2024-09-13T05:10:31.068 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:31.068 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.069 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.069 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:31.069 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425692+0000", 2024-09-13T05:10:31.069 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2639999999999997e-06 2024-09-13T05:10:31.069 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.069 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.069 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:31.069 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425712+0000", 2024-09-13T05:10:31.069 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9990999999999999e-05 2024-09-13T05:10:31.069 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.070 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.070 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.070 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425722+0000", 2024-09-13T05:10:31.070 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5640000000000002e-06 2024-09-13T05:10:31.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.070 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.070 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:31.070 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466412+0000", 2024-09-13T05:10:31.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040690170999999997 2024-09-13T05:10:31.071 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:31.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466477+0000", 2024-09-13T05:10:31.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5321999999999996e-05 2024-09-13T05:10:31.071 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:31.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466542+0000", 2024-09-13T05:10:31.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4338999999999995e-05 2024-09-13T05:10:31.071 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.071 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:31.072 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.072 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.072 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.072 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11822 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 671744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.072 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.425865+0000", 2024-09-13T05:10:31.072 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.60593876899999999, 2024-09-13T05:10:31.072 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040811908000000001, 2024-09-13T05:10:31.072 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:31.072 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:31.072 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:31.072 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:31.072 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.073 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11822 2024-09-13T05:10:31.073 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.073 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:31.073 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.073 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:31.073 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425865+0000", 2024-09-13T05:10:31.073 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.073 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.073 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.073 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:31.073 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425865+0000", 2024-09-13T05:10:31.073 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.073 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.074 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:31.074 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425864+0000", 2024-09-13T05:10:31.074 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:31.074 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.074 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:31.074 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425870+0000", 2024-09-13T05:10:31.074 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3069999999999999e-06 2024-09-13T05:10:31.074 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.074 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:31.074 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425882+0000", 2024-09-13T05:10:31.075 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2123999999999999e-05 2024-09-13T05:10:31.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.075 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.075 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425892+0000", 2024-09-13T05:10:31.075 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3330000000000003e-06 2024-09-13T05:10:31.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.075 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:31.075 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466568+0000", 2024-09-13T05:10:31.075 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040676437000000003 2024-09-13T05:10:31.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.075 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:31.076 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466629+0000", 2024-09-13T05:10:31.076 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0704e-05 2024-09-13T05:10:31.076 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.076 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.076 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:31.076 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466677+0000", 2024-09-13T05:10:31.076 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8186000000000002e-05 2024-09-13T05:10:31.076 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.076 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:31.076 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.076 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.076 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.076 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11823 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 680960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.076 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.426027+0000", 2024-09-13T05:10:31.077 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.60577716000000004, 2024-09-13T05:10:31.077 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040882557999999999, 2024-09-13T05:10:31.077 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:31.077 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:31.077 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:31.077 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:31.077 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.077 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11823 2024-09-13T05:10:31.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.077 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:31.077 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.077 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:31.077 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426027+0000", 2024-09-13T05:10:31.078 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.078 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:31.078 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426027+0000", 2024-09-13T05:10:31.078 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.078 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:31.078 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426025+0000", 2024-09-13T05:10:31.078 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:31.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.078 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:31.079 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426032+0000", 2024-09-13T05:10:31.079 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1140000000000002e-06 2024-09-13T05:10:31.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.079 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.079 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:31.079 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426044+0000", 2024-09-13T05:10:31.079 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2870999999999999e-05 2024-09-13T05:10:31.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.079 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.079 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.079 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426053+0000", 2024-09-13T05:10:31.079 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7620000000000001e-06 2024-09-13T05:10:31.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.080 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.080 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:31.080 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466711+0000", 2024-09-13T05:10:31.080 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040658288000000001 2024-09-13T05:10:31.080 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.080 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.080 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:31.080 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466853+0000", 2024-09-13T05:10:31.080 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014179500000000001 2024-09-13T05:10:31.080 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.080 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.080 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:31.080 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466909+0000", 2024-09-13T05:10:31.081 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5835999999999999e-05 2024-09-13T05:10:31.081 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.081 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:31.081 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.081 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.081 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.081 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11824 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 690176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.081 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.426201+0000", 2024-09-13T05:10:31.081 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.605602486, 2024-09-13T05:10:31.081 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040845895, 2024-09-13T05:10:31.081 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:31.081 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:31.081 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:31.081 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:31.082 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.082 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11824 2024-09-13T05:10:31.082 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.082 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:31.082 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.082 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:31.082 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426201+0000", 2024-09-13T05:10:31.082 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.082 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.082 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.082 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:31.082 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426201+0000", 2024-09-13T05:10:31.082 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.082 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.083 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.083 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:31.083 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426200+0000", 2024-09-13T05:10:31.083 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:31.083 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.083 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.083 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:31.083 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426207+0000", 2024-09-13T05:10:31.083 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1199999999999996e-06 2024-09-13T05:10:31.083 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.083 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.083 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:31.083 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426228+0000", 2024-09-13T05:10:31.084 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1318000000000002e-05 2024-09-13T05:10:31.084 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.084 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.084 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.084 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426238+0000", 2024-09-13T05:10:31.084 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8910000000000007e-06 2024-09-13T05:10:31.084 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.084 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.084 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:31.084 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466932+0000", 2024-09-13T05:10:31.084 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040693952999999998 2024-09-13T05:10:31.084 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.084 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.085 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:31.085 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466990+0000", 2024-09-13T05:10:31.085 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7629e-05 2024-09-13T05:10:31.085 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.085 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.085 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:31.085 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467047+0000", 2024-09-13T05:10:31.085 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7503999999999997e-05 2024-09-13T05:10:31.085 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.085 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:31.085 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.085 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.085 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.085 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11825 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 699392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.086 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.426385+0000", 2024-09-13T05:10:31.086 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.60541823100000003, 2024-09-13T05:10:31.086 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040800628999999998, 2024-09-13T05:10:31.086 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:31.086 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:31.086 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:31.086 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:31.086 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.086 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11825 2024-09-13T05:10:31.086 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.086 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:31.086 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.086 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:31.086 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426385+0000", 2024-09-13T05:10:31.087 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.087 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.087 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:31.087 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426385+0000", 2024-09-13T05:10:31.087 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.087 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.087 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:31.087 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426384+0000", 2024-09-13T05:10:31.087 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:31.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.087 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.087 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:31.088 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426391+0000", 2024-09-13T05:10:31.088 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8000000000000001e-06 2024-09-13T05:10:31.088 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.088 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.088 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:31.088 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426406+0000", 2024-09-13T05:10:31.088 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5310000000000001e-05 2024-09-13T05:10:31.088 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.088 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.088 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.088 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426423+0000", 2024-09-13T05:10:31.088 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7020999999999998e-05 2024-09-13T05:10:31.088 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.089 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.089 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:31.089 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467079+0000", 2024-09-13T05:10:31.089 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040656257000000001 2024-09-13T05:10:31.089 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.089 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.089 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:31.089 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467137+0000", 2024-09-13T05:10:31.089 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7587999999999998e-05 2024-09-13T05:10:31.089 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.089 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.089 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:31.089 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467186+0000", 2024-09-13T05:10:31.090 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9051999999999997e-05 2024-09-13T05:10:31.090 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.090 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:31.090 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.090 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.090 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.090 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11826 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 708608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.090 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.426608+0000", 2024-09-13T05:10:31.090 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.60519561300000002, 2024-09-13T05:10:31.090 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040734543999999998, 2024-09-13T05:10:31.090 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:31.090 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:31.090 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:31.090 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:31.091 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.091 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11826 2024-09-13T05:10:31.091 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.091 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:31.091 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.091 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:31.091 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426608+0000", 2024-09-13T05:10:31.091 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.091 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.091 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.092 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:31.092 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426608+0000", 2024-09-13T05:10:31.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.092 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.092 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:31.092 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426607+0000", 2024-09-13T05:10:31.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:31.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.092 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.092 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:31.092 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426615+0000", 2024-09-13T05:10:31.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8439999999999998e-06 2024-09-13T05:10:31.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:31.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426644+0000", 2024-09-13T05:10:31.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9249000000000001e-05 2024-09-13T05:10:31.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426655+0000", 2024-09-13T05:10:31.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0587e-05 2024-09-13T05:10:31.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.094 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:31.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467228+0000", 2024-09-13T05:10:31.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040573472999999999 2024-09-13T05:10:31.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.094 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:31.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467298+0000", 2024-09-13T05:10:31.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9777999999999995e-05 2024-09-13T05:10:31.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.095 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.095 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:31.095 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467343+0000", 2024-09-13T05:10:31.095 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4889999999999999e-05 2024-09-13T05:10:31.095 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.095 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:31.095 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.095 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.095 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.095 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11827 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 717824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.095 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.426789+0000", 2024-09-13T05:10:31.096 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.60501469299999999, 2024-09-13T05:10:31.096 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040701486000000002, 2024-09-13T05:10:31.096 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:31.096 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:31.096 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:31.096 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:31.096 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.096 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11827 2024-09-13T05:10:31.096 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.096 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:31.096 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.097 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:31.097 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426789+0000", 2024-09-13T05:10:31.097 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.097 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.097 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.097 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:31.097 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426789+0000", 2024-09-13T05:10:31.097 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.097 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.098 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.098 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:31.098 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426788+0000", 2024-09-13T05:10:31.098 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:31.098 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.098 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.098 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:31.098 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426794+0000", 2024-09-13T05:10:31.098 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2450000000000003e-06 2024-09-13T05:10:31.098 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.098 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.098 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:31.098 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426806+0000", 2024-09-13T05:10:31.099 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2272999999999999e-05 2024-09-13T05:10:31.099 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.099 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.099 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.099 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426815+0000", 2024-09-13T05:10:31.099 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2579999999999995e-06 2024-09-13T05:10:31.099 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.099 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.099 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:31.100 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467376+0000", 2024-09-13T05:10:31.100 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040561209000000001 2024-09-13T05:10:31.100 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.100 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.100 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:31.100 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467438+0000", 2024-09-13T05:10:31.100 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2402000000000003e-05 2024-09-13T05:10:31.100 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.100 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.101 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:31.101 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467491+0000", 2024-09-13T05:10:31.101 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2237000000000001e-05 2024-09-13T05:10:31.101 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.101 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:31.101 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.101 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.101 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.101 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11828 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 727040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.101 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.426957+0000", 2024-09-13T05:10:31.102 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.60484708499999995, 2024-09-13T05:10:31.102 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040663008, 2024-09-13T05:10:31.102 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:31.102 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:31.102 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:31.102 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:31.102 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.103 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11828 2024-09-13T05:10:31.103 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.103 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:31.103 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.103 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:31.103 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426957+0000", 2024-09-13T05:10:31.103 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.103 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.103 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.103 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:31.103 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426957+0000", 2024-09-13T05:10:31.103 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.104 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.104 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.104 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:31.104 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426956+0000", 2024-09-13T05:10:31.104 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:31.104 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.104 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.104 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:31.104 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426962+0000", 2024-09-13T05:10:31.104 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9269999999999999e-06 2024-09-13T05:10:31.104 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.104 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.104 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:31.105 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426976+0000", 2024-09-13T05:10:31.105 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3698e-05 2024-09-13T05:10:31.105 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.105 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.105 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.105 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426985+0000", 2024-09-13T05:10:31.105 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9339999999999995e-06 2024-09-13T05:10:31.105 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.105 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.105 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:31.105 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467506+0000", 2024-09-13T05:10:31.105 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040521333 2024-09-13T05:10:31.105 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.106 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.106 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:31.106 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467573+0000", 2024-09-13T05:10:31.106 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6385999999999998e-05 2024-09-13T05:10:31.106 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.106 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.106 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:31.106 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467620+0000", 2024-09-13T05:10:31.106 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6823999999999998e-05 2024-09-13T05:10:31.106 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.106 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:31.106 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.107 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.107 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.107 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11829 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 736256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.107 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.427143+0000", 2024-09-13T05:10:31.107 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.60466068900000003, 2024-09-13T05:10:31.107 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040604647000000001, 2024-09-13T05:10:31.107 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:31.107 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:31.107 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:31.107 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:31.107 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.107 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11829 2024-09-13T05:10:31.107 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.107 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:31.108 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.108 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:31.108 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.427143+0000", 2024-09-13T05:10:31.108 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.108 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.108 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.108 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:31.108 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.427143+0000", 2024-09-13T05:10:31.108 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.108 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.108 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.108 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:31.108 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.427142+0000", 2024-09-13T05:10:31.109 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:31.109 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.109 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.109 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:31.109 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.427148+0000", 2024-09-13T05:10:31.109 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4649999999999999e-06 2024-09-13T05:10:31.109 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.109 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.109 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:31.109 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.427161+0000", 2024-09-13T05:10:31.109 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2376e-05 2024-09-13T05:10:31.109 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.109 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.109 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.110 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.427179+0000", 2024-09-13T05:10:31.110 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8910999999999999e-05 2024-09-13T05:10:31.110 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.110 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.110 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:31.110 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467638+0000", 2024-09-13T05:10:31.110 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040458360999999998 2024-09-13T05:10:31.110 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.110 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.110 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:31.110 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467700+0000", 2024-09-13T05:10:31.110 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1824999999999998e-05 2024-09-13T05:10:31.110 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.110 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.111 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:31.111 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467748+0000", 2024-09-13T05:10:31.111 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8034000000000001e-05 2024-09-13T05:10:31.111 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.111 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:31.111 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.111 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.111 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.111 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:12087 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 746496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.111 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.439201+0000", 2024-09-13T05:10:31.111 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.59260272700000005, 2024-09-13T05:10:31.111 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040712844999999998, 2024-09-13T05:10:31.111 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:31.111 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:31.112 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:31.112 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:31.112 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.112 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 12087 2024-09-13T05:10:31.112 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.112 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:31.112 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.112 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:31.112 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439201+0000", 2024-09-13T05:10:31.112 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.112 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.112 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.112 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:31.112 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439201+0000", 2024-09-13T05:10:31.113 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.113 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.113 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.113 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:31.113 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439201+0000", 2024-09-13T05:10:31.113 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.113 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.113 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.113 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:31.113 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439204+0000", 2024-09-13T05:10:31.113 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.134e-06 2024-09-13T05:10:31.113 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.113 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.114 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:31.114 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439211+0000", 2024-09-13T05:10:31.114 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7179999999999996e-06 2024-09-13T05:10:31.114 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.114 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.114 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.114 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439216+0000", 2024-09-13T05:10:31.114 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.865e-06 2024-09-13T05:10:31.114 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.114 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.114 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:31.114 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.479784+0000", 2024-09-13T05:10:31.114 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040567446 2024-09-13T05:10:31.114 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.115 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.115 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:31.115 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.479854+0000", 2024-09-13T05:10:31.115 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0145e-05 2024-09-13T05:10:31.115 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.115 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.115 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:31.115 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.479914+0000", 2024-09-13T05:10:31.115 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9997999999999997e-05 2024-09-13T05:10:31.115 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.115 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:31.115 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.115 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.116 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.116 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:12088 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 755712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.116 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.439221+0000", 2024-09-13T05:10:31.116 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.59258311600000002, 2024-09-13T05:10:31.116 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040838821999999997, 2024-09-13T05:10:31.116 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:31.116 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:31.116 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:31.116 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:31.116 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.116 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 12088 2024-09-13T05:10:31.116 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.116 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:31.116 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.117 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:31.117 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439221+0000", 2024-09-13T05:10:31.117 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.117 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.117 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.117 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:31.117 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439221+0000", 2024-09-13T05:10:31.117 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.117 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.117 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.117 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:31.117 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439220+0000", 2024-09-13T05:10:31.117 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.117 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.118 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.118 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:31.118 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439223+0000", 2024-09-13T05:10:31.118 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9340000000000002e-06 2024-09-13T05:10:31.118 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.118 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.118 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:31.118 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439229+0000", 2024-09-13T05:10:31.118 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8560000000000003e-06 2024-09-13T05:10:31.118 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.118 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.118 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.118 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439234+0000", 2024-09-13T05:10:31.118 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.899e-06 2024-09-13T05:10:31.119 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.119 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.119 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:31.119 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.479948+0000", 2024-09-13T05:10:31.119 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040714528 2024-09-13T05:10:31.119 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.119 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.119 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:31.119 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.480009+0000", 2024-09-13T05:10:31.119 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0789999999999999e-05 2024-09-13T05:10:31.119 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.119 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.119 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:31.119 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.480059+0000", 2024-09-13T05:10:31.119 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0288999999999999e-05 2024-09-13T05:10:31.120 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.120 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:31.120 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.120 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.120 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.120 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:12089 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 764928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.120 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.439250+0000", 2024-09-13T05:10:31.120 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.59255330100000003, 2024-09-13T05:10:31.120 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040978741999999999, 2024-09-13T05:10:31.120 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:31.120 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:31.120 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:31.120 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:31.120 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.121 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 12089 2024-09-13T05:10:31.121 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.121 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:31.121 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.121 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:31.121 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439250+0000", 2024-09-13T05:10:31.121 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.121 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.121 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.121 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:31.121 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439250+0000", 2024-09-13T05:10:31.121 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.121 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.122 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.122 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:31.122 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439250+0000", 2024-09-13T05:10:31.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.122 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.122 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.122 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:31.122 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439253+0000", 2024-09-13T05:10:31.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0259999999999999e-06 2024-09-13T05:10:31.122 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.122 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.122 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:31.122 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439266+0000", 2024-09-13T05:10:31.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2894000000000001e-05 2024-09-13T05:10:31.123 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.123 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.123 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.123 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439271+0000", 2024-09-13T05:10:31.123 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5949999999999998e-06 2024-09-13T05:10:31.123 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.123 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.123 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:31.124 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.480079+0000", 2024-09-13T05:10:31.124 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040807678 2024-09-13T05:10:31.124 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.124 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.124 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:31.124 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.480150+0000", 2024-09-13T05:10:31.124 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0736999999999997e-05 2024-09-13T05:10:31.124 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.124 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.124 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:31.124 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.480229+0000", 2024-09-13T05:10:31.124 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9313000000000004e-05 2024-09-13T05:10:31.124 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.124 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:31.125 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.125 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.125 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.125 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:12090 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 774144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.125 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.439277+0000", 2024-09-13T05:10:31.125 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.59252690699999999, 2024-09-13T05:10:31.125 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.041098896000000003, 2024-09-13T05:10:31.125 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:31.125 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:31.125 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:31.126 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:31.126 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.126 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 12090 2024-09-13T05:10:31.126 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.126 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:31.126 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.126 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:31.126 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439277+0000", 2024-09-13T05:10:31.126 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.126 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.126 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.127 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:31.127 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439277+0000", 2024-09-13T05:10:31.127 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.127 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.127 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.127 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:31.127 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439276+0000", 2024-09-13T05:10:31.127 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.127 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.127 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.127 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:31.127 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439279+0000", 2024-09-13T05:10:31.128 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0740000000000001e-06 2024-09-13T05:10:31.128 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.128 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.128 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:31.128 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439293+0000", 2024-09-13T05:10:31.128 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3176000000000001e-05 2024-09-13T05:10:31.128 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.128 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.128 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.128 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439298+0000", 2024-09-13T05:10:31.128 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3210000000000004e-06 2024-09-13T05:10:31.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.129 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.129 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:31.129 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.480265+0000", 2024-09-13T05:10:31.129 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040966726000000002 2024-09-13T05:10:31.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.129 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.129 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:31.129 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.480324+0000", 2024-09-13T05:10:31.129 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9416000000000002e-05 2024-09-13T05:10:31.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.129 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.129 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:31.130 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.480376+0000", 2024-09-13T05:10:31.130 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1743000000000002e-05 2024-09-13T05:10:31.130 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.130 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:31.130 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.130 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.130 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.130 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:12091 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 783360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.130 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.439303+0000", 2024-09-13T05:10:31.130 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.59250071699999995, 2024-09-13T05:10:31.130 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.041223893999999997, 2024-09-13T05:10:31.130 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:31.130 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:31.131 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:31.131 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:31.131 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.131 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 12091 2024-09-13T05:10:31.131 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.131 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:31.131 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.131 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:31.131 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439303+0000", 2024-09-13T05:10:31.131 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.131 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.131 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.131 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:31.132 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439303+0000", 2024-09-13T05:10:31.132 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:31.132 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.132 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.132 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:31.132 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439303+0000", 2024-09-13T05:10:31.132 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.132 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.132 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.133 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:31.133 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439305+0000", 2024-09-13T05:10:31.133 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8940000000000002e-06 2024-09-13T05:10:31.133 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.133 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.133 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:31.133 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439312+0000", 2024-09-13T05:10:31.133 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2210000000000002e-06 2024-09-13T05:10:31.133 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.133 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.133 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.134 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439317+0000", 2024-09-13T05:10:31.134 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0939999999999998e-06 2024-09-13T05:10:31.134 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.134 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.134 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:31.134 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.480395+0000", 2024-09-13T05:10:31.134 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.041078587 2024-09-13T05:10:31.134 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.134 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.134 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:31.134 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.480469+0000", 2024-09-13T05:10:31.135 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3188000000000005e-05 2024-09-13T05:10:31.135 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:31.135 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:31.135 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:31.135 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.480527+0000", 2024-09-13T05:10:31.135 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8335999999999998e-05 2024-09-13T05:10:31.135 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.135 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:31.135 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.136 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:31.136 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:31.136 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:31.137 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:10:31.138 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:31.134+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:31.139 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:10:31.239 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:31.235+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:31.274 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:31.274 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:31.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.275 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14116 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.275 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.753138+0000", 2024-09-13T05:10:31.275 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49678455999999999, 2024-09-13T05:10:31.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49681236699999998, 2024-09-13T05:10:31.275 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.275 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.275 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.276 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.276 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.276 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14116 2024-09-13T05:10:31.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.276 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753138+0000", 2024-09-13T05:10:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753138+0000", 2024-09-13T05:10:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749231+0000", 2024-09-13T05:10:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9960933 2024-09-13T05:10:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753144+0000", 2024-09-13T05:10:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039127800000000003 2024-09-13T05:10:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753156+0000", 2024-09-13T05:10:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1411e-05 2024-09-13T05:10:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753166+0000", 2024-09-13T05:10:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0441999999999999e-05 2024-09-13T05:10:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812977+0000", 2024-09-13T05:10:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059811376999999999 2024-09-13T05:10:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812986+0000", 2024-09-13T05:10:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6400000000000003e-06 2024-09-13T05:10:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14180 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:10:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49235452099999999, 2024-09-13T05:10:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49244611999999999, 2024-09-13T05:10:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14180 2024-09-13T05:10:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:10:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:10:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:10:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757570+0000", 2024-09-13T05:10:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3470000000000001e-06 2024-09-13T05:10:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757576+0000", 2024-09-13T05:10:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5550000000000002e-06 2024-09-13T05:10:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757580+0000", 2024-09-13T05:10:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6519999999999997e-06 2024-09-13T05:10:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814975+0000", 2024-09-13T05:10:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057394349999999997 2024-09-13T05:10:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814981+0000", 2024-09-13T05:10:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4119999999999998e-06 2024-09-13T05:10:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14297 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:10:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.484805447, 2024-09-13T05:10:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48493277800000001, 2024-09-13T05:10:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14297 2024-09-13T05:10:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:10:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:10:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:10:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765118+0000", 2024-09-13T05:10:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4190000000000001e-06 2024-09-13T05:10:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765121+0000", 2024-09-13T05:10:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6110000000000001e-06 2024-09-13T05:10:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765124+0000", 2024-09-13T05:10:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3720000000000001e-06 2024-09-13T05:10:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816535+0000", 2024-09-13T05:10:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051410890000000001 2024-09-13T05:10:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816556+0000", 2024-09-13T05:10:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0551e-05 2024-09-13T05:10:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14329 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.772988+0000", 2024-09-13T05:10:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47693423699999998, 2024-09-13T05:10:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47709536000000002, 2024-09-13T05:10:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14329 2024-09-13T05:10:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.772988+0000", 2024-09-13T05:10:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.772988+0000", 2024-09-13T05:10:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.772988+0000", 2024-09-13T05:10:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.772993+0000", 2024-09-13T05:10:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4569999999999996e-06 2024-09-13T05:10:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.772997+0000", 2024-09-13T05:10:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4970000000000001e-06 2024-09-13T05:10:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773000+0000", 2024-09-13T05:10:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9110000000000002e-06 2024-09-13T05:10:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818642+0000", 2024-09-13T05:10:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045642175 2024-09-13T05:10:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818649+0000", 2024-09-13T05:10:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9979999999999997e-06 2024-09-13T05:10:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14361 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.777357+0000", 2024-09-13T05:10:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.472565226, 2024-09-13T05:10:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.472760454, 2024-09-13T05:10:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14361 2024-09-13T05:10:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777357+0000", 2024-09-13T05:10:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777357+0000", 2024-09-13T05:10:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777357+0000", 2024-09-13T05:10:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777360+0000", 2024-09-13T05:10:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8720000000000002e-06 2024-09-13T05:10:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777367+0000", 2024-09-13T05:10:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6210000000000004e-06 2024-09-13T05:10:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777372+0000", 2024-09-13T05:10:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8459999999999999e-06 2024-09-13T05:10:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820046+0000", 2024-09-13T05:10:31.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042673572999999999 2024-09-13T05:10:31.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820055+0000", 2024-09-13T05:10:31.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.594e-06 2024-09-13T05:10:31.296 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.296 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.296 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.296 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14422 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.297 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.785145+0000", 2024-09-13T05:10:31.297 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46477719499999998, 2024-09-13T05:10:31.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.465009636, 2024-09-13T05:10:31.297 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.297 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.297 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14422 2024-09-13T05:10:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785145+0000", 2024-09-13T05:10:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785145+0000", 2024-09-13T05:10:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785145+0000", 2024-09-13T05:10:31.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785147+0000", 2024-09-13T05:10:31.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2290000000000002e-06 2024-09-13T05:10:31.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785153+0000", 2024-09-13T05:10:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0090000000000004e-06 2024-09-13T05:10:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785158+0000", 2024-09-13T05:10:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6700000000000002e-06 2024-09-13T05:10:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821301+0000", 2024-09-13T05:10:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.036143438 2024-09-13T05:10:31.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821312+0000", 2024-09-13T05:10:31.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0244999999999999e-05 2024-09-13T05:10:31.301 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.301 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.301 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14525 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.801236+0000", 2024-09-13T05:10:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44868651799999998, 2024-09-13T05:10:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.448967797, 2024-09-13T05:10:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14525 2024-09-13T05:10:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801236+0000", 2024-09-13T05:10:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801236+0000", 2024-09-13T05:10:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801236+0000", 2024-09-13T05:10:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801237+0000", 2024-09-13T05:10:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.511e-06 2024-09-13T05:10:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801240+0000", 2024-09-13T05:10:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9900000000000002e-06 2024-09-13T05:10:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801244+0000", 2024-09-13T05:10:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3730000000000001e-06 2024-09-13T05:10:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822513+0000", 2024-09-13T05:10:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021269402999999999 2024-09-13T05:10:31.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822524+0000", 2024-09-13T05:10:31.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0519999999999999e-05 2024-09-13T05:10:31.306 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.306 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.306 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.307 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14585 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.307 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.809357+0000", 2024-09-13T05:10:31.307 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44056523800000003, 2024-09-13T05:10:31.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.44088240099999998, 2024-09-13T05:10:31.307 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.307 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.307 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.307 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.308 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.308 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14585 2024-09-13T05:10:31.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.308 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809357+0000", 2024-09-13T05:10:31.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809357+0000", 2024-09-13T05:10:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809357+0000", 2024-09-13T05:10:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809359+0000", 2024-09-13T05:10:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6129999999999998e-06 2024-09-13T05:10:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809365+0000", 2024-09-13T05:10:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9619999999999998e-06 2024-09-13T05:10:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809371+0000", 2024-09-13T05:10:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3469999999999998e-06 2024-09-13T05:10:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823775+0000", 2024-09-13T05:10:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014403813 2024-09-13T05:10:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823778+0000", 2024-09-13T05:10:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6449999999999998e-06 2024-09-13T05:10:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14118 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.753181+0000", 2024-09-13T05:10:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49674144999999997, 2024-09-13T05:10:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49711047800000002, 2024-09-13T05:10:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14118 2024-09-13T05:10:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753181+0000", 2024-09-13T05:10:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753181+0000", 2024-09-13T05:10:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753181+0000", 2024-09-13T05:10:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753183+0000", 2024-09-13T05:10:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6469999999999998e-06 2024-09-13T05:10:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753187+0000", 2024-09-13T05:10:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1880000000000004e-06 2024-09-13T05:10:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753191+0000", 2024-09-13T05:10:31.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3069999999999998e-06 2024-09-13T05:10:31.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813128+0000", 2024-09-13T05:10:31.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059936805000000003 2024-09-13T05:10:31.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813136+0000", 2024-09-13T05:10:31.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8219999999999996e-06 2024-09-13T05:10:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14181 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761125+0000", 2024-09-13T05:10:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48879751100000002, 2024-09-13T05:10:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.489200148, 2024-09-13T05:10:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14181 2024-09-13T05:10:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761125+0000", 2024-09-13T05:10:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761125+0000", 2024-09-13T05:10:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757584+0000", 2024-09-13T05:10:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.996459 2024-09-13T05:10:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761131+0000", 2024-09-13T05:10:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035465589999999999 2024-09-13T05:10:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761140+0000", 2024-09-13T05:10:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3859999999999996e-06 2024-09-13T05:10:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761145+0000", 2024-09-13T05:10:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4369999999999998e-06 2024-09-13T05:10:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815004+0000", 2024-09-13T05:10:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.053858497999999998 2024-09-13T05:10:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815010+0000", 2024-09-13T05:10:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2670000000000003e-06 2024-09-13T05:10:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14298 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:10:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48479605399999998, 2024-09-13T05:10:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48524054500000002, 2024-09-13T05:10:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14298 2024-09-13T05:10:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:10:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:10:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:10:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765128+0000", 2024-09-13T05:10:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4139999999999999e-06 2024-09-13T05:10:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765130+0000", 2024-09-13T05:10:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6809999999999998e-06 2024-09-13T05:10:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765133+0000", 2024-09-13T05:10:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9270000000000001e-06 2024-09-13T05:10:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816592+0000", 2024-09-13T05:10:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051459029000000003 2024-09-13T05:10:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816601+0000", 2024-09-13T05:10:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9819999999999997e-06 2024-09-13T05:10:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14330 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.773002+0000", 2024-09-13T05:10:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47692020299999999, 2024-09-13T05:10:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47739747799999999, 2024-09-13T05:10:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14330 2024-09-13T05:10:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773002+0000", 2024-09-13T05:10:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773002+0000", 2024-09-13T05:10:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773002+0000", 2024-09-13T05:10:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773004+0000", 2024-09-13T05:10:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7129999999999999e-06 2024-09-13T05:10:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773007+0000", 2024-09-13T05:10:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8399999999999999e-06 2024-09-13T05:10:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773009+0000", 2024-09-13T05:10:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.745e-06 2024-09-13T05:10:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818695+0000", 2024-09-13T05:10:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045685304000000003 2024-09-13T05:10:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818703+0000", 2024-09-13T05:10:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4509999999999992e-06 2024-09-13T05:10:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14362 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.780986+0000", 2024-09-13T05:10:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46893646500000002, 2024-09-13T05:10:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.469446476, 2024-09-13T05:10:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14362 2024-09-13T05:10:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.780986+0000", 2024-09-13T05:10:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.780986+0000", 2024-09-13T05:10:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777376+0000", 2024-09-13T05:10:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9963899 2024-09-13T05:10:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.780992+0000", 2024-09-13T05:10:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003616232 2024-09-13T05:10:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781004+0000", 2024-09-13T05:10:31.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1460999999999999e-05 2024-09-13T05:10:31.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781012+0000", 2024-09-13T05:10:31.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2470000000000008e-06 2024-09-13T05:10:31.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820085+0000", 2024-09-13T05:10:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039072843000000003 2024-09-13T05:10:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820088+0000", 2024-09-13T05:10:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3079999999999999e-06 2024-09-13T05:10:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14423 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.334 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.785171+0000", 2024-09-13T05:10:31.334 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46475184800000002, 2024-09-13T05:10:31.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.46529459000000001, 2024-09-13T05:10:31.334 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.334 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.334 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14423 2024-09-13T05:10:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785171+0000", 2024-09-13T05:10:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785171+0000", 2024-09-13T05:10:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785170+0000", 2024-09-13T05:10:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785173+0000", 2024-09-13T05:10:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6010000000000002e-06 2024-09-13T05:10:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785182+0000", 2024-09-13T05:10:31.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0180000000000007e-06 2024-09-13T05:10:31.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785187+0000", 2024-09-13T05:10:31.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8420000000000004e-06 2024-09-13T05:10:31.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821342+0000", 2024-09-13T05:10:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.036155627000000003 2024-09-13T05:10:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821346+0000", 2024-09-13T05:10:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4929999999999998e-06 2024-09-13T05:10:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.339 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14526 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.339 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.801247+0000", 2024-09-13T05:10:31.339 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44867591000000001, 2024-09-13T05:10:31.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.449257507, 2024-09-13T05:10:31.339 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.339 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.339 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14526 2024-09-13T05:10:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801247+0000", 2024-09-13T05:10:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801247+0000", 2024-09-13T05:10:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801246+0000", 2024-09-13T05:10:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801248+0000", 2024-09-13T05:10:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3599999999999999e-06 2024-09-13T05:10:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801251+0000", 2024-09-13T05:10:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5099999999999999e-06 2024-09-13T05:10:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801254+0000", 2024-09-13T05:10:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1470000000000001e-06 2024-09-13T05:10:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822560+0000", 2024-09-13T05:10:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021305561000000001 2024-09-13T05:10:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822564+0000", 2024-09-13T05:10:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.878e-06 2024-09-13T05:10:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14586 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.809376+0000", 2024-09-13T05:10:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44054628400000001, 2024-09-13T05:10:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.44116048299999999, 2024-09-13T05:10:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14586 2024-09-13T05:10:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809376+0000", 2024-09-13T05:10:31.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809376+0000", 2024-09-13T05:10:31.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809376+0000", 2024-09-13T05:10:31.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809378+0000", 2024-09-13T05:10:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6199999999999999e-06 2024-09-13T05:10:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809385+0000", 2024-09-13T05:10:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9269999999999999e-06 2024-09-13T05:10:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809391+0000", 2024-09-13T05:10:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3070000000000002e-06 2024-09-13T05:10:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823815+0000", 2024-09-13T05:10:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014424401999999999 2024-09-13T05:10:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823823+0000", 2024-09-13T05:10:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.435e-06 2024-09-13T05:10:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14120 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.753194+0000", 2024-09-13T05:10:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49672883899999998, 2024-09-13T05:10:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49737748799999998, 2024-09-13T05:10:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14120 2024-09-13T05:10:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753194+0000", 2024-09-13T05:10:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753194+0000", 2024-09-13T05:10:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753193+0000", 2024-09-13T05:10:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753196+0000", 2024-09-13T05:10:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2050000000000001e-06 2024-09-13T05:10:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753201+0000", 2024-09-13T05:10:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2410000000000003e-06 2024-09-13T05:10:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753205+0000", 2024-09-13T05:10:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6580000000000001e-06 2024-09-13T05:10:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813166+0000", 2024-09-13T05:10:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059960878000000002 2024-09-13T05:10:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813174+0000", 2024-09-13T05:10:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1799999999999996e-06 2024-09-13T05:10:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14182 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761151+0000", 2024-09-13T05:10:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48877180399999998, 2024-09-13T05:10:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48946704899999999, 2024-09-13T05:10:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14182 2024-09-13T05:10:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761151+0000", 2024-09-13T05:10:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761151+0000", 2024-09-13T05:10:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761150+0000", 2024-09-13T05:10:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761152+0000", 2024-09-13T05:10:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2369999999999999e-06 2024-09-13T05:10:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761156+0000", 2024-09-13T05:10:31.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4470000000000002e-06 2024-09-13T05:10:31.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761159+0000", 2024-09-13T05:10:31.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9450000000000002e-06 2024-09-13T05:10:31.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815031+0000", 2024-09-13T05:10:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.053871713000000002 2024-09-13T05:10:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815037+0000", 2024-09-13T05:10:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0260000000000004e-06 2024-09-13T05:10:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14299 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:10:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48478728999999998, 2024-09-13T05:10:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48553017900000001, 2024-09-13T05:10:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14299 2024-09-13T05:10:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:10:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:10:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:10:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765136+0000", 2024-09-13T05:10:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5230000000000001e-06 2024-09-13T05:10:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765139+0000", 2024-09-13T05:10:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.672e-06 2024-09-13T05:10:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765142+0000", 2024-09-13T05:10:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6680000000000001e-06 2024-09-13T05:10:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816632+0000", 2024-09-13T05:10:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051489886999999998 2024-09-13T05:10:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816643+0000", 2024-09-13T05:10:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1457000000000001e-05 2024-09-13T05:10:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14331 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.362 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.773011+0000", 2024-09-13T05:10:31.362 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47691103299999998, 2024-09-13T05:10:31.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47769905299999998, 2024-09-13T05:10:31.362 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.362 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.362 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.362 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.362 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.362 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14331 2024-09-13T05:10:31.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.362 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773011+0000", 2024-09-13T05:10:31.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773011+0000", 2024-09-13T05:10:31.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773011+0000", 2024-09-13T05:10:31.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773013+0000", 2024-09-13T05:10:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.73e-06 2024-09-13T05:10:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773018+0000", 2024-09-13T05:10:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6519999999999997e-06 2024-09-13T05:10:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773020+0000", 2024-09-13T05:10:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7590000000000002e-06 2024-09-13T05:10:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818743+0000", 2024-09-13T05:10:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.04572271 2024-09-13T05:10:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818752+0000", 2024-09-13T05:10:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1819999999999995e-06 2024-09-13T05:10:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14363 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.781022+0000", 2024-09-13T05:10:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.468900557, 2024-09-13T05:10:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.46973958500000002, 2024-09-13T05:10:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14363 2024-09-13T05:10:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.367 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781022+0000", 2024-09-13T05:10:31.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781022+0000", 2024-09-13T05:10:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781021+0000", 2024-09-13T05:10:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781025+0000", 2024-09-13T05:10:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9369999999999997e-06 2024-09-13T05:10:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781032+0000", 2024-09-13T05:10:31.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5230000000000001e-06 2024-09-13T05:10:31.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781037+0000", 2024-09-13T05:10:31.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6489999999999996e-06 2024-09-13T05:10:31.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820122+0000", 2024-09-13T05:10:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039085140999999997 2024-09-13T05:10:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820132+0000", 2024-09-13T05:10:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2229999999999996e-06 2024-09-13T05:10:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.371 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14424 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.371 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.785191+0000", 2024-09-13T05:10:31.371 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46473166599999999, 2024-09-13T05:10:31.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.46562083799999998, 2024-09-13T05:10:31.371 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.371 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.371 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.371 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.371 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.372 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14424 2024-09-13T05:10:31.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.372 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785191+0000", 2024-09-13T05:10:31.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785191+0000", 2024-09-13T05:10:31.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785190+0000", 2024-09-13T05:10:31.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785196+0000", 2024-09-13T05:10:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1019999999999996e-06 2024-09-13T05:10:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785201+0000", 2024-09-13T05:10:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3550000000000004e-06 2024-09-13T05:10:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785205+0000", 2024-09-13T05:10:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4469999999999999e-06 2024-09-13T05:10:31.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821378+0000", 2024-09-13T05:10:31.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.036172759999999998 2024-09-13T05:10:31.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821388+0000", 2024-09-13T05:10:31.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.028e-05 2024-09-13T05:10:31.375 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.376 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.376 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.376 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14527 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.376 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.801257+0000", 2024-09-13T05:10:31.376 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44866593300000002, 2024-09-13T05:10:31.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.44962075200000001, 2024-09-13T05:10:31.376 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.377 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.377 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14527 2024-09-13T05:10:31.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.377 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801257+0000", 2024-09-13T05:10:31.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801257+0000", 2024-09-13T05:10:31.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801256+0000", 2024-09-13T05:10:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801258+0000", 2024-09-13T05:10:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.404e-06 2024-09-13T05:10:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801261+0000", 2024-09-13T05:10:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1999999999999999e-06 2024-09-13T05:10:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801264+0000", 2024-09-13T05:10:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7879999999999998e-06 2024-09-13T05:10:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822598+0000", 2024-09-13T05:10:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021333943000000001 2024-09-13T05:10:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822607+0000", 2024-09-13T05:10:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1810000000000007e-06 2024-09-13T05:10:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14588 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.809398+0000", 2024-09-13T05:10:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44052463600000002, 2024-09-13T05:10:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.44157469199999999, 2024-09-13T05:10:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14588 2024-09-13T05:10:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809398+0000", 2024-09-13T05:10:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809398+0000", 2024-09-13T05:10:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809397+0000", 2024-09-13T05:10:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809400+0000", 2024-09-13T05:10:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7080000000000002e-06 2024-09-13T05:10:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809407+0000", 2024-09-13T05:10:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.494e-06 2024-09-13T05:10:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809413+0000", 2024-09-13T05:10:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.737e-06 2024-09-13T05:10:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823856+0000", 2024-09-13T05:10:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014442745999999999 2024-09-13T05:10:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823860+0000", 2024-09-13T05:10:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5449999999999999e-06 2024-09-13T05:10:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14122 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.753210+0000", 2024-09-13T05:10:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49671243399999998, 2024-09-13T05:10:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49783046399999997, 2024-09-13T05:10:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14122 2024-09-13T05:10:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753210+0000", 2024-09-13T05:10:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753210+0000", 2024-09-13T05:10:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753210+0000", 2024-09-13T05:10:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753212+0000", 2024-09-13T05:10:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7530000000000002e-06 2024-09-13T05:10:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753225+0000", 2024-09-13T05:10:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2775000000000001e-05 2024-09-13T05:10:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753231+0000", 2024-09-13T05:10:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7339999999999996e-06 2024-09-13T05:10:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813202+0000", 2024-09-13T05:10:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059971071000000001 2024-09-13T05:10:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813210+0000", 2024-09-13T05:10:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9980000000000003e-06 2024-09-13T05:10:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14183 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761162+0000", 2024-09-13T05:10:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.488760904, 2024-09-13T05:10:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.489948049, 2024-09-13T05:10:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14183 2024-09-13T05:10:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761162+0000", 2024-09-13T05:10:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761162+0000", 2024-09-13T05:10:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761161+0000", 2024-09-13T05:10:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761163+0000", 2024-09-13T05:10:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.807e-06 2024-09-13T05:10:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761166+0000", 2024-09-13T05:10:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8940000000000002e-06 2024-09-13T05:10:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761169+0000", 2024-09-13T05:10:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8509999999999999e-06 2024-09-13T05:10:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815057+0000", 2024-09-13T05:10:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.053888568999999997 2024-09-13T05:10:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815063+0000", 2024-09-13T05:10:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0619999999999997e-06 2024-09-13T05:10:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14300 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:10:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48477848000000001, 2024-09-13T05:10:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48603327499999999, 2024-09-13T05:10:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14300 2024-09-13T05:10:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:10:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:10:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:10:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765145+0000", 2024-09-13T05:10:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.488e-06 2024-09-13T05:10:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765148+0000", 2024-09-13T05:10:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6620000000000001e-06 2024-09-13T05:10:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765151+0000", 2024-09-13T05:10:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6419999999999999e-06 2024-09-13T05:10:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816677+0000", 2024-09-13T05:10:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051526776000000003 2024-09-13T05:10:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816689+0000", 2024-09-13T05:10:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1634000000000001e-05 2024-09-13T05:10:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14332 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.773022+0000", 2024-09-13T05:10:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.476900082, 2024-09-13T05:10:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47819640099999999, 2024-09-13T05:10:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14332 2024-09-13T05:10:31.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.399 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773022+0000", 2024-09-13T05:10:31.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773022+0000", 2024-09-13T05:10:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773022+0000", 2024-09-13T05:10:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773024+0000", 2024-09-13T05:10:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5510000000000001e-06 2024-09-13T05:10:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773027+0000", 2024-09-13T05:10:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8320000000000002e-06 2024-09-13T05:10:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773029+0000", 2024-09-13T05:10:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.588e-06 2024-09-13T05:10:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818784+0000", 2024-09-13T05:10:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045754536999999998 2024-09-13T05:10:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818788+0000", 2024-09-13T05:10:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9519999999999996e-06 2024-09-13T05:10:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.403 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14364 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.403 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.781042+0000", 2024-09-13T05:10:31.403 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46888002400000001, 2024-09-13T05:10:31.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47024400999999999, 2024-09-13T05:10:31.403 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.403 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.403 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14364 2024-09-13T05:10:31.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.404 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781042+0000", 2024-09-13T05:10:31.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781042+0000", 2024-09-13T05:10:31.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781042+0000", 2024-09-13T05:10:31.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781045+0000", 2024-09-13T05:10:31.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9059999999999998e-06 2024-09-13T05:10:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781051+0000", 2024-09-13T05:10:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1199999999999999e-06 2024-09-13T05:10:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781056+0000", 2024-09-13T05:10:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0599999999999998e-06 2024-09-13T05:10:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820160+0000", 2024-09-13T05:10:31.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039104351000000002 2024-09-13T05:10:31.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820164+0000", 2024-09-13T05:10:31.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5300000000000001e-06 2024-09-13T05:10:31.407 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.407 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.408 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.408 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14425 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.408 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.785209+0000", 2024-09-13T05:10:31.408 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46471338099999998, 2024-09-13T05:10:31.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.46621196199999998, 2024-09-13T05:10:31.408 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.408 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.409 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14425 2024-09-13T05:10:31.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.409 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785209+0000", 2024-09-13T05:10:31.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785209+0000", 2024-09-13T05:10:31.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785209+0000", 2024-09-13T05:10:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785211+0000", 2024-09-13T05:10:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1440000000000001e-06 2024-09-13T05:10:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785219+0000", 2024-09-13T05:10:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7389999999999999e-06 2024-09-13T05:10:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785223+0000", 2024-09-13T05:10:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.668e-06 2024-09-13T05:10:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821419+0000", 2024-09-13T05:10:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.036195584000000003 2024-09-13T05:10:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821422+0000", 2024-09-13T05:10:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4910000000000001e-06 2024-09-13T05:10:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14529 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.801266+0000", 2024-09-13T05:10:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44865642900000002, 2024-09-13T05:10:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45019177999999999, 2024-09-13T05:10:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14529 2024-09-13T05:10:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801266+0000", 2024-09-13T05:10:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801266+0000", 2024-09-13T05:10:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801266+0000", 2024-09-13T05:10:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801273+0000", 2024-09-13T05:10:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8809999999999998e-06 2024-09-13T05:10:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801277+0000", 2024-09-13T05:10:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.758e-06 2024-09-13T05:10:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801281+0000", 2024-09-13T05:10:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3050000000000001e-06 2024-09-13T05:10:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822650+0000", 2024-09-13T05:10:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021369191999999999 2024-09-13T05:10:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822657+0000", 2024-09-13T05:10:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9090000000000003e-06 2024-09-13T05:10:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14590 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.809418+0000", 2024-09-13T05:10:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44050458100000001, 2024-09-13T05:10:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.44208940099999999, 2024-09-13T05:10:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14590 2024-09-13T05:10:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809418+0000", 2024-09-13T05:10:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809418+0000", 2024-09-13T05:10:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809418+0000", 2024-09-13T05:10:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809420+0000", 2024-09-13T05:10:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4949999999999998e-06 2024-09-13T05:10:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809428+0000", 2024-09-13T05:10:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6990000000000003e-06 2024-09-13T05:10:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809435+0000", 2024-09-13T05:10:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1130000000000003e-06 2024-09-13T05:10:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823889+0000", 2024-09-13T05:10:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014453941 2024-09-13T05:10:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823898+0000", 2024-09-13T05:10:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8580000000000006e-06 2024-09-13T05:10:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14124 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.753234+0000", 2024-09-13T05:10:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.496688346, 2024-09-13T05:10:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49831734599999999, 2024-09-13T05:10:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14124 2024-09-13T05:10:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753234+0000", 2024-09-13T05:10:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753234+0000", 2024-09-13T05:10:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753234+0000", 2024-09-13T05:10:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753236+0000", 2024-09-13T05:10:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1500000000000002e-06 2024-09-13T05:10:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753243+0000", 2024-09-13T05:10:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9229999999999996e-06 2024-09-13T05:10:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753256+0000", 2024-09-13T05:10:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3215e-05 2024-09-13T05:10:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813238+0000", 2024-09-13T05:10:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059981825000000003 2024-09-13T05:10:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813246+0000", 2024-09-13T05:10:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7079999999999997e-06 2024-09-13T05:10:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14184 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761171+0000", 2024-09-13T05:10:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.488751243, 2024-09-13T05:10:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49043588500000002, 2024-09-13T05:10:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14184 2024-09-13T05:10:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761171+0000", 2024-09-13T05:10:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761171+0000", 2024-09-13T05:10:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761171+0000", 2024-09-13T05:10:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761173+0000", 2024-09-13T05:10:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7880000000000001e-06 2024-09-13T05:10:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761176+0000", 2024-09-13T05:10:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9239999999999999e-06 2024-09-13T05:10:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761180+0000", 2024-09-13T05:10:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7600000000000002e-06 2024-09-13T05:10:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815086+0000", 2024-09-13T05:10:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.053905476000000001 2024-09-13T05:10:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815092+0000", 2024-09-13T05:10:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6050000000000003e-06 2024-09-13T05:10:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14301 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:10:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.484769846, 2024-09-13T05:10:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48650710699999999, 2024-09-13T05:10:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14301 2024-09-13T05:10:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:10:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:10:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765152+0000", 2024-09-13T05:10:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765154+0000", 2024-09-13T05:10:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.449e-06 2024-09-13T05:10:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765157+0000", 2024-09-13T05:10:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6809999999999998e-06 2024-09-13T05:10:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765159+0000", 2024-09-13T05:10:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6060000000000001e-06 2024-09-13T05:10:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816722+0000", 2024-09-13T05:10:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051562535 2024-09-13T05:10:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816733+0000", 2024-09-13T05:10:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1678000000000001e-05 2024-09-13T05:10:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14333 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.773031+0000", 2024-09-13T05:10:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47689126399999998, 2024-09-13T05:10:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47866171800000001, 2024-09-13T05:10:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14333 2024-09-13T05:10:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773031+0000", 2024-09-13T05:10:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773031+0000", 2024-09-13T05:10:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773031+0000", 2024-09-13T05:10:31.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773032+0000", 2024-09-13T05:10:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.497e-06 2024-09-13T05:10:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773035+0000", 2024-09-13T05:10:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6649999999999999e-06 2024-09-13T05:10:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773038+0000", 2024-09-13T05:10:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5220000000000002e-06 2024-09-13T05:10:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818821+0000", 2024-09-13T05:10:31.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045783050999999998 2024-09-13T05:10:31.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818829+0000", 2024-09-13T05:10:31.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6629999999999999e-06 2024-09-13T05:10:31.438 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.438 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14365 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.781060+0000", 2024-09-13T05:10:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46886214300000001, 2024-09-13T05:10:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47067110000000001, 2024-09-13T05:10:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14365 2024-09-13T05:10:31.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.440 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781060+0000", 2024-09-13T05:10:31.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781060+0000", 2024-09-13T05:10:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781060+0000", 2024-09-13T05:10:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781067+0000", 2024-09-13T05:10:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0360000000000001e-06 2024-09-13T05:10:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781073+0000", 2024-09-13T05:10:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8209999999999998e-06 2024-09-13T05:10:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781078+0000", 2024-09-13T05:10:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2209999999999996e-06 2024-09-13T05:10:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820198+0000", 2024-09-13T05:10:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039119490999999999 2024-09-13T05:10:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820204+0000", 2024-09-13T05:10:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8680000000000001e-06 2024-09-13T05:10:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.444 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14426 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.444 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.785227+0000", 2024-09-13T05:10:31.444 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46469517599999999, 2024-09-13T05:10:31.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.46655554799999999, 2024-09-13T05:10:31.444 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.444 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.445 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.445 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.445 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14426 2024-09-13T05:10:31.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.445 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785227+0000", 2024-09-13T05:10:31.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785227+0000", 2024-09-13T05:10:31.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785227+0000", 2024-09-13T05:10:31.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785229+0000", 2024-09-13T05:10:31.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3530000000000002e-06 2024-09-13T05:10:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785239+0000", 2024-09-13T05:10:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1910000000000006e-06 2024-09-13T05:10:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785244+0000", 2024-09-13T05:10:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0010000000000001e-06 2024-09-13T05:10:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821454+0000", 2024-09-13T05:10:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.036210541999999998 2024-09-13T05:10:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821464+0000", 2024-09-13T05:10:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0253e-05 2024-09-13T05:10:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14531 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.801283+0000", 2024-09-13T05:10:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44863915199999999, 2024-09-13T05:10:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45054066500000001, 2024-09-13T05:10:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14531 2024-09-13T05:10:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801283+0000", 2024-09-13T05:10:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801283+0000", 2024-09-13T05:10:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801283+0000", 2024-09-13T05:10:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801287+0000", 2024-09-13T05:10:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3540000000000002e-06 2024-09-13T05:10:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801291+0000", 2024-09-13T05:10:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6890000000000002e-06 2024-09-13T05:10:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801296+0000", 2024-09-13T05:10:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6009999999999997e-06 2024-09-13T05:10:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822693+0000", 2024-09-13T05:10:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021397642000000001 2024-09-13T05:10:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822703+0000", 2024-09-13T05:10:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2129999999999997e-06 2024-09-13T05:10:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14592 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.809439+0000", 2024-09-13T05:10:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.440483085, 2024-09-13T05:10:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.44242022399999997, 2024-09-13T05:10:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14592 2024-09-13T05:10:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809439+0000", 2024-09-13T05:10:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809439+0000", 2024-09-13T05:10:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809439+0000", 2024-09-13T05:10:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809442+0000", 2024-09-13T05:10:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6350000000000002e-06 2024-09-13T05:10:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809447+0000", 2024-09-13T05:10:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9100000000000002e-06 2024-09-13T05:10:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809453+0000", 2024-09-13T05:10:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3149999999999999e-06 2024-09-13T05:10:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823927+0000", 2024-09-13T05:10:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014474143 2024-09-13T05:10:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823930+0000", 2024-09-13T05:10:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4379999999999999e-06 2024-09-13T05:10:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14125 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.753265+0000", 2024-09-13T05:10:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.496657554, 2024-09-13T05:10:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49862753700000001, 2024-09-13T05:10:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14125 2024-09-13T05:10:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753265+0000", 2024-09-13T05:10:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753265+0000", 2024-09-13T05:10:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753264+0000", 2024-09-13T05:10:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753268+0000", 2024-09-13T05:10:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5130000000000001e-06 2024-09-13T05:10:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753275+0000", 2024-09-13T05:10:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3499999999999999e-06 2024-09-13T05:10:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753281+0000", 2024-09-13T05:10:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9100000000000002e-06 2024-09-13T05:10:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813273+0000", 2024-09-13T05:10:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059991742000000001 2024-09-13T05:10:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813281+0000", 2024-09-13T05:10:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6650000000000003e-06 2024-09-13T05:10:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14185 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761184+0000", 2024-09-13T05:10:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48873832299999997, 2024-09-13T05:10:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49074267300000002, 2024-09-13T05:10:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14185 2024-09-13T05:10:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761184+0000", 2024-09-13T05:10:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761184+0000", 2024-09-13T05:10:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761184+0000", 2024-09-13T05:10:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761190+0000", 2024-09-13T05:10:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0650000000000004e-06 2024-09-13T05:10:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761196+0000", 2024-09-13T05:10:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1879999999999999e-06 2024-09-13T05:10:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761200+0000", 2024-09-13T05:10:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4109999999999998e-06 2024-09-13T05:10:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815119+0000", 2024-09-13T05:10:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.053918206000000003 2024-09-13T05:10:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815125+0000", 2024-09-13T05:10:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8259999999999998e-06 2024-09-13T05:10:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14302 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:10:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48476126899999999, 2024-09-13T05:10:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48679795599999998, 2024-09-13T05:10:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14302 2024-09-13T05:10:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:10:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:10:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:10:31.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765162+0000", 2024-09-13T05:10:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4589999999999999e-06 2024-09-13T05:10:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765165+0000", 2024-09-13T05:10:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6019999999999998e-06 2024-09-13T05:10:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765168+0000", 2024-09-13T05:10:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.497e-06 2024-09-13T05:10:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816764+0000", 2024-09-13T05:10:31.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051596722999999997 2024-09-13T05:10:31.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816776+0000", 2024-09-13T05:10:31.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1967000000000001e-05 2024-09-13T05:10:31.470 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.470 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14334 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.773040+0000", 2024-09-13T05:10:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47688275899999999, 2024-09-13T05:10:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47895327199999999, 2024-09-13T05:10:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.472 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14334 2024-09-13T05:10:31.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.472 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773040+0000", 2024-09-13T05:10:31.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773040+0000", 2024-09-13T05:10:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773039+0000", 2024-09-13T05:10:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773041+0000", 2024-09-13T05:10:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.418e-06 2024-09-13T05:10:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773043+0000", 2024-09-13T05:10:31.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5830000000000001e-06 2024-09-13T05:10:31.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773046+0000", 2024-09-13T05:10:31.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6599999999999999e-06 2024-09-13T05:10:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818864+0000", 2024-09-13T05:10:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045817360000000001 2024-09-13T05:10:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818867+0000", 2024-09-13T05:10:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.721e-06 2024-09-13T05:10:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.476 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14366 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.476 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.781083+0000", 2024-09-13T05:10:31.476 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.468839805, 2024-09-13T05:10:31.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.470943942, 2024-09-13T05:10:31.476 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.476 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.476 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.477 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14366 2024-09-13T05:10:31.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.477 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781083+0000", 2024-09-13T05:10:31.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781083+0000", 2024-09-13T05:10:31.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781082+0000", 2024-09-13T05:10:31.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781085+0000", 2024-09-13T05:10:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6639999999999998e-06 2024-09-13T05:10:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781091+0000", 2024-09-13T05:10:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2260000000000002e-06 2024-09-13T05:10:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781097+0000", 2024-09-13T05:10:31.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4489999999999998e-06 2024-09-13T05:10:31.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820238+0000", 2024-09-13T05:10:31.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039141390999999998 2024-09-13T05:10:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820242+0000", 2024-09-13T05:10:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7359999999999999e-06 2024-09-13T05:10:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14427 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.785249+0000", 2024-09-13T05:10:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.464673424, 2024-09-13T05:10:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.46680995400000003, 2024-09-13T05:10:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14427 2024-09-13T05:10:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785249+0000", 2024-09-13T05:10:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785249+0000", 2024-09-13T05:10:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785249+0000", 2024-09-13T05:10:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785251+0000", 2024-09-13T05:10:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.757e-06 2024-09-13T05:10:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785257+0000", 2024-09-13T05:10:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2209999999999996e-06 2024-09-13T05:10:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785261+0000", 2024-09-13T05:10:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5519999999999998e-06 2024-09-13T05:10:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821492+0000", 2024-09-13T05:10:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.036231096999999997 2024-09-13T05:10:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821496+0000", 2024-09-13T05:10:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3179999999999998e-06 2024-09-13T05:10:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14533 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.805064+0000", 2024-09-13T05:10:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.444858107, 2024-09-13T05:10:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.44702835000000002, 2024-09-13T05:10:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14533 2024-09-13T05:10:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805064+0000", 2024-09-13T05:10:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805064+0000", 2024-09-13T05:10:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801300+0000", 2024-09-13T05:10:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9962354 2024-09-13T05:10:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805071+0000", 2024-09-13T05:10:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037715800000000001 2024-09-13T05:10:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805081+0000", 2024-09-13T05:10:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.611e-06 2024-09-13T05:10:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805093+0000", 2024-09-13T05:10:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2490000000000001e-05 2024-09-13T05:10:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822733+0000", 2024-09-13T05:10:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017639232000000001 2024-09-13T05:10:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822738+0000", 2024-09-13T05:10:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5770000000000001e-06 2024-09-13T05:10:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14594 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.809457+0000", 2024-09-13T05:10:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.440465143, 2024-09-13T05:10:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.44266813399999999, 2024-09-13T05:10:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14594 2024-09-13T05:10:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809457+0000", 2024-09-13T05:10:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809457+0000", 2024-09-13T05:10:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809457+0000", 2024-09-13T05:10:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809460+0000", 2024-09-13T05:10:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6539999999999999e-06 2024-09-13T05:10:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809466+0000", 2024-09-13T05:10:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0870000000000003e-06 2024-09-13T05:10:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809471+0000", 2024-09-13T05:10:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1429999999999997e-06 2024-09-13T05:10:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823960+0000", 2024-09-13T05:10:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014488793 2024-09-13T05:10:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823969+0000", 2024-09-13T05:10:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1840000000000005e-06 2024-09-13T05:10:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14126 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.753286+0000", 2024-09-13T05:10:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49663648500000002, 2024-09-13T05:10:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49887365900000002, 2024-09-13T05:10:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14126 2024-09-13T05:10:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753286+0000", 2024-09-13T05:10:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753286+0000", 2024-09-13T05:10:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753286+0000", 2024-09-13T05:10:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753288+0000", 2024-09-13T05:10:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8600000000000001e-06 2024-09-13T05:10:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753295+0000", 2024-09-13T05:10:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.365e-06 2024-09-13T05:10:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753300+0000", 2024-09-13T05:10:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.989e-06 2024-09-13T05:10:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813310+0000", 2024-09-13T05:10:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060010242999999998 2024-09-13T05:10:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813318+0000", 2024-09-13T05:10:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3049999999999993e-06 2024-09-13T05:10:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14186 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761205+0000", 2024-09-13T05:10:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.488717766, 2024-09-13T05:10:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49098743900000003, 2024-09-13T05:10:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.499 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.499 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.499 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14186 2024-09-13T05:10:31.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.499 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761205+0000", 2024-09-13T05:10:31.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761205+0000", 2024-09-13T05:10:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761204+0000", 2024-09-13T05:10:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761207+0000", 2024-09-13T05:10:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9069999999999999e-06 2024-09-13T05:10:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761213+0000", 2024-09-13T05:10:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9209999999999997e-06 2024-09-13T05:10:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761218+0000", 2024-09-13T05:10:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.729e-06 2024-09-13T05:10:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815156+0000", 2024-09-13T05:10:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.053937754999999997 2024-09-13T05:10:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815162+0000", 2024-09-13T05:10:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5150000000000003e-06 2024-09-13T05:10:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14303 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:10:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48475293200000003, 2024-09-13T05:10:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48705660000000001, 2024-09-13T05:10:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14303 2024-09-13T05:10:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:10:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:10:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765169+0000", 2024-09-13T05:10:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765171+0000", 2024-09-13T05:10:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2899999999999999e-06 2024-09-13T05:10:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765173+0000", 2024-09-13T05:10:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-13T05:10:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765176+0000", 2024-09-13T05:10:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.016e-06 2024-09-13T05:10:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816811+0000", 2024-09-13T05:10:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051634684 2024-09-13T05:10:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816840+0000", 2024-09-13T05:10:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8690000000000001e-05 2024-09-13T05:10:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.507 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.507 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14335 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.507 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.773048+0000", 2024-09-13T05:10:31.507 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47687436900000002, 2024-09-13T05:10:31.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47921370600000002, 2024-09-13T05:10:31.507 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.507 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.507 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.507 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14335 2024-09-13T05:10:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773048+0000", 2024-09-13T05:10:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773048+0000", 2024-09-13T05:10:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773048+0000", 2024-09-13T05:10:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773050+0000", 2024-09-13T05:10:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6139999999999999e-06 2024-09-13T05:10:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773052+0000", 2024-09-13T05:10:31.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6919999999999998e-06 2024-09-13T05:10:31.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773055+0000", 2024-09-13T05:10:31.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3099999999999999e-06 2024-09-13T05:10:31.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818903+0000", 2024-09-13T05:10:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045848104000000001 2024-09-13T05:10:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818912+0000", 2024-09-13T05:10:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2650000000000002e-06 2024-09-13T05:10:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.512 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14367 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.512 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.781101+0000", 2024-09-13T05:10:31.512 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46882167299999999, 2024-09-13T05:10:31.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47119319100000001, 2024-09-13T05:10:31.512 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.512 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.512 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.512 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.512 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.512 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14367 2024-09-13T05:10:31.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.513 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781101+0000", 2024-09-13T05:10:31.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781101+0000", 2024-09-13T05:10:31.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781100+0000", 2024-09-13T05:10:31.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781103+0000", 2024-09-13T05:10:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.616e-06 2024-09-13T05:10:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781109+0000", 2024-09-13T05:10:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6489999999999996e-06 2024-09-13T05:10:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781113+0000", 2024-09-13T05:10:31.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.741e-06 2024-09-13T05:10:31.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820277+0000", 2024-09-13T05:10:31.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039163491000000002 2024-09-13T05:10:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820286+0000", 2024-09-13T05:10:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4190000000000008e-06 2024-09-13T05:10:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14428 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.785265+0000", 2024-09-13T05:10:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46465732500000001, 2024-09-13T05:10:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.467062598, 2024-09-13T05:10:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14428 2024-09-13T05:10:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785265+0000", 2024-09-13T05:10:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785265+0000", 2024-09-13T05:10:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785265+0000", 2024-09-13T05:10:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785267+0000", 2024-09-13T05:10:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.452e-06 2024-09-13T05:10:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785272+0000", 2024-09-13T05:10:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9840000000000001e-06 2024-09-13T05:10:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785276+0000", 2024-09-13T05:10:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.805e-06 2024-09-13T05:10:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821527+0000", 2024-09-13T05:10:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.036251068999999997 2024-09-13T05:10:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821534+0000", 2024-09-13T05:10:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.311e-06 2024-09-13T05:10:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14535 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.805106+0000", 2024-09-13T05:10:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44481606899999998, 2024-09-13T05:10:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.44725444199999997, 2024-09-13T05:10:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14535 2024-09-13T05:10:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805106+0000", 2024-09-13T05:10:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805106+0000", 2024-09-13T05:10:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805106+0000", 2024-09-13T05:10:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805109+0000", 2024-09-13T05:10:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7860000000000001e-06 2024-09-13T05:10:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805113+0000", 2024-09-13T05:10:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9210000000000002e-06 2024-09-13T05:10:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805116+0000", 2024-09-13T05:10:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3210000000000001e-06 2024-09-13T05:10:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822770+0000", 2024-09-13T05:10:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017654431000000002 2024-09-13T05:10:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822778+0000", 2024-09-13T05:10:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5549999999999997e-06 2024-09-13T05:10:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14595 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.809475+0000", 2024-09-13T05:10:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44044726499999998, 2024-09-13T05:10:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.44292026899999998, 2024-09-13T05:10:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14595 2024-09-13T05:10:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809475+0000", 2024-09-13T05:10:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809475+0000", 2024-09-13T05:10:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809475+0000", 2024-09-13T05:10:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809477+0000", 2024-09-13T05:10:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5940000000000001e-06 2024-09-13T05:10:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809483+0000", 2024-09-13T05:10:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8529999999999997e-06 2024-09-13T05:10:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809489+0000", 2024-09-13T05:10:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3430000000000003e-06 2024-09-13T05:10:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.824000+0000", 2024-09-13T05:10:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014511268000000001 2024-09-13T05:10:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.824003+0000", 2024-09-13T05:10:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.495e-06 2024-09-13T05:10:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14127 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.753305+0000", 2024-09-13T05:10:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49661793999999998, 2024-09-13T05:10:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49912337800000001, 2024-09-13T05:10:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14127 2024-09-13T05:10:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753305+0000", 2024-09-13T05:10:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753305+0000", 2024-09-13T05:10:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753304+0000", 2024-09-13T05:10:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753307+0000", 2024-09-13T05:10:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8559999999999998e-06 2024-09-13T05:10:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753313+0000", 2024-09-13T05:10:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9989999999999997e-06 2024-09-13T05:10:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753318+0000", 2024-09-13T05:10:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9799999999999998e-06 2024-09-13T05:10:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813346+0000", 2024-09-13T05:10:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060028098000000002 2024-09-13T05:10:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813354+0000", 2024-09-13T05:10:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5020000000000003e-06 2024-09-13T05:10:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14187 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761223+0000", 2024-09-13T05:10:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48869991899999998, 2024-09-13T05:10:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49131023400000001, 2024-09-13T05:10:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14187 2024-09-13T05:10:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761223+0000", 2024-09-13T05:10:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761223+0000", 2024-09-13T05:10:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761222+0000", 2024-09-13T05:10:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761225+0000", 2024-09-13T05:10:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8289999999999999e-06 2024-09-13T05:10:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761231+0000", 2024-09-13T05:10:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7969999999999997e-06 2024-09-13T05:10:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761236+0000", 2024-09-13T05:10:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7509999999999999e-06 2024-09-13T05:10:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815191+0000", 2024-09-13T05:10:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.053955871000000002 2024-09-13T05:10:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815198+0000", 2024-09-13T05:10:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2500000000000003e-06 2024-09-13T05:10:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14304 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:10:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48473006400000002, 2024-09-13T05:10:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48737540800000001, 2024-09-13T05:10:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14304 2024-09-13T05:10:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:10:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:10:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:10:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765195+0000", 2024-09-13T05:10:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6599999999999999e-06 2024-09-13T05:10:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765200+0000", 2024-09-13T05:10:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.356e-06 2024-09-13T05:10:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765205+0000", 2024-09-13T05:10:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3000000000000001e-06 2024-09-13T05:10:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816901+0000", 2024-09-13T05:10:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051695451000000003 2024-09-13T05:10:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816963+0000", 2024-09-13T05:10:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2694000000000007e-05 2024-09-13T05:10:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14336 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.773057+0000", 2024-09-13T05:10:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47686597200000003, 2024-09-13T05:10:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47954381200000001, 2024-09-13T05:10:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14336 2024-09-13T05:10:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773057+0000", 2024-09-13T05:10:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773057+0000", 2024-09-13T05:10:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773056+0000", 2024-09-13T05:10:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773058+0000", 2024-09-13T05:10:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.345e-06 2024-09-13T05:10:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773060+0000", 2024-09-13T05:10:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6479999999999999e-06 2024-09-13T05:10:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773063+0000", 2024-09-13T05:10:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7360000000000001e-06 2024-09-13T05:10:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818941+0000", 2024-09-13T05:10:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.04587803 2024-09-13T05:10:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818947+0000", 2024-09-13T05:10:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9540000000000001e-06 2024-09-13T05:10:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14368 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.781119+0000", 2024-09-13T05:10:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46880298500000001, 2024-09-13T05:10:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47151495599999999, 2024-09-13T05:10:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14368 2024-09-13T05:10:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781119+0000", 2024-09-13T05:10:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781119+0000", 2024-09-13T05:10:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781119+0000", 2024-09-13T05:10:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781122+0000", 2024-09-13T05:10:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5330000000000001e-06 2024-09-13T05:10:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781128+0000", 2024-09-13T05:10:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0850000000000002e-06 2024-09-13T05:10:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781133+0000", 2024-09-13T05:10:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8439999999999997e-06 2024-09-13T05:10:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820316+0000", 2024-09-13T05:10:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039183585999999999 2024-09-13T05:10:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820320+0000", 2024-09-13T05:10:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1849999999999997e-06 2024-09-13T05:10:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14429 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.785279+0000", 2024-09-13T05:10:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46464314299999998, 2024-09-13T05:10:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.46738743300000002, 2024-09-13T05:10:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14429 2024-09-13T05:10:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785279+0000", 2024-09-13T05:10:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785279+0000", 2024-09-13T05:10:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785279+0000", 2024-09-13T05:10:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785281+0000", 2024-09-13T05:10:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.092e-06 2024-09-13T05:10:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785286+0000", 2024-09-13T05:10:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5539999999999999e-06 2024-09-13T05:10:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785290+0000", 2024-09-13T05:10:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1470000000000003e-06 2024-09-13T05:10:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821563+0000", 2024-09-13T05:10:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.036273221000000001 2024-09-13T05:10:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821567+0000", 2024-09-13T05:10:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.456e-06 2024-09-13T05:10:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14537 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.805119+0000", 2024-09-13T05:10:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.444803526, 2024-09-13T05:10:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.447581758, 2024-09-13T05:10:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14537 2024-09-13T05:10:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805119+0000", 2024-09-13T05:10:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805119+0000", 2024-09-13T05:10:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805119+0000", 2024-09-13T05:10:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805120+0000", 2024-09-13T05:10:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9039999999999999e-06 2024-09-13T05:10:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805124+0000", 2024-09-13T05:10:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1370000000000002e-06 2024-09-13T05:10:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805126+0000", 2024-09-13T05:10:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-13T05:10:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822826+0000", 2024-09-13T05:10:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017700218 2024-09-13T05:10:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822832+0000", 2024-09-13T05:10:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7690000000000002e-06 2024-09-13T05:10:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14597 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.809493+0000", 2024-09-13T05:10:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44042937100000001, 2024-09-13T05:10:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.44323989200000002, 2024-09-13T05:10:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14597 2024-09-13T05:10:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809493+0000", 2024-09-13T05:10:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809493+0000", 2024-09-13T05:10:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809492+0000", 2024-09-13T05:10:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809495+0000", 2024-09-13T05:10:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8820000000000001e-06 2024-09-13T05:10:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809501+0000", 2024-09-13T05:10:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9789999999999998e-06 2024-09-13T05:10:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809506+0000", 2024-09-13T05:10:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.147e-06 2024-09-13T05:10:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.824034+0000", 2024-09-13T05:10:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014527527 2024-09-13T05:10:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.824043+0000", 2024-09-13T05:10:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9760000000000001e-06 2024-09-13T05:10:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14092 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.745306+0000", 2024-09-13T05:10:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.504616811, 2024-09-13T05:10:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50746156200000003, 2024-09-13T05:10:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14092 2024-09-13T05:10:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745306+0000", 2024-09-13T05:10:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745306+0000", 2024-09-13T05:10:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745305+0000", 2024-09-13T05:10:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745308+0000", 2024-09-13T05:10:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2780000000000002e-06 2024-09-13T05:10:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745315+0000", 2024-09-13T05:10:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-09-13T05:10:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745321+0000", 2024-09-13T05:10:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.66e-06 2024-09-13T05:10:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812111+0000", 2024-09-13T05:10:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066790634000000002 2024-09-13T05:10:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812122+0000", 2024-09-13T05:10:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1344e-05 2024-09-13T05:10:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14128 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.753322+0000", 2024-09-13T05:10:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49659999599999999, 2024-09-13T05:10:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49947875899999999, 2024-09-13T05:10:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14128 2024-09-13T05:10:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753322+0000", 2024-09-13T05:10:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753322+0000", 2024-09-13T05:10:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753322+0000", 2024-09-13T05:10:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753325+0000", 2024-09-13T05:10:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7870000000000002e-06 2024-09-13T05:10:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753337+0000", 2024-09-13T05:10:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2548000000000001e-05 2024-09-13T05:10:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753343+0000", 2024-09-13T05:10:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3079999999999998e-06 2024-09-13T05:10:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813381+0000", 2024-09-13T05:10:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060038651999999998 2024-09-13T05:10:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813389+0000", 2024-09-13T05:10:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8909999999999995e-06 2024-09-13T05:10:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14188 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761240+0000", 2024-09-13T05:10:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48868243, 2024-09-13T05:10:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49159362299999998, 2024-09-13T05:10:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14188 2024-09-13T05:10:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761240+0000", 2024-09-13T05:10:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761240+0000", 2024-09-13T05:10:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761240+0000", 2024-09-13T05:10:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761242+0000", 2024-09-13T05:10:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6860000000000002e-06 2024-09-13T05:10:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761248+0000", 2024-09-13T05:10:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9170000000000003e-06 2024-09-13T05:10:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761252+0000", 2024-09-13T05:10:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1629999999999998e-06 2024-09-13T05:10:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815218+0000", 2024-09-13T05:10:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.053965199999999998 2024-09-13T05:10:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815224+0000", 2024-09-13T05:10:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2589999999999997e-06 2024-09-13T05:10:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14305 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765209+0000", 2024-09-13T05:10:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48471356599999998, 2024-09-13T05:10:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48766058000000001, 2024-09-13T05:10:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14305 2024-09-13T05:10:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765209+0000", 2024-09-13T05:10:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765209+0000", 2024-09-13T05:10:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765209+0000", 2024-09-13T05:10:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765214+0000", 2024-09-13T05:10:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8499999999999999e-06 2024-09-13T05:10:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765220+0000", 2024-09-13T05:10:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.147e-06 2024-09-13T05:10:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765224+0000", 2024-09-13T05:10:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3850000000000004e-06 2024-09-13T05:10:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.817030+0000", 2024-09-13T05:10:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051805622000000003 2024-09-13T05:10:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.817035+0000", 2024-09-13T05:10:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1159999999999998e-06 2024-09-13T05:10:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14337 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.773073+0000", 2024-09-13T05:10:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47684898199999998, 2024-09-13T05:10:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.479848304, 2024-09-13T05:10:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14337 2024-09-13T05:10:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773073+0000", 2024-09-13T05:10:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773073+0000", 2024-09-13T05:10:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773073+0000", 2024-09-13T05:10:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773075+0000", 2024-09-13T05:10:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8670000000000001e-06 2024-09-13T05:10:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773078+0000", 2024-09-13T05:10:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1939999999999998e-06 2024-09-13T05:10:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773081+0000", 2024-09-13T05:10:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6129999999999998e-06 2024-09-13T05:10:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818981+0000", 2024-09-13T05:10:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045900573 2024-09-13T05:10:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818988+0000", 2024-09-13T05:10:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7549999999999997e-06 2024-09-13T05:10:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14369 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.781137+0000", 2024-09-13T05:10:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.468785387, 2024-09-13T05:10:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47184374600000001, 2024-09-13T05:10:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14369 2024-09-13T05:10:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781137+0000", 2024-09-13T05:10:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781137+0000", 2024-09-13T05:10:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781137+0000", 2024-09-13T05:10:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781139+0000", 2024-09-13T05:10:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7020000000000001e-06 2024-09-13T05:10:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781145+0000", 2024-09-13T05:10:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9120000000000003e-06 2024-09-13T05:10:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781150+0000", 2024-09-13T05:10:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6859999999999997e-06 2024-09-13T05:10:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820354+0000", 2024-09-13T05:10:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039204334 2024-09-13T05:10:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820364+0000", 2024-09-13T05:10:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5840000000000001e-06 2024-09-13T05:10:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14539 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.805129+0000", 2024-09-13T05:10:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44479391600000001, 2024-09-13T05:10:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.44788832699999997, 2024-09-13T05:10:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14539 2024-09-13T05:10:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805129+0000", 2024-09-13T05:10:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805129+0000", 2024-09-13T05:10:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805128+0000", 2024-09-13T05:10:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805130+0000", 2024-09-13T05:10:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5269999999999999e-06 2024-09-13T05:10:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805133+0000", 2024-09-13T05:10:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8720000000000002e-06 2024-09-13T05:10:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805135+0000", 2024-09-13T05:10:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7149999999999998e-06 2024-09-13T05:10:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822872+0000", 2024-09-13T05:10:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017736519999999999 2024-09-13T05:10:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822882+0000", 2024-09-13T05:10:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6169999999999996e-06 2024-09-13T05:10:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14601 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.809527+0000", 2024-09-13T05:10:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44039563300000001, 2024-09-13T05:10:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.44352735300000001, 2024-09-13T05:10:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14601 2024-09-13T05:10:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809527+0000", 2024-09-13T05:10:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809527+0000", 2024-09-13T05:10:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809526+0000", 2024-09-13T05:10:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809534+0000", 2024-09-13T05:10:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7389999999999999e-06 2024-09-13T05:10:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809541+0000", 2024-09-13T05:10:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.182e-06 2024-09-13T05:10:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809547+0000", 2024-09-13T05:10:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4569999999999996e-06 2024-09-13T05:10:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.824072+0000", 2024-09-13T05:10:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014525166000000001 2024-09-13T05:10:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.824076+0000", 2024-09-13T05:10:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5580000000000001e-06 2024-09-13T05:10:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14093 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.745337+0000", 2024-09-13T05:10:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50458572099999999, 2024-09-13T05:10:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50775043200000003, 2024-09-13T05:10:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14093 2024-09-13T05:10:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745337+0000", 2024-09-13T05:10:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745337+0000", 2024-09-13T05:10:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745336+0000", 2024-09-13T05:10:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745340+0000", 2024-09-13T05:10:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6330000000000002e-06 2024-09-13T05:10:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745349+0000", 2024-09-13T05:10:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8599999999999999e-06 2024-09-13T05:10:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745357+0000", 2024-09-13T05:10:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1629999999999996e-06 2024-09-13T05:10:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812154+0000", 2024-09-13T05:10:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066796849000000005 2024-09-13T05:10:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812162+0000", 2024-09-13T05:10:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1009999999999992e-06 2024-09-13T05:10:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14129 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.753348+0000", 2024-09-13T05:10:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.496574872, 2024-09-13T05:10:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49977400300000002, 2024-09-13T05:10:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14129 2024-09-13T05:10:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753348+0000", 2024-09-13T05:10:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753348+0000", 2024-09-13T05:10:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753347+0000", 2024-09-13T05:10:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753350+0000", 2024-09-13T05:10:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2720000000000002e-06 2024-09-13T05:10:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753360+0000", 2024-09-13T05:10:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.064e-06 2024-09-13T05:10:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753365+0000", 2024-09-13T05:10:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1630000000000004e-06 2024-09-13T05:10:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813416+0000", 2024-09-13T05:10:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060051128000000002 2024-09-13T05:10:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813423+0000", 2024-09-13T05:10:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6140000000000003e-06 2024-09-13T05:10:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14189 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761256+0000", 2024-09-13T05:10:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48866628600000001, 2024-09-13T05:10:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49190161100000002, 2024-09-13T05:10:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14189 2024-09-13T05:10:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761256+0000", 2024-09-13T05:10:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761256+0000", 2024-09-13T05:10:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761256+0000", 2024-09-13T05:10:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761259+0000", 2024-09-13T05:10:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8830000000000002e-06 2024-09-13T05:10:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761264+0000", 2024-09-13T05:10:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2619999999999998e-06 2024-09-13T05:10:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761268+0000", 2024-09-13T05:10:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.578e-06 2024-09-13T05:10:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815251+0000", 2024-09-13T05:10:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.053982346 2024-09-13T05:10:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815262+0000", 2024-09-13T05:10:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1459e-05 2024-09-13T05:10:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14306 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765229+0000", 2024-09-13T05:10:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.484693227, 2024-09-13T05:10:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.487961431, 2024-09-13T05:10:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14306 2024-09-13T05:10:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765229+0000", 2024-09-13T05:10:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765229+0000", 2024-09-13T05:10:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765229+0000", 2024-09-13T05:10:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765231+0000", 2024-09-13T05:10:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.295e-06 2024-09-13T05:10:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765236+0000", 2024-09-13T05:10:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1089999999999997e-06 2024-09-13T05:10:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765241+0000", 2024-09-13T05:10:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3839999999999999e-06 2024-09-13T05:10:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.817048+0000", 2024-09-13T05:10:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051807449999999998 2024-09-13T05:10:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.817052+0000", 2024-09-13T05:10:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7189999999999999e-06 2024-09-13T05:10:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14338 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.773083+0000", 2024-09-13T05:10:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47683948900000001, 2024-09-13T05:10:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48014223299999997, 2024-09-13T05:10:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14338 2024-09-13T05:10:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773083+0000", 2024-09-13T05:10:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773083+0000", 2024-09-13T05:10:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773083+0000", 2024-09-13T05:10:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773084+0000", 2024-09-13T05:10:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.553e-06 2024-09-13T05:10:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773087+0000", 2024-09-13T05:10:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6740000000000001e-06 2024-09-13T05:10:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773089+0000", 2024-09-13T05:10:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4870000000000001e-06 2024-09-13T05:10:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819022+0000", 2024-09-13T05:10:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045932919000000003 2024-09-13T05:10:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819033+0000", 2024-09-13T05:10:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0209e-05 2024-09-13T05:10:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14370 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.781154+0000", 2024-09-13T05:10:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46876811600000001, 2024-09-13T05:10:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47210365799999998, 2024-09-13T05:10:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14370 2024-09-13T05:10:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781154+0000", 2024-09-13T05:10:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781154+0000", 2024-09-13T05:10:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781154+0000", 2024-09-13T05:10:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781156+0000", 2024-09-13T05:10:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5040000000000001e-06 2024-09-13T05:10:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781162+0000", 2024-09-13T05:10:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3600000000000004e-06 2024-09-13T05:10:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781167+0000", 2024-09-13T05:10:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9760000000000003e-06 2024-09-13T05:10:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820396+0000", 2024-09-13T05:10:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039229571999999997 2024-09-13T05:10:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820400+0000", 2024-09-13T05:10:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5140000000000002e-06 2024-09-13T05:10:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14541 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.805138+0000", 2024-09-13T05:10:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44478482699999999, 2024-09-13T05:10:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.44815486300000001, 2024-09-13T05:10:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14541 2024-09-13T05:10:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805138+0000", 2024-09-13T05:10:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805138+0000", 2024-09-13T05:10:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805137+0000", 2024-09-13T05:10:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805139+0000", 2024-09-13T05:10:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4190000000000001e-06 2024-09-13T05:10:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805142+0000", 2024-09-13T05:10:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.875e-06 2024-09-13T05:10:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805144+0000", 2024-09-13T05:10:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7049999999999999e-06 2024-09-13T05:10:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822896+0000", 2024-09-13T05:10:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017751841000000001 2024-09-13T05:10:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822900+0000", 2024-09-13T05:10:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.512e-06 2024-09-13T05:10:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14605 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.815125+0000", 2024-09-13T05:10:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.43479730999999999, 2024-09-13T05:10:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.43820011599999997, 2024-09-13T05:10:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14605 2024-09-13T05:10:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815125+0000", 2024-09-13T05:10:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815125+0000", 2024-09-13T05:10:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809551+0000", 2024-09-13T05:10:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9944258 2024-09-13T05:10:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815132+0000", 2024-09-13T05:10:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055812539999999999 2024-09-13T05:10:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815147+0000", 2024-09-13T05:10:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4705000000000001e-05 2024-09-13T05:10:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815158+0000", 2024-09-13T05:10:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1048e-05 2024-09-13T05:10:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.824109+0000", 2024-09-13T05:10:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089505999999999995 2024-09-13T05:10:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.824117+0000", 2024-09-13T05:10:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8380000000000008e-06 2024-09-13T05:10:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14094 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.745362+0000", 2024-09-13T05:10:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50456072600000001, 2024-09-13T05:10:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50799812200000005, 2024-09-13T05:10:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14094 2024-09-13T05:10:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745362+0000", 2024-09-13T05:10:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745362+0000", 2024-09-13T05:10:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745361+0000", 2024-09-13T05:10:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745364+0000", 2024-09-13T05:10:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9610000000000001e-06 2024-09-13T05:10:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745371+0000", 2024-09-13T05:10:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4910000000000002e-06 2024-09-13T05:10:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745376+0000", 2024-09-13T05:10:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7080000000000002e-06 2024-09-13T05:10:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812177+0000", 2024-09-13T05:10:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066800102 2024-09-13T05:10:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812180+0000", 2024-09-13T05:10:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7409999999999998e-06 2024-09-13T05:10:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14130 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.753370+0000", 2024-09-13T05:10:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49655282299999998, 2024-09-13T05:10:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50002602399999996, 2024-09-13T05:10:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14130 2024-09-13T05:10:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753370+0000", 2024-09-13T05:10:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753370+0000", 2024-09-13T05:10:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753369+0000", 2024-09-13T05:10:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753372+0000", 2024-09-13T05:10:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1e-06 2024-09-13T05:10:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753379+0000", 2024-09-13T05:10:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5459999999999997e-06 2024-09-13T05:10:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753384+0000", 2024-09-13T05:10:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7380000000000002e-06 2024-09-13T05:10:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813450+0000", 2024-09-13T05:10:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060066798999999997 2024-09-13T05:10:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813458+0000", 2024-09-13T05:10:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9200000000000004e-06 2024-09-13T05:10:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14190 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761273+0000", 2024-09-13T05:10:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48864986999999999, 2024-09-13T05:10:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.492155921, 2024-09-13T05:10:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14190 2024-09-13T05:10:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761273+0000", 2024-09-13T05:10:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761273+0000", 2024-09-13T05:10:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761272+0000", 2024-09-13T05:10:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761275+0000", 2024-09-13T05:10:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6199999999999999e-06 2024-09-13T05:10:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761279+0000", 2024-09-13T05:10:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0899999999999998e-06 2024-09-13T05:10:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761284+0000", 2024-09-13T05:10:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5900000000000001e-06 2024-09-13T05:10:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815288+0000", 2024-09-13T05:10:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054004244 2024-09-13T05:10:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815295+0000", 2024-09-13T05:10:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9970000000000001e-06 2024-09-13T05:10:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14307 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765244+0000", 2024-09-13T05:10:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48467820900000003, 2024-09-13T05:10:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48821830199999999, 2024-09-13T05:10:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14307 2024-09-13T05:10:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765244+0000", 2024-09-13T05:10:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765244+0000", 2024-09-13T05:10:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765244+0000", 2024-09-13T05:10:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765246+0000", 2024-09-13T05:10:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2910000000000002e-06 2024-09-13T05:10:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765251+0000", 2024-09-13T05:10:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0969999999999996e-06 2024-09-13T05:10:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765256+0000", 2024-09-13T05:10:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5229999999999997e-06 2024-09-13T05:10:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.817073+0000", 2024-09-13T05:10:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051817376999999998 2024-09-13T05:10:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.817080+0000", 2024-09-13T05:10:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6050000000000003e-06 2024-09-13T05:10:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14339 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.773091+0000", 2024-09-13T05:10:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47683106200000003, 2024-09-13T05:10:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48040389100000003, 2024-09-13T05:10:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14339 2024-09-13T05:10:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773091+0000", 2024-09-13T05:10:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773091+0000", 2024-09-13T05:10:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773091+0000", 2024-09-13T05:10:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773093+0000", 2024-09-13T05:10:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4559999999999999e-06 2024-09-13T05:10:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773095+0000", 2024-09-13T05:10:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5560000000000002e-06 2024-09-13T05:10:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773098+0000", 2024-09-13T05:10:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.587e-06 2024-09-13T05:10:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819077+0000", 2024-09-13T05:10:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045979331999999998 2024-09-13T05:10:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819087+0000", 2024-09-13T05:10:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.007e-05 2024-09-13T05:10:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14371 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.781300+0000", 2024-09-13T05:10:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46862218300000003, 2024-09-13T05:10:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47222914999999999, 2024-09-13T05:10:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14371 2024-09-13T05:10:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781300+0000", 2024-09-13T05:10:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781300+0000", 2024-09-13T05:10:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781300+0000", 2024-09-13T05:10:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781304+0000", 2024-09-13T05:10:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6909999999999996e-06 2024-09-13T05:10:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781314+0000", 2024-09-13T05:10:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7909999999999999e-06 2024-09-13T05:10:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781321+0000", 2024-09-13T05:10:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1459999999999999e-06 2024-09-13T05:10:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820435+0000", 2024-09-13T05:10:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039113297999999998 2024-09-13T05:10:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820444+0000", 2024-09-13T05:10:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6399999999999992e-06 2024-09-13T05:10:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14430 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.797013+0000", 2024-09-13T05:10:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.45290935700000001, 2024-09-13T05:10:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45654923600000002, 2024-09-13T05:10:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14430 2024-09-13T05:10:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797013+0000", 2024-09-13T05:10:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797013+0000", 2024-09-13T05:10:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785293+0000", 2024-09-13T05:10:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9882798 2024-09-13T05:10:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797021+0000", 2024-09-13T05:10:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011727454999999999 2024-09-13T05:10:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797031+0000", 2024-09-13T05:10:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0147e-05 2024-09-13T05:10:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797040+0000", 2024-09-13T05:10:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3430000000000002e-06 2024-09-13T05:10:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821601+0000", 2024-09-13T05:10:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024560670999999999 2024-09-13T05:10:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821608+0000", 2024-09-13T05:10:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5429999999999996e-06 2024-09-13T05:10:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14543 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.805146+0000", 2024-09-13T05:10:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44477607200000002, 2024-09-13T05:10:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.44845025799999999, 2024-09-13T05:10:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14543 2024-09-13T05:10:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805146+0000", 2024-09-13T05:10:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805146+0000", 2024-09-13T05:10:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805146+0000", 2024-09-13T05:10:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805147+0000", 2024-09-13T05:10:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.161e-06 2024-09-13T05:10:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805150+0000", 2024-09-13T05:10:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8370000000000001e-06 2024-09-13T05:10:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805154+0000", 2024-09-13T05:10:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5420000000000001e-06 2024-09-13T05:10:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822952+0000", 2024-09-13T05:10:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017798710999999998 2024-09-13T05:10:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822960+0000", 2024-09-13T05:10:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.712e-06 2024-09-13T05:10:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14606 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.815167+0000", 2024-09-13T05:10:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.43475506899999999, 2024-09-13T05:10:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.43846336899999999, 2024-09-13T05:10:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14606 2024-09-13T05:10:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815167+0000", 2024-09-13T05:10:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815167+0000", 2024-09-13T05:10:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815167+0000", 2024-09-13T05:10:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815171+0000", 2024-09-13T05:10:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0600000000000001e-06 2024-09-13T05:10:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815178+0000", 2024-09-13T05:10:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3350000000000001e-06 2024-09-13T05:10:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815184+0000", 2024-09-13T05:10:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1990000000000003e-06 2024-09-13T05:10:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.824145+0000", 2024-09-13T05:10:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089606649999999996 2024-09-13T05:10:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.824148+0000", 2024-09-13T05:10:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4659999999999999e-06 2024-09-13T05:10:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14095 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.745381+0000", 2024-09-13T05:10:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50454114000000005, 2024-09-13T05:10:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50828236699999996, 2024-09-13T05:10:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14095 2024-09-13T05:10:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745381+0000", 2024-09-13T05:10:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745381+0000", 2024-09-13T05:10:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745381+0000", 2024-09-13T05:10:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745384+0000", 2024-09-13T05:10:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9909999999999998e-06 2024-09-13T05:10:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745391+0000", 2024-09-13T05:10:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-09-13T05:10:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745396+0000", 2024-09-13T05:10:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1460000000000004e-06 2024-09-13T05:10:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812193+0000", 2024-09-13T05:10:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066797462000000002 2024-09-13T05:10:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812197+0000", 2024-09-13T05:10:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:10:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.686 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14131 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.686 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.753387+0000", 2024-09-13T05:10:31.686 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.496535964, 2024-09-13T05:10:31.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50031139700000005, 2024-09-13T05:10:31.686 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.686 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.687 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14131 2024-09-13T05:10:31.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.687 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753387+0000", 2024-09-13T05:10:31.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753387+0000", 2024-09-13T05:10:31.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753386+0000", 2024-09-13T05:10:31.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753388+0000", 2024-09-13T05:10:31.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1840000000000002e-06 2024-09-13T05:10:31.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753394+0000", 2024-09-13T05:10:31.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4859999999999997e-06 2024-09-13T05:10:31.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753399+0000", 2024-09-13T05:10:31.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9339999999999997e-06 2024-09-13T05:10:31.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813742+0000", 2024-09-13T05:10:31.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060343582999999999 2024-09-13T05:10:31.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813752+0000", 2024-09-13T05:10:31.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8619999999999998e-06 2024-09-13T05:10:31.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.691 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.691 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14191 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.691 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761287+0000", 2024-09-13T05:10:31.691 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48863505699999998, 2024-09-13T05:10:31.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49244306999999998, 2024-09-13T05:10:31.691 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.691 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.691 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.691 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.691 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.692 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14191 2024-09-13T05:10:31.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.692 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761287+0000", 2024-09-13T05:10:31.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761287+0000", 2024-09-13T05:10:31.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761287+0000", 2024-09-13T05:10:31.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761289+0000", 2024-09-13T05:10:31.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:10:31.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761295+0000", 2024-09-13T05:10:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6180000000000003e-06 2024-09-13T05:10:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761301+0000", 2024-09-13T05:10:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7400000000000001e-06 2024-09-13T05:10:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815318+0000", 2024-09-13T05:10:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054017530000000001 2024-09-13T05:10:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815325+0000", 2024-09-13T05:10:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4339999999999997e-06 2024-09-13T05:10:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14308 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765259+0000", 2024-09-13T05:10:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48466299699999998, 2024-09-13T05:10:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.488505309, 2024-09-13T05:10:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14308 2024-09-13T05:10:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765259+0000", 2024-09-13T05:10:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765259+0000", 2024-09-13T05:10:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765259+0000", 2024-09-13T05:10:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765270+0000", 2024-09-13T05:10:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0302000000000001e-05 2024-09-13T05:10:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765275+0000", 2024-09-13T05:10:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.395e-06 2024-09-13T05:10:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765279+0000", 2024-09-13T05:10:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4580000000000003e-06 2024-09-13T05:10:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.817100+0000", 2024-09-13T05:10:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051820695 2024-09-13T05:10:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.817104+0000", 2024-09-13T05:10:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6049999999999998e-06 2024-09-13T05:10:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14340 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.773101+0000", 2024-09-13T05:10:31.700 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47682127099999999, 2024-09-13T05:10:31.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48069621600000001, 2024-09-13T05:10:31.700 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.700 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.700 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.700 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.700 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.700 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14340 2024-09-13T05:10:31.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.700 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773101+0000", 2024-09-13T05:10:31.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773101+0000", 2024-09-13T05:10:31.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773101+0000", 2024-09-13T05:10:31.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773102+0000", 2024-09-13T05:10:31.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4360000000000001e-06 2024-09-13T05:10:31.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773105+0000", 2024-09-13T05:10:31.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.695e-06 2024-09-13T05:10:31.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773108+0000", 2024-09-13T05:10:31.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4870000000000001e-06 2024-09-13T05:10:31.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819123+0000", 2024-09-13T05:10:31.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.046014907000000001 2024-09-13T05:10:31.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819126+0000", 2024-09-13T05:10:31.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7850000000000002e-06 2024-09-13T05:10:31.703 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.703 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.703 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.704 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14372 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.704 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.781326+0000", 2024-09-13T05:10:31.704 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46859598699999999, 2024-09-13T05:10:31.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47250481700000002, 2024-09-13T05:10:31.704 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.704 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.704 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.704 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.704 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.704 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14372 2024-09-13T05:10:31.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.704 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781326+0000", 2024-09-13T05:10:31.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781326+0000", 2024-09-13T05:10:31.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781326+0000", 2024-09-13T05:10:31.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781329+0000", 2024-09-13T05:10:31.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0139999999999999e-06 2024-09-13T05:10:31.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781335+0000", 2024-09-13T05:10:31.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8950000000000003e-06 2024-09-13T05:10:31.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781340+0000", 2024-09-13T05:10:31.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1619999999999999e-06 2024-09-13T05:10:31.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820473+0000", 2024-09-13T05:10:31.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039133406000000003 2024-09-13T05:10:31.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820479+0000", 2024-09-13T05:10:31.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8279999999999999e-06 2024-09-13T05:10:31.707 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.708 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.708 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.708 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14431 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.708 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.797049+0000", 2024-09-13T05:10:31.708 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.45287353299999999, 2024-09-13T05:10:31.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45681717700000002, 2024-09-13T05:10:31.708 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.708 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.709 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14431 2024-09-13T05:10:31.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.709 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797049+0000", 2024-09-13T05:10:31.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797049+0000", 2024-09-13T05:10:31.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797048+0000", 2024-09-13T05:10:31.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:31.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797058+0000", 2024-09-13T05:10:31.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.961e-06 2024-09-13T05:10:31.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797064+0000", 2024-09-13T05:10:31.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2360000000000001e-06 2024-09-13T05:10:31.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797070+0000", 2024-09-13T05:10:31.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0059999999999998e-06 2024-09-13T05:10:31.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821637+0000", 2024-09-13T05:10:31.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024567346 2024-09-13T05:10:31.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821641+0000", 2024-09-13T05:10:31.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.473e-06 2024-09-13T05:10:31.712 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.712 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.713 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.713 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14545 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.713 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.805156+0000", 2024-09-13T05:10:31.713 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44476651, 2024-09-13T05:10:31.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.44874276600000002, 2024-09-13T05:10:31.713 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.713 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.713 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.713 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.713 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.714 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14545 2024-09-13T05:10:31.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.714 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805156+0000", 2024-09-13T05:10:31.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805156+0000", 2024-09-13T05:10:31.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805156+0000", 2024-09-13T05:10:31.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805157+0000", 2024-09-13T05:10:31.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.556e-06 2024-09-13T05:10:31.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805160+0000", 2024-09-13T05:10:31.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8899999999999999e-06 2024-09-13T05:10:31.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805163+0000", 2024-09-13T05:10:31.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.712e-06 2024-09-13T05:10:31.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822993+0000", 2024-09-13T05:10:31.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017830088000000001 2024-09-13T05:10:31.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822996+0000", 2024-09-13T05:10:31.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4489999999999999e-06 2024-09-13T05:10:31.717 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.717 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.718 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.718 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14607 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.718 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.815190+0000", 2024-09-13T05:10:31.718 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.43473247700000001, 2024-09-13T05:10:31.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.438743249, 2024-09-13T05:10:31.718 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.718 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.719 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.719 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.719 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.719 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14607 2024-09-13T05:10:31.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.719 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815190+0000", 2024-09-13T05:10:31.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815190+0000", 2024-09-13T05:10:31.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815190+0000", 2024-09-13T05:10:31.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815193+0000", 2024-09-13T05:10:31.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0290000000000001e-06 2024-09-13T05:10:31.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815796+0000", 2024-09-13T05:10:31.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00060303400000000001 2024-09-13T05:10:31.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815805+0000", 2024-09-13T05:10:31.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2930000000000006e-06 2024-09-13T05:10:31.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.824171+0000", 2024-09-13T05:10:31.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083657980000000007 2024-09-13T05:10:31.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.824180+0000", 2024-09-13T05:10:31.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1120000000000002e-06 2024-09-13T05:10:31.722 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.722 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.722 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.722 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14096 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.722 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.745400+0000", 2024-09-13T05:10:31.722 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50452218000000004, 2024-09-13T05:10:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50856643099999999, 2024-09-13T05:10:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14096 2024-09-13T05:10:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745400+0000", 2024-09-13T05:10:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745400+0000", 2024-09-13T05:10:31.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745400+0000", 2024-09-13T05:10:31.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745402+0000", 2024-09-13T05:10:31.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2970000000000002e-06 2024-09-13T05:10:31.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745408+0000", 2024-09-13T05:10:31.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3219999999999998e-06 2024-09-13T05:10:31.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745414+0000", 2024-09-13T05:10:31.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4550000000000003e-06 2024-09-13T05:10:31.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812210+0000", 2024-09-13T05:10:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066796243000000005 2024-09-13T05:10:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812217+0000", 2024-09-13T05:10:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7449999999999998e-06 2024-09-13T05:10:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14192 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761305+0000", 2024-09-13T05:10:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48861711800000002, 2024-09-13T05:10:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49270075600000002, 2024-09-13T05:10:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14192 2024-09-13T05:10:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761305+0000", 2024-09-13T05:10:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761305+0000", 2024-09-13T05:10:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761305+0000", 2024-09-13T05:10:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761308+0000", 2024-09-13T05:10:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3249999999999999e-06 2024-09-13T05:10:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761314+0000", 2024-09-13T05:10:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7189999999999998e-06 2024-09-13T05:10:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761318+0000", 2024-09-13T05:10:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.844e-06 2024-09-13T05:10:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815356+0000", 2024-09-13T05:10:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054037723000000003 2024-09-13T05:10:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815363+0000", 2024-09-13T05:10:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9070000000000001e-06 2024-09-13T05:10:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14309 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.768968+0000", 2024-09-13T05:10:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.480954092, 2024-09-13T05:10:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48507011799999999, 2024-09-13T05:10:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14309 2024-09-13T05:10:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.768968+0000", 2024-09-13T05:10:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.768968+0000", 2024-09-13T05:10:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765283+0000", 2024-09-13T05:10:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9963145 2024-09-13T05:10:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.768975+0000", 2024-09-13T05:10:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036921620000000001 2024-09-13T05:10:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.768994+0000", 2024-09-13T05:10:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9113000000000001e-05 2024-09-13T05:10:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769003+0000", 2024-09-13T05:10:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4859999999999997e-06 2024-09-13T05:10:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.817116+0000", 2024-09-13T05:10:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048113087999999998 2024-09-13T05:10:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.817119+0000", 2024-09-13T05:10:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2030000000000001e-06 2024-09-13T05:10:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14341 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.773110+0000", 2024-09-13T05:10:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47681272800000002, 2024-09-13T05:10:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48097206599999998, 2024-09-13T05:10:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14341 2024-09-13T05:10:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773110+0000", 2024-09-13T05:10:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773110+0000", 2024-09-13T05:10:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773110+0000", 2024-09-13T05:10:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773113+0000", 2024-09-13T05:10:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7189999999999999e-06 2024-09-13T05:10:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773116+0000", 2024-09-13T05:10:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9490000000000001e-06 2024-09-13T05:10:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773119+0000", 2024-09-13T05:10:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6249999999999999e-06 2024-09-13T05:10:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819165+0000", 2024-09-13T05:10:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.046046548999999999 2024-09-13T05:10:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819175+0000", 2024-09-13T05:10:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3489999999999998e-06 2024-09-13T05:10:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14373 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.781344+0000", 2024-09-13T05:10:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46857804400000003, 2024-09-13T05:10:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47277240399999998, 2024-09-13T05:10:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14373 2024-09-13T05:10:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781344+0000", 2024-09-13T05:10:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781344+0000", 2024-09-13T05:10:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781344+0000", 2024-09-13T05:10:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781347+0000", 2024-09-13T05:10:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7870000000000002e-06 2024-09-13T05:10:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781353+0000", 2024-09-13T05:10:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6540000000000004e-06 2024-09-13T05:10:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781358+0000", 2024-09-13T05:10:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0939999999999998e-06 2024-09-13T05:10:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820514+0000", 2024-09-13T05:10:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039156327999999997 2024-09-13T05:10:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820523+0000", 2024-09-13T05:10:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1700000000000003e-06 2024-09-13T05:10:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14432 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.797075+0000", 2024-09-13T05:10:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.45284722100000002, 2024-09-13T05:10:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.457074235, 2024-09-13T05:10:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14432 2024-09-13T05:10:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797075+0000", 2024-09-13T05:10:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797075+0000", 2024-09-13T05:10:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797075+0000", 2024-09-13T05:10:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797078+0000", 2024-09-13T05:10:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.65e-06 2024-09-13T05:10:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797083+0000", 2024-09-13T05:10:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4559999999999999e-06 2024-09-13T05:10:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797089+0000", 2024-09-13T05:10:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.156e-06 2024-09-13T05:10:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821674+0000", 2024-09-13T05:10:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024584528000000001 2024-09-13T05:10:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821683+0000", 2024-09-13T05:10:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6029999999999994e-06 2024-09-13T05:10:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14549 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.805165+0000", 2024-09-13T05:10:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44475744299999997, 2024-09-13T05:10:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.449018213, 2024-09-13T05:10:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14549 2024-09-13T05:10:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805165+0000", 2024-09-13T05:10:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805165+0000", 2024-09-13T05:10:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805165+0000", 2024-09-13T05:10:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805166+0000", 2024-09-13T05:10:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4649999999999999e-06 2024-09-13T05:10:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805169+0000", 2024-09-13T05:10:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8459999999999999e-06 2024-09-13T05:10:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805172+0000", 2024-09-13T05:10:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5399999999999998e-06 2024-09-13T05:10:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823043+0000", 2024-09-13T05:10:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017871233 2024-09-13T05:10:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823052+0000", 2024-09-13T05:10:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2909999999999996e-06 2024-09-13T05:10:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14097 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.745419+0000", 2024-09-13T05:10:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50450365200000002, 2024-09-13T05:10:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50879648099999997, 2024-09-13T05:10:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14097 2024-09-13T05:10:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745419+0000", 2024-09-13T05:10:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745419+0000", 2024-09-13T05:10:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745418+0000", 2024-09-13T05:10:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745421+0000", 2024-09-13T05:10:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.712e-06 2024-09-13T05:10:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745427+0000", 2024-09-13T05:10:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.241e-06 2024-09-13T05:10:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745433+0000", 2024-09-13T05:10:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4909999999999996e-06 2024-09-13T05:10:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812244+0000", 2024-09-13T05:10:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066811433000000003 2024-09-13T05:10:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812252+0000", 2024-09-13T05:10:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5469999999999999e-06 2024-09-13T05:10:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14133 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.753490+0000", 2024-09-13T05:10:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49643204200000002, 2024-09-13T05:10:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50076295000000004, 2024-09-13T05:10:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14133 2024-09-13T05:10:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753490+0000", 2024-09-13T05:10:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753490+0000", 2024-09-13T05:10:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753490+0000", 2024-09-13T05:10:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753493+0000", 2024-09-13T05:10:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7130000000000001e-06 2024-09-13T05:10:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753498+0000", 2024-09-13T05:10:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7330000000000003e-06 2024-09-13T05:10:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753501+0000", 2024-09-13T05:10:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.41e-06 2024-09-13T05:10:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813783+0000", 2024-09-13T05:10:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060282509999999997 2024-09-13T05:10:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813792+0000", 2024-09-13T05:10:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5250000000000005e-06 2024-09-13T05:10:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14193 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761333+0000", 2024-09-13T05:10:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48858944500000001, 2024-09-13T05:10:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49295299100000001, 2024-09-13T05:10:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14193 2024-09-13T05:10:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761333+0000", 2024-09-13T05:10:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761333+0000", 2024-09-13T05:10:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761332+0000", 2024-09-13T05:10:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761336+0000", 2024-09-13T05:10:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.439e-06 2024-09-13T05:10:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761341+0000", 2024-09-13T05:10:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0440000000000003e-06 2024-09-13T05:10:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761344+0000", 2024-09-13T05:10:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2559999999999998e-06 2024-09-13T05:10:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815406+0000", 2024-09-13T05:10:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054062280999999997 2024-09-13T05:10:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815414+0000", 2024-09-13T05:10:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2509999999999997e-06 2024-09-13T05:10:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14310 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.769013+0000", 2024-09-13T05:10:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48090994399999998, 2024-09-13T05:10:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48530739699999997, 2024-09-13T05:10:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14310 2024-09-13T05:10:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769013+0000", 2024-09-13T05:10:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769013+0000", 2024-09-13T05:10:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769012+0000", 2024-09-13T05:10:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769016+0000", 2024-09-13T05:10:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6389999999999998e-06 2024-09-13T05:10:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769036+0000", 2024-09-13T05:10:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0129e-05 2024-09-13T05:10:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769045+0000", 2024-09-13T05:10:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5079999999999994e-06 2024-09-13T05:10:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.817131+0000", 2024-09-13T05:10:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048085821000000001 2024-09-13T05:10:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.817136+0000", 2024-09-13T05:10:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0919999999999997e-06 2024-09-13T05:10:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14342 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.773122+0000", 2024-09-13T05:10:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47680019400000001, 2024-09-13T05:10:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48123175499999998, 2024-09-13T05:10:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14342 2024-09-13T05:10:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773122+0000", 2024-09-13T05:10:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773122+0000", 2024-09-13T05:10:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773122+0000", 2024-09-13T05:10:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773123+0000", 2024-09-13T05:10:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4050000000000001e-06 2024-09-13T05:10:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773126+0000", 2024-09-13T05:10:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.661e-06 2024-09-13T05:10:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773129+0000", 2024-09-13T05:10:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5469999999999999e-06 2024-09-13T05:10:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819217+0000", 2024-09-13T05:10:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.046088483 2024-09-13T05:10:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819225+0000", 2024-09-13T05:10:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4000000000000003e-06 2024-09-13T05:10:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14374 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.781362+0000", 2024-09-13T05:10:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46856051900000001, 2024-09-13T05:10:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47302449000000002, 2024-09-13T05:10:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14374 2024-09-13T05:10:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781362+0000", 2024-09-13T05:10:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781362+0000", 2024-09-13T05:10:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781362+0000", 2024-09-13T05:10:31.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781364+0000", 2024-09-13T05:10:31.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7e-06 2024-09-13T05:10:31.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781370+0000", 2024-09-13T05:10:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8259999999999998e-06 2024-09-13T05:10:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781375+0000", 2024-09-13T05:10:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:10:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820554+0000", 2024-09-13T05:10:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039178822000000002 2024-09-13T05:10:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820559+0000", 2024-09-13T05:10:31.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.468e-06 2024-09-13T05:10:31.781 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.781 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.781 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.781 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14433 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.797094+0000", 2024-09-13T05:10:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.45282828800000002, 2024-09-13T05:10:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45732616399999998, 2024-09-13T05:10:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14433 2024-09-13T05:10:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797094+0000", 2024-09-13T05:10:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797094+0000", 2024-09-13T05:10:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797094+0000", 2024-09-13T05:10:31.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797096+0000", 2024-09-13T05:10:31.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.491e-06 2024-09-13T05:10:31.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797103+0000", 2024-09-13T05:10:31.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5799999999999997e-06 2024-09-13T05:10:31.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797107+0000", 2024-09-13T05:10:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0790000000000002e-06 2024-09-13T05:10:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821712+0000", 2024-09-13T05:10:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024605127000000001 2024-09-13T05:10:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821716+0000", 2024-09-13T05:10:31.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4079999999999998e-06 2024-09-13T05:10:31.786 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.786 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.786 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.786 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14552 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.786 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.805174+0000", 2024-09-13T05:10:31.786 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44474865299999999, 2024-09-13T05:10:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.44927885699999998, 2024-09-13T05:10:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14552 2024-09-13T05:10:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805174+0000", 2024-09-13T05:10:31.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805174+0000", 2024-09-13T05:10:31.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805174+0000", 2024-09-13T05:10:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805175+0000", 2024-09-13T05:10:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.393e-06 2024-09-13T05:10:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805185+0000", 2024-09-13T05:10:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0309000000000001e-05 2024-09-13T05:10:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805188+0000", 2024-09-13T05:10:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.83e-06 2024-09-13T05:10:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823077+0000", 2024-09-13T05:10:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017888755999999999 2024-09-13T05:10:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823081+0000", 2024-09-13T05:10:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.844e-06 2024-09-13T05:10:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14098 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.745448+0000", 2024-09-13T05:10:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50447465499999999, 2024-09-13T05:10:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50915225900000005, 2024-09-13T05:10:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.792 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.792 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.792 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.792 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.792 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14098 2024-09-13T05:10:31.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.792 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745448+0000", 2024-09-13T05:10:31.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745448+0000", 2024-09-13T05:10:31.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745447+0000", 2024-09-13T05:10:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745451+0000", 2024-09-13T05:10:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3629999999999998e-06 2024-09-13T05:10:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745457+0000", 2024-09-13T05:10:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-06 2024-09-13T05:10:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745463+0000", 2024-09-13T05:10:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3870000000000003e-06 2024-09-13T05:10:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812278+0000", 2024-09-13T05:10:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066814731000000002 2024-09-13T05:10:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812286+0000", 2024-09-13T05:10:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1450000000000008e-06 2024-09-13T05:10:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14134 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.753504+0000", 2024-09-13T05:10:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49641870599999999, 2024-09-13T05:10:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50112975999999998, 2024-09-13T05:10:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14134 2024-09-13T05:10:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753504+0000", 2024-09-13T05:10:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753504+0000", 2024-09-13T05:10:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753504+0000", 2024-09-13T05:10:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753505+0000", 2024-09-13T05:10:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.773e-06 2024-09-13T05:10:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753508+0000", 2024-09-13T05:10:31.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9119999999999998e-06 2024-09-13T05:10:31.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753511+0000", 2024-09-13T05:10:31.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0429999999999999e-06 2024-09-13T05:10:31.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813823+0000", 2024-09-13T05:10:31.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060312103999999998 2024-09-13T05:10:31.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813832+0000", 2024-09-13T05:10:31.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5520000000000005e-06 2024-09-13T05:10:31.800 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.800 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.800 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.800 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14194 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.800 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761348+0000", 2024-09-13T05:10:31.800 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48857469799999997, 2024-09-13T05:10:31.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49332045000000002, 2024-09-13T05:10:31.800 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.800 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.801 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14194 2024-09-13T05:10:31.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.801 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761348+0000", 2024-09-13T05:10:31.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761348+0000", 2024-09-13T05:10:31.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761347+0000", 2024-09-13T05:10:31.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761349+0000", 2024-09-13T05:10:31.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8980000000000001e-06 2024-09-13T05:10:31.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761352+0000", 2024-09-13T05:10:31.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0599999999999999e-06 2024-09-13T05:10:31.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761355+0000", 2024-09-13T05:10:31.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9349999999999999e-06 2024-09-13T05:10:31.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815439+0000", 2024-09-13T05:10:31.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054083236 2024-09-13T05:10:31.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815445+0000", 2024-09-13T05:10:31.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8669999999999996e-06 2024-09-13T05:10:31.804 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.804 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.804 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.804 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14311 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.804 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.769052+0000", 2024-09-13T05:10:31.804 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48086998600000003, 2024-09-13T05:10:31.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48565912700000002, 2024-09-13T05:10:31.805 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.805 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.805 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.805 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.805 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.805 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14311 2024-09-13T05:10:31.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.805 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769052+0000", 2024-09-13T05:10:31.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769052+0000", 2024-09-13T05:10:31.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769052+0000", 2024-09-13T05:10:31.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:31.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769056+0000", 2024-09-13T05:10:31.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2019999999999997e-06 2024-09-13T05:10:31.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769062+0000", 2024-09-13T05:10:31.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5779999999999998e-06 2024-09-13T05:10:31.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769065+0000", 2024-09-13T05:10:31.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1020000000000001e-06 2024-09-13T05:10:31.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.817265+0000", 2024-09-13T05:10:31.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048200755999999997 2024-09-13T05:10:31.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.817271+0000", 2024-09-13T05:10:31.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8690000000000001e-06 2024-09-13T05:10:31.808 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.808 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.808 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.808 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14343 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.809 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.773131+0000", 2024-09-13T05:10:31.809 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47679160999999998, 2024-09-13T05:10:31.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48162853300000003, 2024-09-13T05:10:31.809 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.809 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.809 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.809 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.809 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.809 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14343 2024-09-13T05:10:31.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.809 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773131+0000", 2024-09-13T05:10:31.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773131+0000", 2024-09-13T05:10:31.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773131+0000", 2024-09-13T05:10:31.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773132+0000", 2024-09-13T05:10:31.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3179999999999999e-06 2024-09-13T05:10:31.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773135+0000", 2024-09-13T05:10:31.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.593e-06 2024-09-13T05:10:31.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773137+0000", 2024-09-13T05:10:31.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4530000000000001e-06 2024-09-13T05:10:31.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819338+0000", 2024-09-13T05:10:31.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.046201287000000001 2024-09-13T05:10:31.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819346+0000", 2024-09-13T05:10:31.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7680000000000008e-06 2024-09-13T05:10:31.812 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.812 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.812 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.813 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14375 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.813 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.781379+0000", 2024-09-13T05:10:31.813 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46854317200000001, 2024-09-13T05:10:31.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47341795599999997, 2024-09-13T05:10:31.813 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.813 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.813 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.813 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.813 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.814 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14375 2024-09-13T05:10:31.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.814 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781379+0000", 2024-09-13T05:10:31.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781379+0000", 2024-09-13T05:10:31.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781379+0000", 2024-09-13T05:10:31.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781382+0000", 2024-09-13T05:10:31.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6340000000000001e-06 2024-09-13T05:10:31.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781388+0000", 2024-09-13T05:10:31.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0070000000000003e-06 2024-09-13T05:10:31.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781393+0000", 2024-09-13T05:10:31.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0089999999999998e-06 2024-09-13T05:10:31.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820593+0000", 2024-09-13T05:10:31.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039200687999999997 2024-09-13T05:10:31.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820603+0000", 2024-09-13T05:10:31.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6050000000000004e-06 2024-09-13T05:10:31.817 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.817 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.817 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.818 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14434 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.818 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.797110+0000", 2024-09-13T05:10:31.818 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.45281293, 2024-09-13T05:10:31.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.457720452, 2024-09-13T05:10:31.818 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.818 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.818 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.818 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.818 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.818 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14434 2024-09-13T05:10:31.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.819 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797110+0000", 2024-09-13T05:10:31.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797110+0000", 2024-09-13T05:10:31.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797109+0000", 2024-09-13T05:10:31.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797112+0000", 2024-09-13T05:10:31.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7690000000000001e-06 2024-09-13T05:10:31.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797118+0000", 2024-09-13T05:10:31.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8130000000000001e-06 2024-09-13T05:10:31.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797122+0000", 2024-09-13T05:10:31.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0230000000000003e-06 2024-09-13T05:10:31.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821739+0000", 2024-09-13T05:10:31.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024616774000000001 2024-09-13T05:10:31.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821743+0000", 2024-09-13T05:10:31.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9090000000000002e-06 2024-09-13T05:10:31.822 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.823 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.823 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.823 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14554 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.823 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.805190+0000", 2024-09-13T05:10:31.823 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44473205999999998, 2024-09-13T05:10:31.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.44968998300000002, 2024-09-13T05:10:31.823 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.823 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.823 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.824 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.824 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.824 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14554 2024-09-13T05:10:31.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.824 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805190+0000", 2024-09-13T05:10:31.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805190+0000", 2024-09-13T05:10:31.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805190+0000", 2024-09-13T05:10:31.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805193+0000", 2024-09-13T05:10:31.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3630000000000001e-06 2024-09-13T05:10:31.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805196+0000", 2024-09-13T05:10:31.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9610000000000001e-06 2024-09-13T05:10:31.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805199+0000", 2024-09-13T05:10:31.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6959999999999998e-06 2024-09-13T05:10:31.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823092+0000", 2024-09-13T05:10:31.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017893238999999998 2024-09-13T05:10:31.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823096+0000", 2024-09-13T05:10:31.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3100000000000001e-06 2024-09-13T05:10:31.827 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.827 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.827 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.828 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14099 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.828 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.745468+0000", 2024-09-13T05:10:31.828 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50445441099999999, 2024-09-13T05:10:31.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50944609699999999, 2024-09-13T05:10:31.828 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.828 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.828 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.828 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.828 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.828 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14099 2024-09-13T05:10:31.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745468+0000", 2024-09-13T05:10:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745468+0000", 2024-09-13T05:10:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745467+0000", 2024-09-13T05:10:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745471+0000", 2024-09-13T05:10:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2320000000000001e-06 2024-09-13T05:10:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745477+0000", 2024-09-13T05:10:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.365e-06 2024-09-13T05:10:31.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745482+0000", 2024-09-13T05:10:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2270000000000001e-06 2024-09-13T05:10:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812310+0000", 2024-09-13T05:10:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066828186999999997 2024-09-13T05:10:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812318+0000", 2024-09-13T05:10:31.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6760000000000007e-06 2024-09-13T05:10:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14135 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.753514+0000", 2024-09-13T05:10:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49640896200000001, 2024-09-13T05:10:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50143575100000004, 2024-09-13T05:10:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.832 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14135 2024-09-13T05:10:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753514+0000", 2024-09-13T05:10:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753514+0000", 2024-09-13T05:10:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753513+0000", 2024-09-13T05:10:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753515+0000", 2024-09-13T05:10:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6619999999999999e-06 2024-09-13T05:10:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753519+0000", 2024-09-13T05:10:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4440000000000001e-06 2024-09-13T05:10:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753522+0000", 2024-09-13T05:10:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0510000000000001e-06 2024-09-13T05:10:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813861+0000", 2024-09-13T05:10:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060338283999999999 2024-09-13T05:10:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813870+0000", 2024-09-13T05:10:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8089999999999999e-06 2024-09-13T05:10:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14195 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761358+0000", 2024-09-13T05:10:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48856492699999998, 2024-09-13T05:10:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49362567499999999, 2024-09-13T05:10:31.836 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14195 2024-09-13T05:10:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761358+0000", 2024-09-13T05:10:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761358+0000", 2024-09-13T05:10:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761357+0000", 2024-09-13T05:10:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761359+0000", 2024-09-13T05:10:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6899999999999999e-06 2024-09-13T05:10:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761362+0000", 2024-09-13T05:10:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8820000000000001e-06 2024-09-13T05:10:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761365+0000", 2024-09-13T05:10:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8760000000000001e-06 2024-09-13T05:10:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815468+0000", 2024-09-13T05:10:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054102898000000003 2024-09-13T05:10:31.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815474+0000", 2024-09-13T05:10:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5130000000000002e-06 2024-09-13T05:10:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14312 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.769067+0000", 2024-09-13T05:10:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48085531799999998, 2024-09-13T05:10:31.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48594849499999998, 2024-09-13T05:10:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14312 2024-09-13T05:10:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769067+0000", 2024-09-13T05:10:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769067+0000", 2024-09-13T05:10:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769067+0000", 2024-09-13T05:10:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769069+0000", 2024-09-13T05:10:31.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6700000000000001e-06 2024-09-13T05:10:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769072+0000", 2024-09-13T05:10:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.988e-06 2024-09-13T05:10:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769074+0000", 2024-09-13T05:10:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6079999999999998e-06 2024-09-13T05:10:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.817286+0000", 2024-09-13T05:10:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048212324000000001 2024-09-13T05:10:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.817291+0000", 2024-09-13T05:10:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9479999999999999e-06 2024-09-13T05:10:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14344 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.844 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.776993+0000", 2024-09-13T05:10:31.845 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47292914800000002, 2024-09-13T05:10:31.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47805598500000002, 2024-09-13T05:10:31.845 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.845 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.845 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.845 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.845 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.845 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14344 2024-09-13T05:10:31.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.845 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.776993+0000", 2024-09-13T05:10:31.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.776993+0000", 2024-09-13T05:10:31.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.773139+0000", 2024-09-13T05:10:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9961452 2024-09-13T05:10:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777000+0000", 2024-09-13T05:10:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038609019999999998 2024-09-13T05:10:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777013+0000", 2024-09-13T05:10:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3052e-05 2024-09-13T05:10:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777021+0000", 2024-09-13T05:10:31.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4069999999999993e-06 2024-09-13T05:10:31.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819379+0000", 2024-09-13T05:10:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042358017999999997 2024-09-13T05:10:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819386+0000", 2024-09-13T05:10:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.323e-06 2024-09-13T05:10:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14376 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.849 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.781397+0000", 2024-09-13T05:10:31.850 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46852553200000002, 2024-09-13T05:10:31.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47368570199999999, 2024-09-13T05:10:31.850 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.850 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.850 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14376 2024-09-13T05:10:31.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.851 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781397+0000", 2024-09-13T05:10:31.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781397+0000", 2024-09-13T05:10:31.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781397+0000", 2024-09-13T05:10:31.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781406+0000", 2024-09-13T05:10:31.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9309999999999997e-06 2024-09-13T05:10:31.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781411+0000", 2024-09-13T05:10:31.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9490000000000001e-06 2024-09-13T05:10:31.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781416+0000", 2024-09-13T05:10:31.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8579999999999999e-06 2024-09-13T05:10:31.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820633+0000", 2024-09-13T05:10:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039217002000000001 2024-09-13T05:10:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820637+0000", 2024-09-13T05:10:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5099999999999999e-06 2024-09-13T05:10:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14435 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.800959+0000", 2024-09-13T05:10:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44896370699999999, 2024-09-13T05:10:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45417384700000002, 2024-09-13T05:10:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14435 2024-09-13T05:10:31.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.856 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.800959+0000", 2024-09-13T05:10:31.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.800959+0000", 2024-09-13T05:10:31.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.797125+0000", 2024-09-13T05:10:31.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9961658 2024-09-13T05:10:31.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.800965+0000", 2024-09-13T05:10:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038405779999999999 2024-09-13T05:10:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.800987+0000", 2024-09-13T05:10:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1260999999999999e-05 2024-09-13T05:10:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.800994+0000", 2024-09-13T05:10:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9249999999999995e-06 2024-09-13T05:10:31.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821768+0000", 2024-09-13T05:10:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020773901000000001 2024-09-13T05:10:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821772+0000", 2024-09-13T05:10:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4750000000000002e-06 2024-09-13T05:10:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14556 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.805202+0000", 2024-09-13T05:10:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.444720895, 2024-09-13T05:10:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.449988742, 2024-09-13T05:10:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14556 2024-09-13T05:10:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.860 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805202+0000", 2024-09-13T05:10:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805202+0000", 2024-09-13T05:10:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805201+0000", 2024-09-13T05:10:31.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805207+0000", 2024-09-13T05:10:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5899999999999998e-06 2024-09-13T05:10:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805211+0000", 2024-09-13T05:10:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9899999999999999e-06 2024-09-13T05:10:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805214+0000", 2024-09-13T05:10:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8229999999999999e-06 2024-09-13T05:10:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823123+0000", 2024-09-13T05:10:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017909016 2024-09-13T05:10:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823130+0000", 2024-09-13T05:10:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.469e-06 2024-09-13T05:10:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.863 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14100 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.745487+0000", 2024-09-13T05:10:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50443576899999998, 2024-09-13T05:10:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50973945300000001, 2024-09-13T05:10:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14100 2024-09-13T05:10:31.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745487+0000", 2024-09-13T05:10:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745487+0000", 2024-09-13T05:10:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745486+0000", 2024-09-13T05:10:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745489+0000", 2024-09-13T05:10:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.621e-06 2024-09-13T05:10:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745495+0000", 2024-09-13T05:10:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6130000000000003e-06 2024-09-13T05:10:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745500+0000", 2024-09-13T05:10:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1229999999999999e-06 2024-09-13T05:10:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812345+0000", 2024-09-13T05:10:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066845450000000001 2024-09-13T05:10:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812353+0000", 2024-09-13T05:10:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6210000000000004e-06 2024-09-13T05:10:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.867 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14196 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:10:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48855543499999998, 2024-09-13T05:10:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49389144800000001, 2024-09-13T05:10:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14196 2024-09-13T05:10:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:10:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:10:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:10:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761368+0000", 2024-09-13T05:10:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3689999999999999e-06 2024-09-13T05:10:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761373+0000", 2024-09-13T05:10:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7180000000000004e-06 2024-09-13T05:10:31.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761376+0000", 2024-09-13T05:10:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0860000000000002e-06 2024-09-13T05:10:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815501+0000", 2024-09-13T05:10:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054125508000000003 2024-09-13T05:10:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815508+0000", 2024-09-13T05:10:31.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5570000000000001e-06 2024-09-13T05:10:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14313 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.769076+0000", 2024-09-13T05:10:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48084621599999999, 2024-09-13T05:10:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48622009300000002, 2024-09-13T05:10:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.872 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14313 2024-09-13T05:10:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769076+0000", 2024-09-13T05:10:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769076+0000", 2024-09-13T05:10:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769076+0000", 2024-09-13T05:10:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769077+0000", 2024-09-13T05:10:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.437e-06 2024-09-13T05:10:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769082+0000", 2024-09-13T05:10:31.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4769999999999997e-06 2024-09-13T05:10:31.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769087+0000", 2024-09-13T05:10:31.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7559999999999999e-06 2024-09-13T05:10:31.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.817323+0000", 2024-09-13T05:10:31.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048236429999999997 2024-09-13T05:10:31.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.817916+0000", 2024-09-13T05:10:31.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00059304300000000002 2024-09-13T05:10:31.876 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.876 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.876 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.876 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14345 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.876 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.777029+0000", 2024-09-13T05:10:31.876 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47289333700000002, 2024-09-13T05:10:31.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47832558800000002, 2024-09-13T05:10:31.876 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.876 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.877 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14345 2024-09-13T05:10:31.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.877 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777029+0000", 2024-09-13T05:10:31.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777029+0000", 2024-09-13T05:10:31.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777028+0000", 2024-09-13T05:10:31.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777032+0000", 2024-09-13T05:10:31.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6009999999999999e-06 2024-09-13T05:10:31.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777039+0000", 2024-09-13T05:10:31.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.165e-06 2024-09-13T05:10:31.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777045+0000", 2024-09-13T05:10:31.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9989999999999997e-06 2024-09-13T05:10:31.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819415+0000", 2024-09-13T05:10:31.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042369336 2024-09-13T05:10:31.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819421+0000", 2024-09-13T05:10:31.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.759e-06 2024-09-13T05:10:31.880 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.880 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.880 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.880 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14377 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.880 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.781421+0000", 2024-09-13T05:10:31.880 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.468501889, 2024-09-13T05:10:31.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47397087100000002, 2024-09-13T05:10:31.880 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.881 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.881 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.881 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.881 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.881 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14377 2024-09-13T05:10:31.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.881 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781421+0000", 2024-09-13T05:10:31.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781421+0000", 2024-09-13T05:10:31.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781420+0000", 2024-09-13T05:10:31.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781422+0000", 2024-09-13T05:10:31.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2350000000000002e-06 2024-09-13T05:10:31.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781429+0000", 2024-09-13T05:10:31.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9940000000000003e-06 2024-09-13T05:10:31.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781435+0000", 2024-09-13T05:10:31.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2780000000000001e-06 2024-09-13T05:10:31.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820670+0000", 2024-09-13T05:10:31.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039235572000000003 2024-09-13T05:10:31.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820680+0000", 2024-09-13T05:10:31.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6530000000000006e-06 2024-09-13T05:10:31.885 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.885 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.885 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.885 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14500 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.885 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.801001+0000", 2024-09-13T05:10:31.885 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44892152499999999, 2024-09-13T05:10:31.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45445023000000001, 2024-09-13T05:10:31.885 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.886 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.886 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.886 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.886 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.886 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14500 2024-09-13T05:10:31.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.886 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801001+0000", 2024-09-13T05:10:31.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801001+0000", 2024-09-13T05:10:31.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801000+0000", 2024-09-13T05:10:31.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801004+0000", 2024-09-13T05:10:31.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0989999999999999e-06 2024-09-13T05:10:31.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801008+0000", 2024-09-13T05:10:31.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0520000000000003e-06 2024-09-13T05:10:31.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801011+0000", 2024-09-13T05:10:31.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.027e-06 2024-09-13T05:10:31.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821794+0000", 2024-09-13T05:10:31.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020783861000000001 2024-09-13T05:10:31.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821798+0000", 2024-09-13T05:10:31.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5159999999999999e-06 2024-09-13T05:10:31.890 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.890 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.890 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.890 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14558 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.890 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.805216+0000", 2024-09-13T05:10:31.890 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44470636400000002, 2024-09-13T05:10:31.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.450268746, 2024-09-13T05:10:31.890 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.891 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.891 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14558 2024-09-13T05:10:31.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.891 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805216+0000", 2024-09-13T05:10:31.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805216+0000", 2024-09-13T05:10:31.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805216+0000", 2024-09-13T05:10:31.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805218+0000", 2024-09-13T05:10:31.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1409999999999999e-06 2024-09-13T05:10:31.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805221+0000", 2024-09-13T05:10:31.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.965e-06 2024-09-13T05:10:31.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805224+0000", 2024-09-13T05:10:31.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0680000000000001e-06 2024-09-13T05:10:31.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823159+0000", 2024-09-13T05:10:31.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017935273000000002 2024-09-13T05:10:31.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823165+0000", 2024-09-13T05:10:31.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4840000000000003e-06 2024-09-13T05:10:31.895 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.895 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.895 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.895 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14101 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.895 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.745504+0000", 2024-09-13T05:10:31.895 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50441846999999995, 2024-09-13T05:10:31.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.51001612399999996, 2024-09-13T05:10:31.895 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.896 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.896 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.896 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.896 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.896 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14101 2024-09-13T05:10:31.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.896 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745504+0000", 2024-09-13T05:10:31.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745504+0000", 2024-09-13T05:10:31.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745504+0000", 2024-09-13T05:10:31.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745506+0000", 2024-09-13T05:10:31.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.858e-06 2024-09-13T05:10:31.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745509+0000", 2024-09-13T05:10:31.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2600000000000001e-06 2024-09-13T05:10:31.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745512+0000", 2024-09-13T05:10:31.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9979999999999999e-06 2024-09-13T05:10:31.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812378+0000", 2024-09-13T05:10:31.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066866471999999996 2024-09-13T05:10:31.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812386+0000", 2024-09-13T05:10:31.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.106e-06 2024-09-13T05:10:31.899 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.899 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.899 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.899 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14136 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.899 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757187+0000", 2024-09-13T05:10:31.899 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49273511199999998, 2024-09-13T05:10:31.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49836529099999999, 2024-09-13T05:10:31.900 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.900 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.900 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14136 2024-09-13T05:10:31.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.900 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757187+0000", 2024-09-13T05:10:31.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757187+0000", 2024-09-13T05:10:31.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.753525+0000", 2024-09-13T05:10:31.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9963374 2024-09-13T05:10:31.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757193+0000", 2024-09-13T05:10:31.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036688049999999998 2024-09-13T05:10:31.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757214+0000", 2024-09-13T05:10:31.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0868000000000001e-05 2024-09-13T05:10:31.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757223+0000", 2024-09-13T05:10:31.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3769999999999996e-06 2024-09-13T05:10:31.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813899+0000", 2024-09-13T05:10:31.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056675938000000002 2024-09-13T05:10:31.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813907+0000", 2024-09-13T05:10:31.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4209999999999995e-06 2024-09-13T05:10:31.903 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.903 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.903 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.903 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14197 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.904 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:10:31.904 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48854419100000002, 2024-09-13T05:10:31.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49420836000000001, 2024-09-13T05:10:31.904 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.904 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.904 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14197 2024-09-13T05:10:31.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.904 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:10:31.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:10:31.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:10:31.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761403+0000", 2024-09-13T05:10:31.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5199e-05 2024-09-13T05:10:31.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761411+0000", 2024-09-13T05:10:31.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4540000000000001e-06 2024-09-13T05:10:31.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761418+0000", 2024-09-13T05:10:31.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9569999999999996e-06 2024-09-13T05:10:31.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815531+0000", 2024-09-13T05:10:31.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054113599999999998 2024-09-13T05:10:31.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815539+0000", 2024-09-13T05:10:31.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.481e-06 2024-09-13T05:10:31.907 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.907 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.907 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.908 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14314 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.908 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.769090+0000", 2024-09-13T05:10:31.908 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48083259499999997, 2024-09-13T05:10:31.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48653086699999998, 2024-09-13T05:10:31.908 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.908 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.908 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.908 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.908 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.908 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14314 2024-09-13T05:10:31.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.908 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769090+0000", 2024-09-13T05:10:31.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769090+0000", 2024-09-13T05:10:31.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769090+0000", 2024-09-13T05:10:31.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769091+0000", 2024-09-13T05:10:31.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.449e-06 2024-09-13T05:10:31.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769094+0000", 2024-09-13T05:10:31.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1030000000000002e-06 2024-09-13T05:10:31.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769098+0000", 2024-09-13T05:10:31.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1439999999999996e-06 2024-09-13T05:10:31.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.817999+0000", 2024-09-13T05:10:31.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048900709000000001 2024-09-13T05:10:31.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818007+0000", 2024-09-13T05:10:31.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3990000000000004e-06 2024-09-13T05:10:31.911 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.911 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.911 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.912 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14346 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.912 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.777050+0000", 2024-09-13T05:10:31.912 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47287210299999999, 2024-09-13T05:10:31.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47862279099999999, 2024-09-13T05:10:31.912 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.912 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.912 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.912 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.912 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.912 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14346 2024-09-13T05:10:31.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.912 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777050+0000", 2024-09-13T05:10:31.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777050+0000", 2024-09-13T05:10:31.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777050+0000", 2024-09-13T05:10:31.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777053+0000", 2024-09-13T05:10:31.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.117e-06 2024-09-13T05:10:31.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777059+0000", 2024-09-13T05:10:31.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2079999999999997e-06 2024-09-13T05:10:31.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777065+0000", 2024-09-13T05:10:31.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5210000000000002e-06 2024-09-13T05:10:31.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819445+0000", 2024-09-13T05:10:31.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042379932000000002 2024-09-13T05:10:31.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819451+0000", 2024-09-13T05:10:31.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7460000000000003e-06 2024-09-13T05:10:31.916 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.916 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.916 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.916 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14407 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.917 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.781463+0000", 2024-09-13T05:10:31.917 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46845947399999999, 2024-09-13T05:10:31.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.474251704, 2024-09-13T05:10:31.917 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.917 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.917 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.917 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.917 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.917 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14407 2024-09-13T05:10:31.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.917 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781463+0000", 2024-09-13T05:10:31.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781463+0000", 2024-09-13T05:10:31.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781462+0000", 2024-09-13T05:10:31.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781466+0000", 2024-09-13T05:10:31.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9169999999999999e-06 2024-09-13T05:10:31.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781474+0000", 2024-09-13T05:10:31.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4499999999999998e-06 2024-09-13T05:10:31.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781480+0000", 2024-09-13T05:10:31.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.908e-06 2024-09-13T05:10:31.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820711+0000", 2024-09-13T05:10:31.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039231461000000002 2024-09-13T05:10:31.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820715+0000", 2024-09-13T05:10:31.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2869999999999998e-06 2024-09-13T05:10:31.921 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.921 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.921 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.922 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14502 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.922 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.801013+0000", 2024-09-13T05:10:31.922 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44890928299999999, 2024-09-13T05:10:31.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45476687100000002, 2024-09-13T05:10:31.922 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.922 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.922 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.922 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.922 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.923 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14502 2024-09-13T05:10:31.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.923 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801013+0000", 2024-09-13T05:10:31.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801013+0000", 2024-09-13T05:10:31.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801013+0000", 2024-09-13T05:10:31.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801015+0000", 2024-09-13T05:10:31.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7889999999999999e-06 2024-09-13T05:10:31.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801018+0000", 2024-09-13T05:10:31.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0479999999999999e-06 2024-09-13T05:10:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801021+0000", 2024-09-13T05:10:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9679999999999998e-06 2024-09-13T05:10:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821820+0000", 2024-09-13T05:10:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020799286 2024-09-13T05:10:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821824+0000", 2024-09-13T05:10:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6210000000000001e-06 2024-09-13T05:10:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14560 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.805226+0000", 2024-09-13T05:10:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44469599300000001, 2024-09-13T05:10:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45062181699999998, 2024-09-13T05:10:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14560 2024-09-13T05:10:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805226+0000", 2024-09-13T05:10:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805226+0000", 2024-09-13T05:10:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805226+0000", 2024-09-13T05:10:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805228+0000", 2024-09-13T05:10:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2890000000000001e-06 2024-09-13T05:10:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805232+0000", 2024-09-13T05:10:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0419999999999996e-06 2024-09-13T05:10:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805237+0000", 2024-09-13T05:10:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0170000000000004e-06 2024-09-13T05:10:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823196+0000", 2024-09-13T05:10:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017959823 2024-09-13T05:10:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823206+0000", 2024-09-13T05:10:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2320000000000007e-06 2024-09-13T05:10:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14102 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.749054+0000", 2024-09-13T05:10:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50086853499999995, 2024-09-13T05:10:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50684801499999999, 2024-09-13T05:10:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.932 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.932 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.932 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14102 2024-09-13T05:10:31.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.932 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749054+0000", 2024-09-13T05:10:31.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749054+0000", 2024-09-13T05:10:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.745514+0000", 2024-09-13T05:10:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.99646 2024-09-13T05:10:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749060+0000", 2024-09-13T05:10:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035465409999999998 2024-09-13T05:10:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749077+0000", 2024-09-13T05:10:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6146000000000001e-05 2024-09-13T05:10:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749084+0000", 2024-09-13T05:10:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6669999999999996e-06 2024-09-13T05:10:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812413+0000", 2024-09-13T05:10:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063328464000000001 2024-09-13T05:10:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812420+0000", 2024-09-13T05:10:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5809999999999999e-06 2024-09-13T05:10:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14137 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757231+0000", 2024-09-13T05:10:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49269160699999998, 2024-09-13T05:10:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49872817200000003, 2024-09-13T05:10:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.936 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.936 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.936 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.936 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.936 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14137 2024-09-13T05:10:31.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.936 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757231+0000", 2024-09-13T05:10:31.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757231+0000", 2024-09-13T05:10:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757230+0000", 2024-09-13T05:10:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757234+0000", 2024-09-13T05:10:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8750000000000002e-06 2024-09-13T05:10:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757241+0000", 2024-09-13T05:10:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6810000000000001e-06 2024-09-13T05:10:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757246+0000", 2024-09-13T05:10:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5049999999999998e-06 2024-09-13T05:10:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813936+0000", 2024-09-13T05:10:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056689458999999998 2024-09-13T05:10:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813944+0000", 2024-09-13T05:10:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5420000000000005e-06 2024-09-13T05:10:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14198 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:10:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.488499183, 2024-09-13T05:10:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49458811899999999, 2024-09-13T05:10:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14198 2024-09-13T05:10:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:10:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:10:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:10:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761426+0000", 2024-09-13T05:10:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8789999999999999e-06 2024-09-13T05:10:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761432+0000", 2024-09-13T05:10:31.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1399999999999997e-06 2024-09-13T05:10:31.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761437+0000", 2024-09-13T05:10:31.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8579999999999999e-06 2024-09-13T05:10:31.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815563+0000", 2024-09-13T05:10:31.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054125877000000003 2024-09-13T05:10:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815570+0000", 2024-09-13T05:10:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1169999999999998e-06 2024-09-13T05:10:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14315 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.769102+0000", 2024-09-13T05:10:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48082061300000001, 2024-09-13T05:10:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.486942918, 2024-09-13T05:10:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14315 2024-09-13T05:10:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769102+0000", 2024-09-13T05:10:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769102+0000", 2024-09-13T05:10:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769102+0000", 2024-09-13T05:10:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769104+0000", 2024-09-13T05:10:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0229999999999999e-06 2024-09-13T05:10:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769109+0000", 2024-09-13T05:10:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0329999999999999e-06 2024-09-13T05:10:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769113+0000", 2024-09-13T05:10:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6009999999999997e-06 2024-09-13T05:10:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818055+0000", 2024-09-13T05:10:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048941720000000001 2024-09-13T05:10:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818063+0000", 2024-09-13T05:10:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5269999999999998e-06 2024-09-13T05:10:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.948 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.948 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14347 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.948 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.777069+0000", 2024-09-13T05:10:31.948 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47285345899999998, 2024-09-13T05:10:31.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47900988500000002, 2024-09-13T05:10:31.948 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.948 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.948 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14347 2024-09-13T05:10:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777069+0000", 2024-09-13T05:10:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777069+0000", 2024-09-13T05:10:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777069+0000", 2024-09-13T05:10:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777071+0000", 2024-09-13T05:10:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6220000000000001e-06 2024-09-13T05:10:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777077+0000", 2024-09-13T05:10:31.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8549999999999998e-06 2024-09-13T05:10:31.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777082+0000", 2024-09-13T05:10:31.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9919999999999998e-06 2024-09-13T05:10:31.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819477+0000", 2024-09-13T05:10:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042395395000000002 2024-09-13T05:10:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819488+0000", 2024-09-13T05:10:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0866000000000001e-05 2024-09-13T05:10:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.953 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14408 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.953 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.781534+0000", 2024-09-13T05:10:31.953 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46838867699999998, 2024-09-13T05:10:31.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47457826400000003, 2024-09-13T05:10:31.953 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.953 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.953 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.953 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.953 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.954 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14408 2024-09-13T05:10:31.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.954 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781534+0000", 2024-09-13T05:10:31.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781534+0000", 2024-09-13T05:10:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781533+0000", 2024-09-13T05:10:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781537+0000", 2024-09-13T05:10:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8569999999999997e-06 2024-09-13T05:10:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781545+0000", 2024-09-13T05:10:31.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2169999999999994e-06 2024-09-13T05:10:31.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781551+0000", 2024-09-13T05:10:31.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.049e-06 2024-09-13T05:10:31.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820750+0000", 2024-09-13T05:10:31.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039198447999999997 2024-09-13T05:10:31.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820760+0000", 2024-09-13T05:10:31.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9879999999999999e-06 2024-09-13T05:10:31.957 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.958 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.958 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.958 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14504 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.958 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.801023+0000", 2024-09-13T05:10:31.958 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44889955500000001, 2024-09-13T05:10:31.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45512307099999999, 2024-09-13T05:10:31.959 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.959 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.959 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14504 2024-09-13T05:10:31.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.959 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801023+0000", 2024-09-13T05:10:31.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801023+0000", 2024-09-13T05:10:31.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801023+0000", 2024-09-13T05:10:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801024+0000", 2024-09-13T05:10:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.683e-06 2024-09-13T05:10:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801027+0000", 2024-09-13T05:10:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.942e-06 2024-09-13T05:10:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801031+0000", 2024-09-13T05:10:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2329999999999998e-06 2024-09-13T05:10:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821847+0000", 2024-09-13T05:10:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020816384 2024-09-13T05:10:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821850+0000", 2024-09-13T05:10:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4979999999999998e-06 2024-09-13T05:10:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14562 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.805241+0000", 2024-09-13T05:10:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44468174399999999, 2024-09-13T05:10:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45093770799999999, 2024-09-13T05:10:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14562 2024-09-13T05:10:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805241+0000", 2024-09-13T05:10:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805241+0000", 2024-09-13T05:10:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805240+0000", 2024-09-13T05:10:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805243+0000", 2024-09-13T05:10:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4609999999999998e-06 2024-09-13T05:10:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805253+0000", 2024-09-13T05:10:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0560000000000001e-05 2024-09-13T05:10:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805260+0000", 2024-09-13T05:10:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5869999999999998e-06 2024-09-13T05:10:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823235+0000", 2024-09-13T05:10:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017974978999999999 2024-09-13T05:10:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823240+0000", 2024-09-13T05:10:31.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4439999999999999e-06 2024-09-13T05:10:31.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.967 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.967 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14103 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.967 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.749103+0000", 2024-09-13T05:10:31.967 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50081935600000005, 2024-09-13T05:10:31.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50711002999999999, 2024-09-13T05:10:31.967 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.967 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14103 2024-09-13T05:10:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749103+0000", 2024-09-13T05:10:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749103+0000", 2024-09-13T05:10:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749103+0000", 2024-09-13T05:10:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749109+0000", 2024-09-13T05:10:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.443e-06 2024-09-13T05:10:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749116+0000", 2024-09-13T05:10:31.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.703e-06 2024-09-13T05:10:31.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749119+0000", 2024-09-13T05:10:31.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-09-13T05:10:31.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812446+0000", 2024-09-13T05:10:31.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063326804 2024-09-13T05:10:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812454+0000", 2024-09-13T05:10:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4719999999999998e-06 2024-09-13T05:10:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14138 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757251+0000", 2024-09-13T05:10:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49267125699999997, 2024-09-13T05:10:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49899595200000002, 2024-09-13T05:10:31.972 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.972 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.972 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.972 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.972 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.972 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14138 2024-09-13T05:10:31.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.972 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757251+0000", 2024-09-13T05:10:31.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757251+0000", 2024-09-13T05:10:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757251+0000", 2024-09-13T05:10:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757254+0000", 2024-09-13T05:10:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9040000000000001e-06 2024-09-13T05:10:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757260+0000", 2024-09-13T05:10:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.127e-06 2024-09-13T05:10:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757266+0000", 2024-09-13T05:10:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0480000000000004e-06 2024-09-13T05:10:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813972+0000", 2024-09-13T05:10:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056705879000000001 2024-09-13T05:10:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.813980+0000", 2024-09-13T05:10:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3100000000000001e-06 2024-09-13T05:10:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14199 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.976 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:10:31.976 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48848030999999997, 2024-09-13T05:10:31.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49483759399999999, 2024-09-13T05:10:31.976 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.976 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.976 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14199 2024-09-13T05:10:31.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.976 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:10:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:10:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:10:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761445+0000", 2024-09-13T05:10:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7779999999999999e-06 2024-09-13T05:10:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761450+0000", 2024-09-13T05:10:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6350000000000003e-06 2024-09-13T05:10:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761455+0000", 2024-09-13T05:10:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9930000000000003e-06 2024-09-13T05:10:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815600+0000", 2024-09-13T05:10:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054144982000000001 2024-09-13T05:10:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815607+0000", 2024-09-13T05:10:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4749999999999998e-06 2024-09-13T05:10:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14316 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.769117+0000", 2024-09-13T05:10:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48080544600000003, 2024-09-13T05:10:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48719661399999997, 2024-09-13T05:10:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14316 2024-09-13T05:10:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769117+0000", 2024-09-13T05:10:31.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769117+0000", 2024-09-13T05:10:31.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769117+0000", 2024-09-13T05:10:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769119+0000", 2024-09-13T05:10:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1239999999999999e-06 2024-09-13T05:10:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769125+0000", 2024-09-13T05:10:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6289999999999998e-06 2024-09-13T05:10:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769129+0000", 2024-09-13T05:10:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7360000000000001e-06 2024-09-13T05:10:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818103+0000", 2024-09-13T05:10:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048973847000000001 2024-09-13T05:10:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818111+0000", 2024-09-13T05:10:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6569999999999997e-06 2024-09-13T05:10:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14348 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.777086+0000", 2024-09-13T05:10:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47283600399999998, 2024-09-13T05:10:31.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47925993300000003, 2024-09-13T05:10:31.985 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.985 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.985 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.985 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.985 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.985 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14348 2024-09-13T05:10:31.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.985 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777086+0000", 2024-09-13T05:10:31.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777086+0000", 2024-09-13T05:10:31.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777086+0000", 2024-09-13T05:10:31.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777089+0000", 2024-09-13T05:10:31.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8839999999999998e-06 2024-09-13T05:10:31.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777095+0000", 2024-09-13T05:10:31.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6720000000000001e-06 2024-09-13T05:10:31.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777100+0000", 2024-09-13T05:10:31.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2870000000000004e-06 2024-09-13T05:10:31.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819516+0000", 2024-09-13T05:10:31.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042415913 2024-09-13T05:10:31.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819522+0000", 2024-09-13T05:10:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1070000000000001e-06 2024-09-13T05:10:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14409 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.781557+0000", 2024-09-13T05:10:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46836594300000001, 2024-09-13T05:10:31.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47482371899999998, 2024-09-13T05:10:31.990 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.990 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.990 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.990 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.990 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.990 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14409 2024-09-13T05:10:31.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.990 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781557+0000", 2024-09-13T05:10:31.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781557+0000", 2024-09-13T05:10:31.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781556+0000", 2024-09-13T05:10:31.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781559+0000", 2024-09-13T05:10:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0630000000000002e-06 2024-09-13T05:10:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781567+0000", 2024-09-13T05:10:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6890000000000004e-06 2024-09-13T05:10:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781572+0000", 2024-09-13T05:10:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:10:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820788+0000", 2024-09-13T05:10:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039216584999999998 2024-09-13T05:10:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820792+0000", 2024-09-13T05:10:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.512e-06 2024-09-13T05:10:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14506 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.801033+0000", 2024-09-13T05:10:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44888966899999999, 2024-09-13T05:10:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45537987000000002, 2024-09-13T05:10:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14506 2024-09-13T05:10:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801033+0000", 2024-09-13T05:10:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801033+0000", 2024-09-13T05:10:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801033+0000", 2024-09-13T05:10:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801035+0000", 2024-09-13T05:10:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0229999999999999e-06 2024-09-13T05:10:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801037+0000", 2024-09-13T05:10:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.853e-06 2024-09-13T05:10:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801040+0000", 2024-09-13T05:10:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7379999999999999e-06 2024-09-13T05:10:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821876+0000", 2024-09-13T05:10:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020835388999999999 2024-09-13T05:10:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821885+0000", 2024-09-13T05:10:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4639999999999995e-06 2024-09-13T05:10:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14564 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.805264+0000", 2024-09-13T05:10:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44465804799999997, 2024-09-13T05:10:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45118228900000001, 2024-09-13T05:10:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.000 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.000 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.000 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.000 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14564 2024-09-13T05:10:32.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.000 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805264+0000", 2024-09-13T05:10:32.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805264+0000", 2024-09-13T05:10:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805264+0000", 2024-09-13T05:10:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805267+0000", 2024-09-13T05:10:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5059999999999998e-06 2024-09-13T05:10:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805278+0000", 2024-09-13T05:10:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1325000000000001e-05 2024-09-13T05:10:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805283+0000", 2024-09-13T05:10:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2480000000000004e-06 2024-09-13T05:10:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823275+0000", 2024-09-13T05:10:32.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017991526000000001 2024-09-13T05:10:32.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823284+0000", 2024-09-13T05:10:32.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9779999999999994e-06 2024-09-13T05:10:32.003 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.003 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.003 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.003 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14104 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.003 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.749122+0000", 2024-09-13T05:10:32.003 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50080008499999995, 2024-09-13T05:10:32.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50735840700000001, 2024-09-13T05:10:32.004 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.004 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.004 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.004 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.004 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.004 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14104 2024-09-13T05:10:32.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.004 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749122+0000", 2024-09-13T05:10:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749122+0000", 2024-09-13T05:10:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749122+0000", 2024-09-13T05:10:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749124+0000", 2024-09-13T05:10:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7120000000000001e-06 2024-09-13T05:10:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749127+0000", 2024-09-13T05:10:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.942e-06 2024-09-13T05:10:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749129+0000", 2024-09-13T05:10:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6000000000000001e-06 2024-09-13T05:10:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812480+0000", 2024-09-13T05:10:32.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063350575000000006 2024-09-13T05:10:32.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812487+0000", 2024-09-13T05:10:32.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3980000000000002e-06 2024-09-13T05:10:32.007 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.007 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.007 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.008 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14139 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.008 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757293+0000", 2024-09-13T05:10:32.008 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49262984199999998, 2024-09-13T05:10:32.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49922050499999998, 2024-09-13T05:10:32.008 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.008 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.008 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.008 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.008 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.008 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14139 2024-09-13T05:10:32.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.008 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757293+0000", 2024-09-13T05:10:32.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757293+0000", 2024-09-13T05:10:32.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757292+0000", 2024-09-13T05:10:32.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:32.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757297+0000", 2024-09-13T05:10:32.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5820000000000001e-06 2024-09-13T05:10:32.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757308+0000", 2024-09-13T05:10:32.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1168e-05 2024-09-13T05:10:32.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757316+0000", 2024-09-13T05:10:32.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6559999999999992e-06 2024-09-13T05:10:32.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814010+0000", 2024-09-13T05:10:32.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056693556999999999 2024-09-13T05:10:32.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814017+0000", 2024-09-13T05:10:32.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.729e-06 2024-09-13T05:10:32.011 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.011 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.012 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.012 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14200 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.012 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:10:32.012 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48846179699999998, 2024-09-13T05:10:32.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49510264799999998, 2024-09-13T05:10:32.012 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.012 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.012 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.012 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.012 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.012 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14200 2024-09-13T05:10:32.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.013 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:10:32.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:10:32.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761460+0000", 2024-09-13T05:10:32.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761462+0000", 2024-09-13T05:10:32.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9659999999999999e-06 2024-09-13T05:10:32.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761466+0000", 2024-09-13T05:10:32.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6109999999999998e-06 2024-09-13T05:10:32.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761471+0000", 2024-09-13T05:10:32.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1019999999999996e-06 2024-09-13T05:10:32.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815631+0000", 2024-09-13T05:10:32.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054159680000000002 2024-09-13T05:10:32.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815637+0000", 2024-09-13T05:10:32.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-09-13T05:10:32.016 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.016 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.017 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.017 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14317 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.017 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.769133+0000", 2024-09-13T05:10:32.017 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48078943400000002, 2024-09-13T05:10:32.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48749453799999998, 2024-09-13T05:10:32.017 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.017 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.017 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.017 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.018 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.018 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14317 2024-09-13T05:10:32.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.018 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769133+0000", 2024-09-13T05:10:32.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769133+0000", 2024-09-13T05:10:32.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769133+0000", 2024-09-13T05:10:32.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769140+0000", 2024-09-13T05:10:32.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0639999999999996e-06 2024-09-13T05:10:32.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769148+0000", 2024-09-13T05:10:32.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1559999999999995e-06 2024-09-13T05:10:32.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769153+0000", 2024-09-13T05:10:32.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0030000000000002e-06 2024-09-13T05:10:32.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818140+0000", 2024-09-13T05:10:32.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048987027000000002 2024-09-13T05:10:32.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818149+0000", 2024-09-13T05:10:32.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7509999999999997e-06 2024-09-13T05:10:32.021 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.021 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.021 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.021 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14349 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.021 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.777104+0000", 2024-09-13T05:10:32.022 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47281823099999998, 2024-09-13T05:10:32.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47959063299999999, 2024-09-13T05:10:32.022 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.022 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.022 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.022 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.022 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.022 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14349 2024-09-13T05:10:32.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.022 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777104+0000", 2024-09-13T05:10:32.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777104+0000", 2024-09-13T05:10:32.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777104+0000", 2024-09-13T05:10:32.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777106+0000", 2024-09-13T05:10:32.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.61e-06 2024-09-13T05:10:32.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777112+0000", 2024-09-13T05:10:32.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-09-13T05:10:32.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777117+0000", 2024-09-13T05:10:32.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8620000000000002e-06 2024-09-13T05:10:32.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819545+0000", 2024-09-13T05:10:32.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042427573000000003 2024-09-13T05:10:32.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819551+0000", 2024-09-13T05:10:32.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0519999999999998e-06 2024-09-13T05:10:32.026 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.026 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.026 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.027 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14410 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.027 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.781576+0000", 2024-09-13T05:10:32.027 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46834609300000002, 2024-09-13T05:10:32.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47518196099999999, 2024-09-13T05:10:32.027 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.027 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.027 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.028 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.028 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.028 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14410 2024-09-13T05:10:32.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.028 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781576+0000", 2024-09-13T05:10:32.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781576+0000", 2024-09-13T05:10:32.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781576+0000", 2024-09-13T05:10:32.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781579+0000", 2024-09-13T05:10:32.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6960000000000001e-06 2024-09-13T05:10:32.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781585+0000", 2024-09-13T05:10:32.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8839999999999999e-06 2024-09-13T05:10:32.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781591+0000", 2024-09-13T05:10:32.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6109999999999999e-06 2024-09-13T05:10:32.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820825+0000", 2024-09-13T05:10:32.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039233344000000003 2024-09-13T05:10:32.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820834+0000", 2024-09-13T05:10:32.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4809999999999995e-06 2024-09-13T05:10:32.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.033 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.033 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14507 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.033 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.801042+0000", 2024-09-13T05:10:32.033 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44888017899999999, 2024-09-13T05:10:32.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45578201800000001, 2024-09-13T05:10:32.033 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.034 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.034 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14507 2024-09-13T05:10:32.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.034 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801042+0000", 2024-09-13T05:10:32.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801042+0000", 2024-09-13T05:10:32.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801042+0000", 2024-09-13T05:10:32.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801044+0000", 2024-09-13T05:10:32.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4929999999999999e-06 2024-09-13T05:10:32.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801047+0000", 2024-09-13T05:10:32.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0149999999999999e-06 2024-09-13T05:10:32.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801051+0000", 2024-09-13T05:10:32.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3549999999999998e-06 2024-09-13T05:10:32.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821922+0000", 2024-09-13T05:10:32.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020870823 2024-09-13T05:10:32.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821929+0000", 2024-09-13T05:10:32.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1439999999999997e-06 2024-09-13T05:10:32.037 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.037 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.037 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.037 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14566 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.037 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.805289+0000", 2024-09-13T05:10:32.038 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44463383099999998, 2024-09-13T05:10:32.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45160110599999997, 2024-09-13T05:10:32.038 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.038 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.038 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.038 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.038 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.038 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14566 2024-09-13T05:10:32.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.038 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805289+0000", 2024-09-13T05:10:32.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805289+0000", 2024-09-13T05:10:32.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805288+0000", 2024-09-13T05:10:32.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805291+0000", 2024-09-13T05:10:32.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.553e-06 2024-09-13T05:10:32.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805301+0000", 2024-09-13T05:10:32.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0392e-05 2024-09-13T05:10:32.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805311+0000", 2024-09-13T05:10:32.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.024e-05 2024-09-13T05:10:32.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823311+0000", 2024-09-13T05:10:32.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017999864000000001 2024-09-13T05:10:32.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823315+0000", 2024-09-13T05:10:32.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4599999999999999e-06 2024-09-13T05:10:32.041 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.041 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.041 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.042 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14105 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.042 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.749131+0000", 2024-09-13T05:10:32.042 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50079111499999995, 2024-09-13T05:10:32.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50783889500000001, 2024-09-13T05:10:32.042 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.042 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.042 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.042 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.042 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.042 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14105 2024-09-13T05:10:32.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.042 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749131+0000", 2024-09-13T05:10:32.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749131+0000", 2024-09-13T05:10:32.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749131+0000", 2024-09-13T05:10:32.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749132+0000", 2024-09-13T05:10:32.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3829999999999999e-06 2024-09-13T05:10:32.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749135+0000", 2024-09-13T05:10:32.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7769999999999998e-06 2024-09-13T05:10:32.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749138+0000", 2024-09-13T05:10:32.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5950000000000001e-06 2024-09-13T05:10:32.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812513+0000", 2024-09-13T05:10:32.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063375467000000005 2024-09-13T05:10:32.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812521+0000", 2024-09-13T05:10:32.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7800000000000001e-06 2024-09-13T05:10:32.046 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.046 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.046 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.046 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14140 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.046 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757322+0000", 2024-09-13T05:10:32.046 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49260005899999998, 2024-09-13T05:10:32.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49971597800000001, 2024-09-13T05:10:32.046 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.046 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.046 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.046 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14140 2024-09-13T05:10:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757322+0000", 2024-09-13T05:10:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757322+0000", 2024-09-13T05:10:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757322+0000", 2024-09-13T05:10:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757326+0000", 2024-09-13T05:10:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1500000000000001e-06 2024-09-13T05:10:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757332+0000", 2024-09-13T05:10:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0249999999999999e-06 2024-09-13T05:10:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757337+0000", 2024-09-13T05:10:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.656e-06 2024-09-13T05:10:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814051+0000", 2024-09-13T05:10:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056714091000000001 2024-09-13T05:10:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814083+0000", 2024-09-13T05:10:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2289999999999997e-05 2024-09-13T05:10:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14201 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:10:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48844736700000002, 2024-09-13T05:10:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49562402999999999, 2024-09-13T05:10:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14201 2024-09-13T05:10:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:10:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:10:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:10:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761477+0000", 2024-09-13T05:10:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5620000000000002e-06 2024-09-13T05:10:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761483+0000", 2024-09-13T05:10:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7400000000000001e-06 2024-09-13T05:10:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761487+0000", 2024-09-13T05:10:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8130000000000002e-06 2024-09-13T05:10:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815697+0000", 2024-09-13T05:10:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054210253 2024-09-13T05:10:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815705+0000", 2024-09-13T05:10:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7049999999999999e-06 2024-09-13T05:10:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14318 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.769157+0000", 2024-09-13T05:10:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48076511100000002, 2024-09-13T05:10:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48800736900000002, 2024-09-13T05:10:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14318 2024-09-13T05:10:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769157+0000", 2024-09-13T05:10:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769157+0000", 2024-09-13T05:10:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769157+0000", 2024-09-13T05:10:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769160+0000", 2024-09-13T05:10:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.537e-06 2024-09-13T05:10:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769165+0000", 2024-09-13T05:10:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3469999999999998e-06 2024-09-13T05:10:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769169+0000", 2024-09-13T05:10:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5430000000000004e-06 2024-09-13T05:10:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818192+0000", 2024-09-13T05:10:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.049022531000000001 2024-09-13T05:10:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818201+0000", 2024-09-13T05:10:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.755e-06 2024-09-13T05:10:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14350 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.777122+0000", 2024-09-13T05:10:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47280075300000002, 2024-09-13T05:10:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48008712100000001, 2024-09-13T05:10:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14350 2024-09-13T05:10:32.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.062 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777122+0000", 2024-09-13T05:10:32.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777122+0000", 2024-09-13T05:10:32.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777121+0000", 2024-09-13T05:10:32.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777124+0000", 2024-09-13T05:10:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8720000000000002e-06 2024-09-13T05:10:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777131+0000", 2024-09-13T05:10:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9380000000000003e-06 2024-09-13T05:10:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777136+0000", 2024-09-13T05:10:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:10:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819598+0000", 2024-09-13T05:10:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042461794999999997 2024-09-13T05:10:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819611+0000", 2024-09-13T05:10:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2347999999999999e-05 2024-09-13T05:10:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14411 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.781597+0000", 2024-09-13T05:10:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46832559800000001, 2024-09-13T05:10:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47565173999999999, 2024-09-13T05:10:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14411 2024-09-13T05:10:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781597+0000", 2024-09-13T05:10:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781597+0000", 2024-09-13T05:10:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781597+0000", 2024-09-13T05:10:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781599+0000", 2024-09-13T05:10:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.463e-06 2024-09-13T05:10:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781605+0000", 2024-09-13T05:10:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2829999999999998e-06 2024-09-13T05:10:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781610+0000", 2024-09-13T05:10:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6970000000000001e-06 2024-09-13T05:10:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820862+0000", 2024-09-13T05:10:32.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039252449000000002 2024-09-13T05:10:32.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820868+0000", 2024-09-13T05:10:32.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8189999999999997e-06 2024-09-13T05:10:32.069 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.069 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.069 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14509 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.801053+0000", 2024-09-13T05:10:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44886906500000001, 2024-09-13T05:10:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45622989400000002, 2024-09-13T05:10:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14509 2024-09-13T05:10:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801053+0000", 2024-09-13T05:10:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801053+0000", 2024-09-13T05:10:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801053+0000", 2024-09-13T05:10:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801055+0000", 2024-09-13T05:10:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5910000000000001e-06 2024-09-13T05:10:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801058+0000", 2024-09-13T05:10:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9919999999999999e-06 2024-09-13T05:10:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801061+0000", 2024-09-13T05:10:32.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5619999999999999e-06 2024-09-13T05:10:32.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821961+0000", 2024-09-13T05:10:32.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020899234999999999 2024-09-13T05:10:32.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821967+0000", 2024-09-13T05:10:32.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4069999999999998e-06 2024-09-13T05:10:32.073 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.073 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14568 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.805317+0000", 2024-09-13T05:10:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44460515099999998, 2024-09-13T05:10:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.451998815, 2024-09-13T05:10:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14568 2024-09-13T05:10:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805317+0000", 2024-09-13T05:10:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805317+0000", 2024-09-13T05:10:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805317+0000", 2024-09-13T05:10:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805320+0000", 2024-09-13T05:10:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8710000000000001e-06 2024-09-13T05:10:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805326+0000", 2024-09-13T05:10:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9000000000000003e-06 2024-09-13T05:10:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805331+0000", 2024-09-13T05:10:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8489999999999997e-06 2024-09-13T05:10:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823346+0000", 2024-09-13T05:10:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018015165 2024-09-13T05:10:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823355+0000", 2024-09-13T05:10:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1689999999999998e-06 2024-09-13T05:10:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14106 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.749140+0000", 2024-09-13T05:10:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.500782422, 2024-09-13T05:10:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50821043099999996, 2024-09-13T05:10:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14106 2024-09-13T05:10:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749140+0000", 2024-09-13T05:10:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749140+0000", 2024-09-13T05:10:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749140+0000", 2024-09-13T05:10:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749141+0000", 2024-09-13T05:10:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4959999999999999e-06 2024-09-13T05:10:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749144+0000", 2024-09-13T05:10:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8629999999999999e-06 2024-09-13T05:10:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749147+0000", 2024-09-13T05:10:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.531e-06 2024-09-13T05:10:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812548+0000", 2024-09-13T05:10:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063400864000000001 2024-09-13T05:10:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812555+0000", 2024-09-13T05:10:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2400000000000001e-06 2024-09-13T05:10:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14141 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757341+0000", 2024-09-13T05:10:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.492581557, 2024-09-13T05:10:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50004230299999997, 2024-09-13T05:10:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14141 2024-09-13T05:10:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757341+0000", 2024-09-13T05:10:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757341+0000", 2024-09-13T05:10:32.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757341+0000", 2024-09-13T05:10:32.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757343+0000", 2024-09-13T05:10:32.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6759999999999999e-06 2024-09-13T05:10:32.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757349+0000", 2024-09-13T05:10:32.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5559999999999998e-06 2024-09-13T05:10:32.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757353+0000", 2024-09-13T05:10:32.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.464e-06 2024-09-13T05:10:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814112+0000", 2024-09-13T05:10:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056758901 2024-09-13T05:10:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814121+0000", 2024-09-13T05:10:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6330000000000002e-06 2024-09-13T05:10:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14202 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:10:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48838271, 2024-09-13T05:10:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49587731800000001, 2024-09-13T05:10:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.088 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14202 2024-09-13T05:10:32.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.088 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:10:32.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:10:32.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761489+0000", 2024-09-13T05:10:32.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999495 2024-09-13T05:10:32.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761543+0000", 2024-09-13T05:10:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3983999999999997e-05 2024-09-13T05:10:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761552+0000", 2024-09-13T05:10:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-13T05:10:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761559+0000", 2024-09-13T05:10:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7710000000000001e-06 2024-09-13T05:10:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815742+0000", 2024-09-13T05:10:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054183488000000002 2024-09-13T05:10:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815749+0000", 2024-09-13T05:10:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1609999999999997e-06 2024-09-13T05:10:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14319 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.769173+0000", 2024-09-13T05:10:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48074915600000001, 2024-09-13T05:10:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48827627800000001, 2024-09-13T05:10:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14319 2024-09-13T05:10:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769173+0000", 2024-09-13T05:10:32.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769173+0000", 2024-09-13T05:10:32.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769173+0000", 2024-09-13T05:10:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769175+0000", 2024-09-13T05:10:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3070000000000001e-06 2024-09-13T05:10:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769183+0000", 2024-09-13T05:10:32.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9810000000000003e-06 2024-09-13T05:10:32.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769188+0000", 2024-09-13T05:10:32.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6890000000000003e-06 2024-09-13T05:10:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818238+0000", 2024-09-13T05:10:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.04904998 2024-09-13T05:10:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818249+0000", 2024-09-13T05:10:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0543999999999999e-05 2024-09-13T05:10:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14351 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.777141+0000", 2024-09-13T05:10:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47278167300000001, 2024-09-13T05:10:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48034271099999998, 2024-09-13T05:10:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14351 2024-09-13T05:10:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777141+0000", 2024-09-13T05:10:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777141+0000", 2024-09-13T05:10:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777140+0000", 2024-09-13T05:10:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777143+0000", 2024-09-13T05:10:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:10:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777149+0000", 2024-09-13T05:10:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0120000000000002e-06 2024-09-13T05:10:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777155+0000", 2024-09-13T05:10:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7819999999999999e-06 2024-09-13T05:10:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819653+0000", 2024-09-13T05:10:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042497906000000002 2024-09-13T05:10:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819660+0000", 2024-09-13T05:10:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0609999999999998e-06 2024-09-13T05:10:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14412 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.781615+0000", 2024-09-13T05:10:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46830786699999999, 2024-09-13T05:10:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47590285799999998, 2024-09-13T05:10:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14412 2024-09-13T05:10:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781615+0000", 2024-09-13T05:10:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781615+0000", 2024-09-13T05:10:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781614+0000", 2024-09-13T05:10:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781617+0000", 2024-09-13T05:10:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9170000000000002e-06 2024-09-13T05:10:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781623+0000", 2024-09-13T05:10:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8080000000000001e-06 2024-09-13T05:10:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781628+0000", 2024-09-13T05:10:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0069999999999997e-06 2024-09-13T05:10:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820906+0000", 2024-09-13T05:10:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039278038000000001 2024-09-13T05:10:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820915+0000", 2024-09-13T05:10:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4469999999999995e-06 2024-09-13T05:10:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14510 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.801064+0000", 2024-09-13T05:10:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44885889400000001, 2024-09-13T05:10:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45648633900000002, 2024-09-13T05:10:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14510 2024-09-13T05:10:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801064+0000", 2024-09-13T05:10:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801064+0000", 2024-09-13T05:10:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801063+0000", 2024-09-13T05:10:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801065+0000", 2024-09-13T05:10:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4649999999999999e-06 2024-09-13T05:10:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801068+0000", 2024-09-13T05:10:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7819999999999998e-06 2024-09-13T05:10:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801070+0000", 2024-09-13T05:10:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8619999999999999e-06 2024-09-13T05:10:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821997+0000", 2024-09-13T05:10:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020926206999999999 2024-09-13T05:10:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822001+0000", 2024-09-13T05:10:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1110000000000001e-06 2024-09-13T05:10:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14570 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.805335+0000", 2024-09-13T05:10:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44458761400000002, 2024-09-13T05:10:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45225656199999997, 2024-09-13T05:10:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14570 2024-09-13T05:10:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805335+0000", 2024-09-13T05:10:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805335+0000", 2024-09-13T05:10:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805335+0000", 2024-09-13T05:10:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805337+0000", 2024-09-13T05:10:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3580000000000001e-06 2024-09-13T05:10:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805347+0000", 2024-09-13T05:10:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0463e-05 2024-09-13T05:10:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805358+0000", 2024-09-13T05:10:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0244999999999999e-05 2024-09-13T05:10:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823383+0000", 2024-09-13T05:10:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018025624000000001 2024-09-13T05:10:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823387+0000", 2024-09-13T05:10:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.382e-06 2024-09-13T05:10:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14107 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.749149+0000", 2024-09-13T05:10:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50077330799999997, 2024-09-13T05:10:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50848608500000003, 2024-09-13T05:10:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14107 2024-09-13T05:10:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749149+0000", 2024-09-13T05:10:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749149+0000", 2024-09-13T05:10:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749149+0000", 2024-09-13T05:10:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749150+0000", 2024-09-13T05:10:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4670000000000001e-06 2024-09-13T05:10:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749153+0000", 2024-09-13T05:10:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8909999999999999e-06 2024-09-13T05:10:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749156+0000", 2024-09-13T05:10:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6840000000000001e-06 2024-09-13T05:10:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812581+0000", 2024-09-13T05:10:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063424916999999997 2024-09-13T05:10:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812589+0000", 2024-09-13T05:10:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9990000000000008e-06 2024-09-13T05:10:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14142 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757357+0000", 2024-09-13T05:10:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49256524699999998, 2024-09-13T05:10:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50031303400000005, 2024-09-13T05:10:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14142 2024-09-13T05:10:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757357+0000", 2024-09-13T05:10:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757357+0000", 2024-09-13T05:10:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757357+0000", 2024-09-13T05:10:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757359+0000", 2024-09-13T05:10:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6010000000000002e-06 2024-09-13T05:10:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757365+0000", 2024-09-13T05:10:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.045e-06 2024-09-13T05:10:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757369+0000", 2024-09-13T05:10:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7360000000000001e-06 2024-09-13T05:10:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814148+0000", 2024-09-13T05:10:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056778948000000003 2024-09-13T05:10:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814157+0000", 2024-09-13T05:10:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5990000000000002e-06 2024-09-13T05:10:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14203 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.764983+0000", 2024-09-13T05:10:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48493993299999999, 2024-09-13T05:10:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49272030500000003, 2024-09-13T05:10:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14203 2024-09-13T05:10:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.764983+0000", 2024-09-13T05:10:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.764983+0000", 2024-09-13T05:10:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761564+0000", 2024-09-13T05:10:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.996582 2024-09-13T05:10:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.764988+0000", 2024-09-13T05:10:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034239190000000001 2024-09-13T05:10:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765002+0000", 2024-09-13T05:10:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3657e-05 2024-09-13T05:10:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765009+0000", 2024-09-13T05:10:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1459999999999999e-06 2024-09-13T05:10:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815973+0000", 2024-09-13T05:10:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050964242 2024-09-13T05:10:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815998+0000", 2024-09-13T05:10:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5001e-05 2024-09-13T05:10:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14320 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.769192+0000", 2024-09-13T05:10:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48073017600000001, 2024-09-13T05:10:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48854499299999998, 2024-09-13T05:10:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14320 2024-09-13T05:10:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769192+0000", 2024-09-13T05:10:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769192+0000", 2024-09-13T05:10:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769192+0000", 2024-09-13T05:10:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769194+0000", 2024-09-13T05:10:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:10:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769202+0000", 2024-09-13T05:10:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4569999999999999e-06 2024-09-13T05:10:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769206+0000", 2024-09-13T05:10:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2699999999999998e-06 2024-09-13T05:10:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818301+0000", 2024-09-13T05:10:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.049094881 2024-09-13T05:10:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818308+0000", 2024-09-13T05:10:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6649999999999997e-06 2024-09-13T05:10:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14352 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.777173+0000", 2024-09-13T05:10:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47274923000000002, 2024-09-13T05:10:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48059646099999997, 2024-09-13T05:10:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14352 2024-09-13T05:10:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777173+0000", 2024-09-13T05:10:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777173+0000", 2024-09-13T05:10:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777173+0000", 2024-09-13T05:10:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777176+0000", 2024-09-13T05:10:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4740000000000001e-06 2024-09-13T05:10:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777183+0000", 2024-09-13T05:10:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4240000000000004e-06 2024-09-13T05:10:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777189+0000", 2024-09-13T05:10:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4210000000000003e-06 2024-09-13T05:10:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819690+0000", 2024-09-13T05:10:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042501153 2024-09-13T05:10:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819694+0000", 2024-09-13T05:10:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0300000000000004e-06 2024-09-13T05:10:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14413 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.781632+0000", 2024-09-13T05:10:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46829040900000002, 2024-09-13T05:10:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47617144, 2024-09-13T05:10:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14413 2024-09-13T05:10:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781632+0000", 2024-09-13T05:10:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781632+0000", 2024-09-13T05:10:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781632+0000", 2024-09-13T05:10:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781634+0000", 2024-09-13T05:10:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6290000000000002e-06 2024-09-13T05:10:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781640+0000", 2024-09-13T05:10:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8619999999999999e-06 2024-09-13T05:10:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781645+0000", 2024-09-13T05:10:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9099999999999996e-06 2024-09-13T05:10:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820944+0000", 2024-09-13T05:10:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039299247000000002 2024-09-13T05:10:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820962+0000", 2024-09-13T05:10:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7278999999999998e-05 2024-09-13T05:10:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14511 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.801073+0000", 2024-09-13T05:10:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44884975900000001, 2024-09-13T05:10:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45676470299999999, 2024-09-13T05:10:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14511 2024-09-13T05:10:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801073+0000", 2024-09-13T05:10:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801073+0000", 2024-09-13T05:10:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801072+0000", 2024-09-13T05:10:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801079+0000", 2024-09-13T05:10:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.105e-06 2024-09-13T05:10:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801088+0000", 2024-09-13T05:10:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8130000000000007e-06 2024-09-13T05:10:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801091+0000", 2024-09-13T05:10:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0709999999999999e-06 2024-09-13T05:10:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822039+0000", 2024-09-13T05:10:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020947457999999999 2024-09-13T05:10:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822050+0000", 2024-09-13T05:10:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1071e-05 2024-09-13T05:10:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14571 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.805362+0000", 2024-09-13T05:10:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.444560181, 2024-09-13T05:10:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45250751500000003, 2024-09-13T05:10:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14571 2024-09-13T05:10:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805362+0000", 2024-09-13T05:10:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805362+0000", 2024-09-13T05:10:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805362+0000", 2024-09-13T05:10:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805365+0000", 2024-09-13T05:10:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6970000000000002e-06 2024-09-13T05:10:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805371+0000", 2024-09-13T05:10:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4339999999999997e-06 2024-09-13T05:10:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805381+0000", 2024-09-13T05:10:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5149999999999995e-06 2024-09-13T05:10:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823418+0000", 2024-09-13T05:10:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018037411 2024-09-13T05:10:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823427+0000", 2024-09-13T05:10:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1200000000000008e-06 2024-09-13T05:10:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14108 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.749158+0000", 2024-09-13T05:10:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50076427099999998, 2024-09-13T05:10:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50874612900000005, 2024-09-13T05:10:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14108 2024-09-13T05:10:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749158+0000", 2024-09-13T05:10:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749158+0000", 2024-09-13T05:10:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749158+0000", 2024-09-13T05:10:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749159+0000", 2024-09-13T05:10:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.305e-06 2024-09-13T05:10:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749162+0000", 2024-09-13T05:10:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8820000000000001e-06 2024-09-13T05:10:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749165+0000", 2024-09-13T05:10:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.729e-06 2024-09-13T05:10:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812615+0000", 2024-09-13T05:10:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063450175999999997 2024-09-13T05:10:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812623+0000", 2024-09-13T05:10:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.571e-06 2024-09-13T05:10:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14143 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757373+0000", 2024-09-13T05:10:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49254924700000002, 2024-09-13T05:10:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50056362600000004, 2024-09-13T05:10:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14143 2024-09-13T05:10:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757373+0000", 2024-09-13T05:10:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757373+0000", 2024-09-13T05:10:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757373+0000", 2024-09-13T05:10:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757377+0000", 2024-09-13T05:10:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8130000000000002e-06 2024-09-13T05:10:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757382+0000", 2024-09-13T05:10:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3159999999999996e-06 2024-09-13T05:10:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757386+0000", 2024-09-13T05:10:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0829999999999997e-06 2024-09-13T05:10:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814185+0000", 2024-09-13T05:10:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056799386 2024-09-13T05:10:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814193+0000", 2024-09-13T05:10:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7130000000000005e-06 2024-09-13T05:10:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14204 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765017+0000", 2024-09-13T05:10:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48490593500000001, 2024-09-13T05:10:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49295410200000001, 2024-09-13T05:10:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14204 2024-09-13T05:10:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765017+0000", 2024-09-13T05:10:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765017+0000", 2024-09-13T05:10:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765016+0000", 2024-09-13T05:10:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765019+0000", 2024-09-13T05:10:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.356e-06 2024-09-13T05:10:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765022+0000", 2024-09-13T05:10:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.591e-06 2024-09-13T05:10:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765025+0000", 2024-09-13T05:10:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6929999999999999e-06 2024-09-13T05:10:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816048+0000", 2024-09-13T05:10:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051023249 2024-09-13T05:10:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816067+0000", 2024-09-13T05:10:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8419000000000001e-05 2024-09-13T05:10:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14321 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.769210+0000", 2024-09-13T05:10:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.480712321, 2024-09-13T05:10:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48879260899999999, 2024-09-13T05:10:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14321 2024-09-13T05:10:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769210+0000", 2024-09-13T05:10:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769210+0000", 2024-09-13T05:10:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769210+0000", 2024-09-13T05:10:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769212+0000", 2024-09-13T05:10:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5469999999999999e-06 2024-09-13T05:10:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769220+0000", 2024-09-13T05:10:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8820000000000001e-06 2024-09-13T05:10:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769225+0000", 2024-09-13T05:10:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5290000000000002e-06 2024-09-13T05:10:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818339+0000", 2024-09-13T05:10:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.049114624000000003 2024-09-13T05:10:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818346+0000", 2024-09-13T05:10:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2269999999999998e-06 2024-09-13T05:10:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14353 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.777194+0000", 2024-09-13T05:10:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47272897400000002, 2024-09-13T05:10:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.480843048, 2024-09-13T05:10:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14353 2024-09-13T05:10:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777194+0000", 2024-09-13T05:10:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777194+0000", 2024-09-13T05:10:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777193+0000", 2024-09-13T05:10:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777202+0000", 2024-09-13T05:10:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5040000000000002e-06 2024-09-13T05:10:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777208+0000", 2024-09-13T05:10:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3119999999999999e-06 2024-09-13T05:10:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777213+0000", 2024-09-13T05:10:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4940000000000003e-06 2024-09-13T05:10:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819731+0000", 2024-09-13T05:10:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042517856999999999 2024-09-13T05:10:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819741+0000", 2024-09-13T05:10:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6010000000000001e-06 2024-09-13T05:10:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14414 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.781649+0000", 2024-09-13T05:10:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46827322999999998, 2024-09-13T05:10:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47642125499999999, 2024-09-13T05:10:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14414 2024-09-13T05:10:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781649+0000", 2024-09-13T05:10:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781649+0000", 2024-09-13T05:10:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781649+0000", 2024-09-13T05:10:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781651+0000", 2024-09-13T05:10:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2900000000000001e-06 2024-09-13T05:10:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781657+0000", 2024-09-13T05:10:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.716e-06 2024-09-13T05:10:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781662+0000", 2024-09-13T05:10:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8060000000000002e-06 2024-09-13T05:10:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821006+0000", 2024-09-13T05:10:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039344531000000002 2024-09-13T05:10:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821013+0000", 2024-09-13T05:10:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7179999999999999e-06 2024-09-13T05:10:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14513 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.801094+0000", 2024-09-13T05:10:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44882833799999999, 2024-09-13T05:10:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45700848799999999, 2024-09-13T05:10:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14513 2024-09-13T05:10:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801094+0000", 2024-09-13T05:10:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801094+0000", 2024-09-13T05:10:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801094+0000", 2024-09-13T05:10:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801096+0000", 2024-09-13T05:10:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.747e-06 2024-09-13T05:10:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801099+0000", 2024-09-13T05:10:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0489999999999999e-06 2024-09-13T05:10:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801101+0000", 2024-09-13T05:10:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8059999999999999e-06 2024-09-13T05:10:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822092+0000", 2024-09-13T05:10:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020990216999999999 2024-09-13T05:10:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822096+0000", 2024-09-13T05:10:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5349999999999998e-06 2024-09-13T05:10:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14573 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.805386+0000", 2024-09-13T05:10:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44453695700000001, 2024-09-13T05:10:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45275314, 2024-09-13T05:10:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14573 2024-09-13T05:10:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805386+0000", 2024-09-13T05:10:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805386+0000", 2024-09-13T05:10:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805385+0000", 2024-09-13T05:10:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805388+0000", 2024-09-13T05:10:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7930000000000002e-06 2024-09-13T05:10:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805397+0000", 2024-09-13T05:10:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1220000000000001e-06 2024-09-13T05:10:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805407+0000", 2024-09-13T05:10:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6660000000000003e-06 2024-09-13T05:10:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823469+0000", 2024-09-13T05:10:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018062361999999998 2024-09-13T05:10:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823477+0000", 2024-09-13T05:10:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6369999999999999e-06 2024-09-13T05:10:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14109 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.749167+0000", 2024-09-13T05:10:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50075536099999995, 2024-09-13T05:10:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50900401399999995, 2024-09-13T05:10:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14109 2024-09-13T05:10:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749167+0000", 2024-09-13T05:10:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749167+0000", 2024-09-13T05:10:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749167+0000", 2024-09-13T05:10:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749168+0000", 2024-09-13T05:10:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2130000000000001e-06 2024-09-13T05:10:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749171+0000", 2024-09-13T05:10:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.83e-06 2024-09-13T05:10:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749174+0000", 2024-09-13T05:10:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7690000000000001e-06 2024-09-13T05:10:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812649+0000", 2024-09-13T05:10:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063475057000000001 2024-09-13T05:10:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812656+0000", 2024-09-13T05:10:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3810000000000001e-06 2024-09-13T05:10:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14144 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757390+0000", 2024-09-13T05:10:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49253228599999999, 2024-09-13T05:10:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50081519200000002, 2024-09-13T05:10:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14144 2024-09-13T05:10:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757390+0000", 2024-09-13T05:10:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757390+0000", 2024-09-13T05:10:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757390+0000", 2024-09-13T05:10:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757397+0000", 2024-09-13T05:10:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4220000000000003e-06 2024-09-13T05:10:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757456+0000", 2024-09-13T05:10:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8356000000000002e-05 2024-09-13T05:10:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757462+0000", 2024-09-13T05:10:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.224e-06 2024-09-13T05:10:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814222+0000", 2024-09-13T05:10:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056759727000000003 2024-09-13T05:10:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814230+0000", 2024-09-13T05:10:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4209999999999995e-06 2024-09-13T05:10:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14205 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765027+0000", 2024-09-13T05:10:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48489533499999998, 2024-09-13T05:10:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49322466399999998, 2024-09-13T05:10:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14205 2024-09-13T05:10:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765027+0000", 2024-09-13T05:10:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765027+0000", 2024-09-13T05:10:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765027+0000", 2024-09-13T05:10:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765028+0000", 2024-09-13T05:10:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4470000000000001e-06 2024-09-13T05:10:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765031+0000", 2024-09-13T05:10:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6709999999999999e-06 2024-09-13T05:10:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765034+0000", 2024-09-13T05:10:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7819999999999998e-06 2024-09-13T05:10:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816160+0000", 2024-09-13T05:10:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051126241000000003 2024-09-13T05:10:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816177+0000", 2024-09-13T05:10:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6833e-05 2024-09-13T05:10:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14322 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.769229+0000", 2024-09-13T05:10:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48069358600000001, 2024-09-13T05:10:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48909122100000002, 2024-09-13T05:10:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14322 2024-09-13T05:10:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769229+0000", 2024-09-13T05:10:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769229+0000", 2024-09-13T05:10:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769229+0000", 2024-09-13T05:10:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769231+0000", 2024-09-13T05:10:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5129999999999999e-06 2024-09-13T05:10:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769239+0000", 2024-09-13T05:10:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0530000000000007e-06 2024-09-13T05:10:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769244+0000", 2024-09-13T05:10:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.566e-06 2024-09-13T05:10:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818383+0000", 2024-09-13T05:10:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.049138873 2024-09-13T05:10:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818393+0000", 2024-09-13T05:10:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0696999999999999e-05 2024-09-13T05:10:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14354 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.777218+0000", 2024-09-13T05:10:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47270449199999998, 2024-09-13T05:10:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48117291000000001, 2024-09-13T05:10:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14354 2024-09-13T05:10:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777218+0000", 2024-09-13T05:10:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777218+0000", 2024-09-13T05:10:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777218+0000", 2024-09-13T05:10:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777220+0000", 2024-09-13T05:10:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4760000000000001e-06 2024-09-13T05:10:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777226+0000", 2024-09-13T05:10:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1530000000000002e-06 2024-09-13T05:10:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777232+0000", 2024-09-13T05:10:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.412e-06 2024-09-13T05:10:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819769+0000", 2024-09-13T05:10:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042536998999999999 2024-09-13T05:10:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819774+0000", 2024-09-13T05:10:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7130000000000002e-06 2024-09-13T05:10:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14415 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.781667+0000", 2024-09-13T05:10:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46825573500000001, 2024-09-13T05:10:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.476794049, 2024-09-13T05:10:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14415 2024-09-13T05:10:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781667+0000", 2024-09-13T05:10:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781667+0000", 2024-09-13T05:10:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781666+0000", 2024-09-13T05:10:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781669+0000", 2024-09-13T05:10:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6630000000000002e-06 2024-09-13T05:10:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781674+0000", 2024-09-13T05:10:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4929999999999998e-06 2024-09-13T05:10:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781679+0000", 2024-09-13T05:10:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1170000000000003e-06 2024-09-13T05:10:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821043+0000", 2024-09-13T05:10:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039363098999999999 2024-09-13T05:10:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821046+0000", 2024-09-13T05:10:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7629999999999998e-06 2024-09-13T05:10:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14514 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.801104+0000", 2024-09-13T05:10:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44881868800000002, 2024-09-13T05:10:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45742770799999999, 2024-09-13T05:10:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14514 2024-09-13T05:10:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801104+0000", 2024-09-13T05:10:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801104+0000", 2024-09-13T05:10:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801104+0000", 2024-09-13T05:10:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801105+0000", 2024-09-13T05:10:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.703e-06 2024-09-13T05:10:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801115+0000", 2024-09-13T05:10:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4450000000000002e-06 2024-09-13T05:10:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801120+0000", 2024-09-13T05:10:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7950000000000004e-06 2024-09-13T05:10:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822142+0000", 2024-09-13T05:10:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021021583 2024-09-13T05:10:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822189+0000", 2024-09-13T05:10:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6474999999999998e-05 2024-09-13T05:10:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14574 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.809099+0000", 2024-09-13T05:10:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.440823301, 2024-09-13T05:10:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.44950126400000001, 2024-09-13T05:10:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14574 2024-09-13T05:10:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809099+0000", 2024-09-13T05:10:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809099+0000", 2024-09-13T05:10:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.805411+0000", 2024-09-13T05:10:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9963121 2024-09-13T05:10:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809121+0000", 2024-09-13T05:10:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037097739999999999 2024-09-13T05:10:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809135+0000", 2024-09-13T05:10:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3448000000000001e-05 2024-09-13T05:10:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809179+0000", 2024-09-13T05:10:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4681999999999997e-05 2024-09-13T05:10:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823512+0000", 2024-09-13T05:10:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014333062000000001 2024-09-13T05:10:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823521+0000", 2024-09-13T05:10:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0469999999999999e-06 2024-09-13T05:10:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14110 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.749176+0000", 2024-09-13T05:10:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50074669000000005, 2024-09-13T05:10:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.509497482, 2024-09-13T05:10:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14110 2024-09-13T05:10:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749176+0000", 2024-09-13T05:10:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749176+0000", 2024-09-13T05:10:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749176+0000", 2024-09-13T05:10:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749177+0000", 2024-09-13T05:10:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4339999999999999e-06 2024-09-13T05:10:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749180+0000", 2024-09-13T05:10:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9059999999999998e-06 2024-09-13T05:10:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749183+0000", 2024-09-13T05:10:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7259999999999998e-06 2024-09-13T05:10:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812682+0000", 2024-09-13T05:10:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063499244999999996 2024-09-13T05:10:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812690+0000", 2024-09-13T05:10:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6580000000000002e-06 2024-09-13T05:10:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14145 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757469+0000", 2024-09-13T05:10:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49245396499999999, 2024-09-13T05:10:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50127324399999995, 2024-09-13T05:10:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14145 2024-09-13T05:10:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757469+0000", 2024-09-13T05:10:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757469+0000", 2024-09-13T05:10:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757468+0000", 2024-09-13T05:10:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757472+0000", 2024-09-13T05:10:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8070000000000001e-06 2024-09-13T05:10:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757478+0000", 2024-09-13T05:10:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.533e-06 2024-09-13T05:10:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757483+0000", 2024-09-13T05:10:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9130000000000002e-06 2024-09-13T05:10:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814259+0000", 2024-09-13T05:10:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056776136999999997 2024-09-13T05:10:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814442+0000", 2024-09-13T05:10:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000182256 2024-09-13T05:10:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14206 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765036+0000", 2024-09-13T05:10:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48488668000000001, 2024-09-13T05:10:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49377003699999999, 2024-09-13T05:10:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14206 2024-09-13T05:10:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765036+0000", 2024-09-13T05:10:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765036+0000", 2024-09-13T05:10:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765036+0000", 2024-09-13T05:10:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765037+0000", 2024-09-13T05:10:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3549999999999999e-06 2024-09-13T05:10:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765040+0000", 2024-09-13T05:10:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6840000000000001e-06 2024-09-13T05:10:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765043+0000", 2024-09-13T05:10:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7720000000000001e-06 2024-09-13T05:10:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816239+0000", 2024-09-13T05:10:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051195899000000003 2024-09-13T05:10:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816252+0000", 2024-09-13T05:10:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2342e-05 2024-09-13T05:10:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14323 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.769248+0000", 2024-09-13T05:10:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48067489000000002, 2024-09-13T05:10:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48962402900000002, 2024-09-13T05:10:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14323 2024-09-13T05:10:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769248+0000", 2024-09-13T05:10:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769248+0000", 2024-09-13T05:10:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769247+0000", 2024-09-13T05:10:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769250+0000", 2024-09-13T05:10:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6139999999999999e-06 2024-09-13T05:10:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769255+0000", 2024-09-13T05:10:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2000000000000002e-06 2024-09-13T05:10:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769259+0000", 2024-09-13T05:10:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2100000000000003e-06 2024-09-13T05:10:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818431+0000", 2024-09-13T05:10:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.049172172 2024-09-13T05:10:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818437+0000", 2024-09-13T05:10:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9549999999999997e-06 2024-09-13T05:10:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14355 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.777236+0000", 2024-09-13T05:10:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.472686196, 2024-09-13T05:10:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48169994900000002, 2024-09-13T05:10:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14355 2024-09-13T05:10:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777236+0000", 2024-09-13T05:10:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777236+0000", 2024-09-13T05:10:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777236+0000", 2024-09-13T05:10:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777238+0000", 2024-09-13T05:10:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4260000000000002e-06 2024-09-13T05:10:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777245+0000", 2024-09-13T05:10:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2469999999999997e-06 2024-09-13T05:10:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777249+0000", 2024-09-13T05:10:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7249999999999997e-06 2024-09-13T05:10:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819809+0000", 2024-09-13T05:10:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042559412999999997 2024-09-13T05:10:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819816+0000", 2024-09-13T05:10:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-06 2024-09-13T05:10:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14416 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.784993+0000", 2024-09-13T05:10:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46492918999999999, 2024-09-13T05:10:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47400888400000002, 2024-09-13T05:10:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14416 2024-09-13T05:10:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.784993+0000", 2024-09-13T05:10:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.784993+0000", 2024-09-13T05:10:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.781683+0000", 2024-09-13T05:10:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9966898 2024-09-13T05:10:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785000+0000", 2024-09-13T05:10:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033164819999999999 2024-09-13T05:10:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785012+0000", 2024-09-13T05:10:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2047e-05 2024-09-13T05:10:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785019+0000", 2024-09-13T05:10:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6199999999999999e-06 2024-09-13T05:10:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821077+0000", 2024-09-13T05:10:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.036057957000000002 2024-09-13T05:10:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821085+0000", 2024-09-13T05:10:32.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3930000000000002e-06 2024-09-13T05:10:32.249 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.249 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.249 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.249 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14516 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.249 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.801151+0000", 2024-09-13T05:10:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44877150900000001, 2024-09-13T05:10:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45791374299999998, 2024-09-13T05:10:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14516 2024-09-13T05:10:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801151+0000", 2024-09-13T05:10:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801151+0000", 2024-09-13T05:10:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801151+0000", 2024-09-13T05:10:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801152+0000", 2024-09-13T05:10:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7749999999999999e-06 2024-09-13T05:10:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801161+0000", 2024-09-13T05:10:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4910000000000005e-06 2024-09-13T05:10:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801164+0000", 2024-09-13T05:10:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9280000000000002e-06 2024-09-13T05:10:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822234+0000", 2024-09-13T05:10:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021070018999999999 2024-09-13T05:10:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822245+0000", 2024-09-13T05:10:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1314999999999999e-05 2024-09-13T05:10:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14575 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.809188+0000", 2024-09-13T05:10:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44073425599999999, 2024-09-13T05:10:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.44993145000000001, 2024-09-13T05:10:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14575 2024-09-13T05:10:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809188+0000", 2024-09-13T05:10:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809188+0000", 2024-09-13T05:10:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809188+0000", 2024-09-13T05:10:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809192+0000", 2024-09-13T05:10:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.104e-06 2024-09-13T05:10:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809199+0000", 2024-09-13T05:10:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1930000000000004e-06 2024-09-13T05:10:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809205+0000", 2024-09-13T05:10:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2269999999999998e-06 2024-09-13T05:10:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823557+0000", 2024-09-13T05:10:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014352142 2024-09-13T05:10:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823561+0000", 2024-09-13T05:10:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9809999999999997e-06 2024-09-13T05:10:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.258 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14111 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.258 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.749185+0000", 2024-09-13T05:10:32.258 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50073766600000003, 2024-09-13T05:10:32.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50996824799999996, 2024-09-13T05:10:32.258 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.258 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.258 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.258 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.258 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.258 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14111 2024-09-13T05:10:32.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.258 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749185+0000", 2024-09-13T05:10:32.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749185+0000", 2024-09-13T05:10:32.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749185+0000", 2024-09-13T05:10:32.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:32.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749186+0000", 2024-09-13T05:10:32.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.266e-06 2024-09-13T05:10:32.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749189+0000", 2024-09-13T05:10:32.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8439999999999998e-06 2024-09-13T05:10:32.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749191+0000", 2024-09-13T05:10:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6749999999999998e-06 2024-09-13T05:10:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812718+0000", 2024-09-13T05:10:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063526650000000004 2024-09-13T05:10:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812726+0000", 2024-09-13T05:10:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5399999999999998e-06 2024-09-13T05:10:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14146 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757487+0000", 2024-09-13T05:10:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49243529000000003, 2024-09-13T05:10:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50170012500000005, 2024-09-13T05:10:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14146 2024-09-13T05:10:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757487+0000", 2024-09-13T05:10:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757487+0000", 2024-09-13T05:10:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757487+0000", 2024-09-13T05:10:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757489+0000", 2024-09-13T05:10:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4090000000000001e-06 2024-09-13T05:10:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757495+0000", 2024-09-13T05:10:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.604e-06 2024-09-13T05:10:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757499+0000", 2024-09-13T05:10:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3030000000000001e-06 2024-09-13T05:10:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814474+0000", 2024-09-13T05:10:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056974956 2024-09-13T05:10:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814483+0000", 2024-09-13T05:10:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2990000000000002e-06 2024-09-13T05:10:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14207 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765047+0000", 2024-09-13T05:10:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.484875579, 2024-09-13T05:10:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49417421299999997, 2024-09-13T05:10:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14207 2024-09-13T05:10:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765047+0000", 2024-09-13T05:10:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765047+0000", 2024-09-13T05:10:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765046+0000", 2024-09-13T05:10:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765049+0000", 2024-09-13T05:10:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4360000000000001e-06 2024-09-13T05:10:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765059+0000", 2024-09-13T05:10:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0227999999999999e-05 2024-09-13T05:10:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765064+0000", 2024-09-13T05:10:32.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7849999999999999e-06 2024-09-13T05:10:32.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816290+0000", 2024-09-13T05:10:32.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051225830999999999 2024-09-13T05:10:32.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816298+0000", 2024-09-13T05:10:32.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5900000000000008e-06 2024-09-13T05:10:32.269 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14324 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.769263+0000", 2024-09-13T05:10:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48065932700000003, 2024-09-13T05:10:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48999093999999999, 2024-09-13T05:10:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14324 2024-09-13T05:10:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769263+0000", 2024-09-13T05:10:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769263+0000", 2024-09-13T05:10:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769263+0000", 2024-09-13T05:10:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769265+0000", 2024-09-13T05:10:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6879999999999999e-06 2024-09-13T05:10:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769284+0000", 2024-09-13T05:10:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8473000000000001e-05 2024-09-13T05:10:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769300+0000", 2024-09-13T05:10:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.588e-05 2024-09-13T05:10:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818468+0000", 2024-09-13T05:10:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.049167917999999998 2024-09-13T05:10:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818471+0000", 2024-09-13T05:10:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4510000000000001e-06 2024-09-13T05:10:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14356 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.777254+0000", 2024-09-13T05:10:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47266897000000002, 2024-09-13T05:10:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.482034992, 2024-09-13T05:10:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14356 2024-09-13T05:10:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777254+0000", 2024-09-13T05:10:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777254+0000", 2024-09-13T05:10:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777253+0000", 2024-09-13T05:10:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777256+0000", 2024-09-13T05:10:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5849999999999998e-06 2024-09-13T05:10:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777262+0000", 2024-09-13T05:10:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.003e-06 2024-09-13T05:10:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777267+0000", 2024-09-13T05:10:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8550000000000001e-06 2024-09-13T05:10:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819848+0000", 2024-09-13T05:10:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042581202999999998 2024-09-13T05:10:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819851+0000", 2024-09-13T05:10:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6179999999999999e-06 2024-09-13T05:10:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14417 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.785041+0000", 2024-09-13T05:10:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.464881614, 2024-09-13T05:10:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47428020500000001, 2024-09-13T05:10:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14417 2024-09-13T05:10:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785041+0000", 2024-09-13T05:10:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785041+0000", 2024-09-13T05:10:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785040+0000", 2024-09-13T05:10:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785044+0000", 2024-09-13T05:10:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6550000000000002e-06 2024-09-13T05:10:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785058+0000", 2024-09-13T05:10:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4364e-05 2024-09-13T05:10:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785067+0000", 2024-09-13T05:10:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6980000000000004e-06 2024-09-13T05:10:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821111+0000", 2024-09-13T05:10:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.036043960999999999 2024-09-13T05:10:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821114+0000", 2024-09-13T05:10:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.433e-06 2024-09-13T05:10:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14517 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.801166+0000", 2024-09-13T05:10:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44875606600000001, 2024-09-13T05:10:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45818871, 2024-09-13T05:10:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14517 2024-09-13T05:10:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801166+0000", 2024-09-13T05:10:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801166+0000", 2024-09-13T05:10:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801166+0000", 2024-09-13T05:10:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801168+0000", 2024-09-13T05:10:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.584e-06 2024-09-13T05:10:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801175+0000", 2024-09-13T05:10:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1189999999999999e-06 2024-09-13T05:10:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801178+0000", 2024-09-13T05:10:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2770000000000001e-06 2024-09-13T05:10:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822277+0000", 2024-09-13T05:10:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021098519 2024-09-13T05:10:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822281+0000", 2024-09-13T05:10:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8260000000000003e-06 2024-09-13T05:10:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14577 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.809210+0000", 2024-09-13T05:10:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44071274199999999, 2024-09-13T05:10:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45017780699999999, 2024-09-13T05:10:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14577 2024-09-13T05:10:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809210+0000", 2024-09-13T05:10:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809210+0000", 2024-09-13T05:10:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809209+0000", 2024-09-13T05:10:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809212+0000", 2024-09-13T05:10:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6970000000000002e-06 2024-09-13T05:10:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809218+0000", 2024-09-13T05:10:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9619999999999998e-06 2024-09-13T05:10:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809225+0000", 2024-09-13T05:10:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7819999999999996e-06 2024-09-13T05:10:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823592+0000", 2024-09-13T05:10:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014367168 2024-09-13T05:10:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823601+0000", 2024-09-13T05:10:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0820000000000005e-06 2024-09-13T05:10:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14112 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.749194+0000", 2024-09-13T05:10:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50072829699999999, 2024-09-13T05:10:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.51022870200000003, 2024-09-13T05:10:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14112 2024-09-13T05:10:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749194+0000", 2024-09-13T05:10:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749194+0000", 2024-09-13T05:10:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749194+0000", 2024-09-13T05:10:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749195+0000", 2024-09-13T05:10:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.279e-06 2024-09-13T05:10:32.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749198+0000", 2024-09-13T05:10:32.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:10:32.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749201+0000", 2024-09-13T05:10:32.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.605e-06 2024-09-13T05:10:32.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812776+0000", 2024-09-13T05:10:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063575009000000002 2024-09-13T05:10:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812786+0000", 2024-09-13T05:10:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9189999999999994e-06 2024-09-13T05:10:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14147 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757503+0000", 2024-09-13T05:10:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49241950800000001, 2024-09-13T05:10:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50224022099999999, 2024-09-13T05:10:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14147 2024-09-13T05:10:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757503+0000", 2024-09-13T05:10:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757503+0000", 2024-09-13T05:10:32.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757503+0000", 2024-09-13T05:10:32.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757505+0000", 2024-09-13T05:10:32.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1660000000000001e-06 2024-09-13T05:10:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757510+0000", 2024-09-13T05:10:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1109999999999999e-06 2024-09-13T05:10:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757514+0000", 2024-09-13T05:10:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5940000000000004e-06 2024-09-13T05:10:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814715+0000", 2024-09-13T05:10:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057200677999999998 2024-09-13T05:10:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814724+0000", 2024-09-13T05:10:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1910000000000006e-06 2024-09-13T05:10:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14293 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765075+0000", 2024-09-13T05:10:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48484770500000002, 2024-09-13T05:10:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49472111400000002, 2024-09-13T05:10:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14293 2024-09-13T05:10:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765075+0000", 2024-09-13T05:10:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765075+0000", 2024-09-13T05:10:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765074+0000", 2024-09-13T05:10:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765077+0000", 2024-09-13T05:10:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0280000000000001e-06 2024-09-13T05:10:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765083+0000", 2024-09-13T05:10:32.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0800000000000002e-06 2024-09-13T05:10:32.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765088+0000", 2024-09-13T05:10:32.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3769999999999998e-06 2024-09-13T05:10:32.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816345+0000", 2024-09-13T05:10:32.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051257608000000003 2024-09-13T05:10:32.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816353+0000", 2024-09-13T05:10:32.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0129999999999993e-06 2024-09-13T05:10:32.301 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.301 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.301 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.301 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14325 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.301 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.769315+0000", 2024-09-13T05:10:32.301 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48060729000000002, 2024-09-13T05:10:32.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49051705899999998, 2024-09-13T05:10:32.302 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.302 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.302 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.302 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.302 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.302 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14325 2024-09-13T05:10:32.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.302 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769315+0000", 2024-09-13T05:10:32.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769315+0000", 2024-09-13T05:10:32.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769315+0000", 2024-09-13T05:10:32.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769318+0000", 2024-09-13T05:10:32.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.067e-06 2024-09-13T05:10:32.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769329+0000", 2024-09-13T05:10:32.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0842999999999999e-05 2024-09-13T05:10:32.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769334+0000", 2024-09-13T05:10:32.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.967e-06 2024-09-13T05:10:32.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818500+0000", 2024-09-13T05:10:32.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.049166319 2024-09-13T05:10:32.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818508+0000", 2024-09-13T05:10:32.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2260000000000005e-06 2024-09-13T05:10:32.305 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.305 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.305 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.306 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14357 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.306 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.777271+0000", 2024-09-13T05:10:32.306 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47265191499999998, 2024-09-13T05:10:32.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48261428200000001, 2024-09-13T05:10:32.306 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.306 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.306 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.306 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.306 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.306 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14357 2024-09-13T05:10:32.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.306 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777271+0000", 2024-09-13T05:10:32.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777271+0000", 2024-09-13T05:10:32.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777270+0000", 2024-09-13T05:10:32.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777273+0000", 2024-09-13T05:10:32.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.525e-06 2024-09-13T05:10:32.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777280+0000", 2024-09-13T05:10:32.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8519999999999998e-06 2024-09-13T05:10:32.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777286+0000", 2024-09-13T05:10:32.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1020000000000002e-06 2024-09-13T05:10:32.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819888+0000", 2024-09-13T05:10:32.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042602176999999998 2024-09-13T05:10:32.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819897+0000", 2024-09-13T05:10:32.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2350000000000005e-06 2024-09-13T05:10:32.309 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.309 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.309 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.310 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14418 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.310 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.785072+0000", 2024-09-13T05:10:32.310 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.464850543, 2024-09-13T05:10:32.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47485453700000002, 2024-09-13T05:10:32.310 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.310 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.310 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.310 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.310 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.310 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14418 2024-09-13T05:10:32.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.310 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785072+0000", 2024-09-13T05:10:32.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785072+0000", 2024-09-13T05:10:32.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785071+0000", 2024-09-13T05:10:32.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785074+0000", 2024-09-13T05:10:32.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0340000000000001e-06 2024-09-13T05:10:32.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785085+0000", 2024-09-13T05:10:32.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0502999999999999e-05 2024-09-13T05:10:32.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785090+0000", 2024-09-13T05:10:32.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8040000000000001e-06 2024-09-13T05:10:32.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821143+0000", 2024-09-13T05:10:32.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.036053667999999997 2024-09-13T05:10:32.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821151+0000", 2024-09-13T05:10:32.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4030000000000001e-06 2024-09-13T05:10:32.313 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.313 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.314 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.314 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14519 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.314 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.801181+0000", 2024-09-13T05:10:32.314 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44874171600000001, 2024-09-13T05:10:32.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45877865899999998, 2024-09-13T05:10:32.314 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.314 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.314 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.314 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.314 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.314 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14519 2024-09-13T05:10:32.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.315 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801181+0000", 2024-09-13T05:10:32.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801181+0000", 2024-09-13T05:10:32.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801180+0000", 2024-09-13T05:10:32.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801182+0000", 2024-09-13T05:10:32.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6190000000000001e-06 2024-09-13T05:10:32.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801187+0000", 2024-09-13T05:10:32.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2089999999999996e-06 2024-09-13T05:10:32.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801190+0000", 2024-09-13T05:10:32.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7939999999999998e-06 2024-09-13T05:10:32.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822315+0000", 2024-09-13T05:10:32.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0211246 2024-09-13T05:10:32.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822324+0000", 2024-09-13T05:10:32.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5459999999999997e-06 2024-09-13T05:10:32.318 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.318 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.318 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.318 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14578 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.318 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.809235+0000", 2024-09-13T05:10:32.318 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.440687567, 2024-09-13T05:10:32.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45077172700000001, 2024-09-13T05:10:32.318 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.318 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.319 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.319 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.319 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14578 2024-09-13T05:10:32.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.319 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809235+0000", 2024-09-13T05:10:32.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809235+0000", 2024-09-13T05:10:32.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809234+0000", 2024-09-13T05:10:32.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809238+0000", 2024-09-13T05:10:32.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5049999999999999e-06 2024-09-13T05:10:32.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809262+0000", 2024-09-13T05:10:32.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4063999999999999e-05 2024-09-13T05:10:32.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809268+0000", 2024-09-13T05:10:32.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9139999999999996e-06 2024-09-13T05:10:32.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823630+0000", 2024-09-13T05:10:32.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014362319 2024-09-13T05:10:32.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823634+0000", 2024-09-13T05:10:32.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669999999999999e-06 2024-09-13T05:10:32.325 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.325 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.325 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.325 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14113 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.326 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.749203+0000", 2024-09-13T05:10:32.326 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50071955000000001, 2024-09-13T05:10:32.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.51086754700000003, 2024-09-13T05:10:32.326 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.326 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.326 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.327 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14113 2024-09-13T05:10:32.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.327 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749203+0000", 2024-09-13T05:10:32.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749203+0000", 2024-09-13T05:10:32.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749203+0000", 2024-09-13T05:10:32.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:32.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749204+0000", 2024-09-13T05:10:32.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2610000000000001e-06 2024-09-13T05:10:32.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749207+0000", 2024-09-13T05:10:32.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7779999999999999e-06 2024-09-13T05:10:32.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749209+0000", 2024-09-13T05:10:32.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.667e-06 2024-09-13T05:10:32.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812829+0000", 2024-09-13T05:10:32.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063619146000000001 2024-09-13T05:10:32.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812836+0000", 2024-09-13T05:10:32.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7610000000000007e-06 2024-09-13T05:10:32.334 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.334 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.334 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.335 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14148 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.335 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757519+0000", 2024-09-13T05:10:32.335 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49240364199999997, 2024-09-13T05:10:32.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50261050200000001, 2024-09-13T05:10:32.335 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.335 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.336 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.336 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.336 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.336 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14148 2024-09-13T05:10:32.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.336 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757519+0000", 2024-09-13T05:10:32.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757519+0000", 2024-09-13T05:10:32.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757518+0000", 2024-09-13T05:10:32.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757521+0000", 2024-09-13T05:10:32.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6570000000000001e-06 2024-09-13T05:10:32.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757526+0000", 2024-09-13T05:10:32.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.215e-06 2024-09-13T05:10:32.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757531+0000", 2024-09-13T05:10:32.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4599999999999996e-06 2024-09-13T05:10:32.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814873+0000", 2024-09-13T05:10:32.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057342595000000003 2024-09-13T05:10:32.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814882+0000", 2024-09-13T05:10:32.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2970000000000004e-06 2024-09-13T05:10:32.344 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.344 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.344 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.345 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14294 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.345 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:10:32.345 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48483179599999998, 2024-09-13T05:10:32.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49507973399999999, 2024-09-13T05:10:32.345 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.345 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.346 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14294 2024-09-13T05:10:32.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.346 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:10:32.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:10:32.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765090+0000", 2024-09-13T05:10:32.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:32.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765092+0000", 2024-09-13T05:10:32.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.542e-06 2024-09-13T05:10:32.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765096+0000", 2024-09-13T05:10:32.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6179999999999999e-06 2024-09-13T05:10:32.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765098+0000", 2024-09-13T05:10:32.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8049999999999998e-06 2024-09-13T05:10:32.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816384+0000", 2024-09-13T05:10:32.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051285338999999999 2024-09-13T05:10:32.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816393+0000", 2024-09-13T05:10:32.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-09-13T05:10:32.353 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.353 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.354 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.354 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14326 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.354 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.769338+0000", 2024-09-13T05:10:32.355 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48058475699999997, 2024-09-13T05:10:32.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49089171199999998, 2024-09-13T05:10:32.355 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.355 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.356 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.356 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.356 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.356 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14326 2024-09-13T05:10:32.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.356 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769338+0000", 2024-09-13T05:10:32.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769338+0000", 2024-09-13T05:10:32.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769337+0000", 2024-09-13T05:10:32.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769340+0000", 2024-09-13T05:10:32.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7690000000000001e-06 2024-09-13T05:10:32.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769353+0000", 2024-09-13T05:10:32.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2624e-05 2024-09-13T05:10:32.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769356+0000", 2024-09-13T05:10:32.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5329999999999999e-06 2024-09-13T05:10:32.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818533+0000", 2024-09-13T05:10:32.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.049176205000000001 2024-09-13T05:10:32.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818536+0000", 2024-09-13T05:10:32.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4489999999999999e-06 2024-09-13T05:10:32.363 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.364 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.364 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.364 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14358 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.365 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.777291+0000", 2024-09-13T05:10:32.365 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47263191999999998, 2024-09-13T05:10:32.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48297568099999999, 2024-09-13T05:10:32.365 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.365 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.365 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.366 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.366 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.366 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14358 2024-09-13T05:10:32.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.366 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777291+0000", 2024-09-13T05:10:32.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777291+0000", 2024-09-13T05:10:32.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777290+0000", 2024-09-13T05:10:32.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777293+0000", 2024-09-13T05:10:32.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7310000000000002e-06 2024-09-13T05:10:32.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777299+0000", 2024-09-13T05:10:32.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1229999999999997e-06 2024-09-13T05:10:32.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777304+0000", 2024-09-13T05:10:32.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9540000000000003e-06 2024-09-13T05:10:32.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819927+0000", 2024-09-13T05:10:32.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042622922000000001 2024-09-13T05:10:32.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819930+0000", 2024-09-13T05:10:32.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5030000000000002e-06 2024-09-13T05:10:32.373 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.373 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.373 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.373 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14419 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.374 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.785094+0000", 2024-09-13T05:10:32.374 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46482842600000002, 2024-09-13T05:10:32.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47520453499999998, 2024-09-13T05:10:32.374 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.374 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.374 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.374 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.375 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.375 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14419 2024-09-13T05:10:32.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.375 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785094+0000", 2024-09-13T05:10:32.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785094+0000", 2024-09-13T05:10:32.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785094+0000", 2024-09-13T05:10:32.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785100+0000", 2024-09-13T05:10:32.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.764e-06 2024-09-13T05:10:32.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785106+0000", 2024-09-13T05:10:32.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4709999999999998e-06 2024-09-13T05:10:32.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785111+0000", 2024-09-13T05:10:32.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6809999999999997e-06 2024-09-13T05:10:32.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821184+0000", 2024-09-13T05:10:32.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.036073802000000002 2024-09-13T05:10:32.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821189+0000", 2024-09-13T05:10:32.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4800000000000003e-06 2024-09-13T05:10:32.378 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.378 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.378 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.378 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14521 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.378 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.801192+0000", 2024-09-13T05:10:32.378 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44873010400000002, 2024-09-13T05:10:32.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.459141672, 2024-09-13T05:10:32.378 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.378 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.378 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.378 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.378 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.379 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14521 2024-09-13T05:10:32.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.379 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801192+0000", 2024-09-13T05:10:32.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801192+0000", 2024-09-13T05:10:32.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801192+0000", 2024-09-13T05:10:32.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:32.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801194+0000", 2024-09-13T05:10:32.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4309999999999999e-06 2024-09-13T05:10:32.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801196+0000", 2024-09-13T05:10:32.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8849999999999999e-06 2024-09-13T05:10:32.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801199+0000", 2024-09-13T05:10:32.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:10:32.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822384+0000", 2024-09-13T05:10:32.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021184574000000001 2024-09-13T05:10:32.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822393+0000", 2024-09-13T05:10:32.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2070000000000001e-06 2024-09-13T05:10:32.382 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.382 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.382 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.382 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14580 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.382 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.809274+0000", 2024-09-13T05:10:32.382 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44064892, 2024-09-13T05:10:32.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.451092769, 2024-09-13T05:10:32.382 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.382 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.382 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.382 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.382 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.383 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14580 2024-09-13T05:10:32.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.383 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809274+0000", 2024-09-13T05:10:32.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809274+0000", 2024-09-13T05:10:32.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809273+0000", 2024-09-13T05:10:32.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809276+0000", 2024-09-13T05:10:32.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2339999999999999e-06 2024-09-13T05:10:32.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809306+0000", 2024-09-13T05:10:32.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9833e-05 2024-09-13T05:10:32.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809312+0000", 2024-09-13T05:10:32.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0000000000000002e-06 2024-09-13T05:10:32.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823666+0000", 2024-09-13T05:10:32.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014353553999999999 2024-09-13T05:10:32.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823675+0000", 2024-09-13T05:10:32.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0350000000000007e-06 2024-09-13T05:10:32.386 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.386 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.386 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.386 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14114 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.386 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.749212+0000", 2024-09-13T05:10:32.386 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50071071, 2024-09-13T05:10:32.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.51118872900000001, 2024-09-13T05:10:32.386 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.386 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.386 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.386 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.386 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.387 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14114 2024-09-13T05:10:32.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.387 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749212+0000", 2024-09-13T05:10:32.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749212+0000", 2024-09-13T05:10:32.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749212+0000", 2024-09-13T05:10:32.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:32.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749213+0000", 2024-09-13T05:10:32.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4270000000000001e-06 2024-09-13T05:10:32.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749216+0000", 2024-09-13T05:10:32.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:10:32.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749218+0000", 2024-09-13T05:10:32.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.621e-06 2024-09-13T05:10:32.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812875+0000", 2024-09-13T05:10:32.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063656968999999994 2024-09-13T05:10:32.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812883+0000", 2024-09-13T05:10:32.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1100000000000003e-06 2024-09-13T05:10:32.390 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.390 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.390 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.390 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14149 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.390 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757536+0000", 2024-09-13T05:10:32.390 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49238662900000002, 2024-09-13T05:10:32.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50289837599999998, 2024-09-13T05:10:32.390 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.390 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.390 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.390 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.391 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.391 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14149 2024-09-13T05:10:32.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.391 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757536+0000", 2024-09-13T05:10:32.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757536+0000", 2024-09-13T05:10:32.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757535+0000", 2024-09-13T05:10:32.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757538+0000", 2024-09-13T05:10:32.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5009999999999999e-06 2024-09-13T05:10:32.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757543+0000", 2024-09-13T05:10:32.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8640000000000004e-06 2024-09-13T05:10:32.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757547+0000", 2024-09-13T05:10:32.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4340000000000002e-06 2024-09-13T05:10:32.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814911+0000", 2024-09-13T05:10:32.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057364143999999999 2024-09-13T05:10:32.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814916+0000", 2024-09-13T05:10:32.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1699999999999999e-06 2024-09-13T05:10:32.394 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.394 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.394 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.394 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14295 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.394 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:10:32.394 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48482203800000001, 2024-09-13T05:10:32.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.495366415, 2024-09-13T05:10:32.395 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.395 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.395 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.395 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.395 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.395 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14295 2024-09-13T05:10:32.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.395 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:10:32.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:10:32.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:10:32.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:32.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765102+0000", 2024-09-13T05:10:32.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3990000000000001e-06 2024-09-13T05:10:32.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765104+0000", 2024-09-13T05:10:32.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:10:32.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765107+0000", 2024-09-13T05:10:32.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.582e-06 2024-09-13T05:10:32.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816432+0000", 2024-09-13T05:10:32.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051325118000000003 2024-09-13T05:10:32.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816440+0000", 2024-09-13T05:10:32.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4679999999999992e-06 2024-09-13T05:10:32.398 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.398 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.398 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.398 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14327 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.398 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.769359+0000", 2024-09-13T05:10:32.398 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48056367500000002, 2024-09-13T05:10:32.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49114154999999998, 2024-09-13T05:10:32.399 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.399 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.399 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.399 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.399 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.399 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14327 2024-09-13T05:10:32.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.399 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769359+0000", 2024-09-13T05:10:32.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769359+0000", 2024-09-13T05:10:32.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769359+0000", 2024-09-13T05:10:32.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:32.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769360+0000", 2024-09-13T05:10:32.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.668e-06 2024-09-13T05:10:32.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769363+0000", 2024-09-13T05:10:32.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9550000000000001e-06 2024-09-13T05:10:32.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769366+0000", 2024-09-13T05:10:32.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6170000000000001e-06 2024-09-13T05:10:32.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818567+0000", 2024-09-13T05:10:32.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.049200896000000001 2024-09-13T05:10:32.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818575+0000", 2024-09-13T05:10:32.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3520000000000007e-06 2024-09-13T05:10:32.402 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.402 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.402 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.402 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14359 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.402 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.777308+0000", 2024-09-13T05:10:32.402 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47261431799999998, 2024-09-13T05:10:32.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48322431900000001, 2024-09-13T05:10:32.402 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.403 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.403 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14359 2024-09-13T05:10:32.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.403 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777308+0000", 2024-09-13T05:10:32.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777308+0000", 2024-09-13T05:10:32.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777308+0000", 2024-09-13T05:10:32.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777310+0000", 2024-09-13T05:10:32.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.463e-06 2024-09-13T05:10:32.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777316+0000", 2024-09-13T05:10:32.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.93e-06 2024-09-13T05:10:32.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777321+0000", 2024-09-13T05:10:32.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9089999999999999e-06 2024-09-13T05:10:32.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819969+0000", 2024-09-13T05:10:32.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042648246000000001 2024-09-13T05:10:32.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.819979+0000", 2024-09-13T05:10:32.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.815e-06 2024-09-13T05:10:32.406 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.406 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.406 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.406 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14420 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.406 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.785115+0000", 2024-09-13T05:10:32.406 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46480792500000001, 2024-09-13T05:10:32.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47545211599999998, 2024-09-13T05:10:32.407 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.407 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.407 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14420 2024-09-13T05:10:32.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.407 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785115+0000", 2024-09-13T05:10:32.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785115+0000", 2024-09-13T05:10:32.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785114+0000", 2024-09-13T05:10:32.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785117+0000", 2024-09-13T05:10:32.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.311e-06 2024-09-13T05:10:32.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785122+0000", 2024-09-13T05:10:32.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.135e-06 2024-09-13T05:10:32.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785126+0000", 2024-09-13T05:10:32.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5750000000000002e-06 2024-09-13T05:10:32.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821227+0000", 2024-09-13T05:10:32.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.036100550000000002 2024-09-13T05:10:32.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821234+0000", 2024-09-13T05:10:32.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2309999999999999e-06 2024-09-13T05:10:32.410 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.410 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.410 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.410 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14522 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.410 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.801203+0000", 2024-09-13T05:10:32.410 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44871968699999998, 2024-09-13T05:10:32.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45939640199999998, 2024-09-13T05:10:32.411 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.411 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.411 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.411 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.411 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.411 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14522 2024-09-13T05:10:32.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.411 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801203+0000", 2024-09-13T05:10:32.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801203+0000", 2024-09-13T05:10:32.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801203+0000", 2024-09-13T05:10:32.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:32.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801204+0000", 2024-09-13T05:10:32.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4699999999999999e-06 2024-09-13T05:10:32.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801212+0000", 2024-09-13T05:10:32.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3890000000000005e-06 2024-09-13T05:10:32.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801222+0000", 2024-09-13T05:10:32.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.645e-06 2024-09-13T05:10:32.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822419+0000", 2024-09-13T05:10:32.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021197053 2024-09-13T05:10:32.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822426+0000", 2024-09-13T05:10:32.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7739999999999999e-06 2024-09-13T05:10:32.414 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.414 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.414 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.414 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14582 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.414 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.809319+0000", 2024-09-13T05:10:32.414 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44060381599999998, 2024-09-13T05:10:32.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45131412799999998, 2024-09-13T05:10:32.414 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.415 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.415 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.415 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.415 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.415 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14582 2024-09-13T05:10:32.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.415 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809319+0000", 2024-09-13T05:10:32.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809319+0000", 2024-09-13T05:10:32.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809318+0000", 2024-09-13T05:10:32.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809322+0000", 2024-09-13T05:10:32.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.569e-06 2024-09-13T05:10:32.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809328+0000", 2024-09-13T05:10:32.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.81e-06 2024-09-13T05:10:32.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809334+0000", 2024-09-13T05:10:32.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1390000000000003e-06 2024-09-13T05:10:32.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823702+0000", 2024-09-13T05:10:32.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014368545999999999 2024-09-13T05:10:32.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823706+0000", 2024-09-13T05:10:32.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6940000000000001e-06 2024-09-13T05:10:32.418 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.418 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.418 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.418 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14115 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.418 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.749221+0000", 2024-09-13T05:10:32.418 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50070172899999998, 2024-09-13T05:10:32.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.51144603200000005, 2024-09-13T05:10:32.418 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.418 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14115 2024-09-13T05:10:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749221+0000", 2024-09-13T05:10:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749221+0000", 2024-09-13T05:10:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749221+0000", 2024-09-13T05:10:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749222+0000", 2024-09-13T05:10:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2729999999999999e-06 2024-09-13T05:10:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749225+0000", 2024-09-13T05:10:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8550000000000002e-06 2024-09-13T05:10:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.749227+0000", 2024-09-13T05:10:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4870000000000001e-06 2024-09-13T05:10:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812923+0000", 2024-09-13T05:10:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.063695850999999998 2024-09-13T05:10:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.812931+0000", 2024-09-13T05:10:32.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7489999999999998e-06 2024-09-13T05:10:32.422 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.422 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.422 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.422 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14179 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.422 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:10:32.422 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49237080599999999, 2024-09-13T05:10:32.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50314716800000003, 2024-09-13T05:10:32.422 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.422 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.423 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14179 2024-09-13T05:10:32.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.423 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:10:32.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:10:32.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757551+0000", 2024-09-13T05:10:32.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757554+0000", 2024-09-13T05:10:32.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5440000000000001e-06 2024-09-13T05:10:32.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757560+0000", 2024-09-13T05:10:32.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6840000000000001e-06 2024-09-13T05:10:32.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757564+0000", 2024-09-13T05:10:32.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3529999999999997e-06 2024-09-13T05:10:32.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814931+0000", 2024-09-13T05:10:32.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057367564000000003 2024-09-13T05:10:32.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814938+0000", 2024-09-13T05:10:32.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1070000000000001e-06 2024-09-13T05:10:32.426 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.426 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.426 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.426 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14296 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.426 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:10:32.426 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48481379200000002, 2024-09-13T05:10:32.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49562425900000001, 2024-09-13T05:10:32.426 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.426 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.427 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.427 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.427 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.427 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14296 2024-09-13T05:10:32.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.427 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:10:32.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:10:32.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765108+0000", 2024-09-13T05:10:32.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:32.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765110+0000", 2024-09-13T05:10:32.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.226e-06 2024-09-13T05:10:32.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765112+0000", 2024-09-13T05:10:32.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6769999999999999e-06 2024-09-13T05:10:32.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765115+0000", 2024-09-13T05:10:32.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.712e-06 2024-09-13T05:10:32.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816479+0000", 2024-09-13T05:10:32.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051364102000000002 2024-09-13T05:10:32.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816503+0000", 2024-09-13T05:10:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3723999999999999e-05 2024-09-13T05:10:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14328 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.772964+0000", 2024-09-13T05:10:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47695852900000002, 2024-09-13T05:10:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48780110900000001, 2024-09-13T05:10:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.431 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.431 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.431 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14328 2024-09-13T05:10:32.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.431 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.772964+0000", 2024-09-13T05:10:32.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.772964+0000", 2024-09-13T05:10:32.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.769368+0000", 2024-09-13T05:10:32.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9964037 2024-09-13T05:10:32.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.772968+0000", 2024-09-13T05:10:32.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036004740000000002 2024-09-13T05:10:32.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.772977+0000", 2024-09-13T05:10:32.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8189999999999998e-06 2024-09-13T05:10:32.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.772982+0000", 2024-09-13T05:10:32.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1569999999999999e-06 2024-09-13T05:10:32.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818602+0000", 2024-09-13T05:10:32.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045619835999999997 2024-09-13T05:10:32.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.818606+0000", 2024-09-13T05:10:32.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.569e-06 2024-09-13T05:10:32.434 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.434 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.434 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.434 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14360 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.434 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.777338+0000", 2024-09-13T05:10:32.434 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.47258447799999997, 2024-09-13T05:10:32.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48346131199999998, 2024-09-13T05:10:32.434 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.434 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.435 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.435 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.435 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.435 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14360 2024-09-13T05:10:32.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.435 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777338+0000", 2024-09-13T05:10:32.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777338+0000", 2024-09-13T05:10:32.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777337+0000", 2024-09-13T05:10:32.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:32.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777341+0000", 2024-09-13T05:10:32.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3979999999999999e-06 2024-09-13T05:10:32.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777347+0000", 2024-09-13T05:10:32.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7100000000000001e-06 2024-09-13T05:10:32.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.777353+0000", 2024-09-13T05:10:32.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4970000000000001e-06 2024-09-13T05:10:32.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820009+0000", 2024-09-13T05:10:32.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042656331999999998 2024-09-13T05:10:32.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.820013+0000", 2024-09-13T05:10:32.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.506e-06 2024-09-13T05:10:32.438 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.438 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.438 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.438 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14421 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.438 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.785130+0000", 2024-09-13T05:10:32.438 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.46479258699999998, 2024-09-13T05:10:32.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.47570176800000002, 2024-09-13T05:10:32.438 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.438 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.438 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.439 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14421 2024-09-13T05:10:32.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.439 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785130+0000", 2024-09-13T05:10:32.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785130+0000", 2024-09-13T05:10:32.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785130+0000", 2024-09-13T05:10:32.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785132+0000", 2024-09-13T05:10:32.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1880000000000001e-06 2024-09-13T05:10:32.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785137+0000", 2024-09-13T05:10:32.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2020000000000003e-06 2024-09-13T05:10:32.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.785141+0000", 2024-09-13T05:10:32.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.464e-06 2024-09-13T05:10:32.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821266+0000", 2024-09-13T05:10:32.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.036124107000000003 2024-09-13T05:10:32.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.821269+0000", 2024-09-13T05:10:32.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3749999999999999e-06 2024-09-13T05:10:32.442 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.442 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.442 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.442 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14524 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.442 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.801225+0000", 2024-09-13T05:10:32.442 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44869739600000003, 2024-09-13T05:10:32.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45964037699999999, 2024-09-13T05:10:32.442 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.442 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.442 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.443 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.443 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.443 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14524 2024-09-13T05:10:32.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.443 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801225+0000", 2024-09-13T05:10:32.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801225+0000", 2024-09-13T05:10:32.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801225+0000", 2024-09-13T05:10:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801226+0000", 2024-09-13T05:10:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5680000000000001e-06 2024-09-13T05:10:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801230+0000", 2024-09-13T05:10:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.287e-06 2024-09-13T05:10:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.801233+0000", 2024-09-13T05:10:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:10:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822464+0000", 2024-09-13T05:10:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021231901000000001 2024-09-13T05:10:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.822469+0000", 2024-09-13T05:10:32.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3340000000000003e-06 2024-09-13T05:10:32.446 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.446 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.446 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.446 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14583 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:32.446 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.809338+0000", 2024-09-13T05:10:32.446 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44058429199999999, 2024-09-13T05:10:32.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.45156072200000003, 2024-09-13T05:10:32.446 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:32.446 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:10:32.446 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:32.446 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:32.447 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:32.447 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14583 2024-09-13T05:10:32.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.447 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:32.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:32.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809338+0000", 2024-09-13T05:10:32.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:32.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809338+0000", 2024-09-13T05:10:32.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:32.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:32.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809338+0000", 2024-09-13T05:10:32.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:32.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:32.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809340+0000", 2024-09-13T05:10:32.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6860000000000002e-06 2024-09-13T05:10:32.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:32.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809346+0000", 2024-09-13T05:10:32.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0950000000000001e-06 2024-09-13T05:10:32.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:32.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.809351+0000", 2024-09-13T05:10:32.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.989e-06 2024-09-13T05:10:32.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:32.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823737+0000", 2024-09-13T05:10:32.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014385693999999999 2024-09-13T05:10:32.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:32.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:32.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:32.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.823746+0000", 2024-09-13T05:10:32.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9630000000000004e-06 2024-09-13T05:10:32.450 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.450 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:32.450 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.450 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:32.450 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:10:32.450 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 256 2024-09-13T05:10:32.450 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:32.450 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T05:10:32.451 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:32.447+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:32.452 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:10:32.453 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:10:32.453 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:10:32.453 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:10:32.453 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:10:32.453 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:10:32.454 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:10:32.454 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:10:32.454 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:10:32.454 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:10:32.455 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:10:32.455 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:10:32.455 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:10:32.455 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:10:32.455 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:10:32.455 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:10:32.455 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:10:32.552 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:32.546+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:32.616 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:32.616 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:32.626 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:10:32.653 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:32.646+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:32.724 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:32.724 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:32.734 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:10:32.777 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:32.774+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:32.843 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is set 2024-09-13T05:10:32.854 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:32.851+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:32.893 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:32.893 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:32.903 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:10:32.956 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:32.951+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:33.014 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:33.014 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:33.026 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:10:33.037 INFO:teuthology.orchestra.run.smithi120.stdout:1090 write 0x9002193 thru 0x9008615 (0x6483 bytes) 2024-09-13T05:10:33.056 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:33.050+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:33.062 INFO:teuthology.orchestra.run.smithi120.stdout:1091 trunc from 0x9008616 to 0xcd7445a 2024-09-13T05:10:33.071 INFO:teuthology.orchestra.run.smithi120.stdout:1092 read 0x10d8edb thru 0x10e44c2 (0xb5e8 bytes) 2024-09-13T05:10:33.125 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:33.125 INFO:teuthology.orchestra.run.smithi120.stdout:1094 punch from 0x38b7fe7 to 0x38b92e6, (0x12ff bytes) 2024-09-13T05:10:33.127 INFO:teuthology.orchestra.run.smithi120.stdout:1096 punch from 0x2951a05 to 0x2951c3e, (0x239 bytes) 2024-09-13T05:10:33.127 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:33.127 INFO:teuthology.orchestra.run.smithi120.stdout:1098 punch from 0x698a866 to 0x6998a11, (0xe1ab bytes) 2024-09-13T05:10:33.127 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:33.127 INFO:teuthology.orchestra.run.smithi120.stdout:1101 trunc from 0xcd7445a to 0xcb9d528 2024-09-13T05:10:33.157 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:33.154+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:33.161 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:33.161 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:33.174 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:10:33.246 INFO:teuthology.orchestra.run.smithi120.stdout:1102 punch from 0xa394f38 to 0xa39ce8f, (0x7f57 bytes) 2024-09-13T05:10:33.246 INFO:teuthology.orchestra.run.smithi120.stdout:1103 write 0xba19b63 thru 0xba1f741 (0x5bdf bytes) 2024-09-13T05:10:33.259 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:33.255+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:33.266 INFO:teuthology.orchestra.run.smithi120.stdout:1108 read 0xb9132e8 thru 0xb9153fb (0x2114 bytes) 2024-09-13T05:10:33.267 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:33.267 INFO:teuthology.orchestra.run.smithi120.stdout:1110 read 0x67dda9 thru 0x68af94 (0xd1ec bytes) 2024-09-13T05:10:33.269 INFO:teuthology.orchestra.run.smithi120.stdout:1111 punch from 0x1e516d1 to 0x1e53839, (0x2168 bytes) 2024-09-13T05:10:33.269 INFO:teuthology.orchestra.run.smithi120.stdout:1112 read 0x3b36d48 thru 0x3b376a0 (0x959 bytes) 2024-09-13T05:10:33.270 INFO:teuthology.orchestra.run.smithi120.stdout:1115 read 0x987be4c thru 0x98882dc (0xc491 bytes) 2024-09-13T05:10:33.270 INFO:teuthology.orchestra.run.smithi120.stdout:1117 read 0x88c2ba2 thru 0x88cbf2e (0x938d bytes) 2024-09-13T05:10:33.279 INFO:teuthology.orchestra.run.smithi120.stdout:1118 writesame 0xd1c570f thru 0xd1c7f01 data_size 0x7(0x27f3 bytes) 2024-09-13T05:10:33.363 INFO:teuthology.orchestra.run.smithi120.stdout:1119 write 0xde9e74a thru 0xdeaae0f (0xc6c6 bytes) 2024-09-13T05:10:33.364 INFO:teuthology.orchestra.run.smithi120.stdout:1120 read 0x53aaf6d thru 0x53b74b4 (0xc548 bytes) 2024-09-13T05:10:33.364 INFO:teuthology.orchestra.run.smithi120.stdout:1122 trunc from 0xdeaae10 to 0xb7cd295 2024-09-13T05:10:33.364 INFO:teuthology.orchestra.run.smithi120.stdout:1124 read 0x99492b6 thru 0x994f3eb (0x6136 bytes) 2024-09-13T05:10:33.364 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:33.364 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:33.364 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:33.365 INFO:teuthology.orchestra.run.smithi120.stdout:1126 trunc from 0xb7cd295 to 0x8a0ffd5 2024-09-13T05:10:33.365 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:10:33.366 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:33.358+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:33.371 INFO:teuthology.orchestra.run.smithi120.stdout:1128 trunc from 0x8a0ffd5 to 0x9078b5 2024-09-13T05:10:33.465 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:33.459+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:33.511 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:33.512 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:33.523 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:10:33.568 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:33.562+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:33.669 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:33.666+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:33.679 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:33.679 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:33.688 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:10:33.771 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:33.766+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:33.793 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:33.793 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:33.802 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:10:33.871 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:33.866+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:33.905 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:33.905 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:33.915 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:10:33.972 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:33.966+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:34.017 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:34.017 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:34.026 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:10:34.073 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:34.071+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:34.142 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:34.142 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:34.152 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:10:34.174 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:34.171+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:34.259 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:34.259 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:34.268 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:10:34.275 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:34.274+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:34.376 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:34.371+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:34.423 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:34.423 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:34.433 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:10:34.456 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:10:34.477 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:34.474+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:34.534 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:34.534 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:34.544 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:10:34.578 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:34.575+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:34.604 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:10:34.629 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:10:34.629 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:34.638 INFO:teuthology.orchestra.run.smithi120.stdout:1130 write 0xc24f20 thru 0xc264a7 (0x1588 bytes) 2024-09-13T05:10:34.655 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:10:34.656 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:34.656 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:34.666 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:10:34.666 INFO:teuthology.orchestra.run.smithi120.stdout:1131 write 0x28bb266 thru 0x28c996b (0xe706 bytes) 2024-09-13T05:10:34.677 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:10:34.678 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:34.675+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:34.685 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:34.685 INFO:teuthology.orchestra.run.smithi120.stdout:1134 clone 9 order 25 su 2097152 sc 13 2024-09-13T05:10:34.699 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:10:34.718 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:10:34.740 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:10:34.763 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:10:34.765 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:10:34.765 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:10:34.766 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:10:34.766 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:10:34.766 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:10:34.766 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:10:34.766 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:10:34.766 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:10:34.771 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:34.771 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:34.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:34.771 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:10:34.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.771 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4200 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 8339456~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:34.771 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436145+0000", 2024-09-13T05:10:34.771 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.331588385, 2024-09-13T05:10:34.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.018953309000000002, 2024-09-13T05:10:34.771 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:34.771 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:34.772 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:34.772 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:34.772 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:34.772 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4200 2024-09-13T05:10:34.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.772 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:34.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:34.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436145+0000", 2024-09-13T05:10:34.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:34.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436145+0000", 2024-09-13T05:10:34.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:34.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436145+0000", 2024-09-13T05:10:34.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:34.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:34.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436146+0000", 2024-09-13T05:10:34.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:10:34.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:34.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436149+0000", 2024-09-13T05:10:34.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1300000000000001e-06 2024-09-13T05:10:34.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:34.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436152+0000", 2024-09-13T05:10:34.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:10:34.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:34.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.454932+0000", 2024-09-13T05:10:34.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.018780429000000001 2024-09-13T05:10:34.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:34.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455039+0000", 2024-09-13T05:10:34.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000106925 2024-09-13T05:10:34.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:34.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455098+0000", 2024-09-13T05:10:34.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8983000000000001e-05 2024-09-13T05:10:34.775 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.775 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:34.775 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.776 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4206 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 6979584~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:34.776 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436154+0000", 2024-09-13T05:10:34.776 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.331579059999999, 2024-09-13T05:10:34.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019108791, 2024-09-13T05:10:34.776 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:34.776 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:34.776 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:34.776 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:34.776 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:34.776 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4206 2024-09-13T05:10:34.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.777 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:34.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:34.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436154+0000", 2024-09-13T05:10:34.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:34.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436154+0000", 2024-09-13T05:10:34.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:34.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436154+0000", 2024-09-13T05:10:34.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:34.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:34.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436159+0000", 2024-09-13T05:10:34.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.536e-06 2024-09-13T05:10:34.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:34.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436163+0000", 2024-09-13T05:10:34.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5030000000000002e-06 2024-09-13T05:10:34.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:34.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436166+0000", 2024-09-13T05:10:34.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3239999999999999e-06 2024-09-13T05:10:34.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:34.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455124+0000", 2024-09-13T05:10:34.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.018957489000000001 2024-09-13T05:10:34.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:34.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455186+0000", 2024-09-13T05:10:34.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2497999999999997e-05 2024-09-13T05:10:34.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:34.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455263+0000", 2024-09-13T05:10:34.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6675999999999996e-05 2024-09-13T05:10:34.781 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.781 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:34.781 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.781 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4209 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 6389760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:34.781 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436169+0000", 2024-09-13T05:10:34.781 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.331564085, 2024-09-13T05:10:34.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019313255000000001, 2024-09-13T05:10:34.782 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:34.782 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:34.782 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:34.782 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:34.782 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:34.782 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4209 2024-09-13T05:10:34.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.782 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:34.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:34.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436169+0000", 2024-09-13T05:10:34.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:34.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436169+0000", 2024-09-13T05:10:34.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:34.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436169+0000", 2024-09-13T05:10:34.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:34.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:34.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436170+0000", 2024-09-13T05:10:34.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.739e-06 2024-09-13T05:10:34.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:34.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436174+0000", 2024-09-13T05:10:34.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1200000000000004e-06 2024-09-13T05:10:34.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:34.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436178+0000", 2024-09-13T05:10:34.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2499999999999998e-06 2024-09-13T05:10:34.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:34.786 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455311+0000", 2024-09-13T05:10:34.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019133407000000002 2024-09-13T05:10:34.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.786 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:34.786 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455366+0000", 2024-09-13T05:10:34.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4982999999999999e-05 2024-09-13T05:10:34.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.786 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:34.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455482+0000", 2024-09-13T05:10:34.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000116333 2024-09-13T05:10:34.787 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.787 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:34.787 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.787 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4214 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 6782976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:34.787 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436194+0000", 2024-09-13T05:10:34.787 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.331539402000001, 2024-09-13T05:10:34.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019632325999999999, 2024-09-13T05:10:34.788 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:34.788 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:34.788 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:34.788 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:34.788 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:34.789 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4214 2024-09-13T05:10:34.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.789 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:34.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:34.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436194+0000", 2024-09-13T05:10:34.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:34.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436194+0000", 2024-09-13T05:10:34.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:34.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436193+0000", 2024-09-13T05:10:34.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:34.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:34.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436195+0000", 2024-09-13T05:10:34.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9400000000000001e-06 2024-09-13T05:10:34.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:34.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436199+0000", 2024-09-13T05:10:34.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.014e-06 2024-09-13T05:10:34.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:34.792 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436203+0000", 2024-09-13T05:10:34.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3069999999999998e-06 2024-09-13T05:10:34.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.792 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:34.792 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455557+0000", 2024-09-13T05:10:34.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019354018000000001 2024-09-13T05:10:34.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.792 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:34.792 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455694+0000", 2024-09-13T05:10:34.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000137188 2024-09-13T05:10:34.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:34.793 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455826+0000", 2024-09-13T05:10:34.793 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013213 2024-09-13T05:10:34.793 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.793 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:34.793 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.793 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4216 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 7372800~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:34.793 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436212+0000", 2024-09-13T05:10:34.793 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.331520782, 2024-09-13T05:10:34.793 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019812019, 2024-09-13T05:10:34.793 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:34.793 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:34.794 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:34.794 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:34.794 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:34.794 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4216 2024-09-13T05:10:34.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.794 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:34.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:34.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436212+0000", 2024-09-13T05:10:34.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:34.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436212+0000", 2024-09-13T05:10:34.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:34.796 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436212+0000", 2024-09-13T05:10:34.796 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:34.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:34.796 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436220+0000", 2024-09-13T05:10:34.796 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.622e-06 2024-09-13T05:10:34.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:34.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436225+0000", 2024-09-13T05:10:34.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7989999999999999e-06 2024-09-13T05:10:34.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:34.798 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436229+0000", 2024-09-13T05:10:34.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5439999999999999e-06 2024-09-13T05:10:34.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.798 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:34.798 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455883+0000", 2024-09-13T05:10:34.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019654482000000001 2024-09-13T05:10:34.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.799 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:34.799 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455954+0000", 2024-09-13T05:10:34.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0439999999999996e-05 2024-09-13T05:10:34.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.799 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.799 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:34.799 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456024+0000", 2024-09-13T05:10:34.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0635000000000004e-05 2024-09-13T05:10:34.799 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.800 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:34.800 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.800 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4218 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 7962624~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:34.800 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436232+0000", 2024-09-13T05:10:34.800 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.331501172999999, 2024-09-13T05:10:34.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019955836000000001, 2024-09-13T05:10:34.801 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:34.801 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:34.801 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:34.801 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:34.801 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:34.801 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4218 2024-09-13T05:10:34.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.802 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:34.802 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.802 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:34.802 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436232+0000", 2024-09-13T05:10:34.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.802 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.802 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:34.802 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436232+0000", 2024-09-13T05:10:34.803 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.803 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.803 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:34.803 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436232+0000", 2024-09-13T05:10:34.803 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:34.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.803 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.804 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:34.804 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436233+0000", 2024-09-13T05:10:34.804 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.564e-06 2024-09-13T05:10:34.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.804 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.804 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:34.804 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436237+0000", 2024-09-13T05:10:34.804 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2909999999999999e-06 2024-09-13T05:10:34.805 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.805 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:34.805 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436240+0000", 2024-09-13T05:10:34.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8639999999999998e-06 2024-09-13T05:10:34.805 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.805 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:34.805 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456053+0000", 2024-09-13T05:10:34.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019812729000000001 2024-09-13T05:10:34.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.806 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:34.806 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456111+0000", 2024-09-13T05:10:34.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8108e-05 2024-09-13T05:10:34.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.806 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:34.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456188+0000", 2024-09-13T05:10:34.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6550000000000004e-05 2024-09-13T05:10:34.807 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.807 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:34.807 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.807 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4221 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 8159232~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:34.807 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436245+0000", 2024-09-13T05:10:34.808 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.331487999, 2024-09-13T05:10:34.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020134613999999999, 2024-09-13T05:10:34.808 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:34.808 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:34.808 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:34.808 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:34.808 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:34.808 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4221 2024-09-13T05:10:34.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.808 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:34.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.808 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:34.808 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436245+0000", 2024-09-13T05:10:34.809 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.809 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.809 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.809 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:34.809 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436245+0000", 2024-09-13T05:10:34.809 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.809 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.809 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.809 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:34.809 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436245+0000", 2024-09-13T05:10:34.809 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:34.809 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.809 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.810 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:34.810 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436246+0000", 2024-09-13T05:10:34.810 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.519e-06 2024-09-13T05:10:34.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.810 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.810 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:34.810 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436252+0000", 2024-09-13T05:10:34.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2220000000000001e-06 2024-09-13T05:10:34.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:34.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436256+0000", 2024-09-13T05:10:34.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0690000000000003e-06 2024-09-13T05:10:34.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:34.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456249+0000", 2024-09-13T05:10:34.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019992942 2024-09-13T05:10:34.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.812 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:34.812 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456303+0000", 2024-09-13T05:10:34.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4366000000000001e-05 2024-09-13T05:10:34.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.812 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:34.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456380+0000", 2024-09-13T05:10:34.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6761000000000006e-05 2024-09-13T05:10:34.813 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.813 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:34.813 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.813 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4223 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 7766016~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:34.813 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436336+0000", 2024-09-13T05:10:34.813 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.331397596, 2024-09-13T05:10:34.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020232878999999999, 2024-09-13T05:10:34.813 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:34.813 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:34.814 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:34.814 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:34.814 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:34.814 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4223 2024-09-13T05:10:34.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.814 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:34.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:34.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436336+0000", 2024-09-13T05:10:34.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.815 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.815 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:34.815 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436336+0000", 2024-09-13T05:10:34.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.815 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.815 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:34.815 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436335+0000", 2024-09-13T05:10:34.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:34.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:34.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436338+0000", 2024-09-13T05:10:34.816 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0970000000000002e-06 2024-09-13T05:10:34.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:34.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436345+0000", 2024-09-13T05:10:34.816 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6120000000000004e-06 2024-09-13T05:10:34.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:34.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436349+0000", 2024-09-13T05:10:34.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0879999999999997e-06 2024-09-13T05:10:34.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:34.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456416+0000", 2024-09-13T05:10:34.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020067806000000001 2024-09-13T05:10:34.818 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:34.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456487+0000", 2024-09-13T05:10:34.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0766000000000007e-05 2024-09-13T05:10:34.818 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:34.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456568+0000", 2024-09-13T05:10:34.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1186999999999994e-05 2024-09-13T05:10:34.819 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.819 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:34.819 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.819 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.819 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.819 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4225 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 8355840~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:34.819 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436354+0000", 2024-09-13T05:10:34.819 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.331379117999999, 2024-09-13T05:10:34.820 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020354098000000001, 2024-09-13T05:10:34.820 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:34.820 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:34.820 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:34.820 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:34.820 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:34.820 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4225 2024-09-13T05:10:34.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.820 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:34.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.820 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:34.820 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436354+0000", 2024-09-13T05:10:34.820 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.821 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.821 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:34.821 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436354+0000", 2024-09-13T05:10:34.821 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.821 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.821 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:34.821 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436354+0000", 2024-09-13T05:10:34.822 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:34.822 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.822 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.822 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:34.822 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436356+0000", 2024-09-13T05:10:34.822 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8610000000000001e-06 2024-09-13T05:10:34.822 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.822 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.822 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:34.822 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436359+0000", 2024-09-13T05:10:34.822 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3739999999999998e-06 2024-09-13T05:10:34.822 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.822 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.822 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:34.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436362+0000", 2024-09-13T05:10:34.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2839999999999998e-06 2024-09-13T05:10:34.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:34.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456594+0000", 2024-09-13T05:10:34.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020231438000000001 2024-09-13T05:10:34.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.824 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:34.824 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456644+0000", 2024-09-13T05:10:34.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0424999999999999e-05 2024-09-13T05:10:34.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.824 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:34.824 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456708+0000", 2024-09-13T05:10:34.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3987999999999998e-05 2024-09-13T05:10:34.825 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.825 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:34.825 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.825 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.825 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4229 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 6406144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:34.825 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436702+0000", 2024-09-13T05:10:34.825 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.331030871999999, 2024-09-13T05:10:34.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020157143999999998, 2024-09-13T05:10:34.826 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:34.826 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:34.826 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:34.826 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:34.826 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:34.826 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4229 2024-09-13T05:10:34.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.826 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:34.826 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.826 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:34.826 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436702+0000", 2024-09-13T05:10:34.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.827 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.827 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:34.827 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436702+0000", 2024-09-13T05:10:34.827 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.827 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.827 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:34.827 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436701+0000", 2024-09-13T05:10:34.827 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:34.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.827 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.827 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:34.828 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436705+0000", 2024-09-13T05:10:34.828 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7979999999999999e-06 2024-09-13T05:10:34.828 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.828 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.828 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:34.828 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436712+0000", 2024-09-13T05:10:34.828 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.516e-06 2024-09-13T05:10:34.828 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.828 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.828 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:34.828 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436716+0000", 2024-09-13T05:10:34.828 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0169999999999998e-06 2024-09-13T05:10:34.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:34.829 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456741+0000", 2024-09-13T05:10:34.829 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020025672000000001 2024-09-13T05:10:34.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:34.829 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456790+0000", 2024-09-13T05:10:34.829 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8894000000000003e-05 2024-09-13T05:10:34.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:34.830 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456859+0000", 2024-09-13T05:10:34.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9221999999999996e-05 2024-09-13T05:10:34.830 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.830 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:34.830 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.830 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.830 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4232 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 6995968~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:34.830 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436911+0000", 2024-09-13T05:10:34.830 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.330821973999999, 2024-09-13T05:10:34.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020106577, 2024-09-13T05:10:34.830 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:34.830 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:34.831 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:34.831 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:34.831 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:34.831 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4232 2024-09-13T05:10:34.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.831 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:34.831 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.831 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:34.832 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436911+0000", 2024-09-13T05:10:34.832 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.832 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.832 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.832 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:34.832 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436911+0000", 2024-09-13T05:10:34.832 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.832 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.832 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.833 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:34.833 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436910+0000", 2024-09-13T05:10:34.833 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:34.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.833 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.833 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:34.833 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436914+0000", 2024-09-13T05:10:34.833 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6260000000000001e-06 2024-09-13T05:10:34.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.833 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:34.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436920+0000", 2024-09-13T05:10:34.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2419999999999997e-06 2024-09-13T05:10:34.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:34.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436924+0000", 2024-09-13T05:10:34.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9899999999999999e-06 2024-09-13T05:10:34.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.835 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:34.835 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456888+0000", 2024-09-13T05:10:34.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019964161000000001 2024-09-13T05:10:34.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.835 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:34.835 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456938+0000", 2024-09-13T05:10:34.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9505999999999997e-05 2024-09-13T05:10:34.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.835 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:34.835 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457018+0000", 2024-09-13T05:10:34.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9908999999999997e-05 2024-09-13T05:10:34.836 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.836 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:34.836 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.836 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4235 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 7192576~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:34.836 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436962+0000", 2024-09-13T05:10:34.836 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.330770878999999, 2024-09-13T05:10:34.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020327004999999999, 2024-09-13T05:10:34.836 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:34.836 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:34.837 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:34.837 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:34.837 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:34.837 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4235 2024-09-13T05:10:34.837 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.837 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:34.837 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.837 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:34.837 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436962+0000", 2024-09-13T05:10:34.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.837 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.837 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.837 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:34.838 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436962+0000", 2024-09-13T05:10:34.838 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.838 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.838 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.838 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:34.838 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436962+0000", 2024-09-13T05:10:34.838 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:34.838 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.838 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.838 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:34.838 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436978+0000", 2024-09-13T05:10:34.838 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6699999999999999e-05 2024-09-13T05:10:34.838 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.838 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.839 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:34.839 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436984+0000", 2024-09-13T05:10:34.839 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0809999999999999e-06 2024-09-13T05:10:34.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.839 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.839 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:34.839 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436999+0000", 2024-09-13T05:10:34.839 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4790000000000001e-05 2024-09-13T05:10:34.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.839 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.839 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:34.839 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457058+0000", 2024-09-13T05:10:34.839 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020058498000000001 2024-09-13T05:10:34.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.839 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.840 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:34.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457168+0000", 2024-09-13T05:10:34.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011000799999999999 2024-09-13T05:10:34.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.840 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:34.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457289+0000", 2024-09-13T05:10:34.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000121641 2024-09-13T05:10:34.840 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.840 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:34.840 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.840 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4240 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 6799360~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:34.841 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.437091+0000", 2024-09-13T05:10:34.841 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.330642586, 2024-09-13T05:10:34.841 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020515418000000001, 2024-09-13T05:10:34.841 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:34.841 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:34.841 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:34.841 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:34.841 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:34.841 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4240 2024-09-13T05:10:34.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.841 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:34.841 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.841 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:34.842 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437091+0000", 2024-09-13T05:10:34.842 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.842 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.842 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.842 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:34.842 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437091+0000", 2024-09-13T05:10:34.842 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.842 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.842 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.842 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:34.842 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437090+0000", 2024-09-13T05:10:34.843 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:34.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.843 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:34.843 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437094+0000", 2024-09-13T05:10:34.843 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5580000000000002e-06 2024-09-13T05:10:34.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.843 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:34.843 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437101+0000", 2024-09-13T05:10:34.843 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2060000000000001e-06 2024-09-13T05:10:34.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.844 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:34.844 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437106+0000", 2024-09-13T05:10:34.844 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7899999999999999e-06 2024-09-13T05:10:34.844 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.844 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.844 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:34.844 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457332+0000", 2024-09-13T05:10:34.844 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020226361000000002 2024-09-13T05:10:34.844 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.844 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.844 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:34.844 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457436+0000", 2024-09-13T05:10:34.844 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000103799 2024-09-13T05:10:34.845 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.845 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.845 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:34.845 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457606+0000", 2024-09-13T05:10:34.845 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016975399999999999 2024-09-13T05:10:34.845 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.845 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:34.845 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.845 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.845 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.845 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4242 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 7389184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:34.846 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.437304+0000", 2024-09-13T05:10:34.846 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.330428684999999, 2024-09-13T05:10:34.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020577726000000001, 2024-09-13T05:10:34.846 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:34.846 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:34.846 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:34.846 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:34.846 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:34.846 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4242 2024-09-13T05:10:34.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.847 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:34.847 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.847 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:34.847 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437304+0000", 2024-09-13T05:10:34.847 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.847 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.847 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.847 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:34.847 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437304+0000", 2024-09-13T05:10:34.847 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.847 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.847 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.848 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:34.848 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437304+0000", 2024-09-13T05:10:34.848 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:34.848 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.848 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.848 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:34.848 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437307+0000", 2024-09-13T05:10:34.848 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.817e-06 2024-09-13T05:10:34.848 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.848 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.849 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:34.849 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437314+0000", 2024-09-13T05:10:34.849 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8689999999999998e-06 2024-09-13T05:10:34.849 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.849 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.849 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:34.849 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437319+0000", 2024-09-13T05:10:34.849 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5220000000000001e-06 2024-09-13T05:10:34.849 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.849 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.850 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:34.850 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457646+0000", 2024-09-13T05:10:34.850 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020327293999999999 2024-09-13T05:10:34.850 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.850 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.850 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:34.850 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457768+0000", 2024-09-13T05:10:34.850 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000121705 2024-09-13T05:10:34.850 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.850 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.851 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:34.851 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457882+0000", 2024-09-13T05:10:34.851 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000114409 2024-09-13T05:10:34.851 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.851 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:34.851 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.851 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.851 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.851 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4244 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 7979008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:34.851 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.437361+0000", 2024-09-13T05:10:34.852 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.330372037, 2024-09-13T05:10:34.852 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020766765999999999, 2024-09-13T05:10:34.852 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:34.852 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:34.852 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:34.852 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:34.852 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:34.852 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4244 2024-09-13T05:10:34.852 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.852 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:34.852 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.852 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:34.853 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437361+0000", 2024-09-13T05:10:34.853 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.853 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.853 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.853 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:34.853 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437361+0000", 2024-09-13T05:10:34.853 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.854 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.854 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.854 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:34.854 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437360+0000", 2024-09-13T05:10:34.854 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:34.854 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.854 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.854 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:34.854 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437363+0000", 2024-09-13T05:10:34.855 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9160000000000001e-06 2024-09-13T05:10:34.855 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.855 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.855 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:34.855 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437370+0000", 2024-09-13T05:10:34.855 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2859999999999996e-06 2024-09-13T05:10:34.855 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.855 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.855 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:34.856 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437375+0000", 2024-09-13T05:10:34.856 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3619999999999997e-06 2024-09-13T05:10:34.856 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.856 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.856 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:34.856 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457918+0000", 2024-09-13T05:10:34.856 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020542826 2024-09-13T05:10:34.857 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.857 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.857 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:34.857 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458008+0000", 2024-09-13T05:10:34.857 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9862000000000001e-05 2024-09-13T05:10:34.857 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.857 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.857 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:34.858 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458128+0000", 2024-09-13T05:10:34.858 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000120202 2024-09-13T05:10:34.858 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.858 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:34.858 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.858 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.858 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.858 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4247 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 8175616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:34.858 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.437466+0000", 2024-09-13T05:10:34.858 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.330267320000001, 2024-09-13T05:10:34.858 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020852763, 2024-09-13T05:10:34.858 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:34.858 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:34.858 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:34.859 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:34.859 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:34.859 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4247 2024-09-13T05:10:34.859 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.859 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:34.859 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.859 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:34.860 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437466+0000", 2024-09-13T05:10:34.860 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.860 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.860 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.860 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:34.860 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437466+0000", 2024-09-13T05:10:34.860 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.860 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.860 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.860 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:34.861 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437465+0000", 2024-09-13T05:10:34.861 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:34.861 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.861 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.861 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:34.861 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437468+0000", 2024-09-13T05:10:34.861 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1990000000000002e-06 2024-09-13T05:10:34.861 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.861 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.861 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:34.861 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437474+0000", 2024-09-13T05:10:34.861 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.113e-06 2024-09-13T05:10:34.862 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.862 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.862 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:34.862 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437479+0000", 2024-09-13T05:10:34.862 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.13e-06 2024-09-13T05:10:34.862 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.862 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.862 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:34.862 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458172+0000", 2024-09-13T05:10:34.862 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020692954 2024-09-13T05:10:34.862 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.862 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.862 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:34.862 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458237+0000", 2024-09-13T05:10:34.862 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5434999999999999e-05 2024-09-13T05:10:34.863 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.863 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.863 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:34.863 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458319+0000", 2024-09-13T05:10:34.863 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1542e-05 2024-09-13T05:10:34.863 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.863 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:34.863 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.863 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.863 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.864 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4249 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 7782400~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:34.864 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.437538+0000", 2024-09-13T05:10:34.864 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.330194875, 2024-09-13T05:10:34.864 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020997966, 2024-09-13T05:10:34.864 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:34.864 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:34.864 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:34.864 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:34.864 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:34.865 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4249 2024-09-13T05:10:34.865 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.865 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:34.865 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.865 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:34.865 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437538+0000", 2024-09-13T05:10:34.865 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.865 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.865 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.865 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:34.865 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437538+0000", 2024-09-13T05:10:34.865 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.866 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.866 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.866 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:34.866 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437537+0000", 2024-09-13T05:10:34.866 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:34.866 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.866 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.866 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:34.866 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437548+0000", 2024-09-13T05:10:34.866 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0713999999999999e-05 2024-09-13T05:10:34.866 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.866 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.866 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:34.866 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437564+0000", 2024-09-13T05:10:34.867 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5644000000000001e-05 2024-09-13T05:10:34.867 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.867 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.867 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:34.867 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437569+0000", 2024-09-13T05:10:34.867 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7910000000000001e-06 2024-09-13T05:10:34.867 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.867 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.867 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:34.867 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458360+0000", 2024-09-13T05:10:34.867 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020790854000000001 2024-09-13T05:10:34.867 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.867 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.867 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:34.868 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458466+0000", 2024-09-13T05:10:34.868 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010558 2024-09-13T05:10:34.868 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.868 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.868 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:34.868 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458536+0000", 2024-09-13T05:10:34.868 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0408999999999996e-05 2024-09-13T05:10:34.868 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.868 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:34.868 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.868 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.868 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.868 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4251 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 8372224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:34.868 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.437628+0000", 2024-09-13T05:10:34.869 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.330104983, 2024-09-13T05:10:34.869 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.021109941, 2024-09-13T05:10:34.869 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:34.869 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:34.869 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:34.869 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:34.869 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:34.869 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4251 2024-09-13T05:10:34.869 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.869 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:34.869 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.869 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:34.869 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437628+0000", 2024-09-13T05:10:34.869 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.870 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.870 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:34.870 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437628+0000", 2024-09-13T05:10:34.870 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.870 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.870 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:34.870 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437627+0000", 2024-09-13T05:10:34.870 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:34.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.870 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.870 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:34.870 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437631+0000", 2024-09-13T05:10:34.871 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8099999999999999e-06 2024-09-13T05:10:34.871 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.871 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.871 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:34.871 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437637+0000", 2024-09-13T05:10:34.871 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5720000000000002e-06 2024-09-13T05:10:34.871 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.871 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.871 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:34.871 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437641+0000", 2024-09-13T05:10:34.871 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0010000000000003e-06 2024-09-13T05:10:34.871 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.871 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.871 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:34.871 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458561+0000", 2024-09-13T05:10:34.872 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.02091991 2024-09-13T05:10:34.872 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.872 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.872 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:34.872 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458623+0000", 2024-09-13T05:10:34.872 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2855999999999996e-05 2024-09-13T05:10:34.872 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.872 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.872 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:34.872 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458738+0000", 2024-09-13T05:10:34.872 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000114751 2024-09-13T05:10:34.872 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.872 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:34.873 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.873 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.873 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.873 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4254 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 7176192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:34.873 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.439888+0000", 2024-09-13T05:10:34.873 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.327844979, 2024-09-13T05:10:34.873 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019045896999999999, 2024-09-13T05:10:34.873 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:34.873 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:34.873 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:34.873 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:34.873 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:34.873 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4254 2024-09-13T05:10:34.873 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.874 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:34.874 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.874 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:34.874 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.439888+0000", 2024-09-13T05:10:34.874 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.874 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.874 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.874 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:34.874 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.439888+0000", 2024-09-13T05:10:34.874 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.875 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.875 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:34.875 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.439887+0000", 2024-09-13T05:10:34.875 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:34.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.875 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.875 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:34.875 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.439894+0000", 2024-09-13T05:10:34.875 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6890000000000004e-06 2024-09-13T05:10:34.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.875 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.876 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:34.876 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.439909+0000", 2024-09-13T05:10:34.876 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4433000000000001e-05 2024-09-13T05:10:34.876 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.876 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.876 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:34.876 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.439918+0000", 2024-09-13T05:10:34.876 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2969999999999992e-06 2024-09-13T05:10:34.876 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.876 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.876 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:34.877 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458762+0000", 2024-09-13T05:10:34.877 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.018843407999999999 2024-09-13T05:10:34.877 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.877 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.877 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:34.877 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458866+0000", 2024-09-13T05:10:34.877 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000104314 2024-09-13T05:10:34.877 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.877 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.877 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:34.877 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458934+0000", 2024-09-13T05:10:34.877 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8165999999999998e-05 2024-09-13T05:10:34.877 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.877 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:34.878 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.878 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.878 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:7867 3.1c 3:3af80b2f:::rbd_data.112db57f3a18.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-13T05:10:34.878 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:25.873439+0000", 2024-09-13T05:10:34.878 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.8942945760000001, 2024-09-13T05:10:34.878 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.021501498000000001, 2024-09-13T05:10:34.878 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:34.879 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:34.879 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:34.879 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:34.879 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:34.879 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 7867 2024-09-13T05:10:34.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.879 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:34.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:34.879 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.873439+0000", 2024-09-13T05:10:34.879 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:34.880 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.873439+0000", 2024-09-13T05:10:34.880 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:34.880 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.880 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.880 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:34.880 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.873437+0000", 2024-09-13T05:10:34.880 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:34.880 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.881 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.881 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:34.881 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.878315+0000", 2024-09-13T05:10:34.881 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0048783530000000002 2024-09-13T05:10:34.881 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.881 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.881 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:34.881 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.878348+0000", 2024-09-13T05:10:34.881 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3420000000000002e-05 2024-09-13T05:10:34.881 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.882 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:34.882 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.878362+0000", 2024-09-13T05:10:34.882 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3784999999999999e-05 2024-09-13T05:10:34.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.882 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:34.882 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.878510+0000", 2024-09-13T05:10:34.882 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014806699999999999 2024-09-13T05:10:34.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.883 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.883 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:34.883 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.878727+0000", 2024-09-13T05:10:34.883 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000216935 2024-09-13T05:10:34.883 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.883 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.883 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:34.883 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.879100+0000", 2024-09-13T05:10:34.883 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00037323800000000002 2024-09-13T05:10:34.883 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.883 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.883 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:34.883 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.892006+0000", 2024-09-13T05:10:34.884 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012905585000000001 2024-09-13T05:10:34.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.884 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.884 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:34.884 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.894853+0000", 2024-09-13T05:10:34.884 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002846711 2024-09-13T05:10:34.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:34.885 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.894901+0000", 2024-09-13T05:10:34.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8758999999999999e-05 2024-09-13T05:10:34.885 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:34.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:34.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:34.885 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.894940+0000", 2024-09-13T05:10:34.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8708000000000003e-05 2024-09-13T05:10:34.886 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.886 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:34.886 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.886 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:34.886 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:34.886 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:34.887 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T05:10:34.889 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:10:34.890 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:34.883+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:34.988 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:34.982+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:35.050 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:35.050 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:35.051 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:35.051 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:35.060 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:10:35.089 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:35.086+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:35.172 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:35.172 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:35.172 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:35.172 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:35.172 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:35.182 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:10:35.191 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:35.186+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:35.291 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:35.291 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:35.291 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:35.291 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:10:35.291 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.291 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:13869 3.a 3:5540fdaf:::rbd_data.112de12546cf.0000000000000008:b [read 58368~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.291 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.745638+0000", 2024-09-13T05:10:35.291 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.542007806, 2024-09-13T05:10:35.291 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052355908, 2024-09-13T05:10:35.291 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.291 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.291 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.292 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.292 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.292 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 13869 2024-09-13T05:10:35.292 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.292 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.292 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.292 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.292 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745638+0000", 2024-09-13T05:10:35.292 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.292 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.292 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.292 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.292 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745638+0000", 2024-09-13T05:10:35.293 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.293 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.293 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.293 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.293 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745637+0000", 2024-09-13T05:10:35.293 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:35.293 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.293 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.293 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.293 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745641+0000", 2024-09-13T05:10:35.293 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3469999999999999e-06 2024-09-13T05:10:35.293 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.294 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.294 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.294 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745646+0000", 2024-09-13T05:10:35.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7649999999999999e-06 2024-09-13T05:10:35.294 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.294 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.294 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.294 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745652+0000", 2024-09-13T05:10:35.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9059999999999999e-06 2024-09-13T05:10:35.294 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.294 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.294 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.294 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.797790+0000", 2024-09-13T05:10:35.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052137492000000001 2024-09-13T05:10:35.295 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.295 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.295 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.295 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.797842+0000", 2024-09-13T05:10:35.295 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1805999999999998e-05 2024-09-13T05:10:35.295 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.295 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.295 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.295 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.797994+0000", 2024-09-13T05:10:35.295 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00015199899999999999 2024-09-13T05:10:35.295 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.295 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.295 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.295 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.296 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.296 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:13871 3.a 3:5540fdaf:::rbd_data.112de12546cf.0000000000000008:b [read 67584~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.296 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.745656+0000", 2024-09-13T05:10:35.296 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.5419891359999998, 2024-09-13T05:10:35.296 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052577589000000001, 2024-09-13T05:10:35.296 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.296 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.296 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.296 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.296 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.296 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 13871 2024-09-13T05:10:35.296 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.296 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.296 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.297 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.297 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745656+0000", 2024-09-13T05:10:35.297 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.297 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.297 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.297 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.297 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745656+0000", 2024-09-13T05:10:35.297 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.297 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.297 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.297 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.297 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745656+0000", 2024-09-13T05:10:35.297 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:35.298 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.298 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.298 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.298 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745659+0000", 2024-09-13T05:10:35.298 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.48e-06 2024-09-13T05:10:35.298 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.298 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.298 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.298 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745664+0000", 2024-09-13T05:10:35.298 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4709999999999998e-06 2024-09-13T05:10:35.298 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.298 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.298 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.298 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745669+0000", 2024-09-13T05:10:35.298 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5469999999999998e-06 2024-09-13T05:10:35.299 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.299 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.299 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.299 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.798032+0000", 2024-09-13T05:10:35.299 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052362862000000003 2024-09-13T05:10:35.299 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.299 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.299 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.299 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.798129+0000", 2024-09-13T05:10:35.299 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7479000000000006e-05 2024-09-13T05:10:35.299 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.299 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.299 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.299 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.798234+0000", 2024-09-13T05:10:35.300 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000105061 2024-09-13T05:10:35.300 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.300 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.300 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.300 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.300 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.300 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:13873 3.a 3:5540fdaf:::rbd_data.112de12546cf.0000000000000008:b [read 76800~862] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.300 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.745673+0000", 2024-09-13T05:10:35.300 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.5419730070000002, 2024-09-13T05:10:35.300 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052769806000000002, 2024-09-13T05:10:35.300 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.300 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.300 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.301 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.301 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.301 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 13873 2024-09-13T05:10:35.301 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.301 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.301 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.301 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.301 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745673+0000", 2024-09-13T05:10:35.301 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.301 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.301 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.301 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.301 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745673+0000", 2024-09-13T05:10:35.301 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.301 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.302 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.302 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.302 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745672+0000", 2024-09-13T05:10:35.302 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:35.302 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.302 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.302 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.302 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745675+0000", 2024-09-13T05:10:35.302 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3180000000000001e-06 2024-09-13T05:10:35.302 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.302 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.302 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.302 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745680+0000", 2024-09-13T05:10:35.302 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5219999999999998e-06 2024-09-13T05:10:35.303 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.303 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.303 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.303 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745687+0000", 2024-09-13T05:10:35.303 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0099999999999998e-06 2024-09-13T05:10:35.303 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.303 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.303 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.303 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.798274+0000", 2024-09-13T05:10:35.303 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052586546999999997 2024-09-13T05:10:35.303 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.303 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.303 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.304 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.798352+0000", 2024-09-13T05:10:35.304 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8219000000000004e-05 2024-09-13T05:10:35.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.304 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.304 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.304 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.798442+0000", 2024-09-13T05:10:35.304 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0498e-05 2024-09-13T05:10:35.304 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.304 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.304 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.304 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.304 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:13876 3.a 3:5540fdaf:::rbd_data.112de12546cf.0000000000000008:b [read 86016~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.304 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.745691+0000", 2024-09-13T05:10:35.304 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.5419543139999998, 2024-09-13T05:10:35.305 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052877840000000002, 2024-09-13T05:10:35.305 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.305 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.305 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.305 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.305 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.305 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 13876 2024-09-13T05:10:35.305 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.305 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.305 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.305 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.305 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745691+0000", 2024-09-13T05:10:35.305 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.306 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.306 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.306 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.306 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745691+0000", 2024-09-13T05:10:35.306 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.306 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.306 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.306 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.306 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745691+0000", 2024-09-13T05:10:35.306 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:35.306 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.306 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.306 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.306 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745693+0000", 2024-09-13T05:10:35.307 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5100000000000001e-06 2024-09-13T05:10:35.307 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.307 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.307 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.307 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745699+0000", 2024-09-13T05:10:35.307 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5600000000000001e-06 2024-09-13T05:10:35.307 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.307 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.307 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.307 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745704+0000", 2024-09-13T05:10:35.307 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0440000000000003e-06 2024-09-13T05:10:35.307 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.307 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.308 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.308 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.798473+0000", 2024-09-13T05:10:35.308 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052769059 2024-09-13T05:10:35.308 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.308 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.308 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.308 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.798519+0000", 2024-09-13T05:10:35.308 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5883000000000001e-05 2024-09-13T05:10:35.308 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.308 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.308 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.308 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.798569+0000", 2024-09-13T05:10:35.309 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0145000000000002e-05 2024-09-13T05:10:35.309 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.309 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.309 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.309 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.309 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.309 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:13878 3.a 3:5540fdaf:::rbd_data.112de12546cf.0000000000000008:b [read 95232~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.309 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.745723+0000", 2024-09-13T05:10:35.309 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.5419228780000003, 2024-09-13T05:10:35.309 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052958395999999998, 2024-09-13T05:10:35.309 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.309 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.310 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.310 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.310 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.310 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 13878 2024-09-13T05:10:35.310 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.310 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.310 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.310 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.310 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745723+0000", 2024-09-13T05:10:35.310 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.311 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.311 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.311 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.311 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745723+0000", 2024-09-13T05:10:35.311 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.311 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.311 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.311 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.311 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745722+0000", 2024-09-13T05:10:35.312 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:35.312 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.312 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.312 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.312 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745729+0000", 2024-09-13T05:10:35.312 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2069999999999998e-06 2024-09-13T05:10:35.312 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.312 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.312 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.312 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745751+0000", 2024-09-13T05:10:35.312 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1824999999999999e-05 2024-09-13T05:10:35.312 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.312 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.312 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.313 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745756+0000", 2024-09-13T05:10:35.313 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3260000000000003e-06 2024-09-13T05:10:35.313 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.313 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.313 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.313 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.798595+0000", 2024-09-13T05:10:35.313 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052839046000000001 2024-09-13T05:10:35.313 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.313 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.313 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.313 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.798637+0000", 2024-09-13T05:10:35.313 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1875000000000001e-05 2024-09-13T05:10:35.313 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.313 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.314 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.314 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.798681+0000", 2024-09-13T05:10:35.314 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3809e-05 2024-09-13T05:10:35.314 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.314 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.314 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.314 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.314 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.314 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:13880 3.a 3:5540fdaf:::rbd_data.112de12546cf.0000000000000008:b [read 104448~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.314 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.745761+0000", 2024-09-13T05:10:35.314 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.5418843869999996, 2024-09-13T05:10:35.314 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.053090569999999997, 2024-09-13T05:10:35.314 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.315 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.315 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.315 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.315 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.315 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 13880 2024-09-13T05:10:35.315 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.315 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.315 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.315 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.315 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745761+0000", 2024-09-13T05:10:35.315 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.315 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.315 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.315 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.316 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745761+0000", 2024-09-13T05:10:35.316 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.316 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.316 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.316 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.316 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745760+0000", 2024-09-13T05:10:35.316 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:35.316 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.316 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.316 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.316 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745763+0000", 2024-09-13T05:10:35.316 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9830000000000001e-06 2024-09-13T05:10:35.316 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.316 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.317 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.317 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745769+0000", 2024-09-13T05:10:35.317 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4729999999999999e-06 2024-09-13T05:10:35.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.317 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.317 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.317 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745774+0000", 2024-09-13T05:10:35.317 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7690000000000004e-06 2024-09-13T05:10:35.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.317 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.317 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.317 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.798712+0000", 2024-09-13T05:10:35.317 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052938236999999999 2024-09-13T05:10:35.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.318 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.318 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.318 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.798771+0000", 2024-09-13T05:10:35.318 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9599000000000003e-05 2024-09-13T05:10:35.318 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.318 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.318 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.318 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.798852+0000", 2024-09-13T05:10:35.318 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0284999999999994e-05 2024-09-13T05:10:35.318 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.318 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.318 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.318 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.319 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.319 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:13882 3.a 3:5540fdaf:::rbd_data.112de12546cf.0000000000000008:b [read 113664~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.319 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.745777+0000", 2024-09-13T05:10:35.319 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.5418682070000003, 2024-09-13T05:10:35.319 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.053380437000000003, 2024-09-13T05:10:35.319 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.319 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.319 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.319 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.319 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.319 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 13882 2024-09-13T05:10:35.319 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.319 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.319 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.319 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.320 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745777+0000", 2024-09-13T05:10:35.320 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.320 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.320 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.320 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.320 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745777+0000", 2024-09-13T05:10:35.320 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.320 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.320 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.320 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.320 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745777+0000", 2024-09-13T05:10:35.320 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:35.320 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.320 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.321 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.321 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745779+0000", 2024-09-13T05:10:35.321 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2500000000000001e-06 2024-09-13T05:10:35.321 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.321 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.321 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.321 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745785+0000", 2024-09-13T05:10:35.321 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.767e-06 2024-09-13T05:10:35.321 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.321 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.321 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.321 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745790+0000", 2024-09-13T05:10:35.321 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6770000000000003e-06 2024-09-13T05:10:35.321 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.322 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.322 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.322 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.799036+0000", 2024-09-13T05:10:35.322 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.053246003 2024-09-13T05:10:35.322 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.322 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.322 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.322 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.799102+0000", 2024-09-13T05:10:35.322 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6595999999999997e-05 2024-09-13T05:10:35.322 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.322 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.322 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.322 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.799158+0000", 2024-09-13T05:10:35.322 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5457000000000001e-05 2024-09-13T05:10:35.323 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.323 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.323 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.323 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.323 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.323 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:13884 3.a 3:5540fdaf:::rbd_data.112de12546cf.0000000000000008:b [read 122880~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.323 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.745794+0000", 2024-09-13T05:10:35.323 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.5418517239999998, 2024-09-13T05:10:35.323 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.053560390999999999, 2024-09-13T05:10:35.323 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.323 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.323 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.323 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.323 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.324 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 13884 2024-09-13T05:10:35.324 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.324 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.324 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.324 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.324 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745794+0000", 2024-09-13T05:10:35.324 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.324 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.324 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.324 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.324 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745794+0000", 2024-09-13T05:10:35.324 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.324 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.324 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.325 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.325 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745794+0000", 2024-09-13T05:10:35.325 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:35.325 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.325 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.325 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.325 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745796+0000", 2024-09-13T05:10:35.325 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3829999999999999e-06 2024-09-13T05:10:35.325 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.325 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.325 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.325 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745801+0000", 2024-09-13T05:10:35.325 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3120000000000001e-06 2024-09-13T05:10:35.326 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.326 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.326 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.326 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745806+0000", 2024-09-13T05:10:35.326 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5929999999999999e-06 2024-09-13T05:10:35.326 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.326 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.326 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.326 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.799200+0000", 2024-09-13T05:10:35.326 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.053393837999999999 2024-09-13T05:10:35.326 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.326 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.326 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.326 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.799303+0000", 2024-09-13T05:10:35.326 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000103725 2024-09-13T05:10:35.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.327 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.327 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.327 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.799354+0000", 2024-09-13T05:10:35.327 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0865000000000002e-05 2024-09-13T05:10:35.327 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.327 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.327 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.327 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.327 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:13886 3.a 3:5540fdaf:::rbd_data.112de12546cf.0000000000000008:b [read 132096~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.327 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.745811+0000", 2024-09-13T05:10:35.328 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.5418348850000001, 2024-09-13T05:10:35.328 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.053681698, 2024-09-13T05:10:35.328 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.328 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.328 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.328 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.328 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.328 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 13886 2024-09-13T05:10:35.328 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.328 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.328 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.328 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.328 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745811+0000", 2024-09-13T05:10:35.329 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.329 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.329 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.329 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.329 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745811+0000", 2024-09-13T05:10:35.329 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.329 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.329 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.329 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.329 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745810+0000", 2024-09-13T05:10:35.329 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:35.329 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.329 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.329 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.330 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745813+0000", 2024-09-13T05:10:35.330 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4650000000000001e-06 2024-09-13T05:10:35.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.330 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.330 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.330 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745818+0000", 2024-09-13T05:10:35.330 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3990000000000003e-06 2024-09-13T05:10:35.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.330 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.330 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.330 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745823+0000", 2024-09-13T05:10:35.330 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7169999999999999e-06 2024-09-13T05:10:35.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.331 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.331 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.331 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.799387+0000", 2024-09-13T05:10:35.331 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.053564332999999999 2024-09-13T05:10:35.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.331 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.331 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.331 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.799432+0000", 2024-09-13T05:10:35.331 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4787000000000003e-05 2024-09-13T05:10:35.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.331 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.331 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.331 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.799492+0000", 2024-09-13T05:10:35.332 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0300000000000002e-05 2024-09-13T05:10:35.332 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.332 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.332 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.332 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.332 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.332 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:13888 3.a 3:5540fdaf:::rbd_data.112de12546cf.0000000000000008:b [read 141312~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.332 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.745829+0000", 2024-09-13T05:10:35.332 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.5418165750000004, 2024-09-13T05:10:35.332 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.053775429, 2024-09-13T05:10:35.332 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.332 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.332 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.332 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.332 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.333 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 13888 2024-09-13T05:10:35.333 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.333 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.333 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.333 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.333 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745829+0000", 2024-09-13T05:10:35.333 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.333 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.333 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.333 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.333 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745829+0000", 2024-09-13T05:10:35.333 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.333 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.334 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.334 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.334 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745829+0000", 2024-09-13T05:10:35.334 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:35.334 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.334 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.334 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.334 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745831+0000", 2024-09-13T05:10:35.334 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.531e-06 2024-09-13T05:10:35.334 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.334 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.334 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.334 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745837+0000", 2024-09-13T05:10:35.335 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3419999999999998e-06 2024-09-13T05:10:35.335 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.335 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.335 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.335 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745841+0000", 2024-09-13T05:10:35.335 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7190000000000001e-06 2024-09-13T05:10:35.335 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.335 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.335 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.335 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.799507+0000", 2024-09-13T05:10:35.335 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.053665909999999997 2024-09-13T05:10:35.335 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.335 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.336 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.336 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.799550+0000", 2024-09-13T05:10:35.336 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2947000000000001e-05 2024-09-13T05:10:35.336 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.336 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.336 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.336 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.799604+0000", 2024-09-13T05:10:35.336 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4318999999999999e-05 2024-09-13T05:10:35.336 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.336 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.336 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.336 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.336 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.336 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:13890 3.a 3:5540fdaf:::rbd_data.112de12546cf.0000000000000008:b [read 150528~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.337 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.745967+0000", 2024-09-13T05:10:35.337 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.5416785339999999, 2024-09-13T05:10:35.337 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.053847389000000002, 2024-09-13T05:10:35.337 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.337 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.337 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.337 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.337 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.337 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 13890 2024-09-13T05:10:35.337 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.337 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.337 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.337 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.338 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745967+0000", 2024-09-13T05:10:35.338 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.338 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.338 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.338 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745967+0000", 2024-09-13T05:10:35.338 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.338 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.338 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.338 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745845+0000", 2024-09-13T05:10:35.338 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9998779 2024-09-13T05:10:35.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.338 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.339 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.339 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745970+0000", 2024-09-13T05:10:35.339 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000125616 2024-09-13T05:10:35.339 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.339 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.339 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.339 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745978+0000", 2024-09-13T05:10:35.339 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8120000000000008e-06 2024-09-13T05:10:35.339 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.339 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.339 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.339 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745986+0000", 2024-09-13T05:10:35.339 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6620000000000005e-06 2024-09-13T05:10:35.339 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.339 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.340 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.340 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.799642+0000", 2024-09-13T05:10:35.340 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.053655656000000003 2024-09-13T05:10:35.340 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.340 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.340 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.340 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.799735+0000", 2024-09-13T05:10:35.340 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3333999999999998e-05 2024-09-13T05:10:35.340 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.340 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.340 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.340 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.799814+0000", 2024-09-13T05:10:35.340 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9522000000000002e-05 2024-09-13T05:10:35.340 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.340 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.341 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.341 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.341 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.341 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:13892 3.a 3:5540fdaf:::rbd_data.112de12546cf.0000000000000008:b [read 159744~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.341 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.746220+0000", 2024-09-13T05:10:35.341 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.5414257559999998, 2024-09-13T05:10:35.341 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.053726022999999998, 2024-09-13T05:10:35.341 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.341 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.341 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.341 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.341 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.341 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 13892 2024-09-13T05:10:35.341 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.341 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.342 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.342 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.342 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.746220+0000", 2024-09-13T05:10:35.342 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.342 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.342 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.342 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.342 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.746220+0000", 2024-09-13T05:10:35.342 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.342 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.342 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.342 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.342 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.745991+0000", 2024-09-13T05:10:35.342 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9997711 2024-09-13T05:10:35.342 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.343 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.343 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.343 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.746224+0000", 2024-09-13T05:10:35.343 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00023304 2024-09-13T05:10:35.343 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.343 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.343 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.343 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.746239+0000", 2024-09-13T05:10:35.343 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4926000000000001e-05 2024-09-13T05:10:35.343 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.343 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.343 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.343 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.746246+0000", 2024-09-13T05:10:35.343 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7470000000000005e-06 2024-09-13T05:10:35.344 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.344 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.344 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.344 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.799853+0000", 2024-09-13T05:10:35.344 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.053606035000000003 2024-09-13T05:10:35.344 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.344 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.344 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.344 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.799898+0000", 2024-09-13T05:10:35.344 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5246e-05 2024-09-13T05:10:35.344 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.344 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.344 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.345 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.799946+0000", 2024-09-13T05:10:35.345 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8096999999999997e-05 2024-09-13T05:10:35.345 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.345 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.345 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.345 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.345 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.345 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:13976 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 1589248~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.345 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.749228+0000", 2024-09-13T05:10:35.345 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.5384171599999998, 2024-09-13T05:10:35.345 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052538057999999999, 2024-09-13T05:10:35.345 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.345 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.346 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.346 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.346 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.346 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 13976 2024-09-13T05:10:35.346 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.346 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.346 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.346 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.346 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.749228+0000", 2024-09-13T05:10:35.346 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.346 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.346 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.346 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.346 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.749228+0000", 2024-09-13T05:10:35.347 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.347 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.347 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.347 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.347 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.749228+0000", 2024-09-13T05:10:35.347 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:35.347 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.347 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.347 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.347 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.749230+0000", 2024-09-13T05:10:35.347 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2740000000000002e-06 2024-09-13T05:10:35.347 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.347 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.348 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.348 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.749236+0000", 2024-09-13T05:10:35.348 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3680000000000001e-06 2024-09-13T05:10:35.348 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.348 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.348 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.348 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.749240+0000", 2024-09-13T05:10:35.348 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6160000000000004e-06 2024-09-13T05:10:35.348 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.348 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.348 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.348 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.801498+0000", 2024-09-13T05:10:35.348 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052257896999999998 2024-09-13T05:10:35.348 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.349 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.349 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.349 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.801547+0000", 2024-09-13T05:10:35.349 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8262e-05 2024-09-13T05:10:35.349 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.349 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.349 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.349 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.801766+0000", 2024-09-13T05:10:35.349 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021996900000000001 2024-09-13T05:10:35.349 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.349 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.349 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.349 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.349 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.349 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:13992 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 1736704~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.350 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.753305+0000", 2024-09-13T05:10:35.350 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.5343402939999997, 2024-09-13T05:10:35.350 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052376749, 2024-09-13T05:10:35.350 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.350 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.350 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.350 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.350 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.350 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 13992 2024-09-13T05:10:35.350 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.350 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.350 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.350 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.350 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.753305+0000", 2024-09-13T05:10:35.350 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.350 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.351 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.351 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.351 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.753305+0000", 2024-09-13T05:10:35.351 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.351 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.351 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.351 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.351 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.753305+0000", 2024-09-13T05:10:35.351 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:35.351 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.351 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.351 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.351 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.753307+0000", 2024-09-13T05:10:35.351 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.249e-06 2024-09-13T05:10:35.352 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.352 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.352 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.352 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.753312+0000", 2024-09-13T05:10:35.352 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2410000000000003e-06 2024-09-13T05:10:35.352 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.352 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.352 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.352 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.753317+0000", 2024-09-13T05:10:35.352 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6290000000000001e-06 2024-09-13T05:10:35.352 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.352 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.352 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.352 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.805471+0000", 2024-09-13T05:10:35.352 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.05215384 2024-09-13T05:10:35.353 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.353 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.353 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.353 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.805514+0000", 2024-09-13T05:10:35.353 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2583999999999998e-05 2024-09-13T05:10:35.353 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.353 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.353 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.353 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.805682+0000", 2024-09-13T05:10:35.353 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016849500000000001 2024-09-13T05:10:35.353 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.353 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.353 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.353 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.354 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.354 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:13993 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 1745920~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.354 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.753326+0000", 2024-09-13T05:10:35.354 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.5343198549999997, 2024-09-13T05:10:35.354 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052471244, 2024-09-13T05:10:35.354 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.354 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.354 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.354 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.354 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.354 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 13993 2024-09-13T05:10:35.354 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.354 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.354 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.355 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.355 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.753326+0000", 2024-09-13T05:10:35.355 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.355 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.355 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.355 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.355 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.753326+0000", 2024-09-13T05:10:35.355 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.355 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.355 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.355 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.355 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.753325+0000", 2024-09-13T05:10:35.355 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:35.355 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.355 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.356 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.356 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.753328+0000", 2024-09-13T05:10:35.356 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1719999999999999e-06 2024-09-13T05:10:35.356 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.356 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.356 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.356 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.753334+0000", 2024-09-13T05:10:35.356 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5849999999999999e-06 2024-09-13T05:10:35.356 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.356 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.356 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.356 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.753339+0000", 2024-09-13T05:10:35.356 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7180000000000004e-06 2024-09-13T05:10:35.356 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.805701+0000", 2024-09-13T05:10:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052362805999999998 2024-09-13T05:10:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.805744+0000", 2024-09-13T05:10:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2561999999999997e-05 2024-09-13T05:10:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.805797+0000", 2024-09-13T05:10:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3059999999999997e-05 2024-09-13T05:10:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:13994 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 1755136~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.753352+0000", 2024-09-13T05:10:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.5342935070000001, 2024-09-13T05:10:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052562984, 2024-09-13T05:10:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 13994 2024-09-13T05:10:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.753352+0000", 2024-09-13T05:10:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.753352+0000", 2024-09-13T05:10:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.753352+0000", 2024-09-13T05:10:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.753356+0000", 2024-09-13T05:10:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9480000000000001e-06 2024-09-13T05:10:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.753362+0000", 2024-09-13T05:10:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5629999999999997e-06 2024-09-13T05:10:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.753367+0000", 2024-09-13T05:10:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.989e-06 2024-09-13T05:10:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.805821+0000", 2024-09-13T05:10:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052453656000000001 2024-09-13T05:10:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.805861+0000", 2024-09-13T05:10:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0263999999999999e-05 2024-09-13T05:10:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.805915+0000", 2024-09-13T05:10:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3980000000000002e-05 2024-09-13T05:10:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:14001 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 1819648~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.754870+0000", 2024-09-13T05:10:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.532775526, 2024-09-13T05:10:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052267138999999997, 2024-09-13T05:10:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 14001 2024-09-13T05:10:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.754870+0000", 2024-09-13T05:10:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.754870+0000", 2024-09-13T05:10:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.754705+0000", 2024-09-13T05:10:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9998345 2024-09-13T05:10:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.754874+0000", 2024-09-13T05:10:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016903799999999999 2024-09-13T05:10:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.754881+0000", 2024-09-13T05:10:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0450000000000003e-06 2024-09-13T05:10:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.754887+0000", 2024-09-13T05:10:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4160000000000001e-06 2024-09-13T05:10:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.806962+0000", 2024-09-13T05:10:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052074902999999999 2024-09-13T05:10:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.807002+0000", 2024-09-13T05:10:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0444000000000001e-05 2024-09-13T05:10:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.807137+0000", 2024-09-13T05:10:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000134795 2024-09-13T05:10:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:14034 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 1856512~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.755905+0000", 2024-09-13T05:10:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.531740857, 2024-09-13T05:10:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052295976000000001, 2024-09-13T05:10:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 14034 2024-09-13T05:10:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.755905+0000", 2024-09-13T05:10:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.755905+0000", 2024-09-13T05:10:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.755753+0000", 2024-09-13T05:10:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9998488 2024-09-13T05:10:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.755908+0000", 2024-09-13T05:10:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00015509399999999999 2024-09-13T05:10:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.755929+0000", 2024-09-13T05:10:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0577e-05 2024-09-13T05:10:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.755936+0000", 2024-09-13T05:10:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2830000000000004e-06 2024-09-13T05:10:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.807797+0000", 2024-09-13T05:10:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.051860911000000003 2024-09-13T05:10:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.807844+0000", 2024-09-13T05:10:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6403000000000003e-05 2024-09-13T05:10:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.808201+0000", 2024-09-13T05:10:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00035708799999999998 2024-09-13T05:10:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:14036 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 1884160~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.756410+0000", 2024-09-13T05:10:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.5312354910000003, 2024-09-13T05:10:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052321999000000001, 2024-09-13T05:10:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 14036 2024-09-13T05:10:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.756410+0000", 2024-09-13T05:10:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.756410+0000", 2024-09-13T05:10:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.756218+0000", 2024-09-13T05:10:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9998078 2024-09-13T05:10:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.756413+0000", 2024-09-13T05:10:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000195658 2024-09-13T05:10:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.756428+0000", 2024-09-13T05:10:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4226999999999999e-05 2024-09-13T05:10:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.756434+0000", 2024-09-13T05:10:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9689999999999999e-06 2024-09-13T05:10:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.808410+0000", 2024-09-13T05:10:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.051976403999999997 2024-09-13T05:10:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.808499+0000", 2024-09-13T05:10:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8657000000000002e-05 2024-09-13T05:10:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.375 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.375 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.375 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.808732+0000", 2024-09-13T05:10:35.375 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000233365 2024-09-13T05:10:35.375 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.375 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.375 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.375 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.375 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.375 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:14039 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 1921024~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.375 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.757097+0000", 2024-09-13T05:10:35.375 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.5305490349999999, 2024-09-13T05:10:35.375 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052457749999999997, 2024-09-13T05:10:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 14039 2024-09-13T05:10:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.757097+0000", 2024-09-13T05:10:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.757097+0000", 2024-09-13T05:10:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.757096+0000", 2024-09-13T05:10:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.757099+0000", 2024-09-13T05:10:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:10:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.757104+0000", 2024-09-13T05:10:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4750000000000001e-06 2024-09-13T05:10:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.757109+0000", 2024-09-13T05:10:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8520000000000003e-06 2024-09-13T05:10:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.809322+0000", 2024-09-13T05:10:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052212913 2024-09-13T05:10:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.809372+0000", 2024-09-13T05:10:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0359999999999999e-05 2024-09-13T05:10:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.809554+0000", 2024-09-13T05:10:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018186999999999999 2024-09-13T05:10:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.380 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.380 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.380 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:35.381 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:10:35.382 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:35.378+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:35.482 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:35.478+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:35.495 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:35.495 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:35.495 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:35.495 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:35.504 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:10:35.583 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:35.579+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:35.612 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:35.612 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:35.613 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:35.613 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:35.613 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:35.616 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is set 2024-09-13T05:10:35.623 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:10:35.684 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:35.678+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:35.725 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:35.726 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:35.726 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:35.726 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:10:35.726 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.726 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11814 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 598016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.726 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.424372+0000", 2024-09-13T05:10:35.726 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.2984008630000003, 2024-09-13T05:10:35.726 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040676889000000001, 2024-09-13T05:10:35.726 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.726 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.727 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.727 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.727 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.727 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11814 2024-09-13T05:10:35.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.727 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.727 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.727 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424372+0000", 2024-09-13T05:10:35.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.727 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.727 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424372+0000", 2024-09-13T05:10:35.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424371+0000", 2024-09-13T05:10:35.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:35.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424377+0000", 2024-09-13T05:10:35.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3619999999999997e-06 2024-09-13T05:10:35.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424387+0000", 2024-09-13T05:10:35.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0526999999999999e-05 2024-09-13T05:10:35.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424395+0000", 2024-09-13T05:10:35.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3599999999999998e-06 2024-09-13T05:10:35.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.730 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.464922+0000", 2024-09-13T05:10:35.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040527101000000003 2024-09-13T05:10:35.730 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.730 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.730 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.730 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.464999+0000", 2024-09-13T05:10:35.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7279000000000003e-05 2024-09-13T05:10:35.730 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.730 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.730 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465049+0000", 2024-09-13T05:10:35.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0237e-05 2024-09-13T05:10:35.731 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.731 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.731 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.731 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11815 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 607232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.731 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.424515+0000", 2024-09-13T05:10:35.731 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.2982576750000003, 2024-09-13T05:10:35.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040712652000000002, 2024-09-13T05:10:35.732 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.732 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.732 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.732 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.732 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.732 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11815 2024-09-13T05:10:35.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.732 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.732 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424515+0000", 2024-09-13T05:10:35.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.733 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.733 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424515+0000", 2024-09-13T05:10:35.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.733 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.733 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424514+0000", 2024-09-13T05:10:35.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:35.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.733 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.733 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424520+0000", 2024-09-13T05:10:35.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8680000000000004e-06 2024-09-13T05:10:35.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424537+0000", 2024-09-13T05:10:35.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6591000000000001e-05 2024-09-13T05:10:35.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424553+0000", 2024-09-13T05:10:35.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5820000000000001e-05 2024-09-13T05:10:35.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465084+0000", 2024-09-13T05:10:35.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040531840999999999 2024-09-13T05:10:35.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465146+0000", 2024-09-13T05:10:35.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1291000000000007e-05 2024-09-13T05:10:35.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465228+0000", 2024-09-13T05:10:35.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2398000000000006e-05 2024-09-13T05:10:35.735 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.735 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.735 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.736 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11816 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 616448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.736 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.424719+0000", 2024-09-13T05:10:35.736 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.2980537290000003, 2024-09-13T05:10:35.736 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040708561999999997, 2024-09-13T05:10:35.736 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.736 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.736 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.736 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.736 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.736 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11816 2024-09-13T05:10:35.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.736 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424719+0000", 2024-09-13T05:10:35.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424719+0000", 2024-09-13T05:10:35.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424718+0000", 2024-09-13T05:10:35.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:35.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424725+0000", 2024-09-13T05:10:35.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3339999999999998e-06 2024-09-13T05:10:35.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424738+0000", 2024-09-13T05:10:35.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3799e-05 2024-09-13T05:10:35.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424766+0000", 2024-09-13T05:10:35.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7953000000000002e-05 2024-09-13T05:10:35.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465267+0000", 2024-09-13T05:10:35.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040500586999999998 2024-09-13T05:10:35.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465349+0000", 2024-09-13T05:10:35.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1854999999999995e-05 2024-09-13T05:10:35.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465428+0000", 2024-09-13T05:10:35.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9246000000000007e-05 2024-09-13T05:10:35.740 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.740 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.740 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.740 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11817 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 625664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.740 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.424896+0000", 2024-09-13T05:10:35.740 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.2978775799999998, 2024-09-13T05:10:35.740 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040676439000000002, 2024-09-13T05:10:35.740 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.740 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.740 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.740 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.740 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.740 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11817 2024-09-13T05:10:35.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.741 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.741 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424896+0000", 2024-09-13T05:10:35.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.741 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424896+0000", 2024-09-13T05:10:35.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424894+0000", 2024-09-13T05:10:35.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:35.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424901+0000", 2024-09-13T05:10:35.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9070000000000001e-06 2024-09-13T05:10:35.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424918+0000", 2024-09-13T05:10:35.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7249e-05 2024-09-13T05:10:35.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.424936+0000", 2024-09-13T05:10:35.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7241e-05 2024-09-13T05:10:35.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465460+0000", 2024-09-13T05:10:35.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040524866999999999 2024-09-13T05:10:35.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465521+0000", 2024-09-13T05:10:35.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0909000000000002e-05 2024-09-13T05:10:35.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.744 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465572+0000", 2024-09-13T05:10:35.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0568000000000001e-05 2024-09-13T05:10:35.744 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.744 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.744 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.744 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11818 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 634880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.744 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.425122+0000", 2024-09-13T05:10:35.744 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.2976510939999999, 2024-09-13T05:10:35.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040642338, 2024-09-13T05:10:35.745 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.745 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.745 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.745 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.745 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.745 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11818 2024-09-13T05:10:35.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.745 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.745 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.745 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.745 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425122+0000", 2024-09-13T05:10:35.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.746 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425122+0000", 2024-09-13T05:10:35.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.746 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425121+0000", 2024-09-13T05:10:35.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:35.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.746 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425127+0000", 2024-09-13T05:10:35.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4699999999999999e-06 2024-09-13T05:10:35.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425165+0000", 2024-09-13T05:10:35.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8118999999999999e-05 2024-09-13T05:10:35.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425176+0000", 2024-09-13T05:10:35.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0295000000000001e-05 2024-09-13T05:10:35.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465610+0000", 2024-09-13T05:10:35.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040434111000000002 2024-09-13T05:10:35.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465692+0000", 2024-09-13T05:10:35.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2138000000000005e-05 2024-09-13T05:10:35.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465764+0000", 2024-09-13T05:10:35.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2362999999999998e-05 2024-09-13T05:10:35.749 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.749 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.749 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.749 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11820 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 653312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.749 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.425506+0000", 2024-09-13T05:10:35.750 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.2972675440000003, 2024-09-13T05:10:35.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040887996000000003, 2024-09-13T05:10:35.750 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.750 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.750 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.750 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.750 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.750 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11820 2024-09-13T05:10:35.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.750 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425506+0000", 2024-09-13T05:10:35.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425506+0000", 2024-09-13T05:10:35.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425504+0000", 2024-09-13T05:10:35.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:35.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425511+0000", 2024-09-13T05:10:35.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4629999999999998e-06 2024-09-13T05:10:35.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425525+0000", 2024-09-13T05:10:35.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3871e-05 2024-09-13T05:10:35.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425552+0000", 2024-09-13T05:10:35.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7334999999999998e-05 2024-09-13T05:10:35.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.465972+0000", 2024-09-13T05:10:35.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040420353999999999 2024-09-13T05:10:35.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466173+0000", 2024-09-13T05:10:35.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020061600000000001 2024-09-13T05:10:35.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466394+0000", 2024-09-13T05:10:35.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00022045499999999999 2024-09-13T05:10:35.754 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.754 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.754 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.754 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11821 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 662528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.754 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.425687+0000", 2024-09-13T05:10:35.754 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.2970860010000003, 2024-09-13T05:10:35.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040854453999999998, 2024-09-13T05:10:35.754 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.754 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.754 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.755 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.755 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.755 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11821 2024-09-13T05:10:35.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.755 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425687+0000", 2024-09-13T05:10:35.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425687+0000", 2024-09-13T05:10:35.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425686+0000", 2024-09-13T05:10:35.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:35.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425692+0000", 2024-09-13T05:10:35.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2639999999999997e-06 2024-09-13T05:10:35.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425712+0000", 2024-09-13T05:10:35.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9990999999999999e-05 2024-09-13T05:10:35.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425722+0000", 2024-09-13T05:10:35.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5640000000000002e-06 2024-09-13T05:10:35.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466412+0000", 2024-09-13T05:10:35.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040690170999999997 2024-09-13T05:10:35.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466477+0000", 2024-09-13T05:10:35.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5321999999999996e-05 2024-09-13T05:10:35.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466542+0000", 2024-09-13T05:10:35.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4338999999999995e-05 2024-09-13T05:10:35.759 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.759 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.759 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.759 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11822 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 671744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.759 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.425865+0000", 2024-09-13T05:10:35.759 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.2969081649999996, 2024-09-13T05:10:35.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040811908000000001, 2024-09-13T05:10:35.759 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.759 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.759 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.760 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.760 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.760 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11822 2024-09-13T05:10:35.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.760 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425865+0000", 2024-09-13T05:10:35.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425865+0000", 2024-09-13T05:10:35.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425864+0000", 2024-09-13T05:10:35.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:35.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425870+0000", 2024-09-13T05:10:35.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3069999999999999e-06 2024-09-13T05:10:35.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425882+0000", 2024-09-13T05:10:35.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2123999999999999e-05 2024-09-13T05:10:35.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.425892+0000", 2024-09-13T05:10:35.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3330000000000003e-06 2024-09-13T05:10:35.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466568+0000", 2024-09-13T05:10:35.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040676437000000003 2024-09-13T05:10:35.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.763 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.763 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466629+0000", 2024-09-13T05:10:35.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0704e-05 2024-09-13T05:10:35.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.763 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.763 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466677+0000", 2024-09-13T05:10:35.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8186000000000002e-05 2024-09-13T05:10:35.763 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.763 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.763 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.764 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11823 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 680960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.764 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.426027+0000", 2024-09-13T05:10:35.764 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.2967465560000004, 2024-09-13T05:10:35.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040882557999999999, 2024-09-13T05:10:35.764 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.764 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.764 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.764 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.764 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.764 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11823 2024-09-13T05:10:35.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.765 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426027+0000", 2024-09-13T05:10:35.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426027+0000", 2024-09-13T05:10:35.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426025+0000", 2024-09-13T05:10:35.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:35.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426032+0000", 2024-09-13T05:10:35.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1140000000000002e-06 2024-09-13T05:10:35.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426044+0000", 2024-09-13T05:10:35.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2870999999999999e-05 2024-09-13T05:10:35.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426053+0000", 2024-09-13T05:10:35.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7620000000000001e-06 2024-09-13T05:10:35.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466711+0000", 2024-09-13T05:10:35.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040658288000000001 2024-09-13T05:10:35.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466853+0000", 2024-09-13T05:10:35.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014179500000000001 2024-09-13T05:10:35.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466909+0000", 2024-09-13T05:10:35.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5835999999999999e-05 2024-09-13T05:10:35.768 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.768 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.768 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.768 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11824 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 690176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.768 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.426201+0000", 2024-09-13T05:10:35.768 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.2965718820000003, 2024-09-13T05:10:35.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040845895, 2024-09-13T05:10:35.768 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.769 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.769 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.769 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.769 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.769 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11824 2024-09-13T05:10:35.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.769 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.769 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426201+0000", 2024-09-13T05:10:35.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426201+0000", 2024-09-13T05:10:35.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426200+0000", 2024-09-13T05:10:35.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:35.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426207+0000", 2024-09-13T05:10:35.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1199999999999996e-06 2024-09-13T05:10:35.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426228+0000", 2024-09-13T05:10:35.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1318000000000002e-05 2024-09-13T05:10:35.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426238+0000", 2024-09-13T05:10:35.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8910000000000007e-06 2024-09-13T05:10:35.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466932+0000", 2024-09-13T05:10:35.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040693952999999998 2024-09-13T05:10:35.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.466990+0000", 2024-09-13T05:10:35.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7629e-05 2024-09-13T05:10:35.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467047+0000", 2024-09-13T05:10:35.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7503999999999997e-05 2024-09-13T05:10:35.773 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.773 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.773 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.773 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11825 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 699392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.773 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.426385+0000", 2024-09-13T05:10:35.773 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.2963876269999997, 2024-09-13T05:10:35.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040800628999999998, 2024-09-13T05:10:35.773 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.773 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.774 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.774 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.774 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.774 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11825 2024-09-13T05:10:35.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.774 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426385+0000", 2024-09-13T05:10:35.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426385+0000", 2024-09-13T05:10:35.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426384+0000", 2024-09-13T05:10:35.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:35.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426391+0000", 2024-09-13T05:10:35.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8000000000000001e-06 2024-09-13T05:10:35.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426406+0000", 2024-09-13T05:10:35.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5310000000000001e-05 2024-09-13T05:10:35.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426423+0000", 2024-09-13T05:10:35.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7020999999999998e-05 2024-09-13T05:10:35.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467079+0000", 2024-09-13T05:10:35.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040656257000000001 2024-09-13T05:10:35.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467137+0000", 2024-09-13T05:10:35.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7587999999999998e-05 2024-09-13T05:10:35.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467186+0000", 2024-09-13T05:10:35.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9051999999999997e-05 2024-09-13T05:10:35.777 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.777 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.777 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.777 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11826 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 708608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.777 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.426608+0000", 2024-09-13T05:10:35.778 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.2961650090000001, 2024-09-13T05:10:35.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040734543999999998, 2024-09-13T05:10:35.778 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.778 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.778 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.778 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.778 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.778 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11826 2024-09-13T05:10:35.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.778 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426608+0000", 2024-09-13T05:10:35.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426608+0000", 2024-09-13T05:10:35.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426607+0000", 2024-09-13T05:10:35.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:35.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426615+0000", 2024-09-13T05:10:35.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8439999999999998e-06 2024-09-13T05:10:35.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426644+0000", 2024-09-13T05:10:35.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9249000000000001e-05 2024-09-13T05:10:35.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426655+0000", 2024-09-13T05:10:35.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0587e-05 2024-09-13T05:10:35.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467228+0000", 2024-09-13T05:10:35.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040573472999999999 2024-09-13T05:10:35.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467298+0000", 2024-09-13T05:10:35.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9777999999999995e-05 2024-09-13T05:10:35.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467343+0000", 2024-09-13T05:10:35.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4889999999999999e-05 2024-09-13T05:10:35.781 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.781 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.781 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.782 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11827 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 717824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.782 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.426789+0000", 2024-09-13T05:10:35.782 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.2959840890000001, 2024-09-13T05:10:35.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040701486000000002, 2024-09-13T05:10:35.782 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.782 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.782 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.782 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.782 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.782 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11827 2024-09-13T05:10:35.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.782 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426789+0000", 2024-09-13T05:10:35.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426789+0000", 2024-09-13T05:10:35.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426788+0000", 2024-09-13T05:10:35.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:35.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426794+0000", 2024-09-13T05:10:35.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2450000000000003e-06 2024-09-13T05:10:35.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426806+0000", 2024-09-13T05:10:35.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2272999999999999e-05 2024-09-13T05:10:35.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426815+0000", 2024-09-13T05:10:35.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2579999999999995e-06 2024-09-13T05:10:35.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467376+0000", 2024-09-13T05:10:35.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040561209000000001 2024-09-13T05:10:35.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467438+0000", 2024-09-13T05:10:35.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2402000000000003e-05 2024-09-13T05:10:35.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.786 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467491+0000", 2024-09-13T05:10:35.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2237000000000001e-05 2024-09-13T05:10:35.786 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.786 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.786 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.786 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11828 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 727040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.786 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.426957+0000", 2024-09-13T05:10:35.786 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.2958164810000001, 2024-09-13T05:10:35.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040663008, 2024-09-13T05:10:35.786 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.786 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.787 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.787 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.787 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.787 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11828 2024-09-13T05:10:35.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.787 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426957+0000", 2024-09-13T05:10:35.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426957+0000", 2024-09-13T05:10:35.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426956+0000", 2024-09-13T05:10:35.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:35.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426962+0000", 2024-09-13T05:10:35.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9269999999999999e-06 2024-09-13T05:10:35.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426976+0000", 2024-09-13T05:10:35.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3698e-05 2024-09-13T05:10:35.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.426985+0000", 2024-09-13T05:10:35.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9339999999999995e-06 2024-09-13T05:10:35.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467506+0000", 2024-09-13T05:10:35.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040521333 2024-09-13T05:10:35.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467573+0000", 2024-09-13T05:10:35.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6385999999999998e-05 2024-09-13T05:10:35.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467620+0000", 2024-09-13T05:10:35.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6823999999999998e-05 2024-09-13T05:10:35.790 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.790 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.790 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.790 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:11829 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 736256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.791 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.427143+0000", 2024-09-13T05:10:35.791 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.295630085, 2024-09-13T05:10:35.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040604647000000001, 2024-09-13T05:10:35.791 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.791 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.791 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.791 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.791 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.791 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 11829 2024-09-13T05:10:35.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.791 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.792 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.792 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.427143+0000", 2024-09-13T05:10:35.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.792 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.792 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.427143+0000", 2024-09-13T05:10:35.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.792 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.792 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.427142+0000", 2024-09-13T05:10:35.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:35.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.793 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.427148+0000", 2024-09-13T05:10:35.793 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4649999999999999e-06 2024-09-13T05:10:35.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.793 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.427161+0000", 2024-09-13T05:10:35.793 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2376e-05 2024-09-13T05:10:35.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.793 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.427179+0000", 2024-09-13T05:10:35.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8910999999999999e-05 2024-09-13T05:10:35.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467638+0000", 2024-09-13T05:10:35.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040458360999999998 2024-09-13T05:10:35.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467700+0000", 2024-09-13T05:10:35.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1824999999999998e-05 2024-09-13T05:10:35.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.467748+0000", 2024-09-13T05:10:35.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8034000000000001e-05 2024-09-13T05:10:35.795 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.795 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.795 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.795 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:12087 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 746496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.795 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.439201+0000", 2024-09-13T05:10:35.795 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.2835721229999999, 2024-09-13T05:10:35.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040712844999999998, 2024-09-13T05:10:35.796 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.796 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.796 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.796 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.796 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.796 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 12087 2024-09-13T05:10:35.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.796 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.796 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439201+0000", 2024-09-13T05:10:35.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439201+0000", 2024-09-13T05:10:35.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439201+0000", 2024-09-13T05:10:35.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:35.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.798 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.798 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439204+0000", 2024-09-13T05:10:35.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.134e-06 2024-09-13T05:10:35.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.798 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.798 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439211+0000", 2024-09-13T05:10:35.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7179999999999996e-06 2024-09-13T05:10:35.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.798 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.798 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439216+0000", 2024-09-13T05:10:35.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.865e-06 2024-09-13T05:10:35.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.799 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.799 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.799 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.479784+0000", 2024-09-13T05:10:35.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040567446 2024-09-13T05:10:35.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.799 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.799 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.799 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.479854+0000", 2024-09-13T05:10:35.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0145e-05 2024-09-13T05:10:35.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.479914+0000", 2024-09-13T05:10:35.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9997999999999997e-05 2024-09-13T05:10:35.800 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.800 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.800 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.800 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:12088 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 755712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.800 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.439221+0000", 2024-09-13T05:10:35.800 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.283552512, 2024-09-13T05:10:35.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040838821999999997, 2024-09-13T05:10:35.801 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.801 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.801 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.801 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.801 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.801 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 12088 2024-09-13T05:10:35.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.801 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.801 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439221+0000", 2024-09-13T05:10:35.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.802 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.802 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439221+0000", 2024-09-13T05:10:35.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.802 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.802 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.802 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439220+0000", 2024-09-13T05:10:35.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:35.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.802 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.802 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.802 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439223+0000", 2024-09-13T05:10:35.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9340000000000002e-06 2024-09-13T05:10:35.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.803 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.803 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.803 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439229+0000", 2024-09-13T05:10:35.803 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8560000000000003e-06 2024-09-13T05:10:35.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.803 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.803 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.803 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439234+0000", 2024-09-13T05:10:35.803 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.899e-06 2024-09-13T05:10:35.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.803 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.803 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.803 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.479948+0000", 2024-09-13T05:10:35.803 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040714528 2024-09-13T05:10:35.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.804 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.804 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.804 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.480009+0000", 2024-09-13T05:10:35.804 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0789999999999999e-05 2024-09-13T05:10:35.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.804 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.804 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.804 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.480059+0000", 2024-09-13T05:10:35.804 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0288999999999999e-05 2024-09-13T05:10:35.804 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.804 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.804 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.805 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:12089 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 764928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.805 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.439250+0000", 2024-09-13T05:10:35.805 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.2835226970000004, 2024-09-13T05:10:35.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040978741999999999, 2024-09-13T05:10:35.805 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.805 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.805 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.805 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.805 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.805 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 12089 2024-09-13T05:10:35.805 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.805 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.806 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.806 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439250+0000", 2024-09-13T05:10:35.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.806 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.806 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439250+0000", 2024-09-13T05:10:35.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.806 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.806 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439250+0000", 2024-09-13T05:10:35.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:35.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439253+0000", 2024-09-13T05:10:35.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0259999999999999e-06 2024-09-13T05:10:35.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439266+0000", 2024-09-13T05:10:35.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2894000000000001e-05 2024-09-13T05:10:35.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.808 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439271+0000", 2024-09-13T05:10:35.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5949999999999998e-06 2024-09-13T05:10:35.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.808 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.808 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.480079+0000", 2024-09-13T05:10:35.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040807678 2024-09-13T05:10:35.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.808 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.808 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.480150+0000", 2024-09-13T05:10:35.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0736999999999997e-05 2024-09-13T05:10:35.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.809 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.809 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.809 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.480229+0000", 2024-09-13T05:10:35.809 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9313000000000004e-05 2024-09-13T05:10:35.809 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.809 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.809 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.809 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.809 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.809 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:12090 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 774144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.809 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.439277+0000", 2024-09-13T05:10:35.809 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.2834963029999997, 2024-09-13T05:10:35.810 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.041098896000000003, 2024-09-13T05:10:35.810 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.810 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.810 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.810 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.810 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.810 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 12090 2024-09-13T05:10:35.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.810 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.810 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.810 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.810 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439277+0000", 2024-09-13T05:10:35.810 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439277+0000", 2024-09-13T05:10:35.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439276+0000", 2024-09-13T05:10:35.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:35.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439279+0000", 2024-09-13T05:10:35.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0740000000000001e-06 2024-09-13T05:10:35.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.812 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.812 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439293+0000", 2024-09-13T05:10:35.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3176000000000001e-05 2024-09-13T05:10:35.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.812 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.812 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439298+0000", 2024-09-13T05:10:35.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3210000000000004e-06 2024-09-13T05:10:35.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.480265+0000", 2024-09-13T05:10:35.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040966726000000002 2024-09-13T05:10:35.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.480324+0000", 2024-09-13T05:10:35.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9416000000000002e-05 2024-09-13T05:10:35.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.480376+0000", 2024-09-13T05:10:35.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1743000000000002e-05 2024-09-13T05:10:35.813 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.814 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.814 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.814 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:12091 3.14 3:29259516:::rbd_data.112de12546cf.0000000000000014:b [read 783360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:35.814 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:30.439303+0000", 2024-09-13T05:10:35.814 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.2834701129999999, 2024-09-13T05:10:35.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.041223893999999997, 2024-09-13T05:10:35.814 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:35.814 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:35.814 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:35.814 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:35.814 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:35.814 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 12091 2024-09-13T05:10:35.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.815 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:35.815 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.815 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:35.815 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439303+0000", 2024-09-13T05:10:35.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.815 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.815 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:35.815 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439303+0000", 2024-09-13T05:10:35.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:35.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.815 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.815 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:35.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439303+0000", 2024-09-13T05:10:35.816 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:35.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:35.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439305+0000", 2024-09-13T05:10:35.816 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8940000000000002e-06 2024-09-13T05:10:35.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:35.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439312+0000", 2024-09-13T05:10:35.816 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2210000000000002e-06 2024-09-13T05:10:35.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:35.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.439317+0000", 2024-09-13T05:10:35.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0939999999999998e-06 2024-09-13T05:10:35.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:35.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.480395+0000", 2024-09-13T05:10:35.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.041078587 2024-09-13T05:10:35.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:35.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.480469+0000", 2024-09-13T05:10:35.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3188000000000005e-05 2024-09-13T05:10:35.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:35.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:35.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:35.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:30.480527+0000", 2024-09-13T05:10:35.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8335999999999998e-05 2024-09-13T05:10:35.818 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.818 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.818 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.818 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:35.818 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:35.818 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:35.820 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:10:35.820 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:35.814+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:35.833 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone8 from 0x28c996c (overlap 0x9078b5) to 0x483c5a 2024-09-13T05:10:35.834 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 5, 6, 7] out_osds: [4, 1] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T05:10:35.834 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:10:35.835 INFO:tasks.thrashosds.thrasher:Removing osd 0, in_osds are: [0, 2, 3, 5, 6, 7] 2024-09-13T05:10:35.835 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 0 2024-09-13T05:10:35.920 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:35.914+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:35.972 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:35.973 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:35.973 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:10:35.973 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:35.983 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:10:36.021 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:36.018+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:36.087 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:36.087 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:36.087 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:36.087 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:36.087 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:36.097 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:10:36.122 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:36.119+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:36.203 INFO:tasks.ceph.mon.a.smithi120.stderr:2024-09-13T05:10:36.198+0000 7fa8b7b30700 -1 mon.a@0(leader).osd e45 definitely_dead 0 2024-09-13T05:10:36.212 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:36.212 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:36.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:36.212 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:36.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.212 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14179 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1835008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.212 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:10:36.212 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4509574660000002, 2024-09-13T05:10:36.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0924508550000001, 2024-09-13T05:10:36.212 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.212 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.213 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.213 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.213 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.213 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14179 2024-09-13T05:10:36.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.213 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:10:36.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:10:36.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757551+0000", 2024-09-13T05:10:36.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757554+0000", 2024-09-13T05:10:36.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5440000000000001e-06 2024-09-13T05:10:36.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757560+0000", 2024-09-13T05:10:36.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6840000000000001e-06 2024-09-13T05:10:36.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757564+0000", 2024-09-13T05:10:36.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3529999999999997e-06 2024-09-13T05:10:36.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814931+0000", 2024-09-13T05:10:36.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057367564000000003 2024-09-13T05:10:36.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:36.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814938+0000", 2024-09-13T05:10:36.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1070000000000001e-06 2024-09-13T05:10:36.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.849802+0000", 2024-09-13T05:10:36.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348647849999999 2024-09-13T05:10:36.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.849885+0000", 2024-09-13T05:10:36.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2859000000000001e-05 2024-09-13T05:10:36.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850003+0000", 2024-09-13T05:10:36.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117279 2024-09-13T05:10:36.218 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.218 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.218 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.218 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14180 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1844224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.218 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:10:36.218 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4509411810000001, 2024-09-13T05:10:36.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.092637853, 2024-09-13T05:10:36.218 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.218 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.218 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.219 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.219 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.219 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14180 2024-09-13T05:10:36.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.219 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:10:36.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:10:36.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:10:36.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757570+0000", 2024-09-13T05:10:36.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3470000000000001e-06 2024-09-13T05:10:36.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757576+0000", 2024-09-13T05:10:36.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5550000000000002e-06 2024-09-13T05:10:36.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757580+0000", 2024-09-13T05:10:36.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6519999999999997e-06 2024-09-13T05:10:36.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814975+0000", 2024-09-13T05:10:36.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057394349999999997 2024-09-13T05:10:36.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:36.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814981+0000", 2024-09-13T05:10:36.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4119999999999998e-06 2024-09-13T05:10:36.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850042+0000", 2024-09-13T05:10:36.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0350611759999999 2024-09-13T05:10:36.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850103+0000", 2024-09-13T05:10:36.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0618000000000001e-05 2024-09-13T05:10:36.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850206+0000", 2024-09-13T05:10:36.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010309199999999999 2024-09-13T05:10:36.223 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.223 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.224 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.224 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14196 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1991680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.224 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:10:36.224 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4471420950000002, 2024-09-13T05:10:36.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0925442910000001, 2024-09-13T05:10:36.224 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.224 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.224 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.224 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.225 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.225 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14196 2024-09-13T05:10:36.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.225 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:10:36.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:10:36.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:10:36.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761368+0000", 2024-09-13T05:10:36.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3689999999999999e-06 2024-09-13T05:10:36.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761373+0000", 2024-09-13T05:10:36.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7180000000000004e-06 2024-09-13T05:10:36.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761376+0000", 2024-09-13T05:10:36.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0860000000000002e-06 2024-09-13T05:10:36.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815501+0000", 2024-09-13T05:10:36.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054125508000000003 2024-09-13T05:10:36.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:36.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815508+0000", 2024-09-13T05:10:36.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5570000000000001e-06 2024-09-13T05:10:36.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853689+0000", 2024-09-13T05:10:36.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0381811919999999 2024-09-13T05:10:36.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853764+0000", 2024-09-13T05:10:36.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4893000000000003e-05 2024-09-13T05:10:36.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853911+0000", 2024-09-13T05:10:36.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014721100000000001 2024-09-13T05:10:36.229 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.229 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.229 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.230 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14197 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2000896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.230 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:10:36.230 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4471308509999998, 2024-09-13T05:10:36.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.092841977, 2024-09-13T05:10:36.230 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.230 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.230 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.230 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.231 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.231 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14197 2024-09-13T05:10:36.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.231 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:10:36.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:10:36.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:10:36.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761403+0000", 2024-09-13T05:10:36.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5199e-05 2024-09-13T05:10:36.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761411+0000", 2024-09-13T05:10:36.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4540000000000001e-06 2024-09-13T05:10:36.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761418+0000", 2024-09-13T05:10:36.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9569999999999996e-06 2024-09-13T05:10:36.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815531+0000", 2024-09-13T05:10:36.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054113599999999998 2024-09-13T05:10:36.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:36.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815539+0000", 2024-09-13T05:10:36.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.481e-06 2024-09-13T05:10:36.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853949+0000", 2024-09-13T05:10:36.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.038410356 2024-09-13T05:10:36.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854022+0000", 2024-09-13T05:10:36.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2807999999999998e-05 2024-09-13T05:10:36.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854220+0000", 2024-09-13T05:10:36.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000198364 2024-09-13T05:10:36.235 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.235 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.235 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.235 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14198 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2010112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.235 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:10:36.236 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.447085843, 2024-09-13T05:10:36.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093063787, 2024-09-13T05:10:36.236 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.236 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.236 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.236 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.236 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.236 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14198 2024-09-13T05:10:36.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.236 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:10:36.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:10:36.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:10:36.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761426+0000", 2024-09-13T05:10:36.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8789999999999999e-06 2024-09-13T05:10:36.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761432+0000", 2024-09-13T05:10:36.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1399999999999997e-06 2024-09-13T05:10:36.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761437+0000", 2024-09-13T05:10:36.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8579999999999999e-06 2024-09-13T05:10:36.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815563+0000", 2024-09-13T05:10:36.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054125877000000003 2024-09-13T05:10:36.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:36.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815570+0000", 2024-09-13T05:10:36.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1169999999999998e-06 2024-09-13T05:10:36.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854265+0000", 2024-09-13T05:10:36.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0386955659999999 2024-09-13T05:10:36.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854338+0000", 2024-09-13T05:10:36.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2537e-05 2024-09-13T05:10:36.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854487+0000", 2024-09-13T05:10:36.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014927899999999999 2024-09-13T05:10:36.241 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.241 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.241 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.242 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14199 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.242 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:10:36.242 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4470669699999998, 2024-09-13T05:10:36.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0933252389999999, 2024-09-13T05:10:36.242 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.242 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.242 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.242 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.242 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.242 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14199 2024-09-13T05:10:36.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.242 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:10:36.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:10:36.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:10:36.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761445+0000", 2024-09-13T05:10:36.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7779999999999999e-06 2024-09-13T05:10:36.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761450+0000", 2024-09-13T05:10:36.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6350000000000003e-06 2024-09-13T05:10:36.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761455+0000", 2024-09-13T05:10:36.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9930000000000003e-06 2024-09-13T05:10:36.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815600+0000", 2024-09-13T05:10:36.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054144982000000001 2024-09-13T05:10:36.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:36.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815607+0000", 2024-09-13T05:10:36.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4749999999999998e-06 2024-09-13T05:10:36.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854527+0000", 2024-09-13T05:10:36.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.038920037 2024-09-13T05:10:36.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854637+0000", 2024-09-13T05:10:36.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011021700000000001 2024-09-13T05:10:36.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854767+0000", 2024-09-13T05:10:36.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130512 2024-09-13T05:10:36.246 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.246 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.247 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.247 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14200 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2028544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.247 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:10:36.247 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4470484570000002, 2024-09-13T05:10:36.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093541554, 2024-09-13T05:10:36.247 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.247 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.247 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.247 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.247 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.247 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14200 2024-09-13T05:10:36.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.247 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:10:36.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:10:36.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761460+0000", 2024-09-13T05:10:36.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761462+0000", 2024-09-13T05:10:36.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9659999999999999e-06 2024-09-13T05:10:36.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761466+0000", 2024-09-13T05:10:36.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6109999999999998e-06 2024-09-13T05:10:36.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761471+0000", 2024-09-13T05:10:36.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1019999999999996e-06 2024-09-13T05:10:36.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815631+0000", 2024-09-13T05:10:36.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054159680000000002 2024-09-13T05:10:36.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:36.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815637+0000", 2024-09-13T05:10:36.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-09-13T05:10:36.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854810+0000", 2024-09-13T05:10:36.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0391731930000001 2024-09-13T05:10:36.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854883+0000", 2024-09-13T05:10:36.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3109999999999996e-05 2024-09-13T05:10:36.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855002+0000", 2024-09-13T05:10:36.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011934600000000001 2024-09-13T05:10:36.253 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.253 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.253 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.253 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14201 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2037760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.253 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:10:36.253 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4470340269999999, 2024-09-13T05:10:36.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0937543320000001, 2024-09-13T05:10:36.253 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.253 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.253 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.254 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.254 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.254 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14201 2024-09-13T05:10:36.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.254 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:10:36.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:10:36.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:10:36.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761477+0000", 2024-09-13T05:10:36.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5620000000000002e-06 2024-09-13T05:10:36.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761483+0000", 2024-09-13T05:10:36.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7400000000000001e-06 2024-09-13T05:10:36.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761487+0000", 2024-09-13T05:10:36.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8130000000000002e-06 2024-09-13T05:10:36.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815697+0000", 2024-09-13T05:10:36.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054210253 2024-09-13T05:10:36.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:36.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815705+0000", 2024-09-13T05:10:36.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7049999999999999e-06 2024-09-13T05:10:36.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855036+0000", 2024-09-13T05:10:36.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.039330799 2024-09-13T05:10:36.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855110+0000", 2024-09-13T05:10:36.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4498000000000004e-05 2024-09-13T05:10:36.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855229+0000", 2024-09-13T05:10:36.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119282 2024-09-13T05:10:36.258 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.258 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.258 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.258 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14202 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.258 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:10:36.258 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4469693699999997, 2024-09-13T05:10:36.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093934027, 2024-09-13T05:10:36.258 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.259 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.259 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.259 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.259 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.259 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14202 2024-09-13T05:10:36.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.259 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:10:36.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:10:36.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761489+0000", 2024-09-13T05:10:36.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999495 2024-09-13T05:10:36.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761543+0000", 2024-09-13T05:10:36.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3983999999999997e-05 2024-09-13T05:10:36.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761552+0000", 2024-09-13T05:10:36.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-13T05:10:36.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761559+0000", 2024-09-13T05:10:36.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7710000000000001e-06 2024-09-13T05:10:36.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815742+0000", 2024-09-13T05:10:36.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054183488000000002 2024-09-13T05:10:36.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:36.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815749+0000", 2024-09-13T05:10:36.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1609999999999997e-06 2024-09-13T05:10:36.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855283+0000", 2024-09-13T05:10:36.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0395336230000001 2024-09-13T05:10:36.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855354+0000", 2024-09-13T05:10:36.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1456000000000002e-05 2024-09-13T05:10:36.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855474+0000", 2024-09-13T05:10:36.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119429 2024-09-13T05:10:36.265 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.265 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.265 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.265 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14294 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2113536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.265 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:10:36.265 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4434184559999998, 2024-09-13T05:10:36.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0923650330000001, 2024-09-13T05:10:36.265 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.265 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.265 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.265 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.266 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.266 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14294 2024-09-13T05:10:36.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.266 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:10:36.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:10:36.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765090+0000", 2024-09-13T05:10:36.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:36.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765092+0000", 2024-09-13T05:10:36.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.542e-06 2024-09-13T05:10:36.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765096+0000", 2024-09-13T05:10:36.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6179999999999999e-06 2024-09-13T05:10:36.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765098+0000", 2024-09-13T05:10:36.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8049999999999998e-06 2024-09-13T05:10:36.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816384+0000", 2024-09-13T05:10:36.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051285338999999999 2024-09-13T05:10:36.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:36.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816393+0000", 2024-09-13T05:10:36.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-09-13T05:10:36.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857258+0000", 2024-09-13T05:10:36.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0408652549999999 2024-09-13T05:10:36.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857327+0000", 2024-09-13T05:10:36.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8714000000000007e-05 2024-09-13T05:10:36.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857456+0000", 2024-09-13T05:10:36.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012909299999999999 2024-09-13T05:10:36.271 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.271 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.271 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.271 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14295 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2122752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.271 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:10:36.271 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4434086979999998, 2024-09-13T05:10:36.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0928006969999999, 2024-09-13T05:10:36.271 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.271 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.271 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.271 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.272 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.272 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14295 2024-09-13T05:10:36.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.272 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:10:36.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:10:36.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:10:36.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:36.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765102+0000", 2024-09-13T05:10:36.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3990000000000001e-06 2024-09-13T05:10:36.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765104+0000", 2024-09-13T05:10:36.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:10:36.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765107+0000", 2024-09-13T05:10:36.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.582e-06 2024-09-13T05:10:36.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816432+0000", 2024-09-13T05:10:36.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051325118000000003 2024-09-13T05:10:36.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:36.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816440+0000", 2024-09-13T05:10:36.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4679999999999992e-06 2024-09-13T05:10:36.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857495+0000", 2024-09-13T05:10:36.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.041054216 2024-09-13T05:10:36.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857644+0000", 2024-09-13T05:10:36.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014909400000000001 2024-09-13T05:10:36.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857901+0000", 2024-09-13T05:10:36.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025746200000000002 2024-09-13T05:10:36.276 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.276 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.276 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.277 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14296 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2131968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.277 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:10:36.277 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4434004519999997, 2024-09-13T05:10:36.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093120361, 2024-09-13T05:10:36.277 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.277 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.277 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.277 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.277 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.277 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14296 2024-09-13T05:10:36.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.278 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:10:36.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:10:36.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765108+0000", 2024-09-13T05:10:36.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:36.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765110+0000", 2024-09-13T05:10:36.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.226e-06 2024-09-13T05:10:36.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765112+0000", 2024-09-13T05:10:36.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6769999999999999e-06 2024-09-13T05:10:36.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765115+0000", 2024-09-13T05:10:36.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.712e-06 2024-09-13T05:10:36.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816479+0000", 2024-09-13T05:10:36.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051364102000000002 2024-09-13T05:10:36.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:36.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816503+0000", 2024-09-13T05:10:36.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3723999999999999e-05 2024-09-13T05:10:36.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857929+0000", 2024-09-13T05:10:36.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0414263180000001 2024-09-13T05:10:36.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858015+0000", 2024-09-13T05:10:36.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5730999999999996e-05 2024-09-13T05:10:36.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858229+0000", 2024-09-13T05:10:36.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021408700000000001 2024-09-13T05:10:36.283 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.283 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.283 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.283 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14297 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2141184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.283 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:10:36.283 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4433921070000002, 2024-09-13T05:10:36.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0936699510000001, 2024-09-13T05:10:36.283 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.283 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.283 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.283 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.283 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.284 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14297 2024-09-13T05:10:36.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.284 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:10:36.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:10:36.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:10:36.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:36.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765118+0000", 2024-09-13T05:10:36.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4190000000000001e-06 2024-09-13T05:10:36.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765121+0000", 2024-09-13T05:10:36.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6110000000000001e-06 2024-09-13T05:10:36.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765124+0000", 2024-09-13T05:10:36.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3720000000000001e-06 2024-09-13T05:10:36.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816535+0000", 2024-09-13T05:10:36.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051410890000000001 2024-09-13T05:10:36.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:36.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816556+0000", 2024-09-13T05:10:36.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0551e-05 2024-09-13T05:10:36.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858552+0000", 2024-09-13T05:10:36.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0419965529999999 2024-09-13T05:10:36.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858640+0000", 2024-09-13T05:10:36.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7907999999999999e-05 2024-09-13T05:10:36.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858787+0000", 2024-09-13T05:10:36.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000146864 2024-09-13T05:10:36.288 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.289 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.289 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.289 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14298 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2150400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.289 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:10:36.289 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4433827140000002, 2024-09-13T05:10:36.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0938958759999999, 2024-09-13T05:10:36.289 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.289 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.289 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.289 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.289 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.290 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14298 2024-09-13T05:10:36.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.290 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:10:36.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:10:36.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:10:36.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:36.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765128+0000", 2024-09-13T05:10:36.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4139999999999999e-06 2024-09-13T05:10:36.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765130+0000", 2024-09-13T05:10:36.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6809999999999998e-06 2024-09-13T05:10:36.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765133+0000", 2024-09-13T05:10:36.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9270000000000001e-06 2024-09-13T05:10:36.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816592+0000", 2024-09-13T05:10:36.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051459029000000003 2024-09-13T05:10:36.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:36.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816601+0000", 2024-09-13T05:10:36.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9819999999999997e-06 2024-09-13T05:10:36.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858818+0000", 2024-09-13T05:10:36.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0422167170000001 2024-09-13T05:10:36.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858896+0000", 2024-09-13T05:10:36.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8128999999999997e-05 2024-09-13T05:10:36.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859022+0000", 2024-09-13T05:10:36.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012619899999999999 2024-09-13T05:10:36.294 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.294 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.295 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.295 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14299 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2168832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.295 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:10:36.295 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4433739499999998, 2024-09-13T05:10:36.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0941207909999999, 2024-09-13T05:10:36.295 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.295 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.296 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14299 2024-09-13T05:10:36.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.296 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:10:36.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:10:36.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:10:36.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:36.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765136+0000", 2024-09-13T05:10:36.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5230000000000001e-06 2024-09-13T05:10:36.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765139+0000", 2024-09-13T05:10:36.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.672e-06 2024-09-13T05:10:36.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765142+0000", 2024-09-13T05:10:36.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6680000000000001e-06 2024-09-13T05:10:36.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816632+0000", 2024-09-13T05:10:36.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051489886999999998 2024-09-13T05:10:36.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:36.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816643+0000", 2024-09-13T05:10:36.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1457000000000001e-05 2024-09-13T05:10:36.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859061+0000", 2024-09-13T05:10:36.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.042417616 2024-09-13T05:10:36.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859138+0000", 2024-09-13T05:10:36.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7077999999999996e-05 2024-09-13T05:10:36.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859256+0000", 2024-09-13T05:10:36.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118108 2024-09-13T05:10:36.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.300 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.300 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14300 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2159616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.300 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:10:36.300 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.44336514, 2024-09-13T05:10:36.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0943386719999999, 2024-09-13T05:10:36.300 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.301 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.301 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14300 2024-09-13T05:10:36.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.301 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:10:36.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:10:36.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:10:36.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:36.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765145+0000", 2024-09-13T05:10:36.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.488e-06 2024-09-13T05:10:36.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765148+0000", 2024-09-13T05:10:36.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6620000000000001e-06 2024-09-13T05:10:36.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765151+0000", 2024-09-13T05:10:36.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6419999999999999e-06 2024-09-13T05:10:36.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816677+0000", 2024-09-13T05:10:36.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051526776000000003 2024-09-13T05:10:36.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:36.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816689+0000", 2024-09-13T05:10:36.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1634000000000001e-05 2024-09-13T05:10:36.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859296+0000", 2024-09-13T05:10:36.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0426066009999999 2024-09-13T05:10:36.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859364+0000", 2024-09-13T05:10:36.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8745999999999995e-05 2024-09-13T05:10:36.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859483+0000", 2024-09-13T05:10:36.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011833900000000001 2024-09-13T05:10:36.306 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.306 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.306 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.306 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14301 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2178048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.306 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:10:36.307 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4433565059999998, 2024-09-13T05:10:36.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0946233009999999, 2024-09-13T05:10:36.307 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.307 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.307 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.307 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.307 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.307 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14301 2024-09-13T05:10:36.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.307 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:10:36.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:10:36.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765152+0000", 2024-09-13T05:10:36.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:36.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765154+0000", 2024-09-13T05:10:36.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.449e-06 2024-09-13T05:10:36.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765157+0000", 2024-09-13T05:10:36.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6809999999999998e-06 2024-09-13T05:10:36.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765159+0000", 2024-09-13T05:10:36.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6060000000000001e-06 2024-09-13T05:10:36.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816722+0000", 2024-09-13T05:10:36.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051562535 2024-09-13T05:10:36.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:36.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816733+0000", 2024-09-13T05:10:36.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1678000000000001e-05 2024-09-13T05:10:36.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859521+0000", 2024-09-13T05:10:36.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0427879440000001 2024-09-13T05:10:36.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859655+0000", 2024-09-13T05:10:36.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134053 2024-09-13T05:10:36.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859776+0000", 2024-09-13T05:10:36.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012058299999999999 2024-09-13T05:10:36.311 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.311 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.311 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.311 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14302 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2187264~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.312 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:10:36.312 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4433479289999998, 2024-09-13T05:10:36.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.094937383, 2024-09-13T05:10:36.312 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.312 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.312 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14302 2024-09-13T05:10:36.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.312 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:10:36.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:10:36.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:10:36.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:36.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765162+0000", 2024-09-13T05:10:36.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4589999999999999e-06 2024-09-13T05:10:36.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765165+0000", 2024-09-13T05:10:36.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6019999999999998e-06 2024-09-13T05:10:36.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765168+0000", 2024-09-13T05:10:36.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.497e-06 2024-09-13T05:10:36.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816764+0000", 2024-09-13T05:10:36.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051596722999999997 2024-09-13T05:10:36.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:36.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816776+0000", 2024-09-13T05:10:36.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1967000000000001e-05 2024-09-13T05:10:36.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859810+0000", 2024-09-13T05:10:36.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0430338299999999 2024-09-13T05:10:36.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859901+0000", 2024-09-13T05:10:36.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1397999999999995e-05 2024-09-13T05:10:36.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860099+0000", 2024-09-13T05:10:36.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000197133 2024-09-13T05:10:36.317 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.317 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.317 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.318 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14303 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2196480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.318 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:10:36.318 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4433395920000001, 2024-09-13T05:10:36.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.095199152, 2024-09-13T05:10:36.318 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.318 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.318 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14303 2024-09-13T05:10:36.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.318 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:10:36.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:10:36.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765169+0000", 2024-09-13T05:10:36.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765171+0000", 2024-09-13T05:10:36.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2899999999999999e-06 2024-09-13T05:10:36.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765173+0000", 2024-09-13T05:10:36.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-13T05:10:36.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765176+0000", 2024-09-13T05:10:36.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.016e-06 2024-09-13T05:10:36.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816811+0000", 2024-09-13T05:10:36.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051634684 2024-09-13T05:10:36.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:36.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816840+0000", 2024-09-13T05:10:36.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8690000000000001e-05 2024-09-13T05:10:36.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860135+0000", 2024-09-13T05:10:36.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0432951029999999 2024-09-13T05:10:36.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860255+0000", 2024-09-13T05:10:36.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119936 2024-09-13T05:10:36.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860369+0000", 2024-09-13T05:10:36.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113978 2024-09-13T05:10:36.322 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.323 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.323 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.323 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14304 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2205696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.323 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:10:36.323 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4433167239999998, 2024-09-13T05:10:36.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0955512999999999, 2024-09-13T05:10:36.324 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.324 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.324 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.324 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.324 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.324 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14304 2024-09-13T05:10:36.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.324 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:10:36.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:10:36.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:10:36.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765195+0000", 2024-09-13T05:10:36.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6599999999999999e-06 2024-09-13T05:10:36.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765200+0000", 2024-09-13T05:10:36.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.356e-06 2024-09-13T05:10:36.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765205+0000", 2024-09-13T05:10:36.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3000000000000001e-06 2024-09-13T05:10:36.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816901+0000", 2024-09-13T05:10:36.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051695451000000003 2024-09-13T05:10:36.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:36.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816963+0000", 2024-09-13T05:10:36.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2694000000000007e-05 2024-09-13T05:10:36.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860434+0000", 2024-09-13T05:10:36.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.04347053 2024-09-13T05:10:36.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860592+0000", 2024-09-13T05:10:36.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015854199999999999 2024-09-13T05:10:36.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860744+0000", 2024-09-13T05:10:36.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015133 2024-09-13T05:10:36.329 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.329 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.329 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.329 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.329 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.329 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:36.330 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:10:36.331 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:36.326+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:36.411 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #7, image image_client.0-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent8 2024-09-13T05:10:36.431 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:36.427+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:36.485 INFO:teuthology.orchestra.run.smithi120.stdout:1135 read 0xed00e4 thru 0xed3720 (0x363d bytes) 2024-09-13T05:10:36.497 INFO:teuthology.orchestra.run.smithi120.stdout:1136 trunc from 0x28c996c to 0xa84ff5 2024-09-13T05:10:36.502 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:36.502 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:36.502 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:10:36.502 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:36.515 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:10:36.531 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:36.526+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:36.633 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:36.631+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:36.657 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:36.658 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:36.658 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:36.658 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:36.658 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:36.671 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:10:36.734 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:36.730+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:36.815 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:36.815 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:36.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:36.815 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:36.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.816 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10634 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 731136~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.816 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:10:36.816 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.4106076859999996, 2024-09-13T05:10:36.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028136992999999999, 2024-09-13T05:10:36.816 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.816 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.816 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.816 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.816 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.816 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10634 2024-09-13T05:10:36.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.816 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:10:36.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:10:36.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:10:36.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401987+0000", 2024-09-13T05:10:36.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5090000000000001e-06 2024-09-13T05:10:36.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401997+0000", 2024-09-13T05:10:36.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8009999999999998e-06 2024-09-13T05:10:36.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402000+0000", 2024-09-13T05:10:36.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.756e-06 2024-09-13T05:10:36.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430035+0000", 2024-09-13T05:10:36.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028034967000000001 2024-09-13T05:10:36.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430081+0000", 2024-09-13T05:10:36.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6448e-05 2024-09-13T05:10:36.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430123+0000", 2024-09-13T05:10:36.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1758000000000002e-05 2024-09-13T05:10:36.820 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.820 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.820 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.820 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10635 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 740352~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.820 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:10:36.820 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.4105910719999999, 2024-09-13T05:10:36.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028229890000000001, 2024-09-13T05:10:36.820 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.820 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.820 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.821 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10635 2024-09-13T05:10:36.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.821 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:10:36.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:10:36.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402002+0000", 2024-09-13T05:10:36.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402004+0000", 2024-09-13T05:10:36.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.575e-06 2024-09-13T05:10:36.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402007+0000", 2024-09-13T05:10:36.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1240000000000001e-06 2024-09-13T05:10:36.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402010+0000", 2024-09-13T05:10:36.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5859999999999999e-06 2024-09-13T05:10:36.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430146+0000", 2024-09-13T05:10:36.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028136746000000001 2024-09-13T05:10:36.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430195+0000", 2024-09-13T05:10:36.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8948e-05 2024-09-13T05:10:36.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430232+0000", 2024-09-13T05:10:36.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7159000000000001e-05 2024-09-13T05:10:36.824 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.824 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.824 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.824 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10636 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 749568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.824 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:10:36.825 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.4105819659999996, 2024-09-13T05:10:36.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328440999999999, 2024-09-13T05:10:36.825 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.825 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.825 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10636 2024-09-13T05:10:36.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.825 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:10:36.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:10:36.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402011+0000", 2024-09-13T05:10:36.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:36.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402017+0000", 2024-09-13T05:10:36.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5620000000000003e-06 2024-09-13T05:10:36.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402020+0000", 2024-09-13T05:10:36.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1410000000000001e-06 2024-09-13T05:10:36.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402024+0000", 2024-09-13T05:10:36.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4489999999999999e-06 2024-09-13T05:10:36.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430256+0000", 2024-09-13T05:10:36.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028232363 2024-09-13T05:10:36.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430299+0000", 2024-09-13T05:10:36.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2830999999999997e-05 2024-09-13T05:10:36.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430340+0000", 2024-09-13T05:10:36.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1301000000000003e-05 2024-09-13T05:10:36.828 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.828 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.829 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.829 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10637 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 758784~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.829 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:10:36.829 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.4105668529999997, 2024-09-13T05:10:36.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028441793, 2024-09-13T05:10:36.829 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.829 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.829 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.829 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.829 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.829 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10637 2024-09-13T05:10:36.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.830 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:10:36.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:10:36.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:10:36.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:36.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402031+0000", 2024-09-13T05:10:36.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6770000000000003e-06 2024-09-13T05:10:36.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402034+0000", 2024-09-13T05:10:36.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1540000000000002e-06 2024-09-13T05:10:36.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402038+0000", 2024-09-13T05:10:36.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4970000000000001e-06 2024-09-13T05:10:36.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430367+0000", 2024-09-13T05:10:36.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328906000000001 2024-09-13T05:10:36.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430416+0000", 2024-09-13T05:10:36.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:10:36.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430469+0000", 2024-09-13T05:10:36.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2284999999999998e-05 2024-09-13T05:10:36.834 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.834 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.834 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.834 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10638 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 768000~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.834 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:10:36.834 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.4105533689999996, 2024-09-13T05:10:36.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028548740999999999, 2024-09-13T05:10:36.834 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.834 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.835 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10638 2024-09-13T05:10:36.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.835 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:10:36.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:10:36.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:10:36.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402041+0000", 2024-09-13T05:10:36.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4789999999999999e-06 2024-09-13T05:10:36.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402044+0000", 2024-09-13T05:10:36.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.694e-06 2024-09-13T05:10:36.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402047+0000", 2024-09-13T05:10:36.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.537e-06 2024-09-13T05:10:36.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430494+0000", 2024-09-13T05:10:36.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028447665 2024-09-13T05:10:36.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430544+0000", 2024-09-13T05:10:36.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9539000000000001e-05 2024-09-13T05:10:36.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430589+0000", 2024-09-13T05:10:36.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5071999999999998e-05 2024-09-13T05:10:36.838 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.838 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.838 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.838 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10639 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 777216~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.838 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:10:36.838 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.4105429879999996, 2024-09-13T05:10:36.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028651769000000001, 2024-09-13T05:10:36.839 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.839 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.839 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.839 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.839 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.839 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10639 2024-09-13T05:10:36.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.839 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:10:36.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:10:36.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402050+0000", 2024-09-13T05:10:36.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402052+0000", 2024-09-13T05:10:36.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2249999999999999e-06 2024-09-13T05:10:36.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402054+0000", 2024-09-13T05:10:36.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8140000000000001e-06 2024-09-13T05:10:36.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402057+0000", 2024-09-13T05:10:36.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4889999999999998e-06 2024-09-13T05:10:36.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430607+0000", 2024-09-13T05:10:36.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028549896000000002 2024-09-13T05:10:36.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430651+0000", 2024-09-13T05:10:36.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4622000000000001e-05 2024-09-13T05:10:36.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430702+0000", 2024-09-13T05:10:36.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0980999999999999e-05 2024-09-13T05:10:36.842 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.842 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.843 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.843 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11151 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 779264~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.843 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:10:36.843 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.3807717070000001, 2024-09-13T05:10:36.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028283188000000001, 2024-09-13T05:10:36.843 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.843 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.843 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.843 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.843 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.843 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11151 2024-09-13T05:10:36.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.844 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:10:36.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:10:36.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:10:36.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431827+0000", 2024-09-13T05:10:36.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0989999999999998e-06 2024-09-13T05:10:36.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431832+0000", 2024-09-13T05:10:36.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8829999999999997e-06 2024-09-13T05:10:36.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431835+0000", 2024-09-13T05:10:36.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.439e-06 2024-09-13T05:10:36.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.459955+0000", 2024-09-13T05:10:36.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028119858000000001 2024-09-13T05:10:36.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.460029+0000", 2024-09-13T05:10:36.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4264000000000006e-05 2024-09-13T05:10:36.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.460105+0000", 2024-09-13T05:10:36.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5906000000000001e-05 2024-09-13T05:10:36.847 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.847 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.847 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.847 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11897 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 579584~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.847 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:10:36.847 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.331622533, 2024-09-13T05:10:36.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028193354, 2024-09-13T05:10:36.848 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.848 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.848 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11897 2024-09-13T05:10:36.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.848 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:10:36.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:10:36.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:10:36.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480973+0000", 2024-09-13T05:10:36.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.934e-06 2024-09-13T05:10:36.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480976+0000", 2024-09-13T05:10:36.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.614e-06 2024-09-13T05:10:36.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480980+0000", 2024-09-13T05:10:36.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.377e-06 2024-09-13T05:10:36.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.508967+0000", 2024-09-13T05:10:36.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027987455000000001 2024-09-13T05:10:36.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509074+0000", 2024-09-13T05:10:36.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107379 2024-09-13T05:10:36.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509164+0000", 2024-09-13T05:10:36.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9979e-05 2024-09-13T05:10:36.851 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.851 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.852 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.852 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11898 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 588800~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.852 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:10:36.852 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.3316104690000001, 2024-09-13T05:10:36.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028308628999999998, 2024-09-13T05:10:36.852 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.852 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.852 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.852 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.852 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.852 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11898 2024-09-13T05:10:36.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.853 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:10:36.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:10:36.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:10:36.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480984+0000", 2024-09-13T05:10:36.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:10:36.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480988+0000", 2024-09-13T05:10:36.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4640000000000002e-06 2024-09-13T05:10:36.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480991+0000", 2024-09-13T05:10:36.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3469999999999999e-06 2024-09-13T05:10:36.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509199+0000", 2024-09-13T05:10:36.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028207449999999998 2024-09-13T05:10:36.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509250+0000", 2024-09-13T05:10:36.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1375000000000002e-05 2024-09-13T05:10:36.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509292+0000", 2024-09-13T05:10:36.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1730000000000002e-05 2024-09-13T05:10:36.856 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.856 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.856 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.856 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11899 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 598016~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.856 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:10:36.856 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.3315996280000002, 2024-09-13T05:10:36.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516703000000001, 2024-09-13T05:10:36.857 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.857 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.857 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11899 2024-09-13T05:10:36.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.857 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:10:36.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:10:36.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:10:36.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480995+0000", 2024-09-13T05:10:36.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7349999999999999e-06 2024-09-13T05:10:36.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481000+0000", 2024-09-13T05:10:36.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0289999999999996e-06 2024-09-13T05:10:36.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481004+0000", 2024-09-13T05:10:36.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3699999999999999e-06 2024-09-13T05:10:36.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509332+0000", 2024-09-13T05:10:36.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328320000000001 2024-09-13T05:10:36.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509428+0000", 2024-09-13T05:10:36.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6150999999999995e-05 2024-09-13T05:10:36.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509511+0000", 2024-09-13T05:10:36.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2396000000000002e-05 2024-09-13T05:10:36.860 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.861 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.861 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.861 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11900 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 607232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.861 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:10:36.861 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.3315870390000004, 2024-09-13T05:10:36.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028621273999999999, 2024-09-13T05:10:36.861 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.861 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.861 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.861 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.861 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.861 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11900 2024-09-13T05:10:36.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.862 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:10:36.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:10:36.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481006+0000", 2024-09-13T05:10:36.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481008+0000", 2024-09-13T05:10:36.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.73e-06 2024-09-13T05:10:36.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481011+0000", 2024-09-13T05:10:36.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4000000000000001e-06 2024-09-13T05:10:36.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481015+0000", 2024-09-13T05:10:36.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2760000000000001e-06 2024-09-13T05:10:36.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509531+0000", 2024-09-13T05:10:36.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516102000000002 2024-09-13T05:10:36.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509588+0000", 2024-09-13T05:10:36.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7423999999999998e-05 2024-09-13T05:10:36.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509628+0000", 2024-09-13T05:10:36.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9644000000000002e-05 2024-09-13T05:10:36.865 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.865 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.865 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.865 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11901 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 616448~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.865 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:10:36.865 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.331576418, 2024-09-13T05:10:36.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028820500999999998, 2024-09-13T05:10:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11901 2024-09-13T05:10:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:10:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:10:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:10:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481022+0000", 2024-09-13T05:10:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0209999999999999e-06 2024-09-13T05:10:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481026+0000", 2024-09-13T05:10:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:10:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481029+0000", 2024-09-13T05:10:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.636e-06 2024-09-13T05:10:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509661+0000", 2024-09-13T05:10:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028631496999999999 2024-09-13T05:10:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509757+0000", 2024-09-13T05:10:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5780999999999997e-05 2024-09-13T05:10:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509838+0000", 2024-09-13T05:10:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1102999999999999e-05 2024-09-13T05:10:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11902 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 625664~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:10:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.3315545560000004, 2024-09-13T05:10:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028894265999999998, 2024-09-13T05:10:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11902 2024-09-13T05:10:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:10:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:10:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:10:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481041+0000", 2024-09-13T05:10:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8020000000000001e-06 2024-09-13T05:10:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481044+0000", 2024-09-13T05:10:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7110000000000001e-06 2024-09-13T05:10:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481048+0000", 2024-09-13T05:10:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.411e-06 2024-09-13T05:10:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509851+0000", 2024-09-13T05:10:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028803295 2024-09-13T05:10:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509896+0000", 2024-09-13T05:10:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4963000000000003e-05 2024-09-13T05:10:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509933+0000", 2024-09-13T05:10:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7384e-05 2024-09-13T05:10:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11903 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 634880~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:10:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.3315433199999998, 2024-09-13T05:10:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029118033000000001, 2024-09-13T05:10:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11903 2024-09-13T05:10:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:10:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:10:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:10:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481052+0000", 2024-09-13T05:10:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.581e-06 2024-09-13T05:10:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481055+0000", 2024-09-13T05:10:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4520000000000002e-06 2024-09-13T05:10:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481058+0000", 2024-09-13T05:10:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4599999999999999e-06 2024-09-13T05:10:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509967+0000", 2024-09-13T05:10:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028908257999999999 2024-09-13T05:10:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510062+0000", 2024-09-13T05:10:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5613999999999996e-05 2024-09-13T05:10:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510168+0000", 2024-09-13T05:10:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105951 2024-09-13T05:10:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11904 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 644096~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:10:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.3315324249999998, 2024-09-13T05:10:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029301971, 2024-09-13T05:10:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11904 2024-09-13T05:10:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:10:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:10:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:10:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481063+0000", 2024-09-13T05:10:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6700000000000001e-06 2024-09-13T05:10:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481068+0000", 2024-09-13T05:10:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4519999999999996e-06 2024-09-13T05:10:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481074+0000", 2024-09-13T05:10:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8370000000000002e-06 2024-09-13T05:10:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510197+0000", 2024-09-13T05:10:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029123237999999999 2024-09-13T05:10:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510285+0000", 2024-09-13T05:10:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7676000000000006e-05 2024-09-13T05:10:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510363+0000", 2024-09-13T05:10:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8418999999999996e-05 2024-09-13T05:10:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11905 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 653312~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:10:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.3315166850000004, 2024-09-13T05:10:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029480164, 2024-09-13T05:10:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11905 2024-09-13T05:10:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:10:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:10:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481076+0000", 2024-09-13T05:10:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481079+0000", 2024-09-13T05:10:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9629999999999998e-06 2024-09-13T05:10:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481087+0000", 2024-09-13T05:10:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6369999999999999e-06 2024-09-13T05:10:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481093+0000", 2024-09-13T05:10:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.857e-06 2024-09-13T05:10:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510408+0000", 2024-09-13T05:10:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029315213 2024-09-13T05:10:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510501+0000", 2024-09-13T05:10:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2916000000000003e-05 2024-09-13T05:10:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510557+0000", 2024-09-13T05:10:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6063999999999997e-05 2024-09-13T05:10:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11906 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 662528~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:10:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.3314746719999997, 2024-09-13T05:10:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029575054999999999, 2024-09-13T05:10:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11906 2024-09-13T05:10:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:10:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:10:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481118+0000", 2024-09-13T05:10:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481122+0000", 2024-09-13T05:10:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2610000000000002e-06 2024-09-13T05:10:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481129+0000", 2024-09-13T05:10:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0079999999999996e-06 2024-09-13T05:10:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481135+0000", 2024-09-13T05:10:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0599999999999996e-06 2024-09-13T05:10:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510575+0000", 2024-09-13T05:10:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029440470999999999 2024-09-13T05:10:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510635+0000", 2024-09-13T05:10:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0177000000000003e-05 2024-09-13T05:10:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510694+0000", 2024-09-13T05:10:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8675999999999999e-05 2024-09-13T05:10:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11907 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 671744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:10:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.3312138769999997, 2024-09-13T05:10:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029479490000000001, 2024-09-13T05:10:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11907 2024-09-13T05:10:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:10:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:10:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481140+0000", 2024-09-13T05:10:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997597 2024-09-13T05:10:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481383+0000", 2024-09-13T05:10:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024355399999999999 2024-09-13T05:10:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481390+0000", 2024-09-13T05:10:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3599999999999998e-06 2024-09-13T05:10:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481395+0000", 2024-09-13T05:10:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8940000000000001e-06 2024-09-13T05:10:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510722+0000", 2024-09-13T05:10:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029327143999999999 2024-09-13T05:10:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510802+0000", 2024-09-13T05:10:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9770000000000004e-05 2024-09-13T05:10:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510859+0000", 2024-09-13T05:10:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6957999999999999e-05 2024-09-13T05:10:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11908 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 680960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:10:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.3311939639999997, 2024-09-13T05:10:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029617622, 2024-09-13T05:10:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11908 2024-09-13T05:10:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:10:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:10:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481399+0000", 2024-09-13T05:10:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481401+0000", 2024-09-13T05:10:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8729999999999999e-06 2024-09-13T05:10:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481413+0000", 2024-09-13T05:10:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1748e-05 2024-09-13T05:10:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481417+0000", 2024-09-13T05:10:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:10:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510908+0000", 2024-09-13T05:10:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029491129000000001 2024-09-13T05:10:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510955+0000", 2024-09-13T05:10:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7188000000000003e-05 2024-09-13T05:10:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511017+0000", 2024-09-13T05:10:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2288999999999999e-05 2024-09-13T05:10:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11909 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 690176~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:10:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.331173637, 2024-09-13T05:10:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029780699000000001, 2024-09-13T05:10:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11909 2024-09-13T05:10:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:10:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:10:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481419+0000", 2024-09-13T05:10:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481421+0000", 2024-09-13T05:10:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.035e-06 2024-09-13T05:10:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481427+0000", 2024-09-13T05:10:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2449999999999998e-06 2024-09-13T05:10:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481430+0000", 2024-09-13T05:10:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.366e-06 2024-09-13T05:10:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511064+0000", 2024-09-13T05:10:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029633711 2024-09-13T05:10:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511160+0000", 2024-09-13T05:10:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6399999999999999e-05 2024-09-13T05:10:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511201+0000", 2024-09-13T05:10:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0448000000000003e-05 2024-09-13T05:10:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:36.906 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:36.906 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:36.906 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:10:36.907 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:36.903+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:36.908 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:10:36.909 INFO:teuthology.orchestra.run.smithi120.stderr:marked out osd.0. 2024-09-13T05:10:37.008 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:37.003+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:37.076 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:37.076 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:37.076 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:10:37.076 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:37.089 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:10:37.090 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:10:37.109 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:37.107+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:37.112 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:10:37.133 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:10:37.156 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:10:37.179 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:10:37.190 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:37.191 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:37.200 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:10:37.203 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:10:37.226 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:10:37.226 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:37.222+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:37.302 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:37.303 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:37.310 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:37.307+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:37.312 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:10:37.411 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:37.407+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:37.462 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:37.462 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:37.472 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:10:37.512 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:37.507+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:37.573 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:37.573 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:37.582 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:10:37.612 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:37.606+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:37.633 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T05:10:37.685 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:37.685 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:37.695 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:10:37.713 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:37.706+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:37.810 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:37.810 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:37.813 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:37.811+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:37.820 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:10:37.902 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:10:37.907 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:10:37.907 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:10:37.907 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:10:37.907 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:10:37.907 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:10:37.908 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:10:37.908 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:10:37.908 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:10:37.914 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:37.911+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:37.973 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:37.973 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:37.987 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:10:38.030 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:38.030 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:38.030 INFO:teuthology.orchestra.run.smithi120.stdout:1139 punch from 0x50a641 to 0x51a1b3, (0xfb72 bytes) 2024-09-13T05:10:38.033 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:38.031+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:38.044 INFO:teuthology.orchestra.run.smithi120.stdout:1141 trunc from 0xa84ff5 to 0x7cb1a70 2024-09-13T05:10:38.074 INFO:teuthology.orchestra.run.smithi120.stdout:1142 write 0xe51e946 thru 0xe52357c (0x4c37 bytes) 2024-09-13T05:10:38.079 INFO:teuthology.orchestra.run.smithi120.stdout:1143 write 0x1d11d94 thru 0x1d1b939 (0x9ba6 bytes) 2024-09-13T05:10:38.082 INFO:teuthology.orchestra.run.smithi120.stdout:1144 write 0x59a13e9 thru 0x59a76f0 (0x6308 bytes) 2024-09-13T05:10:38.085 INFO:teuthology.orchestra.run.smithi120.stdout:1145 punch from 0x7c4dbd2 to 0x7c5430c, (0x673a bytes) 2024-09-13T05:10:38.095 INFO:teuthology.orchestra.run.smithi120.stdout:1149 write 0xe70de78 thru 0xe71c50b (0xe694 bytes) 2024-09-13T05:10:38.101 INFO:teuthology.orchestra.run.smithi120.stdout:1151 writesame 0xcae93b thru 0xcb01b7 data_size 0x1(0x187d bytes) 2024-09-13T05:10:38.111 INFO:teuthology.orchestra.run.smithi120.stdout:1153 read 0x2c19b46 thru 0x2c216d2 (0x7b8d bytes) 2024-09-13T05:10:38.111 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:38.111 INFO:teuthology.orchestra.run.smithi120.stdout:1155 write 0xa023cac thru 0xa030f3c (0xd291 bytes) 2024-09-13T05:10:38.114 INFO:teuthology.orchestra.run.smithi120.stdout:1156 punch from 0x9f0432b to 0x9f056ba, (0x138f bytes) 2024-09-13T05:10:38.114 INFO:teuthology.orchestra.run.smithi120.stdout:1157 writesame 0xb42766d thru 0xb42c11f data_size 0x1(0x4ab3 bytes) 2024-09-13T05:10:38.115 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:38.110+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:38.132 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:38.132 INFO:teuthology.orchestra.run.smithi120.stdout:1160 read 0x5dc9942 thru 0x5dd57ef (0xbeae bytes) 2024-09-13T05:10:38.133 INFO:teuthology.orchestra.run.smithi120.stdout:1162 write 0x796a255 thru 0x7977b49 (0xd8f5 bytes) 2024-09-13T05:10:38.140 INFO:teuthology.orchestra.run.smithi120.stdout:1163 read 0xa6698ac thru 0xa66df7a (0x46cf bytes) 2024-09-13T05:10:38.141 INFO:teuthology.orchestra.run.smithi120.stdout:1166 read 0xe20cdb7 thru 0xe21bf27 (0xf171 bytes) 2024-09-13T05:10:38.141 INFO:teuthology.orchestra.run.smithi120.stdout:1167 writesame 0xe099dc thru 0xe15d50 data_size 0xd(0xc375 bytes) 2024-09-13T05:10:38.151 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:38.151 INFO:teuthology.orchestra.run.smithi120.stdout:1173 write 0x388e0ad thru 0x38982b8 (0xa20c bytes) 2024-09-13T05:10:38.152 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:38.152 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:38.154 INFO:teuthology.orchestra.run.smithi120.stdout:1174 writesame 0x9d20fd5 thru 0x9d21e3c data_size 0x4(0xe68 bytes) 2024-09-13T05:10:38.163 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:10:38.169 INFO:teuthology.orchestra.run.smithi120.stdout:1175 write 0xea708d7 thru 0xea76881 (0x5fab bytes) 2024-09-13T05:10:38.172 INFO:teuthology.orchestra.run.smithi120.stdout:1176 read 0x2ecfb12 thru 0x2ed6d15 (0x7204 bytes) 2024-09-13T05:10:38.173 INFO:teuthology.orchestra.run.smithi120.stdout:1178 write 0x4ae23f8 thru 0x4ae930f (0x6f18 bytes) 2024-09-13T05:10:38.176 INFO:teuthology.orchestra.run.smithi120.stdout:1179 read 0xaaac4ff thru 0xaaba70d (0xe20f bytes) 2024-09-13T05:10:38.177 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:38.177 INFO:teuthology.orchestra.run.smithi120.stdout:1181 punch from 0xa63a0ae to 0xa644c17, (0xab69 bytes) 2024-09-13T05:10:38.177 INFO:teuthology.orchestra.run.smithi120.stdout:1183 writesame 0x6669814 thru 0x6675ac8 data_size 0x5(0xc2b5 bytes) 2024-09-13T05:10:38.185 INFO:teuthology.orchestra.run.smithi120.stdout:1186 read 0x54e531f thru 0x54f07e8 (0xb4ca bytes) 2024-09-13T05:10:38.186 INFO:teuthology.orchestra.run.smithi120.stdout:1187 writesame 0xbd7e7d thru 0xbe3bcd data_size 0x2d(0xbd51 bytes) 2024-09-13T05:10:38.189 INFO:teuthology.orchestra.run.smithi120.stdout:1188 read 0x86920fb thru 0x86a1918 (0xf81e bytes) 2024-09-13T05:10:38.190 INFO:teuthology.orchestra.run.smithi120.stdout:1189 punch from 0x3ca8199 to 0x3caf171, (0x6fd8 bytes) 2024-09-13T05:10:38.192 INFO:teuthology.orchestra.run.smithi120.stdout:1190 trunc from 0xea76882 to 0xddea541 2024-09-13T05:10:38.206 INFO:teuthology.orchestra.run.smithi120.stdout:1191 read 0x4a835c4 thru 0x4a8580f (0x224c bytes) 2024-09-13T05:10:38.206 INFO:teuthology.orchestra.run.smithi120.stdout:1192 writesame 0x698bd2c thru 0x699850d data_size 0xaa(0xc7e2 bytes) 2024-09-13T05:10:38.209 INFO:teuthology.orchestra.run.smithi120.stdout:1193 read 0x3abd9f9 thru 0x3aca3b4 (0xc9bc bytes) 2024-09-13T05:10:38.217 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:38.211+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:38.222 INFO:teuthology.orchestra.run.smithi120.stdout:1194 writesame 0xe529da0 thru 0xe536afc data_size 0x1(0xcd5d bytes) 2024-09-13T05:10:38.236 INFO:teuthology.orchestra.run.smithi120.stdout:1195 write 0xead5c33 thru 0xeae2b13 (0xcee1 bytes) 2024-09-13T05:10:38.240 INFO:teuthology.orchestra.run.smithi120.stdout:1196 write 0xc38082b thru 0xc387c68 (0x743e bytes) 2024-09-13T05:10:38.243 INFO:teuthology.orchestra.run.smithi120.stdout:1197 writesame 0x4c11434 thru 0x4c1a4df data_size 0x2f(0x90ac bytes) 2024-09-13T05:10:38.269 INFO:teuthology.orchestra.run.smithi120.stdout:1198 trunc from 0xeae2b14 to 0x4d05e51 2024-09-13T05:10:38.274 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:38.274 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:38.286 INFO:teuthology.orchestra.run.smithi120.stdout:1199 clone 10 order 24 su 262144 sc 11 2024-09-13T05:10:38.289 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:10:38.333 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:38.331+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:38.387 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:38.387 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:38.397 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:10:38.418 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:38.415+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:38.506 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:38.506 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:38.517 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:10:38.519 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:38.518+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:38.621 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:38.615+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:38.673 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:38.673 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:38.683 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:10:38.722 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:38.718+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:38.823 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:38.822+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:38.834 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:38.835 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:38.844 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:10:38.870 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is unset 2024-09-13T05:10:38.931 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:38.926+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:38.966 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:38.966 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:38.977 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:10:39.024 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:39.018+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:39.082 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:39.083 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:39.089 INFO:teuthology.orchestra.run.smithi120.stdout:flattening image image_client.0-clone9 2024-09-13T05:10:39.093 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:10:39.126 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:39.122+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:39.197 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:39.197 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:39.214 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:10:39.227 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:39.223+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:39.320 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:39.320 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:39.328 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:39.322+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:39.330 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:10:39.352 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #8, image image_client.0-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent9 2024-09-13T05:10:39.430 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:39.427+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:39.451 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:39.451 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:39.461 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:10:39.530 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:39.527+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:39.631 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:39.631 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:39.631 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:39.627+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:39.641 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:10:39.732 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:39.726+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:39.753 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:39.753 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:39.763 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:10:39.834 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:39.831+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:39.920 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:10:39.923 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:39.923 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:39.933 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:10:39.935 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:39.930+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:40.036 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:40.030+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:40.043 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:40.044 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:40.053 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:10:40.060 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:10:40.091 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:10:40.112 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:10:40.133 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:10:40.136 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:40.130+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:40.157 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:10:40.161 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:40.161 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:40.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:40.161 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:40.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.161 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10634 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 731136~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:40.161 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:10:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.7568394010000006, 2024-09-13T05:10:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028136992999999999, 2024-09-13T05:10:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10634 2024-09-13T05:10:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:10:40.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:10:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:10:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401987+0000", 2024-09-13T05:10:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5090000000000001e-06 2024-09-13T05:10:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401997+0000", 2024-09-13T05:10:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8009999999999998e-06 2024-09-13T05:10:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402000+0000", 2024-09-13T05:10:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.756e-06 2024-09-13T05:10:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430035+0000", 2024-09-13T05:10:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028034967000000001 2024-09-13T05:10:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430081+0000", 2024-09-13T05:10:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6448e-05 2024-09-13T05:10:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430123+0000", 2024-09-13T05:10:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1758000000000002e-05 2024-09-13T05:10:40.165 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10635 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 740352~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:10:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.7568227870000008, 2024-09-13T05:10:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028229890000000001, 2024-09-13T05:10:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.166 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10635 2024-09-13T05:10:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:10:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:10:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402002+0000", 2024-09-13T05:10:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402004+0000", 2024-09-13T05:10:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.575e-06 2024-09-13T05:10:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402007+0000", 2024-09-13T05:10:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1240000000000001e-06 2024-09-13T05:10:40.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402010+0000", 2024-09-13T05:10:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5859999999999999e-06 2024-09-13T05:10:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430146+0000", 2024-09-13T05:10:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028136746000000001 2024-09-13T05:10:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430195+0000", 2024-09-13T05:10:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8948e-05 2024-09-13T05:10:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430232+0000", 2024-09-13T05:10:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7159000000000001e-05 2024-09-13T05:10:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10636 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 749568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:10:40.170 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.7568136810000006, 2024-09-13T05:10:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328440999999999, 2024-09-13T05:10:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10636 2024-09-13T05:10:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:10:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:10:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402011+0000", 2024-09-13T05:10:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402017+0000", 2024-09-13T05:10:40.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5620000000000003e-06 2024-09-13T05:10:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402020+0000", 2024-09-13T05:10:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1410000000000001e-06 2024-09-13T05:10:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402024+0000", 2024-09-13T05:10:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4489999999999999e-06 2024-09-13T05:10:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430256+0000", 2024-09-13T05:10:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028232363 2024-09-13T05:10:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430299+0000", 2024-09-13T05:10:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2830999999999997e-05 2024-09-13T05:10:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430340+0000", 2024-09-13T05:10:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1301000000000003e-05 2024-09-13T05:10:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.174 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10637 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 758784~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:10:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.7567985680000007, 2024-09-13T05:10:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028441793, 2024-09-13T05:10:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10637 2024-09-13T05:10:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:10:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:10:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:10:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402031+0000", 2024-09-13T05:10:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6770000000000003e-06 2024-09-13T05:10:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402034+0000", 2024-09-13T05:10:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1540000000000002e-06 2024-09-13T05:10:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402038+0000", 2024-09-13T05:10:40.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4970000000000001e-06 2024-09-13T05:10:40.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430367+0000", 2024-09-13T05:10:40.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328906000000001 2024-09-13T05:10:40.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430416+0000", 2024-09-13T05:10:40.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:10:40.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430469+0000", 2024-09-13T05:10:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2284999999999998e-05 2024-09-13T05:10:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10638 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 768000~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:10:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.7567850840000006, 2024-09-13T05:10:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028548740999999999, 2024-09-13T05:10:40.179 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10638 2024-09-13T05:10:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:10:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:10:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:10:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402041+0000", 2024-09-13T05:10:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4789999999999999e-06 2024-09-13T05:10:40.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402044+0000", 2024-09-13T05:10:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.694e-06 2024-09-13T05:10:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402047+0000", 2024-09-13T05:10:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.537e-06 2024-09-13T05:10:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430494+0000", 2024-09-13T05:10:40.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028447665 2024-09-13T05:10:40.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430544+0000", 2024-09-13T05:10:40.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9539000000000001e-05 2024-09-13T05:10:40.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430589+0000", 2024-09-13T05:10:40.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5071999999999998e-05 2024-09-13T05:10:40.183 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.183 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.183 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.184 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10639 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 777216~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:40.184 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:10:40.184 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.7567747029999996, 2024-09-13T05:10:40.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028651769000000001, 2024-09-13T05:10:40.184 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.184 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.184 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.184 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.184 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.184 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10639 2024-09-13T05:10:40.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.184 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:10:40.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:10:40.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402050+0000", 2024-09-13T05:10:40.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402052+0000", 2024-09-13T05:10:40.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2249999999999999e-06 2024-09-13T05:10:40.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402054+0000", 2024-09-13T05:10:40.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8140000000000001e-06 2024-09-13T05:10:40.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402057+0000", 2024-09-13T05:10:40.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4889999999999998e-06 2024-09-13T05:10:40.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430607+0000", 2024-09-13T05:10:40.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028549896000000002 2024-09-13T05:10:40.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430651+0000", 2024-09-13T05:10:40.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4622000000000001e-05 2024-09-13T05:10:40.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430702+0000", 2024-09-13T05:10:40.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0980999999999999e-05 2024-09-13T05:10:40.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.188 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.188 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11151 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 779264~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:40.188 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:10:40.188 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.7270034219999992, 2024-09-13T05:10:40.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028283188000000001, 2024-09-13T05:10:40.188 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.188 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.188 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.189 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11151 2024-09-13T05:10:40.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.189 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:10:40.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:10:40.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:10:40.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431827+0000", 2024-09-13T05:10:40.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0989999999999998e-06 2024-09-13T05:10:40.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431832+0000", 2024-09-13T05:10:40.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8829999999999997e-06 2024-09-13T05:10:40.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431835+0000", 2024-09-13T05:10:40.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.439e-06 2024-09-13T05:10:40.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.459955+0000", 2024-09-13T05:10:40.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028119858000000001 2024-09-13T05:10:40.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.460029+0000", 2024-09-13T05:10:40.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4264000000000006e-05 2024-09-13T05:10:40.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.460105+0000", 2024-09-13T05:10:40.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5906000000000001e-05 2024-09-13T05:10:40.192 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.192 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.192 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.193 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11897 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 579584~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:40.193 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:10:40.193 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6778542479999992, 2024-09-13T05:10:40.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028193354, 2024-09-13T05:10:40.193 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.193 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.193 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.193 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.193 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.193 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11897 2024-09-13T05:10:40.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.193 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:10:40.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:10:40.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:10:40.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480973+0000", 2024-09-13T05:10:40.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.934e-06 2024-09-13T05:10:40.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480976+0000", 2024-09-13T05:10:40.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.614e-06 2024-09-13T05:10:40.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480980+0000", 2024-09-13T05:10:40.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.377e-06 2024-09-13T05:10:40.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.508967+0000", 2024-09-13T05:10:40.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027987455000000001 2024-09-13T05:10:40.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509074+0000", 2024-09-13T05:10:40.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107379 2024-09-13T05:10:40.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509164+0000", 2024-09-13T05:10:40.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9979e-05 2024-09-13T05:10:40.197 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.197 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.197 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.197 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11898 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 588800~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:40.197 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:10:40.197 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6778421839999993, 2024-09-13T05:10:40.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028308628999999998, 2024-09-13T05:10:40.198 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.198 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.198 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.198 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.198 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.198 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11898 2024-09-13T05:10:40.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.198 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:10:40.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:10:40.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:10:40.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480984+0000", 2024-09-13T05:10:40.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:10:40.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480988+0000", 2024-09-13T05:10:40.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4640000000000002e-06 2024-09-13T05:10:40.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480991+0000", 2024-09-13T05:10:40.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3469999999999999e-06 2024-09-13T05:10:40.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509199+0000", 2024-09-13T05:10:40.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028207449999999998 2024-09-13T05:10:40.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509250+0000", 2024-09-13T05:10:40.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1375000000000002e-05 2024-09-13T05:10:40.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509292+0000", 2024-09-13T05:10:40.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1730000000000002e-05 2024-09-13T05:10:40.201 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.201 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.202 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.202 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11899 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 598016~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:40.202 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:10:40.202 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6778313429999994, 2024-09-13T05:10:40.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516703000000001, 2024-09-13T05:10:40.202 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.202 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.202 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.202 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.202 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.202 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11899 2024-09-13T05:10:40.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.203 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:10:40.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:10:40.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:10:40.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480995+0000", 2024-09-13T05:10:40.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7349999999999999e-06 2024-09-13T05:10:40.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481000+0000", 2024-09-13T05:10:40.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0289999999999996e-06 2024-09-13T05:10:40.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481004+0000", 2024-09-13T05:10:40.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3699999999999999e-06 2024-09-13T05:10:40.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509332+0000", 2024-09-13T05:10:40.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328320000000001 2024-09-13T05:10:40.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509428+0000", 2024-09-13T05:10:40.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6150999999999995e-05 2024-09-13T05:10:40.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509511+0000", 2024-09-13T05:10:40.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2396000000000002e-05 2024-09-13T05:10:40.206 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.206 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.206 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.206 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11900 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 607232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:40.206 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:10:40.206 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6778187540000005, 2024-09-13T05:10:40.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028621273999999999, 2024-09-13T05:10:40.207 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.207 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.207 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.207 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.207 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.207 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11900 2024-09-13T05:10:40.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.207 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:10:40.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:10:40.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481006+0000", 2024-09-13T05:10:40.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481008+0000", 2024-09-13T05:10:40.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.73e-06 2024-09-13T05:10:40.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481011+0000", 2024-09-13T05:10:40.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4000000000000001e-06 2024-09-13T05:10:40.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481015+0000", 2024-09-13T05:10:40.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2760000000000001e-06 2024-09-13T05:10:40.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509531+0000", 2024-09-13T05:10:40.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516102000000002 2024-09-13T05:10:40.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509588+0000", 2024-09-13T05:10:40.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7423999999999998e-05 2024-09-13T05:10:40.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509628+0000", 2024-09-13T05:10:40.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9644000000000002e-05 2024-09-13T05:10:40.210 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.210 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.210 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.211 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11901 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 616448~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:40.211 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:10:40.211 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6778081329999992, 2024-09-13T05:10:40.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028820500999999998, 2024-09-13T05:10:40.211 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.211 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.211 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.211 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.211 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.211 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11901 2024-09-13T05:10:40.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.212 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:10:40.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:10:40.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:10:40.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481022+0000", 2024-09-13T05:10:40.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0209999999999999e-06 2024-09-13T05:10:40.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481026+0000", 2024-09-13T05:10:40.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:10:40.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481029+0000", 2024-09-13T05:10:40.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.636e-06 2024-09-13T05:10:40.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509661+0000", 2024-09-13T05:10:40.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028631496999999999 2024-09-13T05:10:40.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509757+0000", 2024-09-13T05:10:40.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5780999999999997e-05 2024-09-13T05:10:40.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509838+0000", 2024-09-13T05:10:40.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1102999999999999e-05 2024-09-13T05:10:40.215 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.215 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.215 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.215 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11902 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 625664~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:40.215 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:10:40.215 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6777862710000004, 2024-09-13T05:10:40.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028894265999999998, 2024-09-13T05:10:40.215 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.215 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.215 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.216 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.216 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.216 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11902 2024-09-13T05:10:40.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.216 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:10:40.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:10:40.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:10:40.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481041+0000", 2024-09-13T05:10:40.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8020000000000001e-06 2024-09-13T05:10:40.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481044+0000", 2024-09-13T05:10:40.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7110000000000001e-06 2024-09-13T05:10:40.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481048+0000", 2024-09-13T05:10:40.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.411e-06 2024-09-13T05:10:40.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509851+0000", 2024-09-13T05:10:40.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028803295 2024-09-13T05:10:40.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509896+0000", 2024-09-13T05:10:40.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4963000000000003e-05 2024-09-13T05:10:40.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509933+0000", 2024-09-13T05:10:40.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7384e-05 2024-09-13T05:10:40.219 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.219 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.219 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.219 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11903 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 634880~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:40.220 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:10:40.220 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6777750349999998, 2024-09-13T05:10:40.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029118033000000001, 2024-09-13T05:10:40.220 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.220 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.220 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11903 2024-09-13T05:10:40.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.220 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:10:40.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:10:40.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:10:40.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481052+0000", 2024-09-13T05:10:40.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.581e-06 2024-09-13T05:10:40.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481055+0000", 2024-09-13T05:10:40.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4520000000000002e-06 2024-09-13T05:10:40.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481058+0000", 2024-09-13T05:10:40.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4599999999999999e-06 2024-09-13T05:10:40.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509967+0000", 2024-09-13T05:10:40.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028908257999999999 2024-09-13T05:10:40.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510062+0000", 2024-09-13T05:10:40.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5613999999999996e-05 2024-09-13T05:10:40.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510168+0000", 2024-09-13T05:10:40.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105951 2024-09-13T05:10:40.224 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.224 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.224 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.224 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11904 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 644096~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:40.224 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:10:40.224 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6777641400000007, 2024-09-13T05:10:40.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029301971, 2024-09-13T05:10:40.224 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.224 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.224 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.224 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.225 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.225 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11904 2024-09-13T05:10:40.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.225 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:10:40.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:10:40.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:10:40.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481063+0000", 2024-09-13T05:10:40.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6700000000000001e-06 2024-09-13T05:10:40.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481068+0000", 2024-09-13T05:10:40.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4519999999999996e-06 2024-09-13T05:10:40.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481074+0000", 2024-09-13T05:10:40.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8370000000000002e-06 2024-09-13T05:10:40.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510197+0000", 2024-09-13T05:10:40.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029123237999999999 2024-09-13T05:10:40.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510285+0000", 2024-09-13T05:10:40.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7676000000000006e-05 2024-09-13T05:10:40.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510363+0000", 2024-09-13T05:10:40.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8418999999999996e-05 2024-09-13T05:10:40.228 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.228 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.228 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.228 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11905 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 653312~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:40.228 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:10:40.228 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6777484000000005, 2024-09-13T05:10:40.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029480164, 2024-09-13T05:10:40.229 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.229 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.229 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.229 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.229 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.229 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11905 2024-09-13T05:10:40.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.229 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:10:40.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:10:40.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481076+0000", 2024-09-13T05:10:40.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481079+0000", 2024-09-13T05:10:40.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9629999999999998e-06 2024-09-13T05:10:40.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481087+0000", 2024-09-13T05:10:40.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6369999999999999e-06 2024-09-13T05:10:40.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481093+0000", 2024-09-13T05:10:40.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.857e-06 2024-09-13T05:10:40.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510408+0000", 2024-09-13T05:10:40.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029315213 2024-09-13T05:10:40.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510501+0000", 2024-09-13T05:10:40.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2916000000000003e-05 2024-09-13T05:10:40.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510557+0000", 2024-09-13T05:10:40.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6063999999999997e-05 2024-09-13T05:10:40.233 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.233 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.233 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.233 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11906 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 662528~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:40.233 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:10:40.233 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6777063870000006, 2024-09-13T05:10:40.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029575054999999999, 2024-09-13T05:10:40.233 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.234 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.234 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.234 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.234 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.234 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11906 2024-09-13T05:10:40.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.234 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:10:40.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:10:40.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481118+0000", 2024-09-13T05:10:40.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481122+0000", 2024-09-13T05:10:40.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2610000000000002e-06 2024-09-13T05:10:40.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481129+0000", 2024-09-13T05:10:40.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0079999999999996e-06 2024-09-13T05:10:40.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481135+0000", 2024-09-13T05:10:40.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0599999999999996e-06 2024-09-13T05:10:40.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510575+0000", 2024-09-13T05:10:40.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029440470999999999 2024-09-13T05:10:40.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510635+0000", 2024-09-13T05:10:40.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0177000000000003e-05 2024-09-13T05:10:40.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510694+0000", 2024-09-13T05:10:40.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8675999999999999e-05 2024-09-13T05:10:40.237 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.237 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.237 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.238 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11907 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 671744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:40.238 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:10:40.238 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6774455919999998, 2024-09-13T05:10:40.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029479490000000001, 2024-09-13T05:10:40.238 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.238 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.238 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.238 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.238 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.238 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11907 2024-09-13T05:10:40.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.239 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:10:40.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:10:40.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481140+0000", 2024-09-13T05:10:40.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997597 2024-09-13T05:10:40.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481383+0000", 2024-09-13T05:10:40.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024355399999999999 2024-09-13T05:10:40.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481390+0000", 2024-09-13T05:10:40.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3599999999999998e-06 2024-09-13T05:10:40.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481395+0000", 2024-09-13T05:10:40.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8940000000000001e-06 2024-09-13T05:10:40.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510722+0000", 2024-09-13T05:10:40.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029327143999999999 2024-09-13T05:10:40.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510802+0000", 2024-09-13T05:10:40.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9770000000000004e-05 2024-09-13T05:10:40.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510859+0000", 2024-09-13T05:10:40.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6957999999999999e-05 2024-09-13T05:10:40.242 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.242 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.242 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.242 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11908 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 680960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:40.242 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:10:40.242 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6774256790000006, 2024-09-13T05:10:40.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029617622, 2024-09-13T05:10:40.243 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.243 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.243 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.243 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.243 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.243 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11908 2024-09-13T05:10:40.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.243 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:10:40.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:10:40.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481399+0000", 2024-09-13T05:10:40.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481401+0000", 2024-09-13T05:10:40.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8729999999999999e-06 2024-09-13T05:10:40.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481413+0000", 2024-09-13T05:10:40.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1748e-05 2024-09-13T05:10:40.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481417+0000", 2024-09-13T05:10:40.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:10:40.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510908+0000", 2024-09-13T05:10:40.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029491129000000001 2024-09-13T05:10:40.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510955+0000", 2024-09-13T05:10:40.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7188000000000003e-05 2024-09-13T05:10:40.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511017+0000", 2024-09-13T05:10:40.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2288999999999999e-05 2024-09-13T05:10:40.246 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.246 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.246 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.247 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11909 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 690176~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:40.247 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:10:40.247 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6774053519999992, 2024-09-13T05:10:40.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029780699000000001, 2024-09-13T05:10:40.247 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.247 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.247 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.247 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.247 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.247 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11909 2024-09-13T05:10:40.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.248 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:10:40.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:10:40.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481419+0000", 2024-09-13T05:10:40.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481421+0000", 2024-09-13T05:10:40.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.035e-06 2024-09-13T05:10:40.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481427+0000", 2024-09-13T05:10:40.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2449999999999998e-06 2024-09-13T05:10:40.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481430+0000", 2024-09-13T05:10:40.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.366e-06 2024-09-13T05:10:40.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511064+0000", 2024-09-13T05:10:40.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029633711 2024-09-13T05:10:40.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511160+0000", 2024-09-13T05:10:40.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6399999999999999e-05 2024-09-13T05:10:40.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511201+0000", 2024-09-13T05:10:40.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0448000000000003e-05 2024-09-13T05:10:40.251 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.251 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.251 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.251 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.251 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.251 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:40.253 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:10:40.253 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:10:40.253 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:10:40.254 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:40.247+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:40.354 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:40.350+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:40.366 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:10:40.366 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:40.375 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:10:40.454 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:40.451+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:40.479 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:40.480 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:40.480 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:40.480 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:40.480 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:40.489 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:10:40.555 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:40.551+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:40.593 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:40.593 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26335 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1207296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:10:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.8607911270000002, 2024-09-13T05:10:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055338125000000002, 2024-09-13T05:10:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.594 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26335 2024-09-13T05:10:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:10:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:10:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730550+0000", 2024-09-13T05:10:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998579 2024-09-13T05:10:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730705+0000", 2024-09-13T05:10:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015463400000000001 2024-09-13T05:10:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730713+0000", 2024-09-13T05:10:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1580000000000005e-06 2024-09-13T05:10:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730719+0000", 2024-09-13T05:10:40.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2740000000000004e-06 2024-09-13T05:10:40.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.785798+0000", 2024-09-13T05:10:40.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055079454 2024-09-13T05:10:40.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.785894+0000", 2024-09-13T05:10:40.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5896000000000005e-05 2024-09-13T05:10:40.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.786030+0000", 2024-09-13T05:10:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013586199999999999 2024-09-13T05:10:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26346 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1308672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:10:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.8586497199999998, 2024-09-13T05:10:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055416737000000001, 2024-09-13T05:10:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.598 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26346 2024-09-13T05:10:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:10:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:10:40.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732833+0000", 2024-09-13T05:10:40.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732835+0000", 2024-09-13T05:10:40.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3719999999999999e-06 2024-09-13T05:10:40.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732839+0000", 2024-09-13T05:10:40.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1520000000000001e-06 2024-09-13T05:10:40.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732842+0000", 2024-09-13T05:10:40.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.061e-06 2024-09-13T05:10:40.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788126+0000", 2024-09-13T05:10:40.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055284489999999999 2024-09-13T05:10:40.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788183+0000", 2024-09-13T05:10:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7127999999999999e-05 2024-09-13T05:10:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788250+0000", 2024-09-13T05:10:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7001000000000004e-05 2024-09-13T05:10:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.602 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26348 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 800768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:10:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.8582268960000001, 2024-09-13T05:10:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055321395000000002, 2024-09-13T05:10:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26348 2024-09-13T05:10:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:10:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:10:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733127+0000", 2024-09-13T05:10:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998703 2024-09-13T05:10:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733262+0000", 2024-09-13T05:10:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013484400000000001 2024-09-13T05:10:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733273+0000", 2024-09-13T05:10:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1824000000000001e-05 2024-09-13T05:10:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733281+0000", 2024-09-13T05:10:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9999999999999996e-06 2024-09-13T05:10:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788431+0000", 2024-09-13T05:10:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055149535 2024-09-13T05:10:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788490+0000", 2024-09-13T05:10:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9413999999999997e-05 2024-09-13T05:10:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788578+0000", 2024-09-13T05:10:40.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7418999999999998e-05 2024-09-13T05:10:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26368 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 985088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:10:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.8540746989999999, 2024-09-13T05:10:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055320511000000003, 2024-09-13T05:10:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.607 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26368 2024-09-13T05:10:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:10:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:10:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737408+0000", 2024-09-13T05:10:40.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737412+0000", 2024-09-13T05:10:40.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6279999999999998e-06 2024-09-13T05:10:40.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737419+0000", 2024-09-13T05:10:40.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1770000000000001e-06 2024-09-13T05:10:40.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737425+0000", 2024-09-13T05:10:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6949999999999997e-06 2024-09-13T05:10:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792507+0000", 2024-09-13T05:10:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055082840000000001 2024-09-13T05:10:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792606+0000", 2024-09-13T05:10:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8697999999999996e-05 2024-09-13T05:10:40.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792729+0000", 2024-09-13T05:10:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012298499999999999 2024-09-13T05:10:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26417 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 903168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:10:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.8500144389999997, 2024-09-13T05:10:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055375191999999997, 2024-09-13T05:10:40.611 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26417 2024-09-13T05:10:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:10:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:10:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741468+0000", 2024-09-13T05:10:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741472+0000", 2024-09-13T05:10:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4139999999999998e-06 2024-09-13T05:10:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741478+0000", 2024-09-13T05:10:40.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5230000000000001e-06 2024-09-13T05:10:40.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741483+0000", 2024-09-13T05:10:40.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8559999999999998e-06 2024-09-13T05:10:40.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796655+0000", 2024-09-13T05:10:40.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055172153000000002 2024-09-13T05:10:40.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796738+0000", 2024-09-13T05:10:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2912999999999997e-05 2024-09-13T05:10:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796844+0000", 2024-09-13T05:10:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105802 2024-09-13T05:10:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.615 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26419 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 912384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:40.616 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:10:40.616 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.849990574, 2024-09-13T05:10:40.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055570469999999997, 2024-09-13T05:10:40.616 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.616 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.616 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.616 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.616 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.616 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26419 2024-09-13T05:10:40.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.616 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:10:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:10:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741492+0000", 2024-09-13T05:10:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741495+0000", 2024-09-13T05:10:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6369999999999999e-06 2024-09-13T05:10:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741508+0000", 2024-09-13T05:10:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3319000000000001e-05 2024-09-13T05:10:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741527+0000", 2024-09-13T05:10:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8542e-05 2024-09-13T05:10:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796871+0000", 2024-09-13T05:10:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055344474999999997 2024-09-13T05:10:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796967+0000", 2024-09-13T05:10:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5963000000000003e-05 2024-09-13T05:10:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797063+0000", 2024-09-13T05:10:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5909999999999995e-05 2024-09-13T05:10:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26421 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 921600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:10:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.849947271, 2024-09-13T05:10:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055631152000000003, 2024-09-13T05:10:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26421 2024-09-13T05:10:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:10:40.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:10:40.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741535+0000", 2024-09-13T05:10:40.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741540+0000", 2024-09-13T05:10:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1690000000000002e-06 2024-09-13T05:10:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741547+0000", 2024-09-13T05:10:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3409999999999997e-06 2024-09-13T05:10:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741552+0000", 2024-09-13T05:10:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5639999999999996e-06 2024-09-13T05:10:40.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797079+0000", 2024-09-13T05:10:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055526038999999999 2024-09-13T05:10:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797121+0000", 2024-09-13T05:10:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2156000000000001e-05 2024-09-13T05:10:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797167+0000", 2024-09-13T05:10:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6445e-05 2024-09-13T05:10:40.623 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26423 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 930816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:10:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.8495542780000003, 2024-09-13T05:10:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055364370000000003, 2024-09-13T05:10:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.624 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26423 2024-09-13T05:10:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:10:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:10:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741928+0000", 2024-09-13T05:10:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741933+0000", 2024-09-13T05:10:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9980000000000003e-06 2024-09-13T05:10:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741945+0000", 2024-09-13T05:10:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1761e-05 2024-09-13T05:10:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741958+0000", 2024-09-13T05:10:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2604e-05 2024-09-13T05:10:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797185+0000", 2024-09-13T05:10:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055227169 2024-09-13T05:10:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797226+0000", 2024-09-13T05:10:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1619000000000003e-05 2024-09-13T05:10:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797293+0000", 2024-09-13T05:10:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6952999999999994e-05 2024-09-13T05:10:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26424 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 940032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:10:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.8495173409999999, 2024-09-13T05:10:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055448669999999999, 2024-09-13T05:10:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.628 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26424 2024-09-13T05:10:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:10:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:10:40.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741965+0000", 2024-09-13T05:10:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741969+0000", 2024-09-13T05:10:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3440000000000001e-06 2024-09-13T05:10:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741983+0000", 2024-09-13T05:10:40.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4600000000000001e-05 2024-09-13T05:10:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741989+0000", 2024-09-13T05:10:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5350000000000004e-06 2024-09-13T05:10:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797319+0000", 2024-09-13T05:10:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055330121000000003 2024-09-13T05:10:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797364+0000", 2024-09-13T05:10:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5670000000000002e-05 2024-09-13T05:10:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797415+0000", 2024-09-13T05:10:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0124000000000003e-05 2024-09-13T05:10:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26426 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 949248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:10:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.8494901420000001, 2024-09-13T05:10:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055639981999999998, 2024-09-13T05:10:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26426 2024-09-13T05:10:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:10:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:10:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:10:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741995+0000", 2024-09-13T05:10:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.661e-06 2024-09-13T05:10:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742004+0000", 2024-09-13T05:10:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2009999999999999e-06 2024-09-13T05:10:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742008+0000", 2024-09-13T05:10:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7890000000000002e-06 2024-09-13T05:10:40.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797432+0000", 2024-09-13T05:10:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055423448 2024-09-13T05:10:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797516+0000", 2024-09-13T05:10:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4404e-05 2024-09-13T05:10:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797633+0000", 2024-09-13T05:10:40.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116898 2024-09-13T05:10:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26427 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 958464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:10:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.8494700860000002, 2024-09-13T05:10:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055829295000000001, 2024-09-13T05:10:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.637 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26427 2024-09-13T05:10:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:10:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:10:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:10:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742015+0000", 2024-09-13T05:10:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.74e-06 2024-09-13T05:10:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742023+0000", 2024-09-13T05:10:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7039999999999994e-06 2024-09-13T05:10:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742028+0000", 2024-09-13T05:10:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7369999999999997e-06 2024-09-13T05:10:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797666+0000", 2024-09-13T05:10:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055637820999999997 2024-09-13T05:10:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797748+0000", 2024-09-13T05:10:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1787999999999997e-05 2024-09-13T05:10:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797842+0000", 2024-09-13T05:10:40.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4903999999999998e-05 2024-09-13T05:10:40.641 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.641 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.641 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.641 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26432 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 976896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:40.641 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:10:40.641 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.8486769249999999, 2024-09-13T05:10:40.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055402077000000001, 2024-09-13T05:10:40.641 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.641 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.641 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.641 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.642 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.642 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26432 2024-09-13T05:10:40.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.642 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:10:40.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:10:40.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:10:40.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742808+0000", 2024-09-13T05:10:40.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3319999999999999e-06 2024-09-13T05:10:40.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742818+0000", 2024-09-13T05:10:40.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5380000000000008e-06 2024-09-13T05:10:40.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742821+0000", 2024-09-13T05:10:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2179999999999999e-06 2024-09-13T05:10:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798027+0000", 2024-09-13T05:10:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055206344999999997 2024-09-13T05:10:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798103+0000", 2024-09-13T05:10:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5786999999999998e-05 2024-09-13T05:10:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798208+0000", 2024-09-13T05:10:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010521700000000001 2024-09-13T05:10:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26434 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 986112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:10:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.8486597009999999, 2024-09-13T05:10:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055610109999999997, 2024-09-13T05:10:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.645 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26434 2024-09-13T05:10:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:10:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:10:40.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742823+0000", 2024-09-13T05:10:40.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:40.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742825+0000", 2024-09-13T05:10:40.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6220000000000001e-06 2024-09-13T05:10:40.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742828+0000", 2024-09-13T05:10:40.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.926e-06 2024-09-13T05:10:40.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742831+0000", 2024-09-13T05:10:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-13T05:10:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798239+0000", 2024-09-13T05:10:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055408254999999997 2024-09-13T05:10:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798326+0000", 2024-09-13T05:10:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7168000000000003e-05 2024-09-13T05:10:40.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798434+0000", 2024-09-13T05:10:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010767100000000001 2024-09-13T05:10:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26442 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1032192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:10:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.847390361, 2024-09-13T05:10:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055422776, 2024-09-13T05:10:40.651 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26442 2024-09-13T05:10:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:10:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:10:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744061+0000", 2024-09-13T05:10:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999685 2024-09-13T05:10:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744096+0000", 2024-09-13T05:10:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4771999999999998e-05 2024-09-13T05:10:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744147+0000", 2024-09-13T05:10:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0696999999999999e-05 2024-09-13T05:10:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744154+0000", 2024-09-13T05:10:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8510000000000001e-06 2024-09-13T05:10:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799324+0000", 2024-09-13T05:10:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055170074999999999 2024-09-13T05:10:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799415+0000", 2024-09-13T05:10:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1197000000000001e-05 2024-09-13T05:10:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799516+0000", 2024-09-13T05:10:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100666 2024-09-13T05:10:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26443 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1041408~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:10:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.8471097900000002, 2024-09-13T05:10:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055344195999999998, 2024-09-13T05:10:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26443 2024-09-13T05:10:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:10:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:10:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744159+0000", 2024-09-13T05:10:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997849 2024-09-13T05:10:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744379+0000", 2024-09-13T05:10:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022024800000000001 2024-09-13T05:10:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744390+0000", 2024-09-13T05:10:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1105e-05 2024-09-13T05:10:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744397+0000", 2024-09-13T05:10:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2740000000000002e-06 2024-09-13T05:10:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799543+0000", 2024-09-13T05:10:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055145441000000003 2024-09-13T05:10:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799619+0000", 2024-09-13T05:10:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6660000000000001e-05 2024-09-13T05:10:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799718+0000", 2024-09-13T05:10:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8331000000000004e-05 2024-09-13T05:10:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26547 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1318912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:10:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.8469234719999998, 2024-09-13T05:10:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055355834, 2024-09-13T05:10:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26547 2024-09-13T05:10:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:10:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:10:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744404+0000", 2024-09-13T05:10:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998441 2024-09-13T05:10:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744564+0000", 2024-09-13T05:10:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016022200000000001 2024-09-13T05:10:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744579+0000", 2024-09-13T05:10:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5036e-05 2024-09-13T05:10:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744585+0000", 2024-09-13T05:10:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7880000000000003e-06 2024-09-13T05:10:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799747+0000", 2024-09-13T05:10:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055161804000000002 2024-09-13T05:10:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799823+0000", 2024-09-13T05:10:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5956000000000003e-05 2024-09-13T05:10:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799916+0000", 2024-09-13T05:10:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2733999999999997e-05 2024-09-13T05:10:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26550 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1328128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:10:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.8466673130000002, 2024-09-13T05:10:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055315941, 2024-09-13T05:10:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26550 2024-09-13T05:10:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:10:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:10:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744591+0000", 2024-09-13T05:10:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997745 2024-09-13T05:10:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744821+0000", 2024-09-13T05:10:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023031899999999999 2024-09-13T05:10:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744833+0000", 2024-09-13T05:10:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1919000000000001e-05 2024-09-13T05:10:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744837+0000", 2024-09-13T05:10:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4989999999999996e-06 2024-09-13T05:10:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799947+0000", 2024-09-13T05:10:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055110120999999998 2024-09-13T05:10:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800030+0000", 2024-09-13T05:10:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2905999999999995e-05 2024-09-13T05:10:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800132+0000", 2024-09-13T05:10:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101529 2024-09-13T05:10:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26558 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1364992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:10:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.8459323059999999, 2024-09-13T05:10:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055422765999999998, 2024-09-13T05:10:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26558 2024-09-13T05:10:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:10:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:10:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745550+0000", 2024-09-13T05:10:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745553+0000", 2024-09-13T05:10:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7690000000000001e-06 2024-09-13T05:10:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745559+0000", 2024-09-13T05:10:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3149999999999997e-06 2024-09-13T05:10:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745564+0000", 2024-09-13T05:10:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6670000000000004e-06 2024-09-13T05:10:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800791+0000", 2024-09-13T05:10:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055226711999999997 2024-09-13T05:10:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800865+0000", 2024-09-13T05:10:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4344000000000005e-05 2024-09-13T05:10:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800974+0000", 2024-09-13T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108606 2024-09-13T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26561 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1374208~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.8459152530000003, 2024-09-13T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055549315000000002, 2024-09-13T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26561 2024-09-13T05:10:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:10:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:10:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:10:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745570+0000", 2024-09-13T05:10:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4719999999999998e-06 2024-09-13T05:10:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745575+0000", 2024-09-13T05:10:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1900000000000003e-06 2024-09-13T05:10:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745579+0000", 2024-09-13T05:10:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3250000000000001e-06 2024-09-13T05:10:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801000+0000", 2024-09-13T05:10:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055420432999999998 2024-09-13T05:10:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801061+0000", 2024-09-13T05:10:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1427000000000007e-05 2024-09-13T05:10:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801117+0000", 2024-09-13T05:10:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5933000000000001e-05 2024-09-13T05:10:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26582 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1447936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:10:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.8444976130000001, 2024-09-13T05:10:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055394301, 2024-09-13T05:10:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26582 2024-09-13T05:10:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:10:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:10:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746985+0000", 2024-09-13T05:10:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746988+0000", 2024-09-13T05:10:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6479999999999999e-06 2024-09-13T05:10:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.747000+0000", 2024-09-13T05:10:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2009e-05 2024-09-13T05:10:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.747005+0000", 2024-09-13T05:10:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0039999999999999e-06 2024-09-13T05:10:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802232+0000", 2024-09-13T05:10:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055227762999999999 2024-09-13T05:10:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802320+0000", 2024-09-13T05:10:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7576000000000003e-05 2024-09-13T05:10:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802380+0000", 2024-09-13T05:10:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9888e-05 2024-09-13T05:10:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:40.684 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:40.686 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:10:40.686 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:40.683+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:40.787 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:40.783+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:40.800 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:10:40.800 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:40.810 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:10:40.885 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T05:10:40.887 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:40.882+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:40.918 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:10:40.920 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:10:40.920 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:10:40.920 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:10:40.920 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:10:40.920 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:10:40.920 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:10:40.920 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:10:40.921 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:10:40.927 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:40.928 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:40.928 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:40.928 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:40.928 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:40.938 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:10:40.989 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:40.982+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:41.064 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:41.064 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:41.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:41.064 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:716 3.7 3:e36464e2:::rbd_object_map.112dac7a9dca:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T05:10:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:15.991960+0000", 2024-09-13T05:10:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 25.069034314, 2024-09-13T05:10:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091896310000000002, 2024-09-13T05:10:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 716 2024-09-13T05:10:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.991960+0000", 2024-09-13T05:10:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.991960+0000", 2024-09-13T05:10:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.991959+0000", 2024-09-13T05:10:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.991966+0000", 2024-09-13T05:10:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8940000000000004e-06 2024-09-13T05:10:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.991983+0000", 2024-09-13T05:10:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7506000000000001e-05 2024-09-13T05:10:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.991992+0000", 2024-09-13T05:10:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6680000000000007e-06 2024-09-13T05:10:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.993862+0000", 2024-09-13T05:10:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018696019999999999 2024-09-13T05:10:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.993962+0000", 2024-09-13T05:10:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100566 2024-09-13T05:10:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:10:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.994363+0000", 2024-09-13T05:10:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040053000000000002 2024-09-13T05:10:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:15.995982+0000", 2024-09-13T05:10:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001619424 2024-09-13T05:10:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.001091+0000", 2024-09-13T05:10:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051089339999999999 2024-09-13T05:10:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:41.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.001125+0000", 2024-09-13T05:10:41.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3739999999999999e-05 2024-09-13T05:10:41.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:41.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:16.001150+0000", 2024-09-13T05:10:41.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4732999999999999e-05 2024-09-13T05:10:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2037 3.8 3:1349be29:::rbd_data.112d872fd67a.000000000000003b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.108522+0000", 2024-09-13T05:10:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.952472069999999, 2024-09-13T05:10:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016880821000000001, 2024-09-13T05:10:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2037 2024-09-13T05:10:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108522+0000", 2024-09-13T05:10:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108522+0000", 2024-09-13T05:10:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108521+0000", 2024-09-13T05:10:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108527+0000", 2024-09-13T05:10:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0460000000000002e-06 2024-09-13T05:10:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108538+0000", 2024-09-13T05:10:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0891e-05 2024-09-13T05:10:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108548+0000", 2024-09-13T05:10:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9159999999999996e-06 2024-09-13T05:10:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108595+0000", 2024-09-13T05:10:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7107000000000001e-05 2024-09-13T05:10:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108692+0000", 2024-09-13T05:10:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6824999999999995e-05 2024-09-13T05:10:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.111425+0000", 2024-09-13T05:10:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027337110000000002 2024-09-13T05:10:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125249+0000", 2024-09-13T05:10:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013823521 2024-09-13T05:10:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125265+0000", 2024-09-13T05:10:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6257e-05 2024-09-13T05:10:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125347+0000", 2024-09-13T05:10:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1321000000000003e-05 2024-09-13T05:10:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125403+0000", 2024-09-13T05:10:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6362e-05 2024-09-13T05:10:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2947 3.b 3:d32df763:::rbd_data.112d872fd67a.000000000000006b:head [stat,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.921206+0000", 2024-09-13T05:10:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.139787856000002, 2024-09-13T05:10:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095406580000000005, 2024-09-13T05:10:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2947 2024-09-13T05:10:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921206+0000", 2024-09-13T05:10:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921206+0000", 2024-09-13T05:10:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921205+0000", 2024-09-13T05:10:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921212+0000", 2024-09-13T05:10:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3300000000000001e-06 2024-09-13T05:10:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921232+0000", 2024-09-13T05:10:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9601000000000001e-05 2024-09-13T05:10:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921241+0000", 2024-09-13T05:10:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3230000000000004e-06 2024-09-13T05:10:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921297+0000", 2024-09-13T05:10:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5849e-05 2024-09-13T05:10:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921456+0000", 2024-09-13T05:10:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015864899999999999 2024-09-13T05:10:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:41.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.930747+0000", 2024-09-13T05:10:41.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092911450000000007 2024-09-13T05:10:41.081 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.081 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:41.081 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4911 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2801664~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.800434+0000", 2024-09-13T05:10:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.260560148, 2024-09-13T05:10:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096311120000000007, 2024-09-13T05:10:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4911 2024-09-13T05:10:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800434+0000", 2024-09-13T05:10:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800434+0000", 2024-09-13T05:10:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800433+0000", 2024-09-13T05:10:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800441+0000", 2024-09-13T05:10:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4699999999999996e-06 2024-09-13T05:10:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800450+0000", 2024-09-13T05:10:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6030000000000005e-06 2024-09-13T05:10:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800455+0000", 2024-09-13T05:10:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6019999999999999e-06 2024-09-13T05:10:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802738+0000", 2024-09-13T05:10:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022825089999999998 2024-09-13T05:10:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802849+0000", 2024-09-13T05:10:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110849 2024-09-13T05:10:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810065+0000", 2024-09-13T05:10:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072166419999999997 2024-09-13T05:10:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5022 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 1130496~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.801450+0000", 2024-09-13T05:10:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.259544366, 2024-09-13T05:10:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091281130000000002, 2024-09-13T05:10:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5022 2024-09-13T05:10:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801450+0000", 2024-09-13T05:10:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801450+0000", 2024-09-13T05:10:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801449+0000", 2024-09-13T05:10:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801452+0000", 2024-09-13T05:10:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4339999999999999e-06 2024-09-13T05:10:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801457+0000", 2024-09-13T05:10:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2279999999999998e-06 2024-09-13T05:10:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801461+0000", 2024-09-13T05:10:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.206e-06 2024-09-13T05:10:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810421+0000", 2024-09-13T05:10:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089597519999999996 2024-09-13T05:10:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810508+0000", 2024-09-13T05:10:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6793999999999996e-05 2024-09-13T05:10:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810578+0000", 2024-09-13T05:10:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0106999999999998e-05 2024-09-13T05:10:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5024 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 1720320~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.801465+0000", 2024-09-13T05:10:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.259528717999999, 2024-09-13T05:10:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092671309999999996, 2024-09-13T05:10:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:41.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.091 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5024 2024-09-13T05:10:41.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.091 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:41.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:41.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801465+0000", 2024-09-13T05:10:41.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801465+0000", 2024-09-13T05:10:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801465+0000", 2024-09-13T05:10:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801467+0000", 2024-09-13T05:10:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.255e-06 2024-09-13T05:10:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801473+0000", 2024-09-13T05:10:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8699999999999997e-06 2024-09-13T05:10:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801483+0000", 2024-09-13T05:10:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6169999999999996e-06 2024-09-13T05:10:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810610+0000", 2024-09-13T05:10:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091271389999999994 2024-09-13T05:10:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810673+0000", 2024-09-13T05:10:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2973999999999997e-05 2024-09-13T05:10:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810733+0000", 2024-09-13T05:10:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9602999999999998e-05 2024-09-13T05:10:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5028 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 1916928~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.801977+0000", 2024-09-13T05:10:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.259017606, 2024-09-13T05:10:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092754559999999996, 2024-09-13T05:10:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5028 2024-09-13T05:10:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801977+0000", 2024-09-13T05:10:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801977+0000", 2024-09-13T05:10:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801976+0000", 2024-09-13T05:10:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801979+0000", 2024-09-13T05:10:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.813e-06 2024-09-13T05:10:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801985+0000", 2024-09-13T05:10:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6640000000000003e-06 2024-09-13T05:10:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801989+0000", 2024-09-13T05:10:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5759999999999999e-06 2024-09-13T05:10:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810910+0000", 2024-09-13T05:10:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089204430000000001 2024-09-13T05:10:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811176+0000", 2024-09-13T05:10:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026676100000000002 2024-09-13T05:10:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811252+0000", 2024-09-13T05:10:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5655000000000007e-05 2024-09-13T05:10:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5030 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 1523712~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.801994+0000", 2024-09-13T05:10:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.259000455999999, 2024-09-13T05:10:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094030090000000004, 2024-09-13T05:10:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5030 2024-09-13T05:10:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801994+0000", 2024-09-13T05:10:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801994+0000", 2024-09-13T05:10:41.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:41.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801993+0000", 2024-09-13T05:10:41.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:41.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:41.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801997+0000", 2024-09-13T05:10:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2650000000000001e-06 2024-09-13T05:10:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802002+0000", 2024-09-13T05:10:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7389999999999996e-06 2024-09-13T05:10:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802007+0000", 2024-09-13T05:10:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5419999999999999e-06 2024-09-13T05:10:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811276+0000", 2024-09-13T05:10:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092691330000000006 2024-09-13T05:10:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811341+0000", 2024-09-13T05:10:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5028000000000001e-05 2024-09-13T05:10:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811397+0000", 2024-09-13T05:10:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5699000000000003e-05 2024-09-13T05:10:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5033 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2113536~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802011+0000", 2024-09-13T05:10:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.258983107999999, 2024-09-13T05:10:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095360380000000002, 2024-09-13T05:10:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5033 2024-09-13T05:10:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802011+0000", 2024-09-13T05:10:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802011+0000", 2024-09-13T05:10:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802011+0000", 2024-09-13T05:10:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:41.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802013+0000", 2024-09-13T05:10:41.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.131e-06 2024-09-13T05:10:41.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:41.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802019+0000", 2024-09-13T05:10:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8799999999999996e-06 2024-09-13T05:10:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802023+0000", 2024-09-13T05:10:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6829999999999999e-06 2024-09-13T05:10:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811423+0000", 2024-09-13T05:10:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093992139999999995 2024-09-13T05:10:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811475+0000", 2024-09-13T05:10:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2000999999999999e-05 2024-09-13T05:10:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811547+0000", 2024-09-13T05:10:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2465000000000005e-05 2024-09-13T05:10:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5036 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2703360~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802028+0000", 2024-09-13T05:10:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.258966654999998, 2024-09-13T05:10:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096685629999999998, 2024-09-13T05:10:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5036 2024-09-13T05:10:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802028+0000", 2024-09-13T05:10:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802028+0000", 2024-09-13T05:10:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802027+0000", 2024-09-13T05:10:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802030+0000", 2024-09-13T05:10:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3329999999999999e-06 2024-09-13T05:10:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802036+0000", 2024-09-13T05:10:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5610000000000004e-06 2024-09-13T05:10:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802041+0000", 2024-09-13T05:10:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9309999999999999e-06 2024-09-13T05:10:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811568+0000", 2024-09-13T05:10:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095272369999999992 2024-09-13T05:10:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811624+0000", 2024-09-13T05:10:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5673e-05 2024-09-13T05:10:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811696+0000", 2024-09-13T05:10:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2187999999999994e-05 2024-09-13T05:10:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5041 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2310144~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802046+0000", 2024-09-13T05:10:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.258948522000001, 2024-09-13T05:10:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097718389999999992, 2024-09-13T05:10:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5041 2024-09-13T05:10:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802046+0000", 2024-09-13T05:10:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802046+0000", 2024-09-13T05:10:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802045+0000", 2024-09-13T05:10:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802047+0000", 2024-09-13T05:10:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1799999999999999e-06 2024-09-13T05:10:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802053+0000", 2024-09-13T05:10:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.507e-06 2024-09-13T05:10:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802057+0000", 2024-09-13T05:10:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3590000000000001e-06 2024-09-13T05:10:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811713+0000", 2024-09-13T05:10:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096553400000000001 2024-09-13T05:10:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811763+0000", 2024-09-13T05:10:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0050999999999999e-05 2024-09-13T05:10:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811818+0000", 2024-09-13T05:10:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4777000000000001e-05 2024-09-13T05:10:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5044 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2899968~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802062+0000", 2024-09-13T05:10:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.258932538, 2024-09-13T05:10:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0099015260000000008, 2024-09-13T05:10:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5044 2024-09-13T05:10:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802062+0000", 2024-09-13T05:10:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802062+0000", 2024-09-13T05:10:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802061+0000", 2024-09-13T05:10:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802064+0000", 2024-09-13T05:10:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0740000000000001e-06 2024-09-13T05:10:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802070+0000", 2024-09-13T05:10:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8560000000000003e-06 2024-09-13T05:10:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802075+0000", 2024-09-13T05:10:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6360000000000002e-06 2024-09-13T05:10:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811834+0000", 2024-09-13T05:10:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097588710000000006 2024-09-13T05:10:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811878+0000", 2024-09-13T05:10:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3937999999999998e-05 2024-09-13T05:10:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811963+0000", 2024-09-13T05:10:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5505000000000002e-05 2024-09-13T05:10:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5049 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2506752~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802080+0000", 2024-09-13T05:10:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.258914654000002, 2024-09-13T05:10:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010051279, 2024-09-13T05:10:41.122 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:41.122 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:41.122 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:41.122 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:41.122 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.122 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5049 2024-09-13T05:10:41.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.122 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:41.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:41.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802080+0000", 2024-09-13T05:10:41.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802080+0000", 2024-09-13T05:10:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802079+0000", 2024-09-13T05:10:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802081+0000", 2024-09-13T05:10:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2740000000000002e-06 2024-09-13T05:10:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802088+0000", 2024-09-13T05:10:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.567e-06 2024-09-13T05:10:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802093+0000", 2024-09-13T05:10:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8609999999999997e-06 2024-09-13T05:10:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811989+0000", 2024-09-13T05:10:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0098961840000000006 2024-09-13T05:10:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812069+0000", 2024-09-13T05:10:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9534000000000001e-05 2024-09-13T05:10:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812131+0000", 2024-09-13T05:10:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2206999999999996e-05 2024-09-13T05:10:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5052 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 3096576~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802097+0000", 2024-09-13T05:10:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.258897424000001, 2024-09-13T05:10:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010227615000000001, 2024-09-13T05:10:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5052 2024-09-13T05:10:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802097+0000", 2024-09-13T05:10:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802097+0000", 2024-09-13T05:10:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802096+0000", 2024-09-13T05:10:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802099+0000", 2024-09-13T05:10:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3539999999999998e-06 2024-09-13T05:10:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802105+0000", 2024-09-13T05:10:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8440000000000003e-06 2024-09-13T05:10:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802109+0000", 2024-09-13T05:10:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6800000000000001e-06 2024-09-13T05:10:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:41.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812155+0000", 2024-09-13T05:10:41.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010045691000000001 2024-09-13T05:10:41.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:41.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812238+0000", 2024-09-13T05:10:41.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2855000000000005e-05 2024-09-13T05:10:41.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:41.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812324+0000", 2024-09-13T05:10:41.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6621999999999998e-05 2024-09-13T05:10:41.129 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.130 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:41.130 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.130 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:7377 3.1e 3:7d4eb93d:::rbd_header.112d1304fe95:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-13T05:10:41.130 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:24.742504+0000", 2024-09-13T05:10:41.130 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.318490301000001, 2024-09-13T05:10:41.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01013406, 2024-09-13T05:10:41.130 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:41.130 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:41.130 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:41.130 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:41.131 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.131 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7377 2024-09-13T05:10:41.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.131 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:41.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:41.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742504+0000", 2024-09-13T05:10:41.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:41.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742504+0000", 2024-09-13T05:10:41.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:41.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742500+0000", 2024-09-13T05:10:41.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999962 2024-09-13T05:10:41.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:41.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742522+0000", 2024-09-13T05:10:41.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2310000000000002e-05 2024-09-13T05:10:41.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:41.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742572+0000", 2024-09-13T05:10:41.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9872e-05 2024-09-13T05:10:41.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742597+0000", 2024-09-13T05:10:41.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4363e-05 2024-09-13T05:10:41.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:41.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742678+0000", 2024-09-13T05:10:41.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1370000000000002e-05 2024-09-13T05:10:41.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-13T05:10:41.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742686+0000", 2024-09-13T05:10:41.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5259999999999993e-06 2024-09-13T05:10:41.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:41.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.749024+0000", 2024-09-13T05:10:41.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006337372 2024-09-13T05:10:41.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:41.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.749278+0000", 2024-09-13T05:10:41.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025436399999999998 2024-09-13T05:10:41.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:10:41.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.750557+0000", 2024-09-13T05:10:41.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012787129999999999 2024-09-13T05:10:41.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:41.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.751774+0000", 2024-09-13T05:10:41.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001217054 2024-09-13T05:10:41.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:41.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.752530+0000", 2024-09-13T05:10:41.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075635999999999998 2024-09-13T05:10:41.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:41.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.752592+0000", 2024-09-13T05:10:41.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1486000000000001e-05 2024-09-13T05:10:41.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:41.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.752638+0000", 2024-09-13T05:10:41.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6140000000000002e-05 2024-09-13T05:10:41.136 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.136 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:41.136 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.137 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:7961 3.18 3:184d9aea:::rbd_data.112db57f3a18.000000000000002b:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-13T05:10:41.137 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:10:41.137 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.983989082000001, 2024-09-13T05:10:41.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.040271084999999998, 2024-09-13T05:10:41.137 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:41.137 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:41.137 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:41.137 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:41.137 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.137 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7961 2024-09-13T05:10:41.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.137 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:41.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:41.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:10:41.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:41.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:10:41.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:41.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077003+0000", 2024-09-13T05:10:41.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:41.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:41.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077013+0000", 2024-09-13T05:10:41.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6870000000000006e-06 2024-09-13T05:10:41.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:41.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077029+0000", 2024-09-13T05:10:41.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6314e-05 2024-09-13T05:10:41.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077038+0000", 2024-09-13T05:10:41.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5019999999999992e-06 2024-09-13T05:10:41.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:41.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077099+0000", 2024-09-13T05:10:41.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1444000000000003e-05 2024-09-13T05:10:41.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:41.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077234+0000", 2024-09-13T05:10:41.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013461300000000001 2024-09-13T05:10:41.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:41.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.085202+0000", 2024-09-13T05:10:41.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079680140000000007 2024-09-13T05:10:41.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:41.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116860+0000", 2024-09-13T05:10:41.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.031658190000000003 2024-09-13T05:10:41.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:41.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116995+0000", 2024-09-13T05:10:41.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000135601 2024-09-13T05:10:41.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:41.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117152+0000", 2024-09-13T05:10:41.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015681700000000001 2024-09-13T05:10:41.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:41.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117276+0000", 2024-09-13T05:10:41.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012392699999999999 2024-09-13T05:10:41.142 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.142 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:41.142 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.142 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4397.0:7961 3.18 e35/22 ondisk, result = 0)", 2024-09-13T05:10:41.142 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.104860+0000", 2024-09-13T05:10:41.142 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.956134064, 2024-09-13T05:10:41.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012435735999999999, 2024-09-13T05:10:41.143 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:41.143 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:41.143 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:41.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:41.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104860+0000", 2024-09-13T05:10:41.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:41.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104860+0000", 2024-09-13T05:10:41.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:41.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104859+0000", 2024-09-13T05:10:41.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:41.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:41.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104866+0000", 2024-09-13T05:10:41.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0840000000000003e-06 2024-09-13T05:10:41.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:41.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104882+0000", 2024-09-13T05:10:41.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5705e-05 2024-09-13T05:10:41.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104890+0000", 2024-09-13T05:10:41.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5110000000000003e-06 2024-09-13T05:10:41.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:41.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116937+0000", 2024-09-13T05:10:41.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012046563999999999 2024-09-13T05:10:41.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:41.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116975+0000", 2024-09-13T05:10:41.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8243e-05 2024-09-13T05:10:41.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:41.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117296+0000", 2024-09-13T05:10:41.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032082299999999997 2024-09-13T05:10:41.146 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.146 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:41.146 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.146 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:8105 3.b 3:d2ae8f7b:::rbd_data.112db57f3a18.0000000000000028:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-13T05:10:41.146 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:10:41.146 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.748893276, 2024-09-13T05:10:41.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.040653913, 2024-09-13T05:10:41.146 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:41.147 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:41.147 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:41.147 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:41.147 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.147 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 8105 2024-09-13T05:10:41.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.147 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:41.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:41.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:10:41.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:41.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:10:41.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:41.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312099+0000", 2024-09-13T05:10:41.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:41.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:41.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312109+0000", 2024-09-13T05:10:41.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0244999999999999e-05 2024-09-13T05:10:41.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:41.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312129+0000", 2024-09-13T05:10:41.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9751000000000001e-05 2024-09-13T05:10:41.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312141+0000", 2024-09-13T05:10:41.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2201999999999999e-05 2024-09-13T05:10:41.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:41.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312230+0000", 2024-09-13T05:10:41.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9092999999999996e-05 2024-09-13T05:10:41.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:41.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312433+0000", 2024-09-13T05:10:41.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020240500000000001 2024-09-13T05:10:41.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:41.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.320357+0000", 2024-09-13T05:10:41.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079242630000000008 2024-09-13T05:10:41.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:41.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352488+0000", 2024-09-13T05:10:41.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032131588000000003 2024-09-13T05:10:41.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:41.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352533+0000", 2024-09-13T05:10:41.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4601999999999997e-05 2024-09-13T05:10:41.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:41.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352636+0000", 2024-09-13T05:10:41.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103041 2024-09-13T05:10:41.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:41.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352755+0000", 2024-09-13T05:10:41.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118814 2024-09-13T05:10:41.152 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.152 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:41.152 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.152 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4397.0:8105 3.b e35/22 ondisk, result = 0)", 2024-09-13T05:10:41.152 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.342777+0000", 2024-09-13T05:10:41.152 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.718217068, 2024-09-13T05:10:41.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097182480000000005, 2024-09-13T05:10:41.152 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:41.152 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:41.152 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:41.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:41.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342777+0000", 2024-09-13T05:10:41.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:41.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342777+0000", 2024-09-13T05:10:41.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:41.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342776+0000", 2024-09-13T05:10:41.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:41.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:41.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342786+0000", 2024-09-13T05:10:41.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0298e-05 2024-09-13T05:10:41.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:41.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342809+0000", 2024-09-13T05:10:41.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3346999999999999e-05 2024-09-13T05:10:41.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342822+0000", 2024-09-13T05:10:41.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2717e-05 2024-09-13T05:10:41.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:41.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352456+0000", 2024-09-13T05:10:41.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096335659999999997 2024-09-13T05:10:41.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:41.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352474+0000", 2024-09-13T05:10:41.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8776000000000001e-05 2024-09-13T05:10:41.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:41.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352495+0000", 2024-09-13T05:10:41.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.107e-05 2024-09-13T05:10:41.155 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.156 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:41.156 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.156 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:21788 3.2 3:4760cfb8:::rbd_data.112d356d780d.0000000000000030:head [delete] snapc c=[c] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:41.156 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.111156+0000", 2024-09-13T05:10:41.156 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.9498377300000005, 2024-09-13T05:10:41.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0090315819999999998, 2024-09-13T05:10:41.156 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:41.156 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:41.156 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:41.156 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:41.156 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.156 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 21788 2024-09-13T05:10:41.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.157 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:41.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:41.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.111156+0000", 2024-09-13T05:10:41.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:41.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.111156+0000", 2024-09-13T05:10:41.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:41.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:41.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.111156+0000", 2024-09-13T05:10:41.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:41.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:41.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.111159+0000", 2024-09-13T05:10:41.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:10:41.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:41.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.111164+0000", 2024-09-13T05:10:41.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3249999999999998e-06 2024-09-13T05:10:41.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.111169+0000", 2024-09-13T05:10:41.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8049999999999997e-06 2024-09-13T05:10:41.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:41.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.112916+0000", 2024-09-13T05:10:41.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017466840000000001 2024-09-13T05:10:41.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:41.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.113034+0000", 2024-09-13T05:10:41.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011857 2024-09-13T05:10:41.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:10:41.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.113255+0000", 2024-09-13T05:10:41.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000220788 2024-09-13T05:10:41.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:41.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.116786+0000", 2024-09-13T05:10:41.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035311600000000002 2024-09-13T05:10:41.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:41.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.120144+0000", 2024-09-13T05:10:41.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033575969999999999 2024-09-13T05:10:41.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:41.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.120168+0000", 2024-09-13T05:10:41.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4613999999999998e-05 2024-09-13T05:10:41.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:41.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:41.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:41.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.120188+0000", 2024-09-13T05:10:41.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9639999999999998e-05 2024-09-13T05:10:41.161 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.161 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:41.162 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.162 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:41.162 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:41.162 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:41.163 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:10:41.164 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:41.158+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:41.264 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:41.258+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:41.285 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:41.285 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:41.285 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:41.285 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:41.297 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:10:41.337 INFO:teuthology.orchestra.run.smithi120.stdout:1200 punch from 0x2faac24 to 0x2fad5c8, (0x29a4 bytes) 2024-09-13T05:10:41.344 INFO:teuthology.orchestra.run.smithi120.stdout:1203 punch from 0x182b4a2 to 0x18326bc, (0x721a bytes) 2024-09-13T05:10:41.365 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:41.358+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:41.374 INFO:teuthology.orchestra.run.smithi120.stdout:1204 write 0xcd67d26 thru 0xcd74b56 (0xce31 bytes) 2024-09-13T05:10:41.381 INFO:teuthology.orchestra.run.smithi120.stdout:1205 write 0xa43cf3e thru 0xa446a9d (0x9b60 bytes) 2024-09-13T05:10:41.398 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:41.398 INFO:teuthology.orchestra.run.smithi120.stdout:1207 write 0x73e0630 thru 0x73eb876 (0xb247 bytes) 2024-09-13T05:10:41.401 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:41.401 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:41.401 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:41.401 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:41.401 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:41.413 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:10:41.413 INFO:teuthology.orchestra.run.smithi120.stdout:1208 write 0x45ea966 thru 0x45fa3f7 (0xfa92 bytes) 2024-09-13T05:10:41.424 INFO:teuthology.orchestra.run.smithi120.stdout:1210 read 0x14ea69f thru 0x14ec991 (0x22f3 bytes) 2024-09-13T05:10:41.437 INFO:teuthology.orchestra.run.smithi120.stdout:1212 trunc from 0xcd74b57 to 0x7e08766 2024-09-13T05:10:41.466 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:41.462+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:41.473 INFO:teuthology.orchestra.run.smithi120.stdout:1213 writesame 0x401d4b2 thru 0x402708b data_size 0x1(0x9bda bytes) 2024-09-13T05:10:41.512 INFO:teuthology.orchestra.run.smithi120.stdout:1214 trunc from 0x7e08766 to 0xd260154 2024-09-13T05:10:41.521 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:41.521 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:41.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:41.521 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [] 2024-09-13T05:10:41.521 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:41.522 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:41.522 INFO:teuthology.orchestra.run.smithi120.stdout:1216 read 0xa826dc5 thru 0xa828cf1 (0x1f2d bytes) 2024-09-13T05:10:41.522 INFO:teuthology.orchestra.run.smithi120.stdout:1217 writesame 0x4aae885 thru 0x4abc0df data_size 0x1(0xd85b bytes) 2024-09-13T05:10:41.534 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:10:41.563 INFO:teuthology.orchestra.run.smithi120.stdout:1218 read 0x4e1ead5 thru 0x4e25359 (0x6885 bytes) 2024-09-13T05:10:41.564 INFO:teuthology.orchestra.run.smithi120.stdout:1219 read 0x51e9ec8 thru 0x51f4ff7 (0xb130 bytes) 2024-09-13T05:10:41.564 INFO:teuthology.orchestra.run.smithi120.stdout:1220 write 0x8949af8 thru 0x894dcb3 (0x41bc bytes) 2024-09-13T05:10:41.566 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:41.563+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:41.568 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:41.568 INFO:teuthology.orchestra.run.smithi120.stdout:1222 punch from 0x6736689 to 0x673affd, (0x4974 bytes) 2024-09-13T05:10:41.568 INFO:teuthology.orchestra.run.smithi120.stdout:1223 write 0x6075fed thru 0x607d461 (0x7475 bytes) 2024-09-13T05:10:41.574 INFO:teuthology.orchestra.run.smithi120.stdout:1224 trunc from 0xd260154 to 0xbf54553 2024-09-13T05:10:41.583 INFO:teuthology.orchestra.run.smithi120.stdout:1225 read 0x50ae6d3 thru 0x50baed2 (0xc800 bytes) 2024-09-13T05:10:41.585 INFO:teuthology.orchestra.run.smithi120.stdout:1226 punch from 0x628a93c to 0x628dfec, (0x36b0 bytes) 2024-09-13T05:10:41.587 INFO:teuthology.orchestra.run.smithi120.stdout:1228 trunc from 0xbf54553 to 0xa8f8f5f 2024-09-13T05:10:41.602 INFO:teuthology.orchestra.run.smithi120.stdout:1229 punch from 0x60b31f4 to 0x60bad99, (0x7ba5 bytes) 2024-09-13T05:10:41.602 INFO:teuthology.orchestra.run.smithi120.stdout:1230 writesame 0x20f1213 thru 0x20f2a01 data_size 0x1(0x17ef bytes) 2024-09-13T05:10:41.608 INFO:teuthology.orchestra.run.smithi120.stdout:1231 punch from 0x6bc9f66 to 0x6bcaba3, (0xc3d bytes) 2024-09-13T05:10:41.623 INFO:teuthology.orchestra.run.smithi120.stdout:1232 write 0xc9163ba thru 0xc91aea4 (0x4aeb bytes) 2024-09-13T05:10:41.645 INFO:teuthology.orchestra.run.smithi120.stdout:1234 write 0xe6d1308 thru 0xe6d9ae7 (0x87e0 bytes) 2024-09-13T05:10:41.645 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:41.645 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:41.645 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:41.646 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:41.654 INFO:teuthology.orchestra.run.smithi120.stdout:1235 trunc from 0xe6d9ae8 to 0xe369338 2024-09-13T05:10:41.656 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:10:41.664 INFO:teuthology.orchestra.run.smithi120.stdout:1236 punch from 0xa578bd2 to 0xa580e92, (0x82c0 bytes) 2024-09-13T05:10:41.665 INFO:teuthology.orchestra.run.smithi120.stdout:1237 read 0xb74fe01 thru 0xb757e4f (0x804f bytes) 2024-09-13T05:10:41.683 INFO:teuthology.orchestra.run.smithi120.stdout:1240 trunc from 0xe369338 to 0x4b33c1c 2024-09-13T05:10:41.697 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:41.695+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:41.712 INFO:teuthology.orchestra.run.smithi120.stdout:1242 punch from 0x3237643 to 0x3245be8, (0xe5a5 bytes) 2024-09-13T05:10:41.712 INFO:teuthology.orchestra.run.smithi120.stdout:1243 writesame 0x3abed00 thru 0x3ac83ff data_size 0x40(0x9700 bytes) 2024-09-13T05:10:41.717 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:41.717 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:41.717 INFO:teuthology.orchestra.run.smithi120.stdout:1247 read 0x2d725ed thru 0x2d7d94b (0xb35f bytes) 2024-09-13T05:10:41.733 INFO:teuthology.orchestra.run.smithi120.stdout:1248 write 0x6c456cd thru 0x6c4cc33 (0x7567 bytes) 2024-09-13T05:10:41.736 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:41.750 INFO:teuthology.orchestra.run.smithi120.stdout:1250 writesame 0x7bb348e thru 0x7bc27e3 data_size 0x1(0xf356 bytes) 2024-09-13T05:10:41.753 INFO:teuthology.orchestra.run.smithi120.stdout:1251 read 0x37140d6 thru 0x371e0be (0x9fe9 bytes) 2024-09-13T05:10:41.754 INFO:teuthology.orchestra.run.smithi120.stdout:1252 write 0x261d4fc thru 0x261f15e (0x1c63 bytes) 2024-09-13T05:10:41.769 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:41.762+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:41.773 INFO:teuthology.orchestra.run.smithi120.stdout:1253 write 0x9394286 thru 0x9396918 (0x2693 bytes) 2024-09-13T05:10:41.776 INFO:teuthology.orchestra.run.smithi120.stdout:1255 read 0x9362ef9 thru 0x936d2bf (0xa3c7 bytes) 2024-09-13T05:10:41.783 INFO:teuthology.orchestra.run.smithi120.stdout:1256 trunc from 0x9396919 to 0xc2e7f51 2024-09-13T05:10:41.794 INFO:teuthology.orchestra.run.smithi120.stdout:1257 write 0xa5a0b96 thru 0xa5b01c3 (0xf62e bytes) 2024-09-13T05:10:41.798 INFO:teuthology.orchestra.run.smithi120.stdout:1258 write 0xc1d56d4 thru 0xc1d5a6c (0x399 bytes) 2024-09-13T05:10:41.804 INFO:teuthology.orchestra.run.smithi120.stdout:1259 write 0xc4afc5 thru 0xc579b0 (0xc9ec bytes) 2024-09-13T05:10:41.805 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:41.805 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:41.805 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:41.805 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:41.806 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:41.808 INFO:teuthology.orchestra.run.smithi120.stdout:1261 write 0x8567871 thru 0x856d626 (0x5db6 bytes) 2024-09-13T05:10:41.811 INFO:teuthology.orchestra.run.smithi120.stdout:1263 write 0x4b7eb6b thru 0x4b8e3e0 (0xf876 bytes) 2024-09-13T05:10:41.815 INFO:teuthology.orchestra.run.smithi120.stdout:1264 write 0xba4dcd3 thru 0xba5b2da (0xd608 bytes) 2024-09-13T05:10:41.817 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:10:41.821 INFO:teuthology.orchestra.run.smithi120.stdout:1265 read 0x49c7746 thru 0x49cb406 (0x3cc1 bytes) 2024-09-13T05:10:41.836 INFO:teuthology.orchestra.run.smithi120.stdout:1266 trunc from 0xc2e7f51 to 0x5c72824 2024-09-13T05:10:41.870 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:41.866+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:41.876 INFO:teuthology.orchestra.run.smithi120.stdout:1268 trunc from 0x5c72824 to 0xc211043 2024-09-13T05:10:41.884 INFO:teuthology.orchestra.run.smithi120.stdout:1269 read 0x856958e thru 0x8574795 (0xb208 bytes) 2024-09-13T05:10:41.902 INFO:teuthology.orchestra.run.smithi120.stdout:1271 writesame 0xd4902c2 thru 0xd49e787 data_size 0x6(0xe4c6 bytes) 2024-09-13T05:10:41.902 INFO:teuthology.orchestra.run.smithi120.stdout:1272 punch from 0x6de28b2 to 0x6df275b, (0xfea9 bytes) 2024-09-13T05:10:41.902 INFO:teuthology.orchestra.run.smithi120.stdout:1273 read 0x484f091 thru 0x48554c6 (0x6436 bytes) 2024-09-13T05:10:41.902 INFO:teuthology.orchestra.run.smithi120.stdout:1275 read 0x291cb10 thru 0x292b954 (0xee45 bytes) 2024-09-13T05:10:41.903 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is unset 2024-09-13T05:10:41.903 INFO:teuthology.orchestra.run.smithi120.stdout:1276 read 0x5b1ee8 thru 0x5b4069 (0x2182 bytes) 2024-09-13T05:10:41.904 INFO:teuthology.orchestra.run.smithi120.stdout:1277 punch from 0x4a2caf7 to 0x4a3b121, (0xe62a bytes) 2024-09-13T05:10:41.904 INFO:teuthology.orchestra.run.smithi120.stdout:1279 write 0xcf09af8 thru 0xcf1578e (0xbc97 bytes) 2024-09-13T05:10:41.909 INFO:tasks.thrashosds.thrasher:in_osds: [2, 3, 5, 6, 7] out_osds: [4, 1, 0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T05:10:41.909 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:10:41.910 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-13T05:10:41.910 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-13T05:10:41.911 INFO:teuthology.orchestra.run.smithi120.stdout:1280 read 0x9aa7b16 thru 0x9ab6fb2 (0xf49d bytes) 2024-09-13T05:10:41.922 INFO:teuthology.orchestra.run.smithi120.stdout:1281 trunc from 0xd49e788 to 0x7052fd5 2024-09-13T05:10:41.930 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:41.930 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:41.930 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:41.930 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:10:41.930 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.931 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4200 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 8339456~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:41.931 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436145+0000", 2024-09-13T05:10:41.931 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 20.490259296000001, 2024-09-13T05:10:41.931 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.018953309000000002, 2024-09-13T05:10:41.931 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:41.931 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:41.931 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:41.931 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:41.931 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.931 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4200 2024-09-13T05:10:41.931 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.931 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:41.932 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.932 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:41.932 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436145+0000", 2024-09-13T05:10:41.932 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:41.932 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.932 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.932 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:41.932 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436145+0000", 2024-09-13T05:10:41.932 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:41.932 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.933 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.933 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:41.933 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436145+0000", 2024-09-13T05:10:41.933 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:41.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.933 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.933 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:41.933 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436146+0000", 2024-09-13T05:10:41.933 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:10:41.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.933 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.934 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:41.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436149+0000", 2024-09-13T05:10:41.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1300000000000001e-06 2024-09-13T05:10:41.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.934 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.934 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436152+0000", 2024-09-13T05:10:41.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:10:41.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.934 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.934 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:41.935 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.454932+0000", 2024-09-13T05:10:41.935 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.018780429000000001 2024-09-13T05:10:41.935 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.935 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.935 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:41.935 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455039+0000", 2024-09-13T05:10:41.935 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000106925 2024-09-13T05:10:41.935 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.935 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.935 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:41.935 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455098+0000", 2024-09-13T05:10:41.936 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8983000000000001e-05 2024-09-13T05:10:41.936 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:41.936 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:41.936 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:41.936 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.936 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.936 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4206 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 6979584~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:41.936 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436154+0000", 2024-09-13T05:10:41.936 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 20.490249971000001, 2024-09-13T05:10:41.936 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019108791, 2024-09-13T05:10:41.936 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:41.937 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:41.937 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:41.937 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:41.937 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.937 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4206 2024-09-13T05:10:41.937 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.937 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:41.937 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.937 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:41.937 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436154+0000", 2024-09-13T05:10:41.937 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:41.938 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.938 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.938 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:41.938 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436154+0000", 2024-09-13T05:10:41.938 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:41.938 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.938 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.938 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:41.938 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436154+0000", 2024-09-13T05:10:41.938 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:41.938 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.938 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.938 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:41.939 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436159+0000", 2024-09-13T05:10:41.939 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.536e-06 2024-09-13T05:10:41.939 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.939 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.939 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:41.939 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436163+0000", 2024-09-13T05:10:41.939 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5030000000000002e-06 2024-09-13T05:10:41.939 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.939 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.939 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.939 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436166+0000", 2024-09-13T05:10:41.940 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3239999999999999e-06 2024-09-13T05:10:41.940 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.940 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.940 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:41.940 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455124+0000", 2024-09-13T05:10:41.940 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.018957489000000001 2024-09-13T05:10:41.940 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.940 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.940 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:41.940 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455186+0000", 2024-09-13T05:10:41.940 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2497999999999997e-05 2024-09-13T05:10:41.940 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.941 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.941 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:41.941 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455263+0000", 2024-09-13T05:10:41.941 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6675999999999996e-05 2024-09-13T05:10:41.941 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:41.941 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:41.941 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:41.941 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.941 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.941 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4209 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 6389760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:41.941 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436169+0000", 2024-09-13T05:10:41.942 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 20.490234996000002, 2024-09-13T05:10:41.942 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019313255000000001, 2024-09-13T05:10:41.942 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:41.942 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:41.942 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:41.942 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:41.942 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.942 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4209 2024-09-13T05:10:41.942 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.942 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:41.942 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.942 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:41.942 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436169+0000", 2024-09-13T05:10:41.942 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:41.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.943 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:41.943 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436169+0000", 2024-09-13T05:10:41.943 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:41.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.943 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:41.943 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436169+0000", 2024-09-13T05:10:41.943 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:41.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.944 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:41.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436170+0000", 2024-09-13T05:10:41.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.739e-06 2024-09-13T05:10:41.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.944 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:41.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436174+0000", 2024-09-13T05:10:41.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1200000000000004e-06 2024-09-13T05:10:41.945 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.945 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.945 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.945 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436178+0000", 2024-09-13T05:10:41.945 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2499999999999998e-06 2024-09-13T05:10:41.945 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.945 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.945 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:41.946 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455311+0000", 2024-09-13T05:10:41.946 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019133407000000002 2024-09-13T05:10:41.946 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.946 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.946 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:41.946 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455366+0000", 2024-09-13T05:10:41.946 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4982999999999999e-05 2024-09-13T05:10:41.946 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.946 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.946 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:41.946 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455482+0000", 2024-09-13T05:10:41.947 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000116333 2024-09-13T05:10:41.947 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:41.947 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:41.947 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:41.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.947 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.947 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4214 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 6782976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:41.947 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436194+0000", 2024-09-13T05:10:41.947 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 20.490210312999999, 2024-09-13T05:10:41.947 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019632325999999999, 2024-09-13T05:10:41.948 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:41.948 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:41.948 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:41.948 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:41.948 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.948 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4214 2024-09-13T05:10:41.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.948 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:41.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.949 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:41.949 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436194+0000", 2024-09-13T05:10:41.949 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:41.949 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.949 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.949 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:41.949 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436194+0000", 2024-09-13T05:10:41.949 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:41.949 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.949 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.950 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:41.950 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436193+0000", 2024-09-13T05:10:41.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:41.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.950 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:41.950 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436195+0000", 2024-09-13T05:10:41.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9400000000000001e-06 2024-09-13T05:10:41.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.951 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.951 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:41.951 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436199+0000", 2024-09-13T05:10:41.951 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.014e-06 2024-09-13T05:10:41.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.951 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.951 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.951 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436203+0000", 2024-09-13T05:10:41.951 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3069999999999998e-06 2024-09-13T05:10:41.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.952 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:41.952 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455557+0000", 2024-09-13T05:10:41.952 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019354018000000001 2024-09-13T05:10:41.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.953 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:41.953 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455694+0000", 2024-09-13T05:10:41.953 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000137188 2024-09-13T05:10:41.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.953 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:41.953 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455826+0000", 2024-09-13T05:10:41.953 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013213 2024-09-13T05:10:41.953 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:41.954 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:41.954 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:41.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.954 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4216 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 7372800~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:41.954 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436212+0000", 2024-09-13T05:10:41.954 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 20.490191693, 2024-09-13T05:10:41.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019812019, 2024-09-13T05:10:41.955 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:41.955 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:41.955 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:41.955 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:41.955 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.955 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4216 2024-09-13T05:10:41.955 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.955 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:41.955 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.955 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:41.955 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436212+0000", 2024-09-13T05:10:41.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:41.956 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.956 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.956 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:41.956 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436212+0000", 2024-09-13T05:10:41.956 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:41.956 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.956 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.956 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:41.956 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436212+0000", 2024-09-13T05:10:41.956 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:41.956 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:41.957 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436220+0000", 2024-09-13T05:10:41.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.622e-06 2024-09-13T05:10:41.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:41.957 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436225+0000", 2024-09-13T05:10:41.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7989999999999999e-06 2024-09-13T05:10:41.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436229+0000", 2024-09-13T05:10:41.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5439999999999999e-06 2024-09-13T05:10:41.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:41.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455883+0000", 2024-09-13T05:10:41.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019654482000000001 2024-09-13T05:10:41.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:41.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.455954+0000", 2024-09-13T05:10:41.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0439999999999996e-05 2024-09-13T05:10:41.959 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.959 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:41.959 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456024+0000", 2024-09-13T05:10:41.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0635000000000004e-05 2024-09-13T05:10:41.959 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:41.959 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:41.959 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:41.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.960 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4218 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 7962624~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:41.960 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436232+0000", 2024-09-13T05:10:41.960 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 20.490172084000001, 2024-09-13T05:10:41.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019955836000000001, 2024-09-13T05:10:41.960 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:41.960 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:41.960 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:41.960 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:41.961 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.961 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4218 2024-09-13T05:10:41.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.961 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:41.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:41.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436232+0000", 2024-09-13T05:10:41.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:41.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:41.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436232+0000", 2024-09-13T05:10:41.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:41.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:41.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436232+0000", 2024-09-13T05:10:41.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:41.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:41.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436233+0000", 2024-09-13T05:10:41.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.564e-06 2024-09-13T05:10:41.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:41.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436237+0000", 2024-09-13T05:10:41.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2909999999999999e-06 2024-09-13T05:10:41.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436240+0000", 2024-09-13T05:10:41.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8639999999999998e-06 2024-09-13T05:10:41.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:41.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456053+0000", 2024-09-13T05:10:41.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019812729000000001 2024-09-13T05:10:41.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:41.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456111+0000", 2024-09-13T05:10:41.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8108e-05 2024-09-13T05:10:41.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:41.965 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456188+0000", 2024-09-13T05:10:41.965 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6550000000000004e-05 2024-09-13T05:10:41.965 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:41.965 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:41.965 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:41.965 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.965 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.966 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4221 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 8159232~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:41.966 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436245+0000", 2024-09-13T05:10:41.966 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 20.490158910000002, 2024-09-13T05:10:41.966 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020134613999999999, 2024-09-13T05:10:41.966 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:41.966 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:41.966 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:41.967 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:41.967 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.967 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4221 2024-09-13T05:10:41.967 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.967 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:41.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:41.967 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436245+0000", 2024-09-13T05:10:41.967 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:41.967 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:41.968 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436245+0000", 2024-09-13T05:10:41.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:41.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.968 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:41.968 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436245+0000", 2024-09-13T05:10:41.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:41.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.968 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:41.969 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436246+0000", 2024-09-13T05:10:41.969 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.519e-06 2024-09-13T05:10:41.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.969 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:41.969 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436252+0000", 2024-09-13T05:10:41.969 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2220000000000001e-06 2024-09-13T05:10:41.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.969 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.969 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436256+0000", 2024-09-13T05:10:41.969 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0690000000000003e-06 2024-09-13T05:10:41.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:41.970 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456249+0000", 2024-09-13T05:10:41.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019992942 2024-09-13T05:10:41.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.970 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:41.970 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456303+0000", 2024-09-13T05:10:41.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4366000000000001e-05 2024-09-13T05:10:41.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.970 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:41.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456380+0000", 2024-09-13T05:10:41.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6761000000000006e-05 2024-09-13T05:10:41.971 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:41.971 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:41.971 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:41.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.971 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.971 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4223 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 7766016~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:41.971 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436336+0000", 2024-09-13T05:10:41.971 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 20.490068507, 2024-09-13T05:10:41.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020232878999999999, 2024-09-13T05:10:41.971 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:41.971 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:41.972 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:41.972 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:41.972 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.972 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4223 2024-09-13T05:10:41.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.972 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:41.972 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.972 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:41.972 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436336+0000", 2024-09-13T05:10:41.972 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:41.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.972 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:41.973 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436336+0000", 2024-09-13T05:10:41.973 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:41.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.973 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:41.973 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436335+0000", 2024-09-13T05:10:41.973 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:41.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.973 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:41.973 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436338+0000", 2024-09-13T05:10:41.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0970000000000002e-06 2024-09-13T05:10:41.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.974 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:41.974 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436345+0000", 2024-09-13T05:10:41.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6120000000000004e-06 2024-09-13T05:10:41.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.974 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.974 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436349+0000", 2024-09-13T05:10:41.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0879999999999997e-06 2024-09-13T05:10:41.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.975 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:41.975 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456416+0000", 2024-09-13T05:10:41.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020067806000000001 2024-09-13T05:10:41.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.975 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.975 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:41.975 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456487+0000", 2024-09-13T05:10:41.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0766000000000007e-05 2024-09-13T05:10:41.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.975 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.975 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:41.975 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456568+0000", 2024-09-13T05:10:41.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1186999999999994e-05 2024-09-13T05:10:41.976 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:41.976 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:41.976 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:41.976 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.976 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.976 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4225 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 8355840~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:41.976 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436354+0000", 2024-09-13T05:10:41.976 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 20.490050028999999, 2024-09-13T05:10:41.976 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020354098000000001, 2024-09-13T05:10:41.976 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:41.976 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:41.977 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:41.977 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:41.977 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.977 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4225 2024-09-13T05:10:41.977 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.977 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:41.977 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.977 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:41.977 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436354+0000", 2024-09-13T05:10:41.977 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:41.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.978 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.978 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:41.978 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436354+0000", 2024-09-13T05:10:41.978 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:41.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.978 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.978 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:41.978 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436354+0000", 2024-09-13T05:10:41.978 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:41.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.978 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:41.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436356+0000", 2024-09-13T05:10:41.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8610000000000001e-06 2024-09-13T05:10:41.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:41.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436359+0000", 2024-09-13T05:10:41.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3739999999999998e-06 2024-09-13T05:10:41.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436362+0000", 2024-09-13T05:10:41.980 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2839999999999998e-06 2024-09-13T05:10:41.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.980 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.980 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:41.980 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456594+0000", 2024-09-13T05:10:41.980 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020231438000000001 2024-09-13T05:10:41.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.980 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.980 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:41.980 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456644+0000", 2024-09-13T05:10:41.980 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0424999999999999e-05 2024-09-13T05:10:41.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.981 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:41.981 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456708+0000", 2024-09-13T05:10:41.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3987999999999998e-05 2024-09-13T05:10:41.981 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:41.981 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:41.981 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:41.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.981 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4229 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 6406144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:41.981 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436702+0000", 2024-09-13T05:10:41.982 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 20.489701783000001, 2024-09-13T05:10:41.982 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020157143999999998, 2024-09-13T05:10:41.982 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:41.982 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:41.982 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:41.982 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:41.982 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.982 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4229 2024-09-13T05:10:41.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.982 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:41.982 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:41.983 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436702+0000", 2024-09-13T05:10:41.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:41.983 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:41.983 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436702+0000", 2024-09-13T05:10:41.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:41.983 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:41.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436701+0000", 2024-09-13T05:10:41.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:41.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:41.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436705+0000", 2024-09-13T05:10:41.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7979999999999999e-06 2024-09-13T05:10:41.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:41.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436712+0000", 2024-09-13T05:10:41.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.516e-06 2024-09-13T05:10:41.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.985 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.985 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436716+0000", 2024-09-13T05:10:41.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0169999999999998e-06 2024-09-13T05:10:41.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:41.986 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456741+0000", 2024-09-13T05:10:41.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020025672000000001 2024-09-13T05:10:41.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:41.986 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456790+0000", 2024-09-13T05:10:41.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8894000000000003e-05 2024-09-13T05:10:41.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:41.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456859+0000", 2024-09-13T05:10:41.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9221999999999996e-05 2024-09-13T05:10:41.987 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:41.987 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:41.987 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:41.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.987 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4232 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 6995968~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:41.987 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436911+0000", 2024-09-13T05:10:41.988 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 20.489492885000001, 2024-09-13T05:10:41.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020106577, 2024-09-13T05:10:41.988 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:41.988 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:41.988 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:41.988 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:41.988 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.988 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4232 2024-09-13T05:10:41.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.989 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:41.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:41.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436911+0000", 2024-09-13T05:10:41.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:41.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:41.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436911+0000", 2024-09-13T05:10:41.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:41.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.990 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:41.990 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436910+0000", 2024-09-13T05:10:41.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:41.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.990 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:41.991 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436914+0000", 2024-09-13T05:10:41.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6260000000000001e-06 2024-09-13T05:10:41.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.991 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:41.991 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436920+0000", 2024-09-13T05:10:41.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2419999999999997e-06 2024-09-13T05:10:41.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.992 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.992 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436924+0000", 2024-09-13T05:10:41.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9899999999999999e-06 2024-09-13T05:10:41.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.992 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:41.992 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456888+0000", 2024-09-13T05:10:41.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019964161000000001 2024-09-13T05:10:41.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:41.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.456938+0000", 2024-09-13T05:10:41.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9505999999999997e-05 2024-09-13T05:10:41.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:41.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457018+0000", 2024-09-13T05:10:41.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9908999999999997e-05 2024-09-13T05:10:41.994 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:41.994 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:41.994 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:41.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.994 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4235 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 7192576~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:41.995 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.436962+0000", 2024-09-13T05:10:41.995 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 20.489441790000001, 2024-09-13T05:10:41.995 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020327004999999999, 2024-09-13T05:10:41.995 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:41.995 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:41.995 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:41.995 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:41.996 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:41.996 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4235 2024-09-13T05:10:41.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.996 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:41.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:41.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436962+0000", 2024-09-13T05:10:41.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:41.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:41.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436962+0000", 2024-09-13T05:10:41.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:41.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:41.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436962+0000", 2024-09-13T05:10:41.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:41.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:41.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436978+0000", 2024-09-13T05:10:41.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6699999999999999e-05 2024-09-13T05:10:41.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:41.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436984+0000", 2024-09-13T05:10:41.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0809999999999999e-06 2024-09-13T05:10:41.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:41.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.436999+0000", 2024-09-13T05:10:41.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4790000000000001e-05 2024-09-13T05:10:41.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:41.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:41.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:41.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457058+0000", 2024-09-13T05:10:41.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020058498000000001 2024-09-13T05:10:42.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.000 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457168+0000", 2024-09-13T05:10:42.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011000799999999999 2024-09-13T05:10:42.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.000 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457289+0000", 2024-09-13T05:10:42.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000121641 2024-09-13T05:10:42.000 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.000 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.001 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.001 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4240 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 6799360~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:42.001 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.437091+0000", 2024-09-13T05:10:42.001 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 20.489313497000001, 2024-09-13T05:10:42.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020515418000000001, 2024-09-13T05:10:42.001 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.001 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.001 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.001 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.001 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.002 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4240 2024-09-13T05:10:42.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.002 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437091+0000", 2024-09-13T05:10:42.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437091+0000", 2024-09-13T05:10:42.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437090+0000", 2024-09-13T05:10:42.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:42.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437094+0000", 2024-09-13T05:10:42.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5580000000000002e-06 2024-09-13T05:10:42.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.004 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.004 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437101+0000", 2024-09-13T05:10:42.004 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2060000000000001e-06 2024-09-13T05:10:42.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.004 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.004 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437106+0000", 2024-09-13T05:10:42.004 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7899999999999999e-06 2024-09-13T05:10:42.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.005 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457332+0000", 2024-09-13T05:10:42.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020226361000000002 2024-09-13T05:10:42.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.005 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457436+0000", 2024-09-13T05:10:42.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000103799 2024-09-13T05:10:42.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.005 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457606+0000", 2024-09-13T05:10:42.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016975399999999999 2024-09-13T05:10:42.006 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.006 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.006 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.006 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4242 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 7389184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:42.006 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.437304+0000", 2024-09-13T05:10:42.006 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 20.489099595999999, 2024-09-13T05:10:42.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020577726000000001, 2024-09-13T05:10:42.006 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.007 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.007 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.007 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.007 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.007 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4242 2024-09-13T05:10:42.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.007 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437304+0000", 2024-09-13T05:10:42.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.008 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.008 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437304+0000", 2024-09-13T05:10:42.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.008 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.008 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437304+0000", 2024-09-13T05:10:42.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:42.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.009 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.009 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437307+0000", 2024-09-13T05:10:42.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.817e-06 2024-09-13T05:10:42.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.009 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.009 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437314+0000", 2024-09-13T05:10:42.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8689999999999998e-06 2024-09-13T05:10:42.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.010 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437319+0000", 2024-09-13T05:10:42.010 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5220000000000001e-06 2024-09-13T05:10:42.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.010 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457646+0000", 2024-09-13T05:10:42.010 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020327293999999999 2024-09-13T05:10:42.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.011 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457768+0000", 2024-09-13T05:10:42.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000121705 2024-09-13T05:10:42.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.011 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.011 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457882+0000", 2024-09-13T05:10:42.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000114409 2024-09-13T05:10:42.011 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.011 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.011 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.012 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4244 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 7979008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:42.012 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.437361+0000", 2024-09-13T05:10:42.012 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 20.489042948000002, 2024-09-13T05:10:42.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020766765999999999, 2024-09-13T05:10:42.012 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.012 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.012 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.012 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.012 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.012 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4244 2024-09-13T05:10:42.012 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.013 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437361+0000", 2024-09-13T05:10:42.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437361+0000", 2024-09-13T05:10:42.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.014 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.014 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437360+0000", 2024-09-13T05:10:42.014 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:42.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.014 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.014 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437363+0000", 2024-09-13T05:10:42.014 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9160000000000001e-06 2024-09-13T05:10:42.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437370+0000", 2024-09-13T05:10:42.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2859999999999996e-06 2024-09-13T05:10:42.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437375+0000", 2024-09-13T05:10:42.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3619999999999997e-06 2024-09-13T05:10:42.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.016 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.457918+0000", 2024-09-13T05:10:42.016 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020542826 2024-09-13T05:10:42.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.016 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.016 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458008+0000", 2024-09-13T05:10:42.016 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9862000000000001e-05 2024-09-13T05:10:42.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.017 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.017 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458128+0000", 2024-09-13T05:10:42.017 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000120202 2024-09-13T05:10:42.017 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.017 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.017 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.017 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.017 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4247 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 8175616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:42.017 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.437466+0000", 2024-09-13T05:10:42.018 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 20.488938230999999, 2024-09-13T05:10:42.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020852763, 2024-09-13T05:10:42.018 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.018 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.018 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.018 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.018 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.018 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4247 2024-09-13T05:10:42.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.019 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437466+0000", 2024-09-13T05:10:42.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437466+0000", 2024-09-13T05:10:42.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.020 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.020 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437465+0000", 2024-09-13T05:10:42.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:42.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.020 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.020 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437468+0000", 2024-09-13T05:10:42.021 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1990000000000002e-06 2024-09-13T05:10:42.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.021 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.021 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437474+0000", 2024-09-13T05:10:42.021 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.113e-06 2024-09-13T05:10:42.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.021 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437479+0000", 2024-09-13T05:10:42.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.13e-06 2024-09-13T05:10:42.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458172+0000", 2024-09-13T05:10:42.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020692954 2024-09-13T05:10:42.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458237+0000", 2024-09-13T05:10:42.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5434999999999999e-05 2024-09-13T05:10:42.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458319+0000", 2024-09-13T05:10:42.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1542e-05 2024-09-13T05:10:42.024 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.024 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.024 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.024 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4249 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 7782400~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:42.024 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.437538+0000", 2024-09-13T05:10:42.024 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 20.488865786000002, 2024-09-13T05:10:42.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020997966, 2024-09-13T05:10:42.025 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.025 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.025 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.025 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.025 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.025 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4249 2024-09-13T05:10:42.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.026 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.026 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.026 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437538+0000", 2024-09-13T05:10:42.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.027 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.027 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437538+0000", 2024-09-13T05:10:42.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.027 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.027 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437537+0000", 2024-09-13T05:10:42.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:42.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.028 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437548+0000", 2024-09-13T05:10:42.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0713999999999999e-05 2024-09-13T05:10:42.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.028 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437564+0000", 2024-09-13T05:10:42.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5644000000000001e-05 2024-09-13T05:10:42.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437569+0000", 2024-09-13T05:10:42.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7910000000000001e-06 2024-09-13T05:10:42.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458360+0000", 2024-09-13T05:10:42.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020790854000000001 2024-09-13T05:10:42.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458466+0000", 2024-09-13T05:10:42.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010558 2024-09-13T05:10:42.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.030 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458536+0000", 2024-09-13T05:10:42.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0408999999999996e-05 2024-09-13T05:10:42.030 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.030 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.030 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.030 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4251 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 8372224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:42.030 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.437628+0000", 2024-09-13T05:10:42.031 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 20.488775894, 2024-09-13T05:10:42.031 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.021109941, 2024-09-13T05:10:42.031 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.031 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.031 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.031 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.031 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.031 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4251 2024-09-13T05:10:42.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.031 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437628+0000", 2024-09-13T05:10:42.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437628+0000", 2024-09-13T05:10:42.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437627+0000", 2024-09-13T05:10:42.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:42.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437631+0000", 2024-09-13T05:10:42.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8099999999999999e-06 2024-09-13T05:10:42.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437637+0000", 2024-09-13T05:10:42.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5720000000000002e-06 2024-09-13T05:10:42.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.437641+0000", 2024-09-13T05:10:42.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0010000000000003e-06 2024-09-13T05:10:42.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.035 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458561+0000", 2024-09-13T05:10:42.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.02091991 2024-09-13T05:10:42.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.035 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458623+0000", 2024-09-13T05:10:42.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2855999999999996e-05 2024-09-13T05:10:42.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.036 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458738+0000", 2024-09-13T05:10:42.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000114751 2024-09-13T05:10:42.036 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.036 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.036 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.036 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.036 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.036 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:4254 3.16 3:6d3b5aca:::rbd_data.112d318cd671.0000000000000001:6 [read 7176192~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:42.036 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:21.439888+0000", 2024-09-13T05:10:42.036 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 20.48651589, 2024-09-13T05:10:42.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019045896999999999, 2024-09-13T05:10:42.037 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.037 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.037 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.037 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.037 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.037 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 4254 2024-09-13T05:10:42.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.037 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.037 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.037 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.439888+0000", 2024-09-13T05:10:42.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.439888+0000", 2024-09-13T05:10:42.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.439887+0000", 2024-09-13T05:10:42.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:42.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.439894+0000", 2024-09-13T05:10:42.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6890000000000004e-06 2024-09-13T05:10:42.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.439909+0000", 2024-09-13T05:10:42.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4433000000000001e-05 2024-09-13T05:10:42.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.439918+0000", 2024-09-13T05:10:42.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2969999999999992e-06 2024-09-13T05:10:42.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458762+0000", 2024-09-13T05:10:42.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.018843407999999999 2024-09-13T05:10:42.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.041 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.041 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458866+0000", 2024-09-13T05:10:42.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000104314 2024-09-13T05:10:42.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.041 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.041 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.041 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:21.458934+0000", 2024-09-13T05:10:42.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8165999999999998e-05 2024-09-13T05:10:42.041 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.041 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.041 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.042 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:7867 3.1c 3:3af80b2f:::rbd_data.112db57f3a18.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-13T05:10:42.042 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:25.873439+0000", 2024-09-13T05:10:42.042 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 16.052965487000002, 2024-09-13T05:10:42.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.021501498000000001, 2024-09-13T05:10:42.042 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.042 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:42.042 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.042 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.042 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.043 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 7867 2024-09-13T05:10:42.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.043 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.873439+0000", 2024-09-13T05:10:42.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.873439+0000", 2024-09-13T05:10:42.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.873437+0000", 2024-09-13T05:10:42.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:42.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.878315+0000", 2024-09-13T05:10:42.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0048783530000000002 2024-09-13T05:10:42.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.878348+0000", 2024-09-13T05:10:42.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3420000000000002e-05 2024-09-13T05:10:42.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.878362+0000", 2024-09-13T05:10:42.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3784999999999999e-05 2024-09-13T05:10:42.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.046 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.878510+0000", 2024-09-13T05:10:42.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014806699999999999 2024-09-13T05:10:42.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.046 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.046 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.878727+0000", 2024-09-13T05:10:42.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000216935 2024-09-13T05:10:42.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.046 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:42.046 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.879100+0000", 2024-09-13T05:10:42.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00037323800000000002 2024-09-13T05:10:42.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:42.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.892006+0000", 2024-09-13T05:10:42.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012905585000000001 2024-09-13T05:10:42.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:42.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.894853+0000", 2024-09-13T05:10:42.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002846711 2024-09-13T05:10:42.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:42.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.894901+0000", 2024-09-13T05:10:42.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8758999999999999e-05 2024-09-13T05:10:42.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:25.894940+0000", 2024-09-13T05:10:42.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8708000000000003e-05 2024-09-13T05:10:42.048 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.049 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.049 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.049 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.049 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.049 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:42.050 INFO:teuthology.orchestra.run.smithi120.stdout:1282 read 0x52bc301 thru 0x52c9bda (0xd8da bytes) 2024-09-13T05:10:42.051 INFO:teuthology.orchestra.run.smithi120.stdout:1284 trunc from 0x7052fd5 to 0xab49a7c 2024-09-13T05:10:42.051 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:42.051 INFO:teuthology.orchestra.run.smithi120.stdout:1287 clone 11 order 23 su 1048576 sc 5 2024-09-13T05:10:42.051 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:10:42.052 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:42.046+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:42.151 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:42.146+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:42.208 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:42.208 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:42.208 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:42.208 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:42.217 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:10:42.217 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:42.217 INFO:teuthology.orchestra.run.smithi120.stdout: "epoch": 51, 2024-09-13T05:10:42.217 INFO:teuthology.orchestra.run.smithi120.stdout: "fsid": "0a3759da-62bd-4704-8a4a-7c20eb3fc816", 2024-09-13T05:10:42.217 INFO:teuthology.orchestra.run.smithi120.stdout: "created": "2024-09-13T05:09:38.849186+0000", 2024-09-13T05:10:42.217 INFO:teuthology.orchestra.run.smithi120.stdout: "modified": "2024-09-13T05:10:41.880244+0000", 2024-09-13T05:10:42.217 INFO:teuthology.orchestra.run.smithi120.stdout: "last_up_change": "2024-09-13T05:09:51.283212+0000", 2024-09-13T05:10:42.217 INFO:teuthology.orchestra.run.smithi120.stdout: "last_in_change": "2024-09-13T05:10:36.835155+0000", 2024-09-13T05:10:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T05:10:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_num": 5799936, 2024-09-13T05:10:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_set": [ 2024-09-13T05:10:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: "pglog_hardlimit", 2024-09-13T05:10:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: "purged_snapdirs", 2024-09-13T05:10:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: "recovery_deletes", 2024-09-13T05:10:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: "sortbitwise" 2024-09-13T05:10:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:10:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_version": 4, 2024-09-13T05:10:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: "full_ratio": 0.94999998807907104, 2024-09-13T05:10:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-13T05:10:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-13T05:10:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_snapshot": "", 2024-09-13T05:10:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_max": 3, 2024-09-13T05:10:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: "max_osd": 8, 2024-09-13T05:10:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: "require_min_compat_client": "luminous", 2024-09-13T05:10:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: "min_compat_client": "jewel", 2024-09-13T05:10:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: "require_osd_release": "reef", 2024-09-13T05:10:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: "allow_crimson": false, 2024-09-13T05:10:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: "pools": [ 2024-09-13T05:10:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: "pool": 1, 2024-09-13T05:10:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": ".mgr", 2024-09-13T05:10:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: "create_time": "2024-09-13T05:09:52.225455+0000", 2024-09-13T05:10:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-13T05:10:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_names": "hashpspool", 2024-09-13T05:10:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: "type": 1, 2024-09-13T05:10:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 2, 2024-09-13T05:10:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": 1, 2024-09-13T05:10:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_rule": 0, 2024-09-13T05:10:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_count": 0, 2024-09-13T05:10:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_target": 0, 2024-09-13T05:10:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T05:10:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T05:10:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: "object_hash": 2, 2024-09-13T05:10:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscale_mode": "off", 2024-09-13T05:10:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": 1, 2024-09-13T05:10:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num": 1, 2024-09-13T05:10:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num_target": 1, 2024-09-13T05:10:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_target": 1, 2024-09-13T05:10:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_pending": 1, 2024-09-13T05:10:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: "last_pg_merge_meta": { 2024-09-13T05:10:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: "source_pgid": "0.0", 2024-09-13T05:10:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: "ready_epoch": 0, 2024-09-13T05:10:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_started": 0, 2024-09-13T05:10:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_clean": 0, 2024-09-13T05:10:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: "source_version": "0'0", 2024-09-13T05:10:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: "target_version": "0'0" 2024-09-13T05:10:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: "last_change": "16", 2024-09-13T05:10:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend": "0", 2024-09-13T05:10:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T05:10:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T05:10:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: "auid": 0, 2024-09-13T05:10:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_mode": "selfmanaged", 2024-09-13T05:10:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_seq": 0, 2024-09-13T05:10:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_epoch": 0, 2024-09-13T05:10:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_snaps": [], 2024-09-13T05:10:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: "removed_snaps": "[]", 2024-09-13T05:10:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_bytes": 0, 2024-09-13T05:10:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_objects": 0, 2024-09-13T05:10:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: "tiers": [], 2024-09-13T05:10:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: "tier_of": -1, 2024-09-13T05:10:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: "read_tier": -1, 2024-09-13T05:10:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: "write_tier": -1, 2024-09-13T05:10:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_mode": "none", 2024-09-13T05:10:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_bytes": 0, 2024-09-13T05:10:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_objects": 0, 2024-09-13T05:10:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T05:10:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T05:10:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T05:10:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_flush_age": 0, 2024-09-13T05:10:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_evict_age": 0, 2024-09-13T05:10:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_profile": "", 2024-09-13T05:10:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_params": { 2024-09-13T05:10:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "none" 2024-09-13T05:10:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_period": 0, 2024-09-13T05:10:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_count": 0, 2024-09-13T05:10:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: "use_gmt_hitset": true, 2024-09-13T05:10:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: "min_read_recency_for_promote": 0, 2024-09-13T05:10:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: "min_write_recency_for_promote": 0, 2024-09-13T05:10:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T05:10:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_search_last_n": 0, 2024-09-13T05:10:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: "grade_table": [], 2024-09-13T05:10:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: "stripe_width": 0, 2024-09-13T05:10:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: "expected_num_objects": 0, 2024-09-13T05:10:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: "fast_read": false, 2024-09-13T05:10:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: "options": { 2024-09-13T05:10:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_max": 32, 2024-09-13T05:10:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_min": 1 2024-09-13T05:10:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: "application_metadata": { 2024-09-13T05:10:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": {} 2024-09-13T05:10:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: "read_balance": { 2024-09-13T05:10:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: "score_acting": 8, 2024-09-13T05:10:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: "score_stable": 8, 2024-09-13T05:10:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: "optimal_score": 0.25, 2024-09-13T05:10:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_acting": 2, 2024-09-13T05:10:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_stable": 2, 2024-09-13T05:10:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity_weighted": 1, 2024-09-13T05:10:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity": 1, 2024-09-13T05:10:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity_weighted": 1 2024-09-13T05:10:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: "pool": 2, 2024-09-13T05:10:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": "rbd", 2024-09-13T05:10:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: "create_time": "2024-09-13T05:09:57.858552+0000", 2024-09-13T05:10:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 8193, 2024-09-13T05:10:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T05:10:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: "type": 1, 2024-09-13T05:10:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 2, 2024-09-13T05:10:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": 1, 2024-09-13T05:10:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_rule": 0, 2024-09-13T05:10:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_count": 0, 2024-09-13T05:10:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_target": 0, 2024-09-13T05:10:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T05:10:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T05:10:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: "object_hash": 2, 2024-09-13T05:10:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscale_mode": "off", 2024-09-13T05:10:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": 8, 2024-09-13T05:10:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num": 8, 2024-09-13T05:10:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num_target": 8, 2024-09-13T05:10:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_target": 8, 2024-09-13T05:10:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_pending": 8, 2024-09-13T05:10:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: "last_pg_merge_meta": { 2024-09-13T05:10:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: "source_pgid": "0.0", 2024-09-13T05:10:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: "ready_epoch": 0, 2024-09-13T05:10:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_started": 0, 2024-09-13T05:10:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_clean": 0, 2024-09-13T05:10:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: "source_version": "0'0", 2024-09-13T05:10:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: "target_version": "0'0" 2024-09-13T05:10:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: "last_change": "20", 2024-09-13T05:10:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend": "0", 2024-09-13T05:10:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T05:10:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T05:10:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: "auid": 0, 2024-09-13T05:10:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_mode": "selfmanaged", 2024-09-13T05:10:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_seq": 3, 2024-09-13T05:10:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_epoch": 20, 2024-09-13T05:10:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_snaps": [], 2024-09-13T05:10:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: "removed_snaps": "[]", 2024-09-13T05:10:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_bytes": 0, 2024-09-13T05:10:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_objects": 0, 2024-09-13T05:10:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: "tiers": [], 2024-09-13T05:10:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: "tier_of": -1, 2024-09-13T05:10:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: "read_tier": -1, 2024-09-13T05:10:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: "write_tier": -1, 2024-09-13T05:10:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_mode": "none", 2024-09-13T05:10:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_bytes": 0, 2024-09-13T05:10:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_objects": 0, 2024-09-13T05:10:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T05:10:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T05:10:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T05:10:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_flush_age": 0, 2024-09-13T05:10:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_evict_age": 0, 2024-09-13T05:10:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_profile": "", 2024-09-13T05:10:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_params": { 2024-09-13T05:10:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "none" 2024-09-13T05:10:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_period": 0, 2024-09-13T05:10:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_count": 0, 2024-09-13T05:10:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: "use_gmt_hitset": true, 2024-09-13T05:10:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: "min_read_recency_for_promote": 0, 2024-09-13T05:10:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: "min_write_recency_for_promote": 0, 2024-09-13T05:10:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T05:10:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_search_last_n": 0, 2024-09-13T05:10:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: "grade_table": [], 2024-09-13T05:10:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: "stripe_width": 0, 2024-09-13T05:10:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: "expected_num_objects": 0, 2024-09-13T05:10:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: "fast_read": false, 2024-09-13T05:10:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: "options": {}, 2024-09-13T05:10:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: "application_metadata": { 2024-09-13T05:10:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd": {} 2024-09-13T05:10:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: "read_balance": { 2024-09-13T05:10:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: "score_acting": 2.9800000190734863, 2024-09-13T05:10:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: "score_stable": 2.9800000190734863, 2024-09-13T05:10:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: "optimal_score": 0.62999999523162842, 2024-09-13T05:10:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_acting": 1.8799999952316284, 2024-09-13T05:10:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_stable": 1.8799999952316284, 2024-09-13T05:10:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity_weighted": 1, 2024-09-13T05:10:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity": 1, 2024-09-13T05:10:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity_weighted": 1 2024-09-13T05:10:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: "pool": 3, 2024-09-13T05:10:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": "pool_client.0", 2024-09-13T05:10:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: "create_time": "2024-09-13T05:10:07.742110+0000", 2024-09-13T05:10:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 8193, 2024-09-13T05:10:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T05:10:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: "type": 1, 2024-09-13T05:10:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 2, 2024-09-13T05:10:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": 1, 2024-09-13T05:10:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_rule": 0, 2024-09-13T05:10:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_count": 0, 2024-09-13T05:10:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_target": 0, 2024-09-13T05:10:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T05:10:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T05:10:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: "object_hash": 2, 2024-09-13T05:10:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscale_mode": "off", 2024-09-13T05:10:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": 32, 2024-09-13T05:10:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num": 32, 2024-09-13T05:10:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num_target": 32, 2024-09-13T05:10:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_target": 32, 2024-09-13T05:10:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_pending": 32, 2024-09-13T05:10:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: "last_pg_merge_meta": { 2024-09-13T05:10:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: "source_pgid": "0.0", 2024-09-13T05:10:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: "ready_epoch": 0, 2024-09-13T05:10:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_started": 0, 2024-09-13T05:10:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_clean": 0, 2024-09-13T05:10:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: "source_version": "0'0", 2024-09-13T05:10:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: "target_version": "0'0" 2024-09-13T05:10:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: "last_change": "48", 2024-09-13T05:10:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend": "0", 2024-09-13T05:10:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T05:10:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T05:10:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: "auid": 0, 2024-09-13T05:10:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_mode": "selfmanaged", 2024-09-13T05:10:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_seq": 13, 2024-09-13T05:10:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_epoch": 48, 2024-09-13T05:10:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_snaps": [], 2024-09-13T05:10:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: "removed_snaps": "[]", 2024-09-13T05:10:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_bytes": 0, 2024-09-13T05:10:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_objects": 0, 2024-09-13T05:10:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: "tiers": [], 2024-09-13T05:10:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: "tier_of": -1, 2024-09-13T05:10:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: "read_tier": -1, 2024-09-13T05:10:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: "write_tier": -1, 2024-09-13T05:10:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_mode": "none", 2024-09-13T05:10:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_bytes": 0, 2024-09-13T05:10:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_objects": 0, 2024-09-13T05:10:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T05:10:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T05:10:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T05:10:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_flush_age": 0, 2024-09-13T05:10:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_evict_age": 0, 2024-09-13T05:10:42.236 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_profile": "", 2024-09-13T05:10:42.236 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_params": { 2024-09-13T05:10:42.236 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "none" 2024-09-13T05:10:42.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.236 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_period": 0, 2024-09-13T05:10:42.236 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_count": 0, 2024-09-13T05:10:42.236 INFO:teuthology.orchestra.run.smithi120.stdout: "use_gmt_hitset": true, 2024-09-13T05:10:42.236 INFO:teuthology.orchestra.run.smithi120.stdout: "min_read_recency_for_promote": 0, 2024-09-13T05:10:42.236 INFO:teuthology.orchestra.run.smithi120.stdout: "min_write_recency_for_promote": 0, 2024-09-13T05:10:42.236 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T05:10:42.236 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_search_last_n": 0, 2024-09-13T05:10:42.236 INFO:teuthology.orchestra.run.smithi120.stdout: "grade_table": [], 2024-09-13T05:10:42.236 INFO:teuthology.orchestra.run.smithi120.stdout: "stripe_width": 0, 2024-09-13T05:10:42.236 INFO:teuthology.orchestra.run.smithi120.stdout: "expected_num_objects": 0, 2024-09-13T05:10:42.237 INFO:teuthology.orchestra.run.smithi120.stdout: "fast_read": false, 2024-09-13T05:10:42.237 INFO:teuthology.orchestra.run.smithi120.stdout: "options": {}, 2024-09-13T05:10:42.237 INFO:teuthology.orchestra.run.smithi120.stdout: "application_metadata": { 2024-09-13T05:10:42.237 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd": {} 2024-09-13T05:10:42.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.237 INFO:teuthology.orchestra.run.smithi120.stdout: "read_balance": { 2024-09-13T05:10:42.237 INFO:teuthology.orchestra.run.smithi120.stdout: "score_acting": 2.4800000190734863, 2024-09-13T05:10:42.237 INFO:teuthology.orchestra.run.smithi120.stdout: "score_stable": 2.4800000190734863, 2024-09-13T05:10:42.237 INFO:teuthology.orchestra.run.smithi120.stdout: "optimal_score": 0.62999999523162842, 2024-09-13T05:10:42.237 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_acting": 1.559999942779541, 2024-09-13T05:10:42.237 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_stable": 1.559999942779541, 2024-09-13T05:10:42.237 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity_weighted": 1, 2024-09-13T05:10:42.237 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity": 1, 2024-09-13T05:10:42.238 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity_weighted": 1 2024-09-13T05:10:42.238 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.238 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.238 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:10:42.238 INFO:teuthology.orchestra.run.smithi120.stdout: "osds": [ 2024-09-13T05:10:42.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.238 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 0, 2024-09-13T05:10:42.238 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "b304ec03-bb00-4b13-bf2d-71017b8a70a3", 2024-09-13T05:10:42.238 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:10:42.238 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 0, 2024-09-13T05:10:42.238 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 0, 2024-09-13T05:10:42.238 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:10:42.238 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:10:42.239 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:10:42.239 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:10:42.239 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 40, 2024-09-13T05:10:42.239 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:10:42.239 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:10:42.239 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:10:42.239 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.239 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.239 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6800", 2024-09-13T05:10:42.239 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3487103682 2024-09-13T05:10:42.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.239 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.240 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6801", 2024-09-13T05:10:42.240 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3487103682 2024-09-13T05:10:42.240 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.240 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.240 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:10:42.240 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.240 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.240 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6802", 2024-09-13T05:10:42.240 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3487103682 2024-09-13T05:10:42.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.241 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.241 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6803", 2024-09-13T05:10:42.241 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3487103682 2024-09-13T05:10:42.241 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.241 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.241 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:10:42.241 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.241 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.241 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6806", 2024-09-13T05:10:42.241 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3487103682 2024-09-13T05:10:42.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.242 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.242 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6807", 2024-09-13T05:10:42.242 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3487103682 2024-09-13T05:10:42.242 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.242 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.242 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:10:42.242 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.242 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.242 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6804", 2024-09-13T05:10:42.242 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3487103682 2024-09-13T05:10:42.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.243 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.243 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6805", 2024-09-13T05:10:42.243 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3487103682 2024-09-13T05:10:42.243 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.243 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.243 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.120:6801/3487103682", 2024-09-13T05:10:42.243 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.120:6803/3487103682", 2024-09-13T05:10:42.243 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.120:6807/3487103682", 2024-09-13T05:10:42.243 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.120:6805/3487103682", 2024-09-13T05:10:42.243 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:10:42.243 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:10:42.244 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:10:42.244 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.244 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 1, 2024-09-13T05:10:42.244 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "c09e84f3-3a70-46a4-b67b-c9bb52c887b7", 2024-09-13T05:10:42.244 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:10:42.244 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 0, 2024-09-13T05:10:42.244 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 0, 2024-09-13T05:10:42.244 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:10:42.244 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:10:42.244 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:10:42.244 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:10:42.244 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 22, 2024-09-13T05:10:42.245 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:10:42.245 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:10:42.245 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:10:42.245 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.245 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.245 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6808", 2024-09-13T05:10:42.245 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:10:42.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.245 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.245 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6809", 2024-09-13T05:10:42.245 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:10:42.246 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.246 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.246 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:10:42.246 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.246 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.246 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6810", 2024-09-13T05:10:42.246 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:10:42.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.246 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.246 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6811", 2024-09-13T05:10:42.246 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:10:42.247 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.247 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.247 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:10:42.247 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.247 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.247 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6814", 2024-09-13T05:10:42.247 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:10:42.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.247 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.247 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6815", 2024-09-13T05:10:42.247 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:10:42.248 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.248 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.248 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:10:42.248 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.248 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.248 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6812", 2024-09-13T05:10:42.248 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:10:42.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.248 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.248 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6813", 2024-09-13T05:10:42.249 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:10:42.249 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.249 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.249 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.120:6809/1023532100", 2024-09-13T05:10:42.249 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.120:6811/1023532100", 2024-09-13T05:10:42.249 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.120:6815/1023532100", 2024-09-13T05:10:42.249 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.120:6813/1023532100", 2024-09-13T05:10:42.249 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:10:42.249 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:10:42.249 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:10:42.249 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.250 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 2, 2024-09-13T05:10:42.250 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "3c2a0458-369c-4dac-90a3-fb20cb70d53f", 2024-09-13T05:10:42.250 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:10:42.250 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:10:42.250 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:10:42.250 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:10:42.250 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:10:42.250 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:10:42.250 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:10:42.250 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 46, 2024-09-13T05:10:42.250 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:10:42.250 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:10:42.250 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:10:42.250 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.251 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.251 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6816", 2024-09-13T05:10:42.251 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:10:42.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.251 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.251 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6817", 2024-09-13T05:10:42.251 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:10:42.251 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.251 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.251 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:10:42.251 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.252 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.252 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6818", 2024-09-13T05:10:42.252 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:10:42.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.252 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.252 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6819", 2024-09-13T05:10:42.252 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:10:42.252 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.252 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.252 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:10:42.253 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.253 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.253 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6822", 2024-09-13T05:10:42.253 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:10:42.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.253 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.253 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6823", 2024-09-13T05:10:42.253 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:10:42.253 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.253 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.253 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:10:42.254 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.254 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.254 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6820", 2024-09-13T05:10:42.254 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:10:42.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.254 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.254 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6821", 2024-09-13T05:10:42.254 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:10:42.254 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.254 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.255 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.120:6817/592498012", 2024-09-13T05:10:42.255 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.120:6819/592498012", 2024-09-13T05:10:42.255 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.120:6823/592498012", 2024-09-13T05:10:42.255 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.120:6821/592498012", 2024-09-13T05:10:42.255 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:10:42.255 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:10:42.255 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:10:42.255 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.255 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 3, 2024-09-13T05:10:42.255 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "edce3757-5e9d-4221-a1f1-3f356bb5218b", 2024-09-13T05:10:42.255 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:10:42.255 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:10:42.256 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:10:42.256 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:10:42.256 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:10:42.256 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:10:42.256 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:10:42.256 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 46, 2024-09-13T05:10:42.256 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:10:42.256 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:10:42.256 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:10:42.256 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.256 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.256 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6824", 2024-09-13T05:10:42.257 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:10:42.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.257 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.257 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6825", 2024-09-13T05:10:42.257 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:10:42.257 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.257 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.257 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:10:42.257 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.257 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.258 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6826", 2024-09-13T05:10:42.258 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:10:42.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.258 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.258 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6827", 2024-09-13T05:10:42.258 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:10:42.258 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.258 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.258 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:10:42.258 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.258 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.259 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6830", 2024-09-13T05:10:42.259 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:10:42.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.259 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.259 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6831", 2024-09-13T05:10:42.259 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:10:42.259 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.259 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.259 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:10:42.259 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.259 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.260 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6828", 2024-09-13T05:10:42.260 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:10:42.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.260 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.260 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6829", 2024-09-13T05:10:42.260 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:10:42.260 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.260 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.260 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.120:6825/1939753938", 2024-09-13T05:10:42.260 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.120:6827/1939753938", 2024-09-13T05:10:42.260 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.120:6831/1939753938", 2024-09-13T05:10:42.261 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.120:6829/1939753938", 2024-09-13T05:10:42.261 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:10:42.261 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:10:42.261 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:10:42.261 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.261 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 4, 2024-09-13T05:10:42.261 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "5fe378d2-578f-41ea-980a-4673a8b376df", 2024-09-13T05:10:42.261 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:10:42.261 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 0, 2024-09-13T05:10:42.261 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 0, 2024-09-13T05:10:42.261 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:10:42.261 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:10:42.262 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:10:42.262 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:10:42.262 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 0, 2024-09-13T05:10:42.262 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:10:42.262 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:10:42.262 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:10:42.262 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.262 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.262 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6824", 2024-09-13T05:10:42.262 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:10:42.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.262 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.263 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6825", 2024-09-13T05:10:42.263 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:10:42.263 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.263 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.263 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:10:42.263 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.263 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.263 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6826", 2024-09-13T05:10:42.263 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:10:42.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.263 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.264 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6827", 2024-09-13T05:10:42.264 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:10:42.264 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.264 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.264 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:10:42.264 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.264 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.264 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6830", 2024-09-13T05:10:42.264 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:10:42.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.264 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.265 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6831", 2024-09-13T05:10:42.265 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:10:42.265 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.265 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.265 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:10:42.265 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.265 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.265 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6828", 2024-09-13T05:10:42.265 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:10:42.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.265 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.266 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6829", 2024-09-13T05:10:42.266 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:10:42.266 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.266 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.266 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.137:6825/3005075615", 2024-09-13T05:10:42.266 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.137:6827/3005075615", 2024-09-13T05:10:42.266 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.137:6831/3005075615", 2024-09-13T05:10:42.266 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.137:6829/3005075615", 2024-09-13T05:10:42.266 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:10:42.266 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:10:42.266 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:10:42.266 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.267 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 5, 2024-09-13T05:10:42.267 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "6e6f7499-ae9e-4cb1-9db7-4d9f8fd9b257", 2024-09-13T05:10:42.267 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:10:42.267 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:10:42.267 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:10:42.267 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:10:42.267 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:10:42.267 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:10:42.267 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:10:42.267 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 46, 2024-09-13T05:10:42.267 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:10:42.267 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:10:42.268 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:10:42.268 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.268 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.268 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6800", 2024-09-13T05:10:42.268 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:10:42.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.268 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.268 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6801", 2024-09-13T05:10:42.268 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:10:42.268 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.268 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.268 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:10:42.269 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.269 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.269 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6802", 2024-09-13T05:10:42.269 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:10:42.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.269 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.269 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6803", 2024-09-13T05:10:42.269 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:10:42.269 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.269 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.269 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:10:42.270 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.270 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.270 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6806", 2024-09-13T05:10:42.270 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:10:42.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.270 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.270 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6807", 2024-09-13T05:10:42.270 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:10:42.270 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.270 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.270 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:10:42.271 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.271 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.271 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6804", 2024-09-13T05:10:42.271 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:10:42.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.271 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.271 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6805", 2024-09-13T05:10:42.271 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:10:42.271 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.271 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.272 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.137:6801/1108177522", 2024-09-13T05:10:42.272 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.137:6803/1108177522", 2024-09-13T05:10:42.272 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.137:6807/1108177522", 2024-09-13T05:10:42.272 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.137:6805/1108177522", 2024-09-13T05:10:42.272 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:10:42.272 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:10:42.272 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:10:42.272 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.272 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 6, 2024-09-13T05:10:42.272 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "e4c519e5-5df4-4d55-b12e-fbcfb1b0555c", 2024-09-13T05:10:42.272 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:10:42.273 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:10:42.273 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:10:42.273 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:10:42.273 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:10:42.273 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:10:42.273 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:10:42.273 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 46, 2024-09-13T05:10:42.273 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:10:42.273 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:10:42.273 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:10:42.273 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.273 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.274 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6816", 2024-09-13T05:10:42.274 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:10:42.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.274 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.274 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6817", 2024-09-13T05:10:42.274 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:10:42.274 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.274 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.274 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:10:42.274 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.274 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.275 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6818", 2024-09-13T05:10:42.275 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:10:42.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.275 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.275 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6819", 2024-09-13T05:10:42.275 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:10:42.275 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.275 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.275 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:10:42.275 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.276 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.276 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6822", 2024-09-13T05:10:42.276 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:10:42.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.276 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.276 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6823", 2024-09-13T05:10:42.276 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:10:42.276 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.276 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.276 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:10:42.276 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.277 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.277 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6820", 2024-09-13T05:10:42.277 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:10:42.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.277 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.277 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6821", 2024-09-13T05:10:42.277 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:10:42.277 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.277 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.277 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.137:6817/2667039053", 2024-09-13T05:10:42.277 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.137:6819/2667039053", 2024-09-13T05:10:42.278 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.137:6823/2667039053", 2024-09-13T05:10:42.278 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.137:6821/2667039053", 2024-09-13T05:10:42.278 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:10:42.278 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:10:42.278 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:10:42.278 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.278 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 7, 2024-09-13T05:10:42.278 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "914648c2-7a6c-4e66-811d-936e250638db", 2024-09-13T05:10:42.278 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:10:42.278 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:10:42.278 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:10:42.278 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:10:42.279 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:10:42.279 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:10:42.279 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:10:42.279 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 49, 2024-09-13T05:10:42.279 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:10:42.279 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:10:42.279 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:10:42.279 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.279 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.279 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6808", 2024-09-13T05:10:42.279 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:10:42.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.280 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.280 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6809", 2024-09-13T05:10:42.280 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:10:42.280 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.280 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.280 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:10:42.280 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.280 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.280 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6810", 2024-09-13T05:10:42.280 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:10:42.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.281 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.281 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6811", 2024-09-13T05:10:42.281 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:10:42.281 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.281 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.281 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:10:42.281 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.281 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.281 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6814", 2024-09-13T05:10:42.281 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:10:42.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.282 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.282 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6815", 2024-09-13T05:10:42.282 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:10:42.282 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.282 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.282 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:10:42.282 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:10:42.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.282 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:10:42.282 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6812", 2024-09-13T05:10:42.282 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:10:42.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.283 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:10:42.283 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6813", 2024-09-13T05:10:42.283 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:10:42.283 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.283 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.283 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.137:6809/993764921", 2024-09-13T05:10:42.283 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.137:6811/993764921", 2024-09-13T05:10:42.283 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.137:6815/993764921", 2024-09-13T05:10:42.283 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.137:6813/993764921", 2024-09-13T05:10:42.283 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:10:42.283 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:10:42.284 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:10:42.284 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:42.284 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.284 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:10:42.284 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_xinfo": [ 2024-09-13T05:10:42.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.284 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 0, 2024-09-13T05:10:42.284 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:10:42.284 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:10:42.284 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:10:42.284 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:10:42.284 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 65536, 2024-09-13T05:10:42.284 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:46.914820+0000", 2024-09-13T05:10:42.284 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:10:42.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.285 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 1, 2024-09-13T05:10:42.285 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:10:42.285 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:10:42.285 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:10:42.285 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:10:42.285 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 65536, 2024-09-13T05:10:42.285 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.326286+0000", 2024-09-13T05:10:42.285 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:10:42.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.285 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 2, 2024-09-13T05:10:42.286 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:10:42.286 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:10:42.286 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:10:42.286 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:10:42.286 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:10:42.286 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.147193+0000", 2024-09-13T05:10:42.286 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:10:42.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.286 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 3, 2024-09-13T05:10:42.286 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:10:42.286 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:10:42.286 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:10:42.286 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:10:42.287 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:10:42.287 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.478655+0000", 2024-09-13T05:10:42.287 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:10:42.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.287 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 4, 2024-09-13T05:10:42.287 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:10:42.287 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:10:42.287 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:10:42.287 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:10:42.288 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 65536, 2024-09-13T05:10:42.288 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.388938+0000", 2024-09-13T05:10:42.288 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:10:42.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.288 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 5, 2024-09-13T05:10:42.288 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:10:42.288 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:10:42.288 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:10:42.288 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:10:42.288 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:10:42.288 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.127175+0000", 2024-09-13T05:10:42.289 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:10:42.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.289 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 6, 2024-09-13T05:10:42.289 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:10:42.289 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:10:42.289 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:10:42.289 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:10:42.289 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:10:42.289 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.187286+0000", 2024-09-13T05:10:42.289 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:10:42.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:42.290 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 7, 2024-09-13T05:10:42.290 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:10:42.290 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:10:42.290 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:10:42.290 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:10:42.290 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:10:42.290 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:46.962119+0000", 2024-09-13T05:10:42.290 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:10:42.290 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.290 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:10:42.290 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_upmap": [], 2024-09-13T05:10:42.290 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_upmap_items": [], 2024-09-13T05:10:42.290 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_upmap_primaries": [], 2024-09-13T05:10:42.290 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_temp": [], 2024-09-13T05:10:42.291 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_temp": [], 2024-09-13T05:10:42.291 INFO:teuthology.orchestra.run.smithi120.stdout: "blocklist": {}, 2024-09-13T05:10:42.291 INFO:teuthology.orchestra.run.smithi120.stdout: "range_blocklist": {}, 2024-09-13T05:10:42.291 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_profiles": { 2024-09-13T05:10:42.291 INFO:teuthology.orchestra.run.smithi120.stdout: "default": { 2024-09-13T05:10:42.291 INFO:teuthology.orchestra.run.smithi120.stdout: "crush-failure-domain": "osd", 2024-09-13T05:10:42.291 INFO:teuthology.orchestra.run.smithi120.stdout: "k": "2", 2024-09-13T05:10:42.291 INFO:teuthology.orchestra.run.smithi120.stdout: "m": "1", 2024-09-13T05:10:42.291 INFO:teuthology.orchestra.run.smithi120.stdout: "plugin": "jerasure", 2024-09-13T05:10:42.291 INFO:teuthology.orchestra.run.smithi120.stdout: "technique": "reed_sol_van" 2024-09-13T05:10:42.291 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:42.291 INFO:teuthology.orchestra.run.smithi120.stdout: "removed_snaps_queue": [], 2024-09-13T05:10:42.291 INFO:teuthology.orchestra.run.smithi120.stdout: "new_removed_snaps": [], 2024-09-13T05:10:42.291 INFO:teuthology.orchestra.run.smithi120.stdout: "new_purged_snaps": [], 2024-09-13T05:10:42.292 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_node_flags": {}, 2024-09-13T05:10:42.292 INFO:teuthology.orchestra.run.smithi120.stdout: "device_class_flags": {}, 2024-09-13T05:10:42.292 INFO:teuthology.orchestra.run.smithi120.stdout: "stretch_mode": { 2024-09-13T05:10:42.292 INFO:teuthology.orchestra.run.smithi120.stdout: "stretch_mode_enabled": false, 2024-09-13T05:10:42.292 INFO:teuthology.orchestra.run.smithi120.stdout: "stretch_bucket_count": 0, 2024-09-13T05:10:42.292 INFO:teuthology.orchestra.run.smithi120.stdout: "degraded_stretch_mode": 0, 2024-09-13T05:10:42.292 INFO:teuthology.orchestra.run.smithi120.stdout: "recovering_stretch_mode": 0, 2024-09-13T05:10:42.292 INFO:teuthology.orchestra.run.smithi120.stdout: "stretch_mode_bucket": 0 2024-09-13T05:10:42.292 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:42.292 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:42.294 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:10:42.295 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:42.290+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:42.296 INFO:tasks.thrashosds.thrasher:j is {'epoch': 51, 'fsid': '0a3759da-62bd-4704-8a4a-7c20eb3fc816', 'created': '2024-09-13T05:09:38.849186+0000', 'modified': '2024-09-13T05:10:41.880244+0000', 'last_up_change': '2024-09-13T05:09:51.283212+0000', 'last_in_change': '2024-09-13T05:10:36.835155+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T05:09:52.225455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T05:09:57.858552+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.9800000190734863, 'score_stable': 2.9800000190734863, 'optimal_score': 0.6299999952316284, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-13T05:10:07.742110+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 13, 'snap_epoch': 48, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.4800000190734863, 'score_stable': 2.4800000190734863, 'optimal_score': 0.6299999952316284, 'raw_score_acting': 1.559999942779541, 'raw_score_stable': 1.559999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'b304ec03-bb00-4b13-bf2d-71017b8a70a3', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6800', 'nonce': 3487103682}, {'type': 'v1', 'addr': '172.21.15.120:6801', 'nonce': 3487103682}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6802', 'nonce': 3487103682}, {'type': 'v1', 'addr': '172.21.15.120:6803', 'nonce': 3487103682}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6806', 'nonce': 3487103682}, {'type': 'v1', 'addr': '172.21.15.120:6807', 'nonce': 3487103682}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6804', 'nonce': 3487103682}, {'type': 'v1', 'addr': '172.21.15.120:6805', 'nonce': 3487103682}]}, 'public_addr': '172.21.15.120:6801/3487103682', 'cluster_addr': '172.21.15.120:6803/3487103682', 'heartbeat_back_addr': '172.21.15.120:6807/3487103682', 'heartbeat_front_addr': '172.21.15.120:6805/3487103682', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'c09e84f3-3a70-46a4-b67b-c9bb52c887b7', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6808', 'nonce': 1023532100}, {'type': 'v1', 'addr': '172.21.15.120:6809', 'nonce': 1023532100}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6810', 'nonce': 1023532100}, {'type': 'v1', 'addr': '172.21.15.120:6811', 'nonce': 1023532100}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6814', 'nonce': 1023532100}, {'type': 'v1', 'addr': '172.21.15.120:6815', 'nonce': 1023532100}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6812', 'nonce': 1023532100}, {'type': 'v1', 'addr': '172.21.15.120:6813', 'nonce': 1023532100}]}, 'public_addr': '172.21.15.120:6809/1023532100', 'cluster_addr': '172.21.15.120:6811/1023532100', 'heartbeat_back_addr': '172.21.15.120:6815/1023532100', 'heartbeat_front_addr': '172.21.15.120:6813/1023532100', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '3c2a0458-369c-4dac-90a3-fb20cb70d53f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6816', 'nonce': 592498012}, {'type': 'v1', 'addr': '172.21.15.120:6817', 'nonce': 592498012}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6818', 'nonce': 592498012}, {'type': 'v1', 'addr': '172.21.15.120:6819', 'nonce': 592498012}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6822', 'nonce': 592498012}, {'type': 'v1', 'addr': '172.21.15.120:6823', 'nonce': 592498012}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6820', 'nonce': 592498012}, {'type': 'v1', 'addr': '172.21.15.120:6821', 'nonce': 592498012}]}, 'public_addr': '172.21.15.120:6817/592498012', 'cluster_addr': '172.21.15.120:6819/592498012', 'heartbeat_back_addr': '172.21.15.120:6823/592498012', 'heartbeat_front_addr': '172.21.15.120:6821/592498012', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'edce3757-5e9d-4221-a1f1-3f356bb5218b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6824', 'nonce': 1939753938}, {'type': 'v1', 'addr': '172.21.15.120:6825', 'nonce': 1939753938}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6826', 'nonce': 1939753938}, {'type': 'v1', 'addr': '172.21.15.120:6827', 'nonce': 1939753938}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6830', 'nonce': 1939753938}, {'type': 'v1', 'addr': '172.21.15.120:6831', 'nonce': 1939753938}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6828', 'nonce': 1939753938}, {'type': 'v1', 'addr': '172.21.15.120:6829', 'nonce': 1939753938}]}, 'public_addr': '172.21.15.120:6825/1939753938', 'cluster_addr': '172.21.15.120:6827/1939753938', 'heartbeat_back_addr': '172.21.15.120:6831/1939753938', 'heartbeat_front_addr': '172.21.15.120:6829/1939753938', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '5fe378d2-578f-41ea-980a-4673a8b376df', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6824', 'nonce': 3005075615}, {'type': 'v1', 'addr': '172.21.15.137:6825', 'nonce': 3005075615}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6826', 'nonce': 3005075615}, {'type': 'v1', 'addr': '172.21.15.137:6827', 'nonce': 3005075615}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6830', 'nonce': 3005075615}, {'type': 'v1', 'addr': '172.21.15.137:6831', 'nonce': 3005075615}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6828', 'nonce': 3005075615}, {'type': 'v1', 'addr': '172.21.15.137:6829', 'nonce': 3005075615}]}, 'public_addr': '172.21.15.137:6825/3005075615', 'cluster_addr': '172.21.15.137:6827/3005075615', 'heartbeat_back_addr': '172.21.15.137:6831/3005075615', 'heartbeat_front_addr': '172.21.15.137:6829/3005075615', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '6e6f7499-ae9e-4cb1-9db7-4d9f8fd9b257', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6800', 'nonce': 1108177522}, {'type': 'v1', 'addr': '172.21.15.137:6801', 'nonce': 1108177522}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6802', 'nonce': 1108177522}, {'type': 'v1', 'addr': '172.21.15.137:6803', 'nonce': 1108177522}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6806', 'nonce': 1108177522}, {'type': 'v1', 'addr': '172.21.15.137:6807', 'nonce': 1108177522}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6804', 'nonce': 1108177522}, {'type': 'v1', 'addr': '172.21.15.137:6805', 'nonce': 1108177522}]}, 'public_addr': '172.21.15.137:6801/1108177522', 'cluster_addr': '172.21.15.137:6803/1108177522', 'heartbeat_back_addr': '172.21.15.137:6807/1108177522', 'heartbeat_front_addr': '172.21.15.137:6805/1108177522', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e4c519e5-5df4-4d55-b12e-fbcfb1b0555c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6816', 'nonce': 2667039053}, {'type': 'v1', 'addr': '172.21.15.137:6817', 'nonce': 2667039053}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6818', 'nonce': 2667039053}, {'type': 'v1', 'addr': '172.21.15.137:6819', 'nonce': 2667039053}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6822', 'nonce': 2667039053}, {'type': 'v1', 'addr': '172.21.15.137:6823', 'nonce': 2667039053}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6820', 'nonce': 2667039053}, {'type': 'v1', 'addr': '172.21.15.137:6821', 'nonce': 2667039053}]}, 'public_addr': '172.21.15.137:6817/2667039053', 'cluster_addr': '172.21.15.137:6819/2667039053', 'heartbeat_back_addr': '172.21.15.137:6823/2667039053', 'heartbeat_front_addr': '172.21.15.137:6821/2667039053', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '914648c2-7a6c-4e66-811d-936e250638db', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 49, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6808', 'nonce': 993764921}, {'type': 'v1', 'addr': '172.21.15.137:6809', 'nonce': 993764921}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6810', 'nonce': 993764921}, {'type': 'v1', 'addr': '172.21.15.137:6811', 'nonce': 993764921}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6814', 'nonce': 993764921}, {'type': 'v1', 'addr': '172.21.15.137:6815', 'nonce': 993764921}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6812', 'nonce': 993764921}, {'type': 'v1', 'addr': '172.21.15.137:6813', 'nonce': 993764921}]}, 'public_addr': '172.21.15.137:6809/993764921', 'cluster_addr': '172.21.15.137:6811/993764921', 'heartbeat_back_addr': '172.21.15.137:6815/993764921', 'heartbeat_front_addr': '172.21.15.137:6813/993764921', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T05:09:46.914820+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.326286+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.147193+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.478655+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.388938+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.127175+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.187286+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:46.962119+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-13T05:10:42.296 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:10:42.395 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:42.390+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:42.450 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:42.451 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:42.451 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:42.451 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:42.451 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:42.461 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:10:42.505 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:42.502+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:42.574 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:42.574 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:42.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:42.574 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:10:42.574 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.574 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29020 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2855936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:42.575 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:10:42.575 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.5290604630000004, 2024-09-13T05:10:42.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060733743, 2024-09-13T05:10:42.575 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.575 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.575 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.575 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.575 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.575 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29020 2024-09-13T05:10:42.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.575 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.575 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.576 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:10:42.576 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.576 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.576 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.576 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:10:42.576 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.576 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.576 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.576 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041741+0000", 2024-09-13T05:10:42.576 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:42.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.576 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041749+0000", 2024-09-13T05:10:42.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6059999999999997e-06 2024-09-13T05:10:42.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.577 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041754+0000", 2024-09-13T05:10:42.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6740000000000002e-06 2024-09-13T05:10:42.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.577 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041760+0000", 2024-09-13T05:10:42.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0459999999999996e-06 2024-09-13T05:10:42.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.578 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102289+0000", 2024-09-13T05:10:42.578 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060529145999999999 2024-09-13T05:10:42.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.578 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102378+0000", 2024-09-13T05:10:42.578 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8901999999999997e-05 2024-09-13T05:10:42.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.578 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102476+0000", 2024-09-13T05:10:42.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7991000000000004e-05 2024-09-13T05:10:42.579 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.579 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.579 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.579 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29021 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2865152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:42.579 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:10:42.579 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.5290384679999995, 2024-09-13T05:10:42.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060927993999999999, 2024-09-13T05:10:42.579 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.579 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.579 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.579 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.579 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.580 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29021 2024-09-13T05:10:42.580 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.580 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.580 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.580 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.580 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:10:42.580 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.580 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.580 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.580 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.580 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:10:42.580 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.580 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041763+0000", 2024-09-13T05:10:42.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:42.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041766+0000", 2024-09-13T05:10:42.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6800000000000002e-06 2024-09-13T05:10:42.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041771+0000", 2024-09-13T05:10:42.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:10:42.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041776+0000", 2024-09-13T05:10:42.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8489999999999997e-06 2024-09-13T05:10:42.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102513+0000", 2024-09-13T05:10:42.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060737102000000001 2024-09-13T05:10:42.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102597+0000", 2024-09-13T05:10:42.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4374000000000002e-05 2024-09-13T05:10:42.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.583 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102692+0000", 2024-09-13T05:10:42.583 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4436000000000002e-05 2024-09-13T05:10:42.583 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.583 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.583 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.583 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29022 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2874368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:42.583 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:10:42.583 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.529022168, 2024-09-13T05:10:42.583 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061135083999999999, 2024-09-13T05:10:42.584 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.584 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.584 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.584 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.584 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.584 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29022 2024-09-13T05:10:42.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.584 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.584 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.584 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.584 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:10:42.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.584 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.585 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:10:42.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.585 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:10:42.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:42.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.585 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041782+0000", 2024-09-13T05:10:42.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4959999999999999e-06 2024-09-13T05:10:42.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041787+0000", 2024-09-13T05:10:42.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1240000000000004e-06 2024-09-13T05:10:42.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041792+0000", 2024-09-13T05:10:42.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9200000000000003e-06 2024-09-13T05:10:42.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102738+0000", 2024-09-13T05:10:42.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060945581999999998 2024-09-13T05:10:42.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.587 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102821+0000", 2024-09-13T05:10:42.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2898999999999994e-05 2024-09-13T05:10:42.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.587 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102915+0000", 2024-09-13T05:10:42.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4523000000000003e-05 2024-09-13T05:10:42.587 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.587 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.587 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.588 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29067 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2764800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:42.588 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:10:42.588 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.5252479509999999, 2024-09-13T05:10:42.588 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060816621000000001, 2024-09-13T05:10:42.588 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.588 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.588 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.588 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.589 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.589 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29067 2024-09-13T05:10:42.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.589 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:10:42.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:10:42.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:10:42.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:42.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045557+0000", 2024-09-13T05:10:42.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.898e-06 2024-09-13T05:10:42.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045575+0000", 2024-09-13T05:10:42.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8252000000000001e-05 2024-09-13T05:10:42.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045581+0000", 2024-09-13T05:10:42.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:10:42.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106183+0000", 2024-09-13T05:10:42.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060602630999999997 2024-09-13T05:10:42.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106271+0000", 2024-09-13T05:10:42.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7329000000000004e-05 2024-09-13T05:10:42.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.592 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106371+0000", 2024-09-13T05:10:42.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000100164 2024-09-13T05:10:42.592 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.592 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.592 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.592 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29068 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2774016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:42.592 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:10:42.592 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.5252167170000002, 2024-09-13T05:10:42.593 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060994509000000002, 2024-09-13T05:10:42.593 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.593 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.593 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.593 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.593 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.593 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29068 2024-09-13T05:10:42.593 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.593 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.593 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.593 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.593 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:10:42.593 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.594 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.594 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.594 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:10:42.594 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.594 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.594 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.594 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045585+0000", 2024-09-13T05:10:42.594 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:42.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.594 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.594 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.594 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045588+0000", 2024-09-13T05:10:42.594 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:10:42.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.595 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045594+0000", 2024-09-13T05:10:42.595 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9329999999999998e-06 2024-09-13T05:10:42.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.595 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045599+0000", 2024-09-13T05:10:42.595 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3190000000000002e-06 2024-09-13T05:10:42.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.595 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106399+0000", 2024-09-13T05:10:42.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060800361999999997 2024-09-13T05:10:42.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106489+0000", 2024-09-13T05:10:42.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9301000000000004e-05 2024-09-13T05:10:42.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106580+0000", 2024-09-13T05:10:42.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1314e-05 2024-09-13T05:10:42.596 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.596 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.597 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.597 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.597 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29069 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2792448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:42.597 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:10:42.597 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.5251982999999996, 2024-09-13T05:10:42.597 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061207599000000001, 2024-09-13T05:10:42.597 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.597 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.597 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.597 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.597 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.597 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29069 2024-09-13T05:10:42.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.598 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.598 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.598 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.598 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:10:42.598 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.598 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.598 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.598 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:10:42.598 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.598 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.598 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.598 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045603+0000", 2024-09-13T05:10:42.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:42.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.599 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045606+0000", 2024-09-13T05:10:42.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7300000000000001e-06 2024-09-13T05:10:42.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.599 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045612+0000", 2024-09-13T05:10:42.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9599999999999997e-06 2024-09-13T05:10:42.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045619+0000", 2024-09-13T05:10:42.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6019999999999996e-06 2024-09-13T05:10:42.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.600 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106619+0000", 2024-09-13T05:10:42.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061000029999999997 2024-09-13T05:10:42.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.600 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106713+0000", 2024-09-13T05:10:42.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4505000000000004e-05 2024-09-13T05:10:42.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.601 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.601 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106812+0000", 2024-09-13T05:10:42.601 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8264000000000007e-05 2024-09-13T05:10:42.601 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.601 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.601 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.601 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.601 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29070 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2783232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:42.601 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:10:42.601 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.5251778409999996, 2024-09-13T05:10:42.601 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061389805999999998, 2024-09-13T05:10:42.601 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.602 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.602 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.602 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.602 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.602 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29070 2024-09-13T05:10:42.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.602 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:10:42.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.603 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:10:42.603 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.603 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.603 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.603 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.603 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:10:42.603 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:42.603 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.603 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.603 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.603 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045627+0000", 2024-09-13T05:10:42.603 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6579999999999998e-06 2024-09-13T05:10:42.603 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.603 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.604 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.604 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045632+0000", 2024-09-13T05:10:42.604 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8449999999999999e-06 2024-09-13T05:10:42.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.604 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.604 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045639+0000", 2024-09-13T05:10:42.604 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:10:42.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.604 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.604 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106837+0000", 2024-09-13T05:10:42.604 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061198529000000002 2024-09-13T05:10:42.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.605 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.605 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106922+0000", 2024-09-13T05:10:42.605 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4771999999999994e-05 2024-09-13T05:10:42.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.605 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.605 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107014+0000", 2024-09-13T05:10:42.605 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2009000000000006e-05 2024-09-13T05:10:42.605 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.605 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.605 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.606 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29071 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2801664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:42.606 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:10:42.606 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.5251587650000005, 2024-09-13T05:10:42.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061582804999999997, 2024-09-13T05:10:42.606 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.606 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.606 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.606 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.606 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.606 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29071 2024-09-13T05:10:42.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.607 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.607 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.607 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:10:42.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.607 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.607 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:10:42.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.607 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.608 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045643+0000", 2024-09-13T05:10:42.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:42.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.608 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.608 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045646+0000", 2024-09-13T05:10:42.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:10:42.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.608 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.608 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045664+0000", 2024-09-13T05:10:42.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8408000000000001e-05 2024-09-13T05:10:42.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045670+0000", 2024-09-13T05:10:42.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7710000000000003e-06 2024-09-13T05:10:42.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107048+0000", 2024-09-13T05:10:42.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061378438 2024-09-13T05:10:42.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107134+0000", 2024-09-13T05:10:42.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5574000000000004e-05 2024-09-13T05:10:42.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107226+0000", 2024-09-13T05:10:42.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2262000000000005e-05 2024-09-13T05:10:42.610 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.610 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.610 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.610 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29072 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2810880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:42.610 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:10:42.610 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.5251273809999999, 2024-09-13T05:10:42.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061762233999999999, 2024-09-13T05:10:42.610 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.611 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.611 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.611 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.611 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.611 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29072 2024-09-13T05:10:42.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.611 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:10:42.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:10:42.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045674+0000", 2024-09-13T05:10:42.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:42.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045677+0000", 2024-09-13T05:10:42.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9679999999999998e-06 2024-09-13T05:10:42.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.613 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.613 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045694+0000", 2024-09-13T05:10:42.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6801999999999999e-05 2024-09-13T05:10:42.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.613 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.613 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045700+0000", 2024-09-13T05:10:42.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8270000000000003e-06 2024-09-13T05:10:42.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.613 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.613 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107249+0000", 2024-09-13T05:10:42.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061549114000000002 2024-09-13T05:10:42.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107341+0000", 2024-09-13T05:10:42.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2390000000000001e-05 2024-09-13T05:10:42.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107437+0000", 2024-09-13T05:10:42.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5648000000000003e-05 2024-09-13T05:10:42.614 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.614 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.614 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.615 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29073 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2820096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:42.615 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:10:42.615 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.5250854030000003, 2024-09-13T05:10:42.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061873910999999997, 2024-09-13T05:10:42.615 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.615 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.615 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.615 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.615 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.615 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29073 2024-09-13T05:10:42.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.615 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:10:42.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:10:42.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045716+0000", 2024-09-13T05:10:42.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:42.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045726+0000", 2024-09-13T05:10:42.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6350000000000001e-06 2024-09-13T05:10:42.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045739+0000", 2024-09-13T05:10:42.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3325e-05 2024-09-13T05:10:42.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045746+0000", 2024-09-13T05:10:42.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7399999999999998e-06 2024-09-13T05:10:42.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.618 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.618 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107457+0000", 2024-09-13T05:10:42.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061711038000000003 2024-09-13T05:10:42.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.618 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.618 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107522+0000", 2024-09-13T05:10:42.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4850000000000004e-05 2024-09-13T05:10:42.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.618 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.618 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107591+0000", 2024-09-13T05:10:42.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9029999999999995e-05 2024-09-13T05:10:42.619 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.619 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.619 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.619 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29074 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2829312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:42.619 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:10:42.619 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.5250514949999996, 2024-09-13T05:10:42.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062055459, 2024-09-13T05:10:42.619 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.619 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.619 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.619 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.620 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.620 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29074 2024-09-13T05:10:42.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.620 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:10:42.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:10:42.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045750+0000", 2024-09-13T05:10:42.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:42.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045753+0000", 2024-09-13T05:10:42.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8399999999999999e-06 2024-09-13T05:10:42.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045759+0000", 2024-09-13T05:10:42.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8900000000000004e-06 2024-09-13T05:10:42.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045764+0000", 2024-09-13T05:10:42.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3850000000000001e-06 2024-09-13T05:10:42.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107623+0000", 2024-09-13T05:10:42.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061858817000000003 2024-09-13T05:10:42.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107710+0000", 2024-09-13T05:10:42.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7127999999999997e-05 2024-09-13T05:10:42.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107806+0000", 2024-09-13T05:10:42.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5886999999999999e-05 2024-09-13T05:10:42.623 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.623 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.623 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.623 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29075 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2838528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:42.624 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:10:42.624 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.5250330410000004, 2024-09-13T05:10:42.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062188516999999999, 2024-09-13T05:10:42.624 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.624 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.624 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.624 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.624 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.624 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29075 2024-09-13T05:10:42.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.624 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:10:42.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:10:42.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:10:42.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:42.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045772+0000", 2024-09-13T05:10:42.626 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:10:42.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.626 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.626 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.626 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045778+0000", 2024-09-13T05:10:42.626 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9229999999999996e-06 2024-09-13T05:10:42.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.626 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.626 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.626 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045784+0000", 2024-09-13T05:10:42.626 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3800000000000002e-06 2024-09-13T05:10:42.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.626 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.626 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.627 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107823+0000", 2024-09-13T05:10:42.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062039331000000003 2024-09-13T05:10:42.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.627 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.627 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107886+0000", 2024-09-13T05:10:42.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2476000000000003e-05 2024-09-13T05:10:42.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.627 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.627 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107958+0000", 2024-09-13T05:10:42.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2089999999999996e-05 2024-09-13T05:10:42.627 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.628 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.628 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.628 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29115 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2682880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:42.628 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:10:42.628 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.521567514, 2024-09-13T05:10:42.628 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060847898999999997, 2024-09-13T05:10:42.628 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.628 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.628 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.628 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.628 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.628 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29115 2024-09-13T05:10:42.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.629 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.629 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.629 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:10:42.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.629 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.629 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:10:42.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.629 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049234+0000", 2024-09-13T05:10:42.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:42.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.630 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.630 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049237+0000", 2024-09-13T05:10:42.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9069999999999999e-06 2024-09-13T05:10:42.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.630 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.630 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049243+0000", 2024-09-13T05:10:42.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7459999999999997e-06 2024-09-13T05:10:42.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.630 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.630 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.631 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049248+0000", 2024-09-13T05:10:42.631 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1490000000000002e-06 2024-09-13T05:10:42.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.631 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.631 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.631 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.109945+0000", 2024-09-13T05:10:42.631 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060697299000000003 2024-09-13T05:10:42.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.631 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.631 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.631 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110013+0000", 2024-09-13T05:10:42.631 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8023999999999998e-05 2024-09-13T05:10:42.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.631 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.631 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.632 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110083+0000", 2024-09-13T05:10:42.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9296999999999997e-05 2024-09-13T05:10:42.632 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.632 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.632 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.632 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29116 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2692096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:42.632 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:10:42.632 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.5215496699999997, 2024-09-13T05:10:42.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061040167999999999, 2024-09-13T05:10:42.632 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.632 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.633 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.633 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.633 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.633 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29116 2024-09-13T05:10:42.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.633 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.633 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.633 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:10:42.633 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.633 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.633 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:10:42.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.634 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.634 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049252+0000", 2024-09-13T05:10:42.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:42.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.634 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.634 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049255+0000", 2024-09-13T05:10:42.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7250000000000002e-06 2024-09-13T05:10:42.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.634 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.634 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049261+0000", 2024-09-13T05:10:42.635 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.755e-06 2024-09-13T05:10:42.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.635 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.635 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.635 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049266+0000", 2024-09-13T05:10:42.635 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2100000000000001e-06 2024-09-13T05:10:42.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.635 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.635 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.635 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110115+0000", 2024-09-13T05:10:42.635 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060849225999999999 2024-09-13T05:10:42.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.635 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.636 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.636 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110199+0000", 2024-09-13T05:10:42.636 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4339999999999995e-05 2024-09-13T05:10:42.636 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.636 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.636 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.636 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110293+0000", 2024-09-13T05:10:42.636 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3397e-05 2024-09-13T05:10:42.636 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.636 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.636 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.636 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.636 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.637 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29117 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2701312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:42.637 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:10:42.637 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.5215320329999997, 2024-09-13T05:10:42.637 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.06118527, 2024-09-13T05:10:42.637 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.637 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.637 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.637 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.637 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.637 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29117 2024-09-13T05:10:42.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.637 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.637 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.637 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:10:42.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:10:42.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:10:42.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:42.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.639 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.639 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049273+0000", 2024-09-13T05:10:42.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.757e-06 2024-09-13T05:10:42.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.639 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.639 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.639 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049278+0000", 2024-09-13T05:10:42.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7830000000000004e-06 2024-09-13T05:10:42.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.639 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.639 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.639 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049284+0000", 2024-09-13T05:10:42.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3820000000000003e-06 2024-09-13T05:10:42.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.640 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.640 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.640 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110313+0000", 2024-09-13T05:10:42.640 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061029682000000002 2024-09-13T05:10:42.640 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.640 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.640 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.640 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110383+0000", 2024-09-13T05:10:42.640 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9406000000000006e-05 2024-09-13T05:10:42.640 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.640 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.640 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.640 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110456+0000", 2024-09-13T05:10:42.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2750000000000007e-05 2024-09-13T05:10:42.641 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.641 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.641 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.641 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29118 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2710528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:42.641 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:10:42.641 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.5215141179999998, 2024-09-13T05:10:42.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061380698999999997, 2024-09-13T05:10:42.641 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.641 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.641 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.641 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.642 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.642 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29118 2024-09-13T05:10:42.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.642 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.642 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:10:42.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.642 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:10:42.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.643 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.643 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.643 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:10:42.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:42.643 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.643 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.643 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.643 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049291+0000", 2024-09-13T05:10:42.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8770000000000002e-06 2024-09-13T05:10:42.643 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.643 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.643 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.643 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049296+0000", 2024-09-13T05:10:42.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6799999999999998e-06 2024-09-13T05:10:42.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.644 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.644 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.644 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049302+0000", 2024-09-13T05:10:42.644 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2769999999999996e-06 2024-09-13T05:10:42.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.644 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.644 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.644 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110488+0000", 2024-09-13T05:10:42.644 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061186184999999997 2024-09-13T05:10:42.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.644 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.644 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110577+0000", 2024-09-13T05:10:42.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9246000000000006e-05 2024-09-13T05:10:42.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.645 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110669+0000", 2024-09-13T05:10:42.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1923999999999996e-05 2024-09-13T05:10:42.645 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.645 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.645 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.645 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29119 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2719744~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:42.646 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:10:42.646 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.5214963739999998, 2024-09-13T05:10:42.646 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061521165000000003, 2024-09-13T05:10:42.646 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.646 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.646 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.646 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.646 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.646 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29119 2024-09-13T05:10:42.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.646 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.646 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.646 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.646 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:10:42.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.647 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.647 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:10:42.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.647 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.647 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049305+0000", 2024-09-13T05:10:42.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:42.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.647 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.648 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049308+0000", 2024-09-13T05:10:42.648 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7070000000000001e-06 2024-09-13T05:10:42.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.648 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.648 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.648 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049316+0000", 2024-09-13T05:10:42.648 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:10:42.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.648 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.648 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.648 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049322+0000", 2024-09-13T05:10:42.648 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3199999999999999e-06 2024-09-13T05:10:42.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.648 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.649 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.649 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110690+0000", 2024-09-13T05:10:42.649 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061368428000000003 2024-09-13T05:10:42.649 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.649 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.649 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.649 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110755+0000", 2024-09-13T05:10:42.649 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4893000000000004e-05 2024-09-13T05:10:42.649 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.649 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.649 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.649 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110827+0000", 2024-09-13T05:10:42.649 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2039000000000006e-05 2024-09-13T05:10:42.649 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.650 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.650 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.650 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.650 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.650 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29120 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2728960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:42.650 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:10:42.650 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.5214761039999996, 2024-09-13T05:10:42.650 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061718420000000003, 2024-09-13T05:10:42.650 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.650 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.650 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.650 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.650 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.650 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29120 2024-09-13T05:10:42.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.651 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.651 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.651 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.651 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:10:42.651 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.651 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.651 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.651 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:10:42.651 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.651 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.651 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.652 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:10:42.652 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:42.652 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.652 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.652 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.652 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049329+0000", 2024-09-13T05:10:42.652 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.022e-06 2024-09-13T05:10:42.652 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.652 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.652 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.652 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049336+0000", 2024-09-13T05:10:42.652 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0720000000000002e-06 2024-09-13T05:10:42.652 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.652 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.653 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.653 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049341+0000", 2024-09-13T05:10:42.653 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:10:42.653 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.653 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.653 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.653 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110864+0000", 2024-09-13T05:10:42.653 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061523126999999997 2024-09-13T05:10:42.653 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.653 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.653 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.653 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110951+0000", 2024-09-13T05:10:42.653 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6557000000000005e-05 2024-09-13T05:10:42.653 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.654 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.654 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.111045+0000", 2024-09-13T05:10:42.654 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4043999999999996e-05 2024-09-13T05:10:42.654 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.654 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.654 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.654 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.654 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29136 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2876416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:42.654 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:10:42.654 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.517460679, 2024-09-13T05:10:42.654 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060742995000000001, 2024-09-13T05:10:42.654 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.655 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.655 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.655 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.655 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.655 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29136 2024-09-13T05:10:42.655 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.655 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.655 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.655 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.655 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:10:42.655 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.655 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.655 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.655 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.656 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:10:42.656 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.656 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.656 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.656 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.656 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053341+0000", 2024-09-13T05:10:42.656 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:42.656 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.656 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.656 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.656 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053344+0000", 2024-09-13T05:10:42.656 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:10:42.656 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.656 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.657 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.657 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053350+0000", 2024-09-13T05:10:42.657 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7200000000000003e-06 2024-09-13T05:10:42.657 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.657 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.657 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.657 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053355+0000", 2024-09-13T05:10:42.657 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0150000000000003e-06 2024-09-13T05:10:42.657 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.657 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.657 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.657 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113909+0000", 2024-09-13T05:10:42.657 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060554368999999997 2024-09-13T05:10:42.657 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.658 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.658 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.658 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113994+0000", 2024-09-13T05:10:42.658 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4658000000000002e-05 2024-09-13T05:10:42.658 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.658 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.658 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.658 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114085+0000", 2024-09-13T05:10:42.658 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0939000000000005e-05 2024-09-13T05:10:42.658 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.658 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.658 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.658 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.659 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.659 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29166 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2628608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:42.659 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:10:42.659 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.5174432449999999, 2024-09-13T05:10:42.659 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060883127000000002, 2024-09-13T05:10:42.659 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:42.659 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:42.659 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:42.659 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:42.659 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:42.659 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29166 2024-09-13T05:10:42.659 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.659 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:42.659 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.660 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:42.660 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:10:42.660 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.660 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.660 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.660 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:42.660 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:10:42.660 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:42.660 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.660 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.660 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:42.660 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:10:42.660 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:42.660 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.661 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.661 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:42.661 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053361+0000", 2024-09-13T05:10:42.661 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:10:42.661 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.661 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.661 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:42.661 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053367+0000", 2024-09-13T05:10:42.661 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7350000000000001e-06 2024-09-13T05:10:42.661 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.661 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.661 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:42.661 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053372+0000", 2024-09-13T05:10:42.661 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7840000000000003e-06 2024-09-13T05:10:42.662 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.662 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.662 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:42.662 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114103+0000", 2024-09-13T05:10:42.662 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060730924999999998 2024-09-13T05:10:42.662 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.662 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.662 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:42.662 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114171+0000", 2024-09-13T05:10:42.662 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8021999999999993e-05 2024-09-13T05:10:42.662 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:42.662 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:42.662 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:42.662 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114242+0000", 2024-09-13T05:10:42.662 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1390999999999995e-05 2024-09-13T05:10:42.663 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.663 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.663 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.663 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:42.663 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:42.663 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:42.666 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:10:42.666 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:42.658+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:42.667 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:10:42.667 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:10:42.677 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-09-13T05:10:42.175165+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":421561776,"num_objects":660,"num_object_clones":83,"num_object_copies":1320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":660,"num_whiteouts":117,"num_read":46011,"num_read_kb":108185,"num_write":4766,"num_write_kb":67218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":647,"num_bytes_recovered":17034368,"num_keys_recovered":103,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3986,"ondisk_log_size":3986,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":250388,"kb_used_data":86624,"kb_used_omap":7,"kb_used_meta":163704,"kb_avail":471608812,"statfs":{"total":483183820800,"available":482927423488,"internally_reserved":0,"allocated":88702976,"data_stored":96987714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7962,"internal_metadata":167633126},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,34,21,91,97],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":159380717,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":11334,"num_read_kb":19389,"num_write":365,"num_write_kb":21056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":396,"num_bytes_recovered":10400480,"num_keys_recovered":56,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001249"},"pg_stats":[{"pgid":"3.1f","version":"50'122","reported_seq":447,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.842716+0000","last_change":"2024-09-13T05:10:37.993400+0000","last_active":"2024-09-13T05:10:41.842716+0000","last_peered":"2024-09-13T05:10:41.842716+0000","last_clean":"2024-09-13T05:10:41.842716+0000","last_became_active":"2024-09-13T05:10:37.864778+0000","last_became_peered":"2024-09-13T05:10:37.864778+0000","last_unstale":"2024-09-13T05:10:41.842716+0000","last_undegraded":"2024-09-13T05:10:41.842716+0000","last_fullsized":"2024-09-13T05:10:41.842716+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:56:24.801492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011835439999999999,"stat_sum":{"num_bytes":2651570,"num_objects":24,"num_object_clones":1,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":3,"num_read":697,"num_read_kb":610,"num_write":113,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":297202,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"50'64","reported_seq":354,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.891537+0000","last_change":"2024-09-13T05:10:12.076857+0000","last_active":"2024-09-13T05:10:41.891537+0000","last_peered":"2024-09-13T05:10:41.891537+0000","last_clean":"2024-09-13T05:10:41.891537+0000","last_became_active":"2024-09-13T05:10:09.644293+0000","last_became_peered":"2024-09-13T05:10:09.644293+0000","last_unstale":"2024-09-13T05:10:41.891537+0000","last_undegraded":"2024-09-13T05:10:41.891537+0000","last_fullsized":"2024-09-13T05:10:41.891537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:45:32.561793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225439,"stat_sum":{"num_bytes":22347873,"num_objects":11,"num_object_clones":1,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":2,"num_read":733,"num_read_kb":979,"num_write":65,"num_write_kb":1325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"50'58","reported_seq":133,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.451108+0000","last_change":"2024-09-13T05:10:11.645342+0000","last_active":"2024-09-13T05:10:41.451108+0000","last_peered":"2024-09-13T05:10:41.451108+0000","last_clean":"2024-09-13T05:10:41.451108+0000","last_became_active":"2024-09-13T05:10:09.645791+0000","last_became_peered":"2024-09-13T05:10:09.645791+0000","last_unstale":"2024-09-13T05:10:41.451108+0000","last_undegraded":"2024-09-13T05:10:41.451108+0000","last_fullsized":"2024-09-13T05:10:41.451108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:49.028553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072691800000000001,"stat_sum":{"num_bytes":11408627,"num_objects":26,"num_object_clones":4,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":3,"num_read":64,"num_read_kb":830,"num_write":42,"num_write_kb":1438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"51'107","reported_seq":416,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.907157+0000","last_change":"2024-09-13T05:10:31.949427+0000","last_active":"2024-09-13T05:10:41.907157+0000","last_peered":"2024-09-13T05:10:41.907157+0000","last_clean":"2024-09-13T05:10:41.907157+0000","last_became_active":"2024-09-13T05:10:31.828206+0000","last_became_peered":"2024-09-13T05:10:31.828206+0000","last_unstale":"2024-09-13T05:10:41.907157+0000","last_undegraded":"2024-09-13T05:10:41.907157+0000","last_fullsized":"2024-09-13T05:10:41.907157+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:32:46.868249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078437299999999999,"stat_sum":{"num_bytes":6750069,"num_objects":19,"num_object_clones":3,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":2,"num_read":452,"num_read_kb":1027,"num_write":122,"num_write_kb":5434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":372837,"num_keys_recovered":18,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"50'59","reported_seq":240,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.234803+0000","last_change":"2024-09-13T05:10:37.990899+0000","last_active":"2024-09-13T05:10:41.234803+0000","last_peered":"2024-09-13T05:10:41.234803+0000","last_clean":"2024-09-13T05:10:41.234803+0000","last_became_active":"2024-09-13T05:10:37.867842+0000","last_became_peered":"2024-09-13T05:10:37.867842+0000","last_unstale":"2024-09-13T05:10:41.234803+0000","last_undegraded":"2024-09-13T05:10:41.234803+0000","last_fullsized":"2024-09-13T05:10:41.234803+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:38:24.437617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065808499999999999,"stat_sum":{"num_bytes":4404640,"num_objects":27,"num_object_clones":3,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":7,"num_read":87,"num_read_kb":2132,"num_write":42,"num_write_kb":963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":612052,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"51'94","reported_seq":1825,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.900616+0000","last_change":"2024-09-13T05:10:37.948112+0000","last_active":"2024-09-13T05:10:41.900616+0000","last_peered":"2024-09-13T05:10:41.900616+0000","last_clean":"2024-09-13T05:10:41.900616+0000","last_became_active":"2024-09-13T05:10:37.863614+0000","last_became_peered":"2024-09-13T05:10:37.863614+0000","last_unstale":"2024-09-13T05:10:41.900616+0000","last_undegraded":"2024-09-13T05:10:41.900616+0000","last_fullsized":"2024-09-13T05:10:41.900616+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:15.873724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027226559999999999,"stat_sum":{"num_bytes":1547523,"num_objects":24,"num_object_clones":3,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":3,"num_read":1755,"num_read_kb":3405,"num_write":77,"num_write_kb":1026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":77,"num_bytes_recovered":1081937,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"50'421","reported_seq":1813,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.891244+0000","last_change":"2024-09-13T05:10:34.613940+0000","last_active":"2024-09-13T05:10:41.891244+0000","last_peered":"2024-09-13T05:10:41.891244+0000","last_clean":"2024-09-13T05:10:41.891244+0000","last_became_active":"2024-09-13T05:10:34.612579+0000","last_became_peered":"2024-09-13T05:10:34.612579+0000","last_unstale":"2024-09-13T05:10:41.891244+0000","last_undegraded":"2024-09-13T05:10:41.891244+0000","last_fullsized":"2024-09-13T05:10:41.891244+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:43.339882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067403999999999999,"stat_sum":{"num_bytes":32251234,"num_objects":26,"num_object_clones":5,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":5,"num_read":3734,"num_read_kb":9253,"num_write":622,"num_write_kb":1549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":248973,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"50'93","reported_seq":318,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.848841+0000","last_change":"2024-09-13T05:10:37.929523+0000","last_active":"2024-09-13T05:10:41.848841+0000","last_peered":"2024-09-13T05:10:41.848841+0000","last_clean":"2024-09-13T05:10:41.848841+0000","last_became_active":"2024-09-13T05:10:37.865440+0000","last_became_peered":"2024-09-13T05:10:37.865440+0000","last_unstale":"2024-09-13T05:10:41.848841+0000","last_undegraded":"2024-09-13T05:10:41.848841+0000","last_fullsized":"2024-09-13T05:10:41.848841+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:30:31.875141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087399999999998,"stat_sum":{"num_bytes":13096536,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":4,"num_read":234,"num_read_kb":4233,"num_write":105,"num_write_kb":3397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":1513234,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"48'96","reported_seq":705,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:40.877341+0000","last_change":"2024-09-13T05:10:37.920810+0000","last_active":"2024-09-13T05:10:40.877341+0000","last_peered":"2024-09-13T05:10:40.877341+0000","last_clean":"2024-09-13T05:10:40.877341+0000","last_became_active":"2024-09-13T05:10:37.864816+0000","last_became_peered":"2024-09-13T05:10:37.864816+0000","last_unstale":"2024-09-13T05:10:40.877341+0000","last_undegraded":"2024-09-13T05:10:40.877341+0000","last_fullsized":"2024-09-13T05:10:40.877341+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:06.315864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096598599999999995,"stat_sum":{"num_bytes":4409908,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":4,"num_read":1598,"num_read_kb":1359,"num_write":75,"num_write_kb":493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":37802,"num_keys_recovered":23,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"47'112","reported_seq":1017,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.450124+0000","last_change":"2024-09-13T05:10:11.645211+0000","last_active":"2024-09-13T05:10:41.450124+0000","last_peered":"2024-09-13T05:10:41.450124+0000","last_clean":"2024-09-13T05:10:41.450124+0000","last_became_active":"2024-09-13T05:10:09.647763+0000","last_became_peered":"2024-09-13T05:10:09.647763+0000","last_unstale":"2024-09-13T05:10:41.450124+0000","last_undegraded":"2024-09-13T05:10:41.450124+0000","last_fullsized":"2024-09-13T05:10:41.450124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:43.426871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072236499999999999,"stat_sum":{"num_bytes":30090357,"num_objects":20,"num_object_clones":3,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":4,"num_read":1005,"num_read_kb":7378,"num_write":110,"num_write_kb":947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"50'72","reported_seq":191,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.317305+0000","last_change":"2024-09-13T05:10:11.681217+0000","last_active":"2024-09-13T05:10:41.317305+0000","last_peered":"2024-09-13T05:10:41.317305+0000","last_clean":"2024-09-13T05:10:41.317305+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:10:41.317305+0000","last_undegraded":"2024-09-13T05:10:41.317305+0000","last_fullsized":"2024-09-13T05:10:41.317305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:40.457636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095533399999999996,"stat_sum":{"num_bytes":1515202,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":4,"num_read":226,"num_read_kb":2342,"num_write":82,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"50'84","reported_seq":2775,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.851917+0000","last_change":"2024-09-13T05:10:11.681365+0000","last_active":"2024-09-13T05:10:41.851917+0000","last_peered":"2024-09-13T05:10:41.851917+0000","last_clean":"2024-09-13T05:10:41.851917+0000","last_became_active":"2024-09-13T05:10:09.645823+0000","last_became_peered":"2024-09-13T05:10:09.645823+0000","last_unstale":"2024-09-13T05:10:41.851917+0000","last_undegraded":"2024-09-13T05:10:41.851917+0000","last_fullsized":"2024-09-13T05:10:41.851917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:24.367358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011047369999999999,"stat_sum":{"num_bytes":14609810,"num_objects":17,"num_object_clones":2,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":3,"num_read":2689,"num_read_kb":1524,"num_write":68,"num_write_kb":3302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:40.884677+0000","last_change":"2024-09-13T05:10:01.383891+0000","last_active":"2024-09-13T05:10:40.884677+0000","last_peered":"2024-09-13T05:10:40.884677+0000","last_clean":"2024-09-13T05:10:40.884677+0000","last_became_active":"2024-09-13T05:09:59.374793+0000","last_became_peered":"2024-09-13T05:09:59.374793+0000","last_unstale":"2024-09-13T05:10:40.884677+0000","last_undegraded":"2024-09-13T05:10:40.884677+0000","last_fullsized":"2024-09-13T05:10:40.884677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:02.499446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065068999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"50'49","reported_seq":3738,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.457713+0000","last_change":"2024-09-13T05:10:38.046833+0000","last_active":"2024-09-13T05:10:41.457713+0000","last_peered":"2024-09-13T05:10:41.457713+0000","last_clean":"2024-09-13T05:10:41.457713+0000","last_became_active":"2024-09-13T05:10:37.869206+0000","last_became_peered":"2024-09-13T05:10:37.869206+0000","last_unstale":"2024-09-13T05:10:41.457713+0000","last_undegraded":"2024-09-13T05:10:41.457713+0000","last_fullsized":"2024-09-13T05:10:41.457713+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:12.484134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099899699999999995,"stat_sum":{"num_bytes":19156046,"num_objects":15,"num_object_clones":3,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":4,"num_read":2511,"num_read_kb":4346,"num_write":40,"num_write_kb":3948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":5061662,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:40.884701+0000","last_change":"2024-09-13T05:10:31.826927+0000","last_active":"2024-09-13T05:10:40.884701+0000","last_peered":"2024-09-13T05:10:40.884701+0000","last_clean":"2024-09-13T05:10:40.884701+0000","last_became_active":"2024-09-13T05:10:31.826431+0000","last_became_peered":"2024-09-13T05:10:31.826431+0000","last_unstale":"2024-09-13T05:10:40.884701+0000","last_undegraded":"2024-09-13T05:10:40.884701+0000","last_fullsized":"2024-09-13T05:10:40.884701+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:13:36.678853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"45'93","reported_seq":946,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:40.877100+0000","last_change":"2024-09-13T05:10:12.077111+0000","last_active":"2024-09-13T05:10:40.877100+0000","last_peered":"2024-09-13T05:10:40.877100+0000","last_clean":"2024-09-13T05:10:40.877100+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:10:40.877100+0000","last_undegraded":"2024-09-13T05:10:40.877100+0000","last_fullsized":"2024-09-13T05:10:40.877100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:37.976147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001460444,"stat_sum":{"num_bytes":30276982,"num_objects":21,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":5,"num_read":958,"num_read_kb":8323,"num_write":95,"num_write_kb":1244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:40.881748+0000","last_change":"2024-09-13T05:10:37.866953+0000","last_active":"2024-09-13T05:10:40.881748+0000","last_peered":"2024-09-13T05:10:40.881748+0000","last_clean":"2024-09-13T05:10:40.881748+0000","last_became_active":"2024-09-13T05:10:37.866624+0000","last_became_peered":"2024-09-13T05:10:37.866624+0000","last_unstale":"2024-09-13T05:10:40.881748+0000","last_undegraded":"2024-09-13T05:10:40.881748+0000","last_fullsized":"2024-09-13T05:10:40.881748+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:56:20.077971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"50'58","reported_seq":190,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.450305+0000","last_change":"2024-09-13T05:10:32.017095+0000","last_active":"2024-09-13T05:10:41.450305+0000","last_peered":"2024-09-13T05:10:41.450305+0000","last_clean":"2024-09-13T05:10:41.450305+0000","last_became_active":"2024-09-13T05:10:31.829027+0000","last_became_peered":"2024-09-13T05:10:31.829027+0000","last_unstale":"2024-09-13T05:10:41.450305+0000","last_undegraded":"2024-09-13T05:10:41.450305+0000","last_fullsized":"2024-09-13T05:10:41.450305+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:36:33.938992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076234800000000004,"stat_sum":{"num_bytes":8088501,"num_objects":21,"num_object_clones":2,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":5,"num_read":52,"num_read_kb":33,"num_write":45,"num_write_kb":743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":263489,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:40.881312+0000","last_change":"2024-09-13T05:10:37.864940+0000","last_active":"2024-09-13T05:10:40.881312+0000","last_peered":"2024-09-13T05:10:40.881312+0000","last_clean":"2024-09-13T05:10:40.881312+0000","last_became_active":"2024-09-13T05:10:37.864623+0000","last_became_peered":"2024-09-13T05:10:37.864623+0000","last_unstale":"2024-09-13T05:10:40.881312+0000","last_undegraded":"2024-09-13T05:10:40.881312+0000","last_fullsized":"2024-09-13T05:10:40.881312+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:41.598490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.5","version":"50'139","reported_seq":652,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.894955+0000","last_change":"2024-09-13T05:10:11.645960+0000","last_active":"2024-09-13T05:10:41.894955+0000","last_peered":"2024-09-13T05:10:41.894955+0000","last_clean":"2024-09-13T05:10:41.894955+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:10:41.894955+0000","last_undegraded":"2024-09-13T05:10:41.894955+0000","last_fullsized":"2024-09-13T05:10:41.894955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:40.372741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001054028,"stat_sum":{"num_bytes":10548218,"num_objects":26,"num_object_clones":1,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":2,"num_read":1317,"num_read_kb":3072,"num_write":124,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"50'59","reported_seq":929,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.171633+0000","last_change":"2024-09-13T05:10:37.979816+0000","last_active":"2024-09-13T05:10:41.171633+0000","last_peered":"2024-09-13T05:10:41.171633+0000","last_clean":"2024-09-13T05:10:41.171633+0000","last_became_active":"2024-09-13T05:10:37.863256+0000","last_became_peered":"2024-09-13T05:10:37.863256+0000","last_unstale":"2024-09-13T05:10:41.171633+0000","last_undegraded":"2024-09-13T05:10:41.171633+0000","last_fullsized":"2024-09-13T05:10:41.171633+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:58:55.928356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099335200000000008,"stat_sum":{"num_bytes":40720206,"num_objects":17,"num_object_clones":3,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":4,"num_read":806,"num_read_kb":5760,"num_write":52,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":214109,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:40.876643+0000","last_change":"2024-09-13T05:10:31.836193+0000","last_active":"2024-09-13T05:10:40.876643+0000","last_peered":"2024-09-13T05:10:40.876643+0000","last_clean":"2024-09-13T05:10:40.876643+0000","last_became_active":"2024-09-13T05:10:31.825663+0000","last_became_peered":"2024-09-13T05:10:31.825663+0000","last_unstale":"2024-09-13T05:10:40.876643+0000","last_undegraded":"2024-09-13T05:10:40.876643+0000","last_fullsized":"2024-09-13T05:10:40.876643+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:38:23.311570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"50'119","reported_seq":242,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.309409+0000","last_change":"2024-09-13T05:10:31.893494+0000","last_active":"2024-09-13T05:10:41.309409+0000","last_peered":"2024-09-13T05:10:41.309409+0000","last_clean":"2024-09-13T05:10:41.309409+0000","last_became_active":"2024-09-13T05:10:31.827657+0000","last_became_peered":"2024-09-13T05:10:31.827657+0000","last_unstale":"2024-09-13T05:10:41.309409+0000","last_undegraded":"2024-09-13T05:10:41.309409+0000","last_fullsized":"2024-09-13T05:10:41.309409+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:16:14.432049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045163499999999998,"stat_sum":{"num_bytes":3786452,"num_objects":21,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":4,"num_read":324,"num_read_kb":248,"num_write":145,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":84179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:40.899204+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:10:40.899204+0000","last_peered":"2024-09-13T05:10:40.899204+0000","last_clean":"2024-09-13T05:10:40.899204+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:10:40.899204+0000","last_undegraded":"2024-09-13T05:10:40.899204+0000","last_fullsized":"2024-09-13T05:10:40.899204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"47'61","reported_seq":192,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.456014+0000","last_change":"2024-09-13T05:10:38.111510+0000","last_active":"2024-09-13T05:10:41.456014+0000","last_peered":"2024-09-13T05:10:41.456014+0000","last_clean":"2024-09-13T05:10:41.456014+0000","last_became_active":"2024-09-13T05:10:37.869040+0000","last_became_peered":"2024-09-13T05:10:37.869040+0000","last_unstale":"2024-09-13T05:10:41.456014+0000","last_undegraded":"2024-09-13T05:10:41.456014+0000","last_fullsized":"2024-09-13T05:10:41.456014+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:48:18.385423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048152600000000002,"stat_sum":{"num_bytes":8438872,"num_objects":14,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":3,"num_read":49,"num_read_kb":2223,"num_write":52,"num_write_kb":2743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":383717,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:40.881009+0000","last_change":"2024-09-13T05:10:37.865514+0000","last_active":"2024-09-13T05:10:40.881009+0000","last_peered":"2024-09-13T05:10:40.881009+0000","last_clean":"2024-09-13T05:10:40.881009+0000","last_became_active":"2024-09-13T05:10:37.864299+0000","last_became_peered":"2024-09-13T05:10:37.864299+0000","last_unstale":"2024-09-13T05:10:40.881009+0000","last_undegraded":"2024-09-13T05:10:40.881009+0000","last_fullsized":"2024-09-13T05:10:40.881009+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:45:58.276509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"45'39","reported_seq":88,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:40.876505+0000","last_change":"2024-09-13T05:10:12.075510+0000","last_active":"2024-09-13T05:10:40.876505+0000","last_peered":"2024-09-13T05:10:40.876505+0000","last_clean":"2024-09-13T05:10:40.876505+0000","last_became_active":"2024-09-13T05:10:09.646353+0000","last_became_peered":"2024-09-13T05:10:09.646353+0000","last_unstale":"2024-09-13T05:10:40.876505+0000","last_undegraded":"2024-09-13T05:10:40.876505+0000","last_fullsized":"2024-09-13T05:10:40.876505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:54:58.706032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059320200000000003,"stat_sum":{"num_bytes":316911,"num_objects":21,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":6,"num_read":34,"num_read_kb":3,"num_write":22,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":48,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:40.876839+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:10:40.876839+0000","last_peered":"2024-09-13T05:10:40.876839+0000","last_clean":"2024-09-13T05:10:40.876839+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:10:40.876839+0000","last_undegraded":"2024-09-13T05:10:40.876839+0000","last_fullsized":"2024-09-13T05:10:40.876839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":216,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:40.886635+0000","last_change":"2024-09-13T05:10:40.886011+0000","last_active":"2024-09-13T05:10:40.886635+0000","last_peered":"2024-09-13T05:10:40.886635+0000","last_clean":"2024-09-13T05:10:40.886635+0000","last_became_active":"2024-09-13T05:10:40.885587+0000","last_became_peered":"2024-09-13T05:10:40.885587+0000","last_unstale":"2024-09-13T05:10:40.886635+0000","last_undegraded":"2024-09-13T05:10:40.886635+0000","last_fullsized":"2024-09-13T05:10:40.886635+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:52:47.632734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"45'57","reported_seq":213,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:40.876345+0000","last_change":"2024-09-13T05:10:31.888827+0000","last_active":"2024-09-13T05:10:40.876345+0000","last_peered":"2024-09-13T05:10:40.876345+0000","last_clean":"2024-09-13T05:10:40.876345+0000","last_became_active":"2024-09-13T05:10:31.827016+0000","last_became_peered":"2024-09-13T05:10:31.827016+0000","last_unstale":"2024-09-13T05:10:40.876345+0000","last_undegraded":"2024-09-13T05:10:40.876345+0000","last_fullsized":"2024-09-13T05:10:40.876345+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:47.525525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000500144,"stat_sum":{"num_bytes":3705259,"num_objects":23,"num_object_clones":4,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":4,"num_read":88,"num_read_kb":323,"num_write":38,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":58925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"50'104","reported_seq":5025,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.144439+0000","last_change":"2024-09-13T05:10:11.648218+0000","last_active":"2024-09-13T05:10:41.144439+0000","last_peered":"2024-09-13T05:10:41.144439+0000","last_clean":"2024-09-13T05:10:41.144439+0000","last_became_active":"2024-09-13T05:10:09.645408+0000","last_became_peered":"2024-09-13T05:10:09.645408+0000","last_unstale":"2024-09-13T05:10:41.144439+0000","last_undegraded":"2024-09-13T05:10:41.144439+0000","last_fullsized":"2024-09-13T05:10:41.144439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:59.846981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097828900000000002,"stat_sum":{"num_bytes":8028068,"num_objects":22,"num_object_clones":2,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":3,"num_read":5919,"num_read_kb":10650,"num_write":84,"num_write_kb":2643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"50'176","reported_seq":7826,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.309714+0000","last_change":"2024-09-13T05:10:34.613364+0000","last_active":"2024-09-13T05:10:41.309714+0000","last_peered":"2024-09-13T05:10:41.309714+0000","last_clean":"2024-09-13T05:10:41.309714+0000","last_became_active":"2024-09-13T05:10:34.612547+0000","last_became_peered":"2024-09-13T05:10:34.612547+0000","last_unstale":"2024-09-13T05:10:41.309714+0000","last_undegraded":"2024-09-13T05:10:41.309714+0000","last_fullsized":"2024-09-13T05:10:41.309714+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:03:39.521235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013204619999999999,"stat_sum":{"num_bytes":5113341,"num_objects":22,"num_object_clones":4,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":5,"num_read":7666,"num_read_kb":11102,"num_write":240,"num_write_kb":4802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":2443545,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"50'65","reported_seq":990,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.315641+0000","last_change":"2024-09-13T05:10:38.007507+0000","last_active":"2024-09-13T05:10:41.315641+0000","last_peered":"2024-09-13T05:10:41.315641+0000","last_clean":"2024-09-13T05:10:41.315641+0000","last_became_active":"2024-09-13T05:10:37.868643+0000","last_became_peered":"2024-09-13T05:10:37.868643+0000","last_unstale":"2024-09-13T05:10:41.315641+0000","last_undegraded":"2024-09-13T05:10:41.315641+0000","last_fullsized":"2024-09-13T05:10:41.315641+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:29:05.387242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055343700000000005,"stat_sum":{"num_bytes":606702,"num_objects":21,"num_object_clones":4,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":5,"num_read":846,"num_read_kb":26,"num_write":48,"num_write_kb":564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":15854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"50'43","reported_seq":145,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.310152+0000","last_change":"2024-09-13T05:10:11.647302+0000","last_active":"2024-09-13T05:10:41.310152+0000","last_peered":"2024-09-13T05:10:41.310152+0000","last_clean":"2024-09-13T05:10:41.310152+0000","last_became_active":"2024-09-13T05:10:09.647037+0000","last_became_peered":"2024-09-13T05:10:09.647037+0000","last_unstale":"2024-09-13T05:10:41.310152+0000","last_undegraded":"2024-09-13T05:10:41.310152+0000","last_fullsized":"2024-09-13T05:10:41.310152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:54:17.061326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069994199999999995,"stat_sum":{"num_bytes":8105334,"num_objects":19,"num_object_clones":2,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":3,"num_read":91,"num_read_kb":2261,"num_write":34,"num_write_kb":1191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"51'176","reported_seq":2365,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.903772+0000","last_change":"2024-09-13T05:10:11.682463+0000","last_active":"2024-09-13T05:10:41.903772+0000","last_peered":"2024-09-13T05:10:41.903772+0000","last_clean":"2024-09-13T05:10:41.903772+0000","last_became_active":"2024-09-13T05:10:09.647600+0000","last_became_peered":"2024-09-13T05:10:09.647600+0000","last_unstale":"2024-09-13T05:10:41.903772+0000","last_undegraded":"2024-09-13T05:10:41.903772+0000","last_fullsized":"2024-09-13T05:10:41.903772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:20:16.632365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019283150000000001,"stat_sum":{"num_bytes":32281806,"num_objects":26,"num_object_clones":4,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":3,"num_read":2621,"num_read_kb":5057,"num_write":210,"num_write_kb":4966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"50'549","reported_seq":4408,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.319213+0000","last_change":"2024-09-13T05:10:40.887883+0000","last_active":"2024-09-13T05:10:41.319213+0000","last_peered":"2024-09-13T05:10:41.319213+0000","last_clean":"2024-09-13T05:10:41.319213+0000","last_became_active":"2024-09-13T05:10:40.884580+0000","last_became_peered":"2024-09-13T05:10:40.884580+0000","last_unstale":"2024-09-13T05:10:41.319213+0000","last_undegraded":"2024-09-13T05:10:41.319213+0000","last_fullsized":"2024-09-13T05:10:41.319213+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:00.074124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018982339999999999,"stat_sum":{"num_bytes":6645790,"num_objects":21,"num_object_clones":2,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":3,"num_read":5564,"num_read_kb":4911,"num_write":942,"num_write_kb":3878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":2255641,"num_keys_recovered":18,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"50'348","reported_seq":460,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.851612+0000","last_change":"2024-09-13T05:10:40.885332+0000","last_active":"2024-09-13T05:10:41.851612+0000","last_peered":"2024-09-13T05:10:41.851612+0000","last_clean":"2024-09-13T05:10:41.851612+0000","last_became_active":"2024-09-13T05:10:40.884585+0000","last_became_peered":"2024-09-13T05:10:40.884585+0000","last_unstale":"2024-09-13T05:10:41.851612+0000","last_undegraded":"2024-09-13T05:10:41.851612+0000","last_fullsized":"2024-09-13T05:10:41.851612+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:31:19.596080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001164273,"stat_sum":{"num_bytes":9868250,"num_objects":14,"num_object_clones":3,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":2,"num_read":1757,"num_read_kb":1442,"num_write":608,"num_write_kb":1001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":296075,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"50'68","reported_seq":252,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.850944+0000","last_change":"2024-09-13T05:10:37.938278+0000","last_active":"2024-09-13T05:10:41.850944+0000","last_peered":"2024-09-13T05:10:41.850944+0000","last_clean":"2024-09-13T05:10:41.850944+0000","last_became_active":"2024-09-13T05:10:37.862703+0000","last_became_peered":"2024-09-13T05:10:37.862703+0000","last_unstale":"2024-09-13T05:10:41.850944+0000","last_undegraded":"2024-09-13T05:10:41.850944+0000","last_fullsized":"2024-09-13T05:10:41.850944+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:39.174909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009951719999999999,"stat_sum":{"num_bytes":21746225,"num_objects":24,"num_object_clones":1,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":3,"num_read":104,"num_read_kb":4134,"num_write":57,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":569424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"47'72","reported_seq":220,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.454439+0000","last_change":"2024-09-13T05:10:11.680757+0000","last_active":"2024-09-13T05:10:41.454439+0000","last_peered":"2024-09-13T05:10:41.454439+0000","last_clean":"2024-09-13T05:10:41.454439+0000","last_became_active":"2024-09-13T05:10:09.653444+0000","last_became_peered":"2024-09-13T05:10:09.653444+0000","last_unstale":"2024-09-13T05:10:41.454439+0000","last_undegraded":"2024-09-13T05:10:41.454439+0000","last_fullsized":"2024-09-13T05:10:41.454439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:17:06.303008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000625977,"stat_sum":{"num_bytes":8824996,"num_objects":25,"num_object_clones":5,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":5,"num_read":140,"num_read_kb":4861,"num_write":58,"num_write_kb":3104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"50'143","reported_seq":870,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.884662+0000","last_change":"2024-09-13T05:10:40.884306+0000","last_active":"2024-09-13T05:10:41.884662+0000","last_peered":"2024-09-13T05:10:41.884662+0000","last_clean":"2024-09-13T05:10:41.884662+0000","last_became_active":"2024-09-13T05:10:40.883543+0000","last_became_peered":"2024-09-13T05:10:40.883543+0000","last_unstale":"2024-09-13T05:10:41.884662+0000","last_undegraded":"2024-09-13T05:10:41.884662+0000","last_fullsized":"2024-09-13T05:10:41.884662+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:14:23.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048307200000000003,"stat_sum":{"num_bytes":38768497,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":1638,"num_read_kb":3753,"num_write":138,"num_write_kb":3004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":633324,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"50'66","reported_seq":219,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-13T05:10:41.689991+0000","last_change":"2024-09-13T05:10:11.680877+0000","last_active":"2024-09-13T05:10:41.689991+0000","last_peered":"2024-09-13T05:10:41.689991+0000","last_clean":"2024-09-13T05:10:41.689991+0000","last_became_active":"2024-09-13T05:10:09.649053+0000","last_became_peered":"2024-09-13T05:10:09.649053+0000","last_unstale":"2024-09-13T05:10:41.689991+0000","last_undegraded":"2024-09-13T05:10:41.689991+0000","last_fullsized":"2024-09-13T05:10:41.689991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:14.770260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062821800000000005,"stat_sum":{"num_bytes":10861584,"num_objects":19,"num_object_clones":3,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":2,"num_read":136,"num_read_kb":485,"num_write":50,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":420971389,"num_objects":656,"num_object_clones":83,"num_object_copies":1312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":656,"num_whiteouts":117,"num_read":45895,"num_read_kb":108085,"num_write":4605,"num_write_kb":64800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":644,"num_bytes_recovered":16443981,"num_keys_recovered":103,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":109359104,"data_stored":124726352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3866,"ondisk_log_size":3866,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60720,"kb_used_data":25512,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94311120,"statfs":{"total":96636764160,"available":96574586880,"internally_reserved":0,"allocated":26124288,"data_stored":29383993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36043211},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,34,21,91,97],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44972,"kb_used_data":13848,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94326868,"statfs":{"total":96636764160,"available":96590712832,"internally_reserved":0,"allocated":14180352,"data_stored":15316306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51864,"kb_used_data":20752,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94319976,"statfs":{"total":96636764160,"available":96583655424,"internally_reserved":0,"allocated":21250048,"data_stored":22869588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]}]},{"osd":4,"up_from":0,"seq":55834574863,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54728,"kb_used_data":19520,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94317112,"statfs":{"total":96636764160,"available":96580722688,"internally_reserved":0,"allocated":19988480,"data_stored":21039178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38104,"kb_used_data":6992,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94333736,"statfs":{"total":96636764160,"available":96597745664,"internally_reserved":0,"allocated":7159808,"data_stored":8378649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]}]},{"osd":1,"up_from":0,"seq":55834574861,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":0,"seq":55834574863,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10035200,"data_stored":11939429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6619136,"data_stored":10238144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7303168,"data_stored":8835200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19415040,"data_stored":20790572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23179264,"data_stored":25103568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17797120,"data_stored":19226141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25010176,"data_stored":28593298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:10:42.679 INFO:tasks.thrashosds.thrasher:Setting 3.a to [3, 2] 2024-09-13T05:10:42.680 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.a', '3', '2'] 2024-09-13T05:10:42.680 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.a 3 2 2024-09-13T05:10:42.765 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:42.762+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:42.782 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:42.783 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:42.783 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:42.783 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:42.792 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:10:42.866 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:42.862+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:42.907 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:42.908 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:42.908 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:42.908 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:42.908 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:42.919 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:10:42.931 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:10:42.967 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:42.962+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:43.006 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone10 from 0xab49a7c (overlap 0x4b33c1c) to 0xf0a59f 2024-09-13T05:10:43.030 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:43.030 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:43.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:43.030 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:10:43.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.030 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:43.030 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:10:43.030 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 6.1645650700000001, 2024-09-13T05:10:43.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:10:43.030 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:43.030 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:43.031 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:43.031 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:43.031 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:43.031 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:10:43.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.031 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:43.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.031 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:43.031 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:10:43.031 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.031 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:43.031 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:10:43.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:43.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:10:43.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:43.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:43.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:10:43.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:10:43.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:43.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:10:43.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:10:43.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:43.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:10:43.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:10:43.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:10:43.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:10:43.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:43.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:10:43.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:10:43.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:10:43.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:10:43.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:43.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:10:43.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:10:43.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:43.035 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:10:43.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:10:43.035 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.035 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:43.035 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.035 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:43.035 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:10:43.035 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 6.1645406339999997, 2024-09-13T05:10:43.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:10:43.035 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:43.036 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:43.036 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:43.036 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:43.036 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:43.036 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:10:43.036 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.036 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:43.036 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.036 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:43.036 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:10:43.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.036 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.036 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.037 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:43.037 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:10:43.037 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.037 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:43.037 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:10:43.037 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:43.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.037 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:43.037 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:10:43.037 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:10:43.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:43.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:10:43.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:10:43.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:43.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:10:43.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:10:43.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:10:43.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:10:43.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:43.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:10:43.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:10:43.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:10:43.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:10:43.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:43.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:10:43.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:10:43.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:43.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:10:43.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:10:43.040 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.040 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:43.040 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.040 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:43.040 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:10:43.040 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 6.1645308080000003, 2024-09-13T05:10:43.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:10:43.041 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:43.041 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:43.041 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:43.041 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:43.041 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:43.041 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:10:43.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.041 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:43.041 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.041 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:43.041 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:10:43.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:43.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:10:43.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:43.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:10:43.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:43.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:43.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:10:43.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:10:43.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:43.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:10:43.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:10:43.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:43.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:10:43.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:10:43.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:10:43.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:10:43.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:43.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:10:43.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:10:43.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:10:43.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:10:43.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:43.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:10:43.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:10:43.045 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.045 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:43.045 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.045 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:43.045 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:10:43.045 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 6.1645225720000001, 2024-09-13T05:10:43.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:10:43.045 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:43.045 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:43.046 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:43.046 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:43.046 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:43.046 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:10:43.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.046 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:43.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.046 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:43.046 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:10:43.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.046 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:43.046 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:10:43.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:43.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:10:43.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:43.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:43.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:10:43.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:10:43.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:43.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:10:43.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:10:43.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:43.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:10:43.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:10:43.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:10:43.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:10:43.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.049 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:43.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:10:43.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:10:43.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.049 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:10:43.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:10:43.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.049 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:43.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:10:43.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:10:43.049 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.050 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:43.050 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.050 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.050 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.050 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:43.050 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:10:43.050 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 6.1645006599999999, 2024-09-13T05:10:43.050 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:10:43.050 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:43.050 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:43.050 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:43.050 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:43.050 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:43.050 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:10:43.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.051 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:43.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:43.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:10:43.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:43.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:10:43.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:43.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:10:43.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:43.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:43.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:10:43.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:10:43.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:43.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:10:43.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:10:43.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.053 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:43.053 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:10:43.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:10:43.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.053 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.053 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:10:43.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:10:43.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.053 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:43.053 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:10:43.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:10:43.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:10:43.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:10:43.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:43.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:10:43.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:10:43.054 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.054 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:43.054 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.055 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:43.055 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:10:43.055 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 6.1644920560000003, 2024-09-13T05:10:43.055 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:10:43.055 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:43.055 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:43.055 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:43.055 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:43.055 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:43.055 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:10:43.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.055 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:43.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.056 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:43.056 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:10:43.056 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.056 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.056 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:43.056 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:10:43.056 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.056 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.056 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:43.056 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:10:43.056 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:43.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:43.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:10:43.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:10:43.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:43.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:10:43.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:10:43.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:43.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:10:43.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:10:43.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:10:43.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:10:43.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:43.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:10:43.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:10:43.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:10:43.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:10:43.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.059 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.059 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:43.059 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:10:43.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:10:43.059 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.059 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:43.059 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.059 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.059 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:43.059 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:10:43.059 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 6.1644823620000002, 2024-09-13T05:10:43.060 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:10:43.060 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:43.060 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:43.060 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:43.060 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:43.060 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:43.060 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:10:43.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.060 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:43.060 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.060 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:43.060 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:10:43.060 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:43.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:10:43.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:43.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:10:43.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:43.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:43.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:10:43.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:10:43.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:43.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:10:43.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:10:43.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:43.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:10:43.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:10:43.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:10:43.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:10:43.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.063 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.063 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:43.063 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:10:43.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:10:43.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.063 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.063 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.063 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:10:43.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:10:43.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.063 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.064 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:43.064 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:10:43.064 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:10:43.064 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.064 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:43.064 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.064 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.064 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.064 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:43.064 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:10:43.064 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 6.1644732470000001, 2024-09-13T05:10:43.064 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:10:43.064 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:43.064 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:43.065 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:43.065 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:43.065 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:43.065 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:10:43.065 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.065 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:43.065 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.065 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:43.065 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:10:43.065 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.065 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.065 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.065 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:43.065 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:10:43.066 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.066 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.066 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.066 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:43.066 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:10:43.066 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:43.066 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.066 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.066 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:43.066 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:10:43.066 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:10:43.066 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.066 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.066 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:43.067 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:10:43.067 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:10:43.067 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.067 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.067 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:43.067 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:10:43.067 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:10:43.067 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.067 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.067 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.067 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:10:43.067 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:10:43.067 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.067 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.068 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:43.068 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:10:43.068 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:10:43.068 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.068 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.068 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.068 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:10:43.068 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:10:43.068 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.068 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.068 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:43.068 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:10:43.068 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:10:43.069 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.069 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:43.069 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.069 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.069 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.069 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:43.069 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:10:43.069 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 6.1644647680000002, 2024-09-13T05:10:43.069 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:10:43.069 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:43.069 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:43.069 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:43.069 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:43.069 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:43.070 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:10:43.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.070 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:43.070 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.070 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:43.070 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:10:43.070 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.070 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.070 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:43.070 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:10:43.070 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.070 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:43.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:10:43.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:43.071 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:43.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:10:43.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:10:43.071 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:43.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:10:43.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:10:43.071 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.072 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.072 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:43.072 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:10:43.072 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:10:43.072 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.072 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.072 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.072 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:10:43.072 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:10:43.072 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.072 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.072 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:43.072 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:10:43.072 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:10:43.073 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.073 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.073 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.073 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:10:43.073 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:10:43.073 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.073 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.073 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:43.073 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:10:43.073 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:10:43.073 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.073 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:43.073 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.073 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.074 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:43.074 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:10:43.074 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 6.1644528430000003, 2024-09-13T05:10:43.074 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:10:43.074 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:43.074 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:43.074 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:43.074 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:43.074 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:43.074 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:10:43.074 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.074 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:43.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.075 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:43.075 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:10:43.075 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.075 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:43.075 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:10:43.075 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.075 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:43.075 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:10:43.075 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:43.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.076 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.076 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:43.076 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:10:43.076 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:10:43.076 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.076 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.076 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:43.076 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:10:43.076 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:10:43.076 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.076 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.076 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:43.076 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:10:43.076 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:10:43.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.077 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.077 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.077 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:10:43.077 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:10:43.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.077 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.077 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:43.077 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:10:43.077 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:10:43.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.077 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.077 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.077 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:10:43.078 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:10:43.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.078 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:43.078 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:10:43.078 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:10:43.078 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.078 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:43.078 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.078 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:43.078 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:10:43.078 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 6.1644312540000001, 2024-09-13T05:10:43.079 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:10:43.079 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:43.079 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:43.079 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:43.079 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:43.079 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:43.079 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:10:43.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.079 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:43.079 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.079 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:43.079 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:10:43.079 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.080 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.080 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.080 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:43.080 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:10:43.080 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.080 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.080 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.080 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:43.080 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:10:43.080 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:43.080 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.080 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.080 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:43.080 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:10:43.081 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:10:43.081 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.081 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.081 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:43.081 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:10:43.081 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:10:43.081 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.081 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.081 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:43.081 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:10:43.081 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:10:43.081 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.081 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.081 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.082 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:10:43.082 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:10:43.082 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.082 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.082 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:43.082 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:10:43.082 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:10:43.082 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.082 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.082 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.082 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:10:43.082 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:10:43.082 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.083 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.083 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:43.083 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:10:43.083 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:10:43.083 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.083 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:43.083 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.083 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.083 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.083 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:43.083 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:10:43.083 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 6.1644081259999997, 2024-09-13T05:10:43.083 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:10:43.083 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:43.084 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:43.084 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:43.084 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:43.084 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:43.084 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:10:43.084 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.084 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:43.084 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.084 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:43.084 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:10:43.084 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.084 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.084 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.085 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:43.085 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:10:43.085 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.085 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.085 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.085 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:43.085 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:10:43.085 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:43.085 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.085 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.085 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:43.085 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:10:43.085 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:10:43.086 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.086 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.086 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:43.086 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:10:43.086 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:10:43.086 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.086 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.086 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:43.086 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:10:43.086 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:10:43.086 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.086 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.086 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.086 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:10:43.086 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:10:43.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.087 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.087 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:43.087 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:10:43.087 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:10:43.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.087 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.087 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.087 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:10:43.087 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:10:43.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.087 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.087 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:43.088 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:10:43.088 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:10:43.088 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.088 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:43.088 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.088 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.088 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.088 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:43.088 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:10:43.088 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 6.1643927529999996, 2024-09-13T05:10:43.088 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:10:43.088 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:43.088 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:43.089 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:43.089 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:43.089 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:43.089 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:10:43.089 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.089 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:43.089 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.089 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:43.089 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:10:43.089 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.089 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.089 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.089 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:43.089 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:10:43.090 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.090 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.090 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.090 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:43.090 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:10:43.090 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:43.090 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.090 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.090 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:43.091 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:10:43.091 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:10:43.091 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.091 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.091 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:43.091 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:10:43.091 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:10:43.091 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.091 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.091 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:43.091 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:10:43.091 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:10:43.091 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.091 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.092 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.092 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:10:43.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:10:43.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.092 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.092 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:43.092 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:10:43.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:10:43.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.092 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.092 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.092 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:10:43.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:10:43.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:43.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:10:43.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:10:43.093 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.093 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:43.093 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.093 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:43.093 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:10:43.093 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 6.1643722849999998, 2024-09-13T05:10:43.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:10:43.093 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:43.094 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:43.094 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:43.094 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:43.094 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:43.094 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:10:43.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.094 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:43.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.094 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:43.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:10:43.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.094 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:43.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:10:43.095 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.095 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.095 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.095 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:43.095 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:10:43.095 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:43.095 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.095 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.095 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:43.095 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:10:43.095 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:10:43.095 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.095 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.095 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:43.095 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:10:43.095 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:10:43.096 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.096 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.096 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:43.096 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:10:43.096 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:10:43.096 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.096 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.096 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.096 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:10:43.096 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:10:43.096 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.096 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.096 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:43.096 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:10:43.096 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:10:43.096 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.097 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.097 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.097 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:10:43.097 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:10:43.097 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.097 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.097 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:43.097 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:10:43.097 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:10:43.097 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.097 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:43.097 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.097 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.097 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.098 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:43.098 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:10:43.098 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 6.1643556239999997, 2024-09-13T05:10:43.098 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:10:43.098 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:43.098 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:43.098 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:43.098 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:43.098 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:43.101 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:10:43.101 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.101 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:43.101 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.101 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:43.101 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:10:43.101 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.102 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.102 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.102 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:43.102 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:10:43.102 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.102 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.102 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.102 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:43.102 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:10:43.102 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:43.102 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.102 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.102 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:43.102 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:10:43.102 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:10:43.103 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.103 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.103 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:43.103 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:10:43.103 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:10:43.103 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.103 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.103 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:43.103 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:10:43.103 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:10:43.103 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.103 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.103 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.103 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:10:43.104 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:10:43.104 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.104 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.104 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:43.104 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:10:43.104 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:10:43.104 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.104 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.104 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.104 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:10:43.104 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:10:43.104 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.104 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.105 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:43.105 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:10:43.105 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:10:43.105 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.105 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:43.105 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.105 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.105 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.105 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:43.105 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:10:43.105 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 6.1643289110000001, 2024-09-13T05:10:43.105 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:10:43.105 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:43.105 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:43.106 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:43.106 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:43.106 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:43.106 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:10:43.106 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.106 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:43.106 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.106 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:43.106 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:10:43.106 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.106 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.106 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.106 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:43.106 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:10:43.106 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.107 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.107 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.107 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:43.107 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:10:43.107 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:43.107 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.107 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.107 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:43.107 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:10:43.107 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:10:43.107 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.107 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.107 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:43.107 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:10:43.108 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:10:43.108 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.108 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.108 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:43.108 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:10:43.108 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:10:43.108 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.108 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.108 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.108 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:10:43.108 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:10:43.108 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.108 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.108 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:43.109 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:10:43.109 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:10:43.109 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.109 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.109 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.109 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:10:43.109 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:10:43.109 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.109 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.109 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:43.109 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:10:43.109 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:10:43.109 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.109 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:43.109 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.110 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.110 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.110 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:43.110 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:10:43.110 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 6.164310059, 2024-09-13T05:10:43.110 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:10:43.110 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:43.110 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:43.110 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:43.110 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:43.110 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:43.110 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:10:43.110 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.111 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:43.111 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.111 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:43.111 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:10:43.111 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.111 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.111 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.111 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:43.111 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:10:43.111 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.111 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.111 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.111 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:43.111 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:10:43.111 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:43.112 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.112 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.112 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:43.112 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:10:43.112 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:10:43.112 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.112 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.112 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:43.112 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:10:43.112 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:10:43.112 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.112 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.112 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:43.112 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:10:43.113 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:10:43.113 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.113 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.113 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.113 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:10:43.113 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:10:43.113 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.113 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.113 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:43.113 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:10:43.113 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:10:43.113 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.113 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.113 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.114 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:10:43.114 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:10:43.114 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.114 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.114 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:43.114 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:10:43.114 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:10:43.114 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.114 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:43.114 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.114 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.114 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.114 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:43.114 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:10:43.114 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 6.164292273, 2024-09-13T05:10:43.115 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:10:43.115 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:43.115 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:43.115 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:43.115 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:43.115 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:43.115 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:10:43.115 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.115 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:43.115 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.115 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:43.115 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:10:43.115 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.115 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.115 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.116 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:43.116 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:10:43.116 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.116 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.116 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.116 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:43.116 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:10:43.116 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:43.116 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.116 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.116 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:43.116 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:10:43.116 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:10:43.116 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.117 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.117 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:43.117 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:10:43.117 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:10:43.117 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.117 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.117 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:43.117 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:10:43.117 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:10:43.117 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.117 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.117 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.117 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:10:43.117 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:10:43.118 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.118 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.118 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:43.118 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:10:43.118 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:10:43.118 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.118 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.118 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.118 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:10:43.118 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:10:43.118 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.118 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.118 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:43.118 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:10:43.118 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:10:43.119 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.119 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:43.119 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.119 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.119 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.119 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:43.119 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:10:43.119 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 6.164257213, 2024-09-13T05:10:43.119 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:10:43.119 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:43.119 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:43.119 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:43.119 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:43.119 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:43.120 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:10:43.120 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.120 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:43.120 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.120 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:43.120 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:10:43.120 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.120 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.120 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.120 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:43.120 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:10:43.120 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.120 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.120 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.120 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:43.121 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:10:43.121 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:43.121 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.121 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.121 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:43.121 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:10:43.121 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:10:43.121 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.121 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.121 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:43.121 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:10:43.121 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:10:43.121 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.121 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.122 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:43.122 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:10:43.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:10:43.122 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.122 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.122 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.122 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:10:43.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:10:43.122 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.122 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.122 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:43.122 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:10:43.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:10:43.122 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.123 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.123 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.123 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:10:43.123 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:10:43.123 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.123 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.123 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:43.123 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:10:43.123 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:10:43.123 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.123 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:43.123 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.123 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.124 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.124 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:43.124 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:10:43.124 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 6.1642403980000005, 2024-09-13T05:10:43.124 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:10:43.124 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:43.124 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:43.124 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:43.124 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:43.124 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:43.124 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:10:43.124 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.124 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:43.125 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.125 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:43.125 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:10:43.125 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.125 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.125 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.125 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:43.125 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:10:43.125 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:43.125 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.125 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.125 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:43.125 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:10:43.125 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:43.126 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.126 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.126 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:43.126 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:10:43.126 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:10:43.126 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.126 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.126 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:43.126 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:10:43.126 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:10:43.126 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.126 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.126 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:43.126 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:10:43.127 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:10:43.127 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.127 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.127 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.127 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:10:43.127 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:10:43.127 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.127 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.127 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:43.127 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:10:43.127 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:10:43.127 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.127 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.127 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:43.127 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:10:43.128 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:10:43.128 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:43.128 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:43.128 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:43.128 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:10:43.128 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:10:43.128 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.128 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:43.128 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.128 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:43.128 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:43.128 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:43.130 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:10:43.130 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:10:43.130 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:10:43.130 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #9, image image_client.0-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent10 2024-09-13T05:10:43.131 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:43.126+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:43.131 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:10:43.137 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:10:43.160 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:10:43.184 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:10:43.205 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:10:43.227 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:10:43.229 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:10:43.229 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:10:43.229 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:10:43.229 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:10:43.229 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:10:43.229 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:10:43.229 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:10:43.229 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:10:43.230 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:43.226+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:43.247 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:43.248 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:43.260 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:10:43.297 INFO:teuthology.orchestra.run.smithi120.stdout:1288 punch from 0x1ff2c1f to 0x200035e, (0xd73f bytes) 2024-09-13T05:10:43.305 INFO:teuthology.orchestra.run.smithi120.stdout:1292 read 0x772463f thru 0x772f45f (0xae21 bytes) 2024-09-13T05:10:43.307 INFO:teuthology.orchestra.run.smithi120.stdout:1293 write 0x1170cfe thru 0x1176a2d (0x5d30 bytes) 2024-09-13T05:10:43.324 INFO:teuthology.orchestra.run.smithi120.stdout:1296 read 0x2f526e8 thru 0x2f56e39 (0x4752 bytes) 2024-09-13T05:10:43.331 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:43.326+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:43.341 INFO:teuthology.orchestra.run.smithi120.stdout:1298 write 0xc32da07 thru 0xc339d56 (0xc350 bytes) 2024-09-13T05:10:43.348 INFO:teuthology.orchestra.run.smithi120.stdout:1299 read 0x75af00c thru 0x75bdd82 (0xed77 bytes) 2024-09-13T05:10:43.350 INFO:teuthology.orchestra.run.smithi120.stdout:1300 read 0x94e4b5a thru 0x94e780f (0x2cb6 bytes) 2024-09-13T05:10:43.352 INFO:teuthology.orchestra.run.smithi120.stdout:1301 write 0x1ad63c7 thru 0x1ada709 (0x4343 bytes) 2024-09-13T05:10:43.387 INFO:teuthology.orchestra.run.smithi120.stdout:1304 write 0xccf443a thru 0xccfe69f (0xa266 bytes) 2024-09-13T05:10:43.392 INFO:teuthology.orchestra.run.smithi120.stdout:1306 read 0x7334763 thru 0x7338003 (0x38a1 bytes) 2024-09-13T05:10:43.393 INFO:teuthology.orchestra.run.smithi120.stdout:1307 read 0xc56199 thru 0xc5bc01 (0x5a69 bytes) 2024-09-13T05:10:43.395 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:43.402 INFO:teuthology.orchestra.run.smithi120.stdout:1309 trunc from 0xccfe6a0 to 0x90c90e7 2024-09-13T05:10:43.413 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:43.413 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:43.426 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:10:43.433 INFO:teuthology.orchestra.run.smithi120.stdout:1310 read 0x42416d0 thru 0x4249096 (0x79c7 bytes) 2024-09-13T05:10:43.433 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:43.430+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:43.435 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:43.435 INFO:teuthology.orchestra.run.smithi120.stdout:1312 punch from 0x6d3f428 to 0x6d48633, (0x920b bytes) 2024-09-13T05:10:43.456 INFO:teuthology.orchestra.run.smithi120.stdout:1313 write 0xdd6a2b1 thru 0xdd73c80 (0x99d0 bytes) 2024-09-13T05:10:43.461 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:43.474 INFO:teuthology.orchestra.run.smithi120.stdout:1315 trunc from 0xdd73c81 to 0x6cff44f 2024-09-13T05:10:43.529 INFO:teuthology.orchestra.run.smithi120.stdout:1316 writesame 0xdaca04d thru 0xdad5762 data_size 0x6d(0xb716 bytes) 2024-09-13T05:10:43.529 INFO:teuthology.orchestra.run.smithi120.stdout:1317 read 0xa04af6f thru 0xa05308b (0x811d bytes) 2024-09-13T05:10:43.529 INFO:teuthology.orchestra.run.smithi120.stdout:1318 read 0xda194c6 thru 0xda1a4c8 (0x1003 bytes) 2024-09-13T05:10:43.529 INFO:teuthology.orchestra.run.smithi120.stdout:1319 write 0xacd0028 thru 0xacd1203 (0x11dc bytes) 2024-09-13T05:10:43.533 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:43.526+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:43.543 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:43.543 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:43.545 INFO:teuthology.orchestra.run.smithi120.stdout:1320 trunc from 0xdad5763 to 0x77b6522 2024-09-13T05:10:43.555 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:10:43.569 INFO:teuthology.orchestra.run.smithi120.stdout:1321 read 0x3fdd6f3 thru 0x3fe7225 (0x9b33 bytes) 2024-09-13T05:10:43.571 INFO:teuthology.orchestra.run.smithi120.stdout:1322 write 0x58ede8e thru 0x58fb72b (0xd89e bytes) 2024-09-13T05:10:43.575 INFO:teuthology.orchestra.run.smithi120.stdout:1323 read 0x1a0a5c8 thru 0x1a178b5 (0xd2ee bytes) 2024-09-13T05:10:43.576 INFO:teuthology.orchestra.run.smithi120.stdout:1324 read 0x6179aa2 thru 0x6180c8d (0x71ec bytes) 2024-09-13T05:10:43.577 INFO:teuthology.orchestra.run.smithi120.stdout:1325 read 0x62f16fa thru 0x62f6ff8 (0x58ff bytes) 2024-09-13T05:10:43.598 INFO:teuthology.orchestra.run.smithi120.stdout:1326 write 0xcf0be8b thru 0xcf179ec (0xbb62 bytes) 2024-09-13T05:10:43.604 INFO:teuthology.orchestra.run.smithi120.stdout:1327 read 0x70f8550 thru 0x7106384 (0xde35 bytes) 2024-09-13T05:10:43.605 INFO:teuthology.orchestra.run.smithi120.stdout:1328 punch from 0x86420e4 to 0x8645861, (0x377d bytes) 2024-09-13T05:10:43.605 INFO:teuthology.orchestra.run.smithi120.stdout:1331 punch from 0x2dd07c1 to 0x2dd97cb, (0x900a bytes) 2024-09-13T05:10:43.605 INFO:teuthology.orchestra.run.smithi120.stdout:1332 read 0xa891b4c thru 0xa89b79c (0x9c51 bytes) 2024-09-13T05:10:43.605 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:43.606 INFO:teuthology.orchestra.run.smithi120.stdout:1338 write 0x83f1302 thru 0x83f605a (0x4d59 bytes) 2024-09-13T05:10:43.611 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:43.622 INFO:teuthology.orchestra.run.smithi120.stdout:1341 trunc from 0xcf179ed to 0x6cbe5cd 2024-09-13T05:10:43.634 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:43.630+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:43.645 INFO:teuthology.orchestra.run.smithi120.stdout:1342 read 0x194049a thru 0x194e0ef (0xdc56 bytes) 2024-09-13T05:10:43.647 INFO:teuthology.orchestra.run.smithi120.stdout:1347 writesame 0x33f7c92 thru 0x33fab50 data_size 0x1(0x2ebf bytes) 2024-09-13T05:10:43.658 INFO:teuthology.orchestra.run.smithi120.stdout:1348 read 0x509c49c thru 0x509d408 (0xf6d bytes) 2024-09-13T05:10:43.679 INFO:teuthology.orchestra.run.smithi120.stdout:1349 write 0xb88700a thru 0xb88f8ed (0x88e4 bytes) 2024-09-13T05:10:43.684 INFO:teuthology.orchestra.run.smithi120.stdout:1350 read 0x6975507 thru 0x6978ac5 (0x35bf bytes) 2024-09-13T05:10:43.686 INFO:teuthology.orchestra.run.smithi120.stdout:1351 punch from 0x29873d4 to 0x29939ae, (0xc5da bytes) 2024-09-13T05:10:43.686 INFO:teuthology.orchestra.run.smithi120.stdout:1352 write 0x3389992 thru 0x3394bd8 (0xb247 bytes) 2024-09-13T05:10:43.689 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:43.689 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:43.700 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:10:43.702 INFO:teuthology.orchestra.run.smithi120.stdout:1353 write 0xc9398e3 thru 0xc93fee0 (0x65fe bytes) 2024-09-13T05:10:43.709 INFO:teuthology.orchestra.run.smithi120.stdout:1354 flatten 2024-09-13T05:10:43.734 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:43.729+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:43.737 INFO:teuthology.orchestra.run.smithi120.stdout:1355 punch from 0x1591078 to 0x159871e, (0x76a6 bytes) 2024-09-13T05:10:43.737 INFO:teuthology.orchestra.run.smithi120.stdout:1356 read 0x7ab326d thru 0x7abb6b7 (0x844b bytes) 2024-09-13T05:10:43.737 INFO:teuthology.orchestra.run.smithi120.stdout:1358 write 0x85e12bb thru 0x85e2119 (0xe5f bytes) 2024-09-13T05:10:43.760 INFO:teuthology.orchestra.run.smithi120.stdout:1359 trunc from 0xc93fee1 to 0x21954ee 2024-09-13T05:10:43.814 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:43.814 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:43.815 INFO:teuthology.orchestra.run.smithi120.stdout:1360 writesame 0xe3ecb85 thru 0xe3fc9ba data_size 0xd(0xfe36 bytes) 2024-09-13T05:10:43.816 INFO:teuthology.orchestra.run.smithi120.stdout:1361 read 0x997da07 thru 0x998645b (0x8a55 bytes) 2024-09-13T05:10:43.816 INFO:teuthology.orchestra.run.smithi120.stdout:1362 read 0xd0e7cf6 thru 0xd0ec1ac (0x44b7 bytes) 2024-09-13T05:10:43.816 INFO:teuthology.orchestra.run.smithi120.stdout:1363 writesame 0xad8b68a thru 0xad970c4 data_size 0x5(0xba3b bytes) 2024-09-13T05:10:43.824 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:10:43.847 INFO:teuthology.orchestra.run.smithi120.stdout:1364 trunc from 0xe3fc9bb to 0x113404a 2024-09-13T05:10:43.848 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:43.841+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:43.890 INFO:teuthology.orchestra.run.smithi120.stdout:1365 writesame 0x483cc11 thru 0x4841aac data_size 0x34(0x4e9c bytes) 2024-09-13T05:10:43.908 INFO:teuthology.orchestra.run.smithi120.stderr:set 3.a pg_upmap mapping to [3,2] 2024-09-13T05:10:43.917 INFO:teuthology.orchestra.run.smithi120.stdout:1366 write 0xcccf9e6 thru 0xccd5f32 (0x654d bytes) 2024-09-13T05:10:43.920 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T05:10:43.922 INFO:teuthology.orchestra.run.smithi120.stdout:1367 writesame 0x72e1f5a thru 0x72ea92e data_size 0x1(0x89d5 bytes) 2024-09-13T05:10:43.936 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:43.930+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:43.952 INFO:teuthology.orchestra.run.smithi120.stdout:1368 read 0x25b6dd3 thru 0x25bf368 (0x8596 bytes) 2024-09-13T05:10:43.953 INFO:teuthology.orchestra.run.smithi120.stdout:1369 read 0x55c135d thru 0x55d0526 (0xf1ca bytes) 2024-09-13T05:10:43.953 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:43.953 INFO:teuthology.orchestra.run.smithi120.stdout:1372 punch from 0xc0b6e48 to 0xc0bd81b, (0x69d3 bytes) 2024-09-13T05:10:43.953 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:43.957 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:43.958 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:43.972 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:10:43.974 INFO:teuthology.orchestra.run.smithi120.stdout:1374 trunc from 0xccd5f33 to 0xba8b11 2024-09-13T05:10:44.010 INFO:teuthology.orchestra.run.smithi120.stdout:1375 writesame 0x286170f thru 0x287079a data_size 0xa(0xf08c bytes) 2024-09-13T05:10:44.023 INFO:teuthology.orchestra.run.smithi120.stdout:1376 trunc from 0x287079b to 0xa0fceb5 2024-09-13T05:10:44.035 INFO:teuthology.orchestra.run.smithi120.stdout:1378 write 0x3d25a12 thru 0x3d2cc8b (0x727a bytes) 2024-09-13T05:10:44.036 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:44.029+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:44.042 INFO:teuthology.orchestra.run.smithi120.stdout:1379 clone 12 order 18 su 32768 sc 15 2024-09-13T05:10:44.075 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:44.075 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:44.085 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:10:44.137 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:44.133+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:44.238 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:44.234+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:44.241 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:44.241 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:44.250 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:10:44.338 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:44.334+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:44.352 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:44.352 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:44.362 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:10:44.439 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:44.434+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:44.470 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:44.470 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:44.479 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:10:44.540 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:44.534+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:44.589 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:44.589 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:44.599 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:10:44.641 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:44.637+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:44.706 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:44.706 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:44.715 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:10:44.742 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:44.737+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:44.830 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:44.830 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:44.840 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:10:44.842 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:44.838+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:44.918 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is set 2024-09-13T05:10:44.945 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:44.942+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:44.951 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:44.951 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:44.962 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:10:45.046 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:45.042+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:45.065 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:45.065 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:45.075 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:10:45.147 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:45.145+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:45.229 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:45.229 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:45.239 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:10:45.243 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:10:45.290 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:45.285+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:45.344 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:45.345 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:45.349 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:45.346+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:45.354 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:10:45.398 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:10:45.427 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:10:45.448 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:10:45.450 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:45.445+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:45.458 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:45.458 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:45.467 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:10:45.468 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:10:45.487 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:10:45.508 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:10:45.530 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:10:45.550 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:45.546+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:45.552 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:10:45.555 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:10:45.555 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:10:45.555 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:10:45.555 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:10:45.555 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:10:45.555 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:10:45.555 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:10:45.555 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:10:45.577 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:45.577 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:45.577 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:45.577 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:45.587 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:10:45.651 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:45.645+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:45.691 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:45.691 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:45.691 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:45.691 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:45.691 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:45.701 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:10:45.752 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:45.746+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:45.811 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:45.812 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:45.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:45.812 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:10:45.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.812 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29020 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2855936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:45.812 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:10:45.812 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.7666811809999992, 2024-09-13T05:10:45.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060733743, 2024-09-13T05:10:45.812 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:45.812 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:45.813 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:45.813 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:45.813 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:45.813 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29020 2024-09-13T05:10:45.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.813 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:45.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:45.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:10:45.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:45.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:10:45.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:45.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041741+0000", 2024-09-13T05:10:45.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:45.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:45.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041749+0000", 2024-09-13T05:10:45.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6059999999999997e-06 2024-09-13T05:10:45.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.815 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.815 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:45.815 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041754+0000", 2024-09-13T05:10:45.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6740000000000002e-06 2024-09-13T05:10:45.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.815 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.815 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:45.815 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041760+0000", 2024-09-13T05:10:45.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0459999999999996e-06 2024-09-13T05:10:45.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.815 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.815 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:45.815 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102289+0000", 2024-09-13T05:10:45.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060529145999999999 2024-09-13T05:10:45.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:45.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102378+0000", 2024-09-13T05:10:45.816 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8901999999999997e-05 2024-09-13T05:10:45.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:45.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102476+0000", 2024-09-13T05:10:45.816 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7991000000000004e-05 2024-09-13T05:10:45.816 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.816 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:45.816 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.817 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29021 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2865152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:45.817 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:10:45.817 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.766659186, 2024-09-13T05:10:45.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060927993999999999, 2024-09-13T05:10:45.817 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:45.817 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:45.817 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:45.817 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:45.817 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:45.817 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29021 2024-09-13T05:10:45.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.818 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:45.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:45.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:10:45.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.818 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:45.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:10:45.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.818 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:45.819 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041763+0000", 2024-09-13T05:10:45.819 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:45.819 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.819 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.819 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:45.819 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041766+0000", 2024-09-13T05:10:45.819 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6800000000000002e-06 2024-09-13T05:10:45.819 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.819 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.819 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:45.819 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041771+0000", 2024-09-13T05:10:45.819 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:10:45.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.820 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:45.820 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041776+0000", 2024-09-13T05:10:45.820 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8489999999999997e-06 2024-09-13T05:10:45.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.820 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:45.820 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102513+0000", 2024-09-13T05:10:45.820 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060737102000000001 2024-09-13T05:10:45.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.820 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:45.820 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102597+0000", 2024-09-13T05:10:45.821 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4374000000000002e-05 2024-09-13T05:10:45.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.821 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.821 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:45.821 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102692+0000", 2024-09-13T05:10:45.821 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4436000000000002e-05 2024-09-13T05:10:45.821 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.821 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:45.821 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.821 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.821 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29022 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2874368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:45.821 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:10:45.822 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.7666428859999996, 2024-09-13T05:10:45.822 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061135083999999999, 2024-09-13T05:10:45.822 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:45.822 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:45.822 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:45.822 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:45.822 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:45.822 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29022 2024-09-13T05:10:45.822 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.822 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:45.822 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.822 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:45.822 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:10:45.822 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:45.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:10:45.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:45.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:10:45.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:45.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:45.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041782+0000", 2024-09-13T05:10:45.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4959999999999999e-06 2024-09-13T05:10:45.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.824 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:45.824 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041787+0000", 2024-09-13T05:10:45.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1240000000000004e-06 2024-09-13T05:10:45.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.824 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:45.824 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041792+0000", 2024-09-13T05:10:45.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9200000000000003e-06 2024-09-13T05:10:45.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.825 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:45.825 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102738+0000", 2024-09-13T05:10:45.825 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060945581999999998 2024-09-13T05:10:45.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.825 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.825 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:45.825 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102821+0000", 2024-09-13T05:10:45.825 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2898999999999994e-05 2024-09-13T05:10:45.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.825 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.825 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:45.825 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102915+0000", 2024-09-13T05:10:45.825 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4523000000000003e-05 2024-09-13T05:10:45.826 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.826 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:45.826 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.826 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.826 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29067 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2764800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:45.826 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:10:45.826 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.7628686689999995, 2024-09-13T05:10:45.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060816621000000001, 2024-09-13T05:10:45.826 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:45.826 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:45.826 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:45.826 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:45.826 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:45.827 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29067 2024-09-13T05:10:45.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.827 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:45.827 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.827 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:45.827 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:10:45.827 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.827 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.827 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:45.827 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:10:45.827 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.827 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.828 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:45.828 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:10:45.828 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:45.828 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.828 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.828 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:45.828 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045557+0000", 2024-09-13T05:10:45.828 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.898e-06 2024-09-13T05:10:45.828 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.828 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.828 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:45.828 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045575+0000", 2024-09-13T05:10:45.828 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8252000000000001e-05 2024-09-13T05:10:45.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:45.829 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045581+0000", 2024-09-13T05:10:45.829 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:10:45.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:45.829 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106183+0000", 2024-09-13T05:10:45.829 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060602630999999997 2024-09-13T05:10:45.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:45.829 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106271+0000", 2024-09-13T05:10:45.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7329000000000004e-05 2024-09-13T05:10:45.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.830 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.830 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:45.830 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106371+0000", 2024-09-13T05:10:45.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000100164 2024-09-13T05:10:45.830 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.830 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:45.830 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.830 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.830 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29068 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2774016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:45.830 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:10:45.831 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.7628374349999998, 2024-09-13T05:10:45.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060994509000000002, 2024-09-13T05:10:45.831 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:45.831 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:45.831 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:45.831 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:45.831 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:45.831 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29068 2024-09-13T05:10:45.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.831 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:45.831 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.831 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:45.831 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:10:45.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.832 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.832 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.832 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:45.832 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:10:45.832 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.832 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.832 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.832 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:45.832 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045585+0000", 2024-09-13T05:10:45.832 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:45.832 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.832 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.832 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:45.832 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045588+0000", 2024-09-13T05:10:45.833 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:10:45.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.833 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.833 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:45.833 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045594+0000", 2024-09-13T05:10:45.833 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9329999999999998e-06 2024-09-13T05:10:45.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.833 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.833 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:45.833 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045599+0000", 2024-09-13T05:10:45.833 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3190000000000002e-06 2024-09-13T05:10:45.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.833 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:45.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106399+0000", 2024-09-13T05:10:45.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060800361999999997 2024-09-13T05:10:45.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:45.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106489+0000", 2024-09-13T05:10:45.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9301000000000004e-05 2024-09-13T05:10:45.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:45.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106580+0000", 2024-09-13T05:10:45.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1314e-05 2024-09-13T05:10:45.834 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.835 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:45.835 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.835 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29069 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2792448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:45.835 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:10:45.835 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.7628190180000001, 2024-09-13T05:10:45.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061207599000000001, 2024-09-13T05:10:45.835 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:45.835 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:45.835 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:45.835 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:45.835 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:45.835 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29069 2024-09-13T05:10:45.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.836 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:45.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.836 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:45.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:10:45.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.836 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:45.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:10:45.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.837 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:45.837 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045603+0000", 2024-09-13T05:10:45.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:45.837 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.837 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.837 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:45.837 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045606+0000", 2024-09-13T05:10:45.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7300000000000001e-06 2024-09-13T05:10:45.837 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.837 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.837 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:45.837 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045612+0000", 2024-09-13T05:10:45.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9599999999999997e-06 2024-09-13T05:10:45.838 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.838 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.838 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:45.838 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045619+0000", 2024-09-13T05:10:45.838 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6019999999999996e-06 2024-09-13T05:10:45.838 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.838 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.838 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:45.838 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106619+0000", 2024-09-13T05:10:45.838 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061000029999999997 2024-09-13T05:10:45.838 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.838 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.838 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:45.838 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106713+0000", 2024-09-13T05:10:45.839 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4505000000000004e-05 2024-09-13T05:10:45.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.839 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.839 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:45.839 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106812+0000", 2024-09-13T05:10:45.839 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8264000000000007e-05 2024-09-13T05:10:45.839 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.839 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:45.839 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.839 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.839 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29070 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2783232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:45.839 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:10:45.839 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.7627985590000002, 2024-09-13T05:10:45.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061389805999999998, 2024-09-13T05:10:45.840 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:45.840 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:45.840 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:45.840 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:45.840 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:45.840 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29070 2024-09-13T05:10:45.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.840 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:45.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.840 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:45.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:10:45.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.841 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.841 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:45.841 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:10:45.841 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.841 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.841 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:45.841 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:10:45.841 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:45.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.841 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.841 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:45.841 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045627+0000", 2024-09-13T05:10:45.842 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6579999999999998e-06 2024-09-13T05:10:45.842 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.842 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.842 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:45.842 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045632+0000", 2024-09-13T05:10:45.842 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8449999999999999e-06 2024-09-13T05:10:45.842 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.842 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.842 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:45.842 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045639+0000", 2024-09-13T05:10:45.842 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:10:45.842 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.842 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.843 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:45.843 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106837+0000", 2024-09-13T05:10:45.843 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061198529000000002 2024-09-13T05:10:45.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.843 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:45.843 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106922+0000", 2024-09-13T05:10:45.843 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4771999999999994e-05 2024-09-13T05:10:45.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.843 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:45.843 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107014+0000", 2024-09-13T05:10:45.843 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2009000000000006e-05 2024-09-13T05:10:45.843 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.844 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:45.844 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.844 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.844 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.844 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29071 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2801664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:45.844 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:10:45.844 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.7627794829999992, 2024-09-13T05:10:45.844 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061582804999999997, 2024-09-13T05:10:45.844 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:45.844 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:45.844 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:45.844 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:45.844 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:45.845 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29071 2024-09-13T05:10:45.845 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.845 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:45.845 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.845 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:45.845 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:10:45.845 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.845 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.845 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.845 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:45.845 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:10:45.845 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.845 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.845 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:45.846 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045643+0000", 2024-09-13T05:10:45.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:45.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:45.846 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045646+0000", 2024-09-13T05:10:45.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:10:45.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:45.846 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045664+0000", 2024-09-13T05:10:45.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8408000000000001e-05 2024-09-13T05:10:45.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.847 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.847 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:45.847 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045670+0000", 2024-09-13T05:10:45.847 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7710000000000003e-06 2024-09-13T05:10:45.847 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.847 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.847 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:45.847 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107048+0000", 2024-09-13T05:10:45.847 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061378438 2024-09-13T05:10:45.847 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.847 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.847 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:45.847 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107134+0000", 2024-09-13T05:10:45.847 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5574000000000004e-05 2024-09-13T05:10:45.848 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.848 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.848 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:45.848 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107226+0000", 2024-09-13T05:10:45.848 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2262000000000005e-05 2024-09-13T05:10:45.848 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.848 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:45.848 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.848 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.848 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.848 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29072 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2810880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:45.848 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:10:45.848 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.7627480989999995, 2024-09-13T05:10:45.849 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061762233999999999, 2024-09-13T05:10:45.849 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:45.849 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:45.849 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:45.849 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:45.849 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:45.849 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29072 2024-09-13T05:10:45.849 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.849 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:45.849 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.849 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:45.849 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:10:45.849 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.849 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.850 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.850 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:45.850 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:10:45.850 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.850 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.850 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.850 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:45.850 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045674+0000", 2024-09-13T05:10:45.850 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:45.850 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.851 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.851 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:45.851 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045677+0000", 2024-09-13T05:10:45.851 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9679999999999998e-06 2024-09-13T05:10:45.851 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.851 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.851 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:45.851 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045694+0000", 2024-09-13T05:10:45.851 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6801999999999999e-05 2024-09-13T05:10:45.851 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.851 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.851 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:45.851 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045700+0000", 2024-09-13T05:10:45.852 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8270000000000003e-06 2024-09-13T05:10:45.852 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.852 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.852 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:45.852 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107249+0000", 2024-09-13T05:10:45.852 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061549114000000002 2024-09-13T05:10:45.852 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.852 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.852 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:45.852 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107341+0000", 2024-09-13T05:10:45.852 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2390000000000001e-05 2024-09-13T05:10:45.852 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.852 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.853 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:45.853 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107437+0000", 2024-09-13T05:10:45.853 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5648000000000003e-05 2024-09-13T05:10:45.853 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.853 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:45.853 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.853 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.853 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.853 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29073 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2820096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:45.853 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:10:45.853 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.7627061210000008, 2024-09-13T05:10:45.853 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061873910999999997, 2024-09-13T05:10:45.853 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:45.853 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:45.854 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:45.854 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:45.854 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:45.854 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29073 2024-09-13T05:10:45.854 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.854 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:45.854 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.854 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:45.854 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:10:45.854 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.854 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.854 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.854 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:45.854 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:10:45.855 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.855 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.855 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.855 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:45.855 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045716+0000", 2024-09-13T05:10:45.855 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:45.855 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.855 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.855 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:45.855 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045726+0000", 2024-09-13T05:10:45.855 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6350000000000001e-06 2024-09-13T05:10:45.855 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.855 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.856 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:45.856 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045739+0000", 2024-09-13T05:10:45.856 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3325e-05 2024-09-13T05:10:45.856 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.856 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.856 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:45.856 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045746+0000", 2024-09-13T05:10:45.856 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7399999999999998e-06 2024-09-13T05:10:45.856 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.856 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.856 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:45.856 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107457+0000", 2024-09-13T05:10:45.857 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061711038000000003 2024-09-13T05:10:45.857 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.857 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.857 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:45.857 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107522+0000", 2024-09-13T05:10:45.857 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4850000000000004e-05 2024-09-13T05:10:45.857 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.857 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.857 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:45.857 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107591+0000", 2024-09-13T05:10:45.857 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9029999999999995e-05 2024-09-13T05:10:45.857 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.857 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:45.857 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.858 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.858 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.858 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29074 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2829312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:45.858 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:10:45.858 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.7626722130000001, 2024-09-13T05:10:45.858 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062055459, 2024-09-13T05:10:45.858 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:45.858 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:45.858 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:45.858 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:45.858 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:45.858 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29074 2024-09-13T05:10:45.858 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.858 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:45.859 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.859 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:45.859 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:10:45.859 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.859 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.859 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.859 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:45.859 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:10:45.859 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.859 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.859 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.859 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:45.859 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045750+0000", 2024-09-13T05:10:45.860 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:45.860 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.860 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.860 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:45.860 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045753+0000", 2024-09-13T05:10:45.860 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8399999999999999e-06 2024-09-13T05:10:45.860 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.860 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.860 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:45.860 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045759+0000", 2024-09-13T05:10:45.860 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8900000000000004e-06 2024-09-13T05:10:45.860 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.860 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.861 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:45.861 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045764+0000", 2024-09-13T05:10:45.861 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3850000000000001e-06 2024-09-13T05:10:45.861 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.861 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.861 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:45.861 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107623+0000", 2024-09-13T05:10:45.861 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061858817000000003 2024-09-13T05:10:45.861 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.861 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.861 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:45.861 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107710+0000", 2024-09-13T05:10:45.861 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7127999999999997e-05 2024-09-13T05:10:45.862 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.862 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.862 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:45.862 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107806+0000", 2024-09-13T05:10:45.862 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5886999999999999e-05 2024-09-13T05:10:45.862 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.862 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:45.862 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.862 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.862 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.862 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29075 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2838528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:45.862 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:10:45.862 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.7626537589999991, 2024-09-13T05:10:45.863 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062188516999999999, 2024-09-13T05:10:45.863 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:45.863 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:45.863 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:45.863 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:45.863 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:45.863 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29075 2024-09-13T05:10:45.863 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.863 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:45.863 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.863 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:45.863 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:10:45.863 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.864 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.864 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.864 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:45.864 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:10:45.864 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.864 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.864 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.864 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:45.864 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:10:45.864 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:45.864 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.864 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.864 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:45.865 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045772+0000", 2024-09-13T05:10:45.865 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:10:45.865 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.865 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.865 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:45.865 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045778+0000", 2024-09-13T05:10:45.865 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9229999999999996e-06 2024-09-13T05:10:45.865 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.865 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.865 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:45.865 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045784+0000", 2024-09-13T05:10:45.865 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3800000000000002e-06 2024-09-13T05:10:45.865 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.865 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.866 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:45.866 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107823+0000", 2024-09-13T05:10:45.866 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062039331000000003 2024-09-13T05:10:45.866 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.866 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.866 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:45.866 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107886+0000", 2024-09-13T05:10:45.866 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2476000000000003e-05 2024-09-13T05:10:45.866 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.866 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.866 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:45.866 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107958+0000", 2024-09-13T05:10:45.866 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2089999999999996e-05 2024-09-13T05:10:45.866 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.867 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:45.867 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.867 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.867 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.867 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29115 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2682880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:45.867 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:10:45.867 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.7591882319999996, 2024-09-13T05:10:45.867 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060847898999999997, 2024-09-13T05:10:45.867 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:45.867 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:45.867 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:45.867 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:45.867 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:45.868 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29115 2024-09-13T05:10:45.868 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.868 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:45.868 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.868 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:45.868 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:10:45.868 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.868 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.868 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.868 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:45.868 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:10:45.868 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.868 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.868 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.869 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:45.869 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049234+0000", 2024-09-13T05:10:45.869 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:45.869 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.869 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.869 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:45.869 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049237+0000", 2024-09-13T05:10:45.869 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9069999999999999e-06 2024-09-13T05:10:45.869 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.869 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.869 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:45.869 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049243+0000", 2024-09-13T05:10:45.869 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7459999999999997e-06 2024-09-13T05:10:45.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.870 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.870 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:45.870 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049248+0000", 2024-09-13T05:10:45.870 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1490000000000002e-06 2024-09-13T05:10:45.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.870 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.870 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:45.870 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.109945+0000", 2024-09-13T05:10:45.870 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060697299000000003 2024-09-13T05:10:45.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.870 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.870 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:45.871 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110013+0000", 2024-09-13T05:10:45.871 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8023999999999998e-05 2024-09-13T05:10:45.871 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.871 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.871 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:45.871 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110083+0000", 2024-09-13T05:10:45.871 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9296999999999997e-05 2024-09-13T05:10:45.871 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.871 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:45.871 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.871 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.871 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.871 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29116 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2692096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:45.872 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:10:45.872 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.7591703879999994, 2024-09-13T05:10:45.872 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061040167999999999, 2024-09-13T05:10:45.872 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:45.872 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:45.872 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:45.872 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:45.872 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:45.872 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29116 2024-09-13T05:10:45.872 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.872 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:45.872 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.872 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:45.873 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:10:45.873 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.873 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.873 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.873 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:45.873 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:10:45.873 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.873 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.873 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.873 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:45.873 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049252+0000", 2024-09-13T05:10:45.873 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:45.873 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.874 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.874 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:45.874 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049255+0000", 2024-09-13T05:10:45.874 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7250000000000002e-06 2024-09-13T05:10:45.874 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.874 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.874 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:45.874 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049261+0000", 2024-09-13T05:10:45.874 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.755e-06 2024-09-13T05:10:45.874 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.874 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.874 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:45.874 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049266+0000", 2024-09-13T05:10:45.875 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2100000000000001e-06 2024-09-13T05:10:45.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.875 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.875 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:45.875 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110115+0000", 2024-09-13T05:10:45.875 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060849225999999999 2024-09-13T05:10:45.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.875 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.875 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:45.875 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110199+0000", 2024-09-13T05:10:45.875 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4339999999999995e-05 2024-09-13T05:10:45.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.875 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.875 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:45.876 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110293+0000", 2024-09-13T05:10:45.876 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3397e-05 2024-09-13T05:10:45.876 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.876 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:45.876 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.876 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.876 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.876 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29117 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2701312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:45.876 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:10:45.876 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.7591527510000002, 2024-09-13T05:10:45.876 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.06118527, 2024-09-13T05:10:45.876 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:45.876 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:45.877 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:45.877 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:45.877 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:45.877 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29117 2024-09-13T05:10:45.877 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.877 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:45.877 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.877 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:45.877 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:10:45.877 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.877 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.877 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.877 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:45.877 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:10:45.878 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.878 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.878 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:45.878 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:10:45.878 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:45.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.878 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.878 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:45.878 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049273+0000", 2024-09-13T05:10:45.878 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.757e-06 2024-09-13T05:10:45.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.878 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:45.879 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049278+0000", 2024-09-13T05:10:45.879 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7830000000000004e-06 2024-09-13T05:10:45.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:45.879 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049284+0000", 2024-09-13T05:10:45.879 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3820000000000003e-06 2024-09-13T05:10:45.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:45.879 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110313+0000", 2024-09-13T05:10:45.879 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061029682000000002 2024-09-13T05:10:45.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.880 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.880 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:45.880 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110383+0000", 2024-09-13T05:10:45.880 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9406000000000006e-05 2024-09-13T05:10:45.880 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.880 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.880 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:45.880 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110456+0000", 2024-09-13T05:10:45.880 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2750000000000007e-05 2024-09-13T05:10:45.880 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.880 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:45.880 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.880 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.880 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.881 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29118 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2710528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:45.881 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:10:45.881 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.7591348359999994, 2024-09-13T05:10:45.881 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061380698999999997, 2024-09-13T05:10:45.881 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:45.881 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:45.881 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:45.881 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:45.881 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:45.881 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29118 2024-09-13T05:10:45.881 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.881 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:45.881 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.882 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:45.882 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:10:45.882 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.882 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:45.882 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:10:45.882 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.882 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:45.882 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:10:45.882 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:45.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.883 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.883 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:45.883 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049291+0000", 2024-09-13T05:10:45.883 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8770000000000002e-06 2024-09-13T05:10:45.883 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.883 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.883 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:45.883 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049296+0000", 2024-09-13T05:10:45.883 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6799999999999998e-06 2024-09-13T05:10:45.883 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.883 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.883 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:45.883 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049302+0000", 2024-09-13T05:10:45.884 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2769999999999996e-06 2024-09-13T05:10:45.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.884 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.884 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:45.884 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110488+0000", 2024-09-13T05:10:45.884 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061186184999999997 2024-09-13T05:10:45.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.884 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.884 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:45.884 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110577+0000", 2024-09-13T05:10:45.884 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9246000000000006e-05 2024-09-13T05:10:45.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.884 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:45.885 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110669+0000", 2024-09-13T05:10:45.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1923999999999996e-05 2024-09-13T05:10:45.885 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.885 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:45.885 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.885 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.885 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29119 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2719744~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:45.885 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:10:45.885 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.7591170920000003, 2024-09-13T05:10:45.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061521165000000003, 2024-09-13T05:10:45.885 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:45.885 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:45.886 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:45.886 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:45.886 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:45.886 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29119 2024-09-13T05:10:45.886 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.886 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:45.886 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.886 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:45.886 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:10:45.886 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.886 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.886 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.886 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:45.886 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:10:45.887 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.887 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.887 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.887 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:45.887 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049305+0000", 2024-09-13T05:10:45.887 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:45.887 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.887 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.887 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:45.887 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049308+0000", 2024-09-13T05:10:45.887 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7070000000000001e-06 2024-09-13T05:10:45.887 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.887 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.887 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:45.888 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049316+0000", 2024-09-13T05:10:45.888 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:10:45.888 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.888 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.888 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:45.888 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049322+0000", 2024-09-13T05:10:45.888 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3199999999999999e-06 2024-09-13T05:10:45.888 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.888 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.888 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:45.888 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110690+0000", 2024-09-13T05:10:45.888 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061368428000000003 2024-09-13T05:10:45.888 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.889 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.889 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:45.889 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110755+0000", 2024-09-13T05:10:45.889 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4893000000000004e-05 2024-09-13T05:10:45.889 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.889 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.889 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:45.889 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110827+0000", 2024-09-13T05:10:45.889 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2039000000000006e-05 2024-09-13T05:10:45.889 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.889 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:45.889 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.889 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.889 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.890 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29120 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2728960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:45.890 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:10:45.890 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.7590968220000001, 2024-09-13T05:10:45.890 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061718420000000003, 2024-09-13T05:10:45.890 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:45.890 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:45.890 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:45.890 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:45.890 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:45.890 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29120 2024-09-13T05:10:45.890 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.890 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:45.890 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.890 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:45.891 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:10:45.891 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.891 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.891 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.891 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:45.891 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:10:45.891 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.891 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.891 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.891 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:45.891 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:10:45.891 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:45.891 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.892 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:45.892 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049329+0000", 2024-09-13T05:10:45.892 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.022e-06 2024-09-13T05:10:45.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.892 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:45.892 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049336+0000", 2024-09-13T05:10:45.892 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0720000000000002e-06 2024-09-13T05:10:45.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.892 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:45.892 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049341+0000", 2024-09-13T05:10:45.893 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:10:45.893 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.893 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.893 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:45.893 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110864+0000", 2024-09-13T05:10:45.893 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061523126999999997 2024-09-13T05:10:45.893 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.893 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.893 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:45.893 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110951+0000", 2024-09-13T05:10:45.893 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6557000000000005e-05 2024-09-13T05:10:45.893 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.893 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.893 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:45.894 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.111045+0000", 2024-09-13T05:10:45.894 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4043999999999996e-05 2024-09-13T05:10:45.894 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.894 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:45.894 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.894 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.894 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29136 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2876416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:45.894 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:10:45.894 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.7550813969999997, 2024-09-13T05:10:45.894 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060742995000000001, 2024-09-13T05:10:45.894 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:45.894 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:45.894 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:45.895 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:45.895 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:45.895 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29136 2024-09-13T05:10:45.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.895 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:45.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.895 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:45.895 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:10:45.895 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.895 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:45.895 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:10:45.895 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.896 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.896 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.896 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:45.896 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053341+0000", 2024-09-13T05:10:45.896 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:45.896 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.896 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.896 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:45.896 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053344+0000", 2024-09-13T05:10:45.896 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:10:45.896 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.896 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.896 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:45.896 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053350+0000", 2024-09-13T05:10:45.897 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7200000000000003e-06 2024-09-13T05:10:45.897 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.897 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.897 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:45.897 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053355+0000", 2024-09-13T05:10:45.897 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0150000000000003e-06 2024-09-13T05:10:45.897 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.897 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.897 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:45.897 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113909+0000", 2024-09-13T05:10:45.897 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060554368999999997 2024-09-13T05:10:45.897 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.897 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.897 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:45.898 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113994+0000", 2024-09-13T05:10:45.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4658000000000002e-05 2024-09-13T05:10:45.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.898 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:45.898 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114085+0000", 2024-09-13T05:10:45.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0939000000000005e-05 2024-09-13T05:10:45.898 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.898 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:45.898 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.898 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29166 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2628608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:45.899 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:10:45.899 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.7550639629999996, 2024-09-13T05:10:45.899 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060883127000000002, 2024-09-13T05:10:45.899 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:45.899 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:45.899 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:45.899 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:45.899 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:45.899 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29166 2024-09-13T05:10:45.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.899 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:45.899 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.899 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:45.899 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:10:45.900 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.900 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.900 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.900 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:45.900 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:10:45.900 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:45.900 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.900 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.900 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:45.900 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:10:45.900 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:45.900 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.900 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.900 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:45.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053361+0000", 2024-09-13T05:10:45.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:10:45.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:45.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053367+0000", 2024-09-13T05:10:45.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7350000000000001e-06 2024-09-13T05:10:45.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:45.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053372+0000", 2024-09-13T05:10:45.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7840000000000003e-06 2024-09-13T05:10:45.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:45.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114103+0000", 2024-09-13T05:10:45.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060730924999999998 2024-09-13T05:10:45.902 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:45.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114171+0000", 2024-09-13T05:10:45.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8021999999999993e-05 2024-09-13T05:10:45.902 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:45.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:45.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:45.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114242+0000", 2024-09-13T05:10:45.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1390999999999995e-05 2024-09-13T05:10:45.902 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.903 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:45.903 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.903 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:45.903 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:45.903 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:45.904 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:10:45.905 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:45.898+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:46.005 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:46.002+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:46.017 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:46.017 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:46.017 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:46.017 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:46.026 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:10:46.106 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:46.101+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:46.127 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #10, image image_client.0-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent11 2024-09-13T05:10:46.138 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:46.138 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:46.138 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:46.138 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:46.138 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:46.149 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:10:46.170 INFO:teuthology.orchestra.run.smithi120.stdout:1380 writesame 0x936e41b thru 0x937b380 data_size 0x3(0xcf66 bytes) 2024-09-13T05:10:46.197 INFO:teuthology.orchestra.run.smithi120.stdout:1381 trunc from 0xa0fceb5 to 0xb158146 2024-09-13T05:10:46.207 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:46.202+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:46.209 INFO:teuthology.orchestra.run.smithi120.stdout:1382 writesame 0x81c2cda thru 0x81cbe80 data_size 0x9(0x91a7 bytes) 2024-09-13T05:10:46.219 INFO:teuthology.orchestra.run.smithi120.stdout:1383 punch from 0x5bb86a0 to 0x5bc2966, (0xa2c6 bytes) 2024-09-13T05:10:46.219 INFO:teuthology.orchestra.run.smithi120.stdout:1385 writesame 0x58a32b5 thru 0x58ac65b data_size 0x1(0x93a7 bytes) 2024-09-13T05:10:46.241 INFO:teuthology.orchestra.run.smithi120.stdout:1387 read 0x9e92423 thru 0x9ea141e (0xeffc bytes) 2024-09-13T05:10:46.241 INFO:teuthology.orchestra.run.smithi120.stdout:1388 writesame 0x4238d65 thru 0x42407e7 data_size 0x1(0x7a83 bytes) 2024-09-13T05:10:46.263 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:46.263 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:46.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:46.264 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:10:46.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.264 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:46.264 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:10:46.264 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.3978209649999993, 2024-09-13T05:10:46.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:10:46.264 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:46.264 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:46.264 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:46.264 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:46.264 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.264 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:10:46.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.265 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:46.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.265 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:46.265 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:10:46.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.265 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:46.265 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:10:46.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.265 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:46.266 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:10:46.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:46.266 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.266 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:46.266 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:10:46.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:10:46.266 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.266 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:46.266 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:10:46.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:10:46.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.267 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.267 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.267 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:10:46.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:10:46.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.267 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.267 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.267 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:10:46.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:10:46.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.267 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.267 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.267 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:10:46.268 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:10:46.268 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.268 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.268 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.268 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:10:46.268 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:10:46.268 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.268 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.268 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:46.268 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:10:46.268 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:10:46.268 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.268 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.269 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:46.269 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:10:46.269 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:10:46.269 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.269 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:46.269 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.269 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.269 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.269 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:46.269 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:10:46.269 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.3977965290000007, 2024-09-13T05:10:46.269 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:10:46.269 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:46.269 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:46.270 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:46.270 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:46.270 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.270 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:10:46.270 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.270 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:46.270 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.270 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:46.270 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:10:46.270 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.270 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.270 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.270 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:46.270 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:10:46.271 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.271 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.271 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.271 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:46.271 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:10:46.271 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:46.271 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.271 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.271 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:46.271 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:10:46.271 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:10:46.271 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.271 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.271 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:46.272 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:10:46.272 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:10:46.272 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.272 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.272 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.272 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:10:46.272 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:10:46.272 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.272 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.272 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.272 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:10:46.272 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:10:46.273 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.273 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.273 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.273 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:10:46.273 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:10:46.273 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.273 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.273 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.273 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:10:46.273 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:10:46.273 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.273 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.273 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:46.273 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:10:46.274 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:10:46.274 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.274 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.274 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:46.274 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:10:46.274 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:10:46.274 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.274 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:46.274 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.274 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.274 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.274 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:46.274 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:10:46.274 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.3977867029999995, 2024-09-13T05:10:46.274 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:10:46.275 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:46.275 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:46.275 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:46.275 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:46.275 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.275 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:10:46.275 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.275 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:46.275 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.275 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:46.275 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:10:46.275 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.275 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.275 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.276 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:46.276 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:10:46.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.276 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.276 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:46.276 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:10:46.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:46.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.276 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.276 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:46.276 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:10:46.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:10:46.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.277 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.277 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:46.277 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:10:46.277 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:10:46.277 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.277 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.277 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.277 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:10:46.277 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:10:46.277 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.277 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.277 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.277 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:10:46.277 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:10:46.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.278 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.278 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.278 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:10:46.278 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:10:46.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.278 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.278 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.278 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:10:46.278 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:10:46.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.278 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.278 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:46.278 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:10:46.279 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:10:46.279 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.279 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:46.279 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.279 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.279 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.279 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:46.279 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:10:46.279 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.3977784670000002, 2024-09-13T05:10:46.279 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:10:46.279 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:46.279 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:46.279 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:46.279 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:46.280 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.280 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:10:46.280 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.280 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:46.280 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.280 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:46.280 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:10:46.280 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.280 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.280 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.280 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:46.280 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:10:46.280 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.280 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.281 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.281 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:46.281 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:10:46.281 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:46.281 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.281 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.281 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:46.281 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:10:46.281 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:10:46.281 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.281 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.281 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:46.281 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:10:46.281 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:10:46.282 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.282 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.282 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.282 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:10:46.282 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:10:46.282 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.282 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.282 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.282 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:10:46.282 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:10:46.282 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.282 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.282 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.282 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:10:46.282 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:10:46.283 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.283 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.283 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.283 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:10:46.283 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:10:46.283 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.283 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.283 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:46.283 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:10:46.283 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:10:46.283 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.283 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:46.283 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.283 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.284 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.284 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:46.284 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:10:46.284 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.3977565550000008, 2024-09-13T05:10:46.284 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:10:46.284 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:46.284 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:46.284 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:46.284 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:46.284 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.284 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:10:46.284 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.284 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:46.284 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.285 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:46.285 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:10:46.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.285 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:46.285 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:10:46.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.285 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:46.285 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:10:46.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:46.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.286 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.286 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:46.286 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:10:46.286 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:10:46.286 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.286 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.286 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:46.286 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:10:46.286 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:10:46.286 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.286 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.286 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.286 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:10:46.286 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:10:46.287 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.287 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.287 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.287 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:10:46.287 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:10:46.287 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.287 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.287 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.287 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:10:46.287 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:10:46.287 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.287 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.287 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.287 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:10:46.288 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:10:46.288 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.288 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.288 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:46.288 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:10:46.288 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:10:46.288 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.288 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:46.288 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.288 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.288 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.288 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:46.288 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:10:46.289 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.3977479509999995, 2024-09-13T05:10:46.289 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:10:46.289 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:46.289 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:46.289 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:46.289 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:46.289 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.289 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:10:46.289 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.289 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:46.289 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.289 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:46.289 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:10:46.290 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.290 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.290 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.290 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:46.290 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:10:46.290 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.290 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.290 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.290 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:46.290 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:10:46.290 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:46.290 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.290 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.290 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:46.291 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:10:46.291 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:10:46.291 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.291 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.291 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:46.291 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:10:46.291 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:10:46.291 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.291 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.291 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.291 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:10:46.291 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:10:46.291 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.292 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.292 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.292 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:10:46.292 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:10:46.292 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.292 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.292 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.292 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:10:46.292 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:10:46.292 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.292 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.292 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.292 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:10:46.293 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:10:46.293 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.293 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.293 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:46.293 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:10:46.293 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:10:46.293 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.293 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:46.293 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.293 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.293 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.293 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:46.294 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:10:46.294 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.3977382570000003, 2024-09-13T05:10:46.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:10:46.294 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:46.294 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:46.294 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:46.294 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:46.294 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.294 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:10:46.294 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.294 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:46.294 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.294 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:46.294 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:10:46.295 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.295 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.295 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.295 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:46.295 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:10:46.295 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.295 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.295 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.295 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:46.295 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:10:46.295 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:46.295 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.295 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.295 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:46.296 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:10:46.296 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:10:46.296 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.296 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.296 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:46.296 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:10:46.296 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:10:46.296 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.296 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.296 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.296 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:10:46.296 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:10:46.296 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.296 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.297 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.297 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:10:46.297 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:10:46.297 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.297 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.297 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.297 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:10:46.297 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:10:46.297 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.297 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.297 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.297 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:10:46.297 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:10:46.297 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.298 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.298 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:46.298 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:10:46.298 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:10:46.298 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.298 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:46.298 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.298 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.298 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.298 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:46.298 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:10:46.298 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.3977291419999993, 2024-09-13T05:10:46.298 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:10:46.298 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:46.299 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:46.299 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:46.299 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:46.299 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.299 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:10:46.299 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.299 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:46.299 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.299 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:46.299 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:10:46.299 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.299 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.299 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.299 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:46.299 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:10:46.300 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.300 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.300 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.300 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:46.300 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:10:46.300 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:46.300 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.300 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.300 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:46.300 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:10:46.300 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:10:46.300 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.300 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.301 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:46.301 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:10:46.301 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:10:46.301 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.301 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.301 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.301 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:10:46.301 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:10:46.301 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.301 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.301 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.301 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:10:46.301 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:10:46.301 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.302 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.302 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.302 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:10:46.302 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:10:46.302 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.302 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.302 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.302 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:10:46.302 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:10:46.302 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.302 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.302 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:46.302 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:10:46.302 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:10:46.303 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.303 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:46.303 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.303 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.303 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.303 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:46.303 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:10:46.303 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.3977206629999994, 2024-09-13T05:10:46.303 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:10:46.303 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:46.303 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:46.303 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:46.303 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:46.303 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.304 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:10:46.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.304 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:46.304 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.304 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:46.304 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:10:46.304 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.304 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.304 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:46.304 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:10:46.304 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.304 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.305 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:46.305 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:10:46.305 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:46.305 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.305 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.305 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:46.305 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:10:46.305 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:10:46.305 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.305 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.305 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:46.305 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:10:46.305 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:10:46.305 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.306 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.306 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.306 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:10:46.306 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:10:46.306 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.306 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.306 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.306 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:10:46.306 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:10:46.306 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.306 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.306 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.306 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:10:46.306 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:10:46.306 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.307 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.307 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.307 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:10:46.307 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:10:46.307 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.307 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.307 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:46.307 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:10:46.307 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:10:46.307 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.307 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:46.307 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.307 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.308 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.308 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:46.308 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:10:46.308 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.3977087380000004, 2024-09-13T05:10:46.308 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:10:46.308 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:46.308 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:46.308 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:46.308 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:46.308 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.308 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:10:46.308 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.308 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:46.308 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.309 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:46.309 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:10:46.309 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.309 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.309 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.309 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:46.309 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:10:46.309 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.309 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.309 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.309 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:46.309 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:10:46.309 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:46.309 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.309 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.310 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:46.310 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:10:46.310 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:10:46.310 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.310 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.310 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:46.310 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:10:46.310 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:10:46.310 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.310 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.310 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.310 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:10:46.310 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:10:46.310 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.311 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.311 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.311 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:10:46.311 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:10:46.311 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.311 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.311 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.311 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:10:46.311 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:10:46.311 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.311 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.311 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.311 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:10:46.311 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:10:46.312 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.312 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.312 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:46.312 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:10:46.312 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:10:46.312 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.312 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:46.312 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.312 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.312 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.312 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:46.312 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:10:46.312 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.3976871489999994, 2024-09-13T05:10:46.312 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:10:46.313 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:46.313 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:46.313 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:46.313 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:46.313 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.313 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:10:46.313 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.313 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:46.313 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.313 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:46.313 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:10:46.313 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.313 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.313 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.314 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:46.314 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:10:46.314 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.314 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.314 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.314 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:46.314 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:10:46.314 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:46.314 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.315 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.315 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:46.315 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:10:46.315 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:10:46.315 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.315 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.315 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:46.315 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:10:46.315 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:10:46.315 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.315 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.315 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.315 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:10:46.315 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:10:46.316 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.316 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.316 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.316 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:10:46.316 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:10:46.316 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.316 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.316 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.316 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:10:46.316 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:10:46.316 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.316 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.316 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.316 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:10:46.317 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:10:46.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.317 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.317 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:46.317 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:10:46.317 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:10:46.317 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.317 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:46.317 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.317 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.317 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:46.317 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:10:46.317 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.3976640210000006, 2024-09-13T05:10:46.318 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:10:46.318 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:46.318 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:46.318 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:46.318 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:46.318 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.318 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:10:46.318 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.318 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:46.318 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.318 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:46.318 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:10:46.318 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.318 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.319 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.319 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:46.319 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:10:46.319 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.319 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.319 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.319 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:46.319 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:10:46.319 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:46.319 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.319 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.319 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:46.319 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:10:46.319 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:10:46.319 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.320 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.320 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:46.320 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:10:46.320 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:10:46.320 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.320 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.320 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.320 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:10:46.320 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:10:46.320 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.320 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.320 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.320 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:10:46.320 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:10:46.321 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.321 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.321 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.321 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:10:46.321 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:10:46.321 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.321 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.321 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.321 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:10:46.321 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:10:46.321 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.321 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.321 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:46.321 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:10:46.322 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:10:46.322 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.322 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:46.322 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.322 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.322 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.322 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:46.322 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:10:46.322 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.3976486480000005, 2024-09-13T05:10:46.322 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:10:46.322 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:46.322 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:46.322 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:46.322 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:46.322 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.323 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:10:46.323 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.323 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:46.323 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.323 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:46.323 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:10:46.323 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.323 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.323 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.323 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:46.323 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:10:46.323 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.323 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.323 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.324 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:46.324 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:10:46.324 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:46.324 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.324 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.324 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:46.324 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:10:46.324 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:10:46.324 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.324 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.324 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:46.324 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:10:46.324 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:10:46.324 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.325 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.325 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.325 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:10:46.325 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:10:46.325 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.325 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.325 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.325 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:10:46.325 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:10:46.325 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.325 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.325 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.325 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:10:46.325 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:10:46.326 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.326 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.326 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.326 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:10:46.326 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:10:46.326 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.326 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.326 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:46.326 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:10:46.326 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:10:46.326 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.327 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:46.327 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.327 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.327 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:46.327 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:10:46.327 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.3976281799999999, 2024-09-13T05:10:46.327 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:10:46.327 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:46.327 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:46.327 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:46.327 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:46.327 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.327 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:10:46.328 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.328 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:46.328 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.328 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:46.328 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:10:46.328 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.328 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.328 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.328 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:46.328 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:10:46.328 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.328 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.328 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.328 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:46.329 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:10:46.329 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:46.329 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.329 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.329 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:46.329 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:10:46.329 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:10:46.329 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.329 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.329 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:46.329 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:10:46.329 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:10:46.329 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.329 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.329 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.330 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:10:46.330 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:10:46.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.330 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.330 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.330 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:10:46.330 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:10:46.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.330 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.330 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.330 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:10:46.330 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:10:46.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.330 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.331 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.331 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:10:46.331 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:10:46.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.331 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.331 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:46.331 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:10:46.331 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:10:46.331 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.331 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:46.331 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.331 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.331 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:46.331 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:10:46.332 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.3976115189999998, 2024-09-13T05:10:46.332 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:10:46.332 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:46.332 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:46.332 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:46.332 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:46.332 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.332 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:10:46.332 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.332 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:46.332 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.332 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:46.332 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:10:46.333 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.333 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.333 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.333 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:46.333 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:10:46.333 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.333 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.333 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.333 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:46.333 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:10:46.333 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:46.333 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.333 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.333 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:46.334 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:10:46.334 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:10:46.334 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.334 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.334 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:46.334 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:10:46.334 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:10:46.334 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.334 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.334 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.334 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:10:46.334 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:10:46.334 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.334 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.334 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.335 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:10:46.335 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:10:46.335 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.335 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.335 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.335 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:10:46.335 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:10:46.335 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.335 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.335 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.335 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:10:46.335 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:10:46.335 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.335 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.336 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:46.336 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:10:46.336 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:10:46.336 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.336 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:46.336 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.336 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.336 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.336 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:46.336 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:10:46.336 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.3975848059999993, 2024-09-13T05:10:46.336 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:10:46.336 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:46.336 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:46.337 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:46.337 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:46.337 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.337 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:10:46.337 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.337 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:46.337 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.337 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:46.337 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:10:46.337 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.337 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.337 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.337 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:46.337 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:10:46.338 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.338 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.338 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:46.338 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:10:46.338 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:46.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.338 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.338 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:46.338 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:10:46.338 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:10:46.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.338 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.338 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:46.339 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:10:46.339 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:10:46.339 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.339 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.339 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.339 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:10:46.339 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:10:46.339 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.339 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.339 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.339 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:10:46.339 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:10:46.339 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.339 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.340 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.340 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:10:46.340 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:10:46.340 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.340 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.340 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.340 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:10:46.340 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:10:46.340 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.340 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.340 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:46.340 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:10:46.340 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:10:46.341 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.341 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:46.341 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.341 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.341 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.341 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:46.341 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:10:46.341 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.3975659539999992, 2024-09-13T05:10:46.341 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:10:46.341 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:46.341 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:46.341 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:46.341 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:46.341 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.341 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:10:46.342 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.342 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:46.342 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.342 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:46.342 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:10:46.342 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.342 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.342 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.342 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:46.342 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:10:46.342 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.342 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.342 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.342 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:46.343 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:10:46.343 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:46.343 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.343 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.343 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:46.343 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:10:46.343 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:10:46.343 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.343 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.343 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:46.343 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:10:46.343 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:10:46.343 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.343 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.343 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.344 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:10:46.344 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:10:46.344 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.344 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.344 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.344 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:10:46.344 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:10:46.344 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.344 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.344 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.344 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:10:46.344 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:10:46.344 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.345 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.345 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.345 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:10:46.345 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:10:46.345 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.345 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.345 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:46.345 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:10:46.345 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:10:46.345 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.345 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:46.345 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.345 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.345 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.346 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:46.346 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:10:46.346 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.3975481680000001, 2024-09-13T05:10:46.346 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:10:46.346 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:46.346 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:46.346 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:46.346 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:46.346 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.346 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:10:46.346 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.346 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:46.346 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.346 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:46.346 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:10:46.347 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.347 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.347 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.347 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:46.347 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:10:46.347 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.347 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.347 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.347 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:46.347 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:10:46.347 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:46.347 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.347 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.347 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:46.348 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:10:46.348 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:10:46.348 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.348 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.348 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:46.348 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:10:46.348 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:10:46.348 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.348 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.348 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.348 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:10:46.348 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:10:46.348 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.348 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.348 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.349 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:10:46.349 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:10:46.349 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.349 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.349 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.349 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:10:46.349 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:10:46.349 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.349 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.349 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.349 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:10:46.349 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:10:46.349 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.349 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.350 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:46.350 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:10:46.350 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:10:46.350 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.350 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:46.350 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.350 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.350 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.350 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:46.350 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:10:46.350 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.3975131080000001, 2024-09-13T05:10:46.350 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:10:46.350 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:46.351 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:46.351 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:46.351 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:46.351 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.351 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:10:46.351 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.351 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:46.351 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.351 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:46.351 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:10:46.351 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.351 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.352 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.352 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:46.352 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:10:46.352 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.352 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.352 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.352 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:46.352 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:10:46.352 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:46.352 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.352 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.352 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:46.352 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:10:46.353 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:10:46.353 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.353 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.353 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:46.353 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:10:46.353 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:10:46.353 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.353 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.353 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.353 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:10:46.353 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:10:46.353 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.353 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.354 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.354 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:10:46.354 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:10:46.354 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.354 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.354 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.354 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:10:46.354 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:10:46.354 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.354 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.354 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.354 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:10:46.354 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:10:46.354 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.354 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.355 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:46.355 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:10:46.355 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:10:46.355 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.355 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:46.355 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.355 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.355 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.355 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:46.355 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:10:46.355 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.3974962929999997, 2024-09-13T05:10:46.355 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:10:46.355 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:46.356 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:46.356 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:46.356 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:46.356 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.356 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:10:46.356 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.356 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:46.356 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.356 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:46.356 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:10:46.356 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.356 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.356 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.357 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:46.357 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:10:46.357 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:46.357 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.357 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.357 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:46.357 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:10:46.357 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:46.357 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.357 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.357 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:46.357 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:10:46.357 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:10:46.358 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.358 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.358 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:46.358 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:10:46.358 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:10:46.358 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.358 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.358 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.358 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:10:46.358 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:10:46.358 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.358 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.358 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.358 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:10:46.359 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:10:46.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.359 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.359 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.359 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:10:46.359 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:10:46.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.359 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.359 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:46.359 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:10:46.359 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:10:46.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:46.359 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:46.359 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:46.360 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:10:46.360 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:10:46.360 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.360 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:46.360 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.360 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:46.360 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:46.360 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:46.362 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:10:46.363 INFO:teuthology.orchestra.run.smithi120.stdout:1389 read 0x8147b06 thru 0x8151dbd (0xa2b8 bytes) 2024-09-13T05:10:46.363 INFO:teuthology.orchestra.run.smithi120.stdout:1390 punch from 0x31badec to 0x31c4d9c, (0x9fb0 bytes) 2024-09-13T05:10:46.363 INFO:teuthology.orchestra.run.smithi120.stdout:1391 punch from 0x6e14455 to 0x6e1e583, (0xa12e bytes) 2024-09-13T05:10:46.363 INFO:teuthology.orchestra.run.smithi120.stdout:1392 read 0xa637535 thru 0xa643a16 (0xc4e2 bytes) 2024-09-13T05:10:46.363 INFO:teuthology.orchestra.run.smithi120.stdout:1394 write 0xe25b69e thru 0xe261590 (0x5ef3 bytes) 2024-09-13T05:10:46.363 INFO:teuthology.orchestra.run.smithi120.stdout:1395 read 0x780ceb8 thru 0x781157e (0x46c7 bytes) 2024-09-13T05:10:46.363 INFO:teuthology.orchestra.run.smithi120.stdout:1396 write 0xe6cbadc thru 0xe6d1cfd (0x6222 bytes) 2024-09-13T05:10:46.363 INFO:teuthology.orchestra.run.smithi120.stdout:1397 clone 13 order 25 su 4194304 sc 3 2024-09-13T05:10:46.364 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:46.357+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:46.463 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:46.458+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:46.480 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:46.480 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:46.480 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:10:46.480 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:46.491 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:10:46.564 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:46.558+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:46.609 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:46.609 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:46.609 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:46.609 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:46.609 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:46.619 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:10:46.665 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:46.657+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:46.726 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:46.726 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:46.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:46.726 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:46.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.726 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14179 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1835008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:46.726 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:10:46.726 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.964317091, 2024-09-13T05:10:46.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0924508550000001, 2024-09-13T05:10:46.727 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:46.727 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:46.727 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:46.727 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:46.727 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.727 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14179 2024-09-13T05:10:46.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.727 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:46.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:46.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:10:46.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:46.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:10:46.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:46.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757551+0000", 2024-09-13T05:10:46.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:46.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:46.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757554+0000", 2024-09-13T05:10:46.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5440000000000001e-06 2024-09-13T05:10:46.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:46.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757560+0000", 2024-09-13T05:10:46.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6840000000000001e-06 2024-09-13T05:10:46.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757564+0000", 2024-09-13T05:10:46.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3529999999999997e-06 2024-09-13T05:10:46.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814931+0000", 2024-09-13T05:10:46.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057367564000000003 2024-09-13T05:10:46.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814938+0000", 2024-09-13T05:10:46.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1070000000000001e-06 2024-09-13T05:10:46.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.849802+0000", 2024-09-13T05:10:46.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348647849999999 2024-09-13T05:10:46.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:46.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.849885+0000", 2024-09-13T05:10:46.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2859000000000001e-05 2024-09-13T05:10:46.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:46.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850003+0000", 2024-09-13T05:10:46.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117279 2024-09-13T05:10:46.733 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.733 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:46.733 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.734 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14180 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1844224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:46.734 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:10:46.734 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.964300806000001, 2024-09-13T05:10:46.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.092637853, 2024-09-13T05:10:46.735 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:46.735 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:46.735 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:46.735 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:46.735 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.735 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14180 2024-09-13T05:10:46.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.736 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:46.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:46.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:10:46.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:46.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:10:46.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:46.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:10:46.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:46.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:46.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757570+0000", 2024-09-13T05:10:46.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3470000000000001e-06 2024-09-13T05:10:46.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:46.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757576+0000", 2024-09-13T05:10:46.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5550000000000002e-06 2024-09-13T05:10:46.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757580+0000", 2024-09-13T05:10:46.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6519999999999997e-06 2024-09-13T05:10:46.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814975+0000", 2024-09-13T05:10:46.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057394349999999997 2024-09-13T05:10:46.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814981+0000", 2024-09-13T05:10:46.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4119999999999998e-06 2024-09-13T05:10:46.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850042+0000", 2024-09-13T05:10:46.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0350611759999999 2024-09-13T05:10:46.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:46.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850103+0000", 2024-09-13T05:10:46.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0618000000000001e-05 2024-09-13T05:10:46.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:46.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850206+0000", 2024-09-13T05:10:46.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010309199999999999 2024-09-13T05:10:46.745 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.746 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:46.746 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.746 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14196 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1991680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:46.746 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:10:46.747 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.96050172, 2024-09-13T05:10:46.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0925442910000001, 2024-09-13T05:10:46.747 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:46.747 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:46.747 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:46.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:46.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.748 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14196 2024-09-13T05:10:46.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.748 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:46.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:46.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:10:46.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:46.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:10:46.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:46.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:10:46.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:46.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:46.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761368+0000", 2024-09-13T05:10:46.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3689999999999999e-06 2024-09-13T05:10:46.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:46.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761373+0000", 2024-09-13T05:10:46.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7180000000000004e-06 2024-09-13T05:10:46.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761376+0000", 2024-09-13T05:10:46.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0860000000000002e-06 2024-09-13T05:10:46.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815501+0000", 2024-09-13T05:10:46.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054125508000000003 2024-09-13T05:10:46.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815508+0000", 2024-09-13T05:10:46.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5570000000000001e-06 2024-09-13T05:10:46.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853689+0000", 2024-09-13T05:10:46.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0381811919999999 2024-09-13T05:10:46.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:46.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853764+0000", 2024-09-13T05:10:46.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4893000000000003e-05 2024-09-13T05:10:46.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:46.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853911+0000", 2024-09-13T05:10:46.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014721100000000001 2024-09-13T05:10:46.758 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.758 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:46.758 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.759 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14197 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2000896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:46.759 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:10:46.759 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.960490476, 2024-09-13T05:10:46.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.092841977, 2024-09-13T05:10:46.760 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:46.760 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:46.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:46.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:46.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.761 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14197 2024-09-13T05:10:46.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.761 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:46.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:46.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:10:46.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:46.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:10:46.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:46.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:10:46.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:46.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:46.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761403+0000", 2024-09-13T05:10:46.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5199e-05 2024-09-13T05:10:46.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:46.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761411+0000", 2024-09-13T05:10:46.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4540000000000001e-06 2024-09-13T05:10:46.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761418+0000", 2024-09-13T05:10:46.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9569999999999996e-06 2024-09-13T05:10:46.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815531+0000", 2024-09-13T05:10:46.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054113599999999998 2024-09-13T05:10:46.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815539+0000", 2024-09-13T05:10:46.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.481e-06 2024-09-13T05:10:46.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853949+0000", 2024-09-13T05:10:46.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.038410356 2024-09-13T05:10:46.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:46.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854022+0000", 2024-09-13T05:10:46.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2807999999999998e-05 2024-09-13T05:10:46.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854220+0000", 2024-09-13T05:10:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000198364 2024-09-13T05:10:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14198 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2010112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:10:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.960445468, 2024-09-13T05:10:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093063787, 2024-09-13T05:10:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14198 2024-09-13T05:10:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:46.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:10:46.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:46.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:10:46.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:46.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:10:46.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:46.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:46.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761426+0000", 2024-09-13T05:10:46.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8789999999999999e-06 2024-09-13T05:10:46.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:46.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761432+0000", 2024-09-13T05:10:46.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1399999999999997e-06 2024-09-13T05:10:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761437+0000", 2024-09-13T05:10:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8579999999999999e-06 2024-09-13T05:10:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815563+0000", 2024-09-13T05:10:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054125877000000003 2024-09-13T05:10:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815570+0000", 2024-09-13T05:10:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1169999999999998e-06 2024-09-13T05:10:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854265+0000", 2024-09-13T05:10:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0386955659999999 2024-09-13T05:10:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854338+0000", 2024-09-13T05:10:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2537e-05 2024-09-13T05:10:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854487+0000", 2024-09-13T05:10:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014927899999999999 2024-09-13T05:10:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14199 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:10:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.960426594999999, 2024-09-13T05:10:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0933252389999999, 2024-09-13T05:10:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14199 2024-09-13T05:10:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:10:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:10:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:10:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761445+0000", 2024-09-13T05:10:46.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7779999999999999e-06 2024-09-13T05:10:46.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:46.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761450+0000", 2024-09-13T05:10:46.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6350000000000003e-06 2024-09-13T05:10:46.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761455+0000", 2024-09-13T05:10:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9930000000000003e-06 2024-09-13T05:10:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815600+0000", 2024-09-13T05:10:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054144982000000001 2024-09-13T05:10:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815607+0000", 2024-09-13T05:10:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4749999999999998e-06 2024-09-13T05:10:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854527+0000", 2024-09-13T05:10:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.038920037 2024-09-13T05:10:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854637+0000", 2024-09-13T05:10:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011021700000000001 2024-09-13T05:10:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854767+0000", 2024-09-13T05:10:46.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130512 2024-09-13T05:10:46.785 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.785 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:46.785 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.786 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14200 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2028544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:46.786 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:10:46.786 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.960408082000001, 2024-09-13T05:10:46.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093541554, 2024-09-13T05:10:46.786 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14200 2024-09-13T05:10:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:10:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:46.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:10:46.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:46.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761460+0000", 2024-09-13T05:10:46.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:46.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:46.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761462+0000", 2024-09-13T05:10:46.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9659999999999999e-06 2024-09-13T05:10:46.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:46.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761466+0000", 2024-09-13T05:10:46.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6109999999999998e-06 2024-09-13T05:10:46.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761471+0000", 2024-09-13T05:10:46.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1019999999999996e-06 2024-09-13T05:10:46.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815631+0000", 2024-09-13T05:10:46.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054159680000000002 2024-09-13T05:10:46.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815637+0000", 2024-09-13T05:10:46.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-09-13T05:10:46.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854810+0000", 2024-09-13T05:10:46.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0391731930000001 2024-09-13T05:10:46.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:46.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854883+0000", 2024-09-13T05:10:46.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3109999999999996e-05 2024-09-13T05:10:46.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:46.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855002+0000", 2024-09-13T05:10:46.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011934600000000001 2024-09-13T05:10:46.795 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.795 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:46.795 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.795 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14201 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2037760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:46.795 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:10:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.960393652, 2024-09-13T05:10:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0937543320000001, 2024-09-13T05:10:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14201 2024-09-13T05:10:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:10:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:10:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:10:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:46.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761477+0000", 2024-09-13T05:10:46.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5620000000000002e-06 2024-09-13T05:10:46.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:46.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761483+0000", 2024-09-13T05:10:46.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7400000000000001e-06 2024-09-13T05:10:46.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761487+0000", 2024-09-13T05:10:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8130000000000002e-06 2024-09-13T05:10:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815697+0000", 2024-09-13T05:10:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054210253 2024-09-13T05:10:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815705+0000", 2024-09-13T05:10:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7049999999999999e-06 2024-09-13T05:10:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855036+0000", 2024-09-13T05:10:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.039330799 2024-09-13T05:10:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855110+0000", 2024-09-13T05:10:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4498000000000004e-05 2024-09-13T05:10:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:46.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855229+0000", 2024-09-13T05:10:46.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119282 2024-09-13T05:10:46.801 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.801 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:46.801 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.801 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14202 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:46.801 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:10:46.801 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.960328994999999, 2024-09-13T05:10:46.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093934027, 2024-09-13T05:10:46.801 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:46.801 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:46.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:46.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:46.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.802 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14202 2024-09-13T05:10:46.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.802 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:46.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:46.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:10:46.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:46.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:10:46.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:46.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761489+0000", 2024-09-13T05:10:46.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999495 2024-09-13T05:10:46.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:46.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761543+0000", 2024-09-13T05:10:46.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3983999999999997e-05 2024-09-13T05:10:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761552+0000", 2024-09-13T05:10:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-13T05:10:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761559+0000", 2024-09-13T05:10:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7710000000000001e-06 2024-09-13T05:10:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815742+0000", 2024-09-13T05:10:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054183488000000002 2024-09-13T05:10:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815749+0000", 2024-09-13T05:10:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1609999999999997e-06 2024-09-13T05:10:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855283+0000", 2024-09-13T05:10:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0395336230000001 2024-09-13T05:10:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855354+0000", 2024-09-13T05:10:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1456000000000002e-05 2024-09-13T05:10:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855474+0000", 2024-09-13T05:10:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119429 2024-09-13T05:10:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:46.808 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.808 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14294 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2113536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:46.808 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:10:46.808 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.956778081, 2024-09-13T05:10:46.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0923650330000001, 2024-09-13T05:10:46.808 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:46.808 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:46.808 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:46.809 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:46.809 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.809 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14294 2024-09-13T05:10:46.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.809 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:46.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:46.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:10:46.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:10:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765090+0000", 2024-09-13T05:10:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765092+0000", 2024-09-13T05:10:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.542e-06 2024-09-13T05:10:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765096+0000", 2024-09-13T05:10:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6179999999999999e-06 2024-09-13T05:10:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765098+0000", 2024-09-13T05:10:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8049999999999998e-06 2024-09-13T05:10:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816384+0000", 2024-09-13T05:10:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051285338999999999 2024-09-13T05:10:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816393+0000", 2024-09-13T05:10:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-09-13T05:10:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857258+0000", 2024-09-13T05:10:46.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0408652549999999 2024-09-13T05:10:46.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:46.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857327+0000", 2024-09-13T05:10:46.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8714000000000007e-05 2024-09-13T05:10:46.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857456+0000", 2024-09-13T05:10:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012909299999999999 2024-09-13T05:10:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14295 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2122752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:10:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.956768323, 2024-09-13T05:10:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0928006969999999, 2024-09-13T05:10:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14295 2024-09-13T05:10:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:46.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:10:46.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:46.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:10:46.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:10:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765102+0000", 2024-09-13T05:10:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3990000000000001e-06 2024-09-13T05:10:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765104+0000", 2024-09-13T05:10:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:10:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765107+0000", 2024-09-13T05:10:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.582e-06 2024-09-13T05:10:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816432+0000", 2024-09-13T05:10:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051325118000000003 2024-09-13T05:10:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816440+0000", 2024-09-13T05:10:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4679999999999992e-06 2024-09-13T05:10:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857495+0000", 2024-09-13T05:10:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.041054216 2024-09-13T05:10:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857644+0000", 2024-09-13T05:10:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014909400000000001 2024-09-13T05:10:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857901+0000", 2024-09-13T05:10:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025746200000000002 2024-09-13T05:10:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14296 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2131968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:10:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.956760077, 2024-09-13T05:10:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093120361, 2024-09-13T05:10:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14296 2024-09-13T05:10:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:10:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:10:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765108+0000", 2024-09-13T05:10:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765110+0000", 2024-09-13T05:10:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.226e-06 2024-09-13T05:10:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765112+0000", 2024-09-13T05:10:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6769999999999999e-06 2024-09-13T05:10:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765115+0000", 2024-09-13T05:10:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.712e-06 2024-09-13T05:10:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816479+0000", 2024-09-13T05:10:46.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051364102000000002 2024-09-13T05:10:46.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816503+0000", 2024-09-13T05:10:46.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3723999999999999e-05 2024-09-13T05:10:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857929+0000", 2024-09-13T05:10:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0414263180000001 2024-09-13T05:10:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858015+0000", 2024-09-13T05:10:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5730999999999996e-05 2024-09-13T05:10:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:46.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858229+0000", 2024-09-13T05:10:46.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021408700000000001 2024-09-13T05:10:46.826 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.826 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:46.826 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.826 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14297 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2141184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:46.826 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:10:46.826 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.956751732000001, 2024-09-13T05:10:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0936699510000001, 2024-09-13T05:10:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14297 2024-09-13T05:10:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:10:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:10:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:10:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765118+0000", 2024-09-13T05:10:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4190000000000001e-06 2024-09-13T05:10:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765121+0000", 2024-09-13T05:10:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6110000000000001e-06 2024-09-13T05:10:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765124+0000", 2024-09-13T05:10:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3720000000000001e-06 2024-09-13T05:10:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816535+0000", 2024-09-13T05:10:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051410890000000001 2024-09-13T05:10:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816556+0000", 2024-09-13T05:10:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0551e-05 2024-09-13T05:10:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858552+0000", 2024-09-13T05:10:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0419965529999999 2024-09-13T05:10:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858640+0000", 2024-09-13T05:10:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7907999999999999e-05 2024-09-13T05:10:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858787+0000", 2024-09-13T05:10:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000146864 2024-09-13T05:10:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14298 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2150400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:10:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.956742339, 2024-09-13T05:10:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0938958759999999, 2024-09-13T05:10:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14298 2024-09-13T05:10:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:10:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:10:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:10:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765128+0000", 2024-09-13T05:10:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4139999999999999e-06 2024-09-13T05:10:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765130+0000", 2024-09-13T05:10:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6809999999999998e-06 2024-09-13T05:10:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765133+0000", 2024-09-13T05:10:46.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9270000000000001e-06 2024-09-13T05:10:46.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816592+0000", 2024-09-13T05:10:46.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051459029000000003 2024-09-13T05:10:46.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816601+0000", 2024-09-13T05:10:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9819999999999997e-06 2024-09-13T05:10:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858818+0000", 2024-09-13T05:10:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0422167170000001 2024-09-13T05:10:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858896+0000", 2024-09-13T05:10:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8128999999999997e-05 2024-09-13T05:10:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859022+0000", 2024-09-13T05:10:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012619899999999999 2024-09-13T05:10:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14299 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2168832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:10:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.956733574999999, 2024-09-13T05:10:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0941207909999999, 2024-09-13T05:10:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14299 2024-09-13T05:10:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:10:46.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:46.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:10:46.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:46.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:10:46.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:46.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:46.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765136+0000", 2024-09-13T05:10:46.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5230000000000001e-06 2024-09-13T05:10:46.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:46.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765139+0000", 2024-09-13T05:10:46.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.672e-06 2024-09-13T05:10:46.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765142+0000", 2024-09-13T05:10:46.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6680000000000001e-06 2024-09-13T05:10:46.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816632+0000", 2024-09-13T05:10:46.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051489886999999998 2024-09-13T05:10:46.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816643+0000", 2024-09-13T05:10:46.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1457000000000001e-05 2024-09-13T05:10:46.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859061+0000", 2024-09-13T05:10:46.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.042417616 2024-09-13T05:10:46.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:46.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859138+0000", 2024-09-13T05:10:46.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7077999999999996e-05 2024-09-13T05:10:46.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:46.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859256+0000", 2024-09-13T05:10:46.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118108 2024-09-13T05:10:46.847 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.847 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:46.848 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.848 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14300 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2159616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:46.848 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:10:46.848 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.956724765000001, 2024-09-13T05:10:46.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0943386719999999, 2024-09-13T05:10:46.849 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:46.849 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:46.849 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:46.849 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:46.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.850 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14300 2024-09-13T05:10:46.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.850 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:46.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:46.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:10:46.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:46.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:10:46.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:46.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:10:46.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:46.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:46.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765145+0000", 2024-09-13T05:10:46.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.488e-06 2024-09-13T05:10:46.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:46.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765148+0000", 2024-09-13T05:10:46.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6620000000000001e-06 2024-09-13T05:10:46.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765151+0000", 2024-09-13T05:10:46.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6419999999999999e-06 2024-09-13T05:10:46.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816677+0000", 2024-09-13T05:10:46.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051526776000000003 2024-09-13T05:10:46.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816689+0000", 2024-09-13T05:10:46.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1634000000000001e-05 2024-09-13T05:10:46.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859296+0000", 2024-09-13T05:10:46.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0426066009999999 2024-09-13T05:10:46.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:46.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859364+0000", 2024-09-13T05:10:46.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8745999999999995e-05 2024-09-13T05:10:46.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:46.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859483+0000", 2024-09-13T05:10:46.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011833900000000001 2024-09-13T05:10:46.860 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.860 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:46.860 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.861 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14301 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2178048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:46.861 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:10:46.861 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.956716131, 2024-09-13T05:10:46.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0946233009999999, 2024-09-13T05:10:46.861 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:46.861 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:46.862 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:46.862 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:46.862 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.862 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14301 2024-09-13T05:10:46.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.862 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:46.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:46.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:10:46.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:46.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:10:46.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:46.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765152+0000", 2024-09-13T05:10:46.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:46.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:46.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765154+0000", 2024-09-13T05:10:46.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.449e-06 2024-09-13T05:10:46.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:46.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765157+0000", 2024-09-13T05:10:46.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6809999999999998e-06 2024-09-13T05:10:46.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765159+0000", 2024-09-13T05:10:46.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6060000000000001e-06 2024-09-13T05:10:46.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816722+0000", 2024-09-13T05:10:46.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051562535 2024-09-13T05:10:46.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816733+0000", 2024-09-13T05:10:46.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1678000000000001e-05 2024-09-13T05:10:46.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859521+0000", 2024-09-13T05:10:46.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0427879440000001 2024-09-13T05:10:46.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:46.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859655+0000", 2024-09-13T05:10:46.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134053 2024-09-13T05:10:46.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:46.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859776+0000", 2024-09-13T05:10:46.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012058299999999999 2024-09-13T05:10:46.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.872 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:46.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.873 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14302 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2187264~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:46.873 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:10:46.873 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.956707553999999, 2024-09-13T05:10:46.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.094937383, 2024-09-13T05:10:46.874 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:46.874 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:46.874 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:46.874 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:46.874 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.874 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14302 2024-09-13T05:10:46.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.875 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:46.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:46.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:10:46.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:46.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:10:46.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:46.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:10:46.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:46.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:46.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765162+0000", 2024-09-13T05:10:46.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4589999999999999e-06 2024-09-13T05:10:46.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:46.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765165+0000", 2024-09-13T05:10:46.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6019999999999998e-06 2024-09-13T05:10:46.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765168+0000", 2024-09-13T05:10:46.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.497e-06 2024-09-13T05:10:46.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816764+0000", 2024-09-13T05:10:46.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051596722999999997 2024-09-13T05:10:46.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816776+0000", 2024-09-13T05:10:46.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1967000000000001e-05 2024-09-13T05:10:46.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859810+0000", 2024-09-13T05:10:46.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0430338299999999 2024-09-13T05:10:46.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:46.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859901+0000", 2024-09-13T05:10:46.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1397999999999995e-05 2024-09-13T05:10:46.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:46.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860099+0000", 2024-09-13T05:10:46.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000197133 2024-09-13T05:10:46.883 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.883 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:46.883 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.883 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14303 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2196480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:46.883 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:10:46.884 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.956699217000001, 2024-09-13T05:10:46.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.095199152, 2024-09-13T05:10:46.884 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:46.884 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:46.884 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:46.884 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:46.884 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.885 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14303 2024-09-13T05:10:46.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.885 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:46.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:46.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:10:46.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:46.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:10:46.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:46.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765169+0000", 2024-09-13T05:10:46.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:46.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:46.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765171+0000", 2024-09-13T05:10:46.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2899999999999999e-06 2024-09-13T05:10:46.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:46.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765173+0000", 2024-09-13T05:10:46.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-13T05:10:46.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765176+0000", 2024-09-13T05:10:46.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.016e-06 2024-09-13T05:10:46.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816811+0000", 2024-09-13T05:10:46.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051634684 2024-09-13T05:10:46.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816840+0000", 2024-09-13T05:10:46.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8690000000000001e-05 2024-09-13T05:10:46.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860135+0000", 2024-09-13T05:10:46.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0432951029999999 2024-09-13T05:10:46.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:46.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860255+0000", 2024-09-13T05:10:46.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119936 2024-09-13T05:10:46.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:46.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860369+0000", 2024-09-13T05:10:46.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113978 2024-09-13T05:10:46.890 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.890 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:46.890 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.890 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14304 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2205696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:46.890 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:10:46.890 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.956676349, 2024-09-13T05:10:46.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0955512999999999, 2024-09-13T05:10:46.891 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:46.891 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:46.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:46.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:46.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:46.891 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14304 2024-09-13T05:10:46.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.891 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:46.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:46.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:10:46.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:46.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:10:46.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:46.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:46.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:10:46.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:46.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:46.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765195+0000", 2024-09-13T05:10:46.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6599999999999999e-06 2024-09-13T05:10:46.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:46.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765200+0000", 2024-09-13T05:10:46.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.356e-06 2024-09-13T05:10:46.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:46.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765205+0000", 2024-09-13T05:10:46.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3000000000000001e-06 2024-09-13T05:10:46.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816901+0000", 2024-09-13T05:10:46.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051695451000000003 2024-09-13T05:10:46.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:46.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816963+0000", 2024-09-13T05:10:46.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2694000000000007e-05 2024-09-13T05:10:46.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:46.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860434+0000", 2024-09-13T05:10:46.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.04347053 2024-09-13T05:10:46.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:46.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860592+0000", 2024-09-13T05:10:46.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015854199999999999 2024-09-13T05:10:46.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:46.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:46.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:46.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860744+0000", 2024-09-13T05:10:46.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015133 2024-09-13T05:10:46.896 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.896 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:46.896 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.896 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:46.896 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:46.896 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:46.898 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:10:46.898 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:46.893+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:46.933 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T05:10:46.999 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:46.994+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:47.019 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:47.020 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:47.020 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:10:47.020 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:47.029 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:10:47.099 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:47.093+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:47.133 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:47.133 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:47.133 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:47.134 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:47.134 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:47.143 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:10:47.200 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:47.193+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:47.246 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:47.246 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:47.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:47.246 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:47.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.246 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10634 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 731136~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:47.247 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:10:47.247 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.840879701999999, 2024-09-13T05:10:47.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028136992999999999, 2024-09-13T05:10:47.247 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.247 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.247 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.247 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.247 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.247 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10634 2024-09-13T05:10:47.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.247 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:10:47.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:10:47.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:10:47.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401987+0000", 2024-09-13T05:10:47.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5090000000000001e-06 2024-09-13T05:10:47.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401997+0000", 2024-09-13T05:10:47.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8009999999999998e-06 2024-09-13T05:10:47.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402000+0000", 2024-09-13T05:10:47.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.756e-06 2024-09-13T05:10:47.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430035+0000", 2024-09-13T05:10:47.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028034967000000001 2024-09-13T05:10:47.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430081+0000", 2024-09-13T05:10:47.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6448e-05 2024-09-13T05:10:47.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430123+0000", 2024-09-13T05:10:47.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1758000000000002e-05 2024-09-13T05:10:47.251 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.251 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.251 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.251 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10635 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 740352~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:47.251 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:10:47.251 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.840863087999999, 2024-09-13T05:10:47.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028229890000000001, 2024-09-13T05:10:47.251 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.252 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.252 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.252 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.252 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.252 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10635 2024-09-13T05:10:47.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.252 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:10:47.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:10:47.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402002+0000", 2024-09-13T05:10:47.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402004+0000", 2024-09-13T05:10:47.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.575e-06 2024-09-13T05:10:47.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402007+0000", 2024-09-13T05:10:47.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1240000000000001e-06 2024-09-13T05:10:47.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402010+0000", 2024-09-13T05:10:47.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5859999999999999e-06 2024-09-13T05:10:47.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430146+0000", 2024-09-13T05:10:47.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028136746000000001 2024-09-13T05:10:47.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430195+0000", 2024-09-13T05:10:47.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8948e-05 2024-09-13T05:10:47.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430232+0000", 2024-09-13T05:10:47.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7159000000000001e-05 2024-09-13T05:10:47.257 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.257 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.257 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.257 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10636 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 749568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:47.257 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:10:47.257 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.840853981999999, 2024-09-13T05:10:47.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328440999999999, 2024-09-13T05:10:47.257 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.257 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.257 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.257 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.258 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.258 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10636 2024-09-13T05:10:47.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.258 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:10:47.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:10:47.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402011+0000", 2024-09-13T05:10:47.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:47.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402017+0000", 2024-09-13T05:10:47.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5620000000000003e-06 2024-09-13T05:10:47.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402020+0000", 2024-09-13T05:10:47.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1410000000000001e-06 2024-09-13T05:10:47.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402024+0000", 2024-09-13T05:10:47.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4489999999999999e-06 2024-09-13T05:10:47.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430256+0000", 2024-09-13T05:10:47.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028232363 2024-09-13T05:10:47.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430299+0000", 2024-09-13T05:10:47.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2830999999999997e-05 2024-09-13T05:10:47.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430340+0000", 2024-09-13T05:10:47.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1301000000000003e-05 2024-09-13T05:10:47.262 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.262 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.262 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.262 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10637 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 758784~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:47.262 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:10:47.262 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.840838868999999, 2024-09-13T05:10:47.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028441793, 2024-09-13T05:10:47.262 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.262 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.263 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.263 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.263 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.263 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10637 2024-09-13T05:10:47.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.263 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:10:47.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:10:47.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:10:47.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:47.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402031+0000", 2024-09-13T05:10:47.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6770000000000003e-06 2024-09-13T05:10:47.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402034+0000", 2024-09-13T05:10:47.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1540000000000002e-06 2024-09-13T05:10:47.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402038+0000", 2024-09-13T05:10:47.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4970000000000001e-06 2024-09-13T05:10:47.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430367+0000", 2024-09-13T05:10:47.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328906000000001 2024-09-13T05:10:47.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430416+0000", 2024-09-13T05:10:47.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:10:47.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430469+0000", 2024-09-13T05:10:47.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2284999999999998e-05 2024-09-13T05:10:47.267 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.267 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.268 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.268 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10638 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 768000~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:47.268 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:10:47.268 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.840825384999999, 2024-09-13T05:10:47.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028548740999999999, 2024-09-13T05:10:47.268 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.268 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.268 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.268 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.268 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.269 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10638 2024-09-13T05:10:47.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.269 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:10:47.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:10:47.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:10:47.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402041+0000", 2024-09-13T05:10:47.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4789999999999999e-06 2024-09-13T05:10:47.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402044+0000", 2024-09-13T05:10:47.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.694e-06 2024-09-13T05:10:47.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402047+0000", 2024-09-13T05:10:47.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.537e-06 2024-09-13T05:10:47.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430494+0000", 2024-09-13T05:10:47.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028447665 2024-09-13T05:10:47.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430544+0000", 2024-09-13T05:10:47.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9539000000000001e-05 2024-09-13T05:10:47.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430589+0000", 2024-09-13T05:10:47.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5071999999999998e-05 2024-09-13T05:10:47.272 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.272 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.273 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.273 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10639 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 777216~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:47.273 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:10:47.273 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.840815004, 2024-09-13T05:10:47.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028651769000000001, 2024-09-13T05:10:47.273 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.273 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.273 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.273 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.273 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.273 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10639 2024-09-13T05:10:47.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.274 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:10:47.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:10:47.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402050+0000", 2024-09-13T05:10:47.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402052+0000", 2024-09-13T05:10:47.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2249999999999999e-06 2024-09-13T05:10:47.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402054+0000", 2024-09-13T05:10:47.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8140000000000001e-06 2024-09-13T05:10:47.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402057+0000", 2024-09-13T05:10:47.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4889999999999998e-06 2024-09-13T05:10:47.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430607+0000", 2024-09-13T05:10:47.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028549896000000002 2024-09-13T05:10:47.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430651+0000", 2024-09-13T05:10:47.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4622000000000001e-05 2024-09-13T05:10:47.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430702+0000", 2024-09-13T05:10:47.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0980999999999999e-05 2024-09-13T05:10:47.277 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.277 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.277 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.278 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11151 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 779264~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:47.278 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:10:47.278 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.811043723000001, 2024-09-13T05:10:47.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028283188000000001, 2024-09-13T05:10:47.278 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.278 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.278 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11151 2024-09-13T05:10:47.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.278 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:10:47.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:10:47.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:10:47.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431827+0000", 2024-09-13T05:10:47.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0989999999999998e-06 2024-09-13T05:10:47.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431832+0000", 2024-09-13T05:10:47.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8829999999999997e-06 2024-09-13T05:10:47.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431835+0000", 2024-09-13T05:10:47.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.439e-06 2024-09-13T05:10:47.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.459955+0000", 2024-09-13T05:10:47.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028119858000000001 2024-09-13T05:10:47.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.460029+0000", 2024-09-13T05:10:47.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4264000000000006e-05 2024-09-13T05:10:47.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.460105+0000", 2024-09-13T05:10:47.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5906000000000001e-05 2024-09-13T05:10:47.282 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.282 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.282 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.283 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11897 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 579584~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:47.283 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:10:47.283 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.761894549000001, 2024-09-13T05:10:47.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028193354, 2024-09-13T05:10:47.283 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.283 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.283 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.283 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.283 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.283 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11897 2024-09-13T05:10:47.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.284 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:10:47.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:10:47.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:10:47.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480973+0000", 2024-09-13T05:10:47.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.934e-06 2024-09-13T05:10:47.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480976+0000", 2024-09-13T05:10:47.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.614e-06 2024-09-13T05:10:47.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480980+0000", 2024-09-13T05:10:47.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.377e-06 2024-09-13T05:10:47.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.508967+0000", 2024-09-13T05:10:47.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027987455000000001 2024-09-13T05:10:47.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509074+0000", 2024-09-13T05:10:47.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107379 2024-09-13T05:10:47.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509164+0000", 2024-09-13T05:10:47.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9979e-05 2024-09-13T05:10:47.288 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.288 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.288 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.288 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11898 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 588800~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:47.288 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:10:47.288 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.761882485000001, 2024-09-13T05:10:47.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028308628999999998, 2024-09-13T05:10:47.289 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.289 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.289 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.289 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.289 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.289 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11898 2024-09-13T05:10:47.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.289 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:10:47.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:10:47.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:10:47.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480984+0000", 2024-09-13T05:10:47.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:10:47.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480988+0000", 2024-09-13T05:10:47.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4640000000000002e-06 2024-09-13T05:10:47.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480991+0000", 2024-09-13T05:10:47.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3469999999999999e-06 2024-09-13T05:10:47.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509199+0000", 2024-09-13T05:10:47.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028207449999999998 2024-09-13T05:10:47.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509250+0000", 2024-09-13T05:10:47.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1375000000000002e-05 2024-09-13T05:10:47.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509292+0000", 2024-09-13T05:10:47.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1730000000000002e-05 2024-09-13T05:10:47.294 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.294 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.294 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.294 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11899 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 598016~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:47.294 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:10:47.295 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.761871643999999, 2024-09-13T05:10:47.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516703000000001, 2024-09-13T05:10:47.295 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.295 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.295 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11899 2024-09-13T05:10:47.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.295 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:10:47.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:10:47.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:10:47.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480995+0000", 2024-09-13T05:10:47.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7349999999999999e-06 2024-09-13T05:10:47.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481000+0000", 2024-09-13T05:10:47.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0289999999999996e-06 2024-09-13T05:10:47.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481004+0000", 2024-09-13T05:10:47.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3699999999999999e-06 2024-09-13T05:10:47.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509332+0000", 2024-09-13T05:10:47.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328320000000001 2024-09-13T05:10:47.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509428+0000", 2024-09-13T05:10:47.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6150999999999995e-05 2024-09-13T05:10:47.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509511+0000", 2024-09-13T05:10:47.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2396000000000002e-05 2024-09-13T05:10:47.299 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.299 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.299 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.299 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11900 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 607232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:47.300 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:10:47.300 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.761859054999999, 2024-09-13T05:10:47.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028621273999999999, 2024-09-13T05:10:47.300 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.300 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.300 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.300 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.300 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.300 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11900 2024-09-13T05:10:47.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.300 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:10:47.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:10:47.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481006+0000", 2024-09-13T05:10:47.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481008+0000", 2024-09-13T05:10:47.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.73e-06 2024-09-13T05:10:47.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481011+0000", 2024-09-13T05:10:47.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4000000000000001e-06 2024-09-13T05:10:47.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481015+0000", 2024-09-13T05:10:47.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2760000000000001e-06 2024-09-13T05:10:47.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509531+0000", 2024-09-13T05:10:47.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516102000000002 2024-09-13T05:10:47.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509588+0000", 2024-09-13T05:10:47.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7423999999999998e-05 2024-09-13T05:10:47.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509628+0000", 2024-09-13T05:10:47.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9644000000000002e-05 2024-09-13T05:10:47.304 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.304 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.304 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.304 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11901 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 616448~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:47.304 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:10:47.304 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.761848434000001, 2024-09-13T05:10:47.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028820500999999998, 2024-09-13T05:10:47.305 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.305 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.305 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11901 2024-09-13T05:10:47.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.305 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:10:47.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:10:47.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:10:47.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481022+0000", 2024-09-13T05:10:47.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0209999999999999e-06 2024-09-13T05:10:47.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481026+0000", 2024-09-13T05:10:47.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:10:47.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481029+0000", 2024-09-13T05:10:47.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.636e-06 2024-09-13T05:10:47.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509661+0000", 2024-09-13T05:10:47.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028631496999999999 2024-09-13T05:10:47.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509757+0000", 2024-09-13T05:10:47.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5780999999999997e-05 2024-09-13T05:10:47.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509838+0000", 2024-09-13T05:10:47.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1102999999999999e-05 2024-09-13T05:10:47.309 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.309 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.309 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.309 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11902 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 625664~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:47.310 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:10:47.310 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.761826572, 2024-09-13T05:10:47.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028894265999999998, 2024-09-13T05:10:47.310 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.310 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.310 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.310 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.310 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.310 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11902 2024-09-13T05:10:47.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.310 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:10:47.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:10:47.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:10:47.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481041+0000", 2024-09-13T05:10:47.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8020000000000001e-06 2024-09-13T05:10:47.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481044+0000", 2024-09-13T05:10:47.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7110000000000001e-06 2024-09-13T05:10:47.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481048+0000", 2024-09-13T05:10:47.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.411e-06 2024-09-13T05:10:47.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509851+0000", 2024-09-13T05:10:47.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028803295 2024-09-13T05:10:47.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509896+0000", 2024-09-13T05:10:47.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4963000000000003e-05 2024-09-13T05:10:47.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509933+0000", 2024-09-13T05:10:47.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7384e-05 2024-09-13T05:10:47.314 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.314 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.314 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.315 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11903 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 634880~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:47.315 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:10:47.315 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.761815336000002, 2024-09-13T05:10:47.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029118033000000001, 2024-09-13T05:10:47.315 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.315 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.315 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.315 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.315 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.315 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11903 2024-09-13T05:10:47.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.315 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:10:47.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:10:47.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:10:47.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481052+0000", 2024-09-13T05:10:47.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.581e-06 2024-09-13T05:10:47.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481055+0000", 2024-09-13T05:10:47.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4520000000000002e-06 2024-09-13T05:10:47.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481058+0000", 2024-09-13T05:10:47.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4599999999999999e-06 2024-09-13T05:10:47.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509967+0000", 2024-09-13T05:10:47.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028908257999999999 2024-09-13T05:10:47.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510062+0000", 2024-09-13T05:10:47.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5613999999999996e-05 2024-09-13T05:10:47.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510168+0000", 2024-09-13T05:10:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105951 2024-09-13T05:10:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11904 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 644096~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:10:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.761804440999999, 2024-09-13T05:10:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029301971, 2024-09-13T05:10:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11904 2024-09-13T05:10:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:10:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:10:47.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:10:47.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481063+0000", 2024-09-13T05:10:47.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6700000000000001e-06 2024-09-13T05:10:47.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481068+0000", 2024-09-13T05:10:47.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4519999999999996e-06 2024-09-13T05:10:47.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481074+0000", 2024-09-13T05:10:47.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8370000000000002e-06 2024-09-13T05:10:47.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510197+0000", 2024-09-13T05:10:47.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029123237999999999 2024-09-13T05:10:47.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510285+0000", 2024-09-13T05:10:47.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7676000000000006e-05 2024-09-13T05:10:47.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510363+0000", 2024-09-13T05:10:47.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8418999999999996e-05 2024-09-13T05:10:47.326 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.326 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.326 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.327 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11905 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 653312~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:47.327 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:10:47.327 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.761788701, 2024-09-13T05:10:47.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029480164, 2024-09-13T05:10:47.327 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.327 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.328 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11905 2024-09-13T05:10:47.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.328 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:10:47.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:10:47.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481076+0000", 2024-09-13T05:10:47.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481079+0000", 2024-09-13T05:10:47.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9629999999999998e-06 2024-09-13T05:10:47.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481087+0000", 2024-09-13T05:10:47.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6369999999999999e-06 2024-09-13T05:10:47.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481093+0000", 2024-09-13T05:10:47.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.857e-06 2024-09-13T05:10:47.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510408+0000", 2024-09-13T05:10:47.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029315213 2024-09-13T05:10:47.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510501+0000", 2024-09-13T05:10:47.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2916000000000003e-05 2024-09-13T05:10:47.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510557+0000", 2024-09-13T05:10:47.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6063999999999997e-05 2024-09-13T05:10:47.334 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.334 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.334 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.334 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11906 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 662528~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:47.334 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:10:47.334 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.761746687999999, 2024-09-13T05:10:47.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029575054999999999, 2024-09-13T05:10:47.335 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.335 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.335 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.335 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.335 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.335 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11906 2024-09-13T05:10:47.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.335 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:10:47.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:10:47.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481118+0000", 2024-09-13T05:10:47.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481122+0000", 2024-09-13T05:10:47.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2610000000000002e-06 2024-09-13T05:10:47.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481129+0000", 2024-09-13T05:10:47.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0079999999999996e-06 2024-09-13T05:10:47.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481135+0000", 2024-09-13T05:10:47.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0599999999999996e-06 2024-09-13T05:10:47.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510575+0000", 2024-09-13T05:10:47.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029440470999999999 2024-09-13T05:10:47.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510635+0000", 2024-09-13T05:10:47.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0177000000000003e-05 2024-09-13T05:10:47.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510694+0000", 2024-09-13T05:10:47.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8675999999999999e-05 2024-09-13T05:10:47.339 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.339 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.339 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.339 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11907 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 671744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:47.339 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:10:47.339 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.761485893, 2024-09-13T05:10:47.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029479490000000001, 2024-09-13T05:10:47.339 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.339 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.339 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.339 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.340 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.340 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11907 2024-09-13T05:10:47.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.340 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:10:47.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:10:47.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481140+0000", 2024-09-13T05:10:47.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997597 2024-09-13T05:10:47.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481383+0000", 2024-09-13T05:10:47.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024355399999999999 2024-09-13T05:10:47.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481390+0000", 2024-09-13T05:10:47.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3599999999999998e-06 2024-09-13T05:10:47.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481395+0000", 2024-09-13T05:10:47.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8940000000000001e-06 2024-09-13T05:10:47.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510722+0000", 2024-09-13T05:10:47.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029327143999999999 2024-09-13T05:10:47.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510802+0000", 2024-09-13T05:10:47.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9770000000000004e-05 2024-09-13T05:10:47.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510859+0000", 2024-09-13T05:10:47.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6957999999999999e-05 2024-09-13T05:10:47.343 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.343 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.343 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.344 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11908 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 680960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:47.344 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:10:47.344 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.761465980000001, 2024-09-13T05:10:47.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029617622, 2024-09-13T05:10:47.344 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.344 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.344 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.344 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.344 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.344 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11908 2024-09-13T05:10:47.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.345 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:10:47.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:10:47.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481399+0000", 2024-09-13T05:10:47.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481401+0000", 2024-09-13T05:10:47.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8729999999999999e-06 2024-09-13T05:10:47.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481413+0000", 2024-09-13T05:10:47.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1748e-05 2024-09-13T05:10:47.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481417+0000", 2024-09-13T05:10:47.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:10:47.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510908+0000", 2024-09-13T05:10:47.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029491129000000001 2024-09-13T05:10:47.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510955+0000", 2024-09-13T05:10:47.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7188000000000003e-05 2024-09-13T05:10:47.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511017+0000", 2024-09-13T05:10:47.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2288999999999999e-05 2024-09-13T05:10:47.348 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.348 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.348 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.348 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11909 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 690176~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:47.348 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:10:47.348 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.761445652999999, 2024-09-13T05:10:47.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029780699000000001, 2024-09-13T05:10:47.348 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.349 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.349 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.349 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.349 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.349 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11909 2024-09-13T05:10:47.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.349 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:10:47.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:10:47.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481419+0000", 2024-09-13T05:10:47.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481421+0000", 2024-09-13T05:10:47.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.035e-06 2024-09-13T05:10:47.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481427+0000", 2024-09-13T05:10:47.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2449999999999998e-06 2024-09-13T05:10:47.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481430+0000", 2024-09-13T05:10:47.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.366e-06 2024-09-13T05:10:47.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511064+0000", 2024-09-13T05:10:47.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029633711 2024-09-13T05:10:47.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511160+0000", 2024-09-13T05:10:47.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6399999999999999e-05 2024-09-13T05:10:47.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511201+0000", 2024-09-13T05:10:47.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0448000000000003e-05 2024-09-13T05:10:47.352 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.352 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.352 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.352 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.353 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.353 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:47.354 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:10:47.355 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:47.350+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:47.455 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:47.450+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:47.510 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:47.510 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:47.510 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:10:47.510 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:47.519 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:10:47.556 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:47.549+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:47.567 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:10:47.626 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:47.626 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:47.626 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:47.627 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:47.627 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:47.636 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:10:47.658 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:47.654+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:47.721 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:10:47.742 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:47.742 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:47.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:47.742 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:47.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.743 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26335 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1207296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:47.743 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:10:47.743 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.009112741999999, 2024-09-13T05:10:47.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055338125000000002, 2024-09-13T05:10:47.743 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.743 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.743 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.743 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.743 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.743 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26335 2024-09-13T05:10:47.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.743 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:10:47.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:10:47.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730550+0000", 2024-09-13T05:10:47.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998579 2024-09-13T05:10:47.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730705+0000", 2024-09-13T05:10:47.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015463400000000001 2024-09-13T05:10:47.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730713+0000", 2024-09-13T05:10:47.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1580000000000005e-06 2024-09-13T05:10:47.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730719+0000", 2024-09-13T05:10:47.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2740000000000004e-06 2024-09-13T05:10:47.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.785798+0000", 2024-09-13T05:10:47.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055079454 2024-09-13T05:10:47.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.785894+0000", 2024-09-13T05:10:47.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5896000000000005e-05 2024-09-13T05:10:47.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.786030+0000", 2024-09-13T05:10:47.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013586199999999999 2024-09-13T05:10:47.747 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.747 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.747 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.747 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26346 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1308672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:47.747 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:10:47.747 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.006971334999999, 2024-09-13T05:10:47.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055416737000000001, 2024-09-13T05:10:47.747 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.748 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.748 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26346 2024-09-13T05:10:47.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.748 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:10:47.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:10:47.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732833+0000", 2024-09-13T05:10:47.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732835+0000", 2024-09-13T05:10:47.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3719999999999999e-06 2024-09-13T05:10:47.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732839+0000", 2024-09-13T05:10:47.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1520000000000001e-06 2024-09-13T05:10:47.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732842+0000", 2024-09-13T05:10:47.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.061e-06 2024-09-13T05:10:47.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788126+0000", 2024-09-13T05:10:47.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055284489999999999 2024-09-13T05:10:47.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788183+0000", 2024-09-13T05:10:47.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7127999999999999e-05 2024-09-13T05:10:47.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788250+0000", 2024-09-13T05:10:47.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7001000000000004e-05 2024-09-13T05:10:47.751 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.751 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.751 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.752 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26348 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 800768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:47.752 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:10:47.752 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.006548511, 2024-09-13T05:10:47.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055321395000000002, 2024-09-13T05:10:47.752 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.752 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.752 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.752 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.752 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.752 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26348 2024-09-13T05:10:47.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.752 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:10:47.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:10:47.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733127+0000", 2024-09-13T05:10:47.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998703 2024-09-13T05:10:47.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733262+0000", 2024-09-13T05:10:47.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013484400000000001 2024-09-13T05:10:47.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733273+0000", 2024-09-13T05:10:47.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1824000000000001e-05 2024-09-13T05:10:47.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733281+0000", 2024-09-13T05:10:47.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9999999999999996e-06 2024-09-13T05:10:47.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788431+0000", 2024-09-13T05:10:47.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055149535 2024-09-13T05:10:47.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788490+0000", 2024-09-13T05:10:47.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9413999999999997e-05 2024-09-13T05:10:47.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788578+0000", 2024-09-13T05:10:47.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7418999999999998e-05 2024-09-13T05:10:47.756 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.756 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.756 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.756 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26368 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 985088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:47.756 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:10:47.756 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.002396314, 2024-09-13T05:10:47.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055320511000000003, 2024-09-13T05:10:47.756 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.756 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.757 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.757 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.757 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.757 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26368 2024-09-13T05:10:47.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.757 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:10:47.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:10:47.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737408+0000", 2024-09-13T05:10:47.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737412+0000", 2024-09-13T05:10:47.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6279999999999998e-06 2024-09-13T05:10:47.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737419+0000", 2024-09-13T05:10:47.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1770000000000001e-06 2024-09-13T05:10:47.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737425+0000", 2024-09-13T05:10:47.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6949999999999997e-06 2024-09-13T05:10:47.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792507+0000", 2024-09-13T05:10:47.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055082840000000001 2024-09-13T05:10:47.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792606+0000", 2024-09-13T05:10:47.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8697999999999996e-05 2024-09-13T05:10:47.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792729+0000", 2024-09-13T05:10:47.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012298499999999999 2024-09-13T05:10:47.760 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.760 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.760 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.761 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26417 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 903168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:47.761 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:10:47.761 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.998336053999999, 2024-09-13T05:10:47.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055375191999999997, 2024-09-13T05:10:47.761 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.761 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.761 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.761 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.761 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.761 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26417 2024-09-13T05:10:47.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.761 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:10:47.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:10:47.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741468+0000", 2024-09-13T05:10:47.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741472+0000", 2024-09-13T05:10:47.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4139999999999998e-06 2024-09-13T05:10:47.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741478+0000", 2024-09-13T05:10:47.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5230000000000001e-06 2024-09-13T05:10:47.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741483+0000", 2024-09-13T05:10:47.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8559999999999998e-06 2024-09-13T05:10:47.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796655+0000", 2024-09-13T05:10:47.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055172153000000002 2024-09-13T05:10:47.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796738+0000", 2024-09-13T05:10:47.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2912999999999997e-05 2024-09-13T05:10:47.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796844+0000", 2024-09-13T05:10:47.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105802 2024-09-13T05:10:47.765 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.765 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.765 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.765 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26419 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 912384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:47.765 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:10:47.765 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.998312189, 2024-09-13T05:10:47.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055570469999999997, 2024-09-13T05:10:47.765 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.765 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26419 2024-09-13T05:10:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:10:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:10:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741492+0000", 2024-09-13T05:10:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741495+0000", 2024-09-13T05:10:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6369999999999999e-06 2024-09-13T05:10:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741508+0000", 2024-09-13T05:10:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3319000000000001e-05 2024-09-13T05:10:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741527+0000", 2024-09-13T05:10:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8542e-05 2024-09-13T05:10:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796871+0000", 2024-09-13T05:10:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055344474999999997 2024-09-13T05:10:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796967+0000", 2024-09-13T05:10:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5963000000000003e-05 2024-09-13T05:10:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797063+0000", 2024-09-13T05:10:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5909999999999995e-05 2024-09-13T05:10:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26421 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 921600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:47.770 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:10:47.770 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.998268886, 2024-09-13T05:10:47.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055631152000000003, 2024-09-13T05:10:47.770 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.770 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.770 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26421 2024-09-13T05:10:47.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.770 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:10:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:10:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741535+0000", 2024-09-13T05:10:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741540+0000", 2024-09-13T05:10:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1690000000000002e-06 2024-09-13T05:10:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741547+0000", 2024-09-13T05:10:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3409999999999997e-06 2024-09-13T05:10:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741552+0000", 2024-09-13T05:10:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5639999999999996e-06 2024-09-13T05:10:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797079+0000", 2024-09-13T05:10:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055526038999999999 2024-09-13T05:10:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797121+0000", 2024-09-13T05:10:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2156000000000001e-05 2024-09-13T05:10:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797167+0000", 2024-09-13T05:10:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6445e-05 2024-09-13T05:10:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26423 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 930816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:10:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.997875893, 2024-09-13T05:10:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055364370000000003, 2024-09-13T05:10:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26423 2024-09-13T05:10:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:10:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:10:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741928+0000", 2024-09-13T05:10:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741933+0000", 2024-09-13T05:10:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9980000000000003e-06 2024-09-13T05:10:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741945+0000", 2024-09-13T05:10:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1761e-05 2024-09-13T05:10:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741958+0000", 2024-09-13T05:10:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2604e-05 2024-09-13T05:10:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797185+0000", 2024-09-13T05:10:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055227169 2024-09-13T05:10:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797226+0000", 2024-09-13T05:10:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1619000000000003e-05 2024-09-13T05:10:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797293+0000", 2024-09-13T05:10:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6952999999999994e-05 2024-09-13T05:10:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26424 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 940032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:10:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.997838956000001, 2024-09-13T05:10:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055448669999999999, 2024-09-13T05:10:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26424 2024-09-13T05:10:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:10:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:10:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741965+0000", 2024-09-13T05:10:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741969+0000", 2024-09-13T05:10:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3440000000000001e-06 2024-09-13T05:10:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741983+0000", 2024-09-13T05:10:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4600000000000001e-05 2024-09-13T05:10:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741989+0000", 2024-09-13T05:10:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5350000000000004e-06 2024-09-13T05:10:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797319+0000", 2024-09-13T05:10:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055330121000000003 2024-09-13T05:10:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797364+0000", 2024-09-13T05:10:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5670000000000002e-05 2024-09-13T05:10:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797415+0000", 2024-09-13T05:10:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0124000000000003e-05 2024-09-13T05:10:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26426 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 949248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:10:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.997811757000001, 2024-09-13T05:10:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055639981999999998, 2024-09-13T05:10:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26426 2024-09-13T05:10:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:10:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:10:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:10:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741995+0000", 2024-09-13T05:10:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.661e-06 2024-09-13T05:10:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742004+0000", 2024-09-13T05:10:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2009999999999999e-06 2024-09-13T05:10:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742008+0000", 2024-09-13T05:10:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7890000000000002e-06 2024-09-13T05:10:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797432+0000", 2024-09-13T05:10:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055423448 2024-09-13T05:10:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797516+0000", 2024-09-13T05:10:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4404e-05 2024-09-13T05:10:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797633+0000", 2024-09-13T05:10:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116898 2024-09-13T05:10:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26427 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 958464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:10:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.997791701000001, 2024-09-13T05:10:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055829295000000001, 2024-09-13T05:10:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26427 2024-09-13T05:10:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:10:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:10:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:10:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742015+0000", 2024-09-13T05:10:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.74e-06 2024-09-13T05:10:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742023+0000", 2024-09-13T05:10:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7039999999999994e-06 2024-09-13T05:10:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742028+0000", 2024-09-13T05:10:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7369999999999997e-06 2024-09-13T05:10:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797666+0000", 2024-09-13T05:10:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055637820999999997 2024-09-13T05:10:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797748+0000", 2024-09-13T05:10:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1787999999999997e-05 2024-09-13T05:10:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797842+0000", 2024-09-13T05:10:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4903999999999998e-05 2024-09-13T05:10:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26432 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 976896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:10:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.99699854, 2024-09-13T05:10:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055402077000000001, 2024-09-13T05:10:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26432 2024-09-13T05:10:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:10:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:10:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:10:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742808+0000", 2024-09-13T05:10:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3319999999999999e-06 2024-09-13T05:10:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742818+0000", 2024-09-13T05:10:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5380000000000008e-06 2024-09-13T05:10:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742821+0000", 2024-09-13T05:10:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2179999999999999e-06 2024-09-13T05:10:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798027+0000", 2024-09-13T05:10:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055206344999999997 2024-09-13T05:10:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798103+0000", 2024-09-13T05:10:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5786999999999998e-05 2024-09-13T05:10:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798208+0000", 2024-09-13T05:10:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010521700000000001 2024-09-13T05:10:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26434 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 986112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:10:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.996981315999999, 2024-09-13T05:10:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055610109999999997, 2024-09-13T05:10:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26434 2024-09-13T05:10:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:10:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:10:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742823+0000", 2024-09-13T05:10:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742825+0000", 2024-09-13T05:10:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6220000000000001e-06 2024-09-13T05:10:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742828+0000", 2024-09-13T05:10:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.926e-06 2024-09-13T05:10:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742831+0000", 2024-09-13T05:10:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-13T05:10:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798239+0000", 2024-09-13T05:10:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055408254999999997 2024-09-13T05:10:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798326+0000", 2024-09-13T05:10:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7168000000000003e-05 2024-09-13T05:10:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798434+0000", 2024-09-13T05:10:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010767100000000001 2024-09-13T05:10:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26442 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1032192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:10:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.995711976000001, 2024-09-13T05:10:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055422776, 2024-09-13T05:10:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26442 2024-09-13T05:10:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:10:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:10:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744061+0000", 2024-09-13T05:10:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999685 2024-09-13T05:10:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744096+0000", 2024-09-13T05:10:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4771999999999998e-05 2024-09-13T05:10:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744147+0000", 2024-09-13T05:10:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0696999999999999e-05 2024-09-13T05:10:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744154+0000", 2024-09-13T05:10:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8510000000000001e-06 2024-09-13T05:10:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799324+0000", 2024-09-13T05:10:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055170074999999999 2024-09-13T05:10:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799415+0000", 2024-09-13T05:10:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1197000000000001e-05 2024-09-13T05:10:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799516+0000", 2024-09-13T05:10:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100666 2024-09-13T05:10:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26443 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1041408~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:10:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.995431405, 2024-09-13T05:10:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055344195999999998, 2024-09-13T05:10:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26443 2024-09-13T05:10:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:10:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:10:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744159+0000", 2024-09-13T05:10:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997849 2024-09-13T05:10:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744379+0000", 2024-09-13T05:10:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022024800000000001 2024-09-13T05:10:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744390+0000", 2024-09-13T05:10:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1105e-05 2024-09-13T05:10:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744397+0000", 2024-09-13T05:10:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2740000000000002e-06 2024-09-13T05:10:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799543+0000", 2024-09-13T05:10:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055145441000000003 2024-09-13T05:10:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799619+0000", 2024-09-13T05:10:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6660000000000001e-05 2024-09-13T05:10:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799718+0000", 2024-09-13T05:10:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8331000000000004e-05 2024-09-13T05:10:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26547 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1318912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:10:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.995245087000001, 2024-09-13T05:10:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055355834, 2024-09-13T05:10:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.811 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26547 2024-09-13T05:10:47.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.811 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:10:47.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:10:47.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744404+0000", 2024-09-13T05:10:47.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998441 2024-09-13T05:10:47.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744564+0000", 2024-09-13T05:10:47.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016022200000000001 2024-09-13T05:10:47.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744579+0000", 2024-09-13T05:10:47.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5036e-05 2024-09-13T05:10:47.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744585+0000", 2024-09-13T05:10:47.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7880000000000003e-06 2024-09-13T05:10:47.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799747+0000", 2024-09-13T05:10:47.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055161804000000002 2024-09-13T05:10:47.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799823+0000", 2024-09-13T05:10:47.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5956000000000003e-05 2024-09-13T05:10:47.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799916+0000", 2024-09-13T05:10:47.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2733999999999997e-05 2024-09-13T05:10:47.814 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.814 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.814 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.814 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26550 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1328128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:47.815 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:10:47.815 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.994988928, 2024-09-13T05:10:47.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055315941, 2024-09-13T05:10:47.815 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.815 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.815 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.815 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.815 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.815 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26550 2024-09-13T05:10:47.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.815 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:10:47.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:10:47.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744591+0000", 2024-09-13T05:10:47.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997745 2024-09-13T05:10:47.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744821+0000", 2024-09-13T05:10:47.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023031899999999999 2024-09-13T05:10:47.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744833+0000", 2024-09-13T05:10:47.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1919000000000001e-05 2024-09-13T05:10:47.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744837+0000", 2024-09-13T05:10:47.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4989999999999996e-06 2024-09-13T05:10:47.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799947+0000", 2024-09-13T05:10:47.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055110120999999998 2024-09-13T05:10:47.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800030+0000", 2024-09-13T05:10:47.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2905999999999995e-05 2024-09-13T05:10:47.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800132+0000", 2024-09-13T05:10:47.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101529 2024-09-13T05:10:47.819 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.819 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.819 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.819 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26558 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1364992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:47.819 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:10:47.819 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.994253921, 2024-09-13T05:10:47.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055422765999999998, 2024-09-13T05:10:47.819 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.819 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.819 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.819 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.819 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.820 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26558 2024-09-13T05:10:47.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.820 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:10:47.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:10:47.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745550+0000", 2024-09-13T05:10:47.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745553+0000", 2024-09-13T05:10:47.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7690000000000001e-06 2024-09-13T05:10:47.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745559+0000", 2024-09-13T05:10:47.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3149999999999997e-06 2024-09-13T05:10:47.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745564+0000", 2024-09-13T05:10:47.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6670000000000004e-06 2024-09-13T05:10:47.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800791+0000", 2024-09-13T05:10:47.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055226711999999997 2024-09-13T05:10:47.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800865+0000", 2024-09-13T05:10:47.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4344000000000005e-05 2024-09-13T05:10:47.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800974+0000", 2024-09-13T05:10:47.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108606 2024-09-13T05:10:47.823 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.823 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.823 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.823 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26561 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1374208~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:47.823 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:10:47.823 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.994236868, 2024-09-13T05:10:47.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055549315000000002, 2024-09-13T05:10:47.824 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.824 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.824 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.824 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.824 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.824 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26561 2024-09-13T05:10:47.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.824 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:10:47.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:10:47.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:10:47.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745570+0000", 2024-09-13T05:10:47.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4719999999999998e-06 2024-09-13T05:10:47.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745575+0000", 2024-09-13T05:10:47.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1900000000000003e-06 2024-09-13T05:10:47.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745579+0000", 2024-09-13T05:10:47.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3250000000000001e-06 2024-09-13T05:10:47.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801000+0000", 2024-09-13T05:10:47.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055420432999999998 2024-09-13T05:10:47.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801061+0000", 2024-09-13T05:10:47.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1427000000000007e-05 2024-09-13T05:10:47.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801117+0000", 2024-09-13T05:10:47.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5933000000000001e-05 2024-09-13T05:10:47.827 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.828 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.828 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.828 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26582 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1447936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:47.828 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:10:47.828 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.992819228, 2024-09-13T05:10:47.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055394301, 2024-09-13T05:10:47.828 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:47.828 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:47.828 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:47.828 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:47.828 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:47.829 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26582 2024-09-13T05:10:47.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.829 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:47.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:47.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:10:47.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:47.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:10:47.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:47.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:47.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746985+0000", 2024-09-13T05:10:47.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:47.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:47.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746988+0000", 2024-09-13T05:10:47.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6479999999999999e-06 2024-09-13T05:10:47.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:47.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.747000+0000", 2024-09-13T05:10:47.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2009e-05 2024-09-13T05:10:47.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:47.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.747005+0000", 2024-09-13T05:10:47.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0039999999999999e-06 2024-09-13T05:10:47.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:47.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802232+0000", 2024-09-13T05:10:47.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055227762999999999 2024-09-13T05:10:47.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:47.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802320+0000", 2024-09-13T05:10:47.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7576000000000003e-05 2024-09-13T05:10:47.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:47.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:47.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:47.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802380+0000", 2024-09-13T05:10:47.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9888e-05 2024-09-13T05:10:47.832 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.832 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.832 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.832 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:47.832 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:47.832 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:47.833 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:10:47.834 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:10:47.835 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:10:47.835 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:10:47.835 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:10:47.836 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:10:47.836 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:47.830+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:47.855 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:10:47.879 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:10:47.881 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:10:47.882 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:10:47.882 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:10:47.882 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:10:47.882 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:10:47.882 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:10:47.882 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:10:47.882 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:10:47.935 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:47.930+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:47.944 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is set 2024-09-13T05:10:47.946 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:47.947 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:47.957 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:10:47.985 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone12 from 0xe6d1cfe (overlap 0xa0fceb5) to 0x0 2024-09-13T05:10:48.036 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:48.030+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:48.091 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:48.091 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:48.104 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:10:48.145 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:48.141+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:48.237 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:48.233+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:48.270 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:48.270 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:48.284 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:10:48.338 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:48.333+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:48.415 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:48.415 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:48.428 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:10:48.439 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:48.434+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:48.533 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:48.533 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:48.541 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:48.538+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:48.542 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:10:48.568 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #11, image image_client.0-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent12 2024-09-13T05:10:48.642 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:48.637+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:48.696 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:48.696 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:48.705 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:10:48.743 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:48.737+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:48.809 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:48.809 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:48.818 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:10:48.844 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:48.837+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:48.875 INFO:teuthology.orchestra.run.smithi120.stdout:1399 write 0x7e62b5a thru 0x7e65e6f (0x3316 bytes) 2024-09-13T05:10:48.901 INFO:teuthology.orchestra.run.smithi120.stdout:1400 read 0x38dd2f6 thru 0x38e14ae (0x41b9 bytes) 2024-09-13T05:10:48.902 INFO:teuthology.orchestra.run.smithi120.stdout:1402 punch from 0xa14223d to 0xa14e4ab, (0xc26e bytes) 2024-09-13T05:10:48.909 INFO:teuthology.orchestra.run.smithi120.stdout:1403 read 0x1b36b4a thru 0x1b403f7 (0x98ae bytes) 2024-09-13T05:10:48.923 INFO:tasks.thrashosds.thrasher:in_osds: [2, 3, 5, 6, 7] out_osds: [4, 1, 0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T05:10:48.923 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:10:48.923 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-13T05:10:48.924 INFO:tasks.thrashosds.thrasher:Setting osd 6 primary_affinity to 0.827692 2024-09-13T05:10:48.924 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 0.8276920764369452 2024-09-13T05:10:48.930 INFO:teuthology.orchestra.run.smithi120.stdout:1404 flatten 2024-09-13T05:10:48.947 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:48.941+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:48.949 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:48.950 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:48.965 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:10:49.046 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:49.041+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:49.097 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:49.097 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:49.111 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:10:49.146 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:49.142+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:49.210 INFO:teuthology.orchestra.run.smithi120.stdout:1405 write 0xcab53b0 thru 0xcac3f37 (0xeb88 bytes) 2024-09-13T05:10:49.217 INFO:teuthology.orchestra.run.smithi120.stdout:1406 write 0xbcf0f93 thru 0xbcf21ac (0x121a bytes) 2024-09-13T05:10:49.218 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:49.218 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:49.219 INFO:teuthology.orchestra.run.smithi120.stdout:1407 writesame 0xdcd19d5 thru 0xdce0354 data_size 0x40(0xe980 bytes) 2024-09-13T05:10:49.226 INFO:teuthology.orchestra.run.smithi120.stdout:1408 read 0x82c5c6d thru 0x82cecfd (0x9091 bytes) 2024-09-13T05:10:49.227 INFO:teuthology.orchestra.run.smithi120.stdout:1410 write 0x1013b61 thru 0x101c649 (0x8ae9 bytes) 2024-09-13T05:10:49.229 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:10:49.231 INFO:teuthology.orchestra.run.smithi120.stdout:1411 read 0x34cd321 thru 0x34d2a27 (0x5707 bytes) 2024-09-13T05:10:49.240 INFO:teuthology.orchestra.run.smithi120.stdout:1412 trunc from 0xe6d1cfe to 0x8c9e3f0 2024-09-13T05:10:49.248 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:49.241+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:49.268 INFO:teuthology.orchestra.run.smithi120.stdout:1413 write 0x81c3fe5 thru 0x81cd5be (0x95da bytes) 2024-09-13T05:10:49.271 INFO:teuthology.orchestra.run.smithi120.stdout:1415 read 0x444f628 thru 0x44519a2 (0x237b bytes) 2024-09-13T05:10:49.272 INFO:teuthology.orchestra.run.smithi120.stdout:1417 read 0x4afd888 thru 0x4b02615 (0x4d8e bytes) 2024-09-13T05:10:49.272 INFO:teuthology.orchestra.run.smithi120.stdout:1418 writesame 0x6d4392b thru 0x6d4c798 data_size 0x3b(0x8e6e bytes) 2024-09-13T05:10:49.298 INFO:teuthology.orchestra.run.smithi120.stdout:1419 write 0xdd56a29 thru 0xdd5e93c (0x7f14 bytes) 2024-09-13T05:10:49.303 INFO:teuthology.orchestra.run.smithi120.stdout:1421 read 0xbb32762 thru 0xbb3700e (0x48ad bytes) 2024-09-13T05:10:49.304 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:49.304 INFO:teuthology.orchestra.run.smithi120.stdout:1423 write 0xd2d6ff9 thru 0xd2deba8 (0x7bb0 bytes) 2024-09-13T05:10:49.327 INFO:teuthology.orchestra.run.smithi120.stdout:1424 trunc from 0xdd5e93d to 0x30e4663 2024-09-13T05:10:49.348 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:49.341+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:49.387 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:49.387 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:49.390 INFO:teuthology.orchestra.run.smithi120.stdout:1425 write 0xb1b842e thru 0xb1baea4 (0x2a77 bytes) 2024-09-13T05:10:49.398 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:10:49.399 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:49.399 INFO:teuthology.orchestra.run.smithi120.stdout:1427 write 0x95ce14a thru 0x95dc1a2 (0xe059 bytes) 2024-09-13T05:10:49.417 INFO:teuthology.orchestra.run.smithi120.stdout:1428 trunc from 0xb1baea5 to 0x3f1c316 2024-09-13T05:10:49.442 INFO:teuthology.orchestra.run.smithi120.stdout:1429 writesame 0x2f61cce thru 0x2f69ef3 data_size 0x1b(0x8226 bytes) 2024-09-13T05:10:49.445 INFO:teuthology.orchestra.run.smithi120.stdout:1430 clone 14 order 18 su 32768 sc 9 2024-09-13T05:10:49.449 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:49.445+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:49.501 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:49.501 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:49.510 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:10:49.551 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:49.546+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:49.615 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:49.615 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:49.625 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:10:49.651 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:49.645+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:49.734 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:49.734 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:49.744 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:10:49.789 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:49.786+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:49.850 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:49.851 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:49.852 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:49.845+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:49.861 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:10:49.897 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:10:49.953 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:49.950+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:49.956 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T05:10:49.959 INFO:teuthology.orchestra.run.smithi120.stderr:set osd.6 primary-affinity to 0.827692 (8542432) 2024-09-13T05:10:49.993 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:49.993 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:50.004 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:10:50.054 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:50.049+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:50.079 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:10:50.100 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:10:50.112 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:50.112 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:50.112 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:50.112 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:50.112 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:50.119 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:10:50.122 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:10:50.140 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #12, image image_client.0-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent13 2024-09-13T05:10:50.145 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:10:50.155 INFO:teuthology.orchestra.run.smithi120.stdout:1431 punch from 0xfb4beb to 0xfb89c1, (0x3dd6 bytes) 2024-09-13T05:10:50.155 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:50.149+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:50.160 INFO:teuthology.orchestra.run.smithi120.stdout:1432 punch from 0x1711703 to 0x17161e5, (0x4ae2 bytes) 2024-09-13T05:10:50.160 INFO:teuthology.orchestra.run.smithi120.stdout:1433 write 0x18ca3a0 thru 0x18d6aa2 (0xc703 bytes) 2024-09-13T05:10:50.169 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:10:50.179 INFO:teuthology.orchestra.run.smithi120.stdout:1435 read 0xfa86bb thru 0xfafa79 (0x73bf bytes) 2024-09-13T05:10:50.180 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:50.180 INFO:teuthology.orchestra.run.smithi120.stdout:1437 punch from 0xf07cdd to 0xf083aa, (0x6cd bytes) 2024-09-13T05:10:50.180 INFO:teuthology.orchestra.run.smithi120.stdout:1438 read 0x13b6af8 thru 0x13c4450 (0xd959 bytes) 2024-09-13T05:10:50.192 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:10:50.207 INFO:teuthology.orchestra.run.smithi120.stdout:1439 write 0x5b004b0 thru 0x5b0d9fe (0xd54f bytes) 2024-09-13T05:10:50.214 INFO:teuthology.orchestra.run.smithi120.stdout:1441 write 0x1d13404 thru 0x1d19973 (0x6570 bytes) 2024-09-13T05:10:50.216 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:10:50.226 INFO:teuthology.orchestra.run.smithi120.stdout:1442 writesame 0x19c41e5 thru 0x19c9298 data_size 0xa(0x50b4 bytes) 2024-09-13T05:10:50.233 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:50.233 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:50.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:50.234 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:50.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.234 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14179 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1835008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.234 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:10:50.234 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.471931197, 2024-09-13T05:10:50.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0924508550000001, 2024-09-13T05:10:50.234 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.235 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.235 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14179 2024-09-13T05:10:50.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.236 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:10:50.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:10:50.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757551+0000", 2024-09-13T05:10:50.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757554+0000", 2024-09-13T05:10:50.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5440000000000001e-06 2024-09-13T05:10:50.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757560+0000", 2024-09-13T05:10:50.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6840000000000001e-06 2024-09-13T05:10:50.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757564+0000", 2024-09-13T05:10:50.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3529999999999997e-06 2024-09-13T05:10:50.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814931+0000", 2024-09-13T05:10:50.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057367564000000003 2024-09-13T05:10:50.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:50.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814938+0000", 2024-09-13T05:10:50.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1070000000000001e-06 2024-09-13T05:10:50.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.849802+0000", 2024-09-13T05:10:50.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348647849999999 2024-09-13T05:10:50.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.849885+0000", 2024-09-13T05:10:50.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2859000000000001e-05 2024-09-13T05:10:50.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850003+0000", 2024-09-13T05:10:50.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117279 2024-09-13T05:10:50.244 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.244 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.244 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.245 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14180 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1844224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.245 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:10:50.245 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.471914911999999, 2024-09-13T05:10:50.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.092637853, 2024-09-13T05:10:50.245 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.245 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.245 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.245 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.245 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.245 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14180 2024-09-13T05:10:50.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.246 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:10:50.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:10:50.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:10:50.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757570+0000", 2024-09-13T05:10:50.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3470000000000001e-06 2024-09-13T05:10:50.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757576+0000", 2024-09-13T05:10:50.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5550000000000002e-06 2024-09-13T05:10:50.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757580+0000", 2024-09-13T05:10:50.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6519999999999997e-06 2024-09-13T05:10:50.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814975+0000", 2024-09-13T05:10:50.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057394349999999997 2024-09-13T05:10:50.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:50.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814981+0000", 2024-09-13T05:10:50.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4119999999999998e-06 2024-09-13T05:10:50.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850042+0000", 2024-09-13T05:10:50.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0350611759999999 2024-09-13T05:10:50.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850103+0000", 2024-09-13T05:10:50.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0618000000000001e-05 2024-09-13T05:10:50.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850206+0000", 2024-09-13T05:10:50.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010309199999999999 2024-09-13T05:10:50.251 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.251 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.251 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.251 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14196 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1991680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.251 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:10:50.251 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.468115826000002, 2024-09-13T05:10:50.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0925442910000001, 2024-09-13T05:10:50.251 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.252 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.252 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.252 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.252 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.252 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14196 2024-09-13T05:10:50.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.252 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:10:50.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:10:50.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:10:50.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761368+0000", 2024-09-13T05:10:50.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3689999999999999e-06 2024-09-13T05:10:50.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761373+0000", 2024-09-13T05:10:50.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7180000000000004e-06 2024-09-13T05:10:50.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761376+0000", 2024-09-13T05:10:50.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0860000000000002e-06 2024-09-13T05:10:50.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815501+0000", 2024-09-13T05:10:50.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054125508000000003 2024-09-13T05:10:50.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:50.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815508+0000", 2024-09-13T05:10:50.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5570000000000001e-06 2024-09-13T05:10:50.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853689+0000", 2024-09-13T05:10:50.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0381811919999999 2024-09-13T05:10:50.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853764+0000", 2024-09-13T05:10:50.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4893000000000003e-05 2024-09-13T05:10:50.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853911+0000", 2024-09-13T05:10:50.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014721100000000001 2024-09-13T05:10:50.257 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.257 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.257 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.257 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14197 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2000896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.257 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:10:50.257 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.468104581999999, 2024-09-13T05:10:50.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.092841977, 2024-09-13T05:10:50.257 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.257 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.257 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.258 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.258 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.258 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14197 2024-09-13T05:10:50.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.258 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:10:50.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:10:50.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:10:50.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761403+0000", 2024-09-13T05:10:50.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5199e-05 2024-09-13T05:10:50.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761411+0000", 2024-09-13T05:10:50.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4540000000000001e-06 2024-09-13T05:10:50.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761418+0000", 2024-09-13T05:10:50.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9569999999999996e-06 2024-09-13T05:10:50.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815531+0000", 2024-09-13T05:10:50.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054113599999999998 2024-09-13T05:10:50.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:50.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815539+0000", 2024-09-13T05:10:50.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.481e-06 2024-09-13T05:10:50.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853949+0000", 2024-09-13T05:10:50.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.038410356 2024-09-13T05:10:50.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854022+0000", 2024-09-13T05:10:50.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2807999999999998e-05 2024-09-13T05:10:50.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854220+0000", 2024-09-13T05:10:50.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000198364 2024-09-13T05:10:50.267 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.267 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.267 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.268 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14198 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2010112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.268 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:10:50.268 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.468059574000002, 2024-09-13T05:10:50.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093063787, 2024-09-13T05:10:50.269 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.269 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.269 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.269 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.269 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.269 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14198 2024-09-13T05:10:50.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.270 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:10:50.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:10:50.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:10:50.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761426+0000", 2024-09-13T05:10:50.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8789999999999999e-06 2024-09-13T05:10:50.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761432+0000", 2024-09-13T05:10:50.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1399999999999997e-06 2024-09-13T05:10:50.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761437+0000", 2024-09-13T05:10:50.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8579999999999999e-06 2024-09-13T05:10:50.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815563+0000", 2024-09-13T05:10:50.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054125877000000003 2024-09-13T05:10:50.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:50.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815570+0000", 2024-09-13T05:10:50.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1169999999999998e-06 2024-09-13T05:10:50.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854265+0000", 2024-09-13T05:10:50.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0386955659999999 2024-09-13T05:10:50.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854338+0000", 2024-09-13T05:10:50.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2537e-05 2024-09-13T05:10:50.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854487+0000", 2024-09-13T05:10:50.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014927899999999999 2024-09-13T05:10:50.279 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.279 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.280 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.280 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14199 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.280 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:10:50.280 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.468040701, 2024-09-13T05:10:50.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0933252389999999, 2024-09-13T05:10:50.285 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.285 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.285 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.285 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.285 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.286 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14199 2024-09-13T05:10:50.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.286 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:10:50.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:10:50.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:10:50.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761445+0000", 2024-09-13T05:10:50.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7779999999999999e-06 2024-09-13T05:10:50.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761450+0000", 2024-09-13T05:10:50.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6350000000000003e-06 2024-09-13T05:10:50.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761455+0000", 2024-09-13T05:10:50.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9930000000000003e-06 2024-09-13T05:10:50.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815600+0000", 2024-09-13T05:10:50.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054144982000000001 2024-09-13T05:10:50.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:50.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815607+0000", 2024-09-13T05:10:50.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4749999999999998e-06 2024-09-13T05:10:50.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854527+0000", 2024-09-13T05:10:50.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.038920037 2024-09-13T05:10:50.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854637+0000", 2024-09-13T05:10:50.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011021700000000001 2024-09-13T05:10:50.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854767+0000", 2024-09-13T05:10:50.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130512 2024-09-13T05:10:50.295 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.296 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.296 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.297 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14200 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2028544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.297 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:10:50.297 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.468022187999999, 2024-09-13T05:10:50.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093541554, 2024-09-13T05:10:50.297 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.298 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.298 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14200 2024-09-13T05:10:50.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.299 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:10:50.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:10:50.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761460+0000", 2024-09-13T05:10:50.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761462+0000", 2024-09-13T05:10:50.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9659999999999999e-06 2024-09-13T05:10:50.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761466+0000", 2024-09-13T05:10:50.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6109999999999998e-06 2024-09-13T05:10:50.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761471+0000", 2024-09-13T05:10:50.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1019999999999996e-06 2024-09-13T05:10:50.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815631+0000", 2024-09-13T05:10:50.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054159680000000002 2024-09-13T05:10:50.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:50.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815637+0000", 2024-09-13T05:10:50.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-09-13T05:10:50.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854810+0000", 2024-09-13T05:10:50.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0391731930000001 2024-09-13T05:10:50.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854883+0000", 2024-09-13T05:10:50.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3109999999999996e-05 2024-09-13T05:10:50.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855002+0000", 2024-09-13T05:10:50.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011934600000000001 2024-09-13T05:10:50.308 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.308 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.308 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.309 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14201 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2037760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.309 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:10:50.309 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.468007757999999, 2024-09-13T05:10:50.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0937543320000001, 2024-09-13T05:10:50.310 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.310 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.310 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.310 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.310 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.310 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14201 2024-09-13T05:10:50.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.311 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:10:50.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:10:50.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:10:50.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761477+0000", 2024-09-13T05:10:50.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5620000000000002e-06 2024-09-13T05:10:50.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761483+0000", 2024-09-13T05:10:50.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7400000000000001e-06 2024-09-13T05:10:50.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761487+0000", 2024-09-13T05:10:50.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8130000000000002e-06 2024-09-13T05:10:50.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815697+0000", 2024-09-13T05:10:50.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054210253 2024-09-13T05:10:50.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:50.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815705+0000", 2024-09-13T05:10:50.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7049999999999999e-06 2024-09-13T05:10:50.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855036+0000", 2024-09-13T05:10:50.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.039330799 2024-09-13T05:10:50.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855110+0000", 2024-09-13T05:10:50.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4498000000000004e-05 2024-09-13T05:10:50.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855229+0000", 2024-09-13T05:10:50.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119282 2024-09-13T05:10:50.317 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.317 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.317 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.317 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14202 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.317 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:10:50.317 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.467943100999999, 2024-09-13T05:10:50.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093934027, 2024-09-13T05:10:50.317 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.318 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.318 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14202 2024-09-13T05:10:50.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.318 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:10:50.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:10:50.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761489+0000", 2024-09-13T05:10:50.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999495 2024-09-13T05:10:50.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761543+0000", 2024-09-13T05:10:50.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3983999999999997e-05 2024-09-13T05:10:50.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761552+0000", 2024-09-13T05:10:50.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-13T05:10:50.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761559+0000", 2024-09-13T05:10:50.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7710000000000001e-06 2024-09-13T05:10:50.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815742+0000", 2024-09-13T05:10:50.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054183488000000002 2024-09-13T05:10:50.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:50.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815749+0000", 2024-09-13T05:10:50.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1609999999999997e-06 2024-09-13T05:10:50.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855283+0000", 2024-09-13T05:10:50.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0395336230000001 2024-09-13T05:10:50.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855354+0000", 2024-09-13T05:10:50.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1456000000000002e-05 2024-09-13T05:10:50.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855474+0000", 2024-09-13T05:10:50.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119429 2024-09-13T05:10:50.322 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.322 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.322 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.322 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14294 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2113536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.322 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:10:50.322 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.464392187000001, 2024-09-13T05:10:50.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0923650330000001, 2024-09-13T05:10:50.322 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.322 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.323 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.323 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.323 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.323 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14294 2024-09-13T05:10:50.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.323 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:10:50.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:10:50.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765090+0000", 2024-09-13T05:10:50.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:50.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765092+0000", 2024-09-13T05:10:50.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.542e-06 2024-09-13T05:10:50.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765096+0000", 2024-09-13T05:10:50.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6179999999999999e-06 2024-09-13T05:10:50.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765098+0000", 2024-09-13T05:10:50.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8049999999999998e-06 2024-09-13T05:10:50.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816384+0000", 2024-09-13T05:10:50.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051285338999999999 2024-09-13T05:10:50.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:50.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816393+0000", 2024-09-13T05:10:50.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-09-13T05:10:50.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857258+0000", 2024-09-13T05:10:50.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0408652549999999 2024-09-13T05:10:50.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857327+0000", 2024-09-13T05:10:50.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8714000000000007e-05 2024-09-13T05:10:50.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857456+0000", 2024-09-13T05:10:50.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012909299999999999 2024-09-13T05:10:50.327 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.327 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.327 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.327 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14295 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2122752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.327 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:10:50.327 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.464382429, 2024-09-13T05:10:50.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0928006969999999, 2024-09-13T05:10:50.327 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.327 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.328 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14295 2024-09-13T05:10:50.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.328 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:10:50.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:10:50.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:10:50.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:50.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765102+0000", 2024-09-13T05:10:50.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3990000000000001e-06 2024-09-13T05:10:50.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765104+0000", 2024-09-13T05:10:50.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:10:50.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765107+0000", 2024-09-13T05:10:50.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.582e-06 2024-09-13T05:10:50.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816432+0000", 2024-09-13T05:10:50.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051325118000000003 2024-09-13T05:10:50.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:50.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816440+0000", 2024-09-13T05:10:50.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4679999999999992e-06 2024-09-13T05:10:50.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857495+0000", 2024-09-13T05:10:50.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.041054216 2024-09-13T05:10:50.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857644+0000", 2024-09-13T05:10:50.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014909400000000001 2024-09-13T05:10:50.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857901+0000", 2024-09-13T05:10:50.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025746200000000002 2024-09-13T05:10:50.332 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.332 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.332 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.332 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14296 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2131968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.332 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:10:50.332 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.464374183, 2024-09-13T05:10:50.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093120361, 2024-09-13T05:10:50.333 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.333 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.333 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.333 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.333 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.333 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14296 2024-09-13T05:10:50.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.333 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:10:50.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:10:50.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765108+0000", 2024-09-13T05:10:50.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:50.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765110+0000", 2024-09-13T05:10:50.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.226e-06 2024-09-13T05:10:50.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765112+0000", 2024-09-13T05:10:50.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6769999999999999e-06 2024-09-13T05:10:50.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765115+0000", 2024-09-13T05:10:50.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.712e-06 2024-09-13T05:10:50.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816479+0000", 2024-09-13T05:10:50.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051364102000000002 2024-09-13T05:10:50.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:50.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816503+0000", 2024-09-13T05:10:50.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3723999999999999e-05 2024-09-13T05:10:50.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857929+0000", 2024-09-13T05:10:50.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0414263180000001 2024-09-13T05:10:50.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858015+0000", 2024-09-13T05:10:50.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5730999999999996e-05 2024-09-13T05:10:50.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858229+0000", 2024-09-13T05:10:50.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021408700000000001 2024-09-13T05:10:50.337 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.337 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.337 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.337 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14297 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2141184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.337 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:10:50.337 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.464365837999999, 2024-09-13T05:10:50.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0936699510000001, 2024-09-13T05:10:50.338 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.338 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.338 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.338 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.338 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.338 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14297 2024-09-13T05:10:50.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.338 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:10:50.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:10:50.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:10:50.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:50.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765118+0000", 2024-09-13T05:10:50.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4190000000000001e-06 2024-09-13T05:10:50.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765121+0000", 2024-09-13T05:10:50.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6110000000000001e-06 2024-09-13T05:10:50.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765124+0000", 2024-09-13T05:10:50.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3720000000000001e-06 2024-09-13T05:10:50.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816535+0000", 2024-09-13T05:10:50.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051410890000000001 2024-09-13T05:10:50.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:50.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816556+0000", 2024-09-13T05:10:50.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0551e-05 2024-09-13T05:10:50.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858552+0000", 2024-09-13T05:10:50.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0419965529999999 2024-09-13T05:10:50.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858640+0000", 2024-09-13T05:10:50.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7907999999999999e-05 2024-09-13T05:10:50.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858787+0000", 2024-09-13T05:10:50.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000146864 2024-09-13T05:10:50.342 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.342 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.342 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.342 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14298 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2150400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.342 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:10:50.342 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.464356445, 2024-09-13T05:10:50.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0938958759999999, 2024-09-13T05:10:50.342 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.343 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.343 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14298 2024-09-13T05:10:50.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.343 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:10:50.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:10:50.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:10:50.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:50.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765128+0000", 2024-09-13T05:10:50.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4139999999999999e-06 2024-09-13T05:10:50.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765130+0000", 2024-09-13T05:10:50.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6809999999999998e-06 2024-09-13T05:10:50.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765133+0000", 2024-09-13T05:10:50.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9270000000000001e-06 2024-09-13T05:10:50.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816592+0000", 2024-09-13T05:10:50.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051459029000000003 2024-09-13T05:10:50.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:50.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816601+0000", 2024-09-13T05:10:50.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9819999999999997e-06 2024-09-13T05:10:50.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858818+0000", 2024-09-13T05:10:50.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0422167170000001 2024-09-13T05:10:50.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858896+0000", 2024-09-13T05:10:50.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8128999999999997e-05 2024-09-13T05:10:50.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859022+0000", 2024-09-13T05:10:50.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012619899999999999 2024-09-13T05:10:50.347 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.347 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.347 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.347 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14299 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2168832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.347 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:10:50.347 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.464347681, 2024-09-13T05:10:50.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0941207909999999, 2024-09-13T05:10:50.348 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.348 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.348 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.348 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.348 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.348 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14299 2024-09-13T05:10:50.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.348 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:10:50.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:10:50.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:10:50.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:50.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765136+0000", 2024-09-13T05:10:50.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5230000000000001e-06 2024-09-13T05:10:50.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765139+0000", 2024-09-13T05:10:50.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.672e-06 2024-09-13T05:10:50.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765142+0000", 2024-09-13T05:10:50.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6680000000000001e-06 2024-09-13T05:10:50.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816632+0000", 2024-09-13T05:10:50.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051489886999999998 2024-09-13T05:10:50.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:50.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816643+0000", 2024-09-13T05:10:50.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1457000000000001e-05 2024-09-13T05:10:50.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859061+0000", 2024-09-13T05:10:50.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.042417616 2024-09-13T05:10:50.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859138+0000", 2024-09-13T05:10:50.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7077999999999996e-05 2024-09-13T05:10:50.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859256+0000", 2024-09-13T05:10:50.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118108 2024-09-13T05:10:50.352 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.352 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.352 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.352 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14300 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2159616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.352 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:10:50.352 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.464338870999999, 2024-09-13T05:10:50.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0943386719999999, 2024-09-13T05:10:50.353 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.353 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.353 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.353 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.353 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.353 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14300 2024-09-13T05:10:50.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.353 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:10:50.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:10:50.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:10:50.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:50.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765145+0000", 2024-09-13T05:10:50.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.488e-06 2024-09-13T05:10:50.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765148+0000", 2024-09-13T05:10:50.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6620000000000001e-06 2024-09-13T05:10:50.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765151+0000", 2024-09-13T05:10:50.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6419999999999999e-06 2024-09-13T05:10:50.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816677+0000", 2024-09-13T05:10:50.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051526776000000003 2024-09-13T05:10:50.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:50.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816689+0000", 2024-09-13T05:10:50.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1634000000000001e-05 2024-09-13T05:10:50.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859296+0000", 2024-09-13T05:10:50.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0426066009999999 2024-09-13T05:10:50.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859364+0000", 2024-09-13T05:10:50.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8745999999999995e-05 2024-09-13T05:10:50.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859483+0000", 2024-09-13T05:10:50.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011833900000000001 2024-09-13T05:10:50.357 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.357 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.357 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.357 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14301 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2178048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.357 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:10:50.357 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.464330236999999, 2024-09-13T05:10:50.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0946233009999999, 2024-09-13T05:10:50.357 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.358 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.358 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.358 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.358 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.358 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14301 2024-09-13T05:10:50.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.358 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:10:50.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:10:50.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765152+0000", 2024-09-13T05:10:50.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:50.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765154+0000", 2024-09-13T05:10:50.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.449e-06 2024-09-13T05:10:50.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765157+0000", 2024-09-13T05:10:50.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6809999999999998e-06 2024-09-13T05:10:50.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765159+0000", 2024-09-13T05:10:50.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6060000000000001e-06 2024-09-13T05:10:50.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816722+0000", 2024-09-13T05:10:50.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051562535 2024-09-13T05:10:50.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:50.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816733+0000", 2024-09-13T05:10:50.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1678000000000001e-05 2024-09-13T05:10:50.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859521+0000", 2024-09-13T05:10:50.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0427879440000001 2024-09-13T05:10:50.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859655+0000", 2024-09-13T05:10:50.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134053 2024-09-13T05:10:50.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859776+0000", 2024-09-13T05:10:50.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012058299999999999 2024-09-13T05:10:50.362 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.362 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.363 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.363 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14302 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2187264~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.363 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:10:50.363 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.46432166, 2024-09-13T05:10:50.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.094937383, 2024-09-13T05:10:50.363 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.363 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.363 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.363 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.363 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.363 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14302 2024-09-13T05:10:50.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.364 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:10:50.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:10:50.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:10:50.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:50.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765162+0000", 2024-09-13T05:10:50.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4589999999999999e-06 2024-09-13T05:10:50.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765165+0000", 2024-09-13T05:10:50.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6019999999999998e-06 2024-09-13T05:10:50.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765168+0000", 2024-09-13T05:10:50.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.497e-06 2024-09-13T05:10:50.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816764+0000", 2024-09-13T05:10:50.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051596722999999997 2024-09-13T05:10:50.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:50.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816776+0000", 2024-09-13T05:10:50.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1967000000000001e-05 2024-09-13T05:10:50.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859810+0000", 2024-09-13T05:10:50.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0430338299999999 2024-09-13T05:10:50.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859901+0000", 2024-09-13T05:10:50.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1397999999999995e-05 2024-09-13T05:10:50.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860099+0000", 2024-09-13T05:10:50.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000197133 2024-09-13T05:10:50.367 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.367 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.368 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.368 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14303 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2196480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.368 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:10:50.368 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.464313322999999, 2024-09-13T05:10:50.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.095199152, 2024-09-13T05:10:50.368 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.368 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.368 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.368 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.368 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.368 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14303 2024-09-13T05:10:50.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.369 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:10:50.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:10:50.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765169+0000", 2024-09-13T05:10:50.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765171+0000", 2024-09-13T05:10:50.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2899999999999999e-06 2024-09-13T05:10:50.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765173+0000", 2024-09-13T05:10:50.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-13T05:10:50.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765176+0000", 2024-09-13T05:10:50.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.016e-06 2024-09-13T05:10:50.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816811+0000", 2024-09-13T05:10:50.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051634684 2024-09-13T05:10:50.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:50.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816840+0000", 2024-09-13T05:10:50.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8690000000000001e-05 2024-09-13T05:10:50.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860135+0000", 2024-09-13T05:10:50.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0432951029999999 2024-09-13T05:10:50.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860255+0000", 2024-09-13T05:10:50.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119936 2024-09-13T05:10:50.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860369+0000", 2024-09-13T05:10:50.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113978 2024-09-13T05:10:50.372 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.372 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.372 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.373 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14304 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2205696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.373 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:10:50.373 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.464290455, 2024-09-13T05:10:50.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0955512999999999, 2024-09-13T05:10:50.373 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.373 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.373 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.373 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.373 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.373 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14304 2024-09-13T05:10:50.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.373 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:10:50.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:10:50.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:10:50.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765195+0000", 2024-09-13T05:10:50.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6599999999999999e-06 2024-09-13T05:10:50.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765200+0000", 2024-09-13T05:10:50.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.356e-06 2024-09-13T05:10:50.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765205+0000", 2024-09-13T05:10:50.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3000000000000001e-06 2024-09-13T05:10:50.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816901+0000", 2024-09-13T05:10:50.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051695451000000003 2024-09-13T05:10:50.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:10:50.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816963+0000", 2024-09-13T05:10:50.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2694000000000007e-05 2024-09-13T05:10:50.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860434+0000", 2024-09-13T05:10:50.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.04347053 2024-09-13T05:10:50.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860592+0000", 2024-09-13T05:10:50.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015854199999999999 2024-09-13T05:10:50.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860744+0000", 2024-09-13T05:10:50.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015133 2024-09-13T05:10:50.377 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.377 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.377 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.377 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.378 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.378 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:50.378 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:10:50.379 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:10:50.379 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:10:50.379 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:10:50.379 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:10:50.379 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:10:50.379 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:10:50.379 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:10:50.379 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:10:50.380 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:10:50.382 INFO:teuthology.orchestra.run.smithi120.stdout:1443 write 0xce4f550 thru 0xce50790 (0x1241 bytes) 2024-09-13T05:10:50.382 INFO:teuthology.orchestra.run.smithi120.stdout:1444 read 0x84a8ca4 thru 0x84b5a29 (0xcd86 bytes) 2024-09-13T05:10:50.382 INFO:teuthology.orchestra.run.smithi120.stdout:1445 read 0x9b29737 thru 0x9b367c3 (0xd08d bytes) 2024-09-13T05:10:50.383 INFO:teuthology.orchestra.run.smithi120.stdout:1446 write 0x8905843 thru 0x89094c5 (0x3c83 bytes) 2024-09-13T05:10:50.383 INFO:teuthology.orchestra.run.smithi120.stdout:1447 trunc from 0xce50791 to 0x9190fcd 2024-09-13T05:10:50.383 INFO:teuthology.orchestra.run.smithi120.stdout:1448 punch from 0x2acf0d2 to 0x2ade5d7, (0xf505 bytes) 2024-09-13T05:10:50.383 INFO:teuthology.orchestra.run.smithi120.stdout:1449 punch from 0x80984a3 to 0x80a568c, (0xd1e9 bytes) 2024-09-13T05:10:50.383 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:50.383 INFO:teuthology.orchestra.run.smithi120.stdout:1453 read 0x516298e thru 0x516c1ab (0x981e bytes) 2024-09-13T05:10:50.383 INFO:teuthology.orchestra.run.smithi120.stdout:1454 write 0x434de4f thru 0x435b8e7 (0xda99 bytes) 2024-09-13T05:10:50.383 INFO:teuthology.orchestra.run.smithi120.stdout:1455 write 0xc6ff07b thru 0xc70d6fa (0xe680 bytes) 2024-09-13T05:10:50.383 INFO:teuthology.orchestra.run.smithi120.stdout:1457 read 0x805acc1 thru 0x80622a1 (0x75e1 bytes) 2024-09-13T05:10:50.383 INFO:teuthology.orchestra.run.smithi120.stdout:1458 write 0x438f3e3 thru 0x438f928 (0x546 bytes) 2024-09-13T05:10:50.383 INFO:teuthology.orchestra.run.smithi120.stdout:1459 write 0xbb5d6ad thru 0xbb66604 (0x8f58 bytes) 2024-09-13T05:10:50.383 INFO:teuthology.orchestra.run.smithi120.stdout:1462 trunc from 0xc70d6fb to 0x67cdbea 2024-09-13T05:10:50.384 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:50.374+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:50.447 INFO:teuthology.orchestra.run.smithi120.stdout:1463 write 0xd5c834a thru 0xd5c9a79 (0x1730 bytes) 2024-09-13T05:10:50.453 INFO:teuthology.orchestra.run.smithi120.stdout:1464 writesame 0xa835a79 thru 0xa83a0c3 data_size 0x3b(0x464b bytes) 2024-09-13T05:10:50.460 INFO:teuthology.orchestra.run.smithi120.stdout:1465 write 0x1f89a0 thru 0x1fe5ed (0x5c4e bytes) 2024-09-13T05:10:50.473 INFO:teuthology.orchestra.run.smithi120.stdout:1467 read 0x1832eeb thru 0x1839ce9 (0x6dff bytes) 2024-09-13T05:10:50.475 INFO:teuthology.orchestra.run.smithi120.stdout:1468 punch from 0x23c4bbc to 0x23c5d11, (0x1155 bytes) 2024-09-13T05:10:50.475 INFO:teuthology.orchestra.run.smithi120.stdout:1470 write 0x8ffb17b thru 0x9006109 (0xaf8f bytes) 2024-09-13T05:10:50.480 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:50.474+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:50.486 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:50.486 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:50.488 INFO:teuthology.orchestra.run.smithi120.stdout:1474 trunc from 0xd5c9a7a to 0xbaa50be 2024-09-13T05:10:50.506 INFO:teuthology.orchestra.run.smithi120.stdout:1475 writesame 0x496a395 thru 0x49763e3 data_size 0xd(0xc04f bytes) 2024-09-13T05:10:50.528 INFO:teuthology.orchestra.run.smithi120.stdout:1476 write 0xda08b5c thru 0xda0b957 (0x2dfc bytes) 2024-09-13T05:10:50.540 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:50.540 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:50.541 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:10:50.541 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:50.550 INFO:teuthology.orchestra.run.smithi120.stdout:1477 trunc from 0xda0b958 to 0x3d03a70 2024-09-13T05:10:50.553 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:10:50.581 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:50.573+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:50.597 INFO:teuthology.orchestra.run.smithi120.stdout:1478 read 0x256472 thru 0x256a9b (0x62a bytes) 2024-09-13T05:10:50.597 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:50.597 INFO:teuthology.orchestra.run.smithi120.stdout:1483 read 0x37f988b thru 0x37fffce (0x6744 bytes) 2024-09-13T05:10:50.617 INFO:teuthology.orchestra.run.smithi120.stdout:1484 write 0x5bb3e9a thru 0x5bb5d2d (0x1e94 bytes) 2024-09-13T05:10:50.623 INFO:teuthology.orchestra.run.smithi120.stdout:1485 read 0x3dbe865 thru 0x3dc09fe (0x219a bytes) 2024-09-13T05:10:50.623 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:50.623 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:50.623 INFO:teuthology.orchestra.run.smithi120.stdout:1491 write 0x4c076eb thru 0x4c07a8e (0x3a4 bytes) 2024-09-13T05:10:50.634 INFO:teuthology.orchestra.run.smithi120.stdout:1492 trunc from 0x5bb5d2e to 0x8d8d254 2024-09-13T05:10:50.646 INFO:teuthology.orchestra.run.smithi120.stdout:1493 writesame 0x617dc84 thru 0x618cb9c data_size 0x9(0xef19 bytes) 2024-09-13T05:10:50.658 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:50.658 INFO:teuthology.orchestra.run.smithi120.stdout:1495 writesame 0x63f5c3e thru 0x63fbf3a data_size 0x1(0x62fd bytes) 2024-09-13T05:10:50.676 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:50.676 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:50.676 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:50.676 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:50.676 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:50.682 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:50.678+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:50.694 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:10:50.695 INFO:teuthology.orchestra.run.smithi120.stdout:1496 write 0xd25cabe thru 0xd260b1c (0x405f bytes) 2024-09-13T05:10:50.714 INFO:teuthology.orchestra.run.smithi120.stdout:1497 write 0xe20e013 thru 0xe2105d4 (0x25c2 bytes) 2024-09-13T05:10:50.739 INFO:teuthology.orchestra.run.smithi120.stdout:1498 trunc from 0xe2105d5 to 0x41bc9e4 2024-09-13T05:10:50.759 INFO:teuthology.orchestra.run.smithi120.stdout:1499 punch from 0x30a6420 to 0x30ab114, (0x4cf4 bytes) 2024-09-13T05:10:50.768 INFO:teuthology.orchestra.run.smithi120.stdout:1501 write 0x47db854 thru 0x47dd025 (0x17d2 bytes) 2024-09-13T05:10:50.782 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:50.777+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:50.790 INFO:teuthology.orchestra.run.smithi120.stdout:1502 write 0x945602b thru 0x945f554 (0x952a bytes) 2024-09-13T05:10:50.798 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:50.806 INFO:teuthology.orchestra.run.smithi120.stdout:1505 trunc from 0x945f555 to 0xe9d3837 2024-09-13T05:10:50.815 INFO:teuthology.orchestra.run.smithi120.stdout:1506 writesame 0x4d480f5 thru 0x4d57811 data_size 0x3(0xf71d bytes) 2024-09-13T05:10:50.826 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:50.826 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:50.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:50.826 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:50.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.827 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10634 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 731136~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.827 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:10:50.827 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.419211128000001, 2024-09-13T05:10:50.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028136992999999999, 2024-09-13T05:10:50.827 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.827 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.827 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.827 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.827 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.827 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10634 2024-09-13T05:10:50.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.827 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:10:50.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:10:50.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:10:50.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401987+0000", 2024-09-13T05:10:50.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5090000000000001e-06 2024-09-13T05:10:50.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401997+0000", 2024-09-13T05:10:50.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8009999999999998e-06 2024-09-13T05:10:50.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402000+0000", 2024-09-13T05:10:50.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.756e-06 2024-09-13T05:10:50.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430035+0000", 2024-09-13T05:10:50.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028034967000000001 2024-09-13T05:10:50.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430081+0000", 2024-09-13T05:10:50.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6448e-05 2024-09-13T05:10:50.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430123+0000", 2024-09-13T05:10:50.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1758000000000002e-05 2024-09-13T05:10:50.831 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.831 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.831 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.831 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10635 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 740352~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.831 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:10:50.831 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.419194514000001, 2024-09-13T05:10:50.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028229890000000001, 2024-09-13T05:10:50.832 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.832 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.832 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.832 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.832 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.832 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10635 2024-09-13T05:10:50.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.832 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:10:50.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:10:50.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402002+0000", 2024-09-13T05:10:50.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402004+0000", 2024-09-13T05:10:50.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.575e-06 2024-09-13T05:10:50.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402007+0000", 2024-09-13T05:10:50.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1240000000000001e-06 2024-09-13T05:10:50.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402010+0000", 2024-09-13T05:10:50.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5859999999999999e-06 2024-09-13T05:10:50.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430146+0000", 2024-09-13T05:10:50.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028136746000000001 2024-09-13T05:10:50.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430195+0000", 2024-09-13T05:10:50.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8948e-05 2024-09-13T05:10:50.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430232+0000", 2024-09-13T05:10:50.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7159000000000001e-05 2024-09-13T05:10:50.836 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.836 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.836 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.836 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10636 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 749568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.836 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:10:50.836 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.419185408000001, 2024-09-13T05:10:50.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328440999999999, 2024-09-13T05:10:50.836 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.837 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.837 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.837 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.837 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.837 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10636 2024-09-13T05:10:50.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.837 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:10:50.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:10:50.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402011+0000", 2024-09-13T05:10:50.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:50.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402017+0000", 2024-09-13T05:10:50.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5620000000000003e-06 2024-09-13T05:10:50.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402020+0000", 2024-09-13T05:10:50.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1410000000000001e-06 2024-09-13T05:10:50.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402024+0000", 2024-09-13T05:10:50.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4489999999999999e-06 2024-09-13T05:10:50.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430256+0000", 2024-09-13T05:10:50.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028232363 2024-09-13T05:10:50.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430299+0000", 2024-09-13T05:10:50.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2830999999999997e-05 2024-09-13T05:10:50.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430340+0000", 2024-09-13T05:10:50.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1301000000000003e-05 2024-09-13T05:10:50.840 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.840 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.840 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.840 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10637 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 758784~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.841 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:10:50.841 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.419170295000001, 2024-09-13T05:10:50.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028441793, 2024-09-13T05:10:50.841 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.841 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.841 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10637 2024-09-13T05:10:50.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.841 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:10:50.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:10:50.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:10:50.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:50.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402031+0000", 2024-09-13T05:10:50.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6770000000000003e-06 2024-09-13T05:10:50.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402034+0000", 2024-09-13T05:10:50.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1540000000000002e-06 2024-09-13T05:10:50.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402038+0000", 2024-09-13T05:10:50.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4970000000000001e-06 2024-09-13T05:10:50.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430367+0000", 2024-09-13T05:10:50.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328906000000001 2024-09-13T05:10:50.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430416+0000", 2024-09-13T05:10:50.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:10:50.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430469+0000", 2024-09-13T05:10:50.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2284999999999998e-05 2024-09-13T05:10:50.845 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.845 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.845 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.845 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10638 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 768000~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.845 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:10:50.845 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.419156811000001, 2024-09-13T05:10:50.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028548740999999999, 2024-09-13T05:10:50.845 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.845 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.845 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.845 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.845 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.846 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10638 2024-09-13T05:10:50.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.846 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:10:50.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:10:50.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:10:50.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402041+0000", 2024-09-13T05:10:50.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4789999999999999e-06 2024-09-13T05:10:50.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402044+0000", 2024-09-13T05:10:50.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.694e-06 2024-09-13T05:10:50.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402047+0000", 2024-09-13T05:10:50.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.537e-06 2024-09-13T05:10:50.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430494+0000", 2024-09-13T05:10:50.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028447665 2024-09-13T05:10:50.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430544+0000", 2024-09-13T05:10:50.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9539000000000001e-05 2024-09-13T05:10:50.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430589+0000", 2024-09-13T05:10:50.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5071999999999998e-05 2024-09-13T05:10:50.849 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.849 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.849 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.849 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10639 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 777216~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.849 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:10:50.849 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.419146430000001, 2024-09-13T05:10:50.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028651769000000001, 2024-09-13T05:10:50.850 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.850 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.850 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10639 2024-09-13T05:10:50.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.850 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:10:50.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:10:50.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402050+0000", 2024-09-13T05:10:50.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402052+0000", 2024-09-13T05:10:50.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2249999999999999e-06 2024-09-13T05:10:50.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402054+0000", 2024-09-13T05:10:50.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8140000000000001e-06 2024-09-13T05:10:50.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402057+0000", 2024-09-13T05:10:50.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4889999999999998e-06 2024-09-13T05:10:50.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430607+0000", 2024-09-13T05:10:50.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028549896000000002 2024-09-13T05:10:50.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430651+0000", 2024-09-13T05:10:50.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4622000000000001e-05 2024-09-13T05:10:50.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430702+0000", 2024-09-13T05:10:50.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0980999999999999e-05 2024-09-13T05:10:50.853 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.853 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.853 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.854 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11151 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 779264~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.854 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:10:50.854 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.389375148999999, 2024-09-13T05:10:50.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028283188000000001, 2024-09-13T05:10:50.854 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.854 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.854 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11151 2024-09-13T05:10:50.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.854 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:10:50.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:10:50.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:10:50.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431827+0000", 2024-09-13T05:10:50.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0989999999999998e-06 2024-09-13T05:10:50.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431832+0000", 2024-09-13T05:10:50.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8829999999999997e-06 2024-09-13T05:10:50.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431835+0000", 2024-09-13T05:10:50.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.439e-06 2024-09-13T05:10:50.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.459955+0000", 2024-09-13T05:10:50.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028119858000000001 2024-09-13T05:10:50.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.460029+0000", 2024-09-13T05:10:50.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4264000000000006e-05 2024-09-13T05:10:50.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.460105+0000", 2024-09-13T05:10:50.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5906000000000001e-05 2024-09-13T05:10:50.858 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.858 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.858 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.858 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11897 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 579584~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.858 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:10:50.858 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.340225974999999, 2024-09-13T05:10:50.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028193354, 2024-09-13T05:10:50.859 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.859 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.859 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.859 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.859 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.859 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11897 2024-09-13T05:10:50.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.859 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:10:50.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:10:50.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:10:50.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480973+0000", 2024-09-13T05:10:50.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.934e-06 2024-09-13T05:10:50.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480976+0000", 2024-09-13T05:10:50.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.614e-06 2024-09-13T05:10:50.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480980+0000", 2024-09-13T05:10:50.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.377e-06 2024-09-13T05:10:50.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.508967+0000", 2024-09-13T05:10:50.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027987455000000001 2024-09-13T05:10:50.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509074+0000", 2024-09-13T05:10:50.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107379 2024-09-13T05:10:50.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509164+0000", 2024-09-13T05:10:50.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9979e-05 2024-09-13T05:10:50.862 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.862 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.863 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.863 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11898 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 588800~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.863 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:10:50.863 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.340213910999999, 2024-09-13T05:10:50.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028308628999999998, 2024-09-13T05:10:50.863 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.863 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.863 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.863 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.863 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.863 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11898 2024-09-13T05:10:50.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.864 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:10:50.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:10:50.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:10:50.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480984+0000", 2024-09-13T05:10:50.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:10:50.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480988+0000", 2024-09-13T05:10:50.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4640000000000002e-06 2024-09-13T05:10:50.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480991+0000", 2024-09-13T05:10:50.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3469999999999999e-06 2024-09-13T05:10:50.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509199+0000", 2024-09-13T05:10:50.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028207449999999998 2024-09-13T05:10:50.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509250+0000", 2024-09-13T05:10:50.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1375000000000002e-05 2024-09-13T05:10:50.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509292+0000", 2024-09-13T05:10:50.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1730000000000002e-05 2024-09-13T05:10:50.867 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.867 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.867 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.867 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11899 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 598016~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.867 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:10:50.867 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.340203070000001, 2024-09-13T05:10:50.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516703000000001, 2024-09-13T05:10:50.867 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.867 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.867 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.868 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11899 2024-09-13T05:10:50.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.868 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:10:50.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:10:50.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:10:50.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480995+0000", 2024-09-13T05:10:50.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7349999999999999e-06 2024-09-13T05:10:50.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481000+0000", 2024-09-13T05:10:50.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0289999999999996e-06 2024-09-13T05:10:50.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481004+0000", 2024-09-13T05:10:50.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3699999999999999e-06 2024-09-13T05:10:50.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509332+0000", 2024-09-13T05:10:50.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328320000000001 2024-09-13T05:10:50.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509428+0000", 2024-09-13T05:10:50.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6150999999999995e-05 2024-09-13T05:10:50.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509511+0000", 2024-09-13T05:10:50.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2396000000000002e-05 2024-09-13T05:10:50.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.872 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.872 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11900 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 607232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.872 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:10:50.872 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.340190481, 2024-09-13T05:10:50.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028621273999999999, 2024-09-13T05:10:50.872 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.873 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.873 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.873 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.873 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.873 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11900 2024-09-13T05:10:50.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.873 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:10:50.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:10:50.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481006+0000", 2024-09-13T05:10:50.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481008+0000", 2024-09-13T05:10:50.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.73e-06 2024-09-13T05:10:50.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481011+0000", 2024-09-13T05:10:50.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4000000000000001e-06 2024-09-13T05:10:50.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481015+0000", 2024-09-13T05:10:50.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2760000000000001e-06 2024-09-13T05:10:50.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509531+0000", 2024-09-13T05:10:50.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516102000000002 2024-09-13T05:10:50.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509588+0000", 2024-09-13T05:10:50.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7423999999999998e-05 2024-09-13T05:10:50.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509628+0000", 2024-09-13T05:10:50.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9644000000000002e-05 2024-09-13T05:10:50.877 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.877 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.877 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.877 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11901 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 616448~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.877 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:10:50.877 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.340179859999999, 2024-09-13T05:10:50.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028820500999999998, 2024-09-13T05:10:50.877 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.878 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.878 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.878 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.878 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.878 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11901 2024-09-13T05:10:50.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.878 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:10:50.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:10:50.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:10:50.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481022+0000", 2024-09-13T05:10:50.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0209999999999999e-06 2024-09-13T05:10:50.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481026+0000", 2024-09-13T05:10:50.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:10:50.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481029+0000", 2024-09-13T05:10:50.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.636e-06 2024-09-13T05:10:50.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509661+0000", 2024-09-13T05:10:50.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028631496999999999 2024-09-13T05:10:50.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509757+0000", 2024-09-13T05:10:50.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5780999999999997e-05 2024-09-13T05:10:50.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509838+0000", 2024-09-13T05:10:50.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1102999999999999e-05 2024-09-13T05:10:50.882 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.882 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.882 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.882 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11902 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 625664~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.882 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:10:50.882 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.340157997999999, 2024-09-13T05:10:50.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028894265999999998, 2024-09-13T05:10:50.883 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.883 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.883 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.883 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.883 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.883 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11902 2024-09-13T05:10:50.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.883 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:10:50.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:10:50.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:10:50.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481041+0000", 2024-09-13T05:10:50.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8020000000000001e-06 2024-09-13T05:10:50.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481044+0000", 2024-09-13T05:10:50.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7110000000000001e-06 2024-09-13T05:10:50.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481048+0000", 2024-09-13T05:10:50.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.411e-06 2024-09-13T05:10:50.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509851+0000", 2024-09-13T05:10:50.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028803295 2024-09-13T05:10:50.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509896+0000", 2024-09-13T05:10:50.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4963000000000003e-05 2024-09-13T05:10:50.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509933+0000", 2024-09-13T05:10:50.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7384e-05 2024-09-13T05:10:50.887 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.887 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.887 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.887 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11903 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 634880~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.887 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:10:50.887 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.340146762, 2024-09-13T05:10:50.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029118033000000001, 2024-09-13T05:10:50.887 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.887 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.888 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11903 2024-09-13T05:10:50.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.888 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:10:50.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:10:50.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:10:50.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481052+0000", 2024-09-13T05:10:50.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.581e-06 2024-09-13T05:10:50.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481055+0000", 2024-09-13T05:10:50.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4520000000000002e-06 2024-09-13T05:10:50.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481058+0000", 2024-09-13T05:10:50.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4599999999999999e-06 2024-09-13T05:10:50.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509967+0000", 2024-09-13T05:10:50.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028908257999999999 2024-09-13T05:10:50.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510062+0000", 2024-09-13T05:10:50.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5613999999999996e-05 2024-09-13T05:10:50.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510168+0000", 2024-09-13T05:10:50.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105951 2024-09-13T05:10:50.891 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.891 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.891 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.891 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11904 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 644096~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.891 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:10:50.891 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.340135867000001, 2024-09-13T05:10:50.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029301971, 2024-09-13T05:10:50.891 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.892 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.892 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.892 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.892 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.892 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11904 2024-09-13T05:10:50.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.892 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:10:50.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:10:50.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:10:50.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481063+0000", 2024-09-13T05:10:50.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6700000000000001e-06 2024-09-13T05:10:50.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481068+0000", 2024-09-13T05:10:50.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4519999999999996e-06 2024-09-13T05:10:50.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481074+0000", 2024-09-13T05:10:50.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8370000000000002e-06 2024-09-13T05:10:50.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510197+0000", 2024-09-13T05:10:50.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029123237999999999 2024-09-13T05:10:50.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510285+0000", 2024-09-13T05:10:50.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7676000000000006e-05 2024-09-13T05:10:50.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510363+0000", 2024-09-13T05:10:50.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8418999999999996e-05 2024-09-13T05:10:50.899 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.899 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.899 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.899 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11905 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 653312~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.899 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:10:50.899 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.340120126999999, 2024-09-13T05:10:50.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029480164, 2024-09-13T05:10:50.899 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.900 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.900 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11905 2024-09-13T05:10:50.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.900 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:10:50.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:10:50.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481076+0000", 2024-09-13T05:10:50.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481079+0000", 2024-09-13T05:10:50.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9629999999999998e-06 2024-09-13T05:10:50.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481087+0000", 2024-09-13T05:10:50.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6369999999999999e-06 2024-09-13T05:10:50.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481093+0000", 2024-09-13T05:10:50.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.857e-06 2024-09-13T05:10:50.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510408+0000", 2024-09-13T05:10:50.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029315213 2024-09-13T05:10:50.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510501+0000", 2024-09-13T05:10:50.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2916000000000003e-05 2024-09-13T05:10:50.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510557+0000", 2024-09-13T05:10:50.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6063999999999997e-05 2024-09-13T05:10:50.904 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.904 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.904 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.904 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11906 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 662528~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.904 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:10:50.904 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.340078114000001, 2024-09-13T05:10:50.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029575054999999999, 2024-09-13T05:10:50.904 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.905 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.905 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.905 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.905 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.905 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11906 2024-09-13T05:10:50.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.905 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:10:50.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:10:50.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481118+0000", 2024-09-13T05:10:50.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481122+0000", 2024-09-13T05:10:50.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2610000000000002e-06 2024-09-13T05:10:50.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481129+0000", 2024-09-13T05:10:50.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0079999999999996e-06 2024-09-13T05:10:50.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481135+0000", 2024-09-13T05:10:50.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0599999999999996e-06 2024-09-13T05:10:50.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510575+0000", 2024-09-13T05:10:50.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029440470999999999 2024-09-13T05:10:50.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510635+0000", 2024-09-13T05:10:50.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0177000000000003e-05 2024-09-13T05:10:50.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510694+0000", 2024-09-13T05:10:50.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8675999999999999e-05 2024-09-13T05:10:50.908 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.908 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.908 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.909 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11907 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 671744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.909 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:10:50.909 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.339817319000002, 2024-09-13T05:10:50.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029479490000000001, 2024-09-13T05:10:50.909 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.909 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.909 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.909 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.909 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.909 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11907 2024-09-13T05:10:50.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.910 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:10:50.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:10:50.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481140+0000", 2024-09-13T05:10:50.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997597 2024-09-13T05:10:50.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481383+0000", 2024-09-13T05:10:50.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024355399999999999 2024-09-13T05:10:50.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481390+0000", 2024-09-13T05:10:50.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3599999999999998e-06 2024-09-13T05:10:50.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481395+0000", 2024-09-13T05:10:50.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8940000000000001e-06 2024-09-13T05:10:50.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510722+0000", 2024-09-13T05:10:50.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029327143999999999 2024-09-13T05:10:50.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510802+0000", 2024-09-13T05:10:50.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9770000000000004e-05 2024-09-13T05:10:50.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510859+0000", 2024-09-13T05:10:50.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6957999999999999e-05 2024-09-13T05:10:50.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.914 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.914 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11908 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 680960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.914 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:10:50.914 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.339797405999999, 2024-09-13T05:10:50.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029617622, 2024-09-13T05:10:50.914 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.914 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.914 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.914 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.915 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11908 2024-09-13T05:10:50.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.915 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:10:50.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:10:50.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481399+0000", 2024-09-13T05:10:50.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481401+0000", 2024-09-13T05:10:50.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8729999999999999e-06 2024-09-13T05:10:50.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481413+0000", 2024-09-13T05:10:50.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1748e-05 2024-09-13T05:10:50.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481417+0000", 2024-09-13T05:10:50.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:10:50.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510908+0000", 2024-09-13T05:10:50.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029491129000000001 2024-09-13T05:10:50.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510955+0000", 2024-09-13T05:10:50.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7188000000000003e-05 2024-09-13T05:10:50.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511017+0000", 2024-09-13T05:10:50.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2288999999999999e-05 2024-09-13T05:10:50.918 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.918 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.918 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.918 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11909 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 690176~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:10:50.918 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:10:50.918 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.339777079000001, 2024-09-13T05:10:50.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029780699000000001, 2024-09-13T05:10:50.919 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:50.919 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:50.919 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:50.919 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:50.919 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:50.919 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11909 2024-09-13T05:10:50.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.919 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:50.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:50.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:10:50.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:50.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:10:50.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:50.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:50.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481419+0000", 2024-09-13T05:10:50.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:50.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:50.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481421+0000", 2024-09-13T05:10:50.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.035e-06 2024-09-13T05:10:50.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:50.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481427+0000", 2024-09-13T05:10:50.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2449999999999998e-06 2024-09-13T05:10:50.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:50.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481430+0000", 2024-09-13T05:10:50.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.366e-06 2024-09-13T05:10:50.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:50.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511064+0000", 2024-09-13T05:10:50.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029633711 2024-09-13T05:10:50.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:50.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511160+0000", 2024-09-13T05:10:50.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6399999999999999e-05 2024-09-13T05:10:50.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:50.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:50.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:50.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511201+0000", 2024-09-13T05:10:50.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0448000000000003e-05 2024-09-13T05:10:50.922 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.922 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.922 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.923 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:50.923 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:50.923 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:50.924 INFO:teuthology.orchestra.run.smithi120.stdout:1507 punch from 0xd8760ae to 0xd87a16b, (0x40bd bytes) 2024-09-13T05:10:50.924 INFO:teuthology.orchestra.run.smithi120.stdout:1508 punch from 0x83a970a to 0x83b3b50, (0xa446 bytes) 2024-09-13T05:10:50.924 INFO:teuthology.orchestra.run.smithi120.stdout:1509 write 0x7e9f802 thru 0x7ea462f (0x4e2e bytes) 2024-09-13T05:10:50.925 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:10:50.926 INFO:teuthology.orchestra.run.smithi120.stdout:1515 read 0xe1c0430 thru 0xe1c1d1d (0x18ee bytes) 2024-09-13T05:10:50.926 INFO:teuthology.orchestra.run.smithi120.stdout:1516 trunc from 0xe9d3837 to 0x9146930 2024-09-13T05:10:50.926 INFO:teuthology.orchestra.run.smithi120.stdout:1517 read 0x4b283e thru 0x4b807e (0x5841 bytes) 2024-09-13T05:10:50.926 INFO:teuthology.orchestra.run.smithi120.stdout:1518 writesame 0xd86551c thru 0xd86b2d9 data_size 0x47(0x5dbe bytes) 2024-09-13T05:10:50.926 INFO:teuthology.orchestra.run.smithi120.stdout:1520 flatten 2024-09-13T05:10:50.927 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:50.918+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:50.972 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is unset 2024-09-13T05:10:51.025 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:51.017+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:51.079 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:10:51.079 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:51.090 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:10:51.126 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:51.122+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:51.195 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:51.195 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:51.195 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:51.195 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:51.195 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:51.205 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:10:51.249 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:51.245+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:51.310 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:51.310 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:51.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:51.310 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:51.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26335 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1207296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:10:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.575849353000001, 2024-09-13T05:10:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055338125000000002, 2024-09-13T05:10:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26335 2024-09-13T05:10:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:10:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:10:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730550+0000", 2024-09-13T05:10:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998579 2024-09-13T05:10:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730705+0000", 2024-09-13T05:10:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015463400000000001 2024-09-13T05:10:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730713+0000", 2024-09-13T05:10:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1580000000000005e-06 2024-09-13T05:10:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730719+0000", 2024-09-13T05:10:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2740000000000004e-06 2024-09-13T05:10:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.785798+0000", 2024-09-13T05:10:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055079454 2024-09-13T05:10:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.785894+0000", 2024-09-13T05:10:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5896000000000005e-05 2024-09-13T05:10:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.786030+0000", 2024-09-13T05:10:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013586199999999999 2024-09-13T05:10:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26346 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1308672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:10:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.573707946000001, 2024-09-13T05:10:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055416737000000001, 2024-09-13T05:10:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26346 2024-09-13T05:10:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:10:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:10:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732833+0000", 2024-09-13T05:10:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732835+0000", 2024-09-13T05:10:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3719999999999999e-06 2024-09-13T05:10:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732839+0000", 2024-09-13T05:10:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1520000000000001e-06 2024-09-13T05:10:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732842+0000", 2024-09-13T05:10:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.061e-06 2024-09-13T05:10:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788126+0000", 2024-09-13T05:10:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055284489999999999 2024-09-13T05:10:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788183+0000", 2024-09-13T05:10:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7127999999999999e-05 2024-09-13T05:10:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788250+0000", 2024-09-13T05:10:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7001000000000004e-05 2024-09-13T05:10:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26348 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 800768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:10:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.573285122, 2024-09-13T05:10:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055321395000000002, 2024-09-13T05:10:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26348 2024-09-13T05:10:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:10:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:10:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733127+0000", 2024-09-13T05:10:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998703 2024-09-13T05:10:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733262+0000", 2024-09-13T05:10:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013484400000000001 2024-09-13T05:10:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733273+0000", 2024-09-13T05:10:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1824000000000001e-05 2024-09-13T05:10:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733281+0000", 2024-09-13T05:10:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9999999999999996e-06 2024-09-13T05:10:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788431+0000", 2024-09-13T05:10:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055149535 2024-09-13T05:10:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788490+0000", 2024-09-13T05:10:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9413999999999997e-05 2024-09-13T05:10:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788578+0000", 2024-09-13T05:10:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7418999999999998e-05 2024-09-13T05:10:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.325 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.325 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26368 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 985088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:51.325 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:10:51.325 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.569132925, 2024-09-13T05:10:51.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055320511000000003, 2024-09-13T05:10:51.325 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.325 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.325 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.325 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.325 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.326 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26368 2024-09-13T05:10:51.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.326 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:10:51.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:10:51.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737408+0000", 2024-09-13T05:10:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737412+0000", 2024-09-13T05:10:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6279999999999998e-06 2024-09-13T05:10:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737419+0000", 2024-09-13T05:10:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1770000000000001e-06 2024-09-13T05:10:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737425+0000", 2024-09-13T05:10:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6949999999999997e-06 2024-09-13T05:10:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792507+0000", 2024-09-13T05:10:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055082840000000001 2024-09-13T05:10:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792606+0000", 2024-09-13T05:10:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8697999999999996e-05 2024-09-13T05:10:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792729+0000", 2024-09-13T05:10:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012298499999999999 2024-09-13T05:10:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26417 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 903168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:10:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.565072665000001, 2024-09-13T05:10:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055375191999999997, 2024-09-13T05:10:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26417 2024-09-13T05:10:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:10:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:10:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741468+0000", 2024-09-13T05:10:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741472+0000", 2024-09-13T05:10:51.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4139999999999998e-06 2024-09-13T05:10:51.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741478+0000", 2024-09-13T05:10:51.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5230000000000001e-06 2024-09-13T05:10:51.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741483+0000", 2024-09-13T05:10:51.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8559999999999998e-06 2024-09-13T05:10:51.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796655+0000", 2024-09-13T05:10:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055172153000000002 2024-09-13T05:10:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796738+0000", 2024-09-13T05:10:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2912999999999997e-05 2024-09-13T05:10:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796844+0000", 2024-09-13T05:10:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105802 2024-09-13T05:10:51.335 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.335 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.335 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.335 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26419 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 912384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:51.335 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:10:51.335 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.5650488, 2024-09-13T05:10:51.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055570469999999997, 2024-09-13T05:10:51.335 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.335 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.335 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.335 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26419 2024-09-13T05:10:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:10:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:10:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741492+0000", 2024-09-13T05:10:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741495+0000", 2024-09-13T05:10:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6369999999999999e-06 2024-09-13T05:10:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741508+0000", 2024-09-13T05:10:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3319000000000001e-05 2024-09-13T05:10:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741527+0000", 2024-09-13T05:10:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8542e-05 2024-09-13T05:10:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796871+0000", 2024-09-13T05:10:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055344474999999997 2024-09-13T05:10:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796967+0000", 2024-09-13T05:10:51.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5963000000000003e-05 2024-09-13T05:10:51.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797063+0000", 2024-09-13T05:10:51.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5909999999999995e-05 2024-09-13T05:10:51.339 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.339 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.339 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26421 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 921600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:10:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.565005497, 2024-09-13T05:10:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055631152000000003, 2024-09-13T05:10:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26421 2024-09-13T05:10:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:10:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:10:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741535+0000", 2024-09-13T05:10:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741540+0000", 2024-09-13T05:10:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1690000000000002e-06 2024-09-13T05:10:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741547+0000", 2024-09-13T05:10:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3409999999999997e-06 2024-09-13T05:10:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741552+0000", 2024-09-13T05:10:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5639999999999996e-06 2024-09-13T05:10:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797079+0000", 2024-09-13T05:10:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055526038999999999 2024-09-13T05:10:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797121+0000", 2024-09-13T05:10:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2156000000000001e-05 2024-09-13T05:10:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797167+0000", 2024-09-13T05:10:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6445e-05 2024-09-13T05:10:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26423 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 930816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:10:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.564612503999999, 2024-09-13T05:10:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055364370000000003, 2024-09-13T05:10:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26423 2024-09-13T05:10:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:10:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:10:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741928+0000", 2024-09-13T05:10:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741933+0000", 2024-09-13T05:10:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9980000000000003e-06 2024-09-13T05:10:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741945+0000", 2024-09-13T05:10:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1761e-05 2024-09-13T05:10:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741958+0000", 2024-09-13T05:10:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2604e-05 2024-09-13T05:10:51.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797185+0000", 2024-09-13T05:10:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055227169 2024-09-13T05:10:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797226+0000", 2024-09-13T05:10:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1619000000000003e-05 2024-09-13T05:10:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797293+0000", 2024-09-13T05:10:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6952999999999994e-05 2024-09-13T05:10:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26424 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 940032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:10:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.564575567, 2024-09-13T05:10:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055448669999999999, 2024-09-13T05:10:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26424 2024-09-13T05:10:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:10:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:10:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741965+0000", 2024-09-13T05:10:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741969+0000", 2024-09-13T05:10:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3440000000000001e-06 2024-09-13T05:10:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741983+0000", 2024-09-13T05:10:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4600000000000001e-05 2024-09-13T05:10:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741989+0000", 2024-09-13T05:10:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5350000000000004e-06 2024-09-13T05:10:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797319+0000", 2024-09-13T05:10:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055330121000000003 2024-09-13T05:10:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797364+0000", 2024-09-13T05:10:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5670000000000002e-05 2024-09-13T05:10:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797415+0000", 2024-09-13T05:10:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0124000000000003e-05 2024-09-13T05:10:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26426 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 949248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:10:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.564548368000001, 2024-09-13T05:10:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055639981999999998, 2024-09-13T05:10:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26426 2024-09-13T05:10:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:10:51.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:10:51.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:10:51.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:51.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741995+0000", 2024-09-13T05:10:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.661e-06 2024-09-13T05:10:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742004+0000", 2024-09-13T05:10:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2009999999999999e-06 2024-09-13T05:10:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742008+0000", 2024-09-13T05:10:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7890000000000002e-06 2024-09-13T05:10:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797432+0000", 2024-09-13T05:10:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055423448 2024-09-13T05:10:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797516+0000", 2024-09-13T05:10:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4404e-05 2024-09-13T05:10:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797633+0000", 2024-09-13T05:10:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116898 2024-09-13T05:10:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26427 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 958464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:10:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.564528312, 2024-09-13T05:10:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055829295000000001, 2024-09-13T05:10:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26427 2024-09-13T05:10:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:10:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:10:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:10:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742015+0000", 2024-09-13T05:10:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.74e-06 2024-09-13T05:10:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742023+0000", 2024-09-13T05:10:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7039999999999994e-06 2024-09-13T05:10:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742028+0000", 2024-09-13T05:10:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7369999999999997e-06 2024-09-13T05:10:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797666+0000", 2024-09-13T05:10:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055637820999999997 2024-09-13T05:10:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797748+0000", 2024-09-13T05:10:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1787999999999997e-05 2024-09-13T05:10:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797842+0000", 2024-09-13T05:10:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4903999999999998e-05 2024-09-13T05:10:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26432 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 976896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:10:51.364 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.563735150999999, 2024-09-13T05:10:51.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055402077000000001, 2024-09-13T05:10:51.364 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.364 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.364 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.364 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.364 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.364 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26432 2024-09-13T05:10:51.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.364 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:10:51.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:10:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:10:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742808+0000", 2024-09-13T05:10:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3319999999999999e-06 2024-09-13T05:10:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742818+0000", 2024-09-13T05:10:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5380000000000008e-06 2024-09-13T05:10:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742821+0000", 2024-09-13T05:10:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2179999999999999e-06 2024-09-13T05:10:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798027+0000", 2024-09-13T05:10:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055206344999999997 2024-09-13T05:10:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798103+0000", 2024-09-13T05:10:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5786999999999998e-05 2024-09-13T05:10:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798208+0000", 2024-09-13T05:10:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010521700000000001 2024-09-13T05:10:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26434 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 986112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:10:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.563717927000001, 2024-09-13T05:10:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055610109999999997, 2024-09-13T05:10:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26434 2024-09-13T05:10:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:10:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:10:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742823+0000", 2024-09-13T05:10:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:10:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742825+0000", 2024-09-13T05:10:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6220000000000001e-06 2024-09-13T05:10:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742828+0000", 2024-09-13T05:10:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.926e-06 2024-09-13T05:10:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742831+0000", 2024-09-13T05:10:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-13T05:10:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798239+0000", 2024-09-13T05:10:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055408254999999997 2024-09-13T05:10:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798326+0000", 2024-09-13T05:10:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7168000000000003e-05 2024-09-13T05:10:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798434+0000", 2024-09-13T05:10:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010767100000000001 2024-09-13T05:10:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26442 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1032192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:10:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.562448587, 2024-09-13T05:10:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055422776, 2024-09-13T05:10:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26442 2024-09-13T05:10:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:10:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:10:51.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744061+0000", 2024-09-13T05:10:51.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999685 2024-09-13T05:10:51.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744096+0000", 2024-09-13T05:10:51.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4771999999999998e-05 2024-09-13T05:10:51.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744147+0000", 2024-09-13T05:10:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0696999999999999e-05 2024-09-13T05:10:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744154+0000", 2024-09-13T05:10:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8510000000000001e-06 2024-09-13T05:10:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799324+0000", 2024-09-13T05:10:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055170074999999999 2024-09-13T05:10:51.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799415+0000", 2024-09-13T05:10:51.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1197000000000001e-05 2024-09-13T05:10:51.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799516+0000", 2024-09-13T05:10:51.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100666 2024-09-13T05:10:51.377 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.377 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.377 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.378 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26443 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1041408~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:51.378 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:10:51.378 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.562168015999999, 2024-09-13T05:10:51.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055344195999999998, 2024-09-13T05:10:51.378 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.378 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.378 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.378 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.378 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.378 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26443 2024-09-13T05:10:51.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.378 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:10:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:10:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744159+0000", 2024-09-13T05:10:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997849 2024-09-13T05:10:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744379+0000", 2024-09-13T05:10:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022024800000000001 2024-09-13T05:10:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744390+0000", 2024-09-13T05:10:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1105e-05 2024-09-13T05:10:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744397+0000", 2024-09-13T05:10:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2740000000000002e-06 2024-09-13T05:10:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799543+0000", 2024-09-13T05:10:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055145441000000003 2024-09-13T05:10:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799619+0000", 2024-09-13T05:10:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6660000000000001e-05 2024-09-13T05:10:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799718+0000", 2024-09-13T05:10:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8331000000000004e-05 2024-09-13T05:10:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26547 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1318912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:10:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.561981698, 2024-09-13T05:10:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055355834, 2024-09-13T05:10:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26547 2024-09-13T05:10:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:10:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:10:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744404+0000", 2024-09-13T05:10:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998441 2024-09-13T05:10:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744564+0000", 2024-09-13T05:10:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016022200000000001 2024-09-13T05:10:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744579+0000", 2024-09-13T05:10:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5036e-05 2024-09-13T05:10:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744585+0000", 2024-09-13T05:10:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7880000000000003e-06 2024-09-13T05:10:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799747+0000", 2024-09-13T05:10:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055161804000000002 2024-09-13T05:10:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799823+0000", 2024-09-13T05:10:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5956000000000003e-05 2024-09-13T05:10:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799916+0000", 2024-09-13T05:10:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2733999999999997e-05 2024-09-13T05:10:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26550 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1328128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:10:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.561725538999999, 2024-09-13T05:10:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055315941, 2024-09-13T05:10:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26550 2024-09-13T05:10:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:10:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:10:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744591+0000", 2024-09-13T05:10:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997745 2024-09-13T05:10:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744821+0000", 2024-09-13T05:10:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023031899999999999 2024-09-13T05:10:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744833+0000", 2024-09-13T05:10:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1919000000000001e-05 2024-09-13T05:10:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744837+0000", 2024-09-13T05:10:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4989999999999996e-06 2024-09-13T05:10:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799947+0000", 2024-09-13T05:10:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055110120999999998 2024-09-13T05:10:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800030+0000", 2024-09-13T05:10:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2905999999999995e-05 2024-09-13T05:10:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800132+0000", 2024-09-13T05:10:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101529 2024-09-13T05:10:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26558 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1364992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:10:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.560990532, 2024-09-13T05:10:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055422765999999998, 2024-09-13T05:10:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26558 2024-09-13T05:10:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.392 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:10:51.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:10:51.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745550+0000", 2024-09-13T05:10:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745553+0000", 2024-09-13T05:10:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7690000000000001e-06 2024-09-13T05:10:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745559+0000", 2024-09-13T05:10:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3149999999999997e-06 2024-09-13T05:10:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745564+0000", 2024-09-13T05:10:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6670000000000004e-06 2024-09-13T05:10:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800791+0000", 2024-09-13T05:10:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055226711999999997 2024-09-13T05:10:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800865+0000", 2024-09-13T05:10:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4344000000000005e-05 2024-09-13T05:10:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800974+0000", 2024-09-13T05:10:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108606 2024-09-13T05:10:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26561 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1374208~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:10:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.560973478999999, 2024-09-13T05:10:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055549315000000002, 2024-09-13T05:10:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26561 2024-09-13T05:10:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:10:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:10:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:10:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745570+0000", 2024-09-13T05:10:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4719999999999998e-06 2024-09-13T05:10:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745575+0000", 2024-09-13T05:10:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1900000000000003e-06 2024-09-13T05:10:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745579+0000", 2024-09-13T05:10:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3250000000000001e-06 2024-09-13T05:10:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801000+0000", 2024-09-13T05:10:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055420432999999998 2024-09-13T05:10:51.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801061+0000", 2024-09-13T05:10:51.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1427000000000007e-05 2024-09-13T05:10:51.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801117+0000", 2024-09-13T05:10:51.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5933000000000001e-05 2024-09-13T05:10:51.399 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.399 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.399 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26582 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1447936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:10:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:10:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.559555839, 2024-09-13T05:10:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055394301, 2024-09-13T05:10:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26582 2024-09-13T05:10:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:10:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:10:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746985+0000", 2024-09-13T05:10:51.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:51.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746988+0000", 2024-09-13T05:10:51.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6479999999999999e-06 2024-09-13T05:10:51.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.747000+0000", 2024-09-13T05:10:51.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2009e-05 2024-09-13T05:10:51.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.747005+0000", 2024-09-13T05:10:51.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0039999999999999e-06 2024-09-13T05:10:51.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802232+0000", 2024-09-13T05:10:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055227762999999999 2024-09-13T05:10:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802320+0000", 2024-09-13T05:10:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7576000000000003e-05 2024-09-13T05:10:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802380+0000", 2024-09-13T05:10:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9888e-05 2024-09-13T05:10:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.405 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.405 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.405 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.405 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.405 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:51.406 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:10:51.407 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:51.402+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:51.507 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:51.501+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:51.526 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:51.526 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:51.526 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:10:51.526 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:51.538 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:10:51.554 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:51.554 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:51.554 INFO:teuthology.orchestra.run.smithi120.stdout:1523 write 0x8e39ac0 thru 0x8e45af3 (0xc034 bytes) 2024-09-13T05:10:51.561 INFO:teuthology.orchestra.run.smithi120.stdout:1524 write 0xd7bbc33 thru 0xd7c0c48 (0x5016 bytes) 2024-09-13T05:10:51.568 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:51.577 INFO:teuthology.orchestra.run.smithi120.stdout:1531 write 0xe4c7177 thru 0xe4c8ead (0x1d37 bytes) 2024-09-13T05:10:51.584 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:51.585 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:51.585 INFO:teuthology.orchestra.run.smithi120.stdout:1537 punch from 0x990f510 to 0x990f55f, (0x4f bytes) 2024-09-13T05:10:51.600 INFO:teuthology.orchestra.run.smithi120.stdout:1538 trunc from 0xe4c8eae to 0x5dd92a0 2024-09-13T05:10:51.607 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:51.601+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:51.626 INFO:teuthology.orchestra.run.smithi120.stdout:1540 trunc from 0x5dd92a0 to 0x9936b56 2024-09-13T05:10:51.637 INFO:teuthology.orchestra.run.smithi120.stdout:1541 write 0x44f7118 thru 0x4503902 (0xc7eb bytes) 2024-09-13T05:10:51.653 INFO:teuthology.orchestra.run.smithi120.stdout:1542 trunc from 0x9936b56 to 0xd6e7913 2024-09-13T05:10:51.663 INFO:teuthology.orchestra.run.smithi120.stdout:1544 write 0xae42c81 thru 0xae4b2af (0x862f bytes) 2024-09-13T05:10:51.669 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:51.669 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:51.669 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:51.669 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:51.669 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:51.671 INFO:teuthology.orchestra.run.smithi120.stdout:1546 read 0x60262f0 thru 0x60349c8 (0xe6d9 bytes) 2024-09-13T05:10:51.684 INFO:teuthology.orchestra.run.smithi120.stdout:1548 trunc from 0xd6e7913 to 0x54c5349 2024-09-13T05:10:51.687 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:10:51.703 INFO:teuthology.orchestra.run.smithi120.stdout:1549 read 0xe42a0f thru 0xe43ac3 (0x10b5 bytes) 2024-09-13T05:10:51.705 INFO:teuthology.orchestra.run.smithi120.stdout:1551 read 0x530d7f4 thru 0x53162ae (0x8abb bytes) 2024-09-13T05:10:51.723 INFO:teuthology.orchestra.run.smithi120.stdout:1552 write 0x9a12021 thru 0x9a1d27a (0xb25a bytes) 2024-09-13T05:10:51.724 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:51.717+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:51.731 INFO:teuthology.orchestra.run.smithi120.stdout:1553 write 0x6f40a31 thru 0x6f435e0 (0x2bb0 bytes) 2024-09-13T05:10:51.759 INFO:teuthology.orchestra.run.smithi120.stdout:1556 writesame 0xeb03ca2 thru 0xeb0db75 data_size 0x6b(0x9ed4 bytes) 2024-09-13T05:10:51.760 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:51.760 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:51.760 INFO:teuthology.orchestra.run.smithi120.stdout:1559 write 0x5b82968 thru 0x5b8fda3 (0xd43c bytes) 2024-09-13T05:10:51.768 INFO:teuthology.orchestra.run.smithi120.stdout:1560 read 0xbbec319 thru 0xbbec6d8 (0x3c0 bytes) 2024-09-13T05:10:51.768 INFO:teuthology.orchestra.run.smithi120.stdout:1562 write 0x4973063 thru 0x49738a2 (0x840 bytes) 2024-09-13T05:10:51.774 INFO:teuthology.orchestra.run.smithi120.stdout:1563 clone 15 order 19 su 131072 sc 7 2024-09-13T05:10:51.809 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:51.806+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:51.817 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2037 3.8 3:1349be29:::rbd_data.112d872fd67a.000000000000003b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.108522+0000", 2024-09-13T05:10:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.704975522000002, 2024-09-13T05:10:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016880821000000001, 2024-09-13T05:10:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2037 2024-09-13T05:10:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108522+0000", 2024-09-13T05:10:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108522+0000", 2024-09-13T05:10:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108521+0000", 2024-09-13T05:10:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108527+0000", 2024-09-13T05:10:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0460000000000002e-06 2024-09-13T05:10:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108538+0000", 2024-09-13T05:10:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0891e-05 2024-09-13T05:10:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108548+0000", 2024-09-13T05:10:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9159999999999996e-06 2024-09-13T05:10:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108595+0000", 2024-09-13T05:10:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7107000000000001e-05 2024-09-13T05:10:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108692+0000", 2024-09-13T05:10:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6824999999999995e-05 2024-09-13T05:10:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.111425+0000", 2024-09-13T05:10:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027337110000000002 2024-09-13T05:10:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125249+0000", 2024-09-13T05:10:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013823521 2024-09-13T05:10:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125265+0000", 2024-09-13T05:10:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6257e-05 2024-09-13T05:10:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125347+0000", 2024-09-13T05:10:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1321000000000003e-05 2024-09-13T05:10:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125403+0000", 2024-09-13T05:10:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6362e-05 2024-09-13T05:10:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2947 3.b 3:d32df763:::rbd_data.112d872fd67a.000000000000006b:head [stat,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.921206+0000", 2024-09-13T05:10:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.892291308000001, 2024-09-13T05:10:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095406580000000005, 2024-09-13T05:10:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2947 2024-09-13T05:10:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921206+0000", 2024-09-13T05:10:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921206+0000", 2024-09-13T05:10:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921205+0000", 2024-09-13T05:10:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921212+0000", 2024-09-13T05:10:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3300000000000001e-06 2024-09-13T05:10:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921232+0000", 2024-09-13T05:10:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9601000000000001e-05 2024-09-13T05:10:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921241+0000", 2024-09-13T05:10:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3230000000000004e-06 2024-09-13T05:10:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921297+0000", 2024-09-13T05:10:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5849e-05 2024-09-13T05:10:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921456+0000", 2024-09-13T05:10:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015864899999999999 2024-09-13T05:10:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.930747+0000", 2024-09-13T05:10:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092911450000000007 2024-09-13T05:10:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4911 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2801664~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.800434+0000", 2024-09-13T05:10:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.013063599999999, 2024-09-13T05:10:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096311120000000007, 2024-09-13T05:10:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4911 2024-09-13T05:10:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800434+0000", 2024-09-13T05:10:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800434+0000", 2024-09-13T05:10:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800433+0000", 2024-09-13T05:10:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800441+0000", 2024-09-13T05:10:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4699999999999996e-06 2024-09-13T05:10:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800450+0000", 2024-09-13T05:10:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6030000000000005e-06 2024-09-13T05:10:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800455+0000", 2024-09-13T05:10:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6019999999999999e-06 2024-09-13T05:10:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802738+0000", 2024-09-13T05:10:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022825089999999998 2024-09-13T05:10:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802849+0000", 2024-09-13T05:10:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110849 2024-09-13T05:10:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810065+0000", 2024-09-13T05:10:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072166419999999997 2024-09-13T05:10:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5028 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 1916928~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.801977+0000", 2024-09-13T05:10:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.011521058, 2024-09-13T05:10:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092754559999999996, 2024-09-13T05:10:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5028 2024-09-13T05:10:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801977+0000", 2024-09-13T05:10:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801977+0000", 2024-09-13T05:10:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801976+0000", 2024-09-13T05:10:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801979+0000", 2024-09-13T05:10:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.813e-06 2024-09-13T05:10:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801985+0000", 2024-09-13T05:10:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6640000000000003e-06 2024-09-13T05:10:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801989+0000", 2024-09-13T05:10:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5759999999999999e-06 2024-09-13T05:10:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810910+0000", 2024-09-13T05:10:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089204430000000001 2024-09-13T05:10:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811176+0000", 2024-09-13T05:10:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026676100000000002 2024-09-13T05:10:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811252+0000", 2024-09-13T05:10:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5655000000000007e-05 2024-09-13T05:10:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5030 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 1523712~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.801994+0000", 2024-09-13T05:10:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.011503908000002, 2024-09-13T05:10:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094030090000000004, 2024-09-13T05:10:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5030 2024-09-13T05:10:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801994+0000", 2024-09-13T05:10:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801994+0000", 2024-09-13T05:10:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801993+0000", 2024-09-13T05:10:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801997+0000", 2024-09-13T05:10:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2650000000000001e-06 2024-09-13T05:10:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802002+0000", 2024-09-13T05:10:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7389999999999996e-06 2024-09-13T05:10:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802007+0000", 2024-09-13T05:10:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5419999999999999e-06 2024-09-13T05:10:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811276+0000", 2024-09-13T05:10:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092691330000000006 2024-09-13T05:10:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811341+0000", 2024-09-13T05:10:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5028000000000001e-05 2024-09-13T05:10:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811397+0000", 2024-09-13T05:10:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5699000000000003e-05 2024-09-13T05:10:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5033 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2113536~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802011+0000", 2024-09-13T05:10:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.011486560000002, 2024-09-13T05:10:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095360380000000002, 2024-09-13T05:10:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5033 2024-09-13T05:10:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802011+0000", 2024-09-13T05:10:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802011+0000", 2024-09-13T05:10:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802011+0000", 2024-09-13T05:10:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802013+0000", 2024-09-13T05:10:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.131e-06 2024-09-13T05:10:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802019+0000", 2024-09-13T05:10:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8799999999999996e-06 2024-09-13T05:10:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802023+0000", 2024-09-13T05:10:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6829999999999999e-06 2024-09-13T05:10:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811423+0000", 2024-09-13T05:10:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093992139999999995 2024-09-13T05:10:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811475+0000", 2024-09-13T05:10:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2000999999999999e-05 2024-09-13T05:10:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811547+0000", 2024-09-13T05:10:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2465000000000005e-05 2024-09-13T05:10:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5036 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2703360~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802028+0000", 2024-09-13T05:10:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.011470107000001, 2024-09-13T05:10:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096685629999999998, 2024-09-13T05:10:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5036 2024-09-13T05:10:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802028+0000", 2024-09-13T05:10:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802028+0000", 2024-09-13T05:10:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802027+0000", 2024-09-13T05:10:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802030+0000", 2024-09-13T05:10:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3329999999999999e-06 2024-09-13T05:10:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802036+0000", 2024-09-13T05:10:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5610000000000004e-06 2024-09-13T05:10:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802041+0000", 2024-09-13T05:10:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9309999999999999e-06 2024-09-13T05:10:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811568+0000", 2024-09-13T05:10:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095272369999999992 2024-09-13T05:10:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811624+0000", 2024-09-13T05:10:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5673e-05 2024-09-13T05:10:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811696+0000", 2024-09-13T05:10:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2187999999999994e-05 2024-09-13T05:10:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5041 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2310144~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802046+0000", 2024-09-13T05:10:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.011451974, 2024-09-13T05:10:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097718389999999992, 2024-09-13T05:10:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5041 2024-09-13T05:10:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802046+0000", 2024-09-13T05:10:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802046+0000", 2024-09-13T05:10:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802045+0000", 2024-09-13T05:10:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802047+0000", 2024-09-13T05:10:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1799999999999999e-06 2024-09-13T05:10:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802053+0000", 2024-09-13T05:10:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.507e-06 2024-09-13T05:10:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802057+0000", 2024-09-13T05:10:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3590000000000001e-06 2024-09-13T05:10:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811713+0000", 2024-09-13T05:10:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096553400000000001 2024-09-13T05:10:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811763+0000", 2024-09-13T05:10:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0050999999999999e-05 2024-09-13T05:10:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811818+0000", 2024-09-13T05:10:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4777000000000001e-05 2024-09-13T05:10:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5044 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2899968~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802062+0000", 2024-09-13T05:10:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.011435989999999, 2024-09-13T05:10:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0099015260000000008, 2024-09-13T05:10:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5044 2024-09-13T05:10:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802062+0000", 2024-09-13T05:10:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802062+0000", 2024-09-13T05:10:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802061+0000", 2024-09-13T05:10:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802064+0000", 2024-09-13T05:10:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0740000000000001e-06 2024-09-13T05:10:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802070+0000", 2024-09-13T05:10:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8560000000000003e-06 2024-09-13T05:10:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802075+0000", 2024-09-13T05:10:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6360000000000002e-06 2024-09-13T05:10:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811834+0000", 2024-09-13T05:10:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097588710000000006 2024-09-13T05:10:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811878+0000", 2024-09-13T05:10:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3937999999999998e-05 2024-09-13T05:10:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811963+0000", 2024-09-13T05:10:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5505000000000002e-05 2024-09-13T05:10:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5049 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2506752~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802080+0000", 2024-09-13T05:10:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.011418106000001, 2024-09-13T05:10:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010051279, 2024-09-13T05:10:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5049 2024-09-13T05:10:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802080+0000", 2024-09-13T05:10:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802080+0000", 2024-09-13T05:10:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802079+0000", 2024-09-13T05:10:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802081+0000", 2024-09-13T05:10:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2740000000000002e-06 2024-09-13T05:10:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802088+0000", 2024-09-13T05:10:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.567e-06 2024-09-13T05:10:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802093+0000", 2024-09-13T05:10:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8609999999999997e-06 2024-09-13T05:10:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811989+0000", 2024-09-13T05:10:51.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0098961840000000006 2024-09-13T05:10:51.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812069+0000", 2024-09-13T05:10:51.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9534000000000001e-05 2024-09-13T05:10:51.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812131+0000", 2024-09-13T05:10:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2206999999999996e-05 2024-09-13T05:10:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5052 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 3096576~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802097+0000", 2024-09-13T05:10:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.011400876, 2024-09-13T05:10:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010227615000000001, 2024-09-13T05:10:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.867 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.867 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.867 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.867 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5052 2024-09-13T05:10:51.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.867 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802097+0000", 2024-09-13T05:10:51.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802097+0000", 2024-09-13T05:10:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802096+0000", 2024-09-13T05:10:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802099+0000", 2024-09-13T05:10:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3539999999999998e-06 2024-09-13T05:10:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802105+0000", 2024-09-13T05:10:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8440000000000003e-06 2024-09-13T05:10:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802109+0000", 2024-09-13T05:10:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6800000000000001e-06 2024-09-13T05:10:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812155+0000", 2024-09-13T05:10:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010045691000000001 2024-09-13T05:10:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812238+0000", 2024-09-13T05:10:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2855000000000005e-05 2024-09-13T05:10:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812324+0000", 2024-09-13T05:10:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6621999999999998e-05 2024-09-13T05:10:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:7377 3.1e 3:7d4eb93d:::rbd_header.112d1304fe95:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-13T05:10:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:24.742504+0000", 2024-09-13T05:10:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.070993753, 2024-09-13T05:10:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01013406, 2024-09-13T05:10:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7377 2024-09-13T05:10:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742504+0000", 2024-09-13T05:10:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742504+0000", 2024-09-13T05:10:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742500+0000", 2024-09-13T05:10:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999962 2024-09-13T05:10:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742522+0000", 2024-09-13T05:10:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2310000000000002e-05 2024-09-13T05:10:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742572+0000", 2024-09-13T05:10:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9872e-05 2024-09-13T05:10:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742597+0000", 2024-09-13T05:10:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4363e-05 2024-09-13T05:10:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742678+0000", 2024-09-13T05:10:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1370000000000002e-05 2024-09-13T05:10:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-13T05:10:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742686+0000", 2024-09-13T05:10:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5259999999999993e-06 2024-09-13T05:10:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.749024+0000", 2024-09-13T05:10:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006337372 2024-09-13T05:10:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.749278+0000", 2024-09-13T05:10:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025436399999999998 2024-09-13T05:10:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:10:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.750557+0000", 2024-09-13T05:10:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012787129999999999 2024-09-13T05:10:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.751774+0000", 2024-09-13T05:10:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001217054 2024-09-13T05:10:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.752530+0000", 2024-09-13T05:10:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075635999999999998 2024-09-13T05:10:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.752592+0000", 2024-09-13T05:10:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1486000000000001e-05 2024-09-13T05:10:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.752638+0000", 2024-09-13T05:10:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6140000000000002e-05 2024-09-13T05:10:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:7961 3.18 3:184d9aea:::rbd_data.112db57f3a18.000000000000002b:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-13T05:10:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:10:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 25.736492534, 2024-09-13T05:10:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.040271084999999998, 2024-09-13T05:10:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7961 2024-09-13T05:10:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:10:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:10:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077003+0000", 2024-09-13T05:10:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077013+0000", 2024-09-13T05:10:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6870000000000006e-06 2024-09-13T05:10:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077029+0000", 2024-09-13T05:10:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6314e-05 2024-09-13T05:10:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077038+0000", 2024-09-13T05:10:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5019999999999992e-06 2024-09-13T05:10:51.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077099+0000", 2024-09-13T05:10:51.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1444000000000003e-05 2024-09-13T05:10:51.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077234+0000", 2024-09-13T05:10:51.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013461300000000001 2024-09-13T05:10:51.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:51.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.085202+0000", 2024-09-13T05:10:51.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079680140000000007 2024-09-13T05:10:51.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:51.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116860+0000", 2024-09-13T05:10:51.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.031658190000000003 2024-09-13T05:10:51.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:51.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116995+0000", 2024-09-13T05:10:51.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000135601 2024-09-13T05:10:51.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:51.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117152+0000", 2024-09-13T05:10:51.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015681700000000001 2024-09-13T05:10:51.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117276+0000", 2024-09-13T05:10:51.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012392699999999999 2024-09-13T05:10:51.883 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.883 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.883 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.884 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4397.0:7961 3.18 e35/22 ondisk, result = 0)", 2024-09-13T05:10:51.884 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.104860+0000", 2024-09-13T05:10:51.884 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 25.708637516, 2024-09-13T05:10:51.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012435735999999999, 2024-09-13T05:10:51.884 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.884 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.884 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104860+0000", 2024-09-13T05:10:51.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104860+0000", 2024-09-13T05:10:51.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104859+0000", 2024-09-13T05:10:51.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:51.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104866+0000", 2024-09-13T05:10:51.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0840000000000003e-06 2024-09-13T05:10:51.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104882+0000", 2024-09-13T05:10:51.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5705e-05 2024-09-13T05:10:51.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104890+0000", 2024-09-13T05:10:51.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5110000000000003e-06 2024-09-13T05:10:51.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116937+0000", 2024-09-13T05:10:51.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012046563999999999 2024-09-13T05:10:51.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116975+0000", 2024-09-13T05:10:51.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8243e-05 2024-09-13T05:10:51.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117296+0000", 2024-09-13T05:10:51.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032082299999999997 2024-09-13T05:10:51.887 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.887 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.888 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.888 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:8105 3.b 3:d2ae8f7b:::rbd_data.112db57f3a18.0000000000000028:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-13T05:10:51.888 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:10:51.888 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 25.501396728, 2024-09-13T05:10:51.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.040653913, 2024-09-13T05:10:51.888 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.888 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:51.888 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.888 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.888 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.888 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 8105 2024-09-13T05:10:51.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.889 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:10:51.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:10:51.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312099+0000", 2024-09-13T05:10:51.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:51.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312109+0000", 2024-09-13T05:10:51.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0244999999999999e-05 2024-09-13T05:10:51.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312129+0000", 2024-09-13T05:10:51.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9751000000000001e-05 2024-09-13T05:10:51.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312141+0000", 2024-09-13T05:10:51.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2201999999999999e-05 2024-09-13T05:10:51.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312230+0000", 2024-09-13T05:10:51.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9092999999999996e-05 2024-09-13T05:10:51.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312433+0000", 2024-09-13T05:10:51.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020240500000000001 2024-09-13T05:10:51.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:51.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.320357+0000", 2024-09-13T05:10:51.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079242630000000008 2024-09-13T05:10:51.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:51.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352488+0000", 2024-09-13T05:10:51.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032131588000000003 2024-09-13T05:10:51.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:51.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352533+0000", 2024-09-13T05:10:51.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4601999999999997e-05 2024-09-13T05:10:51.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:51.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352636+0000", 2024-09-13T05:10:51.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103041 2024-09-13T05:10:51.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352755+0000", 2024-09-13T05:10:51.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118814 2024-09-13T05:10:51.894 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.894 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.894 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.894 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4397.0:8105 3.b e35/22 ondisk, result = 0)", 2024-09-13T05:10:51.894 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.342777+0000", 2024-09-13T05:10:51.894 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 25.47072052, 2024-09-13T05:10:51.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097182480000000005, 2024-09-13T05:10:51.894 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.894 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.894 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342777+0000", 2024-09-13T05:10:51.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342777+0000", 2024-09-13T05:10:51.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342776+0000", 2024-09-13T05:10:51.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:51.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342786+0000", 2024-09-13T05:10:51.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0298e-05 2024-09-13T05:10:51.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342809+0000", 2024-09-13T05:10:51.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3346999999999999e-05 2024-09-13T05:10:51.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342822+0000", 2024-09-13T05:10:51.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2717e-05 2024-09-13T05:10:51.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352456+0000", 2024-09-13T05:10:51.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096335659999999997 2024-09-13T05:10:51.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352474+0000", 2024-09-13T05:10:51.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8776000000000001e-05 2024-09-13T05:10:51.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352495+0000", 2024-09-13T05:10:51.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.107e-05 2024-09-13T05:10:51.898 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.898 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.898 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.898 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:39305 3.1e 3:79249bf8:::rbd_data.112dcff96bbd.0000000000000003:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-13T05:10:51.898 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:41.473278+0000", 2024-09-13T05:10:51.898 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.340220132000001, 2024-09-13T05:10:51.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027037510000000001, 2024-09-13T05:10:51.898 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.898 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:51.898 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.899 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.899 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.899 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 39305 2024-09-13T05:10:51.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.899 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473278+0000", 2024-09-13T05:10:51.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473278+0000", 2024-09-13T05:10:51.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473276+0000", 2024-09-13T05:10:51.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:51.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473285+0000", 2024-09-13T05:10:51.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0129999999999999e-06 2024-09-13T05:10:51.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473304+0000", 2024-09-13T05:10:51.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8723e-05 2024-09-13T05:10:51.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473313+0000", 2024-09-13T05:10:51.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1419999999999999e-06 2024-09-13T05:10:51.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473390+0000", 2024-09-13T05:10:51.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7001000000000004e-05 2024-09-13T05:10:51.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473496+0000", 2024-09-13T05:10:51.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010577399999999999 2024-09-13T05:10:51.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:10:51.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.478499+0000", 2024-09-13T05:10:51.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050029260000000004 2024-09-13T05:10:51.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:51.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500153+0000", 2024-09-13T05:10:51.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021654421 2024-09-13T05:10:51.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:51.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500216+0000", 2024-09-13T05:10:51.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3233999999999998e-05 2024-09-13T05:10:51.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:51.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500273+0000", 2024-09-13T05:10:51.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6484000000000003e-05 2024-09-13T05:10:51.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500315+0000", 2024-09-13T05:10:51.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2342000000000002e-05 2024-09-13T05:10:51.904 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.904 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.904 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.904 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:40934 3.1 3:86cdeb48:::rbd_data.112d4ab2162d.0000000000000103:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-13T05:10:51.904 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:46.247357+0000", 2024-09-13T05:10:51.904 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.5661408940000001, 2024-09-13T05:10:51.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028923379999999999, 2024-09-13T05:10:51.904 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.904 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:51.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.905 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.905 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.905 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 40934 2024-09-13T05:10:51.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.905 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247357+0000", 2024-09-13T05:10:51.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247357+0000", 2024-09-13T05:10:51.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247354+0000", 2024-09-13T05:10:51.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:10:51.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247371+0000", 2024-09-13T05:10:51.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6697e-05 2024-09-13T05:10:51.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247403+0000", 2024-09-13T05:10:51.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1649000000000001e-05 2024-09-13T05:10:51.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247417+0000", 2024-09-13T05:10:51.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.395e-05 2024-09-13T05:10:51.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247498+0000", 2024-09-13T05:10:51.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1011000000000001e-05 2024-09-13T05:10:51.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247757+0000", 2024-09-13T05:10:51.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000258872 2024-09-13T05:10:51.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:10:51.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.254874+0000", 2024-09-13T05:10:51.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071176449999999997 2024-09-13T05:10:51.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:51.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.275876+0000", 2024-09-13T05:10:51.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021001770999999999 2024-09-13T05:10:51.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:51.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.275989+0000", 2024-09-13T05:10:51.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011301199999999999 2024-09-13T05:10:51.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:51.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.276156+0000", 2024-09-13T05:10:51.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000167453 2024-09-13T05:10:51.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.276280+0000", 2024-09-13T05:10:51.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012369400000000001 2024-09-13T05:10:51.910 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.910 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.910 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.910 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:45910 3.a 3:56753852:::rbd_header.112d678e2955:head [call,call rbd.parent_overlap_get in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e58)", 2024-09-13T05:10:51.910 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:50.370028+0000", 2024-09-13T05:10:51.910 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.4434701460000001, 2024-09-13T05:10:51.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048450024000000001, 2024-09-13T05:10:51.910 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.910 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:51.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.911 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.911 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.911 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45910 2024-09-13T05:10:51.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.911 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370028+0000", 2024-09-13T05:10:51.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370028+0000", 2024-09-13T05:10:51.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370027+0000", 2024-09-13T05:10:51.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:51.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370031+0000", 2024-09-13T05:10:51.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6530000000000002e-06 2024-09-13T05:10:51.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370038+0000", 2024-09-13T05:10:51.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8959999999999997e-06 2024-09-13T05:10:51.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370043+0000", 2024-09-13T05:10:51.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3680000000000004e-06 2024-09-13T05:10:51.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370076+0000", 2024-09-13T05:10:51.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3411000000000002e-05 2024-09-13T05:10:51.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370125+0000", 2024-09-13T05:10:51.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8593e-05 2024-09-13T05:10:51.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.418478+0000", 2024-09-13T05:10:51.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048352978999999997 2024-09-13T05:10:51.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.914 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.915 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:46246 3.1e 3:7bf44c0b:::rbd_data.112d678e2955.000000000000013a:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-13T05:10:51.915 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:50.821618+0000", 2024-09-13T05:10:51.915 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.99187973100000004, 2024-09-13T05:10:51.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093094630000000005, 2024-09-13T05:10:51.915 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:51.915 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:51.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:51.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:51.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:51.915 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 46246 2024-09-13T05:10:51.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.915 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:51.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:51.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.821618+0000", 2024-09-13T05:10:51.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:51.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.821618+0000", 2024-09-13T05:10:51.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:51.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:51.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.821616+0000", 2024-09-13T05:10:51.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:51.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:51.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.821626+0000", 2024-09-13T05:10:51.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0002e-05 2024-09-13T05:10:51.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:51.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.821649+0000", 2024-09-13T05:10:51.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2435000000000001e-05 2024-09-13T05:10:51.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:51.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.821660+0000", 2024-09-13T05:10:51.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0767e-05 2024-09-13T05:10:51.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:51.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.821734+0000", 2024-09-13T05:10:51.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4406999999999994e-05 2024-09-13T05:10:51.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:51.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.821916+0000", 2024-09-13T05:10:51.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000181891 2024-09-13T05:10:51.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:10:51.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.823549+0000", 2024-09-13T05:10:51.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016331029999999999 2024-09-13T05:10:51.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:51.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.830818+0000", 2024-09-13T05:10:51.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072692240000000003 2024-09-13T05:10:51.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:51.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.830845+0000", 2024-09-13T05:10:51.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7260999999999999e-05 2024-09-13T05:10:51.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:51.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.830885+0000", 2024-09-13T05:10:51.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9938000000000003e-05 2024-09-13T05:10:51.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:51.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:51.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:51.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.830927+0000", 2024-09-13T05:10:51.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2021000000000003e-05 2024-09-13T05:10:51.923 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.923 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.923 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.923 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:51.923 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:51.923 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:51.925 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:10:51.925 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:51.917+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:52.026 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:52.022+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:52.043 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:52.044 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:52.044 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:52.044 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:52.054 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:10:52.126 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:52.121+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:52.161 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:52.161 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:52.161 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:52.161 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:52.161 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:52.170 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:10:52.227 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:52.221+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:52.277 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #13, image image_client.0-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent14 2024-09-13T05:10:52.279 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:52.279 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:52.279 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:52.279 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [] 2024-09-13T05:10:52.280 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:52.289 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:10:52.332 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:52.325+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:52.382 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:10:52.398 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:52.398 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:52.398 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:52.398 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:52.407 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:10:52.433 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:52.426+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:52.477 INFO:teuthology.orchestra.run.smithi120.stdout:1564 write 0x9050795 thru 0x9052e8a (0x26f6 bytes) 2024-09-13T05:10:52.491 INFO:teuthology.orchestra.run.smithi120.stdout:1566 punch from 0x21abdef to 0x21af10c, (0x331d bytes) 2024-09-13T05:10:52.498 INFO:teuthology.orchestra.run.smithi120.stdout:1568 trunc from 0xeb0db76 to 0xa3ce587 2024-09-13T05:10:52.517 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:52.517 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:52.518 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:52.518 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:52.518 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:52.519 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:10:52.523 INFO:teuthology.orchestra.run.smithi120.stdout:1569 punch from 0x1692da to 0x16b585, (0x22ab bytes) 2024-09-13T05:10:52.523 INFO:teuthology.orchestra.run.smithi120.stdout:1570 read 0x5e0a7e7 thru 0x5e0d095 (0x28af bytes) 2024-09-13T05:10:52.528 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:10:52.533 INFO:teuthology.orchestra.run.smithi120.stdout:1571 trunc from 0xa3ce587 to 0x6fe968b 2024-09-13T05:10:52.535 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:52.529+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:52.539 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:10:52.553 INFO:teuthology.orchestra.run.smithi120.stdout:1572 writesame 0xff20b1 thru 0xffa06f data_size 0xb(0x7fbf bytes) 2024-09-13T05:10:52.558 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:10:52.561 INFO:teuthology.orchestra.run.smithi120.stdout:1573 read 0x26bfc7b thru 0x26ceae7 (0xee6d bytes) 2024-09-13T05:10:52.562 INFO:teuthology.orchestra.run.smithi120.stdout:1574 writesame 0x648911c thru 0x64938f2 data_size 0x1(0xa7d7 bytes) 2024-09-13T05:10:52.579 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:10:52.600 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:10:52.614 INFO:teuthology.orchestra.run.smithi120.stdout:1576 trunc from 0x6fe968b to 0x652288 2024-09-13T05:10:52.621 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:10:52.635 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:52.630+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:52.642 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:52.642 INFO:teuthology.orchestra.run.smithi120.stdout:1578 read 0x11e066 thru 0x12c275 (0xe210 bytes) 2024-09-13T05:10:52.643 INFO:teuthology.orchestra.run.smithi120.stdout:1579 read 0x4081ba thru 0x416c4d (0xea94 bytes) 2024-09-13T05:10:52.644 INFO:teuthology.orchestra.run.smithi120.stdout:1581 punch from 0x3224c6 to 0x3225fd, (0x137 bytes) 2024-09-13T05:10:52.646 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:52.646 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:52.646 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:10:52.647 INFO:teuthology.orchestra.run.smithi120.stdout:1582 trunc from 0x652288 to 0x1dd39e4 2024-09-13T05:10:52.657 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:10:52.664 INFO:teuthology.orchestra.run.smithi120.stdout:1583 read 0x166566a thru 0x1672aad (0xd444 bytes) 2024-09-13T05:10:52.664 INFO:teuthology.orchestra.run.smithi120.stdout:1585 read 0x1932127 thru 0x193c489 (0xa363 bytes) 2024-09-13T05:10:52.664 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:52.664 INFO:teuthology.orchestra.run.smithi120.stdout:1587 punch from 0xc45fe to 0xcc6a6, (0x80a8 bytes) 2024-09-13T05:10:52.667 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:10:52.670 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:10:52.670 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:10:52.670 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:10:52.670 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:10:52.670 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:10:52.670 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:10:52.670 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:10:52.670 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:10:52.685 INFO:teuthology.orchestra.run.smithi120.stdout:1588 writesame 0x7900b38 thru 0x79103fd data_size 0x7(0xf8c6 bytes) 2024-09-13T05:10:52.685 INFO:teuthology.orchestra.run.smithi120.stdout:1589 punch from 0x4514165 to 0x45198f0, (0x578b bytes) 2024-09-13T05:10:52.693 INFO:teuthology.orchestra.run.smithi120.stdout:1591 trunc from 0x79103fe to 0x2bcbd17 2024-09-13T05:10:52.706 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:52.706 INFO:teuthology.orchestra.run.smithi120.stdout:1593 write 0x664554 thru 0x66c95a (0x8407 bytes) 2024-09-13T05:10:52.732 INFO:teuthology.orchestra.run.smithi120.stdout:1595 write 0x8ebe0fe thru 0x8ec0822 (0x2725 bytes) 2024-09-13T05:10:52.740 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:52.733+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:52.740 INFO:teuthology.orchestra.run.smithi120.stdout:1597 write 0x67553f3 thru 0x6758a55 (0x3663 bytes) 2024-09-13T05:10:52.759 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:52.759 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:52.759 INFO:teuthology.orchestra.run.smithi120.stdout:1598 write 0xa47f294 thru 0xa48ca73 (0xd7e0 bytes) 2024-09-13T05:10:52.768 INFO:teuthology.orchestra.run.smithi120.stdout:1599 read 0x955b80c thru 0x956623f (0xaa34 bytes) 2024-09-13T05:10:52.768 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:52.768 INFO:teuthology.orchestra.run.smithi120.stdout:1603 read 0x9c70437 thru 0x9c7d4d7 (0xd0a1 bytes) 2024-09-13T05:10:52.768 INFO:teuthology.orchestra.run.smithi120.stdout:1607 read 0x4338d3b thru 0x43420ba (0x9380 bytes) 2024-09-13T05:10:52.769 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:10:52.785 INFO:teuthology.orchestra.run.smithi120.stdout:1608 write 0xc450965 thru 0xc460796 (0xfe32 bytes) 2024-09-13T05:10:52.795 INFO:teuthology.orchestra.run.smithi120.stdout:1609 write 0x1216fea thru 0x121a415 (0x342c bytes) 2024-09-13T05:10:52.803 INFO:teuthology.orchestra.run.smithi120.stdout:1610 write 0x734830c thru 0x7355f07 (0xdbfc bytes) 2024-09-13T05:10:52.812 INFO:teuthology.orchestra.run.smithi120.stdout:1611 punch from 0x9fb126f to 0x9fbdb84, (0xc915 bytes) 2024-09-13T05:10:52.812 INFO:teuthology.orchestra.run.smithi120.stdout:1612 writesame 0x798a4d9 thru 0x7991f53 data_size 0x1(0x7a7b bytes) 2024-09-13T05:10:52.839 INFO:teuthology.orchestra.run.smithi120.stdout:1613 read 0x34006b5 thru 0x3407e30 (0x777c bytes) 2024-09-13T05:10:52.841 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:52.833+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:52.862 INFO:teuthology.orchestra.run.smithi120.stdout:1614 trunc from 0xc460797 to 0x2f721e5 2024-09-13T05:10:52.882 INFO:teuthology.orchestra.run.smithi120.stdout:1615 punch from 0x2c36bf1 to 0x2c3eb03, (0x7f12 bytes) 2024-09-13T05:10:52.883 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:52.883 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:52.893 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:10:52.900 INFO:teuthology.orchestra.run.smithi120.stdout:1616 trunc from 0x2f721e5 to 0xd3257f0 2024-09-13T05:10:52.911 INFO:teuthology.orchestra.run.smithi120.stdout:1617 write 0x522a5ce thru 0x522f4bb (0x4eee bytes) 2024-09-13T05:10:52.917 INFO:teuthology.orchestra.run.smithi120.stdout:1618 punch from 0x6c292b7 to 0x6c2afe3, (0x1d2c bytes) 2024-09-13T05:10:52.917 INFO:teuthology.orchestra.run.smithi120.stdout:1619 read 0xc5faa29 thru 0xc6061ab (0xb783 bytes) 2024-09-13T05:10:52.917 INFO:teuthology.orchestra.run.smithi120.stdout:1620 clone 16 order 18 su 4096 sc 2 2024-09-13T05:10:52.943 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:52.938+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:52.987 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T05:10:52.992 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:52.993 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:53.004 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:10:53.043 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:53.037+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:53.108 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone15 from 0xd3257f0 (overlap 0x652288) to 0x143a1b 2024-09-13T05:10:53.110 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:53.111 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:53.123 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:10:53.144 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:53.138+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:53.217 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #14, image image_client.0-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent15 2024-09-13T05:10:53.226 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:53.226 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:53.235 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:10:53.244 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:53.237+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:53.342 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:53.342 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:53.346 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:53.342+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:53.352 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:10:53.447 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:53.441+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:53.471 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:53.471 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:53.481 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:10:53.548 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:53.542+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:53.584 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:53.584 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:53.594 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:10:53.630 INFO:teuthology.orchestra.run.smithi120.stdout:1621 writesame 0x499d293 thru 0x49a1acc data_size 0x2b(0x483a bytes) 2024-09-13T05:10:53.649 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:53.641+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:53.655 INFO:teuthology.orchestra.run.smithi120.stdout:1623 trunc from 0xd3257f0 to 0x8b2402b 2024-09-13T05:10:53.674 INFO:teuthology.orchestra.run.smithi120.stdout:1624 read 0x2bedf08 thru 0x2bf6a23 (0x8b1c bytes) 2024-09-13T05:10:53.691 INFO:teuthology.orchestra.run.smithi120.stdout:1625 write 0xa9b1794 thru 0xa9b3589 (0x1df6 bytes) 2024-09-13T05:10:53.701 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:53.701 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:53.711 INFO:teuthology.orchestra.run.smithi120.stdout:1626 trunc from 0xa9b358a to 0x5d9d234 2024-09-13T05:10:53.714 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:10:53.741 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:53.741 INFO:teuthology.orchestra.run.smithi120.stdout:1628 writesame 0x4445a42 thru 0x444a69b data_size 0x1d(0x4c5a bytes) 2024-09-13T05:10:53.749 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:53.746+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:53.757 INFO:teuthology.orchestra.run.smithi120.stdout:1629 trunc from 0x5d9d234 to 0x3466823 2024-09-13T05:10:53.788 INFO:teuthology.orchestra.run.smithi120.stdout:1630 read 0x1405a38 thru 0x14112c7 (0xb890 bytes) 2024-09-13T05:10:53.788 INFO:teuthology.orchestra.run.smithi120.stdout:1631 write 0x11f3e78 thru 0x11fcbd8 (0x8d61 bytes) 2024-09-13T05:10:53.801 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:53.831 INFO:teuthology.orchestra.run.smithi120.stdout:1633 write 0xc98f616 thru 0xc99d2f6 (0xdce1 bytes) 2024-09-13T05:10:53.840 INFO:teuthology.orchestra.run.smithi120.stdout:1634 write 0x8fcedaa thru 0x8fdb12d (0xc384 bytes) 2024-09-13T05:10:53.850 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:53.846+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:53.850 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:53.850 INFO:teuthology.orchestra.run.smithi120.stdout:1636 write 0x12aa7e8 thru 0x12af1ca (0x49e3 bytes) 2024-09-13T05:10:53.862 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:53.863 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:53.873 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:10:53.884 INFO:teuthology.orchestra.run.smithi120.stdout:1637 trunc from 0xc99d2f7 to 0x3795278 2024-09-13T05:10:53.924 INFO:teuthology.orchestra.run.smithi120.stdout:1638 write 0x659ba3f thru 0x659c2b6 (0x878 bytes) 2024-09-13T05:10:53.932 INFO:teuthology.orchestra.run.smithi120.stdout:1641 write 0x2f8f3fc thru 0x2f940c8 (0x4ccd bytes) 2024-09-13T05:10:53.939 INFO:teuthology.orchestra.run.smithi120.stdout:1642 writesame 0x5d9f3f1 thru 0x5da46ec data_size 0x5e(0x52fc bytes) 2024-09-13T05:10:53.945 INFO:teuthology.orchestra.run.smithi120.stdout:1643 write 0x144b7ae thru 0x14523ef (0x6c42 bytes) 2024-09-13T05:10:53.948 INFO:teuthology.orchestra.run.smithi120.stdout:1644 read 0x64c9239 thru 0x64cb82f (0x25f7 bytes) 2024-09-13T05:10:53.948 INFO:teuthology.orchestra.run.smithi120.stdout:1645 read 0x4da6a95 thru 0x4daa78a (0x3cf6 bytes) 2024-09-13T05:10:53.948 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:53.950 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:53.946+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:53.961 INFO:teuthology.orchestra.run.smithi120.stdout:1647 trunc from 0x659c2b7 to 0xd720671 2024-09-13T05:10:53.973 INFO:teuthology.orchestra.run.smithi120.stdout:1648 write 0xa4b0660 thru 0xa4bcbd3 (0xc574 bytes) 2024-09-13T05:10:53.982 INFO:teuthology.orchestra.run.smithi120.stdout:1650 punch from 0x153f564 to 0x154672e, (0x71ca bytes) 2024-09-13T05:10:53.982 INFO:teuthology.orchestra.run.smithi120.stdout:1651 punch from 0x2a0b05d to 0x2a1717a, (0xc11d bytes) 2024-09-13T05:10:53.995 INFO:teuthology.orchestra.run.smithi120.stdout:1652 trunc from 0xd720671 to 0x785a35f 2024-09-13T05:10:53.997 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:53.997 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:53.998 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is unset 2024-09-13T05:10:54.012 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:10:54.023 INFO:teuthology.orchestra.run.smithi120.stdout:1654 punch from 0x1c0e9cf to 0x1c1b349, (0xc97a bytes) 2024-09-13T05:10:54.023 INFO:teuthology.orchestra.run.smithi120.stdout:1655 read 0x666f644 thru 0x6671914 (0x22d1 bytes) 2024-09-13T05:10:54.046 INFO:teuthology.orchestra.run.smithi120.stdout:1656 write 0xc56f8d8 thru 0xc57f3d4 (0xfafd bytes) 2024-09-13T05:10:54.051 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:54.045+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:54.066 INFO:teuthology.orchestra.run.smithi120.stdout:1657 write 0xdb76549 thru 0xdb7976b (0x3223 bytes) 2024-09-13T05:10:54.075 INFO:teuthology.orchestra.run.smithi120.stdout:1658 writesame 0xbcfbfb7 thru 0xbcfe9de data_size 0x47(0x2a28 bytes) 2024-09-13T05:10:54.085 INFO:teuthology.orchestra.run.smithi120.stdout:1660 write 0x78acc85 thru 0x78baa53 (0xddcf bytes) 2024-09-13T05:10:54.095 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:54.095 INFO:teuthology.orchestra.run.smithi120.stdout:1663 read 0x46d90aa thru 0x46d966b (0x5c2 bytes) 2024-09-13T05:10:54.106 INFO:teuthology.orchestra.run.smithi120.stdout:1664 trunc from 0xdb7976c to 0x86c912d 2024-09-13T05:10:54.129 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:54.129 INFO:teuthology.orchestra.run.smithi120.stdout:1667 read 0x7ead91 thru 0x7faa1a (0xfc8a bytes) 2024-09-13T05:10:54.129 INFO:teuthology.orchestra.run.smithi120.stdout:1668 read 0x4bcff13 thru 0x4bd61e9 (0x62d7 bytes) 2024-09-13T05:10:54.129 INFO:teuthology.orchestra.run.smithi120.stdout:1669 punch from 0x19a3384 to 0x19ac9a7, (0x9623 bytes) 2024-09-13T05:10:54.131 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:54.131 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:54.145 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:10:54.152 INFO:teuthology.orchestra.run.smithi120.stdout:1675 writesame 0xe361a8c thru 0xe36b0a0 data_size 0x3(0x9615 bytes) 2024-09-13T05:10:54.152 INFO:teuthology.orchestra.run.smithi120.stdout:1677 read 0x3b0d717 thru 0x3b14c0b (0x74f5 bytes) 2024-09-13T05:10:54.152 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:54.152 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:54.145+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:54.175 INFO:teuthology.orchestra.run.smithi120.stdout:1679 trunc from 0xe36b0a1 to 0x926db9 2024-09-13T05:10:54.208 INFO:teuthology.orchestra.run.smithi120.stdout:1682 punch from 0x31d09e to 0x324a8c, (0x79ee bytes) 2024-09-13T05:10:54.234 INFO:teuthology.orchestra.run.smithi120.stdout:1683 writesame 0x94c1a47 thru 0x94cfc45 data_size 0x91(0xe1ff bytes) 2024-09-13T05:10:54.253 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:54.249+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:54.257 INFO:teuthology.orchestra.run.smithi120.stdout:1686 writesame 0xe04904b thru 0xe04906a data_size 0x2(0x20 bytes) 2024-09-13T05:10:54.258 INFO:teuthology.orchestra.run.smithi120.stdout:1687 read 0xd82de43 thru 0xd8367d5 (0x8993 bytes) 2024-09-13T05:10:54.258 INFO:teuthology.orchestra.run.smithi120.stdout:1688 write 0xa4b84a0 thru 0xa4c54e2 (0xd043 bytes) 2024-09-13T05:10:54.266 INFO:teuthology.orchestra.run.smithi120.stdout:1690 write 0x1a53421 thru 0x1a62675 (0xf255 bytes) 2024-09-13T05:10:54.274 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:54.274 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:54.297 INFO:teuthology.orchestra.run.smithi120.stdout:1692 trunc from 0xe04906b to 0x1876527 2024-09-13T05:10:54.299 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:10:54.326 INFO:teuthology.orchestra.run.smithi120.stdout:1697 trunc from 0x1876527 to 0x4f1ef90 2024-09-13T05:10:54.339 INFO:teuthology.orchestra.run.smithi120.stdout:1698 write 0x3c5c4aa thru 0x3c5d69e (0x11f5 bytes) 2024-09-13T05:10:54.348 INFO:teuthology.orchestra.run.smithi120.stdout:1699 write 0x41639a8 thru 0x416c564 (0x8bbd bytes) 2024-09-13T05:10:54.354 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:54.350+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:54.356 INFO:teuthology.orchestra.run.smithi120.stdout:1700 read 0x22d2b20 thru 0x22d7cac (0x518d bytes) 2024-09-13T05:10:54.356 INFO:teuthology.orchestra.run.smithi120.stdout:1701 write 0x19afedf thru 0x19b9175 (0x9297 bytes) 2024-09-13T05:10:54.385 INFO:teuthology.orchestra.run.smithi120.stdout:1702 write 0xa5464ad thru 0xa54c56e (0x60c2 bytes) 2024-09-13T05:10:54.393 INFO:teuthology.orchestra.run.smithi120.stdout:1703 punch from 0x4313466 to 0x431b24d, (0x7de7 bytes) 2024-09-13T05:10:54.393 INFO:teuthology.orchestra.run.smithi120.stdout:1705 punch from 0x1701276 to 0x170d6c1, (0xc44b bytes) 2024-09-13T05:10:54.393 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:54.393 INFO:teuthology.orchestra.run.smithi120.stdout:1707 read 0x26662c4 thru 0x2675262 (0xef9f bytes) 2024-09-13T05:10:54.393 INFO:teuthology.orchestra.run.smithi120.stdout:1708 write 0x3de75f7 thru 0x3df0ebe (0x98c8 bytes) 2024-09-13T05:10:54.419 INFO:teuthology.orchestra.run.smithi120.stdout:1709 write 0xca95828 thru 0xcaa3ecb (0xe6a4 bytes) 2024-09-13T05:10:54.431 INFO:teuthology.orchestra.run.smithi120.stdout:1710 trunc from 0xcaa3ecc to 0xec3ac41 2024-09-13T05:10:54.442 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:54.442 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:54.443 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:54.443 INFO:teuthology.orchestra.run.smithi120.stdout:1713 flatten 2024-09-13T05:10:54.455 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:10:54.501 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:54.497+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:54.557 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:54.554+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:54.569 INFO:teuthology.orchestra.run.smithi120.stdout:1715 writesame 0x704cc42 thru 0x7057672 data_size 0x67(0xaa31 bytes) 2024-09-13T05:10:54.575 INFO:teuthology.orchestra.run.smithi120.stdout:1716 punch from 0x6a21385 to 0x6a2a6b2, (0x932d bytes) 2024-09-13T05:10:54.575 INFO:teuthology.orchestra.run.smithi120.stdout:1717 writesame 0xb15ee2f thru 0xb163535 data_size 0x13(0x4707 bytes) 2024-09-13T05:10:54.581 INFO:teuthology.orchestra.run.smithi120.stdout:1719 write 0x8f83d78 thru 0x8f8ea46 (0xaccf bytes) 2024-09-13T05:10:54.587 INFO:teuthology.orchestra.run.smithi120.stdout:1720 write 0x9e37f9a thru 0x9e44bdf (0xcc46 bytes) 2024-09-13T05:10:54.593 INFO:teuthology.orchestra.run.smithi120.stdout:1722 read 0xfdff4d thru 0xfe5658 (0x570c bytes) 2024-09-13T05:10:54.594 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:54.594 INFO:teuthology.orchestra.run.smithi120.stdout:1725 read 0xd14a371 thru 0xd14b065 (0xcf5 bytes) 2024-09-13T05:10:54.594 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:54.594 INFO:teuthology.orchestra.run.smithi120.stdout:1730 read 0x32fce83 thru 0x3309ec7 (0xd045 bytes) 2024-09-13T05:10:54.594 INFO:teuthology.orchestra.run.smithi120.stdout:1731 read 0xa1e32b thru 0xa20712 (0x23e8 bytes) 2024-09-13T05:10:54.607 INFO:teuthology.orchestra.run.smithi120.stdout:1732 trunc from 0xec3ac41 to 0x7e066c3 2024-09-13T05:10:54.614 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:54.614 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:54.628 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:10:54.628 INFO:teuthology.orchestra.run.smithi120.stdout:1733 punch from 0x6c9f7e to 0x6d2e36, (0x8eb8 bytes) 2024-09-13T05:10:54.628 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:54.628 INFO:teuthology.orchestra.run.smithi120.stdout:1735 read 0x367f5df thru 0x3681cfe (0x2720 bytes) 2024-09-13T05:10:54.640 INFO:teuthology.orchestra.run.smithi120.stdout:1736 write 0x99cc972 thru 0x99d972f (0xcdbe bytes) 2024-09-13T05:10:54.649 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:54.649 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:54.649 INFO:teuthology.orchestra.run.smithi120.stdout:1739 read 0x598df0b thru 0x5992e11 (0x4f07 bytes) 2024-09-13T05:10:54.649 INFO:teuthology.orchestra.run.smithi120.stdout:1740 punch from 0x50ee4e7 to 0x50f774c, (0x9265 bytes) 2024-09-13T05:10:54.649 INFO:teuthology.orchestra.run.smithi120.stdout:1741 read 0x4cda51f thru 0x4ce85b9 (0xe09b bytes) 2024-09-13T05:10:54.649 INFO:teuthology.orchestra.run.smithi120.stdout:1742 read 0x21eac42 thru 0x21f5bc6 (0xaf85 bytes) 2024-09-13T05:10:54.649 INFO:teuthology.orchestra.run.smithi120.stdout:1743 writesame 0x4c83000 thru 0x4c9072e data_size 0x1(0xd72f bytes) 2024-09-13T05:10:54.658 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:54.654+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:54.685 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:10:54.691 INFO:teuthology.orchestra.run.smithi120.stdout:1744 write 0x9b152d2 thru 0x9b1a57c (0x52ab bytes) 2024-09-13T05:10:54.720 INFO:teuthology.orchestra.run.smithi120.stdout:1745 write 0xdee75e4 thru 0xdee88ab (0x12c8 bytes) 2024-09-13T05:10:54.728 INFO:teuthology.orchestra.run.smithi120.stdout:1746 write 0x6cb544 thru 0x6d0656 (0x5113 bytes) 2024-09-13T05:10:54.737 INFO:teuthology.orchestra.run.smithi120.stdout:1747 write 0xf231d4 thru 0xf2f9ba (0xc7e7 bytes) 2024-09-13T05:10:54.739 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:54.740 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:54.747 INFO:teuthology.orchestra.run.smithi120.stdout:1748 read 0x63e8355 thru 0x63f503e (0xccea bytes) 2024-09-13T05:10:54.751 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:10:54.754 INFO:teuthology.orchestra.run.smithi120.stdout:1749 trunc from 0xdee88ac to 0xae97e68 2024-09-13T05:10:54.759 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:54.754+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:54.774 INFO:teuthology.orchestra.run.smithi120.stdout:1750 read 0x60148a2 thru 0x601ddc2 (0x9521 bytes) 2024-09-13T05:10:54.790 INFO:teuthology.orchestra.run.smithi120.stdout:1751 write 0xbb76aa5 thru 0xbb8377f (0xccdb bytes) 2024-09-13T05:10:54.799 INFO:teuthology.orchestra.run.smithi120.stdout:1752 read 0x836196b thru 0x836cbcd (0xb263 bytes) 2024-09-13T05:10:54.811 INFO:teuthology.orchestra.run.smithi120.stdout:1753 trunc from 0xbb83780 to 0x35e9d62 2024-09-13T05:10:54.833 INFO:teuthology.orchestra.run.smithi120.stdout:1754 write 0x21dc162 thru 0x21e9b44 (0xd9e3 bytes) 2024-09-13T05:10:54.838 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:10:54.838 INFO:teuthology.orchestra.run.smithi120.stdout:1756 write 0x1f4ef9b thru 0x1f58ad4 (0x9b3a bytes) 2024-09-13T05:10:54.845 INFO:teuthology.orchestra.run.smithi120.stdout:1757 write 0x2a473ef thru 0x2a48058 (0xc6a bytes) 2024-09-13T05:10:54.851 INFO:teuthology.orchestra.run.smithi120.stdout:1760 write 0x263b84 thru 0x2658fd (0x1d7a bytes) 2024-09-13T05:10:54.856 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:54.856 INFO:teuthology.orchestra.run.smithi120.stdout:1762 read 0x2b2a8b thru 0x2bb9b1 (0x8f27 bytes) 2024-09-13T05:10:54.857 INFO:teuthology.orchestra.run.smithi120.stdout:1764 writesame 0x2d5ae05 thru 0x2d6853c data_size 0x8e(0xd738 bytes) 2024-09-13T05:10:54.858 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:10:54.859 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:54.854+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:54.862 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:54.862 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:54.864 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:54.874 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:10:54.875 INFO:teuthology.orchestra.run.smithi120.stdout:1767 trunc from 0x35e9d62 to 0x99f0d74 2024-09-13T05:10:54.879 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:10:54.889 INFO:teuthology.orchestra.run.smithi120.stdout:1770 read 0x5696c05 thru 0x56a5a06 (0xee02 bytes) 2024-09-13T05:10:54.889 INFO:teuthology.orchestra.run.smithi120.stdout:1772 read 0x301a519 thru 0x3021b8f (0x7677 bytes) 2024-09-13T05:10:54.889 INFO:teuthology.orchestra.run.smithi120.stdout:1773 read 0x2c5a70e thru 0x2c5f800 (0x50f3 bytes) 2024-09-13T05:10:54.895 INFO:teuthology.orchestra.run.smithi120.stdout:1777 trunc from 0x99f0d74 to 0xcafc680 2024-09-13T05:10:54.899 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:10:54.906 INFO:teuthology.orchestra.run.smithi120.stdout:1779 write 0x9dddc45 thru 0x9ded428 (0xf7e4 bytes) 2024-09-13T05:10:54.922 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:10:54.928 INFO:teuthology.orchestra.run.smithi120.stdout:1780 write 0xe0ebd1f thru 0xe0fb6d3 (0xf9b5 bytes) 2024-09-13T05:10:54.936 INFO:teuthology.orchestra.run.smithi120.stdout:1782 write 0x1d6c51a thru 0x1d752be (0x8da5 bytes) 2024-09-13T05:10:54.942 INFO:teuthology.orchestra.run.smithi120.stdout:1783 read 0x8ba442d thru 0x8ba92c7 (0x4e9b bytes) 2024-09-13T05:10:54.943 INFO:teuthology.orchestra.run.smithi120.stdout:1784 read 0x627b016 thru 0x62894ae (0xe499 bytes) 2024-09-13T05:10:54.943 INFO:teuthology.orchestra.run.smithi120.stdout:1786 read 0x7d937ab thru 0x7da3493 (0xfce9 bytes) 2024-09-13T05:10:54.943 INFO:teuthology.orchestra.run.smithi120.stdout:1787 write 0x5d9944d thru 0x5d9f9e5 (0x6599 bytes) 2024-09-13T05:10:54.948 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:10:54.948 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:54.949 INFO:teuthology.orchestra.run.smithi120.stdout:1789 punch from 0x3db3b44 to 0x3dc1c6a, (0xe126 bytes) 2024-09-13T05:10:54.949 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:54.960 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:54.954+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:54.969 INFO:teuthology.orchestra.run.smithi120.stdout:1791 trunc from 0xe0fb6d4 to 0x228e75d 2024-09-13T05:10:54.969 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:10:54.971 INFO:tasks.thrashosds.thrasher:in_osds: [2, 3, 5, 6, 7] out_osds: [4, 1, 0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T05:10:54.971 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:10:54.971 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-09-13T05:10:54.972 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-13T05:10:54.972 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-13T05:10:54.972 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-09-13T05:10:54.980 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:54.981 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:10:54.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:10:54.981 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:10:54.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.981 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2037 3.8 3:1349be29:::rbd_data.112d872fd67a.000000000000003b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:10:54.981 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.108522+0000", 2024-09-13T05:10:54.981 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.870164619000001, 2024-09-13T05:10:54.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016880821000000001, 2024-09-13T05:10:54.981 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:54.981 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:54.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:54.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:54.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:54.982 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2037 2024-09-13T05:10:54.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.982 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:54.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:54.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108522+0000", 2024-09-13T05:10:54.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:54.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:54.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108522+0000", 2024-09-13T05:10:54.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:54.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:54.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108521+0000", 2024-09-13T05:10:54.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:54.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:54.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108527+0000", 2024-09-13T05:10:54.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0460000000000002e-06 2024-09-13T05:10:54.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:54.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108538+0000", 2024-09-13T05:10:54.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0891e-05 2024-09-13T05:10:54.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108548+0000", 2024-09-13T05:10:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9159999999999996e-06 2024-09-13T05:10:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108595+0000", 2024-09-13T05:10:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7107000000000001e-05 2024-09-13T05:10:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108692+0000", 2024-09-13T05:10:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6824999999999995e-05 2024-09-13T05:10:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:10:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.111425+0000", 2024-09-13T05:10:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027337110000000002 2024-09-13T05:10:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125249+0000", 2024-09-13T05:10:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013823521 2024-09-13T05:10:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125265+0000", 2024-09-13T05:10:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6257e-05 2024-09-13T05:10:54.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:54.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125347+0000", 2024-09-13T05:10:54.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1321000000000003e-05 2024-09-13T05:10:54.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:54.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125403+0000", 2024-09-13T05:10:54.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6362e-05 2024-09-13T05:10:54.986 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:54.986 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:54.986 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:54.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.987 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2947 3.b 3:d32df763:::rbd_data.112d872fd67a.000000000000006b:head [stat,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:54.987 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.921206+0000", 2024-09-13T05:10:54.987 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.057480405, 2024-09-13T05:10:54.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095406580000000005, 2024-09-13T05:10:54.987 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:54.987 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:54.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:54.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:54.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:54.987 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2947 2024-09-13T05:10:54.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.987 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:54.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:54.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921206+0000", 2024-09-13T05:10:54.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:54.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:54.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921206+0000", 2024-09-13T05:10:54.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:54.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:54.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921205+0000", 2024-09-13T05:10:54.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:54.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:54.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921212+0000", 2024-09-13T05:10:54.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3300000000000001e-06 2024-09-13T05:10:54.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:54.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921232+0000", 2024-09-13T05:10:54.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9601000000000001e-05 2024-09-13T05:10:54.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921241+0000", 2024-09-13T05:10:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3230000000000004e-06 2024-09-13T05:10:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921297+0000", 2024-09-13T05:10:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5849e-05 2024-09-13T05:10:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921456+0000", 2024-09-13T05:10:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015864899999999999 2024-09-13T05:10:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.930747+0000", 2024-09-13T05:10:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092911450000000007 2024-09-13T05:10:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4911 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2801664~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.800434+0000", 2024-09-13T05:10:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.178252696999998, 2024-09-13T05:10:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096311120000000007, 2024-09-13T05:10:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4911 2024-09-13T05:10:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800434+0000", 2024-09-13T05:10:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800434+0000", 2024-09-13T05:10:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800433+0000", 2024-09-13T05:10:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800441+0000", 2024-09-13T05:10:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4699999999999996e-06 2024-09-13T05:10:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800450+0000", 2024-09-13T05:10:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6030000000000005e-06 2024-09-13T05:10:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800455+0000", 2024-09-13T05:10:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6019999999999999e-06 2024-09-13T05:10:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802738+0000", 2024-09-13T05:10:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022825089999999998 2024-09-13T05:10:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802849+0000", 2024-09-13T05:10:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110849 2024-09-13T05:10:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810065+0000", 2024-09-13T05:10:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072166419999999997 2024-09-13T05:10:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5028 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 1916928~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.801977+0000", 2024-09-13T05:10:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.176710155000002, 2024-09-13T05:10:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092754559999999996, 2024-09-13T05:10:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5028 2024-09-13T05:10:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801977+0000", 2024-09-13T05:10:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801977+0000", 2024-09-13T05:10:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801976+0000", 2024-09-13T05:10:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801979+0000", 2024-09-13T05:10:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.813e-06 2024-09-13T05:10:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801985+0000", 2024-09-13T05:10:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6640000000000003e-06 2024-09-13T05:10:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801989+0000", 2024-09-13T05:10:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5759999999999999e-06 2024-09-13T05:10:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810910+0000", 2024-09-13T05:10:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089204430000000001 2024-09-13T05:10:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811176+0000", 2024-09-13T05:10:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026676100000000002 2024-09-13T05:10:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811252+0000", 2024-09-13T05:10:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5655000000000007e-05 2024-09-13T05:10:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5030 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 1523712~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.801994+0000", 2024-09-13T05:10:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.176693004999997, 2024-09-13T05:10:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094030090000000004, 2024-09-13T05:10:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5030 2024-09-13T05:10:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801994+0000", 2024-09-13T05:10:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801994+0000", 2024-09-13T05:10:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801993+0000", 2024-09-13T05:10:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801997+0000", 2024-09-13T05:10:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2650000000000001e-06 2024-09-13T05:10:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802002+0000", 2024-09-13T05:10:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7389999999999996e-06 2024-09-13T05:10:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802007+0000", 2024-09-13T05:10:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5419999999999999e-06 2024-09-13T05:10:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811276+0000", 2024-09-13T05:10:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092691330000000006 2024-09-13T05:10:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811341+0000", 2024-09-13T05:10:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5028000000000001e-05 2024-09-13T05:10:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811397+0000", 2024-09-13T05:10:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5699000000000003e-05 2024-09-13T05:10:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5033 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2113536~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802011+0000", 2024-09-13T05:10:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.176675656999997, 2024-09-13T05:10:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095360380000000002, 2024-09-13T05:10:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5033 2024-09-13T05:10:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802011+0000", 2024-09-13T05:10:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802011+0000", 2024-09-13T05:10:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802011+0000", 2024-09-13T05:10:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802013+0000", 2024-09-13T05:10:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.131e-06 2024-09-13T05:10:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802019+0000", 2024-09-13T05:10:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8799999999999996e-06 2024-09-13T05:10:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802023+0000", 2024-09-13T05:10:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6829999999999999e-06 2024-09-13T05:10:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811423+0000", 2024-09-13T05:10:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093992139999999995 2024-09-13T05:10:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811475+0000", 2024-09-13T05:10:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2000999999999999e-05 2024-09-13T05:10:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811547+0000", 2024-09-13T05:10:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2465000000000005e-05 2024-09-13T05:10:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5036 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2703360~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802028+0000", 2024-09-13T05:10:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.176659204000003, 2024-09-13T05:10:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096685629999999998, 2024-09-13T05:10:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5036 2024-09-13T05:10:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802028+0000", 2024-09-13T05:10:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802028+0000", 2024-09-13T05:10:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802027+0000", 2024-09-13T05:10:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802030+0000", 2024-09-13T05:10:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3329999999999999e-06 2024-09-13T05:10:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802036+0000", 2024-09-13T05:10:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5610000000000004e-06 2024-09-13T05:10:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802041+0000", 2024-09-13T05:10:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9309999999999999e-06 2024-09-13T05:10:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811568+0000", 2024-09-13T05:10:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095272369999999992 2024-09-13T05:10:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811624+0000", 2024-09-13T05:10:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5673e-05 2024-09-13T05:10:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811696+0000", 2024-09-13T05:10:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2187999999999994e-05 2024-09-13T05:10:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5041 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2310144~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802046+0000", 2024-09-13T05:10:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.176641070999999, 2024-09-13T05:10:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097718389999999992, 2024-09-13T05:10:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5041 2024-09-13T05:10:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802046+0000", 2024-09-13T05:10:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802046+0000", 2024-09-13T05:10:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802045+0000", 2024-09-13T05:10:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802047+0000", 2024-09-13T05:10:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1799999999999999e-06 2024-09-13T05:10:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802053+0000", 2024-09-13T05:10:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.507e-06 2024-09-13T05:10:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802057+0000", 2024-09-13T05:10:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3590000000000001e-06 2024-09-13T05:10:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811713+0000", 2024-09-13T05:10:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096553400000000001 2024-09-13T05:10:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811763+0000", 2024-09-13T05:10:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0050999999999999e-05 2024-09-13T05:10:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811818+0000", 2024-09-13T05:10:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4777000000000001e-05 2024-09-13T05:10:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5044 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2899968~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802062+0000", 2024-09-13T05:10:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.176625086999998, 2024-09-13T05:10:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0099015260000000008, 2024-09-13T05:10:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5044 2024-09-13T05:10:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802062+0000", 2024-09-13T05:10:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802062+0000", 2024-09-13T05:10:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802061+0000", 2024-09-13T05:10:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802064+0000", 2024-09-13T05:10:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0740000000000001e-06 2024-09-13T05:10:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802070+0000", 2024-09-13T05:10:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8560000000000003e-06 2024-09-13T05:10:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802075+0000", 2024-09-13T05:10:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6360000000000002e-06 2024-09-13T05:10:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811834+0000", 2024-09-13T05:10:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097588710000000006 2024-09-13T05:10:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811878+0000", 2024-09-13T05:10:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3937999999999998e-05 2024-09-13T05:10:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811963+0000", 2024-09-13T05:10:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5505000000000002e-05 2024-09-13T05:10:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5049 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2506752~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802080+0000", 2024-09-13T05:10:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.176607203000003, 2024-09-13T05:10:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010051279, 2024-09-13T05:10:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5049 2024-09-13T05:10:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802080+0000", 2024-09-13T05:10:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802080+0000", 2024-09-13T05:10:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802079+0000", 2024-09-13T05:10:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802081+0000", 2024-09-13T05:10:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2740000000000002e-06 2024-09-13T05:10:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802088+0000", 2024-09-13T05:10:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.567e-06 2024-09-13T05:10:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802093+0000", 2024-09-13T05:10:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8609999999999997e-06 2024-09-13T05:10:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811989+0000", 2024-09-13T05:10:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0098961840000000006 2024-09-13T05:10:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812069+0000", 2024-09-13T05:10:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9534000000000001e-05 2024-09-13T05:10:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812131+0000", 2024-09-13T05:10:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2206999999999996e-05 2024-09-13T05:10:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5052 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 3096576~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:10:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802097+0000", 2024-09-13T05:10:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.176589972999999, 2024-09-13T05:10:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010227615000000001, 2024-09-13T05:10:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5052 2024-09-13T05:10:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802097+0000", 2024-09-13T05:10:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802097+0000", 2024-09-13T05:10:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802096+0000", 2024-09-13T05:10:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802099+0000", 2024-09-13T05:10:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3539999999999998e-06 2024-09-13T05:10:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802105+0000", 2024-09-13T05:10:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8440000000000003e-06 2024-09-13T05:10:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802109+0000", 2024-09-13T05:10:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6800000000000001e-06 2024-09-13T05:10:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812155+0000", 2024-09-13T05:10:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010045691000000001 2024-09-13T05:10:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812238+0000", 2024-09-13T05:10:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2855000000000005e-05 2024-09-13T05:10:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812324+0000", 2024-09-13T05:10:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6621999999999998e-05 2024-09-13T05:10:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:7377 3.1e 3:7d4eb93d:::rbd_header.112d1304fe95:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-13T05:10:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:24.742504+0000", 2024-09-13T05:10:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.236182849999999, 2024-09-13T05:10:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01013406, 2024-09-13T05:10:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7377 2024-09-13T05:10:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742504+0000", 2024-09-13T05:10:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742504+0000", 2024-09-13T05:10:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742500+0000", 2024-09-13T05:10:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999962 2024-09-13T05:10:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742522+0000", 2024-09-13T05:10:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2310000000000002e-05 2024-09-13T05:10:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742572+0000", 2024-09-13T05:10:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9872e-05 2024-09-13T05:10:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742597+0000", 2024-09-13T05:10:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4363e-05 2024-09-13T05:10:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742678+0000", 2024-09-13T05:10:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1370000000000002e-05 2024-09-13T05:10:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-13T05:10:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742686+0000", 2024-09-13T05:10:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5259999999999993e-06 2024-09-13T05:10:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.749024+0000", 2024-09-13T05:10:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006337372 2024-09-13T05:10:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.749278+0000", 2024-09-13T05:10:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025436399999999998 2024-09-13T05:10:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:10:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.750557+0000", 2024-09-13T05:10:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012787129999999999 2024-09-13T05:10:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.751774+0000", 2024-09-13T05:10:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001217054 2024-09-13T05:10:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.752530+0000", 2024-09-13T05:10:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075635999999999998 2024-09-13T05:10:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.752592+0000", 2024-09-13T05:10:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1486000000000001e-05 2024-09-13T05:10:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.752638+0000", 2024-09-13T05:10:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6140000000000002e-05 2024-09-13T05:10:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:7961 3.18 3:184d9aea:::rbd_data.112db57f3a18.000000000000002b:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-13T05:10:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:10:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.901681630999999, 2024-09-13T05:10:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.040271084999999998, 2024-09-13T05:10:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7961 2024-09-13T05:10:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:10:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:10:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077003+0000", 2024-09-13T05:10:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077013+0000", 2024-09-13T05:10:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6870000000000006e-06 2024-09-13T05:10:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077029+0000", 2024-09-13T05:10:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6314e-05 2024-09-13T05:10:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077038+0000", 2024-09-13T05:10:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5019999999999992e-06 2024-09-13T05:10:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077099+0000", 2024-09-13T05:10:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1444000000000003e-05 2024-09-13T05:10:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077234+0000", 2024-09-13T05:10:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013461300000000001 2024-09-13T05:10:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.085202+0000", 2024-09-13T05:10:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079680140000000007 2024-09-13T05:10:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116860+0000", 2024-09-13T05:10:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.031658190000000003 2024-09-13T05:10:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116995+0000", 2024-09-13T05:10:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000135601 2024-09-13T05:10:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117152+0000", 2024-09-13T05:10:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015681700000000001 2024-09-13T05:10:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117276+0000", 2024-09-13T05:10:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012392699999999999 2024-09-13T05:10:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4397.0:7961 3.18 e35/22 ondisk, result = 0)", 2024-09-13T05:10:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.104860+0000", 2024-09-13T05:10:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.873826612999999, 2024-09-13T05:10:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012435735999999999, 2024-09-13T05:10:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104860+0000", 2024-09-13T05:10:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104860+0000", 2024-09-13T05:10:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104859+0000", 2024-09-13T05:10:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104866+0000", 2024-09-13T05:10:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0840000000000003e-06 2024-09-13T05:10:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104882+0000", 2024-09-13T05:10:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5705e-05 2024-09-13T05:10:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104890+0000", 2024-09-13T05:10:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5110000000000003e-06 2024-09-13T05:10:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116937+0000", 2024-09-13T05:10:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012046563999999999 2024-09-13T05:10:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116975+0000", 2024-09-13T05:10:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8243e-05 2024-09-13T05:10:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117296+0000", 2024-09-13T05:10:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032082299999999997 2024-09-13T05:10:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:8105 3.b 3:d2ae8f7b:::rbd_data.112db57f3a18.0000000000000028:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-13T05:10:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:10:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.666585824999999, 2024-09-13T05:10:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.040653913, 2024-09-13T05:10:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 8105 2024-09-13T05:10:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:10:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:10:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312099+0000", 2024-09-13T05:10:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312109+0000", 2024-09-13T05:10:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0244999999999999e-05 2024-09-13T05:10:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312129+0000", 2024-09-13T05:10:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9751000000000001e-05 2024-09-13T05:10:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312141+0000", 2024-09-13T05:10:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2201999999999999e-05 2024-09-13T05:10:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312230+0000", 2024-09-13T05:10:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9092999999999996e-05 2024-09-13T05:10:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312433+0000", 2024-09-13T05:10:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020240500000000001 2024-09-13T05:10:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-13T05:10:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.320357+0000", 2024-09-13T05:10:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079242630000000008 2024-09-13T05:10:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352488+0000", 2024-09-13T05:10:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032131588000000003 2024-09-13T05:10:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352533+0000", 2024-09-13T05:10:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4601999999999997e-05 2024-09-13T05:10:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352636+0000", 2024-09-13T05:10:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103041 2024-09-13T05:10:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352755+0000", 2024-09-13T05:10:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118814 2024-09-13T05:10:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4397.0:8105 3.b e35/22 ondisk, result = 0)", 2024-09-13T05:10:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.342777+0000", 2024-09-13T05:10:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.635909616999999, 2024-09-13T05:10:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097182480000000005, 2024-09-13T05:10:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342777+0000", 2024-09-13T05:10:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342777+0000", 2024-09-13T05:10:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342776+0000", 2024-09-13T05:10:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342786+0000", 2024-09-13T05:10:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0298e-05 2024-09-13T05:10:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342809+0000", 2024-09-13T05:10:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3346999999999999e-05 2024-09-13T05:10:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342822+0000", 2024-09-13T05:10:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2717e-05 2024-09-13T05:10:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352456+0000", 2024-09-13T05:10:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096335659999999997 2024-09-13T05:10:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352474+0000", 2024-09-13T05:10:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8776000000000001e-05 2024-09-13T05:10:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352495+0000", 2024-09-13T05:10:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.107e-05 2024-09-13T05:10:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:39305 3.1e 3:79249bf8:::rbd_data.112dcff96bbd.0000000000000003:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-13T05:10:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:41.473278+0000", 2024-09-13T05:10:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.505409229, 2024-09-13T05:10:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027037510000000001, 2024-09-13T05:10:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 39305 2024-09-13T05:10:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473278+0000", 2024-09-13T05:10:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473278+0000", 2024-09-13T05:10:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473276+0000", 2024-09-13T05:10:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473285+0000", 2024-09-13T05:10:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0129999999999999e-06 2024-09-13T05:10:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473304+0000", 2024-09-13T05:10:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8723e-05 2024-09-13T05:10:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473313+0000", 2024-09-13T05:10:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1419999999999999e-06 2024-09-13T05:10:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473390+0000", 2024-09-13T05:10:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7001000000000004e-05 2024-09-13T05:10:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473496+0000", 2024-09-13T05:10:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010577399999999999 2024-09-13T05:10:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:10:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.478499+0000", 2024-09-13T05:10:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050029260000000004 2024-09-13T05:10:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500153+0000", 2024-09-13T05:10:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021654421 2024-09-13T05:10:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500216+0000", 2024-09-13T05:10:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3233999999999998e-05 2024-09-13T05:10:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500273+0000", 2024-09-13T05:10:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6484000000000003e-05 2024-09-13T05:10:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500315+0000", 2024-09-13T05:10:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2342000000000002e-05 2024-09-13T05:10:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:40934 3.1 3:86cdeb48:::rbd_data.112d4ab2162d.0000000000000103:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-13T05:10:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:46.247357+0000", 2024-09-13T05:10:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.7313299909999991, 2024-09-13T05:10:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028923379999999999, 2024-09-13T05:10:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 40934 2024-09-13T05:10:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247357+0000", 2024-09-13T05:10:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247357+0000", 2024-09-13T05:10:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247354+0000", 2024-09-13T05:10:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:10:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247371+0000", 2024-09-13T05:10:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6697e-05 2024-09-13T05:10:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247403+0000", 2024-09-13T05:10:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1649000000000001e-05 2024-09-13T05:10:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247417+0000", 2024-09-13T05:10:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.395e-05 2024-09-13T05:10:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247498+0000", 2024-09-13T05:10:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1011000000000001e-05 2024-09-13T05:10:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247757+0000", 2024-09-13T05:10:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000258872 2024-09-13T05:10:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:10:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.254874+0000", 2024-09-13T05:10:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071176449999999997 2024-09-13T05:10:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.275876+0000", 2024-09-13T05:10:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021001770999999999 2024-09-13T05:10:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.275989+0000", 2024-09-13T05:10:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011301199999999999 2024-09-13T05:10:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.276156+0000", 2024-09-13T05:10:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000167453 2024-09-13T05:10:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.276280+0000", 2024-09-13T05:10:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012369400000000001 2024-09-13T05:10:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:45910 3.a 3:56753852:::rbd_header.112d678e2955:head [call,call rbd.parent_overlap_get in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e58)", 2024-09-13T05:10:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:50.370028+0000", 2024-09-13T05:10:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.608659243, 2024-09-13T05:10:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048450024000000001, 2024-09-13T05:10:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:10:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45910 2024-09-13T05:10:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370028+0000", 2024-09-13T05:10:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370028+0000", 2024-09-13T05:10:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370027+0000", 2024-09-13T05:10:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:10:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370031+0000", 2024-09-13T05:10:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6530000000000002e-06 2024-09-13T05:10:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370038+0000", 2024-09-13T05:10:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8959999999999997e-06 2024-09-13T05:10:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370043+0000", 2024-09-13T05:10:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3680000000000004e-06 2024-09-13T05:10:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370076+0000", 2024-09-13T05:10:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3411000000000002e-05 2024-09-13T05:10:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370125+0000", 2024-09-13T05:10:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8593e-05 2024-09-13T05:10:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.418478+0000", 2024-09-13T05:10:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048352978999999997 2024-09-13T05:10:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:46246 3.1e 3:7bf44c0b:::rbd_data.112d678e2955.000000000000013a:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-13T05:10:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:50.821618+0000", 2024-09-13T05:10:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.1570688279999999, 2024-09-13T05:10:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093094630000000005, 2024-09-13T05:10:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:10:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:10:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:10:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 46246 2024-09-13T05:10:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:10:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:10:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.821618+0000", 2024-09-13T05:10:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:10:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.821618+0000", 2024-09-13T05:10:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:10:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:10:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.821616+0000", 2024-09-13T05:10:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:10:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.821626+0000", 2024-09-13T05:10:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0002e-05 2024-09-13T05:10:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:10:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.821649+0000", 2024-09-13T05:10:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2435000000000001e-05 2024-09-13T05:10:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.821660+0000", 2024-09-13T05:10:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0767e-05 2024-09-13T05:10:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:10:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.821734+0000", 2024-09-13T05:10:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4406999999999994e-05 2024-09-13T05:10:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:10:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.821916+0000", 2024-09-13T05:10:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000181891 2024-09-13T05:10:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:10:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.823549+0000", 2024-09-13T05:10:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016331029999999999 2024-09-13T05:10:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.830818+0000", 2024-09-13T05:10:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072692240000000003 2024-09-13T05:10:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:10:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.830845+0000", 2024-09-13T05:10:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7260999999999999e-05 2024-09-13T05:10:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:10:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.830885+0000", 2024-09-13T05:10:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9938000000000003e-05 2024-09-13T05:10:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:10:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:10:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:10:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.830927+0000", 2024-09-13T05:10:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2021000000000003e-05 2024-09-13T05:10:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:10:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:10:55.083 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:55.084 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:55.084 INFO:teuthology.orchestra.run.smithi120.stdout:1794 write 0x1e5c5b1 thru 0x1e67956 (0xb3a6 bytes) 2024-09-13T05:10:55.085 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:10:55.086 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:10:55.086 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:10:55.086 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:10:55.086 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:10:55.086 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:10:55.086 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:10:55.086 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:10:55.086 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:10:55.086 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:10:55.087 INFO:teuthology.orchestra.run.smithi120.stdout:1796 punch from 0x20d7087 to 0x20d8fa8, (0x1f21 bytes) 2024-09-13T05:10:55.088 INFO:teuthology.orchestra.run.smithi120.stdout:1797 writesame 0x86b016a thru 0x86b303a data_size 0x5(0x2ed1 bytes) 2024-09-13T05:10:55.088 INFO:teuthology.orchestra.run.smithi120.stdout:1798 clone 17 order 18 su 131072 sc 9 2024-09-13T05:10:55.088 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-13T05:10:55.088 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:55.088 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:55.077+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:55.185 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:55.182+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:55.212 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:55.212 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:55.212 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:55.212 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:55.222 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:10:55.286 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:55.282+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:55.329 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:55.329 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:55.329 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:55.329 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:55.329 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:55.339 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:10:55.387 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:55.381+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:55.451 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:55.451 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:55.451 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:55.451 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [] 2024-09-13T05:10:55.452 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:55.461 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:10:55.488 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:55.481+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:55.568 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:55.568 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:55.569 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:55.569 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:55.578 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:10:55.588 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:55.582+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:55.688 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:55.688 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:55.688 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:55.688 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:55.688 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:55.689 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:55.686+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:55.697 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:10:55.791 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:55.786+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:55.805 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:55.806 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:55.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:55.806 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:10:55.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.806 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47581 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15532032~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:10:55.806 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.439908+0000", 2024-09-13T05:10:55.806 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.3638629729999998, 2024-09-13T05:10:55.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031694137999999997, 2024-09-13T05:10:55.806 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:55.807 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:55.807 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:55.807 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:55.807 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.807 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47581 2024-09-13T05:10:55.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.807 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:55.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:55.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439908+0000", 2024-09-13T05:10:55.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:55.808 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439908+0000", 2024-09-13T05:10:55.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.808 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:55.808 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439907+0000", 2024-09-13T05:10:55.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:55.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.808 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:55.808 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439911+0000", 2024-09-13T05:10:55.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6370000000000001e-06 2024-09-13T05:10:55.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.809 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.809 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:55.809 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439923+0000", 2024-09-13T05:10:55.809 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.217e-05 2024-09-13T05:10:55.809 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.809 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.809 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439933+0000", 2024-09-13T05:10:55.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0273e-05 2024-09-13T05:10:55.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:55.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.471000+0000", 2024-09-13T05:10:55.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031067230000000001 2024-09-13T05:10:55.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:55.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.471092+0000", 2024-09-13T05:10:55.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1916000000000006e-05 2024-09-13T05:10:55.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:55.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.471602+0000", 2024-09-13T05:10:55.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00050951200000000005 2024-09-13T05:10:55.815 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.815 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:55.815 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.815 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.815 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47582 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15826944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:10:55.815 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.439939+0000", 2024-09-13T05:10:55.815 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.3638314400000002, 2024-09-13T05:10:55.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032266203, 2024-09-13T05:10:55.816 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:55.816 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:55.816 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:55.816 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:55.816 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.816 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47582 2024-09-13T05:10:55.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.816 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:55.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:55.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439939+0000", 2024-09-13T05:10:55.816 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:55.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439939+0000", 2024-09-13T05:10:55.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:55.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439939+0000", 2024-09-13T05:10:55.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:55.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:55.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439949+0000", 2024-09-13T05:10:55.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0906e-05 2024-09-13T05:10:55.818 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:55.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439962+0000", 2024-09-13T05:10:55.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2373e-05 2024-09-13T05:10:55.818 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439969+0000", 2024-09-13T05:10:55.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0570000000000004e-06 2024-09-13T05:10:55.818 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.819 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:55.819 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.471645+0000", 2024-09-13T05:10:55.819 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031676530000000001 2024-09-13T05:10:55.819 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.819 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.819 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:55.819 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.471775+0000", 2024-09-13T05:10:55.819 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000129591 2024-09-13T05:10:55.819 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.819 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.819 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:55.819 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472205+0000", 2024-09-13T05:10:55.819 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00043034900000000001 2024-09-13T05:10:55.820 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.820 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:55.820 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.820 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47583 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16121856~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:10:55.820 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.439975+0000", 2024-09-13T05:10:55.820 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.3637956339999997, 2024-09-13T05:10:55.820 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032777897, 2024-09-13T05:10:55.820 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:55.820 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:55.820 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:55.821 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:55.821 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.821 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47583 2024-09-13T05:10:55.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.821 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:55.821 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.821 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:55.821 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439975+0000", 2024-09-13T05:10:55.821 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.821 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.821 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:55.821 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439975+0000", 2024-09-13T05:10:55.821 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.822 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.822 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.822 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:55.822 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439974+0000", 2024-09-13T05:10:55.822 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:55.822 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.822 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.822 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:55.822 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439978+0000", 2024-09-13T05:10:55.822 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5729999999999999e-06 2024-09-13T05:10:55.822 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.822 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.822 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:55.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439991+0000", 2024-09-13T05:10:55.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3465999999999999e-05 2024-09-13T05:10:55.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439998+0000", 2024-09-13T05:10:55.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8369999999999999e-06 2024-09-13T05:10:55.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:55.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472272+0000", 2024-09-13T05:10:55.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032273617999999997 2024-09-13T05:10:55.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.824 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:55.824 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472382+0000", 2024-09-13T05:10:55.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000109845 2024-09-13T05:10:55.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.824 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:55.824 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472753+0000", 2024-09-13T05:10:55.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00037116100000000001 2024-09-13T05:10:55.824 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.824 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:55.824 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.825 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47584 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16416768~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:10:55.825 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440004+0000", 2024-09-13T05:10:55.825 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.363766568, 2024-09-13T05:10:55.825 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033357242000000002, 2024-09-13T05:10:55.825 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:55.825 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:55.825 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:55.825 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:55.825 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.825 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47584 2024-09-13T05:10:55.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.825 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:55.825 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.826 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:55.826 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440004+0000", 2024-09-13T05:10:55.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.826 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.826 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:55.826 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440004+0000", 2024-09-13T05:10:55.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.826 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.826 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:55.826 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440003+0000", 2024-09-13T05:10:55.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:55.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.826 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.827 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:55.827 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440007+0000", 2024-09-13T05:10:55.827 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9099999999999998e-06 2024-09-13T05:10:55.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.827 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.827 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:55.827 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440020+0000", 2024-09-13T05:10:55.827 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2330000000000001e-05 2024-09-13T05:10:55.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.827 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.827 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.827 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440026+0000", 2024-09-13T05:10:55.827 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7700000000000004e-06 2024-09-13T05:10:55.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.828 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.828 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:55.828 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472807+0000", 2024-09-13T05:10:55.828 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032780431999999998 2024-09-13T05:10:55.828 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.828 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.828 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:55.828 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472927+0000", 2024-09-13T05:10:55.828 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000119645 2024-09-13T05:10:55.828 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.828 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.828 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:55.828 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473361+0000", 2024-09-13T05:10:55.829 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000434745 2024-09-13T05:10:55.829 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.829 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:55.829 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.829 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47585 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16711680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:10:55.829 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440033+0000", 2024-09-13T05:10:55.829 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.3637380319999997, 2024-09-13T05:10:55.829 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033917665999999999, 2024-09-13T05:10:55.829 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:55.829 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:55.829 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:55.830 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:55.830 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.830 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47585 2024-09-13T05:10:55.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.830 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:55.830 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.830 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:55.830 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440033+0000", 2024-09-13T05:10:55.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.830 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.830 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:55.830 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440033+0000", 2024-09-13T05:10:55.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.831 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.831 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:55.831 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440032+0000", 2024-09-13T05:10:55.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:55.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.831 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.831 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:55.831 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440036+0000", 2024-09-13T05:10:55.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.676e-06 2024-09-13T05:10:55.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.831 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.831 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:55.831 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440049+0000", 2024-09-13T05:10:55.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3142999999999999e-05 2024-09-13T05:10:55.832 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.832 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.832 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.832 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440056+0000", 2024-09-13T05:10:55.832 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.827e-06 2024-09-13T05:10:55.832 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.832 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.832 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:55.832 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473451+0000", 2024-09-13T05:10:55.832 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033395344 2024-09-13T05:10:55.832 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.832 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.832 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:55.833 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473565+0000", 2024-09-13T05:10:55.833 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011377700000000001 2024-09-13T05:10:55.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.833 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.833 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:55.833 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473950+0000", 2024-09-13T05:10:55.833 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00038550200000000002 2024-09-13T05:10:55.833 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.833 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:55.833 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.833 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.833 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47589 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15564800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:10:55.834 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440062+0000", 2024-09-13T05:10:55.834 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.3637090460000003, 2024-09-13T05:10:55.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034520812999999997, 2024-09-13T05:10:55.834 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:55.834 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:55.834 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:55.834 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:55.834 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.834 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47589 2024-09-13T05:10:55.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.834 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:55.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:55.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440062+0000", 2024-09-13T05:10:55.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.835 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:55.835 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440062+0000", 2024-09-13T05:10:55.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.835 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:55.835 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440061+0000", 2024-09-13T05:10:55.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:55.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.835 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:55.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440064+0000", 2024-09-13T05:10:55.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4029999999999999e-06 2024-09-13T05:10:55.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.836 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:55.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440072+0000", 2024-09-13T05:10:55.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.79e-06 2024-09-13T05:10:55.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.836 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440079+0000", 2024-09-13T05:10:55.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.81e-06 2024-09-13T05:10:55.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.837 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:55.837 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474016+0000", 2024-09-13T05:10:55.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033936858 2024-09-13T05:10:55.837 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.837 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.837 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:55.837 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474143+0000", 2024-09-13T05:10:55.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012673599999999999 2024-09-13T05:10:55.837 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.837 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.837 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:55.837 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474582+0000", 2024-09-13T05:10:55.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00043982199999999998 2024-09-13T05:10:55.837 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.838 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:55.838 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.838 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.838 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.838 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47590 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15859712~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:10:55.838 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440085+0000", 2024-09-13T05:10:55.838 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.363686103, 2024-09-13T05:10:55.838 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035003000999999999, 2024-09-13T05:10:55.838 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:55.838 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:55.838 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:55.838 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:55.838 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.838 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47590 2024-09-13T05:10:55.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.839 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:55.839 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.839 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:55.839 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440085+0000", 2024-09-13T05:10:55.839 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.839 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.839 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:55.839 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440085+0000", 2024-09-13T05:10:55.839 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.839 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.839 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:55.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440084+0000", 2024-09-13T05:10:55.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:55.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.840 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:55.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440088+0000", 2024-09-13T05:10:55.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7759999999999999e-06 2024-09-13T05:10:55.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.840 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:55.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440100+0000", 2024-09-13T05:10:55.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2537e-05 2024-09-13T05:10:55.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.841 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.841 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440107+0000", 2024-09-13T05:10:55.841 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.046e-06 2024-09-13T05:10:55.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.841 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.841 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:55.841 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474648+0000", 2024-09-13T05:10:55.841 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034540803000000002 2024-09-13T05:10:55.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.841 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.841 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:55.841 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474721+0000", 2024-09-13T05:10:55.841 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2890000000000002e-05 2024-09-13T05:10:55.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.842 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.842 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:55.842 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475088+0000", 2024-09-13T05:10:55.842 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00036654199999999997 2024-09-13T05:10:55.842 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.842 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:55.842 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.842 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.842 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.842 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47591 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16154624~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:10:55.842 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440113+0000", 2024-09-13T05:10:55.842 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.363657527, 2024-09-13T05:10:55.842 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035632759, 2024-09-13T05:10:55.843 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:55.843 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:55.843 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:55.843 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:55.843 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.843 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47591 2024-09-13T05:10:55.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.843 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:55.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.843 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:55.843 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440113+0000", 2024-09-13T05:10:55.843 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.844 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:55.844 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440113+0000", 2024-09-13T05:10:55.844 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.844 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.844 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.844 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:55.844 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440112+0000", 2024-09-13T05:10:55.844 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:55.844 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.844 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.844 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:55.844 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440117+0000", 2024-09-13T05:10:55.844 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0199999999999996e-06 2024-09-13T05:10:55.845 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.845 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.845 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:55.845 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440129+0000", 2024-09-13T05:10:55.845 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2571999999999999e-05 2024-09-13T05:10:55.845 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.845 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.845 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.845 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440136+0000", 2024-09-13T05:10:55.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8870000000000003e-06 2024-09-13T05:10:55.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:55.846 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475160+0000", 2024-09-13T05:10:55.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035024287000000001 2024-09-13T05:10:55.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:55.846 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475294+0000", 2024-09-13T05:10:55.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013386600000000001 2024-09-13T05:10:55.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:55.847 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475746+0000", 2024-09-13T05:10:55.847 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00045173300000000001 2024-09-13T05:10:55.847 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.847 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:55.847 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.847 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.847 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.847 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47592 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16449536~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:10:55.847 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440142+0000", 2024-09-13T05:10:55.847 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.3636288680000002, 2024-09-13T05:10:55.847 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036117556000000002, 2024-09-13T05:10:55.847 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:55.847 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:55.848 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:55.848 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:55.848 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.848 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47592 2024-09-13T05:10:55.848 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.848 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:55.848 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.848 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:55.848 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440142+0000", 2024-09-13T05:10:55.848 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.848 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.848 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.848 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:55.848 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440142+0000", 2024-09-13T05:10:55.849 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.849 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.849 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.849 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:55.849 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440141+0000", 2024-09-13T05:10:55.849 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:55.849 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.849 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.849 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:55.849 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440145+0000", 2024-09-13T05:10:55.849 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5939999999999998e-06 2024-09-13T05:10:55.849 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.849 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.850 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:55.850 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440162+0000", 2024-09-13T05:10:55.850 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7102999999999999e-05 2024-09-13T05:10:55.850 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.850 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.850 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.850 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440169+0000", 2024-09-13T05:10:55.850 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0330000000000003e-06 2024-09-13T05:10:55.850 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.850 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.850 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:55.850 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475812+0000", 2024-09-13T05:10:55.850 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035643542 2024-09-13T05:10:55.851 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.851 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.851 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:55.851 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475899+0000", 2024-09-13T05:10:55.851 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6827000000000001e-05 2024-09-13T05:10:55.851 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.851 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.851 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:55.851 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476259+0000", 2024-09-13T05:10:55.851 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000360057 2024-09-13T05:10:55.852 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.852 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:55.852 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.852 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.852 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.852 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47593 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16744448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:10:55.852 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440175+0000", 2024-09-13T05:10:55.852 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.3635959120000001, 2024-09-13T05:10:55.852 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036661306999999997, 2024-09-13T05:10:55.852 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:55.852 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:55.852 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:55.853 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:55.853 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.853 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47593 2024-09-13T05:10:55.853 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.853 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:55.853 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.853 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:55.853 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440175+0000", 2024-09-13T05:10:55.854 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.854 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.854 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.854 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:55.854 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440175+0000", 2024-09-13T05:10:55.854 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.854 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.854 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.854 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:55.854 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440174+0000", 2024-09-13T05:10:55.854 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:55.854 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.854 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.855 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:55.855 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440178+0000", 2024-09-13T05:10:55.855 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.687e-06 2024-09-13T05:10:55.855 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.855 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.855 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:55.855 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440187+0000", 2024-09-13T05:10:55.855 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6029999999999994e-06 2024-09-13T05:10:55.855 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.855 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.855 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.855 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440194+0000", 2024-09-13T05:10:55.855 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8600000000000004e-06 2024-09-13T05:10:55.855 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.856 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.856 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:55.856 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476312+0000", 2024-09-13T05:10:55.856 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036117727000000002 2024-09-13T05:10:55.856 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.856 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.856 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:55.856 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476436+0000", 2024-09-13T05:10:55.856 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012370600000000001 2024-09-13T05:10:55.856 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.857 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.857 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:55.857 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476836+0000", 2024-09-13T05:10:55.857 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00040031399999999998 2024-09-13T05:10:55.857 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.857 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:55.857 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.857 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.857 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.857 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47597 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15597568~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:10:55.857 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440735+0000", 2024-09-13T05:10:55.857 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.3630359199999997, 2024-09-13T05:10:55.857 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036742364, 2024-09-13T05:10:55.857 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:55.858 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:55.858 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:55.858 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:55.858 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.858 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47597 2024-09-13T05:10:55.858 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.858 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:55.858 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.858 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:55.858 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440735+0000", 2024-09-13T05:10:55.858 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.858 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.858 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.858 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:55.858 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440735+0000", 2024-09-13T05:10:55.859 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.859 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.859 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.859 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:55.859 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440733+0000", 2024-09-13T05:10:55.859 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:10:55.859 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.859 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.859 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:55.859 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440741+0000", 2024-09-13T05:10:55.859 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7100000000000007e-06 2024-09-13T05:10:55.859 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.859 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.859 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:55.859 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440774+0000", 2024-09-13T05:10:55.860 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3062999999999998e-05 2024-09-13T05:10:55.860 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.860 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.860 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.860 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440784+0000", 2024-09-13T05:10:55.860 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6630000000000005e-06 2024-09-13T05:10:55.860 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.860 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.860 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:55.860 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476899+0000", 2024-09-13T05:10:55.860 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036115188999999999 2024-09-13T05:10:55.860 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.860 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.860 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:55.861 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477036+0000", 2024-09-13T05:10:55.861 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000136907 2024-09-13T05:10:55.861 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.861 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.861 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:55.861 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477477+0000", 2024-09-13T05:10:55.861 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00044140899999999997 2024-09-13T05:10:55.861 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.861 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:55.861 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.861 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.861 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.861 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47598 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15892480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:10:55.862 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:10:55.862 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.3629661850000003, 2024-09-13T05:10:55.862 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037255732, 2024-09-13T05:10:55.862 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:55.862 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:55.862 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:55.862 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:55.862 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.862 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47598 2024-09-13T05:10:55.862 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.862 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:55.862 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.862 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:55.862 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:10:55.863 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.863 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.863 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.863 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:55.863 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:10:55.863 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.863 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.863 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.863 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:55.863 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:10:55.863 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:55.863 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.863 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.864 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:55.864 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440809+0000", 2024-09-13T05:10:55.864 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.237e-06 2024-09-13T05:10:55.864 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.864 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.864 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:55.864 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440823+0000", 2024-09-13T05:10:55.864 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4426e-05 2024-09-13T05:10:55.864 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.864 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.864 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.864 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440831+0000", 2024-09-13T05:10:55.864 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6669999999999996e-06 2024-09-13T05:10:55.864 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.865 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.865 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:55.865 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477508+0000", 2024-09-13T05:10:55.865 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036677354000000002 2024-09-13T05:10:55.865 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.865 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.865 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:55.865 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477571+0000", 2024-09-13T05:10:55.865 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2271000000000001e-05 2024-09-13T05:10:55.865 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.865 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.865 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:55.865 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478060+0000", 2024-09-13T05:10:55.865 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00048954399999999996 2024-09-13T05:10:55.866 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.866 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:55.866 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.866 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.866 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.866 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47599 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16187392~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:10:55.866 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:10:55.866 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.3629332429999996, 2024-09-13T05:10:55.866 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037806671, 2024-09-13T05:10:55.866 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:55.866 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:55.866 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:55.866 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:55.867 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.867 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47599 2024-09-13T05:10:55.867 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.867 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:55.867 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.867 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:55.867 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:10:55.867 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.867 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.867 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.867 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:55.867 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:10:55.867 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.867 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.868 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.868 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:55.868 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:10:55.868 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:55.868 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.868 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.868 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:55.868 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440841+0000", 2024-09-13T05:10:55.868 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1699999999999999e-06 2024-09-13T05:10:55.868 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.868 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.868 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:55.868 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440853+0000", 2024-09-13T05:10:55.869 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2466000000000001e-05 2024-09-13T05:10:55.869 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.869 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.869 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.869 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440860+0000", 2024-09-13T05:10:55.869 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8970000000000002e-06 2024-09-13T05:10:55.869 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.869 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.869 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:55.869 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478100+0000", 2024-09-13T05:10:55.869 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037239398 2024-09-13T05:10:55.869 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.869 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.869 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:55.870 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478173+0000", 2024-09-13T05:10:55.870 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3784999999999999e-05 2024-09-13T05:10:55.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.870 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.870 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:55.870 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478644+0000", 2024-09-13T05:10:55.870 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00047058100000000003 2024-09-13T05:10:55.870 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.870 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:55.870 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.870 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.870 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47600 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16482304~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:10:55.871 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:10:55.871 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.3629042690000004, 2024-09-13T05:10:55.871 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038539524999999998, 2024-09-13T05:10:55.871 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:55.871 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:55.871 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:55.871 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:55.871 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.871 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47600 2024-09-13T05:10:55.871 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.871 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:55.871 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.871 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:55.871 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:10:55.872 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.872 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.872 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.872 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:55.872 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:10:55.872 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.872 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.872 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.872 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:55.872 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:10:55.872 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:55.872 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.873 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.873 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:55.873 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440869+0000", 2024-09-13T05:10:55.873 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6229999999999999e-06 2024-09-13T05:10:55.873 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.873 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.873 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:55.873 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440877+0000", 2024-09-13T05:10:55.873 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9289999999999998e-06 2024-09-13T05:10:55.873 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.873 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.873 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.873 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440884+0000", 2024-09-13T05:10:55.873 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9569999999999996e-06 2024-09-13T05:10:55.874 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.874 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.874 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:55.874 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478694+0000", 2024-09-13T05:10:55.874 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037809597 2024-09-13T05:10:55.874 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.874 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.874 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:55.874 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478907+0000", 2024-09-13T05:10:55.874 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021332799999999999 2024-09-13T05:10:55.874 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.874 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.874 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:55.874 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479406+0000", 2024-09-13T05:10:55.875 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00049870100000000005 2024-09-13T05:10:55.875 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.875 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:55.875 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.875 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.875 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47605 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15630336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:10:55.875 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.445919+0000", 2024-09-13T05:10:55.875 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.3578519, 2024-09-13T05:10:55.875 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034071010999999998, 2024-09-13T05:10:55.875 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:55.875 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:55.875 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:55.875 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:55.876 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.876 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47605 2024-09-13T05:10:55.876 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.876 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:55.876 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.876 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:55.876 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445919+0000", 2024-09-13T05:10:55.876 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.876 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.876 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.876 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:55.876 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445919+0000", 2024-09-13T05:10:55.876 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.876 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.877 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.877 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:55.877 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445917+0000", 2024-09-13T05:10:55.877 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:55.877 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.877 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.877 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:55.877 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445928+0000", 2024-09-13T05:10:55.877 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1413000000000001e-05 2024-09-13T05:10:55.877 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.877 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.877 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:55.877 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445965+0000", 2024-09-13T05:10:55.877 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6832999999999998e-05 2024-09-13T05:10:55.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.878 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.878 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.878 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445979+0000", 2024-09-13T05:10:55.878 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4112e-05 2024-09-13T05:10:55.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.878 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.878 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:55.878 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479481+0000", 2024-09-13T05:10:55.878 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033502394999999997 2024-09-13T05:10:55.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.878 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.878 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:55.878 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479577+0000", 2024-09-13T05:10:55.878 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5952999999999994e-05 2024-09-13T05:10:55.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:55.879 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479990+0000", 2024-09-13T05:10:55.879 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00041233799999999999 2024-09-13T05:10:55.879 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.879 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:55.879 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.879 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47606 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15925248~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:10:55.879 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.446006+0000", 2024-09-13T05:10:55.879 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.3577645350000003, 2024-09-13T05:10:55.879 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034653819000000002, 2024-09-13T05:10:55.879 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:55.880 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:55.880 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:55.880 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:55.880 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.880 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47606 2024-09-13T05:10:55.880 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.880 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:55.880 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.880 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:55.880 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446006+0000", 2024-09-13T05:10:55.880 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.880 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.880 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.880 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:55.881 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446006+0000", 2024-09-13T05:10:55.881 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.881 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.881 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.881 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:55.881 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446005+0000", 2024-09-13T05:10:55.881 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:10:55.881 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.881 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.881 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:55.881 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446011+0000", 2024-09-13T05:10:55.882 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8039999999999998e-06 2024-09-13T05:10:55.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.882 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:55.882 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446027+0000", 2024-09-13T05:10:55.882 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6109000000000001e-05 2024-09-13T05:10:55.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.882 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.882 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446036+0000", 2024-09-13T05:10:55.882 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0100000000000001e-06 2024-09-13T05:10:55.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.882 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:55.883 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480068+0000", 2024-09-13T05:10:55.883 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034031516999999997 2024-09-13T05:10:55.883 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.883 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.883 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:55.883 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480216+0000", 2024-09-13T05:10:55.883 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000148701 2024-09-13T05:10:55.883 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.883 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.883 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:55.883 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480660+0000", 2024-09-13T05:10:55.883 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00044355499999999999 2024-09-13T05:10:55.883 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.884 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:55.884 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.884 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.884 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47607 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16220160~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:10:55.884 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.446044+0000", 2024-09-13T05:10:55.884 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.3577270659999998, 2024-09-13T05:10:55.884 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035276967999999999, 2024-09-13T05:10:55.884 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:55.884 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:55.884 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:55.884 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:55.884 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.885 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47607 2024-09-13T05:10:55.885 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.885 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:55.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:55.885 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446044+0000", 2024-09-13T05:10:55.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.885 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:55.885 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446044+0000", 2024-09-13T05:10:55.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.885 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:55.886 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446043+0000", 2024-09-13T05:10:55.886 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:55.886 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.886 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.886 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:55.886 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446047+0000", 2024-09-13T05:10:55.886 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0729999999999998e-06 2024-09-13T05:10:55.886 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.886 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.886 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:55.886 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446055+0000", 2024-09-13T05:10:55.886 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0900000000000005e-06 2024-09-13T05:10:55.886 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.886 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.886 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.887 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446062+0000", 2024-09-13T05:10:55.887 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0169999999999999e-06 2024-09-13T05:10:55.887 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.887 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.887 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:55.887 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480714+0000", 2024-09-13T05:10:55.887 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034651380000000002 2024-09-13T05:10:55.887 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.887 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.887 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:55.887 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480859+0000", 2024-09-13T05:10:55.887 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014580300000000001 2024-09-13T05:10:55.887 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.887 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.887 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:55.888 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481321+0000", 2024-09-13T05:10:55.888 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000461218 2024-09-13T05:10:55.888 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.888 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:55.888 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.888 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.888 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.888 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47608 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16515072~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:10:55.888 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.446068+0000", 2024-09-13T05:10:55.888 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.3577026200000004, 2024-09-13T05:10:55.888 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035881819000000002, 2024-09-13T05:10:55.888 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:55.888 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:55.888 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:55.889 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:55.889 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.889 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47608 2024-09-13T05:10:55.889 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.889 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:55.889 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.889 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:55.889 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446068+0000", 2024-09-13T05:10:55.889 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.889 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.889 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.889 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:55.889 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446068+0000", 2024-09-13T05:10:55.889 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.889 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.890 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.890 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:55.890 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446067+0000", 2024-09-13T05:10:55.890 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:55.890 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.890 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.890 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:55.890 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446071+0000", 2024-09-13T05:10:55.890 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9090000000000002e-06 2024-09-13T05:10:55.890 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.890 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.890 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:55.890 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446079+0000", 2024-09-13T05:10:55.890 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6869999999999994e-06 2024-09-13T05:10:55.890 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.891 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.891 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.891 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446088+0000", 2024-09-13T05:10:55.891 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0129999999999999e-06 2024-09-13T05:10:55.891 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.891 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.891 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:55.891 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481401+0000", 2024-09-13T05:10:55.891 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035313272999999999 2024-09-13T05:10:55.891 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.891 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.891 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:55.891 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481564+0000", 2024-09-13T05:10:55.891 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016223299999999999 2024-09-13T05:10:55.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.892 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:55.892 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481950+0000", 2024-09-13T05:10:55.892 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00038631000000000001 2024-09-13T05:10:55.892 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.892 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:55.892 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.892 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47616 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16547840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:10:55.892 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.452475+0000", 2024-09-13T05:10:55.892 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.3512960200000004, 2024-09-13T05:10:55.892 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031684442, 2024-09-13T05:10:55.893 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:55.893 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:55.893 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:55.893 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:55.893 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.893 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47616 2024-09-13T05:10:55.893 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.893 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:55.893 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.893 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:55.893 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.452475+0000", 2024-09-13T05:10:55.893 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.893 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.894 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.894 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:55.894 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.452475+0000", 2024-09-13T05:10:55.894 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.894 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.894 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:55.894 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.452474+0000", 2024-09-13T05:10:55.894 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:55.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.894 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.894 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:55.894 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.452478+0000", 2024-09-13T05:10:55.894 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5319999999999998e-06 2024-09-13T05:10:55.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.895 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:55.895 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.452484+0000", 2024-09-13T05:10:55.895 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.601e-06 2024-09-13T05:10:55.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.895 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.895 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.452490+0000", 2024-09-13T05:10:55.895 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7649999999999999e-06 2024-09-13T05:10:55.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.895 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:55.895 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.483732+0000", 2024-09-13T05:10:55.895 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031241680000000001 2024-09-13T05:10:55.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.896 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.896 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:55.896 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.483797+0000", 2024-09-13T05:10:55.896 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5683000000000001e-05 2024-09-13T05:10:55.896 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.896 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.896 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:55.896 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.484159+0000", 2024-09-13T05:10:55.896 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00036174200000000002 2024-09-13T05:10:55.896 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.896 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:55.896 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.896 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.896 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.897 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:48448 3.16 3:6fb90bbf:::rbd_data.112d4ee87f83.00000000000000ca:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-13T05:10:55.897 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:52.567838+0000", 2024-09-13T05:10:55.897 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.235932719, 2024-09-13T05:10:55.897 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032609896999999999, 2024-09-13T05:10:55.897 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:55.897 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:10:55.897 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:55.897 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:55.897 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:55.897 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 48448 2024-09-13T05:10:55.897 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.897 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:55.897 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.897 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:55.897 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567838+0000", 2024-09-13T05:10:55.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.898 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:55.898 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567838+0000", 2024-09-13T05:10:55.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:55.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.898 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:55.898 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567836+0000", 2024-09-13T05:10:55.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:10:55.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.898 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:55.898 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567847+0000", 2024-09-13T05:10:55.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1443e-05 2024-09-13T05:10:55.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.899 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.899 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:55.899 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567867+0000", 2024-09-13T05:10:55.899 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0083000000000001e-05 2024-09-13T05:10:55.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.899 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.899 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:55.899 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567877+0000", 2024-09-13T05:10:55.899 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4499999999999993e-06 2024-09-13T05:10:55.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.899 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.899 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:55.899 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567939+0000", 2024-09-13T05:10:55.899 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2552999999999996e-05 2024-09-13T05:10:55.900 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.900 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.900 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:55.900 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.568130+0000", 2024-09-13T05:10:55.900 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00019028799999999999 2024-09-13T05:10:55.900 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.900 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.900 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 7", 2024-09-13T05:10:55.900 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.575017+0000", 2024-09-13T05:10:55.900 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0068869980000000001 2024-09-13T05:10:55.900 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.900 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.900 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:10:55.900 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.600362+0000", 2024-09-13T05:10:55.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.025345828000000001 2024-09-13T05:10:55.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:10:55.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.600374+0000", 2024-09-13T05:10:55.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1096e-05 2024-09-13T05:10:55.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:10:55.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.600410+0000", 2024-09-13T05:10:55.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6142000000000001e-05 2024-09-13T05:10:55.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:55.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:55.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:55.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.600448+0000", 2024-09-13T05:10:55.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8101e-05 2024-09-13T05:10:55.902 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.902 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:55.902 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.902 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:55.902 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:55.902 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:55.904 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:10:55.904 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:55.901+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:56.004 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:55.998+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:56.016 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T05:10:56.066 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:56.066 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:56.066 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:56.066 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:56.076 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:10:56.125 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:56.122+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:56.182 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:56.182 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:56.182 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:56.182 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:56.182 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:56.192 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:10:56.205 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:56.202+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:56.297 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:56.297 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:56.297 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:56.297 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:10:56.298 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.298 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29020 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2855936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.298 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:10:56.298 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.252316662999998, 2024-09-13T05:10:56.298 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060733743, 2024-09-13T05:10:56.298 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.298 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:56.298 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.298 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.298 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.298 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29020 2024-09-13T05:10:56.298 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.298 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.299 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.299 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.299 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:10:56.299 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.299 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.299 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.299 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.299 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:10:56.299 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.299 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.299 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.299 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.299 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041741+0000", 2024-09-13T05:10:56.300 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.300 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.300 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.300 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.300 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041749+0000", 2024-09-13T05:10:56.300 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6059999999999997e-06 2024-09-13T05:10:56.300 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.300 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.300 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.300 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041754+0000", 2024-09-13T05:10:56.300 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6740000000000002e-06 2024-09-13T05:10:56.300 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.300 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.301 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.301 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041760+0000", 2024-09-13T05:10:56.301 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0459999999999996e-06 2024-09-13T05:10:56.301 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.301 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.301 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.301 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102289+0000", 2024-09-13T05:10:56.301 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060529145999999999 2024-09-13T05:10:56.301 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.301 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.302 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:56.302 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102378+0000", 2024-09-13T05:10:56.302 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8901999999999997e-05 2024-09-13T05:10:56.302 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.302 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.302 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.302 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102476+0000", 2024-09-13T05:10:56.302 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7991000000000004e-05 2024-09-13T05:10:56.302 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.302 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.302 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.302 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.302 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.303 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29021 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2865152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.303 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:10:56.303 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.252294668000001, 2024-09-13T05:10:56.303 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060927993999999999, 2024-09-13T05:10:56.303 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.303 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:56.303 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.303 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.303 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.303 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29021 2024-09-13T05:10:56.303 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.303 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.303 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.303 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.304 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:10:56.304 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.304 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.304 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.304 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:10:56.304 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.304 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.304 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.304 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041763+0000", 2024-09-13T05:10:56.304 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.305 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.305 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.305 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041766+0000", 2024-09-13T05:10:56.305 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6800000000000002e-06 2024-09-13T05:10:56.305 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.305 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.305 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.305 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041771+0000", 2024-09-13T05:10:56.305 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:10:56.305 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.305 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.305 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.305 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041776+0000", 2024-09-13T05:10:56.306 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8489999999999997e-06 2024-09-13T05:10:56.306 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.306 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.306 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.306 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102513+0000", 2024-09-13T05:10:56.306 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060737102000000001 2024-09-13T05:10:56.306 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.306 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.306 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:56.306 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102597+0000", 2024-09-13T05:10:56.306 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4374000000000002e-05 2024-09-13T05:10:56.306 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.306 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.307 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.307 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102692+0000", 2024-09-13T05:10:56.307 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4436000000000002e-05 2024-09-13T05:10:56.307 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.307 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.307 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.307 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.307 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.307 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29022 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2874368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.307 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:10:56.307 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.252278367999999, 2024-09-13T05:10:56.307 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061135083999999999, 2024-09-13T05:10:56.307 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.307 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:56.308 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.308 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.308 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.308 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29022 2024-09-13T05:10:56.308 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.308 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.308 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.308 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.308 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:10:56.308 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.308 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.308 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.308 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.309 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:10:56.309 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.309 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.309 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.309 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.309 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:10:56.309 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.309 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.309 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.309 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.309 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041782+0000", 2024-09-13T05:10:56.309 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4959999999999999e-06 2024-09-13T05:10:56.309 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.310 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.310 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.310 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041787+0000", 2024-09-13T05:10:56.310 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1240000000000004e-06 2024-09-13T05:10:56.310 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.310 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.310 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.310 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041792+0000", 2024-09-13T05:10:56.310 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9200000000000003e-06 2024-09-13T05:10:56.310 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.310 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.310 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.310 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102738+0000", 2024-09-13T05:10:56.310 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060945581999999998 2024-09-13T05:10:56.311 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.311 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.311 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:56.311 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102821+0000", 2024-09-13T05:10:56.311 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2898999999999994e-05 2024-09-13T05:10:56.311 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.311 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.311 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.311 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102915+0000", 2024-09-13T05:10:56.311 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4523000000000003e-05 2024-09-13T05:10:56.311 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.311 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.311 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.312 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.312 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.312 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29067 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2764800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.312 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:10:56.312 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.248504150999999, 2024-09-13T05:10:56.312 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060816621000000001, 2024-09-13T05:10:56.312 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.312 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:56.312 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.312 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.312 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.312 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29067 2024-09-13T05:10:56.312 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.312 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.313 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.313 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.313 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:10:56.313 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.313 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.313 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.313 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.313 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:10:56.313 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.313 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.313 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.313 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.313 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:10:56.314 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.314 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.314 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.314 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.314 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045557+0000", 2024-09-13T05:10:56.314 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.898e-06 2024-09-13T05:10:56.314 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.314 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.314 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.314 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045575+0000", 2024-09-13T05:10:56.314 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8252000000000001e-05 2024-09-13T05:10:56.314 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.314 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.314 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.314 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045581+0000", 2024-09-13T05:10:56.315 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:10:56.315 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.315 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.315 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.315 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106183+0000", 2024-09-13T05:10:56.315 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060602630999999997 2024-09-13T05:10:56.315 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.315 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.315 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:56.315 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106271+0000", 2024-09-13T05:10:56.315 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7329000000000004e-05 2024-09-13T05:10:56.315 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.315 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.316 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.316 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106371+0000", 2024-09-13T05:10:56.316 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000100164 2024-09-13T05:10:56.316 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.316 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.316 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.316 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.316 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.316 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29068 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2774016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.316 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:10:56.316 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.248472917000001, 2024-09-13T05:10:56.316 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060994509000000002, 2024-09-13T05:10:56.316 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.317 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:56.317 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.317 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.317 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.317 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29068 2024-09-13T05:10:56.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.317 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.317 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.317 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.317 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:10:56.317 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.317 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.317 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.318 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:10:56.318 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.318 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.318 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.318 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.318 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045585+0000", 2024-09-13T05:10:56.318 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.318 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.318 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.318 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.318 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045588+0000", 2024-09-13T05:10:56.318 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:10:56.318 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.318 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.319 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.319 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045594+0000", 2024-09-13T05:10:56.319 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9329999999999998e-06 2024-09-13T05:10:56.319 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.319 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.319 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.319 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045599+0000", 2024-09-13T05:10:56.319 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3190000000000002e-06 2024-09-13T05:10:56.319 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.319 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.319 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.319 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106399+0000", 2024-09-13T05:10:56.319 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060800361999999997 2024-09-13T05:10:56.319 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.319 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.320 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:56.320 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106489+0000", 2024-09-13T05:10:56.320 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9301000000000004e-05 2024-09-13T05:10:56.320 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.320 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.320 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.320 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106580+0000", 2024-09-13T05:10:56.320 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1314e-05 2024-09-13T05:10:56.320 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.320 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.320 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.320 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.320 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.321 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29069 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2792448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.321 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:10:56.321 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.248454500000001, 2024-09-13T05:10:56.321 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061207599000000001, 2024-09-13T05:10:56.321 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.321 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:56.321 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.321 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.321 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.321 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29069 2024-09-13T05:10:56.321 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.321 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.321 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.321 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.322 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:10:56.322 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.322 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.322 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.322 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.322 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:10:56.322 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.322 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.322 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.322 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.322 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045603+0000", 2024-09-13T05:10:56.322 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.322 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.323 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.323 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.323 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045606+0000", 2024-09-13T05:10:56.323 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7300000000000001e-06 2024-09-13T05:10:56.323 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.323 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.323 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.323 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045612+0000", 2024-09-13T05:10:56.323 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9599999999999997e-06 2024-09-13T05:10:56.323 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.323 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.323 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.323 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045619+0000", 2024-09-13T05:10:56.323 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6019999999999996e-06 2024-09-13T05:10:56.324 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.324 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.324 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.324 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106619+0000", 2024-09-13T05:10:56.324 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061000029999999997 2024-09-13T05:10:56.324 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.324 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.324 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:56.324 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106713+0000", 2024-09-13T05:10:56.324 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4505000000000004e-05 2024-09-13T05:10:56.324 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.324 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.324 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.325 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106812+0000", 2024-09-13T05:10:56.325 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8264000000000007e-05 2024-09-13T05:10:56.325 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.325 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.325 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.325 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.325 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.325 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29070 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2783232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.325 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:10:56.325 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.248434040999999, 2024-09-13T05:10:56.325 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061389805999999998, 2024-09-13T05:10:56.325 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.325 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29070 2024-09-13T05:10:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:10:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.326 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:10:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:10:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045627+0000", 2024-09-13T05:10:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6579999999999998e-06 2024-09-13T05:10:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.327 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045632+0000", 2024-09-13T05:10:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8449999999999999e-06 2024-09-13T05:10:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045639+0000", 2024-09-13T05:10:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:10:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106837+0000", 2024-09-13T05:10:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061198529000000002 2024-09-13T05:10:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.328 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.329 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:56.329 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106922+0000", 2024-09-13T05:10:56.329 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4771999999999994e-05 2024-09-13T05:10:56.329 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.329 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.329 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.329 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107014+0000", 2024-09-13T05:10:56.329 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2009000000000006e-05 2024-09-13T05:10:56.329 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.329 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.329 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.329 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.329 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.329 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29071 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2801664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:10:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.248414964999998, 2024-09-13T05:10:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061582804999999997, 2024-09-13T05:10:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29071 2024-09-13T05:10:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.330 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:10:56.331 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.331 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.331 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.331 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:10:56.331 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.331 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.331 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.331 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045643+0000", 2024-09-13T05:10:56.331 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.332 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.332 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.332 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.332 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045646+0000", 2024-09-13T05:10:56.332 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:10:56.332 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.332 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.332 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.332 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045664+0000", 2024-09-13T05:10:56.332 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8408000000000001e-05 2024-09-13T05:10:56.332 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.332 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.332 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045670+0000", 2024-09-13T05:10:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7710000000000003e-06 2024-09-13T05:10:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107048+0000", 2024-09-13T05:10:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061378438 2024-09-13T05:10:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107134+0000", 2024-09-13T05:10:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5574000000000004e-05 2024-09-13T05:10:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.333 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107226+0000", 2024-09-13T05:10:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2262000000000005e-05 2024-09-13T05:10:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29072 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2810880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:10:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.248383580999999, 2024-09-13T05:10:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061762233999999999, 2024-09-13T05:10:56.334 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29072 2024-09-13T05:10:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:10:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.335 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.336 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:10:56.336 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.336 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.336 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.336 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.336 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045674+0000", 2024-09-13T05:10:56.336 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.336 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.336 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.336 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.336 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045677+0000", 2024-09-13T05:10:56.336 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9679999999999998e-06 2024-09-13T05:10:56.336 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.336 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045694+0000", 2024-09-13T05:10:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6801999999999999e-05 2024-09-13T05:10:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045700+0000", 2024-09-13T05:10:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8270000000000003e-06 2024-09-13T05:10:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107249+0000", 2024-09-13T05:10:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061549114000000002 2024-09-13T05:10:56.337 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107341+0000", 2024-09-13T05:10:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2390000000000001e-05 2024-09-13T05:10:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107437+0000", 2024-09-13T05:10:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5648000000000003e-05 2024-09-13T05:10:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.338 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.339 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29073 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2820096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.339 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:10:56.339 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.248341603, 2024-09-13T05:10:56.339 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061873910999999997, 2024-09-13T05:10:56.339 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.339 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:56.339 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.339 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.339 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.339 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29073 2024-09-13T05:10:56.339 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.339 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.339 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.340 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.340 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:10:56.340 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.340 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.340 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.340 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.340 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:10:56.340 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.340 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.340 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.340 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.340 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045716+0000", 2024-09-13T05:10:56.340 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.340 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.341 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.341 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.341 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045726+0000", 2024-09-13T05:10:56.341 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6350000000000001e-06 2024-09-13T05:10:56.341 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.341 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.341 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.341 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045739+0000", 2024-09-13T05:10:56.341 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3325e-05 2024-09-13T05:10:56.341 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.341 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.341 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.341 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045746+0000", 2024-09-13T05:10:56.342 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7399999999999998e-06 2024-09-13T05:10:56.342 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.342 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.342 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.342 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107457+0000", 2024-09-13T05:10:56.342 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061711038000000003 2024-09-13T05:10:56.342 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.342 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.342 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:56.342 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107522+0000", 2024-09-13T05:10:56.342 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4850000000000004e-05 2024-09-13T05:10:56.342 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.342 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.342 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.343 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107591+0000", 2024-09-13T05:10:56.343 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9029999999999995e-05 2024-09-13T05:10:56.343 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.343 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.343 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.343 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.343 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.343 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29074 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2829312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.343 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:10:56.343 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.248307695000001, 2024-09-13T05:10:56.343 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062055459, 2024-09-13T05:10:56.343 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.343 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:56.344 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.344 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.344 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.344 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29074 2024-09-13T05:10:56.344 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.344 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.344 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.344 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.344 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:10:56.344 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.344 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.344 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.344 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.344 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:10:56.345 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.345 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.345 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.345 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.345 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045750+0000", 2024-09-13T05:10:56.345 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.345 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.345 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.345 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.345 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045753+0000", 2024-09-13T05:10:56.345 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8399999999999999e-06 2024-09-13T05:10:56.345 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.345 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.346 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.346 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045759+0000", 2024-09-13T05:10:56.346 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8900000000000004e-06 2024-09-13T05:10:56.346 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.346 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.346 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.346 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045764+0000", 2024-09-13T05:10:56.346 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3850000000000001e-06 2024-09-13T05:10:56.346 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.346 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.346 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.346 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107623+0000", 2024-09-13T05:10:56.346 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061858817000000003 2024-09-13T05:10:56.346 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.347 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.347 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:56.347 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107710+0000", 2024-09-13T05:10:56.347 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7127999999999997e-05 2024-09-13T05:10:56.347 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.347 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.347 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.347 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107806+0000", 2024-09-13T05:10:56.347 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5886999999999999e-05 2024-09-13T05:10:56.347 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.347 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.347 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.347 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.347 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.348 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29075 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2838528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.348 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:10:56.348 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.248289240999998, 2024-09-13T05:10:56.348 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062188516999999999, 2024-09-13T05:10:56.348 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.348 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:56.348 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.348 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.348 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.348 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29075 2024-09-13T05:10:56.348 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.348 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.348 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.349 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.349 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:10:56.349 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.349 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.349 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.349 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.349 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:10:56.349 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.349 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.349 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.349 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.349 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:10:56.349 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.350 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.350 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.350 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.350 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045772+0000", 2024-09-13T05:10:56.350 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:10:56.350 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.350 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.350 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.350 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045778+0000", 2024-09-13T05:10:56.350 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9229999999999996e-06 2024-09-13T05:10:56.350 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.350 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.350 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.350 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045784+0000", 2024-09-13T05:10:56.351 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3800000000000002e-06 2024-09-13T05:10:56.351 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.351 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.351 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.351 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107823+0000", 2024-09-13T05:10:56.351 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062039331000000003 2024-09-13T05:10:56.351 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.351 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.351 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:56.351 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107886+0000", 2024-09-13T05:10:56.351 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2476000000000003e-05 2024-09-13T05:10:56.351 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.351 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.351 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.352 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107958+0000", 2024-09-13T05:10:56.352 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2089999999999996e-05 2024-09-13T05:10:56.352 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.352 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.352 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.352 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.352 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.352 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29115 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2682880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.352 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:10:56.352 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.244823713999999, 2024-09-13T05:10:56.352 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060847898999999997, 2024-09-13T05:10:56.352 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.352 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:56.353 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.353 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.353 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.353 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29115 2024-09-13T05:10:56.353 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.353 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.353 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.353 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.353 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:10:56.353 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.353 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.353 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.353 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.353 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:10:56.354 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.354 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.354 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.354 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.354 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049234+0000", 2024-09-13T05:10:56.354 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.354 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.354 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.354 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.354 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049237+0000", 2024-09-13T05:10:56.354 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9069999999999999e-06 2024-09-13T05:10:56.354 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.354 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.355 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.355 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049243+0000", 2024-09-13T05:10:56.355 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7459999999999997e-06 2024-09-13T05:10:56.355 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.355 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.355 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.355 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049248+0000", 2024-09-13T05:10:56.355 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1490000000000002e-06 2024-09-13T05:10:56.355 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.355 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.355 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.355 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.109945+0000", 2024-09-13T05:10:56.355 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060697299000000003 2024-09-13T05:10:56.356 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.356 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.356 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:56.356 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110013+0000", 2024-09-13T05:10:56.356 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8023999999999998e-05 2024-09-13T05:10:56.356 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.356 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.356 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.356 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110083+0000", 2024-09-13T05:10:56.356 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9296999999999997e-05 2024-09-13T05:10:56.356 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.356 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.356 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.357 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.357 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.357 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29116 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2692096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.357 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:10:56.357 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.24480587, 2024-09-13T05:10:56.357 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061040167999999999, 2024-09-13T05:10:56.357 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.357 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:56.357 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.357 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.357 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.357 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29116 2024-09-13T05:10:56.357 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.358 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.358 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.358 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.358 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:10:56.358 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.358 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.358 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.358 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.358 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:10:56.358 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.358 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.358 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.358 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.358 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049252+0000", 2024-09-13T05:10:56.359 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.359 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.359 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.359 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049255+0000", 2024-09-13T05:10:56.359 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7250000000000002e-06 2024-09-13T05:10:56.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.359 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.359 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.359 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049261+0000", 2024-09-13T05:10:56.359 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.755e-06 2024-09-13T05:10:56.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.359 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.359 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.360 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049266+0000", 2024-09-13T05:10:56.360 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2100000000000001e-06 2024-09-13T05:10:56.360 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.360 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.360 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.360 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110115+0000", 2024-09-13T05:10:56.360 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060849225999999999 2024-09-13T05:10:56.360 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.360 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.360 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:56.360 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110199+0000", 2024-09-13T05:10:56.360 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4339999999999995e-05 2024-09-13T05:10:56.360 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.361 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.361 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.361 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110293+0000", 2024-09-13T05:10:56.361 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3397e-05 2024-09-13T05:10:56.361 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.361 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.361 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.361 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.361 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.361 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29117 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2701312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.361 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:10:56.361 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.244788233000001, 2024-09-13T05:10:56.361 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.06118527, 2024-09-13T05:10:56.362 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.362 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:56.362 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.362 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.362 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.362 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29117 2024-09-13T05:10:56.362 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.362 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.362 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.362 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.362 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:10:56.362 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.362 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.363 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.363 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.363 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:10:56.363 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.363 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.363 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.363 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.363 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:10:56.363 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.363 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.363 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.363 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.363 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049273+0000", 2024-09-13T05:10:56.363 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.757e-06 2024-09-13T05:10:56.364 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.364 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.364 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.364 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049278+0000", 2024-09-13T05:10:56.364 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7830000000000004e-06 2024-09-13T05:10:56.364 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.364 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.364 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.364 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049284+0000", 2024-09-13T05:10:56.364 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3820000000000003e-06 2024-09-13T05:10:56.364 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.364 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.365 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.365 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110313+0000", 2024-09-13T05:10:56.365 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061029682000000002 2024-09-13T05:10:56.365 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.365 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.365 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:56.365 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110383+0000", 2024-09-13T05:10:56.365 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9406000000000006e-05 2024-09-13T05:10:56.365 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.365 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.365 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.365 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110456+0000", 2024-09-13T05:10:56.365 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2750000000000007e-05 2024-09-13T05:10:56.365 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.366 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.366 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.366 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.366 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.366 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29118 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2710528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.366 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:10:56.366 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.244770318, 2024-09-13T05:10:56.366 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061380698999999997, 2024-09-13T05:10:56.366 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.366 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:56.366 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.366 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.367 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.367 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29118 2024-09-13T05:10:56.367 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.367 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.367 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.367 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.367 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:10:56.367 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.367 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.367 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.367 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.367 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:10:56.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.368 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.368 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.368 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:10:56.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.368 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.368 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.368 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049291+0000", 2024-09-13T05:10:56.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8770000000000002e-06 2024-09-13T05:10:56.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049296+0000", 2024-09-13T05:10:56.369 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6799999999999998e-06 2024-09-13T05:10:56.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049302+0000", 2024-09-13T05:10:56.369 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2769999999999996e-06 2024-09-13T05:10:56.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110488+0000", 2024-09-13T05:10:56.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061186184999999997 2024-09-13T05:10:56.370 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.370 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.370 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:56.370 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110577+0000", 2024-09-13T05:10:56.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9246000000000006e-05 2024-09-13T05:10:56.370 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.370 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.370 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.370 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110669+0000", 2024-09-13T05:10:56.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1923999999999996e-05 2024-09-13T05:10:56.370 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.370 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.371 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.371 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.371 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.371 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29119 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2719744~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.371 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:10:56.371 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.244752574, 2024-09-13T05:10:56.371 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061521165000000003, 2024-09-13T05:10:56.371 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.371 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:56.371 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.371 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.371 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.371 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29119 2024-09-13T05:10:56.372 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.372 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.372 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.372 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.372 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:10:56.372 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.372 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.372 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.372 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.372 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:10:56.373 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.373 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.373 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.373 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049305+0000", 2024-09-13T05:10:56.373 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.373 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.373 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.373 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049308+0000", 2024-09-13T05:10:56.373 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7070000000000001e-06 2024-09-13T05:10:56.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.373 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.373 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.374 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049316+0000", 2024-09-13T05:10:56.374 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:10:56.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.374 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.374 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.374 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049322+0000", 2024-09-13T05:10:56.374 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3199999999999999e-06 2024-09-13T05:10:56.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.374 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.374 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.374 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110690+0000", 2024-09-13T05:10:56.374 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061368428000000003 2024-09-13T05:10:56.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.375 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.375 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:56.375 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110755+0000", 2024-09-13T05:10:56.375 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4893000000000004e-05 2024-09-13T05:10:56.375 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.375 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.375 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.375 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110827+0000", 2024-09-13T05:10:56.375 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2039000000000006e-05 2024-09-13T05:10:56.375 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.375 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.375 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.375 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.375 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.376 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29120 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2728960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.376 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:10:56.376 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.244732303999999, 2024-09-13T05:10:56.376 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061718420000000003, 2024-09-13T05:10:56.376 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.376 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:56.376 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.376 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.376 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.376 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29120 2024-09-13T05:10:56.376 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.376 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.376 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.376 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.377 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:10:56.377 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.377 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.377 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.377 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.377 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:10:56.377 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.377 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.377 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.377 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.377 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:10:56.377 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.377 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049329+0000", 2024-09-13T05:10:56.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.022e-06 2024-09-13T05:10:56.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049336+0000", 2024-09-13T05:10:56.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0720000000000002e-06 2024-09-13T05:10:56.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049341+0000", 2024-09-13T05:10:56.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:10:56.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110864+0000", 2024-09-13T05:10:56.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061523126999999997 2024-09-13T05:10:56.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:56.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110951+0000", 2024-09-13T05:10:56.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6557000000000005e-05 2024-09-13T05:10:56.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.380 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.111045+0000", 2024-09-13T05:10:56.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4043999999999996e-05 2024-09-13T05:10:56.380 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.380 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.380 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.380 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29136 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2876416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.380 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:10:56.380 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.240716879000001, 2024-09-13T05:10:56.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060742995000000001, 2024-09-13T05:10:56.380 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.380 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:56.381 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.381 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.381 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.381 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29136 2024-09-13T05:10:56.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.381 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.381 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.381 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:10:56.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.381 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:10:56.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053341+0000", 2024-09-13T05:10:56.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053344+0000", 2024-09-13T05:10:56.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:10:56.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053350+0000", 2024-09-13T05:10:56.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7200000000000003e-06 2024-09-13T05:10:56.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053355+0000", 2024-09-13T05:10:56.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0150000000000003e-06 2024-09-13T05:10:56.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113909+0000", 2024-09-13T05:10:56.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060554368999999997 2024-09-13T05:10:56.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.384 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:56.384 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113994+0000", 2024-09-13T05:10:56.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4658000000000002e-05 2024-09-13T05:10:56.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.384 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.384 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114085+0000", 2024-09-13T05:10:56.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0939000000000005e-05 2024-09-13T05:10:56.384 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.384 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.384 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.385 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29166 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2628608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.385 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:10:56.385 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.240699445000001, 2024-09-13T05:10:56.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060883127000000002, 2024-09-13T05:10:56.385 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.385 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:56.385 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.385 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.385 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.385 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29166 2024-09-13T05:10:56.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.386 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:10:56.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:10:56.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:10:56.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053361+0000", 2024-09-13T05:10:56.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:10:56.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053367+0000", 2024-09-13T05:10:56.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7350000000000001e-06 2024-09-13T05:10:56.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.388 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053372+0000", 2024-09-13T05:10:56.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7840000000000003e-06 2024-09-13T05:10:56.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.388 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.388 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114103+0000", 2024-09-13T05:10:56.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060730924999999998 2024-09-13T05:10:56.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.388 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:56.388 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114171+0000", 2024-09-13T05:10:56.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8021999999999993e-05 2024-09-13T05:10:56.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114242+0000", 2024-09-13T05:10:56.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1390999999999995e-05 2024-09-13T05:10:56.389 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.389 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.389 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.389 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.389 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.389 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:56.391 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:10:56.391 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:56.385+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:56.483 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #15, image image_client.0-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent16 2024-09-13T05:10:56.491 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:56.486+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:56.504 INFO:teuthology.orchestra.run.smithi120.stdout:1799 punch from 0x5821bf2 to 0x5824d05, (0x3113 bytes) 2024-09-13T05:10:56.512 INFO:teuthology.orchestra.run.smithi120.stdout:1801 write 0x772c085 thru 0x7730f58 (0x4ed4 bytes) 2024-09-13T05:10:56.519 INFO:teuthology.orchestra.run.smithi120.stdout:1802 read 0xc7c8e1 thru 0xc8a1b7 (0xd8d7 bytes) 2024-09-13T05:10:56.520 INFO:teuthology.orchestra.run.smithi120.stdout:1803 write 0x6e13d1e thru 0x6e1f300 (0xb5e3 bytes) 2024-09-13T05:10:56.528 INFO:teuthology.orchestra.run.smithi120.stdout:1805 read 0x72468c4 thru 0x7248022 (0x175f bytes) 2024-09-13T05:10:56.528 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:56.548 INFO:teuthology.orchestra.run.smithi120.stdout:1807 write 0xc2c5fa3 thru 0xc2cca0b (0x6a69 bytes) 2024-09-13T05:10:56.554 INFO:teuthology.orchestra.run.smithi120.stdout:1808 write 0x41e515 thru 0x4292fe (0xadea bytes) 2024-09-13T05:10:56.561 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:56.561 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:56.561 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:10:56.561 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:56.566 INFO:teuthology.orchestra.run.smithi120.stdout:1810 write 0x910a47 thru 0x912d25 (0x22df bytes) 2024-09-13T05:10:56.573 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:10:56.573 INFO:teuthology.orchestra.run.smithi120.stdout:1811 write 0x4531473 thru 0x4532a2b (0x15b9 bytes) 2024-09-13T05:10:56.579 INFO:teuthology.orchestra.run.smithi120.stdout:1812 read 0x10171b6 thru 0x101d489 (0x62d4 bytes) 2024-09-13T05:10:56.579 INFO:teuthology.orchestra.run.smithi120.stdout:1813 write 0x3fd84af thru 0x3fe1afa (0x964c bytes) 2024-09-13T05:10:56.587 INFO:teuthology.orchestra.run.smithi120.stdout:1814 write 0x344f428 thru 0x345dd7e (0xe957 bytes) 2024-09-13T05:10:56.592 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:56.603 INFO:teuthology.orchestra.run.smithi120.stdout:1816 write 0xc90a698 thru 0xc90f944 (0x52ad bytes) 2024-09-13T05:10:56.608 INFO:teuthology.orchestra.run.smithi120.stdout:1817 punch from 0xa93ab45 to 0xa943032, (0x84ed bytes) 2024-09-13T05:10:56.617 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:56.614+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:56.628 INFO:teuthology.orchestra.run.smithi120.stdout:1818 write 0xee14270 thru 0xee1c25e (0x7fef bytes) 2024-09-13T05:10:56.632 INFO:teuthology.orchestra.run.smithi120.stdout:1819 punch from 0xab411b8 to 0xab4fac8, (0xe910 bytes) 2024-09-13T05:10:56.632 INFO:teuthology.orchestra.run.smithi120.stdout:1821 write 0xa3bf69e thru 0xa3c739e (0x7d01 bytes) 2024-09-13T05:10:56.640 INFO:teuthology.orchestra.run.smithi120.stdout:1822 write 0xa95c4f7 thru 0xa969dbf (0xd8c9 bytes) 2024-09-13T05:10:56.647 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:56.647 INFO:teuthology.orchestra.run.smithi120.stdout:1824 read 0xc10de08 thru 0xc1131e9 (0x53e2 bytes) 2024-09-13T05:10:56.647 INFO:teuthology.orchestra.run.smithi120.stdout:1826 writesame 0x5f8c39a thru 0x5f95c66 data_size 0x27(0x98cd bytes) 2024-09-13T05:10:56.671 INFO:teuthology.orchestra.run.smithi120.stdout:1827 trunc from 0xee1c25f to 0x5f14db2 2024-09-13T05:10:56.683 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:56.684 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:56.684 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:56.684 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:56.684 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:56.692 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:56.686+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:56.696 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:10:56.709 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:56.722 INFO:teuthology.orchestra.run.smithi120.stdout:1829 trunc from 0x5f14db2 to 0x5abc61 2024-09-13T05:10:56.761 INFO:teuthology.orchestra.run.smithi120.stdout:1830 read 0x2fa69f thru 0x2fa8cf (0x231 bytes) 2024-09-13T05:10:56.784 INFO:teuthology.orchestra.run.smithi120.stdout:1831 trunc from 0x5abc61 to 0xc18a40c 2024-09-13T05:10:56.793 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:56.790+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:56.795 INFO:teuthology.orchestra.run.smithi120.stdout:1833 punch from 0x65353f to 0x65f322, (0xbde3 bytes) 2024-09-13T05:10:56.795 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:56.795 INFO:teuthology.orchestra.run.smithi120.stdout:1835 punch from 0x9060a27 to 0x906b025, (0xa5fe bytes) 2024-09-13T05:10:56.798 INFO:teuthology.orchestra.run.smithi120.stdout:1836 trunc from 0xc18a40c to 0xdf776e7 2024-09-13T05:10:56.809 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:56.809 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:56.809 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:56.809 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:10:56.809 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:10:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.941900320999999, 2024-09-13T05:10:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:10:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:10:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:10:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:10:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:10:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:10:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:10:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:10:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:10:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:10:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:10:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:10:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:10:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:10:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:10:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:10:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:10:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.815 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.815 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:56.815 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:10:56.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:10:56.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.815 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.815 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.815 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:10:56.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:10:56.815 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:10:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.941875885000002, 2024-09-13T05:10:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:10:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.817 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.817 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.817 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:10:56.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.817 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:10:56.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:10:56.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.818 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:10:56.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:10:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:10:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:10:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:10:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:10:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:10:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:10:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:10:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:10:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:10:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:10:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:10:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:10:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:10:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:10:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:10:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:10:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.941866058999999, 2024-09-13T05:10:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:10:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:10:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:10:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:10:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:10:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:10:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:10:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:10:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:10:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:10:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:10:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:10:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:10:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:10:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:10:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:10:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:10:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:10:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:10:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:10:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.941857822999999, 2024-09-13T05:10:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:10:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:10:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:10:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:10:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:10:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:10:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:10:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:10:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:10:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:10:56.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:10:56.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.830 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.830 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.830 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:10:56.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:10:56.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.830 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:10:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:10:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:10:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:10:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:10:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:10:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:10:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.941835910999998, 2024-09-13T05:10:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:10:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:10:56.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.833 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.833 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.833 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.833 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:10:56.833 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:10:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:10:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:10:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:10:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:10:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:10:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:10:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:10:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:10:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:10:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:10:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:10:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:10:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:10:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:10:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:10:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:10:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.941827307000001, 2024-09-13T05:10:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:10:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:10:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:10:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:10:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:10:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:10:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:10:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:10:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:10:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:10:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:10:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:10:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:10:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:10:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:10:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:10:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:10:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:10:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:10:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:10:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.941817613000001, 2024-09-13T05:10:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:10:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:10:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:10:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:10:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:10:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:10:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:10:56.845 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.845 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.845 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.845 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:10:56.845 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:10:56.845 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.845 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.845 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.845 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:10:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:10:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:10:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:10:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:10:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:10:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:10:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:10:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:10:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:10:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:10:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.941808498, 2024-09-13T05:10:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:10:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:10:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:10:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:10:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:10:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:10:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:10:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:10:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:10:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:10:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:10:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:10:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:10:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:10:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:10:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:10:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:10:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:10:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:10:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:10:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.941800018999999, 2024-09-13T05:10:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:10:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:10:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:10:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:10:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:10:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:10:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:10:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:10:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:10:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:10:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:10:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:10:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:10:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:10:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:10:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:10:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:10:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.858 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.858 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:10:56.858 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:10:56.858 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.858 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.858 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.858 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.858 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.858 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:10:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.941788094, 2024-09-13T05:10:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:10:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:10:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:10:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:10:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:10:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:10:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:10:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:10:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:10:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:10:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:10:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:10:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:10:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:10:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:10:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:10:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:10:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:10:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:10:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:10:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.941766505, 2024-09-13T05:10:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:10:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:10:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:10:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:10:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:10:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:10:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:10:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:10:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:10:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:10:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:10:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:10:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:10:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:10:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:10:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:10:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:10:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:10:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:10:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:10:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.941743377000002, 2024-09-13T05:10:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:10:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:10:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:10:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:10:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:10:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:10:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:10:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:10:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:10:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:10:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:10:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:10:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:10:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:10:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:10:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:10:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:10:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:10:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:10:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:10:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.941728004000002, 2024-09-13T05:10:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:10:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:10:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:10:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:10:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:10:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:10:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:10:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:10:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:10:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:10:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:10:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:10:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:10:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:10:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:10:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:10:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:10:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:10:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:10:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:10:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.941707535999999, 2024-09-13T05:10:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:10:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:10:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:10:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:10:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:10:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:10:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:10:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:10:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:10:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:10:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:10:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:10:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:10:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:56.882 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:10:56.882 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:10:56.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.882 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.882 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:10:56.882 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:10:56.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.882 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:10:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:10:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:10:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.941690874999999, 2024-09-13T05:10:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:10:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.884 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.884 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:10:56.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.884 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.884 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.884 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.884 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:10:56.884 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:10:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:10:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:10:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:10:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:10:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:10:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:10:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:10:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:10:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:10:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:10:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:10:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:10:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:10:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:10:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:10:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:10:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.941664161999999, 2024-09-13T05:10:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:10:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:10:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:10:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:10:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:10:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:10:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:10:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:10:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:10:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:10:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:10:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:10:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:10:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:10:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:10:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:10:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:10:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:10:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:10:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:10:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.941645309999998, 2024-09-13T05:10:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:10:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.894 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.894 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:10:56.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.894 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.894 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.894 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.894 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:10:56.894 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.894 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.895 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.895 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:10:56.895 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.895 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.895 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:10:56.895 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.896 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.896 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.896 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:10:56.896 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:10:56.896 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.896 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.896 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.896 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:10:56.896 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:10:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:10:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:10:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:10:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:10:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:10:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:10:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:10:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:10:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:10:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:10:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:10:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.941627524000001, 2024-09-13T05:10:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:10:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:10:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:10:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:10:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:10:56.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.902 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:10:56.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:10:56.902 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:10:56.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:10:56.902 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.903 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.903 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.903 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:10:56.903 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:10:56.903 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.903 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.903 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.903 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:10:56.903 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:10:56.903 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.903 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.903 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:56.903 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:10:56.904 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:10:56.904 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.904 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.904 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.904 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:10:56.904 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:10:56.904 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.904 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.904 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.904 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:10:56.904 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:10:56.904 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.904 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:10:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.941592463999999, 2024-09-13T05:10:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:10:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:10:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:10:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:10:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:10:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:10:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:10:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:10:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:10:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:10:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:10:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:10:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:10:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:10:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:10:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:10:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:10:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:10:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:10:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:10:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.941575649000001, 2024-09-13T05:10:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:10:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:10:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:10:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:10:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:10:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:10:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:10:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:10:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:10:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:10:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:10:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:10:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:10:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:10:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:10:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:10:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:10:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:56.914 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:56.914 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:56.914 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:10:56.914 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:10:56.914 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.914 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.914 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.914 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:56.914 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:56.914 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:56.916 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:56.910+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:56.916 INFO:teuthology.orchestra.run.smithi120.stdout:1837 read 0x8e9bbe2 thru 0x8ea5da1 (0xa1c0 bytes) 2024-09-13T05:10:56.916 INFO:teuthology.orchestra.run.smithi120.stdout:1838 read 0x5182ac7 thru 0x51907b5 (0xdcef bytes) 2024-09-13T05:10:56.916 INFO:teuthology.orchestra.run.smithi120.stdout:1841 read 0xbf1733f thru 0xbf1f605 (0x82c7 bytes) 2024-09-13T05:10:56.916 INFO:teuthology.orchestra.run.smithi120.stdout:1842 write 0x4b4d104 thru 0x4b59275 (0xc172 bytes) 2024-09-13T05:10:56.917 INFO:teuthology.orchestra.run.smithi120.stdout:1843 trunc from 0xdf776e7 to 0xb5c3cd 2024-09-13T05:10:56.917 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:56.917 INFO:teuthology.orchestra.run.smithi120.stdout:1846 punch from 0x2a1ceb to 0x2a8c84, (0x6f99 bytes) 2024-09-13T05:10:56.917 INFO:teuthology.orchestra.run.smithi120.stdout:1847 write 0xbdfb24f thru 0xbe0a10a (0xeebc bytes) 2024-09-13T05:10:56.917 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:10:56.923 INFO:teuthology.orchestra.run.smithi120.stdout:1848 write 0xe556c20 thru 0xe5624b7 (0xb898 bytes) 2024-09-13T05:10:56.931 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:56.931 INFO:teuthology.orchestra.run.smithi120.stdout:1850 write 0xe26648b thru 0xe275b6c (0xf6e2 bytes) 2024-09-13T05:10:56.948 INFO:teuthology.orchestra.run.smithi120.stdout:1851 trunc from 0xe5624b8 to 0x98f6836 2024-09-13T05:10:56.967 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:56.968 INFO:teuthology.orchestra.run.smithi120.stdout:1856 flatten 2024-09-13T05:10:57.000 INFO:teuthology.orchestra.run.smithi120.stdout:1859 write 0x94d684e thru 0x94e06b4 (0x9e67 bytes) 2024-09-13T05:10:57.014 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is set 2024-09-13T05:10:57.016 INFO:teuthology.orchestra.run.smithi120.stdout:1860 read 0xbae20e thru 0xbb3398 (0x518b bytes) 2024-09-13T05:10:57.016 INFO:teuthology.orchestra.run.smithi120.stdout:1861 read 0x3cf900c thru 0x3d07dde (0xedd3 bytes) 2024-09-13T05:10:57.016 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:57.009+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:57.023 INFO:teuthology.orchestra.run.smithi120.stdout:1862 trunc from 0x98f6836 to 0xecd3cd4 2024-09-13T05:10:57.032 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:57.032 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:57.032 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:10:57.032 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:57.040 INFO:teuthology.orchestra.run.smithi120.stdout:1863 punch from 0x548cc9d to 0x5498b42, (0xbea5 bytes) 2024-09-13T05:10:57.040 INFO:teuthology.orchestra.run.smithi120.stdout:1864 read 0xaa7478f thru 0xaa77c58 (0x34ca bytes) 2024-09-13T05:10:57.040 INFO:teuthology.orchestra.run.smithi120.stdout:1865 write 0x5b92ddc thru 0x5b97fb3 (0x51d8 bytes) 2024-09-13T05:10:57.042 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:10:57.049 INFO:teuthology.orchestra.run.smithi120.stdout:1866 read 0xa34c17c thru 0xa35b247 (0xf0cc bytes) 2024-09-13T05:10:57.049 INFO:teuthology.orchestra.run.smithi120.stdout:1867 read 0xc6ecfe1 thru 0xc6fb1f4 (0xe214 bytes) 2024-09-13T05:10:57.050 INFO:teuthology.orchestra.run.smithi120.stdout:1868 write 0x4f511fd thru 0x4f58e92 (0x7c96 bytes) 2024-09-13T05:10:57.056 INFO:teuthology.orchestra.run.smithi120.stdout:1869 write 0x5fcd1c3 thru 0x5fd71e5 (0xa023 bytes) 2024-09-13T05:10:57.062 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:57.062 INFO:teuthology.orchestra.run.smithi120.stdout:1871 write 0x52a9b07 thru 0x52b3fb5 (0xa4af bytes) 2024-09-13T05:10:57.069 INFO:teuthology.orchestra.run.smithi120.stdout:1873 write 0x372430c thru 0x372c62a (0x831f bytes) 2024-09-13T05:10:57.075 INFO:teuthology.orchestra.run.smithi120.stdout:1874 writesame 0x1c3a81d thru 0x1c3ffcb data_size 0x1(0x57af bytes) 2024-09-13T05:10:57.088 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:10:57.099 INFO:teuthology.orchestra.run.smithi120.stdout:1875 punch from 0xdaddde0 to 0xdae8d63, (0xaf83 bytes) 2024-09-13T05:10:57.101 INFO:teuthology.orchestra.run.smithi120.stdout:1877 trunc from 0xecd3cd4 to 0xe0f3011 2024-09-13T05:10:57.112 INFO:teuthology.orchestra.run.smithi120.stdout:1878 read 0x2550918 thru 0x255ecab (0xe394 bytes) 2024-09-13T05:10:57.117 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:57.110+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:57.133 INFO:teuthology.orchestra.run.smithi120.stdout:1879 trunc from 0xe0f3011 to 0xb01d8d 2024-09-13T05:10:57.156 INFO:teuthology.orchestra.run.smithi120.stdout:1885 read 0x95ddb7 thru 0x969a63 (0xbcad bytes) 2024-09-13T05:10:57.156 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:10:57.156 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:10:57.157 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:10:57.157 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:10:57.157 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:10:57.162 INFO:teuthology.orchestra.run.smithi120.stdout:1886 trunc from 0xb01d8d to 0x46a6ef4 2024-09-13T05:10:57.169 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:10:57.174 INFO:teuthology.orchestra.run.smithi120.stdout:1887 read 0x1dc9805 thru 0x1dd307e (0x987a bytes) 2024-09-13T05:10:57.174 INFO:teuthology.orchestra.run.smithi120.stdout:1889 punch from 0x3d9661c to 0x3da1e43, (0xb827 bytes) 2024-09-13T05:10:57.174 INFO:teuthology.orchestra.run.smithi120.stdout:1890 read 0x2875c80 thru 0x288242f (0xc7b0 bytes) 2024-09-13T05:10:57.174 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:57.174 INFO:teuthology.orchestra.run.smithi120.stdout:1894 write 0x1dcddf4 thru 0x1dd2a4e (0x4c5b bytes) 2024-09-13T05:10:57.180 INFO:teuthology.orchestra.run.smithi120.stdout:1895 punch from 0x2656946 to 0x265db94, (0x724e bytes) 2024-09-13T05:10:57.197 INFO:teuthology.orchestra.run.smithi120.stdout:1896 writesame 0x77f4285 thru 0x77fe51d data_size 0x4b(0xa299 bytes) 2024-09-13T05:10:57.197 INFO:teuthology.orchestra.run.smithi120.stdout:1897 write 0x2a5758f thru 0x2a5b4fa (0x3f6c bytes) 2024-09-13T05:10:57.218 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:57.214+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:57.220 INFO:teuthology.orchestra.run.smithi120.stdout:1898 write 0xac08487 thru 0xac16d24 (0xe89e bytes) 2024-09-13T05:10:57.226 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:57.226 INFO:teuthology.orchestra.run.smithi120.stdout:1900 punch from 0x2638fd to 0x26eae7, (0xb1ea bytes) 2024-09-13T05:10:57.227 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:57.233 INFO:teuthology.orchestra.run.smithi120.stdout:1902 trunc from 0xac16d25 to 0xdc9fc24 2024-09-13T05:10:57.237 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:10:57.244 INFO:teuthology.orchestra.run.smithi120.stdout:1903 write 0xad7c6 thru 0xb9025 (0xb860 bytes) 2024-09-13T05:10:57.248 INFO:teuthology.orchestra.run.smithi120.stdout:1904 read 0xc38e473 thru 0xc395ecd (0x7a5b bytes) 2024-09-13T05:10:57.249 INFO:teuthology.orchestra.run.smithi120.stdout:1906 read 0x78ada98 thru 0x78b416a (0x66d3 bytes) 2024-09-13T05:10:57.249 INFO:teuthology.orchestra.run.smithi120.stdout:1907 read 0xbcfeed3 thru 0xbd0d922 (0xea50 bytes) 2024-09-13T05:10:57.249 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:57.249 INFO:teuthology.orchestra.run.smithi120.stdout:1909 write 0x5df37b7 thru 0x5df7dae (0x45f8 bytes) 2024-09-13T05:10:57.256 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:57.256 INFO:teuthology.orchestra.run.smithi120.stdout:1912 writesame 0x18c1ac1 thru 0x18cf9db data_size 0x1(0xdf1b bytes) 2024-09-13T05:10:57.259 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:10:57.277 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:10:57.284 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:57.284 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:57.294 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:10:57.296 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:10:57.306 INFO:teuthology.orchestra.run.smithi120.stdout:1914 write 0xd3e7574 thru 0xd3ef0ec (0x7b79 bytes) 2024-09-13T05:10:57.312 INFO:teuthology.orchestra.run.smithi120.stdout:1915 punch from 0xb024982 to 0xb02d6db, (0x8d59 bytes) 2024-09-13T05:10:57.313 INFO:teuthology.orchestra.run.smithi120.stdout:1916 punch from 0x5d3915d to 0x5d39b71, (0xa14 bytes) 2024-09-13T05:10:57.313 INFO:teuthology.orchestra.run.smithi120.stdout:1917 write 0xcc8b408 thru 0xcc97f00 (0xcaf9 bytes) 2024-09-13T05:10:57.315 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:10:57.319 INFO:teuthology.orchestra.run.smithi120.stdout:1918 writesame 0x5d1d32e thru 0x5d29062 data_size 0x1(0xbd35 bytes) 2024-09-13T05:10:57.319 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:10:57.313+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:10:57.339 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:10:57.356 INFO:teuthology.orchestra.run.smithi120.stdout:1920 write 0x1ce4ca3 thru 0x1ce6a67 (0x1dc5 bytes) 2024-09-13T05:10:57.360 INFO:teuthology.orchestra.run.smithi120.stdout:1921 read 0xac14bfd thru 0xac18116 (0x351a bytes) 2024-09-13T05:10:57.362 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:57.362 INFO:teuthology.orchestra.run.smithi120.stdout:1924 read 0xd9299fa thru 0xd937c40 (0xe247 bytes) 2024-09-13T05:10:57.362 INFO:teuthology.orchestra.run.smithi120.stdout:1925 read 0x99d7686 thru 0x99db814 (0x418f bytes) 2024-09-13T05:10:57.362 INFO:teuthology.orchestra.run.smithi120.stdout:1927 punch from 0x1e91173 to 0x1e9dd04, (0xcb91 bytes) 2024-09-13T05:10:57.371 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:10:57.374 INFO:teuthology.orchestra.run.smithi120.stdout:1929 trunc from 0xdc9fc24 to 0x7d665c4 2024-09-13T05:10:57.401 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:10:57.401 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:57.401 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:57.402 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:10:57.403 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:10:57.403 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:10:57.403 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:10:57.403 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:10:57.403 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:10:57.403 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:10:57.403 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:10:57.405 INFO:teuthology.orchestra.run.smithi120.stdout:1930 writesame 0x9275d49 thru 0x927cb56 data_size 0x1(0x6e0e bytes) 2024-09-13T05:10:57.406 INFO:teuthology.orchestra.run.smithi120.stdout:1932 punch from 0x1a92cb4 to 0x1a9604c, (0x3398 bytes) 2024-09-13T05:10:57.406 INFO:teuthology.orchestra.run.smithi120.stdout:1933 read 0x295baa5 thru 0x2969bb2 (0xe10e bytes) 2024-09-13T05:10:57.406 INFO:teuthology.orchestra.run.smithi120.stdout:1934 write 0x5c8eb5f thru 0x5c90b0b (0x1fad bytes) 2024-09-13T05:10:57.412 INFO:teuthology.orchestra.run.smithi120.stdout:1935 read 0x312f1f5 thru 0x3130e97 (0x1ca3 bytes) 2024-09-13T05:10:57.417 INFO:teuthology.orchestra.run.smithi120.stdout:1937 trunc from 0x927cb57 to 0x67e3e79 2024-09-13T05:10:57.419 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:10:57.420 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:57.414+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:57.429 INFO:teuthology.orchestra.run.smithi120.stdout:1938 read 0x2008d45 thru 0x201430a (0xb5c6 bytes) 2024-09-13T05:10:57.430 INFO:teuthology.orchestra.run.smithi120.stdout:1940 read 0x1f61dc1 thru 0x1f68847 (0x6a87 bytes) 2024-09-13T05:10:57.430 INFO:teuthology.orchestra.run.smithi120.stdout:1941 writesame 0x47354e4 thru 0x473960f data_size 0x2b(0x412c bytes) 2024-09-13T05:10:57.446 INFO:teuthology.orchestra.run.smithi120.stdout:1942 write 0x69efc99 thru 0x69fb523 (0xb88b bytes) 2024-09-13T05:10:57.453 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:57.453 INFO:teuthology.orchestra.run.smithi120.stdout:1946 read 0x259b9d0 thru 0x25a391d (0x7f4e bytes) 2024-09-13T05:10:57.453 INFO:teuthology.orchestra.run.smithi120.stdout:1948 punch from 0x5765f6 to 0x57ebdc, (0x85e6 bytes) 2024-09-13T05:10:57.453 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:57.453 INFO:teuthology.orchestra.run.smithi120.stdout:1951 punch from 0x94db51 to 0x95d3ab, (0xf85a bytes) 2024-09-13T05:10:57.453 INFO:teuthology.orchestra.run.smithi120.stdout:1952 write 0x252c20e thru 0x2536871 (0xa664 bytes) 2024-09-13T05:10:57.460 INFO:teuthology.orchestra.run.smithi120.stdout:1954 read 0x1f4c32c thru 0x1f525bd (0x6292 bytes) 2024-09-13T05:10:57.475 INFO:teuthology.orchestra.run.smithi120.stdout:1955 write 0x7abdce7 thru 0x7abe591 (0x8ab bytes) 2024-09-13T05:10:57.483 INFO:teuthology.orchestra.run.smithi120.stdout:1957 read 0x7242fd thru 0x728e21 (0x4b25 bytes) 2024-09-13T05:10:57.483 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:57.483 INFO:teuthology.orchestra.run.smithi120.stdout:1959 punch from 0x3678f3e to 0x367f031, (0x60f3 bytes) 2024-09-13T05:10:57.483 INFO:teuthology.orchestra.run.smithi120.stdout:1960 punch from 0x1dd1f18 to 0x1de0bfd, (0xece5 bytes) 2024-09-13T05:10:57.483 INFO:teuthology.orchestra.run.smithi120.stdout:1961 punch from 0x32e33ac to 0x32e7d19, (0x496d bytes) 2024-09-13T05:10:57.483 INFO:teuthology.orchestra.run.smithi120.stdout:1962 punch from 0x40bc50c to 0x40c13e7, (0x4edb bytes) 2024-09-13T05:10:57.483 INFO:teuthology.orchestra.run.smithi120.stdout:1964 punch from 0x5ce93ac to 0x5ce941b, (0x6f bytes) 2024-09-13T05:10:57.483 INFO:teuthology.orchestra.run.smithi120.stdout:1965 write 0x23cc413 thru 0x23d29e0 (0x65ce bytes) 2024-09-13T05:10:57.489 INFO:teuthology.orchestra.run.smithi120.stdout:1966 punch from 0x1bdc1ed to 0x1be8f60, (0xcd73 bytes) 2024-09-13T05:10:57.489 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:57.489 INFO:teuthology.orchestra.run.smithi120.stdout:1969 punch from 0x3a1eda6 to 0x3a23671, (0x48cb bytes) 2024-09-13T05:10:57.489 INFO:teuthology.orchestra.run.smithi120.stdout:1972 write 0x14baaa9 thru 0x14bf8bf (0x4e17 bytes) 2024-09-13T05:10:57.496 INFO:teuthology.orchestra.run.smithi120.stdout:1973 read 0x7852709 thru 0x785c068 (0x9960 bytes) 2024-09-13T05:10:57.496 INFO:teuthology.orchestra.run.smithi120.stdout:1974 punch from 0x711a27d to 0x711ab83, (0x906 bytes) 2024-09-13T05:10:57.496 INFO:teuthology.orchestra.run.smithi120.stdout:1975 write 0xb93f6b thru 0xb98864 (0x48fa bytes) 2024-09-13T05:10:57.503 INFO:teuthology.orchestra.run.smithi120.stdout:1977 read 0x2f783bf thru 0x2f7dddc (0x5a1e bytes) 2024-09-13T05:10:57.503 INFO:teuthology.orchestra.run.smithi120.stdout:1979 read 0x62b5bc2 thru 0x62c03d9 (0xa818 bytes) 2024-09-13T05:10:57.503 INFO:teuthology.orchestra.run.smithi120.stdout:1981 read 0x6e92c9e thru 0x6ea0465 (0xd7c8 bytes) 2024-09-13T05:10:57.512 INFO:teuthology.orchestra.run.smithi120.stdout:1982 trunc from 0x7abe592 to 0x2cb4d9f 2024-09-13T05:10:57.520 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:57.514+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:57.531 INFO:teuthology.orchestra.run.smithi120.stdout:1983 write 0x33825e thru 0x34393c (0xb6df bytes) 2024-09-13T05:10:57.542 INFO:teuthology.orchestra.run.smithi120.stdout:1984 read 0x2b2df8d thru 0x2b2f995 (0x1a09 bytes) 2024-09-13T05:10:57.553 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:57.553 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:57.563 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:10:57.564 INFO:teuthology.orchestra.run.smithi120.stdout:1985 write 0x83eeafb thru 0x83f9def (0xb2f5 bytes) 2024-09-13T05:10:57.570 INFO:teuthology.orchestra.run.smithi120.stdout:1986 read 0xd39286 thru 0xd3c9b2 (0x372d bytes) 2024-09-13T05:10:57.592 INFO:teuthology.orchestra.run.smithi120.stdout:1989 write 0xe202b96 thru 0xe204e58 (0x22c3 bytes) 2024-09-13T05:10:57.598 INFO:teuthology.orchestra.run.smithi120.stdout:1990 write 0xc7b1b26 thru 0xc7b631e (0x47f9 bytes) 2024-09-13T05:10:57.604 INFO:teuthology.orchestra.run.smithi120.stdout:1991 read 0x4862ab thru 0x4880bd (0x1e13 bytes) 2024-09-13T05:10:57.621 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:57.618+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:57.623 INFO:teuthology.orchestra.run.smithi120.stdout:1993 trunc from 0xe204e59 to 0x34901b9 2024-09-13T05:10:57.646 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:57.647 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:57.677 INFO:teuthology.orchestra.run.smithi120.stdout:1997 writesame 0xcd928bd thru 0xcd9f913 data_size 0x1(0xd057 bytes) 2024-09-13T05:10:57.677 INFO:teuthology.orchestra.run.smithi120.stdout:1998 write 0x2323f57 thru 0x232c9bb (0x8a65 bytes) 2024-09-13T05:10:57.684 INFO:teuthology.orchestra.run.smithi120.stdout:2000 writesame 0xb401c1d thru 0xb402ad5 data_size 0x1(0xeb9 bytes) 2024-09-13T05:10:57.690 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:57.690 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:57.693 INFO:teuthology.orchestra.run.smithi120.stdout:2001 read 0x91ba286 thru 0x91c7111 (0xce8c bytes) 2024-09-13T05:10:57.693 INFO:teuthology.orchestra.run.smithi120.stdout:2003 write 0x3ff03b7 thru 0x3ff32a7 (0x2ef1 bytes) 2024-09-13T05:10:57.699 INFO:teuthology.orchestra.run.smithi120.stdout:2004 write 0x4a069a3 thru 0x4a11673 (0xacd1 bytes) 2024-09-13T05:10:57.701 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:10:57.706 INFO:teuthology.orchestra.run.smithi120.stdout:2005 punch from 0x1c1a48 to 0x1c8438, (0x69f0 bytes) 2024-09-13T05:10:57.707 INFO:teuthology.orchestra.run.smithi120.stdout:2006 read 0x491ee29 thru 0x4920f33 (0x210b bytes) 2024-09-13T05:10:57.707 INFO:teuthology.orchestra.run.smithi120.stdout:2007 trunc from 0xcd9f914 to 0xd293d70 2024-09-13T05:10:57.716 INFO:teuthology.orchestra.run.smithi120.stdout:2011 read 0x87e1e67 thru 0x87e6606 (0x47a0 bytes) 2024-09-13T05:10:57.722 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:57.717+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:57.731 INFO:teuthology.orchestra.run.smithi120.stdout:2012 write 0xe1878d6 thru 0xe197481 (0xfbac bytes) 2024-09-13T05:10:57.737 INFO:teuthology.orchestra.run.smithi120.stdout:2013 write 0x9aab479 thru 0x9aae0d0 (0x2c58 bytes) 2024-09-13T05:10:57.743 INFO:teuthology.orchestra.run.smithi120.stdout:2015 read 0x1542b02 thru 0x154be2f (0x932e bytes) 2024-09-13T05:10:57.743 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:57.744 INFO:teuthology.orchestra.run.smithi120.stdout:2018 punch from 0x115d8f2 to 0x1167bde, (0xa2ec bytes) 2024-09-13T05:10:57.744 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:57.744 INFO:teuthology.orchestra.run.smithi120.stdout:2022 writesame 0xbec453e thru 0xbecff4d data_size 0x68(0xba10 bytes) 2024-09-13T05:10:57.750 INFO:teuthology.orchestra.run.smithi120.stdout:2023 write 0xa4184ba thru 0xa41c10f (0x3c56 bytes) 2024-09-13T05:10:57.757 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:57.757 INFO:teuthology.orchestra.run.smithi120.stdout:2025 punch from 0xc0c7d03 to 0xc0d729e, (0xf59b bytes) 2024-09-13T05:10:57.757 INFO:teuthology.orchestra.run.smithi120.stdout:2026 read 0xb1e5be4 thru 0xb1ea800 (0x4c1d bytes) 2024-09-13T05:10:57.757 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:57.757 INFO:teuthology.orchestra.run.smithi120.stdout:2029 read 0x905975f thru 0x905f548 (0x5dea bytes) 2024-09-13T05:10:57.757 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:57.757 INFO:teuthology.orchestra.run.smithi120.stdout:2032 read 0xb98fbb thru 0xb9ec82 (0x5cc8 bytes) 2024-09-13T05:10:57.758 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:57.758 INFO:teuthology.orchestra.run.smithi120.stdout:2034 read 0xae364ab thru 0xae43830 (0xd386 bytes) 2024-09-13T05:10:57.758 INFO:teuthology.orchestra.run.smithi120.stdout:2035 read 0xa727f20 thru 0xa728f3f (0x1020 bytes) 2024-09-13T05:10:57.758 INFO:teuthology.orchestra.run.smithi120.stdout:2037 read 0x3398de1 thru 0x33a81f3 (0xf413 bytes) 2024-09-13T05:10:57.758 INFO:teuthology.orchestra.run.smithi120.stdout:2038 read 0xbbc2404 thru 0xbbc4781 (0x237e bytes) 2024-09-13T05:10:57.758 INFO:teuthology.orchestra.run.smithi120.stdout:2039 write 0xcf099a2 thru 0xcf12c3b (0x929a bytes) 2024-09-13T05:10:57.765 INFO:teuthology.orchestra.run.smithi120.stdout:2040 write 0x7b21724 thru 0x7b2f1d1 (0xdaae bytes) 2024-09-13T05:10:57.773 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:57.773 INFO:teuthology.orchestra.run.smithi120.stdout:2042 write 0x8a379d4 thru 0x8a39a10 (0x203d bytes) 2024-09-13T05:10:57.779 INFO:teuthology.orchestra.run.smithi120.stdout:2044 write 0x6b795d7 thru 0x6b7fa22 (0x644c bytes) 2024-09-13T05:10:57.785 INFO:teuthology.orchestra.run.smithi120.stdout:2045 write 0x61e7a98 thru 0x61f5901 (0xde6a bytes) 2024-09-13T05:10:57.791 INFO:teuthology.orchestra.run.smithi120.stdout:2046 writesame 0x88f8b5e thru 0x8906a18 data_size 0x1(0xdebb bytes) 2024-09-13T05:10:57.816 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:57.817 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:57.823 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:57.818+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:57.824 INFO:teuthology.orchestra.run.smithi120.stdout:2047 punch from 0x25501c4 to 0x25582ac, (0x80e8 bytes) 2024-09-13T05:10:57.824 INFO:teuthology.orchestra.run.smithi120.stdout:2050 write 0xa31b720 thru 0xa32b6cf (0xffb0 bytes) 2024-09-13T05:10:57.828 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:10:57.833 INFO:teuthology.orchestra.run.smithi120.stdout:2052 punch from 0x918f215 to 0x9196b69, (0x7954 bytes) 2024-09-13T05:10:57.833 INFO:teuthology.orchestra.run.smithi120.stdout:2053 write 0x56c615f thru 0x56d3a50 (0xd8f2 bytes) 2024-09-13T05:10:57.840 INFO:teuthology.orchestra.run.smithi120.stdout:2055 write 0xa126e08 thru 0xa131071 (0xa26a bytes) 2024-09-13T05:10:57.845 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:57.845 INFO:teuthology.orchestra.run.smithi120.stdout:2058 write 0x4cf35aa thru 0x4d018e0 (0xe337 bytes) 2024-09-13T05:10:57.853 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:57.858 INFO:teuthology.orchestra.run.smithi120.stdout:2060 trunc from 0xe197482 to 0xb98a692 2024-09-13T05:10:57.878 INFO:teuthology.orchestra.run.smithi120.stdout:2062 write 0x524d3f0 thru 0x5258195 (0xada6 bytes) 2024-09-13T05:10:57.885 INFO:teuthology.orchestra.run.smithi120.stdout:2063 read 0xaf4bcc7 thru 0xaf4d983 (0x1cbd bytes) 2024-09-13T05:10:57.885 INFO:teuthology.orchestra.run.smithi120.stdout:2064 punch from 0xa7332a0 to 0xa73459e, (0x12fe bytes) 2024-09-13T05:10:57.885 INFO:teuthology.orchestra.run.smithi120.stdout:2065 trunc from 0xb98a692 to 0xba16789 2024-09-13T05:10:57.897 INFO:teuthology.orchestra.run.smithi120.stdout:2066 read 0x68b233 thru 0x692a0c (0x77da bytes) 2024-09-13T05:10:57.898 INFO:teuthology.orchestra.run.smithi120.stdout:2067 punch from 0x1b50ad4 to 0x1b529ed, (0x1f19 bytes) 2024-09-13T05:10:57.917 INFO:teuthology.orchestra.run.smithi120.stdout:2068 trunc from 0xba16789 to 0x94e6ba 2024-09-13T05:10:57.924 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:57.918+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:57.942 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:57.942 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:57.954 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:10:57.955 INFO:teuthology.orchestra.run.smithi120.stdout:2069 trunc from 0x94e6ba to 0x6c8b325 2024-09-13T05:10:57.964 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:57.964 INFO:teuthology.orchestra.run.smithi120.stdout:2071 writesame 0x2635119 thru 0x2640861 data_size 0x1(0xb749 bytes) 2024-09-13T05:10:58.008 INFO:teuthology.orchestra.run.smithi120.stdout:2072 trunc from 0x6c8b325 to 0x7af5e48 2024-09-13T05:10:58.020 INFO:teuthology.orchestra.run.smithi120.stdout:2074 read 0x6a1dbe9 thru 0x6a2c94c (0xed64 bytes) 2024-09-13T05:10:58.020 INFO:teuthology.orchestra.run.smithi120.stdout:2075 punch from 0x19c8a39 to 0x19cc390, (0x3957 bytes) 2024-09-13T05:10:58.024 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:58.018+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:58.031 INFO:teuthology.orchestra.run.smithi120.stdout:2077 writesame 0x8e48508 thru 0x8e4a91b data_size 0x1(0x2414 bytes) 2024-09-13T05:10:58.032 INFO:teuthology.orchestra.run.smithi120.stdout:2079 writesame 0xbc7f47 thru 0xbd54d9 data_size 0x87(0xd593 bytes) 2024-09-13T05:10:58.037 INFO:teuthology.orchestra.run.smithi120.stdout:2081 punch from 0x89ea74f to 0x89f7a1a, (0xd2cb bytes) 2024-09-13T05:10:58.038 INFO:teuthology.orchestra.run.smithi120.stdout:2082 read 0x8127822 thru 0x812efd6 (0x77b5 bytes) 2024-09-13T05:10:58.038 INFO:teuthology.orchestra.run.smithi120.stdout:2083 writesame 0x8a655d1 thru 0x8a6b6ce data_size 0x41(0x60fe bytes) 2024-09-13T05:10:58.043 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:58.059 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:58.060 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:58.064 INFO:teuthology.orchestra.run.smithi120.stdout:2085 write 0xda7e6e5 thru 0xda8c505 (0xde21 bytes) 2024-09-13T05:10:58.069 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:10:58.073 INFO:teuthology.orchestra.run.smithi120.stdout:2086 write 0x4006211 thru 0x4009919 (0x3709 bytes) 2024-09-13T05:10:58.078 INFO:teuthology.orchestra.run.smithi120.stdout:2087 write 0x4eb6cc5 thru 0x4eb76fe (0xa3a bytes) 2024-09-13T05:10:58.084 INFO:teuthology.orchestra.run.smithi120.stdout:2088 write 0x9988615 thru 0x998fca9 (0x7695 bytes) 2024-09-13T05:10:58.090 INFO:teuthology.orchestra.run.smithi120.stdout:2089 write 0x154a65 thru 0x15f1f0 (0xa78c bytes) 2024-09-13T05:10:58.110 INFO:teuthology.orchestra.run.smithi120.stdout:2090 trunc from 0xda8c506 to 0x5b7942e 2024-09-13T05:10:58.125 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:58.122+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:58.132 INFO:teuthology.orchestra.run.smithi120.stdout:2091 read 0x130b293 thru 0x1310070 (0x4dde bytes) 2024-09-13T05:10:58.132 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:58.132 INFO:teuthology.orchestra.run.smithi120.stdout:2095 punch from 0x1938513 to 0x194813e, (0xfc2b bytes) 2024-09-13T05:10:58.132 INFO:teuthology.orchestra.run.smithi120.stdout:2096 writesame 0x54c3199 thru 0x54c9c65 data_size 0x1(0x6acd bytes) 2024-09-13T05:10:58.160 INFO:teuthology.orchestra.run.smithi120.stdout:2097 read 0x41f8307 thru 0x41fae32 (0x2b2c bytes) 2024-09-13T05:10:58.162 INFO:teuthology.orchestra.run.smithi120.stdout:2098 trunc from 0x5b7942e to 0x4c79dda 2024-09-13T05:10:58.179 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:58.179 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:58.181 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:58.181 INFO:teuthology.orchestra.run.smithi120.stdout:2100 punch from 0x3015842 to 0x3019c14, (0x43d2 bytes) 2024-09-13T05:10:58.181 INFO:teuthology.orchestra.run.smithi120.stdout:2101 writesame 0x48442a thru 0x486087 data_size 0x1(0x1c5e bytes) 2024-09-13T05:10:58.189 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:10:58.192 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:58.192 INFO:teuthology.orchestra.run.smithi120.stdout:2103 read 0x10d2a36 thru 0x10db885 (0x8e50 bytes) 2024-09-13T05:10:58.192 INFO:teuthology.orchestra.run.smithi120.stdout:2104 write 0x12c0338 thru 0x12cf127 (0xedf0 bytes) 2024-09-13T05:10:58.197 INFO:teuthology.orchestra.run.smithi120.stdout:2105 punch from 0x1fef1b0 to 0x1ff3c52, (0x4aa2 bytes) 2024-09-13T05:10:58.209 INFO:teuthology.orchestra.run.smithi120.stdout:2107 write 0x4d5632a thru 0x4d585b2 (0x2289 bytes) 2024-09-13T05:10:58.222 INFO:teuthology.orchestra.run.smithi120.stdout:2108 trunc from 0x4d585b3 to 0x19d4861 2024-09-13T05:10:58.225 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:58.221+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:58.244 INFO:teuthology.orchestra.run.smithi120.stdout:2112 read 0xa7f800 thru 0xa8f297 (0xfa98 bytes) 2024-09-13T05:10:58.245 INFO:teuthology.orchestra.run.smithi120.stdout:2113 punch from 0x14bb700 to 0x14c7082, (0xb982 bytes) 2024-09-13T05:10:58.245 INFO:teuthology.orchestra.run.smithi120.stdout:2116 writesame 0x9e7480 thru 0x9e988b data_size 0x4(0x240c bytes) 2024-09-13T05:10:58.252 INFO:teuthology.orchestra.run.smithi120.stdout:2117 punch from 0xf16255 to 0xf192c3, (0x306e bytes) 2024-09-13T05:10:58.269 INFO:teuthology.orchestra.run.smithi120.stdout:2119 write 0x33013ce thru 0x3311357 (0xff8a bytes) 2024-09-13T05:10:58.297 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:58.297 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:58.298 INFO:teuthology.orchestra.run.smithi120.stdout:2120 write 0x77befec thru 0x77c4b38 (0x5b4d bytes) 2024-09-13T05:10:58.307 INFO:teuthology.orchestra.run.smithi120.stdout:2121 write 0x12da4fc thru 0x12dff7a (0x5a7f bytes) 2024-09-13T05:10:58.308 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:10:58.322 INFO:teuthology.orchestra.run.smithi120.stdout:2122 write 0x875b519 thru 0x875fc2c (0x4714 bytes) 2024-09-13T05:10:58.329 INFO:teuthology.orchestra.run.smithi120.stdout:2123 read 0x5050b6 thru 0x510bad (0xbaf8 bytes) 2024-09-13T05:10:58.329 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:58.325+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:58.346 INFO:teuthology.orchestra.run.smithi120.stdout:2124 write 0x98c998c thru 0x98cebf8 (0x526d bytes) 2024-09-13T05:10:58.372 INFO:teuthology.orchestra.run.smithi120.stdout:2126 write 0xd34e58a thru 0xd358e63 (0xa8da bytes) 2024-09-13T05:10:58.379 INFO:teuthology.orchestra.run.smithi120.stdout:2128 read 0xc983409 thru 0xc98c184 (0x8d7c bytes) 2024-09-13T05:10:58.379 INFO:teuthology.orchestra.run.smithi120.stdout:2129 read 0x88bda04 thru 0x88c3afe (0x60fb bytes) 2024-09-13T05:10:58.385 INFO:teuthology.orchestra.run.smithi120.stdout:2131 trunc from 0xd358e64 to 0x9a7ba71 2024-09-13T05:10:58.405 INFO:teuthology.orchestra.run.smithi120.stdout:2132 read 0x785465e thru 0x785c982 (0x8325 bytes) 2024-09-13T05:10:58.406 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:58.406 INFO:teuthology.orchestra.run.smithi120.stdout:2134 write 0x411f40 thru 0x420f47 (0xf008 bytes) 2024-09-13T05:10:58.409 INFO:teuthology.orchestra.run.smithi120.stdout:2135 read 0x62a19c thru 0x63549c (0xb301 bytes) 2024-09-13T05:10:58.410 INFO:teuthology.orchestra.run.smithi120.stdout:2136 write 0x460060a thru 0x4608c09 (0x8600 bytes) 2024-09-13T05:10:58.416 INFO:teuthology.orchestra.run.smithi120.stdout:2137 clone 18 order 23 su 262144 sc 10 2024-09-13T05:10:58.428 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:58.422+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:58.436 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:58.436 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:58.446 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:10:58.529 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:58.526+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:58.558 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:58.558 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:58.568 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:10:58.630 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:58.625+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:58.671 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:58.671 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:58.680 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:10:58.730 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:58.725+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:58.784 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:58.784 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:58.794 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:10:58.831 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:10:58.825+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:10:58.901 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:58.901 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:58.911 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:10:58.932 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:10:58.926+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:10:59.023 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:59.023 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:59.030 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T05:10:59.033 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:10:59.030+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:10:59.037 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:10:59.134 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:59.129+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:59.143 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:59.144 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:59.153 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:10:59.235 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:59.230+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:59.266 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:59.267 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:59.272 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #16, image image_client.0-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent17 2024-09-13T05:10:59.277 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:10:59.336 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:59.329+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:59.382 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:59.382 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:59.392 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:10:59.414 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:10:59.461 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:10:59.457+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:10:59.497 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:59.497 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:59.507 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:10:59.537 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:59.534+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:59.545 INFO:teuthology.orchestra.run.smithi120.stdout:2139 read 0x4fd9405 thru 0x4fe5987 (0xc583 bytes) 2024-09-13T05:10:59.552 INFO:teuthology.orchestra.run.smithi120.stdout:2140 punch from 0x230f5f0 to 0x2316c1e, (0x762e bytes) 2024-09-13T05:10:59.552 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:59.553 INFO:teuthology.orchestra.run.smithi120.stdout:2142 punch from 0x146e4cb to 0x1471acb, (0x3600 bytes) 2024-09-13T05:10:59.553 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:59.553 INFO:teuthology.orchestra.run.smithi120.stdout:2144 writesame 0xee4a0a thru 0xef1e3d data_size 0x36(0xd434 bytes) 2024-09-13T05:10:59.553 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:10:59.562 INFO:teuthology.orchestra.run.smithi120.stdout:2145 trunc from 0x9a7ba71 to 0xa9579d9 2024-09-13T05:10:59.571 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:59.578 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:10:59.586 INFO:teuthology.orchestra.run.smithi120.stdout:2147 writesame 0xe1e80c4 thru 0xe1f193e data_size 0x25(0x987b bytes) 2024-09-13T05:10:59.586 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:59.586 INFO:teuthology.orchestra.run.smithi120.stdout:2149 write 0x63e4131 thru 0x63ed60f (0x94df bytes) 2024-09-13T05:10:59.592 INFO:teuthology.orchestra.run.smithi120.stdout:2151 write 0x894d24 thru 0x8965c5 (0x18a2 bytes) 2024-09-13T05:10:59.600 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:10:59.603 INFO:teuthology.orchestra.run.smithi120.stdout:2152 write 0xd29b323 thru 0xd2a9849 (0xe527 bytes) 2024-09-13T05:10:59.610 INFO:teuthology.orchestra.run.smithi120.stdout:2153 writesame 0x7a96fa7 thru 0x7aa6e9d data_size 0x1(0xfef7 bytes) 2024-09-13T05:10:59.622 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:10:59.623 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:10:59.623 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:10:59.633 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:10:59.638 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:10:59.634+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:10:59.642 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:10:59.661 INFO:teuthology.orchestra.run.smithi120.stdout:2154 punch from 0x3c8895 to 0x3cc5c6, (0x3d31 bytes) 2024-09-13T05:10:59.661 INFO:teuthology.orchestra.run.smithi120.stdout:2155 write 0x3c2ce37 thru 0x3c39725 (0xc8ef bytes) 2024-09-13T05:10:59.662 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:10:59.670 INFO:teuthology.orchestra.run.smithi120.stdout:2156 punch from 0xd31d6ef to 0xd321275, (0x3b86 bytes) 2024-09-13T05:10:59.670 INFO:teuthology.orchestra.run.smithi120.stdout:2157 write 0xc4160e5 thru 0xc425c47 (0xfb63 bytes) 2024-09-13T05:10:59.675 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:59.675 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:59.683 INFO:teuthology.orchestra.run.smithi120.stdout:2161 trunc from 0xe1f193f to 0xa0f3fe2 2024-09-13T05:10:59.684 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:10:59.700 INFO:teuthology.orchestra.run.smithi120.stdout:2162 read 0x949cb4f thru 0x94a52cc (0x877e bytes) 2024-09-13T05:10:59.700 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:59.700 INFO:teuthology.orchestra.run.smithi120.stdout:2164 read 0x34fb00e thru 0x3503a87 (0x8a7a bytes) 2024-09-13T05:10:59.701 INFO:teuthology.orchestra.run.smithi120.stdout:2165 read 0x505b474 thru 0x505ee69 (0x39f6 bytes) 2024-09-13T05:10:59.706 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:10:59.710 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:10:59.710 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:10:59.710 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:10:59.710 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:10:59.710 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:10:59.710 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:10:59.711 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:10:59.711 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:10:59.713 INFO:teuthology.orchestra.run.smithi120.stdout:2166 trunc from 0xa0f3fe2 to 0x4680cf6 2024-09-13T05:10:59.739 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:10:59.733+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:10:59.742 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:59.742 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:10:59.742 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:10:59.742 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:10:59.742 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:10:59.742 INFO:teuthology.orchestra.run.smithi120.stdout:2168 read 0x3311ade thru 0x331d056 (0xb579 bytes) 2024-09-13T05:10:59.743 INFO:teuthology.orchestra.run.smithi120.stdout:2169 read 0x1d6e9ea thru 0x1d77235 (0x884c bytes) 2024-09-13T05:10:59.751 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:10:59.752 INFO:teuthology.orchestra.run.smithi120.stdout:2170 write 0x48fc842 thru 0x4900cc9 (0x4488 bytes) 2024-09-13T05:10:59.786 INFO:teuthology.orchestra.run.smithi120.stdout:2171 writesame 0xebb48dd thru 0xebbe2f8 data_size 0xe(0x9a1c bytes) 2024-09-13T05:10:59.786 INFO:teuthology.orchestra.run.smithi120.stdout:2173 writesame 0x4965cd0 thru 0x496c20d data_size 0x1(0x653e bytes) 2024-09-13T05:10:59.805 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:10:59.805 INFO:teuthology.orchestra.run.smithi120.stdout:2175 read 0xd438d11 thru 0xd448601 (0xf8f1 bytes) 2024-09-13T05:10:59.806 INFO:teuthology.orchestra.run.smithi120.stdout:2176 write 0xbf22360 thru 0xbf27ec4 (0x5b65 bytes) 2024-09-13T05:10:59.811 INFO:teuthology.orchestra.run.smithi120.stdout:2177 read 0x7c1bbb0 thru 0x7c1cce5 (0x1136 bytes) 2024-09-13T05:10:59.811 INFO:teuthology.orchestra.run.smithi120.stdout:2179 write 0xbe3cfac thru 0xbe42b40 (0x5b95 bytes) 2024-09-13T05:10:59.820 INFO:teuthology.orchestra.run.smithi120.stdout:2180 clone 19 order 25 su 1048576 sc 7 2024-09-13T05:10:59.840 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:10:59.834+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:10:59.911 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:10:59.911 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:10:59.911 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:10:59.912 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:10:59.912 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.912 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:59.912 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:10:59.912 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.044635512999999, 2024-09-13T05:10:59.912 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:10:59.912 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:59.912 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:59.912 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:59.912 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:59.912 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:59.912 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:10:59.913 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.913 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:59.913 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.913 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:59.913 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:10:59.913 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.913 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.913 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.913 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:59.913 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:10:59.913 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.913 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.913 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.914 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:59.914 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:10:59.914 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:59.914 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.914 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.914 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:59.914 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:10:59.914 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:10:59.914 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.914 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.914 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:59.914 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:10:59.914 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:10:59.914 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.915 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.915 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:59.915 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:10:59.915 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:10:59.915 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.915 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.915 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.915 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:10:59.915 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:10:59.915 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.915 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.915 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:59.915 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:10:59.915 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:10:59.916 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.916 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.916 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.916 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:10:59.916 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:10:59.916 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.916 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.916 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:59.916 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:10:59.916 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:10:59.916 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.916 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.916 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:59.917 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:10:59.917 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:10:59.917 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.917 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:59.917 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.917 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.917 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.917 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:59.917 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:10:59.917 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.044611076999999, 2024-09-13T05:10:59.917 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:10:59.917 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:59.917 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:10:59.918 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:59.918 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:59.918 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:59.918 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:10:59.918 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.918 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:59.918 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.918 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:59.918 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:10:59.918 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.918 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.918 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.918 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:59.918 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:10:59.919 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.919 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.919 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:59.919 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:10:59.919 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:59.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.919 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.919 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:59.919 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:10:59.919 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:10:59.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.919 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.919 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:59.920 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:10:59.920 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:10:59.920 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.920 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.920 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:59.920 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:10:59.920 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:10:59.920 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.920 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.920 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.920 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:10:59.920 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:10:59.920 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.921 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.921 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:59.921 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:10:59.921 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:10:59.921 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.921 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.921 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.921 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:10:59.921 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:10:59.921 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.921 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.921 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:10:59.921 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:10:59.921 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:10:59.922 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.922 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.922 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:59.922 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:10:59.922 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:10:59.922 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.922 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:59.922 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.922 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.922 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.922 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:59.922 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:10:59.922 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.044601251, 2024-09-13T05:10:59.922 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:10:59.923 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:59.923 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:59.923 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:59.923 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:59.923 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:59.923 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:10:59.923 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.923 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:59.923 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.923 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:59.923 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:10:59.923 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.923 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.923 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.924 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:59.924 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:10:59.924 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.924 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.924 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.924 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:59.924 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:10:59.924 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:59.924 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.924 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.924 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:59.924 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:10:59.924 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:10:59.925 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.925 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.925 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:59.925 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:10:59.925 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:10:59.925 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.925 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.925 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:59.925 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:10:59.925 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:10:59.925 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.925 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.925 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.925 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:10:59.926 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:10:59.926 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.926 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.926 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:59.926 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:10:59.926 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:10:59.926 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.926 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.926 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.926 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:10:59.926 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:10:59.926 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.926 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.926 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:59.927 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:10:59.927 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:10:59.927 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.927 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:59.927 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.927 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.927 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.927 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:59.927 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:10:59.927 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.044593015, 2024-09-13T05:10:59.927 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:10:59.927 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:59.927 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:59.928 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:59.928 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:59.928 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:59.928 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:10:59.928 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.928 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:59.928 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.928 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:59.928 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:10:59.928 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.928 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.928 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.928 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:59.928 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:10:59.929 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.929 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.929 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:59.929 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:10:59.929 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:59.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.929 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.929 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:59.929 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:10:59.929 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:10:59.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.929 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.929 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:59.930 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:10:59.930 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:10:59.930 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.930 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.930 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:59.930 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:10:59.930 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:10:59.930 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.930 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.930 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.930 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:10:59.930 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:10:59.930 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.930 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.931 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:59.931 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:10:59.931 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:10:59.931 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.931 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.931 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.931 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:10:59.931 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:10:59.931 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.931 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.931 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:59.931 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:10:59.931 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:10:59.931 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.932 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:59.932 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.932 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.932 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.932 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:59.932 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:10:59.932 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.044571102999999, 2024-09-13T05:10:59.932 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:10:59.932 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:59.932 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:59.932 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:59.932 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:59.932 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:59.933 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:10:59.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.933 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:59.933 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.933 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:59.933 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:10:59.933 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.933 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.933 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:59.933 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:10:59.933 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.933 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.934 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:59.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:10:59.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:59.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.934 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.934 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:59.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:10:59.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:10:59.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.934 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.934 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:59.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:10:59.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:10:59.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.935 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.935 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:59.935 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:10:59.935 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:10:59.935 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.935 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.935 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.935 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:10:59.935 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:10:59.935 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.935 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.935 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:59.935 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:10:59.935 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:10:59.936 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.936 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.936 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.936 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:10:59.936 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:10:59.936 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.936 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.936 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:59.936 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:10:59.936 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:10:59.936 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.936 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:59.936 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.937 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.937 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.937 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:59.937 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:10:59.937 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.044562499000001, 2024-09-13T05:10:59.937 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:10:59.937 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:59.937 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:59.937 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:59.937 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:59.937 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:59.937 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:10:59.937 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.937 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:59.938 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.938 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:59.938 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:10:59.938 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.938 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.938 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.938 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:59.938 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:10:59.938 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.938 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.938 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.938 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:59.938 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:10:59.938 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:59.939 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.939 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.939 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:59.939 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:10:59.939 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:10:59.939 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.939 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.939 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:59.939 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:10:59.939 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:10:59.939 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.939 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.939 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:59.939 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:10:59.940 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:10:59.940 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.940 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.940 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.940 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:10:59.940 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:10:59.940 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.940 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.940 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:59.940 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:10:59.940 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:10:59.940 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.940 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.941 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.941 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:10:59.941 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:10:59.941 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.941 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.941 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:59.941 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:10:59.941 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:10:59.941 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.941 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:59.941 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.941 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.941 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.941 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:59.942 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:10:59.942 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.044552804999999, 2024-09-13T05:10:59.942 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:10:59.942 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:59.942 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:59.942 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:59.942 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:59.942 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:59.942 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:10:59.942 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.942 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:59.942 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.942 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:59.942 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:10:59.943 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.943 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:59.943 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:10:59.943 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.943 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:59.943 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:10:59.943 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:59.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.943 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:59.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:10:59.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:10:59.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.944 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:59.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:10:59.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:10:59.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.944 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:59.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:10:59.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:10:59.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.945 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.945 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.945 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:10:59.945 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:10:59.945 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.945 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.945 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:59.945 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:10:59.945 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:10:59.945 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.945 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.945 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.945 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:10:59.945 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:10:59.946 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.946 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.946 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:59.946 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:10:59.946 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:10:59.946 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.946 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:59.946 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.946 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.946 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.946 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:59.946 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:10:59.946 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.044543690000001, 2024-09-13T05:10:59.946 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:10:59.947 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:59.947 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:59.947 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:59.947 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:59.947 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:59.947 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:10:59.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.947 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:59.947 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.947 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:59.947 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:10:59.947 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.947 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.947 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:59.948 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:10:59.948 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.948 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:59.948 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:10:59.948 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:59.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.948 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:59.948 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:10:59.948 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:10:59.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.949 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.949 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:59.949 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:10:59.949 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:10:59.949 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.949 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.949 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:59.949 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:10:59.949 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:10:59.949 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.949 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.949 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.949 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:10:59.949 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:10:59.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.950 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:59.950 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:10:59.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:10:59.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.950 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.950 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:10:59.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:10:59.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.950 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:59.950 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:10:59.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:10:59.951 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.951 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:59.951 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.951 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.951 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:59.951 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:10:59.951 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.044535210999999, 2024-09-13T05:10:59.951 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:10:59.951 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:59.951 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:59.951 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:59.951 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:59.951 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:59.952 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:10:59.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.952 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:59.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.952 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:59.952 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:10:59.952 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.952 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:59.952 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:10:59.952 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.953 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:59.953 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:10:59.953 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:59.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.953 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:59.953 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:10:59.953 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:10:59.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.953 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:59.953 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:10:59.953 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:10:59.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:59.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:10:59.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:10:59.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:10:59.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:10:59.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:59.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:10:59.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:10:59.955 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.955 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.955 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.955 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:10:59.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:10:59.955 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.955 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.955 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:59.955 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:10:59.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:10:59.955 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.955 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:59.955 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.956 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.956 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.956 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:59.956 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:10:59.956 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.044523286, 2024-09-13T05:10:59.956 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:10:59.956 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:59.956 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:59.956 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:59.956 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:59.956 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:59.956 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:10:59.956 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.957 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:59.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:59.957 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:10:59.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:59.957 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:10:59.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:59.957 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:10:59.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:10:59.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:59.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:10:59.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:10:59.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:59.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:10:59.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:10:59.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:59.959 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:10:59.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:10:59.959 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.959 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.959 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:10:59.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:10:59.959 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.959 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:59.959 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:10:59.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:10:59.959 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:10:59.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:10:59.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:59.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:10:59.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:10:59.960 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.960 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:59.960 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.961 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:59.961 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:10:59.961 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.044501697000001, 2024-09-13T05:10:59.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:10:59.961 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:59.961 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:59.961 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:59.961 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:59.961 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:59.961 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:10:59.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.961 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:59.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:59.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:10:59.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:59.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:10:59.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:59.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:10:59.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:59.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:59.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:10:59.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:10:59.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:59.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:10:59.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:10:59.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:59.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:10:59.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:10:59.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:10:59.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:10:59.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:59.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:10:59.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:10:59.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:10:59.965 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:10:59.965 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.965 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.965 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:59.965 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:10:59.965 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:10:59.965 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.965 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:59.965 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.965 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.965 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.965 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:59.965 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:10:59.965 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.044478568999999, 2024-09-13T05:10:59.966 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:10:59.966 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:59.966 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:59.966 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:59.966 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:59.966 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:59.966 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:10:59.966 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.966 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:59.966 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.966 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:59.966 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:10:59.966 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.966 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:59.967 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:10:59.967 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.967 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:59.967 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:10:59.967 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:59.967 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:59.967 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:10:59.967 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:10:59.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.968 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:59.968 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:10:59.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:10:59.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.968 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:59.968 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:10:59.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:10:59.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.968 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.968 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:10:59.969 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:10:59.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.969 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:59.969 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:10:59.969 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:10:59.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.969 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.969 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:10:59.969 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:10:59.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:59.970 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:10:59.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:10:59.970 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.970 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:59.970 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.970 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.970 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:59.970 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:10:59.970 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.044463195999999, 2024-09-13T05:10:59.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:10:59.970 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:59.970 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:59.971 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:59.971 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:59.971 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:59.971 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:10:59.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.971 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:59.971 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.971 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:59.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:10:59.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.971 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.971 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:59.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:10:59.972 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.972 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.972 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:59.972 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:10:59.972 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:59.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.972 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.972 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:59.972 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:10:59.972 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:10:59.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.972 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.972 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:59.973 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:10:59.973 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:10:59.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.973 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:59.973 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:10:59.973 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:10:59.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.973 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.973 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:10:59.973 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:10:59.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.974 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:59.974 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:10:59.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:10:59.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.974 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.974 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:10:59.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:10:59.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.974 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:59.974 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:10:59.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:10:59.975 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.975 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:59.975 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.975 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.975 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:59.975 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:10:59.975 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.044442728, 2024-09-13T05:10:59.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:10:59.976 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:59.976 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:59.976 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:59.976 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:59.976 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:59.976 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:10:59.976 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.976 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:59.976 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.976 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:59.976 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:10:59.976 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.976 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.976 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.977 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:59.977 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:10:59.977 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.977 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.977 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.977 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:59.977 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:10:59.977 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:59.977 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.977 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.977 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:59.977 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:10:59.977 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:10:59.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.978 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.978 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:59.978 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:10:59.978 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:10:59.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.978 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.978 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:59.978 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:10:59.978 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:10:59.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.978 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.978 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.978 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:10:59.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:10:59.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:59.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:10:59.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:10:59.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:10:59.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:10:59.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:59.980 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:10:59.980 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:10:59.980 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.980 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:59.980 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.980 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.980 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:59.980 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:10:59.980 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.044426067, 2024-09-13T05:10:59.980 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:10:59.980 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:59.980 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:59.980 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:59.981 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:59.981 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:59.981 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:10:59.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.981 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:59.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.981 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:59.981 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:10:59.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.981 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:59.981 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:10:59.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.982 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.982 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:59.982 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:10:59.982 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:59.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.982 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.982 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:59.982 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:10:59.982 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:10:59.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.982 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.982 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:59.983 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:10:59.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:10:59.983 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:59.983 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:10:59.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:10:59.983 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.983 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:10:59.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:10:59.983 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:59.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:10:59.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:10:59.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:10:59.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:10:59.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:59.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:10:59.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:10:59.985 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.985 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:59.985 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.985 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:59.985 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:10:59.985 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.044399353999999, 2024-09-13T05:10:59.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:10:59.985 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:59.985 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:59.985 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:59.985 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:59.986 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:59.986 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:10:59.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.986 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:59.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:59.986 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:10:59.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:59.986 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:10:59.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:59.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:10:59.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:59.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:59.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:10:59.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:10:59.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:59.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:10:59.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:10:59.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.988 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:59.988 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:10:59.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:10:59.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.988 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.988 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:10:59.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:10:59.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.988 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:59.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:10:59.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:10:59.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:10:59.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:10:59.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:59.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:10:59.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:10:59.989 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.990 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:59.990 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.990 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:59.990 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:10:59.990 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.044380501999999, 2024-09-13T05:10:59.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:10:59.990 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:59.990 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:59.990 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:59.990 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:59.990 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:59.991 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:10:59.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.991 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:59.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.991 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:59.991 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:10:59.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.991 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:59.991 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:10:59.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.992 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:59.992 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:10:59.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:59.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.992 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:59.992 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:10:59.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:10:59.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.992 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:59.992 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:10:59.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:10:59.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:59.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:10:59.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:10:59.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:10:59.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:10:59.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:59.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:10:59.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:10:59.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.994 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:10:59.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:10:59.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.994 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:59.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:10:59.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:10:59.994 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.994 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:59.994 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.995 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.995 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.995 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:10:59.995 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:10:59.995 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.044362715999998, 2024-09-13T05:10:59.995 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:10:59.995 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:10:59.995 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:10:59.995 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:10:59.995 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:10:59.995 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:10:59.995 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:10:59.995 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.995 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:10:59.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:10:59.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:10:59.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:10:59.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:10:59.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:10:59.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:10:59.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:10:59.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:10:59.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:10:59.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:10:59.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:10:59.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:10:59.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:10:59.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:10:59.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:10:59.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:10:59.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:10:59.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:10:59.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:10:59.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:10:59.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:10:59.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:10:59.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:10:59.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:10:59.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:10:59.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:10:59.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:10:59.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:10:59.999 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.999 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:10:59.999 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:10:59.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:10:59.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:10:59.999 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:00.000 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:00.000 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.044327656, 2024-09-13T05:11:00.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:11:00.000 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:00.000 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:00.000 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:00.000 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:00.000 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.000 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:11:00.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:00.000 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:00.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:00.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:00.000 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:00.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:00.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:00.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:00.001 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:00.001 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:00.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:00.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:00.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:00.001 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:00.001 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:00.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:00.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:00.001 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:00.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:11:00.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:11:00.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:00.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:00.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:00.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:11:00.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:11:00.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:00.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:00.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:11:00.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:11:00.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:00.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:00.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:00.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:11:00.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:11:00.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:00.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:00.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:00.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:11:00.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:11:00.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:00.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:00.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:00.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:11:00.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:11:00.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:00.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:00.004 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:00.004 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:11:00.004 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:11:00.004 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:00.004 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:00.004 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:00.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:00.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:00.004 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:00.004 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:00.004 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.044310841000001, 2024-09-13T05:11:00.004 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:11:00.005 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:00.005 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:00.005 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:00.005 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:00.005 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.005 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:11:00.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:00.005 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:00.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:00.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:00.005 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:00.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:00.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:00.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:00.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:00.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:00.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:00.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:00.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:00.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:00.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:00.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:00.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:00.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:00.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:11:00.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:11:00.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:00.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:00.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:00.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:11:00.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:11:00.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:00.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:00.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:11:00.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:11:00.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:00.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:00.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:00.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:11:00.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:11:00.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:00.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:00.008 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:00.008 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:11:00.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:11:00.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:00.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:00.008 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:00.008 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:11:00.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:11:00.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:00.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:00.008 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:00.009 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:11:00.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:11:00.009 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:00.009 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:00.009 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:00.009 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:00.009 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:00.009 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:00.010 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:00.006+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:00.011 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:11:00.038 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is set 2024-09-13T05:11:00.090 INFO:tasks.thrashosds.thrasher:in_osds: [2, 3, 5, 6, 7] out_osds: [4, 1, 0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T05:11:00.090 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-13T05:11:00.113 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:00.110+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:00.130 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:00.131 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:00.131 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:00.131 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:00.139 INFO:teuthology.orchestra.run.smithi120.stdout:leaving image image_client.0-clone18 intact 2024-09-13T05:11:00.142 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:11:00.214 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:00.210+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:00.289 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:00.289 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:00.289 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:00.289 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:00.289 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:00.299 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:11:00.316 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:00.310+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:00.343 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #17, image image_client.0-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent18 2024-09-13T05:11:00.411 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14179 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1835008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:11:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.651140035000001, 2024-09-13T05:11:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0924508550000001, 2024-09-13T05:11:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.412 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14179 2024-09-13T05:11:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:11:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:11:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757551+0000", 2024-09-13T05:11:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757554+0000", 2024-09-13T05:11:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5440000000000001e-06 2024-09-13T05:11:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757560+0000", 2024-09-13T05:11:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6840000000000001e-06 2024-09-13T05:11:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757564+0000", 2024-09-13T05:11:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3529999999999997e-06 2024-09-13T05:11:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814931+0000", 2024-09-13T05:11:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057367564000000003 2024-09-13T05:11:00.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:00.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814938+0000", 2024-09-13T05:11:00.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1070000000000001e-06 2024-09-13T05:11:00.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.849802+0000", 2024-09-13T05:11:00.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348647849999999 2024-09-13T05:11:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.849885+0000", 2024-09-13T05:11:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2859000000000001e-05 2024-09-13T05:11:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850003+0000", 2024-09-13T05:11:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117279 2024-09-13T05:11:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.417 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14180 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1844224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.65112375, 2024-09-13T05:11:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.092637853, 2024-09-13T05:11:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14180 2024-09-13T05:11:00.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757570+0000", 2024-09-13T05:11:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3470000000000001e-06 2024-09-13T05:11:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757576+0000", 2024-09-13T05:11:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5550000000000002e-06 2024-09-13T05:11:00.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757580+0000", 2024-09-13T05:11:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6519999999999997e-06 2024-09-13T05:11:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814975+0000", 2024-09-13T05:11:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057394349999999997 2024-09-13T05:11:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:00.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814981+0000", 2024-09-13T05:11:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4119999999999998e-06 2024-09-13T05:11:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850042+0000", 2024-09-13T05:11:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0350611759999999 2024-09-13T05:11:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850103+0000", 2024-09-13T05:11:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0618000000000001e-05 2024-09-13T05:11:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850206+0000", 2024-09-13T05:11:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010309199999999999 2024-09-13T05:11:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14196 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1991680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.647324663999999, 2024-09-13T05:11:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0925442910000001, 2024-09-13T05:11:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14196 2024-09-13T05:11:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:00.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761368+0000", 2024-09-13T05:11:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3689999999999999e-06 2024-09-13T05:11:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761373+0000", 2024-09-13T05:11:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7180000000000004e-06 2024-09-13T05:11:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761376+0000", 2024-09-13T05:11:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0860000000000002e-06 2024-09-13T05:11:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815501+0000", 2024-09-13T05:11:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054125508000000003 2024-09-13T05:11:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815508+0000", 2024-09-13T05:11:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5570000000000001e-06 2024-09-13T05:11:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853689+0000", 2024-09-13T05:11:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0381811919999999 2024-09-13T05:11:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853764+0000", 2024-09-13T05:11:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4893000000000003e-05 2024-09-13T05:11:00.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853911+0000", 2024-09-13T05:11:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014721100000000001 2024-09-13T05:11:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14197 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2000896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.64731342, 2024-09-13T05:11:00.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.092841977, 2024-09-13T05:11:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14197 2024-09-13T05:11:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761403+0000", 2024-09-13T05:11:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5199e-05 2024-09-13T05:11:00.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761411+0000", 2024-09-13T05:11:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4540000000000001e-06 2024-09-13T05:11:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761418+0000", 2024-09-13T05:11:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9569999999999996e-06 2024-09-13T05:11:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815531+0000", 2024-09-13T05:11:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054113599999999998 2024-09-13T05:11:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815539+0000", 2024-09-13T05:11:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.481e-06 2024-09-13T05:11:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853949+0000", 2024-09-13T05:11:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.038410356 2024-09-13T05:11:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854022+0000", 2024-09-13T05:11:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2807999999999998e-05 2024-09-13T05:11:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854220+0000", 2024-09-13T05:11:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000198364 2024-09-13T05:11:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.433 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14198 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2010112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.647268411999999, 2024-09-13T05:11:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093063787, 2024-09-13T05:11:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14198 2024-09-13T05:11:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761426+0000", 2024-09-13T05:11:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8789999999999999e-06 2024-09-13T05:11:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761432+0000", 2024-09-13T05:11:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1399999999999997e-06 2024-09-13T05:11:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761437+0000", 2024-09-13T05:11:00.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8579999999999999e-06 2024-09-13T05:11:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815563+0000", 2024-09-13T05:11:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054125877000000003 2024-09-13T05:11:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815570+0000", 2024-09-13T05:11:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1169999999999998e-06 2024-09-13T05:11:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854265+0000", 2024-09-13T05:11:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0386955659999999 2024-09-13T05:11:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854338+0000", 2024-09-13T05:11:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2537e-05 2024-09-13T05:11:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854487+0000", 2024-09-13T05:11:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014927899999999999 2024-09-13T05:11:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.438 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14199 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.647249539000001, 2024-09-13T05:11:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0933252389999999, 2024-09-13T05:11:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14199 2024-09-13T05:11:00.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761445+0000", 2024-09-13T05:11:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7779999999999999e-06 2024-09-13T05:11:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761450+0000", 2024-09-13T05:11:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6350000000000003e-06 2024-09-13T05:11:00.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761455+0000", 2024-09-13T05:11:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9930000000000003e-06 2024-09-13T05:11:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815600+0000", 2024-09-13T05:11:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054144982000000001 2024-09-13T05:11:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815607+0000", 2024-09-13T05:11:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4749999999999998e-06 2024-09-13T05:11:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854527+0000", 2024-09-13T05:11:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.038920037 2024-09-13T05:11:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854637+0000", 2024-09-13T05:11:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011021700000000001 2024-09-13T05:11:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854767+0000", 2024-09-13T05:11:00.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130512 2024-09-13T05:11:00.444 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.444 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.444 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.444 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14200 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2028544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.444 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:11:00.444 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.647231026, 2024-09-13T05:11:00.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093541554, 2024-09-13T05:11:00.444 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.444 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.445 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.445 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.445 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.445 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14200 2024-09-13T05:11:00.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.445 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:11:00.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:11:00.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761460+0000", 2024-09-13T05:11:00.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761462+0000", 2024-09-13T05:11:00.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9659999999999999e-06 2024-09-13T05:11:00.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761466+0000", 2024-09-13T05:11:00.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6109999999999998e-06 2024-09-13T05:11:00.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761471+0000", 2024-09-13T05:11:00.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1019999999999996e-06 2024-09-13T05:11:00.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815631+0000", 2024-09-13T05:11:00.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054159680000000002 2024-09-13T05:11:00.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:00.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815637+0000", 2024-09-13T05:11:00.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-09-13T05:11:00.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854810+0000", 2024-09-13T05:11:00.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0391731930000001 2024-09-13T05:11:00.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854883+0000", 2024-09-13T05:11:00.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3109999999999996e-05 2024-09-13T05:11:00.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855002+0000", 2024-09-13T05:11:00.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011934600000000001 2024-09-13T05:11:00.449 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.449 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.449 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.449 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14201 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2037760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.449 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:00.450 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.647216596, 2024-09-13T05:11:00.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0937543320000001, 2024-09-13T05:11:00.450 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.450 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.450 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.450 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.450 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.450 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14201 2024-09-13T05:11:00.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.450 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:00.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:00.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:00.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761477+0000", 2024-09-13T05:11:00.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5620000000000002e-06 2024-09-13T05:11:00.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761483+0000", 2024-09-13T05:11:00.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7400000000000001e-06 2024-09-13T05:11:00.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761487+0000", 2024-09-13T05:11:00.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8130000000000002e-06 2024-09-13T05:11:00.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815697+0000", 2024-09-13T05:11:00.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054210253 2024-09-13T05:11:00.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:00.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815705+0000", 2024-09-13T05:11:00.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7049999999999999e-06 2024-09-13T05:11:00.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855036+0000", 2024-09-13T05:11:00.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.039330799 2024-09-13T05:11:00.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855110+0000", 2024-09-13T05:11:00.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4498000000000004e-05 2024-09-13T05:11:00.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855229+0000", 2024-09-13T05:11:00.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119282 2024-09-13T05:11:00.454 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.454 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.454 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.455 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14202 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.455 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:11:00.455 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.647151939, 2024-09-13T05:11:00.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093934027, 2024-09-13T05:11:00.455 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.455 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.455 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.455 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.455 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.455 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14202 2024-09-13T05:11:00.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.455 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:11:00.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:11:00.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761489+0000", 2024-09-13T05:11:00.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999495 2024-09-13T05:11:00.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761543+0000", 2024-09-13T05:11:00.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3983999999999997e-05 2024-09-13T05:11:00.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761552+0000", 2024-09-13T05:11:00.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-13T05:11:00.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761559+0000", 2024-09-13T05:11:00.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7710000000000001e-06 2024-09-13T05:11:00.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815742+0000", 2024-09-13T05:11:00.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054183488000000002 2024-09-13T05:11:00.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:00.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815749+0000", 2024-09-13T05:11:00.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1609999999999997e-06 2024-09-13T05:11:00.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855283+0000", 2024-09-13T05:11:00.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0395336230000001 2024-09-13T05:11:00.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855354+0000", 2024-09-13T05:11:00.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1456000000000002e-05 2024-09-13T05:11:00.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855474+0000", 2024-09-13T05:11:00.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119429 2024-09-13T05:11:00.459 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.459 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.460 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.460 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14294 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2113536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.460 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:11:00.460 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.643601024999999, 2024-09-13T05:11:00.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0923650330000001, 2024-09-13T05:11:00.460 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.460 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.460 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.460 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.460 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.460 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14294 2024-09-13T05:11:00.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.461 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:11:00.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:11:00.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765090+0000", 2024-09-13T05:11:00.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:00.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765092+0000", 2024-09-13T05:11:00.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.542e-06 2024-09-13T05:11:00.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765096+0000", 2024-09-13T05:11:00.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6179999999999999e-06 2024-09-13T05:11:00.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765098+0000", 2024-09-13T05:11:00.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8049999999999998e-06 2024-09-13T05:11:00.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816384+0000", 2024-09-13T05:11:00.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051285338999999999 2024-09-13T05:11:00.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:00.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816393+0000", 2024-09-13T05:11:00.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-09-13T05:11:00.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857258+0000", 2024-09-13T05:11:00.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0408652549999999 2024-09-13T05:11:00.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857327+0000", 2024-09-13T05:11:00.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8714000000000007e-05 2024-09-13T05:11:00.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857456+0000", 2024-09-13T05:11:00.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012909299999999999 2024-09-13T05:11:00.465 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.465 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.465 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.465 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14295 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2122752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.465 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:00.465 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.643591267000001, 2024-09-13T05:11:00.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0928006969999999, 2024-09-13T05:11:00.466 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.466 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.466 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14295 2024-09-13T05:11:00.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.466 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:00.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:00.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:00.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:00.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765102+0000", 2024-09-13T05:11:00.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3990000000000001e-06 2024-09-13T05:11:00.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765104+0000", 2024-09-13T05:11:00.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:11:00.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765107+0000", 2024-09-13T05:11:00.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.582e-06 2024-09-13T05:11:00.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816432+0000", 2024-09-13T05:11:00.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051325118000000003 2024-09-13T05:11:00.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:00.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816440+0000", 2024-09-13T05:11:00.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4679999999999992e-06 2024-09-13T05:11:00.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857495+0000", 2024-09-13T05:11:00.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.041054216 2024-09-13T05:11:00.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857644+0000", 2024-09-13T05:11:00.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014909400000000001 2024-09-13T05:11:00.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857901+0000", 2024-09-13T05:11:00.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025746200000000002 2024-09-13T05:11:00.470 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.470 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.471 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.471 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14296 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2131968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.471 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:11:00.471 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.643583021000001, 2024-09-13T05:11:00.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093120361, 2024-09-13T05:11:00.471 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.471 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.471 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.471 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.471 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.471 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14296 2024-09-13T05:11:00.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.472 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:11:00.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:11:00.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765108+0000", 2024-09-13T05:11:00.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:00.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765110+0000", 2024-09-13T05:11:00.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.226e-06 2024-09-13T05:11:00.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765112+0000", 2024-09-13T05:11:00.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6769999999999999e-06 2024-09-13T05:11:00.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765115+0000", 2024-09-13T05:11:00.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.712e-06 2024-09-13T05:11:00.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816479+0000", 2024-09-13T05:11:00.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051364102000000002 2024-09-13T05:11:00.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:00.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816503+0000", 2024-09-13T05:11:00.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3723999999999999e-05 2024-09-13T05:11:00.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857929+0000", 2024-09-13T05:11:00.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0414263180000001 2024-09-13T05:11:00.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858015+0000", 2024-09-13T05:11:00.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5730999999999996e-05 2024-09-13T05:11:00.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858229+0000", 2024-09-13T05:11:00.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021408700000000001 2024-09-13T05:11:00.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.476 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.476 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14297 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2141184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.476 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:00.476 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.643574676, 2024-09-13T05:11:00.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0936699510000001, 2024-09-13T05:11:00.476 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.476 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.477 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14297 2024-09-13T05:11:00.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.477 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:00.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:00.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:00.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:00.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765118+0000", 2024-09-13T05:11:00.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4190000000000001e-06 2024-09-13T05:11:00.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765121+0000", 2024-09-13T05:11:00.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6110000000000001e-06 2024-09-13T05:11:00.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765124+0000", 2024-09-13T05:11:00.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3720000000000001e-06 2024-09-13T05:11:00.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816535+0000", 2024-09-13T05:11:00.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051410890000000001 2024-09-13T05:11:00.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:00.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816556+0000", 2024-09-13T05:11:00.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0551e-05 2024-09-13T05:11:00.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858552+0000", 2024-09-13T05:11:00.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0419965529999999 2024-09-13T05:11:00.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858640+0000", 2024-09-13T05:11:00.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7907999999999999e-05 2024-09-13T05:11:00.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858787+0000", 2024-09-13T05:11:00.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000146864 2024-09-13T05:11:00.481 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.481 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.481 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.482 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14298 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2150400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.482 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:00.482 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.643565283000001, 2024-09-13T05:11:00.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0938958759999999, 2024-09-13T05:11:00.482 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.482 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.482 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.482 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.482 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.482 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14298 2024-09-13T05:11:00.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.482 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:00.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:00.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:00.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:00.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765128+0000", 2024-09-13T05:11:00.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4139999999999999e-06 2024-09-13T05:11:00.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765130+0000", 2024-09-13T05:11:00.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6809999999999998e-06 2024-09-13T05:11:00.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765133+0000", 2024-09-13T05:11:00.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9270000000000001e-06 2024-09-13T05:11:00.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816592+0000", 2024-09-13T05:11:00.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051459029000000003 2024-09-13T05:11:00.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:00.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816601+0000", 2024-09-13T05:11:00.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9819999999999997e-06 2024-09-13T05:11:00.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858818+0000", 2024-09-13T05:11:00.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0422167170000001 2024-09-13T05:11:00.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858896+0000", 2024-09-13T05:11:00.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8128999999999997e-05 2024-09-13T05:11:00.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859022+0000", 2024-09-13T05:11:00.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012619899999999999 2024-09-13T05:11:00.486 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.486 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.487 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.487 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14299 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2168832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.487 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:00.487 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.643556519000001, 2024-09-13T05:11:00.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0941207909999999, 2024-09-13T05:11:00.487 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.487 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.487 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.487 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.487 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.487 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14299 2024-09-13T05:11:00.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.488 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:00.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:00.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:00.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:00.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765136+0000", 2024-09-13T05:11:00.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5230000000000001e-06 2024-09-13T05:11:00.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765139+0000", 2024-09-13T05:11:00.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.672e-06 2024-09-13T05:11:00.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765142+0000", 2024-09-13T05:11:00.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6680000000000001e-06 2024-09-13T05:11:00.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816632+0000", 2024-09-13T05:11:00.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051489886999999998 2024-09-13T05:11:00.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:00.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816643+0000", 2024-09-13T05:11:00.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1457000000000001e-05 2024-09-13T05:11:00.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859061+0000", 2024-09-13T05:11:00.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.042417616 2024-09-13T05:11:00.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859138+0000", 2024-09-13T05:11:00.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7077999999999996e-05 2024-09-13T05:11:00.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859256+0000", 2024-09-13T05:11:00.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118108 2024-09-13T05:11:00.492 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.492 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.492 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.492 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14300 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2159616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.492 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:00.492 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.643547709, 2024-09-13T05:11:00.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0943386719999999, 2024-09-13T05:11:00.492 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.492 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.492 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.493 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.493 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.493 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14300 2024-09-13T05:11:00.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.493 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:00.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:00.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:00.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:00.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765145+0000", 2024-09-13T05:11:00.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.488e-06 2024-09-13T05:11:00.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765148+0000", 2024-09-13T05:11:00.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6620000000000001e-06 2024-09-13T05:11:00.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765151+0000", 2024-09-13T05:11:00.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6419999999999999e-06 2024-09-13T05:11:00.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816677+0000", 2024-09-13T05:11:00.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051526776000000003 2024-09-13T05:11:00.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:00.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816689+0000", 2024-09-13T05:11:00.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1634000000000001e-05 2024-09-13T05:11:00.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859296+0000", 2024-09-13T05:11:00.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0426066009999999 2024-09-13T05:11:00.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859364+0000", 2024-09-13T05:11:00.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8745999999999995e-05 2024-09-13T05:11:00.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859483+0000", 2024-09-13T05:11:00.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011833900000000001 2024-09-13T05:11:00.497 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.497 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.497 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.497 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14301 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2178048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.497 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:11:00.497 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.643539075, 2024-09-13T05:11:00.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0946233009999999, 2024-09-13T05:11:00.498 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.498 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.498 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.498 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.498 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.498 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14301 2024-09-13T05:11:00.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.498 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:11:00.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:11:00.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765152+0000", 2024-09-13T05:11:00.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:00.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765154+0000", 2024-09-13T05:11:00.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.449e-06 2024-09-13T05:11:00.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765157+0000", 2024-09-13T05:11:00.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6809999999999998e-06 2024-09-13T05:11:00.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765159+0000", 2024-09-13T05:11:00.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6060000000000001e-06 2024-09-13T05:11:00.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816722+0000", 2024-09-13T05:11:00.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051562535 2024-09-13T05:11:00.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:00.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816733+0000", 2024-09-13T05:11:00.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1678000000000001e-05 2024-09-13T05:11:00.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859521+0000", 2024-09-13T05:11:00.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0427879440000001 2024-09-13T05:11:00.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859655+0000", 2024-09-13T05:11:00.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134053 2024-09-13T05:11:00.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859776+0000", 2024-09-13T05:11:00.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012058299999999999 2024-09-13T05:11:00.502 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.502 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.502 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.502 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14302 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2187264~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.502 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:00.503 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.643530498000001, 2024-09-13T05:11:00.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.094937383, 2024-09-13T05:11:00.503 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.503 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.503 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.503 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.503 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.503 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14302 2024-09-13T05:11:00.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.503 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:00.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:00.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:00.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:00.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765162+0000", 2024-09-13T05:11:00.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4589999999999999e-06 2024-09-13T05:11:00.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765165+0000", 2024-09-13T05:11:00.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6019999999999998e-06 2024-09-13T05:11:00.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765168+0000", 2024-09-13T05:11:00.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.497e-06 2024-09-13T05:11:00.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816764+0000", 2024-09-13T05:11:00.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051596722999999997 2024-09-13T05:11:00.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:00.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816776+0000", 2024-09-13T05:11:00.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1967000000000001e-05 2024-09-13T05:11:00.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859810+0000", 2024-09-13T05:11:00.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0430338299999999 2024-09-13T05:11:00.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859901+0000", 2024-09-13T05:11:00.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1397999999999995e-05 2024-09-13T05:11:00.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860099+0000", 2024-09-13T05:11:00.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000197133 2024-09-13T05:11:00.507 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.507 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.507 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.508 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14303 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2196480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.508 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:11:00.508 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.643522161, 2024-09-13T05:11:00.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.095199152, 2024-09-13T05:11:00.508 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.508 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.508 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.508 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.508 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.508 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14303 2024-09-13T05:11:00.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.508 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:11:00.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:11:00.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765169+0000", 2024-09-13T05:11:00.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765171+0000", 2024-09-13T05:11:00.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2899999999999999e-06 2024-09-13T05:11:00.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765173+0000", 2024-09-13T05:11:00.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-13T05:11:00.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765176+0000", 2024-09-13T05:11:00.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.016e-06 2024-09-13T05:11:00.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816811+0000", 2024-09-13T05:11:00.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051634684 2024-09-13T05:11:00.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:00.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816840+0000", 2024-09-13T05:11:00.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8690000000000001e-05 2024-09-13T05:11:00.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860135+0000", 2024-09-13T05:11:00.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0432951029999999 2024-09-13T05:11:00.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860255+0000", 2024-09-13T05:11:00.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119936 2024-09-13T05:11:00.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860369+0000", 2024-09-13T05:11:00.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113978 2024-09-13T05:11:00.513 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.513 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.513 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.513 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14304 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2205696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.513 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:00.513 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.643499293000001, 2024-09-13T05:11:00.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0955512999999999, 2024-09-13T05:11:00.513 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.513 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.513 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.513 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.514 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14304 2024-09-13T05:11:00.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.514 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:00.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:00.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:00.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765195+0000", 2024-09-13T05:11:00.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6599999999999999e-06 2024-09-13T05:11:00.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765200+0000", 2024-09-13T05:11:00.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.356e-06 2024-09-13T05:11:00.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765205+0000", 2024-09-13T05:11:00.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3000000000000001e-06 2024-09-13T05:11:00.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816901+0000", 2024-09-13T05:11:00.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051695451000000003 2024-09-13T05:11:00.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:00.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816963+0000", 2024-09-13T05:11:00.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2694000000000007e-05 2024-09-13T05:11:00.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860434+0000", 2024-09-13T05:11:00.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.04347053 2024-09-13T05:11:00.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860592+0000", 2024-09-13T05:11:00.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015854199999999999 2024-09-13T05:11:00.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860744+0000", 2024-09-13T05:11:00.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015133 2024-09-13T05:11:00.518 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.518 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.518 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.518 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.518 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.518 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:00.520 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:11:00.520 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:00.514+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:00.621 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:00.613+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:00.634 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:00.635 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:00.635 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:00.635 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:00.645 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:11:00.660 INFO:teuthology.orchestra.run.smithi120.stdout:2181 writesame 0xfa360c thru 0xfa74a1 data_size 0x1(0x3e96 bytes) 2024-09-13T05:11:00.692 INFO:teuthology.orchestra.run.smithi120.stdout:2183 read 0xa542ca3 thru 0xa54e947 (0xbca5 bytes) 2024-09-13T05:11:00.694 INFO:teuthology.orchestra.run.smithi120.stdout:2184 read 0x14677e0 thru 0x146b531 (0x3d52 bytes) 2024-09-13T05:11:00.698 INFO:teuthology.orchestra.run.smithi120.stdout:2185 punch from 0xa8b090 to 0xa97623, (0xc593 bytes) 2024-09-13T05:11:00.698 INFO:teuthology.orchestra.run.smithi120.stdout:2186 read 0x1ff0428 thru 0x1ff4fdc (0x4bb5 bytes) 2024-09-13T05:11:00.701 INFO:teuthology.orchestra.run.smithi120.stdout:2187 punch from 0xb647d05 to 0xb64d038, (0x5333 bytes) 2024-09-13T05:11:00.721 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:00.718+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:00.723 INFO:teuthology.orchestra.run.smithi120.stdout:2189 writesame 0xed85a17 thru 0xed885da data_size 0x2(0x2bc4 bytes) 2024-09-13T05:11:00.729 INFO:teuthology.orchestra.run.smithi120.stdout:2190 read 0x219111f thru 0x2193bca (0x2aac bytes) 2024-09-13T05:11:00.731 INFO:teuthology.orchestra.run.smithi120.stdout:2191 writesame 0xafc2ad8 thru 0xafcba98 data_size 0x9(0x8fc1 bytes) 2024-09-13T05:11:00.746 INFO:teuthology.orchestra.run.smithi120.stdout:2192 flatten 2024-09-13T05:11:00.755 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:00.755 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:00.755 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:00.755 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:00.755 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:00.766 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:11:00.767 INFO:teuthology.orchestra.run.smithi120.stdout:2193 writesame 0x5941bdf thru 0x5949db8 data_size 0xb(0x81da bytes) 2024-09-13T05:11:00.770 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:00.771 INFO:teuthology.orchestra.run.smithi120.stdout:2196 punch from 0x52c30ea to 0x52ca74e, (0x7664 bytes) 2024-09-13T05:11:00.771 INFO:teuthology.orchestra.run.smithi120.stdout:2197 writesame 0x56f9654 thru 0x5708fba data_size 0x7(0xf967 bytes) 2024-09-13T05:11:00.795 INFO:teuthology.orchestra.run.smithi120.stdout:2199 trunc from 0xed885db to 0x6638959 2024-09-13T05:11:00.822 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:00.818+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:00.822 INFO:teuthology.orchestra.run.smithi120.stdout:2200 read 0x6373838 thru 0x638279f (0xef68 bytes) 2024-09-13T05:11:00.823 INFO:teuthology.orchestra.run.smithi120.stdout:2201 read 0x1766a90 thru 0x1769d0e (0x327f bytes) 2024-09-13T05:11:00.824 INFO:teuthology.orchestra.run.smithi120.stdout:2202 writesame 0x2f8d744 thru 0x2f901bc data_size 0x1(0x2a79 bytes) 2024-09-13T05:11:00.851 INFO:teuthology.orchestra.run.smithi120.stdout:2203 trunc from 0x6638959 to 0xe507724 2024-09-13T05:11:00.864 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:00.864 INFO:teuthology.orchestra.run.smithi120.stdout:2205 write 0x8c3d1a9 thru 0x8c46fcf (0x9e27 bytes) 2024-09-13T05:11:00.867 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:00.867 INFO:teuthology.orchestra.run.smithi120.stdout:2207 read 0x764bb8e thru 0x7652b7d (0x6ff0 bytes) 2024-09-13T05:11:00.868 INFO:teuthology.orchestra.run.smithi120.stdout:2208 writesame 0x142b0eb thru 0x1432576 data_size 0x2(0x748c bytes) 2024-09-13T05:11:00.879 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:00.879 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:00.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:00.879 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:00.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.879 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10634 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 731136~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.880 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:00.880 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.475360641999998, 2024-09-13T05:11:00.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028136992999999999, 2024-09-13T05:11:00.880 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.880 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.880 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.880 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.880 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.880 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10634 2024-09-13T05:11:00.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.880 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:00.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:00.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:00.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401987+0000", 2024-09-13T05:11:00.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5090000000000001e-06 2024-09-13T05:11:00.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401997+0000", 2024-09-13T05:11:00.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8009999999999998e-06 2024-09-13T05:11:00.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402000+0000", 2024-09-13T05:11:00.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.756e-06 2024-09-13T05:11:00.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430035+0000", 2024-09-13T05:11:00.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028034967000000001 2024-09-13T05:11:00.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430081+0000", 2024-09-13T05:11:00.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6448e-05 2024-09-13T05:11:00.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430123+0000", 2024-09-13T05:11:00.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1758000000000002e-05 2024-09-13T05:11:00.884 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.884 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.884 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.884 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10635 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 740352~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.884 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:11:00.884 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.475344027999999, 2024-09-13T05:11:00.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028229890000000001, 2024-09-13T05:11:00.884 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.884 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.885 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.885 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.885 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.885 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10635 2024-09-13T05:11:00.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.885 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:11:00.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:11:00.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402002+0000", 2024-09-13T05:11:00.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402004+0000", 2024-09-13T05:11:00.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.575e-06 2024-09-13T05:11:00.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402007+0000", 2024-09-13T05:11:00.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1240000000000001e-06 2024-09-13T05:11:00.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402010+0000", 2024-09-13T05:11:00.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5859999999999999e-06 2024-09-13T05:11:00.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430146+0000", 2024-09-13T05:11:00.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028136746000000001 2024-09-13T05:11:00.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430195+0000", 2024-09-13T05:11:00.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8948e-05 2024-09-13T05:11:00.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430232+0000", 2024-09-13T05:11:00.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7159000000000001e-05 2024-09-13T05:11:00.888 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.888 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.888 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.889 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10636 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 749568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.889 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:11:00.889 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.475334921999998, 2024-09-13T05:11:00.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328440999999999, 2024-09-13T05:11:00.889 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.889 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.889 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10636 2024-09-13T05:11:00.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.890 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:11:00.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:11:00.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402011+0000", 2024-09-13T05:11:00.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:00.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402017+0000", 2024-09-13T05:11:00.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5620000000000003e-06 2024-09-13T05:11:00.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402020+0000", 2024-09-13T05:11:00.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1410000000000001e-06 2024-09-13T05:11:00.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402024+0000", 2024-09-13T05:11:00.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4489999999999999e-06 2024-09-13T05:11:00.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430256+0000", 2024-09-13T05:11:00.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028232363 2024-09-13T05:11:00.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430299+0000", 2024-09-13T05:11:00.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2830999999999997e-05 2024-09-13T05:11:00.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430340+0000", 2024-09-13T05:11:00.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1301000000000003e-05 2024-09-13T05:11:00.893 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.893 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.893 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.893 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10637 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 758784~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.893 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:00.893 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.475319808999998, 2024-09-13T05:11:00.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028441793, 2024-09-13T05:11:00.894 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.894 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.894 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.894 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.894 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.894 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10637 2024-09-13T05:11:00.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.894 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:00.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:00.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:00.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:00.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402031+0000", 2024-09-13T05:11:00.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6770000000000003e-06 2024-09-13T05:11:00.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402034+0000", 2024-09-13T05:11:00.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1540000000000002e-06 2024-09-13T05:11:00.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402038+0000", 2024-09-13T05:11:00.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4970000000000001e-06 2024-09-13T05:11:00.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430367+0000", 2024-09-13T05:11:00.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328906000000001 2024-09-13T05:11:00.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430416+0000", 2024-09-13T05:11:00.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:11:00.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430469+0000", 2024-09-13T05:11:00.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2284999999999998e-05 2024-09-13T05:11:00.898 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.898 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.898 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.898 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10638 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 768000~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.898 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:00.898 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.475306324999998, 2024-09-13T05:11:00.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028548740999999999, 2024-09-13T05:11:00.898 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.898 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.898 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.898 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.899 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.899 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10638 2024-09-13T05:11:00.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.899 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:00.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:00.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:00.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402041+0000", 2024-09-13T05:11:00.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4789999999999999e-06 2024-09-13T05:11:00.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402044+0000", 2024-09-13T05:11:00.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.694e-06 2024-09-13T05:11:00.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402047+0000", 2024-09-13T05:11:00.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.537e-06 2024-09-13T05:11:00.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430494+0000", 2024-09-13T05:11:00.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028447665 2024-09-13T05:11:00.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430544+0000", 2024-09-13T05:11:00.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9539000000000001e-05 2024-09-13T05:11:00.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430589+0000", 2024-09-13T05:11:00.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5071999999999998e-05 2024-09-13T05:11:00.902 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.902 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.902 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.902 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10639 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 777216~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.902 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:11:00.902 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.475295943999999, 2024-09-13T05:11:00.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028651769000000001, 2024-09-13T05:11:00.903 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.903 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.903 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.903 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.903 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.903 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10639 2024-09-13T05:11:00.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.903 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:11:00.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:11:00.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402050+0000", 2024-09-13T05:11:00.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402052+0000", 2024-09-13T05:11:00.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2249999999999999e-06 2024-09-13T05:11:00.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402054+0000", 2024-09-13T05:11:00.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8140000000000001e-06 2024-09-13T05:11:00.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402057+0000", 2024-09-13T05:11:00.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4889999999999998e-06 2024-09-13T05:11:00.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430607+0000", 2024-09-13T05:11:00.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028549896000000002 2024-09-13T05:11:00.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430651+0000", 2024-09-13T05:11:00.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4622000000000001e-05 2024-09-13T05:11:00.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430702+0000", 2024-09-13T05:11:00.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0980999999999999e-05 2024-09-13T05:11:00.906 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.907 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.907 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.907 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11151 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 779264~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.907 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:00.907 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.445524663, 2024-09-13T05:11:00.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028283188000000001, 2024-09-13T05:11:00.907 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.907 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.907 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11151 2024-09-13T05:11:00.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.908 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:00.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:00.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:00.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431827+0000", 2024-09-13T05:11:00.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0989999999999998e-06 2024-09-13T05:11:00.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431832+0000", 2024-09-13T05:11:00.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8829999999999997e-06 2024-09-13T05:11:00.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431835+0000", 2024-09-13T05:11:00.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.439e-06 2024-09-13T05:11:00.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.459955+0000", 2024-09-13T05:11:00.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028119858000000001 2024-09-13T05:11:00.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.460029+0000", 2024-09-13T05:11:00.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4264000000000006e-05 2024-09-13T05:11:00.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.460105+0000", 2024-09-13T05:11:00.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5906000000000001e-05 2024-09-13T05:11:00.911 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.911 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.911 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.911 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11897 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 579584~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.912 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:00.912 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.396375489, 2024-09-13T05:11:00.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028193354, 2024-09-13T05:11:00.912 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.912 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.912 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.912 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.912 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.912 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11897 2024-09-13T05:11:00.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.912 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:00.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:00.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:00.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480973+0000", 2024-09-13T05:11:00.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.934e-06 2024-09-13T05:11:00.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480976+0000", 2024-09-13T05:11:00.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.614e-06 2024-09-13T05:11:00.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480980+0000", 2024-09-13T05:11:00.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.377e-06 2024-09-13T05:11:00.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.508967+0000", 2024-09-13T05:11:00.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027987455000000001 2024-09-13T05:11:00.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509074+0000", 2024-09-13T05:11:00.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107379 2024-09-13T05:11:00.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509164+0000", 2024-09-13T05:11:00.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9979e-05 2024-09-13T05:11:00.916 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.916 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.916 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.916 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11898 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 588800~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.916 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:00.916 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.396363425000001, 2024-09-13T05:11:00.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028308628999999998, 2024-09-13T05:11:00.916 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.916 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.916 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.917 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.917 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.917 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11898 2024-09-13T05:11:00.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.917 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:00.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:00.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:00.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480984+0000", 2024-09-13T05:11:00.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:11:00.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480988+0000", 2024-09-13T05:11:00.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4640000000000002e-06 2024-09-13T05:11:00.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480991+0000", 2024-09-13T05:11:00.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3469999999999999e-06 2024-09-13T05:11:00.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509199+0000", 2024-09-13T05:11:00.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028207449999999998 2024-09-13T05:11:00.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509250+0000", 2024-09-13T05:11:00.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1375000000000002e-05 2024-09-13T05:11:00.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509292+0000", 2024-09-13T05:11:00.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1730000000000002e-05 2024-09-13T05:11:00.921 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.921 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.921 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.921 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11899 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 598016~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.921 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:00.921 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.396352583999999, 2024-09-13T05:11:00.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516703000000001, 2024-09-13T05:11:00.921 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.921 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.921 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.921 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.921 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.922 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11899 2024-09-13T05:11:00.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.922 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:00.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:00.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:00.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480995+0000", 2024-09-13T05:11:00.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7349999999999999e-06 2024-09-13T05:11:00.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481000+0000", 2024-09-13T05:11:00.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0289999999999996e-06 2024-09-13T05:11:00.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481004+0000", 2024-09-13T05:11:00.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3699999999999999e-06 2024-09-13T05:11:00.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509332+0000", 2024-09-13T05:11:00.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328320000000001 2024-09-13T05:11:00.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509428+0000", 2024-09-13T05:11:00.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6150999999999995e-05 2024-09-13T05:11:00.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509511+0000", 2024-09-13T05:11:00.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2396000000000002e-05 2024-09-13T05:11:00.928 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.928 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.928 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.929 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11900 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 607232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.929 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:11:00.929 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.396339995000002, 2024-09-13T05:11:00.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028621273999999999, 2024-09-13T05:11:00.929 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.929 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.929 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11900 2024-09-13T05:11:00.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.929 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:11:00.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:11:00.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481006+0000", 2024-09-13T05:11:00.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481008+0000", 2024-09-13T05:11:00.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.73e-06 2024-09-13T05:11:00.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481011+0000", 2024-09-13T05:11:00.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4000000000000001e-06 2024-09-13T05:11:00.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481015+0000", 2024-09-13T05:11:00.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2760000000000001e-06 2024-09-13T05:11:00.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509531+0000", 2024-09-13T05:11:00.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516102000000002 2024-09-13T05:11:00.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509588+0000", 2024-09-13T05:11:00.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7423999999999998e-05 2024-09-13T05:11:00.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509628+0000", 2024-09-13T05:11:00.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9644000000000002e-05 2024-09-13T05:11:00.933 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.933 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.933 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.933 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11901 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 616448~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.933 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:00.933 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.396329374, 2024-09-13T05:11:00.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028820500999999998, 2024-09-13T05:11:00.933 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.933 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.934 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11901 2024-09-13T05:11:00.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.934 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:00.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:00.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:00.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481022+0000", 2024-09-13T05:11:00.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0209999999999999e-06 2024-09-13T05:11:00.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481026+0000", 2024-09-13T05:11:00.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:11:00.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481029+0000", 2024-09-13T05:11:00.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.636e-06 2024-09-13T05:11:00.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509661+0000", 2024-09-13T05:11:00.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028631496999999999 2024-09-13T05:11:00.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509757+0000", 2024-09-13T05:11:00.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5780999999999997e-05 2024-09-13T05:11:00.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509838+0000", 2024-09-13T05:11:00.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1102999999999999e-05 2024-09-13T05:11:00.938 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.938 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.938 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.938 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11902 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 625664~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.938 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:00.938 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.396307512, 2024-09-13T05:11:00.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028894265999999998, 2024-09-13T05:11:00.938 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.938 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.939 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11902 2024-09-13T05:11:00.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.939 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:00.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:00.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:00.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481041+0000", 2024-09-13T05:11:00.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8020000000000001e-06 2024-09-13T05:11:00.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481044+0000", 2024-09-13T05:11:00.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7110000000000001e-06 2024-09-13T05:11:00.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481048+0000", 2024-09-13T05:11:00.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.411e-06 2024-09-13T05:11:00.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509851+0000", 2024-09-13T05:11:00.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028803295 2024-09-13T05:11:00.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509896+0000", 2024-09-13T05:11:00.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4963000000000003e-05 2024-09-13T05:11:00.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509933+0000", 2024-09-13T05:11:00.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7384e-05 2024-09-13T05:11:00.942 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.942 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.942 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.942 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11903 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 634880~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.943 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:00.943 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.396296276000001, 2024-09-13T05:11:00.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029118033000000001, 2024-09-13T05:11:00.943 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.943 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.943 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11903 2024-09-13T05:11:00.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.943 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:00.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:00.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:00.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481052+0000", 2024-09-13T05:11:00.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.581e-06 2024-09-13T05:11:00.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481055+0000", 2024-09-13T05:11:00.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4520000000000002e-06 2024-09-13T05:11:00.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481058+0000", 2024-09-13T05:11:00.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4599999999999999e-06 2024-09-13T05:11:00.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509967+0000", 2024-09-13T05:11:00.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028908257999999999 2024-09-13T05:11:00.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510062+0000", 2024-09-13T05:11:00.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5613999999999996e-05 2024-09-13T05:11:00.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510168+0000", 2024-09-13T05:11:00.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105951 2024-09-13T05:11:00.947 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.947 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.947 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.947 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11904 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 644096~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.947 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:00.947 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.396285380999998, 2024-09-13T05:11:00.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029301971, 2024-09-13T05:11:00.947 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.947 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.948 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.948 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.948 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.948 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11904 2024-09-13T05:11:00.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.948 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:00.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:00.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:00.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481063+0000", 2024-09-13T05:11:00.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6700000000000001e-06 2024-09-13T05:11:00.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481068+0000", 2024-09-13T05:11:00.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4519999999999996e-06 2024-09-13T05:11:00.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481074+0000", 2024-09-13T05:11:00.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8370000000000002e-06 2024-09-13T05:11:00.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510197+0000", 2024-09-13T05:11:00.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029123237999999999 2024-09-13T05:11:00.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510285+0000", 2024-09-13T05:11:00.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7676000000000006e-05 2024-09-13T05:11:00.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510363+0000", 2024-09-13T05:11:00.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8418999999999996e-05 2024-09-13T05:11:00.951 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.951 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.952 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.952 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11905 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 653312~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.952 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:11:00.952 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.396269641, 2024-09-13T05:11:00.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029480164, 2024-09-13T05:11:00.952 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.952 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.952 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.953 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.953 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.953 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11905 2024-09-13T05:11:00.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.953 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:11:00.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:11:00.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481076+0000", 2024-09-13T05:11:00.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481079+0000", 2024-09-13T05:11:00.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9629999999999998e-06 2024-09-13T05:11:00.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481087+0000", 2024-09-13T05:11:00.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6369999999999999e-06 2024-09-13T05:11:00.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481093+0000", 2024-09-13T05:11:00.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.857e-06 2024-09-13T05:11:00.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510408+0000", 2024-09-13T05:11:00.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029315213 2024-09-13T05:11:00.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510501+0000", 2024-09-13T05:11:00.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2916000000000003e-05 2024-09-13T05:11:00.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510557+0000", 2024-09-13T05:11:00.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6063999999999997e-05 2024-09-13T05:11:00.958 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.958 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.958 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.958 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11906 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 662528~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.958 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:11:00.958 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.396227627999998, 2024-09-13T05:11:00.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029575054999999999, 2024-09-13T05:11:00.958 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.958 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.959 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11906 2024-09-13T05:11:00.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.959 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:11:00.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:11:00.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481118+0000", 2024-09-13T05:11:00.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481122+0000", 2024-09-13T05:11:00.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2610000000000002e-06 2024-09-13T05:11:00.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481129+0000", 2024-09-13T05:11:00.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0079999999999996e-06 2024-09-13T05:11:00.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481135+0000", 2024-09-13T05:11:00.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0599999999999996e-06 2024-09-13T05:11:00.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510575+0000", 2024-09-13T05:11:00.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029440470999999999 2024-09-13T05:11:00.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510635+0000", 2024-09-13T05:11:00.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0177000000000003e-05 2024-09-13T05:11:00.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510694+0000", 2024-09-13T05:11:00.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8675999999999999e-05 2024-09-13T05:11:00.962 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.962 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.962 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.963 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11907 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 671744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.963 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:11:00.963 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.395966832999999, 2024-09-13T05:11:00.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029479490000000001, 2024-09-13T05:11:00.963 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.963 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.964 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.964 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11907 2024-09-13T05:11:00.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.964 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:11:00.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:11:00.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481140+0000", 2024-09-13T05:11:00.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997597 2024-09-13T05:11:00.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481383+0000", 2024-09-13T05:11:00.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024355399999999999 2024-09-13T05:11:00.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481390+0000", 2024-09-13T05:11:00.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3599999999999998e-06 2024-09-13T05:11:00.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481395+0000", 2024-09-13T05:11:00.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8940000000000001e-06 2024-09-13T05:11:00.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510722+0000", 2024-09-13T05:11:00.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029327143999999999 2024-09-13T05:11:00.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510802+0000", 2024-09-13T05:11:00.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9770000000000004e-05 2024-09-13T05:11:00.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510859+0000", 2024-09-13T05:11:00.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6957999999999999e-05 2024-09-13T05:11:00.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.967 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.968 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11908 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 680960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.968 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:11:00.968 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.39594692, 2024-09-13T05:11:00.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029617622, 2024-09-13T05:11:00.968 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.968 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.968 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11908 2024-09-13T05:11:00.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.968 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:11:00.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:11:00.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481399+0000", 2024-09-13T05:11:00.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481401+0000", 2024-09-13T05:11:00.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8729999999999999e-06 2024-09-13T05:11:00.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481413+0000", 2024-09-13T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1748e-05 2024-09-13T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481417+0000", 2024-09-13T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510908+0000", 2024-09-13T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029491129000000001 2024-09-13T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510955+0000", 2024-09-13T05:11:00.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7188000000000003e-05 2024-09-13T05:11:00.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511017+0000", 2024-09-13T05:11:00.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2288999999999999e-05 2024-09-13T05:11:00.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.972 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.973 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11909 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 690176~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:00.973 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:11:00.973 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.395926592999999, 2024-09-13T05:11:00.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029780699000000001, 2024-09-13T05:11:00.973 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:00.973 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:00.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:00.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:00.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:00.973 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11909 2024-09-13T05:11:00.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.973 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:00.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:00.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:11:00.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:00.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:11:00.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:00.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:00.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481419+0000", 2024-09-13T05:11:00.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:00.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:00.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481421+0000", 2024-09-13T05:11:00.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.035e-06 2024-09-13T05:11:00.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:00.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481427+0000", 2024-09-13T05:11:00.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2449999999999998e-06 2024-09-13T05:11:00.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481430+0000", 2024-09-13T05:11:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.366e-06 2024-09-13T05:11:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511064+0000", 2024-09-13T05:11:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029633711 2024-09-13T05:11:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511160+0000", 2024-09-13T05:11:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6399999999999999e-05 2024-09-13T05:11:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:00.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:00.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:00.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511201+0000", 2024-09-13T05:11:00.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0448000000000003e-05 2024-09-13T05:11:00.977 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.977 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.977 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.977 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:00.977 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:00.977 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:00.978 INFO:teuthology.orchestra.run.smithi120.stdout:2209 write 0xd79c2 thru 0xdfc4d (0x828c bytes) 2024-09-13T05:11:00.978 INFO:teuthology.orchestra.run.smithi120.stdout:2210 read 0xde68932 thru 0xde6c7f0 (0x3ebf bytes) 2024-09-13T05:11:00.979 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:11:00.980 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:00.980 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:00.980 INFO:teuthology.orchestra.run.smithi120.stdout:2213 punch from 0x6a26584 to 0x6a31991, (0xb40d bytes) 2024-09-13T05:11:00.980 INFO:teuthology.orchestra.run.smithi120.stdout:2214 read 0x2f34e4a thru 0x2f40e7e (0xc035 bytes) 2024-09-13T05:11:00.981 INFO:teuthology.orchestra.run.smithi120.stdout:2215 writesame 0x49c92c thru 0x4a3a52 data_size 0x1(0x7127 bytes) 2024-09-13T05:11:00.981 INFO:teuthology.orchestra.run.smithi120.stdout:2216 write 0x923ce3e thru 0x923ebdc (0x1d9f bytes) 2024-09-13T05:11:00.981 INFO:teuthology.orchestra.run.smithi120.stdout:2217 write 0xa8e325a thru 0xa8e6b80 (0x3927 bytes) 2024-09-13T05:11:00.981 INFO:teuthology.orchestra.run.smithi120.stdout:2218 trunc from 0xe507724 to 0x56ab8c7 2024-09-13T05:11:00.981 INFO:teuthology.orchestra.run.smithi120.stdout:2219 clone 20 order 24 su 131072 sc 9 2024-09-13T05:11:00.981 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:00.973+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:01.048 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.2 to 1 (10000) 2024-09-13T05:11:01.060 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-13T05:11:01.080 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:01.073+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:01.138 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:01.138 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:01.138 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:01.138 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:01.148 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:11:01.195 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:01.189+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:01.277 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #18, image image_client.0-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent19 2024-09-13T05:11:01.284 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:01.277+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:01.306 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:01.306 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:01.306 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:01.306 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:01.306 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:01.317 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:11:01.383 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:01.378+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:01.425 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:01.425 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:01.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:01.425 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:01.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.426 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26335 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1207296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:01.426 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:01.426 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.691330004000001, 2024-09-13T05:11:01.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055338125000000002, 2024-09-13T05:11:01.426 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.426 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.426 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.426 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.426 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.426 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26335 2024-09-13T05:11:01.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.426 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:01.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:01.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730550+0000", 2024-09-13T05:11:01.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998579 2024-09-13T05:11:01.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730705+0000", 2024-09-13T05:11:01.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015463400000000001 2024-09-13T05:11:01.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730713+0000", 2024-09-13T05:11:01.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1580000000000005e-06 2024-09-13T05:11:01.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730719+0000", 2024-09-13T05:11:01.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2740000000000004e-06 2024-09-13T05:11:01.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.785798+0000", 2024-09-13T05:11:01.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055079454 2024-09-13T05:11:01.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.785894+0000", 2024-09-13T05:11:01.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5896000000000005e-05 2024-09-13T05:11:01.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.786030+0000", 2024-09-13T05:11:01.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013586199999999999 2024-09-13T05:11:01.430 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.430 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.430 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.430 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26346 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1308672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:01.430 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:01.430 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.689188597000001, 2024-09-13T05:11:01.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055416737000000001, 2024-09-13T05:11:01.430 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.430 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.431 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.431 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.431 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.431 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26346 2024-09-13T05:11:01.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.431 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:01.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:01.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732833+0000", 2024-09-13T05:11:01.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:01.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732835+0000", 2024-09-13T05:11:01.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3719999999999999e-06 2024-09-13T05:11:01.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732839+0000", 2024-09-13T05:11:01.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1520000000000001e-06 2024-09-13T05:11:01.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732842+0000", 2024-09-13T05:11:01.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.061e-06 2024-09-13T05:11:01.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788126+0000", 2024-09-13T05:11:01.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055284489999999999 2024-09-13T05:11:01.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788183+0000", 2024-09-13T05:11:01.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7127999999999999e-05 2024-09-13T05:11:01.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788250+0000", 2024-09-13T05:11:01.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7001000000000004e-05 2024-09-13T05:11:01.434 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.434 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.434 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.435 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26348 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 800768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:01.435 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:01.435 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.688765773, 2024-09-13T05:11:01.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055321395000000002, 2024-09-13T05:11:01.435 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.435 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.435 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.435 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.435 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.435 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26348 2024-09-13T05:11:01.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.435 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:01.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:01.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733127+0000", 2024-09-13T05:11:01.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998703 2024-09-13T05:11:01.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733262+0000", 2024-09-13T05:11:01.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013484400000000001 2024-09-13T05:11:01.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733273+0000", 2024-09-13T05:11:01.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1824000000000001e-05 2024-09-13T05:11:01.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733281+0000", 2024-09-13T05:11:01.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9999999999999996e-06 2024-09-13T05:11:01.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788431+0000", 2024-09-13T05:11:01.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055149535 2024-09-13T05:11:01.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788490+0000", 2024-09-13T05:11:01.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9413999999999997e-05 2024-09-13T05:11:01.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788578+0000", 2024-09-13T05:11:01.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7418999999999998e-05 2024-09-13T05:11:01.439 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.439 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.439 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.440 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26368 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 985088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:01.440 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:11:01.440 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.684613576, 2024-09-13T05:11:01.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055320511000000003, 2024-09-13T05:11:01.440 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.440 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.440 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.440 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.440 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.440 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26368 2024-09-13T05:11:01.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.440 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:11:01.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:11:01.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737408+0000", 2024-09-13T05:11:01.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:01.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737412+0000", 2024-09-13T05:11:01.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6279999999999998e-06 2024-09-13T05:11:01.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737419+0000", 2024-09-13T05:11:01.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1770000000000001e-06 2024-09-13T05:11:01.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737425+0000", 2024-09-13T05:11:01.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6949999999999997e-06 2024-09-13T05:11:01.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792507+0000", 2024-09-13T05:11:01.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055082840000000001 2024-09-13T05:11:01.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792606+0000", 2024-09-13T05:11:01.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8697999999999996e-05 2024-09-13T05:11:01.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792729+0000", 2024-09-13T05:11:01.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012298499999999999 2024-09-13T05:11:01.444 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.444 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.444 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.444 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26417 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 903168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:01.444 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:01.444 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.680553316000001, 2024-09-13T05:11:01.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055375191999999997, 2024-09-13T05:11:01.444 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.444 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.445 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.445 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.445 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.445 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26417 2024-09-13T05:11:01.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.445 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:01.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:01.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741468+0000", 2024-09-13T05:11:01.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:01.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741472+0000", 2024-09-13T05:11:01.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4139999999999998e-06 2024-09-13T05:11:01.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741478+0000", 2024-09-13T05:11:01.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5230000000000001e-06 2024-09-13T05:11:01.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741483+0000", 2024-09-13T05:11:01.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8559999999999998e-06 2024-09-13T05:11:01.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796655+0000", 2024-09-13T05:11:01.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055172153000000002 2024-09-13T05:11:01.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796738+0000", 2024-09-13T05:11:01.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2912999999999997e-05 2024-09-13T05:11:01.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796844+0000", 2024-09-13T05:11:01.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105802 2024-09-13T05:11:01.448 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.449 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.449 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.449 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26419 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 912384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:01.449 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:01.449 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.680529450999998, 2024-09-13T05:11:01.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055570469999999997, 2024-09-13T05:11:01.449 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.449 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.449 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.449 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.449 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.450 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26419 2024-09-13T05:11:01.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.450 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:01.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:01.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741492+0000", 2024-09-13T05:11:01.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:01.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741495+0000", 2024-09-13T05:11:01.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6369999999999999e-06 2024-09-13T05:11:01.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741508+0000", 2024-09-13T05:11:01.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3319000000000001e-05 2024-09-13T05:11:01.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741527+0000", 2024-09-13T05:11:01.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8542e-05 2024-09-13T05:11:01.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796871+0000", 2024-09-13T05:11:01.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055344474999999997 2024-09-13T05:11:01.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796967+0000", 2024-09-13T05:11:01.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5963000000000003e-05 2024-09-13T05:11:01.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797063+0000", 2024-09-13T05:11:01.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5909999999999995e-05 2024-09-13T05:11:01.453 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.453 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.453 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.453 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26421 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 921600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:01.453 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:01.453 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.680486148, 2024-09-13T05:11:01.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055631152000000003, 2024-09-13T05:11:01.454 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.454 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.454 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.454 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.454 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.454 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26421 2024-09-13T05:11:01.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.454 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:01.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:01.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741535+0000", 2024-09-13T05:11:01.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:01.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741540+0000", 2024-09-13T05:11:01.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1690000000000002e-06 2024-09-13T05:11:01.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741547+0000", 2024-09-13T05:11:01.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3409999999999997e-06 2024-09-13T05:11:01.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741552+0000", 2024-09-13T05:11:01.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5639999999999996e-06 2024-09-13T05:11:01.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797079+0000", 2024-09-13T05:11:01.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055526038999999999 2024-09-13T05:11:01.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797121+0000", 2024-09-13T05:11:01.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2156000000000001e-05 2024-09-13T05:11:01.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797167+0000", 2024-09-13T05:11:01.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6445e-05 2024-09-13T05:11:01.458 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.458 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.458 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.458 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26423 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 930816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:01.458 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:01.458 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.680093155000002, 2024-09-13T05:11:01.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055364370000000003, 2024-09-13T05:11:01.458 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.458 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.458 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.458 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.459 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.459 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26423 2024-09-13T05:11:01.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.459 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:01.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:01.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741928+0000", 2024-09-13T05:11:01.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:01.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741933+0000", 2024-09-13T05:11:01.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9980000000000003e-06 2024-09-13T05:11:01.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741945+0000", 2024-09-13T05:11:01.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1761e-05 2024-09-13T05:11:01.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741958+0000", 2024-09-13T05:11:01.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2604e-05 2024-09-13T05:11:01.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797185+0000", 2024-09-13T05:11:01.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055227169 2024-09-13T05:11:01.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797226+0000", 2024-09-13T05:11:01.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1619000000000003e-05 2024-09-13T05:11:01.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797293+0000", 2024-09-13T05:11:01.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6952999999999994e-05 2024-09-13T05:11:01.462 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.462 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.462 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.462 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26424 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 940032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:01.462 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:01.463 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.680056218000001, 2024-09-13T05:11:01.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055448669999999999, 2024-09-13T05:11:01.463 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.463 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.463 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.463 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.463 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.463 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26424 2024-09-13T05:11:01.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.463 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:01.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:01.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741965+0000", 2024-09-13T05:11:01.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:01.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741969+0000", 2024-09-13T05:11:01.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3440000000000001e-06 2024-09-13T05:11:01.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741983+0000", 2024-09-13T05:11:01.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4600000000000001e-05 2024-09-13T05:11:01.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741989+0000", 2024-09-13T05:11:01.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5350000000000004e-06 2024-09-13T05:11:01.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797319+0000", 2024-09-13T05:11:01.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055330121000000003 2024-09-13T05:11:01.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797364+0000", 2024-09-13T05:11:01.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5670000000000002e-05 2024-09-13T05:11:01.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797415+0000", 2024-09-13T05:11:01.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0124000000000003e-05 2024-09-13T05:11:01.467 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.467 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.467 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.467 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26426 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 949248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:01.467 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:01.467 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.680029018999999, 2024-09-13T05:11:01.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055639981999999998, 2024-09-13T05:11:01.467 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.467 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.467 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.468 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.468 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.468 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26426 2024-09-13T05:11:01.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.468 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:01.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:01.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:01.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:01.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741995+0000", 2024-09-13T05:11:01.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.661e-06 2024-09-13T05:11:01.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742004+0000", 2024-09-13T05:11:01.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2009999999999999e-06 2024-09-13T05:11:01.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742008+0000", 2024-09-13T05:11:01.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7890000000000002e-06 2024-09-13T05:11:01.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797432+0000", 2024-09-13T05:11:01.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055423448 2024-09-13T05:11:01.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797516+0000", 2024-09-13T05:11:01.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4404e-05 2024-09-13T05:11:01.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797633+0000", 2024-09-13T05:11:01.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116898 2024-09-13T05:11:01.471 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.471 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.471 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.472 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26427 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 958464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:01.472 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:01.472 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.680008962999999, 2024-09-13T05:11:01.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055829295000000001, 2024-09-13T05:11:01.472 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.472 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.472 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.472 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.472 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.472 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26427 2024-09-13T05:11:01.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.472 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:01.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:01.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:01.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:01.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742015+0000", 2024-09-13T05:11:01.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.74e-06 2024-09-13T05:11:01.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742023+0000", 2024-09-13T05:11:01.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7039999999999994e-06 2024-09-13T05:11:01.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742028+0000", 2024-09-13T05:11:01.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7369999999999997e-06 2024-09-13T05:11:01.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797666+0000", 2024-09-13T05:11:01.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055637820999999997 2024-09-13T05:11:01.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797748+0000", 2024-09-13T05:11:01.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1787999999999997e-05 2024-09-13T05:11:01.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797842+0000", 2024-09-13T05:11:01.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4903999999999998e-05 2024-09-13T05:11:01.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.476 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.476 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26432 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 976896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:01.476 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:01.476 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.679215802000002, 2024-09-13T05:11:01.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055402077000000001, 2024-09-13T05:11:01.477 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.477 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.477 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26432 2024-09-13T05:11:01.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.477 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:01.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:01.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:01.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:01.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742808+0000", 2024-09-13T05:11:01.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3319999999999999e-06 2024-09-13T05:11:01.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742818+0000", 2024-09-13T05:11:01.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5380000000000008e-06 2024-09-13T05:11:01.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742821+0000", 2024-09-13T05:11:01.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2179999999999999e-06 2024-09-13T05:11:01.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798027+0000", 2024-09-13T05:11:01.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055206344999999997 2024-09-13T05:11:01.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798103+0000", 2024-09-13T05:11:01.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5786999999999998e-05 2024-09-13T05:11:01.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798208+0000", 2024-09-13T05:11:01.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010521700000000001 2024-09-13T05:11:01.480 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.480 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.480 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.481 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26434 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 986112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:01.481 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:01.481 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.679198578000001, 2024-09-13T05:11:01.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055610109999999997, 2024-09-13T05:11:01.481 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.481 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.481 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.481 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.481 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.481 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26434 2024-09-13T05:11:01.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.481 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:01.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:01.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742823+0000", 2024-09-13T05:11:01.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:01.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742825+0000", 2024-09-13T05:11:01.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6220000000000001e-06 2024-09-13T05:11:01.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742828+0000", 2024-09-13T05:11:01.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.926e-06 2024-09-13T05:11:01.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742831+0000", 2024-09-13T05:11:01.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-13T05:11:01.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798239+0000", 2024-09-13T05:11:01.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055408254999999997 2024-09-13T05:11:01.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798326+0000", 2024-09-13T05:11:01.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7168000000000003e-05 2024-09-13T05:11:01.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798434+0000", 2024-09-13T05:11:01.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010767100000000001 2024-09-13T05:11:01.485 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.485 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.485 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.485 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26442 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1032192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:01.485 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:01.485 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.677929238000001, 2024-09-13T05:11:01.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055422776, 2024-09-13T05:11:01.485 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.486 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.486 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.486 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.486 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.486 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26442 2024-09-13T05:11:01.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.486 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:01.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:01.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744061+0000", 2024-09-13T05:11:01.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999685 2024-09-13T05:11:01.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744096+0000", 2024-09-13T05:11:01.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4771999999999998e-05 2024-09-13T05:11:01.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744147+0000", 2024-09-13T05:11:01.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0696999999999999e-05 2024-09-13T05:11:01.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744154+0000", 2024-09-13T05:11:01.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8510000000000001e-06 2024-09-13T05:11:01.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799324+0000", 2024-09-13T05:11:01.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055170074999999999 2024-09-13T05:11:01.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799415+0000", 2024-09-13T05:11:01.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1197000000000001e-05 2024-09-13T05:11:01.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799516+0000", 2024-09-13T05:11:01.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100666 2024-09-13T05:11:01.489 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.489 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.489 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.490 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26443 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1041408~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:01.490 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:01.490 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.677648667, 2024-09-13T05:11:01.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055344195999999998, 2024-09-13T05:11:01.490 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.490 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.490 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26443 2024-09-13T05:11:01.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.490 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:01.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:01.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744159+0000", 2024-09-13T05:11:01.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997849 2024-09-13T05:11:01.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744379+0000", 2024-09-13T05:11:01.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022024800000000001 2024-09-13T05:11:01.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744390+0000", 2024-09-13T05:11:01.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1105e-05 2024-09-13T05:11:01.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744397+0000", 2024-09-13T05:11:01.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2740000000000002e-06 2024-09-13T05:11:01.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799543+0000", 2024-09-13T05:11:01.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055145441000000003 2024-09-13T05:11:01.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799619+0000", 2024-09-13T05:11:01.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6660000000000001e-05 2024-09-13T05:11:01.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799718+0000", 2024-09-13T05:11:01.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8331000000000004e-05 2024-09-13T05:11:01.494 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.494 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.494 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.495 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26547 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1318912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:01.495 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:01.495 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.677462348999999, 2024-09-13T05:11:01.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055355834, 2024-09-13T05:11:01.495 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.495 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.495 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.495 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.495 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.495 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26547 2024-09-13T05:11:01.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.495 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:01.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:01.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744404+0000", 2024-09-13T05:11:01.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998441 2024-09-13T05:11:01.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744564+0000", 2024-09-13T05:11:01.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016022200000000001 2024-09-13T05:11:01.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744579+0000", 2024-09-13T05:11:01.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5036e-05 2024-09-13T05:11:01.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744585+0000", 2024-09-13T05:11:01.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7880000000000003e-06 2024-09-13T05:11:01.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799747+0000", 2024-09-13T05:11:01.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055161804000000002 2024-09-13T05:11:01.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799823+0000", 2024-09-13T05:11:01.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5956000000000003e-05 2024-09-13T05:11:01.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799916+0000", 2024-09-13T05:11:01.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2733999999999997e-05 2024-09-13T05:11:01.499 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.499 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.499 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.499 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26550 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1328128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:01.500 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:11:01.500 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.67720619, 2024-09-13T05:11:01.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055315941, 2024-09-13T05:11:01.500 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.500 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.500 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.500 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.500 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.501 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26550 2024-09-13T05:11:01.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.501 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:11:01.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:11:01.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744591+0000", 2024-09-13T05:11:01.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997745 2024-09-13T05:11:01.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744821+0000", 2024-09-13T05:11:01.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023031899999999999 2024-09-13T05:11:01.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744833+0000", 2024-09-13T05:11:01.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1919000000000001e-05 2024-09-13T05:11:01.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744837+0000", 2024-09-13T05:11:01.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4989999999999996e-06 2024-09-13T05:11:01.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799947+0000", 2024-09-13T05:11:01.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055110120999999998 2024-09-13T05:11:01.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800030+0000", 2024-09-13T05:11:01.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2905999999999995e-05 2024-09-13T05:11:01.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800132+0000", 2024-09-13T05:11:01.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101529 2024-09-13T05:11:01.504 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.504 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.504 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.504 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26558 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1364992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:01.504 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:01.504 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.676471183, 2024-09-13T05:11:01.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055422765999999998, 2024-09-13T05:11:01.505 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.505 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.505 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.505 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.505 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.505 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26558 2024-09-13T05:11:01.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.505 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:01.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:01.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745550+0000", 2024-09-13T05:11:01.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:01.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745553+0000", 2024-09-13T05:11:01.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7690000000000001e-06 2024-09-13T05:11:01.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745559+0000", 2024-09-13T05:11:01.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3149999999999997e-06 2024-09-13T05:11:01.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745564+0000", 2024-09-13T05:11:01.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6670000000000004e-06 2024-09-13T05:11:01.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800791+0000", 2024-09-13T05:11:01.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055226711999999997 2024-09-13T05:11:01.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800865+0000", 2024-09-13T05:11:01.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4344000000000005e-05 2024-09-13T05:11:01.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800974+0000", 2024-09-13T05:11:01.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108606 2024-09-13T05:11:01.509 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.509 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.509 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.509 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26561 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1374208~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:01.509 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:01.509 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.67645413, 2024-09-13T05:11:01.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055549315000000002, 2024-09-13T05:11:01.509 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.509 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.509 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.510 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.510 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.510 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26561 2024-09-13T05:11:01.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.510 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:01.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:01.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:01.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:01.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745570+0000", 2024-09-13T05:11:01.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4719999999999998e-06 2024-09-13T05:11:01.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745575+0000", 2024-09-13T05:11:01.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1900000000000003e-06 2024-09-13T05:11:01.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745579+0000", 2024-09-13T05:11:01.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3250000000000001e-06 2024-09-13T05:11:01.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801000+0000", 2024-09-13T05:11:01.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055420432999999998 2024-09-13T05:11:01.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801061+0000", 2024-09-13T05:11:01.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1427000000000007e-05 2024-09-13T05:11:01.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801117+0000", 2024-09-13T05:11:01.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5933000000000001e-05 2024-09-13T05:11:01.513 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.513 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.513 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.513 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26582 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1447936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:01.513 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:01.514 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.67503649, 2024-09-13T05:11:01.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055394301, 2024-09-13T05:11:01.514 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.514 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.514 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26582 2024-09-13T05:11:01.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.514 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:01.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:01.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746985+0000", 2024-09-13T05:11:01.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:01.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746988+0000", 2024-09-13T05:11:01.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6479999999999999e-06 2024-09-13T05:11:01.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.747000+0000", 2024-09-13T05:11:01.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2009e-05 2024-09-13T05:11:01.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.747005+0000", 2024-09-13T05:11:01.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0039999999999999e-06 2024-09-13T05:11:01.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802232+0000", 2024-09-13T05:11:01.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055227762999999999 2024-09-13T05:11:01.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802320+0000", 2024-09-13T05:11:01.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7576000000000003e-05 2024-09-13T05:11:01.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802380+0000", 2024-09-13T05:11:01.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9888e-05 2024-09-13T05:11:01.518 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.518 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.518 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.518 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.518 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.518 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:01.519 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:11:01.520 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:01.513+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:01.620 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:01.613+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:01.633 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:01.633 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:01.644 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:11:01.721 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:01.718+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:01.725 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:11:01.745 INFO:teuthology.orchestra.run.smithi120.stdout:2220 write 0xbc09918 thru 0xbc0d3b9 (0x3aa2 bytes) 2024-09-13T05:11:01.751 INFO:teuthology.orchestra.run.smithi120.stdout:2222 punch from 0x4719ce to 0x480423, (0xea55 bytes) 2024-09-13T05:11:01.752 INFO:teuthology.orchestra.run.smithi120.stdout:2223 trunc from 0xbc0d3ba to 0xc36434b 2024-09-13T05:11:01.763 INFO:teuthology.orchestra.run.smithi120.stdout:2224 write 0xa0930a2 thru 0xa0991a3 (0x6102 bytes) 2024-09-13T05:11:01.770 INFO:teuthology.orchestra.run.smithi120.stdout:2225 punch from 0xb41e96f to 0xb42114b, (0x27dc bytes) 2024-09-13T05:11:01.770 INFO:teuthology.orchestra.run.smithi120.stdout:2226 read 0x5b2ac2a thru 0x5b3a3eb (0xf7c2 bytes) 2024-09-13T05:11:01.770 INFO:teuthology.orchestra.run.smithi120.stdout:2228 write 0x3188856 thru 0x318c0bb (0x3866 bytes) 2024-09-13T05:11:01.786 INFO:teuthology.orchestra.run.smithi120.stdout:2232 write 0xac75cc3 thru 0xac79225 (0x3563 bytes) 2024-09-13T05:11:01.791 INFO:teuthology.orchestra.run.smithi120.stdout:2233 punch from 0x46df46a to 0x46e8365, (0x8efb bytes) 2024-09-13T05:11:01.802 INFO:teuthology.orchestra.run.smithi120.stdout:2234 writesame 0xd3dbafe thru 0xd3e411d data_size 0x1d(0x8620 bytes) 2024-09-13T05:11:01.805 INFO:teuthology.orchestra.run.smithi120.stdout:2235 punch from 0xbae7ca2 to 0xbaebd6d, (0x40cb bytes) 2024-09-13T05:11:01.805 INFO:teuthology.orchestra.run.smithi120.stdout:2237 read 0x3c20509 thru 0x3c3006f (0xfb67 bytes) 2024-09-13T05:11:01.806 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:01.806 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:01.806 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:01.806 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:01.806 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:01.807 INFO:teuthology.orchestra.run.smithi120.stdout:2238 write 0xc8d668a thru 0xc8d9fd5 (0x394c bytes) 2024-09-13T05:11:01.817 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:11:01.822 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:01.818+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:01.830 INFO:teuthology.orchestra.run.smithi120.stdout:2240 trunc from 0xd3e411e to 0x5b5088d 2024-09-13T05:11:01.886 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:11:01.890 INFO:teuthology.orchestra.run.smithi120.stdout:2241 punch from 0x1919090 to 0x19239bf, (0xa92f bytes) 2024-09-13T05:11:01.890 INFO:teuthology.orchestra.run.smithi120.stdout:2242 read 0x1e50454 thru 0x1e5e829 (0xe3d6 bytes) 2024-09-13T05:11:01.892 INFO:teuthology.orchestra.run.smithi120.stdout:2244 trunc from 0x5b5088d to 0x6dcec86 2024-09-13T05:11:01.901 INFO:teuthology.orchestra.run.smithi120.stdout:2246 write 0x61ff38b thru 0x6204a55 (0x56cb bytes) 2024-09-13T05:11:01.905 INFO:teuthology.orchestra.run.smithi120.stdout:2247 read 0xe24649 thru 0xe28a6e (0x4426 bytes) 2024-09-13T05:11:01.905 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:11:01.905 INFO:teuthology.orchestra.run.smithi120.stdout:2248 write 0x1537b6c thru 0x15470fa (0xf58f bytes) 2024-09-13T05:11:01.908 INFO:teuthology.orchestra.run.smithi120.stdout:2250 read 0x1624822 thru 0x162dbbd (0x939c bytes) 2024-09-13T05:11:01.909 INFO:teuthology.orchestra.run.smithi120.stdout:2251 read 0x3b3d485 thru 0x3b417fa (0x4376 bytes) 2024-09-13T05:11:01.910 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:01.910 INFO:teuthology.orchestra.run.smithi120.stdout:2254 read 0x5860a9c thru 0x586830e (0x7873 bytes) 2024-09-13T05:11:01.911 INFO:teuthology.orchestra.run.smithi120.stdout:2255 punch from 0x156a07c to 0x156f746, (0x56ca bytes) 2024-09-13T05:11:01.911 INFO:teuthology.orchestra.run.smithi120.stdout:2256 writesame 0x6cde097 thru 0x6ce18f0 data_size 0x1(0x385a bytes) 2024-09-13T05:11:01.922 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:11:01.922 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:01.923 INFO:teuthology.orchestra.run.smithi120.stdout:2260 writesame 0x69a2710 thru 0x69a55c3 data_size 0x3d(0x2eb4 bytes) 2024-09-13T05:11:01.923 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:01.917+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:01.925 INFO:teuthology.orchestra.run.smithi120.stdout:2262 read 0x347cfa3 thru 0x348a8d9 (0xd937 bytes) 2024-09-13T05:11:01.926 INFO:teuthology.orchestra.run.smithi120.stdout:2263 write 0x58d3c77 thru 0x58d71f7 (0x3581 bytes) 2024-09-13T05:11:01.929 INFO:teuthology.orchestra.run.smithi120.stdout:2264 read 0x208a647 thru 0x2096565 (0xbf1f bytes) 2024-09-13T05:11:01.929 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:01.930 INFO:teuthology.orchestra.run.smithi120.stdout:2268 write 0x1f607eb thru 0x1f639f8 (0x320e bytes) 2024-09-13T05:11:01.935 INFO:teuthology.orchestra.run.smithi120.stdout:2269 trunc from 0x6dcec86 to 0x5669bcb 2024-09-13T05:11:01.938 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:01.938 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:01.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:01.938 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:01.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.938 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2037 3.8 3:1349be29:::rbd_data.112d872fd67a.000000000000003b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:11:01.939 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.108522+0000", 2024-09-13T05:11:01.939 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.826609343000001, 2024-09-13T05:11:01.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016880821000000001, 2024-09-13T05:11:01.939 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.939 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:01.939 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.939 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.939 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.939 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2037 2024-09-13T05:11:01.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.939 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108522+0000", 2024-09-13T05:11:01.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108522+0000", 2024-09-13T05:11:01.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108521+0000", 2024-09-13T05:11:01.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:01.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108527+0000", 2024-09-13T05:11:01.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0460000000000002e-06 2024-09-13T05:11:01.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108538+0000", 2024-09-13T05:11:01.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0891e-05 2024-09-13T05:11:01.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108548+0000", 2024-09-13T05:11:01.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9159999999999996e-06 2024-09-13T05:11:01.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108595+0000", 2024-09-13T05:11:01.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7107000000000001e-05 2024-09-13T05:11:01.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108692+0000", 2024-09-13T05:11:01.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6824999999999995e-05 2024-09-13T05:11:01.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:11:01.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.111425+0000", 2024-09-13T05:11:01.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027337110000000002 2024-09-13T05:11:01.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:01.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125249+0000", 2024-09-13T05:11:01.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013823521 2024-09-13T05:11:01.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:01.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125265+0000", 2024-09-13T05:11:01.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6257e-05 2024-09-13T05:11:01.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:01.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125347+0000", 2024-09-13T05:11:01.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1321000000000003e-05 2024-09-13T05:11:01.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125403+0000", 2024-09-13T05:11:01.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6362e-05 2024-09-13T05:11:01.944 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.945 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.945 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.945 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2947 3.b 3:d32df763:::rbd_data.112d872fd67a.000000000000006b:head [stat,delete] snapc 7=[7] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:11:01.945 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.921206+0000", 2024-09-13T05:11:01.945 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.013925129, 2024-09-13T05:11:01.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095406580000000005, 2024-09-13T05:11:01.945 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.945 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.945 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.945 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.945 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.945 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2947 2024-09-13T05:11:01.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.946 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921206+0000", 2024-09-13T05:11:01.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921206+0000", 2024-09-13T05:11:01.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921205+0000", 2024-09-13T05:11:01.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:01.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921212+0000", 2024-09-13T05:11:01.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3300000000000001e-06 2024-09-13T05:11:01.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921232+0000", 2024-09-13T05:11:01.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9601000000000001e-05 2024-09-13T05:11:01.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921241+0000", 2024-09-13T05:11:01.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3230000000000004e-06 2024-09-13T05:11:01.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921297+0000", 2024-09-13T05:11:01.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5849e-05 2024-09-13T05:11:01.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.921456+0000", 2024-09-13T05:11:01.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015864899999999999 2024-09-13T05:11:01.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.930747+0000", 2024-09-13T05:11:01.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092911450000000007 2024-09-13T05:11:01.949 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.949 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.949 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.949 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:4911 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2801664~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:11:01.949 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.800434+0000", 2024-09-13T05:11:01.949 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.134697420999998, 2024-09-13T05:11:01.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096311120000000007, 2024-09-13T05:11:01.949 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.949 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.950 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 4911 2024-09-13T05:11:01.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.950 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800434+0000", 2024-09-13T05:11:01.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800434+0000", 2024-09-13T05:11:01.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800433+0000", 2024-09-13T05:11:01.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:01.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800441+0000", 2024-09-13T05:11:01.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4699999999999996e-06 2024-09-13T05:11:01.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800450+0000", 2024-09-13T05:11:01.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6030000000000005e-06 2024-09-13T05:11:01.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.800455+0000", 2024-09-13T05:11:01.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6019999999999999e-06 2024-09-13T05:11:01.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802738+0000", 2024-09-13T05:11:01.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022825089999999998 2024-09-13T05:11:01.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802849+0000", 2024-09-13T05:11:01.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110849 2024-09-13T05:11:01.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.810065+0000", 2024-09-13T05:11:01.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072166419999999997 2024-09-13T05:11:01.956 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.956 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.956 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.956 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5030 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 1523712~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:11:01.956 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.801994+0000", 2024-09-13T05:11:01.956 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.133137728999998, 2024-09-13T05:11:01.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094030090000000004, 2024-09-13T05:11:01.956 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.957 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.957 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5030 2024-09-13T05:11:01.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.957 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801994+0000", 2024-09-13T05:11:01.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801994+0000", 2024-09-13T05:11:01.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801993+0000", 2024-09-13T05:11:01.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:01.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.801997+0000", 2024-09-13T05:11:01.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2650000000000001e-06 2024-09-13T05:11:01.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802002+0000", 2024-09-13T05:11:01.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7389999999999996e-06 2024-09-13T05:11:01.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802007+0000", 2024-09-13T05:11:01.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5419999999999999e-06 2024-09-13T05:11:01.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811276+0000", 2024-09-13T05:11:01.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092691330000000006 2024-09-13T05:11:01.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811341+0000", 2024-09-13T05:11:01.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5028000000000001e-05 2024-09-13T05:11:01.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811397+0000", 2024-09-13T05:11:01.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5699000000000003e-05 2024-09-13T05:11:01.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.960 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.961 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5033 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2113536~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:11:01.961 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802011+0000", 2024-09-13T05:11:01.961 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.133120380999998, 2024-09-13T05:11:01.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095360380000000002, 2024-09-13T05:11:01.961 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.961 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.961 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5033 2024-09-13T05:11:01.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.961 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802011+0000", 2024-09-13T05:11:01.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802011+0000", 2024-09-13T05:11:01.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802011+0000", 2024-09-13T05:11:01.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:01.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802013+0000", 2024-09-13T05:11:01.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.131e-06 2024-09-13T05:11:01.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802019+0000", 2024-09-13T05:11:01.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8799999999999996e-06 2024-09-13T05:11:01.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802023+0000", 2024-09-13T05:11:01.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6829999999999999e-06 2024-09-13T05:11:01.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811423+0000", 2024-09-13T05:11:01.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093992139999999995 2024-09-13T05:11:01.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811475+0000", 2024-09-13T05:11:01.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2000999999999999e-05 2024-09-13T05:11:01.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811547+0000", 2024-09-13T05:11:01.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2465000000000005e-05 2024-09-13T05:11:01.965 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.965 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.965 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.965 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5036 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2703360~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:11:01.965 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802028+0000", 2024-09-13T05:11:01.965 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.133103927999997, 2024-09-13T05:11:01.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096685629999999998, 2024-09-13T05:11:01.965 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.965 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.966 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5036 2024-09-13T05:11:01.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.966 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802028+0000", 2024-09-13T05:11:01.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802028+0000", 2024-09-13T05:11:01.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802027+0000", 2024-09-13T05:11:01.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:01.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802030+0000", 2024-09-13T05:11:01.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3329999999999999e-06 2024-09-13T05:11:01.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802036+0000", 2024-09-13T05:11:01.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5610000000000004e-06 2024-09-13T05:11:01.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802041+0000", 2024-09-13T05:11:01.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9309999999999999e-06 2024-09-13T05:11:01.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811568+0000", 2024-09-13T05:11:01.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095272369999999992 2024-09-13T05:11:01.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811624+0000", 2024-09-13T05:11:01.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5673e-05 2024-09-13T05:11:01.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811696+0000", 2024-09-13T05:11:01.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2187999999999994e-05 2024-09-13T05:11:01.969 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.969 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.969 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.970 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5041 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2310144~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:11:01.970 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802046+0000", 2024-09-13T05:11:01.970 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.133085795, 2024-09-13T05:11:01.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097718389999999992, 2024-09-13T05:11:01.970 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.970 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.970 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.970 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.970 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.970 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5041 2024-09-13T05:11:01.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.970 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802046+0000", 2024-09-13T05:11:01.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802046+0000", 2024-09-13T05:11:01.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802045+0000", 2024-09-13T05:11:01.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:01.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802047+0000", 2024-09-13T05:11:01.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1799999999999999e-06 2024-09-13T05:11:01.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802053+0000", 2024-09-13T05:11:01.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.507e-06 2024-09-13T05:11:01.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802057+0000", 2024-09-13T05:11:01.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3590000000000001e-06 2024-09-13T05:11:01.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811713+0000", 2024-09-13T05:11:01.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096553400000000001 2024-09-13T05:11:01.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811763+0000", 2024-09-13T05:11:01.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0050999999999999e-05 2024-09-13T05:11:01.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811818+0000", 2024-09-13T05:11:01.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4777000000000001e-05 2024-09-13T05:11:01.974 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.974 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.974 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.974 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5044 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2899968~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:11:01.974 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802062+0000", 2024-09-13T05:11:01.974 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.133069810999999, 2024-09-13T05:11:01.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0099015260000000008, 2024-09-13T05:11:01.974 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.974 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.975 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5044 2024-09-13T05:11:01.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.975 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802062+0000", 2024-09-13T05:11:01.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802062+0000", 2024-09-13T05:11:01.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802061+0000", 2024-09-13T05:11:01.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:01.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802064+0000", 2024-09-13T05:11:01.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0740000000000001e-06 2024-09-13T05:11:01.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802070+0000", 2024-09-13T05:11:01.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8560000000000003e-06 2024-09-13T05:11:01.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802075+0000", 2024-09-13T05:11:01.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6360000000000002e-06 2024-09-13T05:11:01.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811834+0000", 2024-09-13T05:11:01.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097588710000000006 2024-09-13T05:11:01.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811878+0000", 2024-09-13T05:11:01.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3937999999999998e-05 2024-09-13T05:11:01.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811963+0000", 2024-09-13T05:11:01.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5505000000000002e-05 2024-09-13T05:11:01.978 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.978 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.978 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.978 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5049 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 2506752~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:11:01.978 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802080+0000", 2024-09-13T05:11:01.978 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.133051926999997, 2024-09-13T05:11:01.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010051279, 2024-09-13T05:11:01.979 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.979 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.979 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5049 2024-09-13T05:11:01.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.979 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802080+0000", 2024-09-13T05:11:01.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802080+0000", 2024-09-13T05:11:01.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802079+0000", 2024-09-13T05:11:01.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:01.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802081+0000", 2024-09-13T05:11:01.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2740000000000002e-06 2024-09-13T05:11:01.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802088+0000", 2024-09-13T05:11:01.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.567e-06 2024-09-13T05:11:01.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802093+0000", 2024-09-13T05:11:01.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8609999999999997e-06 2024-09-13T05:11:01.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.811989+0000", 2024-09-13T05:11:01.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0098961840000000006 2024-09-13T05:11:01.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812069+0000", 2024-09-13T05:11:01.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9534000000000001e-05 2024-09-13T05:11:01.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812131+0000", 2024-09-13T05:11:01.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2206999999999996e-05 2024-09-13T05:11:01.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.983 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.983 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.983 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:5052 3.7 3:e07c7f83:::rbd_data.112d318cd671.0000000000000003:6 [read 3096576~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e31)", 2024-09-13T05:11:01.983 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:21.802097+0000", 2024-09-13T05:11:01.983 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.133034696999999, 2024-09-13T05:11:01.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010227615000000001, 2024-09-13T05:11:01.983 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.983 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:01.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.984 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5052 2024-09-13T05:11:01.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.984 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802097+0000", 2024-09-13T05:11:01.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802097+0000", 2024-09-13T05:11:01.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802096+0000", 2024-09-13T05:11:01.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:01.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802099+0000", 2024-09-13T05:11:01.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3539999999999998e-06 2024-09-13T05:11:01.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802105+0000", 2024-09-13T05:11:01.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8440000000000003e-06 2024-09-13T05:11:01.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.802109+0000", 2024-09-13T05:11:01.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6800000000000001e-06 2024-09-13T05:11:01.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812155+0000", 2024-09-13T05:11:01.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010045691000000001 2024-09-13T05:11:01.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812238+0000", 2024-09-13T05:11:01.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2855000000000005e-05 2024-09-13T05:11:01.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:21.812324+0000", 2024-09-13T05:11:01.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6621999999999998e-05 2024-09-13T05:11:01.987 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.987 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.987 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.987 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:7377 3.1e 3:7d4eb93d:::rbd_header.112d1304fe95:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-13T05:11:01.987 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:24.742504+0000", 2024-09-13T05:11:01.987 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 37.192627573999999, 2024-09-13T05:11:01.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01013406, 2024-09-13T05:11:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7377 2024-09-13T05:11:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742504+0000", 2024-09-13T05:11:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742504+0000", 2024-09-13T05:11:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742500+0000", 2024-09-13T05:11:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999962 2024-09-13T05:11:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742522+0000", 2024-09-13T05:11:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2310000000000002e-05 2024-09-13T05:11:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742572+0000", 2024-09-13T05:11:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9872e-05 2024-09-13T05:11:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742597+0000", 2024-09-13T05:11:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4363e-05 2024-09-13T05:11:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742678+0000", 2024-09-13T05:11:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1370000000000002e-05 2024-09-13T05:11:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-13T05:11:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.742686+0000", 2024-09-13T05:11:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5259999999999993e-06 2024-09-13T05:11:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.749024+0000", 2024-09-13T05:11:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006337372 2024-09-13T05:11:01.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.749278+0000", 2024-09-13T05:11:01.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025436399999999998 2024-09-13T05:11:01.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:11:01.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.750557+0000", 2024-09-13T05:11:01.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012787129999999999 2024-09-13T05:11:01.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:01.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.751774+0000", 2024-09-13T05:11:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001217054 2024-09-13T05:11:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.752530+0000", 2024-09-13T05:11:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075635999999999998 2024-09-13T05:11:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.752592+0000", 2024-09-13T05:11:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1486000000000001e-05 2024-09-13T05:11:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:24.752638+0000", 2024-09-13T05:11:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6140000000000002e-05 2024-09-13T05:11:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:7961 3.18 3:184d9aea:::rbd_data.112db57f3a18.000000000000002b:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-13T05:11:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:11:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.858126355000003, 2024-09-13T05:11:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.040271084999999998, 2024-09-13T05:11:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:01.994 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:01.995 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:01.995 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:01.995 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:01.995 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7961 2024-09-13T05:11:01.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.995 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:01.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:01.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:11:01.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:11:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077003+0000", 2024-09-13T05:11:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077013+0000", 2024-09-13T05:11:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6870000000000006e-06 2024-09-13T05:11:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077029+0000", 2024-09-13T05:11:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6314e-05 2024-09-13T05:11:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077038+0000", 2024-09-13T05:11:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5019999999999992e-06 2024-09-13T05:11:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:01.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077099+0000", 2024-09-13T05:11:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1444000000000003e-05 2024-09-13T05:11:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077234+0000", 2024-09-13T05:11:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013461300000000001 2024-09-13T05:11:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-13T05:11:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.085202+0000", 2024-09-13T05:11:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079680140000000007 2024-09-13T05:11:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116860+0000", 2024-09-13T05:11:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.031658190000000003 2024-09-13T05:11:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116995+0000", 2024-09-13T05:11:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000135601 2024-09-13T05:11:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117152+0000", 2024-09-13T05:11:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015681700000000001 2024-09-13T05:11:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:01.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:02.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117276+0000", 2024-09-13T05:11:02.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012392699999999999 2024-09-13T05:11:02.000 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:02.000 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:02.000 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:02.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.000 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4397.0:7961 3.18 e35/22 ondisk, result = 0)", 2024-09-13T05:11:02.000 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.104860+0000", 2024-09-13T05:11:02.000 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.830271336999999, 2024-09-13T05:11:02.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012435735999999999, 2024-09-13T05:11:02.000 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:02.000 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:02.001 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:02.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:02.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104860+0000", 2024-09-13T05:11:02.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:02.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:02.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104860+0000", 2024-09-13T05:11:02.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:02.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104859+0000", 2024-09-13T05:11:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104866+0000", 2024-09-13T05:11:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0840000000000003e-06 2024-09-13T05:11:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104882+0000", 2024-09-13T05:11:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5705e-05 2024-09-13T05:11:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.104890+0000", 2024-09-13T05:11:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5110000000000003e-06 2024-09-13T05:11:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116937+0000", 2024-09-13T05:11:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012046563999999999 2024-09-13T05:11:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116975+0000", 2024-09-13T05:11:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8243e-05 2024-09-13T05:11:02.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117296+0000", 2024-09-13T05:11:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032082299999999997 2024-09-13T05:11:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:8105 3.b 3:d2ae8f7b:::rbd_data.112db57f3a18.0000000000000028:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-13T05:11:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:11:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.623030548999999, 2024-09-13T05:11:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.040653913, 2024-09-13T05:11:02.004 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 8105 2024-09-13T05:11:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:11:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:11:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312099+0000", 2024-09-13T05:11:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312109+0000", 2024-09-13T05:11:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0244999999999999e-05 2024-09-13T05:11:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312129+0000", 2024-09-13T05:11:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9751000000000001e-05 2024-09-13T05:11:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312141+0000", 2024-09-13T05:11:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2201999999999999e-05 2024-09-13T05:11:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312230+0000", 2024-09-13T05:11:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9092999999999996e-05 2024-09-13T05:11:02.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312433+0000", 2024-09-13T05:11:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020240500000000001 2024-09-13T05:11:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-13T05:11:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.320357+0000", 2024-09-13T05:11:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079242630000000008 2024-09-13T05:11:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:02.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352488+0000", 2024-09-13T05:11:02.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032131588000000003 2024-09-13T05:11:02.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:02.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352533+0000", 2024-09-13T05:11:02.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4601999999999997e-05 2024-09-13T05:11:02.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:02.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352636+0000", 2024-09-13T05:11:02.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103041 2024-09-13T05:11:02.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352755+0000", 2024-09-13T05:11:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118814 2024-09-13T05:11:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4397.0:8105 3.b e35/22 ondisk, result = 0)", 2024-09-13T05:11:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.342777+0000", 2024-09-13T05:11:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.592354340999997, 2024-09-13T05:11:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097182480000000005, 2024-09-13T05:11:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:02.010 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342777+0000", 2024-09-13T05:11:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342777+0000", 2024-09-13T05:11:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:02.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342776+0000", 2024-09-13T05:11:02.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:02.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:02.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342786+0000", 2024-09-13T05:11:02.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0298e-05 2024-09-13T05:11:02.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:02.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342809+0000", 2024-09-13T05:11:02.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3346999999999999e-05 2024-09-13T05:11:02.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.342822+0000", 2024-09-13T05:11:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2717e-05 2024-09-13T05:11:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352456+0000", 2024-09-13T05:11:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096335659999999997 2024-09-13T05:11:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352474+0000", 2024-09-13T05:11:02.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8776000000000001e-05 2024-09-13T05:11:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352495+0000", 2024-09-13T05:11:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.107e-05 2024-09-13T05:11:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:39305 3.1e 3:79249bf8:::rbd_data.112dcff96bbd.0000000000000003:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-13T05:11:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:41.473278+0000", 2024-09-13T05:11:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.461853952999999, 2024-09-13T05:11:02.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027037510000000001, 2024-09-13T05:11:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 39305 2024-09-13T05:11:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473278+0000", 2024-09-13T05:11:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473278+0000", 2024-09-13T05:11:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473276+0000", 2024-09-13T05:11:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473285+0000", 2024-09-13T05:11:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0129999999999999e-06 2024-09-13T05:11:02.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473304+0000", 2024-09-13T05:11:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8723e-05 2024-09-13T05:11:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473313+0000", 2024-09-13T05:11:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1419999999999999e-06 2024-09-13T05:11:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:02.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473390+0000", 2024-09-13T05:11:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7001000000000004e-05 2024-09-13T05:11:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473496+0000", 2024-09-13T05:11:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010577399999999999 2024-09-13T05:11:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:11:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.478499+0000", 2024-09-13T05:11:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050029260000000004 2024-09-13T05:11:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500153+0000", 2024-09-13T05:11:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021654421 2024-09-13T05:11:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500216+0000", 2024-09-13T05:11:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3233999999999998e-05 2024-09-13T05:11:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500273+0000", 2024-09-13T05:11:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6484000000000003e-05 2024-09-13T05:11:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500315+0000", 2024-09-13T05:11:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2342000000000002e-05 2024-09-13T05:11:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:40934 3.1 3:86cdeb48:::rbd_data.112d4ab2162d.0000000000000103:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-13T05:11:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:46.247357+0000", 2024-09-13T05:11:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.687774715, 2024-09-13T05:11:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028923379999999999, 2024-09-13T05:11:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 40934 2024-09-13T05:11:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247357+0000", 2024-09-13T05:11:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247357+0000", 2024-09-13T05:11:02.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247354+0000", 2024-09-13T05:11:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:11:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247371+0000", 2024-09-13T05:11:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6697e-05 2024-09-13T05:11:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:02.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247403+0000", 2024-09-13T05:11:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1649000000000001e-05 2024-09-13T05:11:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247417+0000", 2024-09-13T05:11:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.395e-05 2024-09-13T05:11:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247498+0000", 2024-09-13T05:11:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1011000000000001e-05 2024-09-13T05:11:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247757+0000", 2024-09-13T05:11:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000258872 2024-09-13T05:11:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:11:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.254874+0000", 2024-09-13T05:11:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071176449999999997 2024-09-13T05:11:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.275876+0000", 2024-09-13T05:11:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021001770999999999 2024-09-13T05:11:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.275989+0000", 2024-09-13T05:11:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011301199999999999 2024-09-13T05:11:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.276156+0000", 2024-09-13T05:11:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000167453 2024-09-13T05:11:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.276280+0000", 2024-09-13T05:11:02.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012369400000000001 2024-09-13T05:11:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:45910 3.a 3:56753852:::rbd_header.112d678e2955:head [call,call rbd.parent_overlap_get in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e58)", 2024-09-13T05:11:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:50.370028+0000", 2024-09-13T05:11:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.565103967000001, 2024-09-13T05:11:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048450024000000001, 2024-09-13T05:11:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:02.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45910 2024-09-13T05:11:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370028+0000", 2024-09-13T05:11:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370028+0000", 2024-09-13T05:11:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:02.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370027+0000", 2024-09-13T05:11:02.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:02.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:02.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370031+0000", 2024-09-13T05:11:02.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6530000000000002e-06 2024-09-13T05:11:02.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:02.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370038+0000", 2024-09-13T05:11:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8959999999999997e-06 2024-09-13T05:11:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370043+0000", 2024-09-13T05:11:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3680000000000004e-06 2024-09-13T05:11:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370076+0000", 2024-09-13T05:11:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3411000000000002e-05 2024-09-13T05:11:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370125+0000", 2024-09-13T05:11:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8593e-05 2024-09-13T05:11:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.418478+0000", 2024-09-13T05:11:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048352978999999997 2024-09-13T05:11:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.030 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:51935 3.1e 3:7e634d7d:::rbd_data.112d52e13700.0000000000000255:head [set-alloc-hint object_size 262144 write_size 262144,write 0~1717] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-13T05:11:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:57.005334+0000", 2024-09-13T05:11:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.9297975879999996, 2024-09-13T05:11:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01007542, 2024-09-13T05:11:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 51935 2024-09-13T05:11:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:02.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:57.005334+0000", 2024-09-13T05:11:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:57.005334+0000", 2024-09-13T05:11:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:57.005331+0000", 2024-09-13T05:11:02.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999971 2024-09-13T05:11:02.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:02.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:57.005348+0000", 2024-09-13T05:11:02.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6977e-05 2024-09-13T05:11:02.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:02.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:57.005382+0000", 2024-09-13T05:11:02.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4585999999999997e-05 2024-09-13T05:11:02.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:57.005400+0000", 2024-09-13T05:11:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7847e-05 2024-09-13T05:11:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:57.005479+0000", 2024-09-13T05:11:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8387999999999996e-05 2024-09-13T05:11:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-13T05:11:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:57.005486+0000", 2024-09-13T05:11:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4909999999999999e-06 2024-09-13T05:11:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:57.013179+0000", 2024-09-13T05:11:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076924000000000003 2024-09-13T05:11:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:57.013380+0000", 2024-09-13T05:11:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020145100000000001 2024-09-13T05:11:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:11:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:57.013589+0000", 2024-09-13T05:11:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020910199999999999 2024-09-13T05:11:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:57.014738+0000", 2024-09-13T05:11:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001149251 2024-09-13T05:11:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:57.015347+0000", 2024-09-13T05:11:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00060868900000000004 2024-09-13T05:11:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:57.015383+0000", 2024-09-13T05:11:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6329999999999999e-05 2024-09-13T05:11:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:57.015409+0000", 2024-09-13T05:11:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5948e-05 2024-09-13T05:11:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:53089 3.19 3:99c9c083:::rbd_data.112d7b5dd21c.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-13T05:11:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:00.676318+0000", 2024-09-13T05:11:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.258813247, 2024-09-13T05:11:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015605427, 2024-09-13T05:11:02.037 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 53089 2024-09-13T05:11:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.676318+0000", 2024-09-13T05:11:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.676318+0000", 2024-09-13T05:11:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.676316+0000", 2024-09-13T05:11:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.676841+0000", 2024-09-13T05:11:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00052474100000000001 2024-09-13T05:11:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.676865+0000", 2024-09-13T05:11:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4017999999999999e-05 2024-09-13T05:11:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.676876+0000", 2024-09-13T05:11:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-09-13T05:11:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.676941+0000", 2024-09-13T05:11:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4500999999999998e-05 2024-09-13T05:11:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.677287+0000", 2024-09-13T05:11:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00034602199999999997 2024-09-13T05:11:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:11:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.679699+0000", 2024-09-13T05:11:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002411711 2024-09-13T05:11:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.691637+0000", 2024-09-13T05:11:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011938822999999999 2024-09-13T05:11:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.691664+0000", 2024-09-13T05:11:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.671e-05 2024-09-13T05:11:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.691804+0000", 2024-09-13T05:11:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014044700000000001 2024-09-13T05:11:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:02.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:02.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:02.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.691924+0000", 2024-09-13T05:11:02.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011916700000000001 2024-09-13T05:11:02.043 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:02.043 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:02.043 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:02.043 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:02.043 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:02.043 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:02.044 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:11:02.045 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:11:02.045 INFO:teuthology.orchestra.run.smithi120.stdout:2270 punch from 0x1d112b8 to 0x1d16d98, (0x5ae0 bytes) 2024-09-13T05:11:02.046 INFO:teuthology.orchestra.run.smithi120.stdout:2271 read 0x4c81725 thru 0x4c8fe40 (0xe71c bytes) 2024-09-13T05:11:02.046 INFO:teuthology.orchestra.run.smithi120.stdout:2272 trunc from 0x5669bcb to 0x135e5f0 2024-09-13T05:11:02.046 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:11:02.046 INFO:teuthology.orchestra.run.smithi120.stdout:2274 writesame 0x4b22017 thru 0x4b2eeeb data_size 0x1(0xced5 bytes) 2024-09-13T05:11:02.046 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:11:02.047 INFO:teuthology.orchestra.run.smithi120.stdout:2275 trunc from 0x4b2eeec to 0x673c452 2024-09-13T05:11:02.047 INFO:teuthology.orchestra.run.smithi120.stdout:2277 read 0x1f61794 thru 0x1f6a12a (0x8997 bytes) 2024-09-13T05:11:02.047 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:11:02.048 INFO:teuthology.orchestra.run.smithi120.stdout:2278 trunc from 0x673c452 to 0xb49a78d 2024-09-13T05:11:02.048 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:02.048 INFO:teuthology.orchestra.run.smithi120.stdout:2281 punch from 0x8276009 to 0x82808c3, (0xa8ba bytes) 2024-09-13T05:11:02.048 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:02.048 INFO:teuthology.orchestra.run.smithi120.stdout:2284 read 0x624883c thru 0x624e6b2 (0x5e77 bytes) 2024-09-13T05:11:02.048 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:02.048 INFO:teuthology.orchestra.run.smithi120.stdout:2286 write 0x7fc53b9 thru 0x7fd4e3b (0xfa83 bytes) 2024-09-13T05:11:02.049 INFO:teuthology.orchestra.run.smithi120.stdout:2287 punch from 0xa96163 to 0xaa5611, (0xf4ae bytes) 2024-09-13T05:11:02.049 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:11:02.049 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:11:02.049 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:11:02.049 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:11:02.049 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:11:02.049 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:11:02.049 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:11:02.049 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:11:02.049 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:11:02.050 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:02.042+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:02.050 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.3 to 1 (10000) 2024-09-13T05:11:02.053 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T05:11:02.058 INFO:teuthology.orchestra.run.smithi120.stdout:2288 writesame 0xc4ced17 thru 0xc4d3fa1 data_size 0x11(0x528b bytes) 2024-09-13T05:11:02.058 INFO:teuthology.orchestra.run.smithi120.stdout:2289 read 0x9e531e6 thru 0x9e59027 (0x5e42 bytes) 2024-09-13T05:11:02.058 INFO:teuthology.orchestra.run.smithi120.stdout:2290 read 0x8e8ef thru 0x91d06 (0x3418 bytes) 2024-09-13T05:11:02.059 INFO:teuthology.orchestra.run.smithi120.stdout:2291 writesame 0xbdf4247 thru 0xbdf5a76 data_size 0x30(0x1830 bytes) 2024-09-13T05:11:02.066 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-13T05:11:02.067 INFO:teuthology.orchestra.run.smithi120.stdout:2292 write 0x26eb160 thru 0x26eb291 (0x132 bytes) 2024-09-13T05:11:02.081 INFO:teuthology.orchestra.run.smithi120.stdout:2293 trunc from 0xc4d3fa2 to 0x5741b73 2024-09-13T05:11:02.104 INFO:teuthology.orchestra.run.smithi120.stdout:2294 trunc from 0x5741b73 to 0x34d0b67 2024-09-13T05:11:02.140 INFO:teuthology.orchestra.run.smithi120.stdout:2295 write 0xa5ae069 thru 0xa5baef8 (0xce90 bytes) 2024-09-13T05:11:02.145 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:02.137+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:02.145 INFO:teuthology.orchestra.run.smithi120.stdout:2296 read 0x81733c8 thru 0x8180b9f (0xd7d8 bytes) 2024-09-13T05:11:02.146 INFO:teuthology.orchestra.run.smithi120.stdout:2297 write 0x20998e3 thru 0x209af0e (0x162c bytes) 2024-09-13T05:11:02.149 INFO:teuthology.orchestra.run.smithi120.stdout:2298 punch from 0x6115bba to 0x6119ff2, (0x4438 bytes) 2024-09-13T05:11:02.162 INFO:teuthology.orchestra.run.smithi120.stdout:2299 write 0xbdf9a41 thru 0xbe08b22 (0xf0e2 bytes) 2024-09-13T05:11:02.167 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:02.167 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:02.171 INFO:teuthology.orchestra.run.smithi120.stdout:2300 trunc from 0xbe08b23 to 0xb1b5110 2024-09-13T05:11:02.179 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:11:02.182 INFO:teuthology.orchestra.run.smithi120.stdout:2304 punch from 0xa0d6001 to 0xa0dd469, (0x7468 bytes) 2024-09-13T05:11:02.182 INFO:teuthology.orchestra.run.smithi120.stdout:2306 read 0x2875e24 thru 0x287a318 (0x44f5 bytes) 2024-09-13T05:11:02.183 INFO:teuthology.orchestra.run.smithi120.stdout:2308 punch from 0x97c9a97 to 0x97ceadd, (0x5046 bytes) 2024-09-13T05:11:02.183 INFO:teuthology.orchestra.run.smithi120.stdout:2310 write 0x5d8bc06 thru 0x5d8cfde (0x13d9 bytes) 2024-09-13T05:11:02.184 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:02.186 INFO:teuthology.orchestra.run.smithi120.stdout:2312 trunc from 0xb1b5110 to 0x9f83043 2024-09-13T05:11:02.196 INFO:teuthology.orchestra.run.smithi120.stdout:2314 read 0x749c607 thru 0x749c960 (0x35a bytes) 2024-09-13T05:11:02.196 INFO:teuthology.orchestra.run.smithi120.stdout:2315 punch from 0x967893e to 0x967a18c, (0x184e bytes) 2024-09-13T05:11:02.204 INFO:teuthology.orchestra.run.smithi120.stdout:2316 trunc from 0x9f83043 to 0x55da7c7 2024-09-13T05:11:02.225 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:02.225 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:02.237 INFO:teuthology.orchestra.run.smithi120.stdout:2322 writesame 0x7c1d18b thru 0x7c1f6f9 data_size 0x7(0x256f bytes) 2024-09-13T05:11:02.239 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:02.239 INFO:teuthology.orchestra.run.smithi120.stdout:2324 read 0x4e3a6c9 thru 0x4e458a6 (0xb1de bytes) 2024-09-13T05:11:02.246 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:02.242+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:02.252 INFO:teuthology.orchestra.run.smithi120.stdout:2325 trunc from 0x7c1f6fa to 0xe2db703 2024-09-13T05:11:02.261 INFO:teuthology.orchestra.run.smithi120.stdout:2327 read 0xc4df85b thru 0xc4e2047 (0x27ed bytes) 2024-09-13T05:11:02.262 INFO:teuthology.orchestra.run.smithi120.stdout:2329 read 0xb375b6b thru 0xb37b7e3 (0x5c79 bytes) 2024-09-13T05:11:02.262 INFO:teuthology.orchestra.run.smithi120.stdout:2332 read 0x5d9e58e thru 0x5da05a7 (0x201a bytes) 2024-09-13T05:11:02.262 INFO:teuthology.orchestra.run.smithi120.stdout:2333 read 0x158fac6 thru 0x159a010 (0xa54b bytes) 2024-09-13T05:11:02.263 INFO:teuthology.orchestra.run.smithi120.stdout:2334 read 0xbf46179 thru 0xbf4d9ea (0x7872 bytes) 2024-09-13T05:11:02.263 INFO:teuthology.orchestra.run.smithi120.stdout:2335 read 0x46a4c81 thru 0x46b357a (0xe8fa bytes) 2024-09-13T05:11:02.263 INFO:teuthology.orchestra.run.smithi120.stdout:2336 writesame 0x12ab73e thru 0x12add4f data_size 0xb(0x2612 bytes) 2024-09-13T05:11:02.267 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:02.267 INFO:teuthology.orchestra.run.smithi120.stdout:2340 read 0x2a67a28 thru 0x2a76d21 (0xf2fa bytes) 2024-09-13T05:11:02.268 INFO:teuthology.orchestra.run.smithi120.stdout:2344 punch from 0x37b89c7 to 0x37bd201, (0x483a bytes) 2024-09-13T05:11:02.268 INFO:teuthology.orchestra.run.smithi120.stdout:2345 write 0x1b87976 thru 0x1b8ae7f (0x350a bytes) 2024-09-13T05:11:02.270 INFO:teuthology.orchestra.run.smithi120.stdout:2347 write 0xc5739a4 thru 0xc57dcd1 (0xa32e bytes) 2024-09-13T05:11:02.285 INFO:teuthology.orchestra.run.smithi120.stdout:2348 write 0xe3ed835 thru 0xe3f4f47 (0x7713 bytes) 2024-09-13T05:11:02.290 INFO:teuthology.orchestra.run.smithi120.stdout:2349 write 0xcdbd1e9 thru 0xcdbd951 (0x769 bytes) 2024-09-13T05:11:02.294 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:02.295 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:02.295 INFO:teuthology.orchestra.run.smithi120.stdout:2350 punch from 0x70c431d to 0x70d2777, (0xe45a bytes) 2024-09-13T05:11:02.295 INFO:teuthology.orchestra.run.smithi120.stdout:2352 write 0x6762e5f thru 0x67659bd (0x2b5f bytes) 2024-09-13T05:11:02.297 INFO:teuthology.orchestra.run.smithi120.stdout:2353 write 0x36ca0b9 thru 0x36cea9d (0x49e5 bytes) 2024-09-13T05:11:02.301 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:02.305 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:11:02.321 INFO:teuthology.orchestra.run.smithi120.stdout:2356 trunc from 0xe3f4f48 to 0x153f1b3 2024-09-13T05:11:02.340 INFO:teuthology.orchestra.run.smithi120.stdout:2357 punch from 0xcebd32 to 0xcf83e3, (0xc6b1 bytes) 2024-09-13T05:11:02.346 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:02.342+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:02.353 INFO:teuthology.orchestra.run.smithi120.stdout:2358 trunc from 0x153f1b3 to 0x94bc396 2024-09-13T05:11:02.361 INFO:teuthology.orchestra.run.smithi120.stdout:2359 writesame 0x5393c26 thru 0x5396025 data_size 0x30(0x2400 bytes) 2024-09-13T05:11:02.365 INFO:teuthology.orchestra.run.smithi120.stdout:2360 read 0x1fecddd thru 0x1ff8c52 (0xbe76 bytes) 2024-09-13T05:11:02.366 INFO:teuthology.orchestra.run.smithi120.stdout:2362 trunc from 0x94bc396 to 0x90b6420 2024-09-13T05:11:02.377 INFO:teuthology.orchestra.run.smithi120.stdout:2364 read 0x365d284 thru 0x3669037 (0xbdb4 bytes) 2024-09-13T05:11:02.378 INFO:teuthology.orchestra.run.smithi120.stdout:2367 punch from 0x76c2c47 to 0x76c3cf6, (0x10af bytes) 2024-09-13T05:11:02.378 INFO:teuthology.orchestra.run.smithi120.stdout:2368 read 0x56d7621 thru 0x56e6a3b (0xf41b bytes) 2024-09-13T05:11:02.378 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:02.378 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:02.378 INFO:teuthology.orchestra.run.smithi120.stdout:2374 write 0x6804579 thru 0x6811bb3 (0xd63b bytes) 2024-09-13T05:11:02.381 INFO:teuthology.orchestra.run.smithi120.stdout:2375 read 0x7ef8a96 thru 0x7f04eac (0xc417 bytes) 2024-09-13T05:11:02.387 INFO:teuthology.orchestra.run.smithi120.stdout:2376 trunc from 0x90b6420 to 0xbc5da4c 2024-09-13T05:11:02.398 INFO:teuthology.orchestra.run.smithi120.stdout:2377 punch from 0x3bcec49 to 0x3bd73c0, (0x8777 bytes) 2024-09-13T05:11:02.398 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:02.398 INFO:teuthology.orchestra.run.smithi120.stdout:2379 read 0x65b4f22 thru 0x65c20de (0xd1bd bytes) 2024-09-13T05:11:02.399 INFO:teuthology.orchestra.run.smithi120.stdout:2380 clone 21 order 18 su 32768 sc 11 2024-09-13T05:11:02.413 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:02.413 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:02.423 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:11:02.465 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:02.462+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:02.548 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:02.542+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:02.575 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:02.575 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:02.585 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:11:02.649 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:02.646+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:02.689 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:02.689 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:02.699 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:11:02.750 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:02.745+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:02.800 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:02.801 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:02.810 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:11:02.850 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:02.845+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:02.916 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:02.916 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:02.926 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:11:02.951 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:02.945+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:03.029 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:03.029 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:03.039 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:11:03.052 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:03.045+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:03.069 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is unset 2024-09-13T05:11:03.070 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.5 to 1 (10000) 2024-09-13T05:11:03.085 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-13T05:11:03.153 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:03.149+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:03.158 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:03.158 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:03.168 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:11:03.192 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone20 from 0xbc5da4c (overlap 0x135e5f0) to 0x0 2024-09-13T05:11:03.253 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:03.249+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:03.273 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:03.273 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:03.283 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:11:03.292 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #19, image image_client.0-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent20 2024-09-13T05:11:03.354 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:03.349+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:03.385 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:03.385 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:03.396 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:11:03.455 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:03.449+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:03.476 INFO:teuthology.orchestra.run.smithi120.stdout:2381 punch from 0xb521349 to 0xb526d1f, (0x59d6 bytes) 2024-09-13T05:11:03.483 INFO:teuthology.orchestra.run.smithi120.stdout:2384 write 0x65b1bf1 thru 0x65b3403 (0x1813 bytes) 2024-09-13T05:11:03.501 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:03.502 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:03.503 INFO:teuthology.orchestra.run.smithi120.stdout:2385 trunc from 0xbc5da4c to 0x4fd2b36 2024-09-13T05:11:03.512 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:11:03.533 INFO:teuthology.orchestra.run.smithi120.stdout:2386 read 0x31eea87 thru 0x31f68d6 (0x7e50 bytes) 2024-09-13T05:11:03.534 INFO:teuthology.orchestra.run.smithi120.stdout:2389 read 0x15ea293 thru 0x15f34d6 (0x9244 bytes) 2024-09-13T05:11:03.535 INFO:teuthology.orchestra.run.smithi120.stdout:2390 read 0xfe1e46 thru 0xfea114 (0x82cf bytes) 2024-09-13T05:11:03.556 INFO:teuthology.orchestra.run.smithi120.stdout:2391 write 0x7e014cf thru 0x7e0dd93 (0xc8c5 bytes) 2024-09-13T05:11:03.556 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:03.549+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:03.563 INFO:teuthology.orchestra.run.smithi120.stdout:2392 punch from 0x4c8152a to 0x4c83c8d, (0x2763 bytes) 2024-09-13T05:11:03.563 INFO:teuthology.orchestra.run.smithi120.stdout:2394 writesame 0x148edaf thru 0x14978d0 data_size 0xb(0x8b22 bytes) 2024-09-13T05:11:03.566 INFO:teuthology.orchestra.run.smithi120.stdout:2396 read 0x7a71c7b thru 0x7a80ba1 (0xef27 bytes) 2024-09-13T05:11:03.571 INFO:teuthology.orchestra.run.smithi120.stdout:2397 trunc from 0x7e0dd94 to 0xaa493b1 2024-09-13T05:11:03.593 INFO:teuthology.orchestra.run.smithi120.stdout:2399 write 0xae13f93 thru 0xae145f0 (0x65e bytes) 2024-09-13T05:11:03.612 INFO:teuthology.orchestra.run.smithi120.stdout:2400 writesame 0xb191575 thru 0xb1a096d data_size 0x6d(0xf3f9 bytes) 2024-09-13T05:11:03.625 INFO:teuthology.orchestra.run.smithi120.stdout:2401 writesame 0xb3c1399 thru 0xb3c1973 data_size 0x1(0x5db bytes) 2024-09-13T05:11:03.625 INFO:teuthology.orchestra.run.smithi120.stdout:2402 write 0x17e3d9c thru 0x17e826b (0x44d0 bytes) 2024-09-13T05:11:03.628 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:03.628 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:03.639 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:11:03.652 INFO:teuthology.orchestra.run.smithi120.stdout:2403 write 0xe51d2cc thru 0xe51f33e (0x2073 bytes) 2024-09-13T05:11:03.657 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:03.654+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:03.658 INFO:teuthology.orchestra.run.smithi120.stdout:2404 write 0xcd8b74f thru 0xcd9aff1 (0xf8a3 bytes) 2024-09-13T05:11:03.670 INFO:teuthology.orchestra.run.smithi120.stdout:2405 writesame 0x8842e33 thru 0x884312d data_size 0x7(0x2fb bytes) 2024-09-13T05:11:03.676 INFO:teuthology.orchestra.run.smithi120.stdout:2408 writesame 0x311e44b thru 0x3120986 data_size 0x2(0x253c bytes) 2024-09-13T05:11:03.686 INFO:teuthology.orchestra.run.smithi120.stdout:2409 write 0x2fb4c08 thru 0x2fc3c72 (0xf06b bytes) 2024-09-13T05:11:03.694 INFO:teuthology.orchestra.run.smithi120.stdout:2410 write 0x70b1664 thru 0x70bbcbe (0xa65b bytes) 2024-09-13T05:11:03.711 INFO:teuthology.orchestra.run.smithi120.stdout:2413 trunc from 0xe51f33f to 0x92f9dc9 2024-09-13T05:11:03.733 INFO:teuthology.orchestra.run.smithi120.stdout:2414 read 0x88dedad thru 0x88e5785 (0x69d9 bytes) 2024-09-13T05:11:03.733 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:03.733 INFO:teuthology.orchestra.run.smithi120.stdout:2416 writesame 0x110089a thru 0x110b047 data_size 0x2(0xa7ae bytes) 2024-09-13T05:11:03.756 INFO:teuthology.orchestra.run.smithi120.stdout:2417 read 0x389ec06 thru 0x38a94f5 (0xa8f0 bytes) 2024-09-13T05:11:03.757 INFO:teuthology.orchestra.run.smithi120.stdout:2419 read 0x90cc0fd thru 0x90da170 (0xe074 bytes) 2024-09-13T05:11:03.758 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:03.754+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:03.762 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:03.762 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:03.774 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:11:03.778 INFO:teuthology.orchestra.run.smithi120.stdout:2422 write 0xc9d0765 thru 0xc9da0ac (0x9948 bytes) 2024-09-13T05:11:03.784 INFO:teuthology.orchestra.run.smithi120.stdout:2423 write 0xb8e85d thru 0xb90270 (0x1a14 bytes) 2024-09-13T05:11:03.793 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:03.810 INFO:teuthology.orchestra.run.smithi120.stdout:2425 write 0xee0f51a thru 0xee1c2a0 (0xcd87 bytes) 2024-09-13T05:11:03.821 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:03.821 INFO:teuthology.orchestra.run.smithi120.stdout:2428 punch from 0x577437f to 0x5780abe, (0xc73f bytes) 2024-09-13T05:11:03.821 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:03.821 INFO:teuthology.orchestra.run.smithi120.stdout:2430 read 0xbf84729 thru 0xbf88d96 (0x466e bytes) 2024-09-13T05:11:03.822 INFO:teuthology.orchestra.run.smithi120.stdout:2433 read 0xc1b240e thru 0xc1b5272 (0x2e65 bytes) 2024-09-13T05:11:03.822 INFO:teuthology.orchestra.run.smithi120.stdout:2434 read 0xed93f thru 0xf138a (0x3a4c bytes) 2024-09-13T05:11:03.822 INFO:teuthology.orchestra.run.smithi120.stdout:2435 punch from 0xcfc2267 to 0xcfc3fcb, (0x1d64 bytes) 2024-09-13T05:11:03.823 INFO:teuthology.orchestra.run.smithi120.stdout:2436 writesame 0x4d9c3c0 thru 0x4da5c49 data_size 0x6e(0x988a bytes) 2024-09-13T05:11:03.836 INFO:teuthology.orchestra.run.smithi120.stdout:2437 writesame 0xd639b0e thru 0xd63a95e data_size 0x1(0xe51 bytes) 2024-09-13T05:11:03.842 INFO:teuthology.orchestra.run.smithi120.stdout:2439 writesame 0xccdfc07 thru 0xcce14ca data_size 0xa(0x18c4 bytes) 2024-09-13T05:11:03.849 INFO:teuthology.orchestra.run.smithi120.stdout:2440 write 0x44ea33f thru 0x44f0ca9 (0x696b bytes) 2024-09-13T05:11:03.857 INFO:teuthology.orchestra.run.smithi120.stdout:2441 punch from 0xebb4b88 to 0xebb4f8d, (0x405 bytes) 2024-09-13T05:11:03.857 INFO:teuthology.orchestra.run.smithi120.stdout:2442 read 0xd52d83c thru 0xd52de33 (0x5f8 bytes) 2024-09-13T05:11:03.857 INFO:teuthology.orchestra.run.smithi120.stdout:2443 write 0x22acf9b thru 0x22b6fb6 (0xa01c bytes) 2024-09-13T05:11:03.858 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:03.853+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:03.865 INFO:teuthology.orchestra.run.smithi120.stdout:2444 writesame 0x865749c thru 0x8659951 data_size 0x2(0x24b6 bytes) 2024-09-13T05:11:03.874 INFO:teuthology.orchestra.run.smithi120.stdout:2445 write 0x1530b32 thru 0x153ce0c (0xc2db bytes) 2024-09-13T05:11:03.881 INFO:teuthology.orchestra.run.smithi120.stdout:2448 writesame 0x6af3c4c thru 0x6b0224d data_size 0x2(0xe602 bytes) 2024-09-13T05:11:03.890 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:03.890 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:03.900 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:11:03.915 INFO:teuthology.orchestra.run.smithi120.stdout:2450 trunc from 0xee1c2a1 to 0x74eaeaf 2024-09-13T05:11:03.935 INFO:teuthology.orchestra.run.smithi120.stdout:2451 read 0x8a6b6e thru 0x8ac775 (0x5c08 bytes) 2024-09-13T05:11:03.937 INFO:teuthology.orchestra.run.smithi120.stdout:2453 punch from 0x45e60ea to 0x45f2c8b, (0xcba1 bytes) 2024-09-13T05:11:03.937 INFO:teuthology.orchestra.run.smithi120.stdout:2454 read 0x23fbcf5 thru 0x23fd30c (0x1618 bytes) 2024-09-13T05:11:03.950 INFO:teuthology.orchestra.run.smithi120.stdout:2455 trunc from 0x74eaeaf to 0xd0a9e25 2024-09-13T05:11:03.959 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:03.954+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:03.960 INFO:teuthology.orchestra.run.smithi120.stdout:2456 punch from 0xc421f97 to 0xc42e127, (0xc190 bytes) 2024-09-13T05:11:03.960 INFO:teuthology.orchestra.run.smithi120.stdout:2459 punch from 0x7096448 to 0x7099621, (0x31d9 bytes) 2024-09-13T05:11:03.960 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:03.960 INFO:teuthology.orchestra.run.smithi120.stdout:2462 write 0x50ec5eb thru 0x50ecbfb (0x611 bytes) 2024-09-13T05:11:03.965 INFO:teuthology.orchestra.run.smithi120.stdout:2463 read 0x556738a thru 0x5576f58 (0xfbcf bytes) 2024-09-13T05:11:03.965 INFO:teuthology.orchestra.run.smithi120.stdout:2464 write 0xc52565e thru 0xc532bb8 (0xd55b bytes) 2024-09-13T05:11:03.973 INFO:teuthology.orchestra.run.smithi120.stdout:2465 read 0x968d98 thru 0x97705c (0xe2c5 bytes) 2024-09-13T05:11:03.986 INFO:teuthology.orchestra.run.smithi120.stdout:2466 trunc from 0xd0a9e25 to 0x6768877 2024-09-13T05:11:04.026 INFO:teuthology.orchestra.run.smithi120.stdout:2467 write 0xb844bbb thru 0xb84f10e (0xa554 bytes) 2024-09-13T05:11:04.029 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:04.029 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:04.033 INFO:teuthology.orchestra.run.smithi120.stdout:2468 read 0x2fd7d7 thru 0x2ffef3 (0x271d bytes) 2024-09-13T05:11:04.034 INFO:teuthology.orchestra.run.smithi120.stdout:2470 read 0x4ecd086 thru 0x4ed161c (0x4597 bytes) 2024-09-13T05:11:04.036 INFO:teuthology.orchestra.run.smithi120.stdout:2471 read 0x2b9c15 thru 0x2c9121 (0xf50d bytes) 2024-09-13T05:11:04.039 INFO:teuthology.orchestra.run.smithi120.stdout:2472 read 0xa0dd371 thru 0xa0ed352 (0xffe2 bytes) 2024-09-13T05:11:04.040 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:11:04.041 INFO:teuthology.orchestra.run.smithi120.stdout:2473 read 0x975f43b thru 0x97689a5 (0x956b bytes) 2024-09-13T05:11:04.041 INFO:teuthology.orchestra.run.smithi120.stdout:2474 read 0x51bc7a1 thru 0x51ca270 (0xdad0 bytes) 2024-09-13T05:11:04.041 INFO:teuthology.orchestra.run.smithi120.stdout:2475 punch from 0x7634c55 to 0x7641a75, (0xce20 bytes) 2024-09-13T05:11:04.056 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:11:04.060 INFO:teuthology.orchestra.run.smithi120.stdout:2476 write 0xea05585 thru 0xea109a9 (0xb425 bytes) 2024-09-13T05:11:04.060 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:04.053+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:04.075 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.6 to 1 (10000) 2024-09-13T05:11:04.084 INFO:teuthology.orchestra.run.smithi120.stdout:2477 trunc from 0xea109aa to 0x66c748a 2024-09-13T05:11:04.089 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-13T05:11:04.107 INFO:teuthology.orchestra.run.smithi120.stdout:2478 read 0x52e053a thru 0x52e947f (0x8f46 bytes) 2024-09-13T05:11:04.108 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:04.109 INFO:teuthology.orchestra.run.smithi120.stdout:2480 trunc from 0x66c748a to 0x776c1f6 2024-09-13T05:11:04.120 INFO:teuthology.orchestra.run.smithi120.stdout:2481 write 0xef6c89 thru 0xf0631d (0xf695 bytes) 2024-09-13T05:11:04.132 INFO:teuthology.orchestra.run.smithi120.stdout:2482 punch from 0x31711dd to 0x3172852, (0x1675 bytes) 2024-09-13T05:11:04.136 INFO:teuthology.orchestra.run.smithi120.stdout:2483 trunc from 0x776c1f6 to 0x4fc4ff1 2024-09-13T05:11:04.159 INFO:teuthology.orchestra.run.smithi120.stdout:2484 read 0xae79ad thru 0xaf17df (0x9e33 bytes) 2024-09-13T05:11:04.160 INFO:teuthology.orchestra.run.smithi120.stdout:2485 read 0x47053c5 thru 0x470c898 (0x74d4 bytes) 2024-09-13T05:11:04.161 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:04.158+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:04.181 INFO:teuthology.orchestra.run.smithi120.stdout:2486 write 0xb6a55a1 thru 0xb6aa89a (0x52fa bytes) 2024-09-13T05:11:04.186 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:04.187 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:04.192 INFO:teuthology.orchestra.run.smithi120.stdout:2487 trunc from 0xb6aa89b to 0x897a0e1 2024-09-13T05:11:04.199 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:11:04.208 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:11:04.212 INFO:teuthology.orchestra.run.smithi120.stdout:2488 punch from 0x35e7748 to 0x35ed53f, (0x5df7 bytes) 2024-09-13T05:11:04.226 INFO:teuthology.orchestra.run.smithi120.stdout:2489 write 0x95e353e thru 0x95e4826 (0x12e9 bytes) 2024-09-13T05:11:04.230 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:11:04.233 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:04.237 INFO:teuthology.orchestra.run.smithi120.stdout:2491 trunc from 0x95e4827 to 0xc2ac9ae 2024-09-13T05:11:04.247 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:04.247 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:04.247 INFO:teuthology.orchestra.run.smithi120.stdout:2499 write 0x4cf4271 thru 0x4cf9a5f (0x57ef bytes) 2024-09-13T05:11:04.249 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:11:04.256 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:04.256 INFO:teuthology.orchestra.run.smithi120.stdout:2501 read 0x6a15be0 thru 0x6a2288f (0xccb0 bytes) 2024-09-13T05:11:04.256 INFO:teuthology.orchestra.run.smithi120.stdout:2505 write 0x68db2c8 thru 0x68ea467 (0xf1a0 bytes) 2024-09-13T05:11:04.261 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:04.258+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:04.265 INFO:teuthology.orchestra.run.smithi120.stdout:2506 read 0x73dc888 thru 0x73de0c0 (0x1839 bytes) 2024-09-13T05:11:04.268 INFO:teuthology.orchestra.run.smithi120.stdout:2507 trunc from 0xc2ac9ae to 0xe1c637d 2024-09-13T05:11:04.270 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:11:04.279 INFO:teuthology.orchestra.run.smithi120.stdout:2508 punch from 0xd491e0d to 0xd494af1, (0x2ce4 bytes) 2024-09-13T05:11:04.279 INFO:teuthology.orchestra.run.smithi120.stdout:2509 write 0xa1d21ce thru 0xa1de58e (0xc3c1 bytes) 2024-09-13T05:11:04.286 INFO:teuthology.orchestra.run.smithi120.stdout:2511 write 0x426f44e thru 0x4270e03 (0x19b6 bytes) 2024-09-13T05:11:04.292 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:11:04.301 INFO:teuthology.orchestra.run.smithi120.stdout:2512 trunc from 0xe1c637d to 0xa18e475 2024-09-13T05:11:04.313 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:04.313 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:04.313 INFO:teuthology.orchestra.run.smithi120.stdout:2515 read 0x999780e thru 0x99a3def (0xc5e2 bytes) 2024-09-13T05:11:04.313 INFO:teuthology.orchestra.run.smithi120.stdout:2516 writesame 0x43b43b6 thru 0x43bf81b data_size 0x81(0xb466 bytes) 2024-09-13T05:11:04.315 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:11:04.320 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:04.320 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:04.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:04.320 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:04.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.320 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10634 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 731136~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:04.320 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:04.320 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.916404321000002, 2024-09-13T05:11:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028136992999999999, 2024-09-13T05:11:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10634 2024-09-13T05:11:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401987+0000", 2024-09-13T05:11:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5090000000000001e-06 2024-09-13T05:11:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401997+0000", 2024-09-13T05:11:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8009999999999998e-06 2024-09-13T05:11:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402000+0000", 2024-09-13T05:11:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.756e-06 2024-09-13T05:11:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430035+0000", 2024-09-13T05:11:04.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028034967000000001 2024-09-13T05:11:04.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430081+0000", 2024-09-13T05:11:04.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6448e-05 2024-09-13T05:11:04.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430123+0000", 2024-09-13T05:11:04.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1758000000000002e-05 2024-09-13T05:11:04.324 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10635 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 740352~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:11:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.916387706999998, 2024-09-13T05:11:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028229890000000001, 2024-09-13T05:11:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10635 2024-09-13T05:11:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:11:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:11:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402002+0000", 2024-09-13T05:11:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402004+0000", 2024-09-13T05:11:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.575e-06 2024-09-13T05:11:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402007+0000", 2024-09-13T05:11:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1240000000000001e-06 2024-09-13T05:11:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402010+0000", 2024-09-13T05:11:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5859999999999999e-06 2024-09-13T05:11:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430146+0000", 2024-09-13T05:11:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028136746000000001 2024-09-13T05:11:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430195+0000", 2024-09-13T05:11:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8948e-05 2024-09-13T05:11:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430232+0000", 2024-09-13T05:11:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7159000000000001e-05 2024-09-13T05:11:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10636 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 749568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:11:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.916378600999998, 2024-09-13T05:11:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328440999999999, 2024-09-13T05:11:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10636 2024-09-13T05:11:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:11:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:11:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402011+0000", 2024-09-13T05:11:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402017+0000", 2024-09-13T05:11:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5620000000000003e-06 2024-09-13T05:11:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402020+0000", 2024-09-13T05:11:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1410000000000001e-06 2024-09-13T05:11:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402024+0000", 2024-09-13T05:11:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4489999999999999e-06 2024-09-13T05:11:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430256+0000", 2024-09-13T05:11:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028232363 2024-09-13T05:11:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430299+0000", 2024-09-13T05:11:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2830999999999997e-05 2024-09-13T05:11:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430340+0000", 2024-09-13T05:11:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1301000000000003e-05 2024-09-13T05:11:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10637 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 758784~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.916363488000002, 2024-09-13T05:11:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028441793, 2024-09-13T05:11:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10637 2024-09-13T05:11:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402031+0000", 2024-09-13T05:11:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6770000000000003e-06 2024-09-13T05:11:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402034+0000", 2024-09-13T05:11:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1540000000000002e-06 2024-09-13T05:11:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402038+0000", 2024-09-13T05:11:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4970000000000001e-06 2024-09-13T05:11:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430367+0000", 2024-09-13T05:11:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328906000000001 2024-09-13T05:11:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430416+0000", 2024-09-13T05:11:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:11:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430469+0000", 2024-09-13T05:11:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2284999999999998e-05 2024-09-13T05:11:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10638 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 768000~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.916350004000002, 2024-09-13T05:11:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028548740999999999, 2024-09-13T05:11:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10638 2024-09-13T05:11:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402041+0000", 2024-09-13T05:11:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4789999999999999e-06 2024-09-13T05:11:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402044+0000", 2024-09-13T05:11:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.694e-06 2024-09-13T05:11:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402047+0000", 2024-09-13T05:11:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.537e-06 2024-09-13T05:11:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430494+0000", 2024-09-13T05:11:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028447665 2024-09-13T05:11:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430544+0000", 2024-09-13T05:11:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9539000000000001e-05 2024-09-13T05:11:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430589+0000", 2024-09-13T05:11:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5071999999999998e-05 2024-09-13T05:11:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10639 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 777216~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:11:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.916339622999999, 2024-09-13T05:11:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028651769000000001, 2024-09-13T05:11:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10639 2024-09-13T05:11:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:11:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:11:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402050+0000", 2024-09-13T05:11:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402052+0000", 2024-09-13T05:11:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2249999999999999e-06 2024-09-13T05:11:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402054+0000", 2024-09-13T05:11:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8140000000000001e-06 2024-09-13T05:11:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402057+0000", 2024-09-13T05:11:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4889999999999998e-06 2024-09-13T05:11:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430607+0000", 2024-09-13T05:11:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028549896000000002 2024-09-13T05:11:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430651+0000", 2024-09-13T05:11:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4622000000000001e-05 2024-09-13T05:11:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430702+0000", 2024-09-13T05:11:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0980999999999999e-05 2024-09-13T05:11:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11151 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 779264~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.886568341999997, 2024-09-13T05:11:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028283188000000001, 2024-09-13T05:11:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11151 2024-09-13T05:11:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431827+0000", 2024-09-13T05:11:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0989999999999998e-06 2024-09-13T05:11:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431832+0000", 2024-09-13T05:11:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8829999999999997e-06 2024-09-13T05:11:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431835+0000", 2024-09-13T05:11:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.439e-06 2024-09-13T05:11:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.459955+0000", 2024-09-13T05:11:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028119858000000001 2024-09-13T05:11:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.460029+0000", 2024-09-13T05:11:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4264000000000006e-05 2024-09-13T05:11:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.460105+0000", 2024-09-13T05:11:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5906000000000001e-05 2024-09-13T05:11:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11897 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 579584~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.837419167999997, 2024-09-13T05:11:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028193354, 2024-09-13T05:11:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11897 2024-09-13T05:11:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480973+0000", 2024-09-13T05:11:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.934e-06 2024-09-13T05:11:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480976+0000", 2024-09-13T05:11:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.614e-06 2024-09-13T05:11:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480980+0000", 2024-09-13T05:11:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.377e-06 2024-09-13T05:11:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.508967+0000", 2024-09-13T05:11:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027987455000000001 2024-09-13T05:11:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509074+0000", 2024-09-13T05:11:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107379 2024-09-13T05:11:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509164+0000", 2024-09-13T05:11:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9979e-05 2024-09-13T05:11:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11898 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 588800~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.837407104, 2024-09-13T05:11:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028308628999999998, 2024-09-13T05:11:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11898 2024-09-13T05:11:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480984+0000", 2024-09-13T05:11:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:11:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480988+0000", 2024-09-13T05:11:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4640000000000002e-06 2024-09-13T05:11:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480991+0000", 2024-09-13T05:11:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3469999999999999e-06 2024-09-13T05:11:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509199+0000", 2024-09-13T05:11:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028207449999999998 2024-09-13T05:11:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509250+0000", 2024-09-13T05:11:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1375000000000002e-05 2024-09-13T05:11:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509292+0000", 2024-09-13T05:11:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1730000000000002e-05 2024-09-13T05:11:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11899 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 598016~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.837396263000002, 2024-09-13T05:11:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516703000000001, 2024-09-13T05:11:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11899 2024-09-13T05:11:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480995+0000", 2024-09-13T05:11:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7349999999999999e-06 2024-09-13T05:11:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481000+0000", 2024-09-13T05:11:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0289999999999996e-06 2024-09-13T05:11:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481004+0000", 2024-09-13T05:11:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3699999999999999e-06 2024-09-13T05:11:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509332+0000", 2024-09-13T05:11:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328320000000001 2024-09-13T05:11:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509428+0000", 2024-09-13T05:11:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6150999999999995e-05 2024-09-13T05:11:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509511+0000", 2024-09-13T05:11:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2396000000000002e-05 2024-09-13T05:11:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11900 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 607232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:11:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.837383674000002, 2024-09-13T05:11:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028621273999999999, 2024-09-13T05:11:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11900 2024-09-13T05:11:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:11:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:11:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481006+0000", 2024-09-13T05:11:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481008+0000", 2024-09-13T05:11:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.73e-06 2024-09-13T05:11:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481011+0000", 2024-09-13T05:11:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4000000000000001e-06 2024-09-13T05:11:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481015+0000", 2024-09-13T05:11:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2760000000000001e-06 2024-09-13T05:11:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509531+0000", 2024-09-13T05:11:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516102000000002 2024-09-13T05:11:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509588+0000", 2024-09-13T05:11:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7423999999999998e-05 2024-09-13T05:11:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509628+0000", 2024-09-13T05:11:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9644000000000002e-05 2024-09-13T05:11:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11901 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 616448~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.837373053, 2024-09-13T05:11:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028820500999999998, 2024-09-13T05:11:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11901 2024-09-13T05:11:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481022+0000", 2024-09-13T05:11:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0209999999999999e-06 2024-09-13T05:11:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481026+0000", 2024-09-13T05:11:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:11:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481029+0000", 2024-09-13T05:11:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.636e-06 2024-09-13T05:11:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509661+0000", 2024-09-13T05:11:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028631496999999999 2024-09-13T05:11:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509757+0000", 2024-09-13T05:11:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5780999999999997e-05 2024-09-13T05:11:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509838+0000", 2024-09-13T05:11:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1102999999999999e-05 2024-09-13T05:11:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11902 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 625664~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.837351191000003, 2024-09-13T05:11:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028894265999999998, 2024-09-13T05:11:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11902 2024-09-13T05:11:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481041+0000", 2024-09-13T05:11:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8020000000000001e-06 2024-09-13T05:11:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481044+0000", 2024-09-13T05:11:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7110000000000001e-06 2024-09-13T05:11:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481048+0000", 2024-09-13T05:11:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.411e-06 2024-09-13T05:11:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509851+0000", 2024-09-13T05:11:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028803295 2024-09-13T05:11:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509896+0000", 2024-09-13T05:11:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4963000000000003e-05 2024-09-13T05:11:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509933+0000", 2024-09-13T05:11:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7384e-05 2024-09-13T05:11:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11903 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 634880~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.837339954999997, 2024-09-13T05:11:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029118033000000001, 2024-09-13T05:11:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11903 2024-09-13T05:11:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481052+0000", 2024-09-13T05:11:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.581e-06 2024-09-13T05:11:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481055+0000", 2024-09-13T05:11:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4520000000000002e-06 2024-09-13T05:11:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481058+0000", 2024-09-13T05:11:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4599999999999999e-06 2024-09-13T05:11:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509967+0000", 2024-09-13T05:11:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028908257999999999 2024-09-13T05:11:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510062+0000", 2024-09-13T05:11:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5613999999999996e-05 2024-09-13T05:11:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510168+0000", 2024-09-13T05:11:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105951 2024-09-13T05:11:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11904 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 644096~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.837329060000002, 2024-09-13T05:11:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029301971, 2024-09-13T05:11:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11904 2024-09-13T05:11:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481063+0000", 2024-09-13T05:11:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6700000000000001e-06 2024-09-13T05:11:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481068+0000", 2024-09-13T05:11:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4519999999999996e-06 2024-09-13T05:11:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481074+0000", 2024-09-13T05:11:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8370000000000002e-06 2024-09-13T05:11:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510197+0000", 2024-09-13T05:11:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029123237999999999 2024-09-13T05:11:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510285+0000", 2024-09-13T05:11:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7676000000000006e-05 2024-09-13T05:11:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510363+0000", 2024-09-13T05:11:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8418999999999996e-05 2024-09-13T05:11:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11905 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 653312~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:11:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.83731332, 2024-09-13T05:11:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029480164, 2024-09-13T05:11:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11905 2024-09-13T05:11:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:11:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:11:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481076+0000", 2024-09-13T05:11:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481079+0000", 2024-09-13T05:11:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9629999999999998e-06 2024-09-13T05:11:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481087+0000", 2024-09-13T05:11:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6369999999999999e-06 2024-09-13T05:11:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481093+0000", 2024-09-13T05:11:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.857e-06 2024-09-13T05:11:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510408+0000", 2024-09-13T05:11:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029315213 2024-09-13T05:11:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510501+0000", 2024-09-13T05:11:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2916000000000003e-05 2024-09-13T05:11:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510557+0000", 2024-09-13T05:11:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6063999999999997e-05 2024-09-13T05:11:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11906 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 662528~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:11:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.837271307000002, 2024-09-13T05:11:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029575054999999999, 2024-09-13T05:11:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11906 2024-09-13T05:11:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:11:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:11:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481118+0000", 2024-09-13T05:11:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481122+0000", 2024-09-13T05:11:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2610000000000002e-06 2024-09-13T05:11:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481129+0000", 2024-09-13T05:11:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0079999999999996e-06 2024-09-13T05:11:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481135+0000", 2024-09-13T05:11:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0599999999999996e-06 2024-09-13T05:11:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510575+0000", 2024-09-13T05:11:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029440470999999999 2024-09-13T05:11:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510635+0000", 2024-09-13T05:11:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0177000000000003e-05 2024-09-13T05:11:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510694+0000", 2024-09-13T05:11:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8675999999999999e-05 2024-09-13T05:11:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11907 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 671744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:11:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.837010511999999, 2024-09-13T05:11:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029479490000000001, 2024-09-13T05:11:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11907 2024-09-13T05:11:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:11:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:11:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481140+0000", 2024-09-13T05:11:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997597 2024-09-13T05:11:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481383+0000", 2024-09-13T05:11:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024355399999999999 2024-09-13T05:11:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481390+0000", 2024-09-13T05:11:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3599999999999998e-06 2024-09-13T05:11:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481395+0000", 2024-09-13T05:11:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8940000000000001e-06 2024-09-13T05:11:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510722+0000", 2024-09-13T05:11:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029327143999999999 2024-09-13T05:11:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510802+0000", 2024-09-13T05:11:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9770000000000004e-05 2024-09-13T05:11:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510859+0000", 2024-09-13T05:11:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6957999999999999e-05 2024-09-13T05:11:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11908 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 680960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:11:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.836990599000003, 2024-09-13T05:11:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029617622, 2024-09-13T05:11:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11908 2024-09-13T05:11:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:11:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:11:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481399+0000", 2024-09-13T05:11:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481401+0000", 2024-09-13T05:11:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8729999999999999e-06 2024-09-13T05:11:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481413+0000", 2024-09-13T05:11:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1748e-05 2024-09-13T05:11:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481417+0000", 2024-09-13T05:11:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:11:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510908+0000", 2024-09-13T05:11:04.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029491129000000001 2024-09-13T05:11:04.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510955+0000", 2024-09-13T05:11:04.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7188000000000003e-05 2024-09-13T05:11:04.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511017+0000", 2024-09-13T05:11:04.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2288999999999999e-05 2024-09-13T05:11:04.406 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11909 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 690176~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:11:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.836970272000002, 2024-09-13T05:11:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029780699000000001, 2024-09-13T05:11:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11909 2024-09-13T05:11:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:11:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:11:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481419+0000", 2024-09-13T05:11:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481421+0000", 2024-09-13T05:11:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.035e-06 2024-09-13T05:11:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481427+0000", 2024-09-13T05:11:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2449999999999998e-06 2024-09-13T05:11:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481430+0000", 2024-09-13T05:11:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.366e-06 2024-09-13T05:11:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511064+0000", 2024-09-13T05:11:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029633711 2024-09-13T05:11:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511160+0000", 2024-09-13T05:11:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6399999999999999e-05 2024-09-13T05:11:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511201+0000", 2024-09-13T05:11:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0448000000000003e-05 2024-09-13T05:11:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.411 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:04.412 INFO:teuthology.orchestra.run.smithi120.stdout:2518 trunc from 0xa18e475 to 0x7051a6a 2024-09-13T05:11:04.413 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:11:04.413 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:11:04.414 INFO:teuthology.orchestra.run.smithi120.stdout:2520 trunc from 0x7051a6a to 0x25ce4b8 2024-09-13T05:11:04.414 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:11:04.415 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:11:04.415 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:11:04.415 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:11:04.415 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:11:04.415 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:11:04.415 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:11:04.415 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:11:04.415 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:11:04.416 INFO:teuthology.orchestra.run.smithi120.stdout:2521 write 0x534c8ae thru 0x535bcfb (0xf44e bytes) 2024-09-13T05:11:04.416 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:04.406+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:04.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:11:04.429+0000 7f96d6d9d700 0 --2- 172.21.15.120:0/2166731919 >> v2:172.21.15.120:3300/0 conn(0x7f96d8139ee0 0x7f96d813a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-13T05:11:04.437 INFO:teuthology.orchestra.run.smithi120.stdout:2522 write 0x9e333dd thru 0x9e41915 (0xe539 bytes) 2024-09-13T05:11:04.472 INFO:teuthology.orchestra.run.smithi120.stdout:2523 writesame 0xedaa703 thru 0xedaf2c8 data_size 0x3d(0x4bc6 bytes) 2024-09-13T05:11:04.472 INFO:teuthology.orchestra.run.smithi120.stdout:2525 read 0x1543bd4 thru 0x154a800 (0x6c2d bytes) 2024-09-13T05:11:04.473 INFO:teuthology.orchestra.run.smithi120.stdout:2526 write 0xa31555a thru 0xa31bbd6 (0x667d bytes) 2024-09-13T05:11:04.483 INFO:teuthology.orchestra.run.smithi120.stdout:2527 read 0x17a2375 thru 0x17ad908 (0xb594 bytes) 2024-09-13T05:11:04.484 INFO:teuthology.orchestra.run.smithi120.stdout:2528 read 0x7d357c thru 0x7e106c (0xdaf1 bytes) 2024-09-13T05:11:04.486 INFO:teuthology.orchestra.run.smithi120.stdout:2531 write 0xb1c503e thru 0xb1cecd4 (0x9c97 bytes) 2024-09-13T05:11:04.500 INFO:teuthology.orchestra.run.smithi120.stdout:2532 write 0x1e35878 thru 0x1e42b99 (0xd322 bytes) 2024-09-13T05:11:04.508 INFO:teuthology.orchestra.run.smithi120.stdout:2533 read 0x665fa67 thru 0x66666e6 (0x6c80 bytes) 2024-09-13T05:11:04.508 INFO:teuthology.orchestra.run.smithi120.stdout:2534 write 0xb955a3a thru 0xb95b858 (0x5e1f bytes) 2024-09-13T05:11:04.513 INFO:teuthology.orchestra.run.smithi120.stdout:2537 read 0xc3b4d48 thru 0xc3bdfef (0x92a8 bytes) 2024-09-13T05:11:04.573 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:04.573 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:04.573 INFO:teuthology.orchestra.run.smithi120.stdout:2541 read 0x998e289 thru 0x99938f7 (0x566f bytes) 2024-09-13T05:11:04.573 INFO:teuthology.orchestra.run.smithi120.stdout:2544 write 0x1324b22 thru 0x132f155 (0xa634 bytes) 2024-09-13T05:11:04.573 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:04.509+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:04.574 INFO:teuthology.orchestra.run.smithi120.stdout:2545 write 0xaf113e1 thru 0xaf13fb0 (0x2bd0 bytes) 2024-09-13T05:11:04.574 INFO:teuthology.orchestra.run.smithi120.stdout:2546 trunc from 0xedaf2c9 to 0x302d536 2024-09-13T05:11:04.574 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:04.574 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:04.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.575 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:56178 3.4 3:21689248:::rbd_object_map.112d667fb7f9:head [call lock.assert_locked in=44b,call rbd.object_map_resize in=29b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-13T05:11:04.575 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:04.558440+0000", 2024-09-13T05:11:04.575 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00046655500000000001, 2024-09-13T05:11:04.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049462699999999998, 2024-09-13T05:11:04.575 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.575 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-13T05:11:04.575 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.575 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.575 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.575 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 56178 2024-09-13T05:11:04.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.576 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.558440+0000", 2024-09-13T05:11:04.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.558440+0000", 2024-09-13T05:11:04.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.558439+0000", 2024-09-13T05:11:04.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:04.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.558446+0000", 2024-09-13T05:11:04.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4699999999999996e-06 2024-09-13T05:11:04.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.558462+0000", 2024-09-13T05:11:04.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5656000000000001e-05 2024-09-13T05:11:04.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.558474+0000", 2024-09-13T05:11:04.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1741e-05 2024-09-13T05:11:04.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.558526+0000", 2024-09-13T05:11:04.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2243000000000001e-05 2024-09-13T05:11:04.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.558589+0000", 2024-09-13T05:11:04.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3635999999999999e-05 2024-09-13T05:11:04.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:11:04.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.558764+0000", 2024-09-13T05:11:04.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000174272 2024-09-13T05:11:04.579 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.580 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.580 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.580 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.580 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:11:04.580 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 1 2024-09-13T05:11:04.580 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:04.581 INFO:teuthology.orchestra.run.smithi120.stdout:2547 punch from 0x2f1e4c7 to 0x2f2759c, (0x90d5 bytes) 2024-09-13T05:11:04.581 INFO:teuthology.orchestra.run.smithi120.stdout:2548 punch from 0x680edc to 0x690d5e, (0xfe82 bytes) 2024-09-13T05:11:04.581 INFO:teuthology.orchestra.run.smithi120.stdout:2549 punch from 0x1a0b154 to 0x1a0c055, (0xf01 bytes) 2024-09-13T05:11:04.581 INFO:teuthology.orchestra.run.smithi120.stdout:2550 read 0x2ee102d thru 0x2eeabd7 (0x9bab bytes) 2024-09-13T05:11:04.582 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:11:04.582 INFO:teuthology.orchestra.run.smithi120.stdout:2551 write 0x64a58e9 thru 0x64a7d08 (0x2420 bytes) 2024-09-13T05:11:04.583 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:04.584 INFO:teuthology.orchestra.run.smithi120.stdout:2555 punch from 0x63cdd9f to 0x63dd2c0, (0xf521 bytes) 2024-09-13T05:11:04.584 INFO:teuthology.orchestra.run.smithi120.stdout:2556 read 0x5b1cad0 thru 0x5b1e4b1 (0x19e2 bytes) 2024-09-13T05:11:04.584 INFO:teuthology.orchestra.run.smithi120.stdout:2557 read 0x4457574 thru 0x4461db0 (0xa83d bytes) 2024-09-13T05:11:04.584 INFO:teuthology.orchestra.run.smithi120.stdout:2558 read 0x54ec6c0 thru 0x54ede66 (0x17a7 bytes) 2024-09-13T05:11:04.586 INFO:teuthology.orchestra.run.smithi120.stdout:2559 trunc from 0x64a7d09 to 0x45e6dc5 2024-09-13T05:11:04.614 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:04.610+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:04.622 INFO:teuthology.orchestra.run.smithi120.stdout:2560 write 0x6ff5449 thru 0x6ffd97f (0x8537 bytes) 2024-09-13T05:11:04.629 INFO:teuthology.orchestra.run.smithi120.stdout:2561 write 0x276fe97 thru 0x2770cf7 (0xe61 bytes) 2024-09-13T05:11:04.638 INFO:teuthology.orchestra.run.smithi120.stdout:2562 read 0x4000b3d thru 0x400930d (0x87d1 bytes) 2024-09-13T05:11:04.638 INFO:teuthology.orchestra.run.smithi120.stdout:2563 write 0x1dedfd thru 0x1ecb43 (0xdd47 bytes) 2024-09-13T05:11:04.656 INFO:teuthology.orchestra.run.smithi120.stdout:2564 trunc from 0x6ffd980 to 0x3395e79 2024-09-13T05:11:04.674 INFO:teuthology.orchestra.run.smithi120.stdout:2566 punch from 0x1a74e44 to 0x1a7bf87, (0x7143 bytes) 2024-09-13T05:11:04.674 INFO:teuthology.orchestra.run.smithi120.stdout:2567 read 0x2eaf246 thru 0x2eb41c4 (0x4f7f bytes) 2024-09-13T05:11:04.686 INFO:teuthology.orchestra.run.smithi120.stdout:2569 trunc from 0x3395e79 to 0x9fa039b 2024-09-13T05:11:04.698 INFO:teuthology.orchestra.run.smithi120.stdout:2571 writesame 0x23bdf20 thru 0x23cad02 data_size 0x1(0xcde3 bytes) 2024-09-13T05:11:04.708 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:04.708 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:04.708 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:04.708 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:04.708 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:04.715 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:04.709+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:04.719 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:11:04.723 INFO:teuthology.orchestra.run.smithi120.stdout:2572 write 0x979001f thru 0x97936cd (0x36af bytes) 2024-09-13T05:11:04.731 INFO:teuthology.orchestra.run.smithi120.stdout:2573 trunc from 0x9fa039b to 0x867c3ee 2024-09-13T05:11:04.751 INFO:teuthology.orchestra.run.smithi120.stdout:2574 read 0x7434f15 thru 0x743d73a (0x8826 bytes) 2024-09-13T05:11:04.753 INFO:teuthology.orchestra.run.smithi120.stdout:2575 trunc from 0x867c3ee to 0x708c9ef 2024-09-13T05:11:04.766 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:04.766 INFO:teuthology.orchestra.run.smithi120.stdout:2579 write 0x1801f35 thru 0x180e696 (0xc762 bytes) 2024-09-13T05:11:04.774 INFO:teuthology.orchestra.run.smithi120.stdout:2580 read 0x3c61fa3 thru 0x3c62856 (0x8b4 bytes) 2024-09-13T05:11:04.774 INFO:teuthology.orchestra.run.smithi120.stdout:2581 read 0xefe87d thru 0xf0a91f (0xc0a3 bytes) 2024-09-13T05:11:04.777 INFO:teuthology.orchestra.run.smithi120.stdout:2582 read 0x3551667 thru 0x3552982 (0x131c bytes) 2024-09-13T05:11:04.777 INFO:teuthology.orchestra.run.smithi120.stdout:2585 punch from 0x2801af7 to 0x2810995, (0xee9e bytes) 2024-09-13T05:11:04.777 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:04.777 INFO:teuthology.orchestra.run.smithi120.stdout:2587 read 0x34c7de thru 0x35aa4a (0xe26d bytes) 2024-09-13T05:11:04.778 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:04.779 INFO:teuthology.orchestra.run.smithi120.stdout:2591 writesame 0x1924d7d thru 0x1933d15 data_size 0x1(0xef99 bytes) 2024-09-13T05:11:04.816 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:04.810+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:04.824 INFO:teuthology.orchestra.run.smithi120.stdout:2592 write 0x72cfa65 thru 0x72d09ef (0xf8b bytes) 2024-09-13T05:11:04.832 INFO:teuthology.orchestra.run.smithi120.stdout:2595 read 0x2aa5f88 thru 0x2aaa2b2 (0x432b bytes) 2024-09-13T05:11:04.832 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:04.833 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:04.833 INFO:teuthology.orchestra.run.smithi120.stdout:2598 clone 22 order 19 su 8192 sc 2 2024-09-13T05:11:04.835 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:04.835 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:04.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:04.835 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:04.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.836 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26335 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1207296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:04.836 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:04.836 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.102182676000002, 2024-09-13T05:11:04.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055338125000000002, 2024-09-13T05:11:04.836 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.836 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.836 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.836 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.836 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.836 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26335 2024-09-13T05:11:04.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.836 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730550+0000", 2024-09-13T05:11:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998579 2024-09-13T05:11:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730705+0000", 2024-09-13T05:11:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015463400000000001 2024-09-13T05:11:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730713+0000", 2024-09-13T05:11:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1580000000000005e-06 2024-09-13T05:11:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730719+0000", 2024-09-13T05:11:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2740000000000004e-06 2024-09-13T05:11:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.785798+0000", 2024-09-13T05:11:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055079454 2024-09-13T05:11:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.785894+0000", 2024-09-13T05:11:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5896000000000005e-05 2024-09-13T05:11:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.786030+0000", 2024-09-13T05:11:04.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013586199999999999 2024-09-13T05:11:04.840 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.840 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.840 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.840 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26346 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1308672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:04.840 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:04.840 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.100041268999998, 2024-09-13T05:11:04.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055416737000000001, 2024-09-13T05:11:04.840 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.840 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.840 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.841 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26346 2024-09-13T05:11:04.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.841 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:04.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:04.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732833+0000", 2024-09-13T05:11:04.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732835+0000", 2024-09-13T05:11:04.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3719999999999999e-06 2024-09-13T05:11:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732839+0000", 2024-09-13T05:11:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1520000000000001e-06 2024-09-13T05:11:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732842+0000", 2024-09-13T05:11:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.061e-06 2024-09-13T05:11:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788126+0000", 2024-09-13T05:11:04.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055284489999999999 2024-09-13T05:11:04.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788183+0000", 2024-09-13T05:11:04.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7127999999999999e-05 2024-09-13T05:11:04.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788250+0000", 2024-09-13T05:11:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7001000000000004e-05 2024-09-13T05:11:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26348 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 800768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.099618445000001, 2024-09-13T05:11:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055321395000000002, 2024-09-13T05:11:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26348 2024-09-13T05:11:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733127+0000", 2024-09-13T05:11:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998703 2024-09-13T05:11:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733262+0000", 2024-09-13T05:11:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013484400000000001 2024-09-13T05:11:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733273+0000", 2024-09-13T05:11:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1824000000000001e-05 2024-09-13T05:11:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733281+0000", 2024-09-13T05:11:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9999999999999996e-06 2024-09-13T05:11:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788431+0000", 2024-09-13T05:11:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055149535 2024-09-13T05:11:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788490+0000", 2024-09-13T05:11:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9413999999999997e-05 2024-09-13T05:11:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788578+0000", 2024-09-13T05:11:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7418999999999998e-05 2024-09-13T05:11:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26368 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 985088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:11:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.095466248000001, 2024-09-13T05:11:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055320511000000003, 2024-09-13T05:11:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26368 2024-09-13T05:11:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:11:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:11:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737408+0000", 2024-09-13T05:11:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737412+0000", 2024-09-13T05:11:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6279999999999998e-06 2024-09-13T05:11:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737419+0000", 2024-09-13T05:11:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1770000000000001e-06 2024-09-13T05:11:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737425+0000", 2024-09-13T05:11:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6949999999999997e-06 2024-09-13T05:11:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792507+0000", 2024-09-13T05:11:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055082840000000001 2024-09-13T05:11:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792606+0000", 2024-09-13T05:11:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8697999999999996e-05 2024-09-13T05:11:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792729+0000", 2024-09-13T05:11:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012298499999999999 2024-09-13T05:11:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26417 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 903168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.091405987999998, 2024-09-13T05:11:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055375191999999997, 2024-09-13T05:11:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26417 2024-09-13T05:11:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741468+0000", 2024-09-13T05:11:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741472+0000", 2024-09-13T05:11:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4139999999999998e-06 2024-09-13T05:11:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741478+0000", 2024-09-13T05:11:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5230000000000001e-06 2024-09-13T05:11:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741483+0000", 2024-09-13T05:11:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8559999999999998e-06 2024-09-13T05:11:04.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796655+0000", 2024-09-13T05:11:04.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055172153000000002 2024-09-13T05:11:04.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796738+0000", 2024-09-13T05:11:04.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2912999999999997e-05 2024-09-13T05:11:04.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796844+0000", 2024-09-13T05:11:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105802 2024-09-13T05:11:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26419 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 912384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.091382122999999, 2024-09-13T05:11:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055570469999999997, 2024-09-13T05:11:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26419 2024-09-13T05:11:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741492+0000", 2024-09-13T05:11:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741495+0000", 2024-09-13T05:11:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6369999999999999e-06 2024-09-13T05:11:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741508+0000", 2024-09-13T05:11:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3319000000000001e-05 2024-09-13T05:11:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741527+0000", 2024-09-13T05:11:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8542e-05 2024-09-13T05:11:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796871+0000", 2024-09-13T05:11:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055344474999999997 2024-09-13T05:11:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796967+0000", 2024-09-13T05:11:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5963000000000003e-05 2024-09-13T05:11:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797063+0000", 2024-09-13T05:11:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5909999999999995e-05 2024-09-13T05:11:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26421 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 921600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.091338820000001, 2024-09-13T05:11:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055631152000000003, 2024-09-13T05:11:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26421 2024-09-13T05:11:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741535+0000", 2024-09-13T05:11:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741540+0000", 2024-09-13T05:11:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1690000000000002e-06 2024-09-13T05:11:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741547+0000", 2024-09-13T05:11:04.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3409999999999997e-06 2024-09-13T05:11:04.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741552+0000", 2024-09-13T05:11:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5639999999999996e-06 2024-09-13T05:11:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797079+0000", 2024-09-13T05:11:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055526038999999999 2024-09-13T05:11:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797121+0000", 2024-09-13T05:11:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2156000000000001e-05 2024-09-13T05:11:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797167+0000", 2024-09-13T05:11:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6445e-05 2024-09-13T05:11:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26423 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 930816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.090945826999999, 2024-09-13T05:11:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055364370000000003, 2024-09-13T05:11:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26423 2024-09-13T05:11:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741928+0000", 2024-09-13T05:11:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741933+0000", 2024-09-13T05:11:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9980000000000003e-06 2024-09-13T05:11:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741945+0000", 2024-09-13T05:11:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1761e-05 2024-09-13T05:11:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741958+0000", 2024-09-13T05:11:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2604e-05 2024-09-13T05:11:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797185+0000", 2024-09-13T05:11:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055227169 2024-09-13T05:11:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797226+0000", 2024-09-13T05:11:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1619000000000003e-05 2024-09-13T05:11:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797293+0000", 2024-09-13T05:11:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6952999999999994e-05 2024-09-13T05:11:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26424 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 940032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.090908890000001, 2024-09-13T05:11:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055448669999999999, 2024-09-13T05:11:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26424 2024-09-13T05:11:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741965+0000", 2024-09-13T05:11:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741969+0000", 2024-09-13T05:11:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3440000000000001e-06 2024-09-13T05:11:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741983+0000", 2024-09-13T05:11:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4600000000000001e-05 2024-09-13T05:11:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741989+0000", 2024-09-13T05:11:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5350000000000004e-06 2024-09-13T05:11:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797319+0000", 2024-09-13T05:11:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055330121000000003 2024-09-13T05:11:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797364+0000", 2024-09-13T05:11:04.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5670000000000002e-05 2024-09-13T05:11:04.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797415+0000", 2024-09-13T05:11:04.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0124000000000003e-05 2024-09-13T05:11:04.875 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.875 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.875 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26426 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 949248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.090881691, 2024-09-13T05:11:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055639981999999998, 2024-09-13T05:11:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26426 2024-09-13T05:11:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741995+0000", 2024-09-13T05:11:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.661e-06 2024-09-13T05:11:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742004+0000", 2024-09-13T05:11:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2009999999999999e-06 2024-09-13T05:11:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742008+0000", 2024-09-13T05:11:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7890000000000002e-06 2024-09-13T05:11:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797432+0000", 2024-09-13T05:11:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055423448 2024-09-13T05:11:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797516+0000", 2024-09-13T05:11:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4404e-05 2024-09-13T05:11:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797633+0000", 2024-09-13T05:11:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116898 2024-09-13T05:11:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26427 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 958464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.090861635, 2024-09-13T05:11:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055829295000000001, 2024-09-13T05:11:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26427 2024-09-13T05:11:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742015+0000", 2024-09-13T05:11:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.74e-06 2024-09-13T05:11:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742023+0000", 2024-09-13T05:11:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7039999999999994e-06 2024-09-13T05:11:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742028+0000", 2024-09-13T05:11:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7369999999999997e-06 2024-09-13T05:11:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797666+0000", 2024-09-13T05:11:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055637820999999997 2024-09-13T05:11:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797748+0000", 2024-09-13T05:11:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1787999999999997e-05 2024-09-13T05:11:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797842+0000", 2024-09-13T05:11:04.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4903999999999998e-05 2024-09-13T05:11:04.884 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.884 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.884 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.884 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26432 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 976896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:04.884 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:04.884 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.090068473999999, 2024-09-13T05:11:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055402077000000001, 2024-09-13T05:11:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26432 2024-09-13T05:11:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742808+0000", 2024-09-13T05:11:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3319999999999999e-06 2024-09-13T05:11:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742818+0000", 2024-09-13T05:11:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5380000000000008e-06 2024-09-13T05:11:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742821+0000", 2024-09-13T05:11:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2179999999999999e-06 2024-09-13T05:11:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798027+0000", 2024-09-13T05:11:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055206344999999997 2024-09-13T05:11:04.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798103+0000", 2024-09-13T05:11:04.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5786999999999998e-05 2024-09-13T05:11:04.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798208+0000", 2024-09-13T05:11:04.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010521700000000001 2024-09-13T05:11:04.888 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.888 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.888 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26434 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 986112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.090051249999998, 2024-09-13T05:11:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055610109999999997, 2024-09-13T05:11:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26434 2024-09-13T05:11:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742823+0000", 2024-09-13T05:11:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742825+0000", 2024-09-13T05:11:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6220000000000001e-06 2024-09-13T05:11:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742828+0000", 2024-09-13T05:11:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.926e-06 2024-09-13T05:11:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742831+0000", 2024-09-13T05:11:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-13T05:11:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798239+0000", 2024-09-13T05:11:04.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055408254999999997 2024-09-13T05:11:04.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798326+0000", 2024-09-13T05:11:04.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7168000000000003e-05 2024-09-13T05:11:04.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798434+0000", 2024-09-13T05:11:04.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010767100000000001 2024-09-13T05:11:04.893 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.893 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.893 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.893 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26442 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1032192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:04.893 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:04.893 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.088781910000002, 2024-09-13T05:11:04.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055422776, 2024-09-13T05:11:04.893 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.893 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26442 2024-09-13T05:11:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744061+0000", 2024-09-13T05:11:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999685 2024-09-13T05:11:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744096+0000", 2024-09-13T05:11:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4771999999999998e-05 2024-09-13T05:11:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744147+0000", 2024-09-13T05:11:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0696999999999999e-05 2024-09-13T05:11:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744154+0000", 2024-09-13T05:11:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8510000000000001e-06 2024-09-13T05:11:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799324+0000", 2024-09-13T05:11:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055170074999999999 2024-09-13T05:11:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799415+0000", 2024-09-13T05:11:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1197000000000001e-05 2024-09-13T05:11:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799516+0000", 2024-09-13T05:11:04.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100666 2024-09-13T05:11:04.897 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.897 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.897 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.897 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26443 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1041408~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:04.897 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:04.897 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.088501339, 2024-09-13T05:11:04.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055344195999999998, 2024-09-13T05:11:04.897 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.897 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.898 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.898 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.898 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.898 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26443 2024-09-13T05:11:04.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.898 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:04.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:04.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744159+0000", 2024-09-13T05:11:04.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997849 2024-09-13T05:11:04.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744379+0000", 2024-09-13T05:11:04.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022024800000000001 2024-09-13T05:11:04.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744390+0000", 2024-09-13T05:11:04.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1105e-05 2024-09-13T05:11:04.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744397+0000", 2024-09-13T05:11:04.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2740000000000002e-06 2024-09-13T05:11:04.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799543+0000", 2024-09-13T05:11:04.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055145441000000003 2024-09-13T05:11:04.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799619+0000", 2024-09-13T05:11:04.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6660000000000001e-05 2024-09-13T05:11:04.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799718+0000", 2024-09-13T05:11:04.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8331000000000004e-05 2024-09-13T05:11:04.901 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.901 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.901 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.901 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26547 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1318912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:04.901 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:04.901 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.088315021, 2024-09-13T05:11:04.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055355834, 2024-09-13T05:11:04.902 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.902 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.902 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.902 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.902 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.902 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26547 2024-09-13T05:11:04.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.902 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:04.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:04.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744404+0000", 2024-09-13T05:11:04.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998441 2024-09-13T05:11:04.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744564+0000", 2024-09-13T05:11:04.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016022200000000001 2024-09-13T05:11:04.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744579+0000", 2024-09-13T05:11:04.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5036e-05 2024-09-13T05:11:04.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744585+0000", 2024-09-13T05:11:04.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7880000000000003e-06 2024-09-13T05:11:04.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799747+0000", 2024-09-13T05:11:04.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055161804000000002 2024-09-13T05:11:04.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799823+0000", 2024-09-13T05:11:04.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5956000000000003e-05 2024-09-13T05:11:04.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799916+0000", 2024-09-13T05:11:04.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2733999999999997e-05 2024-09-13T05:11:04.905 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.905 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.905 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.906 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26550 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1328128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:04.906 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:11:04.906 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.088058862, 2024-09-13T05:11:04.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055315941, 2024-09-13T05:11:04.906 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.906 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.906 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.906 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.906 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.906 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26550 2024-09-13T05:11:04.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.906 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:11:04.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:11:04.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744591+0000", 2024-09-13T05:11:04.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997745 2024-09-13T05:11:04.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744821+0000", 2024-09-13T05:11:04.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023031899999999999 2024-09-13T05:11:04.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744833+0000", 2024-09-13T05:11:04.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1919000000000001e-05 2024-09-13T05:11:04.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744837+0000", 2024-09-13T05:11:04.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4989999999999996e-06 2024-09-13T05:11:04.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799947+0000", 2024-09-13T05:11:04.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055110120999999998 2024-09-13T05:11:04.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800030+0000", 2024-09-13T05:11:04.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2905999999999995e-05 2024-09-13T05:11:04.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800132+0000", 2024-09-13T05:11:04.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101529 2024-09-13T05:11:04.909 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.910 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.910 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.910 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26558 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1364992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:04.910 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:04.910 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.087323855000001, 2024-09-13T05:11:04.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055422765999999998, 2024-09-13T05:11:04.910 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.910 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.910 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26558 2024-09-13T05:11:04.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.911 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:04.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:04.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745550+0000", 2024-09-13T05:11:04.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745553+0000", 2024-09-13T05:11:04.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7690000000000001e-06 2024-09-13T05:11:04.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745559+0000", 2024-09-13T05:11:04.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3149999999999997e-06 2024-09-13T05:11:04.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745564+0000", 2024-09-13T05:11:04.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6670000000000004e-06 2024-09-13T05:11:04.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800791+0000", 2024-09-13T05:11:04.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055226711999999997 2024-09-13T05:11:04.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800865+0000", 2024-09-13T05:11:04.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4344000000000005e-05 2024-09-13T05:11:04.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800974+0000", 2024-09-13T05:11:04.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108606 2024-09-13T05:11:04.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.914 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.914 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26561 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1374208~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:04.914 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:04.914 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.087306802000001, 2024-09-13T05:11:04.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055549315000000002, 2024-09-13T05:11:04.914 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.914 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.914 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.915 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26561 2024-09-13T05:11:04.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.915 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:04.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:04.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:04.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745570+0000", 2024-09-13T05:11:04.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4719999999999998e-06 2024-09-13T05:11:04.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745575+0000", 2024-09-13T05:11:04.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1900000000000003e-06 2024-09-13T05:11:04.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745579+0000", 2024-09-13T05:11:04.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3250000000000001e-06 2024-09-13T05:11:04.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801000+0000", 2024-09-13T05:11:04.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055420432999999998 2024-09-13T05:11:04.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801061+0000", 2024-09-13T05:11:04.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1427000000000007e-05 2024-09-13T05:11:04.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801117+0000", 2024-09-13T05:11:04.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5933000000000001e-05 2024-09-13T05:11:04.918 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.918 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.918 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.918 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26582 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1447936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:04.918 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:04.918 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.085889162000001, 2024-09-13T05:11:04.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055394301, 2024-09-13T05:11:04.919 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:04.919 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:04.919 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:04.919 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:04.919 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:04.919 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26582 2024-09-13T05:11:04.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.919 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:04.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:04.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:04.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:04.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:04.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:04.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:04.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746985+0000", 2024-09-13T05:11:04.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:04.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:04.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746988+0000", 2024-09-13T05:11:04.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6479999999999999e-06 2024-09-13T05:11:04.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:04.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.747000+0000", 2024-09-13T05:11:04.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2009e-05 2024-09-13T05:11:04.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:04.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.747005+0000", 2024-09-13T05:11:04.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0039999999999999e-06 2024-09-13T05:11:04.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:04.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802232+0000", 2024-09-13T05:11:04.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055227762999999999 2024-09-13T05:11:04.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:04.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802320+0000", 2024-09-13T05:11:04.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7576000000000003e-05 2024-09-13T05:11:04.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:04.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:04.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:04.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802380+0000", 2024-09-13T05:11:04.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9888e-05 2024-09-13T05:11:04.922 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.922 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.922 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.922 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:04.922 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:04.922 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:04.924 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:11:04.924 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:04.917+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:05.025 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:05.022+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:05.079 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.7 to 1 (10000) 2024-09-13T05:11:05.088 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T05:11:05.090 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:05.090 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:05.090 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:05.091 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:05.092 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-13T05:11:05.092 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:11:05.101 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:11:05.126 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:05.122+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:05.205 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone21 from 0x72d09f0 (overlap 0x25ce4b8) to 0x0 2024-09-13T05:11:05.227 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:05.221+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:05.293 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:05.293 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:05.293 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:05.293 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:05.293 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:05.307 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:11:05.328 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:05.322+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:05.423 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:05.423 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:05.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:05.424 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:05.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.424 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2037 3.8 3:1349be29:::rbd_data.112d872fd67a.000000000000003b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:11:05.424 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.108522+0000", 2024-09-13T05:11:05.424 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.312588351000002, 2024-09-13T05:11:05.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016880821000000001, 2024-09-13T05:11:05.424 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:05.424 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:05.424 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:05.424 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:05.424 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:05.424 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2037 2024-09-13T05:11:05.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.425 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:05.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:05.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108522+0000", 2024-09-13T05:11:05.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:05.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108522+0000", 2024-09-13T05:11:05.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:05.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108521+0000", 2024-09-13T05:11:05.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:05.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:05.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108527+0000", 2024-09-13T05:11:05.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0460000000000002e-06 2024-09-13T05:11:05.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:05.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108538+0000", 2024-09-13T05:11:05.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0891e-05 2024-09-13T05:11:05.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:05.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108548+0000", 2024-09-13T05:11:05.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9159999999999996e-06 2024-09-13T05:11:05.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:05.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108595+0000", 2024-09-13T05:11:05.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7107000000000001e-05 2024-09-13T05:11:05.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:05.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108692+0000", 2024-09-13T05:11:05.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6824999999999995e-05 2024-09-13T05:11:05.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:11:05.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.111425+0000", 2024-09-13T05:11:05.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027337110000000002 2024-09-13T05:11:05.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:05.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125249+0000", 2024-09-13T05:11:05.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013823521 2024-09-13T05:11:05.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:05.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125265+0000", 2024-09-13T05:11:05.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6257e-05 2024-09-13T05:11:05.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:05.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125347+0000", 2024-09-13T05:11:05.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1321000000000003e-05 2024-09-13T05:11:05.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:05.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125403+0000", 2024-09-13T05:11:05.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6362e-05 2024-09-13T05:11:05.431 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.431 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:05.431 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.432 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:7961 3.18 3:184d9aea:::rbd_data.112db57f3a18.000000000000002b:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-13T05:11:05.432 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:11:05.432 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.344105362999997, 2024-09-13T05:11:05.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.040271084999999998, 2024-09-13T05:11:05.432 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:05.432 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:05.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:05.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:05.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:05.432 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7961 2024-09-13T05:11:05.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:11:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:11:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077003+0000", 2024-09-13T05:11:05.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:05.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:05.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077013+0000", 2024-09-13T05:11:05.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6870000000000006e-06 2024-09-13T05:11:05.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:05.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077029+0000", 2024-09-13T05:11:05.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6314e-05 2024-09-13T05:11:05.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:05.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077038+0000", 2024-09-13T05:11:05.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5019999999999992e-06 2024-09-13T05:11:05.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:05.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077099+0000", 2024-09-13T05:11:05.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1444000000000003e-05 2024-09-13T05:11:05.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:05.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077234+0000", 2024-09-13T05:11:05.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013461300000000001 2024-09-13T05:11:05.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-13T05:11:05.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.085202+0000", 2024-09-13T05:11:05.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079680140000000007 2024-09-13T05:11:05.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:05.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116860+0000", 2024-09-13T05:11:05.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.031658190000000003 2024-09-13T05:11:05.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:05.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116995+0000", 2024-09-13T05:11:05.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000135601 2024-09-13T05:11:05.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:05.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117152+0000", 2024-09-13T05:11:05.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015681700000000001 2024-09-13T05:11:05.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:05.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117276+0000", 2024-09-13T05:11:05.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012392699999999999 2024-09-13T05:11:05.437 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.437 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:05.437 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.438 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:8105 3.b 3:d2ae8f7b:::rbd_data.112db57f3a18.0000000000000028:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-13T05:11:05.438 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:11:05.438 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.109009557, 2024-09-13T05:11:05.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.040653913, 2024-09-13T05:11:05.438 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:05.438 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:05.440 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:05.440 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:05.440 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:05.440 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 8105 2024-09-13T05:11:05.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.440 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:05.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:05.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:11:05.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:11:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312099+0000", 2024-09-13T05:11:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312109+0000", 2024-09-13T05:11:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0244999999999999e-05 2024-09-13T05:11:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:05.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312129+0000", 2024-09-13T05:11:05.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9751000000000001e-05 2024-09-13T05:11:05.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:05.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312141+0000", 2024-09-13T05:11:05.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2201999999999999e-05 2024-09-13T05:11:05.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:05.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312230+0000", 2024-09-13T05:11:05.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9092999999999996e-05 2024-09-13T05:11:05.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:05.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312433+0000", 2024-09-13T05:11:05.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020240500000000001 2024-09-13T05:11:05.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-13T05:11:05.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.320357+0000", 2024-09-13T05:11:05.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079242630000000008 2024-09-13T05:11:05.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:05.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352488+0000", 2024-09-13T05:11:05.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032131588000000003 2024-09-13T05:11:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352533+0000", 2024-09-13T05:11:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4601999999999997e-05 2024-09-13T05:11:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352636+0000", 2024-09-13T05:11:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103041 2024-09-13T05:11:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352755+0000", 2024-09-13T05:11:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118814 2024-09-13T05:11:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:39305 3.1e 3:79249bf8:::rbd_data.112dcff96bbd.0000000000000003:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-13T05:11:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:41.473278+0000", 2024-09-13T05:11:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.947832961, 2024-09-13T05:11:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027037510000000001, 2024-09-13T05:11:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 39305 2024-09-13T05:11:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473278+0000", 2024-09-13T05:11:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473278+0000", 2024-09-13T05:11:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473276+0000", 2024-09-13T05:11:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473285+0000", 2024-09-13T05:11:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0129999999999999e-06 2024-09-13T05:11:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473304+0000", 2024-09-13T05:11:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8723e-05 2024-09-13T05:11:05.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:05.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473313+0000", 2024-09-13T05:11:05.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1419999999999999e-06 2024-09-13T05:11:05.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:05.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473390+0000", 2024-09-13T05:11:05.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7001000000000004e-05 2024-09-13T05:11:05.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:05.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473496+0000", 2024-09-13T05:11:05.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010577399999999999 2024-09-13T05:11:05.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:11:05.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.478499+0000", 2024-09-13T05:11:05.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050029260000000004 2024-09-13T05:11:05.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:05.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500153+0000", 2024-09-13T05:11:05.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021654421 2024-09-13T05:11:05.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:05.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500216+0000", 2024-09-13T05:11:05.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3233999999999998e-05 2024-09-13T05:11:05.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:05.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500273+0000", 2024-09-13T05:11:05.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6484000000000003e-05 2024-09-13T05:11:05.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:05.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500315+0000", 2024-09-13T05:11:05.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2342000000000002e-05 2024-09-13T05:11:05.450 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.450 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:05.451 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.451 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:40934 3.1 3:86cdeb48:::rbd_data.112d4ab2162d.0000000000000103:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-13T05:11:05.451 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:46.247357+0000", 2024-09-13T05:11:05.451 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.173753723000001, 2024-09-13T05:11:05.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028923379999999999, 2024-09-13T05:11:05.451 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:05.451 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:05.451 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:05.451 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:05.451 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:05.451 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 40934 2024-09-13T05:11:05.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.452 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:05.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:05.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247357+0000", 2024-09-13T05:11:05.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:05.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247357+0000", 2024-09-13T05:11:05.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:05.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247354+0000", 2024-09-13T05:11:05.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:11:05.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:05.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247371+0000", 2024-09-13T05:11:05.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6697e-05 2024-09-13T05:11:05.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:05.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247403+0000", 2024-09-13T05:11:05.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1649000000000001e-05 2024-09-13T05:11:05.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:05.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247417+0000", 2024-09-13T05:11:05.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.395e-05 2024-09-13T05:11:05.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:05.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247498+0000", 2024-09-13T05:11:05.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1011000000000001e-05 2024-09-13T05:11:05.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:05.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247757+0000", 2024-09-13T05:11:05.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000258872 2024-09-13T05:11:05.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:11:05.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.254874+0000", 2024-09-13T05:11:05.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071176449999999997 2024-09-13T05:11:05.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:05.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.275876+0000", 2024-09-13T05:11:05.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021001770999999999 2024-09-13T05:11:05.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:05.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.275989+0000", 2024-09-13T05:11:05.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011301199999999999 2024-09-13T05:11:05.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:05.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.276156+0000", 2024-09-13T05:11:05.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000167453 2024-09-13T05:11:05.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:05.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.276280+0000", 2024-09-13T05:11:05.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012369400000000001 2024-09-13T05:11:05.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.456 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:05.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.457 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:45910 3.a 3:56753852:::rbd_header.112d678e2955:head [call,call rbd.parent_overlap_get in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e58)", 2024-09-13T05:11:05.457 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:50.370028+0000", 2024-09-13T05:11:05.457 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.051082975, 2024-09-13T05:11:05.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048450024000000001, 2024-09-13T05:11:05.457 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:05.457 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:05.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:05.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:05.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:05.457 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45910 2024-09-13T05:11:05.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.457 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:05.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:05.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370028+0000", 2024-09-13T05:11:05.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:05.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370028+0000", 2024-09-13T05:11:05.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:05.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370027+0000", 2024-09-13T05:11:05.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:05.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:05.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370031+0000", 2024-09-13T05:11:05.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6530000000000002e-06 2024-09-13T05:11:05.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:05.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370038+0000", 2024-09-13T05:11:05.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8959999999999997e-06 2024-09-13T05:11:05.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:05.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370043+0000", 2024-09-13T05:11:05.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3680000000000004e-06 2024-09-13T05:11:05.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:05.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370076+0000", 2024-09-13T05:11:05.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3411000000000002e-05 2024-09-13T05:11:05.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:05.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370125+0000", 2024-09-13T05:11:05.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8593e-05 2024-09-13T05:11:05.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:05.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.418478+0000", 2024-09-13T05:11:05.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048352978999999997 2024-09-13T05:11:05.460 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.461 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:05.461 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.461 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:53089 3.19 3:99c9c083:::rbd_data.112d7b5dd21c.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-13T05:11:05.461 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:00.676318+0000", 2024-09-13T05:11:05.461 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7447922550000001, 2024-09-13T05:11:05.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015605427, 2024-09-13T05:11:05.461 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:05.461 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:05.461 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:05.461 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:05.461 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:05.461 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 53089 2024-09-13T05:11:05.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.462 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:05.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:05.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.676318+0000", 2024-09-13T05:11:05.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:05.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.676318+0000", 2024-09-13T05:11:05.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:05.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.676316+0000", 2024-09-13T05:11:05.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:05.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:05.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.676841+0000", 2024-09-13T05:11:05.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00052474100000000001 2024-09-13T05:11:05.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:05.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.676865+0000", 2024-09-13T05:11:05.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4017999999999999e-05 2024-09-13T05:11:05.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:05.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.676876+0000", 2024-09-13T05:11:05.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-09-13T05:11:05.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:05.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.676941+0000", 2024-09-13T05:11:05.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4500999999999998e-05 2024-09-13T05:11:05.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:05.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.677287+0000", 2024-09-13T05:11:05.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00034602199999999997 2024-09-13T05:11:05.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:11:05.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.679699+0000", 2024-09-13T05:11:05.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002411711 2024-09-13T05:11:05.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:05.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.691637+0000", 2024-09-13T05:11:05.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011938822999999999 2024-09-13T05:11:05.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:05.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.691664+0000", 2024-09-13T05:11:05.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.671e-05 2024-09-13T05:11:05.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:05.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.691804+0000", 2024-09-13T05:11:05.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014044700000000001 2024-09-13T05:11:05.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:05.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:00.691924+0000", 2024-09-13T05:11:05.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011916700000000001 2024-09-13T05:11:05.467 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.467 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:05.467 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.467 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:54378 3.19 3:99c9c083:::rbd_data.112d7b5dd21c.0000000000000001:17 [sparse-read 1966080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-13T05:11:05.467 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:01.845901+0000", 2024-09-13T05:11:05.467 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.5752090709999997, 2024-09-13T05:11:05.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01443029, 2024-09-13T05:11:05.467 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:05.467 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:05.467 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:05.467 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:05.468 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:05.468 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 54378 2024-09-13T05:11:05.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.468 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:05.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:05.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845901+0000", 2024-09-13T05:11:05.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:05.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845901+0000", 2024-09-13T05:11:05.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:05.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845901+0000", 2024-09-13T05:11:05.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:05.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:05.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845904+0000", 2024-09-13T05:11:05.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8949999999999998e-06 2024-09-13T05:11:05.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:05.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845910+0000", 2024-09-13T05:11:05.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3709999999999996e-06 2024-09-13T05:11:05.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:05.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845915+0000", 2024-09-13T05:11:05.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2410000000000003e-06 2024-09-13T05:11:05.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:05.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.860095+0000", 2024-09-13T05:11:05.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014179173 2024-09-13T05:11:05.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:05.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.860185+0000", 2024-09-13T05:11:05.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0093999999999995e-05 2024-09-13T05:11:05.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:05.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.860332+0000", 2024-09-13T05:11:05.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014703200000000001 2024-09-13T05:11:05.471 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.471 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:05.471 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.471 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:54379 3.19 3:99c9c083:::rbd_data.112d7b5dd21c.0000000000000001:17 [sparse-read 2752512~16022] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-13T05:11:05.471 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:01.845920+0000", 2024-09-13T05:11:05.471 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.57519016, 2024-09-13T05:11:05.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015034728000000001, 2024-09-13T05:11:05.472 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:05.472 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:05.472 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:05.472 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:05.472 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:05.472 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 54379 2024-09-13T05:11:05.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.472 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:05.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:05.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845920+0000", 2024-09-13T05:11:05.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:05.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845920+0000", 2024-09-13T05:11:05.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:05.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845920+0000", 2024-09-13T05:11:05.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:05.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:05.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845927+0000", 2024-09-13T05:11:05.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3350000000000001e-06 2024-09-13T05:11:05.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:05.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845933+0000", 2024-09-13T05:11:05.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0650000000000004e-06 2024-09-13T05:11:05.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:05.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845937+0000", 2024-09-13T05:11:05.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1670000000000001e-06 2024-09-13T05:11:05.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:05.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.860351+0000", 2024-09-13T05:11:05.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014414018000000001 2024-09-13T05:11:05.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:05.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.860417+0000", 2024-09-13T05:11:05.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5603000000000002e-05 2024-09-13T05:11:05.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:05.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.860955+0000", 2024-09-13T05:11:05.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00053799000000000002 2024-09-13T05:11:05.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.476 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:05.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.476 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:54380 3.19 3:99c9c083:::rbd_data.112d7b5dd21c.0000000000000001:17 [sparse-read 3538944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-13T05:11:05.476 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:01.845941+0000", 2024-09-13T05:11:05.477 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.5751692180000001, 2024-09-13T05:11:05.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015248737, 2024-09-13T05:11:05.477 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:05.477 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:05.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:05.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:05.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:05.477 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 54380 2024-09-13T05:11:05.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.477 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:05.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:05.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845941+0000", 2024-09-13T05:11:05.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:05.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845941+0000", 2024-09-13T05:11:05.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:05.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845941+0000", 2024-09-13T05:11:05.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:05.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:05.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845943+0000", 2024-09-13T05:11:05.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9829999999999999e-06 2024-09-13T05:11:05.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:05.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845948+0000", 2024-09-13T05:11:05.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7539999999999997e-06 2024-09-13T05:11:05.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:05.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845955+0000", 2024-09-13T05:11:05.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1439999999999997e-06 2024-09-13T05:11:05.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:05.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.861005+0000", 2024-09-13T05:11:05.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015050111999999999 2024-09-13T05:11:05.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:05.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.861102+0000", 2024-09-13T05:11:05.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7493999999999999e-05 2024-09-13T05:11:05.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:05.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.861190+0000", 2024-09-13T05:11:05.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7571000000000006e-05 2024-09-13T05:11:05.480 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.480 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:05.480 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.481 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:54381 3.19 3:99c9c083:::rbd_data.112d7b5dd21c.0000000000000001:17 [sparse-read 4325376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-13T05:11:05.481 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:01.845958+0000", 2024-09-13T05:11:05.481 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.5751521159999999, 2024-09-13T05:11:05.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015366677, 2024-09-13T05:11:05.481 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:05.481 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:05.481 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:05.481 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:05.481 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:05.481 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 54381 2024-09-13T05:11:05.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.481 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:05.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:05.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845958+0000", 2024-09-13T05:11:05.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:05.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845958+0000", 2024-09-13T05:11:05.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:05.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845958+0000", 2024-09-13T05:11:05.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:05.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:05.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845960+0000", 2024-09-13T05:11:05.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1040000000000001e-06 2024-09-13T05:11:05.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:05.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845965+0000", 2024-09-13T05:11:05.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9350000000000002e-06 2024-09-13T05:11:05.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:05.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845971+0000", 2024-09-13T05:11:05.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1399999999999997e-06 2024-09-13T05:11:05.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:05.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.861213+0000", 2024-09-13T05:11:05.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015241762000000001 2024-09-13T05:11:05.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:05.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.861260+0000", 2024-09-13T05:11:05.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6748e-05 2024-09-13T05:11:05.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:05.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.861325+0000", 2024-09-13T05:11:05.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5276000000000003e-05 2024-09-13T05:11:05.485 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.485 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:05.485 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.485 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:54382 3.19 3:99c9c083:::rbd_data.112d7b5dd21c.0000000000000001:17 [sparse-read 7077888~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-13T05:11:05.485 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:01.845975+0000", 2024-09-13T05:11:05.485 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.5751357009999998, 2024-09-13T05:11:05.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015621794, 2024-09-13T05:11:05.485 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:05.485 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:05.485 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:05.486 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:05.486 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:05.486 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 54382 2024-09-13T05:11:05.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.486 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:05.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:05.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845975+0000", 2024-09-13T05:11:05.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:05.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845975+0000", 2024-09-13T05:11:05.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:05.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845974+0000", 2024-09-13T05:11:05.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:05.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:05.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845977+0000", 2024-09-13T05:11:05.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0499999999999999e-06 2024-09-13T05:11:05.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:05.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845985+0000", 2024-09-13T05:11:05.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3059999999999998e-06 2024-09-13T05:11:05.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:05.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845995+0000", 2024-09-13T05:11:05.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8730000000000002e-06 2024-09-13T05:11:05.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:05.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.861408+0000", 2024-09-13T05:11:05.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015413392 2024-09-13T05:11:05.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:05.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.861499+0000", 2024-09-13T05:11:05.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1014999999999995e-05 2024-09-13T05:11:05.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:05.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.861597+0000", 2024-09-13T05:11:05.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7460000000000005e-05 2024-09-13T05:11:05.489 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.489 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:05.489 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.489 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:54383 3.19 3:99c9c083:::rbd_data.112d7b5dd21c.0000000000000001:17 [sparse-read 7864320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-13T05:11:05.489 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:01.845999+0000", 2024-09-13T05:11:05.490 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.5751111440000001, 2024-09-13T05:11:05.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015843672, 2024-09-13T05:11:05.490 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:05.490 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:05.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:05.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:05.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:05.490 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 54383 2024-09-13T05:11:05.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.490 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:05.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:05.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845999+0000", 2024-09-13T05:11:05.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:05.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845999+0000", 2024-09-13T05:11:05.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:05.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.845999+0000", 2024-09-13T05:11:05.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:05.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:05.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846002+0000", 2024-09-13T05:11:05.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6809999999999998e-06 2024-09-13T05:11:05.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:05.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846007+0000", 2024-09-13T05:11:05.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7370000000000003e-06 2024-09-13T05:11:05.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:05.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846012+0000", 2024-09-13T05:11:05.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1019999999999996e-06 2024-09-13T05:11:05.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:05.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.861636+0000", 2024-09-13T05:11:05.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015623257 2024-09-13T05:11:05.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:05.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.861725+0000", 2024-09-13T05:11:05.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9146000000000003e-05 2024-09-13T05:11:05.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:05.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.861843+0000", 2024-09-13T05:11:05.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118121 2024-09-13T05:11:05.494 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.494 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:05.494 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.494 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:54384 3.19 3:99c9c083:::rbd_data.112d7b5dd21c.0000000000000001:17 [sparse-read 8650752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-13T05:11:05.494 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:01.846017+0000", 2024-09-13T05:11:05.494 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.5750930969999999, 2024-09-13T05:11:05.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016059838999999999, 2024-09-13T05:11:05.494 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:05.494 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:05.495 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:05.495 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:05.495 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:05.495 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 54384 2024-09-13T05:11:05.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.495 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:05.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:05.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846017+0000", 2024-09-13T05:11:05.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:05.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846017+0000", 2024-09-13T05:11:05.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:05.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846017+0000", 2024-09-13T05:11:05.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:05.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:05.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846020+0000", 2024-09-13T05:11:05.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4569999999999999e-06 2024-09-13T05:11:05.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:05.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846025+0000", 2024-09-13T05:11:05.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8470000000000001e-06 2024-09-13T05:11:05.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:05.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846037+0000", 2024-09-13T05:11:05.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1904e-05 2024-09-13T05:11:05.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:05.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.861879+0000", 2024-09-13T05:11:05.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015841812 2024-09-13T05:11:05.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:05.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.861956+0000", 2024-09-13T05:11:05.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6600000000000005e-05 2024-09-13T05:11:05.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:05.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.862077+0000", 2024-09-13T05:11:05.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121531 2024-09-13T05:11:05.498 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.498 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:05.498 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.498 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:54385 3.19 3:99c9c083:::rbd_data.112d7b5dd21c.0000000000000001:17 [sparse-read 9437184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-13T05:11:05.499 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:01.846046+0000", 2024-09-13T05:11:05.499 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.575064851, 2024-09-13T05:11:05.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016260261000000002, 2024-09-13T05:11:05.499 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:05.499 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:05.499 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:05.499 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:05.499 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:05.499 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 54385 2024-09-13T05:11:05.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.499 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:05.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:05.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846046+0000", 2024-09-13T05:11:05.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:05.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846046+0000", 2024-09-13T05:11:05.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:05.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846045+0000", 2024-09-13T05:11:05.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:05.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:05.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846048+0000", 2024-09-13T05:11:05.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9229999999999998e-06 2024-09-13T05:11:05.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:05.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846054+0000", 2024-09-13T05:11:05.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9290000000000003e-06 2024-09-13T05:11:05.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:05.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846059+0000", 2024-09-13T05:11:05.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6700000000000002e-06 2024-09-13T05:11:05.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:05.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.862120+0000", 2024-09-13T05:11:05.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016060905 2024-09-13T05:11:05.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:05.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.862203+0000", 2024-09-13T05:11:05.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3564000000000002e-05 2024-09-13T05:11:05.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:05.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.862306+0000", 2024-09-13T05:11:05.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102707 2024-09-13T05:11:05.502 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.503 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:05.503 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.503 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:54386 3.19 3:99c9c083:::rbd_data.112d7b5dd21c.0000000000000001:17 [sparse-read 11403264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-13T05:11:05.503 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:01.846063+0000", 2024-09-13T05:11:05.503 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.5750473080000003, 2024-09-13T05:11:05.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016380753000000001, 2024-09-13T05:11:05.503 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:05.503 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:05.503 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:05.503 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:05.503 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:05.503 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 54386 2024-09-13T05:11:05.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.504 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:05.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:05.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846063+0000", 2024-09-13T05:11:05.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:05.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846063+0000", 2024-09-13T05:11:05.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:05.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846063+0000", 2024-09-13T05:11:05.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:05.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:05.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846065+0000", 2024-09-13T05:11:05.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5840000000000002e-06 2024-09-13T05:11:05.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:05.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846071+0000", 2024-09-13T05:11:05.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6799999999999998e-06 2024-09-13T05:11:05.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:05.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846075+0000", 2024-09-13T05:11:05.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9650000000000002e-06 2024-09-13T05:11:05.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:05.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.862322+0000", 2024-09-13T05:11:05.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016247237000000001 2024-09-13T05:11:05.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:05.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.862365+0000", 2024-09-13T05:11:05.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2880000000000003e-05 2024-09-13T05:11:05.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:05.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.862444+0000", 2024-09-13T05:11:05.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8787000000000003e-05 2024-09-13T05:11:05.507 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.507 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:05.507 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.507 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:54387 3.19 3:99c9c083:::rbd_data.112d7b5dd21c.0000000000000001:17 [sparse-read 12189696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-13T05:11:05.507 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:01.846079+0000", 2024-09-13T05:11:05.507 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.5750310789999999, 2024-09-13T05:11:05.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016599566999999999, 2024-09-13T05:11:05.507 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:05.507 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:05.508 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:05.508 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:05.508 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:05.508 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 54387 2024-09-13T05:11:05.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.508 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:05.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:05.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846079+0000", 2024-09-13T05:11:05.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:05.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846079+0000", 2024-09-13T05:11:05.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:05.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846079+0000", 2024-09-13T05:11:05.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:05.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:05.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846081+0000", 2024-09-13T05:11:05.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3429999999999998e-06 2024-09-13T05:11:05.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:05.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846087+0000", 2024-09-13T05:11:05.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3630000000000002e-06 2024-09-13T05:11:05.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:05.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846091+0000", 2024-09-13T05:11:05.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0300000000000004e-06 2024-09-13T05:11:05.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:05.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.862482+0000", 2024-09-13T05:11:05.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016391084 2024-09-13T05:11:05.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:05.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.862570+0000", 2024-09-13T05:11:05.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7729e-05 2024-09-13T05:11:05.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:05.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.862679+0000", 2024-09-13T05:11:05.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109372 2024-09-13T05:11:05.511 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.511 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:05.511 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.511 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:54388 3.19 3:99c9c083:::rbd_data.112d7b5dd21c.0000000000000001:17 [sparse-read 12976128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-13T05:11:05.511 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:01.846103+0000", 2024-09-13T05:11:05.512 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.575007598, 2024-09-13T05:11:05.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016717823999999999, 2024-09-13T05:11:05.512 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:05.512 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:05.512 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:05.512 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:05.512 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:05.512 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 54388 2024-09-13T05:11:05.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.512 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:05.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:05.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846103+0000", 2024-09-13T05:11:05.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:05.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846103+0000", 2024-09-13T05:11:05.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:05.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846103+0000", 2024-09-13T05:11:05.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:05.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:05.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846112+0000", 2024-09-13T05:11:05.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5419999999999994e-06 2024-09-13T05:11:05.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:05.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846118+0000", 2024-09-13T05:11:05.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0249999999999999e-06 2024-09-13T05:11:05.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:05.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846126+0000", 2024-09-13T05:11:05.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5170000000000002e-06 2024-09-13T05:11:05.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:05.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.862692+0000", 2024-09-13T05:11:05.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016566019000000001 2024-09-13T05:11:05.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:05.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.862750+0000", 2024-09-13T05:11:05.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8415999999999998e-05 2024-09-13T05:11:05.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:05.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.862821+0000", 2024-09-13T05:11:05.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0679000000000005e-05 2024-09-13T05:11:05.515 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.515 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:05.516 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.516 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:56276 3.1 3:8275684a:::rbd_data.112d667fb7f9.000000000000008f:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-13T05:11:05.516 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:04.698605+0000", 2024-09-13T05:11:05.516 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.72250525899999996, 2024-09-13T05:11:05.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024657968999999998, 2024-09-13T05:11:05.516 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:05.516 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:05.516 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:05.516 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:05.516 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:05.516 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 56276 2024-09-13T05:11:05.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.517 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:05.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:05.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698605+0000", 2024-09-13T05:11:05.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:05.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698605+0000", 2024-09-13T05:11:05.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:05.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698602+0000", 2024-09-13T05:11:05.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999971 2024-09-13T05:11:05.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:05.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698621+0000", 2024-09-13T05:11:05.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8783e-05 2024-09-13T05:11:05.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:05.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698667+0000", 2024-09-13T05:11:05.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5509000000000001e-05 2024-09-13T05:11:05.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:05.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698684+0000", 2024-09-13T05:11:05.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7799999999999999e-05 2024-09-13T05:11:05.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:05.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698782+0000", 2024-09-13T05:11:05.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7534000000000005e-05 2024-09-13T05:11:05.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:05.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698905+0000", 2024-09-13T05:11:05.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012293699999999999 2024-09-13T05:11:05.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:11:05.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.707711+0000", 2024-09-13T05:11:05.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088062939999999992 2024-09-13T05:11:05.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:05.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.723142+0000", 2024-09-13T05:11:05.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015430413 2024-09-13T05:11:05.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:05.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.723156+0000", 2024-09-13T05:11:05.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4868999999999999e-05 2024-09-13T05:11:05.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:05.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.723214+0000", 2024-09-13T05:11:05.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7522000000000003e-05 2024-09-13T05:11:05.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:05.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.723263+0000", 2024-09-13T05:11:05.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9261999999999997e-05 2024-09-13T05:11:05.521 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.521 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:05.521 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.521 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:56368 3.1e 3:7d682469:::rbd_data.112d667fb7f9.0000000000000065:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-13T05:11:05.522 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:04.786960+0000", 2024-09-13T05:11:05.522 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.63415073200000005, 2024-09-13T05:11:05.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027546363000000001, 2024-09-13T05:11:05.522 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:05.522 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:05.522 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:05.522 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:05.522 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:05.522 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 56368 2024-09-13T05:11:05.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.522 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:05.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:05.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786960+0000", 2024-09-13T05:11:05.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:05.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786960+0000", 2024-09-13T05:11:05.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:05.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:05.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786959+0000", 2024-09-13T05:11:05.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:05.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:05.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786967+0000", 2024-09-13T05:11:05.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6249999999999996e-06 2024-09-13T05:11:05.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:05.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786979+0000", 2024-09-13T05:11:05.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1982e-05 2024-09-13T05:11:05.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:05.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786986+0000", 2024-09-13T05:11:05.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.126e-06 2024-09-13T05:11:05.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:05.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.787039+0000", 2024-09-13T05:11:05.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2431e-05 2024-09-13T05:11:05.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:05.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.787180+0000", 2024-09-13T05:11:05.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014091 2024-09-13T05:11:05.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:11:05.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.793251+0000", 2024-09-13T05:11:05.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060717419999999998 2024-09-13T05:11:05.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:05.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.814381+0000", 2024-09-13T05:11:05.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021129267 2024-09-13T05:11:05.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:05.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.814430+0000", 2024-09-13T05:11:05.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8952000000000002e-05 2024-09-13T05:11:05.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:05.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.814476+0000", 2024-09-13T05:11:05.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6223000000000001e-05 2024-09-13T05:11:05.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:05.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:05.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:05.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.814506+0000", 2024-09-13T05:11:05.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0287999999999999e-05 2024-09-13T05:11:05.527 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.527 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:05.527 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.527 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:05.527 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:05.527 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:05.528 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #20, image image_client.0-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent21 2024-09-13T05:11:05.529 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:11:05.531 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:11:05.532 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:11:05.532 INFO:teuthology.orchestra.run.smithi120.stdout:2599 trunc from 0x72d09f0 to 0xc46852b 2024-09-13T05:11:05.533 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2024-09-13T05:11:05.066234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":829392219,"num_objects":1581,"num_object_clones":144,"num_object_copies":3162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1581,"num_whiteouts":775,"num_read":66889,"num_read_kb":310312,"num_write":8303,"num_write_kb":212026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":680,"num_bytes_recovered":20794777,"num_keys_recovered":113,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7477,"ondisk_log_size":7477,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":411048,"kb_used_data":216772,"kb_used_omap":7,"kb_used_meta":194040,"kb_avail":471448152,"statfs":{"total":483183820800,"available":482762907648,"internally_reserved":0,"allocated":221974528,"data_stored":243805965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7962,"internal_metadata":198697190},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":280161829,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":4464,"num_read_kb":19898,"num_write":806,"num_write_kb":11970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.026813"},"pg_stats":[{"pgid":"3.1f","version":"67'189","reported_seq":694,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.094636+0000","last_change":"2024-09-13T05:10:37.993400+0000","last_active":"2024-09-13T05:11:01.094636+0000","last_peered":"2024-09-13T05:11:01.094636+0000","last_clean":"2024-09-13T05:11:01.094636+0000","last_became_active":"2024-09-13T05:10:37.864778+0000","last_became_peered":"2024-09-13T05:10:37.864778+0000","last_unstale":"2024-09-13T05:11:01.094636+0000","last_undegraded":"2024-09-13T05:11:01.094636+0000","last_fullsized":"2024-09-13T05:11:01.094636+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:56:24.801492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011835439999999999,"stat_sum":{"num_bytes":4389000,"num_objects":49,"num_object_clones":4,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":17,"num_read":895,"num_read_kb":2340,"num_write":165,"num_write_kb":1525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":297202,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"64'139","reported_seq":794,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.421406+0000","last_change":"2024-09-13T05:10:12.076857+0000","last_active":"2024-09-13T05:11:00.421406+0000","last_peered":"2024-09-13T05:11:00.421406+0000","last_clean":"2024-09-13T05:11:00.421406+0000","last_became_active":"2024-09-13T05:10:09.644293+0000","last_became_peered":"2024-09-13T05:10:09.644293+0000","last_unstale":"2024-09-13T05:11:00.421406+0000","last_undegraded":"2024-09-13T05:11:00.421406+0000","last_fullsized":"2024-09-13T05:11:00.421406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:45:32.561793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225439,"stat_sum":{"num_bytes":26028163,"num_objects":46,"num_object_clones":5,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":24,"num_read":1129,"num_read_kb":4025,"num_write":116,"num_write_kb":2180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"67'147","reported_seq":1245,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.908410+0000","last_change":"2024-09-13T05:10:11.645342+0000","last_active":"2024-09-13T05:11:01.908410+0000","last_peered":"2024-09-13T05:11:01.908410+0000","last_clean":"2024-09-13T05:11:01.908410+0000","last_became_active":"2024-09-13T05:10:09.645791+0000","last_became_peered":"2024-09-13T05:10:09.645791+0000","last_unstale":"2024-09-13T05:11:01.908410+0000","last_undegraded":"2024-09-13T05:11:01.908410+0000","last_fullsized":"2024-09-13T05:11:01.908410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:49.028553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072691800000000001,"stat_sum":{"num_bytes":40837266,"num_objects":59,"num_object_clones":8,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":24,"num_read":1117,"num_read_kb":7760,"num_write":113,"num_write_kb":3356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"67'449","reported_seq":1251,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.925981+0000","last_change":"2024-09-13T05:10:31.949427+0000","last_active":"2024-09-13T05:11:01.925981+0000","last_peered":"2024-09-13T05:11:01.925981+0000","last_clean":"2024-09-13T05:11:01.925981+0000","last_became_active":"2024-09-13T05:10:31.828206+0000","last_became_peered":"2024-09-13T05:10:31.828206+0000","last_unstale":"2024-09-13T05:11:01.925981+0000","last_undegraded":"2024-09-13T05:11:01.925981+0000","last_fullsized":"2024-09-13T05:11:01.925981+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:32:46.868249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078437299999999999,"stat_sum":{"num_bytes":30867520,"num_objects":41,"num_object_clones":3,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":15,"num_read":2915,"num_read_kb":4566,"num_write":623,"num_write_kb":7388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":372837,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"67'234","reported_seq":723,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.751378+0000","last_change":"2024-09-13T05:10:37.990899+0000","last_active":"2024-09-13T05:11:01.751378+0000","last_peered":"2024-09-13T05:11:01.751378+0000","last_clean":"2024-09-13T05:11:01.751378+0000","last_became_active":"2024-09-13T05:10:37.867842+0000","last_became_peered":"2024-09-13T05:10:37.867842+0000","last_unstale":"2024-09-13T05:11:01.751378+0000","last_undegraded":"2024-09-13T05:11:01.751378+0000","last_fullsized":"2024-09-13T05:11:01.751378+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:38:24.437617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065808499999999999,"stat_sum":{"num_bytes":4440526,"num_objects":48,"num_object_clones":3,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":25,"num_read":1266,"num_read_kb":3185,"num_write":242,"num_write_kb":1373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":612052,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"65'194","reported_seq":2466,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.889114+0000","last_change":"2024-09-13T05:10:37.948112+0000","last_active":"2024-09-13T05:11:01.889114+0000","last_peered":"2024-09-13T05:11:01.889114+0000","last_clean":"2024-09-13T05:11:01.889114+0000","last_became_active":"2024-09-13T05:10:37.863614+0000","last_became_peered":"2024-09-13T05:10:37.863614+0000","last_unstale":"2024-09-13T05:11:01.889114+0000","last_undegraded":"2024-09-13T05:11:01.889114+0000","last_fullsized":"2024-09-13T05:11:01.889114+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:15.873724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027226559999999999,"stat_sum":{"num_bytes":9899581,"num_objects":53,"num_object_clones":4,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":21,"num_read":2681,"num_read_kb":5294,"num_write":152,"num_write_kb":1883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":77,"num_bytes_recovered":1081937,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"66'484","reported_seq":2208,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.862641+0000","last_change":"2024-09-13T05:10:34.613940+0000","last_active":"2024-09-13T05:11:01.862641+0000","last_peered":"2024-09-13T05:11:01.862641+0000","last_clean":"2024-09-13T05:11:01.862641+0000","last_became_active":"2024-09-13T05:10:34.612579+0000","last_became_peered":"2024-09-13T05:10:34.612579+0000","last_unstale":"2024-09-13T05:11:01.862641+0000","last_undegraded":"2024-09-13T05:11:01.862641+0000","last_fullsized":"2024-09-13T05:11:01.862641+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:43.339882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067403999999999999,"stat_sum":{"num_bytes":48373122,"num_objects":50,"num_object_clones":7,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":22,"num_read":4088,"num_read_kb":12096,"num_write":671,"num_write_kb":2811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":248973,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"67'198","reported_seq":1138,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.886076+0000","last_change":"2024-09-13T05:10:37.929523+0000","last_active":"2024-09-13T05:11:01.886076+0000","last_peered":"2024-09-13T05:11:01.886076+0000","last_clean":"2024-09-13T05:11:01.886076+0000","last_became_active":"2024-09-13T05:10:37.865440+0000","last_became_peered":"2024-09-13T05:10:37.865440+0000","last_unstale":"2024-09-13T05:11:01.886076+0000","last_undegraded":"2024-09-13T05:11:01.886076+0000","last_fullsized":"2024-09-13T05:11:01.886076+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:30:31.875141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087399999999998,"stat_sum":{"num_bytes":18139977,"num_objects":52,"num_object_clones":4,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":31,"num_read":1081,"num_read_kb":11591,"num_write":199,"num_write_kb":5147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":1513234,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"67'143","reported_seq":825,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.846696+0000","last_change":"2024-09-13T05:10:37.920810+0000","last_active":"2024-09-13T05:11:01.846696+0000","last_peered":"2024-09-13T05:11:01.846696+0000","last_clean":"2024-09-13T05:11:01.846696+0000","last_became_active":"2024-09-13T05:10:37.864816+0000","last_became_peered":"2024-09-13T05:10:37.864816+0000","last_unstale":"2024-09-13T05:11:01.846696+0000","last_undegraded":"2024-09-13T05:11:01.846696+0000","last_fullsized":"2024-09-13T05:11:01.846696+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:06.315864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096598599999999995,"stat_sum":{"num_bytes":16928716,"num_objects":35,"num_object_clones":1,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":15,"num_read":1773,"num_read_kb":2041,"num_write":113,"num_write_kb":1049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":37802,"num_keys_recovered":23,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"64'188","reported_seq":1366,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.033805+0000","last_change":"2024-09-13T05:10:11.645211+0000","last_active":"2024-09-13T05:11:00.033805+0000","last_peered":"2024-09-13T05:11:00.033805+0000","last_clean":"2024-09-13T05:11:00.033805+0000","last_became_active":"2024-09-13T05:10:09.647763+0000","last_became_peered":"2024-09-13T05:10:09.647763+0000","last_unstale":"2024-09-13T05:11:00.033805+0000","last_undegraded":"2024-09-13T05:11:00.033805+0000","last_fullsized":"2024-09-13T05:11:00.033805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:43.426871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072236499999999999,"stat_sum":{"num_bytes":31859829,"num_objects":48,"num_object_clones":9,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":24,"num_read":1293,"num_read_kb":9309,"num_write":161,"num_write_kb":2710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"67'124","reported_seq":295,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.881240+0000","last_change":"2024-09-13T05:10:11.681217+0000","last_active":"2024-09-13T05:11:01.881240+0000","last_peered":"2024-09-13T05:11:01.881240+0000","last_clean":"2024-09-13T05:11:01.881240+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:11:01.881240+0000","last_undegraded":"2024-09-13T05:11:01.881240+0000","last_fullsized":"2024-09-13T05:11:01.881240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:40.457636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095533399999999996,"stat_sum":{"num_bytes":27119592,"num_objects":41,"num_object_clones":2,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":22,"num_read":287,"num_read_kb":2431,"num_write":119,"num_write_kb":2102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"64'166","reported_seq":3629,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.424104+0000","last_change":"2024-09-13T05:10:11.681365+0000","last_active":"2024-09-13T05:11:00.424104+0000","last_peered":"2024-09-13T05:11:00.424104+0000","last_clean":"2024-09-13T05:11:00.424104+0000","last_became_active":"2024-09-13T05:10:09.645823+0000","last_became_peered":"2024-09-13T05:10:09.645823+0000","last_unstale":"2024-09-13T05:11:00.424104+0000","last_undegraded":"2024-09-13T05:11:00.424104+0000","last_fullsized":"2024-09-13T05:11:00.424104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:24.367358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011047369999999999,"stat_sum":{"num_bytes":38597648,"num_objects":50,"num_object_clones":4,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":26,"num_read":3486,"num_read_kb":24836,"num_write":129,"num_write_kb":3900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.032514+0000","last_change":"2024-09-13T05:10:01.383891+0000","last_active":"2024-09-13T05:11:00.032514+0000","last_peered":"2024-09-13T05:11:00.032514+0000","last_clean":"2024-09-13T05:11:00.032514+0000","last_became_active":"2024-09-13T05:09:59.374793+0000","last_became_peered":"2024-09-13T05:09:59.374793+0000","last_unstale":"2024-09-13T05:11:00.032514+0000","last_undegraded":"2024-09-13T05:11:00.032514+0000","last_fullsized":"2024-09-13T05:11:00.032514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:02.499446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065068999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"65'146","reported_seq":4170,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.054958+0000","last_change":"2024-09-13T05:10:38.046833+0000","last_active":"2024-09-13T05:11:01.054958+0000","last_peered":"2024-09-13T05:11:01.054958+0000","last_clean":"2024-09-13T05:11:01.054958+0000","last_became_active":"2024-09-13T05:10:37.869206+0000","last_became_peered":"2024-09-13T05:10:37.869206+0000","last_unstale":"2024-09-13T05:11:01.054958+0000","last_undegraded":"2024-09-13T05:11:01.054958+0000","last_fullsized":"2024-09-13T05:11:01.054958+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:12.484134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099899699999999995,"stat_sum":{"num_bytes":28690323,"num_objects":43,"num_object_clones":5,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":21,"num_read":3113,"num_read_kb":7626,"num_write":117,"num_write_kb":5992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":5061662,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.032583+0000","last_change":"2024-09-13T05:10:31.826927+0000","last_active":"2024-09-13T05:11:00.032583+0000","last_peered":"2024-09-13T05:11:00.032583+0000","last_clean":"2024-09-13T05:11:00.032583+0000","last_became_active":"2024-09-13T05:10:31.826431+0000","last_became_peered":"2024-09-13T05:10:31.826431+0000","last_unstale":"2024-09-13T05:11:00.032583+0000","last_undegraded":"2024-09-13T05:11:00.032583+0000","last_fullsized":"2024-09-13T05:11:00.032583+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:13:36.678853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"66'179","reported_seq":1215,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.857817+0000","last_change":"2024-09-13T05:10:12.077111+0000","last_active":"2024-09-13T05:11:01.857817+0000","last_peered":"2024-09-13T05:11:01.857817+0000","last_clean":"2024-09-13T05:11:01.857817+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:11:01.857817+0000","last_undegraded":"2024-09-13T05:11:01.857817+0000","last_fullsized":"2024-09-13T05:11:01.857817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:37.976147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001460444,"stat_sum":{"num_bytes":51509824,"num_objects":59,"num_object_clones":5,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":33,"num_read":1164,"num_read_kb":9907,"num_write":155,"num_write_kb":2656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":71,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.040797+0000","last_change":"2024-09-13T05:10:37.866953+0000","last_active":"2024-09-13T05:11:00.040797+0000","last_peered":"2024-09-13T05:11:00.040797+0000","last_clean":"2024-09-13T05:11:00.040797+0000","last_became_active":"2024-09-13T05:10:37.866624+0000","last_became_peered":"2024-09-13T05:10:37.866624+0000","last_unstale":"2024-09-13T05:11:00.040797+0000","last_undegraded":"2024-09-13T05:11:00.040797+0000","last_fullsized":"2024-09-13T05:11:00.040797+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:56:20.077971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"65'127","reported_seq":329,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.059722+0000","last_change":"2024-09-13T05:10:32.017095+0000","last_active":"2024-09-13T05:11:01.059722+0000","last_peered":"2024-09-13T05:11:01.059722+0000","last_clean":"2024-09-13T05:11:01.059722+0000","last_became_active":"2024-09-13T05:10:31.829027+0000","last_became_peered":"2024-09-13T05:10:31.829027+0000","last_unstale":"2024-09-13T05:11:01.059722+0000","last_undegraded":"2024-09-13T05:11:01.059722+0000","last_fullsized":"2024-09-13T05:11:01.059722+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:36:33.938992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076234800000000004,"stat_sum":{"num_bytes":12517204,"num_objects":53,"num_object_clones":3,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":27,"num_read":139,"num_read_kb":1296,"num_write":95,"num_write_kb":1563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":263489,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.041019+0000","last_change":"2024-09-13T05:10:37.864940+0000","last_active":"2024-09-13T05:11:00.041019+0000","last_peered":"2024-09-13T05:11:00.041019+0000","last_clean":"2024-09-13T05:11:00.041019+0000","last_became_active":"2024-09-13T05:10:37.864623+0000","last_became_peered":"2024-09-13T05:10:37.864623+0000","last_unstale":"2024-09-13T05:11:00.041019+0000","last_undegraded":"2024-09-13T05:11:00.041019+0000","last_fullsized":"2024-09-13T05:11:00.041019+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:41.598490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.5","version":"67'220","reported_seq":1690,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.399077+0000","last_change":"2024-09-13T05:10:11.645960+0000","last_active":"2024-09-13T05:11:01.399077+0000","last_peered":"2024-09-13T05:11:01.399077+0000","last_clean":"2024-09-13T05:11:01.399077+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:11:01.399077+0000","last_undegraded":"2024-09-13T05:11:01.399077+0000","last_fullsized":"2024-09-13T05:11:01.399077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:40.372741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001054028,"stat_sum":{"num_bytes":67269626,"num_objects":54,"num_object_clones":4,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":20,"num_read":2292,"num_read_kb":43887,"num_write":209,"num_write_kb":35933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"67'165","reported_seq":1717,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.770007+0000","last_change":"2024-09-13T05:10:37.979816+0000","last_active":"2024-09-13T05:11:01.770007+0000","last_peered":"2024-09-13T05:11:01.770007+0000","last_clean":"2024-09-13T05:11:01.770007+0000","last_became_active":"2024-09-13T05:10:37.863256+0000","last_became_peered":"2024-09-13T05:10:37.863256+0000","last_unstale":"2024-09-13T05:11:01.770007+0000","last_undegraded":"2024-09-13T05:11:01.770007+0000","last_fullsized":"2024-09-13T05:11:01.770007+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:58:55.928356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099335200000000008,"stat_sum":{"num_bytes":52929688,"num_objects":48,"num_object_clones":5,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":27,"num_read":1724,"num_read_kb":16780,"num_write":145,"num_write_kb":22833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":214109,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":77,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.033288+0000","last_change":"2024-09-13T05:10:31.836193+0000","last_active":"2024-09-13T05:11:00.033288+0000","last_peered":"2024-09-13T05:11:00.033288+0000","last_clean":"2024-09-13T05:11:00.033288+0000","last_became_active":"2024-09-13T05:10:31.825663+0000","last_became_peered":"2024-09-13T05:10:31.825663+0000","last_unstale":"2024-09-13T05:11:00.033288+0000","last_undegraded":"2024-09-13T05:11:00.033288+0000","last_fullsized":"2024-09-13T05:11:00.033288+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:38:23.311570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"65'244","reported_seq":398,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.421631+0000","last_change":"2024-09-13T05:10:31.893494+0000","last_active":"2024-09-13T05:11:00.421631+0000","last_peered":"2024-09-13T05:11:00.421631+0000","last_clean":"2024-09-13T05:11:00.421631+0000","last_became_active":"2024-09-13T05:10:31.827657+0000","last_became_peered":"2024-09-13T05:10:31.827657+0000","last_unstale":"2024-09-13T05:11:00.421631+0000","last_undegraded":"2024-09-13T05:11:00.421631+0000","last_fullsized":"2024-09-13T05:11:00.421631+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:16:14.432049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045163499999999998,"stat_sum":{"num_bytes":4145771,"num_objects":42,"num_object_clones":4,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":20,"num_read":744,"num_read_kb":637,"num_write":306,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":84179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.037290+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:11:00.037290+0000","last_peered":"2024-09-13T05:11:00.037290+0000","last_clean":"2024-09-13T05:11:00.037290+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:11:00.037290+0000","last_undegraded":"2024-09-13T05:11:00.037290+0000","last_fullsized":"2024-09-13T05:11:00.037290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"65'124","reported_seq":407,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.421970+0000","last_change":"2024-09-13T05:10:38.111510+0000","last_active":"2024-09-13T05:11:00.421970+0000","last_peered":"2024-09-13T05:11:00.421970+0000","last_clean":"2024-09-13T05:11:00.421970+0000","last_became_active":"2024-09-13T05:10:37.869040+0000","last_became_peered":"2024-09-13T05:10:37.869040+0000","last_unstale":"2024-09-13T05:11:00.421970+0000","last_undegraded":"2024-09-13T05:11:00.421970+0000","last_fullsized":"2024-09-13T05:11:00.421970+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:48:18.385423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048152600000000002,"stat_sum":{"num_bytes":9454547,"num_objects":37,"num_object_clones":4,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":21,"num_read":209,"num_read_kb":5190,"num_write":97,"num_write_kb":3257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":383717,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":79,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.040379+0000","last_change":"2024-09-13T05:10:37.865514+0000","last_active":"2024-09-13T05:11:00.040379+0000","last_peered":"2024-09-13T05:11:00.040379+0000","last_clean":"2024-09-13T05:11:00.040379+0000","last_became_active":"2024-09-13T05:10:37.864299+0000","last_became_peered":"2024-09-13T05:10:37.864299+0000","last_unstale":"2024-09-13T05:11:00.040379+0000","last_undegraded":"2024-09-13T05:11:00.040379+0000","last_fullsized":"2024-09-13T05:11:00.040379+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:45:58.276509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"64'109","reported_seq":209,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.422307+0000","last_change":"2024-09-13T05:10:12.075510+0000","last_active":"2024-09-13T05:11:00.422307+0000","last_peered":"2024-09-13T05:11:00.422307+0000","last_clean":"2024-09-13T05:11:00.422307+0000","last_became_active":"2024-09-13T05:10:09.646353+0000","last_became_peered":"2024-09-13T05:10:09.646353+0000","last_unstale":"2024-09-13T05:11:00.422307+0000","last_undegraded":"2024-09-13T05:11:00.422307+0000","last_fullsized":"2024-09-13T05:11:00.422307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:54:58.706032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059320200000000003,"stat_sum":{"num_bytes":1948860,"num_objects":51,"num_object_clones":4,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":26,"num_read":101,"num_read_kb":1857,"num_write":77,"num_write_kb":1399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":64,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.033268+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:11:00.033268+0000","last_peered":"2024-09-13T05:11:00.033268+0000","last_clean":"2024-09-13T05:11:00.033268+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:11:00.033268+0000","last_undegraded":"2024-09-13T05:11:00.033268+0000","last_fullsized":"2024-09-13T05:11:00.033268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":232,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.041124+0000","last_change":"2024-09-13T05:10:40.886011+0000","last_active":"2024-09-13T05:11:00.041124+0000","last_peered":"2024-09-13T05:11:00.041124+0000","last_clean":"2024-09-13T05:11:00.041124+0000","last_became_active":"2024-09-13T05:10:40.885587+0000","last_became_peered":"2024-09-13T05:10:40.885587+0000","last_unstale":"2024-09-13T05:11:00.041124+0000","last_undegraded":"2024-09-13T05:11:00.041124+0000","last_fullsized":"2024-09-13T05:11:00.041124+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:52:47.632734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"66'136","reported_seq":323,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.248143+0000","last_change":"2024-09-13T05:10:31.888827+0000","last_active":"2024-09-13T05:11:01.248143+0000","last_peered":"2024-09-13T05:11:01.248143+0000","last_clean":"2024-09-13T05:11:01.248143+0000","last_became_active":"2024-09-13T05:10:31.827016+0000","last_became_peered":"2024-09-13T05:10:31.827016+0000","last_unstale":"2024-09-13T05:11:01.248143+0000","last_undegraded":"2024-09-13T05:11:01.248143+0000","last_fullsized":"2024-09-13T05:11:01.248143+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:47.525525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000500144,"stat_sum":{"num_bytes":4384406,"num_objects":59,"num_object_clones":6,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":33,"num_read":147,"num_read_kb":907,"num_write":104,"num_write_kb":23880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":58925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"67'186","reported_seq":5767,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.505141+0000","last_change":"2024-09-13T05:10:11.648218+0000","last_active":"2024-09-13T05:11:01.505141+0000","last_peered":"2024-09-13T05:11:01.505141+0000","last_clean":"2024-09-13T05:11:01.505141+0000","last_became_active":"2024-09-13T05:10:09.645408+0000","last_became_peered":"2024-09-13T05:10:09.645408+0000","last_unstale":"2024-09-13T05:11:01.505141+0000","last_undegraded":"2024-09-13T05:11:01.505141+0000","last_fullsized":"2024-09-13T05:11:01.505141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:59.846981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097828900000000002,"stat_sum":{"num_bytes":19349938,"num_objects":45,"num_object_clones":2,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":20,"num_read":6816,"num_read_kb":18673,"num_write":149,"num_write_kb":4908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"67'304","reported_seq":8372,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.098654+0000","last_change":"2024-09-13T05:10:47.940550+0000","last_active":"2024-09-13T05:11:01.098654+0000","last_peered":"2024-09-13T05:11:01.098654+0000","last_clean":"2024-09-13T05:11:01.098654+0000","last_became_active":"2024-09-13T05:10:47.939220+0000","last_became_peered":"2024-09-13T05:10:47.939220+0000","last_unstale":"2024-09-13T05:11:01.098654+0000","last_undegraded":"2024-09-13T05:11:01.098654+0000","last_fullsized":"2024-09-13T05:11:01.098654+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:59.693041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013204619999999999,"stat_sum":{"num_bytes":5351971,"num_objects":49,"num_object_clones":5,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":28,"num_read":8570,"num_read_kb":11898,"num_write":340,"num_write_kb":4978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":59,"num_bytes_recovered":6203954,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"67'155","reported_seq":1110,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.890342+0000","last_change":"2024-09-13T05:10:38.007507+0000","last_active":"2024-09-13T05:11:01.890342+0000","last_peered":"2024-09-13T05:11:01.890342+0000","last_clean":"2024-09-13T05:11:01.890342+0000","last_became_active":"2024-09-13T05:10:37.868643+0000","last_became_peered":"2024-09-13T05:10:37.868643+0000","last_unstale":"2024-09-13T05:11:01.890342+0000","last_undegraded":"2024-09-13T05:11:01.890342+0000","last_fullsized":"2024-09-13T05:11:01.890342+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:29:05.387242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055343700000000005,"stat_sum":{"num_bytes":11747878,"num_objects":51,"num_object_clones":6,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":29,"num_read":901,"num_read_kb":603,"num_write":116,"num_write_kb":1684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":15854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"66'97","reported_seq":327,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.863798+0000","last_change":"2024-09-13T05:10:11.647302+0000","last_active":"2024-09-13T05:11:01.863798+0000","last_peered":"2024-09-13T05:11:01.863798+0000","last_clean":"2024-09-13T05:11:01.863798+0000","last_became_active":"2024-09-13T05:10:09.647037+0000","last_became_peered":"2024-09-13T05:10:09.647037+0000","last_unstale":"2024-09-13T05:11:01.863798+0000","last_undegraded":"2024-09-13T05:11:01.863798+0000","last_fullsized":"2024-09-13T05:11:01.863798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:54:17.061326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069994199999999995,"stat_sum":{"num_bytes":22347761,"num_objects":40,"num_object_clones":3,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":19,"num_read":223,"num_read_kb":2901,"num_write":80,"num_write_kb":2190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"67'451","reported_seq":3106,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.900222+0000","last_change":"2024-09-13T05:10:11.682463+0000","last_active":"2024-09-13T05:11:01.900222+0000","last_peered":"2024-09-13T05:11:01.900222+0000","last_clean":"2024-09-13T05:11:01.900222+0000","last_became_active":"2024-09-13T05:10:09.647600+0000","last_became_peered":"2024-09-13T05:10:09.647600+0000","last_unstale":"2024-09-13T05:11:01.900222+0000","last_undegraded":"2024-09-13T05:11:01.900222+0000","last_fullsized":"2024-09-13T05:11:01.900222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:20:16.632365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019283150000000001,"stat_sum":{"num_bytes":67099118,"num_objects":59,"num_object_clones":6,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":25,"num_read":4150,"num_read_kb":11641,"num_write":614,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"67'651","reported_seq":4642,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.857281+0000","last_change":"2024-09-13T05:10:40.887883+0000","last_active":"2024-09-13T05:11:01.857281+0000","last_peered":"2024-09-13T05:11:01.857281+0000","last_clean":"2024-09-13T05:11:01.857281+0000","last_became_active":"2024-09-13T05:10:40.884580+0000","last_became_peered":"2024-09-13T05:10:40.884580+0000","last_unstale":"2024-09-13T05:11:01.857281+0000","last_undegraded":"2024-09-13T05:11:01.857281+0000","last_fullsized":"2024-09-13T05:11:01.857281+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:00.074124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018982339999999999,"stat_sum":{"num_bytes":20395007,"num_objects":53,"num_object_clones":3,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":28,"num_read":5788,"num_read_kb":5831,"num_write":1027,"num_write_kb":4719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":2255641,"num_keys_recovered":18,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"64'434","reported_seq":1152,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.423499+0000","last_change":"2024-09-13T05:10:40.885332+0000","last_active":"2024-09-13T05:11:00.423499+0000","last_peered":"2024-09-13T05:11:00.423499+0000","last_clean":"2024-09-13T05:11:00.423499+0000","last_became_active":"2024-09-13T05:10:40.884585+0000","last_became_peered":"2024-09-13T05:10:40.884585+0000","last_unstale":"2024-09-13T05:11:00.423499+0000","last_undegraded":"2024-09-13T05:11:00.423499+0000","last_fullsized":"2024-09-13T05:11:00.423499+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:31:19.596080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001164273,"stat_sum":{"num_bytes":15786431,"num_objects":48,"num_object_clones":5,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":27,"num_read":2387,"num_read_kb":9626,"num_write":671,"num_write_kb":3996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":296075,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"65'262","reported_seq":1311,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.048224+0000","last_change":"2024-09-13T05:10:37.938278+0000","last_active":"2024-09-13T05:11:01.048224+0000","last_peered":"2024-09-13T05:11:01.048224+0000","last_clean":"2024-09-13T05:11:01.048224+0000","last_became_active":"2024-09-13T05:10:37.862703+0000","last_became_peered":"2024-09-13T05:10:37.862703+0000","last_unstale":"2024-09-13T05:11:01.048224+0000","last_undegraded":"2024-09-13T05:11:01.048224+0000","last_fullsized":"2024-09-13T05:11:01.048224+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:39.174909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009951719999999999,"stat_sum":{"num_bytes":34055444,"num_objects":57,"num_object_clones":3,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":26,"num_read":1787,"num_read_kb":13741,"num_write":280,"num_write_kb":6086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":569424,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"64'148","reported_seq":329,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.040582+0000","last_change":"2024-09-13T05:10:11.680757+0000","last_active":"2024-09-13T05:11:00.040582+0000","last_peered":"2024-09-13T05:11:00.040582+0000","last_clean":"2024-09-13T05:11:00.040582+0000","last_became_active":"2024-09-13T05:10:09.653444+0000","last_became_peered":"2024-09-13T05:10:09.653444+0000","last_unstale":"2024-09-13T05:11:00.040582+0000","last_undegraded":"2024-09-13T05:11:00.040582+0000","last_fullsized":"2024-09-13T05:11:00.040582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:17:06.303008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000625977,"stat_sum":{"num_bytes":9295811,"num_objects":57,"num_object_clones":6,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":31,"num_read":195,"num_read_kb":7053,"num_write":107,"num_write_kb":3358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"67'208","reported_seq":1099,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.835185+0000","last_change":"2024-09-13T05:10:40.884306+0000","last_active":"2024-09-13T05:11:01.835185+0000","last_peered":"2024-09-13T05:11:01.835185+0000","last_clean":"2024-09-13T05:11:01.835185+0000","last_became_active":"2024-09-13T05:10:40.883543+0000","last_became_peered":"2024-09-13T05:10:40.883543+0000","last_unstale":"2024-09-13T05:11:01.835185+0000","last_undegraded":"2024-09-13T05:11:01.835185+0000","last_fullsized":"2024-09-13T05:11:01.835185+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:14:23.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048307200000000003,"stat_sum":{"num_bytes":53973873,"num_objects":44,"num_object_clones":5,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":21,"num_read":1818,"num_read_kb":7340,"num_write":185,"num_write_kb":3595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":633324,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"67'356","reported_seq":1601,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.397658+0000","last_change":"2024-09-13T05:10:11.680877+0000","last_active":"2024-09-13T05:11:01.397658+0000","last_peered":"2024-09-13T05:11:01.397658+0000","last_clean":"2024-09-13T05:11:01.397658+0000","last_became_active":"2024-09-13T05:10:09.649053+0000","last_became_peered":"2024-09-13T05:10:09.649053+0000","last_unstale":"2024-09-13T05:11:01.397658+0000","last_undegraded":"2024-09-13T05:11:01.397658+0000","last_fullsized":"2024-09-13T05:11:01.397658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:14.770260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062821800000000005,"stat_sum":{"num_bytes":39067411,"num_objects":56,"num_object_clones":6,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":27,"num_read":2494,"num_read_kb":43344,"num_write":465,"num_write_kb":33407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":828801832,"num_objects":1577,"num_object_clones":144,"num_object_copies":3154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1577,"num_whiteouts":775,"num_read":66773,"num_read_kb":310212,"num_write":8142,"num_write_kb":209608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":677,"num_bytes_recovered":20204390,"num_keys_recovered":113,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":238682112,"data_stored":268010937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7357,"ondisk_log_size":7357,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101868,"kb_used_data":56764,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94269972,"statfs":{"total":96636764160,"available":96532451328,"internally_reserved":0,"allocated":58126336,"data_stored":64826958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.879}]},{"osd":1,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.95399999999999996}]},{"osd":2,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.337}]},{"osd":3,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.087}]},{"osd":4,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":1.05},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.131}]},{"osd":5,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.395},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.177}]},{"osd":6,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":1.29},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.2170000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57208,"kb_used_data":21944,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94314632,"statfs":{"total":96636764160,"available":96578183168,"internally_reserved":0,"allocated":22470656,"data_stored":24770797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36043207},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.89200000000000002}]},{"osd":1,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.72799999999999998}]},{"osd":2,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.876}]},{"osd":3,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.97999999999999998}]},{"osd":4,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.75900000000000001}]},{"osd":7,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.2390000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96640,"kb_used_data":57336,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94275200,"statfs":{"total":96636764160,"available":96537804800,"internally_reserved":0,"allocated":58712064,"data_stored":62961918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.282},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.71599999999999997}]},{"osd":1,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.1950000000000001}]},{"osd":2,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.82199999999999995}]},{"osd":3,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.236}]},{"osd":4,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.79800000000000004}]},{"osd":6,"last update":"Fri Sep 13 05:10:58 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":1.345},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.369}]},{"osd":7,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.413}]}]},{"osd":4,"up_from":0,"seq":55834574867,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85088,"kb_used_data":45696,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94286752,"statfs":{"total":96636764160,"available":96549634048,"internally_reserved":0,"allocated":46792704,"data_stored":52132422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.255},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.32500000000000001}]},{"osd":1,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.377},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.56100000000000005}]},{"osd":6,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.73599999999999999}]},{"osd":7,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.86099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70244,"kb_used_data":35032,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94301596,"statfs":{"total":96636764160,"available":96564834304,"internally_reserved":0,"allocated":35872768,"data_stored":39113870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.73299999999999998}]},{"osd":1,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.55100000000000005}]},{"osd":3,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.71599999999999997}]},{"osd":4,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.85899999999999999}]},{"osd":5,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.3380000000000001}]},{"osd":6,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.80500000000000005}]},{"osd":7,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.028},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.101}]}]},{"osd":1,"up_from":0,"seq":55834574865,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":0,"seq":55834574867,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10035200,"data_stored":11939429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6619136,"data_stored":10238144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":35090432,"data_stored":38762815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":47661056,"data_stored":53365093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":59215872,"data_stored":63840965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":22003712,"data_stored":24716757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":58056704,"data_stored":65147734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:11:05.536 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:11:05.537 INFO:teuthology.orchestra.run.smithi120.stdout:2600 writesame 0x43e5e4d thru 0x43efae7 data_size 0x1(0x9c9b bytes) 2024-09-13T05:11:05.537 INFO:teuthology.orchestra.run.smithi120.stdout:2601 punch from 0x7be52b8 to 0x7bea654, (0x539c bytes) 2024-09-13T05:11:05.537 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:05.537 INFO:teuthology.orchestra.run.smithi120.stdout:2603 write 0xa7f9c07 thru 0xa808fd5 (0xf3cf bytes) 2024-09-13T05:11:05.537 INFO:teuthology.orchestra.run.smithi120.stdout:2604 read 0x1135f01 thru 0x113f5a5 (0x96a5 bytes) 2024-09-13T05:11:05.537 INFO:teuthology.orchestra.run.smithi120.stdout:2607 trunc from 0xc46852b to 0x961f68b 2024-09-13T05:11:05.537 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:05.521+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:05.540 INFO:teuthology.orchestra.run.smithi120.stdout:2609 write 0x4cdd8b8 thru 0x4ceb0f5 (0xd83e bytes) 2024-09-13T05:11:05.568 INFO:teuthology.orchestra.run.smithi120.stdout:2610 write 0xd9aa6b2 thru 0xd9ad40d (0x2d5c bytes) 2024-09-13T05:11:05.575 INFO:teuthology.orchestra.run.smithi120.stdout:2613 write 0xa9c58d6 thru 0xa9cffaf (0xa6da bytes) 2024-09-13T05:11:05.583 INFO:teuthology.orchestra.run.smithi120.stdout:2614 write 0x8f9ab04 thru 0x8fa4e49 (0xa346 bytes) 2024-09-13T05:11:05.591 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:05.591 INFO:teuthology.orchestra.run.smithi120.stdout:2617 writesame 0xa8a803b thru 0xa8a8c61 data_size 0x11(0xc27 bytes) 2024-09-13T05:11:05.597 INFO:teuthology.orchestra.run.smithi120.stdout:2619 flatten 2024-09-13T05:11:05.629 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:05.625+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:05.677 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:05.678 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:05.678 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:11:05.678 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:05.692 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:11:05.730 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:05.725+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:05.831 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:05.826+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:05.836 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:05.836 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:05.836 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:05.836 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:05.836 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:05.846 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:11:05.855 INFO:teuthology.orchestra.run.smithi120.stdout:2620 write 0xcf60c48 thru 0xcf6dc99 (0xd052 bytes) 2024-09-13T05:11:05.861 INFO:teuthology.orchestra.run.smithi120.stdout:2621 write 0x50420f1 thru 0x504cc7e (0xab8e bytes) 2024-09-13T05:11:05.869 INFO:teuthology.orchestra.run.smithi120.stdout:2622 trunc from 0xd9ad40e to 0xcee2784 2024-09-13T05:11:05.887 INFO:teuthology.orchestra.run.smithi120.stdout:2624 writesame 0x7d30ed4 thru 0x7d34ac2 data_size 0x1(0x3bef bytes) 2024-09-13T05:11:05.901 INFO:teuthology.orchestra.run.smithi120.stdout:2625 writesame 0x67c32b6 thru 0x67d281e data_size 0x23(0xf569 bytes) 2024-09-13T05:11:05.909 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:05.909 INFO:teuthology.orchestra.run.smithi120.stdout:2629 punch from 0x503a395 to 0x5049eb3, (0xfb1e bytes) 2024-09-13T05:11:05.909 INFO:teuthology.orchestra.run.smithi120.stdout:2630 write 0xc24e00 thru 0xc32860 (0xda61 bytes) 2024-09-13T05:11:05.916 INFO:teuthology.orchestra.run.smithi120.stdout:2631 write 0xc02d081 thru 0xc0354a5 (0x8425 bytes) 2024-09-13T05:11:05.923 INFO:teuthology.orchestra.run.smithi120.stdout:2632 read 0xc4bc0b thru 0xc55357 (0x974d bytes) 2024-09-13T05:11:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:11:05.925 INFO:teuthology.orchestra.run.smithi120.stdout:2633 write 0x14c79e8 thru 0x14c7b69 (0x182 bytes) 2024-09-13T05:11:05.927 INFO:teuthology.orchestra.run.smithi120.stdout:2634 trunc from 0xcee2784 to 0xda2f5bc 2024-09-13T05:11:05.928 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:11:05.932 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:05.925+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:05.937 INFO:teuthology.orchestra.run.smithi120.stdout:2635 writesame 0x22091e8 thru 0x220b233 data_size 0xd(0x204c bytes) 2024-09-13T05:11:05.941 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2024-09-13T05:11:05.066234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":829392219,"num_objects":1581,"num_object_clones":144,"num_object_copies":3162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1581,"num_whiteouts":775,"num_read":66889,"num_read_kb":310312,"num_write":8303,"num_write_kb":212026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":680,"num_bytes_recovered":20794777,"num_keys_recovered":113,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7477,"ondisk_log_size":7477,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":411048,"kb_used_data":216772,"kb_used_omap":7,"kb_used_meta":194040,"kb_avail":471448152,"statfs":{"total":483183820800,"available":482762907648,"internally_reserved":0,"allocated":221974528,"data_stored":243805965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7962,"internal_metadata":198697190},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":280161829,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":4464,"num_read_kb":19898,"num_write":806,"num_write_kb":11970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.026813"},"pg_stats":[{"pgid":"3.1f","version":"67'189","reported_seq":694,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.094636+0000","last_change":"2024-09-13T05:10:37.993400+0000","last_active":"2024-09-13T05:11:01.094636+0000","last_peered":"2024-09-13T05:11:01.094636+0000","last_clean":"2024-09-13T05:11:01.094636+0000","last_became_active":"2024-09-13T05:10:37.864778+0000","last_became_peered":"2024-09-13T05:10:37.864778+0000","last_unstale":"2024-09-13T05:11:01.094636+0000","last_undegraded":"2024-09-13T05:11:01.094636+0000","last_fullsized":"2024-09-13T05:11:01.094636+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:56:24.801492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011835439999999999,"stat_sum":{"num_bytes":4389000,"num_objects":49,"num_object_clones":4,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":17,"num_read":895,"num_read_kb":2340,"num_write":165,"num_write_kb":1525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":297202,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"64'139","reported_seq":794,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.421406+0000","last_change":"2024-09-13T05:10:12.076857+0000","last_active":"2024-09-13T05:11:00.421406+0000","last_peered":"2024-09-13T05:11:00.421406+0000","last_clean":"2024-09-13T05:11:00.421406+0000","last_became_active":"2024-09-13T05:10:09.644293+0000","last_became_peered":"2024-09-13T05:10:09.644293+0000","last_unstale":"2024-09-13T05:11:00.421406+0000","last_undegraded":"2024-09-13T05:11:00.421406+0000","last_fullsized":"2024-09-13T05:11:00.421406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:45:32.561793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225439,"stat_sum":{"num_bytes":26028163,"num_objects":46,"num_object_clones":5,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":24,"num_read":1129,"num_read_kb":4025,"num_write":116,"num_write_kb":2180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"67'147","reported_seq":1245,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.908410+0000","last_change":"2024-09-13T05:10:11.645342+0000","last_active":"2024-09-13T05:11:01.908410+0000","last_peered":"2024-09-13T05:11:01.908410+0000","last_clean":"2024-09-13T05:11:01.908410+0000","last_became_active":"2024-09-13T05:10:09.645791+0000","last_became_peered":"2024-09-13T05:10:09.645791+0000","last_unstale":"2024-09-13T05:11:01.908410+0000","last_undegraded":"2024-09-13T05:11:01.908410+0000","last_fullsized":"2024-09-13T05:11:01.908410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:49.028553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072691800000000001,"stat_sum":{"num_bytes":40837266,"num_objects":59,"num_object_clones":8,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":24,"num_read":1117,"num_read_kb":7760,"num_write":113,"num_write_kb":3356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"67'449","reported_seq":1251,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.925981+0000","last_change":"2024-09-13T05:10:31.949427+0000","last_active":"2024-09-13T05:11:01.925981+0000","last_peered":"2024-09-13T05:11:01.925981+0000","last_clean":"2024-09-13T05:11:01.925981+0000","last_became_active":"2024-09-13T05:10:31.828206+0000","last_became_peered":"2024-09-13T05:10:31.828206+0000","last_unstale":"2024-09-13T05:11:01.925981+0000","last_undegraded":"2024-09-13T05:11:01.925981+0000","last_fullsized":"2024-09-13T05:11:01.925981+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:32:46.868249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078437299999999999,"stat_sum":{"num_bytes":30867520,"num_objects":41,"num_object_clones":3,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":15,"num_read":2915,"num_read_kb":4566,"num_write":623,"num_write_kb":7388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":372837,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"67'234","reported_seq":723,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.751378+0000","last_change":"2024-09-13T05:10:37.990899+0000","last_active":"2024-09-13T05:11:01.751378+0000","last_peered":"2024-09-13T05:11:01.751378+0000","last_clean":"2024-09-13T05:11:01.751378+0000","last_became_active":"2024-09-13T05:10:37.867842+0000","last_became_peered":"2024-09-13T05:10:37.867842+0000","last_unstale":"2024-09-13T05:11:01.751378+0000","last_undegraded":"2024-09-13T05:11:01.751378+0000","last_fullsized":"2024-09-13T05:11:01.751378+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:38:24.437617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065808499999999999,"stat_sum":{"num_bytes":4440526,"num_objects":48,"num_object_clones":3,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":25,"num_read":1266,"num_read_kb":3185,"num_write":242,"num_write_kb":1373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":612052,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"65'194","reported_seq":2466,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.889114+0000","last_change":"2024-09-13T05:10:37.948112+0000","last_active":"2024-09-13T05:11:01.889114+0000","last_peered":"2024-09-13T05:11:01.889114+0000","last_clean":"2024-09-13T05:11:01.889114+0000","last_became_active":"2024-09-13T05:10:37.863614+0000","last_became_peered":"2024-09-13T05:10:37.863614+0000","last_unstale":"2024-09-13T05:11:01.889114+0000","last_undegraded":"2024-09-13T05:11:01.889114+0000","last_fullsized":"2024-09-13T05:11:01.889114+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:15.873724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027226559999999999,"stat_sum":{"num_bytes":9899581,"num_objects":53,"num_object_clones":4,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":21,"num_read":2681,"num_read_kb":5294,"num_write":152,"num_write_kb":1883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":77,"num_bytes_recovered":1081937,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"66'484","reported_seq":2208,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.862641+0000","last_change":"2024-09-13T05:10:34.613940+0000","last_active":"2024-09-13T05:11:01.862641+0000","last_peered":"2024-09-13T05:11:01.862641+0000","last_clean":"2024-09-13T05:11:01.862641+0000","last_became_active":"2024-09-13T05:10:34.612579+0000","last_became_peered":"2024-09-13T05:10:34.612579+0000","last_unstale":"2024-09-13T05:11:01.862641+0000","last_undegraded":"2024-09-13T05:11:01.862641+0000","last_fullsized":"2024-09-13T05:11:01.862641+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:43.339882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067403999999999999,"stat_sum":{"num_bytes":48373122,"num_objects":50,"num_object_clones":7,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":22,"num_read":4088,"num_read_kb":12096,"num_write":671,"num_write_kb":2811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":248973,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"67'198","reported_seq":1138,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.886076+0000","last_change":"2024-09-13T05:10:37.929523+0000","last_active":"2024-09-13T05:11:01.886076+0000","last_peered":"2024-09-13T05:11:01.886076+0000","last_clean":"2024-09-13T05:11:01.886076+0000","last_became_active":"2024-09-13T05:10:37.865440+0000","last_became_peered":"2024-09-13T05:10:37.865440+0000","last_unstale":"2024-09-13T05:11:01.886076+0000","last_undegraded":"2024-09-13T05:11:01.886076+0000","last_fullsized":"2024-09-13T05:11:01.886076+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:30:31.875141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087399999999998,"stat_sum":{"num_bytes":18139977,"num_objects":52,"num_object_clones":4,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":31,"num_read":1081,"num_read_kb":11591,"num_write":199,"num_write_kb":5147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":1513234,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"67'143","reported_seq":825,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.846696+0000","last_change":"2024-09-13T05:10:37.920810+0000","last_active":"2024-09-13T05:11:01.846696+0000","last_peered":"2024-09-13T05:11:01.846696+0000","last_clean":"2024-09-13T05:11:01.846696+0000","last_became_active":"2024-09-13T05:10:37.864816+0000","last_became_peered":"2024-09-13T05:10:37.864816+0000","last_unstale":"2024-09-13T05:11:01.846696+0000","last_undegraded":"2024-09-13T05:11:01.846696+0000","last_fullsized":"2024-09-13T05:11:01.846696+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:06.315864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096598599999999995,"stat_sum":{"num_bytes":16928716,"num_objects":35,"num_object_clones":1,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":15,"num_read":1773,"num_read_kb":2041,"num_write":113,"num_write_kb":1049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":37802,"num_keys_recovered":23,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"64'188","reported_seq":1366,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.033805+0000","last_change":"2024-09-13T05:10:11.645211+0000","last_active":"2024-09-13T05:11:00.033805+0000","last_peered":"2024-09-13T05:11:00.033805+0000","last_clean":"2024-09-13T05:11:00.033805+0000","last_became_active":"2024-09-13T05:10:09.647763+0000","last_became_peered":"2024-09-13T05:10:09.647763+0000","last_unstale":"2024-09-13T05:11:00.033805+0000","last_undegraded":"2024-09-13T05:11:00.033805+0000","last_fullsized":"2024-09-13T05:11:00.033805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:43.426871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072236499999999999,"stat_sum":{"num_bytes":31859829,"num_objects":48,"num_object_clones":9,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":24,"num_read":1293,"num_read_kb":9309,"num_write":161,"num_write_kb":2710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"67'124","reported_seq":295,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.881240+0000","last_change":"2024-09-13T05:10:11.681217+0000","last_active":"2024-09-13T05:11:01.881240+0000","last_peered":"2024-09-13T05:11:01.881240+0000","last_clean":"2024-09-13T05:11:01.881240+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:11:01.881240+0000","last_undegraded":"2024-09-13T05:11:01.881240+0000","last_fullsized":"2024-09-13T05:11:01.881240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:40.457636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095533399999999996,"stat_sum":{"num_bytes":27119592,"num_objects":41,"num_object_clones":2,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":22,"num_read":287,"num_read_kb":2431,"num_write":119,"num_write_kb":2102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"64'166","reported_seq":3629,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.424104+0000","last_change":"2024-09-13T05:10:11.681365+0000","last_active":"2024-09-13T05:11:00.424104+0000","last_peered":"2024-09-13T05:11:00.424104+0000","last_clean":"2024-09-13T05:11:00.424104+0000","last_became_active":"2024-09-13T05:10:09.645823+0000","last_became_peered":"2024-09-13T05:10:09.645823+0000","last_unstale":"2024-09-13T05:11:00.424104+0000","last_undegraded":"2024-09-13T05:11:00.424104+0000","last_fullsized":"2024-09-13T05:11:00.424104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:24.367358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011047369999999999,"stat_sum":{"num_bytes":38597648,"num_objects":50,"num_object_clones":4,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":26,"num_read":3486,"num_read_kb":24836,"num_write":129,"num_write_kb":3900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.032514+0000","last_change":"2024-09-13T05:10:01.383891+0000","last_active":"2024-09-13T05:11:00.032514+0000","last_peered":"2024-09-13T05:11:00.032514+0000","last_clean":"2024-09-13T05:11:00.032514+0000","last_became_active":"2024-09-13T05:09:59.374793+0000","last_became_peered":"2024-09-13T05:09:59.374793+0000","last_unstale":"2024-09-13T05:11:00.032514+0000","last_undegraded":"2024-09-13T05:11:00.032514+0000","last_fullsized":"2024-09-13T05:11:00.032514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:02.499446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065068999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"65'146","reported_seq":4170,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.054958+0000","last_change":"2024-09-13T05:10:38.046833+0000","last_active":"2024-09-13T05:11:01.054958+0000","last_peered":"2024-09-13T05:11:01.054958+0000","last_clean":"2024-09-13T05:11:01.054958+0000","last_became_active":"2024-09-13T05:10:37.869206+0000","last_became_peered":"2024-09-13T05:10:37.869206+0000","last_unstale":"2024-09-13T05:11:01.054958+0000","last_undegraded":"2024-09-13T05:11:01.054958+0000","last_fullsized":"2024-09-13T05:11:01.054958+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:12.484134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099899699999999995,"stat_sum":{"num_bytes":28690323,"num_objects":43,"num_object_clones":5,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":21,"num_read":3113,"num_read_kb":7626,"num_write":117,"num_write_kb":5992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":5061662,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.032583+0000","last_change":"2024-09-13T05:10:31.826927+0000","last_active":"2024-09-13T05:11:00.032583+0000","last_peered":"2024-09-13T05:11:00.032583+0000","last_clean":"2024-09-13T05:11:00.032583+0000","last_became_active":"2024-09-13T05:10:31.826431+0000","last_became_peered":"2024-09-13T05:10:31.826431+0000","last_unstale":"2024-09-13T05:11:00.032583+0000","last_undegraded":"2024-09-13T05:11:00.032583+0000","last_fullsized":"2024-09-13T05:11:00.032583+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:13:36.678853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"66'179","reported_seq":1215,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.857817+0000","last_change":"2024-09-13T05:10:12.077111+0000","last_active":"2024-09-13T05:11:01.857817+0000","last_peered":"2024-09-13T05:11:01.857817+0000","last_clean":"2024-09-13T05:11:01.857817+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:11:01.857817+0000","last_undegraded":"2024-09-13T05:11:01.857817+0000","last_fullsized":"2024-09-13T05:11:01.857817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:37.976147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001460444,"stat_sum":{"num_bytes":51509824,"num_objects":59,"num_object_clones":5,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":33,"num_read":1164,"num_read_kb":9907,"num_write":155,"num_write_kb":2656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":71,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.040797+0000","last_change":"2024-09-13T05:10:37.866953+0000","last_active":"2024-09-13T05:11:00.040797+0000","last_peered":"2024-09-13T05:11:00.040797+0000","last_clean":"2024-09-13T05:11:00.040797+0000","last_became_active":"2024-09-13T05:10:37.866624+0000","last_became_peered":"2024-09-13T05:10:37.866624+0000","last_unstale":"2024-09-13T05:11:00.040797+0000","last_undegraded":"2024-09-13T05:11:00.040797+0000","last_fullsized":"2024-09-13T05:11:00.040797+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:56:20.077971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"65'127","reported_seq":329,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.059722+0000","last_change":"2024-09-13T05:10:32.017095+0000","last_active":"2024-09-13T05:11:01.059722+0000","last_peered":"2024-09-13T05:11:01.059722+0000","last_clean":"2024-09-13T05:11:01.059722+0000","last_became_active":"2024-09-13T05:10:31.829027+0000","last_became_peered":"2024-09-13T05:10:31.829027+0000","last_unstale":"2024-09-13T05:11:01.059722+0000","last_undegraded":"2024-09-13T05:11:01.059722+0000","last_fullsized":"2024-09-13T05:11:01.059722+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:36:33.938992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076234800000000004,"stat_sum":{"num_bytes":12517204,"num_objects":53,"num_object_clones":3,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":27,"num_read":139,"num_read_kb":1296,"num_write":95,"num_write_kb":1563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":263489,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.041019+0000","last_change":"2024-09-13T05:10:37.864940+0000","last_active":"2024-09-13T05:11:00.041019+0000","last_peered":"2024-09-13T05:11:00.041019+0000","last_clean":"2024-09-13T05:11:00.041019+0000","last_became_active":"2024-09-13T05:10:37.864623+0000","last_became_peered":"2024-09-13T05:10:37.864623+0000","last_unstale":"2024-09-13T05:11:00.041019+0000","last_undegraded":"2024-09-13T05:11:00.041019+0000","last_fullsized":"2024-09-13T05:11:00.041019+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:41.598490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.5","version":"67'220","reported_seq":1690,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.399077+0000","last_change":"2024-09-13T05:10:11.645960+0000","last_active":"2024-09-13T05:11:01.399077+0000","last_peered":"2024-09-13T05:11:01.399077+0000","last_clean":"2024-09-13T05:11:01.399077+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:11:01.399077+0000","last_undegraded":"2024-09-13T05:11:01.399077+0000","last_fullsized":"2024-09-13T05:11:01.399077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:40.372741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001054028,"stat_sum":{"num_bytes":67269626,"num_objects":54,"num_object_clones":4,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":20,"num_read":2292,"num_read_kb":43887,"num_write":209,"num_write_kb":35933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"67'165","reported_seq":1717,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.770007+0000","last_change":"2024-09-13T05:10:37.979816+0000","last_active":"2024-09-13T05:11:01.770007+0000","last_peered":"2024-09-13T05:11:01.770007+0000","last_clean":"2024-09-13T05:11:01.770007+0000","last_became_active":"2024-09-13T05:10:37.863256+0000","last_became_peered":"2024-09-13T05:10:37.863256+0000","last_unstale":"2024-09-13T05:11:01.770007+0000","last_undegraded":"2024-09-13T05:11:01.770007+0000","last_fullsized":"2024-09-13T05:11:01.770007+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:58:55.928356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099335200000000008,"stat_sum":{"num_bytes":52929688,"num_objects":48,"num_object_clones":5,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":27,"num_read":1724,"num_read_kb":16780,"num_write":145,"num_write_kb":22833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":214109,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":77,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.033288+0000","last_change":"2024-09-13T05:10:31.836193+0000","last_active":"2024-09-13T05:11:00.033288+0000","last_peered":"2024-09-13T05:11:00.033288+0000","last_clean":"2024-09-13T05:11:00.033288+0000","last_became_active":"2024-09-13T05:10:31.825663+0000","last_became_peered":"2024-09-13T05:10:31.825663+0000","last_unstale":"2024-09-13T05:11:00.033288+0000","last_undegraded":"2024-09-13T05:11:00.033288+0000","last_fullsized":"2024-09-13T05:11:00.033288+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:38:23.311570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"65'244","reported_seq":398,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.421631+0000","last_change":"2024-09-13T05:10:31.893494+0000","last_active":"2024-09-13T05:11:00.421631+0000","last_peered":"2024-09-13T05:11:00.421631+0000","last_clean":"2024-09-13T05:11:00.421631+0000","last_became_active":"2024-09-13T05:10:31.827657+0000","last_became_peered":"2024-09-13T05:10:31.827657+0000","last_unstale":"2024-09-13T05:11:00.421631+0000","last_undegraded":"2024-09-13T05:11:00.421631+0000","last_fullsized":"2024-09-13T05:11:00.421631+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:16:14.432049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045163499999999998,"stat_sum":{"num_bytes":4145771,"num_objects":42,"num_object_clones":4,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":20,"num_read":744,"num_read_kb":637,"num_write":306,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":84179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.037290+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:11:00.037290+0000","last_peered":"2024-09-13T05:11:00.037290+0000","last_clean":"2024-09-13T05:11:00.037290+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:11:00.037290+0000","last_undegraded":"2024-09-13T05:11:00.037290+0000","last_fullsized":"2024-09-13T05:11:00.037290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"65'124","reported_seq":407,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.421970+0000","last_change":"2024-09-13T05:10:38.111510+0000","last_active":"2024-09-13T05:11:00.421970+0000","last_peered":"2024-09-13T05:11:00.421970+0000","last_clean":"2024-09-13T05:11:00.421970+0000","last_became_active":"2024-09-13T05:10:37.869040+0000","last_became_peered":"2024-09-13T05:10:37.869040+0000","last_unstale":"2024-09-13T05:11:00.421970+0000","last_undegraded":"2024-09-13T05:11:00.421970+0000","last_fullsized":"2024-09-13T05:11:00.421970+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:48:18.385423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048152600000000002,"stat_sum":{"num_bytes":9454547,"num_objects":37,"num_object_clones":4,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":21,"num_read":209,"num_read_kb":5190,"num_write":97,"num_write_kb":3257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":383717,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":79,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.040379+0000","last_change":"2024-09-13T05:10:37.865514+0000","last_active":"2024-09-13T05:11:00.040379+0000","last_peered":"2024-09-13T05:11:00.040379+0000","last_clean":"2024-09-13T05:11:00.040379+0000","last_became_active":"2024-09-13T05:10:37.864299+0000","last_became_peered":"2024-09-13T05:10:37.864299+0000","last_unstale":"2024-09-13T05:11:00.040379+0000","last_undegraded":"2024-09-13T05:11:00.040379+0000","last_fullsized":"2024-09-13T05:11:00.040379+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:45:58.276509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"64'109","reported_seq":209,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.422307+0000","last_change":"2024-09-13T05:10:12.075510+0000","last_active":"2024-09-13T05:11:00.422307+0000","last_peered":"2024-09-13T05:11:00.422307+0000","last_clean":"2024-09-13T05:11:00.422307+0000","last_became_active":"2024-09-13T05:10:09.646353+0000","last_became_peered":"2024-09-13T05:10:09.646353+0000","last_unstale":"2024-09-13T05:11:00.422307+0000","last_undegraded":"2024-09-13T05:11:00.422307+0000","last_fullsized":"2024-09-13T05:11:00.422307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:54:58.706032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059320200000000003,"stat_sum":{"num_bytes":1948860,"num_objects":51,"num_object_clones":4,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":26,"num_read":101,"num_read_kb":1857,"num_write":77,"num_write_kb":1399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":64,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.033268+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:11:00.033268+0000","last_peered":"2024-09-13T05:11:00.033268+0000","last_clean":"2024-09-13T05:11:00.033268+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:11:00.033268+0000","last_undegraded":"2024-09-13T05:11:00.033268+0000","last_fullsized":"2024-09-13T05:11:00.033268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":232,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.041124+0000","last_change":"2024-09-13T05:10:40.886011+0000","last_active":"2024-09-13T05:11:00.041124+0000","last_peered":"2024-09-13T05:11:00.041124+0000","last_clean":"2024-09-13T05:11:00.041124+0000","last_became_active":"2024-09-13T05:10:40.885587+0000","last_became_peered":"2024-09-13T05:10:40.885587+0000","last_unstale":"2024-09-13T05:11:00.041124+0000","last_undegraded":"2024-09-13T05:11:00.041124+0000","last_fullsized":"2024-09-13T05:11:00.041124+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:52:47.632734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"66'136","reported_seq":323,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.248143+0000","last_change":"2024-09-13T05:10:31.888827+0000","last_active":"2024-09-13T05:11:01.248143+0000","last_peered":"2024-09-13T05:11:01.248143+0000","last_clean":"2024-09-13T05:11:01.248143+0000","last_became_active":"2024-09-13T05:10:31.827016+0000","last_became_peered":"2024-09-13T05:10:31.827016+0000","last_unstale":"2024-09-13T05:11:01.248143+0000","last_undegraded":"2024-09-13T05:11:01.248143+0000","last_fullsized":"2024-09-13T05:11:01.248143+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:47.525525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000500144,"stat_sum":{"num_bytes":4384406,"num_objects":59,"num_object_clones":6,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":33,"num_read":147,"num_read_kb":907,"num_write":104,"num_write_kb":23880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":58925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"67'186","reported_seq":5767,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.505141+0000","last_change":"2024-09-13T05:10:11.648218+0000","last_active":"2024-09-13T05:11:01.505141+0000","last_peered":"2024-09-13T05:11:01.505141+0000","last_clean":"2024-09-13T05:11:01.505141+0000","last_became_active":"2024-09-13T05:10:09.645408+0000","last_became_peered":"2024-09-13T05:10:09.645408+0000","last_unstale":"2024-09-13T05:11:01.505141+0000","last_undegraded":"2024-09-13T05:11:01.505141+0000","last_fullsized":"2024-09-13T05:11:01.505141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:59.846981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097828900000000002,"stat_sum":{"num_bytes":19349938,"num_objects":45,"num_object_clones":2,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":20,"num_read":6816,"num_read_kb":18673,"num_write":149,"num_write_kb":4908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"67'304","reported_seq":8372,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.098654+0000","last_change":"2024-09-13T05:10:47.940550+0000","last_active":"2024-09-13T05:11:01.098654+0000","last_peered":"2024-09-13T05:11:01.098654+0000","last_clean":"2024-09-13T05:11:01.098654+0000","last_became_active":"2024-09-13T05:10:47.939220+0000","last_became_peered":"2024-09-13T05:10:47.939220+0000","last_unstale":"2024-09-13T05:11:01.098654+0000","last_undegraded":"2024-09-13T05:11:01.098654+0000","last_fullsized":"2024-09-13T05:11:01.098654+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:59.693041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013204619999999999,"stat_sum":{"num_bytes":5351971,"num_objects":49,"num_object_clones":5,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":28,"num_read":8570,"num_read_kb":11898,"num_write":340,"num_write_kb":4978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":59,"num_bytes_recovered":6203954,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"67'155","reported_seq":1110,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.890342+0000","last_change":"2024-09-13T05:10:38.007507+0000","last_active":"2024-09-13T05:11:01.890342+0000","last_peered":"2024-09-13T05:11:01.890342+0000","last_clean":"2024-09-13T05:11:01.890342+0000","last_became_active":"2024-09-13T05:10:37.868643+0000","last_became_peered":"2024-09-13T05:10:37.868643+0000","last_unstale":"2024-09-13T05:11:01.890342+0000","last_undegraded":"2024-09-13T05:11:01.890342+0000","last_fullsized":"2024-09-13T05:11:01.890342+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:29:05.387242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055343700000000005,"stat_sum":{"num_bytes":11747878,"num_objects":51,"num_object_clones":6,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":29,"num_read":901,"num_read_kb":603,"num_write":116,"num_write_kb":1684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":15854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"66'97","reported_seq":327,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.863798+0000","last_change":"2024-09-13T05:10:11.647302+0000","last_active":"2024-09-13T05:11:01.863798+0000","last_peered":"2024-09-13T05:11:01.863798+0000","last_clean":"2024-09-13T05:11:01.863798+0000","last_became_active":"2024-09-13T05:10:09.647037+0000","last_became_peered":"2024-09-13T05:10:09.647037+0000","last_unstale":"2024-09-13T05:11:01.863798+0000","last_undegraded":"2024-09-13T05:11:01.863798+0000","last_fullsized":"2024-09-13T05:11:01.863798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:54:17.061326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069994199999999995,"stat_sum":{"num_bytes":22347761,"num_objects":40,"num_object_clones":3,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":19,"num_read":223,"num_read_kb":2901,"num_write":80,"num_write_kb":2190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"67'451","reported_seq":3106,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.900222+0000","last_change":"2024-09-13T05:10:11.682463+0000","last_active":"2024-09-13T05:11:01.900222+0000","last_peered":"2024-09-13T05:11:01.900222+0000","last_clean":"2024-09-13T05:11:01.900222+0000","last_became_active":"2024-09-13T05:10:09.647600+0000","last_became_peered":"2024-09-13T05:10:09.647600+0000","last_unstale":"2024-09-13T05:11:01.900222+0000","last_undegraded":"2024-09-13T05:11:01.900222+0000","last_fullsized":"2024-09-13T05:11:01.900222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:20:16.632365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019283150000000001,"stat_sum":{"num_bytes":67099118,"num_objects":59,"num_object_clones":6,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":25,"num_read":4150,"num_read_kb":11641,"num_write":614,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"67'651","reported_seq":4642,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.857281+0000","last_change":"2024-09-13T05:10:40.887883+0000","last_active":"2024-09-13T05:11:01.857281+0000","last_peered":"2024-09-13T05:11:01.857281+0000","last_clean":"2024-09-13T05:11:01.857281+0000","last_became_active":"2024-09-13T05:10:40.884580+0000","last_became_peered":"2024-09-13T05:10:40.884580+0000","last_unstale":"2024-09-13T05:11:01.857281+0000","last_undegraded":"2024-09-13T05:11:01.857281+0000","last_fullsized":"2024-09-13T05:11:01.857281+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:00.074124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018982339999999999,"stat_sum":{"num_bytes":20395007,"num_objects":53,"num_object_clones":3,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":28,"num_read":5788,"num_read_kb":5831,"num_write":1027,"num_write_kb":4719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":2255641,"num_keys_recovered":18,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"64'434","reported_seq":1152,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.423499+0000","last_change":"2024-09-13T05:10:40.885332+0000","last_active":"2024-09-13T05:11:00.423499+0000","last_peered":"2024-09-13T05:11:00.423499+0000","last_clean":"2024-09-13T05:11:00.423499+0000","last_became_active":"2024-09-13T05:10:40.884585+0000","last_became_peered":"2024-09-13T05:10:40.884585+0000","last_unstale":"2024-09-13T05:11:00.423499+0000","last_undegraded":"2024-09-13T05:11:00.423499+0000","last_fullsized":"2024-09-13T05:11:00.423499+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:31:19.596080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001164273,"stat_sum":{"num_bytes":15786431,"num_objects":48,"num_object_clones":5,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":27,"num_read":2387,"num_read_kb":9626,"num_write":671,"num_write_kb":3996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":296075,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"65'262","reported_seq":1311,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.048224+0000","last_change":"2024-09-13T05:10:37.938278+0000","last_active":"2024-09-13T05:11:01.048224+0000","last_peered":"2024-09-13T05:11:01.048224+0000","last_clean":"2024-09-13T05:11:01.048224+0000","last_became_active":"2024-09-13T05:10:37.862703+0000","last_became_peered":"2024-09-13T05:10:37.862703+0000","last_unstale":"2024-09-13T05:11:01.048224+0000","last_undegraded":"2024-09-13T05:11:01.048224+0000","last_fullsized":"2024-09-13T05:11:01.048224+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:39.174909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009951719999999999,"stat_sum":{"num_bytes":34055444,"num_objects":57,"num_object_clones":3,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":26,"num_read":1787,"num_read_kb":13741,"num_write":280,"num_write_kb":6086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":569424,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"64'148","reported_seq":329,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.040582+0000","last_change":"2024-09-13T05:10:11.680757+0000","last_active":"2024-09-13T05:11:00.040582+0000","last_peered":"2024-09-13T05:11:00.040582+0000","last_clean":"2024-09-13T05:11:00.040582+0000","last_became_active":"2024-09-13T05:10:09.653444+0000","last_became_peered":"2024-09-13T05:10:09.653444+0000","last_unstale":"2024-09-13T05:11:00.040582+0000","last_undegraded":"2024-09-13T05:11:00.040582+0000","last_fullsized":"2024-09-13T05:11:00.040582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:17:06.303008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000625977,"stat_sum":{"num_bytes":9295811,"num_objects":57,"num_object_clones":6,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":31,"num_read":195,"num_read_kb":7053,"num_write":107,"num_write_kb":3358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"67'208","reported_seq":1099,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.835185+0000","last_change":"2024-09-13T05:10:40.884306+0000","last_active":"2024-09-13T05:11:01.835185+0000","last_peered":"2024-09-13T05:11:01.835185+0000","last_clean":"2024-09-13T05:11:01.835185+0000","last_became_active":"2024-09-13T05:10:40.883543+0000","last_became_peered":"2024-09-13T05:10:40.883543+0000","last_unstale":"2024-09-13T05:11:01.835185+0000","last_undegraded":"2024-09-13T05:11:01.835185+0000","last_fullsized":"2024-09-13T05:11:01.835185+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:14:23.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048307200000000003,"stat_sum":{"num_bytes":53973873,"num_objects":44,"num_object_clones":5,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":21,"num_read":1818,"num_read_kb":7340,"num_write":185,"num_write_kb":3595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":633324,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"67'356","reported_seq":1601,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.397658+0000","last_change":"2024-09-13T05:10:11.680877+0000","last_active":"2024-09-13T05:11:01.397658+0000","last_peered":"2024-09-13T05:11:01.397658+0000","last_clean":"2024-09-13T05:11:01.397658+0000","last_became_active":"2024-09-13T05:10:09.649053+0000","last_became_peered":"2024-09-13T05:10:09.649053+0000","last_unstale":"2024-09-13T05:11:01.397658+0000","last_undegraded":"2024-09-13T05:11:01.397658+0000","last_fullsized":"2024-09-13T05:11:01.397658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:14.770260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062821800000000005,"stat_sum":{"num_bytes":39067411,"num_objects":56,"num_object_clones":6,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":27,"num_read":2494,"num_read_kb":43344,"num_write":465,"num_write_kb":33407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":828801832,"num_objects":1577,"num_object_clones":144,"num_object_copies":3154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1577,"num_whiteouts":775,"num_read":66773,"num_read_kb":310212,"num_write":8142,"num_write_kb":209608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":677,"num_bytes_recovered":20204390,"num_keys_recovered":113,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":238682112,"data_stored":268010937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7357,"ondisk_log_size":7357,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101868,"kb_used_data":56764,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94269972,"statfs":{"total":96636764160,"available":96532451328,"internally_reserved":0,"allocated":58126336,"data_stored":64826958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.879}]},{"osd":1,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.95399999999999996}]},{"osd":2,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.337}]},{"osd":3,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.087}]},{"osd":4,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":1.05},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.131}]},{"osd":5,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.395},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.177}]},{"osd":6,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":1.29},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.2170000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57208,"kb_used_data":21944,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94314632,"statfs":{"total":96636764160,"available":96578183168,"internally_reserved":0,"allocated":22470656,"data_stored":24770797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36043207},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.89200000000000002}]},{"osd":1,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.72799999999999998}]},{"osd":2,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.876}]},{"osd":3,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.97999999999999998}]},{"osd":4,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.75900000000000001}]},{"osd":7,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.2390000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96640,"kb_used_data":57336,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94275200,"statfs":{"total":96636764160,"available":96537804800,"internally_reserved":0,"allocated":58712064,"data_stored":62961918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.282},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.71599999999999997}]},{"osd":1,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.1950000000000001}]},{"osd":2,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.82199999999999995}]},{"osd":3,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.236}]},{"osd":4,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.79800000000000004}]},{"osd":6,"last update":"Fri Sep 13 05:10:58 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":1.345},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.369}]},{"osd":7,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.413}]}]},{"osd":4,"up_from":0,"seq":55834574867,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85088,"kb_used_data":45696,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94286752,"statfs":{"total":96636764160,"available":96549634048,"internally_reserved":0,"allocated":46792704,"data_stored":52132422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.255},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.32500000000000001}]},{"osd":1,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.377},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.56100000000000005}]},{"osd":6,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.73599999999999999}]},{"osd":7,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.86099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70244,"kb_used_data":35032,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94301596,"statfs":{"total":96636764160,"available":96564834304,"internally_reserved":0,"allocated":35872768,"data_stored":39113870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.73299999999999998}]},{"osd":1,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.55100000000000005}]},{"osd":3,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.71599999999999997}]},{"osd":4,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.85899999999999999}]},{"osd":5,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.3380000000000001}]},{"osd":6,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.80500000000000005}]},{"osd":7,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.028},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.101}]}]},{"osd":1,"up_from":0,"seq":55834574865,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":0,"seq":55834574867,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10035200,"data_stored":11939429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6619136,"data_stored":10238144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":35090432,"data_stored":38762815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":47661056,"data_stored":53365093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":59215872,"data_stored":63840965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":22003712,"data_stored":24716757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":58056704,"data_stored":65147734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:11:05.944 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-13T05:11:05.944 INFO:teuthology.orchestra.run.smithi120.stdout:2636 writesame 0x984f74c thru 0x985178a data_size 0xd(0x203f bytes) 2024-09-13T05:11:05.944 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:11:05.944 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:11:05.947 INFO:teuthology.orchestra.run.smithi120.stdout:2637 read 0x128877f thru 0x128be86 (0x3708 bytes) 2024-09-13T05:11:05.959 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:05.959 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:05.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:05.959 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [] 2024-09-13T05:11:05.959 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:05.961 INFO:teuthology.orchestra.run.smithi120.stdout:2640 trunc from 0xda2f5bc to 0x60d13f5 2024-09-13T05:11:05.970 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:11:05.990 INFO:teuthology.orchestra.run.smithi120.stdout:2641 trunc from 0x60d13f5 to 0x4eb6a4 2024-09-13T05:11:06.033 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:06.029+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:06.042 INFO:teuthology.orchestra.run.smithi120.stdout:2642 writesame 0x9f77e70 thru 0x9f7b498 data_size 0x2f(0x3629 bytes) 2024-09-13T05:11:06.052 INFO:teuthology.orchestra.run.smithi120.stdout:2643 trunc from 0x9f7b499 to 0x32866db 2024-09-13T05:11:06.060 INFO:teuthology.orchestra.run.smithi120.stdout:2645 punch from 0x19061a to 0x1994db, (0x8ec1 bytes) 2024-09-13T05:11:06.060 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:06.061 INFO:teuthology.orchestra.run.smithi120.stdout:2647 punch from 0x7c5797 to 0x7d2809, (0xd072 bytes) 2024-09-13T05:11:06.062 INFO:teuthology.orchestra.run.smithi120.stdout:2648 trunc from 0x32866db to 0x4380241 2024-09-13T05:11:06.071 INFO:teuthology.orchestra.run.smithi120.stdout:2651 read 0x1775aee thru 0x17839a1 (0xdeb4 bytes) 2024-09-13T05:11:06.071 INFO:teuthology.orchestra.run.smithi120.stdout:2652 read 0x1ebfd44 thru 0x1ec9fc7 (0xa284 bytes) 2024-09-13T05:11:06.071 INFO:teuthology.orchestra.run.smithi120.stdout:2655 read 0x80be0b thru 0x81bc2e (0xfe24 bytes) 2024-09-13T05:11:06.071 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:06.072 INFO:teuthology.orchestra.run.smithi120.stdout:2657 writesame 0x351ad13 thru 0x3524faf data_size 0x7(0xa29d bytes) 2024-09-13T05:11:06.085 INFO:teuthology.orchestra.run.smithi120.stdout:2658 trunc from 0x4380241 to 0x5c66c94 2024-09-13T05:11:06.086 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is unset 2024-09-13T05:11:06.087 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:06.088 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:06.088 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:11:06.088 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:06.098 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:11:06.118 INFO:teuthology.orchestra.run.smithi120.stdout:2659 write 0xc8b5276 thru 0xc8c0dc9 (0xbb54 bytes) 2024-09-13T05:11:06.127 INFO:teuthology.orchestra.run.smithi120.stdout:2660 writesame 0xc303c96 thru 0xc30f52d data_size 0x58(0xb898 bytes) 2024-09-13T05:11:06.133 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:06.130+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:06.133 INFO:teuthology.orchestra.run.smithi120.stdout:2661 read 0xbd41fd3 thru 0xbd44b10 (0x2b3e bytes) 2024-09-13T05:11:06.134 INFO:teuthology.orchestra.run.smithi120.stdout:2662 write 0x422f35c thru 0x4239498 (0xa13d bytes) 2024-09-13T05:11:06.140 INFO:teuthology.orchestra.run.smithi120.stdout:2663 read 0xc4327c5 thru 0xc43eae5 (0xc321 bytes) 2024-09-13T05:11:06.154 INFO:teuthology.orchestra.run.smithi120.stdout:2664 write 0xe3b18be thru 0xe3be1b5 (0xc8f8 bytes) 2024-09-13T05:11:06.162 INFO:teuthology.orchestra.run.smithi120.stdout:2666 write 0xe0463af thru 0xe049695 (0x32e7 bytes) 2024-09-13T05:11:06.170 INFO:teuthology.orchestra.run.smithi120.stdout:2667 punch from 0xc0c8af5 to 0xc0cefd5, (0x64e0 bytes) 2024-09-13T05:11:06.170 INFO:teuthology.orchestra.run.smithi120.stdout:2668 write 0x827bb50 thru 0x827febd (0x436e bytes) 2024-09-13T05:11:06.177 INFO:teuthology.orchestra.run.smithi120.stdout:2669 read 0x5ac451 thru 0x5b89f4 (0xc5a4 bytes) 2024-09-13T05:11:06.177 INFO:teuthology.orchestra.run.smithi120.stdout:2670 punch from 0x78df0d1 to 0x78e7746, (0x8675 bytes) 2024-09-13T05:11:06.177 INFO:teuthology.orchestra.run.smithi120.stdout:2673 read 0xb1e15d5 thru 0xb1effb9 (0xe9e5 bytes) 2024-09-13T05:11:06.177 INFO:teuthology.orchestra.run.smithi120.stdout:2674 write 0xc0908 thru 0xc50df (0x47d8 bytes) 2024-09-13T05:11:06.180 INFO:teuthology.orchestra.run.smithi120.stdout:2677 punch from 0x4a3775e to 0x4a3aafe, (0x33a0 bytes) 2024-09-13T05:11:06.180 INFO:teuthology.orchestra.run.smithi120.stdout:2679 punch from 0x1505bd0 to 0x150b43f, (0x586f bytes) 2024-09-13T05:11:06.190 INFO:teuthology.orchestra.run.smithi120.stdout:2680 write 0xeaa43a6 thru 0xeaa899c (0x45f7 bytes) 2024-09-13T05:11:06.197 INFO:teuthology.orchestra.run.smithi120.stdout:2681 punch from 0x82ca130 to 0x82d4f28, (0xadf8 bytes) 2024-09-13T05:11:06.207 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:06.207 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:06.208 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:06.208 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:06.208 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:06.211 INFO:teuthology.orchestra.run.smithi120.stdout:2682 trunc from 0xeaa899d to 0x6e479f7 2024-09-13T05:11:06.218 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:11:06.233 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:06.233 INFO:teuthology.orchestra.run.smithi120.stdout:2686 read 0x32112df thru 0x3212e51 (0x1b73 bytes) 2024-09-13T05:11:06.233 INFO:teuthology.orchestra.run.smithi120.stdout:2688 read 0x63402be thru 0x634dc72 (0xd9b5 bytes) 2024-09-13T05:11:06.233 INFO:teuthology.orchestra.run.smithi120.stdout:2689 punch from 0x158888f to 0x15981b7, (0xf928 bytes) 2024-09-13T05:11:06.233 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:06.233 INFO:teuthology.orchestra.run.smithi120.stdout:2691 write 0x556c5c7 thru 0x557349c (0x6ed6 bytes) 2024-09-13T05:11:06.234 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:06.229+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:06.241 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:06.244 INFO:teuthology.orchestra.run.smithi120.stdout:2693 trunc from 0x6e479f7 to 0x50d4eb0 2024-09-13T05:11:06.262 INFO:teuthology.orchestra.run.smithi120.stdout:2694 punch from 0x453fc14 to 0x454c776, (0xcb62 bytes) 2024-09-13T05:11:06.276 INFO:teuthology.orchestra.run.smithi120.stdout:2695 write 0x6ec86dc thru 0x6ed77a6 (0xf0cb bytes) 2024-09-13T05:11:06.293 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:11:06.296 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:11:06.301 INFO:teuthology.orchestra.run.smithi120.stdout:2696 write 0xba006e2 thru 0xba0da4c (0xd36b bytes) 2024-09-13T05:11:06.309 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2024-09-13T05:11:06.181108+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":829392219,"num_objects":1581,"num_object_clones":144,"num_object_copies":3162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1581,"num_whiteouts":775,"num_read":66889,"num_read_kb":310312,"num_write":8303,"num_write_kb":212026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":680,"num_bytes_recovered":20794777,"num_keys_recovered":113,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7477,"ondisk_log_size":7477,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":411048,"kb_used_data":216772,"kb_used_omap":7,"kb_used_meta":194040,"kb_avail":471448152,"statfs":{"total":483183820800,"available":482762907648,"internally_reserved":0,"allocated":221974528,"data_stored":243805965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7962,"internal_metadata":198697190},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000752"},"pg_stats":[{"pgid":"3.1f","version":"67'189","reported_seq":694,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.094636+0000","last_change":"2024-09-13T05:10:37.993400+0000","last_active":"2024-09-13T05:11:01.094636+0000","last_peered":"2024-09-13T05:11:01.094636+0000","last_clean":"2024-09-13T05:11:01.094636+0000","last_became_active":"2024-09-13T05:10:37.864778+0000","last_became_peered":"2024-09-13T05:10:37.864778+0000","last_unstale":"2024-09-13T05:11:01.094636+0000","last_undegraded":"2024-09-13T05:11:01.094636+0000","last_fullsized":"2024-09-13T05:11:01.094636+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:56:24.801492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011835439999999999,"stat_sum":{"num_bytes":4389000,"num_objects":49,"num_object_clones":4,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":17,"num_read":895,"num_read_kb":2340,"num_write":165,"num_write_kb":1525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":297202,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"64'139","reported_seq":794,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.421406+0000","last_change":"2024-09-13T05:10:12.076857+0000","last_active":"2024-09-13T05:11:00.421406+0000","last_peered":"2024-09-13T05:11:00.421406+0000","last_clean":"2024-09-13T05:11:00.421406+0000","last_became_active":"2024-09-13T05:10:09.644293+0000","last_became_peered":"2024-09-13T05:10:09.644293+0000","last_unstale":"2024-09-13T05:11:00.421406+0000","last_undegraded":"2024-09-13T05:11:00.421406+0000","last_fullsized":"2024-09-13T05:11:00.421406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:45:32.561793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225439,"stat_sum":{"num_bytes":26028163,"num_objects":46,"num_object_clones":5,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":24,"num_read":1129,"num_read_kb":4025,"num_write":116,"num_write_kb":2180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"67'147","reported_seq":1245,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.908410+0000","last_change":"2024-09-13T05:10:11.645342+0000","last_active":"2024-09-13T05:11:01.908410+0000","last_peered":"2024-09-13T05:11:01.908410+0000","last_clean":"2024-09-13T05:11:01.908410+0000","last_became_active":"2024-09-13T05:10:09.645791+0000","last_became_peered":"2024-09-13T05:10:09.645791+0000","last_unstale":"2024-09-13T05:11:01.908410+0000","last_undegraded":"2024-09-13T05:11:01.908410+0000","last_fullsized":"2024-09-13T05:11:01.908410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:49.028553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072691800000000001,"stat_sum":{"num_bytes":40837266,"num_objects":59,"num_object_clones":8,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":24,"num_read":1117,"num_read_kb":7760,"num_write":113,"num_write_kb":3356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"67'449","reported_seq":1251,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.925981+0000","last_change":"2024-09-13T05:10:31.949427+0000","last_active":"2024-09-13T05:11:01.925981+0000","last_peered":"2024-09-13T05:11:01.925981+0000","last_clean":"2024-09-13T05:11:01.925981+0000","last_became_active":"2024-09-13T05:10:31.828206+0000","last_became_peered":"2024-09-13T05:10:31.828206+0000","last_unstale":"2024-09-13T05:11:01.925981+0000","last_undegraded":"2024-09-13T05:11:01.925981+0000","last_fullsized":"2024-09-13T05:11:01.925981+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:32:46.868249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078437299999999999,"stat_sum":{"num_bytes":30867520,"num_objects":41,"num_object_clones":3,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":15,"num_read":2915,"num_read_kb":4566,"num_write":623,"num_write_kb":7388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":372837,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"67'234","reported_seq":723,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.751378+0000","last_change":"2024-09-13T05:10:37.990899+0000","last_active":"2024-09-13T05:11:01.751378+0000","last_peered":"2024-09-13T05:11:01.751378+0000","last_clean":"2024-09-13T05:11:01.751378+0000","last_became_active":"2024-09-13T05:10:37.867842+0000","last_became_peered":"2024-09-13T05:10:37.867842+0000","last_unstale":"2024-09-13T05:11:01.751378+0000","last_undegraded":"2024-09-13T05:11:01.751378+0000","last_fullsized":"2024-09-13T05:11:01.751378+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:38:24.437617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065808499999999999,"stat_sum":{"num_bytes":4440526,"num_objects":48,"num_object_clones":3,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":25,"num_read":1266,"num_read_kb":3185,"num_write":242,"num_write_kb":1373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":612052,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"65'194","reported_seq":2466,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.889114+0000","last_change":"2024-09-13T05:10:37.948112+0000","last_active":"2024-09-13T05:11:01.889114+0000","last_peered":"2024-09-13T05:11:01.889114+0000","last_clean":"2024-09-13T05:11:01.889114+0000","last_became_active":"2024-09-13T05:10:37.863614+0000","last_became_peered":"2024-09-13T05:10:37.863614+0000","last_unstale":"2024-09-13T05:11:01.889114+0000","last_undegraded":"2024-09-13T05:11:01.889114+0000","last_fullsized":"2024-09-13T05:11:01.889114+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:15.873724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027226559999999999,"stat_sum":{"num_bytes":9899581,"num_objects":53,"num_object_clones":4,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":21,"num_read":2681,"num_read_kb":5294,"num_write":152,"num_write_kb":1883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":77,"num_bytes_recovered":1081937,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"66'484","reported_seq":2208,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.862641+0000","last_change":"2024-09-13T05:10:34.613940+0000","last_active":"2024-09-13T05:11:01.862641+0000","last_peered":"2024-09-13T05:11:01.862641+0000","last_clean":"2024-09-13T05:11:01.862641+0000","last_became_active":"2024-09-13T05:10:34.612579+0000","last_became_peered":"2024-09-13T05:10:34.612579+0000","last_unstale":"2024-09-13T05:11:01.862641+0000","last_undegraded":"2024-09-13T05:11:01.862641+0000","last_fullsized":"2024-09-13T05:11:01.862641+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:43.339882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067403999999999999,"stat_sum":{"num_bytes":48373122,"num_objects":50,"num_object_clones":7,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":22,"num_read":4088,"num_read_kb":12096,"num_write":671,"num_write_kb":2811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":248973,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"67'198","reported_seq":1138,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.886076+0000","last_change":"2024-09-13T05:10:37.929523+0000","last_active":"2024-09-13T05:11:01.886076+0000","last_peered":"2024-09-13T05:11:01.886076+0000","last_clean":"2024-09-13T05:11:01.886076+0000","last_became_active":"2024-09-13T05:10:37.865440+0000","last_became_peered":"2024-09-13T05:10:37.865440+0000","last_unstale":"2024-09-13T05:11:01.886076+0000","last_undegraded":"2024-09-13T05:11:01.886076+0000","last_fullsized":"2024-09-13T05:11:01.886076+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:30:31.875141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087399999999998,"stat_sum":{"num_bytes":18139977,"num_objects":52,"num_object_clones":4,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":31,"num_read":1081,"num_read_kb":11591,"num_write":199,"num_write_kb":5147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":1513234,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"67'143","reported_seq":825,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.846696+0000","last_change":"2024-09-13T05:10:37.920810+0000","last_active":"2024-09-13T05:11:01.846696+0000","last_peered":"2024-09-13T05:11:01.846696+0000","last_clean":"2024-09-13T05:11:01.846696+0000","last_became_active":"2024-09-13T05:10:37.864816+0000","last_became_peered":"2024-09-13T05:10:37.864816+0000","last_unstale":"2024-09-13T05:11:01.846696+0000","last_undegraded":"2024-09-13T05:11:01.846696+0000","last_fullsized":"2024-09-13T05:11:01.846696+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:06.315864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096598599999999995,"stat_sum":{"num_bytes":16928716,"num_objects":35,"num_object_clones":1,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":15,"num_read":1773,"num_read_kb":2041,"num_write":113,"num_write_kb":1049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":37802,"num_keys_recovered":23,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"64'188","reported_seq":1366,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.033805+0000","last_change":"2024-09-13T05:10:11.645211+0000","last_active":"2024-09-13T05:11:00.033805+0000","last_peered":"2024-09-13T05:11:00.033805+0000","last_clean":"2024-09-13T05:11:00.033805+0000","last_became_active":"2024-09-13T05:10:09.647763+0000","last_became_peered":"2024-09-13T05:10:09.647763+0000","last_unstale":"2024-09-13T05:11:00.033805+0000","last_undegraded":"2024-09-13T05:11:00.033805+0000","last_fullsized":"2024-09-13T05:11:00.033805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:43.426871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072236499999999999,"stat_sum":{"num_bytes":31859829,"num_objects":48,"num_object_clones":9,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":24,"num_read":1293,"num_read_kb":9309,"num_write":161,"num_write_kb":2710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"67'124","reported_seq":295,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.881240+0000","last_change":"2024-09-13T05:10:11.681217+0000","last_active":"2024-09-13T05:11:01.881240+0000","last_peered":"2024-09-13T05:11:01.881240+0000","last_clean":"2024-09-13T05:11:01.881240+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:11:01.881240+0000","last_undegraded":"2024-09-13T05:11:01.881240+0000","last_fullsized":"2024-09-13T05:11:01.881240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:40.457636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095533399999999996,"stat_sum":{"num_bytes":27119592,"num_objects":41,"num_object_clones":2,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":22,"num_read":287,"num_read_kb":2431,"num_write":119,"num_write_kb":2102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"64'166","reported_seq":3629,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.424104+0000","last_change":"2024-09-13T05:10:11.681365+0000","last_active":"2024-09-13T05:11:00.424104+0000","last_peered":"2024-09-13T05:11:00.424104+0000","last_clean":"2024-09-13T05:11:00.424104+0000","last_became_active":"2024-09-13T05:10:09.645823+0000","last_became_peered":"2024-09-13T05:10:09.645823+0000","last_unstale":"2024-09-13T05:11:00.424104+0000","last_undegraded":"2024-09-13T05:11:00.424104+0000","last_fullsized":"2024-09-13T05:11:00.424104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:24.367358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011047369999999999,"stat_sum":{"num_bytes":38597648,"num_objects":50,"num_object_clones":4,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":26,"num_read":3486,"num_read_kb":24836,"num_write":129,"num_write_kb":3900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.032514+0000","last_change":"2024-09-13T05:10:01.383891+0000","last_active":"2024-09-13T05:11:00.032514+0000","last_peered":"2024-09-13T05:11:00.032514+0000","last_clean":"2024-09-13T05:11:00.032514+0000","last_became_active":"2024-09-13T05:09:59.374793+0000","last_became_peered":"2024-09-13T05:09:59.374793+0000","last_unstale":"2024-09-13T05:11:00.032514+0000","last_undegraded":"2024-09-13T05:11:00.032514+0000","last_fullsized":"2024-09-13T05:11:00.032514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:02.499446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065068999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"65'146","reported_seq":4170,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.054958+0000","last_change":"2024-09-13T05:10:38.046833+0000","last_active":"2024-09-13T05:11:01.054958+0000","last_peered":"2024-09-13T05:11:01.054958+0000","last_clean":"2024-09-13T05:11:01.054958+0000","last_became_active":"2024-09-13T05:10:37.869206+0000","last_became_peered":"2024-09-13T05:10:37.869206+0000","last_unstale":"2024-09-13T05:11:01.054958+0000","last_undegraded":"2024-09-13T05:11:01.054958+0000","last_fullsized":"2024-09-13T05:11:01.054958+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:12.484134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099899699999999995,"stat_sum":{"num_bytes":28690323,"num_objects":43,"num_object_clones":5,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":21,"num_read":3113,"num_read_kb":7626,"num_write":117,"num_write_kb":5992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":5061662,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.032583+0000","last_change":"2024-09-13T05:10:31.826927+0000","last_active":"2024-09-13T05:11:00.032583+0000","last_peered":"2024-09-13T05:11:00.032583+0000","last_clean":"2024-09-13T05:11:00.032583+0000","last_became_active":"2024-09-13T05:10:31.826431+0000","last_became_peered":"2024-09-13T05:10:31.826431+0000","last_unstale":"2024-09-13T05:11:00.032583+0000","last_undegraded":"2024-09-13T05:11:00.032583+0000","last_fullsized":"2024-09-13T05:11:00.032583+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:13:36.678853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"66'179","reported_seq":1215,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.857817+0000","last_change":"2024-09-13T05:10:12.077111+0000","last_active":"2024-09-13T05:11:01.857817+0000","last_peered":"2024-09-13T05:11:01.857817+0000","last_clean":"2024-09-13T05:11:01.857817+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:11:01.857817+0000","last_undegraded":"2024-09-13T05:11:01.857817+0000","last_fullsized":"2024-09-13T05:11:01.857817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:37.976147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001460444,"stat_sum":{"num_bytes":51509824,"num_objects":59,"num_object_clones":5,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":33,"num_read":1164,"num_read_kb":9907,"num_write":155,"num_write_kb":2656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":71,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.040797+0000","last_change":"2024-09-13T05:10:37.866953+0000","last_active":"2024-09-13T05:11:00.040797+0000","last_peered":"2024-09-13T05:11:00.040797+0000","last_clean":"2024-09-13T05:11:00.040797+0000","last_became_active":"2024-09-13T05:10:37.866624+0000","last_became_peered":"2024-09-13T05:10:37.866624+0000","last_unstale":"2024-09-13T05:11:00.040797+0000","last_undegraded":"2024-09-13T05:11:00.040797+0000","last_fullsized":"2024-09-13T05:11:00.040797+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:56:20.077971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"65'127","reported_seq":329,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.059722+0000","last_change":"2024-09-13T05:10:32.017095+0000","last_active":"2024-09-13T05:11:01.059722+0000","last_peered":"2024-09-13T05:11:01.059722+0000","last_clean":"2024-09-13T05:11:01.059722+0000","last_became_active":"2024-09-13T05:10:31.829027+0000","last_became_peered":"2024-09-13T05:10:31.829027+0000","last_unstale":"2024-09-13T05:11:01.059722+0000","last_undegraded":"2024-09-13T05:11:01.059722+0000","last_fullsized":"2024-09-13T05:11:01.059722+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:36:33.938992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076234800000000004,"stat_sum":{"num_bytes":12517204,"num_objects":53,"num_object_clones":3,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":27,"num_read":139,"num_read_kb":1296,"num_write":95,"num_write_kb":1563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":263489,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.041019+0000","last_change":"2024-09-13T05:10:37.864940+0000","last_active":"2024-09-13T05:11:00.041019+0000","last_peered":"2024-09-13T05:11:00.041019+0000","last_clean":"2024-09-13T05:11:00.041019+0000","last_became_active":"2024-09-13T05:10:37.864623+0000","last_became_peered":"2024-09-13T05:10:37.864623+0000","last_unstale":"2024-09-13T05:11:00.041019+0000","last_undegraded":"2024-09-13T05:11:00.041019+0000","last_fullsized":"2024-09-13T05:11:00.041019+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:41.598490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.5","version":"67'220","reported_seq":1690,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.399077+0000","last_change":"2024-09-13T05:10:11.645960+0000","last_active":"2024-09-13T05:11:01.399077+0000","last_peered":"2024-09-13T05:11:01.399077+0000","last_clean":"2024-09-13T05:11:01.399077+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:11:01.399077+0000","last_undegraded":"2024-09-13T05:11:01.399077+0000","last_fullsized":"2024-09-13T05:11:01.399077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:40.372741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001054028,"stat_sum":{"num_bytes":67269626,"num_objects":54,"num_object_clones":4,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":20,"num_read":2292,"num_read_kb":43887,"num_write":209,"num_write_kb":35933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"67'165","reported_seq":1717,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.770007+0000","last_change":"2024-09-13T05:10:37.979816+0000","last_active":"2024-09-13T05:11:01.770007+0000","last_peered":"2024-09-13T05:11:01.770007+0000","last_clean":"2024-09-13T05:11:01.770007+0000","last_became_active":"2024-09-13T05:10:37.863256+0000","last_became_peered":"2024-09-13T05:10:37.863256+0000","last_unstale":"2024-09-13T05:11:01.770007+0000","last_undegraded":"2024-09-13T05:11:01.770007+0000","last_fullsized":"2024-09-13T05:11:01.770007+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:58:55.928356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099335200000000008,"stat_sum":{"num_bytes":52929688,"num_objects":48,"num_object_clones":5,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":27,"num_read":1724,"num_read_kb":16780,"num_write":145,"num_write_kb":22833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":214109,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":77,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.033288+0000","last_change":"2024-09-13T05:10:31.836193+0000","last_active":"2024-09-13T05:11:00.033288+0000","last_peered":"2024-09-13T05:11:00.033288+0000","last_clean":"2024-09-13T05:11:00.033288+0000","last_became_active":"2024-09-13T05:10:31.825663+0000","last_became_peered":"2024-09-13T05:10:31.825663+0000","last_unstale":"2024-09-13T05:11:00.033288+0000","last_undegraded":"2024-09-13T05:11:00.033288+0000","last_fullsized":"2024-09-13T05:11:00.033288+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:38:23.311570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"65'244","reported_seq":398,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.421631+0000","last_change":"2024-09-13T05:10:31.893494+0000","last_active":"2024-09-13T05:11:00.421631+0000","last_peered":"2024-09-13T05:11:00.421631+0000","last_clean":"2024-09-13T05:11:00.421631+0000","last_became_active":"2024-09-13T05:10:31.827657+0000","last_became_peered":"2024-09-13T05:10:31.827657+0000","last_unstale":"2024-09-13T05:11:00.421631+0000","last_undegraded":"2024-09-13T05:11:00.421631+0000","last_fullsized":"2024-09-13T05:11:00.421631+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:16:14.432049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045163499999999998,"stat_sum":{"num_bytes":4145771,"num_objects":42,"num_object_clones":4,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":20,"num_read":744,"num_read_kb":637,"num_write":306,"num_write_kb":902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":84179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.037290+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:11:00.037290+0000","last_peered":"2024-09-13T05:11:00.037290+0000","last_clean":"2024-09-13T05:11:00.037290+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:11:00.037290+0000","last_undegraded":"2024-09-13T05:11:00.037290+0000","last_fullsized":"2024-09-13T05:11:00.037290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"65'124","reported_seq":407,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.421970+0000","last_change":"2024-09-13T05:10:38.111510+0000","last_active":"2024-09-13T05:11:00.421970+0000","last_peered":"2024-09-13T05:11:00.421970+0000","last_clean":"2024-09-13T05:11:00.421970+0000","last_became_active":"2024-09-13T05:10:37.869040+0000","last_became_peered":"2024-09-13T05:10:37.869040+0000","last_unstale":"2024-09-13T05:11:00.421970+0000","last_undegraded":"2024-09-13T05:11:00.421970+0000","last_fullsized":"2024-09-13T05:11:00.421970+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:48:18.385423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048152600000000002,"stat_sum":{"num_bytes":9454547,"num_objects":37,"num_object_clones":4,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":21,"num_read":209,"num_read_kb":5190,"num_write":97,"num_write_kb":3257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":383717,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":79,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.040379+0000","last_change":"2024-09-13T05:10:37.865514+0000","last_active":"2024-09-13T05:11:00.040379+0000","last_peered":"2024-09-13T05:11:00.040379+0000","last_clean":"2024-09-13T05:11:00.040379+0000","last_became_active":"2024-09-13T05:10:37.864299+0000","last_became_peered":"2024-09-13T05:10:37.864299+0000","last_unstale":"2024-09-13T05:11:00.040379+0000","last_undegraded":"2024-09-13T05:11:00.040379+0000","last_fullsized":"2024-09-13T05:11:00.040379+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:45:58.276509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"64'109","reported_seq":209,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.422307+0000","last_change":"2024-09-13T05:10:12.075510+0000","last_active":"2024-09-13T05:11:00.422307+0000","last_peered":"2024-09-13T05:11:00.422307+0000","last_clean":"2024-09-13T05:11:00.422307+0000","last_became_active":"2024-09-13T05:10:09.646353+0000","last_became_peered":"2024-09-13T05:10:09.646353+0000","last_unstale":"2024-09-13T05:11:00.422307+0000","last_undegraded":"2024-09-13T05:11:00.422307+0000","last_fullsized":"2024-09-13T05:11:00.422307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:54:58.706032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059320200000000003,"stat_sum":{"num_bytes":1948860,"num_objects":51,"num_object_clones":4,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":26,"num_read":101,"num_read_kb":1857,"num_write":77,"num_write_kb":1399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":64,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.033268+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:11:00.033268+0000","last_peered":"2024-09-13T05:11:00.033268+0000","last_clean":"2024-09-13T05:11:00.033268+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:11:00.033268+0000","last_undegraded":"2024-09-13T05:11:00.033268+0000","last_fullsized":"2024-09-13T05:11:00.033268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":232,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.041124+0000","last_change":"2024-09-13T05:10:40.886011+0000","last_active":"2024-09-13T05:11:00.041124+0000","last_peered":"2024-09-13T05:11:00.041124+0000","last_clean":"2024-09-13T05:11:00.041124+0000","last_became_active":"2024-09-13T05:10:40.885587+0000","last_became_peered":"2024-09-13T05:10:40.885587+0000","last_unstale":"2024-09-13T05:11:00.041124+0000","last_undegraded":"2024-09-13T05:11:00.041124+0000","last_fullsized":"2024-09-13T05:11:00.041124+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:52:47.632734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"66'136","reported_seq":323,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.248143+0000","last_change":"2024-09-13T05:10:31.888827+0000","last_active":"2024-09-13T05:11:01.248143+0000","last_peered":"2024-09-13T05:11:01.248143+0000","last_clean":"2024-09-13T05:11:01.248143+0000","last_became_active":"2024-09-13T05:10:31.827016+0000","last_became_peered":"2024-09-13T05:10:31.827016+0000","last_unstale":"2024-09-13T05:11:01.248143+0000","last_undegraded":"2024-09-13T05:11:01.248143+0000","last_fullsized":"2024-09-13T05:11:01.248143+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:47.525525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000500144,"stat_sum":{"num_bytes":4384406,"num_objects":59,"num_object_clones":6,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":33,"num_read":147,"num_read_kb":907,"num_write":104,"num_write_kb":23880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":58925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"67'186","reported_seq":5767,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.505141+0000","last_change":"2024-09-13T05:10:11.648218+0000","last_active":"2024-09-13T05:11:01.505141+0000","last_peered":"2024-09-13T05:11:01.505141+0000","last_clean":"2024-09-13T05:11:01.505141+0000","last_became_active":"2024-09-13T05:10:09.645408+0000","last_became_peered":"2024-09-13T05:10:09.645408+0000","last_unstale":"2024-09-13T05:11:01.505141+0000","last_undegraded":"2024-09-13T05:11:01.505141+0000","last_fullsized":"2024-09-13T05:11:01.505141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:59.846981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097828900000000002,"stat_sum":{"num_bytes":19349938,"num_objects":45,"num_object_clones":2,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":20,"num_read":6816,"num_read_kb":18673,"num_write":149,"num_write_kb":4908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"67'304","reported_seq":8372,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.098654+0000","last_change":"2024-09-13T05:10:47.940550+0000","last_active":"2024-09-13T05:11:01.098654+0000","last_peered":"2024-09-13T05:11:01.098654+0000","last_clean":"2024-09-13T05:11:01.098654+0000","last_became_active":"2024-09-13T05:10:47.939220+0000","last_became_peered":"2024-09-13T05:10:47.939220+0000","last_unstale":"2024-09-13T05:11:01.098654+0000","last_undegraded":"2024-09-13T05:11:01.098654+0000","last_fullsized":"2024-09-13T05:11:01.098654+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:59.693041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013204619999999999,"stat_sum":{"num_bytes":5351971,"num_objects":49,"num_object_clones":5,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":28,"num_read":8570,"num_read_kb":11898,"num_write":340,"num_write_kb":4978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":59,"num_bytes_recovered":6203954,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"67'155","reported_seq":1110,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.890342+0000","last_change":"2024-09-13T05:10:38.007507+0000","last_active":"2024-09-13T05:11:01.890342+0000","last_peered":"2024-09-13T05:11:01.890342+0000","last_clean":"2024-09-13T05:11:01.890342+0000","last_became_active":"2024-09-13T05:10:37.868643+0000","last_became_peered":"2024-09-13T05:10:37.868643+0000","last_unstale":"2024-09-13T05:11:01.890342+0000","last_undegraded":"2024-09-13T05:11:01.890342+0000","last_fullsized":"2024-09-13T05:11:01.890342+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:29:05.387242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055343700000000005,"stat_sum":{"num_bytes":11747878,"num_objects":51,"num_object_clones":6,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":29,"num_read":901,"num_read_kb":603,"num_write":116,"num_write_kb":1684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":15854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"66'97","reported_seq":327,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.863798+0000","last_change":"2024-09-13T05:10:11.647302+0000","last_active":"2024-09-13T05:11:01.863798+0000","last_peered":"2024-09-13T05:11:01.863798+0000","last_clean":"2024-09-13T05:11:01.863798+0000","last_became_active":"2024-09-13T05:10:09.647037+0000","last_became_peered":"2024-09-13T05:10:09.647037+0000","last_unstale":"2024-09-13T05:11:01.863798+0000","last_undegraded":"2024-09-13T05:11:01.863798+0000","last_fullsized":"2024-09-13T05:11:01.863798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:54:17.061326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069994199999999995,"stat_sum":{"num_bytes":22347761,"num_objects":40,"num_object_clones":3,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":19,"num_read":223,"num_read_kb":2901,"num_write":80,"num_write_kb":2190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"67'451","reported_seq":3106,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.900222+0000","last_change":"2024-09-13T05:10:11.682463+0000","last_active":"2024-09-13T05:11:01.900222+0000","last_peered":"2024-09-13T05:11:01.900222+0000","last_clean":"2024-09-13T05:11:01.900222+0000","last_became_active":"2024-09-13T05:10:09.647600+0000","last_became_peered":"2024-09-13T05:10:09.647600+0000","last_unstale":"2024-09-13T05:11:01.900222+0000","last_undegraded":"2024-09-13T05:11:01.900222+0000","last_fullsized":"2024-09-13T05:11:01.900222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:20:16.632365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019283150000000001,"stat_sum":{"num_bytes":67099118,"num_objects":59,"num_object_clones":6,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":25,"num_read":4150,"num_read_kb":11641,"num_write":614,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"67'651","reported_seq":4642,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.857281+0000","last_change":"2024-09-13T05:10:40.887883+0000","last_active":"2024-09-13T05:11:01.857281+0000","last_peered":"2024-09-13T05:11:01.857281+0000","last_clean":"2024-09-13T05:11:01.857281+0000","last_became_active":"2024-09-13T05:10:40.884580+0000","last_became_peered":"2024-09-13T05:10:40.884580+0000","last_unstale":"2024-09-13T05:11:01.857281+0000","last_undegraded":"2024-09-13T05:11:01.857281+0000","last_fullsized":"2024-09-13T05:11:01.857281+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:00.074124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018982339999999999,"stat_sum":{"num_bytes":20395007,"num_objects":53,"num_object_clones":3,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":28,"num_read":5788,"num_read_kb":5831,"num_write":1027,"num_write_kb":4719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":2255641,"num_keys_recovered":18,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"64'434","reported_seq":1152,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.423499+0000","last_change":"2024-09-13T05:10:40.885332+0000","last_active":"2024-09-13T05:11:00.423499+0000","last_peered":"2024-09-13T05:11:00.423499+0000","last_clean":"2024-09-13T05:11:00.423499+0000","last_became_active":"2024-09-13T05:10:40.884585+0000","last_became_peered":"2024-09-13T05:10:40.884585+0000","last_unstale":"2024-09-13T05:11:00.423499+0000","last_undegraded":"2024-09-13T05:11:00.423499+0000","last_fullsized":"2024-09-13T05:11:00.423499+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:31:19.596080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001164273,"stat_sum":{"num_bytes":15786431,"num_objects":48,"num_object_clones":5,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":27,"num_read":2387,"num_read_kb":9626,"num_write":671,"num_write_kb":3996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":296075,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"65'262","reported_seq":1311,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.048224+0000","last_change":"2024-09-13T05:10:37.938278+0000","last_active":"2024-09-13T05:11:01.048224+0000","last_peered":"2024-09-13T05:11:01.048224+0000","last_clean":"2024-09-13T05:11:01.048224+0000","last_became_active":"2024-09-13T05:10:37.862703+0000","last_became_peered":"2024-09-13T05:10:37.862703+0000","last_unstale":"2024-09-13T05:11:01.048224+0000","last_undegraded":"2024-09-13T05:11:01.048224+0000","last_fullsized":"2024-09-13T05:11:01.048224+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:39.174909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009951719999999999,"stat_sum":{"num_bytes":34055444,"num_objects":57,"num_object_clones":3,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":26,"num_read":1787,"num_read_kb":13741,"num_write":280,"num_write_kb":6086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":569424,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"64'148","reported_seq":329,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T05:11:00.040582+0000","last_change":"2024-09-13T05:10:11.680757+0000","last_active":"2024-09-13T05:11:00.040582+0000","last_peered":"2024-09-13T05:11:00.040582+0000","last_clean":"2024-09-13T05:11:00.040582+0000","last_became_active":"2024-09-13T05:10:09.653444+0000","last_became_peered":"2024-09-13T05:10:09.653444+0000","last_unstale":"2024-09-13T05:11:00.040582+0000","last_undegraded":"2024-09-13T05:11:00.040582+0000","last_fullsized":"2024-09-13T05:11:00.040582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:17:06.303008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000625977,"stat_sum":{"num_bytes":9295811,"num_objects":57,"num_object_clones":6,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":31,"num_read":195,"num_read_kb":7053,"num_write":107,"num_write_kb":3358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"67'208","reported_seq":1099,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.835185+0000","last_change":"2024-09-13T05:10:40.884306+0000","last_active":"2024-09-13T05:11:01.835185+0000","last_peered":"2024-09-13T05:11:01.835185+0000","last_clean":"2024-09-13T05:11:01.835185+0000","last_became_active":"2024-09-13T05:10:40.883543+0000","last_became_peered":"2024-09-13T05:10:40.883543+0000","last_unstale":"2024-09-13T05:11:01.835185+0000","last_undegraded":"2024-09-13T05:11:01.835185+0000","last_fullsized":"2024-09-13T05:11:01.835185+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:14:23.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048307200000000003,"stat_sum":{"num_bytes":53973873,"num_objects":44,"num_object_clones":5,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":21,"num_read":1818,"num_read_kb":7340,"num_write":185,"num_write_kb":3595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":633324,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"67'356","reported_seq":1601,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T05:11:01.397658+0000","last_change":"2024-09-13T05:10:11.680877+0000","last_active":"2024-09-13T05:11:01.397658+0000","last_peered":"2024-09-13T05:11:01.397658+0000","last_clean":"2024-09-13T05:11:01.397658+0000","last_became_active":"2024-09-13T05:10:09.649053+0000","last_became_peered":"2024-09-13T05:10:09.649053+0000","last_unstale":"2024-09-13T05:11:01.397658+0000","last_undegraded":"2024-09-13T05:11:01.397658+0000","last_fullsized":"2024-09-13T05:11:01.397658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:14.770260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062821800000000005,"stat_sum":{"num_bytes":39067411,"num_objects":56,"num_object_clones":6,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":27,"num_read":2494,"num_read_kb":43344,"num_write":465,"num_write_kb":33407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":828801832,"num_objects":1577,"num_object_clones":144,"num_object_copies":3154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1577,"num_whiteouts":775,"num_read":66773,"num_read_kb":310212,"num_write":8142,"num_write_kb":209608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":677,"num_bytes_recovered":20204390,"num_keys_recovered":113,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":238682112,"data_stored":268010937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7357,"ondisk_log_size":7357,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101868,"kb_used_data":56764,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94269972,"statfs":{"total":96636764160,"available":96532451328,"internally_reserved":0,"allocated":58126336,"data_stored":64826958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.879}]},{"osd":1,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.95399999999999996}]},{"osd":2,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.337}]},{"osd":3,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.087}]},{"osd":4,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":1.05},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.131}]},{"osd":5,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.395},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.177}]},{"osd":6,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":1.29},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.2170000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57208,"kb_used_data":21944,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94314632,"statfs":{"total":96636764160,"available":96578183168,"internally_reserved":0,"allocated":22470656,"data_stored":24770797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36043207},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.89200000000000002}]},{"osd":1,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.72799999999999998}]},{"osd":2,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.876}]},{"osd":3,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.97999999999999998}]},{"osd":4,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.75900000000000001}]},{"osd":7,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.2390000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96640,"kb_used_data":57336,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94275200,"statfs":{"total":96636764160,"available":96537804800,"internally_reserved":0,"allocated":58712064,"data_stored":62961918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.282},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.71599999999999997}]},{"osd":1,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.1950000000000001}]},{"osd":2,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.82199999999999995}]},{"osd":3,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.236}]},{"osd":4,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.79800000000000004}]},{"osd":6,"last update":"Fri Sep 13 05:10:58 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":1.345},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.369}]},{"osd":7,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.413}]}]},{"osd":4,"up_from":0,"seq":55834574867,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85088,"kb_used_data":45696,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94286752,"statfs":{"total":96636764160,"available":96549634048,"internally_reserved":0,"allocated":46792704,"data_stored":52132422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.255},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.32500000000000001}]},{"osd":1,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.377},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.56100000000000005}]},{"osd":6,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.73599999999999999}]},{"osd":7,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.86099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70244,"kb_used_data":35032,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94301596,"statfs":{"total":96636764160,"available":96564834304,"internally_reserved":0,"allocated":35872768,"data_stored":39113870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.73299999999999998}]},{"osd":1,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.55100000000000005}]},{"osd":3,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.71599999999999997}]},{"osd":4,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.85899999999999999}]},{"osd":5,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.3380000000000001}]},{"osd":6,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.80500000000000005}]},{"osd":7,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.028},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.101}]}]},{"osd":1,"up_from":0,"seq":55834574865,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":0,"seq":55834574867,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10035200,"data_stored":11939429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6619136,"data_stored":10238144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":35090432,"data_stored":38762815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":47661056,"data_stored":53365093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":59215872,"data_stored":63840965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":22003712,"data_stored":24716757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":58056704,"data_stored":65147734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:11:06.312 INFO:teuthology.orchestra.run.smithi120.stdout:2697 read 0x4e14502 thru 0x4e1bc74 (0x7773 bytes) 2024-09-13T05:11:06.313 INFO:teuthology.orchestra.run.smithi120.stdout:2700 read 0x990dccb thru 0x9910adb (0x2e11 bytes) 2024-09-13T05:11:06.313 INFO:teuthology.orchestra.run.smithi120.stdout:2701 read 0x1a6e14a thru 0x1a7961d (0xb4d4 bytes) 2024-09-13T05:11:06.313 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:06.313 INFO:teuthology.orchestra.run.smithi120.stdout:2703 punch from 0xb8d4c12 to 0xb8dd418, (0x8806 bytes) 2024-09-13T05:11:06.313 INFO:teuthology.orchestra.run.smithi120.stdout:2704 read 0x9bfa962 thru 0x9bfdf1b (0x35ba bytes) 2024-09-13T05:11:06.313 INFO:teuthology.orchestra.run.smithi120.stdout:2705 read 0xb455e9 thru 0xb50a89 (0xb4a1 bytes) 2024-09-13T05:11:06.313 INFO:teuthology.orchestra.run.smithi120.stdout:2706 write 0x2c7c5f1 thru 0x2c7d29b (0xcab bytes) 2024-09-13T05:11:06.316 INFO:teuthology.orchestra.run.smithi120.stdout:2707 write 0x1409892 thru 0x1416d73 (0xd4e2 bytes) 2024-09-13T05:11:06.334 INFO:teuthology.orchestra.run.smithi120.stdout:2708 trunc from 0xba0da4d to 0x5ea7bf4 2024-09-13T05:11:06.335 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:06.329+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:06.354 INFO:teuthology.orchestra.run.smithi120.stdout:2709 read 0xa5625f thru 0xa5885a (0x25fc bytes) 2024-09-13T05:11:06.359 INFO:teuthology.orchestra.run.smithi120.stdout:2711 trunc from 0x5ea7bf4 to 0x8862811 2024-09-13T05:11:06.374 INFO:teuthology.orchestra.run.smithi120.stdout:2713 writesame 0x47c8d19 thru 0x47c994c data_size 0x4(0xc34 bytes) 2024-09-13T05:11:06.378 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:06.378 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:06.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:06.378 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:06.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.378 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47581 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15532032~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:06.379 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.439908+0000", 2024-09-13T05:11:06.379 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.934169968999999, 2024-09-13T05:11:06.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031694137999999997, 2024-09-13T05:11:06.379 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:06.379 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:06.379 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:06.379 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:06.379 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:06.379 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47581 2024-09-13T05:11:06.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.379 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:06.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:06.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439908+0000", 2024-09-13T05:11:06.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.380 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:06.380 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439908+0000", 2024-09-13T05:11:06.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.380 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:06.380 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439907+0000", 2024-09-13T05:11:06.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:06.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.381 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:06.381 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439911+0000", 2024-09-13T05:11:06.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6370000000000001e-06 2024-09-13T05:11:06.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.381 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:06.381 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439923+0000", 2024-09-13T05:11:06.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.217e-05 2024-09-13T05:11:06.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:06.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439933+0000", 2024-09-13T05:11:06.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0273e-05 2024-09-13T05:11:06.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:06.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.471000+0000", 2024-09-13T05:11:06.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031067230000000001 2024-09-13T05:11:06.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:06.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.471092+0000", 2024-09-13T05:11:06.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1916000000000006e-05 2024-09-13T05:11:06.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:06.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.471602+0000", 2024-09-13T05:11:06.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00050951200000000005 2024-09-13T05:11:06.383 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.383 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:06.383 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.384 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47582 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15826944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:06.384 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.439939+0000", 2024-09-13T05:11:06.384 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.934138436, 2024-09-13T05:11:06.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032266203, 2024-09-13T05:11:06.384 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:06.384 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:06.384 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:06.384 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:06.384 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:06.384 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47582 2024-09-13T05:11:06.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.385 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:06.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:06.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439939+0000", 2024-09-13T05:11:06.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:06.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439939+0000", 2024-09-13T05:11:06.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:06.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439939+0000", 2024-09-13T05:11:06.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:06.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:06.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439949+0000", 2024-09-13T05:11:06.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0906e-05 2024-09-13T05:11:06.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:06.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439962+0000", 2024-09-13T05:11:06.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2373e-05 2024-09-13T05:11:06.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:06.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439969+0000", 2024-09-13T05:11:06.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0570000000000004e-06 2024-09-13T05:11:06.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:06.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.471645+0000", 2024-09-13T05:11:06.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031676530000000001 2024-09-13T05:11:06.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:06.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.471775+0000", 2024-09-13T05:11:06.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000129591 2024-09-13T05:11:06.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.388 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:06.388 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472205+0000", 2024-09-13T05:11:06.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00043034900000000001 2024-09-13T05:11:06.388 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.388 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:06.388 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.388 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47583 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16121856~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:06.389 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.439975+0000", 2024-09-13T05:11:06.389 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.93410263, 2024-09-13T05:11:06.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032777897, 2024-09-13T05:11:06.389 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:06.389 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:06.389 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:06.389 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:06.389 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:06.389 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47583 2024-09-13T05:11:06.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.389 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:06.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:06.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439975+0000", 2024-09-13T05:11:06.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:06.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439975+0000", 2024-09-13T05:11:06.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:06.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439974+0000", 2024-09-13T05:11:06.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:06.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.391 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:06.391 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439978+0000", 2024-09-13T05:11:06.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5729999999999999e-06 2024-09-13T05:11:06.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.391 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:06.391 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439991+0000", 2024-09-13T05:11:06.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3465999999999999e-05 2024-09-13T05:11:06.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.391 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:06.391 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439998+0000", 2024-09-13T05:11:06.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8369999999999999e-06 2024-09-13T05:11:06.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.392 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.392 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:06.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472272+0000", 2024-09-13T05:11:06.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032273617999999997 2024-09-13T05:11:06.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.392 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.392 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:06.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472382+0000", 2024-09-13T05:11:06.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000109845 2024-09-13T05:11:06.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.392 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.392 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:06.393 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472753+0000", 2024-09-13T05:11:06.393 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00037116100000000001 2024-09-13T05:11:06.393 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.393 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:06.393 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.393 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.393 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.393 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47584 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16416768~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:06.393 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440004+0000", 2024-09-13T05:11:06.393 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.934073564, 2024-09-13T05:11:06.393 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033357242000000002, 2024-09-13T05:11:06.393 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:06.393 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:06.394 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:06.394 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:06.394 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:06.394 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47584 2024-09-13T05:11:06.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.394 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:06.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:06.394 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440004+0000", 2024-09-13T05:11:06.394 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:06.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440004+0000", 2024-09-13T05:11:06.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:06.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440003+0000", 2024-09-13T05:11:06.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:06.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:06.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440007+0000", 2024-09-13T05:11:06.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9099999999999998e-06 2024-09-13T05:11:06.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:06.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440020+0000", 2024-09-13T05:11:06.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2330000000000001e-05 2024-09-13T05:11:06.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:06.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440026+0000", 2024-09-13T05:11:06.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7700000000000004e-06 2024-09-13T05:11:06.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:06.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472807+0000", 2024-09-13T05:11:06.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032780431999999998 2024-09-13T05:11:06.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.397 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:06.397 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472927+0000", 2024-09-13T05:11:06.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000119645 2024-09-13T05:11:06.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.397 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:06.397 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473361+0000", 2024-09-13T05:11:06.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000434745 2024-09-13T05:11:06.397 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.397 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:06.398 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.398 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.398 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.398 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47585 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16711680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:06.398 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440033+0000", 2024-09-13T05:11:06.398 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.934045028, 2024-09-13T05:11:06.398 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033917665999999999, 2024-09-13T05:11:06.398 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:06.398 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:06.398 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:06.398 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:06.398 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:06.398 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47585 2024-09-13T05:11:06.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.399 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:06.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:06.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440033+0000", 2024-09-13T05:11:06.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:06.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440033+0000", 2024-09-13T05:11:06.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:06.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440032+0000", 2024-09-13T05:11:06.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:06.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:06.400 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440036+0000", 2024-09-13T05:11:06.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.676e-06 2024-09-13T05:11:06.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:06.400 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440049+0000", 2024-09-13T05:11:06.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3142999999999999e-05 2024-09-13T05:11:06.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:06.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440056+0000", 2024-09-13T05:11:06.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.827e-06 2024-09-13T05:11:06.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:06.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473451+0000", 2024-09-13T05:11:06.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033395344 2024-09-13T05:11:06.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:06.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473565+0000", 2024-09-13T05:11:06.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011377700000000001 2024-09-13T05:11:06.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.402 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:06.402 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473950+0000", 2024-09-13T05:11:06.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00038550200000000002 2024-09-13T05:11:06.402 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.402 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:06.402 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.402 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47589 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15564800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:06.402 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440062+0000", 2024-09-13T05:11:06.402 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.934016042, 2024-09-13T05:11:06.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034520812999999997, 2024-09-13T05:11:06.402 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:06.403 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:06.403 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:06.403 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:06.403 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:06.403 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47589 2024-09-13T05:11:06.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.403 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:06.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.403 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:06.403 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440062+0000", 2024-09-13T05:11:06.403 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.403 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:06.404 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440062+0000", 2024-09-13T05:11:06.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.404 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:06.404 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440061+0000", 2024-09-13T05:11:06.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:06.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.404 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:06.404 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440064+0000", 2024-09-13T05:11:06.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4029999999999999e-06 2024-09-13T05:11:06.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.405 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:06.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440072+0000", 2024-09-13T05:11:06.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.79e-06 2024-09-13T05:11:06.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.405 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:06.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440079+0000", 2024-09-13T05:11:06.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.81e-06 2024-09-13T05:11:06.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.405 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:06.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474016+0000", 2024-09-13T05:11:06.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033936858 2024-09-13T05:11:06.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:06.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474143+0000", 2024-09-13T05:11:06.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012673599999999999 2024-09-13T05:11:06.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:06.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474582+0000", 2024-09-13T05:11:06.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00043982199999999998 2024-09-13T05:11:06.406 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.406 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:06.406 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.407 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47590 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15859712~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:06.407 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440085+0000", 2024-09-13T05:11:06.407 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.933993099, 2024-09-13T05:11:06.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035003000999999999, 2024-09-13T05:11:06.407 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:06.407 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:06.407 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:06.407 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:06.407 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:06.407 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47590 2024-09-13T05:11:06.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.407 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:06.407 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.407 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:06.408 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440085+0000", 2024-09-13T05:11:06.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.408 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.408 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:06.408 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440085+0000", 2024-09-13T05:11:06.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.408 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.408 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:06.408 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440084+0000", 2024-09-13T05:11:06.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:06.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.409 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:06.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440088+0000", 2024-09-13T05:11:06.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7759999999999999e-06 2024-09-13T05:11:06.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.409 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:06.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440100+0000", 2024-09-13T05:11:06.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2537e-05 2024-09-13T05:11:06.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.409 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:06.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440107+0000", 2024-09-13T05:11:06.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.046e-06 2024-09-13T05:11:06.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.410 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:06.410 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474648+0000", 2024-09-13T05:11:06.410 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034540803000000002 2024-09-13T05:11:06.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.410 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:06.410 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474721+0000", 2024-09-13T05:11:06.410 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2890000000000002e-05 2024-09-13T05:11:06.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.410 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:06.410 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475088+0000", 2024-09-13T05:11:06.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00036654199999999997 2024-09-13T05:11:06.411 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.411 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:06.411 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.411 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47591 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16154624~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:06.411 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440113+0000", 2024-09-13T05:11:06.411 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.933964523, 2024-09-13T05:11:06.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035632759, 2024-09-13T05:11:06.411 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:06.411 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:06.411 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:06.411 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:06.411 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:06.412 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47591 2024-09-13T05:11:06.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.412 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:06.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:06.412 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440113+0000", 2024-09-13T05:11:06.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:06.412 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440113+0000", 2024-09-13T05:11:06.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:06.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440112+0000", 2024-09-13T05:11:06.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:06.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:06.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440117+0000", 2024-09-13T05:11:06.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0199999999999996e-06 2024-09-13T05:11:06.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:06.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440129+0000", 2024-09-13T05:11:06.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2571999999999999e-05 2024-09-13T05:11:06.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:06.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440136+0000", 2024-09-13T05:11:06.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8870000000000003e-06 2024-09-13T05:11:06.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:06.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475160+0000", 2024-09-13T05:11:06.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035024287000000001 2024-09-13T05:11:06.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:06.415 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475294+0000", 2024-09-13T05:11:06.415 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013386600000000001 2024-09-13T05:11:06.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.415 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:06.415 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475746+0000", 2024-09-13T05:11:06.415 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00045173300000000001 2024-09-13T05:11:06.415 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.415 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:06.415 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.415 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47592 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16449536~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:06.415 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440142+0000", 2024-09-13T05:11:06.415 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.933935864, 2024-09-13T05:11:06.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036117556000000002, 2024-09-13T05:11:06.416 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:06.416 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:06.416 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:06.416 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:06.416 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:06.416 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47592 2024-09-13T05:11:06.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.416 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:06.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.416 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:06.416 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440142+0000", 2024-09-13T05:11:06.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.417 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:06.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440142+0000", 2024-09-13T05:11:06.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.417 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:06.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440141+0000", 2024-09-13T05:11:06.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:06.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.417 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:06.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440145+0000", 2024-09-13T05:11:06.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5939999999999998e-06 2024-09-13T05:11:06.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:06.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440162+0000", 2024-09-13T05:11:06.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7102999999999999e-05 2024-09-13T05:11:06.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:06.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440169+0000", 2024-09-13T05:11:06.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0330000000000003e-06 2024-09-13T05:11:06.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.419 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:06.419 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475812+0000", 2024-09-13T05:11:06.419 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035643542 2024-09-13T05:11:06.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.419 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:06.419 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475899+0000", 2024-09-13T05:11:06.419 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6827000000000001e-05 2024-09-13T05:11:06.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.419 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:06.419 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476259+0000", 2024-09-13T05:11:06.419 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000360057 2024-09-13T05:11:06.419 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.420 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:06.420 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.420 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.420 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.420 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47593 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16744448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:06.420 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440175+0000", 2024-09-13T05:11:06.420 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.933902908, 2024-09-13T05:11:06.420 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036661306999999997, 2024-09-13T05:11:06.420 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:06.420 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:06.420 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:06.420 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:06.420 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:06.420 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47593 2024-09-13T05:11:06.420 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.421 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:06.421 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.421 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:06.421 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440175+0000", 2024-09-13T05:11:06.421 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.421 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.421 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:06.421 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440175+0000", 2024-09-13T05:11:06.421 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.421 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.421 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:06.421 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440174+0000", 2024-09-13T05:11:06.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:06.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.422 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:06.422 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440178+0000", 2024-09-13T05:11:06.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.687e-06 2024-09-13T05:11:06.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.422 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:06.422 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440187+0000", 2024-09-13T05:11:06.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6029999999999994e-06 2024-09-13T05:11:06.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.422 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:06.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440194+0000", 2024-09-13T05:11:06.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8600000000000004e-06 2024-09-13T05:11:06.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:06.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476312+0000", 2024-09-13T05:11:06.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036117727000000002 2024-09-13T05:11:06.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:06.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476436+0000", 2024-09-13T05:11:06.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012370600000000001 2024-09-13T05:11:06.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.424 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.424 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:06.424 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476836+0000", 2024-09-13T05:11:06.424 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00040031399999999998 2024-09-13T05:11:06.424 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.424 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:06.424 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.424 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.424 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.424 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47597 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15597568~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:06.424 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440735+0000", 2024-09-13T05:11:06.424 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.933342916000001, 2024-09-13T05:11:06.424 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036742364, 2024-09-13T05:11:06.424 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:06.425 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:06.425 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:06.425 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:06.425 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:06.425 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47597 2024-09-13T05:11:06.425 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.425 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:06.425 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.425 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:06.425 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440735+0000", 2024-09-13T05:11:06.425 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.425 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.425 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:06.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440735+0000", 2024-09-13T05:11:06.426 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.426 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:06.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440733+0000", 2024-09-13T05:11:06.426 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:06.426 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:06.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440741+0000", 2024-09-13T05:11:06.426 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7100000000000007e-06 2024-09-13T05:11:06.426 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:06.427 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440774+0000", 2024-09-13T05:11:06.427 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3062999999999998e-05 2024-09-13T05:11:06.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:06.427 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440784+0000", 2024-09-13T05:11:06.427 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6630000000000005e-06 2024-09-13T05:11:06.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:06.427 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476899+0000", 2024-09-13T05:11:06.427 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036115188999999999 2024-09-13T05:11:06.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:06.428 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477036+0000", 2024-09-13T05:11:06.428 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000136907 2024-09-13T05:11:06.428 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.428 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.428 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:06.428 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477477+0000", 2024-09-13T05:11:06.428 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00044140899999999997 2024-09-13T05:11:06.428 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.428 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:06.428 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.428 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.428 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.428 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47598 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15892480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:06.428 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:11:06.429 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.933273181000001, 2024-09-13T05:11:06.429 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037255732, 2024-09-13T05:11:06.429 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:06.429 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:06.429 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:06.429 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:06.429 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:06.429 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47598 2024-09-13T05:11:06.429 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.429 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:06.429 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.429 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:06.429 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:11:06.429 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.430 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.430 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.430 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:06.430 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:11:06.430 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.430 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.430 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.430 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:06.430 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:11:06.430 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:06.430 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.430 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.430 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:06.430 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440809+0000", 2024-09-13T05:11:06.431 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.237e-06 2024-09-13T05:11:06.431 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.431 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.431 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:06.431 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440823+0000", 2024-09-13T05:11:06.431 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4426e-05 2024-09-13T05:11:06.431 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.431 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.431 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:06.431 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440831+0000", 2024-09-13T05:11:06.431 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6669999999999996e-06 2024-09-13T05:11:06.431 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.431 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.432 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:06.432 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477508+0000", 2024-09-13T05:11:06.432 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036677354000000002 2024-09-13T05:11:06.432 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.432 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.432 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:06.432 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477571+0000", 2024-09-13T05:11:06.432 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2271000000000001e-05 2024-09-13T05:11:06.432 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.432 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.432 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:06.432 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478060+0000", 2024-09-13T05:11:06.432 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00048954399999999996 2024-09-13T05:11:06.432 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.433 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:06.433 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.433 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.433 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.433 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47599 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16187392~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:06.433 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:11:06.433 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.933240239, 2024-09-13T05:11:06.433 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037806671, 2024-09-13T05:11:06.433 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:06.433 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:06.433 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:06.433 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:06.434 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:06.434 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47599 2024-09-13T05:11:06.434 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.434 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:06.434 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.434 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:06.434 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:11:06.434 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.434 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.434 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.434 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:06.434 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:11:06.434 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.434 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.435 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.435 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:06.435 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:11:06.435 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:06.435 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.435 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.435 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:06.435 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440841+0000", 2024-09-13T05:11:06.435 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1699999999999999e-06 2024-09-13T05:11:06.435 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.435 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.435 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:06.435 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440853+0000", 2024-09-13T05:11:06.435 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2466000000000001e-05 2024-09-13T05:11:06.435 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.436 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.436 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:06.436 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440860+0000", 2024-09-13T05:11:06.436 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8970000000000002e-06 2024-09-13T05:11:06.436 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.436 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.436 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:06.436 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478100+0000", 2024-09-13T05:11:06.436 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037239398 2024-09-13T05:11:06.436 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.436 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.436 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:06.436 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478173+0000", 2024-09-13T05:11:06.437 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3784999999999999e-05 2024-09-13T05:11:06.437 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.437 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.437 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:06.437 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478644+0000", 2024-09-13T05:11:06.437 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00047058100000000003 2024-09-13T05:11:06.437 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.437 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:06.437 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.437 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.437 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.437 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47600 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16482304~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:06.437 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:11:06.437 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.933211265000001, 2024-09-13T05:11:06.438 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038539524999999998, 2024-09-13T05:11:06.438 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:06.438 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:06.438 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:06.438 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:06.438 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:06.438 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47600 2024-09-13T05:11:06.438 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.438 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:06.438 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.438 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:06.438 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:11:06.438 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.438 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.439 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.439 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:06.439 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:11:06.439 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.439 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.439 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.439 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:06.439 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:11:06.439 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:06.439 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.439 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.439 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:06.439 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440869+0000", 2024-09-13T05:11:06.439 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6229999999999999e-06 2024-09-13T05:11:06.440 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.440 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.440 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:06.440 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440877+0000", 2024-09-13T05:11:06.440 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9289999999999998e-06 2024-09-13T05:11:06.440 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.440 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.440 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:06.440 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440884+0000", 2024-09-13T05:11:06.440 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9569999999999996e-06 2024-09-13T05:11:06.440 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.440 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.440 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:06.441 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478694+0000", 2024-09-13T05:11:06.441 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037809597 2024-09-13T05:11:06.441 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.441 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.441 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:06.441 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478907+0000", 2024-09-13T05:11:06.441 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021332799999999999 2024-09-13T05:11:06.441 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.441 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.441 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:06.441 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479406+0000", 2024-09-13T05:11:06.441 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00049870100000000005 2024-09-13T05:11:06.441 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.442 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:06.442 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.442 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.442 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.442 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47605 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15630336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:06.442 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.445919+0000", 2024-09-13T05:11:06.442 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.928158895999999, 2024-09-13T05:11:06.442 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034071010999999998, 2024-09-13T05:11:06.442 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:06.442 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:06.442 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:06.442 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:06.442 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:06.442 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47605 2024-09-13T05:11:06.443 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.443 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:06.443 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.443 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:06.443 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445919+0000", 2024-09-13T05:11:06.443 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.443 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.443 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.443 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:06.443 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445919+0000", 2024-09-13T05:11:06.443 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.443 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.443 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:06.444 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445917+0000", 2024-09-13T05:11:06.444 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:06.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.444 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:06.444 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445928+0000", 2024-09-13T05:11:06.444 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1413000000000001e-05 2024-09-13T05:11:06.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.444 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:06.444 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445965+0000", 2024-09-13T05:11:06.444 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6832999999999998e-05 2024-09-13T05:11:06.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.445 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.445 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:06.445 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445979+0000", 2024-09-13T05:11:06.445 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4112e-05 2024-09-13T05:11:06.445 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.445 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.445 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:06.445 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479481+0000", 2024-09-13T05:11:06.445 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033502394999999997 2024-09-13T05:11:06.445 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.445 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.445 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:06.445 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479577+0000", 2024-09-13T05:11:06.446 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5952999999999994e-05 2024-09-13T05:11:06.446 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.446 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.446 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:06.446 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479990+0000", 2024-09-13T05:11:06.446 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00041233799999999999 2024-09-13T05:11:06.446 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.446 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:06.446 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.446 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.446 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.446 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47606 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15925248~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:06.446 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.446006+0000", 2024-09-13T05:11:06.446 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.928071531000001, 2024-09-13T05:11:06.447 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034653819000000002, 2024-09-13T05:11:06.447 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:06.447 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:06.447 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:06.447 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:06.447 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:06.447 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47606 2024-09-13T05:11:06.447 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.447 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:06.447 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.447 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:06.447 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446006+0000", 2024-09-13T05:11:06.447 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.447 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.447 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.448 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:06.448 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446006+0000", 2024-09-13T05:11:06.448 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.448 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.448 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.448 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:06.448 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446005+0000", 2024-09-13T05:11:06.448 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:06.448 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.448 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.448 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:06.448 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446011+0000", 2024-09-13T05:11:06.448 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8039999999999998e-06 2024-09-13T05:11:06.448 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.449 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.449 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:06.449 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446027+0000", 2024-09-13T05:11:06.449 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6109000000000001e-05 2024-09-13T05:11:06.449 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.449 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.449 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:06.449 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446036+0000", 2024-09-13T05:11:06.449 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0100000000000001e-06 2024-09-13T05:11:06.449 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.449 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.449 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:06.449 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480068+0000", 2024-09-13T05:11:06.450 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034031516999999997 2024-09-13T05:11:06.450 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.450 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.450 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:06.450 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480216+0000", 2024-09-13T05:11:06.450 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000148701 2024-09-13T05:11:06.450 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.450 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.450 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:06.450 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480660+0000", 2024-09-13T05:11:06.450 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00044355499999999999 2024-09-13T05:11:06.450 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.450 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:06.451 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.451 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.451 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.451 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47607 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16220160~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:06.451 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.446044+0000", 2024-09-13T05:11:06.451 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.928034062, 2024-09-13T05:11:06.451 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035276967999999999, 2024-09-13T05:11:06.451 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:06.451 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:06.451 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:06.451 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:06.451 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:06.451 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47607 2024-09-13T05:11:06.452 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.452 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:06.452 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.452 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:06.452 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446044+0000", 2024-09-13T05:11:06.452 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.452 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.452 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.452 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:06.452 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446044+0000", 2024-09-13T05:11:06.452 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.452 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.452 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.452 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:06.453 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446043+0000", 2024-09-13T05:11:06.453 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:06.453 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.453 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.453 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:06.453 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446047+0000", 2024-09-13T05:11:06.453 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0729999999999998e-06 2024-09-13T05:11:06.453 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.453 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.453 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:06.453 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446055+0000", 2024-09-13T05:11:06.453 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0900000000000005e-06 2024-09-13T05:11:06.453 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.453 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.454 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:06.454 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446062+0000", 2024-09-13T05:11:06.454 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0169999999999999e-06 2024-09-13T05:11:06.454 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.454 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.454 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:06.454 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480714+0000", 2024-09-13T05:11:06.454 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034651380000000002 2024-09-13T05:11:06.454 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.454 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.454 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:06.454 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480859+0000", 2024-09-13T05:11:06.454 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014580300000000001 2024-09-13T05:11:06.455 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.455 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.455 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:06.455 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481321+0000", 2024-09-13T05:11:06.455 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000461218 2024-09-13T05:11:06.455 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.455 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:06.455 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.455 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.455 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.455 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47608 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16515072~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:06.455 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.446068+0000", 2024-09-13T05:11:06.455 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.928009616000001, 2024-09-13T05:11:06.455 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035881819000000002, 2024-09-13T05:11:06.456 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:06.456 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:06.456 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:06.456 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:06.456 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:06.456 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47608 2024-09-13T05:11:06.456 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.456 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:06.456 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.456 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:06.456 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446068+0000", 2024-09-13T05:11:06.456 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.456 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.457 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.457 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:06.457 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446068+0000", 2024-09-13T05:11:06.457 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.457 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.457 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.457 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:06.457 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446067+0000", 2024-09-13T05:11:06.457 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:06.457 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.457 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.457 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:06.457 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446071+0000", 2024-09-13T05:11:06.458 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9090000000000002e-06 2024-09-13T05:11:06.458 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.458 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.458 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:06.458 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446079+0000", 2024-09-13T05:11:06.458 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6869999999999994e-06 2024-09-13T05:11:06.458 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.458 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.458 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:06.458 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446088+0000", 2024-09-13T05:11:06.458 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0129999999999999e-06 2024-09-13T05:11:06.458 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.458 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.458 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:06.459 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481401+0000", 2024-09-13T05:11:06.459 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035313272999999999 2024-09-13T05:11:06.459 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.459 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.459 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:06.459 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481564+0000", 2024-09-13T05:11:06.459 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016223299999999999 2024-09-13T05:11:06.459 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.459 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.459 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:06.459 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481950+0000", 2024-09-13T05:11:06.459 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00038631000000000001 2024-09-13T05:11:06.459 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.460 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:06.460 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.460 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.460 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.460 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47616 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16547840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:06.460 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.452475+0000", 2024-09-13T05:11:06.460 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.921603016000001, 2024-09-13T05:11:06.460 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031684442, 2024-09-13T05:11:06.460 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:06.460 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:06.460 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:06.460 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:06.461 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:06.461 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47616 2024-09-13T05:11:06.461 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.461 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:06.461 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.461 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:06.461 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.452475+0000", 2024-09-13T05:11:06.461 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.461 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.461 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.461 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:06.461 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.452475+0000", 2024-09-13T05:11:06.461 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.462 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.462 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.462 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:06.462 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.452474+0000", 2024-09-13T05:11:06.462 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:06.462 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.462 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.462 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:06.462 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.452478+0000", 2024-09-13T05:11:06.462 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5319999999999998e-06 2024-09-13T05:11:06.462 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.462 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.462 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:06.463 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.452484+0000", 2024-09-13T05:11:06.463 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.601e-06 2024-09-13T05:11:06.463 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.463 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.463 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:06.463 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.452490+0000", 2024-09-13T05:11:06.463 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7649999999999999e-06 2024-09-13T05:11:06.463 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.463 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.463 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:06.463 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.483732+0000", 2024-09-13T05:11:06.463 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031241680000000001 2024-09-13T05:11:06.463 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.463 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.464 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:06.464 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.483797+0000", 2024-09-13T05:11:06.464 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5683000000000001e-05 2024-09-13T05:11:06.464 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.464 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.464 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:06.464 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.484159+0000", 2024-09-13T05:11:06.464 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00036174200000000002 2024-09-13T05:11:06.464 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.464 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:06.464 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.464 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.464 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.465 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:48448 3.16 3:6fb90bbf:::rbd_data.112d4ee87f83.00000000000000ca:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-13T05:11:06.465 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:52.567838+0000", 2024-09-13T05:11:06.465 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.806239715, 2024-09-13T05:11:06.465 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032609896999999999, 2024-09-13T05:11:06.465 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:06.465 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:06.465 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:06.465 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:06.465 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:06.465 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 48448 2024-09-13T05:11:06.465 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.465 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:06.465 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.465 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:06.466 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567838+0000", 2024-09-13T05:11:06.466 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.466 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.466 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.466 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:06.466 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567838+0000", 2024-09-13T05:11:06.466 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:06.466 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.466 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.466 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:06.466 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567836+0000", 2024-09-13T05:11:06.466 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:06.466 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.467 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.467 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:06.467 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567847+0000", 2024-09-13T05:11:06.467 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1443e-05 2024-09-13T05:11:06.467 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.467 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.467 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:06.467 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567867+0000", 2024-09-13T05:11:06.467 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0083000000000001e-05 2024-09-13T05:11:06.467 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.467 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.467 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:06.467 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567877+0000", 2024-09-13T05:11:06.467 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4499999999999993e-06 2024-09-13T05:11:06.468 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.468 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.468 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:06.468 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567939+0000", 2024-09-13T05:11:06.468 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2552999999999996e-05 2024-09-13T05:11:06.468 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.468 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.468 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:06.468 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.568130+0000", 2024-09-13T05:11:06.468 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00019028799999999999 2024-09-13T05:11:06.468 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.468 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.468 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 7", 2024-09-13T05:11:06.468 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.575017+0000", 2024-09-13T05:11:06.469 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0068869980000000001 2024-09-13T05:11:06.469 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.469 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.469 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:06.469 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.600362+0000", 2024-09-13T05:11:06.469 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.025345828000000001 2024-09-13T05:11:06.469 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.469 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.469 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:11:06.469 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.600374+0000", 2024-09-13T05:11:06.469 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1096e-05 2024-09-13T05:11:06.469 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.469 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.470 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:11:06.470 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.600410+0000", 2024-09-13T05:11:06.470 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6142000000000001e-05 2024-09-13T05:11:06.470 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:06.470 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:06.470 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:06.470 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.600448+0000", 2024-09-13T05:11:06.470 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8101e-05 2024-09-13T05:11:06.470 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.470 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:06.470 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.470 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:06.470 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:06.470 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:06.471 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:11:06.473 INFO:teuthology.orchestra.run.smithi120.stdout:2714 writesame 0xdb74b48 thru 0xdb7d996 data_size 0x1(0x8e4f bytes) 2024-09-13T05:11:06.473 INFO:teuthology.orchestra.run.smithi120.stdout:2715 read 0x86a787a thru 0x86ab818 (0x3f9f bytes) 2024-09-13T05:11:06.473 INFO:teuthology.orchestra.run.smithi120.stdout:2716 trunc from 0xdb7d997 to 0x36494fb 2024-09-13T05:11:06.473 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:06.473 INFO:teuthology.orchestra.run.smithi120.stdout:2719 trunc from 0x36494fb to 0x550e5f8 2024-09-13T05:11:06.473 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:06.474 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:11:06.474 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:06.466+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:06.475 INFO:teuthology.orchestra.run.smithi120.stdout:2724 trunc from 0x550e5f8 to 0xac5d61b 2024-09-13T05:11:06.487 INFO:teuthology.orchestra.run.smithi120.stdout:2725 write 0x5aee084 thru 0x5af4c78 (0x6bf5 bytes) 2024-09-13T05:11:06.496 INFO:teuthology.orchestra.run.smithi120.stdout:2726 writesame 0xdabd4a thru 0xdb6420 data_size 0x17(0xa6d7 bytes) 2024-09-13T05:11:06.504 INFO:teuthology.orchestra.run.smithi120.stdout:2727 write 0x830c83f thru 0x830cb45 (0x307 bytes) 2024-09-13T05:11:06.509 INFO:teuthology.orchestra.run.smithi120.stdout:2728 write 0x4c06cf0 thru 0x4c152dd (0xe5ee bytes) 2024-09-13T05:11:06.518 INFO:teuthology.orchestra.run.smithi120.stdout:2730 writesame 0x48e30e8 thru 0x48e6d0d data_size 0x1(0x3c26 bytes) 2024-09-13T05:11:06.530 INFO:teuthology.orchestra.run.smithi120.stdout:2732 read 0x50bcd6b thru 0x50c19bd (0x4c53 bytes) 2024-09-13T05:11:06.530 INFO:teuthology.orchestra.run.smithi120.stdout:2734 read 0x3e30aeb thru 0x3e3cdfc (0xc312 bytes) 2024-09-13T05:11:06.543 INFO:teuthology.orchestra.run.smithi120.stdout:2735 write 0xc7e9827 thru 0xc7f9036 (0xf810 bytes) 2024-09-13T05:11:06.551 INFO:teuthology.orchestra.run.smithi120.stdout:2736 read 0x28a9fa8 thru 0x28aa3e8 (0x441 bytes) 2024-09-13T05:11:06.563 INFO:teuthology.orchestra.run.smithi120.stdout:2737 write 0xdbe2357 thru 0xdbeb8ac (0x9556 bytes) 2024-09-13T05:11:06.573 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:06.570+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:06.582 INFO:teuthology.orchestra.run.smithi120.stdout:2738 trunc from 0xdbeb8ad to 0x89badfb 2024-09-13T05:11:06.599 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:06.599 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:06.600 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:11:06.600 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:06.609 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:11:06.618 INFO:teuthology.orchestra.run.smithi120.stdout:2739 write 0xdca85c4 thru 0xdcb3d12 (0xb74f bytes) 2024-09-13T05:11:06.618 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:11:06.625 INFO:teuthology.orchestra.run.smithi120.stdout:2740 write 0x7bf869c thru 0x7c0794b (0xf2b0 bytes) 2024-09-13T05:11:06.632 INFO:teuthology.orchestra.run.smithi120.stdout:2741 write 0x7dfada9 thru 0x7e0730a (0xc562 bytes) 2024-09-13T05:11:06.642 INFO:teuthology.orchestra.run.smithi120.stdout:2742 writesame 0x1b633a7 thru 0x1b71025 data_size 0x1(0xdc7f bytes) 2024-09-13T05:11:06.643 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:11:06.661 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:11:06.676 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:06.670+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:06.681 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:11:06.686 INFO:teuthology.orchestra.run.smithi120.stdout:2743 punch from 0x93024b to 0x93b608, (0xb3bd bytes) 2024-09-13T05:11:06.686 INFO:teuthology.orchestra.run.smithi120.stdout:2744 write 0xa0752e2 thru 0xa07fb21 (0xa840 bytes) 2024-09-13T05:11:06.693 INFO:teuthology.orchestra.run.smithi120.stdout:2745 write 0x4fa7e0d thru 0x4fb0c94 (0x8e88 bytes) 2024-09-13T05:11:06.700 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:06.700 INFO:teuthology.orchestra.run.smithi120.stdout:2747 trunc from 0xdcb3d13 to 0xd817933 2024-09-13T05:11:06.700 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:11:06.718 INFO:teuthology.orchestra.run.smithi120.stdout:2748 read 0xcfc3842 thru 0xcfd1fea (0xe7a9 bytes) 2024-09-13T05:11:06.718 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:06.718 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:06.718 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:06.718 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:06.718 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:06.728 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:11:06.729 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:11:06.739 INFO:teuthology.orchestra.run.smithi120.stdout:2749 trunc from 0xd817933 to 0x1c3c803 2024-09-13T05:11:06.753 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:11:06.762 INFO:teuthology.orchestra.run.smithi120.stdout:2750 read 0x19d6ada thru 0x19e68bd (0xfde4 bytes) 2024-09-13T05:11:06.775 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:11:06.775 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:06.770+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:06.777 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:11:06.777 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:11:06.777 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:11:06.777 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:11:06.777 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:11:06.777 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:11:06.777 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:11:06.777 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:11:06.791 INFO:teuthology.orchestra.run.smithi120.stdout:2751 writesame 0xc67e770 thru 0xc686fde data_size 0x1(0x886f bytes) 2024-09-13T05:11:06.791 INFO:teuthology.orchestra.run.smithi120.stdout:2753 read 0x5f36c19 thru 0x5f36fb7 (0x39f bytes) 2024-09-13T05:11:06.791 INFO:teuthology.orchestra.run.smithi120.stdout:2754 punch from 0x5702079 to 0x5710930, (0xe8b7 bytes) 2024-09-13T05:11:06.791 INFO:teuthology.orchestra.run.smithi120.stdout:2756 read 0x65dc02a thru 0x65e7014 (0xafeb bytes) 2024-09-13T05:11:06.791 INFO:teuthology.orchestra.run.smithi120.stdout:2757 writesame 0x1064ab7 thru 0x1072829 data_size 0x3(0xdd73 bytes) 2024-09-13T05:11:06.807 INFO:teuthology.orchestra.run.smithi120.stdout:2758 read 0x58b01ac thru 0x58b3169 (0x2fbe bytes) 2024-09-13T05:11:06.807 INFO:teuthology.orchestra.run.smithi120.stdout:2759 writesame 0xc229a6 thru 0xc32454 data_size 0x55(0xfaaf bytes) 2024-09-13T05:11:06.816 INFO:teuthology.orchestra.run.smithi120.stdout:2761 read 0x7c4202d thru 0x7c473a0 (0x5374 bytes) 2024-09-13T05:11:06.816 INFO:teuthology.orchestra.run.smithi120.stdout:2763 read 0x1ea9892 thru 0x1eb0309 (0x6a78 bytes) 2024-09-13T05:11:06.817 INFO:teuthology.orchestra.run.smithi120.stdout:2764 read 0x5f726ed thru 0x5f77fa7 (0x58bb bytes) 2024-09-13T05:11:06.837 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:06.837 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:06.838 INFO:teuthology.orchestra.run.smithi120.stdout:2765 trunc from 0xc686fdf to 0xddcfef 2024-09-13T05:11:06.848 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:11:06.877 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:06.869+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:06.930 INFO:teuthology.orchestra.run.smithi120.stdout:2766 writesame 0xd0dcea7 thru 0xd0de8cd data_size 0xd(0x1a27 bytes) 2024-09-13T05:11:06.930 INFO:teuthology.orchestra.run.smithi120.stdout:2767 writesame 0x1b311b4 thru 0x1b3c8eb data_size 0x8f(0xb738 bytes) 2024-09-13T05:11:06.938 INFO:teuthology.orchestra.run.smithi120.stdout:2769 read 0x5ea1226 thru 0x5eb034b (0xf126 bytes) 2024-09-13T05:11:06.938 INFO:teuthology.orchestra.run.smithi120.stdout:2770 writesame 0x8c3314e thru 0x8c34c43 data_size 0x1(0x1af6 bytes) 2024-09-13T05:11:06.947 INFO:teuthology.orchestra.run.smithi120.stdout:2771 read 0x5d7f1ed thru 0x5d7f290 (0xa4 bytes) 2024-09-13T05:11:06.947 INFO:teuthology.orchestra.run.smithi120.stdout:2772 write 0xaecde7b thru 0xaed0414 (0x259a bytes) 2024-09-13T05:11:06.953 INFO:teuthology.orchestra.run.smithi120.stdout:2773 read 0x777a6f1 thru 0x7784d68 (0xa678 bytes) 2024-09-13T05:11:06.955 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:06.955 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:06.963 INFO:teuthology.orchestra.run.smithi120.stdout:2774 write 0xd92d601 thru 0xd9311c4 (0x3bc4 bytes) 2024-09-13T05:11:06.965 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:11:06.970 INFO:teuthology.orchestra.run.smithi120.stdout:2776 read 0x9e48cef thru 0x9e49e7e (0x1190 bytes) 2024-09-13T05:11:06.971 INFO:teuthology.orchestra.run.smithi120.stdout:2777 write 0x740acd2 thru 0x740d6de (0x2a0d bytes) 2024-09-13T05:11:06.977 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:06.977 INFO:teuthology.orchestra.run.smithi120.stdout:2779 write 0x73864ac thru 0x7395104 (0xec59 bytes) 2024-09-13T05:11:06.984 INFO:teuthology.orchestra.run.smithi120.stdout:2781 write 0x7644a3e thru 0x764aa8f (0x6052 bytes) 2024-09-13T05:11:06.991 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:06.991 INFO:teuthology.orchestra.run.smithi120.stdout:2783 read 0x7605200 thru 0x760f5ed (0xa3ee bytes) 2024-09-13T05:11:06.992 INFO:teuthology.orchestra.run.smithi120.stdout:2784 read 0xe03c47 thru 0xe0f60c (0xb9c6 bytes) 2024-09-13T05:11:06.993 INFO:teuthology.orchestra.run.smithi120.stdout:2785 read 0xbef2a6a thru 0xbefd5c9 (0xab60 bytes) 2024-09-13T05:11:06.993 INFO:teuthology.orchestra.run.smithi120.stdout:2786 read 0xa29a5eb thru 0xa2a05e6 (0x5ffc bytes) 2024-09-13T05:11:06.993 INFO:teuthology.orchestra.run.smithi120.stdout:2787 write 0xbe480d7 thru 0xbe4f41d (0x7347 bytes) 2024-09-13T05:11:07.000 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:07.000 INFO:teuthology.orchestra.run.smithi120.stdout:2789 write 0x2b411b6 thru 0x2b4991f (0x876a bytes) 2024-09-13T05:11:07.006 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:07.009 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:07.006+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:07.018 INFO:teuthology.orchestra.run.smithi120.stdout:2791 writesame 0xdce4f63 thru 0xdced1f3 data_size 0x23(0x8291 bytes) 2024-09-13T05:11:07.019 INFO:teuthology.orchestra.run.smithi120.stdout:2792 punch from 0xc203aa0 to 0xc20aac0, (0x7020 bytes) 2024-09-13T05:11:07.019 INFO:teuthology.orchestra.run.smithi120.stdout:2793 write 0x14c0d11 thru 0x14ce159 (0xd449 bytes) 2024-09-13T05:11:07.027 INFO:teuthology.orchestra.run.smithi120.stdout:2794 read 0x6f35b7f thru 0x6f3ad1c (0x519e bytes) 2024-09-13T05:11:07.027 INFO:teuthology.orchestra.run.smithi120.stdout:2795 punch from 0x1be35e9 to 0x1beb5ad, (0x7fc4 bytes) 2024-09-13T05:11:07.027 INFO:teuthology.orchestra.run.smithi120.stdout:2797 punch from 0x2684b5 to 0x274c06, (0xc751 bytes) 2024-09-13T05:11:07.027 INFO:teuthology.orchestra.run.smithi120.stdout:2798 read 0x8cc2be3 thru 0x8cc8a15 (0x5e33 bytes) 2024-09-13T05:11:07.028 INFO:teuthology.orchestra.run.smithi120.stdout:2799 read 0x61e2ffe thru 0x61f11a6 (0xe1a9 bytes) 2024-09-13T05:11:07.028 INFO:teuthology.orchestra.run.smithi120.stdout:2800 read 0x6028470 thru 0x602e791 (0x6322 bytes) 2024-09-13T05:11:07.047 INFO:teuthology.orchestra.run.smithi120.stdout:2801 trunc from 0xdced1f4 to 0x58d7c5f 2024-09-13T05:11:07.070 INFO:teuthology.orchestra.run.smithi120.stdout:2802 writesame 0x4b2e962 thru 0x4b3c7c3 data_size 0x5(0xde62 bytes) 2024-09-13T05:11:07.077 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:07.077 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:07.080 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:07.074+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:07.082 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:07.087 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:11:07.097 INFO:teuthology.orchestra.run.smithi120.stdout:2805 trunc from 0x58d7c5f to 0xba6fcc8 2024-09-13T05:11:07.116 INFO:teuthology.orchestra.run.smithi120.stdout:2806 write 0xbf17588 thru 0xbf1bca0 (0x4719 bytes) 2024-09-13T05:11:07.125 INFO:teuthology.orchestra.run.smithi120.stdout:2807 write 0x1c56380 thru 0x1c58016 (0x1c97 bytes) 2024-09-13T05:11:07.132 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:07.133 INFO:teuthology.orchestra.run.smithi120.stdout:2810 writesame 0x1808bc7 thru 0x1813a2b data_size 0x1(0xae65 bytes) 2024-09-13T05:11:07.159 INFO:teuthology.orchestra.run.smithi120.stdout:2811 writesame 0xb7523f0 thru 0xb756405 data_size 0xd(0x4016 bytes) 2024-09-13T05:11:07.179 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:07.174+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:07.193 INFO:teuthology.orchestra.run.smithi120.stdout:2812 trunc from 0xbf1bca1 to 0xb8620 2024-09-13T05:11:07.197 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:07.198 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:07.212 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:11:07.250 INFO:teuthology.orchestra.run.smithi120.stdout:2813 write 0xc62671c thru 0xc63640a (0xfcef bytes) 2024-09-13T05:11:07.258 INFO:teuthology.orchestra.run.smithi120.stdout:2814 writesame 0x407c478 thru 0x408655b data_size 0xe(0xa0e4 bytes) 2024-09-13T05:11:07.271 INFO:teuthology.orchestra.run.smithi120.stdout:2816 trunc from 0xc63640b to 0xaad2319 2024-09-13T05:11:07.280 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:07.273+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:07.303 INFO:teuthology.orchestra.run.smithi120.stdout:2817 trunc from 0xaad2319 to 0x456dbfc 2024-09-13T05:11:07.341 INFO:teuthology.orchestra.run.smithi120.stdout:2819 write 0xd95f726 thru 0xd96dd38 (0xe613 bytes) 2024-09-13T05:11:07.341 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:07.341 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:07.350 INFO:teuthology.orchestra.run.smithi120.stdout:2820 write 0xca18ab4 thru 0xca19e11 (0x135e bytes) 2024-09-13T05:11:07.352 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:11:07.357 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:07.357 INFO:teuthology.orchestra.run.smithi120.stdout:2822 punch from 0xd2dec35 to 0xd2e0dae, (0x2179 bytes) 2024-09-13T05:11:07.361 INFO:teuthology.orchestra.run.smithi120.stdout:2824 trunc from 0xd96dd39 to 0xb2d3516 2024-09-13T05:11:07.381 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:07.377+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:07.381 INFO:teuthology.orchestra.run.smithi120.stdout:2825 punch from 0x93280 to 0xa2def, (0xfb6f bytes) 2024-09-13T05:11:07.398 INFO:teuthology.orchestra.run.smithi120.stdout:2826 write 0xda5d9a7 thru 0xda667e8 (0x8e42 bytes) 2024-09-13T05:11:07.407 INFO:teuthology.orchestra.run.smithi120.stdout:2827 punch from 0x1efea11 to 0x1f01c09, (0x31f8 bytes) 2024-09-13T05:11:07.407 INFO:teuthology.orchestra.run.smithi120.stdout:2829 read 0x5677507 thru 0x5680cde (0x97d8 bytes) 2024-09-13T05:11:07.408 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:07.408 INFO:teuthology.orchestra.run.smithi120.stdout:2831 writesame 0x9959105 thru 0x995f489 data_size 0x1(0x6385 bytes) 2024-09-13T05:11:07.427 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:07.427 INFO:teuthology.orchestra.run.smithi120.stdout:2834 read 0x1b1d2f0 thru 0x1b289a4 (0xb6b5 bytes) 2024-09-13T05:11:07.427 INFO:teuthology.orchestra.run.smithi120.stdout:2835 read 0x268a028 thru 0x268f8d1 (0x58aa bytes) 2024-09-13T05:11:07.427 INFO:teuthology.orchestra.run.smithi120.stdout:2836 writesame 0x6eaf301 thru 0x6eb7743 data_size 0x7(0x8443 bytes) 2024-09-13T05:11:07.437 INFO:teuthology.orchestra.run.smithi120.stdout:2837 write 0x88cdb78 thru 0x88d279f (0x4c28 bytes) 2024-09-13T05:11:07.446 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:07.456 INFO:teuthology.orchestra.run.smithi120.stdout:2839 write 0xdfb2ddc thru 0xdfbe903 (0xbb28 bytes) 2024-09-13T05:11:07.463 INFO:teuthology.orchestra.run.smithi120.stdout:2840 punch from 0xcb6af74 to 0xcb701a8, (0x5234 bytes) 2024-09-13T05:11:07.463 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:07.464 INFO:teuthology.orchestra.run.smithi120.stdout:2843 write 0x78cd6ba thru 0x78db635 (0xdf7c bytes) 2024-09-13T05:11:07.472 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:07.472 INFO:teuthology.orchestra.run.smithi120.stdout:2846 writesame 0x70d1875 thru 0x70dcdc4 data_size 0x6(0xb550 bytes) 2024-09-13T05:11:07.472 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:07.473 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:07.482 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:07.477+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:07.484 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:11:07.488 INFO:teuthology.orchestra.run.smithi120.stdout:2847 read 0x88e3c8d thru 0x88e400b (0x37f bytes) 2024-09-13T05:11:07.498 INFO:teuthology.orchestra.run.smithi120.stdout:2848 write 0xeaa2415 thru 0xeaa73e9 (0x4fd5 bytes) 2024-09-13T05:11:07.507 INFO:teuthology.orchestra.run.smithi120.stdout:2851 read 0x631664 thru 0x639add (0x847a bytes) 2024-09-13T05:11:07.507 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:07.512 INFO:teuthology.orchestra.run.smithi120.stdout:2853 trunc from 0xeaa73ea to 0xbc7d561 2024-09-13T05:11:07.533 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:07.534 INFO:teuthology.orchestra.run.smithi120.stdout:2855 read 0x6c63820 thru 0x6c712de (0xdabf bytes) 2024-09-13T05:11:07.534 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:07.534 INFO:teuthology.orchestra.run.smithi120.stdout:2857 punch from 0xe2787e to 0xe3087b, (0x8ffd bytes) 2024-09-13T05:11:07.534 INFO:teuthology.orchestra.run.smithi120.stdout:2858 read 0xa978138 thru 0xa980724 (0x85ed bytes) 2024-09-13T05:11:07.534 INFO:teuthology.orchestra.run.smithi120.stdout:2859 read 0x5540267 thru 0x5545f01 (0x5c9b bytes) 2024-09-13T05:11:07.534 INFO:teuthology.orchestra.run.smithi120.stdout:2860 writesame 0x42a1a57 thru 0x42a605e data_size 0x53(0x4608 bytes) 2024-09-13T05:11:07.554 INFO:teuthology.orchestra.run.smithi120.stdout:2864 write 0xc72c2a2 thru 0xc72cf90 (0xcef bytes) 2024-09-13T05:11:07.559 INFO:teuthology.orchestra.run.smithi120.stdout:2865 read 0x88624a0 thru 0x8865894 (0x33f5 bytes) 2024-09-13T05:11:07.560 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:07.577 INFO:teuthology.orchestra.run.smithi120.stdout:2867 trunc from 0xc72cf91 to 0x2df820a 2024-09-13T05:11:07.584 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:07.578+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:07.595 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:07.595 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:07.600 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:07.600 INFO:teuthology.orchestra.run.smithi120.stdout:2871 read 0x20b518e thru 0x20c28b2 (0xd725 bytes) 2024-09-13T05:11:07.600 INFO:teuthology.orchestra.run.smithi120.stdout:2873 read 0x279beec thru 0x279f5e4 (0x36f9 bytes) 2024-09-13T05:11:07.607 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:11:07.613 INFO:teuthology.orchestra.run.smithi120.stdout:2874 write 0x60d78a5 thru 0x60d7dae (0x50a bytes) 2024-09-13T05:11:07.618 INFO:teuthology.orchestra.run.smithi120.stdout:2875 write 0x4a7d63 thru 0x4b588e (0xdb2c bytes) 2024-09-13T05:11:07.626 INFO:teuthology.orchestra.run.smithi120.stdout:2876 write 0x1f29ec9 thru 0x1f30e11 (0x6f49 bytes) 2024-09-13T05:11:07.642 INFO:teuthology.orchestra.run.smithi120.stdout:2877 trunc from 0x60d7daf to 0x1ad28d9 2024-09-13T05:11:07.662 INFO:teuthology.orchestra.run.smithi120.stdout:2878 punch from 0x136fb7b to 0x1372dad, (0x3232 bytes) 2024-09-13T05:11:07.684 INFO:teuthology.orchestra.run.smithi120.stdout:2879 write 0x75b699f thru 0x75bd481 (0x6ae3 bytes) 2024-09-13T05:11:07.684 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:07.677+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:07.693 INFO:teuthology.orchestra.run.smithi120.stdout:2880 write 0x4cecf37 thru 0x4cf078c (0x3856 bytes) 2024-09-13T05:11:07.701 INFO:teuthology.orchestra.run.smithi120.stdout:2881 punch from 0xcbb8a6 to 0xcbd8c1, (0x201b bytes) 2024-09-13T05:11:07.702 INFO:teuthology.orchestra.run.smithi120.stdout:2882 write 0x385a1c4 thru 0x386a1bf (0xfffc bytes) 2024-09-13T05:11:07.711 INFO:teuthology.orchestra.run.smithi120.stdout:2883 read 0x3141e7f thru 0x314b11f (0x92a1 bytes) 2024-09-13T05:11:07.712 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:07.722 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:07.722 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:07.727 INFO:teuthology.orchestra.run.smithi120.stdout:2885 writesame 0xa5fa0a6 thru 0xa5ff1bf data_size 0x7(0x511a bytes) 2024-09-13T05:11:07.727 INFO:teuthology.orchestra.run.smithi120.stdout:2886 read 0x6c374c thru 0x6d166b (0xdf20 bytes) 2024-09-13T05:11:07.727 INFO:teuthology.orchestra.run.smithi120.stdout:2887 read 0xf8818a thru 0xf8c740 (0x45b7 bytes) 2024-09-13T05:11:07.727 INFO:teuthology.orchestra.run.smithi120.stdout:2890 read 0x4cab162 thru 0x4cb12c5 (0x6164 bytes) 2024-09-13T05:11:07.735 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:11:07.746 INFO:teuthology.orchestra.run.smithi120.stdout:2891 trunc from 0xa5ff1c0 to 0xf4fd8 2024-09-13T05:11:07.784 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:07.778+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:07.790 INFO:teuthology.orchestra.run.smithi120.stdout:2892 trunc from 0xf4fd8 to 0xe8ce36d 2024-09-13T05:11:07.815 INFO:teuthology.orchestra.run.smithi120.stdout:2893 trunc from 0xe8ce36d to 0x49e6187 2024-09-13T05:11:07.825 INFO:teuthology.orchestra.run.smithi120.stdout:2896 read 0x490ba29 thru 0x491af8f (0xf567 bytes) 2024-09-13T05:11:07.825 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:07.839 INFO:teuthology.orchestra.run.smithi120.stdout:2898 trunc from 0x49e6187 to 0xccbc8b6 2024-09-13T05:11:07.860 INFO:teuthology.orchestra.run.smithi120.stdout:2899 writesame 0xe47c690 thru 0xe484bdb data_size 0x26(0x854c bytes) 2024-09-13T05:11:07.860 INFO:teuthology.orchestra.run.smithi120.stdout:2901 read 0x49fdcd2 thru 0x4a089f9 (0xad28 bytes) 2024-09-13T05:11:07.861 INFO:teuthology.orchestra.run.smithi120.stdout:2902 read 0x2bd8ff2 thru 0x2be4034 (0xb043 bytes) 2024-09-13T05:11:07.861 INFO:teuthology.orchestra.run.smithi120.stdout:2903 punch from 0xd47c689 to 0xd483293, (0x6c0a bytes) 2024-09-13T05:11:07.861 INFO:teuthology.orchestra.run.smithi120.stdout:2904 read 0x760f1dc thru 0x7614396 (0x51bb bytes) 2024-09-13T05:11:07.861 INFO:teuthology.orchestra.run.smithi120.stdout:2905 write 0x2be949c thru 0x2bf3edc (0xaa41 bytes) 2024-09-13T05:11:07.861 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:07.861 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:07.872 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:11:07.877 INFO:teuthology.orchestra.run.smithi120.stdout:2906 trunc from 0xe484bdc to 0x94a6441 2024-09-13T05:11:07.885 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:07.881+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:07.891 INFO:teuthology.orchestra.run.smithi120.stdout:2908 trunc from 0x94a6441 to 0x66c46e3 2024-09-13T05:11:07.903 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:07.903 INFO:teuthology.orchestra.run.smithi120.stdout:2910 punch from 0x2c3aecc to 0x2c46d5a, (0xbe8e bytes) 2024-09-13T05:11:07.903 INFO:teuthology.orchestra.run.smithi120.stdout:2911 punch from 0x14d6deb to 0x14dda47, (0x6c5c bytes) 2024-09-13T05:11:07.903 INFO:teuthology.orchestra.run.smithi120.stdout:2912 trunc from 0x66c46e3 to 0x6139a9d 2024-09-13T05:11:07.932 INFO:teuthology.orchestra.run.smithi120.stdout:2913 write 0x9c61555 thru 0x9c70841 (0xf2ed bytes) 2024-09-13T05:11:07.942 INFO:teuthology.orchestra.run.smithi120.stdout:2915 punch from 0x46c31dc to 0x46cef14, (0xbd38 bytes) 2024-09-13T05:11:07.942 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:07.945 INFO:teuthology.orchestra.run.smithi120.stdout:2917 trunc from 0x9c70842 to 0x7e6f833 2024-09-13T05:11:07.967 INFO:teuthology.orchestra.run.smithi120.stdout:2918 writesame 0x3aeadfd thru 0x3af156b data_size 0x1(0x676f bytes) 2024-09-13T05:11:07.986 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:07.981+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:07.989 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:07.989 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:07.995 INFO:teuthology.orchestra.run.smithi120.stdout:2919 write 0x16de4c7 thru 0x16eca8d (0xe5c7 bytes) 2024-09-13T05:11:08.000 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:11:08.011 INFO:teuthology.orchestra.run.smithi120.stdout:2920 trunc from 0x7e6f833 to 0x22f7cab 2024-09-13T05:11:08.055 INFO:teuthology.orchestra.run.smithi120.stdout:2923 write 0xa6572e1 thru 0xa660054 (0x8d74 bytes) 2024-09-13T05:11:08.077 INFO:teuthology.orchestra.run.smithi120.stdout:2924 write 0xb849553 thru 0xb8532a3 (0x9d51 bytes) 2024-09-13T05:11:08.087 INFO:teuthology.orchestra.run.smithi120.stdout:2925 writesame 0x98b2eb8 thru 0x98b65e9 data_size 0x2d(0x3732 bytes) 2024-09-13T05:11:08.087 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:08.082+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:08.094 INFO:teuthology.orchestra.run.smithi120.stdout:2926 punch from 0x320b172 to 0x320b7d5, (0x663 bytes) 2024-09-13T05:11:08.094 INFO:teuthology.orchestra.run.smithi120.stdout:2927 write 0x6962c6f thru 0x696b1b4 (0x8546 bytes) 2024-09-13T05:11:08.102 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T05:11:08.102 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:08.103 INFO:teuthology.orchestra.run.smithi120.stdout:2930 write 0x7cb9311 thru 0x7cc31ee (0x9ede bytes) 2024-09-13T05:11:08.120 INFO:teuthology.orchestra.run.smithi120.stdout:2931 write 0xd39229f thru 0xd39dd18 (0xba7a bytes) 2024-09-13T05:11:08.123 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:08.123 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:08.127 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:08.127 INFO:teuthology.orchestra.run.smithi120.stdout:2933 write 0x76f2c9b thru 0x76f7dca (0x5130 bytes) 2024-09-13T05:11:08.134 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:11:08.134 INFO:teuthology.orchestra.run.smithi120.stdout:2934 read 0x21814b2 thru 0x218e811 (0xd360 bytes) 2024-09-13T05:11:08.136 INFO:teuthology.orchestra.run.smithi120.stdout:2935 trunc from 0xd39dd19 to 0xe98ba4d 2024-09-13T05:11:08.148 INFO:teuthology.orchestra.run.smithi120.stdout:2936 trunc from 0xe98ba4d to 0xd7a2466 2024-09-13T05:11:08.175 INFO:teuthology.orchestra.run.smithi120.stdout:2937 trunc from 0xd7a2466 to 0x1102695 2024-09-13T05:11:08.188 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:08.181+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:08.197 INFO:teuthology.orchestra.run.smithi120.stdout:2940 punch from 0x1b0e38 to 0x1bb7d8, (0xa9a0 bytes) 2024-09-13T05:11:08.207 INFO:teuthology.orchestra.run.smithi120.stdout:2942 write 0x1c3d082 thru 0x1c451df (0x815e bytes) 2024-09-13T05:11:08.243 INFO:teuthology.orchestra.run.smithi120.stdout:2944 writesame 0xdedd767 thru 0xdeece57 data_size 0x1(0xf6f1 bytes) 2024-09-13T05:11:08.243 INFO:teuthology.orchestra.run.smithi120.stdout:2945 write 0x991e7bc thru 0x9921197 (0x29dc bytes) 2024-09-13T05:11:08.250 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:08.250 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:08.250 INFO:teuthology.orchestra.run.smithi120.stdout:2948 write 0xce33875 thru 0xce3c52e (0x8cba bytes) 2024-09-13T05:11:08.252 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:08.252 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:08.258 INFO:teuthology.orchestra.run.smithi120.stdout:2949 read 0x743d4c thru 0x75142c (0xd6e1 bytes) 2024-09-13T05:11:08.263 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:11:08.268 INFO:teuthology.orchestra.run.smithi120.stdout:2950 write 0xe1f5f53 thru 0xe1fe175 (0x8223 bytes) 2024-09-13T05:11:08.275 INFO:teuthology.orchestra.run.smithi120.stdout:2952 read 0x75837f3 thru 0x75847b2 (0xfc0 bytes) 2024-09-13T05:11:08.276 INFO:teuthology.orchestra.run.smithi120.stdout:2954 write 0xaaae8d9 thru 0xaaaf9c8 (0x10f0 bytes) 2024-09-13T05:11:08.281 INFO:teuthology.orchestra.run.smithi120.stdout:2955 clone 23 order 21 su 32768 sc 5 2024-09-13T05:11:08.288 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:08.281+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:08.370 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:08.370 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:08.379 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:11:08.389 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:08.386+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:08.490 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:08.486+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:08.522 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:08.522 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:08.531 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:11:08.591 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:08.586+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:08.647 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:08.647 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:08.656 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:11:08.701 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:08.697+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:08.762 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:08.762 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:08.772 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:11:08.790 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:11:08.817 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:08.814+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:08.888 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:08.888 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:08.894 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:08.890+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:08.899 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:11:08.935 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:11:08.955 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:11:08.974 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:11:08.993 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:11:08.994 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:08.990+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:09.001 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:09.001 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:09.011 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:11:09.017 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:11:09.039 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:11:09.063 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:11:09.085 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:11:09.088 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:11:09.088 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:11:09.088 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:11:09.088 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:11:09.088 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:11:09.088 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:11:09.088 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:11:09.088 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:11:09.095 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:09.090+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:09.161 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:09.161 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:09.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:09.162 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [] 2024-09-13T05:11:09.162 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:09.171 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:11:09.195 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:09.189+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:09.251 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is set 2024-09-13T05:11:09.276 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:09.276 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:09.276 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:11:09.276 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:09.286 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:11:09.296 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:09.290+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:09.386 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:09.386 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:09.387 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:09.387 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:09.387 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:09.396 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:11:09.397 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:09.393+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:09.499 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:09.493+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:09.550 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #21, image image_client.0-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent22 2024-09-13T05:11:09.552 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:09.552 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:09.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:09.552 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:09.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.552 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47581 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15532032~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:09.552 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.439908+0000", 2024-09-13T05:11:09.552 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.109268861, 2024-09-13T05:11:09.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031694137999999997, 2024-09-13T05:11:09.553 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:09.553 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:09.553 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:09.553 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:09.553 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:09.553 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47581 2024-09-13T05:11:09.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.553 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:09.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.553 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:09.553 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439908+0000", 2024-09-13T05:11:09.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:09.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439908+0000", 2024-09-13T05:11:09.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:09.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439907+0000", 2024-09-13T05:11:09.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:09.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:09.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439911+0000", 2024-09-13T05:11:09.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6370000000000001e-06 2024-09-13T05:11:09.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:09.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439923+0000", 2024-09-13T05:11:09.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.217e-05 2024-09-13T05:11:09.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:09.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439933+0000", 2024-09-13T05:11:09.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0273e-05 2024-09-13T05:11:09.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:09.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.471000+0000", 2024-09-13T05:11:09.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031067230000000001 2024-09-13T05:11:09.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:09.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.471092+0000", 2024-09-13T05:11:09.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1916000000000006e-05 2024-09-13T05:11:09.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:09.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.471602+0000", 2024-09-13T05:11:09.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00050951200000000005 2024-09-13T05:11:09.557 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.557 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:09.557 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.557 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47582 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15826944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:09.557 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.439939+0000", 2024-09-13T05:11:09.557 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.109237327999999, 2024-09-13T05:11:09.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032266203, 2024-09-13T05:11:09.557 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:09.557 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:09.557 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:09.558 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:09.558 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:09.558 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47582 2024-09-13T05:11:09.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.558 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:09.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:09.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439939+0000", 2024-09-13T05:11:09.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:09.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439939+0000", 2024-09-13T05:11:09.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:09.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439939+0000", 2024-09-13T05:11:09.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:09.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:09.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439949+0000", 2024-09-13T05:11:09.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0906e-05 2024-09-13T05:11:09.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:09.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439962+0000", 2024-09-13T05:11:09.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2373e-05 2024-09-13T05:11:09.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:09.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439969+0000", 2024-09-13T05:11:09.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0570000000000004e-06 2024-09-13T05:11:09.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:09.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.471645+0000", 2024-09-13T05:11:09.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031676530000000001 2024-09-13T05:11:09.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:09.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.471775+0000", 2024-09-13T05:11:09.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000129591 2024-09-13T05:11:09.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:09.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472205+0000", 2024-09-13T05:11:09.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00043034900000000001 2024-09-13T05:11:09.561 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.561 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:09.561 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.562 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47583 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16121856~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:09.562 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.439975+0000", 2024-09-13T05:11:09.562 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.109201521999999, 2024-09-13T05:11:09.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032777897, 2024-09-13T05:11:09.562 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:09.562 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:09.562 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:09.562 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:09.562 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:09.562 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47583 2024-09-13T05:11:09.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.562 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:09.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:09.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439975+0000", 2024-09-13T05:11:09.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:09.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439975+0000", 2024-09-13T05:11:09.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:09.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439974+0000", 2024-09-13T05:11:09.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:09.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:09.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439978+0000", 2024-09-13T05:11:09.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5729999999999999e-06 2024-09-13T05:11:09.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:09.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439991+0000", 2024-09-13T05:11:09.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3465999999999999e-05 2024-09-13T05:11:09.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:09.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439998+0000", 2024-09-13T05:11:09.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8369999999999999e-06 2024-09-13T05:11:09.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:09.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472272+0000", 2024-09-13T05:11:09.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032273617999999997 2024-09-13T05:11:09.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:09.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472382+0000", 2024-09-13T05:11:09.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000109845 2024-09-13T05:11:09.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:09.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472753+0000", 2024-09-13T05:11:09.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00037116100000000001 2024-09-13T05:11:09.566 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.566 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:09.566 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.566 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47584 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16416768~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:09.566 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440004+0000", 2024-09-13T05:11:09.566 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.109172456, 2024-09-13T05:11:09.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033357242000000002, 2024-09-13T05:11:09.566 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:09.566 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:09.567 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:09.567 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:09.567 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:09.567 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47584 2024-09-13T05:11:09.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.567 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:09.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:09.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440004+0000", 2024-09-13T05:11:09.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:09.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440004+0000", 2024-09-13T05:11:09.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:09.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440003+0000", 2024-09-13T05:11:09.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:09.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:09.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440007+0000", 2024-09-13T05:11:09.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9099999999999998e-06 2024-09-13T05:11:09.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:09.569 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440020+0000", 2024-09-13T05:11:09.569 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2330000000000001e-05 2024-09-13T05:11:09.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:09.569 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440026+0000", 2024-09-13T05:11:09.569 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7700000000000004e-06 2024-09-13T05:11:09.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:09.570 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472807+0000", 2024-09-13T05:11:09.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032780431999999998 2024-09-13T05:11:09.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.570 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:09.570 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472927+0000", 2024-09-13T05:11:09.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000119645 2024-09-13T05:11:09.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.570 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:09.571 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473361+0000", 2024-09-13T05:11:09.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000434745 2024-09-13T05:11:09.571 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.571 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:09.571 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.571 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.571 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47585 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16711680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:09.571 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440033+0000", 2024-09-13T05:11:09.571 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.109143920000001, 2024-09-13T05:11:09.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033917665999999999, 2024-09-13T05:11:09.571 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:09.571 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:09.572 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:09.572 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:09.572 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:09.572 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47585 2024-09-13T05:11:09.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.572 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:09.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:09.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440033+0000", 2024-09-13T05:11:09.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:09.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440033+0000", 2024-09-13T05:11:09.573 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.573 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:09.573 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440032+0000", 2024-09-13T05:11:09.573 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:09.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.573 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:09.573 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440036+0000", 2024-09-13T05:11:09.573 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.676e-06 2024-09-13T05:11:09.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.574 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:09.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440049+0000", 2024-09-13T05:11:09.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3142999999999999e-05 2024-09-13T05:11:09.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.574 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.574 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:09.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440056+0000", 2024-09-13T05:11:09.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.827e-06 2024-09-13T05:11:09.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.574 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.574 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:09.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473451+0000", 2024-09-13T05:11:09.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033395344 2024-09-13T05:11:09.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.575 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:09.575 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473565+0000", 2024-09-13T05:11:09.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011377700000000001 2024-09-13T05:11:09.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.575 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:09.575 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473950+0000", 2024-09-13T05:11:09.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00038550200000000002 2024-09-13T05:11:09.575 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.575 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:09.575 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.576 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.576 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47589 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15564800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:09.576 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440062+0000", 2024-09-13T05:11:09.576 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.109114934000001, 2024-09-13T05:11:09.576 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034520812999999997, 2024-09-13T05:11:09.576 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:09.576 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:09.576 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:09.576 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:09.576 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:09.576 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47589 2024-09-13T05:11:09.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.577 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:09.577 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:09.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440062+0000", 2024-09-13T05:11:09.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.577 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:09.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440062+0000", 2024-09-13T05:11:09.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.577 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:09.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440061+0000", 2024-09-13T05:11:09.578 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:09.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:09.578 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440064+0000", 2024-09-13T05:11:09.578 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4029999999999999e-06 2024-09-13T05:11:09.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:09.578 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440072+0000", 2024-09-13T05:11:09.578 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.79e-06 2024-09-13T05:11:09.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:09.578 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440079+0000", 2024-09-13T05:11:09.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.81e-06 2024-09-13T05:11:09.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:09.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474016+0000", 2024-09-13T05:11:09.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033936858 2024-09-13T05:11:09.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:09.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474143+0000", 2024-09-13T05:11:09.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012673599999999999 2024-09-13T05:11:09.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.580 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:09.580 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474582+0000", 2024-09-13T05:11:09.580 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00043982199999999998 2024-09-13T05:11:09.580 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.580 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:09.580 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.580 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.580 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.580 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47590 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15859712~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:09.580 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440085+0000", 2024-09-13T05:11:09.580 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.109091991, 2024-09-13T05:11:09.580 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035003000999999999, 2024-09-13T05:11:09.580 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:09.580 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:09.581 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:09.581 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:09.581 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:09.581 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47590 2024-09-13T05:11:09.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.581 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:09.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:09.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440085+0000", 2024-09-13T05:11:09.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:09.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440085+0000", 2024-09-13T05:11:09.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:09.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440084+0000", 2024-09-13T05:11:09.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:09.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:09.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440088+0000", 2024-09-13T05:11:09.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7759999999999999e-06 2024-09-13T05:11:09.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.583 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:09.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440100+0000", 2024-09-13T05:11:09.583 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2537e-05 2024-09-13T05:11:09.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.583 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:09.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440107+0000", 2024-09-13T05:11:09.583 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.046e-06 2024-09-13T05:11:09.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.583 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:09.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474648+0000", 2024-09-13T05:11:09.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034540803000000002 2024-09-13T05:11:09.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.584 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.584 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:09.584 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474721+0000", 2024-09-13T05:11:09.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2890000000000002e-05 2024-09-13T05:11:09.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.584 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.584 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:09.584 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475088+0000", 2024-09-13T05:11:09.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00036654199999999997 2024-09-13T05:11:09.584 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.584 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:09.585 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.585 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47591 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16154624~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:09.585 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440113+0000", 2024-09-13T05:11:09.585 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.109063415000001, 2024-09-13T05:11:09.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035632759, 2024-09-13T05:11:09.585 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:09.585 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:09.585 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:09.585 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:09.585 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:09.585 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47591 2024-09-13T05:11:09.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.586 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:09.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:09.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440113+0000", 2024-09-13T05:11:09.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:09.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440113+0000", 2024-09-13T05:11:09.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.587 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:09.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440112+0000", 2024-09-13T05:11:09.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:09.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.587 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:09.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440117+0000", 2024-09-13T05:11:09.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0199999999999996e-06 2024-09-13T05:11:09.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.587 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:09.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440129+0000", 2024-09-13T05:11:09.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2571999999999999e-05 2024-09-13T05:11:09.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.588 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.588 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:09.588 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440136+0000", 2024-09-13T05:11:09.588 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8870000000000003e-06 2024-09-13T05:11:09.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.588 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.588 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:09.588 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475160+0000", 2024-09-13T05:11:09.588 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035024287000000001 2024-09-13T05:11:09.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.588 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.588 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:09.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475294+0000", 2024-09-13T05:11:09.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013386600000000001 2024-09-13T05:11:09.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:09.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475746+0000", 2024-09-13T05:11:09.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00045173300000000001 2024-09-13T05:11:09.589 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.589 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:09.589 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.589 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47592 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16449536~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:09.589 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440142+0000", 2024-09-13T05:11:09.590 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.109034756, 2024-09-13T05:11:09.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036117556000000002, 2024-09-13T05:11:09.590 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:09.590 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:09.590 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:09.590 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:09.590 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:09.590 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47592 2024-09-13T05:11:09.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.590 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:09.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:09.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440142+0000", 2024-09-13T05:11:09.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:09.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440142+0000", 2024-09-13T05:11:09.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:09.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440141+0000", 2024-09-13T05:11:09.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:09.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:09.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440145+0000", 2024-09-13T05:11:09.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5939999999999998e-06 2024-09-13T05:11:09.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.592 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:09.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440162+0000", 2024-09-13T05:11:09.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7102999999999999e-05 2024-09-13T05:11:09.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.592 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:09.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440169+0000", 2024-09-13T05:11:09.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0330000000000003e-06 2024-09-13T05:11:09.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.593 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:09.593 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475812+0000", 2024-09-13T05:11:09.593 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035643542 2024-09-13T05:11:09.593 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.593 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.593 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:09.593 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475899+0000", 2024-09-13T05:11:09.593 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6827000000000001e-05 2024-09-13T05:11:09.593 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.593 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.593 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:09.593 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476259+0000", 2024-09-13T05:11:09.593 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000360057 2024-09-13T05:11:09.594 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.594 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:09.594 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.594 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.594 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47593 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16744448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:09.594 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440175+0000", 2024-09-13T05:11:09.594 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.109001800000001, 2024-09-13T05:11:09.594 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036661306999999997, 2024-09-13T05:11:09.594 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:09.594 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:09.594 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:09.594 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:09.594 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:09.595 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47593 2024-09-13T05:11:09.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.595 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:09.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.595 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:09.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440175+0000", 2024-09-13T05:11:09.595 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.595 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:09.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440175+0000", 2024-09-13T05:11:09.595 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:09.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440174+0000", 2024-09-13T05:11:09.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:09.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:09.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440178+0000", 2024-09-13T05:11:09.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.687e-06 2024-09-13T05:11:09.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:09.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440187+0000", 2024-09-13T05:11:09.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6029999999999994e-06 2024-09-13T05:11:09.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.597 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.597 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:09.597 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440194+0000", 2024-09-13T05:11:09.597 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8600000000000004e-06 2024-09-13T05:11:09.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.597 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.597 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:09.597 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476312+0000", 2024-09-13T05:11:09.597 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036117727000000002 2024-09-13T05:11:09.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.597 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.597 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:09.597 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476436+0000", 2024-09-13T05:11:09.598 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012370600000000001 2024-09-13T05:11:09.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.598 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.598 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:09.598 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476836+0000", 2024-09-13T05:11:09.598 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00040031399999999998 2024-09-13T05:11:09.598 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.598 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:09.598 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.598 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.598 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47597 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15597568~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:09.598 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440735+0000", 2024-09-13T05:11:09.598 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.108441807999998, 2024-09-13T05:11:09.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036742364, 2024-09-13T05:11:09.599 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:09.599 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:09.599 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:09.599 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:09.599 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:09.599 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47597 2024-09-13T05:11:09.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.599 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:09.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:09.599 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440735+0000", 2024-09-13T05:11:09.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.600 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:09.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440735+0000", 2024-09-13T05:11:09.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.600 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:09.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440733+0000", 2024-09-13T05:11:09.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:09.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.600 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:09.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440741+0000", 2024-09-13T05:11:09.601 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7100000000000007e-06 2024-09-13T05:11:09.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.601 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.601 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:09.601 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440774+0000", 2024-09-13T05:11:09.601 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3062999999999998e-05 2024-09-13T05:11:09.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.601 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.601 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:09.601 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440784+0000", 2024-09-13T05:11:09.601 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6630000000000005e-06 2024-09-13T05:11:09.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.601 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:09.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476899+0000", 2024-09-13T05:11:09.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036115188999999999 2024-09-13T05:11:09.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:09.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477036+0000", 2024-09-13T05:11:09.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000136907 2024-09-13T05:11:09.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:09.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477477+0000", 2024-09-13T05:11:09.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00044140899999999997 2024-09-13T05:11:09.602 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.603 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:09.603 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.603 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.603 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.603 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47598 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15892480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:09.603 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:11:09.603 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.108372073000002, 2024-09-13T05:11:09.603 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037255732, 2024-09-13T05:11:09.603 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:09.603 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:09.603 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:09.603 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:09.603 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:09.604 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47598 2024-09-13T05:11:09.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.604 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:09.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.604 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:09.604 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:11:09.604 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.604 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:09.604 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:11:09.604 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.605 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:09.605 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:11:09.605 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:09.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.605 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:09.605 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440809+0000", 2024-09-13T05:11:09.605 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.237e-06 2024-09-13T05:11:09.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:09.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440823+0000", 2024-09-13T05:11:09.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4426e-05 2024-09-13T05:11:09.606 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:09.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440831+0000", 2024-09-13T05:11:09.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6669999999999996e-06 2024-09-13T05:11:09.606 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:09.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477508+0000", 2024-09-13T05:11:09.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036677354000000002 2024-09-13T05:11:09.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.607 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:09.607 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477571+0000", 2024-09-13T05:11:09.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2271000000000001e-05 2024-09-13T05:11:09.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.607 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:09.607 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478060+0000", 2024-09-13T05:11:09.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00048954399999999996 2024-09-13T05:11:09.607 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.607 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:09.608 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.608 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47599 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16187392~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:09.608 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:11:09.608 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.108339131000001, 2024-09-13T05:11:09.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037806671, 2024-09-13T05:11:09.608 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:09.608 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:09.608 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:09.608 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:09.608 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:09.608 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47599 2024-09-13T05:11:09.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.609 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:09.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:09.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:11:09.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:09.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:11:09.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:09.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:11:09.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:09.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:09.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440841+0000", 2024-09-13T05:11:09.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1699999999999999e-06 2024-09-13T05:11:09.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:09.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440853+0000", 2024-09-13T05:11:09.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2466000000000001e-05 2024-09-13T05:11:09.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:09.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440860+0000", 2024-09-13T05:11:09.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8970000000000002e-06 2024-09-13T05:11:09.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:09.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478100+0000", 2024-09-13T05:11:09.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037239398 2024-09-13T05:11:09.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:09.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478173+0000", 2024-09-13T05:11:09.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3784999999999999e-05 2024-09-13T05:11:09.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:09.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478644+0000", 2024-09-13T05:11:09.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00047058100000000003 2024-09-13T05:11:09.612 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.612 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:09.612 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.612 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47600 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16482304~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:09.612 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:11:09.612 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.108310156999998, 2024-09-13T05:11:09.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038539524999999998, 2024-09-13T05:11:09.613 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:09.613 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:09.613 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:09.613 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:09.613 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:09.613 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47600 2024-09-13T05:11:09.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.613 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:09.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.613 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:09.613 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:11:09.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:09.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:11:09.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:09.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:11:09.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:09.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:09.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440869+0000", 2024-09-13T05:11:09.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6229999999999999e-06 2024-09-13T05:11:09.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:09.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440877+0000", 2024-09-13T05:11:09.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9289999999999998e-06 2024-09-13T05:11:09.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:09.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440884+0000", 2024-09-13T05:11:09.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9569999999999996e-06 2024-09-13T05:11:09.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:09.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478694+0000", 2024-09-13T05:11:09.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037809597 2024-09-13T05:11:09.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:09.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478907+0000", 2024-09-13T05:11:09.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021332799999999999 2024-09-13T05:11:09.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:09.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479406+0000", 2024-09-13T05:11:09.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00049870100000000005 2024-09-13T05:11:09.616 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.617 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:09.617 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.617 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47605 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15630336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:09.617 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.445919+0000", 2024-09-13T05:11:09.617 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.103257788000001, 2024-09-13T05:11:09.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034071010999999998, 2024-09-13T05:11:09.617 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:09.617 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:09.617 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:09.617 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:09.617 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:09.618 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47605 2024-09-13T05:11:09.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.618 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:09.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.618 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:09.618 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445919+0000", 2024-09-13T05:11:09.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.618 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:09.618 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445919+0000", 2024-09-13T05:11:09.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:09.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445917+0000", 2024-09-13T05:11:09.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:09.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:09.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445928+0000", 2024-09-13T05:11:09.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1413000000000001e-05 2024-09-13T05:11:09.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:09.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445965+0000", 2024-09-13T05:11:09.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6832999999999998e-05 2024-09-13T05:11:09.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:09.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445979+0000", 2024-09-13T05:11:09.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4112e-05 2024-09-13T05:11:09.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:09.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479481+0000", 2024-09-13T05:11:09.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033502394999999997 2024-09-13T05:11:09.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:09.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479577+0000", 2024-09-13T05:11:09.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5952999999999994e-05 2024-09-13T05:11:09.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:09.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479990+0000", 2024-09-13T05:11:09.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00041233799999999999 2024-09-13T05:11:09.621 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.621 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:09.621 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.621 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47606 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15925248~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:09.621 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.446006+0000", 2024-09-13T05:11:09.622 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.103170423000002, 2024-09-13T05:11:09.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034653819000000002, 2024-09-13T05:11:09.622 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:09.622 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:09.622 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:09.622 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:09.622 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:09.622 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47606 2024-09-13T05:11:09.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.622 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:09.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:09.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446006+0000", 2024-09-13T05:11:09.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:09.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446006+0000", 2024-09-13T05:11:09.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:09.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446005+0000", 2024-09-13T05:11:09.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:09.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:09.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446011+0000", 2024-09-13T05:11:09.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8039999999999998e-06 2024-09-13T05:11:09.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:09.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446027+0000", 2024-09-13T05:11:09.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6109000000000001e-05 2024-09-13T05:11:09.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:09.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446036+0000", 2024-09-13T05:11:09.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0100000000000001e-06 2024-09-13T05:11:09.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:09.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480068+0000", 2024-09-13T05:11:09.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034031516999999997 2024-09-13T05:11:09.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:09.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480216+0000", 2024-09-13T05:11:09.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000148701 2024-09-13T05:11:09.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:09.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480660+0000", 2024-09-13T05:11:09.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00044355499999999999 2024-09-13T05:11:09.626 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.626 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:09.626 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.626 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.626 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47607 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16220160~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:09.626 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.446044+0000", 2024-09-13T05:11:09.626 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.103132953999999, 2024-09-13T05:11:09.626 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035276967999999999, 2024-09-13T05:11:09.626 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:09.626 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:09.626 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:09.626 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:09.626 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:09.627 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47607 2024-09-13T05:11:09.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.627 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:09.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.627 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:09.627 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446044+0000", 2024-09-13T05:11:09.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.627 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:09.627 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446044+0000", 2024-09-13T05:11:09.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.628 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:09.628 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446043+0000", 2024-09-13T05:11:09.628 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:09.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.628 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:09.628 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446047+0000", 2024-09-13T05:11:09.628 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0729999999999998e-06 2024-09-13T05:11:09.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.628 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:09.628 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446055+0000", 2024-09-13T05:11:09.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0900000000000005e-06 2024-09-13T05:11:09.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.629 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:09.629 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446062+0000", 2024-09-13T05:11:09.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0169999999999999e-06 2024-09-13T05:11:09.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.629 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:09.629 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480714+0000", 2024-09-13T05:11:09.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034651380000000002 2024-09-13T05:11:09.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.630 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:09.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480859+0000", 2024-09-13T05:11:09.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014580300000000001 2024-09-13T05:11:09.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.630 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.630 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:09.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481321+0000", 2024-09-13T05:11:09.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000461218 2024-09-13T05:11:09.630 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.630 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:09.630 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.630 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.631 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47608 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16515072~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:09.631 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.446068+0000", 2024-09-13T05:11:09.631 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.103108507999998, 2024-09-13T05:11:09.631 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035881819000000002, 2024-09-13T05:11:09.631 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:09.631 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:09.631 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:09.631 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:09.631 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:09.631 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47608 2024-09-13T05:11:09.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.631 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:09.631 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.631 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:09.632 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446068+0000", 2024-09-13T05:11:09.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.632 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:09.632 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446068+0000", 2024-09-13T05:11:09.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.632 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:09.632 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446067+0000", 2024-09-13T05:11:09.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:09.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.633 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:09.633 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446071+0000", 2024-09-13T05:11:09.633 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9090000000000002e-06 2024-09-13T05:11:09.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.633 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:09.633 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446079+0000", 2024-09-13T05:11:09.633 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6869999999999994e-06 2024-09-13T05:11:09.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.633 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:09.633 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446088+0000", 2024-09-13T05:11:09.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0129999999999999e-06 2024-09-13T05:11:09.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.634 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:09.634 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481401+0000", 2024-09-13T05:11:09.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035313272999999999 2024-09-13T05:11:09.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.634 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:09.634 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481564+0000", 2024-09-13T05:11:09.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016223299999999999 2024-09-13T05:11:09.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.635 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:09.635 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481950+0000", 2024-09-13T05:11:09.635 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00038631000000000001 2024-09-13T05:11:09.635 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.635 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:09.635 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.635 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.635 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47616 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16547840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:09.635 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.452475+0000", 2024-09-13T05:11:09.635 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.096701908, 2024-09-13T05:11:09.635 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031684442, 2024-09-13T05:11:09.635 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:09.636 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:09.636 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:09.636 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:09.636 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:09.636 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47616 2024-09-13T05:11:09.636 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.636 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:09.636 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.636 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:09.636 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.452475+0000", 2024-09-13T05:11:09.636 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.636 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.636 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.637 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:09.637 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.452475+0000", 2024-09-13T05:11:09.637 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.637 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.637 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:09.637 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.452474+0000", 2024-09-13T05:11:09.637 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:09.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.637 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.637 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:09.637 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.452478+0000", 2024-09-13T05:11:09.637 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5319999999999998e-06 2024-09-13T05:11:09.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:09.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.452484+0000", 2024-09-13T05:11:09.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.601e-06 2024-09-13T05:11:09.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:09.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.452490+0000", 2024-09-13T05:11:09.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7649999999999999e-06 2024-09-13T05:11:09.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:09.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.483732+0000", 2024-09-13T05:11:09.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031241680000000001 2024-09-13T05:11:09.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.639 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.639 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:09.639 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.483797+0000", 2024-09-13T05:11:09.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5683000000000001e-05 2024-09-13T05:11:09.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.639 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.639 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:09.639 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.484159+0000", 2024-09-13T05:11:09.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00036174200000000002 2024-09-13T05:11:09.639 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.639 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:09.639 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.640 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.640 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:48448 3.16 3:6fb90bbf:::rbd_data.112d4ee87f83.00000000000000ca:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-13T05:11:09.640 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:52.567838+0000", 2024-09-13T05:11:09.640 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 16.981338607000001, 2024-09-13T05:11:09.640 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032609896999999999, 2024-09-13T05:11:09.640 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:09.640 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:09.640 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:09.640 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:09.640 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:09.640 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 48448 2024-09-13T05:11:09.640 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.640 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:09.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:09.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567838+0000", 2024-09-13T05:11:09.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:09.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567838+0000", 2024-09-13T05:11:09.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:09.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567836+0000", 2024-09-13T05:11:09.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:09.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.642 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:09.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567847+0000", 2024-09-13T05:11:09.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1443e-05 2024-09-13T05:11:09.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.642 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:09.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567867+0000", 2024-09-13T05:11:09.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0083000000000001e-05 2024-09-13T05:11:09.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.642 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:09.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567877+0000", 2024-09-13T05:11:09.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4499999999999993e-06 2024-09-13T05:11:09.643 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.643 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.643 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:09.643 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567939+0000", 2024-09-13T05:11:09.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2552999999999996e-05 2024-09-13T05:11:09.643 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.643 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.643 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:09.643 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.568130+0000", 2024-09-13T05:11:09.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00019028799999999999 2024-09-13T05:11:09.643 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.643 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.643 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 7", 2024-09-13T05:11:09.644 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.575017+0000", 2024-09-13T05:11:09.644 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0068869980000000001 2024-09-13T05:11:09.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.644 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.644 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:09.644 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.600362+0000", 2024-09-13T05:11:09.644 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.025345828000000001 2024-09-13T05:11:09.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.644 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.644 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:11:09.644 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.600374+0000", 2024-09-13T05:11:09.644 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1096e-05 2024-09-13T05:11:09.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.644 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.645 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:11:09.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.600410+0000", 2024-09-13T05:11:09.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6142000000000001e-05 2024-09-13T05:11:09.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.645 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:09.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.600448+0000", 2024-09-13T05:11:09.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8101e-05 2024-09-13T05:11:09.645 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.645 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:09.645 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.645 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.645 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:09.645 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:09.647 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:09.647 INFO:teuthology.orchestra.run.smithi120.stdout:2958 write 0x858af4c thru 0x8599d91 (0xee46 bytes) 2024-09-13T05:11:09.647 INFO:teuthology.orchestra.run.smithi120.stdout:2959 write 0xaee6b6b thru 0xaef5bab (0xf041 bytes) 2024-09-13T05:11:09.648 INFO:teuthology.orchestra.run.smithi120.stdout:2960 read 0x2617127 thru 0x261c136 (0x5010 bytes) 2024-09-13T05:11:09.648 INFO:teuthology.orchestra.run.smithi120.stdout:2962 read 0x472a556 thru 0x472d807 (0x32b2 bytes) 2024-09-13T05:11:09.648 INFO:teuthology.orchestra.run.smithi120.stdout:2963 trunc from 0xe1fe176 to 0xdd452e3 2024-09-13T05:11:09.648 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:11:09.648 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:09.642+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:09.652 INFO:teuthology.orchestra.run.smithi120.stdout:2964 write 0xe0a3960 thru 0xe0b2550 (0xebf1 bytes) 2024-09-13T05:11:09.656 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:09.656 INFO:teuthology.orchestra.run.smithi120.stdout:2966 read 0x10874ed thru 0x1089605 (0x2119 bytes) 2024-09-13T05:11:09.657 INFO:teuthology.orchestra.run.smithi120.stdout:2967 write 0x7e8f8f5 thru 0x7e9c3b7 (0xcac3 bytes) 2024-09-13T05:11:09.671 INFO:teuthology.orchestra.run.smithi120.stdout:2968 write 0x2e25878 thru 0x2e290de (0x3867 bytes) 2024-09-13T05:11:09.679 INFO:teuthology.orchestra.run.smithi120.stdout:2969 write 0xbb97640 thru 0xbb9a4e1 (0x2ea2 bytes) 2024-09-13T05:11:09.686 INFO:teuthology.orchestra.run.smithi120.stdout:2971 read 0x5c26277 thru 0x5c2cf37 (0x6cc1 bytes) 2024-09-13T05:11:09.686 INFO:teuthology.orchestra.run.smithi120.stdout:2972 punch from 0xd522b53 to 0xd532374, (0xf821 bytes) 2024-09-13T05:11:09.687 INFO:teuthology.orchestra.run.smithi120.stdout:2974 punch from 0xc23f42 to 0xc2f433, (0xb4f1 bytes) 2024-09-13T05:11:09.687 INFO:teuthology.orchestra.run.smithi120.stdout:2975 read 0x21b4da7 thru 0x21b50b1 (0x30b bytes) 2024-09-13T05:11:09.687 INFO:teuthology.orchestra.run.smithi120.stdout:2976 punch from 0x2cd76cf to 0x2cdcf51, (0x5882 bytes) 2024-09-13T05:11:09.687 INFO:teuthology.orchestra.run.smithi120.stdout:2977 read 0x5445712 thru 0x544b48b (0x5d7a bytes) 2024-09-13T05:11:09.688 INFO:teuthology.orchestra.run.smithi120.stdout:2978 write 0x1fff740 thru 0x200d1e1 (0xdaa2 bytes) 2024-09-13T05:11:09.699 INFO:teuthology.orchestra.run.smithi120.stdout:2979 read 0x876f6e9 thru 0x8771953 (0x226b bytes) 2024-09-13T05:11:09.699 INFO:teuthology.orchestra.run.smithi120.stdout:2980 read 0xdced739 thru 0xdcf96fc (0xbfc4 bytes) 2024-09-13T05:11:09.718 INFO:teuthology.orchestra.run.smithi120.stdout:2982 trunc from 0xe0b2551 to 0x5bb4ff5 2024-09-13T05:11:09.745 INFO:teuthology.orchestra.run.smithi120.stdout:2983 writesame 0x34b1335 thru 0x34b228c data_size 0x4(0xf58 bytes) 2024-09-13T05:11:09.748 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:09.742+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:09.751 INFO:teuthology.orchestra.run.smithi120.stdout:2986 read 0x4f645f7 thru 0x4f70038 (0xba42 bytes) 2024-09-13T05:11:09.752 INFO:teuthology.orchestra.run.smithi120.stdout:2989 read 0x3f86202 thru 0x3f8b509 (0x5308 bytes) 2024-09-13T05:11:09.764 INFO:teuthology.orchestra.run.smithi120.stdout:2990 trunc from 0x5bb4ff5 to 0x114c03b 2024-09-13T05:11:09.774 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:09.774 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:09.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.774 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:64348 3.3 3:c6325cf8:::rbd_data.112d89f9378d.0000000000000029:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-13T05:11:09.774 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:09.770173+0000", 2024-09-13T05:11:09.774 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.002705215, 2024-09-13T05:11:09.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0027579140000000002, 2024-09-13T05:11:09.774 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:09.774 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "waiting for sub ops", 2024-09-13T05:11:09.774 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:09.775 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:09.775 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:09.775 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 64348 2024-09-13T05:11:09.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.775 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:09.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:09.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.770173+0000", 2024-09-13T05:11:09.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:09.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.770173+0000", 2024-09-13T05:11:09.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:09.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.770171+0000", 2024-09-13T05:11:09.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:11:09.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:09.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.770182+0000", 2024-09-13T05:11:09.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1e-05 2024-09-13T05:11:09.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:09.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.770202+0000", 2024-09-13T05:11:09.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0275000000000002e-05 2024-09-13T05:11:09.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:09.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.770216+0000", 2024-09-13T05:11:09.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3507e-05 2024-09-13T05:11:09.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:09.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.770496+0000", 2024-09-13T05:11:09.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00028053099999999999 2024-09-13T05:11:09.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:09.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.770572+0000", 2024-09-13T05:11:09.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5839000000000004e-05 2024-09-13T05:11:09.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 5", 2024-09-13T05:11:09.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.770678+0000", 2024-09-13T05:11:09.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000106004 2024-09-13T05:11:09.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:09.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.771835+0000", 2024-09-13T05:11:09.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0011574370000000001 2024-09-13T05:11:09.780 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.780 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:09.780 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.780 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:64351 3.19 e73/43 3:99e28b85:::rbd_data.112d89f9378d.000000000000002e:head v 73'512, mlcod=73'510)", 2024-09-13T05:11:09.781 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:09.770964+0000", 2024-09-13T05:11:09.781 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0019146079999999999, 2024-09-13T05:11:09.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002193193, 2024-09-13T05:11:09.781 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:09.781 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:09.781 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:09.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:09.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.770964+0000", 2024-09-13T05:11:09.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:09.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.770964+0000", 2024-09-13T05:11:09.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:09.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.770962+0000", 2024-09-13T05:11:09.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:09.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:09.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.770977+0000", 2024-09-13T05:11:09.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4453999999999999e-05 2024-09-13T05:11:09.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:09.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.770999+0000", 2024-09-13T05:11:09.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2033999999999999e-05 2024-09-13T05:11:09.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:09.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.771013+0000", 2024-09-13T05:11:09.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4548e-05 2024-09-13T05:11:09.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:09.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.771092+0000", 2024-09-13T05:11:09.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8553000000000005e-05 2024-09-13T05:11:09.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:09.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.771136+0000", 2024-09-13T05:11:09.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3979e-05 2024-09-13T05:11:09.784 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.784 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:09.784 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.785 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:64353 3.14 e73/22 3:2fb00591:::rbd_data.112d89f9378d.0000000000000030:head v 73'225, mlcod=73'223)", 2024-09-13T05:11:09.785 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:09.772863+0000", 2024-09-13T05:11:09.785 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.5546999999999999e-05, 2024-09-13T05:11:09.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00043648899999999997, 2024-09-13T05:11:09.785 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:09.785 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:09.785 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:09.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:09.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.772863+0000", 2024-09-13T05:11:09.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.786 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:09.786 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.772863+0000", 2024-09-13T05:11:09.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:09.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.786 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:09.786 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.772861+0000", 2024-09-13T05:11:09.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:09.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.786 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:09.786 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.772897+0000", 2024-09-13T05:11:09.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5255e-05 2024-09-13T05:11:09.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:09.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.772917+0000", 2024-09-13T05:11:09.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0494000000000001e-05 2024-09-13T05:11:09.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:09.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.772930+0000", 2024-09-13T05:11:09.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2867000000000001e-05 2024-09-13T05:11:09.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:09.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.772989+0000", 2024-09-13T05:11:09.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8647000000000003e-05 2024-09-13T05:11:09.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:09.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:09.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:09.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:09.773007+0000", 2024-09-13T05:11:09.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8031000000000001e-05 2024-09-13T05:11:09.788 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.788 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:09.788 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.788 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:09.788 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-09-13T05:11:09.788 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 3 2024-09-13T05:11:09.788 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:09.790 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:11:09.793 INFO:teuthology.orchestra.run.smithi120.stdout:2991 read 0x1d77db thru 0x1e26c6 (0xaeec bytes) 2024-09-13T05:11:09.821 INFO:teuthology.orchestra.run.smithi120.stdout:2992 write 0x68f0ada thru 0x68ffdcd (0xf2f4 bytes) 2024-09-13T05:11:09.848 INFO:teuthology.orchestra.run.smithi120.stdout:2993 writesame 0x9d0974c thru 0x9d17ecd data_size 0x1(0xe782 bytes) 2024-09-13T05:11:09.848 INFO:teuthology.orchestra.run.smithi120.stdout:2996 punch from 0x367c123 to 0x367c24f, (0x12c bytes) 2024-09-13T05:11:09.849 INFO:teuthology.orchestra.run.smithi120.stdout:3000 read 0x470e867 thru 0x471a408 (0xbba2 bytes) 2024-09-13T05:11:09.849 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:09.849 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:09.849 INFO:teuthology.orchestra.run.smithi120.stdout:3003 read 0xbf9444 thru 0xc068d5 (0xd492 bytes) 2024-09-13T05:11:09.849 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:09.841+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:09.849 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:09.850 INFO:teuthology.orchestra.run.smithi120.stdout:3005 write 0x7fd8176 thru 0x7fe2863 (0xa6ee bytes) 2024-09-13T05:11:09.857 INFO:teuthology.orchestra.run.smithi120.stdout:3006 read 0x369a615 thru 0x369c9b6 (0x23a2 bytes) 2024-09-13T05:11:09.857 INFO:teuthology.orchestra.run.smithi120.stdout:3007 write 0x9094e97 thru 0x90a3690 (0xe7fa bytes) 2024-09-13T05:11:09.865 INFO:teuthology.orchestra.run.smithi120.stdout:3008 read 0x4380850 thru 0x43856ac (0x4e5d bytes) 2024-09-13T05:11:09.866 INFO:teuthology.orchestra.run.smithi120.stdout:3009 read 0x9c2c7c6 thru 0x9c3c1c5 (0xfa00 bytes) 2024-09-13T05:11:09.880 INFO:teuthology.orchestra.run.smithi120.stdout:3012 trunc from 0x9d17ece to 0x38529be 2024-09-13T05:11:09.897 INFO:teuthology.orchestra.run.smithi120.stdout:3013 clone 24 order 19 su 131072 sc 7 2024-09-13T05:11:09.899 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:09.899 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:09.899 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:09.899 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:09.899 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:09.909 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:11:09.950 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:09.949+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:10.011 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:10.011 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:10.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:10.011 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:10.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.011 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29020 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2855936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.011 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:11:10.011 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 32.967370690000003, 2024-09-13T05:11:10.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060733743, 2024-09-13T05:11:10.012 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.012 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:10.012 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.012 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.012 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.012 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29020 2024-09-13T05:11:10.012 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.012 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.012 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.012 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:11:10.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:11:10.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041741+0000", 2024-09-13T05:11:10.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041749+0000", 2024-09-13T05:11:10.014 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6059999999999997e-06 2024-09-13T05:11:10.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.014 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.014 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041754+0000", 2024-09-13T05:11:10.014 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6740000000000002e-06 2024-09-13T05:11:10.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.014 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.014 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041760+0000", 2024-09-13T05:11:10.014 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0459999999999996e-06 2024-09-13T05:11:10.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102289+0000", 2024-09-13T05:11:10.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060529145999999999 2024-09-13T05:11:10.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:10.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102378+0000", 2024-09-13T05:11:10.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8901999999999997e-05 2024-09-13T05:11:10.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102476+0000", 2024-09-13T05:11:10.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7991000000000004e-05 2024-09-13T05:11:10.015 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.016 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.016 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.016 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29021 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2865152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.016 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:11:10.016 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 32.967348694999998, 2024-09-13T05:11:10.016 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060927993999999999, 2024-09-13T05:11:10.016 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.016 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:10.016 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.016 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.016 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.016 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29021 2024-09-13T05:11:10.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.017 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.017 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.017 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.017 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:11:10.017 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.017 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.017 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.017 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:11:10.017 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.017 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.017 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041763+0000", 2024-09-13T05:11:10.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041766+0000", 2024-09-13T05:11:10.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6800000000000002e-06 2024-09-13T05:11:10.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041771+0000", 2024-09-13T05:11:10.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:11:10.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041776+0000", 2024-09-13T05:11:10.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8489999999999997e-06 2024-09-13T05:11:10.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102513+0000", 2024-09-13T05:11:10.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060737102000000001 2024-09-13T05:11:10.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:10.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102597+0000", 2024-09-13T05:11:10.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4374000000000002e-05 2024-09-13T05:11:10.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.020 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.020 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102692+0000", 2024-09-13T05:11:10.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4436000000000002e-05 2024-09-13T05:11:10.020 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.020 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.020 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.020 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29022 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2874368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.020 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:11:10.020 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 32.967332395, 2024-09-13T05:11:10.021 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061135083999999999, 2024-09-13T05:11:10.021 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.021 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:10.021 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.021 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.021 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.021 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29022 2024-09-13T05:11:10.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.021 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.021 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.021 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:11:10.021 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:11:10.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:11:10.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041782+0000", 2024-09-13T05:11:10.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4959999999999999e-06 2024-09-13T05:11:10.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041787+0000", 2024-09-13T05:11:10.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1240000000000004e-06 2024-09-13T05:11:10.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041792+0000", 2024-09-13T05:11:10.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9200000000000003e-06 2024-09-13T05:11:10.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.024 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102738+0000", 2024-09-13T05:11:10.024 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060945581999999998 2024-09-13T05:11:10.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:10.024 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102821+0000", 2024-09-13T05:11:10.024 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2898999999999994e-05 2024-09-13T05:11:10.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.025 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102915+0000", 2024-09-13T05:11:10.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4523000000000003e-05 2024-09-13T05:11:10.025 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.025 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.025 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.025 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29067 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2764800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.025 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:11:10.025 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 32.963558178, 2024-09-13T05:11:10.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060816621000000001, 2024-09-13T05:11:10.025 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.025 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:10.025 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.026 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.026 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.026 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29067 2024-09-13T05:11:10.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.026 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.026 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.026 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:11:10.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.026 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.026 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:11:10.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.027 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.027 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:11:10.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.027 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.027 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045557+0000", 2024-09-13T05:11:10.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.898e-06 2024-09-13T05:11:10.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.027 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.027 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045575+0000", 2024-09-13T05:11:10.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8252000000000001e-05 2024-09-13T05:11:10.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.028 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045581+0000", 2024-09-13T05:11:10.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:11:10.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.028 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106183+0000", 2024-09-13T05:11:10.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060602630999999997 2024-09-13T05:11:10.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:10.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106271+0000", 2024-09-13T05:11:10.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7329000000000004e-05 2024-09-13T05:11:10.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106371+0000", 2024-09-13T05:11:10.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000100164 2024-09-13T05:11:10.029 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.029 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.029 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.029 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29068 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2774016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.030 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:11:10.030 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 32.963526944000002, 2024-09-13T05:11:10.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060994509000000002, 2024-09-13T05:11:10.030 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.030 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:10.030 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.030 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.030 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.030 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29068 2024-09-13T05:11:10.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.030 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.030 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:11:10.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.031 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.031 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:11:10.031 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.031 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.031 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045585+0000", 2024-09-13T05:11:10.031 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.031 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.031 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045588+0000", 2024-09-13T05:11:10.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:11:10.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045594+0000", 2024-09-13T05:11:10.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9329999999999998e-06 2024-09-13T05:11:10.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045599+0000", 2024-09-13T05:11:10.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3190000000000002e-06 2024-09-13T05:11:10.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106399+0000", 2024-09-13T05:11:10.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060800361999999997 2024-09-13T05:11:10.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:10.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106489+0000", 2024-09-13T05:11:10.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9301000000000004e-05 2024-09-13T05:11:10.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106580+0000", 2024-09-13T05:11:10.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1314e-05 2024-09-13T05:11:10.033 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.034 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.034 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.034 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29069 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2792448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.034 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:11:10.034 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 32.963508527000002, 2024-09-13T05:11:10.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061207599000000001, 2024-09-13T05:11:10.034 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.034 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:10.034 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.034 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.034 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.034 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29069 2024-09-13T05:11:10.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.035 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.035 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:11:10.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.035 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:11:10.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.036 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045603+0000", 2024-09-13T05:11:10.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.036 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.036 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.036 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.036 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045606+0000", 2024-09-13T05:11:10.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7300000000000001e-06 2024-09-13T05:11:10.036 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.036 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.036 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.036 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045612+0000", 2024-09-13T05:11:10.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9599999999999997e-06 2024-09-13T05:11:10.036 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.036 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.037 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.037 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045619+0000", 2024-09-13T05:11:10.037 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6019999999999996e-06 2024-09-13T05:11:10.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.037 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.037 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106619+0000", 2024-09-13T05:11:10.037 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061000029999999997 2024-09-13T05:11:10.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.037 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:10.037 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106713+0000", 2024-09-13T05:11:10.037 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4505000000000004e-05 2024-09-13T05:11:10.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106812+0000", 2024-09-13T05:11:10.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8264000000000007e-05 2024-09-13T05:11:10.038 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.038 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.038 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.038 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29070 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2783232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.038 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:11:10.038 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 32.963488067999997, 2024-09-13T05:11:10.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061389805999999998, 2024-09-13T05:11:10.038 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.039 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:10.039 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.039 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.039 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.039 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29070 2024-09-13T05:11:10.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.039 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:11:10.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:11:10.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:11:10.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045627+0000", 2024-09-13T05:11:10.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6579999999999998e-06 2024-09-13T05:11:10.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.041 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.041 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.041 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045632+0000", 2024-09-13T05:11:10.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8449999999999999e-06 2024-09-13T05:11:10.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.041 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.041 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.041 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045639+0000", 2024-09-13T05:11:10.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:11:10.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.041 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.041 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.041 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106837+0000", 2024-09-13T05:11:10.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061198529000000002 2024-09-13T05:11:10.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:10.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106922+0000", 2024-09-13T05:11:10.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4771999999999994e-05 2024-09-13T05:11:10.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107014+0000", 2024-09-13T05:11:10.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2009000000000006e-05 2024-09-13T05:11:10.042 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.042 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.042 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.043 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29071 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2801664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.043 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:11:10.043 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 32.963468992000003, 2024-09-13T05:11:10.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061582804999999997, 2024-09-13T05:11:10.043 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.043 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:10.043 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.043 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.043 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.043 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29071 2024-09-13T05:11:10.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.043 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:11:10.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:11:10.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045643+0000", 2024-09-13T05:11:10.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045646+0000", 2024-09-13T05:11:10.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:11:10.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045664+0000", 2024-09-13T05:11:10.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8408000000000001e-05 2024-09-13T05:11:10.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045670+0000", 2024-09-13T05:11:10.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7710000000000003e-06 2024-09-13T05:11:10.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.046 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.046 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107048+0000", 2024-09-13T05:11:10.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061378438 2024-09-13T05:11:10.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.046 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:10.046 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107134+0000", 2024-09-13T05:11:10.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5574000000000004e-05 2024-09-13T05:11:10.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.046 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.046 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107226+0000", 2024-09-13T05:11:10.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2262000000000005e-05 2024-09-13T05:11:10.047 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.047 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.047 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.047 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29072 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2810880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.047 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:11:10.047 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 32.963437608, 2024-09-13T05:11:10.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061762233999999999, 2024-09-13T05:11:10.047 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.047 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:10.047 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.048 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.048 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.048 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29072 2024-09-13T05:11:10.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.048 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:11:10.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:11:10.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.049 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045674+0000", 2024-09-13T05:11:10.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.049 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045677+0000", 2024-09-13T05:11:10.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9679999999999998e-06 2024-09-13T05:11:10.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.049 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045694+0000", 2024-09-13T05:11:10.050 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6801999999999999e-05 2024-09-13T05:11:10.050 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.050 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.050 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.050 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045700+0000", 2024-09-13T05:11:10.050 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8270000000000003e-06 2024-09-13T05:11:10.050 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.050 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.050 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.050 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107249+0000", 2024-09-13T05:11:10.050 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061549114000000002 2024-09-13T05:11:10.050 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.050 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.050 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:10.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107341+0000", 2024-09-13T05:11:10.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2390000000000001e-05 2024-09-13T05:11:10.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107437+0000", 2024-09-13T05:11:10.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5648000000000003e-05 2024-09-13T05:11:10.051 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.051 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.051 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.051 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29073 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2820096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.051 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:11:10.052 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 32.963395630000001, 2024-09-13T05:11:10.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061873910999999997, 2024-09-13T05:11:10.052 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.052 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:10.052 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.052 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.052 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.052 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29073 2024-09-13T05:11:10.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.052 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:11:10.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.053 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.053 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:11:10.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.053 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.053 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045716+0000", 2024-09-13T05:11:10.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.053 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045726+0000", 2024-09-13T05:11:10.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6350000000000001e-06 2024-09-13T05:11:10.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045739+0000", 2024-09-13T05:11:10.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3325e-05 2024-09-13T05:11:10.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045746+0000", 2024-09-13T05:11:10.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7399999999999998e-06 2024-09-13T05:11:10.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.055 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.055 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107457+0000", 2024-09-13T05:11:10.055 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061711038000000003 2024-09-13T05:11:10.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.055 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:10.055 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107522+0000", 2024-09-13T05:11:10.055 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4850000000000004e-05 2024-09-13T05:11:10.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.055 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.055 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107591+0000", 2024-09-13T05:11:10.055 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9029999999999995e-05 2024-09-13T05:11:10.055 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.056 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.056 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.056 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.056 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29074 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2829312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.056 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:11:10.056 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 32.963361722000002, 2024-09-13T05:11:10.056 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062055459, 2024-09-13T05:11:10.056 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.056 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:10.056 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.056 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.056 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.056 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29074 2024-09-13T05:11:10.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.057 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:11:10.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:11:10.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045750+0000", 2024-09-13T05:11:10.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045753+0000", 2024-09-13T05:11:10.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8399999999999999e-06 2024-09-13T05:11:10.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045759+0000", 2024-09-13T05:11:10.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8900000000000004e-06 2024-09-13T05:11:10.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.059 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.059 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045764+0000", 2024-09-13T05:11:10.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3850000000000001e-06 2024-09-13T05:11:10.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.059 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.059 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.059 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107623+0000", 2024-09-13T05:11:10.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061858817000000003 2024-09-13T05:11:10.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.059 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.059 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:10.059 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107710+0000", 2024-09-13T05:11:10.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7127999999999997e-05 2024-09-13T05:11:10.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.060 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.060 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.060 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107806+0000", 2024-09-13T05:11:10.060 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5886999999999999e-05 2024-09-13T05:11:10.060 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.060 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.060 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.060 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.060 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29075 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2838528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.060 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:11:10.060 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 32.963343268000003, 2024-09-13T05:11:10.060 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062188516999999999, 2024-09-13T05:11:10.061 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.061 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:10.061 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.061 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.061 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.061 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29075 2024-09-13T05:11:10.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.061 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:11:10.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:11:10.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:11:10.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045772+0000", 2024-09-13T05:11:10.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:11:10.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.063 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.063 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.063 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045778+0000", 2024-09-13T05:11:10.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9229999999999996e-06 2024-09-13T05:11:10.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.063 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.063 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.063 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045784+0000", 2024-09-13T05:11:10.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3800000000000002e-06 2024-09-13T05:11:10.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.063 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.063 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.063 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107823+0000", 2024-09-13T05:11:10.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062039331000000003 2024-09-13T05:11:10.064 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.064 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.064 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:10.064 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107886+0000", 2024-09-13T05:11:10.064 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2476000000000003e-05 2024-09-13T05:11:10.064 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.064 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.064 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.064 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107958+0000", 2024-09-13T05:11:10.064 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2089999999999996e-05 2024-09-13T05:11:10.064 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.064 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.064 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.064 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.065 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.065 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29115 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2682880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.065 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:11:10.065 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 32.959877741, 2024-09-13T05:11:10.065 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060847898999999997, 2024-09-13T05:11:10.065 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.065 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:10.065 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.065 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.065 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.065 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29115 2024-09-13T05:11:10.065 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.065 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.065 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.066 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.066 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:11:10.066 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.066 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.066 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.066 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.066 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:11:10.066 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.066 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.066 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.066 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.066 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049234+0000", 2024-09-13T05:11:10.066 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.066 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.067 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.067 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.067 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049237+0000", 2024-09-13T05:11:10.067 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9069999999999999e-06 2024-09-13T05:11:10.067 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.067 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.067 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.067 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049243+0000", 2024-09-13T05:11:10.067 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7459999999999997e-06 2024-09-13T05:11:10.067 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.067 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.067 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.068 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049248+0000", 2024-09-13T05:11:10.068 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1490000000000002e-06 2024-09-13T05:11:10.068 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.068 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.068 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.068 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.109945+0000", 2024-09-13T05:11:10.068 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060697299000000003 2024-09-13T05:11:10.068 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.068 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.068 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:10.068 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110013+0000", 2024-09-13T05:11:10.068 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8023999999999998e-05 2024-09-13T05:11:10.069 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.069 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.069 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.069 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110083+0000", 2024-09-13T05:11:10.069 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9296999999999997e-05 2024-09-13T05:11:10.069 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.069 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.069 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.069 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.069 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.069 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29116 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2692096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.069 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:11:10.069 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 32.959859897000001, 2024-09-13T05:11:10.070 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061040167999999999, 2024-09-13T05:11:10.070 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.070 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:10.070 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.070 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.070 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.070 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29116 2024-09-13T05:11:10.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.070 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.070 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.070 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.070 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:11:10.070 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:11:10.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.071 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049252+0000", 2024-09-13T05:11:10.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.071 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049255+0000", 2024-09-13T05:11:10.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7250000000000002e-06 2024-09-13T05:11:10.072 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.072 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.072 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.072 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049261+0000", 2024-09-13T05:11:10.072 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.755e-06 2024-09-13T05:11:10.072 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.072 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.072 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.072 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049266+0000", 2024-09-13T05:11:10.072 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2100000000000001e-06 2024-09-13T05:11:10.072 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.072 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.072 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.073 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110115+0000", 2024-09-13T05:11:10.073 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060849225999999999 2024-09-13T05:11:10.073 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.073 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.073 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:10.073 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110199+0000", 2024-09-13T05:11:10.073 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4339999999999995e-05 2024-09-13T05:11:10.073 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.073 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.073 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.073 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110293+0000", 2024-09-13T05:11:10.073 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3397e-05 2024-09-13T05:11:10.073 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.073 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.074 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.074 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.074 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29117 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2701312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.074 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:11:10.074 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 32.959842260000002, 2024-09-13T05:11:10.074 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.06118527, 2024-09-13T05:11:10.074 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.074 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:10.074 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.074 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.074 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.074 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29117 2024-09-13T05:11:10.074 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.075 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.075 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.075 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:11:10.075 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.075 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.075 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:11:10.075 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.075 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.075 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:11:10.076 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.076 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.076 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.076 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.076 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049273+0000", 2024-09-13T05:11:10.076 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.757e-06 2024-09-13T05:11:10.076 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.076 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.076 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.076 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049278+0000", 2024-09-13T05:11:10.076 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7830000000000004e-06 2024-09-13T05:11:10.076 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.076 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.077 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.077 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049284+0000", 2024-09-13T05:11:10.077 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3820000000000003e-06 2024-09-13T05:11:10.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.077 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.077 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.077 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110313+0000", 2024-09-13T05:11:10.077 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061029682000000002 2024-09-13T05:11:10.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.077 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.077 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:10.077 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110383+0000", 2024-09-13T05:11:10.077 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9406000000000006e-05 2024-09-13T05:11:10.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.078 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.078 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110456+0000", 2024-09-13T05:11:10.078 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2750000000000007e-05 2024-09-13T05:11:10.078 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.078 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.078 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.078 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29118 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2710528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.078 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:11:10.078 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 32.959824345000001, 2024-09-13T05:11:10.078 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061380698999999997, 2024-09-13T05:11:10.078 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.079 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:10.079 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.079 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.079 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.079 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29118 2024-09-13T05:11:10.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.079 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.079 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.079 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.079 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:11:10.079 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.079 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.079 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.080 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:11:10.080 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.080 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.080 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.080 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.080 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:11:10.080 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.080 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.080 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.080 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.080 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049291+0000", 2024-09-13T05:11:10.080 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8770000000000002e-06 2024-09-13T05:11:10.080 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.081 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.081 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.081 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049296+0000", 2024-09-13T05:11:10.081 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6799999999999998e-06 2024-09-13T05:11:10.081 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.081 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.081 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.081 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049302+0000", 2024-09-13T05:11:10.081 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2769999999999996e-06 2024-09-13T05:11:10.081 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.081 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.081 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.081 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110488+0000", 2024-09-13T05:11:10.081 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061186184999999997 2024-09-13T05:11:10.082 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.082 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.082 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:10.082 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110577+0000", 2024-09-13T05:11:10.082 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9246000000000006e-05 2024-09-13T05:11:10.082 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.082 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.082 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.082 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110669+0000", 2024-09-13T05:11:10.082 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1923999999999996e-05 2024-09-13T05:11:10.082 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.082 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.082 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.082 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.083 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.083 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29119 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2719744~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.083 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:11:10.083 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 32.959806600999997, 2024-09-13T05:11:10.083 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061521165000000003, 2024-09-13T05:11:10.083 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.083 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:10.083 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.083 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.083 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.083 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29119 2024-09-13T05:11:10.083 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.083 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.083 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.084 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.084 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:11:10.084 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.084 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.084 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.084 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.084 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:11:10.084 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.084 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.084 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.084 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.084 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049305+0000", 2024-09-13T05:11:10.084 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.085 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.085 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.085 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.085 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049308+0000", 2024-09-13T05:11:10.085 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7070000000000001e-06 2024-09-13T05:11:10.085 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.085 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.085 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.085 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049316+0000", 2024-09-13T05:11:10.085 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:11:10.085 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.085 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.085 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.085 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049322+0000", 2024-09-13T05:11:10.086 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3199999999999999e-06 2024-09-13T05:11:10.086 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.086 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.086 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.086 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110690+0000", 2024-09-13T05:11:10.086 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061368428000000003 2024-09-13T05:11:10.086 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.086 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.086 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:10.086 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110755+0000", 2024-09-13T05:11:10.086 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4893000000000004e-05 2024-09-13T05:11:10.086 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.086 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.087 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.087 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110827+0000", 2024-09-13T05:11:10.087 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2039000000000006e-05 2024-09-13T05:11:10.087 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.087 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.087 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.087 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.087 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29120 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2728960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.087 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:11:10.087 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 32.959786330999997, 2024-09-13T05:11:10.087 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061718420000000003, 2024-09-13T05:11:10.087 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.087 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:10.088 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.088 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.088 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.088 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29120 2024-09-13T05:11:10.088 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.088 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.088 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.088 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.088 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:11:10.088 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.088 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.088 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.088 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.089 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:11:10.089 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.089 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.089 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.089 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.089 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:11:10.089 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.089 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.089 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.089 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.089 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049329+0000", 2024-09-13T05:11:10.089 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.022e-06 2024-09-13T05:11:10.089 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.089 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.090 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.090 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049336+0000", 2024-09-13T05:11:10.090 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0720000000000002e-06 2024-09-13T05:11:10.090 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.090 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.090 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.090 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049341+0000", 2024-09-13T05:11:10.090 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:11:10.090 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.090 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.090 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.090 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110864+0000", 2024-09-13T05:11:10.090 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061523126999999997 2024-09-13T05:11:10.090 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.091 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.091 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:10.091 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110951+0000", 2024-09-13T05:11:10.091 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6557000000000005e-05 2024-09-13T05:11:10.091 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.091 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.091 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.091 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.111045+0000", 2024-09-13T05:11:10.091 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4043999999999996e-05 2024-09-13T05:11:10.091 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.091 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.091 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.091 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.091 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.091 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29136 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2876416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.092 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:11:10.092 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 32.955770905999998, 2024-09-13T05:11:10.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060742995000000001, 2024-09-13T05:11:10.092 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.092 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:10.092 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.092 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.092 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.092 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29136 2024-09-13T05:11:10.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.092 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.092 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.092 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.092 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:11:10.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:11:10.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053341+0000", 2024-09-13T05:11:10.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053344+0000", 2024-09-13T05:11:10.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:11:10.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.094 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053350+0000", 2024-09-13T05:11:10.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7200000000000003e-06 2024-09-13T05:11:10.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.094 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053355+0000", 2024-09-13T05:11:10.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0150000000000003e-06 2024-09-13T05:11:10.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.095 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.095 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113909+0000", 2024-09-13T05:11:10.095 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060554368999999997 2024-09-13T05:11:10.095 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.095 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.095 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:10.095 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113994+0000", 2024-09-13T05:11:10.095 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4658000000000002e-05 2024-09-13T05:11:10.095 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.095 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.095 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.095 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114085+0000", 2024-09-13T05:11:10.095 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0939000000000005e-05 2024-09-13T05:11:10.096 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.096 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.096 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.096 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.096 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.096 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29166 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2628608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.096 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:11:10.096 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 32.955753471999998, 2024-09-13T05:11:10.096 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060883127000000002, 2024-09-13T05:11:10.096 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.096 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:10.096 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.096 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.096 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.097 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29166 2024-09-13T05:11:10.097 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.097 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.097 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.097 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.097 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:11:10.097 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.097 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.097 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.097 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.097 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:11:10.097 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.097 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.097 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.098 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.098 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:11:10.098 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.098 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.098 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.098 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.098 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053361+0000", 2024-09-13T05:11:10.098 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:11:10.098 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.098 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.098 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.098 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053367+0000", 2024-09-13T05:11:10.098 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7350000000000001e-06 2024-09-13T05:11:10.098 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.098 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.099 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.099 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053372+0000", 2024-09-13T05:11:10.099 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7840000000000003e-06 2024-09-13T05:11:10.099 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.099 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.099 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.099 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114103+0000", 2024-09-13T05:11:10.099 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060730924999999998 2024-09-13T05:11:10.099 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.099 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.099 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:10.099 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114171+0000", 2024-09-13T05:11:10.099 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8021999999999993e-05 2024-09-13T05:11:10.099 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.100 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.100 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.100 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114242+0000", 2024-09-13T05:11:10.100 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1390999999999995e-05 2024-09-13T05:11:10.100 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.100 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.100 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.100 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.100 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.100 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:10.102 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:11:10.102 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:10.097+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:10.202 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:10.201+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:10.216 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:10.216 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:10.216 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:11:10.216 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:10.225 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:11:10.303 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:10.297+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:10.338 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:10.338 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:10.338 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:10.338 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:10.339 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:10.348 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:11:10.385 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone23 from 0x38529be (overlap 0x114c03b) to 0xa60cf0 2024-09-13T05:11:10.404 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:10.397+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:10.465 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:10.466 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:10.466 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:10.466 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:10.466 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.466 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.466 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:10.466 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 33.599187411999999, 2024-09-13T05:11:10.466 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:11:10.466 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.466 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:10.466 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.467 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.467 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.467 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:11:10.467 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.467 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.467 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.467 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.467 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:10.467 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.467 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.467 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.467 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.467 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:10.468 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.468 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.468 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.468 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.468 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:10.468 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:10.468 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.468 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.468 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.468 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:11:10.468 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:11:10.468 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.468 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.468 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.469 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:11:10.469 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:11:10.469 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.469 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.469 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.469 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:11:10.469 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:11:10.469 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.469 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.469 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.469 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:11:10.469 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:11:10.469 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.470 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.470 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.470 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:11:10.470 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:11:10.470 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.470 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.470 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.470 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:11:10.470 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:11:10.470 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.470 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.470 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:10.470 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:11:10.471 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:11:10.471 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.471 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.471 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.471 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:11:10.471 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:11:10.471 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.471 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.471 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.471 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.471 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.471 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.471 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:10.471 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 33.599162976000002, 2024-09-13T05:11:10.472 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:11:10.472 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.472 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:10.472 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.472 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.472 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.472 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:11:10.472 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.472 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.472 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.472 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.472 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:10.472 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.473 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.473 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.473 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.473 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:10.473 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.473 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.473 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.473 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.473 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:10.473 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:10.473 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.473 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.473 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.473 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:11:10.474 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:11:10.474 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.474 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.474 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.474 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:11:10.474 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:11:10.474 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.474 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.474 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.474 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:11:10.474 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:11:10.474 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.474 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.475 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.475 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:11:10.475 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:11:10.475 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.475 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.475 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.475 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:11:10.475 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:11:10.475 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.475 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.475 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.475 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:11:10.475 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:11:10.475 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.476 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.476 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:10.476 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:11:10.476 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:11:10.476 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.476 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.476 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.476 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:11:10.476 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:11:10.476 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.476 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.476 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.476 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.477 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.477 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.477 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:10.477 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 33.599153149999999, 2024-09-13T05:11:10.477 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:11:10.477 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.477 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:10.477 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.477 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.477 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.477 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:11:10.477 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.477 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.477 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.478 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.478 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:10.478 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.478 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.478 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.478 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.478 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:10.478 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.478 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.478 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.478 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.478 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:10.479 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:10.479 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.479 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.479 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.479 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:11:10.479 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:11:10.479 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.479 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.479 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.479 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:11:10.479 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:11:10.479 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.479 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.479 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.480 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:11:10.480 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:11:10.480 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.480 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.480 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.480 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:11:10.480 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:11:10.480 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.480 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.480 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.480 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:11:10.480 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:11:10.480 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.481 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.481 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.481 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:11:10.481 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:11:10.481 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.481 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.481 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.481 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:11:10.481 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:11:10.481 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.481 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.481 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.481 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.481 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.482 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.482 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:10.482 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 33.599144914, 2024-09-13T05:11:10.482 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:11:10.482 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.482 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:10.482 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.482 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.482 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.482 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:11:10.482 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.482 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.482 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.483 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.483 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:10.483 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.483 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.483 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.483 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:10.483 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.483 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.483 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.483 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:10.483 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:10.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.484 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.484 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.484 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:11:10.484 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:11:10.484 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.484 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.484 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.484 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:11:10.484 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:11:10.484 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.484 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.484 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.484 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:11:10.485 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:11:10.485 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.485 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.485 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.485 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:11:10.485 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:11:10.485 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.485 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.485 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.485 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:11:10.485 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:11:10.485 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.485 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.486 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.486 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:11:10.486 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:11:10.486 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.486 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.486 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.486 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:11:10.486 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:11:10.486 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.486 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.486 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.486 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.486 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.486 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.487 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:10.487 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 33.599123001999999, 2024-09-13T05:11:10.487 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:11:10.487 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.487 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:10.487 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.487 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.487 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.487 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:11:10.487 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.487 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.487 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.487 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.487 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:10.488 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.488 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.488 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.488 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.488 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:10.488 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.488 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.488 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.488 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.488 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:10.488 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:10.488 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.488 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.489 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.489 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:11:10.489 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:11:10.489 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.489 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.489 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.489 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:11:10.489 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:11:10.489 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.489 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.489 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.489 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:11:10.489 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:11:10.489 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.490 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.490 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.490 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:11:10.490 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:11:10.490 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.490 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.490 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.490 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:11:10.490 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:11:10.490 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.490 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.490 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.490 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:11:10.491 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:11:10.491 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.491 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.491 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.491 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:11:10.491 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:11:10.491 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.491 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.491 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.491 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.491 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.491 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.491 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:10.491 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 33.599114397999998, 2024-09-13T05:11:10.492 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:11:10.492 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.492 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:10.492 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.492 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.492 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.492 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:11:10.492 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.492 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.492 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.492 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.492 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:10.492 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.493 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.493 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.493 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.493 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:10.493 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.493 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.493 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.493 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.493 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:10.493 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:10.493 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.493 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.493 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.493 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:11:10.494 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:11:10.494 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.494 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.494 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.494 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:11:10.494 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:11:10.494 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.494 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.494 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.494 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:11:10.494 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:11:10.494 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.494 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.494 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.495 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:11:10.495 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:11:10.495 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.495 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.495 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.495 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:11:10.495 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:11:10.495 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.495 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.495 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.495 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:11:10.495 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:11:10.495 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.496 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.496 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.496 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:11:10.496 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:11:10.496 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.496 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.496 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.496 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.496 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.496 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.496 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:10.496 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 33.599104703999998, 2024-09-13T05:11:10.496 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:11:10.497 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.497 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:10.497 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.497 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.497 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.497 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:11:10.497 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.497 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.497 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.497 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.497 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:10.497 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.497 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.497 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.498 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.498 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:10.498 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.498 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.498 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.498 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.498 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:10.498 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:10.498 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.498 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.498 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.498 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:11:10.498 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:11:10.498 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.499 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.499 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.499 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:11:10.499 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:11:10.499 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.499 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.499 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.499 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:11:10.499 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:11:10.499 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.499 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.499 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.499 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:11:10.500 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:11:10.500 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.500 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.500 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.500 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:11:10.500 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:11:10.500 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.500 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.500 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.500 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:11:10.500 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:11:10.500 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.500 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.501 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.501 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:11:10.501 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:11:10.501 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.501 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.501 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.501 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.501 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.501 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.501 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:10.501 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 33.599095589000001, 2024-09-13T05:11:10.501 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:11:10.501 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.501 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:10.502 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.502 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.502 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.502 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:11:10.502 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.502 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.502 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.502 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.502 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:10.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.502 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.502 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.502 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.502 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:10.503 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.503 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.503 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.503 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.503 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:10.503 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:10.503 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.503 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.503 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.503 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:11:10.503 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:11:10.503 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.503 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.503 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.504 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:11:10.504 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:11:10.504 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.504 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.504 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.504 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:11:10.504 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:11:10.504 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.504 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.504 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.504 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:11:10.504 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:11:10.504 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.504 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.505 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.505 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:11:10.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:11:10.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.505 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.505 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.505 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:11:10.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:11:10.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.505 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.505 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.505 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:11:10.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:11:10.505 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.506 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.506 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.506 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.506 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.506 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:11:10.506 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 33.599087109999999, 2024-09-13T05:11:10.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:11:10.506 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.506 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:10.506 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.506 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.506 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.507 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:11:10.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.507 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.507 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.507 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:11:10.507 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.507 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.507 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:11:10.507 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.508 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.508 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:11:10.508 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.508 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.508 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.508 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.508 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:11:10.508 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:11:10.508 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.508 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.508 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.508 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:11:10.508 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:11:10.509 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.509 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.509 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.509 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:11:10.509 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:11:10.509 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.509 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.509 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.509 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:11:10.509 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:11:10.509 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.509 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.509 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.510 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:11:10.510 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:11:10.510 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.510 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.510 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.510 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:11:10.510 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:11:10.510 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.510 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.510 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.510 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:11:10.510 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:11:10.510 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.510 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.511 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.511 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.511 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.511 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:11:10.511 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 33.599075184999997, 2024-09-13T05:11:10.511 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:11:10.511 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.511 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:10.511 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.511 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.511 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.511 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:11:10.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.512 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.512 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.512 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.512 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:11:10.512 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.512 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.512 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.512 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:11:10.512 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.512 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.512 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.513 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:11:10.513 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:10.513 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.513 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.513 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:11:10.513 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:11:10.513 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.513 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.513 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:11:10.513 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:11:10.513 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.514 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.514 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:11:10.514 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:11:10.514 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.514 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.514 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.514 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:11:10.514 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:11:10.514 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.514 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.514 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.514 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:11:10.514 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:11:10.514 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.515 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.515 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:11:10.515 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:11:10.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.515 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.515 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:11:10.515 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:11:10.515 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.515 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.515 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.516 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.516 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:10.516 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 33.599053595999997, 2024-09-13T05:11:10.516 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:11:10.516 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.516 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:10.516 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.516 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.516 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.516 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:11:10.516 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.516 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.516 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.516 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.517 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:10.517 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.517 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.517 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:10.517 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.517 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.517 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:10.517 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.518 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.518 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:11:10.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:11:10.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.518 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.518 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:11:10.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:11:10.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.518 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.518 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:11:10.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:11:10.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.519 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:11:10.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:11:10.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.519 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:11:10.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:11:10.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.519 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:11:10.520 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:11:10.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.520 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.520 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:11:10.520 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:11:10.520 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.520 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.520 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.520 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.520 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:10.521 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 33.599030468000002, 2024-09-13T05:11:10.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:11:10.521 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.521 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:10.521 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.521 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.521 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.521 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:11:10.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.521 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.521 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.521 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:10.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:10.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:10.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:11:10.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:11:10.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.523 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:11:10.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:11:10.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.523 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:11:10.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:11:10.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:11:10.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:11:10.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:11:10.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:11:10.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:11:10.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:11:10.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.525 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.525 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:11:10.525 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:11:10.525 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.525 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.525 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.525 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.525 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:11:10.525 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 33.599015094999999, 2024-09-13T05:11:10.525 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:11:10.526 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.526 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:10.526 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.526 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.526 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.526 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:11:10.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.526 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.526 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.526 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:11:10.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:11:10.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:11:10.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:11:10.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:11:10.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.528 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.528 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:11:10.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:11:10.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.528 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.528 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:11:10.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:11:10.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.528 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.528 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:11:10.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:11:10.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.529 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.529 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:11:10.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:11:10.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.529 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.529 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:11:10.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:11:10.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.529 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.530 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:11:10.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:11:10.530 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.530 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.530 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.530 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.530 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:10.530 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 33.598994627000003, 2024-09-13T05:11:10.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:11:10.530 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.530 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:10.531 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.531 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.531 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.531 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:11:10.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.531 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:10.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:10.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:10.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:11:10.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:11:10.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:11:10.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:11:10.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:11:10.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:11:10.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:11:10.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:11:10.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:11:10.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:11:10.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:11:10.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:11:10.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:11:10.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:11:10.535 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.535 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.535 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.535 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.535 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.535 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:10.535 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 33.598977966, 2024-09-13T05:11:10.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:11:10.535 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.535 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:10.535 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.535 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.535 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.536 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:11:10.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.536 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:10.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:10.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:10.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:11:10.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:11:10.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:11:10.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:11:10.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:11:10.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:11:10.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:11:10.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:11:10.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:11:10.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:11:10.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.539 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.539 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:11:10.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:11:10.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.539 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.539 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:11:10.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:11:10.539 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.539 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.539 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:11:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 33.598951253000003, 2024-09-13T05:11:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:11:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:11:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.540 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:11:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:11:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:11:10.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:11:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:11:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:11:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:11:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:11:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:11:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:11:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:11:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:11:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:11:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:11:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:11:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:11:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:11:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.544 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 33.598932400999999, 2024-09-13T05:11:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:11:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:11:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.545 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:10.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:10.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:10.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:11:10.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:11:10.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:11:10.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:11:10.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:11:10.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:11:10.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:11:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:11:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:11:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:11:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:11:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:11:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:11:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:11:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:10.549 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 33.598914614999998, 2024-09-13T05:11:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:11:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:11:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:11:10.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:11:10.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:11:10.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:11:10.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:11:10.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:11:10.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:11:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:11:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:11:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:11:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:11:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:11:10.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:11:10.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:11:10.554 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.554 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.555 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 33.598879555000003, 2024-09-13T05:11:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:11:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.556 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:11:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:10.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:11:10.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:11:10.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:11:10.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:11:10.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:11:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:11:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:11:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:11:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:11:10.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:11:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:11:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:11:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:11:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:11:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.561 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:10.561 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:10.561 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 33.598862740000001, 2024-09-13T05:11:10.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:11:10.561 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:10.561 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:10.561 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:10.561 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:10.561 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.561 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:11:10.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.561 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:10.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:10.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:11:10.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:11:10.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:10.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:11:10.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:11:10.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:11:10.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:11:10.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:11:10.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:11:10.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:11:10.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:11:10.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:10.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:11:10.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:11:10.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:10.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:10.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:10.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:11:10.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:11:10.565 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.565 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.565 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.565 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:10.565 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:10.565 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:10.566 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #22, image image_client.0-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent23 2024-09-13T05:11:10.567 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:11:10.568 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:10.561+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:10.668 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:10.661+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:10.680 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:10.680 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:10.680 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:10.680 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:10.690 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:11:10.769 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:10.766+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:10.804 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:10.805 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:10.805 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:10.805 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:10.805 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:10.816 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:11:10.870 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:10.865+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:10.919 INFO:teuthology.orchestra.run.smithi120.stdout:3014 punch from 0x18c8dbb to 0x18d37b1, (0xa9f6 bytes) 2024-09-13T05:11:10.922 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:10.922 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:10.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:10.922 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:10.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.922 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14179 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1835008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:10.922 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:11:10.922 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.161937201000001, 2024-09-13T05:11:10.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0924508550000001, 2024-09-13T05:11:10.923 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:10.923 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:10.923 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:10.923 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:10.923 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.923 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14179 2024-09-13T05:11:10.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.923 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:10.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:10.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:11:10.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:10.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:11:10.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:10.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757551+0000", 2024-09-13T05:11:10.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757554+0000", 2024-09-13T05:11:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5440000000000001e-06 2024-09-13T05:11:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757560+0000", 2024-09-13T05:11:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6840000000000001e-06 2024-09-13T05:11:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757564+0000", 2024-09-13T05:11:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3529999999999997e-06 2024-09-13T05:11:10.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814931+0000", 2024-09-13T05:11:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057367564000000003 2024-09-13T05:11:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814938+0000", 2024-09-13T05:11:10.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1070000000000001e-06 2024-09-13T05:11:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.849802+0000", 2024-09-13T05:11:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348647849999999 2024-09-13T05:11:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.849885+0000", 2024-09-13T05:11:10.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2859000000000001e-05 2024-09-13T05:11:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850003+0000", 2024-09-13T05:11:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117279 2024-09-13T05:11:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14180 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1844224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.161920916, 2024-09-13T05:11:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.092637853, 2024-09-13T05:11:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14180 2024-09-13T05:11:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757570+0000", 2024-09-13T05:11:10.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3470000000000001e-06 2024-09-13T05:11:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757576+0000", 2024-09-13T05:11:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5550000000000002e-06 2024-09-13T05:11:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757580+0000", 2024-09-13T05:11:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6519999999999997e-06 2024-09-13T05:11:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814975+0000", 2024-09-13T05:11:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057394349999999997 2024-09-13T05:11:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814981+0000", 2024-09-13T05:11:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4119999999999998e-06 2024-09-13T05:11:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850042+0000", 2024-09-13T05:11:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0350611759999999 2024-09-13T05:11:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:10.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850103+0000", 2024-09-13T05:11:10.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0618000000000001e-05 2024-09-13T05:11:10.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:10.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850206+0000", 2024-09-13T05:11:10.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010309199999999999 2024-09-13T05:11:10.933 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.933 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:10.933 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.933 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14196 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1991680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.158121829999999, 2024-09-13T05:11:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0925442910000001, 2024-09-13T05:11:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14196 2024-09-13T05:11:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:10.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761368+0000", 2024-09-13T05:11:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3689999999999999e-06 2024-09-13T05:11:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761373+0000", 2024-09-13T05:11:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7180000000000004e-06 2024-09-13T05:11:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761376+0000", 2024-09-13T05:11:10.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0860000000000002e-06 2024-09-13T05:11:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815501+0000", 2024-09-13T05:11:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054125508000000003 2024-09-13T05:11:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815508+0000", 2024-09-13T05:11:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5570000000000001e-06 2024-09-13T05:11:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853689+0000", 2024-09-13T05:11:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0381811919999999 2024-09-13T05:11:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853764+0000", 2024-09-13T05:11:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4893000000000003e-05 2024-09-13T05:11:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853911+0000", 2024-09-13T05:11:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014721100000000001 2024-09-13T05:11:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.938 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14197 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2000896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.158110585999999, 2024-09-13T05:11:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.092841977, 2024-09-13T05:11:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.939 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14197 2024-09-13T05:11:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761403+0000", 2024-09-13T05:11:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5199e-05 2024-09-13T05:11:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761411+0000", 2024-09-13T05:11:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4540000000000001e-06 2024-09-13T05:11:10.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761418+0000", 2024-09-13T05:11:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9569999999999996e-06 2024-09-13T05:11:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815531+0000", 2024-09-13T05:11:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054113599999999998 2024-09-13T05:11:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815539+0000", 2024-09-13T05:11:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.481e-06 2024-09-13T05:11:10.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853949+0000", 2024-09-13T05:11:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.038410356 2024-09-13T05:11:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854022+0000", 2024-09-13T05:11:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2807999999999998e-05 2024-09-13T05:11:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854220+0000", 2024-09-13T05:11:10.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000198364 2024-09-13T05:11:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14198 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2010112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.158065577999999, 2024-09-13T05:11:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093063787, 2024-09-13T05:11:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:10.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14198 2024-09-13T05:11:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:10.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761426+0000", 2024-09-13T05:11:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8789999999999999e-06 2024-09-13T05:11:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:10.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761432+0000", 2024-09-13T05:11:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1399999999999997e-06 2024-09-13T05:11:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761437+0000", 2024-09-13T05:11:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8579999999999999e-06 2024-09-13T05:11:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815563+0000", 2024-09-13T05:11:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054125877000000003 2024-09-13T05:11:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815570+0000", 2024-09-13T05:11:10.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1169999999999998e-06 2024-09-13T05:11:10.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854265+0000", 2024-09-13T05:11:10.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0386955659999999 2024-09-13T05:11:10.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:10.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854338+0000", 2024-09-13T05:11:10.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2537e-05 2024-09-13T05:11:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854487+0000", 2024-09-13T05:11:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014927899999999999 2024-09-13T05:11:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14199 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:10.949 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.158046704999997, 2024-09-13T05:11:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0933252389999999, 2024-09-13T05:11:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14199 2024-09-13T05:11:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761445+0000", 2024-09-13T05:11:10.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7779999999999999e-06 2024-09-13T05:11:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761450+0000", 2024-09-13T05:11:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6350000000000003e-06 2024-09-13T05:11:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761455+0000", 2024-09-13T05:11:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9930000000000003e-06 2024-09-13T05:11:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815600+0000", 2024-09-13T05:11:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054144982000000001 2024-09-13T05:11:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815607+0000", 2024-09-13T05:11:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4749999999999998e-06 2024-09-13T05:11:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854527+0000", 2024-09-13T05:11:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.038920037 2024-09-13T05:11:10.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854637+0000", 2024-09-13T05:11:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011021700000000001 2024-09-13T05:11:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854767+0000", 2024-09-13T05:11:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130512 2024-09-13T05:11:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14200 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2028544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:11:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.158028192000003, 2024-09-13T05:11:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093541554, 2024-09-13T05:11:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14200 2024-09-13T05:11:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.955 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:11:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:11:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:10.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761460+0000", 2024-09-13T05:11:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761462+0000", 2024-09-13T05:11:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9659999999999999e-06 2024-09-13T05:11:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761466+0000", 2024-09-13T05:11:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6109999999999998e-06 2024-09-13T05:11:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761471+0000", 2024-09-13T05:11:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1019999999999996e-06 2024-09-13T05:11:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815631+0000", 2024-09-13T05:11:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054159680000000002 2024-09-13T05:11:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815637+0000", 2024-09-13T05:11:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-09-13T05:11:10.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854810+0000", 2024-09-13T05:11:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0391731930000001 2024-09-13T05:11:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854883+0000", 2024-09-13T05:11:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3109999999999996e-05 2024-09-13T05:11:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:10.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855002+0000", 2024-09-13T05:11:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011934600000000001 2024-09-13T05:11:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14201 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2037760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.158013762000003, 2024-09-13T05:11:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0937543320000001, 2024-09-13T05:11:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:10.960 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14201 2024-09-13T05:11:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:10.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761477+0000", 2024-09-13T05:11:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5620000000000002e-06 2024-09-13T05:11:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:10.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761483+0000", 2024-09-13T05:11:10.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7400000000000001e-06 2024-09-13T05:11:10.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761487+0000", 2024-09-13T05:11:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8130000000000002e-06 2024-09-13T05:11:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815697+0000", 2024-09-13T05:11:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054210253 2024-09-13T05:11:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815705+0000", 2024-09-13T05:11:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7049999999999999e-06 2024-09-13T05:11:10.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855036+0000", 2024-09-13T05:11:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.039330799 2024-09-13T05:11:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855110+0000", 2024-09-13T05:11:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4498000000000004e-05 2024-09-13T05:11:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:10.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855229+0000", 2024-09-13T05:11:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119282 2024-09-13T05:11:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14202 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:11:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.157949105, 2024-09-13T05:11:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093934027, 2024-09-13T05:11:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:10.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14202 2024-09-13T05:11:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:11:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:11:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761489+0000", 2024-09-13T05:11:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999495 2024-09-13T05:11:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761543+0000", 2024-09-13T05:11:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3983999999999997e-05 2024-09-13T05:11:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761552+0000", 2024-09-13T05:11:10.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-13T05:11:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761559+0000", 2024-09-13T05:11:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7710000000000001e-06 2024-09-13T05:11:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815742+0000", 2024-09-13T05:11:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054183488000000002 2024-09-13T05:11:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815749+0000", 2024-09-13T05:11:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1609999999999997e-06 2024-09-13T05:11:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855283+0000", 2024-09-13T05:11:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0395336230000001 2024-09-13T05:11:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855354+0000", 2024-09-13T05:11:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1456000000000002e-05 2024-09-13T05:11:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855474+0000", 2024-09-13T05:11:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119429 2024-09-13T05:11:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14294 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2113536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:11:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.154398190999999, 2024-09-13T05:11:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0923650330000001, 2024-09-13T05:11:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:10.971 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14294 2024-09-13T05:11:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:11:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:10.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:11:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765090+0000", 2024-09-13T05:11:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765092+0000", 2024-09-13T05:11:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.542e-06 2024-09-13T05:11:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765096+0000", 2024-09-13T05:11:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6179999999999999e-06 2024-09-13T05:11:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765098+0000", 2024-09-13T05:11:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8049999999999998e-06 2024-09-13T05:11:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816384+0000", 2024-09-13T05:11:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051285338999999999 2024-09-13T05:11:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816393+0000", 2024-09-13T05:11:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-09-13T05:11:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857258+0000", 2024-09-13T05:11:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0408652549999999 2024-09-13T05:11:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857327+0000", 2024-09-13T05:11:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8714000000000007e-05 2024-09-13T05:11:10.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:10.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857456+0000", 2024-09-13T05:11:10.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012909299999999999 2024-09-13T05:11:10.976 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.976 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:10.976 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.976 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14295 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2122752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.154388433000001, 2024-09-13T05:11:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0928006969999999, 2024-09-13T05:11:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14295 2024-09-13T05:11:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:10.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:10.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765102+0000", 2024-09-13T05:11:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3990000000000001e-06 2024-09-13T05:11:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765104+0000", 2024-09-13T05:11:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:11:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765107+0000", 2024-09-13T05:11:10.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.582e-06 2024-09-13T05:11:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816432+0000", 2024-09-13T05:11:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051325118000000003 2024-09-13T05:11:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816440+0000", 2024-09-13T05:11:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4679999999999992e-06 2024-09-13T05:11:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857495+0000", 2024-09-13T05:11:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.041054216 2024-09-13T05:11:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857644+0000", 2024-09-13T05:11:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014909400000000001 2024-09-13T05:11:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857901+0000", 2024-09-13T05:11:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025746200000000002 2024-09-13T05:11:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.981 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14296 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2131968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:11:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.154380187000001, 2024-09-13T05:11:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093120361, 2024-09-13T05:11:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.982 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14296 2024-09-13T05:11:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:11:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:11:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765108+0000", 2024-09-13T05:11:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765110+0000", 2024-09-13T05:11:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.226e-06 2024-09-13T05:11:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765112+0000", 2024-09-13T05:11:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6769999999999999e-06 2024-09-13T05:11:10.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765115+0000", 2024-09-13T05:11:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.712e-06 2024-09-13T05:11:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816479+0000", 2024-09-13T05:11:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051364102000000002 2024-09-13T05:11:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816503+0000", 2024-09-13T05:11:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3723999999999999e-05 2024-09-13T05:11:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857929+0000", 2024-09-13T05:11:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0414263180000001 2024-09-13T05:11:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858015+0000", 2024-09-13T05:11:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5730999999999996e-05 2024-09-13T05:11:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858229+0000", 2024-09-13T05:11:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021408700000000001 2024-09-13T05:11:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14297 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2141184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.154371842000003, 2024-09-13T05:11:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0936699510000001, 2024-09-13T05:11:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:10.987 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14297 2024-09-13T05:11:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765118+0000", 2024-09-13T05:11:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4190000000000001e-06 2024-09-13T05:11:10.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765121+0000", 2024-09-13T05:11:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6110000000000001e-06 2024-09-13T05:11:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765124+0000", 2024-09-13T05:11:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3720000000000001e-06 2024-09-13T05:11:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816535+0000", 2024-09-13T05:11:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051410890000000001 2024-09-13T05:11:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816556+0000", 2024-09-13T05:11:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0551e-05 2024-09-13T05:11:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858552+0000", 2024-09-13T05:11:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0419965529999999 2024-09-13T05:11:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858640+0000", 2024-09-13T05:11:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7907999999999999e-05 2024-09-13T05:11:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858787+0000", 2024-09-13T05:11:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000146864 2024-09-13T05:11:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14298 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2150400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:10.992 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.154362448999997, 2024-09-13T05:11:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0938958759999999, 2024-09-13T05:11:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14298 2024-09-13T05:11:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:10.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765128+0000", 2024-09-13T05:11:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4139999999999999e-06 2024-09-13T05:11:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765130+0000", 2024-09-13T05:11:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6809999999999998e-06 2024-09-13T05:11:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765133+0000", 2024-09-13T05:11:10.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9270000000000001e-06 2024-09-13T05:11:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816592+0000", 2024-09-13T05:11:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051459029000000003 2024-09-13T05:11:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816601+0000", 2024-09-13T05:11:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9819999999999997e-06 2024-09-13T05:11:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:10.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858818+0000", 2024-09-13T05:11:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0422167170000001 2024-09-13T05:11:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858896+0000", 2024-09-13T05:11:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8128999999999997e-05 2024-09-13T05:11:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859022+0000", 2024-09-13T05:11:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012619899999999999 2024-09-13T05:11:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.997 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14299 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2168832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.154353684999997, 2024-09-13T05:11:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0941207909999999, 2024-09-13T05:11:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:10.998 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14299 2024-09-13T05:11:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:10.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765136+0000", 2024-09-13T05:11:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5230000000000001e-06 2024-09-13T05:11:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765139+0000", 2024-09-13T05:11:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.672e-06 2024-09-13T05:11:11.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765142+0000", 2024-09-13T05:11:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6680000000000001e-06 2024-09-13T05:11:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816632+0000", 2024-09-13T05:11:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051489886999999998 2024-09-13T05:11:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:11.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816643+0000", 2024-09-13T05:11:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1457000000000001e-05 2024-09-13T05:11:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859061+0000", 2024-09-13T05:11:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.042417616 2024-09-13T05:11:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859138+0000", 2024-09-13T05:11:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7077999999999996e-05 2024-09-13T05:11:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:11.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859256+0000", 2024-09-13T05:11:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118108 2024-09-13T05:11:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14300 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2159616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.154344875, 2024-09-13T05:11:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0943386719999999, 2024-09-13T05:11:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:11.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14300 2024-09-13T05:11:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:11.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765145+0000", 2024-09-13T05:11:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.488e-06 2024-09-13T05:11:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765148+0000", 2024-09-13T05:11:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6620000000000001e-06 2024-09-13T05:11:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765151+0000", 2024-09-13T05:11:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6419999999999999e-06 2024-09-13T05:11:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816677+0000", 2024-09-13T05:11:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051526776000000003 2024-09-13T05:11:11.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816689+0000", 2024-09-13T05:11:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1634000000000001e-05 2024-09-13T05:11:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859296+0000", 2024-09-13T05:11:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0426066009999999 2024-09-13T05:11:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859364+0000", 2024-09-13T05:11:11.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8745999999999995e-05 2024-09-13T05:11:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859483+0000", 2024-09-13T05:11:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011833900000000001 2024-09-13T05:11:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14301 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2178048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:11:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.154336241000003, 2024-09-13T05:11:11.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0946233009999999, 2024-09-13T05:11:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14301 2024-09-13T05:11:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:11:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:11.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:11:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765152+0000", 2024-09-13T05:11:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:11.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765154+0000", 2024-09-13T05:11:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.449e-06 2024-09-13T05:11:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765157+0000", 2024-09-13T05:11:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6809999999999998e-06 2024-09-13T05:11:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:11.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765159+0000", 2024-09-13T05:11:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6060000000000001e-06 2024-09-13T05:11:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816722+0000", 2024-09-13T05:11:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051562535 2024-09-13T05:11:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816733+0000", 2024-09-13T05:11:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1678000000000001e-05 2024-09-13T05:11:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859521+0000", 2024-09-13T05:11:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0427879440000001 2024-09-13T05:11:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859655+0000", 2024-09-13T05:11:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134053 2024-09-13T05:11:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859776+0000", 2024-09-13T05:11:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012058299999999999 2024-09-13T05:11:11.013 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14302 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2187264~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.154327664, 2024-09-13T05:11:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.094937383, 2024-09-13T05:11:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14302 2024-09-13T05:11:11.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:11.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765162+0000", 2024-09-13T05:11:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4589999999999999e-06 2024-09-13T05:11:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765165+0000", 2024-09-13T05:11:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6019999999999998e-06 2024-09-13T05:11:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765168+0000", 2024-09-13T05:11:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.497e-06 2024-09-13T05:11:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816764+0000", 2024-09-13T05:11:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051596722999999997 2024-09-13T05:11:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816776+0000", 2024-09-13T05:11:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1967000000000001e-05 2024-09-13T05:11:11.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859810+0000", 2024-09-13T05:11:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0430338299999999 2024-09-13T05:11:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859901+0000", 2024-09-13T05:11:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1397999999999995e-05 2024-09-13T05:11:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:11.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860099+0000", 2024-09-13T05:11:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000197133 2024-09-13T05:11:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14303 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2196480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:11:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.154319327000003, 2024-09-13T05:11:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.095199152, 2024-09-13T05:11:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:11.019 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14303 2024-09-13T05:11:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:11:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:11:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765169+0000", 2024-09-13T05:11:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765171+0000", 2024-09-13T05:11:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2899999999999999e-06 2024-09-13T05:11:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765173+0000", 2024-09-13T05:11:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-13T05:11:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765176+0000", 2024-09-13T05:11:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.016e-06 2024-09-13T05:11:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816811+0000", 2024-09-13T05:11:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051634684 2024-09-13T05:11:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816840+0000", 2024-09-13T05:11:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8690000000000001e-05 2024-09-13T05:11:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860135+0000", 2024-09-13T05:11:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0432951029999999 2024-09-13T05:11:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860255+0000", 2024-09-13T05:11:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119936 2024-09-13T05:11:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860369+0000", 2024-09-13T05:11:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113978 2024-09-13T05:11:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14304 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2205696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.154296459000001, 2024-09-13T05:11:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0955512999999999, 2024-09-13T05:11:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14304 2024-09-13T05:11:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765195+0000", 2024-09-13T05:11:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6599999999999999e-06 2024-09-13T05:11:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765200+0000", 2024-09-13T05:11:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.356e-06 2024-09-13T05:11:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765205+0000", 2024-09-13T05:11:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3000000000000001e-06 2024-09-13T05:11:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816901+0000", 2024-09-13T05:11:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051695451000000003 2024-09-13T05:11:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816963+0000", 2024-09-13T05:11:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2694000000000007e-05 2024-09-13T05:11:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860434+0000", 2024-09-13T05:11:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.04347053 2024-09-13T05:11:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860592+0000", 2024-09-13T05:11:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015854199999999999 2024-09-13T05:11:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860744+0000", 2024-09-13T05:11:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015133 2024-09-13T05:11:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:11.030 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:11.031 INFO:teuthology.orchestra.run.smithi120.stdout:3017 read 0x374e89e thru 0x3755e87 (0x75ea bytes) 2024-09-13T05:11:11.032 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:11:11.033 INFO:teuthology.orchestra.run.smithi120.stdout:3018 write 0xca1d6d0 thru 0xca20c77 (0x35a8 bytes) 2024-09-13T05:11:11.033 INFO:teuthology.orchestra.run.smithi120.stdout:3019 trunc from 0xca20c78 to 0xc730b6f 2024-09-13T05:11:11.033 INFO:teuthology.orchestra.run.smithi120.stdout:3021 punch from 0x2a480a to 0x2aae09, (0x65ff bytes) 2024-09-13T05:11:11.033 INFO:teuthology.orchestra.run.smithi120.stdout:3022 write 0x3c88cec thru 0x3c8b329 (0x263e bytes) 2024-09-13T05:11:11.033 INFO:teuthology.orchestra.run.smithi120.stdout:3023 trunc from 0xc730b6f to 0x91471c3 2024-09-13T05:11:11.033 INFO:teuthology.orchestra.run.smithi120.stdout:3024 writesame 0x7f35b2 thru 0x7fa298 data_size 0x1(0x6ce7 bytes) 2024-09-13T05:11:11.033 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:11.026+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:11.038 INFO:teuthology.orchestra.run.smithi120.stdout:3025 punch from 0x33ef5f8 to 0x33f05bf, (0xfc7 bytes) 2024-09-13T05:11:11.038 INFO:teuthology.orchestra.run.smithi120.stdout:3027 writesame 0x12438fb thru 0x124e4bf data_size 0x1(0xabc5 bytes) 2024-09-13T05:11:11.097 INFO:teuthology.orchestra.run.smithi120.stdout:3028 writesame 0xe260ec6 thru 0xe26d8e3 data_size 0x29(0xca1e bytes) 2024-09-13T05:11:11.097 INFO:teuthology.orchestra.run.smithi120.stdout:3029 write 0x36b34cc thru 0x36b8e26 (0x595b bytes) 2024-09-13T05:11:11.100 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:11:11.104 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:11.104 INFO:teuthology.orchestra.run.smithi120.stdout:3031 read 0x252d9bf thru 0x2537f7e (0xa5c0 bytes) 2024-09-13T05:11:11.104 INFO:teuthology.orchestra.run.smithi120.stdout:3032 read 0x3470728 thru 0x347b663 (0xaf3c bytes) 2024-09-13T05:11:11.104 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:11.104 INFO:teuthology.orchestra.run.smithi120.stdout:3034 read 0xb82dffa thru 0xb83d002 (0xf009 bytes) 2024-09-13T05:11:11.105 INFO:teuthology.orchestra.run.smithi120.stdout:3035 writesame 0xef0fb0 thru 0xefc149 data_size 0x2(0xb19a bytes) 2024-09-13T05:11:11.132 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:11.125+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:11.134 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:11.134 INFO:teuthology.orchestra.run.smithi120.stdout:3038 punch from 0xa71ddb9 to 0xa722cde, (0x4f25 bytes) 2024-09-13T05:11:11.134 INFO:teuthology.orchestra.run.smithi120.stdout:3039 read 0xb6fc184 thru 0xb70a1e9 (0xe066 bytes) 2024-09-13T05:11:11.134 INFO:teuthology.orchestra.run.smithi120.stdout:3041 write 0x85f5be6 thru 0x85ffc70 (0xa08b bytes) 2024-09-13T05:11:11.141 INFO:teuthology.orchestra.run.smithi120.stdout:3042 read 0xa6c07a9 thru 0xa6d0571 (0xfdc9 bytes) 2024-09-13T05:11:11.141 INFO:teuthology.orchestra.run.smithi120.stdout:3043 read 0xbec2fa7 thru 0xbed2dff (0xfe59 bytes) 2024-09-13T05:11:11.141 INFO:teuthology.orchestra.run.smithi120.stdout:3044 write 0x78cd523 thru 0x78cdb59 (0x637 bytes) 2024-09-13T05:11:11.146 INFO:teuthology.orchestra.run.smithi120.stdout:3045 write 0x65c0272 thru 0x65c0b20 (0x8af bytes) 2024-09-13T05:11:11.151 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:11.151 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:11.151 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:11.152 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:11.153 INFO:teuthology.orchestra.run.smithi120.stdout:3046 punch from 0x991701d to 0x9917749, (0x72c bytes) 2024-09-13T05:11:11.153 INFO:teuthology.orchestra.run.smithi120.stdout:3047 writesame 0xcb84615 thru 0xcb84d41 data_size 0x1(0x72d bytes) 2024-09-13T05:11:11.159 INFO:teuthology.orchestra.run.smithi120.stdout:3048 write 0x9a8306b thru 0x9a855ce (0x2564 bytes) 2024-09-13T05:11:11.162 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:11:11.165 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:11.165 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:11.165 INFO:teuthology.orchestra.run.smithi120.stdout:3051 read 0x4d01e09 thru 0x4d09dc3 (0x7fbb bytes) 2024-09-13T05:11:11.165 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:11.165 INFO:teuthology.orchestra.run.smithi120.stdout:3054 write 0xc4e22d0 thru 0xc4ef0b9 (0xcdea bytes) 2024-09-13T05:11:11.171 INFO:teuthology.orchestra.run.smithi120.stdout:3055 write 0x1f9d00b thru 0x1fab305 (0xe2fb bytes) 2024-09-13T05:11:11.179 INFO:teuthology.orchestra.run.smithi120.stdout:3056 read 0x4cab108 thru 0x4cac993 (0x188c bytes) 2024-09-13T05:11:11.179 INFO:teuthology.orchestra.run.smithi120.stdout:3057 read 0xd8dd1d4 thru 0xd8de7c8 (0x15f5 bytes) 2024-09-13T05:11:11.179 INFO:teuthology.orchestra.run.smithi120.stdout:3058 writesame 0x82cd0cc thru 0x82d2e5e data_size 0x5(0x5d93 bytes) 2024-09-13T05:11:11.189 INFO:teuthology.orchestra.run.smithi120.stdout:3059 punch from 0xa49c401 to 0xa4a5270, (0x8e6f bytes) 2024-09-13T05:11:11.189 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:11.190 INFO:teuthology.orchestra.run.smithi120.stdout:3062 read 0xaeb7f66 thru 0xaebe9b4 (0x6a4f bytes) 2024-09-13T05:11:11.190 INFO:teuthology.orchestra.run.smithi120.stdout:3064 punch from 0x3ef7ade to 0x3f013c9, (0x98eb bytes) 2024-09-13T05:11:11.190 INFO:teuthology.orchestra.run.smithi120.stdout:3065 write 0x929d280 thru 0x92a6873 (0x95f4 bytes) 2024-09-13T05:11:11.197 INFO:teuthology.orchestra.run.smithi120.stdout:3066 write 0x6f4aed2 thru 0x6f59fcc (0xf0fb bytes) 2024-09-13T05:11:11.202 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:11.224 INFO:teuthology.orchestra.run.smithi120.stdout:3069 trunc from 0xe26d8e4 to 0x2cf55e1 2024-09-13T05:11:11.233 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:11.230+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:11.245 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:11:11.259 INFO:teuthology.orchestra.run.smithi120.stdout:3071 trunc from 0x2cf55e1 to 0x53300e8 2024-09-13T05:11:11.266 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T05:11:11.268 INFO:teuthology.orchestra.run.smithi120.stdout:3073 clone 25 order 22 su 32768 sc 12 2024-09-13T05:11:11.273 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:11:11.274 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:11.274 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:11.285 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:11:11.292 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:11:11.310 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:11:11.313 INFO:tasks.thrashosds.thrasher:in_osds: [2, 3, 5, 6, 7] out_osds: [4, 1, 0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T05:11:11.313 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:11:11.313 INFO:tasks.thrashosds.thrasher:Reweighting osd 5 to 0.6285474617159071 2024-09-13T05:11:11.313 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 0.6285474617159071 2024-09-13T05:11:11.335 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:11.330+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:11.335 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:11:11.359 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:11:11.382 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:11:11.408 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:11:11.411 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:11:11.411 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:11:11.411 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:11:11.411 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:11:11.411 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:11:11.411 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:11:11.411 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:11:11.411 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:11:11.417 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:11.417 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:11.430 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:11:11.435 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:11.430+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:11.537 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:11.534+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:11.588 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:11.588 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:11.598 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:11:11.638 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:11.634+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:11.694 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:11.694 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:11.704 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:11:11.739 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:11.733+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:11.815 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:11.815 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:11.825 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:11:11.840 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:11.834+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:11.941 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:11.937+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:11.980 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:11.980 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:11.992 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:11:12.041 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:12.038+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:12.102 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:12.102 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:12.112 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:11:12.143 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:12.138+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:12.219 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:12.220 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:12.229 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:11:12.274 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:12.270+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:12.278 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is set 2024-09-13T05:11:12.279 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.5 to 0.628547 (a0e8) 2024-09-13T05:11:12.345 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:12.342+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:12.350 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:12.350 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:12.359 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:11:12.445 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:12.442+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:12.463 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:12.463 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:12.474 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:11:12.546 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:12.542+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:12.628 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:12.629 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:12.638 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:11:12.646 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:12.641+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:12.741 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:12.741 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:12.747 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:12.741+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:12.750 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:11:12.848 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:12.842+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:12.855 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:12.855 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:12.865 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:11:12.949 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:12.946+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:13.017 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:13.017 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:13.026 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:11:13.050 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:13.045+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:13.129 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:13.129 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:13.138 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:11:13.151 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:13.146+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:13.240 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:13.240 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:13.251 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:11:13.252 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:13.249+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:13.353 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:13.350+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:13.399 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:13.400 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:13.410 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:11:13.425 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:11:13.469 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:13.465+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:13.518 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:13.519 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:13.528 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:11:13.573 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:13.570+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:13.576 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:11:13.594 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:11:13.613 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:11:13.633 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:11:13.635 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:13.635 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:13.645 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:11:13.654 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:13.650+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:13.657 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:11:13.677 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:11:13.699 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:11:13.719 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:11:13.721 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:11:13.722 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:11:13.722 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:11:13.722 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:11:13.722 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:11:13.722 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:11:13.722 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:11:13.722 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:11:13.756 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:13.756 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:13.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:13.756 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:13.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.757 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:13.757 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:13.757 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 36.890728269, 2024-09-13T05:11:13.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:11:13.757 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:13.757 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:13.757 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:13.757 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:13.757 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:13.757 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:11:13.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.757 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:13.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:13.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:13.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:13.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:13.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:13.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:13.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:13.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:13.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:11:13.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:11:13.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:13.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:11:13.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:11:13.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:13.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:11:13.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:11:13.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:11:13.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:11:13.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:13.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:11:13.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:11:13.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:11:13.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:11:13.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:13.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:11:13.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:11:13.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:13.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:11:13.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:11:13.762 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.762 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:13.762 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.763 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:13.763 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:13.763 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 36.890703833000003, 2024-09-13T05:11:13.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:11:13.763 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:13.763 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:13.763 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:13.763 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:13.763 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:13.763 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:11:13.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.764 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:13.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:13.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:13.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:13.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:13.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:13.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:13.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:13.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:13.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:11:13.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:11:13.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:13.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:11:13.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:11:13.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:13.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:11:13.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:11:13.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:11:13.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:11:13.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:13.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:11:13.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:11:13.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:11:13.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:11:13.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:13.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:11:13.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:11:13.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:13.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:11:13.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:11:13.768 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.768 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:13.768 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.769 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:13.769 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:13.769 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 36.890694007, 2024-09-13T05:11:13.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:11:13.769 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:13.769 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:13.769 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:13.769 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:13.769 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:13.770 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:11:13.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.770 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:13.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:13.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:13.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:13.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:13.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:13.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:13.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:13.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:13.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:11:13.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:11:13.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:13.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:11:13.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:11:13.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:13.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:11:13.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:11:13.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:11:13.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:11:13.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:13.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:11:13.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:11:13.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:11:13.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:11:13.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:13.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:11:13.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:11:13.774 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.774 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:13.774 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.774 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:13.775 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:13.775 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 36.890685771000001, 2024-09-13T05:11:13.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:11:13.775 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:13.775 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:13.775 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:13.775 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:13.775 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:13.775 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:11:13.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.775 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:13.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:13.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:13.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:13.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:13.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:13.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:13.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:13.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:13.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:11:13.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:11:13.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:13.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:11:13.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:11:13.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:13.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:11:13.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:11:13.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:11:13.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:11:13.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:13.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:11:13.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:11:13.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:11:13.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:11:13.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:13.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:11:13.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:11:13.780 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.780 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:13.780 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.780 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:13.780 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:13.780 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 36.890663859, 2024-09-13T05:11:13.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:11:13.780 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:13.780 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:13.780 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:13.781 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:13.781 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:13.781 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:11:13.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.781 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:13.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:13.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:13.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:13.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:13.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:13.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:13.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:13.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:13.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:11:13.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:11:13.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:13.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:11:13.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:11:13.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:13.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:11:13.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:11:13.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:11:13.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:11:13.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:13.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:11:13.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:11:13.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:11:13.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:11:13.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:13.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:11:13.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:11:13.785 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.785 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:13.785 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.786 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:13.786 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:13.786 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 36.890655254999999, 2024-09-13T05:11:13.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:11:13.786 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:13.786 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:13.786 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:13.786 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:13.786 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:13.786 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:11:13.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.787 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:13.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:13.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:13.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:13.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:13.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:13.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:13.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:13.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:13.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:11:13.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:11:13.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:13.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:11:13.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:11:13.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:13.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:11:13.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:11:13.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:11:13.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:11:13.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:13.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:11:13.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:11:13.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:11:13.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:11:13.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:13.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:11:13.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:11:13.791 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.791 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:13.792 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.792 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:13.792 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:13.792 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 36.890645560999999, 2024-09-13T05:11:13.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:11:13.792 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:13.792 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:13.792 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:13.792 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:13.793 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:13.793 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:11:13.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.793 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:13.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:13.793 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:13.793 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:13.793 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:13.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:13.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:13.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:13.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:13.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:11:13.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:11:13.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:13.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:11:13.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:11:13.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:13.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:11:13.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:11:13.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.796 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:11:13.796 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:11:13.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:13.796 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:11:13.796 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:11:13.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:11:13.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:11:13.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:13.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:11:13.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:11:13.797 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.797 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:13.797 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.798 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:13.798 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:13.798 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 36.890636446000002, 2024-09-13T05:11:13.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:11:13.798 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:13.798 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:13.798 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:13.798 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:13.798 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:13.798 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:11:13.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.799 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:13.799 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.799 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:13.799 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:13.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.799 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.799 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:13.799 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:13.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.799 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:13.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:13.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:13.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:13.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:11:13.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:11:13.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:13.801 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:11:13.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:11:13.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:13.801 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:11:13.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:11:13.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.801 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:11:13.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:11:13.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.802 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.802 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:13.802 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:11:13.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:11:13.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.802 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.802 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.802 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:11:13.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:11:13.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.803 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.803 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:13.803 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:11:13.803 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:11:13.803 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.803 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:13.803 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.803 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.803 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:13.803 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:11:13.804 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 36.890627967, 2024-09-13T05:11:13.804 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:11:13.804 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:13.804 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:13.804 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:13.804 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:13.804 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:13.804 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:11:13.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.804 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:13.804 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.804 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:13.805 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:11:13.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.805 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.805 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:13.805 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:11:13.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.805 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.805 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:13.805 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:11:13.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:13.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.806 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:13.806 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:11:13.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:11:13.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.806 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:13.806 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:11:13.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:11:13.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:13.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:11:13.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:11:13.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:11:13.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:11:13.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:13.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:11:13.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:11:13.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.808 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.808 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:11:13.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:11:13.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.808 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:13.808 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:11:13.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:11:13.808 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.809 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:13.809 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.809 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.809 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.809 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:13.809 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:11:13.809 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 36.890616041999998, 2024-09-13T05:11:13.809 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:11:13.809 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:13.809 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:13.809 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:13.810 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:13.810 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:13.810 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:11:13.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.810 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:13.810 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.810 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:13.810 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:11:13.810 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.810 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.810 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:13.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:11:13.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:13.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:11:13.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:13.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:13.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:11:13.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:11:13.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.812 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:13.812 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:11:13.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:11:13.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.812 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:13.812 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:11:13.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:11:13.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:11:13.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:11:13.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:13.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:11:13.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:11:13.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:11:13.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:11:13.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:13.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:11:13.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:11:13.814 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.814 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:13.814 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.815 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:13.815 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:13.815 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 36.890594452999999, 2024-09-13T05:11:13.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:11:13.815 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:13.815 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:13.815 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:13.815 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:13.815 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:13.815 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:11:13.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.816 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:13.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:13.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:13.816 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:13.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:13.816 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:13.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:13.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:13.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:13.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:11:13.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:11:13.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:13.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:11:13.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:11:13.818 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:13.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:11:13.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:11:13.818 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:11:13.819 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:11:13.819 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.819 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.819 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:13.819 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:11:13.819 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:11:13.819 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.819 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.819 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.819 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:11:13.819 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:11:13.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.820 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:13.820 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:11:13.820 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:11:13.820 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.820 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:13.820 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.820 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:13.821 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:13.821 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 36.890571325000003, 2024-09-13T05:11:13.821 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:11:13.821 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:13.821 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:13.821 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:13.821 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:13.821 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:13.821 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:11:13.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.821 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:13.822 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.822 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:13.822 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:13.822 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.822 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.822 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.822 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:13.822 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:13.822 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.822 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.822 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.822 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:13.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:13.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:13.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:13.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:11:13.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:11:13.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:13.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:11:13.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:11:13.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.824 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:13.824 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:11:13.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:11:13.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.824 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.824 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:11:13.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:11:13.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.825 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:13.825 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:11:13.825 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:11:13.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.825 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.825 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.825 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:11:13.825 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:11:13.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.825 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.825 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:13.825 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:11:13.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:11:13.826 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.826 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:13.826 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.826 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.826 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:13.826 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:11:13.826 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 36.890555952, 2024-09-13T05:11:13.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:11:13.826 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:13.826 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:13.827 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:13.827 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:13.827 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:13.827 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:11:13.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.827 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:13.827 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.827 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:13.827 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:11:13.827 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.827 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.828 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:13.828 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:11:13.828 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.828 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.828 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.828 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:13.828 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:11:13.828 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:13.828 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.828 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.828 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:13.828 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:11:13.829 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:11:13.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:13.829 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:11:13.829 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:11:13.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:13.829 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:11:13.829 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:11:13.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.830 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.830 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.830 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:11:13.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:11:13.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.830 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.830 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:13.830 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:11:13.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:11:13.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.830 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.830 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.831 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:11:13.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:11:13.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.831 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.831 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:13.831 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:11:13.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:11:13.831 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.831 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:13.831 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.831 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.832 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:13.832 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:13.832 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 36.890535483999997, 2024-09-13T05:11:13.832 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:11:13.832 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:13.832 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:13.832 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:13.832 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:13.832 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:13.832 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:11:13.832 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.832 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:13.833 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.833 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:13.833 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:13.833 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.833 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.833 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:13.833 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:13.833 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.833 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.833 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:13.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:13.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:13.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:13.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:11:13.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:11:13.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:13.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:11:13.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:11:13.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.836 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:13.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:11:13.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:11:13.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.836 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:11:13.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:11:13.837 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.837 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.837 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:13.837 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:11:13.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:11:13.837 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.837 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.837 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.837 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:11:13.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:11:13.837 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.838 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.838 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:13.838 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:11:13.838 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:11:13.838 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.838 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:13.838 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.838 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.838 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.838 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:13.838 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:13.838 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 36.890518823000001, 2024-09-13T05:11:13.839 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:11:13.839 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:13.839 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:13.839 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:13.839 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:13.839 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:13.839 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:11:13.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.839 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:13.839 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.839 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:13.839 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:13.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.840 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:13.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:13.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.840 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:13.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:13.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:13.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.841 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.841 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:13.841 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:11:13.841 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:11:13.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.841 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.841 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:13.841 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:11:13.841 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:11:13.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.841 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.842 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:13.842 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:11:13.842 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:11:13.842 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.842 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.842 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.842 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:11:13.842 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:11:13.842 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.842 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.842 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:13.842 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:11:13.843 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:11:13.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.843 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.843 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:11:13.843 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:11:13.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.843 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:13.843 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:11:13.843 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:11:13.843 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.844 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:13.844 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.844 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.844 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.844 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:13.844 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:11:13.844 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 36.890492109999997, 2024-09-13T05:11:13.844 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:11:13.844 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:13.844 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:13.844 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:13.844 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:13.845 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:13.845 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:11:13.845 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.845 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:13.845 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.845 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:13.845 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:11:13.845 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.845 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.845 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.845 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:13.845 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:11:13.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:13.846 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:11:13.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:13.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:13.846 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:11:13.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:11:13.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.847 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.847 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:13.847 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:11:13.847 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:11:13.847 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.847 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.847 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:13.847 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:11:13.847 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:11:13.847 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.847 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.847 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.848 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:11:13.848 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:11:13.848 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.848 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.848 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:13.848 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:11:13.848 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:11:13.848 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.848 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.848 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.848 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:11:13.848 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:11:13.849 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.849 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.849 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:13.849 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:11:13.849 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:11:13.849 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.849 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:13.849 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.849 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.849 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.849 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:13.849 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:13.850 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 36.890473258, 2024-09-13T05:11:13.850 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:11:13.850 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:13.850 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:13.850 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:13.850 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:13.850 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:13.850 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:11:13.850 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.850 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:13.850 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.850 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:13.851 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:13.851 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.851 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.851 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.851 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:13.851 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:13.851 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.851 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.851 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.851 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:13.851 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:13.852 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:13.852 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.852 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.852 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:13.852 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:11:13.852 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:11:13.852 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.852 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.852 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:13.852 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:11:13.852 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:11:13.852 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.853 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.853 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:13.853 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:11:13.853 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:11:13.853 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.853 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.853 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.853 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:11:13.853 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:11:13.853 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.853 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.853 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:13.854 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:11:13.854 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:11:13.854 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.854 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.854 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.854 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:11:13.854 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:11:13.854 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.854 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.854 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:13.854 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:11:13.854 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:11:13.855 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.855 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:13.855 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.855 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.855 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.855 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:13.855 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:13.855 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 36.890455471999999, 2024-09-13T05:11:13.855 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:11:13.855 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:13.855 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:13.855 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:13.856 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:13.856 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:13.856 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:11:13.856 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.856 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:13.856 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.856 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:13.856 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:13.856 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.856 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.856 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.856 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:13.857 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:13.857 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.857 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.857 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.857 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:13.857 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:13.857 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:13.857 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.857 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.857 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:13.857 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:11:13.857 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:11:13.858 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.858 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.858 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:13.858 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:11:13.858 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:11:13.858 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.858 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.858 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:13.858 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:11:13.858 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:11:13.858 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.858 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.858 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.859 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:11:13.859 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:11:13.859 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.859 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.859 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:13.859 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:11:13.859 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:11:13.859 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.859 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.859 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.859 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:11:13.860 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:11:13.860 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.860 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.860 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:13.860 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:11:13.860 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:11:13.860 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.860 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:13.860 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.860 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.860 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.860 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:13.861 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:13.861 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 36.890420411999997, 2024-09-13T05:11:13.861 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:11:13.861 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:13.861 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:13.861 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:13.861 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:13.861 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:13.861 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:11:13.861 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.861 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:13.861 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.862 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:13.862 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:13.862 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.862 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.862 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.862 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:13.862 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:13.862 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.862 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.862 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.862 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:13.862 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:13.862 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:13.863 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.863 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.863 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:13.863 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:11:13.863 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:11:13.863 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.863 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.863 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:13.863 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:11:13.863 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:11:13.863 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.863 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.864 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:13.864 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:11:13.864 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:11:13.864 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.864 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.864 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.864 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:11:13.864 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:11:13.864 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.864 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.864 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:13.865 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:11:13.865 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:11:13.865 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.865 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.865 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.865 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:11:13.865 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:11:13.865 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.865 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.865 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:13.865 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:11:13.865 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:11:13.866 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.866 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:13.866 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.866 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.866 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.866 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:13.866 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:13.866 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 36.890403597000002, 2024-09-13T05:11:13.866 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:11:13.866 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:13.866 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:13.866 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:13.866 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:13.867 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:13.867 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:11:13.867 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.867 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:13.867 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.867 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:13.867 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:13.867 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.867 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.867 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.867 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:13.867 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:13.868 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:13.868 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.868 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.868 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:13.868 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:13.868 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:13.868 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.868 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.868 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:13.868 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:11:13.868 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:11:13.868 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.869 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.869 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:13.869 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:11:13.869 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:11:13.869 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.869 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.869 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:13.869 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:11:13.869 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:11:13.869 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.869 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.869 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.870 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:11:13.870 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:11:13.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.870 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.870 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:13.870 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:11:13.870 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:11:13.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.870 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.870 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:13.870 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:11:13.870 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:11:13.871 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:13.871 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:13.871 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:13.871 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:11:13.871 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:11:13.871 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.871 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:13.871 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.871 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:13.871 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:13.871 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:13.872 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:13.749+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:13.873 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:11:13.874 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:13.869+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:13.974 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:13.970+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:13.986 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:13.987 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:13.987 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:13.987 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:13.997 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:11:14.075 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:14.074+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:14.100 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:14.100 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:14.100 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:14.100 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:14.100 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:14.109 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:11:14.176 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:14.170+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:14.223 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14179 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1835008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:11:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.462295560999998, 2024-09-13T05:11:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0924508550000001, 2024-09-13T05:11:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14179 2024-09-13T05:11:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:11:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:11:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757551+0000", 2024-09-13T05:11:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757554+0000", 2024-09-13T05:11:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5440000000000001e-06 2024-09-13T05:11:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757560+0000", 2024-09-13T05:11:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6840000000000001e-06 2024-09-13T05:11:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757564+0000", 2024-09-13T05:11:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3529999999999997e-06 2024-09-13T05:11:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814931+0000", 2024-09-13T05:11:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057367564000000003 2024-09-13T05:11:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:14.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814938+0000", 2024-09-13T05:11:14.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1070000000000001e-06 2024-09-13T05:11:14.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.849802+0000", 2024-09-13T05:11:14.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348647849999999 2024-09-13T05:11:14.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.849885+0000", 2024-09-13T05:11:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2859000000000001e-05 2024-09-13T05:11:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850003+0000", 2024-09-13T05:11:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117279 2024-09-13T05:11:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14180 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1844224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.462279275999997, 2024-09-13T05:11:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.092637853, 2024-09-13T05:11:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14180 2024-09-13T05:11:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757570+0000", 2024-09-13T05:11:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3470000000000001e-06 2024-09-13T05:11:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757576+0000", 2024-09-13T05:11:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5550000000000002e-06 2024-09-13T05:11:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757580+0000", 2024-09-13T05:11:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6519999999999997e-06 2024-09-13T05:11:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814975+0000", 2024-09-13T05:11:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057394349999999997 2024-09-13T05:11:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814981+0000", 2024-09-13T05:11:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4119999999999998e-06 2024-09-13T05:11:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850042+0000", 2024-09-13T05:11:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0350611759999999 2024-09-13T05:11:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850103+0000", 2024-09-13T05:11:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0618000000000001e-05 2024-09-13T05:11:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850206+0000", 2024-09-13T05:11:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010309199999999999 2024-09-13T05:11:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14196 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1991680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.458480190000003, 2024-09-13T05:11:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0925442910000001, 2024-09-13T05:11:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14196 2024-09-13T05:11:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:14.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761368+0000", 2024-09-13T05:11:14.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3689999999999999e-06 2024-09-13T05:11:14.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761373+0000", 2024-09-13T05:11:14.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7180000000000004e-06 2024-09-13T05:11:14.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761376+0000", 2024-09-13T05:11:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0860000000000002e-06 2024-09-13T05:11:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815501+0000", 2024-09-13T05:11:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054125508000000003 2024-09-13T05:11:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815508+0000", 2024-09-13T05:11:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5570000000000001e-06 2024-09-13T05:11:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853689+0000", 2024-09-13T05:11:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0381811919999999 2024-09-13T05:11:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853764+0000", 2024-09-13T05:11:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4893000000000003e-05 2024-09-13T05:11:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853911+0000", 2024-09-13T05:11:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014721100000000001 2024-09-13T05:11:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14197 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2000896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.458468945999996, 2024-09-13T05:11:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.092841977, 2024-09-13T05:11:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14197 2024-09-13T05:11:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761403+0000", 2024-09-13T05:11:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5199e-05 2024-09-13T05:11:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761411+0000", 2024-09-13T05:11:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4540000000000001e-06 2024-09-13T05:11:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761418+0000", 2024-09-13T05:11:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9569999999999996e-06 2024-09-13T05:11:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815531+0000", 2024-09-13T05:11:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054113599999999998 2024-09-13T05:11:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815539+0000", 2024-09-13T05:11:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.481e-06 2024-09-13T05:11:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853949+0000", 2024-09-13T05:11:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.038410356 2024-09-13T05:11:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854022+0000", 2024-09-13T05:11:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2807999999999998e-05 2024-09-13T05:11:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854220+0000", 2024-09-13T05:11:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000198364 2024-09-13T05:11:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14198 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2010112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.458423938000003, 2024-09-13T05:11:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093063787, 2024-09-13T05:11:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14198 2024-09-13T05:11:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761426+0000", 2024-09-13T05:11:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8789999999999999e-06 2024-09-13T05:11:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761432+0000", 2024-09-13T05:11:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1399999999999997e-06 2024-09-13T05:11:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761437+0000", 2024-09-13T05:11:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8579999999999999e-06 2024-09-13T05:11:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815563+0000", 2024-09-13T05:11:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054125877000000003 2024-09-13T05:11:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815570+0000", 2024-09-13T05:11:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1169999999999998e-06 2024-09-13T05:11:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854265+0000", 2024-09-13T05:11:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0386955659999999 2024-09-13T05:11:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854338+0000", 2024-09-13T05:11:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2537e-05 2024-09-13T05:11:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854487+0000", 2024-09-13T05:11:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014927899999999999 2024-09-13T05:11:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14199 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.458405065000001, 2024-09-13T05:11:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0933252389999999, 2024-09-13T05:11:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14199 2024-09-13T05:11:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761445+0000", 2024-09-13T05:11:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7779999999999999e-06 2024-09-13T05:11:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761450+0000", 2024-09-13T05:11:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6350000000000003e-06 2024-09-13T05:11:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761455+0000", 2024-09-13T05:11:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9930000000000003e-06 2024-09-13T05:11:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815600+0000", 2024-09-13T05:11:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054144982000000001 2024-09-13T05:11:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815607+0000", 2024-09-13T05:11:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4749999999999998e-06 2024-09-13T05:11:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854527+0000", 2024-09-13T05:11:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.038920037 2024-09-13T05:11:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854637+0000", 2024-09-13T05:11:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011021700000000001 2024-09-13T05:11:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854767+0000", 2024-09-13T05:11:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130512 2024-09-13T05:11:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14200 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2028544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:11:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.458386552, 2024-09-13T05:11:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093541554, 2024-09-13T05:11:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14200 2024-09-13T05:11:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:11:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:11:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761460+0000", 2024-09-13T05:11:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761462+0000", 2024-09-13T05:11:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9659999999999999e-06 2024-09-13T05:11:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761466+0000", 2024-09-13T05:11:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6109999999999998e-06 2024-09-13T05:11:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761471+0000", 2024-09-13T05:11:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1019999999999996e-06 2024-09-13T05:11:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815631+0000", 2024-09-13T05:11:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054159680000000002 2024-09-13T05:11:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815637+0000", 2024-09-13T05:11:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-09-13T05:11:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854810+0000", 2024-09-13T05:11:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0391731930000001 2024-09-13T05:11:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854883+0000", 2024-09-13T05:11:14.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3109999999999996e-05 2024-09-13T05:11:14.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855002+0000", 2024-09-13T05:11:14.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011934600000000001 2024-09-13T05:11:14.261 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.261 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.261 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14201 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2037760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.458372122, 2024-09-13T05:11:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0937543320000001, 2024-09-13T05:11:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14201 2024-09-13T05:11:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:14.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:14.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761477+0000", 2024-09-13T05:11:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5620000000000002e-06 2024-09-13T05:11:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761483+0000", 2024-09-13T05:11:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7400000000000001e-06 2024-09-13T05:11:14.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761487+0000", 2024-09-13T05:11:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8130000000000002e-06 2024-09-13T05:11:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815697+0000", 2024-09-13T05:11:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054210253 2024-09-13T05:11:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815705+0000", 2024-09-13T05:11:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7049999999999999e-06 2024-09-13T05:11:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855036+0000", 2024-09-13T05:11:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.039330799 2024-09-13T05:11:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855110+0000", 2024-09-13T05:11:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4498000000000004e-05 2024-09-13T05:11:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855229+0000", 2024-09-13T05:11:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119282 2024-09-13T05:11:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.268 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.268 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14202 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.268 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:11:14.268 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.458307464999997, 2024-09-13T05:11:14.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093934027, 2024-09-13T05:11:14.268 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.268 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.268 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14202 2024-09-13T05:11:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:11:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:11:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761489+0000", 2024-09-13T05:11:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999495 2024-09-13T05:11:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761543+0000", 2024-09-13T05:11:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3983999999999997e-05 2024-09-13T05:11:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761552+0000", 2024-09-13T05:11:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-13T05:11:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761559+0000", 2024-09-13T05:11:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7710000000000001e-06 2024-09-13T05:11:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815742+0000", 2024-09-13T05:11:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054183488000000002 2024-09-13T05:11:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815749+0000", 2024-09-13T05:11:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1609999999999997e-06 2024-09-13T05:11:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855283+0000", 2024-09-13T05:11:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0395336230000001 2024-09-13T05:11:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855354+0000", 2024-09-13T05:11:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1456000000000002e-05 2024-09-13T05:11:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855474+0000", 2024-09-13T05:11:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119429 2024-09-13T05:11:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14294 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2113536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:11:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.454756551000003, 2024-09-13T05:11:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0923650330000001, 2024-09-13T05:11:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14294 2024-09-13T05:11:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:11:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:11:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765090+0000", 2024-09-13T05:11:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765092+0000", 2024-09-13T05:11:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.542e-06 2024-09-13T05:11:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765096+0000", 2024-09-13T05:11:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6179999999999999e-06 2024-09-13T05:11:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765098+0000", 2024-09-13T05:11:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8049999999999998e-06 2024-09-13T05:11:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816384+0000", 2024-09-13T05:11:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051285338999999999 2024-09-13T05:11:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816393+0000", 2024-09-13T05:11:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-09-13T05:11:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857258+0000", 2024-09-13T05:11:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0408652549999999 2024-09-13T05:11:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857327+0000", 2024-09-13T05:11:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8714000000000007e-05 2024-09-13T05:11:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857456+0000", 2024-09-13T05:11:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012909299999999999 2024-09-13T05:11:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14295 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2122752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.454746792999998, 2024-09-13T05:11:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0928006969999999, 2024-09-13T05:11:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14295 2024-09-13T05:11:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765102+0000", 2024-09-13T05:11:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3990000000000001e-06 2024-09-13T05:11:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765104+0000", 2024-09-13T05:11:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:11:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765107+0000", 2024-09-13T05:11:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.582e-06 2024-09-13T05:11:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816432+0000", 2024-09-13T05:11:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051325118000000003 2024-09-13T05:11:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816440+0000", 2024-09-13T05:11:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4679999999999992e-06 2024-09-13T05:11:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857495+0000", 2024-09-13T05:11:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.041054216 2024-09-13T05:11:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857644+0000", 2024-09-13T05:11:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014909400000000001 2024-09-13T05:11:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857901+0000", 2024-09-13T05:11:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025746200000000002 2024-09-13T05:11:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14296 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2131968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:11:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.454738546999998, 2024-09-13T05:11:14.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093120361, 2024-09-13T05:11:14.284 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.284 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.284 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.284 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.284 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.284 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14296 2024-09-13T05:11:14.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.284 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:11:14.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:11:14.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765108+0000", 2024-09-13T05:11:14.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:14.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765110+0000", 2024-09-13T05:11:14.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.226e-06 2024-09-13T05:11:14.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765112+0000", 2024-09-13T05:11:14.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6769999999999999e-06 2024-09-13T05:11:14.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765115+0000", 2024-09-13T05:11:14.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.712e-06 2024-09-13T05:11:14.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816479+0000", 2024-09-13T05:11:14.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051364102000000002 2024-09-13T05:11:14.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:14.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816503+0000", 2024-09-13T05:11:14.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3723999999999999e-05 2024-09-13T05:11:14.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857929+0000", 2024-09-13T05:11:14.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0414263180000001 2024-09-13T05:11:14.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858015+0000", 2024-09-13T05:11:14.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5730999999999996e-05 2024-09-13T05:11:14.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858229+0000", 2024-09-13T05:11:14.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021408700000000001 2024-09-13T05:11:14.288 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.288 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.288 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.288 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14297 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2141184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.288 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:14.289 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.454730202, 2024-09-13T05:11:14.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0936699510000001, 2024-09-13T05:11:14.289 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.289 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.289 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.289 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.289 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.289 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14297 2024-09-13T05:11:14.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.289 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:14.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:14.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:14.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:14.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765118+0000", 2024-09-13T05:11:14.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4190000000000001e-06 2024-09-13T05:11:14.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765121+0000", 2024-09-13T05:11:14.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6110000000000001e-06 2024-09-13T05:11:14.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765124+0000", 2024-09-13T05:11:14.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3720000000000001e-06 2024-09-13T05:11:14.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816535+0000", 2024-09-13T05:11:14.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051410890000000001 2024-09-13T05:11:14.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:14.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816556+0000", 2024-09-13T05:11:14.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0551e-05 2024-09-13T05:11:14.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858552+0000", 2024-09-13T05:11:14.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0419965529999999 2024-09-13T05:11:14.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858640+0000", 2024-09-13T05:11:14.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7907999999999999e-05 2024-09-13T05:11:14.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858787+0000", 2024-09-13T05:11:14.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000146864 2024-09-13T05:11:14.294 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.294 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.294 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.294 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14298 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2150400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.294 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:14.294 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.454720809000001, 2024-09-13T05:11:14.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0938958759999999, 2024-09-13T05:11:14.294 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.294 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.294 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.295 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14298 2024-09-13T05:11:14.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.295 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:14.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:14.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:14.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:14.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765128+0000", 2024-09-13T05:11:14.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4139999999999999e-06 2024-09-13T05:11:14.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765130+0000", 2024-09-13T05:11:14.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6809999999999998e-06 2024-09-13T05:11:14.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765133+0000", 2024-09-13T05:11:14.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9270000000000001e-06 2024-09-13T05:11:14.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816592+0000", 2024-09-13T05:11:14.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051459029000000003 2024-09-13T05:11:14.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:14.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816601+0000", 2024-09-13T05:11:14.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9819999999999997e-06 2024-09-13T05:11:14.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858818+0000", 2024-09-13T05:11:14.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0422167170000001 2024-09-13T05:11:14.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858896+0000", 2024-09-13T05:11:14.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8128999999999997e-05 2024-09-13T05:11:14.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859022+0000", 2024-09-13T05:11:14.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012619899999999999 2024-09-13T05:11:14.299 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.299 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.299 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.299 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14299 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2168832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.299 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:14.299 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.454712045000001, 2024-09-13T05:11:14.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0941207909999999, 2024-09-13T05:11:14.299 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.300 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.300 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.300 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.300 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.300 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14299 2024-09-13T05:11:14.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.300 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:14.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:14.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:14.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:14.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765136+0000", 2024-09-13T05:11:14.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5230000000000001e-06 2024-09-13T05:11:14.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765139+0000", 2024-09-13T05:11:14.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.672e-06 2024-09-13T05:11:14.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765142+0000", 2024-09-13T05:11:14.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6680000000000001e-06 2024-09-13T05:11:14.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816632+0000", 2024-09-13T05:11:14.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051489886999999998 2024-09-13T05:11:14.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:14.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816643+0000", 2024-09-13T05:11:14.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1457000000000001e-05 2024-09-13T05:11:14.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859061+0000", 2024-09-13T05:11:14.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.042417616 2024-09-13T05:11:14.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859138+0000", 2024-09-13T05:11:14.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7077999999999996e-05 2024-09-13T05:11:14.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859256+0000", 2024-09-13T05:11:14.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118108 2024-09-13T05:11:14.304 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.304 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.304 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.304 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14300 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2159616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.304 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:14.304 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.454703234999997, 2024-09-13T05:11:14.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0943386719999999, 2024-09-13T05:11:14.305 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.305 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.305 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14300 2024-09-13T05:11:14.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.305 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:14.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:14.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:14.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:14.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765145+0000", 2024-09-13T05:11:14.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.488e-06 2024-09-13T05:11:14.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765148+0000", 2024-09-13T05:11:14.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6620000000000001e-06 2024-09-13T05:11:14.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765151+0000", 2024-09-13T05:11:14.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6419999999999999e-06 2024-09-13T05:11:14.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816677+0000", 2024-09-13T05:11:14.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051526776000000003 2024-09-13T05:11:14.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:14.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816689+0000", 2024-09-13T05:11:14.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1634000000000001e-05 2024-09-13T05:11:14.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859296+0000", 2024-09-13T05:11:14.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0426066009999999 2024-09-13T05:11:14.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859364+0000", 2024-09-13T05:11:14.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8745999999999995e-05 2024-09-13T05:11:14.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859483+0000", 2024-09-13T05:11:14.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011833900000000001 2024-09-13T05:11:14.309 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.309 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.309 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.310 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14301 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2178048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.310 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:11:14.310 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.454694601, 2024-09-13T05:11:14.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0946233009999999, 2024-09-13T05:11:14.310 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.310 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.310 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.310 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.310 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.310 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14301 2024-09-13T05:11:14.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.310 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:11:14.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:11:14.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765152+0000", 2024-09-13T05:11:14.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:14.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765154+0000", 2024-09-13T05:11:14.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.449e-06 2024-09-13T05:11:14.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765157+0000", 2024-09-13T05:11:14.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6809999999999998e-06 2024-09-13T05:11:14.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765159+0000", 2024-09-13T05:11:14.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6060000000000001e-06 2024-09-13T05:11:14.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816722+0000", 2024-09-13T05:11:14.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051562535 2024-09-13T05:11:14.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:14.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816733+0000", 2024-09-13T05:11:14.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1678000000000001e-05 2024-09-13T05:11:14.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859521+0000", 2024-09-13T05:11:14.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0427879440000001 2024-09-13T05:11:14.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859655+0000", 2024-09-13T05:11:14.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134053 2024-09-13T05:11:14.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859776+0000", 2024-09-13T05:11:14.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012058299999999999 2024-09-13T05:11:14.314 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.314 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.315 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.315 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14302 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2187264~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.315 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:14.315 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.454686023999997, 2024-09-13T05:11:14.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.094937383, 2024-09-13T05:11:14.315 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.315 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.315 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.315 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.315 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.315 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14302 2024-09-13T05:11:14.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.316 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:14.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:14.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:14.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:14.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765162+0000", 2024-09-13T05:11:14.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4589999999999999e-06 2024-09-13T05:11:14.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765165+0000", 2024-09-13T05:11:14.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6019999999999998e-06 2024-09-13T05:11:14.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765168+0000", 2024-09-13T05:11:14.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.497e-06 2024-09-13T05:11:14.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816764+0000", 2024-09-13T05:11:14.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051596722999999997 2024-09-13T05:11:14.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:14.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816776+0000", 2024-09-13T05:11:14.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1967000000000001e-05 2024-09-13T05:11:14.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859810+0000", 2024-09-13T05:11:14.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0430338299999999 2024-09-13T05:11:14.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859901+0000", 2024-09-13T05:11:14.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1397999999999995e-05 2024-09-13T05:11:14.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860099+0000", 2024-09-13T05:11:14.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000197133 2024-09-13T05:11:14.319 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.320 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.320 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.320 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14303 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2196480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.320 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:11:14.320 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.454677687, 2024-09-13T05:11:14.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.095199152, 2024-09-13T05:11:14.320 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14303 2024-09-13T05:11:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:11:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:11:14.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765169+0000", 2024-09-13T05:11:14.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765171+0000", 2024-09-13T05:11:14.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2899999999999999e-06 2024-09-13T05:11:14.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765173+0000", 2024-09-13T05:11:14.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-13T05:11:14.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765176+0000", 2024-09-13T05:11:14.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.016e-06 2024-09-13T05:11:14.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816811+0000", 2024-09-13T05:11:14.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051634684 2024-09-13T05:11:14.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:14.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816840+0000", 2024-09-13T05:11:14.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8690000000000001e-05 2024-09-13T05:11:14.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860135+0000", 2024-09-13T05:11:14.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0432951029999999 2024-09-13T05:11:14.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860255+0000", 2024-09-13T05:11:14.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119936 2024-09-13T05:11:14.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860369+0000", 2024-09-13T05:11:14.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113978 2024-09-13T05:11:14.325 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.325 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.325 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.326 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14304 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2205696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.326 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:14.326 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.454654818999998, 2024-09-13T05:11:14.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0955512999999999, 2024-09-13T05:11:14.326 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.326 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.326 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.326 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.326 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.326 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14304 2024-09-13T05:11:14.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.326 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:14.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:14.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:14.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765195+0000", 2024-09-13T05:11:14.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6599999999999999e-06 2024-09-13T05:11:14.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765200+0000", 2024-09-13T05:11:14.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.356e-06 2024-09-13T05:11:14.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765205+0000", 2024-09-13T05:11:14.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3000000000000001e-06 2024-09-13T05:11:14.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816901+0000", 2024-09-13T05:11:14.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051695451000000003 2024-09-13T05:11:14.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:14.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816963+0000", 2024-09-13T05:11:14.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2694000000000007e-05 2024-09-13T05:11:14.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860434+0000", 2024-09-13T05:11:14.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.04347053 2024-09-13T05:11:14.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860592+0000", 2024-09-13T05:11:14.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015854199999999999 2024-09-13T05:11:14.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860744+0000", 2024-09-13T05:11:14.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015133 2024-09-13T05:11:14.331 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.331 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.331 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.331 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.331 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.331 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:14.332 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T05:11:14.333 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:14.326+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:14.333 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:11:14.334 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone24 from 0x53300e8 (overlap 0x2cf55e1) to 0x23f77e7 2024-09-13T05:11:14.433 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:14.430+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:14.461 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:14.461 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:14.461 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:14.461 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:14.472 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:11:14.496 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #23, image image_client.0-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent24 2024-09-13T05:11:14.535 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:14.529+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:14.561 INFO:teuthology.orchestra.run.smithi120.stdout:3074 writesame 0x997e0ef thru 0x998d22e data_size 0x50(0xf140 bytes) 2024-09-13T05:11:14.561 INFO:teuthology.orchestra.run.smithi120.stdout:3077 writesame 0xf3b83c thru 0xf46a5f data_size 0xd(0xb224 bytes) 2024-09-13T05:11:14.585 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:14.586 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:14.586 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:14.586 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:14.586 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:14.592 INFO:teuthology.orchestra.run.smithi120.stdout:3078 read 0x1fe914f thru 0x1ff08cc (0x777e bytes) 2024-09-13T05:11:14.593 INFO:teuthology.orchestra.run.smithi120.stdout:3080 write 0x57c370d thru 0x57cb6aa (0x7f9e bytes) 2024-09-13T05:11:14.596 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:11:14.629 INFO:teuthology.orchestra.run.smithi120.stdout:3082 writesame 0xd696962 thru 0xd6a6753 data_size 0x42(0xfdf2 bytes) 2024-09-13T05:11:14.629 INFO:teuthology.orchestra.run.smithi120.stdout:3083 write 0x5f65fbf thru 0x5f66c9f (0xce1 bytes) 2024-09-13T05:11:14.634 INFO:teuthology.orchestra.run.smithi120.stdout:3084 writesame 0x50c11c1 thru 0x50cbaa1 data_size 0x1(0xa8e1 bytes) 2024-09-13T05:11:14.635 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:14.629+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:14.656 INFO:teuthology.orchestra.run.smithi120.stdout:3085 write 0xf3868 thru 0x10330c (0xfaa5 bytes) 2024-09-13T05:11:14.668 INFO:teuthology.orchestra.run.smithi120.stdout:3086 read 0x2dccf29 thru 0x2dd8d30 (0xbe08 bytes) 2024-09-13T05:11:14.676 INFO:teuthology.orchestra.run.smithi120.stdout:3088 trunc from 0xd6a6754 to 0xabcf783 2024-09-13T05:11:14.715 INFO:teuthology.orchestra.run.smithi120.stdout:3089 write 0xde6ad21 thru 0xde78749 (0xda29 bytes) 2024-09-13T05:11:14.724 INFO:teuthology.orchestra.run.smithi120.stdout:3092 read 0xc366291 thru 0xc37288b (0xc5fb bytes) 2024-09-13T05:11:14.724 INFO:teuthology.orchestra.run.smithi120.stdout:3093 read 0x7d55120 thru 0x7d60fa0 (0xbe81 bytes) 2024-09-13T05:11:14.725 INFO:teuthology.orchestra.run.smithi120.stdout:3094 writesame 0xd725dbb thru 0xd73160d data_size 0x15(0xb853 bytes) 2024-09-13T05:11:14.733 INFO:teuthology.orchestra.run.smithi120.stdout:3095 write 0x18199c6 thru 0x181b487 (0x1ac2 bytes) 2024-09-13T05:11:14.737 INFO:teuthology.orchestra.run.smithi120.stdout:3096 read 0x481d2ba thru 0x4824280 (0x6fc7 bytes) 2024-09-13T05:11:14.737 INFO:teuthology.orchestra.run.smithi120.stdout:3098 write 0xa56c0d2 thru 0xa57812b (0xc05a bytes) 2024-09-13T05:11:14.737 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:14.729+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:14.745 INFO:teuthology.orchestra.run.smithi120.stdout:3099 writesame 0x87ca23 thru 0x88480b data_size 0x1(0x7de9 bytes) 2024-09-13T05:11:14.749 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:14.750 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:14.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:14.750 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:14.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.750 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10634 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 731136~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.750 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.344577307000002, 2024-09-13T05:11:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028136992999999999, 2024-09-13T05:11:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10634 2024-09-13T05:11:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401987+0000", 2024-09-13T05:11:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5090000000000001e-06 2024-09-13T05:11:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401997+0000", 2024-09-13T05:11:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8009999999999998e-06 2024-09-13T05:11:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402000+0000", 2024-09-13T05:11:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.756e-06 2024-09-13T05:11:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430035+0000", 2024-09-13T05:11:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028034967000000001 2024-09-13T05:11:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430081+0000", 2024-09-13T05:11:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6448e-05 2024-09-13T05:11:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430123+0000", 2024-09-13T05:11:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1758000000000002e-05 2024-09-13T05:11:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10635 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 740352~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:11:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.344560692999998, 2024-09-13T05:11:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028229890000000001, 2024-09-13T05:11:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10635 2024-09-13T05:11:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:11:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:11:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402002+0000", 2024-09-13T05:11:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402004+0000", 2024-09-13T05:11:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.575e-06 2024-09-13T05:11:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402007+0000", 2024-09-13T05:11:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1240000000000001e-06 2024-09-13T05:11:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402010+0000", 2024-09-13T05:11:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5859999999999999e-06 2024-09-13T05:11:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430146+0000", 2024-09-13T05:11:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028136746000000001 2024-09-13T05:11:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430195+0000", 2024-09-13T05:11:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8948e-05 2024-09-13T05:11:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430232+0000", 2024-09-13T05:11:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7159000000000001e-05 2024-09-13T05:11:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10636 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 749568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:11:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.344551586999998, 2024-09-13T05:11:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328440999999999, 2024-09-13T05:11:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10636 2024-09-13T05:11:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:11:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:11:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402011+0000", 2024-09-13T05:11:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402017+0000", 2024-09-13T05:11:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5620000000000003e-06 2024-09-13T05:11:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402020+0000", 2024-09-13T05:11:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1410000000000001e-06 2024-09-13T05:11:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402024+0000", 2024-09-13T05:11:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4489999999999999e-06 2024-09-13T05:11:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430256+0000", 2024-09-13T05:11:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028232363 2024-09-13T05:11:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430299+0000", 2024-09-13T05:11:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2830999999999997e-05 2024-09-13T05:11:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430340+0000", 2024-09-13T05:11:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1301000000000003e-05 2024-09-13T05:11:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10637 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 758784~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.344536474000002, 2024-09-13T05:11:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028441793, 2024-09-13T05:11:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10637 2024-09-13T05:11:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402031+0000", 2024-09-13T05:11:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6770000000000003e-06 2024-09-13T05:11:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402034+0000", 2024-09-13T05:11:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1540000000000002e-06 2024-09-13T05:11:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402038+0000", 2024-09-13T05:11:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4970000000000001e-06 2024-09-13T05:11:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430367+0000", 2024-09-13T05:11:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328906000000001 2024-09-13T05:11:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430416+0000", 2024-09-13T05:11:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:11:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430469+0000", 2024-09-13T05:11:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2284999999999998e-05 2024-09-13T05:11:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10638 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 768000~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.344522990000002, 2024-09-13T05:11:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028548740999999999, 2024-09-13T05:11:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10638 2024-09-13T05:11:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402041+0000", 2024-09-13T05:11:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4789999999999999e-06 2024-09-13T05:11:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402044+0000", 2024-09-13T05:11:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.694e-06 2024-09-13T05:11:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402047+0000", 2024-09-13T05:11:14.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.537e-06 2024-09-13T05:11:14.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430494+0000", 2024-09-13T05:11:14.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028447665 2024-09-13T05:11:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430544+0000", 2024-09-13T05:11:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9539000000000001e-05 2024-09-13T05:11:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430589+0000", 2024-09-13T05:11:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5071999999999998e-05 2024-09-13T05:11:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10639 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 777216~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:11:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.344512608999999, 2024-09-13T05:11:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028651769000000001, 2024-09-13T05:11:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10639 2024-09-13T05:11:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:11:14.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:11:14.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402050+0000", 2024-09-13T05:11:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402052+0000", 2024-09-13T05:11:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2249999999999999e-06 2024-09-13T05:11:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402054+0000", 2024-09-13T05:11:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8140000000000001e-06 2024-09-13T05:11:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402057+0000", 2024-09-13T05:11:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4889999999999998e-06 2024-09-13T05:11:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430607+0000", 2024-09-13T05:11:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028549896000000002 2024-09-13T05:11:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430651+0000", 2024-09-13T05:11:14.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4622000000000001e-05 2024-09-13T05:11:14.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430702+0000", 2024-09-13T05:11:14.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0980999999999999e-05 2024-09-13T05:11:14.785 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.785 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.785 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.786 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11151 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 779264~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.786 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:14.786 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.314741327999997, 2024-09-13T05:11:14.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028283188000000001, 2024-09-13T05:11:14.786 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.786 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.786 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11151 2024-09-13T05:11:14.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.787 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:14.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:14.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:14.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431827+0000", 2024-09-13T05:11:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0989999999999998e-06 2024-09-13T05:11:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431832+0000", 2024-09-13T05:11:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8829999999999997e-06 2024-09-13T05:11:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431835+0000", 2024-09-13T05:11:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.439e-06 2024-09-13T05:11:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.459955+0000", 2024-09-13T05:11:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028119858000000001 2024-09-13T05:11:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.460029+0000", 2024-09-13T05:11:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4264000000000006e-05 2024-09-13T05:11:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.460105+0000", 2024-09-13T05:11:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5906000000000001e-05 2024-09-13T05:11:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11897 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 579584~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.265592153999997, 2024-09-13T05:11:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028193354, 2024-09-13T05:11:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11897 2024-09-13T05:11:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480973+0000", 2024-09-13T05:11:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.934e-06 2024-09-13T05:11:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480976+0000", 2024-09-13T05:11:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.614e-06 2024-09-13T05:11:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480980+0000", 2024-09-13T05:11:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.377e-06 2024-09-13T05:11:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.508967+0000", 2024-09-13T05:11:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027987455000000001 2024-09-13T05:11:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509074+0000", 2024-09-13T05:11:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107379 2024-09-13T05:11:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509164+0000", 2024-09-13T05:11:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9979e-05 2024-09-13T05:11:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11898 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 588800~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.26558009, 2024-09-13T05:11:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028308628999999998, 2024-09-13T05:11:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11898 2024-09-13T05:11:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480984+0000", 2024-09-13T05:11:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:11:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480988+0000", 2024-09-13T05:11:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4640000000000002e-06 2024-09-13T05:11:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480991+0000", 2024-09-13T05:11:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3469999999999999e-06 2024-09-13T05:11:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509199+0000", 2024-09-13T05:11:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028207449999999998 2024-09-13T05:11:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509250+0000", 2024-09-13T05:11:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1375000000000002e-05 2024-09-13T05:11:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509292+0000", 2024-09-13T05:11:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1730000000000002e-05 2024-09-13T05:11:14.801 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.801 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.801 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.801 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11899 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 598016~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.265569249000002, 2024-09-13T05:11:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516703000000001, 2024-09-13T05:11:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11899 2024-09-13T05:11:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480995+0000", 2024-09-13T05:11:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7349999999999999e-06 2024-09-13T05:11:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481000+0000", 2024-09-13T05:11:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0289999999999996e-06 2024-09-13T05:11:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481004+0000", 2024-09-13T05:11:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3699999999999999e-06 2024-09-13T05:11:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509332+0000", 2024-09-13T05:11:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328320000000001 2024-09-13T05:11:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509428+0000", 2024-09-13T05:11:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6150999999999995e-05 2024-09-13T05:11:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509511+0000", 2024-09-13T05:11:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2396000000000002e-05 2024-09-13T05:11:14.806 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.806 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.806 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.806 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11900 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 607232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.806 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:11:14.806 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.265556660000001, 2024-09-13T05:11:14.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028621273999999999, 2024-09-13T05:11:14.806 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.807 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.807 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.807 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.807 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.807 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11900 2024-09-13T05:11:14.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.807 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:11:14.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:11:14.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481006+0000", 2024-09-13T05:11:14.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481008+0000", 2024-09-13T05:11:14.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.73e-06 2024-09-13T05:11:14.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481011+0000", 2024-09-13T05:11:14.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4000000000000001e-06 2024-09-13T05:11:14.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481015+0000", 2024-09-13T05:11:14.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2760000000000001e-06 2024-09-13T05:11:14.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509531+0000", 2024-09-13T05:11:14.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516102000000002 2024-09-13T05:11:14.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509588+0000", 2024-09-13T05:11:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7423999999999998e-05 2024-09-13T05:11:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509628+0000", 2024-09-13T05:11:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9644000000000002e-05 2024-09-13T05:11:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11901 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 616448~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.265546039, 2024-09-13T05:11:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028820500999999998, 2024-09-13T05:11:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11901 2024-09-13T05:11:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481022+0000", 2024-09-13T05:11:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0209999999999999e-06 2024-09-13T05:11:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481026+0000", 2024-09-13T05:11:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:11:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481029+0000", 2024-09-13T05:11:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.636e-06 2024-09-13T05:11:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509661+0000", 2024-09-13T05:11:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028631496999999999 2024-09-13T05:11:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509757+0000", 2024-09-13T05:11:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5780999999999997e-05 2024-09-13T05:11:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509838+0000", 2024-09-13T05:11:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1102999999999999e-05 2024-09-13T05:11:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11902 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 625664~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.265524177000003, 2024-09-13T05:11:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028894265999999998, 2024-09-13T05:11:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11902 2024-09-13T05:11:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481041+0000", 2024-09-13T05:11:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8020000000000001e-06 2024-09-13T05:11:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481044+0000", 2024-09-13T05:11:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7110000000000001e-06 2024-09-13T05:11:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481048+0000", 2024-09-13T05:11:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.411e-06 2024-09-13T05:11:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509851+0000", 2024-09-13T05:11:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028803295 2024-09-13T05:11:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509896+0000", 2024-09-13T05:11:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4963000000000003e-05 2024-09-13T05:11:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509933+0000", 2024-09-13T05:11:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7384e-05 2024-09-13T05:11:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11903 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 634880~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.265512940999997, 2024-09-13T05:11:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029118033000000001, 2024-09-13T05:11:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11903 2024-09-13T05:11:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481052+0000", 2024-09-13T05:11:14.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.581e-06 2024-09-13T05:11:14.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481055+0000", 2024-09-13T05:11:14.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4520000000000002e-06 2024-09-13T05:11:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481058+0000", 2024-09-13T05:11:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4599999999999999e-06 2024-09-13T05:11:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509967+0000", 2024-09-13T05:11:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028908257999999999 2024-09-13T05:11:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510062+0000", 2024-09-13T05:11:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5613999999999996e-05 2024-09-13T05:11:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510168+0000", 2024-09-13T05:11:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105951 2024-09-13T05:11:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11904 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 644096~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.265502046000002, 2024-09-13T05:11:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029301971, 2024-09-13T05:11:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11904 2024-09-13T05:11:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481063+0000", 2024-09-13T05:11:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6700000000000001e-06 2024-09-13T05:11:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481068+0000", 2024-09-13T05:11:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4519999999999996e-06 2024-09-13T05:11:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481074+0000", 2024-09-13T05:11:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8370000000000002e-06 2024-09-13T05:11:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510197+0000", 2024-09-13T05:11:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029123237999999999 2024-09-13T05:11:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510285+0000", 2024-09-13T05:11:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7676000000000006e-05 2024-09-13T05:11:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510363+0000", 2024-09-13T05:11:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8418999999999996e-05 2024-09-13T05:11:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11905 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 653312~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:11:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.265486306, 2024-09-13T05:11:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029480164, 2024-09-13T05:11:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11905 2024-09-13T05:11:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:11:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:11:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481076+0000", 2024-09-13T05:11:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481079+0000", 2024-09-13T05:11:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9629999999999998e-06 2024-09-13T05:11:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481087+0000", 2024-09-13T05:11:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6369999999999999e-06 2024-09-13T05:11:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481093+0000", 2024-09-13T05:11:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.857e-06 2024-09-13T05:11:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510408+0000", 2024-09-13T05:11:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029315213 2024-09-13T05:11:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510501+0000", 2024-09-13T05:11:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2916000000000003e-05 2024-09-13T05:11:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510557+0000", 2024-09-13T05:11:14.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6063999999999997e-05 2024-09-13T05:11:14.833 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.833 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.833 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.833 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11906 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 662528~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.833 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:11:14.833 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.265444293000002, 2024-09-13T05:11:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029575054999999999, 2024-09-13T05:11:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11906 2024-09-13T05:11:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:11:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:11:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481118+0000", 2024-09-13T05:11:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481122+0000", 2024-09-13T05:11:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2610000000000002e-06 2024-09-13T05:11:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481129+0000", 2024-09-13T05:11:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0079999999999996e-06 2024-09-13T05:11:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481135+0000", 2024-09-13T05:11:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0599999999999996e-06 2024-09-13T05:11:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510575+0000", 2024-09-13T05:11:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029440470999999999 2024-09-13T05:11:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510635+0000", 2024-09-13T05:11:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0177000000000003e-05 2024-09-13T05:11:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510694+0000", 2024-09-13T05:11:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8675999999999999e-05 2024-09-13T05:11:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11907 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 671744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:11:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.265183497999999, 2024-09-13T05:11:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029479490000000001, 2024-09-13T05:11:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11907 2024-09-13T05:11:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:11:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:11:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481140+0000", 2024-09-13T05:11:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997597 2024-09-13T05:11:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481383+0000", 2024-09-13T05:11:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024355399999999999 2024-09-13T05:11:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481390+0000", 2024-09-13T05:11:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3599999999999998e-06 2024-09-13T05:11:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481395+0000", 2024-09-13T05:11:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8940000000000001e-06 2024-09-13T05:11:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510722+0000", 2024-09-13T05:11:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029327143999999999 2024-09-13T05:11:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510802+0000", 2024-09-13T05:11:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9770000000000004e-05 2024-09-13T05:11:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510859+0000", 2024-09-13T05:11:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6957999999999999e-05 2024-09-13T05:11:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11908 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 680960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:11:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.265163585000003, 2024-09-13T05:11:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029617622, 2024-09-13T05:11:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11908 2024-09-13T05:11:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:11:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:11:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481399+0000", 2024-09-13T05:11:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481401+0000", 2024-09-13T05:11:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8729999999999999e-06 2024-09-13T05:11:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481413+0000", 2024-09-13T05:11:14.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1748e-05 2024-09-13T05:11:14.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481417+0000", 2024-09-13T05:11:14.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:11:14.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510908+0000", 2024-09-13T05:11:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029491129000000001 2024-09-13T05:11:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510955+0000", 2024-09-13T05:11:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7188000000000003e-05 2024-09-13T05:11:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511017+0000", 2024-09-13T05:11:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2288999999999999e-05 2024-09-13T05:11:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11909 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 690176~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:11:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.265143258000002, 2024-09-13T05:11:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029780699000000001, 2024-09-13T05:11:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11909 2024-09-13T05:11:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:11:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:11:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481419+0000", 2024-09-13T05:11:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481421+0000", 2024-09-13T05:11:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.035e-06 2024-09-13T05:11:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481427+0000", 2024-09-13T05:11:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2449999999999998e-06 2024-09-13T05:11:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481430+0000", 2024-09-13T05:11:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.366e-06 2024-09-13T05:11:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511064+0000", 2024-09-13T05:11:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029633711 2024-09-13T05:11:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511160+0000", 2024-09-13T05:11:14.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6399999999999999e-05 2024-09-13T05:11:14.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:14.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511201+0000", 2024-09-13T05:11:14.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0448000000000003e-05 2024-09-13T05:11:14.851 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.851 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.852 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.852 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.852 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.852 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:14.857 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:11:14.858 INFO:teuthology.orchestra.run.smithi120.stdout:3100 trunc from 0xde7874a to 0x6589406 2024-09-13T05:11:14.858 INFO:teuthology.orchestra.run.smithi120.stdout:3102 read 0x5a572f7 thru 0x5a631cb (0xbed5 bytes) 2024-09-13T05:11:14.858 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:14.858 INFO:teuthology.orchestra.run.smithi120.stdout:3106 write 0xb1483fd thru 0xb155468 (0xd06c bytes) 2024-09-13T05:11:14.858 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:14.858 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:14.858 INFO:teuthology.orchestra.run.smithi120.stdout:3110 punch from 0x59358a6 to 0x5938063, (0x27bd bytes) 2024-09-13T05:11:14.858 INFO:teuthology.orchestra.run.smithi120.stdout:3111 read 0xa837dcb thru 0xa843f1d (0xc153 bytes) 2024-09-13T05:11:14.858 INFO:teuthology.orchestra.run.smithi120.stdout:3112 writesame 0x245abd thru 0x24d917 data_size 0x1(0x7e5b bytes) 2024-09-13T05:11:14.859 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:14.849+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:14.860 INFO:teuthology.orchestra.run.smithi120.stdout:3113 read 0x5a1a962 thru 0x5a1cd03 (0x23a2 bytes) 2024-09-13T05:11:14.861 INFO:teuthology.orchestra.run.smithi120.stdout:3114 write 0x699f017 thru 0x699f518 (0x502 bytes) 2024-09-13T05:11:14.866 INFO:teuthology.orchestra.run.smithi120.stdout:3116 punch from 0x8d99e6b to 0x8da404f, (0xa1e4 bytes) 2024-09-13T05:11:14.866 INFO:teuthology.orchestra.run.smithi120.stdout:3117 write 0x19fe2b7 thru 0x1a0bd28 (0xda72 bytes) 2024-09-13T05:11:14.901 INFO:teuthology.orchestra.run.smithi120.stdout:3118 punch from 0x35a430a to 0x35a5835, (0x152b bytes) 2024-09-13T05:11:14.901 INFO:teuthology.orchestra.run.smithi120.stdout:3119 punch from 0xa9d0059 to 0xa9d6a20, (0x69c7 bytes) 2024-09-13T05:11:14.901 INFO:teuthology.orchestra.run.smithi120.stdout:3120 write 0x107a931 thru 0x1088bc3 (0xe293 bytes) 2024-09-13T05:11:14.926 INFO:teuthology.orchestra.run.smithi120.stdout:3121 write 0x6dfe985 thru 0x6e05337 (0x69b3 bytes) 2024-09-13T05:11:14.937 INFO:teuthology.orchestra.run.smithi120.stdout:3124 trunc from 0xb155469 to 0x9dc477e 2024-09-13T05:11:14.949 INFO:teuthology.orchestra.run.smithi120.stdout:3125 read 0x58893ae thru 0x588d036 (0x3c89 bytes) 2024-09-13T05:11:14.950 INFO:teuthology.orchestra.run.smithi120.stdout:3126 writesame 0x4b9cc7f thru 0x4ba0745 data_size 0x1(0x3ac7 bytes) 2024-09-13T05:11:14.959 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:14.954+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:14.978 INFO:teuthology.orchestra.run.smithi120.stdout:3127 write 0xbc130f1 thru 0xbc15282 (0x2192 bytes) 2024-09-13T05:11:14.983 INFO:teuthology.orchestra.run.smithi120.stdout:3128 write 0x3a58a70 thru 0x3a5b99b (0x2f2c bytes) 2024-09-13T05:11:14.985 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:14.985 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:14.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.985 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:65875 3.9 3:975f9007:::rbd_data.112d8ff9b77a.0000000000000013:head [stat out=16b,write 887408~12076 in=12076b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-13T05:11:14.986 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:14.983115+0000", 2024-09-13T05:11:14.986 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001314289, 2024-09-13T05:11:14.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013851099999999999, 2024-09-13T05:11:14.986 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:14.986 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-13T05:11:14.986 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:14.986 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:14.986 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:14.986 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65875 2024-09-13T05:11:14.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.986 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:14.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:14.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.983115+0000", 2024-09-13T05:11:14.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:14.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.983115+0000", 2024-09-13T05:11:14.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:14.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:14.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.983113+0000", 2024-09-13T05:11:14.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:14.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:14.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.983137+0000", 2024-09-13T05:11:14.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4122999999999999e-05 2024-09-13T05:11:14.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:14.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.983164+0000", 2024-09-13T05:11:14.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6846e-05 2024-09-13T05:11:14.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:14.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.983177+0000", 2024-09-13T05:11:14.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3529999999999999e-05 2024-09-13T05:11:14.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:14.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.983259+0000", 2024-09-13T05:11:14.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1928000000000006e-05 2024-09-13T05:11:14.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:14.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.983403+0000", 2024-09-13T05:11:14.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014362399999999999 2024-09-13T05:11:14.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:14.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:14.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:11:14.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.983608+0000", 2024-09-13T05:11:14.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020506499999999999 2024-09-13T05:11:14.990 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.990 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:14.990 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.990 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:14.990 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:11:14.991 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 1 2024-09-13T05:11:14.991 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:14.991 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:14.991 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:14.999 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:11:15.003 INFO:teuthology.orchestra.run.smithi120.stdout:3133 trunc from 0xbc15283 to 0x10c55fe 2024-09-13T05:11:15.046 INFO:teuthology.orchestra.run.smithi120.stdout:3135 punch from 0xf8530a to 0xf9463a, (0xf330 bytes) 2024-09-13T05:11:15.046 INFO:teuthology.orchestra.run.smithi120.stdout:3136 read 0xd1e964 thru 0xd22d52 (0x43ef bytes) 2024-09-13T05:11:15.047 INFO:teuthology.orchestra.run.smithi120.stdout:3138 read 0x97a0eb thru 0x9867b6 (0xc6cc bytes) 2024-09-13T05:11:15.056 INFO:teuthology.orchestra.run.smithi120.stdout:3140 trunc from 0x10c55fe to 0x59ed8cd 2024-09-13T05:11:15.062 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:15.054+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:15.065 INFO:teuthology.orchestra.run.smithi120.stdout:3141 read 0x474db4a thru 0x4754f3f (0x73f6 bytes) 2024-09-13T05:11:15.065 INFO:teuthology.orchestra.run.smithi120.stdout:3143 write 0x8ec169 thru 0x8fa706 (0xe59e bytes) 2024-09-13T05:11:15.091 INFO:teuthology.orchestra.run.smithi120.stdout:3144 writesame 0xaee4a45 thru 0xaeeb9fc data_size 0x82(0x6fb8 bytes) 2024-09-13T05:11:15.091 INFO:teuthology.orchestra.run.smithi120.stdout:3145 read 0x10ec4db thru 0x10edb56 (0x167c bytes) 2024-09-13T05:11:15.091 INFO:teuthology.orchestra.run.smithi120.stdout:3146 read 0x473490d thru 0x4737226 (0x291a bytes) 2024-09-13T05:11:15.102 INFO:teuthology.orchestra.run.smithi120.stdout:3147 write 0xb255cd7 thru 0xb25c901 (0x6c2b bytes) 2024-09-13T05:11:15.112 INFO:teuthology.orchestra.run.smithi120.stdout:3148 trunc from 0xb25c902 to 0xd68885d 2024-09-13T05:11:15.120 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:15.121 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:15.123 INFO:teuthology.orchestra.run.smithi120.stdout:3150 write 0x71a7b3f thru 0x71aedb5 (0x7277 bytes) 2024-09-13T05:11:15.131 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:11:15.131 INFO:teuthology.orchestra.run.smithi120.stdout:3151 writesame 0x6743fd8 thru 0x67473c8 data_size 0x1(0x33f1 bytes) 2024-09-13T05:11:15.147 INFO:teuthology.orchestra.run.smithi120.stdout:3152 read 0xd285daa thru 0xd291f90 (0xc1e7 bytes) 2024-09-13T05:11:15.147 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:15.148 INFO:teuthology.orchestra.run.smithi120.stdout:3154 write 0x55c024f thru 0x55cfc04 (0xf9b6 bytes) 2024-09-13T05:11:15.156 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:15.149+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:15.168 INFO:teuthology.orchestra.run.smithi120.stdout:3155 trunc from 0xd68885d to 0x68445d9 2024-09-13T05:11:15.188 INFO:teuthology.orchestra.run.smithi120.stdout:3156 writesame 0x19225ff thru 0x192c62a data_size 0x66(0xa02c bytes) 2024-09-13T05:11:15.191 INFO:teuthology.orchestra.run.smithi120.stdout:3157 read 0x5c39892 thru 0x5c4172c (0x7e9b bytes) 2024-09-13T05:11:15.191 INFO:teuthology.orchestra.run.smithi120.stdout:3158 read 0x6205195 thru 0x6205891 (0x6fd bytes) 2024-09-13T05:11:15.192 INFO:teuthology.orchestra.run.smithi120.stdout:3159 read 0x406fe04 thru 0x407e921 (0xeb1e bytes) 2024-09-13T05:11:15.213 INFO:teuthology.orchestra.run.smithi120.stdout:3160 write 0xbaf3b4d thru 0xbafa29c (0x6750 bytes) 2024-09-13T05:11:15.221 INFO:teuthology.orchestra.run.smithi120.stdout:3161 read 0x33152d8 thru 0x3315c43 (0x96c bytes) 2024-09-13T05:11:15.231 INFO:teuthology.orchestra.run.smithi120.stdout:3163 trunc from 0xbafa29d to 0x5edfef8 2024-09-13T05:11:15.248 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:15.248 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:15.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:15.248 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:15.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.248 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26335 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1207296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:15.249 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:15.249 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.514601822000003, 2024-09-13T05:11:15.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055338125000000002, 2024-09-13T05:11:15.249 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.249 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.249 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26335 2024-09-13T05:11:15.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.249 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:15.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:15.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730550+0000", 2024-09-13T05:11:15.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998579 2024-09-13T05:11:15.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730705+0000", 2024-09-13T05:11:15.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015463400000000001 2024-09-13T05:11:15.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730713+0000", 2024-09-13T05:11:15.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1580000000000005e-06 2024-09-13T05:11:15.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730719+0000", 2024-09-13T05:11:15.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2740000000000004e-06 2024-09-13T05:11:15.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.785798+0000", 2024-09-13T05:11:15.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055079454 2024-09-13T05:11:15.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.785894+0000", 2024-09-13T05:11:15.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5896000000000005e-05 2024-09-13T05:11:15.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.786030+0000", 2024-09-13T05:11:15.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013586199999999999 2024-09-13T05:11:15.253 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.253 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.253 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.253 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26346 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1308672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:15.254 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:15.254 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.512460415, 2024-09-13T05:11:15.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055416737000000001, 2024-09-13T05:11:15.254 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.254 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.254 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.254 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.254 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.254 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26346 2024-09-13T05:11:15.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.254 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:15.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:15.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732833+0000", 2024-09-13T05:11:15.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:15.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732835+0000", 2024-09-13T05:11:15.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3719999999999999e-06 2024-09-13T05:11:15.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732839+0000", 2024-09-13T05:11:15.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1520000000000001e-06 2024-09-13T05:11:15.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732842+0000", 2024-09-13T05:11:15.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.061e-06 2024-09-13T05:11:15.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788126+0000", 2024-09-13T05:11:15.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055284489999999999 2024-09-13T05:11:15.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788183+0000", 2024-09-13T05:11:15.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7127999999999999e-05 2024-09-13T05:11:15.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788250+0000", 2024-09-13T05:11:15.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7001000000000004e-05 2024-09-13T05:11:15.260 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.260 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.261 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.261 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26348 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 800768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:15.261 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:15.261 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.512037591000002, 2024-09-13T05:11:15.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055321395000000002, 2024-09-13T05:11:15.262 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.262 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.262 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26348 2024-09-13T05:11:15.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.262 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:15.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:15.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733127+0000", 2024-09-13T05:11:15.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998703 2024-09-13T05:11:15.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733262+0000", 2024-09-13T05:11:15.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013484400000000001 2024-09-13T05:11:15.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733273+0000", 2024-09-13T05:11:15.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1824000000000001e-05 2024-09-13T05:11:15.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733281+0000", 2024-09-13T05:11:15.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9999999999999996e-06 2024-09-13T05:11:15.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788431+0000", 2024-09-13T05:11:15.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055149535 2024-09-13T05:11:15.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788490+0000", 2024-09-13T05:11:15.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9413999999999997e-05 2024-09-13T05:11:15.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788578+0000", 2024-09-13T05:11:15.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7418999999999998e-05 2024-09-13T05:11:15.268 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.269 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.269 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.269 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26368 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 985088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:15.269 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:11:15.270 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.507885393999999, 2024-09-13T05:11:15.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055320511000000003, 2024-09-13T05:11:15.270 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.270 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.271 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.271 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26368 2024-09-13T05:11:15.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.271 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:11:15.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:11:15.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737408+0000", 2024-09-13T05:11:15.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:15.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737412+0000", 2024-09-13T05:11:15.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6279999999999998e-06 2024-09-13T05:11:15.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737419+0000", 2024-09-13T05:11:15.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1770000000000001e-06 2024-09-13T05:11:15.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737425+0000", 2024-09-13T05:11:15.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6949999999999997e-06 2024-09-13T05:11:15.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792507+0000", 2024-09-13T05:11:15.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055082840000000001 2024-09-13T05:11:15.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792606+0000", 2024-09-13T05:11:15.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8697999999999996e-05 2024-09-13T05:11:15.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792729+0000", 2024-09-13T05:11:15.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012298499999999999 2024-09-13T05:11:15.279 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.279 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.279 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.280 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26417 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 903168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:15.280 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:15.280 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.503825134000003, 2024-09-13T05:11:15.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055375191999999997, 2024-09-13T05:11:15.280 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.280 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.281 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.281 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.281 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.281 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26417 2024-09-13T05:11:15.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.281 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:15.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:15.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741468+0000", 2024-09-13T05:11:15.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:15.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741472+0000", 2024-09-13T05:11:15.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4139999999999998e-06 2024-09-13T05:11:15.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741478+0000", 2024-09-13T05:11:15.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5230000000000001e-06 2024-09-13T05:11:15.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741483+0000", 2024-09-13T05:11:15.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8559999999999998e-06 2024-09-13T05:11:15.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796655+0000", 2024-09-13T05:11:15.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055172153000000002 2024-09-13T05:11:15.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796738+0000", 2024-09-13T05:11:15.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2912999999999997e-05 2024-09-13T05:11:15.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796844+0000", 2024-09-13T05:11:15.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105802 2024-09-13T05:11:15.291 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.291 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.291 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.291 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26419 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 912384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:15.291 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:15.291 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.503801269, 2024-09-13T05:11:15.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055570469999999997, 2024-09-13T05:11:15.292 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.292 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.292 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.292 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.292 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.292 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26419 2024-09-13T05:11:15.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.292 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:15.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:15.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741492+0000", 2024-09-13T05:11:15.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:15.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741495+0000", 2024-09-13T05:11:15.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6369999999999999e-06 2024-09-13T05:11:15.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741508+0000", 2024-09-13T05:11:15.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3319000000000001e-05 2024-09-13T05:11:15.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741527+0000", 2024-09-13T05:11:15.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8542e-05 2024-09-13T05:11:15.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796871+0000", 2024-09-13T05:11:15.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055344474999999997 2024-09-13T05:11:15.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796967+0000", 2024-09-13T05:11:15.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5963000000000003e-05 2024-09-13T05:11:15.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797063+0000", 2024-09-13T05:11:15.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5909999999999995e-05 2024-09-13T05:11:15.296 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.296 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.296 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.296 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26421 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 921600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:15.296 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:15.296 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.503757966000002, 2024-09-13T05:11:15.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055631152000000003, 2024-09-13T05:11:15.296 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.297 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.297 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26421 2024-09-13T05:11:15.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.297 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:15.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:15.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741535+0000", 2024-09-13T05:11:15.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:15.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741540+0000", 2024-09-13T05:11:15.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1690000000000002e-06 2024-09-13T05:11:15.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741547+0000", 2024-09-13T05:11:15.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3409999999999997e-06 2024-09-13T05:11:15.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741552+0000", 2024-09-13T05:11:15.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5639999999999996e-06 2024-09-13T05:11:15.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797079+0000", 2024-09-13T05:11:15.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055526038999999999 2024-09-13T05:11:15.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797121+0000", 2024-09-13T05:11:15.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2156000000000001e-05 2024-09-13T05:11:15.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797167+0000", 2024-09-13T05:11:15.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6445e-05 2024-09-13T05:11:15.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.300 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.301 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26423 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 930816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:15.301 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:15.301 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.503364973000004, 2024-09-13T05:11:15.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055364370000000003, 2024-09-13T05:11:15.301 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.301 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.301 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26423 2024-09-13T05:11:15.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.301 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:15.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:15.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741928+0000", 2024-09-13T05:11:15.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:15.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741933+0000", 2024-09-13T05:11:15.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9980000000000003e-06 2024-09-13T05:11:15.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741945+0000", 2024-09-13T05:11:15.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1761e-05 2024-09-13T05:11:15.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741958+0000", 2024-09-13T05:11:15.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2604e-05 2024-09-13T05:11:15.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797185+0000", 2024-09-13T05:11:15.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055227169 2024-09-13T05:11:15.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797226+0000", 2024-09-13T05:11:15.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1619000000000003e-05 2024-09-13T05:11:15.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797293+0000", 2024-09-13T05:11:15.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6952999999999994e-05 2024-09-13T05:11:15.306 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.306 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.306 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.306 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26424 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 940032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:15.306 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:15.306 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.503328035999999, 2024-09-13T05:11:15.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055448669999999999, 2024-09-13T05:11:15.306 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.306 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.307 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.307 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.307 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.307 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26424 2024-09-13T05:11:15.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.307 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:15.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:15.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741965+0000", 2024-09-13T05:11:15.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:15.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741969+0000", 2024-09-13T05:11:15.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3440000000000001e-06 2024-09-13T05:11:15.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741983+0000", 2024-09-13T05:11:15.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4600000000000001e-05 2024-09-13T05:11:15.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741989+0000", 2024-09-13T05:11:15.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5350000000000004e-06 2024-09-13T05:11:15.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797319+0000", 2024-09-13T05:11:15.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055330121000000003 2024-09-13T05:11:15.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797364+0000", 2024-09-13T05:11:15.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5670000000000002e-05 2024-09-13T05:11:15.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797415+0000", 2024-09-13T05:11:15.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0124000000000003e-05 2024-09-13T05:11:15.311 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.311 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.311 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.311 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26426 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 949248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:15.311 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:15.311 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.503300836999998, 2024-09-13T05:11:15.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055639981999999998, 2024-09-13T05:11:15.312 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.312 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.312 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26426 2024-09-13T05:11:15.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.313 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:15.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:15.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:15.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:15.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741995+0000", 2024-09-13T05:11:15.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.661e-06 2024-09-13T05:11:15.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742004+0000", 2024-09-13T05:11:15.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2009999999999999e-06 2024-09-13T05:11:15.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742008+0000", 2024-09-13T05:11:15.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7890000000000002e-06 2024-09-13T05:11:15.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797432+0000", 2024-09-13T05:11:15.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055423448 2024-09-13T05:11:15.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797516+0000", 2024-09-13T05:11:15.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4404e-05 2024-09-13T05:11:15.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797633+0000", 2024-09-13T05:11:15.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116898 2024-09-13T05:11:15.321 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.321 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.321 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.321 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26427 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 958464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:15.322 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:15.322 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.503280781000001, 2024-09-13T05:11:15.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055829295000000001, 2024-09-13T05:11:15.322 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.322 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.322 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.323 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.323 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.323 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26427 2024-09-13T05:11:15.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.323 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:15.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:15.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:15.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:15.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742015+0000", 2024-09-13T05:11:15.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.74e-06 2024-09-13T05:11:15.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742023+0000", 2024-09-13T05:11:15.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7039999999999994e-06 2024-09-13T05:11:15.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742028+0000", 2024-09-13T05:11:15.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7369999999999997e-06 2024-09-13T05:11:15.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797666+0000", 2024-09-13T05:11:15.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055637820999999997 2024-09-13T05:11:15.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797748+0000", 2024-09-13T05:11:15.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1787999999999997e-05 2024-09-13T05:11:15.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797842+0000", 2024-09-13T05:11:15.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4903999999999998e-05 2024-09-13T05:11:15.331 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.332 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.332 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.332 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26432 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 976896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:15.332 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:15.333 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.502487619999997, 2024-09-13T05:11:15.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055402077000000001, 2024-09-13T05:11:15.333 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.333 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.333 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.333 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.334 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26432 2024-09-13T05:11:15.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.334 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:15.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:15.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:15.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:15.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742808+0000", 2024-09-13T05:11:15.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3319999999999999e-06 2024-09-13T05:11:15.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742818+0000", 2024-09-13T05:11:15.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5380000000000008e-06 2024-09-13T05:11:15.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742821+0000", 2024-09-13T05:11:15.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2179999999999999e-06 2024-09-13T05:11:15.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798027+0000", 2024-09-13T05:11:15.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055206344999999997 2024-09-13T05:11:15.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798103+0000", 2024-09-13T05:11:15.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5786999999999998e-05 2024-09-13T05:11:15.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798208+0000", 2024-09-13T05:11:15.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010521700000000001 2024-09-13T05:11:15.342 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.342 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.342 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.343 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26434 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 986112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:15.343 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:15.343 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.502470396, 2024-09-13T05:11:15.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055610109999999997, 2024-09-13T05:11:15.343 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.343 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.344 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.344 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.344 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.344 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26434 2024-09-13T05:11:15.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.344 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:15.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:15.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742823+0000", 2024-09-13T05:11:15.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:15.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742825+0000", 2024-09-13T05:11:15.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6220000000000001e-06 2024-09-13T05:11:15.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742828+0000", 2024-09-13T05:11:15.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.926e-06 2024-09-13T05:11:15.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742831+0000", 2024-09-13T05:11:15.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-13T05:11:15.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798239+0000", 2024-09-13T05:11:15.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055408254999999997 2024-09-13T05:11:15.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798326+0000", 2024-09-13T05:11:15.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7168000000000003e-05 2024-09-13T05:11:15.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798434+0000", 2024-09-13T05:11:15.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010767100000000001 2024-09-13T05:11:15.352 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.352 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.352 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.352 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26442 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1032192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:15.352 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:15.352 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.501201055999999, 2024-09-13T05:11:15.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055422776, 2024-09-13T05:11:15.353 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.353 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.353 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.353 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.353 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.353 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26442 2024-09-13T05:11:15.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.353 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:15.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:15.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744061+0000", 2024-09-13T05:11:15.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999685 2024-09-13T05:11:15.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744096+0000", 2024-09-13T05:11:15.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4771999999999998e-05 2024-09-13T05:11:15.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744147+0000", 2024-09-13T05:11:15.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0696999999999999e-05 2024-09-13T05:11:15.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744154+0000", 2024-09-13T05:11:15.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8510000000000001e-06 2024-09-13T05:11:15.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799324+0000", 2024-09-13T05:11:15.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055170074999999999 2024-09-13T05:11:15.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799415+0000", 2024-09-13T05:11:15.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1197000000000001e-05 2024-09-13T05:11:15.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799516+0000", 2024-09-13T05:11:15.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100666 2024-09-13T05:11:15.358 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.358 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.358 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.359 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26443 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1041408~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:15.359 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:15.359 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.500920485000002, 2024-09-13T05:11:15.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055344195999999998, 2024-09-13T05:11:15.359 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.359 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.359 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.359 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.359 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.360 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26443 2024-09-13T05:11:15.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.360 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:15.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:15.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744159+0000", 2024-09-13T05:11:15.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997849 2024-09-13T05:11:15.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744379+0000", 2024-09-13T05:11:15.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022024800000000001 2024-09-13T05:11:15.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744390+0000", 2024-09-13T05:11:15.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1105e-05 2024-09-13T05:11:15.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744397+0000", 2024-09-13T05:11:15.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2740000000000002e-06 2024-09-13T05:11:15.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799543+0000", 2024-09-13T05:11:15.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055145441000000003 2024-09-13T05:11:15.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799619+0000", 2024-09-13T05:11:15.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6660000000000001e-05 2024-09-13T05:11:15.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799718+0000", 2024-09-13T05:11:15.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8331000000000004e-05 2024-09-13T05:11:15.363 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.363 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.363 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.363 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26547 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1318912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:15.363 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:15.363 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.500734166999997, 2024-09-13T05:11:15.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055355834, 2024-09-13T05:11:15.364 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.364 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.364 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.364 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.364 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.364 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26547 2024-09-13T05:11:15.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.364 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:15.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:15.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744404+0000", 2024-09-13T05:11:15.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998441 2024-09-13T05:11:15.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744564+0000", 2024-09-13T05:11:15.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016022200000000001 2024-09-13T05:11:15.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744579+0000", 2024-09-13T05:11:15.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5036e-05 2024-09-13T05:11:15.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744585+0000", 2024-09-13T05:11:15.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7880000000000003e-06 2024-09-13T05:11:15.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799747+0000", 2024-09-13T05:11:15.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055161804000000002 2024-09-13T05:11:15.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799823+0000", 2024-09-13T05:11:15.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5956000000000003e-05 2024-09-13T05:11:15.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799916+0000", 2024-09-13T05:11:15.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2733999999999997e-05 2024-09-13T05:11:15.367 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.367 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.367 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.368 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26550 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1328128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:15.368 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:11:15.368 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.500478008000002, 2024-09-13T05:11:15.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055315941, 2024-09-13T05:11:15.368 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.368 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.368 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.368 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.368 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.368 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26550 2024-09-13T05:11:15.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.368 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:11:15.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:11:15.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744591+0000", 2024-09-13T05:11:15.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997745 2024-09-13T05:11:15.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744821+0000", 2024-09-13T05:11:15.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023031899999999999 2024-09-13T05:11:15.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744833+0000", 2024-09-13T05:11:15.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1919000000000001e-05 2024-09-13T05:11:15.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744837+0000", 2024-09-13T05:11:15.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4989999999999996e-06 2024-09-13T05:11:15.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799947+0000", 2024-09-13T05:11:15.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055110120999999998 2024-09-13T05:11:15.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800030+0000", 2024-09-13T05:11:15.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2905999999999995e-05 2024-09-13T05:11:15.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800132+0000", 2024-09-13T05:11:15.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101529 2024-09-13T05:11:15.372 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.372 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.372 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.372 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26558 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1364992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:15.372 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:15.372 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.499743000999999, 2024-09-13T05:11:15.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055422765999999998, 2024-09-13T05:11:15.372 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.372 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.372 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.372 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.372 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.373 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26558 2024-09-13T05:11:15.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.373 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:15.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:15.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745550+0000", 2024-09-13T05:11:15.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:15.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745553+0000", 2024-09-13T05:11:15.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7690000000000001e-06 2024-09-13T05:11:15.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745559+0000", 2024-09-13T05:11:15.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3149999999999997e-06 2024-09-13T05:11:15.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745564+0000", 2024-09-13T05:11:15.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6670000000000004e-06 2024-09-13T05:11:15.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800791+0000", 2024-09-13T05:11:15.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055226711999999997 2024-09-13T05:11:15.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800865+0000", 2024-09-13T05:11:15.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4344000000000005e-05 2024-09-13T05:11:15.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800974+0000", 2024-09-13T05:11:15.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108606 2024-09-13T05:11:15.376 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.376 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.376 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.376 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26561 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1374208~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:15.376 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:15.376 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.499725947999998, 2024-09-13T05:11:15.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055549315000000002, 2024-09-13T05:11:15.377 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.377 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.377 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26561 2024-09-13T05:11:15.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.377 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:15.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:15.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:15.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:15.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745570+0000", 2024-09-13T05:11:15.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4719999999999998e-06 2024-09-13T05:11:15.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745575+0000", 2024-09-13T05:11:15.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1900000000000003e-06 2024-09-13T05:11:15.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745579+0000", 2024-09-13T05:11:15.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3250000000000001e-06 2024-09-13T05:11:15.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801000+0000", 2024-09-13T05:11:15.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055420432999999998 2024-09-13T05:11:15.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801061+0000", 2024-09-13T05:11:15.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1427000000000007e-05 2024-09-13T05:11:15.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801117+0000", 2024-09-13T05:11:15.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5933000000000001e-05 2024-09-13T05:11:15.380 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.380 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.380 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.381 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26582 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1447936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:15.381 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:15.381 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.498308307999999, 2024-09-13T05:11:15.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055394301, 2024-09-13T05:11:15.381 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.381 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.381 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.381 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.381 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.381 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26582 2024-09-13T05:11:15.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.381 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:15.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:15.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746985+0000", 2024-09-13T05:11:15.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:15.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746988+0000", 2024-09-13T05:11:15.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6479999999999999e-06 2024-09-13T05:11:15.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.747000+0000", 2024-09-13T05:11:15.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2009e-05 2024-09-13T05:11:15.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.747005+0000", 2024-09-13T05:11:15.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0039999999999999e-06 2024-09-13T05:11:15.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802232+0000", 2024-09-13T05:11:15.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055227762999999999 2024-09-13T05:11:15.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802320+0000", 2024-09-13T05:11:15.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7576000000000003e-05 2024-09-13T05:11:15.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802380+0000", 2024-09-13T05:11:15.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9888e-05 2024-09-13T05:11:15.385 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.385 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.385 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.385 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.385 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.385 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:15.386 INFO:teuthology.orchestra.run.smithi120.stdout:3164 writesame 0x29dc92b thru 0x29df289 data_size 0x11(0x295f bytes) 2024-09-13T05:11:15.386 INFO:teuthology.orchestra.run.smithi120.stdout:3165 writesame 0x1aa17a9 thru 0x1aa545b data_size 0x1(0x3cb3 bytes) 2024-09-13T05:11:15.387 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:11:15.388 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:15.389 INFO:teuthology.orchestra.run.smithi120.stdout:3170 punch from 0x2996f0f to 0x299cf12, (0x6003 bytes) 2024-09-13T05:11:15.389 INFO:teuthology.orchestra.run.smithi120.stdout:3171 read 0x9ebf08 thru 0x9f30a1 (0x719a bytes) 2024-09-13T05:11:15.389 INFO:teuthology.orchestra.run.smithi120.stdout:3172 punch from 0x2319074 to 0x231c0d9, (0x3065 bytes) 2024-09-13T05:11:15.389 INFO:teuthology.orchestra.run.smithi120.stdout:3173 writesame 0x4dff00f thru 0x4e0e4c5 data_size 0x3d(0xf4b7 bytes) 2024-09-13T05:11:15.389 INFO:teuthology.orchestra.run.smithi120.stdout:3174 trunc from 0x5edfef8 to 0x82087f8 2024-09-13T05:11:15.389 INFO:teuthology.orchestra.run.smithi120.stdout:3175 punch from 0x78c56be to 0x78d055e, (0xaea0 bytes) 2024-09-13T05:11:15.389 INFO:teuthology.orchestra.run.smithi120.stdout:3176 read 0x135ff5a thru 0x13631f4 (0x329b bytes) 2024-09-13T05:11:15.389 INFO:teuthology.orchestra.run.smithi120.stdout:3178 write 0x6a621c8 thru 0x6a69eea (0x7d23 bytes) 2024-09-13T05:11:15.392 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is unset 2024-09-13T05:11:15.393 INFO:teuthology.orchestra.run.smithi120.stdout:3179 trunc from 0x82087f8 to 0x40fe41f 2024-09-13T05:11:15.394 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:15.382+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:15.487 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:15.481+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:15.547 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:15.548 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:15.548 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:15.548 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:15.558 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:11:15.588 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:15.586+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:15.664 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:15.664 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:15.664 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:15.664 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:15.664 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:15.674 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:11:15.689 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:15.681+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:15.734 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:11:15.780 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:15.781 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:15.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:15.781 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:15.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.781 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:2037 3.8 3:1349be29:::rbd_data.112d872fd67a.000000000000003b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T05:11:15.781 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:20.108522+0000", 2024-09-13T05:11:15.781 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.670050953000001, 2024-09-13T05:11:15.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016880821000000001, 2024-09-13T05:11:15.781 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.781 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:15.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.782 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 2037 2024-09-13T05:11:15.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.782 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108522+0000", 2024-09-13T05:11:15.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108522+0000", 2024-09-13T05:11:15.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108521+0000", 2024-09-13T05:11:15.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:15.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108527+0000", 2024-09-13T05:11:15.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0460000000000002e-06 2024-09-13T05:11:15.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108538+0000", 2024-09-13T05:11:15.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0891e-05 2024-09-13T05:11:15.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108548+0000", 2024-09-13T05:11:15.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9159999999999996e-06 2024-09-13T05:11:15.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108595+0000", 2024-09-13T05:11:15.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7107000000000001e-05 2024-09-13T05:11:15.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.108692+0000", 2024-09-13T05:11:15.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6824999999999995e-05 2024-09-13T05:11:15.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:11:15.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.111425+0000", 2024-09-13T05:11:15.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027337110000000002 2024-09-13T05:11:15.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:15.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125249+0000", 2024-09-13T05:11:15.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013823521 2024-09-13T05:11:15.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:15.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125265+0000", 2024-09-13T05:11:15.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6257e-05 2024-09-13T05:11:15.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:15.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125347+0000", 2024-09-13T05:11:15.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1321000000000003e-05 2024-09-13T05:11:15.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:20.125403+0000", 2024-09-13T05:11:15.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6362e-05 2024-09-13T05:11:15.788 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.788 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.788 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.788 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:7961 3.18 3:184d9aea:::rbd_data.112db57f3a18.000000000000002b:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-13T05:11:15.788 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:11:15.788 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.701567965000002, 2024-09-13T05:11:15.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.040271084999999998, 2024-09-13T05:11:15.788 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.788 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:15.788 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.788 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.789 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.789 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7961 2024-09-13T05:11:15.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.789 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:11:15.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:11:15.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077003+0000", 2024-09-13T05:11:15.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:15.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077013+0000", 2024-09-13T05:11:15.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6870000000000006e-06 2024-09-13T05:11:15.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077029+0000", 2024-09-13T05:11:15.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6314e-05 2024-09-13T05:11:15.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077038+0000", 2024-09-13T05:11:15.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5019999999999992e-06 2024-09-13T05:11:15.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077099+0000", 2024-09-13T05:11:15.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1444000000000003e-05 2024-09-13T05:11:15.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077234+0000", 2024-09-13T05:11:15.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013461300000000001 2024-09-13T05:11:15.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-13T05:11:15.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.085202+0000", 2024-09-13T05:11:15.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079680140000000007 2024-09-13T05:11:15.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:15.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116860+0000", 2024-09-13T05:11:15.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.031658190000000003 2024-09-13T05:11:15.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:15.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116995+0000", 2024-09-13T05:11:15.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000135601 2024-09-13T05:11:15.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:15.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117152+0000", 2024-09-13T05:11:15.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015681700000000001 2024-09-13T05:11:15.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117276+0000", 2024-09-13T05:11:15.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012392699999999999 2024-09-13T05:11:15.794 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.794 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.794 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.795 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:8105 3.b 3:d2ae8f7b:::rbd_data.112db57f3a18.0000000000000028:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-13T05:11:15.795 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:11:15.795 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.466472158999998, 2024-09-13T05:11:15.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.040653913, 2024-09-13T05:11:15.795 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.795 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:15.795 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.795 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.795 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.795 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 8105 2024-09-13T05:11:15.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.795 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:11:15.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:11:15.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312099+0000", 2024-09-13T05:11:15.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:15.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312109+0000", 2024-09-13T05:11:15.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0244999999999999e-05 2024-09-13T05:11:15.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312129+0000", 2024-09-13T05:11:15.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9751000000000001e-05 2024-09-13T05:11:15.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312141+0000", 2024-09-13T05:11:15.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2201999999999999e-05 2024-09-13T05:11:15.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312230+0000", 2024-09-13T05:11:15.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9092999999999996e-05 2024-09-13T05:11:15.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312433+0000", 2024-09-13T05:11:15.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020240500000000001 2024-09-13T05:11:15.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-13T05:11:15.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.320357+0000", 2024-09-13T05:11:15.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079242630000000008 2024-09-13T05:11:15.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:15.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352488+0000", 2024-09-13T05:11:15.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032131588000000003 2024-09-13T05:11:15.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:15.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352533+0000", 2024-09-13T05:11:15.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4601999999999997e-05 2024-09-13T05:11:15.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:15.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352636+0000", 2024-09-13T05:11:15.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103041 2024-09-13T05:11:15.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352755+0000", 2024-09-13T05:11:15.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118814 2024-09-13T05:11:15.801 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.801 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.801 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.801 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:39305 3.1e 3:79249bf8:::rbd_data.112dcff96bbd.0000000000000003:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-13T05:11:15.801 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:41.473278+0000", 2024-09-13T05:11:15.801 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.305295563000001, 2024-09-13T05:11:15.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027037510000000001, 2024-09-13T05:11:15.802 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.802 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:15.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.802 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 39305 2024-09-13T05:11:15.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.802 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473278+0000", 2024-09-13T05:11:15.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473278+0000", 2024-09-13T05:11:15.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473276+0000", 2024-09-13T05:11:15.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:15.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473285+0000", 2024-09-13T05:11:15.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0129999999999999e-06 2024-09-13T05:11:15.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473304+0000", 2024-09-13T05:11:15.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8723e-05 2024-09-13T05:11:15.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473313+0000", 2024-09-13T05:11:15.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1419999999999999e-06 2024-09-13T05:11:15.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473390+0000", 2024-09-13T05:11:15.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7001000000000004e-05 2024-09-13T05:11:15.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473496+0000", 2024-09-13T05:11:15.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010577399999999999 2024-09-13T05:11:15.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:11:15.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.478499+0000", 2024-09-13T05:11:15.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050029260000000004 2024-09-13T05:11:15.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:15.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500153+0000", 2024-09-13T05:11:15.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021654421 2024-09-13T05:11:15.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:15.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500216+0000", 2024-09-13T05:11:15.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3233999999999998e-05 2024-09-13T05:11:15.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:15.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500273+0000", 2024-09-13T05:11:15.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6484000000000003e-05 2024-09-13T05:11:15.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500315+0000", 2024-09-13T05:11:15.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2342000000000002e-05 2024-09-13T05:11:15.807 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.807 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.807 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.808 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:40934 3.1 3:86cdeb48:::rbd_data.112d4ab2162d.0000000000000103:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-13T05:11:15.808 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:46.247357+0000", 2024-09-13T05:11:15.808 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.531216324999999, 2024-09-13T05:11:15.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028923379999999999, 2024-09-13T05:11:15.808 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.808 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:15.809 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.809 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.809 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.809 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 40934 2024-09-13T05:11:15.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.809 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247357+0000", 2024-09-13T05:11:15.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247357+0000", 2024-09-13T05:11:15.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247354+0000", 2024-09-13T05:11:15.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:11:15.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247371+0000", 2024-09-13T05:11:15.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6697e-05 2024-09-13T05:11:15.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247403+0000", 2024-09-13T05:11:15.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1649000000000001e-05 2024-09-13T05:11:15.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247417+0000", 2024-09-13T05:11:15.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.395e-05 2024-09-13T05:11:15.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247498+0000", 2024-09-13T05:11:15.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1011000000000001e-05 2024-09-13T05:11:15.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247757+0000", 2024-09-13T05:11:15.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000258872 2024-09-13T05:11:15.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:11:15.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.254874+0000", 2024-09-13T05:11:15.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071176449999999997 2024-09-13T05:11:15.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:15.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.275876+0000", 2024-09-13T05:11:15.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021001770999999999 2024-09-13T05:11:15.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:15.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.275989+0000", 2024-09-13T05:11:15.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011301199999999999 2024-09-13T05:11:15.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:15.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.276156+0000", 2024-09-13T05:11:15.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000167453 2024-09-13T05:11:15.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.276280+0000", 2024-09-13T05:11:15.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012369400000000001 2024-09-13T05:11:15.814 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.814 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.814 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.815 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:45910 3.a 3:56753852:::rbd_header.112d678e2955:head [call,call rbd.parent_overlap_get in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e58)", 2024-09-13T05:11:15.815 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:50.370028+0000", 2024-09-13T05:11:15.815 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 25.408545577000002, 2024-09-13T05:11:15.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048450024000000001, 2024-09-13T05:11:15.815 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.815 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.815 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.815 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.815 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.815 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45910 2024-09-13T05:11:15.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.815 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370028+0000", 2024-09-13T05:11:15.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370028+0000", 2024-09-13T05:11:15.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370027+0000", 2024-09-13T05:11:15.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:15.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370031+0000", 2024-09-13T05:11:15.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6530000000000002e-06 2024-09-13T05:11:15.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370038+0000", 2024-09-13T05:11:15.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8959999999999997e-06 2024-09-13T05:11:15.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370043+0000", 2024-09-13T05:11:15.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3680000000000004e-06 2024-09-13T05:11:15.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370076+0000", 2024-09-13T05:11:15.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3411000000000002e-05 2024-09-13T05:11:15.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370125+0000", 2024-09-13T05:11:15.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8593e-05 2024-09-13T05:11:15.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.418478+0000", 2024-09-13T05:11:15.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048352978999999997 2024-09-13T05:11:15.819 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.819 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.819 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.819 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:54388 3.19 3:99c9c083:::rbd_data.112d7b5dd21c.0000000000000001:17 [sparse-read 12976128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-13T05:11:15.819 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:01.846103+0000", 2024-09-13T05:11:15.819 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.932470200000001, 2024-09-13T05:11:15.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016717823999999999, 2024-09-13T05:11:15.819 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.820 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.820 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.820 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.820 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.820 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 54388 2024-09-13T05:11:15.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.820 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846103+0000", 2024-09-13T05:11:15.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846103+0000", 2024-09-13T05:11:15.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846103+0000", 2024-09-13T05:11:15.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:15.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846112+0000", 2024-09-13T05:11:15.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5419999999999994e-06 2024-09-13T05:11:15.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846118+0000", 2024-09-13T05:11:15.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0249999999999999e-06 2024-09-13T05:11:15.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.846126+0000", 2024-09-13T05:11:15.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5170000000000002e-06 2024-09-13T05:11:15.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.862692+0000", 2024-09-13T05:11:15.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016566019000000001 2024-09-13T05:11:15.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.862750+0000", 2024-09-13T05:11:15.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8415999999999998e-05 2024-09-13T05:11:15.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:01.862821+0000", 2024-09-13T05:11:15.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0679000000000005e-05 2024-09-13T05:11:15.824 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.824 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.824 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.824 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:56276 3.1 3:8275684a:::rbd_data.112d667fb7f9.000000000000008f:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-13T05:11:15.824 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:04.698605+0000", 2024-09-13T05:11:15.824 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.079967861, 2024-09-13T05:11:15.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024657968999999998, 2024-09-13T05:11:15.824 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.825 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:15.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.825 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 56276 2024-09-13T05:11:15.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.825 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698605+0000", 2024-09-13T05:11:15.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698605+0000", 2024-09-13T05:11:15.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698602+0000", 2024-09-13T05:11:15.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999971 2024-09-13T05:11:15.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698621+0000", 2024-09-13T05:11:15.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8783e-05 2024-09-13T05:11:15.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698667+0000", 2024-09-13T05:11:15.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5509000000000001e-05 2024-09-13T05:11:15.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698684+0000", 2024-09-13T05:11:15.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7799999999999999e-05 2024-09-13T05:11:15.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698782+0000", 2024-09-13T05:11:15.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7534000000000005e-05 2024-09-13T05:11:15.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698905+0000", 2024-09-13T05:11:15.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012293699999999999 2024-09-13T05:11:15.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:11:15.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.707711+0000", 2024-09-13T05:11:15.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088062939999999992 2024-09-13T05:11:15.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:15.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.723142+0000", 2024-09-13T05:11:15.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015430413 2024-09-13T05:11:15.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:15.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.723156+0000", 2024-09-13T05:11:15.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4868999999999999e-05 2024-09-13T05:11:15.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:15.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.723214+0000", 2024-09-13T05:11:15.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7522000000000003e-05 2024-09-13T05:11:15.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.723263+0000", 2024-09-13T05:11:15.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9261999999999997e-05 2024-09-13T05:11:15.830 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.830 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.830 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.830 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:56368 3.1e 3:7d682469:::rbd_data.112d667fb7f9.0000000000000065:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-13T05:11:15.830 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:04.786960+0000", 2024-09-13T05:11:15.830 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.991613334, 2024-09-13T05:11:15.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027546363000000001, 2024-09-13T05:11:15.830 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.831 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:15.831 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.831 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.831 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.831 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 56368 2024-09-13T05:11:15.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.831 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786960+0000", 2024-09-13T05:11:15.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786960+0000", 2024-09-13T05:11:15.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786959+0000", 2024-09-13T05:11:15.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:15.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786967+0000", 2024-09-13T05:11:15.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6249999999999996e-06 2024-09-13T05:11:15.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786979+0000", 2024-09-13T05:11:15.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1982e-05 2024-09-13T05:11:15.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786986+0000", 2024-09-13T05:11:15.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.126e-06 2024-09-13T05:11:15.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.787039+0000", 2024-09-13T05:11:15.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2431e-05 2024-09-13T05:11:15.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.787180+0000", 2024-09-13T05:11:15.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014091 2024-09-13T05:11:15.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:11:15.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.793251+0000", 2024-09-13T05:11:15.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060717419999999998 2024-09-13T05:11:15.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:15.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.814381+0000", 2024-09-13T05:11:15.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021129267 2024-09-13T05:11:15.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:15.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.814430+0000", 2024-09-13T05:11:15.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8952000000000002e-05 2024-09-13T05:11:15.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:15.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.814476+0000", 2024-09-13T05:11:15.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6223000000000001e-05 2024-09-13T05:11:15.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.814506+0000", 2024-09-13T05:11:15.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0287999999999999e-05 2024-09-13T05:11:15.836 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.836 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.836 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.836 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58069 3.2 3:45c87af8:::rbd_data.112d667fb7f9.0000000000000009:19 [read 253952~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:15.836 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.607725+0000", 2024-09-13T05:11:15.836 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.170847879, 2024-09-13T05:11:15.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016895331999999999, 2024-09-13T05:11:15.836 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.837 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.837 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.837 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.837 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.837 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58069 2024-09-13T05:11:15.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.837 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.607725+0000", 2024-09-13T05:11:15.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.607725+0000", 2024-09-13T05:11:15.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.607725+0000", 2024-09-13T05:11:15.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:15.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.607727+0000", 2024-09-13T05:11:15.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6440000000000001e-06 2024-09-13T05:11:15.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.607730+0000", 2024-09-13T05:11:15.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0419999999999998e-06 2024-09-13T05:11:15.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.607733+0000", 2024-09-13T05:11:15.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.044e-06 2024-09-13T05:11:15.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.624316+0000", 2024-09-13T05:11:15.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016583764000000001 2024-09-13T05:11:15.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.624362+0000", 2024-09-13T05:11:15.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5951000000000001e-05 2024-09-13T05:11:15.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.624621+0000", 2024-09-13T05:11:15.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025811600000000002 2024-09-13T05:11:15.841 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.841 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.841 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.841 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58307 3.18 3:1e8eca72:::rbd_data.112d667fb7f9.0000000000000010:19 [read 221184~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:15.841 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615299+0000", 2024-09-13T05:11:15.841 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.163273964, 2024-09-13T05:11:15.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018495981000000002, 2024-09-13T05:11:15.842 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.842 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.842 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.842 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.842 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.842 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58307 2024-09-13T05:11:15.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.842 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615299+0000", 2024-09-13T05:11:15.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615299+0000", 2024-09-13T05:11:15.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615299+0000", 2024-09-13T05:11:15.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:15.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615301+0000", 2024-09-13T05:11:15.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5009999999999999e-06 2024-09-13T05:11:15.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615307+0000", 2024-09-13T05:11:15.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9100000000000002e-06 2024-09-13T05:11:15.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615312+0000", 2024-09-13T05:11:15.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0350000000000001e-06 2024-09-13T05:11:15.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.631195+0000", 2024-09-13T05:11:15.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015883044999999998 2024-09-13T05:11:15.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.631309+0000", 2024-09-13T05:11:15.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113585 2024-09-13T05:11:15.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.633795+0000", 2024-09-13T05:11:15.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024862679999999998 2024-09-13T05:11:15.846 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.846 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.846 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.846 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58312 3.18 3:1e6e3be3:::rbd_data.112d667fb7f9.0000000000000012:19 [read 106496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:15.846 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615434+0000", 2024-09-13T05:11:15.846 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.163138598, 2024-09-13T05:11:15.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018590530000000001, 2024-09-13T05:11:15.846 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.846 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.846 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.847 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.847 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.847 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58312 2024-09-13T05:11:15.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.847 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615434+0000", 2024-09-13T05:11:15.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615434+0000", 2024-09-13T05:11:15.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615434+0000", 2024-09-13T05:11:15.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:15.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615436+0000", 2024-09-13T05:11:15.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2989999999999999e-06 2024-09-13T05:11:15.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615442+0000", 2024-09-13T05:11:15.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1200000000000001e-06 2024-09-13T05:11:15.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615445+0000", 2024-09-13T05:11:15.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6789999999999998e-06 2024-09-13T05:11:15.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.633861+0000", 2024-09-13T05:11:15.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018416218000000002 2024-09-13T05:11:15.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.633952+0000", 2024-09-13T05:11:15.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0558999999999998e-05 2024-09-13T05:11:15.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634025+0000", 2024-09-13T05:11:15.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2964000000000001e-05 2024-09-13T05:11:15.850 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.850 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.850 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.851 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58313 3.18 3:1e6e3be3:::rbd_data.112d667fb7f9.0000000000000012:19 [read 122880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:15.851 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615450+0000", 2024-09-13T05:11:15.851 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.163123456999999, 2024-09-13T05:11:15.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018740063000000001, 2024-09-13T05:11:15.851 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.851 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.851 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.851 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.851 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.851 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58313 2024-09-13T05:11:15.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.851 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615450+0000", 2024-09-13T05:11:15.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615450+0000", 2024-09-13T05:11:15.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615449+0000", 2024-09-13T05:11:15.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:15.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615455+0000", 2024-09-13T05:11:15.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2530000000000001e-06 2024-09-13T05:11:15.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615461+0000", 2024-09-13T05:11:15.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8259999999999998e-06 2024-09-13T05:11:15.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615466+0000", 2024-09-13T05:11:15.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6670000000000004e-06 2024-09-13T05:11:15.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634053+0000", 2024-09-13T05:11:15.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018586733000000001 2024-09-13T05:11:15.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634127+0000", 2024-09-13T05:11:15.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4327999999999997e-05 2024-09-13T05:11:15.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634190+0000", 2024-09-13T05:11:15.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2714999999999998e-05 2024-09-13T05:11:15.855 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.855 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.855 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.855 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58314 3.18 3:1e6e3be3:::rbd_data.112d667fb7f9.0000000000000012:19 [read 139264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:15.855 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615470+0000", 2024-09-13T05:11:15.855 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.163102619, 2024-09-13T05:11:15.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019039985999999998, 2024-09-13T05:11:15.855 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.855 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.855 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.855 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.856 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.856 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58314 2024-09-13T05:11:15.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.856 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615470+0000", 2024-09-13T05:11:15.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615470+0000", 2024-09-13T05:11:15.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615470+0000", 2024-09-13T05:11:15.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:15.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615473+0000", 2024-09-13T05:11:15.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7319999999999998e-06 2024-09-13T05:11:15.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615478+0000", 2024-09-13T05:11:15.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5899999999999998e-06 2024-09-13T05:11:15.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615483+0000", 2024-09-13T05:11:15.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5210000000000004e-06 2024-09-13T05:11:15.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634351+0000", 2024-09-13T05:11:15.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018867999 2024-09-13T05:11:15.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634446+0000", 2024-09-13T05:11:15.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5483999999999996e-05 2024-09-13T05:11:15.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634510+0000", 2024-09-13T05:11:15.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4049999999999998e-05 2024-09-13T05:11:15.859 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.859 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.859 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.859 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58315 3.18 3:1e6e3be3:::rbd_data.112d667fb7f9.0000000000000012:19 [read 155648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:15.860 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615487+0000", 2024-09-13T05:11:15.860 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.163086056999999, 2024-09-13T05:11:15.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019184718999999999, 2024-09-13T05:11:15.860 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.860 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.860 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.860 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.860 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.860 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58315 2024-09-13T05:11:15.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.861 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615487+0000", 2024-09-13T05:11:15.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615487+0000", 2024-09-13T05:11:15.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615487+0000", 2024-09-13T05:11:15.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:15.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615489+0000", 2024-09-13T05:11:15.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.469e-06 2024-09-13T05:11:15.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615495+0000", 2024-09-13T05:11:15.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4870000000000002e-06 2024-09-13T05:11:15.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615499+0000", 2024-09-13T05:11:15.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4530000000000004e-06 2024-09-13T05:11:15.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634536+0000", 2024-09-13T05:11:15.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019036507000000001 2024-09-13T05:11:15.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634610+0000", 2024-09-13T05:11:15.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4429000000000002e-05 2024-09-13T05:11:15.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634672+0000", 2024-09-13T05:11:15.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1682999999999999e-05 2024-09-13T05:11:15.864 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.864 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.864 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.864 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58316 3.18 3:1e6e3be3:::rbd_data.112d667fb7f9.0000000000000012:19 [read 172032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:15.864 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615505+0000", 2024-09-13T05:11:15.864 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.163068325999999, 2024-09-13T05:11:15.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01934669, 2024-09-13T05:11:15.865 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.865 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.865 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.865 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.865 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.865 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58316 2024-09-13T05:11:15.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.865 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615505+0000", 2024-09-13T05:11:15.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615505+0000", 2024-09-13T05:11:15.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615504+0000", 2024-09-13T05:11:15.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:15.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615507+0000", 2024-09-13T05:11:15.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7930000000000002e-06 2024-09-13T05:11:15.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615514+0000", 2024-09-13T05:11:15.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1169999999999998e-06 2024-09-13T05:11:15.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615519+0000", 2024-09-13T05:11:15.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6439999999999999e-06 2024-09-13T05:11:15.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634697+0000", 2024-09-13T05:11:15.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019177963999999999 2024-09-13T05:11:15.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634782+0000", 2024-09-13T05:11:15.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5198999999999995e-05 2024-09-13T05:11:15.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634851+0000", 2024-09-13T05:11:15.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9547000000000003e-05 2024-09-13T05:11:15.868 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.868 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.868 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.869 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58317 3.18 3:1e6e3be3:::rbd_data.112d667fb7f9.0000000000000012:19 [read 188416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:15.869 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615530+0000", 2024-09-13T05:11:15.869 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.163043371000001, 2024-09-13T05:11:15.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019487342000000001, 2024-09-13T05:11:15.869 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.869 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:15.869 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.869 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.869 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.869 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58317 2024-09-13T05:11:15.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.869 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615530+0000", 2024-09-13T05:11:15.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615530+0000", 2024-09-13T05:11:15.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615529+0000", 2024-09-13T05:11:15.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:15.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615532+0000", 2024-09-13T05:11:15.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.078e-06 2024-09-13T05:11:15.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615538+0000", 2024-09-13T05:11:15.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8799999999999996e-06 2024-09-13T05:11:15.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615543+0000", 2024-09-13T05:11:15.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1669999999999998e-06 2024-09-13T05:11:15.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634878+0000", 2024-09-13T05:11:15.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019334646 2024-09-13T05:11:15.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634954+0000", 2024-09-13T05:11:15.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6317999999999997e-05 2024-09-13T05:11:15.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.635017+0000", 2024-09-13T05:11:15.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2702999999999999e-05 2024-09-13T05:11:15.873 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.873 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.873 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.873 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:64721 3.2 3:4170fd18:::rbd_data.112d7bfe4877.0000000000000029:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-13T05:11:15.873 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:11.044325+0000", 2024-09-13T05:11:15.873 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7342485229999998, 2024-09-13T05:11:15.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.030376619000000001, 2024-09-13T05:11:15.873 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.877 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:15.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.877 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 64721 2024-09-13T05:11:15.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.877 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044325+0000", 2024-09-13T05:11:15.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044325+0000", 2024-09-13T05:11:15.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044324+0000", 2024-09-13T05:11:15.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:15.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044329+0000", 2024-09-13T05:11:15.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9009999999999999e-06 2024-09-13T05:11:15.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044343+0000", 2024-09-13T05:11:15.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3315999999999999e-05 2024-09-13T05:11:15.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044348+0000", 2024-09-13T05:11:15.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7320000000000003e-06 2024-09-13T05:11:15.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044411+0000", 2024-09-13T05:11:15.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2779000000000003e-05 2024-09-13T05:11:15.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044587+0000", 2024-09-13T05:11:15.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017561200000000001 2024-09-13T05:11:15.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:11:15.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.050936+0000", 2024-09-13T05:11:15.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006349543 2024-09-13T05:11:15.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:15.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.074487+0000", 2024-09-13T05:11:15.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023550564 2024-09-13T05:11:15.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:15.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.074506+0000", 2024-09-13T05:11:15.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9273e-05 2024-09-13T05:11:15.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:15.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.074606+0000", 2024-09-13T05:11:15.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9738e-05 2024-09-13T05:11:15.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.074701+0000", 2024-09-13T05:11:15.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.522e-05 2024-09-13T05:11:15.882 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.882 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.882 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.882 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:64754 3.1 3:85fb02f7:::rbd_data.112d7bfe4877.000000000000001c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-13T05:11:15.882 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:11.112788+0000", 2024-09-13T05:11:15.882 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.6657853649999996, 2024-09-13T05:11:15.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021038556, 2024-09-13T05:11:15.882 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.883 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:15.883 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.883 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.883 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.883 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 64754 2024-09-13T05:11:15.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.883 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112788+0000", 2024-09-13T05:11:15.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112788+0000", 2024-09-13T05:11:15.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112786+0000", 2024-09-13T05:11:15.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:15.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112797+0000", 2024-09-13T05:11:15.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1153e-05 2024-09-13T05:11:15.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112818+0000", 2024-09-13T05:11:15.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0812e-05 2024-09-13T05:11:15.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112827+0000", 2024-09-13T05:11:15.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8140000000000007e-06 2024-09-13T05:11:15.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112928+0000", 2024-09-13T05:11:15.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010168800000000001 2024-09-13T05:11:15.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.113152+0000", 2024-09-13T05:11:15.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022388599999999999 2024-09-13T05:11:15.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:11:15.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.118142+0000", 2024-09-13T05:11:15.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049900020000000003 2024-09-13T05:11:15.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:15.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.133650+0000", 2024-09-13T05:11:15.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015508020000000001 2024-09-13T05:11:15.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:15.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.133666+0000", 2024-09-13T05:11:15.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6237000000000001e-05 2024-09-13T05:11:15.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:15.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.133740+0000", 2024-09-13T05:11:15.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3254e-05 2024-09-13T05:11:15.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.133826+0000", 2024-09-13T05:11:15.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6576000000000006e-05 2024-09-13T05:11:15.888 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.888 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.888 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.888 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:65398 3.b 3:d1d66040:::rbd_data.112d8ff9b77a.0000000000000010:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-13T05:11:15.888 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:14.634623+0000", 2024-09-13T05:11:15.888 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.1439499989999999, 2024-09-13T05:11:15.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021311337, 2024-09-13T05:11:15.888 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:15.888 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:15.888 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:15.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:15.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:15.889 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65398 2024-09-13T05:11:15.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.889 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:15.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:15.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634623+0000", 2024-09-13T05:11:15.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:15.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634623+0000", 2024-09-13T05:11:15.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:15.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:15.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634622+0000", 2024-09-13T05:11:15.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:15.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:15.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634631+0000", 2024-09-13T05:11:15.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2019999999999993e-06 2024-09-13T05:11:15.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:15.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634648+0000", 2024-09-13T05:11:15.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7047000000000001e-05 2024-09-13T05:11:15.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:15.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634661+0000", 2024-09-13T05:11:15.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2828e-05 2024-09-13T05:11:15.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:15.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634727+0000", 2024-09-13T05:11:15.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6291999999999995e-05 2024-09-13T05:11:15.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:15.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634820+0000", 2024-09-13T05:11:15.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2665999999999997e-05 2024-09-13T05:11:15.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:11:15.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.639215+0000", 2024-09-13T05:11:15.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043956730000000001 2024-09-13T05:11:15.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:15.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.655864+0000", 2024-09-13T05:11:15.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016648169000000001 2024-09-13T05:11:15.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:15.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.655875+0000", 2024-09-13T05:11:15.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1289e-05 2024-09-13T05:11:15.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:15.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.655909+0000", 2024-09-13T05:11:15.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3794000000000002e-05 2024-09-13T05:11:15.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:15.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:15.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:15.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.655934+0000", 2024-09-13T05:11:15.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5749e-05 2024-09-13T05:11:15.894 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.894 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.894 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.894 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:15.894 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:15.894 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:15.896 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:11:15.896 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:11:15.896 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:11:15.897 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:15.894+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:15.910 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:11:15.929 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:11:15.951 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:11:15.975 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:11:15.997 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:15.994+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:15.998 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:11:16.015 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:16.015 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:16.021 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:11:16.023 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:11:16.023 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:11:16.023 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:11:16.023 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:11:16.023 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:11:16.024 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:11:16.024 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:11:16.024 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:11:16.027 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:11:16.098 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:16.094+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:16.131 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:16.131 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:16.141 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:11:16.199 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:16.197+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:16.246 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:16.247 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:16.256 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:11:16.300 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:16.293+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:16.335 INFO:teuthology.orchestra.run.smithi120.stdout:3180 read 0x24418d0 thru 0x24451f6 (0x3927 bytes) 2024-09-13T05:11:16.354 INFO:teuthology.orchestra.run.smithi120.stdout:3181 trunc from 0x40fe41f to 0xd11d3ab 2024-09-13T05:11:16.363 INFO:teuthology.orchestra.run.smithi120.stdout:3182 punch from 0x409fc24 to 0x40a7c7c, (0x8058 bytes) 2024-09-13T05:11:16.363 INFO:teuthology.orchestra.run.smithi120.stdout:3183 punch from 0x63415da to 0x634735b, (0x5d81 bytes) 2024-09-13T05:11:16.364 INFO:teuthology.orchestra.run.smithi120.stdout:3184 write 0x2bb958a thru 0x2bbbe90 (0x2907 bytes) 2024-09-13T05:11:16.366 INFO:teuthology.orchestra.run.smithi120.stdout:3185 read 0x45fd271 thru 0x460289a (0x562a bytes) 2024-09-13T05:11:16.367 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:16.370 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:16.370 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:16.379 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:11:16.389 INFO:teuthology.orchestra.run.smithi120.stdout:3187 trunc from 0xd11d3ab to 0x355ccf0 2024-09-13T05:11:16.400 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:16.394+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:16.420 INFO:teuthology.orchestra.run.smithi120.stdout:3188 trunc from 0x355ccf0 to 0xb39074d 2024-09-13T05:11:16.432 INFO:teuthology.orchestra.run.smithi120.stdout:3189 punch from 0x121572e to 0x121c51c, (0x6dee bytes) 2024-09-13T05:11:16.432 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:16.432 INFO:teuthology.orchestra.run.smithi120.stdout:3191 read 0x9cb3215 thru 0x9cb6393 (0x317f bytes) 2024-09-13T05:11:16.432 INFO:teuthology.orchestra.run.smithi120.stdout:3192 writesame 0x5f716a1 thru 0x5f71ce7 data_size 0x1(0x647 bytes) 2024-09-13T05:11:16.439 INFO:teuthology.orchestra.run.smithi120.stdout:3193 write 0x7722617 thru 0x77292d3 (0x6cbd bytes) 2024-09-13T05:11:16.445 INFO:teuthology.orchestra.run.smithi120.stdout:3194 writesame 0x224e9c6 thru 0x225cd01 data_size 0x2(0xe33c bytes) 2024-09-13T05:11:16.467 INFO:teuthology.orchestra.run.smithi120.stdout:3195 trunc from 0xb39074d to 0xce63e3d 2024-09-13T05:11:16.478 INFO:teuthology.orchestra.run.smithi120.stdout:3196 punch from 0x99289f2 to 0x993281c, (0x9e2a bytes) 2024-09-13T05:11:16.478 INFO:teuthology.orchestra.run.smithi120.stdout:3198 write 0x695e094 thru 0x696afb1 (0xcf1e bytes) 2024-09-13T05:11:16.488 INFO:teuthology.orchestra.run.smithi120.stdout:3199 write 0x35ac329 thru 0x35b0b5c (0x4834 bytes) 2024-09-13T05:11:16.489 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:16.489 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:16.500 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:11:16.502 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:16.497+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:16.603 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:16.601+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:16.648 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:16.648 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:16.657 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:11:16.704 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:16.698+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:16.764 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:16.764 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:16.774 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:11:16.804 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:16.798+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:16.877 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:16.877 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:16.887 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:11:16.905 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:16.905+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:17.006 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:17.002+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:17.040 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:17.040 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:17.050 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:11:17.107 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:17.105+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:17.159 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:17.159 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:17.169 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:11:17.207 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:17.201+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:17.273 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:17.273 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:17.283 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:11:17.292 INFO:tasks.thrashosds.thrasher:in_osds: [2, 3, 5, 6, 7] out_osds: [4, 1, 0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T05:11:17.292 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-13T05:11:17.324 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:17.324 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:17.317+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:17.335 INFO:teuthology.orchestra.run.smithi120.stdout:3203 trunc from 0xce63e3d to 0x7257257 2024-09-13T05:11:17.348 INFO:teuthology.orchestra.run.smithi120.stdout:3204 read 0x5a17bf thru 0x5afdd9 (0xe61b bytes) 2024-09-13T05:11:17.349 INFO:teuthology.orchestra.run.smithi120.stdout:3205 read 0x4274972 thru 0x427d7a3 (0x8e32 bytes) 2024-09-13T05:11:17.349 INFO:teuthology.orchestra.run.smithi120.stdout:3206 read 0x5b1ade6 thru 0x5b27f7e (0xd199 bytes) 2024-09-13T05:11:17.350 INFO:teuthology.orchestra.run.smithi120.stdout:3208 punch from 0x50b5571 to 0x50b572b, (0x1ba bytes) 2024-09-13T05:11:17.350 INFO:teuthology.orchestra.run.smithi120.stdout:3210 read 0x42894b9 thru 0x428e8d9 (0x5421 bytes) 2024-09-13T05:11:17.350 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:17.366 INFO:teuthology.orchestra.run.smithi120.stdout:3212 write 0x97ebabe thru 0x97f17a4 (0x5ce7 bytes) 2024-09-13T05:11:17.374 INFO:teuthology.orchestra.run.smithi120.stdout:3213 write 0x7290b34 thru 0x729b21e (0xa6eb bytes) 2024-09-13T05:11:17.391 INFO:teuthology.orchestra.run.smithi120.stdout:3214 write 0x9b0bab6 thru 0x9b19244 (0xd78f bytes) 2024-09-13T05:11:17.395 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T05:11:17.405 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:17.405 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:17.406 INFO:teuthology.orchestra.run.smithi120.stdout:3215 trunc from 0x9b19245 to 0x72be7f4 2024-09-13T05:11:17.409 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:17.405+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:17.416 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:11:17.429 INFO:teuthology.orchestra.run.smithi120.stdout:3216 write 0x36c479c thru 0x36cc78f (0x7ff4 bytes) 2024-09-13T05:11:17.431 INFO:teuthology.orchestra.run.smithi120.stdout:3217 read 0x3e00c8a thru 0x3e06abb (0x5e32 bytes) 2024-09-13T05:11:17.431 INFO:teuthology.orchestra.run.smithi120.stdout:3218 read 0x5ed529f thru 0x5ee185f (0xc5c1 bytes) 2024-09-13T05:11:17.453 INFO:teuthology.orchestra.run.smithi120.stdout:3219 write 0xe8fd19d thru 0xe9069a1 (0x9805 bytes) 2024-09-13T05:11:17.462 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:17.462 INFO:teuthology.orchestra.run.smithi120.stdout:3222 punch from 0x6956155 to 0x695a9d7, (0x4882 bytes) 2024-09-13T05:11:17.471 INFO:teuthology.orchestra.run.smithi120.stdout:3223 write 0xedd729f thru 0xeddec9e (0x7a00 bytes) 2024-09-13T05:11:17.480 INFO:teuthology.orchestra.run.smithi120.stdout:3224 write 0xb7774f thru 0xb7f872 (0x8124 bytes) 2024-09-13T05:11:17.481 INFO:teuthology.orchestra.run.smithi120.stdout:3226 write 0x8ac76f2 thru 0x8ad54fe (0xde0d bytes) 2024-09-13T05:11:17.495 INFO:teuthology.orchestra.run.smithi120.stdout:3227 trunc from 0xeddec9f to 0x996dcb8 2024-09-13T05:11:17.510 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:17.505+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:17.511 INFO:teuthology.orchestra.run.smithi120.stdout:3228 write 0x5f036ae thru 0x5f09913 (0x6266 bytes) 2024-09-13T05:11:17.518 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:17.519 INFO:teuthology.orchestra.run.smithi120.stdout:3230 write 0x8249214 thru 0x824d2ef (0x40dc bytes) 2024-09-13T05:11:17.528 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:17.528 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:17.533 INFO:teuthology.orchestra.run.smithi120.stdout:3231 write 0xa0ffe4d thru 0xa109dfd (0x9fb1 bytes) 2024-09-13T05:11:17.538 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:11:17.543 INFO:teuthology.orchestra.run.smithi120.stdout:3233 read 0x4be9483 thru 0x4bf791d (0xe49b bytes) 2024-09-13T05:11:17.548 INFO:teuthology.orchestra.run.smithi120.stdout:3235 trunc from 0xa109dfe to 0xc83be41 2024-09-13T05:11:17.557 INFO:teuthology.orchestra.run.smithi120.stdout:3237 punch from 0x5b8b834 to 0x5b8c930, (0x10fc bytes) 2024-09-13T05:11:17.570 INFO:teuthology.orchestra.run.smithi120.stdout:3238 write 0xdd3aefb thru 0xdd472c9 (0xc3cf bytes) 2024-09-13T05:11:17.590 INFO:teuthology.orchestra.run.smithi120.stdout:3240 write 0xe6b3352 thru 0xe6b63e4 (0x3093 bytes) 2024-09-13T05:11:17.595 INFO:teuthology.orchestra.run.smithi120.stdout:3241 write 0xc14cfa3 thru 0xc154793 (0x77f1 bytes) 2024-09-13T05:11:17.602 INFO:teuthology.orchestra.run.smithi120.stdout:3242 write 0x8457a69 thru 0x845ef50 (0x74e8 bytes) 2024-09-13T05:11:17.609 INFO:teuthology.orchestra.run.smithi120.stdout:3243 write 0x492bab9 thru 0x493296e (0x6eb6 bytes) 2024-09-13T05:11:17.611 INFO:teuthology.orchestra.run.smithi120.stdout:3245 punch from 0xa995fa3 to 0xa9a0d7c, (0xadd9 bytes) 2024-09-13T05:11:17.611 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:17.605+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:17.623 INFO:teuthology.orchestra.run.smithi120.stdout:3246 trunc from 0xe6b63e5 to 0x6cd573b 2024-09-13T05:11:17.651 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:17.651 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:17.662 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:11:17.666 INFO:teuthology.orchestra.run.smithi120.stdout:3247 write 0xc5e48c1 thru 0xc5f2d27 (0xe467 bytes) 2024-09-13T05:11:17.693 INFO:teuthology.orchestra.run.smithi120.stdout:3248 trunc from 0xc5f2d28 to 0x1217fbb 2024-09-13T05:11:17.712 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:17.705+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:17.728 INFO:teuthology.orchestra.run.smithi120.stdout:3252 write 0x17ddb7b thru 0x17e3452 (0x58d8 bytes) 2024-09-13T05:11:17.741 INFO:teuthology.orchestra.run.smithi120.stdout:3253 trunc from 0x17e3453 to 0x7a72194 2024-09-13T05:11:17.765 INFO:teuthology.orchestra.run.smithi120.stdout:3254 writesame 0x8d277da thru 0x8d2fae5 data_size 0x2(0x830c bytes) 2024-09-13T05:11:17.766 INFO:teuthology.orchestra.run.smithi120.stdout:3255 punch from 0x6c436f3 to 0x6c5293e, (0xf24b bytes) 2024-09-13T05:11:17.766 INFO:teuthology.orchestra.run.smithi120.stdout:3256 writesame 0x72de021 thru 0x72e90e8 data_size 0x4(0xb0c8 bytes) 2024-09-13T05:11:17.785 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:17.786 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:17.786 INFO:teuthology.orchestra.run.smithi120.stdout:3257 trunc from 0x8d2fae6 to 0xb36a57b 2024-09-13T05:11:17.796 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:11:17.798 INFO:teuthology.orchestra.run.smithi120.stdout:3258 read 0xac8c757 thru 0xac9b071 (0xe91b bytes) 2024-09-13T05:11:17.812 INFO:teuthology.orchestra.run.smithi120.stdout:3259 writesame 0xcdbb9cc thru 0xcdc2d20 data_size 0x5(0x7355 bytes) 2024-09-13T05:11:17.812 INFO:teuthology.orchestra.run.smithi120.stdout:3260 punch from 0xb70e84f to 0xb7139ec, (0x519d bytes) 2024-09-13T05:11:17.812 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:17.812 INFO:teuthology.orchestra.run.smithi120.stdout:3265 read 0xb0964cb thru 0xb09870b (0x2241 bytes) 2024-09-13T05:11:17.812 INFO:teuthology.orchestra.run.smithi120.stdout:3266 writesame 0x80b854a thru 0x80be3ef data_size 0x5(0x5ea6 bytes) 2024-09-13T05:11:17.813 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:17.810+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:17.819 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:17.820 INFO:teuthology.orchestra.run.smithi120.stdout:3268 punch from 0x83ca619 to 0x83d0bef, (0x65d6 bytes) 2024-09-13T05:11:17.820 INFO:teuthology.orchestra.run.smithi120.stdout:3269 read 0x9d9b780 thru 0x9da3bb0 (0x8431 bytes) 2024-09-13T05:11:17.820 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:17.835 INFO:teuthology.orchestra.run.smithi120.stdout:3271 write 0xe18728c thru 0xe192ca7 (0xba1c bytes) 2024-09-13T05:11:17.847 INFO:teuthology.orchestra.run.smithi120.stdout:3275 trunc from 0xe192ca8 to 0xd642616 2024-09-13T05:11:17.862 INFO:teuthology.orchestra.run.smithi120.stdout:3276 write 0x3bebd00 thru 0x3bed41a (0x171b bytes) 2024-09-13T05:11:17.867 INFO:teuthology.orchestra.run.smithi120.stdout:3279 write 0xc811690 thru 0xc81ff5a (0xe8cb bytes) 2024-09-13T05:11:17.874 INFO:teuthology.orchestra.run.smithi120.stdout:3280 writesame 0x3091cf4 thru 0x3096a01 data_size 0x7(0x4d0e bytes) 2024-09-13T05:11:17.884 INFO:teuthology.orchestra.run.smithi120.stdout:3281 trunc from 0xd642616 to 0xc3b9173 2024-09-13T05:11:17.897 INFO:teuthology.orchestra.run.smithi120.stdout:3282 read 0x61e05e7 thru 0x61eb410 (0xae2a bytes) 2024-09-13T05:11:17.897 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:17.904 INFO:teuthology.orchestra.run.smithi120.stdout:3286 trunc from 0xc3b9173 to 0x786f2c6 2024-09-13T05:11:17.910 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:17.911 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:17.915 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:17.910+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:17.921 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:11:17.926 INFO:teuthology.orchestra.run.smithi120.stdout:3287 punch from 0x25d9733 to 0x25e1cae, (0x857b bytes) 2024-09-13T05:11:17.926 INFO:teuthology.orchestra.run.smithi120.stdout:3288 read 0x76762f thru 0x76a321 (0x2cf3 bytes) 2024-09-13T05:11:17.928 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:17.947 INFO:teuthology.orchestra.run.smithi120.stdout:3291 writesame 0xc837db5 thru 0xc83a981 data_size 0x1(0x2bcd bytes) 2024-09-13T05:11:17.948 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:17.948 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:17.948 INFO:teuthology.orchestra.run.smithi120.stdout:3298 read 0x2add877 thru 0x2adf339 (0x1ac3 bytes) 2024-09-13T05:11:17.948 INFO:teuthology.orchestra.run.smithi120.stdout:3299 write 0x199463e thru 0x199c9f8 (0x83bb bytes) 2024-09-13T05:11:17.950 INFO:teuthology.orchestra.run.smithi120.stdout:3300 punch from 0x9c864d2 to 0x9c94053, (0xdb81 bytes) 2024-09-13T05:11:17.950 INFO:teuthology.orchestra.run.smithi120.stdout:3301 punch from 0x9a7838d to 0x9a7d104, (0x4d77 bytes) 2024-09-13T05:11:17.964 INFO:teuthology.orchestra.run.smithi120.stdout:3302 write 0xdcac9f0 thru 0xdcb40aa (0x76bb bytes) 2024-09-13T05:11:17.973 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:17.973 INFO:teuthology.orchestra.run.smithi120.stdout:3304 writesame 0x52bed38 thru 0x52bf877 data_size 0x28(0xb40 bytes) 2024-09-13T05:11:17.978 INFO:teuthology.orchestra.run.smithi120.stdout:3305 punch from 0x869bb2d to 0x869d99d, (0x1e70 bytes) 2024-09-13T05:11:17.979 INFO:teuthology.orchestra.run.smithi120.stdout:3306 write 0xc766d89 thru 0xc772fd4 (0xc24c bytes) 2024-09-13T05:11:17.989 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:17.989 INFO:teuthology.orchestra.run.smithi120.stdout:3308 write 0xcd743c8 thru 0xcd796a0 (0x52d9 bytes) 2024-09-13T05:11:17.994 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:17.994 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:17.995 INFO:teuthology.orchestra.run.smithi120.stdout:3311 trunc from 0xdcb40ab to 0xe59e41f 2024-09-13T05:11:18.005 INFO:teuthology.orchestra.run.smithi120.stdout:3312 punch from 0x6802331 to 0x680cd88, (0xaa57 bytes) 2024-09-13T05:11:18.006 INFO:teuthology.orchestra.run.smithi120.stdout:3313 read 0x5bca79e thru 0x5bcb370 (0xbd3 bytes) 2024-09-13T05:11:18.016 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:18.009+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:18.020 INFO:teuthology.orchestra.run.smithi120.stdout:3314 trunc from 0xe59e41f to 0x70a64e9 2024-09-13T05:11:18.036 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:11:18.038 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:18.039 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:18.043 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:18.049 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:11:18.053 INFO:teuthology.orchestra.run.smithi120.stdout:3318 trunc from 0x70a64e9 to 0xc7a2811 2024-09-13T05:11:18.065 INFO:teuthology.orchestra.run.smithi120.stdout:3319 write 0x951686f thru 0x9519ac2 (0x3254 bytes) 2024-09-13T05:11:18.072 INFO:teuthology.orchestra.run.smithi120.stdout:3320 writesame 0x38a5eb1 thru 0x38a6da1 data_size 0x11(0xef1 bytes) 2024-09-13T05:11:18.078 INFO:teuthology.orchestra.run.smithi120.stdout:3321 write 0xa2c2a12 thru 0xa2c5af1 (0x30e0 bytes) 2024-09-13T05:11:18.084 INFO:teuthology.orchestra.run.smithi120.stdout:3322 read 0x9c153c4 thru 0x9c18b1d (0x375a bytes) 2024-09-13T05:11:18.084 INFO:teuthology.orchestra.run.smithi120.stdout:3324 write 0x30070c2 thru 0x300e954 (0x7893 bytes) 2024-09-13T05:11:18.090 INFO:teuthology.orchestra.run.smithi120.stdout:3325 punch from 0x81266ef to 0x813592d, (0xf23e bytes) 2024-09-13T05:11:18.091 INFO:teuthology.orchestra.run.smithi120.stdout:3326 read 0x391cf75 thru 0x392a8cb (0xd957 bytes) 2024-09-13T05:11:18.091 INFO:teuthology.orchestra.run.smithi120.stdout:3329 punch from 0x47ff4b to 0x484952, (0x4a07 bytes) 2024-09-13T05:11:18.091 INFO:teuthology.orchestra.run.smithi120.stdout:3332 read 0xfbee4a thru 0xfcc8ef (0xdaa6 bytes) 2024-09-13T05:11:18.091 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:18.105 INFO:teuthology.orchestra.run.smithi120.stdout:3336 write 0xd9aaed2 thru 0xd9b0d2e (0x5e5d bytes) 2024-09-13T05:11:18.112 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:18.113 INFO:teuthology.orchestra.run.smithi120.stdout:3338 read 0x473a411 thru 0x4745d1a (0xb90a bytes) 2024-09-13T05:11:18.114 INFO:teuthology.orchestra.run.smithi120.stdout:3340 read 0x29fbdfa thru 0x2a0baa6 (0xfcad bytes) 2024-09-13T05:11:18.114 INFO:teuthology.orchestra.run.smithi120.stdout:3341 read 0x42afc70 thru 0x42bdf45 (0xe2d6 bytes) 2024-09-13T05:11:18.115 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:18.116 INFO:teuthology.orchestra.run.smithi120.stdout:3346 write 0xbea8751 thru 0xbeb2e82 (0xa732 bytes) 2024-09-13T05:11:18.117 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:18.114+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:18.122 INFO:teuthology.orchestra.run.smithi120.stdout:3347 read 0x825f01e thru 0x8261f51 (0x2f34 bytes) 2024-09-13T05:11:18.122 INFO:teuthology.orchestra.run.smithi120.stdout:3351 clone 26 order 18 su 65536 sc 15 2024-09-13T05:11:18.157 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:18.157 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:18.166 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:11:18.173 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:11:18.194 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:11:18.212 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:11:18.218 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:18.214+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:18.234 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:11:18.257 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:11:18.275 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:18.275 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:18.275 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:18.275 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:18.280 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:11:18.284 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:11:18.302 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:11:18.319 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:18.314+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:18.324 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:11:18.327 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:11:18.327 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:11:18.327 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:11:18.327 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:11:18.327 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:11:18.327 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:11:18.327 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:11:18.327 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:11:18.331 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.2 to 1 (10000) 2024-09-13T05:11:18.337 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is unset 2024-09-13T05:11:18.347 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-13T05:11:18.418 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:18.418 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:18.418 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:18.418 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:18.418 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:18.419 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:18.414+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:18.428 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:11:18.479 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone25 from 0xd9b0d2f (overlap 0x10c55fe) to 0x0 2024-09-13T05:11:18.520 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:18.514+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:18.540 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:18.540 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26335 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1207296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.806881035000004, 2024-09-13T05:11:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055338125000000002, 2024-09-13T05:11:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:18.541 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26335 2024-09-13T05:11:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730550+0000", 2024-09-13T05:11:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998579 2024-09-13T05:11:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730705+0000", 2024-09-13T05:11:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015463400000000001 2024-09-13T05:11:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730713+0000", 2024-09-13T05:11:18.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1580000000000005e-06 2024-09-13T05:11:18.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:18.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730719+0000", 2024-09-13T05:11:18.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2740000000000004e-06 2024-09-13T05:11:18.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:18.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.785798+0000", 2024-09-13T05:11:18.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055079454 2024-09-13T05:11:18.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:18.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.785894+0000", 2024-09-13T05:11:18.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5896000000000005e-05 2024-09-13T05:11:18.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:18.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.786030+0000", 2024-09-13T05:11:18.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013586199999999999 2024-09-13T05:11:18.545 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.545 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:18.545 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.545 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26346 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1308672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:18.545 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:18.546 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.804739628, 2024-09-13T05:11:18.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055416737000000001, 2024-09-13T05:11:18.546 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:18.546 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:18.546 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:18.546 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:18.546 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:18.546 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26346 2024-09-13T05:11:18.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.546 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:18.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:18.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:18.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:18.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:18.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:18.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732833+0000", 2024-09-13T05:11:18.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:18.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:18.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732835+0000", 2024-09-13T05:11:18.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3719999999999999e-06 2024-09-13T05:11:18.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:18.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732839+0000", 2024-09-13T05:11:18.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1520000000000001e-06 2024-09-13T05:11:18.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:18.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732842+0000", 2024-09-13T05:11:18.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.061e-06 2024-09-13T05:11:18.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:18.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788126+0000", 2024-09-13T05:11:18.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055284489999999999 2024-09-13T05:11:18.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:18.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788183+0000", 2024-09-13T05:11:18.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7127999999999999e-05 2024-09-13T05:11:18.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:18.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788250+0000", 2024-09-13T05:11:18.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7001000000000004e-05 2024-09-13T05:11:18.551 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.551 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:18.551 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.551 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26348 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 800768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:18.551 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:18.551 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.804316804000003, 2024-09-13T05:11:18.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055321395000000002, 2024-09-13T05:11:18.551 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:18.551 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:18.551 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:18.551 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:18.552 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:18.552 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26348 2024-09-13T05:11:18.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.552 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:18.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:18.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:18.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:18.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:18.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:18.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733127+0000", 2024-09-13T05:11:18.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998703 2024-09-13T05:11:18.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:18.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733262+0000", 2024-09-13T05:11:18.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013484400000000001 2024-09-13T05:11:18.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:18.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733273+0000", 2024-09-13T05:11:18.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1824000000000001e-05 2024-09-13T05:11:18.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:18.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733281+0000", 2024-09-13T05:11:18.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9999999999999996e-06 2024-09-13T05:11:18.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:18.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788431+0000", 2024-09-13T05:11:18.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055149535 2024-09-13T05:11:18.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:18.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788490+0000", 2024-09-13T05:11:18.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9413999999999997e-05 2024-09-13T05:11:18.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:18.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788578+0000", 2024-09-13T05:11:18.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7418999999999998e-05 2024-09-13T05:11:18.556 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.556 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:18.556 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.556 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26368 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 985088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:18.556 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:11:18.556 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.800164606999999, 2024-09-13T05:11:18.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055320511000000003, 2024-09-13T05:11:18.557 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:18.557 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:18.557 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:18.557 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:18.557 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:18.557 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26368 2024-09-13T05:11:18.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.557 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:18.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:18.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:11:18.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:18.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:11:18.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:18.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737408+0000", 2024-09-13T05:11:18.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:18.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:18.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737412+0000", 2024-09-13T05:11:18.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6279999999999998e-06 2024-09-13T05:11:18.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:18.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737419+0000", 2024-09-13T05:11:18.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1770000000000001e-06 2024-09-13T05:11:18.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:18.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737425+0000", 2024-09-13T05:11:18.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6949999999999997e-06 2024-09-13T05:11:18.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:18.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792507+0000", 2024-09-13T05:11:18.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055082840000000001 2024-09-13T05:11:18.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:18.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792606+0000", 2024-09-13T05:11:18.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8697999999999996e-05 2024-09-13T05:11:18.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:18.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792729+0000", 2024-09-13T05:11:18.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012298499999999999 2024-09-13T05:11:18.561 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.561 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:18.561 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.562 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26417 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 903168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:18.562 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:18.562 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.796104346999996, 2024-09-13T05:11:18.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055375191999999997, 2024-09-13T05:11:18.562 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:18.562 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:18.562 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:18.562 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:18.562 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:18.562 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26417 2024-09-13T05:11:18.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.563 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:18.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:18.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:18.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:18.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:18.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:18.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741468+0000", 2024-09-13T05:11:18.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:18.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:18.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741472+0000", 2024-09-13T05:11:18.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4139999999999998e-06 2024-09-13T05:11:18.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:18.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741478+0000", 2024-09-13T05:11:18.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5230000000000001e-06 2024-09-13T05:11:18.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:18.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741483+0000", 2024-09-13T05:11:18.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8559999999999998e-06 2024-09-13T05:11:18.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:18.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796655+0000", 2024-09-13T05:11:18.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055172153000000002 2024-09-13T05:11:18.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:18.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796738+0000", 2024-09-13T05:11:18.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2912999999999997e-05 2024-09-13T05:11:18.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:18.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796844+0000", 2024-09-13T05:11:18.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105802 2024-09-13T05:11:18.566 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.566 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:18.566 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.567 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26419 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 912384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:18.567 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:18.567 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.796080482000001, 2024-09-13T05:11:18.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055570469999999997, 2024-09-13T05:11:18.567 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:18.567 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:18.567 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:18.567 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:18.567 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:18.567 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26419 2024-09-13T05:11:18.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.568 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:18.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:18.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:18.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:18.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:18.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:18.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741492+0000", 2024-09-13T05:11:18.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:18.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:18.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741495+0000", 2024-09-13T05:11:18.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6369999999999999e-06 2024-09-13T05:11:18.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:18.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741508+0000", 2024-09-13T05:11:18.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3319000000000001e-05 2024-09-13T05:11:18.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:18.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741527+0000", 2024-09-13T05:11:18.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8542e-05 2024-09-13T05:11:18.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:18.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796871+0000", 2024-09-13T05:11:18.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055344474999999997 2024-09-13T05:11:18.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:18.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796967+0000", 2024-09-13T05:11:18.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5963000000000003e-05 2024-09-13T05:11:18.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:18.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797063+0000", 2024-09-13T05:11:18.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5909999999999995e-05 2024-09-13T05:11:18.571 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.572 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:18.572 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.572 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26421 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 921600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:18.572 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:18.572 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.796037179000002, 2024-09-13T05:11:18.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055631152000000003, 2024-09-13T05:11:18.572 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:18.572 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:18.572 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:18.573 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:18.573 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:18.573 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26421 2024-09-13T05:11:18.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.573 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:18.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:18.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:18.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:18.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:18.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:18.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741535+0000", 2024-09-13T05:11:18.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:18.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:18.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741540+0000", 2024-09-13T05:11:18.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1690000000000002e-06 2024-09-13T05:11:18.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:18.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741547+0000", 2024-09-13T05:11:18.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3409999999999997e-06 2024-09-13T05:11:18.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:18.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741552+0000", 2024-09-13T05:11:18.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5639999999999996e-06 2024-09-13T05:11:18.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:18.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797079+0000", 2024-09-13T05:11:18.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055526038999999999 2024-09-13T05:11:18.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:18.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797121+0000", 2024-09-13T05:11:18.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2156000000000001e-05 2024-09-13T05:11:18.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:18.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797167+0000", 2024-09-13T05:11:18.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6445e-05 2024-09-13T05:11:18.577 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.577 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:18.577 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.578 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26423 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 930816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:18.578 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:18.578 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.795644185999997, 2024-09-13T05:11:18.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055364370000000003, 2024-09-13T05:11:18.578 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:18.579 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:18.579 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:18.579 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:18.579 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:18.579 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26423 2024-09-13T05:11:18.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.579 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:18.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:18.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:18.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:18.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:18.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:18.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741928+0000", 2024-09-13T05:11:18.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:18.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:18.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741933+0000", 2024-09-13T05:11:18.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9980000000000003e-06 2024-09-13T05:11:18.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:18.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741945+0000", 2024-09-13T05:11:18.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1761e-05 2024-09-13T05:11:18.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741958+0000", 2024-09-13T05:11:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2604e-05 2024-09-13T05:11:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797185+0000", 2024-09-13T05:11:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055227169 2024-09-13T05:11:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797226+0000", 2024-09-13T05:11:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1619000000000003e-05 2024-09-13T05:11:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797293+0000", 2024-09-13T05:11:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6952999999999994e-05 2024-09-13T05:11:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26424 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 940032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.795607249, 2024-09-13T05:11:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055448669999999999, 2024-09-13T05:11:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26424 2024-09-13T05:11:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:18.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741965+0000", 2024-09-13T05:11:18.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:18.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741969+0000", 2024-09-13T05:11:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3440000000000001e-06 2024-09-13T05:11:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741983+0000", 2024-09-13T05:11:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4600000000000001e-05 2024-09-13T05:11:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741989+0000", 2024-09-13T05:11:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5350000000000004e-06 2024-09-13T05:11:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797319+0000", 2024-09-13T05:11:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055330121000000003 2024-09-13T05:11:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797364+0000", 2024-09-13T05:11:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5670000000000002e-05 2024-09-13T05:11:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797415+0000", 2024-09-13T05:11:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0124000000000003e-05 2024-09-13T05:11:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26426 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 949248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.795580049999998, 2024-09-13T05:11:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055639981999999998, 2024-09-13T05:11:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26426 2024-09-13T05:11:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741995+0000", 2024-09-13T05:11:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.661e-06 2024-09-13T05:11:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742004+0000", 2024-09-13T05:11:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2009999999999999e-06 2024-09-13T05:11:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742008+0000", 2024-09-13T05:11:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7890000000000002e-06 2024-09-13T05:11:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797432+0000", 2024-09-13T05:11:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055423448 2024-09-13T05:11:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797516+0000", 2024-09-13T05:11:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4404e-05 2024-09-13T05:11:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797633+0000", 2024-09-13T05:11:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116898 2024-09-13T05:11:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26427 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 958464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.795559994000001, 2024-09-13T05:11:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055829295000000001, 2024-09-13T05:11:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26427 2024-09-13T05:11:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742015+0000", 2024-09-13T05:11:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.74e-06 2024-09-13T05:11:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742023+0000", 2024-09-13T05:11:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7039999999999994e-06 2024-09-13T05:11:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742028+0000", 2024-09-13T05:11:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7369999999999997e-06 2024-09-13T05:11:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797666+0000", 2024-09-13T05:11:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055637820999999997 2024-09-13T05:11:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797748+0000", 2024-09-13T05:11:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1787999999999997e-05 2024-09-13T05:11:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797842+0000", 2024-09-13T05:11:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4903999999999998e-05 2024-09-13T05:11:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26432 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 976896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.794766832999997, 2024-09-13T05:11:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055402077000000001, 2024-09-13T05:11:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26432 2024-09-13T05:11:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742808+0000", 2024-09-13T05:11:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3319999999999999e-06 2024-09-13T05:11:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742818+0000", 2024-09-13T05:11:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5380000000000008e-06 2024-09-13T05:11:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742821+0000", 2024-09-13T05:11:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2179999999999999e-06 2024-09-13T05:11:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798027+0000", 2024-09-13T05:11:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055206344999999997 2024-09-13T05:11:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798103+0000", 2024-09-13T05:11:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5786999999999998e-05 2024-09-13T05:11:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798208+0000", 2024-09-13T05:11:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010521700000000001 2024-09-13T05:11:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26434 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 986112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.794749609, 2024-09-13T05:11:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055610109999999997, 2024-09-13T05:11:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26434 2024-09-13T05:11:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742823+0000", 2024-09-13T05:11:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742825+0000", 2024-09-13T05:11:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6220000000000001e-06 2024-09-13T05:11:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742828+0000", 2024-09-13T05:11:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.926e-06 2024-09-13T05:11:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742831+0000", 2024-09-13T05:11:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-13T05:11:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798239+0000", 2024-09-13T05:11:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055408254999999997 2024-09-13T05:11:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798326+0000", 2024-09-13T05:11:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7168000000000003e-05 2024-09-13T05:11:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798434+0000", 2024-09-13T05:11:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010767100000000001 2024-09-13T05:11:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26442 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1032192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.793480269, 2024-09-13T05:11:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055422776, 2024-09-13T05:11:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26442 2024-09-13T05:11:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744061+0000", 2024-09-13T05:11:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999685 2024-09-13T05:11:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744096+0000", 2024-09-13T05:11:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4771999999999998e-05 2024-09-13T05:11:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744147+0000", 2024-09-13T05:11:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0696999999999999e-05 2024-09-13T05:11:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744154+0000", 2024-09-13T05:11:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8510000000000001e-06 2024-09-13T05:11:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799324+0000", 2024-09-13T05:11:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055170074999999999 2024-09-13T05:11:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799415+0000", 2024-09-13T05:11:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1197000000000001e-05 2024-09-13T05:11:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799516+0000", 2024-09-13T05:11:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100666 2024-09-13T05:11:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26443 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1041408~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.793199698000002, 2024-09-13T05:11:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055344195999999998, 2024-09-13T05:11:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26443 2024-09-13T05:11:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744159+0000", 2024-09-13T05:11:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997849 2024-09-13T05:11:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744379+0000", 2024-09-13T05:11:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022024800000000001 2024-09-13T05:11:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744390+0000", 2024-09-13T05:11:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1105e-05 2024-09-13T05:11:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744397+0000", 2024-09-13T05:11:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2740000000000002e-06 2024-09-13T05:11:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799543+0000", 2024-09-13T05:11:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055145441000000003 2024-09-13T05:11:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799619+0000", 2024-09-13T05:11:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6660000000000001e-05 2024-09-13T05:11:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799718+0000", 2024-09-13T05:11:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8331000000000004e-05 2024-09-13T05:11:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26547 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1318912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.793013379999998, 2024-09-13T05:11:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055355834, 2024-09-13T05:11:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26547 2024-09-13T05:11:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744404+0000", 2024-09-13T05:11:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998441 2024-09-13T05:11:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744564+0000", 2024-09-13T05:11:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016022200000000001 2024-09-13T05:11:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744579+0000", 2024-09-13T05:11:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5036e-05 2024-09-13T05:11:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744585+0000", 2024-09-13T05:11:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7880000000000003e-06 2024-09-13T05:11:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799747+0000", 2024-09-13T05:11:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055161804000000002 2024-09-13T05:11:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799823+0000", 2024-09-13T05:11:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5956000000000003e-05 2024-09-13T05:11:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799916+0000", 2024-09-13T05:11:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2733999999999997e-05 2024-09-13T05:11:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26550 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1328128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:11:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.792757221000002, 2024-09-13T05:11:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055315941, 2024-09-13T05:11:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26550 2024-09-13T05:11:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:11:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:11:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744591+0000", 2024-09-13T05:11:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997745 2024-09-13T05:11:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744821+0000", 2024-09-13T05:11:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023031899999999999 2024-09-13T05:11:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744833+0000", 2024-09-13T05:11:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1919000000000001e-05 2024-09-13T05:11:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744837+0000", 2024-09-13T05:11:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4989999999999996e-06 2024-09-13T05:11:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799947+0000", 2024-09-13T05:11:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055110120999999998 2024-09-13T05:11:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800030+0000", 2024-09-13T05:11:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2905999999999995e-05 2024-09-13T05:11:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800132+0000", 2024-09-13T05:11:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101529 2024-09-13T05:11:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26558 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1364992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.792022213999999, 2024-09-13T05:11:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055422765999999998, 2024-09-13T05:11:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26558 2024-09-13T05:11:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745550+0000", 2024-09-13T05:11:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745553+0000", 2024-09-13T05:11:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7690000000000001e-06 2024-09-13T05:11:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745559+0000", 2024-09-13T05:11:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3149999999999997e-06 2024-09-13T05:11:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745564+0000", 2024-09-13T05:11:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6670000000000004e-06 2024-09-13T05:11:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800791+0000", 2024-09-13T05:11:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055226711999999997 2024-09-13T05:11:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800865+0000", 2024-09-13T05:11:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4344000000000005e-05 2024-09-13T05:11:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800974+0000", 2024-09-13T05:11:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108606 2024-09-13T05:11:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26561 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1374208~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.792005160999999, 2024-09-13T05:11:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055549315000000002, 2024-09-13T05:11:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26561 2024-09-13T05:11:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745570+0000", 2024-09-13T05:11:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4719999999999998e-06 2024-09-13T05:11:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745575+0000", 2024-09-13T05:11:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1900000000000003e-06 2024-09-13T05:11:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745579+0000", 2024-09-13T05:11:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3250000000000001e-06 2024-09-13T05:11:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801000+0000", 2024-09-13T05:11:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055420432999999998 2024-09-13T05:11:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801061+0000", 2024-09-13T05:11:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1427000000000007e-05 2024-09-13T05:11:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801117+0000", 2024-09-13T05:11:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5933000000000001e-05 2024-09-13T05:11:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26582 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1447936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.790587520999999, 2024-09-13T05:11:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055394301, 2024-09-13T05:11:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26582 2024-09-13T05:11:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746985+0000", 2024-09-13T05:11:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746988+0000", 2024-09-13T05:11:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6479999999999999e-06 2024-09-13T05:11:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.747000+0000", 2024-09-13T05:11:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2009e-05 2024-09-13T05:11:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.747005+0000", 2024-09-13T05:11:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0039999999999999e-06 2024-09-13T05:11:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802232+0000", 2024-09-13T05:11:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055227762999999999 2024-09-13T05:11:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802320+0000", 2024-09-13T05:11:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7576000000000003e-05 2024-09-13T05:11:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802380+0000", 2024-09-13T05:11:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9888e-05 2024-09-13T05:11:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:18.640 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:18.642 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:11:18.642 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:18.638+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:18.649 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #24, image image_client.0-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent25 2024-09-13T05:11:18.743 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:18.737+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:18.780 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:18.780 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:68364 3.1b e81/46)", 2024-09-13T05:11:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:18.779923+0000", 2024-09-13T05:11:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.3646999999999998e-05, 2024-09-13T05:11:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7151000000000002e-05, 2024-09-13T05:11:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.779923+0000", 2024-09-13T05:11:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.779923+0000", 2024-09-13T05:11:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.779922+0000", 2024-09-13T05:11:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.779928+0000", 2024-09-13T05:11:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6740000000000002e-06 2024-09-13T05:11:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.779939+0000", 2024-09-13T05:11:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1242e-05 2024-09-13T05:11:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.779944+0000", 2024-09-13T05:11:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7770000000000002e-06 2024-09-13T05:11:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:18.784 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.784 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:18.784 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:11:18.784 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 1 2024-09-13T05:11:18.784 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:18.791 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:11:18.815 INFO:teuthology.orchestra.run.smithi120.stdout:3352 writesame 0x81afdc1 thru 0x81bf886 data_size 0x1(0xfac6 bytes) 2024-09-13T05:11:18.844 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:18.838+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:18.871 INFO:teuthology.orchestra.run.smithi120.stdout:3354 read 0x84044fc thru 0x841311b (0xec20 bytes) 2024-09-13T05:11:18.871 INFO:teuthology.orchestra.run.smithi120.stdout:3355 trunc from 0xd9b0d2f to 0xd20576f 2024-09-13T05:11:18.895 INFO:teuthology.orchestra.run.smithi120.stdout:3356 read 0x3e01353 thru 0x3e016aa (0x358 bytes) 2024-09-13T05:11:18.895 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:18.895 INFO:teuthology.orchestra.run.smithi120.stdout:3359 write 0xc9a43e9 thru 0xc9a9761 (0x5379 bytes) 2024-09-13T05:11:18.900 INFO:teuthology.orchestra.run.smithi120.stdout:3361 writesame 0xc3fb701 thru 0xc3fc09c data_size 0x14(0x99c bytes) 2024-09-13T05:11:18.906 INFO:teuthology.orchestra.run.smithi120.stdout:3362 read 0x218b393 thru 0x219a25f (0xeecd bytes) 2024-09-13T05:11:18.907 INFO:teuthology.orchestra.run.smithi120.stdout:3363 writesame 0x1ea92e2 thru 0x1eb1cf3 data_size 0x56(0x8a12 bytes) 2024-09-13T05:11:18.918 INFO:teuthology.orchestra.run.smithi120.stdout:3364 read 0xb73dd03 thru 0xb74002a (0x2328 bytes) 2024-09-13T05:11:18.919 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:18.919 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:18.919 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:18.919 INFO:teuthology.orchestra.run.smithi120.stdout:3368 read 0x1ccbfa3 thru 0x1ccd004 (0x1062 bytes) 2024-09-13T05:11:18.920 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:18.920 INFO:teuthology.orchestra.run.smithi120.stdout:3371 punch from 0x281ee72 to 0x28216d7, (0x2865 bytes) 2024-09-13T05:11:18.920 INFO:teuthology.orchestra.run.smithi120.stdout:3373 read 0x5aabef9 thru 0x5aac980 (0xa88 bytes) 2024-09-13T05:11:18.921 INFO:teuthology.orchestra.run.smithi120.stdout:3374 write 0x1d4f063 thru 0x1d5069f (0x163d bytes) 2024-09-13T05:11:18.931 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:18.932 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:18.932 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:18.932 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:18.932 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:18.932 INFO:teuthology.orchestra.run.smithi120.stdout:3377 read 0x26dbfdd thru 0x26e65dd (0xa601 bytes) 2024-09-13T05:11:18.932 INFO:teuthology.orchestra.run.smithi120.stdout:3378 write 0xb94028b thru 0xb94d0f5 (0xce6b bytes) 2024-09-13T05:11:18.941 INFO:teuthology.orchestra.run.smithi120.stdout:3379 write 0xa23bde5 thru 0xa240014 (0x4230 bytes) 2024-09-13T05:11:18.942 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:11:18.944 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:18.937+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:18.947 INFO:teuthology.orchestra.run.smithi120.stdout:3380 write 0x549b7fa thru 0x54a4a62 (0x9269 bytes) 2024-09-13T05:11:18.956 INFO:teuthology.orchestra.run.smithi120.stdout:3381 read 0x508e746 thru 0x50941c4 (0x5a7f bytes) 2024-09-13T05:11:18.956 INFO:teuthology.orchestra.run.smithi120.stdout:3382 writesame 0x3181b36 thru 0x318a897 data_size 0x1(0x8d62 bytes) 2024-09-13T05:11:18.982 INFO:teuthology.orchestra.run.smithi120.stdout:3383 write 0x63831 thru 0x68186 (0x4956 bytes) 2024-09-13T05:11:18.991 INFO:teuthology.orchestra.run.smithi120.stdout:3384 write 0x42c4207 thru 0x42c9cbe (0x5ab8 bytes) 2024-09-13T05:11:19.001 INFO:teuthology.orchestra.run.smithi120.stdout:3386 punch from 0x641ee0c to 0x6422732, (0x3926 bytes) 2024-09-13T05:11:19.002 INFO:teuthology.orchestra.run.smithi120.stdout:3387 trunc from 0xd20576f to 0xcbb4e96 2024-09-13T05:11:19.045 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:19.041+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:19.050 INFO:teuthology.orchestra.run.smithi120.stdout:3388 trunc from 0xcbb4e96 to 0xb2a8885 2024-09-13T05:11:19.060 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:19.060 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:19.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:19.060 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:19.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.060 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:7961 3.18 3:184d9aea:::rbd_data.112db57f3a18.000000000000002b:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-13T05:11:19.060 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:11:19.060 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.979594460000001, 2024-09-13T05:11:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.040271084999999998, 2024-09-13T05:11:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7961 2024-09-13T05:11:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:11:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:11:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077003+0000", 2024-09-13T05:11:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077013+0000", 2024-09-13T05:11:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6870000000000006e-06 2024-09-13T05:11:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077029+0000", 2024-09-13T05:11:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6314e-05 2024-09-13T05:11:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077038+0000", 2024-09-13T05:11:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5019999999999992e-06 2024-09-13T05:11:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077099+0000", 2024-09-13T05:11:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1444000000000003e-05 2024-09-13T05:11:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077234+0000", 2024-09-13T05:11:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013461300000000001 2024-09-13T05:11:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-13T05:11:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.085202+0000", 2024-09-13T05:11:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079680140000000007 2024-09-13T05:11:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116860+0000", 2024-09-13T05:11:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.031658190000000003 2024-09-13T05:11:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116995+0000", 2024-09-13T05:11:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000135601 2024-09-13T05:11:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117152+0000", 2024-09-13T05:11:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015681700000000001 2024-09-13T05:11:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117276+0000", 2024-09-13T05:11:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012392699999999999 2024-09-13T05:11:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:8105 3.b 3:d2ae8f7b:::rbd_data.112db57f3a18.0000000000000028:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-13T05:11:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:11:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.744498653999997, 2024-09-13T05:11:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.040653913, 2024-09-13T05:11:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 8105 2024-09-13T05:11:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:11:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:11:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312099+0000", 2024-09-13T05:11:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312109+0000", 2024-09-13T05:11:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0244999999999999e-05 2024-09-13T05:11:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312129+0000", 2024-09-13T05:11:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9751000000000001e-05 2024-09-13T05:11:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312141+0000", 2024-09-13T05:11:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2201999999999999e-05 2024-09-13T05:11:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312230+0000", 2024-09-13T05:11:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9092999999999996e-05 2024-09-13T05:11:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312433+0000", 2024-09-13T05:11:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020240500000000001 2024-09-13T05:11:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-13T05:11:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.320357+0000", 2024-09-13T05:11:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079242630000000008 2024-09-13T05:11:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352488+0000", 2024-09-13T05:11:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032131588000000003 2024-09-13T05:11:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352533+0000", 2024-09-13T05:11:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4601999999999997e-05 2024-09-13T05:11:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352636+0000", 2024-09-13T05:11:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103041 2024-09-13T05:11:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352755+0000", 2024-09-13T05:11:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118814 2024-09-13T05:11:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:39305 3.1e 3:79249bf8:::rbd_data.112dcff96bbd.0000000000000003:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-13T05:11:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:41.473278+0000", 2024-09-13T05:11:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 37.583322058, 2024-09-13T05:11:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027037510000000001, 2024-09-13T05:11:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 39305 2024-09-13T05:11:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473278+0000", 2024-09-13T05:11:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473278+0000", 2024-09-13T05:11:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473276+0000", 2024-09-13T05:11:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473285+0000", 2024-09-13T05:11:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0129999999999999e-06 2024-09-13T05:11:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473304+0000", 2024-09-13T05:11:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8723e-05 2024-09-13T05:11:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473313+0000", 2024-09-13T05:11:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1419999999999999e-06 2024-09-13T05:11:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473390+0000", 2024-09-13T05:11:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7001000000000004e-05 2024-09-13T05:11:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473496+0000", 2024-09-13T05:11:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010577399999999999 2024-09-13T05:11:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:11:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.478499+0000", 2024-09-13T05:11:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050029260000000004 2024-09-13T05:11:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500153+0000", 2024-09-13T05:11:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021654421 2024-09-13T05:11:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500216+0000", 2024-09-13T05:11:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3233999999999998e-05 2024-09-13T05:11:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500273+0000", 2024-09-13T05:11:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6484000000000003e-05 2024-09-13T05:11:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500315+0000", 2024-09-13T05:11:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2342000000000002e-05 2024-09-13T05:11:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:40934 3.1 3:86cdeb48:::rbd_data.112d4ab2162d.0000000000000103:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-13T05:11:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:46.247357+0000", 2024-09-13T05:11:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.809242820000001, 2024-09-13T05:11:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028923379999999999, 2024-09-13T05:11:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 40934 2024-09-13T05:11:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247357+0000", 2024-09-13T05:11:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247357+0000", 2024-09-13T05:11:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247354+0000", 2024-09-13T05:11:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:11:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247371+0000", 2024-09-13T05:11:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6697e-05 2024-09-13T05:11:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247403+0000", 2024-09-13T05:11:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1649000000000001e-05 2024-09-13T05:11:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247417+0000", 2024-09-13T05:11:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.395e-05 2024-09-13T05:11:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247498+0000", 2024-09-13T05:11:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1011000000000001e-05 2024-09-13T05:11:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247757+0000", 2024-09-13T05:11:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000258872 2024-09-13T05:11:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:11:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.254874+0000", 2024-09-13T05:11:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071176449999999997 2024-09-13T05:11:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.275876+0000", 2024-09-13T05:11:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021001770999999999 2024-09-13T05:11:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.275989+0000", 2024-09-13T05:11:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011301199999999999 2024-09-13T05:11:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.276156+0000", 2024-09-13T05:11:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000167453 2024-09-13T05:11:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.276280+0000", 2024-09-13T05:11:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012369400000000001 2024-09-13T05:11:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:45910 3.a 3:56753852:::rbd_header.112d678e2955:head [call,call rbd.parent_overlap_get in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e58)", 2024-09-13T05:11:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:50.370028+0000", 2024-09-13T05:11:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.686572072000001, 2024-09-13T05:11:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048450024000000001, 2024-09-13T05:11:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45910 2024-09-13T05:11:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370028+0000", 2024-09-13T05:11:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370028+0000", 2024-09-13T05:11:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370027+0000", 2024-09-13T05:11:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370031+0000", 2024-09-13T05:11:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6530000000000002e-06 2024-09-13T05:11:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370038+0000", 2024-09-13T05:11:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8959999999999997e-06 2024-09-13T05:11:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370043+0000", 2024-09-13T05:11:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3680000000000004e-06 2024-09-13T05:11:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370076+0000", 2024-09-13T05:11:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3411000000000002e-05 2024-09-13T05:11:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370125+0000", 2024-09-13T05:11:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8593e-05 2024-09-13T05:11:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.418478+0000", 2024-09-13T05:11:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048352978999999997 2024-09-13T05:11:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:56276 3.1 3:8275684a:::rbd_data.112d667fb7f9.000000000000008f:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-13T05:11:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:04.698605+0000", 2024-09-13T05:11:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.357994356000001, 2024-09-13T05:11:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024657968999999998, 2024-09-13T05:11:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 56276 2024-09-13T05:11:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698605+0000", 2024-09-13T05:11:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698605+0000", 2024-09-13T05:11:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698602+0000", 2024-09-13T05:11:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999971 2024-09-13T05:11:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698621+0000", 2024-09-13T05:11:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8783e-05 2024-09-13T05:11:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698667+0000", 2024-09-13T05:11:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5509000000000001e-05 2024-09-13T05:11:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698684+0000", 2024-09-13T05:11:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7799999999999999e-05 2024-09-13T05:11:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698782+0000", 2024-09-13T05:11:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7534000000000005e-05 2024-09-13T05:11:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698905+0000", 2024-09-13T05:11:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012293699999999999 2024-09-13T05:11:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:11:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.707711+0000", 2024-09-13T05:11:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088062939999999992 2024-09-13T05:11:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.723142+0000", 2024-09-13T05:11:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015430413 2024-09-13T05:11:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.723156+0000", 2024-09-13T05:11:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4868999999999999e-05 2024-09-13T05:11:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.723214+0000", 2024-09-13T05:11:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7522000000000003e-05 2024-09-13T05:11:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.723263+0000", 2024-09-13T05:11:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9261999999999997e-05 2024-09-13T05:11:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:56368 3.1e 3:7d682469:::rbd_data.112d667fb7f9.0000000000000065:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-13T05:11:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:04.786960+0000", 2024-09-13T05:11:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.269639829000001, 2024-09-13T05:11:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027546363000000001, 2024-09-13T05:11:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 56368 2024-09-13T05:11:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786960+0000", 2024-09-13T05:11:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786960+0000", 2024-09-13T05:11:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786959+0000", 2024-09-13T05:11:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786967+0000", 2024-09-13T05:11:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6249999999999996e-06 2024-09-13T05:11:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786979+0000", 2024-09-13T05:11:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1982e-05 2024-09-13T05:11:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786986+0000", 2024-09-13T05:11:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.126e-06 2024-09-13T05:11:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.787039+0000", 2024-09-13T05:11:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2431e-05 2024-09-13T05:11:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.787180+0000", 2024-09-13T05:11:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014091 2024-09-13T05:11:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:11:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.793251+0000", 2024-09-13T05:11:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060717419999999998 2024-09-13T05:11:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.814381+0000", 2024-09-13T05:11:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021129267 2024-09-13T05:11:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:19.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.814430+0000", 2024-09-13T05:11:19.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8952000000000002e-05 2024-09-13T05:11:19.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.814476+0000", 2024-09-13T05:11:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6223000000000001e-05 2024-09-13T05:11:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.814506+0000", 2024-09-13T05:11:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0287999999999999e-05 2024-09-13T05:11:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58069 3.2 3:45c87af8:::rbd_data.112d667fb7f9.0000000000000009:19 [read 253952~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.607725+0000", 2024-09-13T05:11:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.448874374000001, 2024-09-13T05:11:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016895331999999999, 2024-09-13T05:11:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58069 2024-09-13T05:11:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.607725+0000", 2024-09-13T05:11:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.607725+0000", 2024-09-13T05:11:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.607725+0000", 2024-09-13T05:11:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.607727+0000", 2024-09-13T05:11:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6440000000000001e-06 2024-09-13T05:11:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.607730+0000", 2024-09-13T05:11:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0419999999999998e-06 2024-09-13T05:11:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.607733+0000", 2024-09-13T05:11:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.044e-06 2024-09-13T05:11:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.624316+0000", 2024-09-13T05:11:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016583764000000001 2024-09-13T05:11:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.624362+0000", 2024-09-13T05:11:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5951000000000001e-05 2024-09-13T05:11:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.624621+0000", 2024-09-13T05:11:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025811600000000002 2024-09-13T05:11:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58307 3.18 3:1e8eca72:::rbd_data.112d667fb7f9.0000000000000010:19 [read 221184~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615299+0000", 2024-09-13T05:11:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.441300459000001, 2024-09-13T05:11:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018495981000000002, 2024-09-13T05:11:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58307 2024-09-13T05:11:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615299+0000", 2024-09-13T05:11:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615299+0000", 2024-09-13T05:11:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615299+0000", 2024-09-13T05:11:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615301+0000", 2024-09-13T05:11:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5009999999999999e-06 2024-09-13T05:11:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615307+0000", 2024-09-13T05:11:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9100000000000002e-06 2024-09-13T05:11:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615312+0000", 2024-09-13T05:11:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0350000000000001e-06 2024-09-13T05:11:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.631195+0000", 2024-09-13T05:11:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015883044999999998 2024-09-13T05:11:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.631309+0000", 2024-09-13T05:11:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113585 2024-09-13T05:11:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.633795+0000", 2024-09-13T05:11:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024862679999999998 2024-09-13T05:11:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.112 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58312 3.18 3:1e6e3be3:::rbd_data.112d667fb7f9.0000000000000012:19 [read 106496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:19.112 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615434+0000", 2024-09-13T05:11:19.112 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.441165093, 2024-09-13T05:11:19.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018590530000000001, 2024-09-13T05:11:19.112 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:19.112 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:19.112 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:19.112 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:19.112 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.112 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58312 2024-09-13T05:11:19.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.112 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615434+0000", 2024-09-13T05:11:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615434+0000", 2024-09-13T05:11:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615434+0000", 2024-09-13T05:11:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615436+0000", 2024-09-13T05:11:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2989999999999999e-06 2024-09-13T05:11:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615442+0000", 2024-09-13T05:11:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1200000000000001e-06 2024-09-13T05:11:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615445+0000", 2024-09-13T05:11:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6789999999999998e-06 2024-09-13T05:11:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.633861+0000", 2024-09-13T05:11:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018416218000000002 2024-09-13T05:11:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.633952+0000", 2024-09-13T05:11:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0558999999999998e-05 2024-09-13T05:11:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634025+0000", 2024-09-13T05:11:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2964000000000001e-05 2024-09-13T05:11:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58313 3.18 3:1e6e3be3:::rbd_data.112d667fb7f9.0000000000000012:19 [read 122880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615450+0000", 2024-09-13T05:11:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.441149952, 2024-09-13T05:11:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018740063000000001, 2024-09-13T05:11:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58313 2024-09-13T05:11:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615450+0000", 2024-09-13T05:11:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615450+0000", 2024-09-13T05:11:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615449+0000", 2024-09-13T05:11:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615455+0000", 2024-09-13T05:11:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2530000000000001e-06 2024-09-13T05:11:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615461+0000", 2024-09-13T05:11:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8259999999999998e-06 2024-09-13T05:11:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615466+0000", 2024-09-13T05:11:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6670000000000004e-06 2024-09-13T05:11:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634053+0000", 2024-09-13T05:11:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018586733000000001 2024-09-13T05:11:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634127+0000", 2024-09-13T05:11:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4327999999999997e-05 2024-09-13T05:11:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634190+0000", 2024-09-13T05:11:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2714999999999998e-05 2024-09-13T05:11:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58314 3.18 3:1e6e3be3:::rbd_data.112d667fb7f9.0000000000000012:19 [read 139264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615470+0000", 2024-09-13T05:11:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.441129114000001, 2024-09-13T05:11:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019039985999999998, 2024-09-13T05:11:19.121 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:19.121 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:19.121 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:19.121 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:19.121 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.121 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58314 2024-09-13T05:11:19.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.121 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:19.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615470+0000", 2024-09-13T05:11:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615470+0000", 2024-09-13T05:11:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615470+0000", 2024-09-13T05:11:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615473+0000", 2024-09-13T05:11:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7319999999999998e-06 2024-09-13T05:11:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615478+0000", 2024-09-13T05:11:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5899999999999998e-06 2024-09-13T05:11:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615483+0000", 2024-09-13T05:11:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5210000000000004e-06 2024-09-13T05:11:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634351+0000", 2024-09-13T05:11:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018867999 2024-09-13T05:11:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634446+0000", 2024-09-13T05:11:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5483999999999996e-05 2024-09-13T05:11:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634510+0000", 2024-09-13T05:11:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4049999999999998e-05 2024-09-13T05:11:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58315 3.18 3:1e6e3be3:::rbd_data.112d667fb7f9.0000000000000012:19 [read 155648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615487+0000", 2024-09-13T05:11:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.441112552, 2024-09-13T05:11:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019184718999999999, 2024-09-13T05:11:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58315 2024-09-13T05:11:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615487+0000", 2024-09-13T05:11:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615487+0000", 2024-09-13T05:11:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615487+0000", 2024-09-13T05:11:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615489+0000", 2024-09-13T05:11:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.469e-06 2024-09-13T05:11:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615495+0000", 2024-09-13T05:11:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4870000000000002e-06 2024-09-13T05:11:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615499+0000", 2024-09-13T05:11:19.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4530000000000004e-06 2024-09-13T05:11:19.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:19.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634536+0000", 2024-09-13T05:11:19.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019036507000000001 2024-09-13T05:11:19.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:19.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634610+0000", 2024-09-13T05:11:19.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4429000000000002e-05 2024-09-13T05:11:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634672+0000", 2024-09-13T05:11:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1682999999999999e-05 2024-09-13T05:11:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58316 3.18 3:1e6e3be3:::rbd_data.112d667fb7f9.0000000000000012:19 [read 172032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615505+0000", 2024-09-13T05:11:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.441094821, 2024-09-13T05:11:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01934669, 2024-09-13T05:11:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58316 2024-09-13T05:11:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615505+0000", 2024-09-13T05:11:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615505+0000", 2024-09-13T05:11:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615504+0000", 2024-09-13T05:11:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615507+0000", 2024-09-13T05:11:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7930000000000002e-06 2024-09-13T05:11:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615514+0000", 2024-09-13T05:11:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1169999999999998e-06 2024-09-13T05:11:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615519+0000", 2024-09-13T05:11:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6439999999999999e-06 2024-09-13T05:11:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634697+0000", 2024-09-13T05:11:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019177963999999999 2024-09-13T05:11:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634782+0000", 2024-09-13T05:11:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5198999999999995e-05 2024-09-13T05:11:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634851+0000", 2024-09-13T05:11:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9547000000000003e-05 2024-09-13T05:11:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58317 3.18 3:1e6e3be3:::rbd_data.112d667fb7f9.0000000000000012:19 [read 188416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615530+0000", 2024-09-13T05:11:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.441069865999999, 2024-09-13T05:11:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019487342000000001, 2024-09-13T05:11:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58317 2024-09-13T05:11:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615530+0000", 2024-09-13T05:11:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615530+0000", 2024-09-13T05:11:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615529+0000", 2024-09-13T05:11:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615532+0000", 2024-09-13T05:11:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.078e-06 2024-09-13T05:11:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615538+0000", 2024-09-13T05:11:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8799999999999996e-06 2024-09-13T05:11:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615543+0000", 2024-09-13T05:11:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1669999999999998e-06 2024-09-13T05:11:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634878+0000", 2024-09-13T05:11:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019334646 2024-09-13T05:11:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634954+0000", 2024-09-13T05:11:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6317999999999997e-05 2024-09-13T05:11:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.635017+0000", 2024-09-13T05:11:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2702999999999999e-05 2024-09-13T05:11:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.138 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:19.138 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.138 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:64721 3.2 3:4170fd18:::rbd_data.112d7bfe4877.0000000000000029:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-13T05:11:19.138 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:11.044325+0000", 2024-09-13T05:11:19.138 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.0122750180000004, 2024-09-13T05:11:19.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.030376619000000001, 2024-09-13T05:11:19.138 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:19.138 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:19.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:19.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:19.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.139 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 64721 2024-09-13T05:11:19.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.139 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:19.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:19.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044325+0000", 2024-09-13T05:11:19.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044325+0000", 2024-09-13T05:11:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044324+0000", 2024-09-13T05:11:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044329+0000", 2024-09-13T05:11:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9009999999999999e-06 2024-09-13T05:11:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044343+0000", 2024-09-13T05:11:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3315999999999999e-05 2024-09-13T05:11:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044348+0000", 2024-09-13T05:11:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7320000000000003e-06 2024-09-13T05:11:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044411+0000", 2024-09-13T05:11:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2779000000000003e-05 2024-09-13T05:11:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044587+0000", 2024-09-13T05:11:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017561200000000001 2024-09-13T05:11:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:11:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.050936+0000", 2024-09-13T05:11:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006349543 2024-09-13T05:11:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.074487+0000", 2024-09-13T05:11:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023550564 2024-09-13T05:11:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.074506+0000", 2024-09-13T05:11:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9273e-05 2024-09-13T05:11:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.074606+0000", 2024-09-13T05:11:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9738e-05 2024-09-13T05:11:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.074701+0000", 2024-09-13T05:11:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.522e-05 2024-09-13T05:11:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:64754 3.1 3:85fb02f7:::rbd_data.112d7bfe4877.000000000000001c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-13T05:11:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:11.112788+0000", 2024-09-13T05:11:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.9438118600000003, 2024-09-13T05:11:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021038556, 2024-09-13T05:11:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 64754 2024-09-13T05:11:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112788+0000", 2024-09-13T05:11:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112788+0000", 2024-09-13T05:11:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:19.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112786+0000", 2024-09-13T05:11:19.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:19.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:19.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112797+0000", 2024-09-13T05:11:19.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1153e-05 2024-09-13T05:11:19.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:19.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112818+0000", 2024-09-13T05:11:19.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0812e-05 2024-09-13T05:11:19.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112827+0000", 2024-09-13T05:11:19.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8140000000000007e-06 2024-09-13T05:11:19.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:19.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112928+0000", 2024-09-13T05:11:19.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010168800000000001 2024-09-13T05:11:19.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:19.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.113152+0000", 2024-09-13T05:11:19.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022388599999999999 2024-09-13T05:11:19.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:11:19.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.118142+0000", 2024-09-13T05:11:19.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049900020000000003 2024-09-13T05:11:19.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:19.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.133650+0000", 2024-09-13T05:11:19.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015508020000000001 2024-09-13T05:11:19.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:19.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.133666+0000", 2024-09-13T05:11:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6237000000000001e-05 2024-09-13T05:11:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.133740+0000", 2024-09-13T05:11:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3254e-05 2024-09-13T05:11:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.133826+0000", 2024-09-13T05:11:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6576000000000006e-05 2024-09-13T05:11:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:65398 3.b 3:d1d66040:::rbd_data.112d8ff9b77a.0000000000000010:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-13T05:11:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:14.634623+0000", 2024-09-13T05:11:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.4219764939999999, 2024-09-13T05:11:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021311337, 2024-09-13T05:11:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65398 2024-09-13T05:11:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:19.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634623+0000", 2024-09-13T05:11:19.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:19.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634623+0000", 2024-09-13T05:11:19.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:19.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634622+0000", 2024-09-13T05:11:19.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:19.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:19.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634631+0000", 2024-09-13T05:11:19.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2019999999999993e-06 2024-09-13T05:11:19.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:19.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634648+0000", 2024-09-13T05:11:19.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7047000000000001e-05 2024-09-13T05:11:19.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634661+0000", 2024-09-13T05:11:19.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2828e-05 2024-09-13T05:11:19.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:19.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634727+0000", 2024-09-13T05:11:19.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6291999999999995e-05 2024-09-13T05:11:19.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:19.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634820+0000", 2024-09-13T05:11:19.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2665999999999997e-05 2024-09-13T05:11:19.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:11:19.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.639215+0000", 2024-09-13T05:11:19.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043956730000000001 2024-09-13T05:11:19.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:19.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.655864+0000", 2024-09-13T05:11:19.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016648169000000001 2024-09-13T05:11:19.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:19.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.655875+0000", 2024-09-13T05:11:19.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1289e-05 2024-09-13T05:11:19.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:19.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.655909+0000", 2024-09-13T05:11:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3794000000000002e-05 2024-09-13T05:11:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.655934+0000", 2024-09-13T05:11:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5749e-05 2024-09-13T05:11:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:66867 3.b 3:d5613bfd:::rbd_data.112d8ff9b77a.0000000000000003:head [stat,delete] snapc 1d=[1d] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-13T05:11:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:18.482131+0000", 2024-09-13T05:11:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.57446892100000002, 2024-09-13T05:11:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020547362999999999, 2024-09-13T05:11:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66867 2024-09-13T05:11:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482131+0000", 2024-09-13T05:11:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482131+0000", 2024-09-13T05:11:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482129+0000", 2024-09-13T05:11:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482139+0000", 2024-09-13T05:11:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5489999999999995e-06 2024-09-13T05:11:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482167+0000", 2024-09-13T05:11:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7713e-05 2024-09-13T05:11:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482179+0000", 2024-09-13T05:11:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2631e-05 2024-09-13T05:11:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482318+0000", 2024-09-13T05:11:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013872 2024-09-13T05:11:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482492+0000", 2024-09-13T05:11:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017404200000000001 2024-09-13T05:11:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:11:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482879+0000", 2024-09-13T05:11:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038729999999999998 2024-09-13T05:11:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.487409+0000", 2024-09-13T05:11:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045295200000000004 2024-09-13T05:11:19.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:19.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.502507+0000", 2024-09-13T05:11:19.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015098555 2024-09-13T05:11:19.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:19.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.502569+0000", 2024-09-13T05:11:19.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1648000000000003e-05 2024-09-13T05:11:19.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:19.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.502678+0000", 2024-09-13T05:11:19.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109042 2024-09-13T05:11:19.161 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.161 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:19.161 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.161 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:67286 3.1e 3:7bbcd3a2:::rbd_data.112d89f9378d.0000000000000002:1b [read 1540096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-13T05:11:19.161 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:18.684855+0000", 2024-09-13T05:11:19.161 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.37174481199999998, 2024-09-13T05:11:19.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017131753, 2024-09-13T05:11:19.161 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:19.161 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:19.161 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:19.161 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67286 2024-09-13T05:11:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.684855+0000", 2024-09-13T05:11:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.684855+0000", 2024-09-13T05:11:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.684854+0000", 2024-09-13T05:11:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.684857+0000", 2024-09-13T05:11:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7030000000000002e-06 2024-09-13T05:11:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.684863+0000", 2024-09-13T05:11:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7790000000000001e-06 2024-09-13T05:11:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.684868+0000", 2024-09-13T05:11:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6070000000000001e-06 2024-09-13T05:11:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.696725+0000", 2024-09-13T05:11:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011857384 2024-09-13T05:11:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.697046+0000", 2024-09-13T05:11:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032122500000000002 2024-09-13T05:11:19.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:19.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:19.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:19.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.701987+0000", 2024-09-13T05:11:19.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004940402 2024-09-13T05:11:19.165 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.165 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:19.165 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.165 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:19.165 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:19.165 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:19.167 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:11:19.168 INFO:teuthology.orchestra.run.smithi120.stdout:3389 writesame 0xbdc314c thru 0xbdc5ac2 data_size 0xb(0x2977 bytes) 2024-09-13T05:11:19.168 INFO:teuthology.orchestra.run.smithi120.stdout:3390 trunc from 0xbdc5ac3 to 0xc9f365c 2024-09-13T05:11:19.168 INFO:teuthology.orchestra.run.smithi120.stdout:3391 write 0x1ccbc39 thru 0x1ccdbbf (0x1f87 bytes) 2024-09-13T05:11:19.168 INFO:teuthology.orchestra.run.smithi120.stdout:3393 read 0x4e219e thru 0x4e59f0 (0x3853 bytes) 2024-09-13T05:11:19.169 INFO:teuthology.orchestra.run.smithi120.stdout:3394 read 0x4bb391f thru 0x4bbdd83 (0xa465 bytes) 2024-09-13T05:11:19.169 INFO:teuthology.orchestra.run.smithi120.stdout:3395 read 0x59f009 thru 0x5a3b27 (0x4b1f bytes) 2024-09-13T05:11:19.169 INFO:teuthology.orchestra.run.smithi120.stdout:3396 read 0xdf1a4d thru 0xdfea1a (0xcfce bytes) 2024-09-13T05:11:19.169 INFO:teuthology.orchestra.run.smithi120.stdout:3397 read 0x862f803 thru 0x863bc6e (0xc46c bytes) 2024-09-13T05:11:19.169 INFO:teuthology.orchestra.run.smithi120.stdout:3398 writesame 0xc137b5b thru 0xc13f7a6 data_size 0x56(0x7c4c bytes) 2024-09-13T05:11:19.169 INFO:teuthology.orchestra.run.smithi120.stdout:3399 writesame 0x6b367ee thru 0x6b3d9b7 data_size 0xf(0x71ca bytes) 2024-09-13T05:11:19.169 INFO:teuthology.orchestra.run.smithi120.stdout:3400 punch from 0x3095b51 to 0x30a36a7, (0xdb56 bytes) 2024-09-13T05:11:19.169 INFO:teuthology.orchestra.run.smithi120.stdout:3401 write 0x9e6d2cc thru 0x9e7aa57 (0xd78c bytes) 2024-09-13T05:11:19.169 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:19.169 INFO:teuthology.orchestra.run.smithi120.stdout:3404 write 0x1ccd168 thru 0x1cd3fcd (0x6e66 bytes) 2024-09-13T05:11:19.169 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:19.161+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:19.170 INFO:teuthology.orchestra.run.smithi120.stdout:3405 read 0x95f55f4 thru 0x95f9474 (0x3e81 bytes) 2024-09-13T05:11:19.170 INFO:teuthology.orchestra.run.smithi120.stdout:3407 punch from 0x71f1690 to 0x71fc9d8, (0xb348 bytes) 2024-09-13T05:11:19.171 INFO:teuthology.orchestra.run.smithi120.stdout:3408 punch from 0x946fced to 0x947df10, (0xe223 bytes) 2024-09-13T05:11:19.171 INFO:teuthology.orchestra.run.smithi120.stdout:3411 punch from 0xa55fae1 to 0xa5601d8, (0x6f7 bytes) 2024-09-13T05:11:19.171 INFO:teuthology.orchestra.run.smithi120.stdout:3412 punch from 0x27bf6aa to 0x27bf801, (0x157 bytes) 2024-09-13T05:11:19.171 INFO:teuthology.orchestra.run.smithi120.stdout:3413 read 0x8fd7b26 thru 0x8fd9f23 (0x23fe bytes) 2024-09-13T05:11:19.171 INFO:teuthology.orchestra.run.smithi120.stdout:3414 punch from 0x6c48162 to 0x6c53684, (0xb522 bytes) 2024-09-13T05:11:19.171 INFO:teuthology.orchestra.run.smithi120.stdout:3415 read 0x4df9ee5 thru 0x4e0573d (0xb859 bytes) 2024-09-13T05:11:19.172 INFO:teuthology.orchestra.run.smithi120.stdout:3416 write 0x2763727 thru 0x2772b1f (0xf3f9 bytes) 2024-09-13T05:11:19.186 INFO:teuthology.orchestra.run.smithi120.stdout:3417 writesame 0x370a4f2 thru 0x3719da5 data_size 0x16(0xf8b4 bytes) 2024-09-13T05:11:19.194 INFO:teuthology.orchestra.run.smithi120.stdout:3418 read 0x76324ed thru 0x76333fa (0xf0e bytes) 2024-09-13T05:11:19.194 INFO:teuthology.orchestra.run.smithi120.stdout:3419 writesame 0x426f65c thru 0x4270838 data_size 0x1(0x11dd bytes) 2024-09-13T05:11:19.205 INFO:teuthology.orchestra.run.smithi120.stdout:3420 write 0x8e9750a thru 0x8ea3dd7 (0xc8ce bytes) 2024-09-13T05:11:19.212 INFO:teuthology.orchestra.run.smithi120.stdout:3421 read 0x5e2e70b thru 0x5e2f93c (0x1232 bytes) 2024-09-13T05:11:19.213 INFO:teuthology.orchestra.run.smithi120.stdout:3423 read 0xa3e523a thru 0xa3e94ba (0x4281 bytes) 2024-09-13T05:11:19.214 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:19.231 INFO:teuthology.orchestra.run.smithi120.stdout:3425 trunc from 0xc9f365c to 0x4ed9560 2024-09-13T05:11:19.268 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:19.262+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:19.283 INFO:teuthology.orchestra.run.smithi120.stdout:3426 write 0x7e2487f thru 0x7e33505 (0xec87 bytes) 2024-09-13T05:11:19.288 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:19.288 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:19.288 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:11:19.288 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:19.290 INFO:teuthology.orchestra.run.smithi120.stdout:3428 read 0x55a1e95 thru 0x55a7afd (0x5c69 bytes) 2024-09-13T05:11:19.291 INFO:teuthology.orchestra.run.smithi120.stdout:3432 punch from 0x2124076 to 0x212ab39, (0x6ac3 bytes) 2024-09-13T05:11:19.291 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:19.291 INFO:teuthology.orchestra.run.smithi120.stdout:3434 punch from 0x1bc78b7 to 0x1bcf265, (0x79ae bytes) 2024-09-13T05:11:19.291 INFO:teuthology.orchestra.run.smithi120.stdout:3436 write 0x1c21bc6 thru 0x1c24891 (0x2ccc bytes) 2024-09-13T05:11:19.297 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:19.298 INFO:teuthology.orchestra.run.smithi120.stdout:3438 read 0x4749579 thru 0x474c64c (0x30d4 bytes) 2024-09-13T05:11:19.298 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:19.300 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:11:19.324 INFO:teuthology.orchestra.run.smithi120.stdout:3442 write 0xd2b6144 thru 0xd2bf886 (0x9743 bytes) 2024-09-13T05:11:19.332 INFO:teuthology.orchestra.run.smithi120.stdout:3443 writesame 0xccf8bc8 thru 0xcd05a30 data_size 0x1(0xce69 bytes) 2024-09-13T05:11:19.340 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.3 to 1 (10000) 2024-09-13T05:11:19.357 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-13T05:11:19.361 INFO:teuthology.orchestra.run.smithi120.stdout:3444 punch from 0x15920f1 to 0x1592538, (0x447 bytes) 2024-09-13T05:11:19.362 INFO:teuthology.orchestra.run.smithi120.stdout:3446 punch from 0x6db0ee8 to 0x6db5f34, (0x504c bytes) 2024-09-13T05:11:19.362 INFO:teuthology.orchestra.run.smithi120.stdout:3448 punch from 0x4af8c47 to 0x4afdf40, (0x52f9 bytes) 2024-09-13T05:11:19.362 INFO:teuthology.orchestra.run.smithi120.stdout:3449 punch from 0x66312aa to 0x663d19d, (0xbef3 bytes) 2024-09-13T05:11:19.369 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:19.362+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:19.380 INFO:teuthology.orchestra.run.smithi120.stdout:3450 trunc from 0xd2bf887 to 0x330cc1b 2024-09-13T05:11:19.410 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:19.410 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:19.410 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:19.410 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:19.410 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:19.420 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:11:19.422 INFO:teuthology.orchestra.run.smithi120.stdout:3451 punch from 0x7d300b to 0x7de6e7, (0xb6dc bytes) 2024-09-13T05:11:19.422 INFO:teuthology.orchestra.run.smithi120.stdout:3456 read 0xeb8064 thru 0xeb80e3 (0x80 bytes) 2024-09-13T05:11:19.433 INFO:teuthology.orchestra.run.smithi120.stdout:3457 trunc from 0x330cc1b to 0x92e4dd1 2024-09-13T05:11:19.441 INFO:teuthology.orchestra.run.smithi120.stdout:3458 read 0x511ca6b thru 0x5129236 (0xc7cc bytes) 2024-09-13T05:11:19.441 INFO:teuthology.orchestra.run.smithi120.stdout:3459 writesame 0x44b63cd thru 0x44b82a2 data_size 0x1(0x1ed6 bytes) 2024-09-13T05:11:19.463 INFO:teuthology.orchestra.run.smithi120.stdout:3460 trunc from 0x92e4dd1 to 0x26ca76c 2024-09-13T05:11:19.469 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:19.465+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:19.529 INFO:teuthology.orchestra.run.smithi120.stdout:3461 writesame 0x7744edb thru 0x774fc20 data_size 0x3(0xad46 bytes) 2024-09-13T05:11:19.548 INFO:teuthology.orchestra.run.smithi120.stdout:3462 writesame 0xc406e9e thru 0xc411667 data_size 0x3(0xa7ca bytes) 2024-09-13T05:11:19.549 INFO:teuthology.orchestra.run.smithi120.stdout:3463 read 0x6f675ac thru 0x6f7105f (0x9ab4 bytes) 2024-09-13T05:11:19.561 INFO:teuthology.orchestra.run.smithi120.stdout:3464 trunc from 0xc411668 to 0x3a94960 2024-09-13T05:11:19.568 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:19.568 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:19.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:19.568 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [] 2024-09-13T05:11:19.568 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:19.570 INFO:teuthology.orchestra.run.smithi120.stdout:3467 read 0x28516a thru 0x288126 (0x2fbd bytes) 2024-09-13T05:11:19.570 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:19.566+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:19.576 INFO:teuthology.orchestra.run.smithi120.stdout:3468 trunc from 0x3a94960 to 0xee5324 2024-09-13T05:11:19.579 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:11:19.629 INFO:teuthology.orchestra.run.smithi120.stdout:3469 write 0x826d47f thru 0x827af68 (0xdaea bytes) 2024-09-13T05:11:19.639 INFO:teuthology.orchestra.run.smithi120.stdout:3470 trunc from 0x827af69 to 0x6931e81 2024-09-13T05:11:19.657 INFO:teuthology.orchestra.run.smithi120.stdout:3471 read 0x1dc5e2b thru 0x1dc780a (0x19e0 bytes) 2024-09-13T05:11:19.657 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:19.657 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:19.670 INFO:teuthology.orchestra.run.smithi120.stdout:3474 write 0x7886a97 thru 0x788a8f5 (0x3e5f bytes) 2024-09-13T05:11:19.671 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:19.666+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:19.676 INFO:teuthology.orchestra.run.smithi120.stdout:3475 clone 27 order 22 su 524288 sc 14 2024-09-13T05:11:19.685 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:19.685 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:19.685 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:11:19.685 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:19.696 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:11:19.772 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:19.769+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:19.853 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:19.854 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:19.854 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:19.854 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:19.854 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:19.863 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:11:19.873 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:19.869+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:19.969 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:19.969 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:19.969 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:19.969 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:19.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.970 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47582 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15826944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:19.970 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.439939+0000", 2024-09-13T05:11:19.970 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.527094159000001, 2024-09-13T05:11:19.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032266203, 2024-09-13T05:11:19.970 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:19.970 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:19.970 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:19.970 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:19.970 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.970 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47582 2024-09-13T05:11:19.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.970 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:19.970 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:19.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439939+0000", 2024-09-13T05:11:19.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:19.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.971 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.971 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:19.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439939+0000", 2024-09-13T05:11:19.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:19.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.971 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.971 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:19.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439939+0000", 2024-09-13T05:11:19.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:19.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.971 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.972 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:19.972 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439949+0000", 2024-09-13T05:11:19.972 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0906e-05 2024-09-13T05:11:19.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.972 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.972 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:19.972 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439962+0000", 2024-09-13T05:11:19.972 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2373e-05 2024-09-13T05:11:19.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.972 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.972 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.972 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439969+0000", 2024-09-13T05:11:19.972 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0570000000000004e-06 2024-09-13T05:11:19.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.973 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:19.973 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.471645+0000", 2024-09-13T05:11:19.973 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031676530000000001 2024-09-13T05:11:19.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.973 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:19.973 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.471775+0000", 2024-09-13T05:11:19.973 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000129591 2024-09-13T05:11:19.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.973 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:19.973 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472205+0000", 2024-09-13T05:11:19.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00043034900000000001 2024-09-13T05:11:19.974 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:19.974 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:19.974 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:19.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.974 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47583 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16121856~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:19.974 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.439975+0000", 2024-09-13T05:11:19.974 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.527058353000001, 2024-09-13T05:11:19.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032777897, 2024-09-13T05:11:19.974 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:19.974 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:19.974 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:19.974 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:19.975 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.975 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47583 2024-09-13T05:11:19.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.975 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:19.975 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.975 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:19.975 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439975+0000", 2024-09-13T05:11:19.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:19.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.975 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.975 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:19.975 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439975+0000", 2024-09-13T05:11:19.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:19.976 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.976 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.976 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:19.976 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439974+0000", 2024-09-13T05:11:19.976 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:19.976 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.976 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.976 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:19.976 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439978+0000", 2024-09-13T05:11:19.976 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5729999999999999e-06 2024-09-13T05:11:19.976 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.976 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.976 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:19.976 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439991+0000", 2024-09-13T05:11:19.977 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3465999999999999e-05 2024-09-13T05:11:19.977 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.977 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.977 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.977 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439998+0000", 2024-09-13T05:11:19.977 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8369999999999999e-06 2024-09-13T05:11:19.977 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.977 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.977 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:19.977 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472272+0000", 2024-09-13T05:11:19.977 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032273617999999997 2024-09-13T05:11:19.977 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.977 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.978 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:19.978 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472382+0000", 2024-09-13T05:11:19.978 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000109845 2024-09-13T05:11:19.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.978 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.978 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:19.978 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472753+0000", 2024-09-13T05:11:19.978 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00037116100000000001 2024-09-13T05:11:19.978 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:19.978 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:19.978 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:19.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.978 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.978 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47584 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16416768~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:19.979 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440004+0000", 2024-09-13T05:11:19.979 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.527029287000001, 2024-09-13T05:11:19.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033357242000000002, 2024-09-13T05:11:19.979 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:19.979 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:19.979 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:19.979 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:19.979 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.979 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47584 2024-09-13T05:11:19.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.979 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:19.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:19.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440004+0000", 2024-09-13T05:11:19.980 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:19.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.980 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.980 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:19.980 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440004+0000", 2024-09-13T05:11:19.980 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:19.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.980 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.980 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:19.980 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440003+0000", 2024-09-13T05:11:19.980 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:19.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.980 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.980 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:19.981 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440007+0000", 2024-09-13T05:11:19.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9099999999999998e-06 2024-09-13T05:11:19.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.981 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:19.981 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440020+0000", 2024-09-13T05:11:19.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2330000000000001e-05 2024-09-13T05:11:19.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.981 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.981 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440026+0000", 2024-09-13T05:11:19.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7700000000000004e-06 2024-09-13T05:11:19.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.982 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:19.982 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472807+0000", 2024-09-13T05:11:19.982 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032780431999999998 2024-09-13T05:11:19.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.982 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.982 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:19.982 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472927+0000", 2024-09-13T05:11:19.982 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000119645 2024-09-13T05:11:19.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.982 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.982 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:19.982 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473361+0000", 2024-09-13T05:11:19.982 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000434745 2024-09-13T05:11:19.983 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:19.983 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:19.983 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:19.983 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.983 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47585 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16711680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:19.983 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440033+0000", 2024-09-13T05:11:19.983 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.527000750999999, 2024-09-13T05:11:19.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033917665999999999, 2024-09-13T05:11:19.983 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:19.983 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:19.983 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:19.983 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:19.983 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.984 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47585 2024-09-13T05:11:19.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.984 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:19.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:19.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440033+0000", 2024-09-13T05:11:19.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:19.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:19.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440033+0000", 2024-09-13T05:11:19.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:19.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.985 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:19.985 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440032+0000", 2024-09-13T05:11:19.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:19.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.985 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:19.985 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440036+0000", 2024-09-13T05:11:19.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.676e-06 2024-09-13T05:11:19.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.985 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:19.985 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440049+0000", 2024-09-13T05:11:19.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3142999999999999e-05 2024-09-13T05:11:19.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.986 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440056+0000", 2024-09-13T05:11:19.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.827e-06 2024-09-13T05:11:19.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:19.986 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473451+0000", 2024-09-13T05:11:19.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033395344 2024-09-13T05:11:19.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:19.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473565+0000", 2024-09-13T05:11:19.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011377700000000001 2024-09-13T05:11:19.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:19.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473950+0000", 2024-09-13T05:11:19.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00038550200000000002 2024-09-13T05:11:19.987 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:19.987 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:19.987 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:19.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.987 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47589 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15564800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:19.987 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440062+0000", 2024-09-13T05:11:19.988 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.526971764999999, 2024-09-13T05:11:19.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034520812999999997, 2024-09-13T05:11:19.988 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:19.988 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:19.988 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:19.988 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:19.988 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.988 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47589 2024-09-13T05:11:19.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.988 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:19.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.988 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:19.988 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440062+0000", 2024-09-13T05:11:19.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:19.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:19.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440062+0000", 2024-09-13T05:11:19.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:19.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:19.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440061+0000", 2024-09-13T05:11:19.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:19.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:19.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440064+0000", 2024-09-13T05:11:19.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4029999999999999e-06 2024-09-13T05:11:19.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.990 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:19.990 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440072+0000", 2024-09-13T05:11:19.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.79e-06 2024-09-13T05:11:19.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.990 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.990 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440079+0000", 2024-09-13T05:11:19.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.81e-06 2024-09-13T05:11:19.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.990 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:19.991 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474016+0000", 2024-09-13T05:11:19.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033936858 2024-09-13T05:11:19.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.991 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:19.991 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474143+0000", 2024-09-13T05:11:19.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012673599999999999 2024-09-13T05:11:19.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.991 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:19.991 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474582+0000", 2024-09-13T05:11:19.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00043982199999999998 2024-09-13T05:11:19.991 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:19.991 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:19.992 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:19.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.992 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47590 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15859712~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:19.992 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440085+0000", 2024-09-13T05:11:19.992 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.526948822000001, 2024-09-13T05:11:19.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035003000999999999, 2024-09-13T05:11:19.992 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:19.992 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:19.992 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:19.992 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:19.992 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.992 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47590 2024-09-13T05:11:19.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.993 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:19.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:19.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440085+0000", 2024-09-13T05:11:19.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:19.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:19.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440085+0000", 2024-09-13T05:11:19.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:19.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:19.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440084+0000", 2024-09-13T05:11:19.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:19.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.994 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:19.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440088+0000", 2024-09-13T05:11:19.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7759999999999999e-06 2024-09-13T05:11:19.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.994 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:19.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440100+0000", 2024-09-13T05:11:19.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2537e-05 2024-09-13T05:11:19.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.995 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.995 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440107+0000", 2024-09-13T05:11:19.995 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.046e-06 2024-09-13T05:11:19.995 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.995 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.995 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:19.995 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474648+0000", 2024-09-13T05:11:19.995 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034540803000000002 2024-09-13T05:11:19.995 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.995 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.995 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:19.995 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474721+0000", 2024-09-13T05:11:19.995 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2890000000000002e-05 2024-09-13T05:11:19.995 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:19.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475088+0000", 2024-09-13T05:11:19.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00036654199999999997 2024-09-13T05:11:19.996 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:19.996 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:19.996 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:19.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.996 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47591 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16154624~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:19.996 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440113+0000", 2024-09-13T05:11:19.996 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.526920246, 2024-09-13T05:11:19.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035632759, 2024-09-13T05:11:19.996 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:19.997 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:19.997 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:19.997 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:19.997 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:19.997 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47591 2024-09-13T05:11:19.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.997 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:19.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:19.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440113+0000", 2024-09-13T05:11:19.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:19.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:19.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440113+0000", 2024-09-13T05:11:19.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:19.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:19.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440112+0000", 2024-09-13T05:11:19.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:19.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:19.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440117+0000", 2024-09-13T05:11:19.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0199999999999996e-06 2024-09-13T05:11:19.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:19.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440129+0000", 2024-09-13T05:11:19.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2571999999999999e-05 2024-09-13T05:11:19.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:19.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440136+0000", 2024-09-13T05:11:19.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8870000000000003e-06 2024-09-13T05:11:19.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:19.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:19.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:19.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475160+0000", 2024-09-13T05:11:19.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035024287000000001 2024-09-13T05:11:19.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.000 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475294+0000", 2024-09-13T05:11:20.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013386600000000001 2024-09-13T05:11:20.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.000 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475746+0000", 2024-09-13T05:11:20.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00045173300000000001 2024-09-13T05:11:20.000 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.000 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.000 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.001 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47592 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16449536~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:20.001 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440142+0000", 2024-09-13T05:11:20.001 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.526891587000001, 2024-09-13T05:11:20.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036117556000000002, 2024-09-13T05:11:20.001 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.001 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.001 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.001 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.001 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.001 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47592 2024-09-13T05:11:20.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.001 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.001 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440142+0000", 2024-09-13T05:11:20.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440142+0000", 2024-09-13T05:11:20.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440141+0000", 2024-09-13T05:11:20.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440145+0000", 2024-09-13T05:11:20.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5939999999999998e-06 2024-09-13T05:11:20.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440162+0000", 2024-09-13T05:11:20.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7102999999999999e-05 2024-09-13T05:11:20.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440169+0000", 2024-09-13T05:11:20.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0330000000000003e-06 2024-09-13T05:11:20.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.004 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.004 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475812+0000", 2024-09-13T05:11:20.004 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035643542 2024-09-13T05:11:20.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.004 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.004 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475899+0000", 2024-09-13T05:11:20.004 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6827000000000001e-05 2024-09-13T05:11:20.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.004 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.004 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476259+0000", 2024-09-13T05:11:20.004 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000360057 2024-09-13T05:11:20.005 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.005 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.005 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.005 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47593 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16744448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:20.005 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440175+0000", 2024-09-13T05:11:20.005 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.526858631, 2024-09-13T05:11:20.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036661306999999997, 2024-09-13T05:11:20.005 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.005 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.005 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.005 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.005 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.006 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47593 2024-09-13T05:11:20.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.006 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440175+0000", 2024-09-13T05:11:20.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440175+0000", 2024-09-13T05:11:20.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440174+0000", 2024-09-13T05:11:20.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440178+0000", 2024-09-13T05:11:20.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.687e-06 2024-09-13T05:11:20.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440187+0000", 2024-09-13T05:11:20.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6029999999999994e-06 2024-09-13T05:11:20.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.008 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.008 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440194+0000", 2024-09-13T05:11:20.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8600000000000004e-06 2024-09-13T05:11:20.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.008 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.008 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476312+0000", 2024-09-13T05:11:20.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036117727000000002 2024-09-13T05:11:20.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.008 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.008 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476436+0000", 2024-09-13T05:11:20.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012370600000000001 2024-09-13T05:11:20.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.009 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.009 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476836+0000", 2024-09-13T05:11:20.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00040031399999999998 2024-09-13T05:11:20.009 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.009 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.009 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.009 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47597 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15597568~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:20.009 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440735+0000", 2024-09-13T05:11:20.009 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.526298639, 2024-09-13T05:11:20.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036742364, 2024-09-13T05:11:20.010 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.011 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.011 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.011 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.011 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.011 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47597 2024-09-13T05:11:20.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.012 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.012 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.012 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440735+0000", 2024-09-13T05:11:20.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.012 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.012 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.012 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440735+0000", 2024-09-13T05:11:20.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440733+0000", 2024-09-13T05:11:20.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:20.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440741+0000", 2024-09-13T05:11:20.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7100000000000007e-06 2024-09-13T05:11:20.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.014 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.014 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440774+0000", 2024-09-13T05:11:20.014 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3062999999999998e-05 2024-09-13T05:11:20.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.014 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.014 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440784+0000", 2024-09-13T05:11:20.014 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6630000000000005e-06 2024-09-13T05:11:20.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.014 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476899+0000", 2024-09-13T05:11:20.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036115188999999999 2024-09-13T05:11:20.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477036+0000", 2024-09-13T05:11:20.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000136907 2024-09-13T05:11:20.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477477+0000", 2024-09-13T05:11:20.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00044140899999999997 2024-09-13T05:11:20.016 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.016 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.016 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.016 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47598 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15892480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:20.016 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:11:20.016 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.526228904, 2024-09-13T05:11:20.016 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037255732, 2024-09-13T05:11:20.016 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.017 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.017 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.017 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.017 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.017 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47598 2024-09-13T05:11:20.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.017 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.017 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.017 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.017 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:11:20.017 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:11:20.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:11:20.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:20.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440809+0000", 2024-09-13T05:11:20.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.237e-06 2024-09-13T05:11:20.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440823+0000", 2024-09-13T05:11:20.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4426e-05 2024-09-13T05:11:20.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440831+0000", 2024-09-13T05:11:20.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6669999999999996e-06 2024-09-13T05:11:20.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.020 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.020 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477508+0000", 2024-09-13T05:11:20.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036677354000000002 2024-09-13T05:11:20.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.020 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.020 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477571+0000", 2024-09-13T05:11:20.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2271000000000001e-05 2024-09-13T05:11:20.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.021 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.021 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478060+0000", 2024-09-13T05:11:20.021 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00048954399999999996 2024-09-13T05:11:20.021 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.021 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.021 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.021 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47599 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16187392~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:20.021 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:11:20.022 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.526195961999999, 2024-09-13T05:11:20.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037806671, 2024-09-13T05:11:20.022 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.022 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.022 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.022 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.022 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.022 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47599 2024-09-13T05:11:20.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.022 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:11:20.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:11:20.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:11:20.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.024 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440841+0000", 2024-09-13T05:11:20.024 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1699999999999999e-06 2024-09-13T05:11:20.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.024 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440853+0000", 2024-09-13T05:11:20.024 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2466000000000001e-05 2024-09-13T05:11:20.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.025 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.025 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440860+0000", 2024-09-13T05:11:20.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8970000000000002e-06 2024-09-13T05:11:20.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.025 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.026 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478100+0000", 2024-09-13T05:11:20.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037239398 2024-09-13T05:11:20.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.026 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.026 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478173+0000", 2024-09-13T05:11:20.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3784999999999999e-05 2024-09-13T05:11:20.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.026 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.026 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478644+0000", 2024-09-13T05:11:20.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00047058100000000003 2024-09-13T05:11:20.027 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.027 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.027 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.027 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47600 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16482304~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:20.027 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:11:20.027 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.526166988, 2024-09-13T05:11:20.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038539524999999998, 2024-09-13T05:11:20.028 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.028 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.028 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.028 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.028 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.028 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47600 2024-09-13T05:11:20.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.028 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:11:20.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:11:20.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.030 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:11:20.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.030 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440869+0000", 2024-09-13T05:11:20.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6229999999999999e-06 2024-09-13T05:11:20.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.031 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.031 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440877+0000", 2024-09-13T05:11:20.031 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9289999999999998e-06 2024-09-13T05:11:20.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.031 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440884+0000", 2024-09-13T05:11:20.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9569999999999996e-06 2024-09-13T05:11:20.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478694+0000", 2024-09-13T05:11:20.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037809597 2024-09-13T05:11:20.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478907+0000", 2024-09-13T05:11:20.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021332799999999999 2024-09-13T05:11:20.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479406+0000", 2024-09-13T05:11:20.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00049870100000000005 2024-09-13T05:11:20.034 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.034 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.034 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.034 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47605 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15630336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:20.035 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.445919+0000", 2024-09-13T05:11:20.035 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.521114618999999, 2024-09-13T05:11:20.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034071010999999998, 2024-09-13T05:11:20.035 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.035 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.035 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.035 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.036 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.036 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47605 2024-09-13T05:11:20.036 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.036 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.036 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.036 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.036 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445919+0000", 2024-09-13T05:11:20.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.037 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.037 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445919+0000", 2024-09-13T05:11:20.037 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.037 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445917+0000", 2024-09-13T05:11:20.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:20.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445928+0000", 2024-09-13T05:11:20.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1413000000000001e-05 2024-09-13T05:11:20.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445965+0000", 2024-09-13T05:11:20.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6832999999999998e-05 2024-09-13T05:11:20.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445979+0000", 2024-09-13T05:11:20.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4112e-05 2024-09-13T05:11:20.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479481+0000", 2024-09-13T05:11:20.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033502394999999997 2024-09-13T05:11:20.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479577+0000", 2024-09-13T05:11:20.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5952999999999994e-05 2024-09-13T05:11:20.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.041 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.041 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479990+0000", 2024-09-13T05:11:20.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00041233799999999999 2024-09-13T05:11:20.041 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.041 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.041 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.041 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.041 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47606 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15925248~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:20.041 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.446006+0000", 2024-09-13T05:11:20.041 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.521027254, 2024-09-13T05:11:20.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034653819000000002, 2024-09-13T05:11:20.042 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.042 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.042 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.042 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.042 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.042 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47606 2024-09-13T05:11:20.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.042 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446006+0000", 2024-09-13T05:11:20.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446006+0000", 2024-09-13T05:11:20.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446005+0000", 2024-09-13T05:11:20.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:20.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446011+0000", 2024-09-13T05:11:20.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8039999999999998e-06 2024-09-13T05:11:20.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446027+0000", 2024-09-13T05:11:20.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6109000000000001e-05 2024-09-13T05:11:20.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446036+0000", 2024-09-13T05:11:20.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0100000000000001e-06 2024-09-13T05:11:20.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480068+0000", 2024-09-13T05:11:20.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034031516999999997 2024-09-13T05:11:20.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.046 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.046 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480216+0000", 2024-09-13T05:11:20.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000148701 2024-09-13T05:11:20.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.046 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.046 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480660+0000", 2024-09-13T05:11:20.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00044355499999999999 2024-09-13T05:11:20.047 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.047 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.047 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.047 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47607 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16220160~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:20.047 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.446044+0000", 2024-09-13T05:11:20.048 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.520989785000001, 2024-09-13T05:11:20.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035276967999999999, 2024-09-13T05:11:20.048 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.048 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.048 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.048 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.048 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.048 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47607 2024-09-13T05:11:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446044+0000", 2024-09-13T05:11:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446044+0000", 2024-09-13T05:11:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446043+0000", 2024-09-13T05:11:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446047+0000", 2024-09-13T05:11:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0729999999999998e-06 2024-09-13T05:11:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.050 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446055+0000", 2024-09-13T05:11:20.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0900000000000005e-06 2024-09-13T05:11:20.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446062+0000", 2024-09-13T05:11:20.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0169999999999999e-06 2024-09-13T05:11:20.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480714+0000", 2024-09-13T05:11:20.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034651380000000002 2024-09-13T05:11:20.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480859+0000", 2024-09-13T05:11:20.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014580300000000001 2024-09-13T05:11:20.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481321+0000", 2024-09-13T05:11:20.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000461218 2024-09-13T05:11:20.052 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.052 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.053 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.053 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47608 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16515072~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:20.053 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.446068+0000", 2024-09-13T05:11:20.053 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.520965339, 2024-09-13T05:11:20.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035881819000000002, 2024-09-13T05:11:20.053 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.053 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.053 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.053 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47608 2024-09-13T05:11:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446068+0000", 2024-09-13T05:11:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446068+0000", 2024-09-13T05:11:20.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446067+0000", 2024-09-13T05:11:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446071+0000", 2024-09-13T05:11:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9090000000000002e-06 2024-09-13T05:11:20.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.056 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.056 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.056 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446079+0000", 2024-09-13T05:11:20.056 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6869999999999994e-06 2024-09-13T05:11:20.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.056 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.056 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.056 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446088+0000", 2024-09-13T05:11:20.056 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0129999999999999e-06 2024-09-13T05:11:20.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.056 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481401+0000", 2024-09-13T05:11:20.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035313272999999999 2024-09-13T05:11:20.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481564+0000", 2024-09-13T05:11:20.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016223299999999999 2024-09-13T05:11:20.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481950+0000", 2024-09-13T05:11:20.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00038631000000000001 2024-09-13T05:11:20.058 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.058 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.058 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.058 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:48448 3.16 3:6fb90bbf:::rbd_data.112d4ee87f83.00000000000000ca:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-13T05:11:20.058 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:52.567838+0000", 2024-09-13T05:11:20.058 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 27.399195438, 2024-09-13T05:11:20.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032609896999999999, 2024-09-13T05:11:20.058 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.059 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:20.059 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.059 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.059 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.059 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 48448 2024-09-13T05:11:20.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.059 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.059 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.059 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.059 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567838+0000", 2024-09-13T05:11:20.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.060 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.060 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.060 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567838+0000", 2024-09-13T05:11:20.060 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.060 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.060 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.060 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567836+0000", 2024-09-13T05:11:20.060 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:20.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.060 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.060 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567847+0000", 2024-09-13T05:11:20.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1443e-05 2024-09-13T05:11:20.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567867+0000", 2024-09-13T05:11:20.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0083000000000001e-05 2024-09-13T05:11:20.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567877+0000", 2024-09-13T05:11:20.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4499999999999993e-06 2024-09-13T05:11:20.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567939+0000", 2024-09-13T05:11:20.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2552999999999996e-05 2024-09-13T05:11:20.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.063 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.063 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.568130+0000", 2024-09-13T05:11:20.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00019028799999999999 2024-09-13T05:11:20.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.063 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.063 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 7", 2024-09-13T05:11:20.063 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.575017+0000", 2024-09-13T05:11:20.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0068869980000000001 2024-09-13T05:11:20.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.063 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.064 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:20.064 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.600362+0000", 2024-09-13T05:11:20.064 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.025345828000000001 2024-09-13T05:11:20.064 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.064 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.064 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:11:20.064 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.600374+0000", 2024-09-13T05:11:20.064 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1096e-05 2024-09-13T05:11:20.064 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.065 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.065 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:11:20.065 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.600410+0000", 2024-09-13T05:11:20.065 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6142000000000001e-05 2024-09-13T05:11:20.065 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.065 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.065 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.065 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.600448+0000", 2024-09-13T05:11:20.065 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8101e-05 2024-09-13T05:11:20.066 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.066 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.066 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.066 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.066 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.066 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:67653 3.1f 3:f936ba4b:::rbd_object_map.112d7bfe4877:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e81)", 2024-09-13T05:11:20.066 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:18.704251+0000", 2024-09-13T05:11:20.066 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.2627819739999999, 2024-09-13T05:11:20.066 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034028673000000002, 2024-09-13T05:11:20.066 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.067 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:20.067 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.067 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.067 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.067 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 67653 2024-09-13T05:11:20.067 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.067 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.067 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.067 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.067 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704251+0000", 2024-09-13T05:11:20.068 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.068 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.068 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.068 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.068 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704251+0000", 2024-09-13T05:11:20.068 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.068 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.068 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.068 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.068 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704251+0000", 2024-09-13T05:11:20.069 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:20.069 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.069 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.069 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.069 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704253+0000", 2024-09-13T05:11:20.069 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.136e-06 2024-09-13T05:11:20.069 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.069 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.069 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.070 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704256+0000", 2024-09-13T05:11:20.070 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7049999999999999e-06 2024-09-13T05:11:20.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.070 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.070 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.070 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704259+0000", 2024-09-13T05:11:20.070 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6970000000000002e-06 2024-09-13T05:11:20.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.070 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.729746+0000", 2024-09-13T05:11:20.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.025486892000000001 2024-09-13T05:11:20.071 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.729834+0000", 2024-09-13T05:11:20.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8864999999999997e-05 2024-09-13T05:11:20.072 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.072 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.072 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 2", 2024-09-13T05:11:20.072 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.730192+0000", 2024-09-13T05:11:20.072 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00035797100000000001 2024-09-13T05:11:20.072 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.072 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.073 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:11:20.073 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.734948+0000", 2024-09-13T05:11:20.073 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0047558139999999997 2024-09-13T05:11:20.073 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.073 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.073 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:20.073 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.738189+0000", 2024-09-13T05:11:20.073 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003241234 2024-09-13T05:11:20.073 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.074 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:11:20.074 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.738245+0000", 2024-09-13T05:11:20.074 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6001000000000001e-05 2024-09-13T05:11:20.074 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.074 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.074 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.738280+0000", 2024-09-13T05:11:20.074 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4567000000000003e-05 2024-09-13T05:11:20.074 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.074 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.074 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.075 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:67654 3.1f 3:f936ba4b:::rbd_object_map.112d7bfe4877:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e81)", 2024-09-13T05:11:20.075 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:18.704261+0000", 2024-09-13T05:11:20.075 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.2627724389999999, 2024-09-13T05:11:20.075 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034141218000000001, 2024-09-13T05:11:20.075 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.075 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:20.075 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.075 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.075 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.075 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 67654 2024-09-13T05:11:20.076 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.076 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.076 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.076 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.076 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704261+0000", 2024-09-13T05:11:20.076 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.076 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.076 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.076 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.076 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704261+0000", 2024-09-13T05:11:20.076 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.077 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.077 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.077 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704261+0000", 2024-09-13T05:11:20.077 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:20.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.077 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.077 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.077 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704263+0000", 2024-09-13T05:11:20.077 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3999999999999999e-06 2024-09-13T05:11:20.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.077 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.078 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.078 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704266+0000", 2024-09-13T05:11:20.078 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7879999999999998e-06 2024-09-13T05:11:20.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.078 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.078 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704269+0000", 2024-09-13T05:11:20.078 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:11:20.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.078 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.078 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.730747+0000", 2024-09-13T05:11:20.078 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.026478224000000002 2024-09-13T05:11:20.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.079 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.079 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.079 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.730796+0000", 2024-09-13T05:11:20.079 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9137000000000001e-05 2024-09-13T05:11:20.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.079 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.079 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 2", 2024-09-13T05:11:20.079 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.731142+0000", 2024-09-13T05:11:20.079 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00034581500000000002 2024-09-13T05:11:20.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.079 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.080 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:11:20.080 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.734952+0000", 2024-09-13T05:11:20.080 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0038102909999999999 2024-09-13T05:11:20.080 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.080 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.080 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:20.080 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.738325+0000", 2024-09-13T05:11:20.080 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033727890000000002 2024-09-13T05:11:20.081 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.081 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.081 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:11:20.081 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.738369+0000", 2024-09-13T05:11:20.081 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4338999999999997e-05 2024-09-13T05:11:20.081 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.081 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.081 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.081 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.738402+0000", 2024-09-13T05:11:20.081 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2880999999999999e-05 2024-09-13T05:11:20.081 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.082 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.082 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.082 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.082 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.082 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:20.084 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:11:20.084 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:20.082+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:20.184 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:20.178+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:20.237 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:20.237 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:20.237 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:11:20.237 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:20.247 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:11:20.286 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:20.285+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:20.342 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:11:20.353 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T05:11:20.359 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:20.360 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:20.360 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:20.360 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:20.360 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:20.362 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.5 to 1 (10000) 2024-09-13T05:11:20.369 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:11:20.379 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-13T05:11:20.426 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:20.421+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:20.474 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:20.474 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:20.474 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:20.474 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:20.474 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.474 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29020 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2855936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:20.474 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:11:20.474 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 43.428869356, 2024-09-13T05:11:20.474 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060733743, 2024-09-13T05:11:20.474 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.474 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.475 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.475 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.475 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.475 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29020 2024-09-13T05:11:20.475 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.475 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.475 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.475 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.475 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:11:20.475 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.475 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.475 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.475 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.476 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:11:20.476 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.476 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.476 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.476 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.476 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041741+0000", 2024-09-13T05:11:20.476 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.476 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.476 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.476 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.476 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041749+0000", 2024-09-13T05:11:20.476 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6059999999999997e-06 2024-09-13T05:11:20.476 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.476 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.477 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.477 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041754+0000", 2024-09-13T05:11:20.477 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6740000000000002e-06 2024-09-13T05:11:20.477 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.477 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.477 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.477 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041760+0000", 2024-09-13T05:11:20.477 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0459999999999996e-06 2024-09-13T05:11:20.477 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.477 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.477 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.478 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102289+0000", 2024-09-13T05:11:20.478 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060529145999999999 2024-09-13T05:11:20.478 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.478 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.478 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.478 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102378+0000", 2024-09-13T05:11:20.478 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8901999999999997e-05 2024-09-13T05:11:20.478 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.478 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.478 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.478 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102476+0000", 2024-09-13T05:11:20.479 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7991000000000004e-05 2024-09-13T05:11:20.479 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.479 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.479 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.479 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.479 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.479 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29021 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2865152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:20.479 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:11:20.479 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 43.428847361000003, 2024-09-13T05:11:20.479 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060927993999999999, 2024-09-13T05:11:20.480 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.480 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.480 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.480 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.480 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.480 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29021 2024-09-13T05:11:20.480 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.480 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.480 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.480 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.480 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:11:20.480 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.480 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.481 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.481 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.481 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:11:20.481 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.481 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.481 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.481 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.481 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041763+0000", 2024-09-13T05:11:20.481 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.481 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.481 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.481 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.481 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041766+0000", 2024-09-13T05:11:20.481 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6800000000000002e-06 2024-09-13T05:11:20.482 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.482 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.482 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.482 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041771+0000", 2024-09-13T05:11:20.482 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:11:20.482 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.482 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.482 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.482 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041776+0000", 2024-09-13T05:11:20.482 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8489999999999997e-06 2024-09-13T05:11:20.482 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.482 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.482 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.483 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102513+0000", 2024-09-13T05:11:20.483 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060737102000000001 2024-09-13T05:11:20.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.483 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.483 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.483 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102597+0000", 2024-09-13T05:11:20.483 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4374000000000002e-05 2024-09-13T05:11:20.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.483 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.483 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.483 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102692+0000", 2024-09-13T05:11:20.484 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4436000000000002e-05 2024-09-13T05:11:20.484 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.484 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.484 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.484 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.484 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.484 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29022 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2874368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:20.484 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:11:20.484 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 43.428831060999997, 2024-09-13T05:11:20.484 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061135083999999999, 2024-09-13T05:11:20.484 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.484 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.485 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.485 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.485 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.485 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29022 2024-09-13T05:11:20.485 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.485 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.485 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.485 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.485 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:11:20.485 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.485 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.485 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.485 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.485 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:11:20.486 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.486 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.486 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.486 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.486 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:11:20.486 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.486 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.486 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.486 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.486 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041782+0000", 2024-09-13T05:11:20.486 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4959999999999999e-06 2024-09-13T05:11:20.486 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.486 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.487 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.487 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041787+0000", 2024-09-13T05:11:20.487 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1240000000000004e-06 2024-09-13T05:11:20.487 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.487 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.487 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.487 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041792+0000", 2024-09-13T05:11:20.487 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9200000000000003e-06 2024-09-13T05:11:20.487 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.487 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.487 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.487 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102738+0000", 2024-09-13T05:11:20.487 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060945581999999998 2024-09-13T05:11:20.487 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.488 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.488 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.488 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102821+0000", 2024-09-13T05:11:20.488 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2898999999999994e-05 2024-09-13T05:11:20.488 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.488 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.488 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.488 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102915+0000", 2024-09-13T05:11:20.488 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4523000000000003e-05 2024-09-13T05:11:20.488 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.488 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.489 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.489 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.489 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.489 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29067 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2764800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:20.489 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:11:20.489 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 43.425056843999997, 2024-09-13T05:11:20.489 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060816621000000001, 2024-09-13T05:11:20.489 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.489 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.489 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.489 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.489 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.489 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29067 2024-09-13T05:11:20.490 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.490 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.490 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.490 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.490 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:11:20.490 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.490 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.490 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.490 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.490 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:11:20.490 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.490 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.490 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.490 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.491 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:11:20.491 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.491 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.491 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.491 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.491 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045557+0000", 2024-09-13T05:11:20.491 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.898e-06 2024-09-13T05:11:20.491 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.491 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.491 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.491 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045575+0000", 2024-09-13T05:11:20.491 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8252000000000001e-05 2024-09-13T05:11:20.491 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.491 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.492 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.492 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045581+0000", 2024-09-13T05:11:20.492 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:11:20.492 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.492 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.492 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.492 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106183+0000", 2024-09-13T05:11:20.492 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060602630999999997 2024-09-13T05:11:20.492 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.492 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.492 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.492 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106271+0000", 2024-09-13T05:11:20.492 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7329000000000004e-05 2024-09-13T05:11:20.492 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.493 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.493 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.493 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106371+0000", 2024-09-13T05:11:20.493 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000100164 2024-09-13T05:11:20.493 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.493 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.493 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.493 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.493 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.493 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29068 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2774016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:20.493 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:11:20.493 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 43.425025609999999, 2024-09-13T05:11:20.493 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060994509000000002, 2024-09-13T05:11:20.494 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.494 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.494 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.494 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.495 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.495 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29068 2024-09-13T05:11:20.495 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.495 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.495 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.495 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.495 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:11:20.495 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.495 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.495 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.495 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.495 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:11:20.495 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.495 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.496 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.496 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.496 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045585+0000", 2024-09-13T05:11:20.496 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.496 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.496 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.496 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.496 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045588+0000", 2024-09-13T05:11:20.496 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:11:20.496 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.497 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.497 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.497 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045594+0000", 2024-09-13T05:11:20.497 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9329999999999998e-06 2024-09-13T05:11:20.497 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.497 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.497 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.497 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045599+0000", 2024-09-13T05:11:20.497 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3190000000000002e-06 2024-09-13T05:11:20.497 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.497 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.497 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.497 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106399+0000", 2024-09-13T05:11:20.497 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060800361999999997 2024-09-13T05:11:20.498 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.498 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.498 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.498 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106489+0000", 2024-09-13T05:11:20.498 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9301000000000004e-05 2024-09-13T05:11:20.498 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.498 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.498 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.498 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106580+0000", 2024-09-13T05:11:20.498 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1314e-05 2024-09-13T05:11:20.498 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.498 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.498 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.499 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.499 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.499 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29069 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2792448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:20.499 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:11:20.499 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 43.425007192999999, 2024-09-13T05:11:20.499 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061207599000000001, 2024-09-13T05:11:20.499 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.499 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.499 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.499 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.499 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.499 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29069 2024-09-13T05:11:20.499 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.499 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.500 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.500 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.500 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:11:20.500 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.500 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.500 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.500 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.500 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:11:20.500 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.500 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.500 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.500 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.500 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045603+0000", 2024-09-13T05:11:20.501 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.501 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.501 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.501 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.501 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045606+0000", 2024-09-13T05:11:20.501 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7300000000000001e-06 2024-09-13T05:11:20.501 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.501 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.501 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.501 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045612+0000", 2024-09-13T05:11:20.501 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9599999999999997e-06 2024-09-13T05:11:20.501 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.501 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.502 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.502 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045619+0000", 2024-09-13T05:11:20.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6019999999999996e-06 2024-09-13T05:11:20.502 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.502 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.502 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.502 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106619+0000", 2024-09-13T05:11:20.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061000029999999997 2024-09-13T05:11:20.502 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.502 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.502 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.502 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106713+0000", 2024-09-13T05:11:20.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4505000000000004e-05 2024-09-13T05:11:20.503 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.503 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.503 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.503 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106812+0000", 2024-09-13T05:11:20.503 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8264000000000007e-05 2024-09-13T05:11:20.503 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.503 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.503 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.503 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.503 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.503 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29070 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2783232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:20.503 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:11:20.504 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 43.424986734000001, 2024-09-13T05:11:20.504 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061389805999999998, 2024-09-13T05:11:20.504 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.504 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.504 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.504 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.504 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.504 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29070 2024-09-13T05:11:20.504 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.504 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.504 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.504 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.504 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:11:20.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.505 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.505 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.505 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:11:20.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.505 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.505 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.505 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:11:20.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.505 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.506 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.506 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045627+0000", 2024-09-13T05:11:20.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6579999999999998e-06 2024-09-13T05:11:20.506 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.506 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.506 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045632+0000", 2024-09-13T05:11:20.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8449999999999999e-06 2024-09-13T05:11:20.506 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.506 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.506 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045639+0000", 2024-09-13T05:11:20.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:11:20.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.507 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.507 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106837+0000", 2024-09-13T05:11:20.507 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061198529000000002 2024-09-13T05:11:20.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.507 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.507 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106922+0000", 2024-09-13T05:11:20.507 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4771999999999994e-05 2024-09-13T05:11:20.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.508 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.508 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107014+0000", 2024-09-13T05:11:20.508 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2009000000000006e-05 2024-09-13T05:11:20.508 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.508 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.508 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.508 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.508 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.508 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29071 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2801664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:20.508 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:11:20.508 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 43.424967658, 2024-09-13T05:11:20.508 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061582804999999997, 2024-09-13T05:11:20.509 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.509 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.509 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.509 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.509 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.509 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29071 2024-09-13T05:11:20.509 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.510 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.510 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.510 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.510 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:11:20.510 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.510 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.510 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.510 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.510 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:11:20.511 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.511 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.511 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.511 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045643+0000", 2024-09-13T05:11:20.511 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.511 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.511 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.511 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045646+0000", 2024-09-13T05:11:20.511 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:11:20.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.511 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.511 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.512 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045664+0000", 2024-09-13T05:11:20.512 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8408000000000001e-05 2024-09-13T05:11:20.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.512 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.512 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.512 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045670+0000", 2024-09-13T05:11:20.512 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7710000000000003e-06 2024-09-13T05:11:20.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.512 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.512 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.512 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107048+0000", 2024-09-13T05:11:20.512 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061378438 2024-09-13T05:11:20.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.512 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.513 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.513 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107134+0000", 2024-09-13T05:11:20.513 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5574000000000004e-05 2024-09-13T05:11:20.513 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.513 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.513 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107226+0000", 2024-09-13T05:11:20.513 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2262000000000005e-05 2024-09-13T05:11:20.513 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.513 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.513 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.513 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.513 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29072 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2810880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:20.514 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:11:20.514 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 43.424936273999997, 2024-09-13T05:11:20.514 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061762233999999999, 2024-09-13T05:11:20.514 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.514 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.514 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.514 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.514 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.514 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29072 2024-09-13T05:11:20.514 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.514 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.514 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.514 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.515 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:11:20.515 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.515 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.515 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:11:20.515 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.515 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.515 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045674+0000", 2024-09-13T05:11:20.515 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.516 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.516 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045677+0000", 2024-09-13T05:11:20.516 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9679999999999998e-06 2024-09-13T05:11:20.516 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.516 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.516 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.516 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045694+0000", 2024-09-13T05:11:20.516 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6801999999999999e-05 2024-09-13T05:11:20.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.517 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.517 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045700+0000", 2024-09-13T05:11:20.517 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8270000000000003e-06 2024-09-13T05:11:20.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.517 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.517 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107249+0000", 2024-09-13T05:11:20.517 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061549114000000002 2024-09-13T05:11:20.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.517 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.518 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107341+0000", 2024-09-13T05:11:20.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2390000000000001e-05 2024-09-13T05:11:20.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.518 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.518 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107437+0000", 2024-09-13T05:11:20.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5648000000000003e-05 2024-09-13T05:11:20.518 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.518 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.518 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.518 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29073 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2820096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:20.518 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:11:20.519 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 43.424894295999998, 2024-09-13T05:11:20.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061873910999999997, 2024-09-13T05:11:20.519 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.519 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.519 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.519 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.519 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.519 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29073 2024-09-13T05:11:20.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.519 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.519 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:11:20.520 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.520 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.520 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:11:20.520 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.520 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.520 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045716+0000", 2024-09-13T05:11:20.520 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.521 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.521 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045726+0000", 2024-09-13T05:11:20.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6350000000000001e-06 2024-09-13T05:11:20.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.521 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.521 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045739+0000", 2024-09-13T05:11:20.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3325e-05 2024-09-13T05:11:20.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.521 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.521 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045746+0000", 2024-09-13T05:11:20.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7399999999999998e-06 2024-09-13T05:11:20.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107457+0000", 2024-09-13T05:11:20.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061711038000000003 2024-09-13T05:11:20.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107522+0000", 2024-09-13T05:11:20.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4850000000000004e-05 2024-09-13T05:11:20.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107591+0000", 2024-09-13T05:11:20.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9029999999999995e-05 2024-09-13T05:11:20.523 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.523 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.523 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.523 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29074 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2829312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:20.523 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:11:20.523 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 43.424860387999999, 2024-09-13T05:11:20.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062055459, 2024-09-13T05:11:20.523 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.523 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.523 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.523 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.524 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.524 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29074 2024-09-13T05:11:20.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.524 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:11:20.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:11:20.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.525 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.525 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045750+0000", 2024-09-13T05:11:20.525 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.525 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.525 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045753+0000", 2024-09-13T05:11:20.525 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8399999999999999e-06 2024-09-13T05:11:20.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.525 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.526 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045759+0000", 2024-09-13T05:11:20.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8900000000000004e-06 2024-09-13T05:11:20.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.526 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.526 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045764+0000", 2024-09-13T05:11:20.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3850000000000001e-06 2024-09-13T05:11:20.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.526 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.526 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107623+0000", 2024-09-13T05:11:20.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061858817000000003 2024-09-13T05:11:20.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107710+0000", 2024-09-13T05:11:20.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7127999999999997e-05 2024-09-13T05:11:20.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107806+0000", 2024-09-13T05:11:20.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5886999999999999e-05 2024-09-13T05:11:20.527 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.527 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.527 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.528 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29075 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2838528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:20.528 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:11:20.528 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 43.424841934, 2024-09-13T05:11:20.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062188516999999999, 2024-09-13T05:11:20.528 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.528 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.528 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.528 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.528 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.528 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29075 2024-09-13T05:11:20.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.528 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.529 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.529 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:11:20.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.529 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.529 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:11:20.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.529 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.529 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:11:20.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.530 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.530 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045772+0000", 2024-09-13T05:11:20.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:11:20.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.530 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.530 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045778+0000", 2024-09-13T05:11:20.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9229999999999996e-06 2024-09-13T05:11:20.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.530 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.530 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045784+0000", 2024-09-13T05:11:20.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3800000000000002e-06 2024-09-13T05:11:20.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107823+0000", 2024-09-13T05:11:20.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062039331000000003 2024-09-13T05:11:20.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107886+0000", 2024-09-13T05:11:20.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2476000000000003e-05 2024-09-13T05:11:20.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107958+0000", 2024-09-13T05:11:20.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2089999999999996e-05 2024-09-13T05:11:20.532 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.532 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.532 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.532 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29115 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2682880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:20.532 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:11:20.532 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 43.421376406999997, 2024-09-13T05:11:20.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060847898999999997, 2024-09-13T05:11:20.532 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.532 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.532 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.532 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.533 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.533 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29115 2024-09-13T05:11:20.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.533 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:11:20.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:11:20.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049234+0000", 2024-09-13T05:11:20.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049237+0000", 2024-09-13T05:11:20.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9069999999999999e-06 2024-09-13T05:11:20.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.535 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.535 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049243+0000", 2024-09-13T05:11:20.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7459999999999997e-06 2024-09-13T05:11:20.535 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.535 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.535 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049248+0000", 2024-09-13T05:11:20.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1490000000000002e-06 2024-09-13T05:11:20.535 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.535 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.535 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.109945+0000", 2024-09-13T05:11:20.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060697299000000003 2024-09-13T05:11:20.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110013+0000", 2024-09-13T05:11:20.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8023999999999998e-05 2024-09-13T05:11:20.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110083+0000", 2024-09-13T05:11:20.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9296999999999997e-05 2024-09-13T05:11:20.536 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.536 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.536 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.537 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29116 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2692096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:20.537 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:11:20.537 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 43.421358562999998, 2024-09-13T05:11:20.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061040167999999999, 2024-09-13T05:11:20.537 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.537 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.537 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.537 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.537 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.537 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29116 2024-09-13T05:11:20.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.538 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:11:20.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:11:20.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049252+0000", 2024-09-13T05:11:20.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.539 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.539 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049255+0000", 2024-09-13T05:11:20.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7250000000000002e-06 2024-09-13T05:11:20.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.539 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.539 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049261+0000", 2024-09-13T05:11:20.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.755e-06 2024-09-13T05:11:20.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.539 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.539 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049266+0000", 2024-09-13T05:11:20.540 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2100000000000001e-06 2024-09-13T05:11:20.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.540 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.540 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110115+0000", 2024-09-13T05:11:20.540 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060849225999999999 2024-09-13T05:11:20.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.540 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.540 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110199+0000", 2024-09-13T05:11:20.540 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4339999999999995e-05 2024-09-13T05:11:20.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110293+0000", 2024-09-13T05:11:20.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3397e-05 2024-09-13T05:11:20.541 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.541 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.541 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.541 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29117 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2701312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:20.541 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:11:20.541 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 43.421340925999999, 2024-09-13T05:11:20.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.06118527, 2024-09-13T05:11:20.541 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.541 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.542 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.542 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.542 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.542 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29117 2024-09-13T05:11:20.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.542 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:11:20.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:11:20.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:11:20.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049273+0000", 2024-09-13T05:11:20.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.757e-06 2024-09-13T05:11:20.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049278+0000", 2024-09-13T05:11:20.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7830000000000004e-06 2024-09-13T05:11:20.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.544 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049284+0000", 2024-09-13T05:11:20.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3820000000000003e-06 2024-09-13T05:11:20.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.544 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110313+0000", 2024-09-13T05:11:20.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061029682000000002 2024-09-13T05:11:20.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.545 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110383+0000", 2024-09-13T05:11:20.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9406000000000006e-05 2024-09-13T05:11:20.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.545 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110456+0000", 2024-09-13T05:11:20.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2750000000000007e-05 2024-09-13T05:11:20.545 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.545 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.545 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.546 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29118 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2710528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:20.546 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:11:20.546 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 43.421323010999998, 2024-09-13T05:11:20.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061380698999999997, 2024-09-13T05:11:20.546 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.546 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.546 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.546 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.546 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.546 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29118 2024-09-13T05:11:20.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.546 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:11:20.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:11:20.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:11:20.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049291+0000", 2024-09-13T05:11:20.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8770000000000002e-06 2024-09-13T05:11:20.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049296+0000", 2024-09-13T05:11:20.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6799999999999998e-06 2024-09-13T05:11:20.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049302+0000", 2024-09-13T05:11:20.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2769999999999996e-06 2024-09-13T05:11:20.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110488+0000", 2024-09-13T05:11:20.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061186184999999997 2024-09-13T05:11:20.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110577+0000", 2024-09-13T05:11:20.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9246000000000006e-05 2024-09-13T05:11:20.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110669+0000", 2024-09-13T05:11:20.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1923999999999996e-05 2024-09-13T05:11:20.550 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.550 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.550 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.550 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29119 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2719744~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:20.550 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:11:20.550 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 43.421305267000001, 2024-09-13T05:11:20.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061521165000000003, 2024-09-13T05:11:20.550 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.550 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.550 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.550 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.550 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.551 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29119 2024-09-13T05:11:20.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.551 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:11:20.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:11:20.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049305+0000", 2024-09-13T05:11:20.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049308+0000", 2024-09-13T05:11:20.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7070000000000001e-06 2024-09-13T05:11:20.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049316+0000", 2024-09-13T05:11:20.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:11:20.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.553 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.553 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049322+0000", 2024-09-13T05:11:20.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3199999999999999e-06 2024-09-13T05:11:20.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.553 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.553 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110690+0000", 2024-09-13T05:11:20.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061368428000000003 2024-09-13T05:11:20.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110755+0000", 2024-09-13T05:11:20.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4893000000000004e-05 2024-09-13T05:11:20.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110827+0000", 2024-09-13T05:11:20.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2039000000000006e-05 2024-09-13T05:11:20.554 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.554 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.554 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.555 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29120 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2728960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:20.555 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:11:20.555 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 43.421284997000001, 2024-09-13T05:11:20.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061718420000000003, 2024-09-13T05:11:20.555 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.555 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.555 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.555 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.555 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.555 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29120 2024-09-13T05:11:20.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.555 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:11:20.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:11:20.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:11:20.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049329+0000", 2024-09-13T05:11:20.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.022e-06 2024-09-13T05:11:20.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049336+0000", 2024-09-13T05:11:20.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0720000000000002e-06 2024-09-13T05:11:20.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049341+0000", 2024-09-13T05:11:20.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:11:20.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110864+0000", 2024-09-13T05:11:20.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061523126999999997 2024-09-13T05:11:20.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110951+0000", 2024-09-13T05:11:20.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6557000000000005e-05 2024-09-13T05:11:20.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.111045+0000", 2024-09-13T05:11:20.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4043999999999996e-05 2024-09-13T05:11:20.559 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.559 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.559 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.559 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29136 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2876416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:20.559 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:11:20.559 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 43.417269572000002, 2024-09-13T05:11:20.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060742995000000001, 2024-09-13T05:11:20.559 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.559 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.559 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.559 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.560 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.560 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29136 2024-09-13T05:11:20.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.560 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:11:20.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:11:20.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053341+0000", 2024-09-13T05:11:20.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053344+0000", 2024-09-13T05:11:20.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:11:20.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053350+0000", 2024-09-13T05:11:20.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7200000000000003e-06 2024-09-13T05:11:20.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.562 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053355+0000", 2024-09-13T05:11:20.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0150000000000003e-06 2024-09-13T05:11:20.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.562 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113909+0000", 2024-09-13T05:11:20.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060554368999999997 2024-09-13T05:11:20.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113994+0000", 2024-09-13T05:11:20.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4658000000000002e-05 2024-09-13T05:11:20.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114085+0000", 2024-09-13T05:11:20.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0939000000000005e-05 2024-09-13T05:11:20.563 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.563 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.563 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.563 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29166 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2628608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:20.564 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:11:20.564 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 43.417252138000002, 2024-09-13T05:11:20.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060883127000000002, 2024-09-13T05:11:20.564 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:20.564 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:20.564 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:20.564 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:20.564 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:20.564 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29166 2024-09-13T05:11:20.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.564 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:20.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:20.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:11:20.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:20.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:11:20.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:20.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:20.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:11:20.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:20.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:20.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053361+0000", 2024-09-13T05:11:20.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:11:20.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:20.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053367+0000", 2024-09-13T05:11:20.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7350000000000001e-06 2024-09-13T05:11:20.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:20.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053372+0000", 2024-09-13T05:11:20.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7840000000000003e-06 2024-09-13T05:11:20.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:20.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114103+0000", 2024-09-13T05:11:20.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060730924999999998 2024-09-13T05:11:20.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:20.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114171+0000", 2024-09-13T05:11:20.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8021999999999993e-05 2024-09-13T05:11:20.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:20.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:20.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:20.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114242+0000", 2024-09-13T05:11:20.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1390999999999995e-05 2024-09-13T05:11:20.568 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.568 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.568 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.568 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:20.568 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:20.568 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:20.570 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:11:20.570 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:11:20.570 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:11:20.570 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:11:20.571 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:20.565+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:20.571 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:11:20.590 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:11:20.614 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:11:20.642 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:11:20.664 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:11:20.666 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:11:20.666 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:11:20.666 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:11:20.666 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:11:20.666 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:11:20.666 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:11:20.666 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:11:20.666 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:11:20.670 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:20.665+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:20.687 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:20.687 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:20.697 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:11:20.772 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:20.766+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:20.802 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:20.802 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:20.811 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:11:20.873 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:20.870+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:20.964 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:20.964 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:20.973 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:11:20.975 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:20.970+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:21.076 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:21.070+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:21.092 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:21.092 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:21.102 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:11:21.177 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:21.174+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:21.206 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:21.206 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:21.216 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:11:21.279 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:21.273+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:21.325 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:21.325 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:21.335 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:11:21.365 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is set 2024-09-13T05:11:21.365 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.6 to 1 (10000) 2024-09-13T05:11:21.379 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-13T05:11:21.380 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:21.373+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:21.460 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:21.460 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:21.470 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:11:21.480 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:21.473+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:21.581 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:21.581 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:21.581 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:21.577+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:21.591 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:11:21.682 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:21.678+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:21.739 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:21.740 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:21.750 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:11:21.782 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:21.777+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:21.851 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:21.851 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:21.861 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:11:21.884 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:21.878+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:21.965 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:21.965 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:21.975 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:11:21.984 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:21.977+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:22.086 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:22.086 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:22.087 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:22.082+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:22.095 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:11:22.187 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:22.182+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:22.200 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:22.200 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:22.210 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:11:22.288 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:22.281+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:22.320 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:22.320 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:22.330 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:11:22.363 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.7 to 1 (10000) 2024-09-13T05:11:22.380 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-13T05:11:22.380 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:11:22.389 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:22.382+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:22.451 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:22.452 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:22.463 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:11:22.490 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:22.485+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:22.511 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone26 from 0x788a8f6 (overlap 0xee5324) to 0x477f57 2024-09-13T05:11:22.590 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:22.586+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:22.605 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:22.606 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:22.616 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:11:22.677 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:11:22.691 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:22.685+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:22.718 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:11:22.719 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:22.719 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:22.722 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:11:22.729 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:11:22.736 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2024-09-13T05:11:22.353141+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":842581438,"num_objects":2038,"num_object_clones":272,"num_object_copies":4076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2038,"num_whiteouts":982,"num_read":89597,"num_read_kb":405944,"num_write":12700,"num_write_kb":273436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1302,"num_bytes_recovered":45181655,"num_keys_recovered":167,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11070,"ondisk_log_size":11070,"up":82,"acting":76,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":452864,"kb_used_data":262716,"kb_used_omap":7,"kb_used_meta":189944,"kb_avail":471406336,"statfs":{"total":483183820800,"available":482720088064,"internally_reserved":0,"allocated":269021184,"data_stored":289648950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7962,"internal_metadata":194502886},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8851593,"num_objects":107,"num_object_clones":26,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":26,"num_read":5275,"num_read_kb":25334,"num_write":1095,"num_write_kb":3290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.032404"},"pg_stats":[{"pgid":"3.1f","version":"82'346","reported_seq":906,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350704+0000","last_change":"2024-09-13T05:10:37.993400+0000","last_active":"2024-09-13T05:11:20.350704+0000","last_peered":"2024-09-13T05:11:20.350704+0000","last_clean":"2024-09-13T05:11:20.350704+0000","last_became_active":"2024-09-13T05:10:37.864778+0000","last_became_peered":"2024-09-13T05:10:37.864778+0000","last_unstale":"2024-09-13T05:11:20.350704+0000","last_undegraded":"2024-09-13T05:11:20.350704+0000","last_fullsized":"2024-09-13T05:11:20.350704+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:56:24.801492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011835439999999999,"stat_sum":{"num_bytes":4432308,"num_objects":61,"num_object_clones":5,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":23,"num_read":1614,"num_read_kb":2891,"num_write":419,"num_write_kb":2370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":297202,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"82'194","reported_seq":1056,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.357588+0000","last_change":"2024-09-13T05:10:12.076857+0000","last_active":"2024-09-13T05:11:20.357588+0000","last_peered":"2024-09-13T05:11:20.357588+0000","last_clean":"2024-09-13T05:11:20.357588+0000","last_became_active":"2024-09-13T05:10:09.644293+0000","last_became_peered":"2024-09-13T05:10:09.644293+0000","last_unstale":"2024-09-13T05:11:20.357588+0000","last_undegraded":"2024-09-13T05:11:20.357588+0000","last_fullsized":"2024-09-13T05:11:20.357588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:45:32.561793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225439,"stat_sum":{"num_bytes":26552467,"num_objects":56,"num_object_clones":7,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":28,"num_read":1342,"num_read_kb":4732,"num_write":167,"num_write_kb":3206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"82'234","reported_seq":2154,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350503+0000","last_change":"2024-09-13T05:10:11.645342+0000","last_active":"2024-09-13T05:11:20.350503+0000","last_peered":"2024-09-13T05:11:20.350503+0000","last_clean":"2024-09-13T05:11:20.350503+0000","last_became_active":"2024-09-13T05:10:09.645791+0000","last_became_peered":"2024-09-13T05:10:09.645791+0000","last_unstale":"2024-09-13T05:11:20.350503+0000","last_undegraded":"2024-09-13T05:11:20.350503+0000","last_fullsized":"2024-09-13T05:11:20.350503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:49.028553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072691800000000001,"stat_sum":{"num_bytes":33288741,"num_objects":76,"num_object_clones":13,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":32,"num_read":1957,"num_read_kb":11839,"num_write":196,"num_write_kb":4852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"81'523","reported_seq":2510,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350868+0000","last_change":"2024-09-13T05:10:31.949427+0000","last_active":"2024-09-13T05:11:20.350868+0000","last_peered":"2024-09-13T05:11:20.350868+0000","last_clean":"2024-09-13T05:11:20.350868+0000","last_became_active":"2024-09-13T05:10:31.828206+0000","last_became_peered":"2024-09-13T05:10:31.828206+0000","last_unstale":"2024-09-13T05:11:20.350868+0000","last_undegraded":"2024-09-13T05:11:20.350868+0000","last_fullsized":"2024-09-13T05:11:20.350868+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:32:46.868249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078437299999999999,"stat_sum":{"num_bytes":14843968,"num_objects":57,"num_object_clones":9,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":23,"num_read":4135,"num_read_kb":16509,"num_write":687,"num_write_kb":7839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":372837,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'328","reported_seq":1326,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356100+0000","last_change":"2024-09-13T05:10:37.990899+0000","last_active":"2024-09-13T05:11:20.356100+0000","last_peered":"2024-09-13T05:11:20.356100+0000","last_clean":"2024-09-13T05:11:20.356100+0000","last_became_active":"2024-09-13T05:10:37.867842+0000","last_became_peered":"2024-09-13T05:10:37.867842+0000","last_unstale":"2024-09-13T05:11:20.356100+0000","last_undegraded":"2024-09-13T05:11:20.356100+0000","last_fullsized":"2024-09-13T05:11:20.356100+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:38:24.437617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065808499999999999,"stat_sum":{"num_bytes":10335452,"num_objects":66,"num_object_clones":8,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":33,"num_read":2088,"num_read_kb":5710,"num_write":339,"num_write_kb":8660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":612052,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"81'269","reported_seq":3250,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.352366+0000","last_change":"2024-09-13T05:10:37.948112+0000","last_active":"2024-09-13T05:11:20.352366+0000","last_peered":"2024-09-13T05:11:20.352366+0000","last_clean":"2024-09-13T05:11:20.352366+0000","last_became_active":"2024-09-13T05:10:37.863614+0000","last_became_peered":"2024-09-13T05:10:37.863614+0000","last_unstale":"2024-09-13T05:11:20.352366+0000","last_undegraded":"2024-09-13T05:11:20.352366+0000","last_fullsized":"2024-09-13T05:11:20.352366+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:15.873724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027226559999999999,"stat_sum":{"num_bytes":12785593,"num_objects":73,"num_object_clones":10,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":30,"num_read":3419,"num_read_kb":7048,"num_write":224,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":77,"num_bytes_recovered":1081937,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"82'550","reported_seq":2529,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356910+0000","last_change":"2024-09-13T05:10:34.613940+0000","last_active":"2024-09-13T05:11:20.356910+0000","last_peered":"2024-09-13T05:11:20.356910+0000","last_clean":"2024-09-13T05:11:20.356910+0000","last_became_active":"2024-09-13T05:10:34.612579+0000","last_became_peered":"2024-09-13T05:10:34.612579+0000","last_unstale":"2024-09-13T05:11:20.356910+0000","last_undegraded":"2024-09-13T05:11:20.356910+0000","last_fullsized":"2024-09-13T05:11:20.356910+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:43.339882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067403999999999999,"stat_sum":{"num_bytes":52132499,"num_objects":67,"num_object_clones":10,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":27,"num_read":4360,"num_read_kb":17477,"num_write":732,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":248973,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"82'312","reported_seq":1519,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.358136+0000","last_change":"2024-09-13T05:10:37.929523+0000","last_active":"2024-09-13T05:11:20.358136+0000","last_peered":"2024-09-13T05:11:20.358136+0000","last_clean":"2024-09-13T05:11:20.358136+0000","last_became_active":"2024-09-13T05:10:37.865440+0000","last_became_peered":"2024-09-13T05:10:37.865440+0000","last_unstale":"2024-09-13T05:11:20.358136+0000","last_undegraded":"2024-09-13T05:11:20.358136+0000","last_fullsized":"2024-09-13T05:11:20.358136+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:30:31.875141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087399999999998,"stat_sum":{"num_bytes":23966439,"num_objects":75,"num_object_clones":12,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":41,"num_read":1531,"num_read_kb":13147,"num_write":317,"num_write_kb":9444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":1513234,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"82'282","reported_seq":1906,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350868+0000","last_change":"2024-09-13T05:10:37.920810+0000","last_active":"2024-09-13T05:11:20.350868+0000","last_peered":"2024-09-13T05:11:20.350868+0000","last_clean":"2024-09-13T05:11:20.350868+0000","last_became_active":"2024-09-13T05:10:37.864816+0000","last_became_peered":"2024-09-13T05:10:37.864816+0000","last_unstale":"2024-09-13T05:11:20.350868+0000","last_undegraded":"2024-09-13T05:11:20.350868+0000","last_fullsized":"2024-09-13T05:11:20.350868+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:06.315864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096598599999999995,"stat_sum":{"num_bytes":8008426,"num_objects":49,"num_object_clones":5,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":23,"num_read":3422,"num_read_kb":5977,"num_write":249,"num_write_kb":2787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":37802,"num_keys_recovered":23,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"82'242","reported_seq":1792,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.359759+0000","last_change":"2024-09-13T05:11:21.359759+0000","last_active":"2024-09-13T05:11:21.359759+0000","last_peered":"2024-09-13T05:11:19.636191+0000","last_clean":"2024-09-13T05:11:19.636191+0000","last_became_active":"2024-09-13T05:11:16.318103+0000","last_became_peered":"2024-09-13T05:11:16.318103+0000","last_unstale":"2024-09-13T05:11:21.359759+0000","last_undegraded":"2024-09-13T05:11:21.359759+0000","last_fullsized":"2024-09-13T05:11:21.359759+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:26:59.453898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072236499999999999,"stat_sum":{"num_bytes":33427991,"num_objects":63,"num_object_clones":14,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":33,"num_read":1467,"num_read_kb":10421,"num_write":205,"num_write_kb":3380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":2367921,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"82'278","reported_seq":1494,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.357948+0000","last_change":"2024-09-13T05:10:11.681217+0000","last_active":"2024-09-13T05:11:20.357948+0000","last_peered":"2024-09-13T05:11:20.357948+0000","last_clean":"2024-09-13T05:11:20.357948+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:11:20.357948+0000","last_undegraded":"2024-09-13T05:11:20.357948+0000","last_fullsized":"2024-09-13T05:11:20.357948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:40.457636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095533399999999996,"stat_sum":{"num_bytes":15069163,"num_objects":59,"num_object_clones":11,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":31,"num_read":1761,"num_read_kb":10093,"num_write":332,"num_write_kb":6418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"82'252","reported_seq":3932,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356606+0000","last_change":"2024-09-13T05:10:11.681365+0000","last_active":"2024-09-13T05:11:20.356606+0000","last_peered":"2024-09-13T05:11:20.356606+0000","last_clean":"2024-09-13T05:11:20.356606+0000","last_became_active":"2024-09-13T05:10:09.645823+0000","last_became_peered":"2024-09-13T05:10:09.645823+0000","last_unstale":"2024-09-13T05:11:20.356606+0000","last_undegraded":"2024-09-13T05:11:20.356606+0000","last_fullsized":"2024-09-13T05:11:20.356606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:24.367358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011047369999999999,"stat_sum":{"num_bytes":40943795,"num_objects":70,"num_object_clones":11,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":36,"num_read":3719,"num_read_kb":26564,"num_write":218,"num_write_kb":5946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.354092+0000","last_change":"2024-09-13T05:10:01.383891+0000","last_active":"2024-09-13T05:11:20.354092+0000","last_peered":"2024-09-13T05:11:20.354092+0000","last_clean":"2024-09-13T05:11:20.354092+0000","last_became_active":"2024-09-13T05:09:59.374793+0000","last_became_peered":"2024-09-13T05:09:59.374793+0000","last_unstale":"2024-09-13T05:11:20.354092+0000","last_undegraded":"2024-09-13T05:11:20.354092+0000","last_fullsized":"2024-09-13T05:11:20.354092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:02.499446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065068999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"81'208","reported_seq":4630,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.355141+0000","last_change":"2024-09-13T05:11:21.355557+0000","last_active":"2024-09-13T05:11:20.356777+0000","last_peered":"2024-09-13T05:11:19.396360+0000","last_clean":"2024-09-13T05:11:19.396360+0000","last_became_active":"2024-09-13T05:11:16.320129+0000","last_became_peered":"2024-09-13T05:11:16.320129+0000","last_unstale":"2024-09-13T05:11:21.355141+0000","last_undegraded":"2024-09-13T05:11:21.355141+0000","last_fullsized":"2024-09-13T05:11:21.355141+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:46.094415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099899699999999995,"stat_sum":{"num_bytes":30257384,"num_objects":54,"num_object_clones":7,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":25,"num_read":3334,"num_read_kb":12021,"num_write":170,"num_write_kb":6871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":9357649,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.354122+0000","last_change":"2024-09-13T05:10:31.826927+0000","last_active":"2024-09-13T05:11:20.354122+0000","last_peered":"2024-09-13T05:11:20.354122+0000","last_clean":"2024-09-13T05:11:20.354122+0000","last_became_active":"2024-09-13T05:10:31.826431+0000","last_became_peered":"2024-09-13T05:10:31.826431+0000","last_unstale":"2024-09-13T05:11:20.354122+0000","last_undegraded":"2024-09-13T05:11:20.354122+0000","last_fullsized":"2024-09-13T05:11:20.354122+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:13:36.678853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"82'235","reported_seq":1353,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.357116+0000","last_change":"2024-09-13T05:10:12.077111+0000","last_active":"2024-09-13T05:11:20.357116+0000","last_peered":"2024-09-13T05:11:20.357116+0000","last_clean":"2024-09-13T05:11:20.357116+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:11:20.357116+0000","last_undegraded":"2024-09-13T05:11:20.357116+0000","last_fullsized":"2024-09-13T05:11:20.357116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:37.976147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001460444,"stat_sum":{"num_bytes":51840824,"num_objects":65,"num_object_clones":7,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":36,"num_read":1243,"num_read_kb":10722,"num_write":204,"num_write_kb":3289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":88,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.358251+0000","last_change":"2024-09-13T05:10:37.866953+0000","last_active":"2024-09-13T05:11:20.358251+0000","last_peered":"2024-09-13T05:11:20.358251+0000","last_clean":"2024-09-13T05:11:20.358251+0000","last_became_active":"2024-09-13T05:10:37.866624+0000","last_became_peered":"2024-09-13T05:10:37.866624+0000","last_unstale":"2024-09-13T05:11:20.358251+0000","last_undegraded":"2024-09-13T05:11:20.358251+0000","last_fullsized":"2024-09-13T05:11:20.358251+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:56:20.077971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"82'395","reported_seq":869,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.360669+0000","last_change":"2024-09-13T05:11:21.361787+0000","last_active":"2024-09-13T05:11:20.353207+0000","last_peered":"2024-09-13T05:11:19.588315+0000","last_clean":"2024-09-13T05:11:19.588315+0000","last_became_active":"2024-09-13T05:11:16.320218+0000","last_became_peered":"2024-09-13T05:11:16.320218+0000","last_unstale":"2024-09-13T05:11:21.360669+0000","last_undegraded":"2024-09-13T05:11:21.360669+0000","last_fullsized":"2024-09-13T05:11:21.360669+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:55.459490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076234800000000004,"stat_sum":{"num_bytes":12725004,"num_objects":62,"num_object_clones":5,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":32,"num_read":1423,"num_read_kb":2480,"num_write":544,"num_write_kb":3485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":1446352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356542+0000","last_change":"2024-09-13T05:10:37.864940+0000","last_active":"2024-09-13T05:11:20.356542+0000","last_peered":"2024-09-13T05:11:20.356542+0000","last_clean":"2024-09-13T05:11:20.356542+0000","last_became_active":"2024-09-13T05:10:37.864623+0000","last_became_peered":"2024-09-13T05:10:37.864623+0000","last_unstale":"2024-09-13T05:11:20.356542+0000","last_undegraded":"2024-09-13T05:11:20.356542+0000","last_fullsized":"2024-09-13T05:11:20.356542+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:41.598490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.5","version":"82'304","reported_seq":2657,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350596+0000","last_change":"2024-09-13T05:10:11.645960+0000","last_active":"2024-09-13T05:11:20.350596+0000","last_peered":"2024-09-13T05:11:20.350596+0000","last_clean":"2024-09-13T05:11:20.350596+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:11:20.350596+0000","last_undegraded":"2024-09-13T05:11:20.350596+0000","last_fullsized":"2024-09-13T05:11:20.350596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:40.372741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001054028,"stat_sum":{"num_bytes":68392647,"num_objects":67,"num_object_clones":8,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":25,"num_read":3566,"num_read_kb":55119,"num_write":289,"num_write_kb":37660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"82'421","reported_seq":2245,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.352386+0000","last_change":"2024-09-13T05:10:37.979816+0000","last_active":"2024-09-13T05:11:20.352386+0000","last_peered":"2024-09-13T05:11:20.352386+0000","last_clean":"2024-09-13T05:11:20.352386+0000","last_became_active":"2024-09-13T05:10:37.863256+0000","last_became_peered":"2024-09-13T05:10:37.863256+0000","last_unstale":"2024-09-13T05:11:20.352386+0000","last_undegraded":"2024-09-13T05:11:20.352386+0000","last_fullsized":"2024-09-13T05:11:20.352386+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:58:55.928356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099335200000000008,"stat_sum":{"num_bytes":55125174,"num_objects":60,"num_object_clones":8,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":31,"num_read":3071,"num_read_kb":18570,"num_write":534,"num_write_kb":24635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":214109,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350590+0000","last_change":"2024-09-13T05:10:31.836193+0000","last_active":"2024-09-13T05:11:20.350590+0000","last_peered":"2024-09-13T05:11:20.350590+0000","last_clean":"2024-09-13T05:11:20.350590+0000","last_became_active":"2024-09-13T05:10:31.825663+0000","last_became_peered":"2024-09-13T05:10:31.825663+0000","last_unstale":"2024-09-13T05:11:20.350590+0000","last_undegraded":"2024-09-13T05:11:20.350590+0000","last_fullsized":"2024-09-13T05:11:20.350590+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:38:23.311570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"82'308","reported_seq":648,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.351978+0000","last_change":"2024-09-13T05:10:31.893494+0000","last_active":"2024-09-13T05:11:20.351978+0000","last_peered":"2024-09-13T05:11:20.351978+0000","last_clean":"2024-09-13T05:11:20.351978+0000","last_became_active":"2024-09-13T05:10:31.827657+0000","last_became_peered":"2024-09-13T05:10:31.827657+0000","last_unstale":"2024-09-13T05:11:20.351978+0000","last_undegraded":"2024-09-13T05:11:20.351978+0000","last_fullsized":"2024-09-13T05:11:20.351978+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:16:14.432049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045163499999999998,"stat_sum":{"num_bytes":9373413,"num_objects":64,"num_object_clones":10,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":30,"num_read":946,"num_read_kb":2010,"num_write":355,"num_write_kb":1595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":84179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.352208+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:11:20.352208+0000","last_peered":"2024-09-13T05:11:20.352208+0000","last_clean":"2024-09-13T05:11:20.352208+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:11:20.352208+0000","last_undegraded":"2024-09-13T05:11:20.352208+0000","last_fullsized":"2024-09-13T05:11:20.352208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"82'199","reported_seq":621,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356737+0000","last_change":"2024-09-13T05:10:38.111510+0000","last_active":"2024-09-13T05:11:20.356737+0000","last_peered":"2024-09-13T05:11:20.356737+0000","last_clean":"2024-09-13T05:11:20.356737+0000","last_became_active":"2024-09-13T05:10:37.869040+0000","last_became_peered":"2024-09-13T05:10:37.869040+0000","last_unstale":"2024-09-13T05:11:20.356737+0000","last_undegraded":"2024-09-13T05:11:20.356737+0000","last_fullsized":"2024-09-13T05:11:20.356737+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:48:18.385423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048152600000000002,"stat_sum":{"num_bytes":14153518,"num_objects":53,"num_object_clones":8,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":28,"num_read":372,"num_read_kb":6477,"num_write":183,"num_write_kb":7640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":383717,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.355963+0000","last_change":"2024-09-13T05:10:37.865514+0000","last_active":"2024-09-13T05:11:20.355963+0000","last_peered":"2024-09-13T05:11:20.355963+0000","last_clean":"2024-09-13T05:11:20.355963+0000","last_became_active":"2024-09-13T05:10:37.864299+0000","last_became_peered":"2024-09-13T05:10:37.864299+0000","last_unstale":"2024-09-13T05:11:20.355963+0000","last_undegraded":"2024-09-13T05:11:20.355963+0000","last_fullsized":"2024-09-13T05:11:20.355963+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:45:58.276509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"82'291","reported_seq":1424,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.361675+0000","last_change":"2024-09-13T05:11:21.361851+0000","last_active":"2024-09-13T05:11:20.357426+0000","last_peered":"2024-09-13T05:11:19.677565+0000","last_clean":"2024-09-13T05:11:19.677565+0000","last_became_active":"2024-09-13T05:11:16.318497+0000","last_became_peered":"2024-09-13T05:11:16.318497+0000","last_unstale":"2024-09-13T05:11:21.361675+0000","last_undegraded":"2024-09-13T05:11:21.361675+0000","last_fullsized":"2024-09-13T05:11:21.361675+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:41:26.275072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059320200000000003,"stat_sum":{"num_bytes":2453385,"num_objects":63,"num_object_clones":6,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":30,"num_read":2378,"num_read_kb":4246,"num_write":246,"num_write_kb":2311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":1411492,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350763+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:11:20.350763+0000","last_peered":"2024-09-13T05:11:20.350763+0000","last_clean":"2024-09-13T05:11:20.350763+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:11:20.350763+0000","last_undegraded":"2024-09-13T05:11:20.350763+0000","last_fullsized":"2024-09-13T05:11:20.350763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":249,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356133+0000","last_change":"2024-09-13T05:10:40.886011+0000","last_active":"2024-09-13T05:11:20.356133+0000","last_peered":"2024-09-13T05:11:20.356133+0000","last_clean":"2024-09-13T05:11:20.356133+0000","last_became_active":"2024-09-13T05:10:40.885587+0000","last_became_peered":"2024-09-13T05:10:40.885587+0000","last_unstale":"2024-09-13T05:11:20.356133+0000","last_undegraded":"2024-09-13T05:11:20.356133+0000","last_fullsized":"2024-09-13T05:11:20.356133+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:52:47.632734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"82'200","reported_seq":462,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.358238+0000","last_change":"2024-09-13T05:10:31.888827+0000","last_active":"2024-09-13T05:11:20.358238+0000","last_peered":"2024-09-13T05:11:20.358238+0000","last_clean":"2024-09-13T05:11:20.358238+0000","last_became_active":"2024-09-13T05:10:31.827016+0000","last_became_peered":"2024-09-13T05:10:31.827016+0000","last_unstale":"2024-09-13T05:11:20.358238+0000","last_undegraded":"2024-09-13T05:11:20.358238+0000","last_fullsized":"2024-09-13T05:11:20.358238+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:47.525525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000500144,"stat_sum":{"num_bytes":5421745,"num_objects":68,"num_object_clones":8,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":38,"num_read":219,"num_read_kb":1292,"num_write":156,"num_write_kb":24142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":58925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"82'242","reported_seq":5921,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.352030+0000","last_change":"2024-09-13T05:10:11.648218+0000","last_active":"2024-09-13T05:11:20.352030+0000","last_peered":"2024-09-13T05:11:20.352030+0000","last_clean":"2024-09-13T05:11:20.352030+0000","last_became_active":"2024-09-13T05:10:09.645408+0000","last_became_peered":"2024-09-13T05:10:09.645408+0000","last_unstale":"2024-09-13T05:11:20.352030+0000","last_undegraded":"2024-09-13T05:11:20.352030+0000","last_fullsized":"2024-09-13T05:11:20.352030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:59.846981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097828900000000002,"stat_sum":{"num_bytes":26732733,"num_objects":55,"num_object_clones":5,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":24,"num_read":6916,"num_read_kb":20339,"num_write":199,"num_write_kb":5391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"82'378","reported_seq":8606,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356790+0000","last_change":"2024-09-13T05:10:47.940550+0000","last_active":"2024-09-13T05:11:20.356790+0000","last_peered":"2024-09-13T05:11:20.356790+0000","last_clean":"2024-09-13T05:11:20.356790+0000","last_became_active":"2024-09-13T05:10:47.939220+0000","last_became_peered":"2024-09-13T05:10:47.939220+0000","last_unstale":"2024-09-13T05:11:20.356790+0000","last_undegraded":"2024-09-13T05:11:20.356790+0000","last_fullsized":"2024-09-13T05:11:20.356790+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:59.693041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013204619999999999,"stat_sum":{"num_bytes":5708351,"num_objects":63,"num_object_clones":9,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":33,"num_read":8750,"num_read_kb":12319,"num_write":427,"num_write_kb":6929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":59,"num_bytes_recovered":6203954,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"81'216","reported_seq":1693,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356722+0000","last_change":"2024-09-13T05:10:38.007507+0000","last_active":"2024-09-13T05:11:20.356722+0000","last_peered":"2024-09-13T05:11:20.356722+0000","last_clean":"2024-09-13T05:11:20.356722+0000","last_became_active":"2024-09-13T05:10:37.868643+0000","last_became_peered":"2024-09-13T05:10:37.868643+0000","last_unstale":"2024-09-13T05:11:20.356722+0000","last_undegraded":"2024-09-13T05:11:20.356722+0000","last_fullsized":"2024-09-13T05:11:20.356722+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:29:05.387242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055343700000000005,"stat_sum":{"num_bytes":6059553,"num_objects":62,"num_object_clones":11,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":35,"num_read":1443,"num_read_kb":3806,"num_write":176,"num_write_kb":6478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":15854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"82'152","reported_seq":514,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350963+0000","last_change":"2024-09-13T05:10:11.647302+0000","last_active":"2024-09-13T05:11:20.350963+0000","last_peered":"2024-09-13T05:11:20.350963+0000","last_clean":"2024-09-13T05:11:20.350963+0000","last_became_active":"2024-09-13T05:10:09.647037+0000","last_became_peered":"2024-09-13T05:10:09.647037+0000","last_unstale":"2024-09-13T05:11:20.350963+0000","last_undegraded":"2024-09-13T05:11:20.350963+0000","last_fullsized":"2024-09-13T05:11:20.350963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:54:17.061326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069994199999999995,"stat_sum":{"num_bytes":23527409,"num_objects":54,"num_object_clones":7,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":27,"num_read":362,"num_read_kb":4460,"num_write":133,"num_write_kb":3240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"82'538","reported_seq":3722,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.355244+0000","last_change":"2024-09-13T05:11:21.355680+0000","last_active":"2024-09-13T05:11:20.356779+0000","last_peered":"2024-09-13T05:11:19.588900+0000","last_clean":"2024-09-13T05:11:19.588900+0000","last_became_active":"2024-09-13T05:11:16.320142+0000","last_became_peered":"2024-09-13T05:11:16.320142+0000","last_unstale":"2024-09-13T05:11:21.355244+0000","last_undegraded":"2024-09-13T05:11:21.355244+0000","last_fullsized":"2024-09-13T05:11:21.355244+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:22:28.513701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019283150000000001,"stat_sum":{"num_bytes":67865030,"num_objects":68,"num_object_clones":7,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":29,"num_read":4868,"num_read_kb":14274,"num_write":691,"num_write_kb":7824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":6390508,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"82'706","reported_seq":4976,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.356791+0000","last_change":"2024-09-13T05:11:21.357157+0000","last_active":"2024-09-13T05:11:20.357722+0000","last_peered":"2024-09-13T05:11:19.473240+0000","last_clean":"2024-09-13T05:11:19.473240+0000","last_became_active":"2024-09-13T05:11:17.320630+0000","last_became_peered":"2024-09-13T05:11:17.320630+0000","last_unstale":"2024-09-13T05:11:21.356791+0000","last_undegraded":"2024-09-13T05:11:21.356791+0000","last_fullsized":"2024-09-13T05:11:21.356791+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:59:37.099760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018982339999999999,"stat_sum":{"num_bytes":21050383,"num_objects":62,"num_object_clones":5,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":33,"num_read":5865,"num_read_kb":6503,"num_write":1074,"num_write_kb":5137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":5447772,"num_keys_recovered":27,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"81'571","reported_seq":1739,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356396+0000","last_change":"2024-09-13T05:10:40.885332+0000","last_active":"2024-09-13T05:11:20.356396+0000","last_peered":"2024-09-13T05:11:20.356396+0000","last_clean":"2024-09-13T05:11:20.356396+0000","last_became_active":"2024-09-13T05:10:40.884585+0000","last_became_peered":"2024-09-13T05:10:40.884585+0000","last_unstale":"2024-09-13T05:11:20.356396+0000","last_undegraded":"2024-09-13T05:11:20.356396+0000","last_fullsized":"2024-09-13T05:11:20.356396+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:31:19.596080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001164273,"stat_sum":{"num_bytes":16441807,"num_objects":62,"num_object_clones":8,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":33,"num_read":3424,"num_read_kb":11070,"num_write":814,"num_write_kb":6507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":296075,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"82'304","reported_seq":1645,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.360339+0000","last_change":"2024-09-13T05:11:21.360699+0000","last_active":"2024-09-13T05:11:20.351535+0000","last_peered":"2024-09-13T05:11:19.586024+0000","last_clean":"2024-09-13T05:11:19.586024+0000","last_became_active":"2024-09-13T05:11:16.318398+0000","last_became_peered":"2024-09-13T05:11:16.318398+0000","last_unstale":"2024-09-13T05:11:21.360339+0000","last_undegraded":"2024-09-13T05:11:21.360339+0000","last_fullsized":"2024-09-13T05:11:21.360339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:15.586596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009951719999999999,"stat_sum":{"num_bytes":34507347,"num_objects":70,"num_object_clones":5,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":30,"num_read":1883,"num_read_kb":13826,"num_write":314,"num_write_kb":6862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":6115400,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"82'208","reported_seq":550,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356242+0000","last_change":"2024-09-13T05:10:11.680757+0000","last_active":"2024-09-13T05:11:20.356242+0000","last_peered":"2024-09-13T05:11:20.356242+0000","last_clean":"2024-09-13T05:11:20.356242+0000","last_became_active":"2024-09-13T05:10:09.653444+0000","last_became_peered":"2024-09-13T05:10:09.653444+0000","last_unstale":"2024-09-13T05:11:20.356242+0000","last_undegraded":"2024-09-13T05:11:20.356242+0000","last_fullsized":"2024-09-13T05:11:20.356242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:17:06.303008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000625977,"stat_sum":{"num_bytes":11696067,"num_objects":69,"num_object_clones":9,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":37,"num_read":367,"num_read_kb":8786,"num_write":170,"num_write_kb":4690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"82'654","reported_seq":2276,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356098+0000","last_change":"2024-09-13T05:10:40.884306+0000","last_active":"2024-09-13T05:11:20.356098+0000","last_peered":"2024-09-13T05:11:20.356098+0000","last_clean":"2024-09-13T05:11:20.356098+0000","last_became_active":"2024-09-13T05:10:40.883543+0000","last_became_peered":"2024-09-13T05:10:40.883543+0000","last_unstale":"2024-09-13T05:11:20.356098+0000","last_undegraded":"2024-09-13T05:11:20.356098+0000","last_fullsized":"2024-09-13T05:11:20.356098+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:14:23.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048307200000000003,"stat_sum":{"num_bytes":57651425,"num_objects":62,"num_object_clones":10,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":28,"num_read":4555,"num_read_kb":19689,"num_write":918,"num_write_kb":5670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":633324,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"82'610","reported_seq":2086,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356890+0000","last_change":"2024-09-13T05:10:11.680877+0000","last_active":"2024-09-13T05:11:20.356890+0000","last_peered":"2024-09-13T05:11:20.356890+0000","last_clean":"2024-09-13T05:11:20.356890+0000","last_became_active":"2024-09-13T05:10:09.649053+0000","last_became_peered":"2024-09-13T05:10:09.649053+0000","last_unstale":"2024-09-13T05:11:20.356890+0000","last_undegraded":"2024-09-13T05:11:20.356890+0000","last_fullsized":"2024-09-13T05:11:20.356890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:14.770260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062821800000000005,"stat_sum":{"num_bytes":45221010,"num_objects":79,"num_object_clones":14,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":38,"num_read":3681,"num_read_kb":45427,"num_write":857,"num_write_kb":38413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":841991051,"num_objects":2034,"num_object_clones":272,"num_object_copies":4068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2034,"num_whiteouts":982,"num_read":89481,"num_read_kb":405844,"num_write":12539,"num_write_kb":271018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1299,"num_bytes_recovered":44591268,"num_keys_recovered":167,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":279560192,"data_stored":308393489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10950,"ondisk_log_size":10950,"up":64,"acting":58,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120844,"kb_used_data":71680,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94250996,"statfs":{"total":96636764160,"available":96513019904,"internally_reserved":0,"allocated":73400320,"data_stored":79819178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":50330059},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.751}]},{"osd":1,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.88500000000000001}]},{"osd":2,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.0609999999999999}]},{"osd":3,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.95199999999999996}]},{"osd":4,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.97999999999999998}]},{"osd":5,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.117},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.92400000000000004}]},{"osd":6,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.0820000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79332,"kb_used_data":39900,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94292508,"statfs":{"total":96636764160,"available":96555528192,"internally_reserved":0,"allocated":40857600,"data_stored":45907384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.64500000000000002}]},{"osd":1,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.82999999999999996}]},{"osd":2,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":1.109},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.93600000000000005}]},{"osd":3,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.1719999999999999}]},{"osd":4,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.752}]},{"osd":5,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.014}]},{"osd":7,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.2350000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70344,"kb_used_data":39224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94301496,"statfs":{"total":96636764160,"available":96564731904,"internally_reserved":0,"allocated":40165376,"data_stored":40304922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.96799999999999997}]},{"osd":1,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.83599999999999997}]},{"osd":2,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.627},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.90500000000000003}]},{"osd":3,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.131}]},{"osd":4,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.014},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.153}]},{"osd":6,"last update":"Fri Sep 13 05:10:58 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.107}]},{"osd":7,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.079},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.2}]}]},{"osd":4,"up_from":0,"seq":55834574871,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102824,"kb_used_data":71704,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94269016,"statfs":{"total":96636764160,"available":96531472384,"internally_reserved":0,"allocated":73424896,"data_stored":79410349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.41699999999999998}]},{"osd":1,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.442}]},{"osd":2,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.54000000000000004}]},{"osd":4,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.71999999999999997}]},{"osd":5,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.65700000000000003}]},{"osd":6,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.70199999999999996}]},{"osd":7,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.878},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.80900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79520,"kb_used_data":40208,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94292320,"statfs":{"total":96636764160,"available":96555335680,"internally_reserved":0,"allocated":41172992,"data_stored":44207117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.69199999999999995}]},{"osd":1,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.90700000000000003}]},{"osd":3,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.84799999999999998}]},{"osd":4,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.997}]},{"osd":5,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.0209999999999999}]},{"osd":6,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.048}]},{"osd":7,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.093},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.98299999999999998}]}]},{"osd":1,"up_from":0,"seq":55834574869,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":0,"seq":55834574871,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10035200,"data_stored":11939429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6619136,"data_stored":10238144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40181760,"data_stored":43752921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":72433664,"data_stored":78956153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":39182336,"data_stored":39856947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":39280640,"data_stored":44869041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":71827456,"data_stored":78780854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:11:22.739 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:11:22.746 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #25, image image_client.0-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent26 2024-09-13T05:11:22.759 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:22.759 INFO:teuthology.orchestra.run.smithi120.stdout:3477 read 0x28a5b89 thru 0x28b2254 (0xc6cc bytes) 2024-09-13T05:11:22.766 INFO:teuthology.orchestra.run.smithi120.stdout:3478 write 0x326deae thru 0x327923d (0xb390 bytes) 2024-09-13T05:11:22.788 INFO:teuthology.orchestra.run.smithi120.stdout:3479 write 0x7a4cc1f thru 0x7a574f6 (0xa8d8 bytes) 2024-09-13T05:11:22.792 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:22.785+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:22.792 INFO:teuthology.orchestra.run.smithi120.stdout:3481 write 0x30a7881 thru 0x30af523 (0x7ca3 bytes) 2024-09-13T05:11:22.799 INFO:teuthology.orchestra.run.smithi120.stdout:3482 punch from 0x5d9a67c to 0x5d9d274, (0x2bf8 bytes) 2024-09-13T05:11:22.800 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:22.810 INFO:teuthology.orchestra.run.smithi120.stdout:3484 writesame 0x852436e thru 0x852acaa data_size 0x1(0x693d bytes) 2024-09-13T05:11:22.815 INFO:teuthology.orchestra.run.smithi120.stdout:3486 read 0x20b83e3 thru 0x20c65cb (0xe1e9 bytes) 2024-09-13T05:11:22.816 INFO:teuthology.orchestra.run.smithi120.stdout:3487 writesame 0x5b8f4b9 thru 0x5b95f69 data_size 0x1(0x6ab1 bytes) 2024-09-13T05:11:22.839 INFO:teuthology.orchestra.run.smithi120.stdout:3488 write 0x7b6bac2 thru 0x7b73c19 (0x8158 bytes) 2024-09-13T05:11:22.844 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:11:22.845 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:22.845 INFO:teuthology.orchestra.run.smithi120.stdout:3490 punch from 0x103f4cc to 0x1043f9f, (0x4ad3 bytes) 2024-09-13T05:11:22.846 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:22.846 INFO:teuthology.orchestra.run.smithi120.stdout:3494 read 0x4bafcbf thru 0x4bbe5f2 (0xe934 bytes) 2024-09-13T05:11:22.846 INFO:teuthology.orchestra.run.smithi120.stdout:3495 read 0x28882c9 thru 0x288c5f9 (0x4331 bytes) 2024-09-13T05:11:22.848 INFO:teuthology.orchestra.run.smithi120.stdout:3496 punch from 0x635e66f to 0x6366ae2, (0x8473 bytes) 2024-09-13T05:11:22.848 INFO:teuthology.orchestra.run.smithi120.stdout:3497 read 0x3cb701a thru 0x3cc5182 (0xe169 bytes) 2024-09-13T05:11:22.848 INFO:teuthology.orchestra.run.smithi120.stdout:3498 punch from 0x499b865 to 0x49a3f9e, (0x8739 bytes) 2024-09-13T05:11:22.848 INFO:teuthology.orchestra.run.smithi120.stdout:3499 writesame 0x38de27 thru 0x38f2e9 data_size 0x1(0x14c3 bytes) 2024-09-13T05:11:22.853 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:22.853 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:22.861 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:22.861 INFO:teuthology.orchestra.run.smithi120.stdout:3501 read 0x74d116c thru 0x74daed6 (0x9d6b bytes) 2024-09-13T05:11:22.864 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:11:22.872 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:11:22.879 INFO:teuthology.orchestra.run.smithi120.stdout:3502 writesame 0xe0921c8 thru 0xe09daff data_size 0x4(0xb938 bytes) 2024-09-13T05:11:22.879 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:22.879 INFO:teuthology.orchestra.run.smithi120.stdout:3508 write 0x30c5911 thru 0x30cdd16 (0x8406 bytes) 2024-09-13T05:11:22.882 INFO:teuthology.orchestra.run.smithi120.stdout:3510 punch from 0xdde4c2f to 0xddeda76, (0x8e47 bytes) 2024-09-13T05:11:22.882 INFO:teuthology.orchestra.run.smithi120.stdout:3511 write 0xd336193 thru 0xd342519 (0xc387 bytes) 2024-09-13T05:11:22.888 INFO:teuthology.orchestra.run.smithi120.stdout:3513 read 0x505ebc2 thru 0x5063e9e (0x52dd bytes) 2024-09-13T05:11:22.892 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:22.885+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:22.894 INFO:teuthology.orchestra.run.smithi120.stdout:3515 trunc from 0xe09db00 to 0xac01566 2024-09-13T05:11:22.899 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:11:22.905 INFO:teuthology.orchestra.run.smithi120.stdout:3516 read 0x17ae33e thru 0x17bd1b6 (0xee79 bytes) 2024-09-13T05:11:22.906 INFO:teuthology.orchestra.run.smithi120.stdout:3517 read 0x5ade52f thru 0x5aecfdb (0xeaad bytes) 2024-09-13T05:11:22.907 INFO:teuthology.orchestra.run.smithi120.stdout:3519 write 0x50d8135 thru 0x50da23a (0x2106 bytes) 2024-09-13T05:11:22.926 INFO:teuthology.orchestra.run.smithi120.stdout:3520 trunc from 0xac01566 to 0x1e889a6 2024-09-13T05:11:22.932 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:11:22.963 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:11:22.986 INFO:teuthology.orchestra.run.smithi120.stdout:3521 punch from 0xcec513 to 0xceccb2, (0x79f bytes) 2024-09-13T05:11:22.987 INFO:teuthology.orchestra.run.smithi120.stdout:3522 punch from 0xe0a77a to 0xe16f6c, (0xc7f2 bytes) 2024-09-13T05:11:22.987 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:11:22.990 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:22.990 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:22.990 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:11:22.990 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:22.993 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:22.990+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:23.001 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:11:23.011 INFO:teuthology.orchestra.run.smithi120.stdout:3523 write 0xae5bd6d thru 0xae617c9 (0x5a5d bytes) 2024-09-13T05:11:23.012 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:11:23.034 INFO:teuthology.orchestra.run.smithi120.stdout:3525 write 0xe18f5c7 thru 0xe19b1f5 (0xbc2f bytes) 2024-09-13T05:11:23.038 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:11:23.040 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:11:23.040 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:11:23.040 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:11:23.040 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:11:23.041 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:11:23.041 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:11:23.041 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:11:23.041 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:11:23.046 INFO:teuthology.orchestra.run.smithi120.stdout:3526 trunc from 0xe19b1f6 to 0x893ccf3 2024-09-13T05:11:23.062 INFO:teuthology.orchestra.run.smithi120.stdout:3527 punch from 0x4dec403 to 0x4df86c9, (0xc2c6 bytes) 2024-09-13T05:11:23.062 INFO:teuthology.orchestra.run.smithi120.stdout:3528 write 0x17a8993 thru 0x17aaa2c (0x209a bytes) 2024-09-13T05:11:23.066 INFO:teuthology.orchestra.run.smithi120.stdout:3529 read 0x5e7447b thru 0x5e7d7fc (0x9382 bytes) 2024-09-13T05:11:23.087 INFO:teuthology.orchestra.run.smithi120.stdout:3532 writesame 0xe12734b thru 0xe12d414 data_size 0xd(0x60ca bytes) 2024-09-13T05:11:23.087 INFO:teuthology.orchestra.run.smithi120.stdout:3535 clone 28 order 24 su 2097152 sc 15 2024-09-13T05:11:23.094 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:23.089+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:23.110 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:11:23.112 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:11:23.117 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:23.117 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:23.117 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:23.117 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:23.117 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:23.125 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2024-09-13T05:11:22.353141+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":842581438,"num_objects":2038,"num_object_clones":272,"num_object_copies":4076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2038,"num_whiteouts":982,"num_read":89597,"num_read_kb":405944,"num_write":12700,"num_write_kb":273436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1302,"num_bytes_recovered":45181655,"num_keys_recovered":167,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11070,"ondisk_log_size":11070,"up":82,"acting":76,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":452864,"kb_used_data":262716,"kb_used_omap":7,"kb_used_meta":189944,"kb_avail":471406336,"statfs":{"total":483183820800,"available":482720088064,"internally_reserved":0,"allocated":269021184,"data_stored":289648950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7962,"internal_metadata":194502886},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8851593,"num_objects":107,"num_object_clones":26,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":26,"num_read":5275,"num_read_kb":25334,"num_write":1095,"num_write_kb":3290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.032404"},"pg_stats":[{"pgid":"3.1f","version":"82'346","reported_seq":906,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350704+0000","last_change":"2024-09-13T05:10:37.993400+0000","last_active":"2024-09-13T05:11:20.350704+0000","last_peered":"2024-09-13T05:11:20.350704+0000","last_clean":"2024-09-13T05:11:20.350704+0000","last_became_active":"2024-09-13T05:10:37.864778+0000","last_became_peered":"2024-09-13T05:10:37.864778+0000","last_unstale":"2024-09-13T05:11:20.350704+0000","last_undegraded":"2024-09-13T05:11:20.350704+0000","last_fullsized":"2024-09-13T05:11:20.350704+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:56:24.801492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011835439999999999,"stat_sum":{"num_bytes":4432308,"num_objects":61,"num_object_clones":5,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":23,"num_read":1614,"num_read_kb":2891,"num_write":419,"num_write_kb":2370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":297202,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"82'194","reported_seq":1056,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.357588+0000","last_change":"2024-09-13T05:10:12.076857+0000","last_active":"2024-09-13T05:11:20.357588+0000","last_peered":"2024-09-13T05:11:20.357588+0000","last_clean":"2024-09-13T05:11:20.357588+0000","last_became_active":"2024-09-13T05:10:09.644293+0000","last_became_peered":"2024-09-13T05:10:09.644293+0000","last_unstale":"2024-09-13T05:11:20.357588+0000","last_undegraded":"2024-09-13T05:11:20.357588+0000","last_fullsized":"2024-09-13T05:11:20.357588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:45:32.561793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225439,"stat_sum":{"num_bytes":26552467,"num_objects":56,"num_object_clones":7,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":28,"num_read":1342,"num_read_kb":4732,"num_write":167,"num_write_kb":3206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"82'234","reported_seq":2154,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350503+0000","last_change":"2024-09-13T05:10:11.645342+0000","last_active":"2024-09-13T05:11:20.350503+0000","last_peered":"2024-09-13T05:11:20.350503+0000","last_clean":"2024-09-13T05:11:20.350503+0000","last_became_active":"2024-09-13T05:10:09.645791+0000","last_became_peered":"2024-09-13T05:10:09.645791+0000","last_unstale":"2024-09-13T05:11:20.350503+0000","last_undegraded":"2024-09-13T05:11:20.350503+0000","last_fullsized":"2024-09-13T05:11:20.350503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:49.028553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072691800000000001,"stat_sum":{"num_bytes":33288741,"num_objects":76,"num_object_clones":13,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":32,"num_read":1957,"num_read_kb":11839,"num_write":196,"num_write_kb":4852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"81'523","reported_seq":2510,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350868+0000","last_change":"2024-09-13T05:10:31.949427+0000","last_active":"2024-09-13T05:11:20.350868+0000","last_peered":"2024-09-13T05:11:20.350868+0000","last_clean":"2024-09-13T05:11:20.350868+0000","last_became_active":"2024-09-13T05:10:31.828206+0000","last_became_peered":"2024-09-13T05:10:31.828206+0000","last_unstale":"2024-09-13T05:11:20.350868+0000","last_undegraded":"2024-09-13T05:11:20.350868+0000","last_fullsized":"2024-09-13T05:11:20.350868+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:32:46.868249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078437299999999999,"stat_sum":{"num_bytes":14843968,"num_objects":57,"num_object_clones":9,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":23,"num_read":4135,"num_read_kb":16509,"num_write":687,"num_write_kb":7839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":372837,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'328","reported_seq":1326,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356100+0000","last_change":"2024-09-13T05:10:37.990899+0000","last_active":"2024-09-13T05:11:20.356100+0000","last_peered":"2024-09-13T05:11:20.356100+0000","last_clean":"2024-09-13T05:11:20.356100+0000","last_became_active":"2024-09-13T05:10:37.867842+0000","last_became_peered":"2024-09-13T05:10:37.867842+0000","last_unstale":"2024-09-13T05:11:20.356100+0000","last_undegraded":"2024-09-13T05:11:20.356100+0000","last_fullsized":"2024-09-13T05:11:20.356100+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:38:24.437617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065808499999999999,"stat_sum":{"num_bytes":10335452,"num_objects":66,"num_object_clones":8,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":33,"num_read":2088,"num_read_kb":5710,"num_write":339,"num_write_kb":8660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":612052,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"81'269","reported_seq":3250,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.352366+0000","last_change":"2024-09-13T05:10:37.948112+0000","last_active":"2024-09-13T05:11:20.352366+0000","last_peered":"2024-09-13T05:11:20.352366+0000","last_clean":"2024-09-13T05:11:20.352366+0000","last_became_active":"2024-09-13T05:10:37.863614+0000","last_became_peered":"2024-09-13T05:10:37.863614+0000","last_unstale":"2024-09-13T05:11:20.352366+0000","last_undegraded":"2024-09-13T05:11:20.352366+0000","last_fullsized":"2024-09-13T05:11:20.352366+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:15.873724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027226559999999999,"stat_sum":{"num_bytes":12785593,"num_objects":73,"num_object_clones":10,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":30,"num_read":3419,"num_read_kb":7048,"num_write":224,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":77,"num_bytes_recovered":1081937,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"82'550","reported_seq":2529,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356910+0000","last_change":"2024-09-13T05:10:34.613940+0000","last_active":"2024-09-13T05:11:20.356910+0000","last_peered":"2024-09-13T05:11:20.356910+0000","last_clean":"2024-09-13T05:11:20.356910+0000","last_became_active":"2024-09-13T05:10:34.612579+0000","last_became_peered":"2024-09-13T05:10:34.612579+0000","last_unstale":"2024-09-13T05:11:20.356910+0000","last_undegraded":"2024-09-13T05:11:20.356910+0000","last_fullsized":"2024-09-13T05:11:20.356910+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:43.339882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067403999999999999,"stat_sum":{"num_bytes":52132499,"num_objects":67,"num_object_clones":10,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":27,"num_read":4360,"num_read_kb":17477,"num_write":732,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":248973,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"82'312","reported_seq":1519,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.358136+0000","last_change":"2024-09-13T05:10:37.929523+0000","last_active":"2024-09-13T05:11:20.358136+0000","last_peered":"2024-09-13T05:11:20.358136+0000","last_clean":"2024-09-13T05:11:20.358136+0000","last_became_active":"2024-09-13T05:10:37.865440+0000","last_became_peered":"2024-09-13T05:10:37.865440+0000","last_unstale":"2024-09-13T05:11:20.358136+0000","last_undegraded":"2024-09-13T05:11:20.358136+0000","last_fullsized":"2024-09-13T05:11:20.358136+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:30:31.875141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087399999999998,"stat_sum":{"num_bytes":23966439,"num_objects":75,"num_object_clones":12,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":41,"num_read":1531,"num_read_kb":13147,"num_write":317,"num_write_kb":9444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":1513234,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"82'282","reported_seq":1906,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350868+0000","last_change":"2024-09-13T05:10:37.920810+0000","last_active":"2024-09-13T05:11:20.350868+0000","last_peered":"2024-09-13T05:11:20.350868+0000","last_clean":"2024-09-13T05:11:20.350868+0000","last_became_active":"2024-09-13T05:10:37.864816+0000","last_became_peered":"2024-09-13T05:10:37.864816+0000","last_unstale":"2024-09-13T05:11:20.350868+0000","last_undegraded":"2024-09-13T05:11:20.350868+0000","last_fullsized":"2024-09-13T05:11:20.350868+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:06.315864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096598599999999995,"stat_sum":{"num_bytes":8008426,"num_objects":49,"num_object_clones":5,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":23,"num_read":3422,"num_read_kb":5977,"num_write":249,"num_write_kb":2787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":37802,"num_keys_recovered":23,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"82'242","reported_seq":1792,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.359759+0000","last_change":"2024-09-13T05:11:21.359759+0000","last_active":"2024-09-13T05:11:21.359759+0000","last_peered":"2024-09-13T05:11:19.636191+0000","last_clean":"2024-09-13T05:11:19.636191+0000","last_became_active":"2024-09-13T05:11:16.318103+0000","last_became_peered":"2024-09-13T05:11:16.318103+0000","last_unstale":"2024-09-13T05:11:21.359759+0000","last_undegraded":"2024-09-13T05:11:21.359759+0000","last_fullsized":"2024-09-13T05:11:21.359759+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:26:59.453898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072236499999999999,"stat_sum":{"num_bytes":33427991,"num_objects":63,"num_object_clones":14,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":33,"num_read":1467,"num_read_kb":10421,"num_write":205,"num_write_kb":3380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":2367921,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"82'278","reported_seq":1494,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.357948+0000","last_change":"2024-09-13T05:10:11.681217+0000","last_active":"2024-09-13T05:11:20.357948+0000","last_peered":"2024-09-13T05:11:20.357948+0000","last_clean":"2024-09-13T05:11:20.357948+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:11:20.357948+0000","last_undegraded":"2024-09-13T05:11:20.357948+0000","last_fullsized":"2024-09-13T05:11:20.357948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:40.457636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095533399999999996,"stat_sum":{"num_bytes":15069163,"num_objects":59,"num_object_clones":11,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":31,"num_read":1761,"num_read_kb":10093,"num_write":332,"num_write_kb":6418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"82'252","reported_seq":3932,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356606+0000","last_change":"2024-09-13T05:10:11.681365+0000","last_active":"2024-09-13T05:11:20.356606+0000","last_peered":"2024-09-13T05:11:20.356606+0000","last_clean":"2024-09-13T05:11:20.356606+0000","last_became_active":"2024-09-13T05:10:09.645823+0000","last_became_peered":"2024-09-13T05:10:09.645823+0000","last_unstale":"2024-09-13T05:11:20.356606+0000","last_undegraded":"2024-09-13T05:11:20.356606+0000","last_fullsized":"2024-09-13T05:11:20.356606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:24.367358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011047369999999999,"stat_sum":{"num_bytes":40943795,"num_objects":70,"num_object_clones":11,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":36,"num_read":3719,"num_read_kb":26564,"num_write":218,"num_write_kb":5946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.354092+0000","last_change":"2024-09-13T05:10:01.383891+0000","last_active":"2024-09-13T05:11:20.354092+0000","last_peered":"2024-09-13T05:11:20.354092+0000","last_clean":"2024-09-13T05:11:20.354092+0000","last_became_active":"2024-09-13T05:09:59.374793+0000","last_became_peered":"2024-09-13T05:09:59.374793+0000","last_unstale":"2024-09-13T05:11:20.354092+0000","last_undegraded":"2024-09-13T05:11:20.354092+0000","last_fullsized":"2024-09-13T05:11:20.354092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:02.499446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065068999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"81'208","reported_seq":4630,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.355141+0000","last_change":"2024-09-13T05:11:21.355557+0000","last_active":"2024-09-13T05:11:20.356777+0000","last_peered":"2024-09-13T05:11:19.396360+0000","last_clean":"2024-09-13T05:11:19.396360+0000","last_became_active":"2024-09-13T05:11:16.320129+0000","last_became_peered":"2024-09-13T05:11:16.320129+0000","last_unstale":"2024-09-13T05:11:21.355141+0000","last_undegraded":"2024-09-13T05:11:21.355141+0000","last_fullsized":"2024-09-13T05:11:21.355141+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:46.094415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099899699999999995,"stat_sum":{"num_bytes":30257384,"num_objects":54,"num_object_clones":7,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":25,"num_read":3334,"num_read_kb":12021,"num_write":170,"num_write_kb":6871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":9357649,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.354122+0000","last_change":"2024-09-13T05:10:31.826927+0000","last_active":"2024-09-13T05:11:20.354122+0000","last_peered":"2024-09-13T05:11:20.354122+0000","last_clean":"2024-09-13T05:11:20.354122+0000","last_became_active":"2024-09-13T05:10:31.826431+0000","last_became_peered":"2024-09-13T05:10:31.826431+0000","last_unstale":"2024-09-13T05:11:20.354122+0000","last_undegraded":"2024-09-13T05:11:20.354122+0000","last_fullsized":"2024-09-13T05:11:20.354122+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:13:36.678853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"82'235","reported_seq":1353,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.357116+0000","last_change":"2024-09-13T05:10:12.077111+0000","last_active":"2024-09-13T05:11:20.357116+0000","last_peered":"2024-09-13T05:11:20.357116+0000","last_clean":"2024-09-13T05:11:20.357116+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:11:20.357116+0000","last_undegraded":"2024-09-13T05:11:20.357116+0000","last_fullsized":"2024-09-13T05:11:20.357116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:37.976147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001460444,"stat_sum":{"num_bytes":51840824,"num_objects":65,"num_object_clones":7,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":36,"num_read":1243,"num_read_kb":10722,"num_write":204,"num_write_kb":3289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":88,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.358251+0000","last_change":"2024-09-13T05:10:37.866953+0000","last_active":"2024-09-13T05:11:20.358251+0000","last_peered":"2024-09-13T05:11:20.358251+0000","last_clean":"2024-09-13T05:11:20.358251+0000","last_became_active":"2024-09-13T05:10:37.866624+0000","last_became_peered":"2024-09-13T05:10:37.866624+0000","last_unstale":"2024-09-13T05:11:20.358251+0000","last_undegraded":"2024-09-13T05:11:20.358251+0000","last_fullsized":"2024-09-13T05:11:20.358251+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:56:20.077971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"82'395","reported_seq":869,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.360669+0000","last_change":"2024-09-13T05:11:21.361787+0000","last_active":"2024-09-13T05:11:20.353207+0000","last_peered":"2024-09-13T05:11:19.588315+0000","last_clean":"2024-09-13T05:11:19.588315+0000","last_became_active":"2024-09-13T05:11:16.320218+0000","last_became_peered":"2024-09-13T05:11:16.320218+0000","last_unstale":"2024-09-13T05:11:21.360669+0000","last_undegraded":"2024-09-13T05:11:21.360669+0000","last_fullsized":"2024-09-13T05:11:21.360669+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:55.459490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076234800000000004,"stat_sum":{"num_bytes":12725004,"num_objects":62,"num_object_clones":5,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":32,"num_read":1423,"num_read_kb":2480,"num_write":544,"num_write_kb":3485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":1446352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356542+0000","last_change":"2024-09-13T05:10:37.864940+0000","last_active":"2024-09-13T05:11:20.356542+0000","last_peered":"2024-09-13T05:11:20.356542+0000","last_clean":"2024-09-13T05:11:20.356542+0000","last_became_active":"2024-09-13T05:10:37.864623+0000","last_became_peered":"2024-09-13T05:10:37.864623+0000","last_unstale":"2024-09-13T05:11:20.356542+0000","last_undegraded":"2024-09-13T05:11:20.356542+0000","last_fullsized":"2024-09-13T05:11:20.356542+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:41.598490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.5","version":"82'304","reported_seq":2657,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350596+0000","last_change":"2024-09-13T05:10:11.645960+0000","last_active":"2024-09-13T05:11:20.350596+0000","last_peered":"2024-09-13T05:11:20.350596+0000","last_clean":"2024-09-13T05:11:20.350596+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:11:20.350596+0000","last_undegraded":"2024-09-13T05:11:20.350596+0000","last_fullsized":"2024-09-13T05:11:20.350596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:40.372741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001054028,"stat_sum":{"num_bytes":68392647,"num_objects":67,"num_object_clones":8,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":25,"num_read":3566,"num_read_kb":55119,"num_write":289,"num_write_kb":37660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"82'421","reported_seq":2245,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.352386+0000","last_change":"2024-09-13T05:10:37.979816+0000","last_active":"2024-09-13T05:11:20.352386+0000","last_peered":"2024-09-13T05:11:20.352386+0000","last_clean":"2024-09-13T05:11:20.352386+0000","last_became_active":"2024-09-13T05:10:37.863256+0000","last_became_peered":"2024-09-13T05:10:37.863256+0000","last_unstale":"2024-09-13T05:11:20.352386+0000","last_undegraded":"2024-09-13T05:11:20.352386+0000","last_fullsized":"2024-09-13T05:11:20.352386+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:58:55.928356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099335200000000008,"stat_sum":{"num_bytes":55125174,"num_objects":60,"num_object_clones":8,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":31,"num_read":3071,"num_read_kb":18570,"num_write":534,"num_write_kb":24635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":214109,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350590+0000","last_change":"2024-09-13T05:10:31.836193+0000","last_active":"2024-09-13T05:11:20.350590+0000","last_peered":"2024-09-13T05:11:20.350590+0000","last_clean":"2024-09-13T05:11:20.350590+0000","last_became_active":"2024-09-13T05:10:31.825663+0000","last_became_peered":"2024-09-13T05:10:31.825663+0000","last_unstale":"2024-09-13T05:11:20.350590+0000","last_undegraded":"2024-09-13T05:11:20.350590+0000","last_fullsized":"2024-09-13T05:11:20.350590+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:38:23.311570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"82'308","reported_seq":648,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.351978+0000","last_change":"2024-09-13T05:10:31.893494+0000","last_active":"2024-09-13T05:11:20.351978+0000","last_peered":"2024-09-13T05:11:20.351978+0000","last_clean":"2024-09-13T05:11:20.351978+0000","last_became_active":"2024-09-13T05:10:31.827657+0000","last_became_peered":"2024-09-13T05:10:31.827657+0000","last_unstale":"2024-09-13T05:11:20.351978+0000","last_undegraded":"2024-09-13T05:11:20.351978+0000","last_fullsized":"2024-09-13T05:11:20.351978+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:16:14.432049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045163499999999998,"stat_sum":{"num_bytes":9373413,"num_objects":64,"num_object_clones":10,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":30,"num_read":946,"num_read_kb":2010,"num_write":355,"num_write_kb":1595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":84179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.352208+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:11:20.352208+0000","last_peered":"2024-09-13T05:11:20.352208+0000","last_clean":"2024-09-13T05:11:20.352208+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:11:20.352208+0000","last_undegraded":"2024-09-13T05:11:20.352208+0000","last_fullsized":"2024-09-13T05:11:20.352208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"82'199","reported_seq":621,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356737+0000","last_change":"2024-09-13T05:10:38.111510+0000","last_active":"2024-09-13T05:11:20.356737+0000","last_peered":"2024-09-13T05:11:20.356737+0000","last_clean":"2024-09-13T05:11:20.356737+0000","last_became_active":"2024-09-13T05:10:37.869040+0000","last_became_peered":"2024-09-13T05:10:37.869040+0000","last_unstale":"2024-09-13T05:11:20.356737+0000","last_undegraded":"2024-09-13T05:11:20.356737+0000","last_fullsized":"2024-09-13T05:11:20.356737+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:48:18.385423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048152600000000002,"stat_sum":{"num_bytes":14153518,"num_objects":53,"num_object_clones":8,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":28,"num_read":372,"num_read_kb":6477,"num_write":183,"num_write_kb":7640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":383717,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.355963+0000","last_change":"2024-09-13T05:10:37.865514+0000","last_active":"2024-09-13T05:11:20.355963+0000","last_peered":"2024-09-13T05:11:20.355963+0000","last_clean":"2024-09-13T05:11:20.355963+0000","last_became_active":"2024-09-13T05:10:37.864299+0000","last_became_peered":"2024-09-13T05:10:37.864299+0000","last_unstale":"2024-09-13T05:11:20.355963+0000","last_undegraded":"2024-09-13T05:11:20.355963+0000","last_fullsized":"2024-09-13T05:11:20.355963+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:45:58.276509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"82'291","reported_seq":1424,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.361675+0000","last_change":"2024-09-13T05:11:21.361851+0000","last_active":"2024-09-13T05:11:20.357426+0000","last_peered":"2024-09-13T05:11:19.677565+0000","last_clean":"2024-09-13T05:11:19.677565+0000","last_became_active":"2024-09-13T05:11:16.318497+0000","last_became_peered":"2024-09-13T05:11:16.318497+0000","last_unstale":"2024-09-13T05:11:21.361675+0000","last_undegraded":"2024-09-13T05:11:21.361675+0000","last_fullsized":"2024-09-13T05:11:21.361675+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:41:26.275072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059320200000000003,"stat_sum":{"num_bytes":2453385,"num_objects":63,"num_object_clones":6,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":30,"num_read":2378,"num_read_kb":4246,"num_write":246,"num_write_kb":2311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":1411492,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350763+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:11:20.350763+0000","last_peered":"2024-09-13T05:11:20.350763+0000","last_clean":"2024-09-13T05:11:20.350763+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:11:20.350763+0000","last_undegraded":"2024-09-13T05:11:20.350763+0000","last_fullsized":"2024-09-13T05:11:20.350763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":249,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356133+0000","last_change":"2024-09-13T05:10:40.886011+0000","last_active":"2024-09-13T05:11:20.356133+0000","last_peered":"2024-09-13T05:11:20.356133+0000","last_clean":"2024-09-13T05:11:20.356133+0000","last_became_active":"2024-09-13T05:10:40.885587+0000","last_became_peered":"2024-09-13T05:10:40.885587+0000","last_unstale":"2024-09-13T05:11:20.356133+0000","last_undegraded":"2024-09-13T05:11:20.356133+0000","last_fullsized":"2024-09-13T05:11:20.356133+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:52:47.632734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"82'200","reported_seq":462,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.358238+0000","last_change":"2024-09-13T05:10:31.888827+0000","last_active":"2024-09-13T05:11:20.358238+0000","last_peered":"2024-09-13T05:11:20.358238+0000","last_clean":"2024-09-13T05:11:20.358238+0000","last_became_active":"2024-09-13T05:10:31.827016+0000","last_became_peered":"2024-09-13T05:10:31.827016+0000","last_unstale":"2024-09-13T05:11:20.358238+0000","last_undegraded":"2024-09-13T05:11:20.358238+0000","last_fullsized":"2024-09-13T05:11:20.358238+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:47.525525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000500144,"stat_sum":{"num_bytes":5421745,"num_objects":68,"num_object_clones":8,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":38,"num_read":219,"num_read_kb":1292,"num_write":156,"num_write_kb":24142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":58925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"82'242","reported_seq":5921,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.352030+0000","last_change":"2024-09-13T05:10:11.648218+0000","last_active":"2024-09-13T05:11:20.352030+0000","last_peered":"2024-09-13T05:11:20.352030+0000","last_clean":"2024-09-13T05:11:20.352030+0000","last_became_active":"2024-09-13T05:10:09.645408+0000","last_became_peered":"2024-09-13T05:10:09.645408+0000","last_unstale":"2024-09-13T05:11:20.352030+0000","last_undegraded":"2024-09-13T05:11:20.352030+0000","last_fullsized":"2024-09-13T05:11:20.352030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:59.846981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097828900000000002,"stat_sum":{"num_bytes":26732733,"num_objects":55,"num_object_clones":5,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":24,"num_read":6916,"num_read_kb":20339,"num_write":199,"num_write_kb":5391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"82'378","reported_seq":8606,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356790+0000","last_change":"2024-09-13T05:10:47.940550+0000","last_active":"2024-09-13T05:11:20.356790+0000","last_peered":"2024-09-13T05:11:20.356790+0000","last_clean":"2024-09-13T05:11:20.356790+0000","last_became_active":"2024-09-13T05:10:47.939220+0000","last_became_peered":"2024-09-13T05:10:47.939220+0000","last_unstale":"2024-09-13T05:11:20.356790+0000","last_undegraded":"2024-09-13T05:11:20.356790+0000","last_fullsized":"2024-09-13T05:11:20.356790+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:59.693041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013204619999999999,"stat_sum":{"num_bytes":5708351,"num_objects":63,"num_object_clones":9,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":33,"num_read":8750,"num_read_kb":12319,"num_write":427,"num_write_kb":6929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":59,"num_bytes_recovered":6203954,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"81'216","reported_seq":1693,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356722+0000","last_change":"2024-09-13T05:10:38.007507+0000","last_active":"2024-09-13T05:11:20.356722+0000","last_peered":"2024-09-13T05:11:20.356722+0000","last_clean":"2024-09-13T05:11:20.356722+0000","last_became_active":"2024-09-13T05:10:37.868643+0000","last_became_peered":"2024-09-13T05:10:37.868643+0000","last_unstale":"2024-09-13T05:11:20.356722+0000","last_undegraded":"2024-09-13T05:11:20.356722+0000","last_fullsized":"2024-09-13T05:11:20.356722+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:29:05.387242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055343700000000005,"stat_sum":{"num_bytes":6059553,"num_objects":62,"num_object_clones":11,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":35,"num_read":1443,"num_read_kb":3806,"num_write":176,"num_write_kb":6478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":15854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"82'152","reported_seq":514,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350963+0000","last_change":"2024-09-13T05:10:11.647302+0000","last_active":"2024-09-13T05:11:20.350963+0000","last_peered":"2024-09-13T05:11:20.350963+0000","last_clean":"2024-09-13T05:11:20.350963+0000","last_became_active":"2024-09-13T05:10:09.647037+0000","last_became_peered":"2024-09-13T05:10:09.647037+0000","last_unstale":"2024-09-13T05:11:20.350963+0000","last_undegraded":"2024-09-13T05:11:20.350963+0000","last_fullsized":"2024-09-13T05:11:20.350963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:54:17.061326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069994199999999995,"stat_sum":{"num_bytes":23527409,"num_objects":54,"num_object_clones":7,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":27,"num_read":362,"num_read_kb":4460,"num_write":133,"num_write_kb":3240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"82'538","reported_seq":3722,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.355244+0000","last_change":"2024-09-13T05:11:21.355680+0000","last_active":"2024-09-13T05:11:20.356779+0000","last_peered":"2024-09-13T05:11:19.588900+0000","last_clean":"2024-09-13T05:11:19.588900+0000","last_became_active":"2024-09-13T05:11:16.320142+0000","last_became_peered":"2024-09-13T05:11:16.320142+0000","last_unstale":"2024-09-13T05:11:21.355244+0000","last_undegraded":"2024-09-13T05:11:21.355244+0000","last_fullsized":"2024-09-13T05:11:21.355244+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:22:28.513701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019283150000000001,"stat_sum":{"num_bytes":67865030,"num_objects":68,"num_object_clones":7,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":29,"num_read":4868,"num_read_kb":14274,"num_write":691,"num_write_kb":7824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":6390508,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"82'706","reported_seq":4976,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.356791+0000","last_change":"2024-09-13T05:11:21.357157+0000","last_active":"2024-09-13T05:11:20.357722+0000","last_peered":"2024-09-13T05:11:19.473240+0000","last_clean":"2024-09-13T05:11:19.473240+0000","last_became_active":"2024-09-13T05:11:17.320630+0000","last_became_peered":"2024-09-13T05:11:17.320630+0000","last_unstale":"2024-09-13T05:11:21.356791+0000","last_undegraded":"2024-09-13T05:11:21.356791+0000","last_fullsized":"2024-09-13T05:11:21.356791+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:59:37.099760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018982339999999999,"stat_sum":{"num_bytes":21050383,"num_objects":62,"num_object_clones":5,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":33,"num_read":5865,"num_read_kb":6503,"num_write":1074,"num_write_kb":5137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":5447772,"num_keys_recovered":27,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"81'571","reported_seq":1739,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356396+0000","last_change":"2024-09-13T05:10:40.885332+0000","last_active":"2024-09-13T05:11:20.356396+0000","last_peered":"2024-09-13T05:11:20.356396+0000","last_clean":"2024-09-13T05:11:20.356396+0000","last_became_active":"2024-09-13T05:10:40.884585+0000","last_became_peered":"2024-09-13T05:10:40.884585+0000","last_unstale":"2024-09-13T05:11:20.356396+0000","last_undegraded":"2024-09-13T05:11:20.356396+0000","last_fullsized":"2024-09-13T05:11:20.356396+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:31:19.596080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001164273,"stat_sum":{"num_bytes":16441807,"num_objects":62,"num_object_clones":8,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":33,"num_read":3424,"num_read_kb":11070,"num_write":814,"num_write_kb":6507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":296075,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"82'304","reported_seq":1645,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.360339+0000","last_change":"2024-09-13T05:11:21.360699+0000","last_active":"2024-09-13T05:11:20.351535+0000","last_peered":"2024-09-13T05:11:19.586024+0000","last_clean":"2024-09-13T05:11:19.586024+0000","last_became_active":"2024-09-13T05:11:16.318398+0000","last_became_peered":"2024-09-13T05:11:16.318398+0000","last_unstale":"2024-09-13T05:11:21.360339+0000","last_undegraded":"2024-09-13T05:11:21.360339+0000","last_fullsized":"2024-09-13T05:11:21.360339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:15.586596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009951719999999999,"stat_sum":{"num_bytes":34507347,"num_objects":70,"num_object_clones":5,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":30,"num_read":1883,"num_read_kb":13826,"num_write":314,"num_write_kb":6862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":6115400,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"82'208","reported_seq":550,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356242+0000","last_change":"2024-09-13T05:10:11.680757+0000","last_active":"2024-09-13T05:11:20.356242+0000","last_peered":"2024-09-13T05:11:20.356242+0000","last_clean":"2024-09-13T05:11:20.356242+0000","last_became_active":"2024-09-13T05:10:09.653444+0000","last_became_peered":"2024-09-13T05:10:09.653444+0000","last_unstale":"2024-09-13T05:11:20.356242+0000","last_undegraded":"2024-09-13T05:11:20.356242+0000","last_fullsized":"2024-09-13T05:11:20.356242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:17:06.303008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000625977,"stat_sum":{"num_bytes":11696067,"num_objects":69,"num_object_clones":9,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":37,"num_read":367,"num_read_kb":8786,"num_write":170,"num_write_kb":4690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"82'654","reported_seq":2276,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356098+0000","last_change":"2024-09-13T05:10:40.884306+0000","last_active":"2024-09-13T05:11:20.356098+0000","last_peered":"2024-09-13T05:11:20.356098+0000","last_clean":"2024-09-13T05:11:20.356098+0000","last_became_active":"2024-09-13T05:10:40.883543+0000","last_became_peered":"2024-09-13T05:10:40.883543+0000","last_unstale":"2024-09-13T05:11:20.356098+0000","last_undegraded":"2024-09-13T05:11:20.356098+0000","last_fullsized":"2024-09-13T05:11:20.356098+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:14:23.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048307200000000003,"stat_sum":{"num_bytes":57651425,"num_objects":62,"num_object_clones":10,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":28,"num_read":4555,"num_read_kb":19689,"num_write":918,"num_write_kb":5670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":633324,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"82'610","reported_seq":2086,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356890+0000","last_change":"2024-09-13T05:10:11.680877+0000","last_active":"2024-09-13T05:11:20.356890+0000","last_peered":"2024-09-13T05:11:20.356890+0000","last_clean":"2024-09-13T05:11:20.356890+0000","last_became_active":"2024-09-13T05:10:09.649053+0000","last_became_peered":"2024-09-13T05:10:09.649053+0000","last_unstale":"2024-09-13T05:11:20.356890+0000","last_undegraded":"2024-09-13T05:11:20.356890+0000","last_fullsized":"2024-09-13T05:11:20.356890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:14.770260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062821800000000005,"stat_sum":{"num_bytes":45221010,"num_objects":79,"num_object_clones":14,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":38,"num_read":3681,"num_read_kb":45427,"num_write":857,"num_write_kb":38413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":841991051,"num_objects":2034,"num_object_clones":272,"num_object_copies":4068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2034,"num_whiteouts":982,"num_read":89481,"num_read_kb":405844,"num_write":12539,"num_write_kb":271018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1299,"num_bytes_recovered":44591268,"num_keys_recovered":167,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":279560192,"data_stored":308393489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10950,"ondisk_log_size":10950,"up":64,"acting":58,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120844,"kb_used_data":71680,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94250996,"statfs":{"total":96636764160,"available":96513019904,"internally_reserved":0,"allocated":73400320,"data_stored":79819178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":50330059},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.751}]},{"osd":1,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.88500000000000001}]},{"osd":2,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.0609999999999999}]},{"osd":3,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.95199999999999996}]},{"osd":4,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.97999999999999998}]},{"osd":5,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.117},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.92400000000000004}]},{"osd":6,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.0820000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79332,"kb_used_data":39900,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94292508,"statfs":{"total":96636764160,"available":96555528192,"internally_reserved":0,"allocated":40857600,"data_stored":45907384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.64500000000000002}]},{"osd":1,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.82999999999999996}]},{"osd":2,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":1.109},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.93600000000000005}]},{"osd":3,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.1719999999999999}]},{"osd":4,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.752}]},{"osd":5,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.014}]},{"osd":7,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.2350000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70344,"kb_used_data":39224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94301496,"statfs":{"total":96636764160,"available":96564731904,"internally_reserved":0,"allocated":40165376,"data_stored":40304922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.96799999999999997}]},{"osd":1,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.83599999999999997}]},{"osd":2,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.627},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.90500000000000003}]},{"osd":3,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.131}]},{"osd":4,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.014},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.153}]},{"osd":6,"last update":"Fri Sep 13 05:10:58 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.107}]},{"osd":7,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.079},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.2}]}]},{"osd":4,"up_from":0,"seq":55834574871,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102824,"kb_used_data":71704,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94269016,"statfs":{"total":96636764160,"available":96531472384,"internally_reserved":0,"allocated":73424896,"data_stored":79410349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.41699999999999998}]},{"osd":1,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.442}]},{"osd":2,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.54000000000000004}]},{"osd":4,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.71999999999999997}]},{"osd":5,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.65700000000000003}]},{"osd":6,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.70199999999999996}]},{"osd":7,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.878},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.80900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79520,"kb_used_data":40208,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94292320,"statfs":{"total":96636764160,"available":96555335680,"internally_reserved":0,"allocated":41172992,"data_stored":44207117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.69199999999999995}]},{"osd":1,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.90700000000000003}]},{"osd":3,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.84799999999999998}]},{"osd":4,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.997}]},{"osd":5,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.0209999999999999}]},{"osd":6,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.048}]},{"osd":7,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.093},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.98299999999999998}]}]},{"osd":1,"up_from":0,"seq":55834574869,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":0,"seq":55834574871,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10035200,"data_stored":11939429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6619136,"data_stored":10238144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40181760,"data_stored":43752921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":72433664,"data_stored":78956153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":39182336,"data_stored":39856947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":39280640,"data_stored":44869041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":71827456,"data_stored":78780854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:11:23.128 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T05:11:23.129 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:11:23.196 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:23.189+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:23.243 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:23.244 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:23.244 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:23.244 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:23.244 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.244 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47582 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15826944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:23.244 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.439939+0000", 2024-09-13T05:11:23.244 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 31.801554640999999, 2024-09-13T05:11:23.244 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032266203, 2024-09-13T05:11:23.244 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.244 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.244 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.244 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.244 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.245 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47582 2024-09-13T05:11:23.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.245 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.245 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.245 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.245 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439939+0000", 2024-09-13T05:11:23.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.245 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.245 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.245 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439939+0000", 2024-09-13T05:11:23.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439939+0000", 2024-09-13T05:11:23.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439949+0000", 2024-09-13T05:11:23.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0906e-05 2024-09-13T05:11:23.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439962+0000", 2024-09-13T05:11:23.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2373e-05 2024-09-13T05:11:23.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439969+0000", 2024-09-13T05:11:23.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0570000000000004e-06 2024-09-13T05:11:23.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.471645+0000", 2024-09-13T05:11:23.248 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031676530000000001 2024-09-13T05:11:23.248 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.248 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.248 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.471775+0000", 2024-09-13T05:11:23.248 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000129591 2024-09-13T05:11:23.248 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.248 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.248 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472205+0000", 2024-09-13T05:11:23.248 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00043034900000000001 2024-09-13T05:11:23.248 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.248 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.249 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.249 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.249 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.249 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47583 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16121856~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:23.249 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.439975+0000", 2024-09-13T05:11:23.249 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 31.801518835, 2024-09-13T05:11:23.249 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032777897, 2024-09-13T05:11:23.249 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.249 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.249 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.249 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.249 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.249 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47583 2024-09-13T05:11:23.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.250 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439975+0000", 2024-09-13T05:11:23.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439975+0000", 2024-09-13T05:11:23.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439974+0000", 2024-09-13T05:11:23.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439978+0000", 2024-09-13T05:11:23.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5729999999999999e-06 2024-09-13T05:11:23.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439991+0000", 2024-09-13T05:11:23.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3465999999999999e-05 2024-09-13T05:11:23.252 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.252 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.252 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.252 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.439998+0000", 2024-09-13T05:11:23.252 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8369999999999999e-06 2024-09-13T05:11:23.252 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.252 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.252 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.252 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472272+0000", 2024-09-13T05:11:23.252 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032273617999999997 2024-09-13T05:11:23.252 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.252 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.252 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.253 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472382+0000", 2024-09-13T05:11:23.253 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000109845 2024-09-13T05:11:23.253 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.253 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.253 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.253 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472753+0000", 2024-09-13T05:11:23.253 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00037116100000000001 2024-09-13T05:11:23.253 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.253 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.254 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.254 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.254 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.254 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47584 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16416768~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:23.254 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440004+0000", 2024-09-13T05:11:23.254 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 31.801489769, 2024-09-13T05:11:23.254 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033357242000000002, 2024-09-13T05:11:23.254 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.254 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.254 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.254 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.254 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.254 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47584 2024-09-13T05:11:23.254 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.255 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.255 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.255 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.255 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440004+0000", 2024-09-13T05:11:23.255 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.255 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.255 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.255 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.255 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440004+0000", 2024-09-13T05:11:23.255 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.255 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.255 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.255 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.255 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440003+0000", 2024-09-13T05:11:23.256 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.256 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.256 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.256 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.256 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440007+0000", 2024-09-13T05:11:23.256 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9099999999999998e-06 2024-09-13T05:11:23.256 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.256 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.256 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.256 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440020+0000", 2024-09-13T05:11:23.256 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2330000000000001e-05 2024-09-13T05:11:23.256 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.256 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.257 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.257 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440026+0000", 2024-09-13T05:11:23.257 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7700000000000004e-06 2024-09-13T05:11:23.257 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.257 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.257 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.257 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472807+0000", 2024-09-13T05:11:23.257 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032780431999999998 2024-09-13T05:11:23.257 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.257 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.257 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.257 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.472927+0000", 2024-09-13T05:11:23.257 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000119645 2024-09-13T05:11:23.258 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.258 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.258 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.258 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473361+0000", 2024-09-13T05:11:23.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000434745 2024-09-13T05:11:23.258 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.258 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.258 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.258 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.258 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.258 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47585 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16711680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:23.258 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440033+0000", 2024-09-13T05:11:23.258 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 31.801461233000001, 2024-09-13T05:11:23.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033917665999999999, 2024-09-13T05:11:23.259 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.259 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.259 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.259 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.259 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.259 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47585 2024-09-13T05:11:23.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.259 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.259 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.259 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440033+0000", 2024-09-13T05:11:23.259 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.260 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.260 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.260 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440033+0000", 2024-09-13T05:11:23.260 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.260 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.260 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.260 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.260 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440032+0000", 2024-09-13T05:11:23.260 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.260 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.260 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.260 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.260 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440036+0000", 2024-09-13T05:11:23.261 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.676e-06 2024-09-13T05:11:23.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.261 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.261 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.261 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440049+0000", 2024-09-13T05:11:23.261 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3142999999999999e-05 2024-09-13T05:11:23.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.261 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.261 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.261 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440056+0000", 2024-09-13T05:11:23.261 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.827e-06 2024-09-13T05:11:23.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.261 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.261 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.262 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473451+0000", 2024-09-13T05:11:23.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033395344 2024-09-13T05:11:23.262 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.262 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.262 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.262 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473565+0000", 2024-09-13T05:11:23.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011377700000000001 2024-09-13T05:11:23.262 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.262 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.262 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.262 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473950+0000", 2024-09-13T05:11:23.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00038550200000000002 2024-09-13T05:11:23.262 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.263 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.263 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.263 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.263 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.263 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47589 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15564800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:23.263 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440062+0000", 2024-09-13T05:11:23.263 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 31.801432247000001, 2024-09-13T05:11:23.263 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034520812999999997, 2024-09-13T05:11:23.263 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.263 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.263 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.263 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.263 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.263 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47589 2024-09-13T05:11:23.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.264 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.264 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440062+0000", 2024-09-13T05:11:23.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.264 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440062+0000", 2024-09-13T05:11:23.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.265 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.265 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440061+0000", 2024-09-13T05:11:23.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.265 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.265 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440064+0000", 2024-09-13T05:11:23.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4029999999999999e-06 2024-09-13T05:11:23.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.265 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.265 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440072+0000", 2024-09-13T05:11:23.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.79e-06 2024-09-13T05:11:23.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.266 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.266 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440079+0000", 2024-09-13T05:11:23.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.81e-06 2024-09-13T05:11:23.266 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.266 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.266 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474016+0000", 2024-09-13T05:11:23.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033936858 2024-09-13T05:11:23.266 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.266 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.266 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474143+0000", 2024-09-13T05:11:23.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012673599999999999 2024-09-13T05:11:23.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.267 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.267 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.267 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474582+0000", 2024-09-13T05:11:23.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00043982199999999998 2024-09-13T05:11:23.267 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.267 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.267 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.268 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.268 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47590 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15859712~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:23.268 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440085+0000", 2024-09-13T05:11:23.268 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 31.801409304, 2024-09-13T05:11:23.268 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035003000999999999, 2024-09-13T05:11:23.268 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.268 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.268 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.268 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.268 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.268 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47590 2024-09-13T05:11:23.268 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.269 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.269 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.269 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.269 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440085+0000", 2024-09-13T05:11:23.269 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.269 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.269 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.269 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.269 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440085+0000", 2024-09-13T05:11:23.269 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.269 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.269 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.269 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.269 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440084+0000", 2024-09-13T05:11:23.270 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.270 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.270 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.270 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.270 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440088+0000", 2024-09-13T05:11:23.270 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7759999999999999e-06 2024-09-13T05:11:23.270 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.270 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.270 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.270 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440100+0000", 2024-09-13T05:11:23.270 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2537e-05 2024-09-13T05:11:23.270 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.270 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.270 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.271 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440107+0000", 2024-09-13T05:11:23.271 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.046e-06 2024-09-13T05:11:23.271 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.271 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.271 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.271 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474648+0000", 2024-09-13T05:11:23.271 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034540803000000002 2024-09-13T05:11:23.271 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.271 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.271 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.271 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474721+0000", 2024-09-13T05:11:23.271 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2890000000000002e-05 2024-09-13T05:11:23.271 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.272 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.272 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.272 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475088+0000", 2024-09-13T05:11:23.272 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00036654199999999997 2024-09-13T05:11:23.272 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.272 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.272 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.272 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.272 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.272 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47591 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16154624~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:23.272 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440113+0000", 2024-09-13T05:11:23.272 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 31.801380728000002, 2024-09-13T05:11:23.272 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035632759, 2024-09-13T05:11:23.273 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.273 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.273 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.273 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.273 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.273 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47591 2024-09-13T05:11:23.273 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.273 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.273 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.273 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.273 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440113+0000", 2024-09-13T05:11:23.273 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.273 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.274 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.274 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.274 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440113+0000", 2024-09-13T05:11:23.274 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.274 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.274 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.274 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.274 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440112+0000", 2024-09-13T05:11:23.274 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.274 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.274 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.274 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.274 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440117+0000", 2024-09-13T05:11:23.275 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0199999999999996e-06 2024-09-13T05:11:23.275 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.275 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.275 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.275 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440129+0000", 2024-09-13T05:11:23.275 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2571999999999999e-05 2024-09-13T05:11:23.275 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.275 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.275 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.275 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440136+0000", 2024-09-13T05:11:23.275 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8870000000000003e-06 2024-09-13T05:11:23.275 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.275 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.275 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.276 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475160+0000", 2024-09-13T05:11:23.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035024287000000001 2024-09-13T05:11:23.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.276 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.276 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.276 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475294+0000", 2024-09-13T05:11:23.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013386600000000001 2024-09-13T05:11:23.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.276 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.276 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.276 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475746+0000", 2024-09-13T05:11:23.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00045173300000000001 2024-09-13T05:11:23.276 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.277 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.277 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.277 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.277 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.277 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47592 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16449536~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:23.277 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440142+0000", 2024-09-13T05:11:23.277 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 31.801352069, 2024-09-13T05:11:23.277 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036117556000000002, 2024-09-13T05:11:23.277 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.277 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.277 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.277 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.277 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.278 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47592 2024-09-13T05:11:23.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.278 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.278 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.278 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.278 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440142+0000", 2024-09-13T05:11:23.278 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.278 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.278 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.278 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440142+0000", 2024-09-13T05:11:23.278 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.278 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.279 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.279 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440141+0000", 2024-09-13T05:11:23.279 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.279 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.279 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.279 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.279 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440145+0000", 2024-09-13T05:11:23.279 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5939999999999998e-06 2024-09-13T05:11:23.279 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.279 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.279 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.279 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440162+0000", 2024-09-13T05:11:23.280 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7102999999999999e-05 2024-09-13T05:11:23.280 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.280 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.280 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.280 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440169+0000", 2024-09-13T05:11:23.280 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0330000000000003e-06 2024-09-13T05:11:23.280 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.280 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.280 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.280 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475812+0000", 2024-09-13T05:11:23.280 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035643542 2024-09-13T05:11:23.280 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.280 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.280 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.281 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475899+0000", 2024-09-13T05:11:23.281 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6827000000000001e-05 2024-09-13T05:11:23.281 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.281 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.281 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.281 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476259+0000", 2024-09-13T05:11:23.281 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000360057 2024-09-13T05:11:23.281 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.281 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.281 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.281 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.281 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.281 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47593 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16744448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:23.282 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440175+0000", 2024-09-13T05:11:23.282 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 31.801319113000002, 2024-09-13T05:11:23.282 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036661306999999997, 2024-09-13T05:11:23.282 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.282 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.282 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.282 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.282 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.282 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47593 2024-09-13T05:11:23.282 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.282 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.282 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.282 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.282 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440175+0000", 2024-09-13T05:11:23.283 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.283 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.283 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.283 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.283 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440175+0000", 2024-09-13T05:11:23.283 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.283 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.283 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.283 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.283 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440174+0000", 2024-09-13T05:11:23.283 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.283 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.283 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.283 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.284 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440178+0000", 2024-09-13T05:11:23.284 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.687e-06 2024-09-13T05:11:23.284 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.284 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.284 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.284 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440187+0000", 2024-09-13T05:11:23.284 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6029999999999994e-06 2024-09-13T05:11:23.284 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.284 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.284 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.284 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440194+0000", 2024-09-13T05:11:23.284 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8600000000000004e-06 2024-09-13T05:11:23.284 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.285 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.285 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476312+0000", 2024-09-13T05:11:23.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036117727000000002 2024-09-13T05:11:23.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.285 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.285 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476436+0000", 2024-09-13T05:11:23.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012370600000000001 2024-09-13T05:11:23.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.285 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.285 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476836+0000", 2024-09-13T05:11:23.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00040031399999999998 2024-09-13T05:11:23.286 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.286 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.286 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.286 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.286 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.286 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47597 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15597568~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:23.286 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440735+0000", 2024-09-13T05:11:23.286 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 31.800759120999999, 2024-09-13T05:11:23.286 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036742364, 2024-09-13T05:11:23.286 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.286 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.286 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.287 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.287 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.287 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47597 2024-09-13T05:11:23.287 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.287 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.287 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.287 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.287 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440735+0000", 2024-09-13T05:11:23.287 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.287 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.287 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.287 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.287 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440735+0000", 2024-09-13T05:11:23.288 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.288 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.288 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.288 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.288 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440733+0000", 2024-09-13T05:11:23.288 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:23.288 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.288 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.288 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.288 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440741+0000", 2024-09-13T05:11:23.288 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7100000000000007e-06 2024-09-13T05:11:23.288 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.288 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.288 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.289 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440774+0000", 2024-09-13T05:11:23.289 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3062999999999998e-05 2024-09-13T05:11:23.289 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.289 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.289 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.289 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440784+0000", 2024-09-13T05:11:23.289 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6630000000000005e-06 2024-09-13T05:11:23.289 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.289 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.289 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.289 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476899+0000", 2024-09-13T05:11:23.290 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036115188999999999 2024-09-13T05:11:23.290 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.290 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.290 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.290 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477036+0000", 2024-09-13T05:11:23.290 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000136907 2024-09-13T05:11:23.290 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.291 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.291 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.291 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477477+0000", 2024-09-13T05:11:23.291 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00044140899999999997 2024-09-13T05:11:23.291 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.291 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.291 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.291 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.291 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.291 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47598 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15892480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:23.291 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:11:23.291 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 31.800689385999998, 2024-09-13T05:11:23.291 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037255732, 2024-09-13T05:11:23.291 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.292 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.292 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.292 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.292 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.292 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47598 2024-09-13T05:11:23.292 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.292 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.292 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.292 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.292 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:11:23.292 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.292 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.292 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.293 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.293 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:11:23.293 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.293 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.293 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.293 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.293 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:11:23.293 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:23.293 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.293 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.293 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.293 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440809+0000", 2024-09-13T05:11:23.293 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.237e-06 2024-09-13T05:11:23.294 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.294 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.294 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.294 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440823+0000", 2024-09-13T05:11:23.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4426e-05 2024-09-13T05:11:23.294 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.294 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.294 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.294 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440831+0000", 2024-09-13T05:11:23.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6669999999999996e-06 2024-09-13T05:11:23.294 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.294 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.294 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.294 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477508+0000", 2024-09-13T05:11:23.295 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036677354000000002 2024-09-13T05:11:23.295 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.295 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.295 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.295 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477571+0000", 2024-09-13T05:11:23.295 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2271000000000001e-05 2024-09-13T05:11:23.295 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.295 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.295 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.295 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478060+0000", 2024-09-13T05:11:23.295 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00048954399999999996 2024-09-13T05:11:23.295 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.295 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.296 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.296 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.296 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.296 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47599 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16187392~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:23.296 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:11:23.296 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 31.800656444000001, 2024-09-13T05:11:23.296 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037806671, 2024-09-13T05:11:23.296 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.296 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.296 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.296 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.296 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.296 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47599 2024-09-13T05:11:23.296 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.297 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.297 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.297 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.297 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:11:23.297 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.297 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.297 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.297 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.297 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:11:23.297 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.297 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.298 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.298 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.298 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:11:23.298 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.298 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.298 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.298 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.298 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440841+0000", 2024-09-13T05:11:23.298 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1699999999999999e-06 2024-09-13T05:11:23.298 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.299 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.299 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.299 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440853+0000", 2024-09-13T05:11:23.299 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2466000000000001e-05 2024-09-13T05:11:23.299 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.299 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.299 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.299 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440860+0000", 2024-09-13T05:11:23.299 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8970000000000002e-06 2024-09-13T05:11:23.299 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.299 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.299 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.299 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478100+0000", 2024-09-13T05:11:23.299 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037239398 2024-09-13T05:11:23.300 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.300 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.300 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.300 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478173+0000", 2024-09-13T05:11:23.300 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3784999999999999e-05 2024-09-13T05:11:23.300 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.300 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.300 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.300 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478644+0000", 2024-09-13T05:11:23.300 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00047058100000000003 2024-09-13T05:11:23.300 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.300 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.300 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.301 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.301 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.301 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47600 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16482304~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:23.301 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:11:23.301 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 31.800627469999998, 2024-09-13T05:11:23.301 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038539524999999998, 2024-09-13T05:11:23.301 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.301 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.301 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.301 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.301 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.301 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47600 2024-09-13T05:11:23.301 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.301 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.302 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.302 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.302 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:11:23.302 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.302 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.302 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.302 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.302 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:11:23.302 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.302 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.302 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.302 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.302 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:11:23.303 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.303 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.303 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.303 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.303 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440869+0000", 2024-09-13T05:11:23.303 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6229999999999999e-06 2024-09-13T05:11:23.303 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.303 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.303 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.303 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440877+0000", 2024-09-13T05:11:23.303 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9289999999999998e-06 2024-09-13T05:11:23.303 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.303 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.303 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.304 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440884+0000", 2024-09-13T05:11:23.304 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9569999999999996e-06 2024-09-13T05:11:23.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.304 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.304 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.304 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478694+0000", 2024-09-13T05:11:23.304 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037809597 2024-09-13T05:11:23.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.304 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.304 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.304 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478907+0000", 2024-09-13T05:11:23.304 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021332799999999999 2024-09-13T05:11:23.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.305 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.305 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.305 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479406+0000", 2024-09-13T05:11:23.305 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00049870100000000005 2024-09-13T05:11:23.305 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.305 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.305 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.305 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.305 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.305 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47605 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15630336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:23.305 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.445919+0000", 2024-09-13T05:11:23.305 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 31.795575101000001, 2024-09-13T05:11:23.305 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034071010999999998, 2024-09-13T05:11:23.306 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.306 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.306 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.306 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.306 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.306 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47605 2024-09-13T05:11:23.306 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.306 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.306 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.306 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.306 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445919+0000", 2024-09-13T05:11:23.306 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.306 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.306 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.306 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.307 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445919+0000", 2024-09-13T05:11:23.307 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.307 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.307 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.307 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.307 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445917+0000", 2024-09-13T05:11:23.307 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:23.307 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.307 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.307 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.307 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445928+0000", 2024-09-13T05:11:23.307 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1413000000000001e-05 2024-09-13T05:11:23.307 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.308 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.308 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.308 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445965+0000", 2024-09-13T05:11:23.308 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6832999999999998e-05 2024-09-13T05:11:23.308 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.308 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.308 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.308 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445979+0000", 2024-09-13T05:11:23.308 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4112e-05 2024-09-13T05:11:23.308 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.308 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.308 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.308 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479481+0000", 2024-09-13T05:11:23.309 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033502394999999997 2024-09-13T05:11:23.309 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.309 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.309 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.309 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479577+0000", 2024-09-13T05:11:23.309 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5952999999999994e-05 2024-09-13T05:11:23.309 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.309 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.309 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.309 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479990+0000", 2024-09-13T05:11:23.310 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00041233799999999999 2024-09-13T05:11:23.310 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.310 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.310 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.310 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.310 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.310 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47606 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15925248~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:23.310 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.446006+0000", 2024-09-13T05:11:23.310 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 31.795487735999998, 2024-09-13T05:11:23.310 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034653819000000002, 2024-09-13T05:11:23.310 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.310 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.310 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.310 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.311 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.311 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47606 2024-09-13T05:11:23.311 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.311 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.311 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.311 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.311 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446006+0000", 2024-09-13T05:11:23.311 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.311 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.311 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.311 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.311 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446006+0000", 2024-09-13T05:11:23.311 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.312 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.312 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.312 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.312 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446005+0000", 2024-09-13T05:11:23.312 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:23.312 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.312 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.312 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.312 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446011+0000", 2024-09-13T05:11:23.312 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8039999999999998e-06 2024-09-13T05:11:23.312 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.312 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.313 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.313 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446027+0000", 2024-09-13T05:11:23.313 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6109000000000001e-05 2024-09-13T05:11:23.313 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.313 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.313 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.313 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446036+0000", 2024-09-13T05:11:23.313 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0100000000000001e-06 2024-09-13T05:11:23.313 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.313 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.313 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.313 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480068+0000", 2024-09-13T05:11:23.313 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034031516999999997 2024-09-13T05:11:23.314 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.314 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.314 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.314 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480216+0000", 2024-09-13T05:11:23.314 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000148701 2024-09-13T05:11:23.314 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.314 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.314 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.314 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480660+0000", 2024-09-13T05:11:23.314 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00044355499999999999 2024-09-13T05:11:23.314 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.314 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.314 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.315 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.315 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.315 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47607 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16220160~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:23.315 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.446044+0000", 2024-09-13T05:11:23.315 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 31.795450267, 2024-09-13T05:11:23.315 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035276967999999999, 2024-09-13T05:11:23.315 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.315 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.315 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.315 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.315 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.315 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47607 2024-09-13T05:11:23.315 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.316 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.316 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.316 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.316 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446044+0000", 2024-09-13T05:11:23.316 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.316 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.316 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.316 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.316 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446044+0000", 2024-09-13T05:11:23.316 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.316 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.316 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.316 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.317 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446043+0000", 2024-09-13T05:11:23.317 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.317 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.317 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.317 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446047+0000", 2024-09-13T05:11:23.317 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0729999999999998e-06 2024-09-13T05:11:23.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.317 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.317 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.317 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446055+0000", 2024-09-13T05:11:23.317 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0900000000000005e-06 2024-09-13T05:11:23.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.317 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.318 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.318 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446062+0000", 2024-09-13T05:11:23.318 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0169999999999999e-06 2024-09-13T05:11:23.318 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.318 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.318 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.318 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480714+0000", 2024-09-13T05:11:23.318 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034651380000000002 2024-09-13T05:11:23.318 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.318 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.318 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.318 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480859+0000", 2024-09-13T05:11:23.318 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014580300000000001 2024-09-13T05:11:23.318 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.319 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.319 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.319 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481321+0000", 2024-09-13T05:11:23.319 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000461218 2024-09-13T05:11:23.319 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.319 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.319 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.319 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.319 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.319 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47608 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16515072~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:23.319 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.446068+0000", 2024-09-13T05:11:23.319 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 31.795425820999998, 2024-09-13T05:11:23.319 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035881819000000002, 2024-09-13T05:11:23.320 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.320 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.320 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.320 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.320 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.320 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47608 2024-09-13T05:11:23.320 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.320 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.320 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.320 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.320 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446068+0000", 2024-09-13T05:11:23.320 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.321 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.321 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.321 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.321 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446068+0000", 2024-09-13T05:11:23.321 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.321 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.321 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.321 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.321 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446067+0000", 2024-09-13T05:11:23.321 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.322 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.322 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.322 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.322 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446071+0000", 2024-09-13T05:11:23.322 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9090000000000002e-06 2024-09-13T05:11:23.322 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.322 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.322 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.322 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446079+0000", 2024-09-13T05:11:23.322 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6869999999999994e-06 2024-09-13T05:11:23.322 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.322 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.322 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446088+0000", 2024-09-13T05:11:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0129999999999999e-06 2024-09-13T05:11:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481401+0000", 2024-09-13T05:11:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035313272999999999 2024-09-13T05:11:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481564+0000", 2024-09-13T05:11:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016223299999999999 2024-09-13T05:11:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.324 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.324 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481950+0000", 2024-09-13T05:11:23.324 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00038631000000000001 2024-09-13T05:11:23.324 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.324 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.324 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.324 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.324 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.324 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:48448 3.16 3:6fb90bbf:::rbd_data.112d4ee87f83.00000000000000ca:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-13T05:11:23.324 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:52.567838+0000", 2024-09-13T05:11:23.324 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 30.673655920000002, 2024-09-13T05:11:23.324 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032609896999999999, 2024-09-13T05:11:23.324 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.325 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:23.325 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.325 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.325 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.325 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 48448 2024-09-13T05:11:23.325 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.325 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.325 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.325 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.325 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567838+0000", 2024-09-13T05:11:23.325 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.325 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.325 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.325 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.326 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567838+0000", 2024-09-13T05:11:23.326 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.326 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.326 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.326 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.326 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567836+0000", 2024-09-13T05:11:23.326 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:23.326 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.326 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.326 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.326 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567847+0000", 2024-09-13T05:11:23.326 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1443e-05 2024-09-13T05:11:23.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.327 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.327 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.327 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567867+0000", 2024-09-13T05:11:23.327 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0083000000000001e-05 2024-09-13T05:11:23.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.327 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.327 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.327 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567877+0000", 2024-09-13T05:11:23.327 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4499999999999993e-06 2024-09-13T05:11:23.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.327 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.327 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.328 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.567939+0000", 2024-09-13T05:11:23.328 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2552999999999996e-05 2024-09-13T05:11:23.328 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.328 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.328 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.328 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.568130+0000", 2024-09-13T05:11:23.328 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00019028799999999999 2024-09-13T05:11:23.328 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.328 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.328 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 7", 2024-09-13T05:11:23.328 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.575017+0000", 2024-09-13T05:11:23.328 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0068869980000000001 2024-09-13T05:11:23.328 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.329 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.329 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:23.329 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.600362+0000", 2024-09-13T05:11:23.329 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.025345828000000001 2024-09-13T05:11:23.329 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.329 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.329 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:11:23.329 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.600374+0000", 2024-09-13T05:11:23.329 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1096e-05 2024-09-13T05:11:23.329 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.329 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.329 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:11:23.329 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.600410+0000", 2024-09-13T05:11:23.330 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6142000000000001e-05 2024-09-13T05:11:23.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.330 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.330 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.330 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:52.600448+0000", 2024-09-13T05:11:23.330 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8101e-05 2024-09-13T05:11:23.330 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.330 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.330 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.330 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.330 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:67653 3.1f 3:f936ba4b:::rbd_object_map.112d7bfe4877:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e81)", 2024-09-13T05:11:23.330 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:18.704251+0000", 2024-09-13T05:11:23.330 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.5372424559999995, 2024-09-13T05:11:23.331 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034028673000000002, 2024-09-13T05:11:23.331 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.331 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:23.331 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.331 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.331 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.331 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 67653 2024-09-13T05:11:23.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.331 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.331 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.331 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.331 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704251+0000", 2024-09-13T05:11:23.331 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.332 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.332 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.332 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.332 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704251+0000", 2024-09-13T05:11:23.332 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.332 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.332 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.332 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.332 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704251+0000", 2024-09-13T05:11:23.332 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:23.332 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.332 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.332 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.333 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704253+0000", 2024-09-13T05:11:23.333 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.136e-06 2024-09-13T05:11:23.333 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.333 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.333 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.333 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704256+0000", 2024-09-13T05:11:23.333 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7049999999999999e-06 2024-09-13T05:11:23.333 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.333 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.333 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.333 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704259+0000", 2024-09-13T05:11:23.333 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6970000000000002e-06 2024-09-13T05:11:23.333 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.333 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.334 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.334 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.729746+0000", 2024-09-13T05:11:23.334 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.025486892000000001 2024-09-13T05:11:23.334 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.334 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.334 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.334 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.729834+0000", 2024-09-13T05:11:23.334 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8864999999999997e-05 2024-09-13T05:11:23.334 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.334 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.334 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 2", 2024-09-13T05:11:23.334 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.730192+0000", 2024-09-13T05:11:23.334 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00035797100000000001 2024-09-13T05:11:23.334 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.335 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.335 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:11:23.335 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.734948+0000", 2024-09-13T05:11:23.335 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0047558139999999997 2024-09-13T05:11:23.335 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.335 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.335 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:23.335 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.738189+0000", 2024-09-13T05:11:23.335 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003241234 2024-09-13T05:11:23.335 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.335 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.335 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:11:23.335 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.738245+0000", 2024-09-13T05:11:23.335 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6001000000000001e-05 2024-09-13T05:11:23.336 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.336 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.336 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.336 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.738280+0000", 2024-09-13T05:11:23.336 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4567000000000003e-05 2024-09-13T05:11:23.336 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.336 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.336 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.336 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.336 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.336 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:67654 3.1f 3:f936ba4b:::rbd_object_map.112d7bfe4877:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e81)", 2024-09-13T05:11:23.336 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:18.704261+0000", 2024-09-13T05:11:23.337 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.5372329210000002, 2024-09-13T05:11:23.337 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034141218000000001, 2024-09-13T05:11:23.337 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.337 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:23.337 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.337 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.337 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.337 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 67654 2024-09-13T05:11:23.337 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.337 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.337 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.337 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.337 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704261+0000", 2024-09-13T05:11:23.337 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.338 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.338 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.338 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704261+0000", 2024-09-13T05:11:23.338 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.338 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.338 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.338 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704261+0000", 2024-09-13T05:11:23.338 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:23.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.338 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.338 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.338 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704263+0000", 2024-09-13T05:11:23.339 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3999999999999999e-06 2024-09-13T05:11:23.339 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.339 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.339 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.339 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704266+0000", 2024-09-13T05:11:23.339 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7879999999999998e-06 2024-09-13T05:11:23.339 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.339 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.339 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.339 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704269+0000", 2024-09-13T05:11:23.339 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:11:23.339 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.339 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.339 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.340 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.730747+0000", 2024-09-13T05:11:23.340 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.026478224000000002 2024-09-13T05:11:23.340 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.340 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.340 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.340 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.730796+0000", 2024-09-13T05:11:23.340 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9137000000000001e-05 2024-09-13T05:11:23.340 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.340 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.340 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 2", 2024-09-13T05:11:23.340 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.731142+0000", 2024-09-13T05:11:23.340 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00034581500000000002 2024-09-13T05:11:23.341 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.341 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.341 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:11:23.341 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.734952+0000", 2024-09-13T05:11:23.341 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0038102909999999999 2024-09-13T05:11:23.341 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.341 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.341 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:23.341 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.738325+0000", 2024-09-13T05:11:23.341 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033727890000000002 2024-09-13T05:11:23.341 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.341 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.341 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:11:23.341 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.738369+0000", 2024-09-13T05:11:23.342 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4338999999999997e-05 2024-09-13T05:11:23.342 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.342 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.342 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.342 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.738402+0000", 2024-09-13T05:11:23.342 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2880999999999999e-05 2024-09-13T05:11:23.342 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.342 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.342 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.342 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.342 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.342 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:23.344 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:11:23.344 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:23.338+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:23.377 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T05:11:23.444 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:23.437+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:23.469 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:23.470 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:23.470 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:11:23.470 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:23.480 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:11:23.545 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:23.541+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:23.595 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:23.595 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:23.596 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:23.596 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:23.596 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:23.597 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:11:23.597 INFO:teuthology.orchestra.run.smithi120.stdout:{"fsid":"0a3759da-62bd-4704-8a4a-7c20eb3fc816","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noscrub flag(s) set","count":7},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":104,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":86,"num_osds":8,"num_up_osds":8,"osd_up_since":1726204191,"num_in_osds":5,"osd_in_since":1726204236,"num_remapped_pgs":3},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":34},{"state_name":"remapped+peering","count":7}],"num_pgs":41,"num_pools":3,"num_objects":2038,"data_bytes":842581438,"bytes_used":463732736,"bytes_avail":482720088064,"bytes_total":483183820800,"inactive_pgs_ratio":0.17073170840740204,"read_bytes_sec":6483670,"write_bytes_sec":842001,"read_op_per_sec":1318,"write_op_per_sec":273},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-09-13T05:10:52.177972+0000","services":{}},"progress_events":{}} 2024-09-13T05:11:23.606 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:11:23.612 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-13T05:11:23.613 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:11:23.646 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:23.642+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:23.712 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone27 from 0xe12d415 (overlap 0x1e889a6) to 0x1251f63 2024-09-13T05:11:23.722 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:23.722 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:23.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:23.722 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:23.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.722 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29020 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2855936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:23.722 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:11:23.722 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 46.676715684000001, 2024-09-13T05:11:23.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060733743, 2024-09-13T05:11:23.723 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.723 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.723 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.723 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.723 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.723 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29020 2024-09-13T05:11:23.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.723 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.723 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.723 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:11:23.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:11:23.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041741+0000", 2024-09-13T05:11:23.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041749+0000", 2024-09-13T05:11:23.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6059999999999997e-06 2024-09-13T05:11:23.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.725 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.725 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041754+0000", 2024-09-13T05:11:23.725 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6740000000000002e-06 2024-09-13T05:11:23.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.725 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.725 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041760+0000", 2024-09-13T05:11:23.725 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0459999999999996e-06 2024-09-13T05:11:23.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.725 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.725 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102289+0000", 2024-09-13T05:11:23.726 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060529145999999999 2024-09-13T05:11:23.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.726 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.726 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.726 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102378+0000", 2024-09-13T05:11:23.726 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8901999999999997e-05 2024-09-13T05:11:23.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.726 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.726 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.726 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102476+0000", 2024-09-13T05:11:23.726 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7991000000000004e-05 2024-09-13T05:11:23.726 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.726 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.726 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.727 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29021 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2865152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:23.727 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:11:23.727 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 46.676693688999997, 2024-09-13T05:11:23.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060927993999999999, 2024-09-13T05:11:23.727 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.727 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.727 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.727 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.727 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.727 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29021 2024-09-13T05:11:23.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.727 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:11:23.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:11:23.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041763+0000", 2024-09-13T05:11:23.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041766+0000", 2024-09-13T05:11:23.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6800000000000002e-06 2024-09-13T05:11:23.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041771+0000", 2024-09-13T05:11:23.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:11:23.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.730 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.730 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.730 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041776+0000", 2024-09-13T05:11:23.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8489999999999997e-06 2024-09-13T05:11:23.730 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.730 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.730 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.730 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102513+0000", 2024-09-13T05:11:23.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060737102000000001 2024-09-13T05:11:23.730 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.730 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.730 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.730 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102597+0000", 2024-09-13T05:11:23.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4374000000000002e-05 2024-09-13T05:11:23.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102692+0000", 2024-09-13T05:11:23.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4436000000000002e-05 2024-09-13T05:11:23.731 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.731 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.731 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.731 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29022 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2874368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:23.731 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:11:23.731 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 46.676677388999998, 2024-09-13T05:11:23.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061135083999999999, 2024-09-13T05:11:23.732 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.732 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.732 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.732 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.732 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.732 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29022 2024-09-13T05:11:23.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.732 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.732 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:11:23.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.733 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.733 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:11:23.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.733 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.733 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:11:23.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.733 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.733 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041782+0000", 2024-09-13T05:11:23.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4959999999999999e-06 2024-09-13T05:11:23.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041787+0000", 2024-09-13T05:11:23.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1240000000000004e-06 2024-09-13T05:11:23.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041792+0000", 2024-09-13T05:11:23.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9200000000000003e-06 2024-09-13T05:11:23.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102738+0000", 2024-09-13T05:11:23.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060945581999999998 2024-09-13T05:11:23.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102821+0000", 2024-09-13T05:11:23.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2898999999999994e-05 2024-09-13T05:11:23.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102915+0000", 2024-09-13T05:11:23.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4523000000000003e-05 2024-09-13T05:11:23.735 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.735 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.736 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.736 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29067 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2764800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:23.736 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:11:23.736 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 46.672903171999998, 2024-09-13T05:11:23.736 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060816621000000001, 2024-09-13T05:11:23.736 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.736 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.736 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.736 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.736 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.737 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29067 2024-09-13T05:11:23.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.737 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:11:23.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:11:23.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:11:23.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045557+0000", 2024-09-13T05:11:23.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.898e-06 2024-09-13T05:11:23.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045575+0000", 2024-09-13T05:11:23.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8252000000000001e-05 2024-09-13T05:11:23.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045581+0000", 2024-09-13T05:11:23.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:11:23.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106183+0000", 2024-09-13T05:11:23.740 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060602630999999997 2024-09-13T05:11:23.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.740 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.740 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106271+0000", 2024-09-13T05:11:23.740 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7329000000000004e-05 2024-09-13T05:11:23.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.740 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.740 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106371+0000", 2024-09-13T05:11:23.740 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000100164 2024-09-13T05:11:23.740 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.740 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.741 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.741 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29068 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2774016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:23.741 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:11:23.741 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 46.672871938, 2024-09-13T05:11:23.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060994509000000002, 2024-09-13T05:11:23.741 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.741 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.741 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.741 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.741 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.741 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29068 2024-09-13T05:11:23.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.742 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:11:23.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:11:23.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045585+0000", 2024-09-13T05:11:23.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045588+0000", 2024-09-13T05:11:23.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:11:23.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045594+0000", 2024-09-13T05:11:23.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9329999999999998e-06 2024-09-13T05:11:23.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045599+0000", 2024-09-13T05:11:23.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3190000000000002e-06 2024-09-13T05:11:23.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.744 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106399+0000", 2024-09-13T05:11:23.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060800361999999997 2024-09-13T05:11:23.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.744 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106489+0000", 2024-09-13T05:11:23.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9301000000000004e-05 2024-09-13T05:11:23.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.745 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.745 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106580+0000", 2024-09-13T05:11:23.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1314e-05 2024-09-13T05:11:23.745 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.745 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.745 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.745 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.745 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29069 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2792448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:23.745 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:11:23.745 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 46.672853521, 2024-09-13T05:11:23.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061207599000000001, 2024-09-13T05:11:23.745 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.745 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.746 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.746 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.746 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.746 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29069 2024-09-13T05:11:23.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.746 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.746 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:11:23.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.746 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:11:23.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045603+0000", 2024-09-13T05:11:23.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045606+0000", 2024-09-13T05:11:23.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7300000000000001e-06 2024-09-13T05:11:23.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045612+0000", 2024-09-13T05:11:23.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9599999999999997e-06 2024-09-13T05:11:23.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045619+0000", 2024-09-13T05:11:23.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6019999999999996e-06 2024-09-13T05:11:23.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106619+0000", 2024-09-13T05:11:23.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061000029999999997 2024-09-13T05:11:23.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106713+0000", 2024-09-13T05:11:23.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4505000000000004e-05 2024-09-13T05:11:23.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106812+0000", 2024-09-13T05:11:23.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8264000000000007e-05 2024-09-13T05:11:23.749 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.749 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.749 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.750 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29070 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2783232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:23.750 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:11:23.750 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 46.672833062000002, 2024-09-13T05:11:23.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061389805999999998, 2024-09-13T05:11:23.750 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.750 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.750 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.750 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.750 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.750 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29070 2024-09-13T05:11:23.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.750 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:11:23.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:11:23.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:11:23.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045627+0000", 2024-09-13T05:11:23.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6579999999999998e-06 2024-09-13T05:11:23.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045632+0000", 2024-09-13T05:11:23.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8449999999999999e-06 2024-09-13T05:11:23.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045639+0000", 2024-09-13T05:11:23.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:11:23.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106837+0000", 2024-09-13T05:11:23.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061198529000000002 2024-09-13T05:11:23.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106922+0000", 2024-09-13T05:11:23.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4771999999999994e-05 2024-09-13T05:11:23.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107014+0000", 2024-09-13T05:11:23.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2009000000000006e-05 2024-09-13T05:11:23.754 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.754 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.754 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.754 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29071 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2801664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:23.754 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:11:23.754 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 46.672813986000001, 2024-09-13T05:11:23.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061582804999999997, 2024-09-13T05:11:23.754 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.754 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.754 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.754 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.755 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.755 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29071 2024-09-13T05:11:23.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.755 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:11:23.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:11:23.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045643+0000", 2024-09-13T05:11:23.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045646+0000", 2024-09-13T05:11:23.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:11:23.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045664+0000", 2024-09-13T05:11:23.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8408000000000001e-05 2024-09-13T05:11:23.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045670+0000", 2024-09-13T05:11:23.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7710000000000003e-06 2024-09-13T05:11:23.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107048+0000", 2024-09-13T05:11:23.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061378438 2024-09-13T05:11:23.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107134+0000", 2024-09-13T05:11:23.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5574000000000004e-05 2024-09-13T05:11:23.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107226+0000", 2024-09-13T05:11:23.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2262000000000005e-05 2024-09-13T05:11:23.759 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.759 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.759 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.759 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29072 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2810880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:23.760 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:11:23.760 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 46.672782601999998, 2024-09-13T05:11:23.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061762233999999999, 2024-09-13T05:11:23.760 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.760 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.760 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.760 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.760 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.760 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29072 2024-09-13T05:11:23.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.760 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:11:23.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:11:23.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045674+0000", 2024-09-13T05:11:23.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045677+0000", 2024-09-13T05:11:23.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9679999999999998e-06 2024-09-13T05:11:23.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045694+0000", 2024-09-13T05:11:23.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6801999999999999e-05 2024-09-13T05:11:23.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.763 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.763 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045700+0000", 2024-09-13T05:11:23.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8270000000000003e-06 2024-09-13T05:11:23.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.763 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.763 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107249+0000", 2024-09-13T05:11:23.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061549114000000002 2024-09-13T05:11:23.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.763 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107341+0000", 2024-09-13T05:11:23.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2390000000000001e-05 2024-09-13T05:11:23.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107437+0000", 2024-09-13T05:11:23.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5648000000000003e-05 2024-09-13T05:11:23.764 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.764 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.764 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.765 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29073 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2820096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:23.765 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:11:23.765 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 46.672740623999999, 2024-09-13T05:11:23.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061873910999999997, 2024-09-13T05:11:23.765 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.765 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.765 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.765 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.765 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.765 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29073 2024-09-13T05:11:23.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.765 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:11:23.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:11:23.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045716+0000", 2024-09-13T05:11:23.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045726+0000", 2024-09-13T05:11:23.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6350000000000001e-06 2024-09-13T05:11:23.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045739+0000", 2024-09-13T05:11:23.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3325e-05 2024-09-13T05:11:23.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045746+0000", 2024-09-13T05:11:23.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7399999999999998e-06 2024-09-13T05:11:23.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107457+0000", 2024-09-13T05:11:23.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061711038000000003 2024-09-13T05:11:23.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.769 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.769 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107522+0000", 2024-09-13T05:11:23.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4850000000000004e-05 2024-09-13T05:11:23.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.769 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.769 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107591+0000", 2024-09-13T05:11:23.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9029999999999995e-05 2024-09-13T05:11:23.769 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.769 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.769 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.770 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29074 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2829312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:23.770 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:11:23.770 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 46.672706716, 2024-09-13T05:11:23.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062055459, 2024-09-13T05:11:23.770 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.770 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.770 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.770 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.770 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.770 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29074 2024-09-13T05:11:23.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.770 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:11:23.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:11:23.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045750+0000", 2024-09-13T05:11:23.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045753+0000", 2024-09-13T05:11:23.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8399999999999999e-06 2024-09-13T05:11:23.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045759+0000", 2024-09-13T05:11:23.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8900000000000004e-06 2024-09-13T05:11:23.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045764+0000", 2024-09-13T05:11:23.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3850000000000001e-06 2024-09-13T05:11:23.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107623+0000", 2024-09-13T05:11:23.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061858817000000003 2024-09-13T05:11:23.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107710+0000", 2024-09-13T05:11:23.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7127999999999997e-05 2024-09-13T05:11:23.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107806+0000", 2024-09-13T05:11:23.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5886999999999999e-05 2024-09-13T05:11:23.774 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.774 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.774 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.774 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29075 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2838528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:23.774 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:11:23.774 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 46.672688262000001, 2024-09-13T05:11:23.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062188516999999999, 2024-09-13T05:11:23.774 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.774 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.774 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.774 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.775 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.775 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29075 2024-09-13T05:11:23.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.775 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:11:23.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:11:23.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:11:23.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045772+0000", 2024-09-13T05:11:23.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:11:23.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045778+0000", 2024-09-13T05:11:23.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9229999999999996e-06 2024-09-13T05:11:23.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045784+0000", 2024-09-13T05:11:23.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3800000000000002e-06 2024-09-13T05:11:23.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107823+0000", 2024-09-13T05:11:23.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062039331000000003 2024-09-13T05:11:23.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107886+0000", 2024-09-13T05:11:23.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2476000000000003e-05 2024-09-13T05:11:23.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107958+0000", 2024-09-13T05:11:23.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2089999999999996e-05 2024-09-13T05:11:23.778 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.778 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.778 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.778 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29115 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2682880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:23.778 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:11:23.779 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 46.669222734999998, 2024-09-13T05:11:23.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060847898999999997, 2024-09-13T05:11:23.779 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.779 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.779 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.779 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.779 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.779 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29115 2024-09-13T05:11:23.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.779 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:11:23.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:11:23.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049234+0000", 2024-09-13T05:11:23.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049237+0000", 2024-09-13T05:11:23.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9069999999999999e-06 2024-09-13T05:11:23.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049243+0000", 2024-09-13T05:11:23.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7459999999999997e-06 2024-09-13T05:11:23.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049248+0000", 2024-09-13T05:11:23.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1490000000000002e-06 2024-09-13T05:11:23.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.109945+0000", 2024-09-13T05:11:23.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060697299000000003 2024-09-13T05:11:23.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110013+0000", 2024-09-13T05:11:23.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8023999999999998e-05 2024-09-13T05:11:23.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110083+0000", 2024-09-13T05:11:23.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9296999999999997e-05 2024-09-13T05:11:23.782 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.782 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.783 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.783 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29116 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2692096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:23.783 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:11:23.783 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 46.669204891, 2024-09-13T05:11:23.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061040167999999999, 2024-09-13T05:11:23.783 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.783 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.783 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.783 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.783 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.783 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29116 2024-09-13T05:11:23.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.784 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:11:23.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:11:23.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049252+0000", 2024-09-13T05:11:23.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049255+0000", 2024-09-13T05:11:23.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7250000000000002e-06 2024-09-13T05:11:23.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049261+0000", 2024-09-13T05:11:23.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.755e-06 2024-09-13T05:11:23.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.786 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049266+0000", 2024-09-13T05:11:23.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2100000000000001e-06 2024-09-13T05:11:23.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.786 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.786 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110115+0000", 2024-09-13T05:11:23.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060849225999999999 2024-09-13T05:11:23.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.786 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.786 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110199+0000", 2024-09-13T05:11:23.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4339999999999995e-05 2024-09-13T05:11:23.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110293+0000", 2024-09-13T05:11:23.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3397e-05 2024-09-13T05:11:23.787 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.787 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.787 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.787 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29117 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2701312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:23.787 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:11:23.787 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 46.669187254000001, 2024-09-13T05:11:23.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.06118527, 2024-09-13T05:11:23.787 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.788 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.788 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.788 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.788 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.788 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29117 2024-09-13T05:11:23.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.788 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:11:23.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:11:23.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:11:23.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049273+0000", 2024-09-13T05:11:23.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.757e-06 2024-09-13T05:11:23.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049278+0000", 2024-09-13T05:11:23.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7830000000000004e-06 2024-09-13T05:11:23.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049284+0000", 2024-09-13T05:11:23.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3820000000000003e-06 2024-09-13T05:11:23.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110313+0000", 2024-09-13T05:11:23.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061029682000000002 2024-09-13T05:11:23.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110383+0000", 2024-09-13T05:11:23.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9406000000000006e-05 2024-09-13T05:11:23.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110456+0000", 2024-09-13T05:11:23.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2750000000000007e-05 2024-09-13T05:11:23.792 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.792 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.792 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.792 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29118 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2710528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:23.792 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:11:23.792 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 46.669169339, 2024-09-13T05:11:23.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061380698999999997, 2024-09-13T05:11:23.792 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.792 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.792 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.792 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.793 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.793 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29118 2024-09-13T05:11:23.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.793 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.793 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:11:23.793 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.793 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:11:23.793 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:11:23.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049291+0000", 2024-09-13T05:11:23.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8770000000000002e-06 2024-09-13T05:11:23.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049296+0000", 2024-09-13T05:11:23.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6799999999999998e-06 2024-09-13T05:11:23.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049302+0000", 2024-09-13T05:11:23.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2769999999999996e-06 2024-09-13T05:11:23.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110488+0000", 2024-09-13T05:11:23.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061186184999999997 2024-09-13T05:11:23.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.796 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110577+0000", 2024-09-13T05:11:23.796 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9246000000000006e-05 2024-09-13T05:11:23.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.796 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110669+0000", 2024-09-13T05:11:23.796 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1923999999999996e-05 2024-09-13T05:11:23.796 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.796 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.796 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.796 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29119 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2719744~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:23.797 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:11:23.797 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 46.669151595000002, 2024-09-13T05:11:23.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061521165000000003, 2024-09-13T05:11:23.797 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.797 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.797 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.797 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.797 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.797 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29119 2024-09-13T05:11:23.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.798 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.798 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.798 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:11:23.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.798 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.798 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:11:23.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.798 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.799 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049305+0000", 2024-09-13T05:11:23.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.799 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.799 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.799 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049308+0000", 2024-09-13T05:11:23.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7070000000000001e-06 2024-09-13T05:11:23.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.799 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.799 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.799 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049316+0000", 2024-09-13T05:11:23.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:11:23.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049322+0000", 2024-09-13T05:11:23.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3199999999999999e-06 2024-09-13T05:11:23.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110690+0000", 2024-09-13T05:11:23.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061368428000000003 2024-09-13T05:11:23.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.801 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110755+0000", 2024-09-13T05:11:23.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4893000000000004e-05 2024-09-13T05:11:23.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.801 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110827+0000", 2024-09-13T05:11:23.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2039000000000006e-05 2024-09-13T05:11:23.801 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.801 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.801 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.801 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29120 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2728960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:23.801 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:11:23.802 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 46.669131325000002, 2024-09-13T05:11:23.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061718420000000003, 2024-09-13T05:11:23.802 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.802 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.802 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.802 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.802 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.802 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29120 2024-09-13T05:11:23.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.802 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.802 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.802 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.802 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:11:23.803 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.803 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.803 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.803 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:11:23.803 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.803 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.803 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.803 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:11:23.803 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.803 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.803 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.803 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049329+0000", 2024-09-13T05:11:23.804 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.022e-06 2024-09-13T05:11:23.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.804 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.804 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.804 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049336+0000", 2024-09-13T05:11:23.804 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0720000000000002e-06 2024-09-13T05:11:23.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.804 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.804 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.804 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049341+0000", 2024-09-13T05:11:23.804 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:11:23.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.804 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.805 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.805 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110864+0000", 2024-09-13T05:11:23.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061523126999999997 2024-09-13T05:11:23.805 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.805 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.805 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110951+0000", 2024-09-13T05:11:23.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6557000000000005e-05 2024-09-13T05:11:23.805 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.805 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.805 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.111045+0000", 2024-09-13T05:11:23.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4043999999999996e-05 2024-09-13T05:11:23.806 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.806 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.806 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.806 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29136 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2876416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:23.806 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:11:23.806 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 46.665115900000004, 2024-09-13T05:11:23.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060742995000000001, 2024-09-13T05:11:23.806 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.806 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.806 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.806 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.806 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.807 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29136 2024-09-13T05:11:23.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.807 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:11:23.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:11:23.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.808 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.808 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053341+0000", 2024-09-13T05:11:23.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.808 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.808 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053344+0000", 2024-09-13T05:11:23.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:11:23.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.808 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.808 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053350+0000", 2024-09-13T05:11:23.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7200000000000003e-06 2024-09-13T05:11:23.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.809 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.809 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.809 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053355+0000", 2024-09-13T05:11:23.809 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0150000000000003e-06 2024-09-13T05:11:23.809 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.809 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.809 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.809 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113909+0000", 2024-09-13T05:11:23.809 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060554368999999997 2024-09-13T05:11:23.809 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.809 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.809 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.809 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113994+0000", 2024-09-13T05:11:23.809 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4658000000000002e-05 2024-09-13T05:11:23.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.810 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.810 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.810 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114085+0000", 2024-09-13T05:11:23.810 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0939000000000005e-05 2024-09-13T05:11:23.810 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.810 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.810 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.810 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.810 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29166 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2628608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:23.810 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:11:23.810 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 46.665098466000003, 2024-09-13T05:11:23.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060883127000000002, 2024-09-13T05:11:23.811 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:23.811 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:23.811 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:23.811 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:23.811 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:23.811 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29166 2024-09-13T05:11:23.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.811 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:23.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:23.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:11:23.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.812 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:23.812 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:11:23.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:23.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.812 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:23.812 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:11:23.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:23.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.812 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:23.812 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053361+0000", 2024-09-13T05:11:23.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:11:23.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:23.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053367+0000", 2024-09-13T05:11:23.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7350000000000001e-06 2024-09-13T05:11:23.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:23.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053372+0000", 2024-09-13T05:11:23.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7840000000000003e-06 2024-09-13T05:11:23.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:23.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114103+0000", 2024-09-13T05:11:23.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060730924999999998 2024-09-13T05:11:23.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:23.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114171+0000", 2024-09-13T05:11:23.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8021999999999993e-05 2024-09-13T05:11:23.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:23.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:23.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:23.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114242+0000", 2024-09-13T05:11:23.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1390999999999995e-05 2024-09-13T05:11:23.814 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.814 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.814 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.814 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:23.815 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:23.815 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:23.816 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:11:23.816 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:23.810+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:23.914 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:11:23.916 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:11:23.916 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:23.910+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:23.929 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2024-09-13T05:11:23.609796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":842581438,"num_objects":2038,"num_object_clones":272,"num_object_copies":4076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2038,"num_whiteouts":982,"num_read":89597,"num_read_kb":405944,"num_write":12700,"num_write_kb":273436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1302,"num_bytes_recovered":45181655,"num_keys_recovered":167,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11070,"ondisk_log_size":11070,"up":82,"acting":76,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":452864,"kb_used_data":262716,"kb_used_omap":7,"kb_used_meta":189944,"kb_avail":471406336,"statfs":{"total":483183820800,"available":482720088064,"internally_reserved":0,"allocated":269021184,"data_stored":289648950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7962,"internal_metadata":194502886},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8851593,"num_objects":107,"num_object_clones":26,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":26,"num_read":5275,"num_read_kb":25334,"num_write":1095,"num_write_kb":3290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.424337"},"pg_stats":[{"pgid":"3.1f","version":"82'346","reported_seq":906,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350704+0000","last_change":"2024-09-13T05:10:37.993400+0000","last_active":"2024-09-13T05:11:20.350704+0000","last_peered":"2024-09-13T05:11:20.350704+0000","last_clean":"2024-09-13T05:11:20.350704+0000","last_became_active":"2024-09-13T05:10:37.864778+0000","last_became_peered":"2024-09-13T05:10:37.864778+0000","last_unstale":"2024-09-13T05:11:20.350704+0000","last_undegraded":"2024-09-13T05:11:20.350704+0000","last_fullsized":"2024-09-13T05:11:20.350704+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:56:24.801492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011835439999999999,"stat_sum":{"num_bytes":4432308,"num_objects":61,"num_object_clones":5,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":23,"num_read":1614,"num_read_kb":2891,"num_write":419,"num_write_kb":2370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":297202,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"82'194","reported_seq":1056,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.357588+0000","last_change":"2024-09-13T05:10:12.076857+0000","last_active":"2024-09-13T05:11:20.357588+0000","last_peered":"2024-09-13T05:11:20.357588+0000","last_clean":"2024-09-13T05:11:20.357588+0000","last_became_active":"2024-09-13T05:10:09.644293+0000","last_became_peered":"2024-09-13T05:10:09.644293+0000","last_unstale":"2024-09-13T05:11:20.357588+0000","last_undegraded":"2024-09-13T05:11:20.357588+0000","last_fullsized":"2024-09-13T05:11:20.357588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:45:32.561793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225439,"stat_sum":{"num_bytes":26552467,"num_objects":56,"num_object_clones":7,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":28,"num_read":1342,"num_read_kb":4732,"num_write":167,"num_write_kb":3206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"82'234","reported_seq":2154,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350503+0000","last_change":"2024-09-13T05:10:11.645342+0000","last_active":"2024-09-13T05:11:20.350503+0000","last_peered":"2024-09-13T05:11:20.350503+0000","last_clean":"2024-09-13T05:11:20.350503+0000","last_became_active":"2024-09-13T05:10:09.645791+0000","last_became_peered":"2024-09-13T05:10:09.645791+0000","last_unstale":"2024-09-13T05:11:20.350503+0000","last_undegraded":"2024-09-13T05:11:20.350503+0000","last_fullsized":"2024-09-13T05:11:20.350503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:49.028553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072691800000000001,"stat_sum":{"num_bytes":33288741,"num_objects":76,"num_object_clones":13,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":32,"num_read":1957,"num_read_kb":11839,"num_write":196,"num_write_kb":4852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"81'523","reported_seq":2510,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350868+0000","last_change":"2024-09-13T05:10:31.949427+0000","last_active":"2024-09-13T05:11:20.350868+0000","last_peered":"2024-09-13T05:11:20.350868+0000","last_clean":"2024-09-13T05:11:20.350868+0000","last_became_active":"2024-09-13T05:10:31.828206+0000","last_became_peered":"2024-09-13T05:10:31.828206+0000","last_unstale":"2024-09-13T05:11:20.350868+0000","last_undegraded":"2024-09-13T05:11:20.350868+0000","last_fullsized":"2024-09-13T05:11:20.350868+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:32:46.868249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078437299999999999,"stat_sum":{"num_bytes":14843968,"num_objects":57,"num_object_clones":9,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":23,"num_read":4135,"num_read_kb":16509,"num_write":687,"num_write_kb":7839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":372837,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'328","reported_seq":1326,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356100+0000","last_change":"2024-09-13T05:10:37.990899+0000","last_active":"2024-09-13T05:11:20.356100+0000","last_peered":"2024-09-13T05:11:20.356100+0000","last_clean":"2024-09-13T05:11:20.356100+0000","last_became_active":"2024-09-13T05:10:37.867842+0000","last_became_peered":"2024-09-13T05:10:37.867842+0000","last_unstale":"2024-09-13T05:11:20.356100+0000","last_undegraded":"2024-09-13T05:11:20.356100+0000","last_fullsized":"2024-09-13T05:11:20.356100+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:38:24.437617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065808499999999999,"stat_sum":{"num_bytes":10335452,"num_objects":66,"num_object_clones":8,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":33,"num_read":2088,"num_read_kb":5710,"num_write":339,"num_write_kb":8660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":612052,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"81'269","reported_seq":3250,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.352366+0000","last_change":"2024-09-13T05:10:37.948112+0000","last_active":"2024-09-13T05:11:20.352366+0000","last_peered":"2024-09-13T05:11:20.352366+0000","last_clean":"2024-09-13T05:11:20.352366+0000","last_became_active":"2024-09-13T05:10:37.863614+0000","last_became_peered":"2024-09-13T05:10:37.863614+0000","last_unstale":"2024-09-13T05:11:20.352366+0000","last_undegraded":"2024-09-13T05:11:20.352366+0000","last_fullsized":"2024-09-13T05:11:20.352366+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:15.873724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027226559999999999,"stat_sum":{"num_bytes":12785593,"num_objects":73,"num_object_clones":10,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":30,"num_read":3419,"num_read_kb":7048,"num_write":224,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":77,"num_bytes_recovered":1081937,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"82'550","reported_seq":2529,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356910+0000","last_change":"2024-09-13T05:10:34.613940+0000","last_active":"2024-09-13T05:11:20.356910+0000","last_peered":"2024-09-13T05:11:20.356910+0000","last_clean":"2024-09-13T05:11:20.356910+0000","last_became_active":"2024-09-13T05:10:34.612579+0000","last_became_peered":"2024-09-13T05:10:34.612579+0000","last_unstale":"2024-09-13T05:11:20.356910+0000","last_undegraded":"2024-09-13T05:11:20.356910+0000","last_fullsized":"2024-09-13T05:11:20.356910+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:43.339882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067403999999999999,"stat_sum":{"num_bytes":52132499,"num_objects":67,"num_object_clones":10,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":27,"num_read":4360,"num_read_kb":17477,"num_write":732,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":248973,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"82'312","reported_seq":1519,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.358136+0000","last_change":"2024-09-13T05:10:37.929523+0000","last_active":"2024-09-13T05:11:20.358136+0000","last_peered":"2024-09-13T05:11:20.358136+0000","last_clean":"2024-09-13T05:11:20.358136+0000","last_became_active":"2024-09-13T05:10:37.865440+0000","last_became_peered":"2024-09-13T05:10:37.865440+0000","last_unstale":"2024-09-13T05:11:20.358136+0000","last_undegraded":"2024-09-13T05:11:20.358136+0000","last_fullsized":"2024-09-13T05:11:20.358136+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:30:31.875141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087399999999998,"stat_sum":{"num_bytes":23966439,"num_objects":75,"num_object_clones":12,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":41,"num_read":1531,"num_read_kb":13147,"num_write":317,"num_write_kb":9444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":1513234,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"82'282","reported_seq":1906,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350868+0000","last_change":"2024-09-13T05:10:37.920810+0000","last_active":"2024-09-13T05:11:20.350868+0000","last_peered":"2024-09-13T05:11:20.350868+0000","last_clean":"2024-09-13T05:11:20.350868+0000","last_became_active":"2024-09-13T05:10:37.864816+0000","last_became_peered":"2024-09-13T05:10:37.864816+0000","last_unstale":"2024-09-13T05:11:20.350868+0000","last_undegraded":"2024-09-13T05:11:20.350868+0000","last_fullsized":"2024-09-13T05:11:20.350868+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:06.315864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096598599999999995,"stat_sum":{"num_bytes":8008426,"num_objects":49,"num_object_clones":5,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":23,"num_read":3422,"num_read_kb":5977,"num_write":249,"num_write_kb":2787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":37802,"num_keys_recovered":23,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"82'242","reported_seq":1792,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.359759+0000","last_change":"2024-09-13T05:11:21.359759+0000","last_active":"2024-09-13T05:11:21.359759+0000","last_peered":"2024-09-13T05:11:19.636191+0000","last_clean":"2024-09-13T05:11:19.636191+0000","last_became_active":"2024-09-13T05:11:16.318103+0000","last_became_peered":"2024-09-13T05:11:16.318103+0000","last_unstale":"2024-09-13T05:11:21.359759+0000","last_undegraded":"2024-09-13T05:11:21.359759+0000","last_fullsized":"2024-09-13T05:11:21.359759+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:26:59.453898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072236499999999999,"stat_sum":{"num_bytes":33427991,"num_objects":63,"num_object_clones":14,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":33,"num_read":1467,"num_read_kb":10421,"num_write":205,"num_write_kb":3380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":2367921,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"82'278","reported_seq":1494,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.357948+0000","last_change":"2024-09-13T05:10:11.681217+0000","last_active":"2024-09-13T05:11:20.357948+0000","last_peered":"2024-09-13T05:11:20.357948+0000","last_clean":"2024-09-13T05:11:20.357948+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:11:20.357948+0000","last_undegraded":"2024-09-13T05:11:20.357948+0000","last_fullsized":"2024-09-13T05:11:20.357948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:40.457636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095533399999999996,"stat_sum":{"num_bytes":15069163,"num_objects":59,"num_object_clones":11,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":31,"num_read":1761,"num_read_kb":10093,"num_write":332,"num_write_kb":6418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"82'252","reported_seq":3932,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356606+0000","last_change":"2024-09-13T05:10:11.681365+0000","last_active":"2024-09-13T05:11:20.356606+0000","last_peered":"2024-09-13T05:11:20.356606+0000","last_clean":"2024-09-13T05:11:20.356606+0000","last_became_active":"2024-09-13T05:10:09.645823+0000","last_became_peered":"2024-09-13T05:10:09.645823+0000","last_unstale":"2024-09-13T05:11:20.356606+0000","last_undegraded":"2024-09-13T05:11:20.356606+0000","last_fullsized":"2024-09-13T05:11:20.356606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:24.367358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011047369999999999,"stat_sum":{"num_bytes":40943795,"num_objects":70,"num_object_clones":11,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":36,"num_read":3719,"num_read_kb":26564,"num_write":218,"num_write_kb":5946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.354092+0000","last_change":"2024-09-13T05:10:01.383891+0000","last_active":"2024-09-13T05:11:20.354092+0000","last_peered":"2024-09-13T05:11:20.354092+0000","last_clean":"2024-09-13T05:11:20.354092+0000","last_became_active":"2024-09-13T05:09:59.374793+0000","last_became_peered":"2024-09-13T05:09:59.374793+0000","last_unstale":"2024-09-13T05:11:20.354092+0000","last_undegraded":"2024-09-13T05:11:20.354092+0000","last_fullsized":"2024-09-13T05:11:20.354092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:02.499446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065068999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"81'208","reported_seq":4630,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.355141+0000","last_change":"2024-09-13T05:11:21.355557+0000","last_active":"2024-09-13T05:11:20.356777+0000","last_peered":"2024-09-13T05:11:19.396360+0000","last_clean":"2024-09-13T05:11:19.396360+0000","last_became_active":"2024-09-13T05:11:16.320129+0000","last_became_peered":"2024-09-13T05:11:16.320129+0000","last_unstale":"2024-09-13T05:11:21.355141+0000","last_undegraded":"2024-09-13T05:11:21.355141+0000","last_fullsized":"2024-09-13T05:11:21.355141+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:46.094415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099899699999999995,"stat_sum":{"num_bytes":30257384,"num_objects":54,"num_object_clones":7,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":25,"num_read":3334,"num_read_kb":12021,"num_write":170,"num_write_kb":6871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":9357649,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.354122+0000","last_change":"2024-09-13T05:10:31.826927+0000","last_active":"2024-09-13T05:11:20.354122+0000","last_peered":"2024-09-13T05:11:20.354122+0000","last_clean":"2024-09-13T05:11:20.354122+0000","last_became_active":"2024-09-13T05:10:31.826431+0000","last_became_peered":"2024-09-13T05:10:31.826431+0000","last_unstale":"2024-09-13T05:11:20.354122+0000","last_undegraded":"2024-09-13T05:11:20.354122+0000","last_fullsized":"2024-09-13T05:11:20.354122+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:13:36.678853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"82'235","reported_seq":1353,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.357116+0000","last_change":"2024-09-13T05:10:12.077111+0000","last_active":"2024-09-13T05:11:20.357116+0000","last_peered":"2024-09-13T05:11:20.357116+0000","last_clean":"2024-09-13T05:11:20.357116+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:11:20.357116+0000","last_undegraded":"2024-09-13T05:11:20.357116+0000","last_fullsized":"2024-09-13T05:11:20.357116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:37.976147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001460444,"stat_sum":{"num_bytes":51840824,"num_objects":65,"num_object_clones":7,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":36,"num_read":1243,"num_read_kb":10722,"num_write":204,"num_write_kb":3289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":88,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.358251+0000","last_change":"2024-09-13T05:10:37.866953+0000","last_active":"2024-09-13T05:11:20.358251+0000","last_peered":"2024-09-13T05:11:20.358251+0000","last_clean":"2024-09-13T05:11:20.358251+0000","last_became_active":"2024-09-13T05:10:37.866624+0000","last_became_peered":"2024-09-13T05:10:37.866624+0000","last_unstale":"2024-09-13T05:11:20.358251+0000","last_undegraded":"2024-09-13T05:11:20.358251+0000","last_fullsized":"2024-09-13T05:11:20.358251+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:56:20.077971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"82'395","reported_seq":869,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.360669+0000","last_change":"2024-09-13T05:11:21.361787+0000","last_active":"2024-09-13T05:11:20.353207+0000","last_peered":"2024-09-13T05:11:19.588315+0000","last_clean":"2024-09-13T05:11:19.588315+0000","last_became_active":"2024-09-13T05:11:16.320218+0000","last_became_peered":"2024-09-13T05:11:16.320218+0000","last_unstale":"2024-09-13T05:11:21.360669+0000","last_undegraded":"2024-09-13T05:11:21.360669+0000","last_fullsized":"2024-09-13T05:11:21.360669+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:55.459490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076234800000000004,"stat_sum":{"num_bytes":12725004,"num_objects":62,"num_object_clones":5,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":32,"num_read":1423,"num_read_kb":2480,"num_write":544,"num_write_kb":3485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":1446352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356542+0000","last_change":"2024-09-13T05:10:37.864940+0000","last_active":"2024-09-13T05:11:20.356542+0000","last_peered":"2024-09-13T05:11:20.356542+0000","last_clean":"2024-09-13T05:11:20.356542+0000","last_became_active":"2024-09-13T05:10:37.864623+0000","last_became_peered":"2024-09-13T05:10:37.864623+0000","last_unstale":"2024-09-13T05:11:20.356542+0000","last_undegraded":"2024-09-13T05:11:20.356542+0000","last_fullsized":"2024-09-13T05:11:20.356542+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:41.598490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.5","version":"82'304","reported_seq":2657,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350596+0000","last_change":"2024-09-13T05:10:11.645960+0000","last_active":"2024-09-13T05:11:20.350596+0000","last_peered":"2024-09-13T05:11:20.350596+0000","last_clean":"2024-09-13T05:11:20.350596+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:11:20.350596+0000","last_undegraded":"2024-09-13T05:11:20.350596+0000","last_fullsized":"2024-09-13T05:11:20.350596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:40.372741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001054028,"stat_sum":{"num_bytes":68392647,"num_objects":67,"num_object_clones":8,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":25,"num_read":3566,"num_read_kb":55119,"num_write":289,"num_write_kb":37660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"82'421","reported_seq":2245,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.352386+0000","last_change":"2024-09-13T05:10:37.979816+0000","last_active":"2024-09-13T05:11:20.352386+0000","last_peered":"2024-09-13T05:11:20.352386+0000","last_clean":"2024-09-13T05:11:20.352386+0000","last_became_active":"2024-09-13T05:10:37.863256+0000","last_became_peered":"2024-09-13T05:10:37.863256+0000","last_unstale":"2024-09-13T05:11:20.352386+0000","last_undegraded":"2024-09-13T05:11:20.352386+0000","last_fullsized":"2024-09-13T05:11:20.352386+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:58:55.928356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099335200000000008,"stat_sum":{"num_bytes":55125174,"num_objects":60,"num_object_clones":8,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":31,"num_read":3071,"num_read_kb":18570,"num_write":534,"num_write_kb":24635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":214109,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350590+0000","last_change":"2024-09-13T05:10:31.836193+0000","last_active":"2024-09-13T05:11:20.350590+0000","last_peered":"2024-09-13T05:11:20.350590+0000","last_clean":"2024-09-13T05:11:20.350590+0000","last_became_active":"2024-09-13T05:10:31.825663+0000","last_became_peered":"2024-09-13T05:10:31.825663+0000","last_unstale":"2024-09-13T05:11:20.350590+0000","last_undegraded":"2024-09-13T05:11:20.350590+0000","last_fullsized":"2024-09-13T05:11:20.350590+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:38:23.311570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"82'308","reported_seq":648,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.351978+0000","last_change":"2024-09-13T05:10:31.893494+0000","last_active":"2024-09-13T05:11:20.351978+0000","last_peered":"2024-09-13T05:11:20.351978+0000","last_clean":"2024-09-13T05:11:20.351978+0000","last_became_active":"2024-09-13T05:10:31.827657+0000","last_became_peered":"2024-09-13T05:10:31.827657+0000","last_unstale":"2024-09-13T05:11:20.351978+0000","last_undegraded":"2024-09-13T05:11:20.351978+0000","last_fullsized":"2024-09-13T05:11:20.351978+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:16:14.432049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045163499999999998,"stat_sum":{"num_bytes":9373413,"num_objects":64,"num_object_clones":10,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":30,"num_read":946,"num_read_kb":2010,"num_write":355,"num_write_kb":1595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":84179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.352208+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:11:20.352208+0000","last_peered":"2024-09-13T05:11:20.352208+0000","last_clean":"2024-09-13T05:11:20.352208+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:11:20.352208+0000","last_undegraded":"2024-09-13T05:11:20.352208+0000","last_fullsized":"2024-09-13T05:11:20.352208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"82'199","reported_seq":621,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356737+0000","last_change":"2024-09-13T05:10:38.111510+0000","last_active":"2024-09-13T05:11:20.356737+0000","last_peered":"2024-09-13T05:11:20.356737+0000","last_clean":"2024-09-13T05:11:20.356737+0000","last_became_active":"2024-09-13T05:10:37.869040+0000","last_became_peered":"2024-09-13T05:10:37.869040+0000","last_unstale":"2024-09-13T05:11:20.356737+0000","last_undegraded":"2024-09-13T05:11:20.356737+0000","last_fullsized":"2024-09-13T05:11:20.356737+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:48:18.385423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048152600000000002,"stat_sum":{"num_bytes":14153518,"num_objects":53,"num_object_clones":8,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":28,"num_read":372,"num_read_kb":6477,"num_write":183,"num_write_kb":7640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":383717,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.355963+0000","last_change":"2024-09-13T05:10:37.865514+0000","last_active":"2024-09-13T05:11:20.355963+0000","last_peered":"2024-09-13T05:11:20.355963+0000","last_clean":"2024-09-13T05:11:20.355963+0000","last_became_active":"2024-09-13T05:10:37.864299+0000","last_became_peered":"2024-09-13T05:10:37.864299+0000","last_unstale":"2024-09-13T05:11:20.355963+0000","last_undegraded":"2024-09-13T05:11:20.355963+0000","last_fullsized":"2024-09-13T05:11:20.355963+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:45:58.276509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"82'291","reported_seq":1424,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.361675+0000","last_change":"2024-09-13T05:11:21.361851+0000","last_active":"2024-09-13T05:11:20.357426+0000","last_peered":"2024-09-13T05:11:19.677565+0000","last_clean":"2024-09-13T05:11:19.677565+0000","last_became_active":"2024-09-13T05:11:16.318497+0000","last_became_peered":"2024-09-13T05:11:16.318497+0000","last_unstale":"2024-09-13T05:11:21.361675+0000","last_undegraded":"2024-09-13T05:11:21.361675+0000","last_fullsized":"2024-09-13T05:11:21.361675+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:41:26.275072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059320200000000003,"stat_sum":{"num_bytes":2453385,"num_objects":63,"num_object_clones":6,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":30,"num_read":2378,"num_read_kb":4246,"num_write":246,"num_write_kb":2311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":1411492,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350763+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:11:20.350763+0000","last_peered":"2024-09-13T05:11:20.350763+0000","last_clean":"2024-09-13T05:11:20.350763+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:11:20.350763+0000","last_undegraded":"2024-09-13T05:11:20.350763+0000","last_fullsized":"2024-09-13T05:11:20.350763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":249,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356133+0000","last_change":"2024-09-13T05:10:40.886011+0000","last_active":"2024-09-13T05:11:20.356133+0000","last_peered":"2024-09-13T05:11:20.356133+0000","last_clean":"2024-09-13T05:11:20.356133+0000","last_became_active":"2024-09-13T05:10:40.885587+0000","last_became_peered":"2024-09-13T05:10:40.885587+0000","last_unstale":"2024-09-13T05:11:20.356133+0000","last_undegraded":"2024-09-13T05:11:20.356133+0000","last_fullsized":"2024-09-13T05:11:20.356133+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:52:47.632734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"82'200","reported_seq":462,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.358238+0000","last_change":"2024-09-13T05:10:31.888827+0000","last_active":"2024-09-13T05:11:20.358238+0000","last_peered":"2024-09-13T05:11:20.358238+0000","last_clean":"2024-09-13T05:11:20.358238+0000","last_became_active":"2024-09-13T05:10:31.827016+0000","last_became_peered":"2024-09-13T05:10:31.827016+0000","last_unstale":"2024-09-13T05:11:20.358238+0000","last_undegraded":"2024-09-13T05:11:20.358238+0000","last_fullsized":"2024-09-13T05:11:20.358238+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:47.525525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000500144,"stat_sum":{"num_bytes":5421745,"num_objects":68,"num_object_clones":8,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":38,"num_read":219,"num_read_kb":1292,"num_write":156,"num_write_kb":24142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":58925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"82'242","reported_seq":5921,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.352030+0000","last_change":"2024-09-13T05:10:11.648218+0000","last_active":"2024-09-13T05:11:20.352030+0000","last_peered":"2024-09-13T05:11:20.352030+0000","last_clean":"2024-09-13T05:11:20.352030+0000","last_became_active":"2024-09-13T05:10:09.645408+0000","last_became_peered":"2024-09-13T05:10:09.645408+0000","last_unstale":"2024-09-13T05:11:20.352030+0000","last_undegraded":"2024-09-13T05:11:20.352030+0000","last_fullsized":"2024-09-13T05:11:20.352030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:59.846981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097828900000000002,"stat_sum":{"num_bytes":26732733,"num_objects":55,"num_object_clones":5,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":24,"num_read":6916,"num_read_kb":20339,"num_write":199,"num_write_kb":5391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"82'378","reported_seq":8606,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356790+0000","last_change":"2024-09-13T05:10:47.940550+0000","last_active":"2024-09-13T05:11:20.356790+0000","last_peered":"2024-09-13T05:11:20.356790+0000","last_clean":"2024-09-13T05:11:20.356790+0000","last_became_active":"2024-09-13T05:10:47.939220+0000","last_became_peered":"2024-09-13T05:10:47.939220+0000","last_unstale":"2024-09-13T05:11:20.356790+0000","last_undegraded":"2024-09-13T05:11:20.356790+0000","last_fullsized":"2024-09-13T05:11:20.356790+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:59.693041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013204619999999999,"stat_sum":{"num_bytes":5708351,"num_objects":63,"num_object_clones":9,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":33,"num_read":8750,"num_read_kb":12319,"num_write":427,"num_write_kb":6929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":59,"num_bytes_recovered":6203954,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"81'216","reported_seq":1693,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356722+0000","last_change":"2024-09-13T05:10:38.007507+0000","last_active":"2024-09-13T05:11:20.356722+0000","last_peered":"2024-09-13T05:11:20.356722+0000","last_clean":"2024-09-13T05:11:20.356722+0000","last_became_active":"2024-09-13T05:10:37.868643+0000","last_became_peered":"2024-09-13T05:10:37.868643+0000","last_unstale":"2024-09-13T05:11:20.356722+0000","last_undegraded":"2024-09-13T05:11:20.356722+0000","last_fullsized":"2024-09-13T05:11:20.356722+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:29:05.387242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055343700000000005,"stat_sum":{"num_bytes":6059553,"num_objects":62,"num_object_clones":11,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":35,"num_read":1443,"num_read_kb":3806,"num_write":176,"num_write_kb":6478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":15854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"82'152","reported_seq":514,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350963+0000","last_change":"2024-09-13T05:10:11.647302+0000","last_active":"2024-09-13T05:11:20.350963+0000","last_peered":"2024-09-13T05:11:20.350963+0000","last_clean":"2024-09-13T05:11:20.350963+0000","last_became_active":"2024-09-13T05:10:09.647037+0000","last_became_peered":"2024-09-13T05:10:09.647037+0000","last_unstale":"2024-09-13T05:11:20.350963+0000","last_undegraded":"2024-09-13T05:11:20.350963+0000","last_fullsized":"2024-09-13T05:11:20.350963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:54:17.061326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069994199999999995,"stat_sum":{"num_bytes":23527409,"num_objects":54,"num_object_clones":7,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":27,"num_read":362,"num_read_kb":4460,"num_write":133,"num_write_kb":3240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"82'538","reported_seq":3722,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.355244+0000","last_change":"2024-09-13T05:11:21.355680+0000","last_active":"2024-09-13T05:11:20.356779+0000","last_peered":"2024-09-13T05:11:19.588900+0000","last_clean":"2024-09-13T05:11:19.588900+0000","last_became_active":"2024-09-13T05:11:16.320142+0000","last_became_peered":"2024-09-13T05:11:16.320142+0000","last_unstale":"2024-09-13T05:11:21.355244+0000","last_undegraded":"2024-09-13T05:11:21.355244+0000","last_fullsized":"2024-09-13T05:11:21.355244+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:22:28.513701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019283150000000001,"stat_sum":{"num_bytes":67865030,"num_objects":68,"num_object_clones":7,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":29,"num_read":4868,"num_read_kb":14274,"num_write":691,"num_write_kb":7824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":6390508,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"82'706","reported_seq":4976,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.356791+0000","last_change":"2024-09-13T05:11:21.357157+0000","last_active":"2024-09-13T05:11:20.357722+0000","last_peered":"2024-09-13T05:11:19.473240+0000","last_clean":"2024-09-13T05:11:19.473240+0000","last_became_active":"2024-09-13T05:11:17.320630+0000","last_became_peered":"2024-09-13T05:11:17.320630+0000","last_unstale":"2024-09-13T05:11:21.356791+0000","last_undegraded":"2024-09-13T05:11:21.356791+0000","last_fullsized":"2024-09-13T05:11:21.356791+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:59:37.099760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018982339999999999,"stat_sum":{"num_bytes":21050383,"num_objects":62,"num_object_clones":5,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":33,"num_read":5865,"num_read_kb":6503,"num_write":1074,"num_write_kb":5137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":5447772,"num_keys_recovered":27,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"81'571","reported_seq":1739,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356396+0000","last_change":"2024-09-13T05:10:40.885332+0000","last_active":"2024-09-13T05:11:20.356396+0000","last_peered":"2024-09-13T05:11:20.356396+0000","last_clean":"2024-09-13T05:11:20.356396+0000","last_became_active":"2024-09-13T05:10:40.884585+0000","last_became_peered":"2024-09-13T05:10:40.884585+0000","last_unstale":"2024-09-13T05:11:20.356396+0000","last_undegraded":"2024-09-13T05:11:20.356396+0000","last_fullsized":"2024-09-13T05:11:20.356396+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:31:19.596080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001164273,"stat_sum":{"num_bytes":16441807,"num_objects":62,"num_object_clones":8,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":33,"num_read":3424,"num_read_kb":11070,"num_write":814,"num_write_kb":6507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":296075,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"82'304","reported_seq":1645,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.360339+0000","last_change":"2024-09-13T05:11:21.360699+0000","last_active":"2024-09-13T05:11:20.351535+0000","last_peered":"2024-09-13T05:11:19.586024+0000","last_clean":"2024-09-13T05:11:19.586024+0000","last_became_active":"2024-09-13T05:11:16.318398+0000","last_became_peered":"2024-09-13T05:11:16.318398+0000","last_unstale":"2024-09-13T05:11:21.360339+0000","last_undegraded":"2024-09-13T05:11:21.360339+0000","last_fullsized":"2024-09-13T05:11:21.360339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:15.586596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009951719999999999,"stat_sum":{"num_bytes":34507347,"num_objects":70,"num_object_clones":5,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":30,"num_read":1883,"num_read_kb":13826,"num_write":314,"num_write_kb":6862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":6115400,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"82'208","reported_seq":550,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356242+0000","last_change":"2024-09-13T05:10:11.680757+0000","last_active":"2024-09-13T05:11:20.356242+0000","last_peered":"2024-09-13T05:11:20.356242+0000","last_clean":"2024-09-13T05:11:20.356242+0000","last_became_active":"2024-09-13T05:10:09.653444+0000","last_became_peered":"2024-09-13T05:10:09.653444+0000","last_unstale":"2024-09-13T05:11:20.356242+0000","last_undegraded":"2024-09-13T05:11:20.356242+0000","last_fullsized":"2024-09-13T05:11:20.356242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:17:06.303008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000625977,"stat_sum":{"num_bytes":11696067,"num_objects":69,"num_object_clones":9,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":37,"num_read":367,"num_read_kb":8786,"num_write":170,"num_write_kb":4690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"82'654","reported_seq":2276,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356098+0000","last_change":"2024-09-13T05:10:40.884306+0000","last_active":"2024-09-13T05:11:20.356098+0000","last_peered":"2024-09-13T05:11:20.356098+0000","last_clean":"2024-09-13T05:11:20.356098+0000","last_became_active":"2024-09-13T05:10:40.883543+0000","last_became_peered":"2024-09-13T05:10:40.883543+0000","last_unstale":"2024-09-13T05:11:20.356098+0000","last_undegraded":"2024-09-13T05:11:20.356098+0000","last_fullsized":"2024-09-13T05:11:20.356098+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:14:23.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048307200000000003,"stat_sum":{"num_bytes":57651425,"num_objects":62,"num_object_clones":10,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":28,"num_read":4555,"num_read_kb":19689,"num_write":918,"num_write_kb":5670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":633324,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"82'610","reported_seq":2086,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356890+0000","last_change":"2024-09-13T05:10:11.680877+0000","last_active":"2024-09-13T05:11:20.356890+0000","last_peered":"2024-09-13T05:11:20.356890+0000","last_clean":"2024-09-13T05:11:20.356890+0000","last_became_active":"2024-09-13T05:10:09.649053+0000","last_became_peered":"2024-09-13T05:10:09.649053+0000","last_unstale":"2024-09-13T05:11:20.356890+0000","last_undegraded":"2024-09-13T05:11:20.356890+0000","last_fullsized":"2024-09-13T05:11:20.356890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:14.770260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062821800000000005,"stat_sum":{"num_bytes":45221010,"num_objects":79,"num_object_clones":14,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":38,"num_read":3681,"num_read_kb":45427,"num_write":857,"num_write_kb":38413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":841991051,"num_objects":2034,"num_object_clones":272,"num_object_copies":4068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2034,"num_whiteouts":982,"num_read":89481,"num_read_kb":405844,"num_write":12539,"num_write_kb":271018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1299,"num_bytes_recovered":44591268,"num_keys_recovered":167,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":279560192,"data_stored":308393489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10950,"ondisk_log_size":10950,"up":64,"acting":58,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120844,"kb_used_data":71680,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94250996,"statfs":{"total":96636764160,"available":96513019904,"internally_reserved":0,"allocated":73400320,"data_stored":79819178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":50330059},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.751}]},{"osd":1,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.88500000000000001}]},{"osd":2,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.0609999999999999}]},{"osd":3,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.95199999999999996}]},{"osd":4,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.97999999999999998}]},{"osd":5,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.117},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.92400000000000004}]},{"osd":6,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.0820000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79332,"kb_used_data":39900,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94292508,"statfs":{"total":96636764160,"available":96555528192,"internally_reserved":0,"allocated":40857600,"data_stored":45907384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.64500000000000002}]},{"osd":1,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.82999999999999996}]},{"osd":2,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":1.109},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.93600000000000005}]},{"osd":3,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.1719999999999999}]},{"osd":4,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.752}]},{"osd":5,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.014}]},{"osd":7,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.2350000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70344,"kb_used_data":39224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94301496,"statfs":{"total":96636764160,"available":96564731904,"internally_reserved":0,"allocated":40165376,"data_stored":40304922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.96799999999999997}]},{"osd":1,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.83599999999999997}]},{"osd":2,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.627},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.90500000000000003}]},{"osd":3,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.131}]},{"osd":4,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.014},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.153}]},{"osd":6,"last update":"Fri Sep 13 05:10:58 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.107}]},{"osd":7,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.079},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.2}]}]},{"osd":4,"up_from":0,"seq":55834574871,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102824,"kb_used_data":71704,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94269016,"statfs":{"total":96636764160,"available":96531472384,"internally_reserved":0,"allocated":73424896,"data_stored":79410349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.41699999999999998}]},{"osd":1,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.442}]},{"osd":2,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.54000000000000004}]},{"osd":4,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.71999999999999997}]},{"osd":5,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.65700000000000003}]},{"osd":6,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.70199999999999996}]},{"osd":7,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.878},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.80900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79520,"kb_used_data":40208,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94292320,"statfs":{"total":96636764160,"available":96555335680,"internally_reserved":0,"allocated":41172992,"data_stored":44207117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.69199999999999995}]},{"osd":1,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.90700000000000003}]},{"osd":3,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.84799999999999998}]},{"osd":4,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.997}]},{"osd":5,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.0209999999999999}]},{"osd":6,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.048}]},{"osd":7,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.093},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.98299999999999998}]}]},{"osd":1,"up_from":0,"seq":55834574869,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":0,"seq":55834574871,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10035200,"data_stored":11939429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6619136,"data_stored":10238144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40181760,"data_stored":43752921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":72433664,"data_stored":78956153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":39182336,"data_stored":39856947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":39280640,"data_stored":44869041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":71827456,"data_stored":78780854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:11:23.932 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:23.932 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:23.932 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:11:23.932 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:23.936 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #26, image image_client.0-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent27 2024-09-13T05:11:23.940 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:11:24.017 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:24.014+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:24.047 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:24.047 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:24.047 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:24.047 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:24.047 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:24.057 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:11:24.118 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:24.114+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:24.213 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:24.213 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:24.213 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:24.214 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:24.214 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.214 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:24.214 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:24.214 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 47.346585212999997, 2024-09-13T05:11:24.214 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:11:24.214 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:24.214 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:24.214 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:24.214 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:24.214 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.214 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:11:24.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.214 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:24.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.215 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:24.215 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:24.215 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.215 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:24.215 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:24.215 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.215 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:24.215 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:24.215 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:24.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.216 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.216 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:24.216 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:11:24.216 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:11:24.216 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.216 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.216 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:24.216 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:11:24.216 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:11:24.216 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.216 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.216 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.216 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:11:24.217 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:11:24.217 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.217 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.217 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.217 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:11:24.217 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:11:24.217 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.217 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.217 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.217 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:11:24.217 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:11:24.217 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.217 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.218 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:11:24.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:11:24.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.218 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.218 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:24.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:11:24.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:11:24.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.218 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.218 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:24.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:11:24.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:11:24.218 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.219 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:24.219 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.219 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.219 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.219 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:24.219 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:24.219 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 47.346560777000001, 2024-09-13T05:11:24.219 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:11:24.219 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:24.219 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:24.219 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:24.219 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:24.219 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.219 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:11:24.220 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.220 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:24.220 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.220 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:24.220 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:24.220 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.220 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.220 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.220 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:24.220 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:24.220 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.220 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.220 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.220 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:24.221 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:24.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:24.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.221 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:24.221 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:11:24.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:11:24.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.221 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:24.221 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:11:24.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:11:24.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.222 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.222 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.222 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:11:24.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:11:24.222 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.222 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.222 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.222 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:11:24.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:11:24.222 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.222 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.222 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.222 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:11:24.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:11:24.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:11:24.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:11:24.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:24.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:11:24.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:11:24.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:24.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:11:24.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:11:24.224 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.224 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:24.224 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.224 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.224 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:24.224 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:24.224 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 47.346550950999998, 2024-09-13T05:11:24.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:11:24.224 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:24.224 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:24.224 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:24.225 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:24.225 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.225 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:11:24.225 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.225 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:24.225 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.225 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:24.225 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:24.225 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.225 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.225 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.225 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:24.225 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:24.225 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:24.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:24.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:24.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:24.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:11:24.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:11:24.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:24.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:11:24.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:11:24.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:11:24.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:11:24.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:11:24.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:11:24.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.228 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:11:24.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:11:24.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.228 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.228 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:11:24.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:11:24.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.228 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:24.228 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:11:24.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:11:24.228 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.229 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:24.229 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.229 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.229 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.229 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:24.229 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:24.229 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 47.346542714999998, 2024-09-13T05:11:24.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:11:24.229 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:24.229 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:24.229 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:24.229 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:24.229 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.229 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:11:24.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.230 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:24.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:24.230 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:24.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:24.230 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:24.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:24.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:24.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:24.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:24.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:11:24.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:11:24.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:24.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:11:24.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:11:24.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.232 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.232 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:11:24.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:11:24.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.232 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.232 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.232 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:11:24.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:11:24.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.232 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.232 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.232 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:11:24.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:11:24.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:11:24.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:11:24.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:24.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:11:24.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:11:24.233 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.233 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:24.233 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.234 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.234 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:24.234 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:24.234 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 47.346520802999997, 2024-09-13T05:11:24.234 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:11:24.234 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:24.234 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:24.234 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:24.234 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:24.234 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.234 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:11:24.234 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.234 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:24.234 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:24.235 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:24.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:24.235 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:24.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:24.235 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:24.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:24.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:24.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:11:24.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:11:24.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:24.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:11:24.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:11:24.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:11:24.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:11:24.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:11:24.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:11:24.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:11:24.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:11:24.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:11:24.238 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:11:24.238 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.238 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.238 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:24.238 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:11:24.238 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:11:24.238 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.238 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:24.238 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.238 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.238 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.238 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:24.238 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:24.238 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 47.346512199000003, 2024-09-13T05:11:24.239 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:11:24.239 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:24.239 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:24.239 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:24.239 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:24.239 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.239 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:11:24.239 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.239 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:24.239 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.240 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:24.240 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:24.240 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.240 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.240 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:24.240 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:24.240 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.240 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.240 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:24.240 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:24.240 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:24.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:24.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:11:24.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:11:24.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:24.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:11:24.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:11:24.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:11:24.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:11:24.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:11:24.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:11:24.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:11:24.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:11:24.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:11:24.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:11:24.243 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.243 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.243 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:24.243 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:11:24.243 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:11:24.243 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.243 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:24.243 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.243 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.243 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.243 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:24.243 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:24.243 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 47.346502504999997, 2024-09-13T05:11:24.243 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:11:24.244 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:24.244 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:24.244 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:24.244 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:24.244 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.244 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:11:24.244 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.244 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:24.244 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.244 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:24.244 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:24.244 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.244 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.244 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.245 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:24.245 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:24.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.245 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.245 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:24.245 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:24.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:24.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.245 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.245 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:24.245 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:11:24.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:11:24.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:24.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:11:24.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:11:24.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:11:24.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:11:24.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:11:24.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:11:24.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:11:24.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:11:24.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:11:24.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:11:24.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:24.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:11:24.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:11:24.247 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.248 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:24.248 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.248 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.248 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:24.248 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:24.248 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 47.346493389999999, 2024-09-13T05:11:24.248 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:11:24.248 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:24.248 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:24.248 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:24.248 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:24.248 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.248 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:11:24.248 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.249 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:24.249 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.249 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:24.249 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:24.249 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.249 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.249 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.249 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:24.249 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:24.249 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.249 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.249 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.249 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:24.249 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:24.249 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:24.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:24.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:11:24.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:11:24.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:24.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:11:24.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:11:24.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:11:24.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:11:24.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:11:24.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:11:24.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:11:24.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:11:24.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.252 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.252 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:11:24.252 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:11:24.252 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.252 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.252 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:24.252 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:11:24.252 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:11:24.252 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.252 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:24.252 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.252 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.252 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.252 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:24.252 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:11:24.253 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 47.346484910999997, 2024-09-13T05:11:24.253 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:11:24.253 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:24.253 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:24.257 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:24.257 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:24.257 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.257 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:11:24.257 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.257 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:24.257 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.257 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:24.257 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:11:24.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.258 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.258 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.258 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:24.258 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:11:24.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.258 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.258 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.258 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:24.258 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:11:24.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:24.258 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.259 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:24.259 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:11:24.259 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:11:24.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.259 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:24.259 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:11:24.259 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:11:24.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.259 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.260 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:11:24.260 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:11:24.260 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.260 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.260 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.260 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:11:24.260 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:11:24.260 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.260 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.260 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.260 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:11:24.261 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:11:24.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.261 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.261 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.261 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:11:24.261 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:11:24.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.261 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.261 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:24.261 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:11:24.261 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:11:24.261 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.262 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:24.262 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.262 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.262 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.262 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:24.262 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:11:24.262 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 47.346472986000002, 2024-09-13T05:11:24.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:11:24.262 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:24.262 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:24.262 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:24.263 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:24.263 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.263 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:11:24.263 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.263 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:24.263 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.263 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:24.263 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:11:24.263 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.263 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:24.264 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:11:24.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:24.264 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:11:24.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:24.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.265 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:24.265 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:11:24.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:11:24.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.265 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:24.265 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:11:24.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:11:24.266 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.266 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.266 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:11:24.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:11:24.266 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.266 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.266 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:11:24.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:11:24.266 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.267 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.267 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.267 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:11:24.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:11:24.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.267 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.267 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.267 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:11:24.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:11:24.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.268 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.268 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:24.268 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:11:24.268 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:11:24.268 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.268 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:24.268 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.268 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.268 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.268 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:24.268 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:24.269 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 47.346451397000003, 2024-09-13T05:11:24.269 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:11:24.269 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:24.269 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:24.269 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:24.269 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:24.269 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.269 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:11:24.269 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.269 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:24.269 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.269 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:24.270 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:24.270 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.270 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.270 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.270 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:24.270 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:24.270 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.270 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.270 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.270 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:24.270 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:24.270 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:24.271 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.271 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.271 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:24.271 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:11:24.271 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:11:24.271 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.271 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.271 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:24.271 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:11:24.271 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:11:24.271 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.271 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.272 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.272 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:11:24.272 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:11:24.272 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.272 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.272 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.272 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:11:24.272 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:11:24.272 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.272 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.272 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.272 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:11:24.273 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:11:24.273 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.273 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.273 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.273 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:11:24.273 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:11:24.273 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.273 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.273 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:24.273 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:11:24.273 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:11:24.274 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.274 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:24.274 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.274 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.274 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.274 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:24.274 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:24.274 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 47.346428269, 2024-09-13T05:11:24.274 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:11:24.274 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:24.274 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:24.274 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:24.275 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:24.275 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.275 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:11:24.275 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.275 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:24.275 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.275 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:24.275 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:24.275 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.275 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.275 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.276 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:24.276 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:24.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.276 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.276 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:24.276 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:24.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:24.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.276 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.277 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:24.277 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:11:24.277 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:11:24.277 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.277 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.277 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:24.277 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:11:24.277 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:11:24.277 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.277 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.277 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.277 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:11:24.278 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:11:24.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.278 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.278 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.278 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:11:24.278 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:11:24.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.278 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.278 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.278 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:11:24.278 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:11:24.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.279 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.279 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.279 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:11:24.279 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:11:24.279 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.279 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.279 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:24.279 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:11:24.279 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:11:24.279 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.279 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:24.279 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.280 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.280 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.280 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:24.280 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:11:24.280 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 47.346412895999997, 2024-09-13T05:11:24.280 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:11:24.280 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:24.280 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:24.280 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:24.280 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:24.280 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.281 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:11:24.281 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.281 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:24.281 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.281 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:24.281 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:11:24.281 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.281 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.281 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.281 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:24.281 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:11:24.281 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.282 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.282 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.282 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:24.282 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:11:24.282 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:24.282 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.282 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.282 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:24.282 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:11:24.282 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:11:24.282 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.282 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.283 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:24.283 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:11:24.283 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:11:24.283 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.283 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.283 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.283 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:11:24.283 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:11:24.283 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.283 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.283 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.284 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:11:24.284 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:11:24.284 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.284 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.284 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.284 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:11:24.284 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:11:24.284 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.284 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.284 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.284 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:11:24.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:11:24.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.285 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:24.285 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:11:24.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:11:24.285 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.285 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:24.285 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.286 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:24.286 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:24.286 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 47.346392428000001, 2024-09-13T05:11:24.286 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:11:24.286 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:24.286 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:24.286 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:24.286 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:24.286 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.286 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:11:24.286 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.287 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:24.287 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.287 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:24.287 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:24.287 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.287 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.287 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.287 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:24.287 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:24.287 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.288 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.288 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.288 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:24.288 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:24.288 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:24.288 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.288 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.288 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:24.288 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:11:24.288 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:11:24.288 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.289 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.289 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:24.289 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:11:24.289 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:11:24.289 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.289 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.289 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.289 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:11:24.289 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:11:24.289 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.289 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.290 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.290 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:11:24.290 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:11:24.290 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.290 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.290 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.290 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:11:24.290 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:11:24.290 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.290 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.290 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.291 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:11:24.291 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:11:24.291 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.291 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.291 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:24.291 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:11:24.291 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:11:24.291 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.291 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:24.291 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.291 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.292 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.292 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:24.292 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:24.292 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 47.346375766999998, 2024-09-13T05:11:24.292 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:11:24.292 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:24.292 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:24.292 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:24.292 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:24.292 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.292 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:11:24.293 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.293 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:24.293 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.293 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:24.293 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:24.293 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.293 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.293 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.293 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:24.293 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:24.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.294 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.294 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.294 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:24.294 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:24.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:24.294 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.294 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.294 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:24.294 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:11:24.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:11:24.294 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.295 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.295 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:24.295 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:11:24.295 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:11:24.295 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.295 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.295 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.295 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:11:24.295 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:11:24.295 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.295 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.295 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.296 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:11:24.296 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:11:24.296 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.296 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.296 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.296 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:11:24.296 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:11:24.296 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.296 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.296 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.297 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:11:24.297 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:11:24.297 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.297 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.297 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:24.297 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:11:24.297 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:11:24.297 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.297 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:24.297 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.297 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.298 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.298 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:24.298 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:11:24.298 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 47.346349054000001, 2024-09-13T05:11:24.298 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:11:24.298 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:24.298 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:24.298 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:24.298 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:24.298 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.298 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:11:24.298 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.299 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:24.299 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.299 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:24.299 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:11:24.299 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.299 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.299 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.299 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:24.299 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:11:24.299 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.299 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.299 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.300 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:24.300 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:11:24.300 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:24.300 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.300 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.300 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:24.300 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:11:24.300 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:11:24.300 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.300 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.300 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:24.300 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:11:24.301 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:11:24.301 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.301 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.301 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.301 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:11:24.301 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:11:24.301 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.301 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.301 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.301 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:11:24.301 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:11:24.302 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.302 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.302 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.302 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:11:24.302 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:11:24.302 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.302 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.302 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.302 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:11:24.302 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:11:24.302 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.302 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.303 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:24.303 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:11:24.303 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:11:24.303 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.303 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:24.303 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.303 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.303 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.303 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:24.303 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:24.303 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 47.346330201999997, 2024-09-13T05:11:24.304 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:11:24.304 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:24.304 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:24.304 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:24.304 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:24.304 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.304 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:11:24.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.304 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:24.304 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.304 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:24.304 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:24.305 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.305 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.305 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.305 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:24.305 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:24.305 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.305 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.305 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.305 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:24.305 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:24.305 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:24.306 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.306 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.306 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:24.306 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:11:24.306 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:11:24.306 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.306 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.306 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:24.306 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:11:24.306 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:11:24.306 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.306 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.307 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.307 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:11:24.307 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:11:24.307 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.307 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.307 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.307 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:11:24.307 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:11:24.307 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.307 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.307 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.307 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:11:24.308 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:11:24.308 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.308 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.308 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.308 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:11:24.308 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:11:24.308 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.308 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.308 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:24.308 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:11:24.309 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:11:24.309 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.309 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:24.309 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.309 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.309 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.309 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:24.310 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:24.310 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 47.346312416000004, 2024-09-13T05:11:24.310 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:11:24.310 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:24.310 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:24.310 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:24.310 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:24.310 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.311 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:11:24.311 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.311 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:24.311 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.311 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:24.311 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:24.311 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.311 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.311 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.311 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:24.311 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:24.312 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.312 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.312 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.312 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:24.312 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:24.312 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:24.312 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.312 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.312 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:24.312 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:11:24.312 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:11:24.312 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.313 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.313 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:24.313 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:11:24.313 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:11:24.313 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.313 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.313 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.313 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:11:24.313 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:11:24.313 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.313 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.314 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.314 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:11:24.314 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:11:24.314 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.314 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.314 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.314 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:11:24.314 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:11:24.314 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.314 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.314 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.314 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:11:24.315 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:11:24.315 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.315 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.315 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:24.315 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:11:24.315 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:11:24.315 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.315 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:24.315 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.315 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.315 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.315 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:24.316 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:24.316 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 47.346277356000002, 2024-09-13T05:11:24.316 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:11:24.316 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:24.316 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:24.316 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:24.316 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:24.316 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.316 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:11:24.316 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.316 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:24.317 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.317 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:24.317 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:24.317 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.317 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.317 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:24.317 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:24.317 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.317 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.317 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:24.318 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:24.318 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:24.318 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.318 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.318 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:24.318 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:11:24.318 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:11:24.318 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.318 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.318 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:24.318 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:11:24.318 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:11:24.319 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.319 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.319 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.319 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:11:24.319 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:11:24.319 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.319 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.319 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.319 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:11:24.319 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:11:24.319 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.319 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.320 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.320 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:11:24.320 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:11:24.320 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.320 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.320 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.320 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:11:24.320 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:11:24.320 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.320 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.320 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:24.321 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:11:24.321 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:11:24.321 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.321 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:24.321 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.321 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.321 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.321 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:24.321 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:24.321 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 47.346260540999999, 2024-09-13T05:11:24.321 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:11:24.321 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:24.322 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:24.322 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:24.322 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:24.322 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.322 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:11:24.322 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.322 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:24.322 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.322 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:24.322 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:24.322 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.322 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.323 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.323 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:24.323 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:24.323 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:24.323 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.323 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.323 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:24.323 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:24.323 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:24.323 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.323 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.324 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:24.324 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:11:24.324 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:11:24.324 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.324 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.324 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:24.324 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:11:24.324 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:11:24.324 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.325 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.325 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.325 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:11:24.325 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:11:24.325 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.325 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.325 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.325 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:11:24.325 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:11:24.325 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.326 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.326 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.326 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:11:24.326 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:11:24.326 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.326 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.326 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:24.326 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:11:24.326 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:11:24.326 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:24.326 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:24.327 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:24.327 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:11:24.327 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:11:24.327 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.327 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:24.327 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.327 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:24.327 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:24.327 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:24.329 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:24.326+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:24.329 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:11:24.429 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:24.426+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:24.446 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:24.447 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:24.447 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:24.447 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:24.456 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:11:24.530 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:24.525+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:24.561 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:24.561 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:24.561 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:24.561 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:24.561 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:24.570 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:11:24.629 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is set 2024-09-13T05:11:24.631 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:24.625+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:24.647 INFO:teuthology.orchestra.run.smithi120.stdout:3536 write 0xd1be1aa thru 0xd1c0d57 (0x2bae bytes) 2024-09-13T05:11:24.659 INFO:teuthology.orchestra.run.smithi120.stdout:3537 write 0x250e340 thru 0x251a104 (0xbdc5 bytes) 2024-09-13T05:11:24.686 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:24.686 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:24.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:24.686 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:24.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.686 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14179 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1835008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:24.686 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:11:24.686 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.924890724999997, 2024-09-13T05:11:24.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0924508550000001, 2024-09-13T05:11:24.687 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:24.687 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:24.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:24.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:24.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.687 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14179 2024-09-13T05:11:24.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.687 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:24.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:24.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:11:24.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:24.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:11:24.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:24.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757551+0000", 2024-09-13T05:11:24.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:24.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:24.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757554+0000", 2024-09-13T05:11:24.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5440000000000001e-06 2024-09-13T05:11:24.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:24.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757560+0000", 2024-09-13T05:11:24.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6840000000000001e-06 2024-09-13T05:11:24.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757564+0000", 2024-09-13T05:11:24.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3529999999999997e-06 2024-09-13T05:11:24.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814931+0000", 2024-09-13T05:11:24.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057367564000000003 2024-09-13T05:11:24.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814938+0000", 2024-09-13T05:11:24.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1070000000000001e-06 2024-09-13T05:11:24.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.849802+0000", 2024-09-13T05:11:24.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348647849999999 2024-09-13T05:11:24.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:24.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.849885+0000", 2024-09-13T05:11:24.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2859000000000001e-05 2024-09-13T05:11:24.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:24.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850003+0000", 2024-09-13T05:11:24.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117279 2024-09-13T05:11:24.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.691 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:24.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.692 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14180 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1844224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:24.692 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:24.692 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.924874439999996, 2024-09-13T05:11:24.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.092637853, 2024-09-13T05:11:24.692 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:24.692 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:24.692 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:24.692 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:24.692 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.692 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14180 2024-09-13T05:11:24.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.692 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:24.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:24.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:24.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:24.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:24.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:24.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:24.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:24.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:24.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757570+0000", 2024-09-13T05:11:24.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3470000000000001e-06 2024-09-13T05:11:24.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:24.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757576+0000", 2024-09-13T05:11:24.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5550000000000002e-06 2024-09-13T05:11:24.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757580+0000", 2024-09-13T05:11:24.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6519999999999997e-06 2024-09-13T05:11:24.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814975+0000", 2024-09-13T05:11:24.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057394349999999997 2024-09-13T05:11:24.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814981+0000", 2024-09-13T05:11:24.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4119999999999998e-06 2024-09-13T05:11:24.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850042+0000", 2024-09-13T05:11:24.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0350611759999999 2024-09-13T05:11:24.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:24.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850103+0000", 2024-09-13T05:11:24.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0618000000000001e-05 2024-09-13T05:11:24.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:24.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850206+0000", 2024-09-13T05:11:24.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010309199999999999 2024-09-13T05:11:24.697 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.697 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:24.697 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.697 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14196 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1991680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:24.697 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:24.697 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.921075354000003, 2024-09-13T05:11:24.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0925442910000001, 2024-09-13T05:11:24.697 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:24.697 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:24.697 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:24.697 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:24.697 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.698 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14196 2024-09-13T05:11:24.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.698 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:24.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:24.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:24.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:24.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:24.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:24.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:24.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:24.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:24.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761368+0000", 2024-09-13T05:11:24.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3689999999999999e-06 2024-09-13T05:11:24.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:24.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761373+0000", 2024-09-13T05:11:24.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7180000000000004e-06 2024-09-13T05:11:24.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761376+0000", 2024-09-13T05:11:24.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0860000000000002e-06 2024-09-13T05:11:24.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815501+0000", 2024-09-13T05:11:24.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054125508000000003 2024-09-13T05:11:24.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815508+0000", 2024-09-13T05:11:24.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5570000000000001e-06 2024-09-13T05:11:24.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853689+0000", 2024-09-13T05:11:24.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0381811919999999 2024-09-13T05:11:24.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:24.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853764+0000", 2024-09-13T05:11:24.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4893000000000003e-05 2024-09-13T05:11:24.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:24.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853911+0000", 2024-09-13T05:11:24.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014721100000000001 2024-09-13T05:11:24.702 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.702 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:24.702 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.702 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14197 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2000896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:24.702 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:24.702 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.921064110000003, 2024-09-13T05:11:24.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.092841977, 2024-09-13T05:11:24.702 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:24.702 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:24.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:24.703 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:24.703 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.703 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14197 2024-09-13T05:11:24.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.703 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:24.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:24.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:24.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:24.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:24.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:24.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:24.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:24.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:24.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761403+0000", 2024-09-13T05:11:24.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5199e-05 2024-09-13T05:11:24.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:24.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761411+0000", 2024-09-13T05:11:24.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4540000000000001e-06 2024-09-13T05:11:24.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761418+0000", 2024-09-13T05:11:24.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9569999999999996e-06 2024-09-13T05:11:24.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815531+0000", 2024-09-13T05:11:24.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054113599999999998 2024-09-13T05:11:24.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815539+0000", 2024-09-13T05:11:24.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.481e-06 2024-09-13T05:11:24.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853949+0000", 2024-09-13T05:11:24.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.038410356 2024-09-13T05:11:24.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:24.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854022+0000", 2024-09-13T05:11:24.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2807999999999998e-05 2024-09-13T05:11:24.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:24.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854220+0000", 2024-09-13T05:11:24.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000198364 2024-09-13T05:11:24.707 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.707 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:24.707 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.707 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14198 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2010112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:24.707 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:24.707 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.921019102000002, 2024-09-13T05:11:24.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093063787, 2024-09-13T05:11:24.708 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:24.708 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:24.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:24.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:24.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.708 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14198 2024-09-13T05:11:24.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.708 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:24.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:24.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:24.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:24.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:24.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:24.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:24.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:24.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:24.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761426+0000", 2024-09-13T05:11:24.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8789999999999999e-06 2024-09-13T05:11:24.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:24.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761432+0000", 2024-09-13T05:11:24.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1399999999999997e-06 2024-09-13T05:11:24.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761437+0000", 2024-09-13T05:11:24.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8579999999999999e-06 2024-09-13T05:11:24.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815563+0000", 2024-09-13T05:11:24.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054125877000000003 2024-09-13T05:11:24.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815570+0000", 2024-09-13T05:11:24.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1169999999999998e-06 2024-09-13T05:11:24.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854265+0000", 2024-09-13T05:11:24.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0386955659999999 2024-09-13T05:11:24.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:24.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854338+0000", 2024-09-13T05:11:24.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2537e-05 2024-09-13T05:11:24.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:24.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854487+0000", 2024-09-13T05:11:24.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014927899999999999 2024-09-13T05:11:24.712 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.712 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:24.712 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.712 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14199 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:24.712 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:24.713 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.921000229000001, 2024-09-13T05:11:24.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0933252389999999, 2024-09-13T05:11:24.713 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:24.713 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:24.713 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:24.713 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:24.713 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.713 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14199 2024-09-13T05:11:24.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.713 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:24.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:24.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:24.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:24.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:24.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:24.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:24.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:24.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:24.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761445+0000", 2024-09-13T05:11:24.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7779999999999999e-06 2024-09-13T05:11:24.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:24.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761450+0000", 2024-09-13T05:11:24.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6350000000000003e-06 2024-09-13T05:11:24.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761455+0000", 2024-09-13T05:11:24.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9930000000000003e-06 2024-09-13T05:11:24.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815600+0000", 2024-09-13T05:11:24.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054144982000000001 2024-09-13T05:11:24.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815607+0000", 2024-09-13T05:11:24.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4749999999999998e-06 2024-09-13T05:11:24.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854527+0000", 2024-09-13T05:11:24.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.038920037 2024-09-13T05:11:24.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:24.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854637+0000", 2024-09-13T05:11:24.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011021700000000001 2024-09-13T05:11:24.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:24.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854767+0000", 2024-09-13T05:11:24.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130512 2024-09-13T05:11:24.717 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.717 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:24.717 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.718 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14200 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2028544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:24.718 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:11:24.718 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.920981716, 2024-09-13T05:11:24.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093541554, 2024-09-13T05:11:24.718 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:24.718 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:24.718 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:24.718 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:24.718 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.718 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14200 2024-09-13T05:11:24.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.718 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:24.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:24.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:11:24.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:24.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:11:24.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:24.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761460+0000", 2024-09-13T05:11:24.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:24.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:24.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761462+0000", 2024-09-13T05:11:24.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9659999999999999e-06 2024-09-13T05:11:24.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:24.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761466+0000", 2024-09-13T05:11:24.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6109999999999998e-06 2024-09-13T05:11:24.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761471+0000", 2024-09-13T05:11:24.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1019999999999996e-06 2024-09-13T05:11:24.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815631+0000", 2024-09-13T05:11:24.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054159680000000002 2024-09-13T05:11:24.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815637+0000", 2024-09-13T05:11:24.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-09-13T05:11:24.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854810+0000", 2024-09-13T05:11:24.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0391731930000001 2024-09-13T05:11:24.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:24.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854883+0000", 2024-09-13T05:11:24.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3109999999999996e-05 2024-09-13T05:11:24.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:24.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855002+0000", 2024-09-13T05:11:24.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011934600000000001 2024-09-13T05:11:24.722 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.723 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:24.723 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.723 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14201 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2037760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:24.723 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:24.723 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.920967286, 2024-09-13T05:11:24.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0937543320000001, 2024-09-13T05:11:24.723 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:24.723 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:24.723 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:24.723 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:24.723 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.723 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14201 2024-09-13T05:11:24.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.724 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:24.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:24.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:24.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:24.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:24.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:24.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:24.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:24.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:24.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761477+0000", 2024-09-13T05:11:24.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5620000000000002e-06 2024-09-13T05:11:24.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:24.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761483+0000", 2024-09-13T05:11:24.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7400000000000001e-06 2024-09-13T05:11:24.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761487+0000", 2024-09-13T05:11:24.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8130000000000002e-06 2024-09-13T05:11:24.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815697+0000", 2024-09-13T05:11:24.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054210253 2024-09-13T05:11:24.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815705+0000", 2024-09-13T05:11:24.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7049999999999999e-06 2024-09-13T05:11:24.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855036+0000", 2024-09-13T05:11:24.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.039330799 2024-09-13T05:11:24.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:24.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855110+0000", 2024-09-13T05:11:24.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4498000000000004e-05 2024-09-13T05:11:24.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:24.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855229+0000", 2024-09-13T05:11:24.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119282 2024-09-13T05:11:24.728 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.728 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:24.728 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.728 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14202 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:24.729 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:11:24.729 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.920902628999997, 2024-09-13T05:11:24.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093934027, 2024-09-13T05:11:24.729 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:24.729 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:24.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:24.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:24.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.729 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14202 2024-09-13T05:11:24.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.729 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:24.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:24.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:11:24.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:24.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:11:24.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:24.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761489+0000", 2024-09-13T05:11:24.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999495 2024-09-13T05:11:24.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:24.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761543+0000", 2024-09-13T05:11:24.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3983999999999997e-05 2024-09-13T05:11:24.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:24.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761552+0000", 2024-09-13T05:11:24.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-13T05:11:24.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761559+0000", 2024-09-13T05:11:24.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7710000000000001e-06 2024-09-13T05:11:24.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815742+0000", 2024-09-13T05:11:24.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054183488000000002 2024-09-13T05:11:24.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815749+0000", 2024-09-13T05:11:24.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1609999999999997e-06 2024-09-13T05:11:24.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855283+0000", 2024-09-13T05:11:24.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0395336230000001 2024-09-13T05:11:24.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:24.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855354+0000", 2024-09-13T05:11:24.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1456000000000002e-05 2024-09-13T05:11:24.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:24.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855474+0000", 2024-09-13T05:11:24.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119429 2024-09-13T05:11:24.734 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.734 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:24.734 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.734 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14294 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2113536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:24.734 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:11:24.734 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.917351715000002, 2024-09-13T05:11:24.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0923650330000001, 2024-09-13T05:11:24.734 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:24.734 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:24.734 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:24.735 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:24.735 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.735 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14294 2024-09-13T05:11:24.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.735 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:24.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:24.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:11:24.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:24.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:11:24.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:24.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765090+0000", 2024-09-13T05:11:24.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:24.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:24.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765092+0000", 2024-09-13T05:11:24.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.542e-06 2024-09-13T05:11:24.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:24.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765096+0000", 2024-09-13T05:11:24.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6179999999999999e-06 2024-09-13T05:11:24.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765098+0000", 2024-09-13T05:11:24.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8049999999999998e-06 2024-09-13T05:11:24.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816384+0000", 2024-09-13T05:11:24.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051285338999999999 2024-09-13T05:11:24.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816393+0000", 2024-09-13T05:11:24.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-09-13T05:11:24.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857258+0000", 2024-09-13T05:11:24.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0408652549999999 2024-09-13T05:11:24.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:24.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857327+0000", 2024-09-13T05:11:24.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8714000000000007e-05 2024-09-13T05:11:24.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:24.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857456+0000", 2024-09-13T05:11:24.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012909299999999999 2024-09-13T05:11:24.739 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.739 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:24.739 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.739 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14295 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2122752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:24.739 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:24.739 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.917341956999998, 2024-09-13T05:11:24.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0928006969999999, 2024-09-13T05:11:24.740 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:24.740 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:24.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:24.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:24.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.740 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14295 2024-09-13T05:11:24.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.740 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:24.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:24.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:24.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:24.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:24.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:24.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:24.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:24.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:24.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765102+0000", 2024-09-13T05:11:24.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3990000000000001e-06 2024-09-13T05:11:24.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:24.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765104+0000", 2024-09-13T05:11:24.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:11:24.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765107+0000", 2024-09-13T05:11:24.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.582e-06 2024-09-13T05:11:24.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816432+0000", 2024-09-13T05:11:24.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051325118000000003 2024-09-13T05:11:24.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816440+0000", 2024-09-13T05:11:24.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4679999999999992e-06 2024-09-13T05:11:24.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857495+0000", 2024-09-13T05:11:24.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.041054216 2024-09-13T05:11:24.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:24.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857644+0000", 2024-09-13T05:11:24.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014909400000000001 2024-09-13T05:11:24.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:24.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857901+0000", 2024-09-13T05:11:24.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025746200000000002 2024-09-13T05:11:24.744 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.744 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:24.744 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.745 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14296 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2131968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:24.745 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:11:24.745 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.917333710999998, 2024-09-13T05:11:24.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093120361, 2024-09-13T05:11:24.745 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:24.745 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:24.745 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:24.745 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:24.745 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.745 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14296 2024-09-13T05:11:24.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.745 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:24.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:24.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:11:24.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:24.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:11:24.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:24.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765108+0000", 2024-09-13T05:11:24.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:24.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:24.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765110+0000", 2024-09-13T05:11:24.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.226e-06 2024-09-13T05:11:24.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:24.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765112+0000", 2024-09-13T05:11:24.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6769999999999999e-06 2024-09-13T05:11:24.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765115+0000", 2024-09-13T05:11:24.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.712e-06 2024-09-13T05:11:24.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816479+0000", 2024-09-13T05:11:24.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051364102000000002 2024-09-13T05:11:24.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816503+0000", 2024-09-13T05:11:24.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3723999999999999e-05 2024-09-13T05:11:24.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857929+0000", 2024-09-13T05:11:24.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0414263180000001 2024-09-13T05:11:24.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:24.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858015+0000", 2024-09-13T05:11:24.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5730999999999996e-05 2024-09-13T05:11:24.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:24.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858229+0000", 2024-09-13T05:11:24.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021408700000000001 2024-09-13T05:11:24.749 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.749 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:24.749 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.750 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14297 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2141184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:24.750 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:24.750 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.917325366, 2024-09-13T05:11:24.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0936699510000001, 2024-09-13T05:11:24.750 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:24.750 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:24.750 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:24.750 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:24.750 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.750 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14297 2024-09-13T05:11:24.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.751 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:24.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:24.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:24.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:24.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:24.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:24.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:24.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:24.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:24.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765118+0000", 2024-09-13T05:11:24.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4190000000000001e-06 2024-09-13T05:11:24.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:24.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765121+0000", 2024-09-13T05:11:24.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6110000000000001e-06 2024-09-13T05:11:24.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765124+0000", 2024-09-13T05:11:24.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3720000000000001e-06 2024-09-13T05:11:24.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816535+0000", 2024-09-13T05:11:24.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051410890000000001 2024-09-13T05:11:24.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816556+0000", 2024-09-13T05:11:24.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0551e-05 2024-09-13T05:11:24.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858552+0000", 2024-09-13T05:11:24.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0419965529999999 2024-09-13T05:11:24.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:24.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858640+0000", 2024-09-13T05:11:24.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7907999999999999e-05 2024-09-13T05:11:24.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:24.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858787+0000", 2024-09-13T05:11:24.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000146864 2024-09-13T05:11:24.755 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.755 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:24.755 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.755 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14298 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2150400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:24.755 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:24.755 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.917315973000001, 2024-09-13T05:11:24.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0938958759999999, 2024-09-13T05:11:24.755 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:24.755 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:24.755 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:24.755 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:24.756 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.756 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14298 2024-09-13T05:11:24.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.756 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:24.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:24.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:24.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:24.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:24.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:24.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:24.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:24.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:24.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765128+0000", 2024-09-13T05:11:24.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4139999999999999e-06 2024-09-13T05:11:24.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:24.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765130+0000", 2024-09-13T05:11:24.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6809999999999998e-06 2024-09-13T05:11:24.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765133+0000", 2024-09-13T05:11:24.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9270000000000001e-06 2024-09-13T05:11:24.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816592+0000", 2024-09-13T05:11:24.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051459029000000003 2024-09-13T05:11:24.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816601+0000", 2024-09-13T05:11:24.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9819999999999997e-06 2024-09-13T05:11:24.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858818+0000", 2024-09-13T05:11:24.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0422167170000001 2024-09-13T05:11:24.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:24.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858896+0000", 2024-09-13T05:11:24.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8128999999999997e-05 2024-09-13T05:11:24.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:24.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859022+0000", 2024-09-13T05:11:24.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012619899999999999 2024-09-13T05:11:24.760 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.760 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:24.760 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.760 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14299 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2168832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:24.760 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:24.760 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.917307209000001, 2024-09-13T05:11:24.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0941207909999999, 2024-09-13T05:11:24.761 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:24.761 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:24.761 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:24.761 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:24.761 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.761 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14299 2024-09-13T05:11:24.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.761 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:24.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:24.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:24.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:24.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:24.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:24.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:24.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:24.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:24.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765136+0000", 2024-09-13T05:11:24.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5230000000000001e-06 2024-09-13T05:11:24.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:24.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765139+0000", 2024-09-13T05:11:24.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.672e-06 2024-09-13T05:11:24.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765142+0000", 2024-09-13T05:11:24.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6680000000000001e-06 2024-09-13T05:11:24.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816632+0000", 2024-09-13T05:11:24.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051489886999999998 2024-09-13T05:11:24.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816643+0000", 2024-09-13T05:11:24.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1457000000000001e-05 2024-09-13T05:11:24.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859061+0000", 2024-09-13T05:11:24.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.042417616 2024-09-13T05:11:24.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:24.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859138+0000", 2024-09-13T05:11:24.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7077999999999996e-05 2024-09-13T05:11:24.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:24.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859256+0000", 2024-09-13T05:11:24.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118108 2024-09-13T05:11:24.765 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.765 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:24.766 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.766 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14300 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2159616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:24.766 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:24.766 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.917298399000003, 2024-09-13T05:11:24.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0943386719999999, 2024-09-13T05:11:24.766 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:24.766 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:24.766 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:24.767 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:24.767 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.767 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14300 2024-09-13T05:11:24.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.767 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:24.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:24.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:24.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:24.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:24.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:24.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:24.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:24.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:24.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765145+0000", 2024-09-13T05:11:24.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.488e-06 2024-09-13T05:11:24.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:24.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765148+0000", 2024-09-13T05:11:24.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6620000000000001e-06 2024-09-13T05:11:24.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765151+0000", 2024-09-13T05:11:24.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6419999999999999e-06 2024-09-13T05:11:24.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816677+0000", 2024-09-13T05:11:24.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051526776000000003 2024-09-13T05:11:24.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816689+0000", 2024-09-13T05:11:24.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1634000000000001e-05 2024-09-13T05:11:24.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859296+0000", 2024-09-13T05:11:24.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0426066009999999 2024-09-13T05:11:24.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:24.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859364+0000", 2024-09-13T05:11:24.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8745999999999995e-05 2024-09-13T05:11:24.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:24.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859483+0000", 2024-09-13T05:11:24.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011833900000000001 2024-09-13T05:11:24.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.771 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:24.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.771 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14301 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2178048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:24.771 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:11:24.771 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.917289765, 2024-09-13T05:11:24.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0946233009999999, 2024-09-13T05:11:24.772 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:24.772 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:24.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:24.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:24.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.772 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14301 2024-09-13T05:11:24.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.772 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:24.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:24.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:11:24.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:24.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:11:24.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:24.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765152+0000", 2024-09-13T05:11:24.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:24.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:24.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765154+0000", 2024-09-13T05:11:24.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.449e-06 2024-09-13T05:11:24.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:24.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765157+0000", 2024-09-13T05:11:24.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6809999999999998e-06 2024-09-13T05:11:24.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765159+0000", 2024-09-13T05:11:24.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6060000000000001e-06 2024-09-13T05:11:24.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816722+0000", 2024-09-13T05:11:24.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051562535 2024-09-13T05:11:24.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816733+0000", 2024-09-13T05:11:24.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1678000000000001e-05 2024-09-13T05:11:24.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859521+0000", 2024-09-13T05:11:24.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0427879440000001 2024-09-13T05:11:24.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:24.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859655+0000", 2024-09-13T05:11:24.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134053 2024-09-13T05:11:24.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:24.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859776+0000", 2024-09-13T05:11:24.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012058299999999999 2024-09-13T05:11:24.776 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.776 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:24.776 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.777 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14302 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2187264~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:24.777 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:24.777 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.917281187999997, 2024-09-13T05:11:24.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.094937383, 2024-09-13T05:11:24.777 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:24.777 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:24.777 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:24.777 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:24.777 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.777 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14302 2024-09-13T05:11:24.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.777 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:24.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:24.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:24.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:24.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:24.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:24.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:24.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:24.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:24.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765162+0000", 2024-09-13T05:11:24.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4589999999999999e-06 2024-09-13T05:11:24.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:24.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765165+0000", 2024-09-13T05:11:24.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6019999999999998e-06 2024-09-13T05:11:24.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765168+0000", 2024-09-13T05:11:24.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.497e-06 2024-09-13T05:11:24.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816764+0000", 2024-09-13T05:11:24.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051596722999999997 2024-09-13T05:11:24.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816776+0000", 2024-09-13T05:11:24.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1967000000000001e-05 2024-09-13T05:11:24.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859810+0000", 2024-09-13T05:11:24.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0430338299999999 2024-09-13T05:11:24.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:24.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859901+0000", 2024-09-13T05:11:24.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1397999999999995e-05 2024-09-13T05:11:24.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:24.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860099+0000", 2024-09-13T05:11:24.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000197133 2024-09-13T05:11:24.781 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.781 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:24.782 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.782 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14303 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2196480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:24.782 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:11:24.782 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.917272851, 2024-09-13T05:11:24.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.095199152, 2024-09-13T05:11:24.782 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:24.782 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:24.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:24.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:24.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.782 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14303 2024-09-13T05:11:24.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.783 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:24.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:24.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:11:24.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:24.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:11:24.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:24.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765169+0000", 2024-09-13T05:11:24.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:24.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:24.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765171+0000", 2024-09-13T05:11:24.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2899999999999999e-06 2024-09-13T05:11:24.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:24.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765173+0000", 2024-09-13T05:11:24.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-13T05:11:24.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765176+0000", 2024-09-13T05:11:24.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.016e-06 2024-09-13T05:11:24.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816811+0000", 2024-09-13T05:11:24.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051634684 2024-09-13T05:11:24.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816840+0000", 2024-09-13T05:11:24.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8690000000000001e-05 2024-09-13T05:11:24.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860135+0000", 2024-09-13T05:11:24.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0432951029999999 2024-09-13T05:11:24.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:24.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860255+0000", 2024-09-13T05:11:24.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119936 2024-09-13T05:11:24.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:24.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860369+0000", 2024-09-13T05:11:24.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113978 2024-09-13T05:11:24.787 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.787 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:24.787 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.787 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14304 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2205696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:24.787 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:24.787 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.917249982999998, 2024-09-13T05:11:24.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0955512999999999, 2024-09-13T05:11:24.787 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:24.787 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:24.787 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:24.787 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:24.788 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:24.788 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14304 2024-09-13T05:11:24.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.788 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:24.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:24.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:24.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:24.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:24.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:24.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:24.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:24.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:24.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:24.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765195+0000", 2024-09-13T05:11:24.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6599999999999999e-06 2024-09-13T05:11:24.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:24.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765200+0000", 2024-09-13T05:11:24.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.356e-06 2024-09-13T05:11:24.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:24.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765205+0000", 2024-09-13T05:11:24.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3000000000000001e-06 2024-09-13T05:11:24.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816901+0000", 2024-09-13T05:11:24.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051695451000000003 2024-09-13T05:11:24.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:24.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816963+0000", 2024-09-13T05:11:24.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2694000000000007e-05 2024-09-13T05:11:24.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:24.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860434+0000", 2024-09-13T05:11:24.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.04347053 2024-09-13T05:11:24.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:24.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860592+0000", 2024-09-13T05:11:24.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015854199999999999 2024-09-13T05:11:24.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:24.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:24.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:24.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860744+0000", 2024-09-13T05:11:24.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015133 2024-09-13T05:11:24.792 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.792 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:24.792 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.792 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:24.792 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:24.792 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:24.794 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:11:24.794 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:24.789+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:24.894 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:24.889+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:24.952 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:24.952 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:24.953 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:24.953 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:24.963 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:11:24.995 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:24.990+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:25.055 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:11:25.073 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:25.074 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:25.074 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:25.074 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:25.074 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:25.084 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:11:25.096 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:25.093+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:25.196 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:25.189+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:25.199 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:11:25.218 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:11:25.235 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:25.235 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:25.236 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:11:25.245 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:11:25.254 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:11:25.276 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:11:25.297 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:25.289+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:25.299 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:11:25.322 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:11:25.346 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:11:25.348 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:11:25.348 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:11:25.348 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:11:25.348 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:11:25.349 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:11:25.349 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:11:25.349 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:11:25.349 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:11:25.349 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:25.349 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:25.360 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:11:25.398 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:25.393+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:25.499 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:25.493+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:25.511 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:25.511 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:25.521 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:11:25.600 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:25.593+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:25.629 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:25.629 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:25.640 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:11:25.659 INFO:teuthology.orchestra.run.smithi120.stdout:3538 write 0x2cd3e19 thru 0x2cdd377 (0x955f bytes) 2024-09-13T05:11:25.668 INFO:teuthology.orchestra.run.smithi120.stdout:3540 read 0xc2455b1 thru 0xc25190d (0xc35d bytes) 2024-09-13T05:11:25.668 INFO:teuthology.orchestra.run.smithi120.stdout:3543 writesame 0x23f4456 thru 0x2400a9c data_size 0x1(0xc647 bytes) 2024-09-13T05:11:25.701 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:25.693+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:25.710 INFO:teuthology.orchestra.run.smithi120.stdout:3544 punch from 0x6900190 to 0x6902f0b, (0x2d7b bytes) 2024-09-13T05:11:25.710 INFO:teuthology.orchestra.run.smithi120.stdout:3545 read 0x6505e59 thru 0x6513847 (0xd9ef bytes) 2024-09-13T05:11:25.728 INFO:teuthology.orchestra.run.smithi120.stdout:3546 trunc from 0xe12d415 to 0x4dd08fe 2024-09-13T05:11:25.752 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:25.752 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:25.762 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:11:25.767 INFO:teuthology.orchestra.run.smithi120.stdout:3547 trunc from 0x4dd08fe to 0x73ae306 2024-09-13T05:11:25.774 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:25.788 INFO:teuthology.orchestra.run.smithi120.stdout:3550 writesame 0x9be383e thru 0x9bf0c26 data_size 0x6b(0xd3e9 bytes) 2024-09-13T05:11:25.793 INFO:teuthology.orchestra.run.smithi120.stdout:3551 trunc from 0x9bf0c27 to 0x881f5cf 2024-09-13T05:11:25.801 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:25.797+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:25.825 INFO:teuthology.orchestra.run.smithi120.stdout:3552 write 0xdcf836a thru 0xdd061cf (0xde66 bytes) 2024-09-13T05:11:25.829 INFO:teuthology.orchestra.run.smithi120.stdout:3553 write 0x944e5a7 thru 0x94579fa (0x9454 bytes) 2024-09-13T05:11:25.832 INFO:teuthology.orchestra.run.smithi120.stdout:3555 write 0x6901c9e thru 0x690e849 (0xcbac bytes) 2024-09-13T05:11:25.854 INFO:teuthology.orchestra.run.smithi120.stdout:3556 trunc from 0xdd061d0 to 0x1713b6d 2024-09-13T05:11:25.876 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:25.876 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:25.891 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:11:25.902 INFO:teuthology.orchestra.run.smithi120.stdout:3557 trunc from 0x1713b6d to 0xd842963 2024-09-13T05:11:25.902 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:25.897+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:25.922 INFO:teuthology.orchestra.run.smithi120.stdout:3558 writesame 0xedb8ce5 thru 0xedc62ec data_size 0x24(0xd608 bytes) 2024-09-13T05:11:25.922 INFO:teuthology.orchestra.run.smithi120.stdout:3559 write 0xfb04f8 thru 0xfb1ba2 (0x16ab bytes) 2024-09-13T05:11:25.925 INFO:teuthology.orchestra.run.smithi120.stdout:3560 read 0x3a2ba1f thru 0x3a2f263 (0x3845 bytes) 2024-09-13T05:11:25.925 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:25.925 INFO:teuthology.orchestra.run.smithi120.stdout:3563 write 0x4683fd3 thru 0x4689d87 (0x5db5 bytes) 2024-09-13T05:11:25.929 INFO:teuthology.orchestra.run.smithi120.stdout:3564 punch from 0xbbed3e5 to 0xbbf8079, (0xac94 bytes) 2024-09-13T05:11:25.929 INFO:teuthology.orchestra.run.smithi120.stdout:3568 read 0x63f08b8 thru 0x63fcd17 (0xc460 bytes) 2024-09-13T05:11:25.929 INFO:teuthology.orchestra.run.smithi120.stdout:3569 read 0x859e5be thru 0x85a93ca (0xae0d bytes) 2024-09-13T05:11:25.931 INFO:teuthology.orchestra.run.smithi120.stdout:3570 write 0xc7be223 thru 0xc7c8e19 (0xabf7 bytes) 2024-09-13T05:11:25.933 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:25.933 INFO:teuthology.orchestra.run.smithi120.stdout:3572 read 0xaadcbe3 thru 0xaaea9b7 (0xddd5 bytes) 2024-09-13T05:11:25.934 INFO:teuthology.orchestra.run.smithi120.stdout:3573 write 0xeea8e6 thru 0xef31d5 (0x88f0 bytes) 2024-09-13T05:11:25.937 INFO:teuthology.orchestra.run.smithi120.stdout:3574 write 0x433e1dc thru 0x4341deb (0x3c10 bytes) 2024-09-13T05:11:25.940 INFO:teuthology.orchestra.run.smithi120.stdout:3575 write 0x86625a4 thru 0x8670597 (0xdff4 bytes) 2024-09-13T05:11:25.943 INFO:teuthology.orchestra.run.smithi120.stdout:3577 write 0xc63b029 thru 0xc6483a3 (0xd37b bytes) 2024-09-13T05:11:25.948 INFO:teuthology.orchestra.run.smithi120.stdout:3578 trunc from 0xedc62ed to 0xe4027b4 2024-09-13T05:11:25.962 INFO:teuthology.orchestra.run.smithi120.stdout:3579 write 0xe2fe8de thru 0xe30d34a (0xea6d bytes) 2024-09-13T05:11:25.965 INFO:teuthology.orchestra.run.smithi120.stdout:3582 read 0x4b278e8 thru 0x4b34c84 (0xd39d bytes) 2024-09-13T05:11:25.966 INFO:teuthology.orchestra.run.smithi120.stdout:3583 punch from 0x957c4fc to 0x957d3e0, (0xee4 bytes) 2024-09-13T05:11:25.966 INFO:teuthology.orchestra.run.smithi120.stdout:3584 punch from 0x1ab9c2a to 0x1ac7e0f, (0xe1e5 bytes) 2024-09-13T05:11:25.966 INFO:teuthology.orchestra.run.smithi120.stdout:3585 write 0x24ded62 thru 0x24eca34 (0xdcd3 bytes) 2024-09-13T05:11:25.970 INFO:teuthology.orchestra.run.smithi120.stdout:3587 read 0x1f96ea7 thru 0x1fa204d (0xb1a7 bytes) 2024-09-13T05:11:25.970 INFO:teuthology.orchestra.run.smithi120.stdout:3588 read 0x65d7df2 thru 0x65db9ec (0x3bfb bytes) 2024-09-13T05:11:25.986 INFO:teuthology.orchestra.run.smithi120.stdout:3589 trunc from 0xe4027b4 to 0x53bb3d7 2024-09-13T05:11:26.001 INFO:teuthology.orchestra.run.smithi120.stdout:3590 punch from 0x4e74dd to 0x4eb972, (0x4495 bytes) 2024-09-13T05:11:26.001 INFO:teuthology.orchestra.run.smithi120.stdout:3591 write 0x232676c thru 0x2334459 (0xdcee bytes) 2024-09-13T05:11:26.003 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:25.997+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:26.003 INFO:teuthology.orchestra.run.smithi120.stdout:3593 writesame 0x1e1fe30 thru 0x1e2c73f data_size 0x8(0xc910 bytes) 2024-09-13T05:11:26.010 INFO:teuthology.orchestra.run.smithi120.stdout:3595 read 0x13ed4bd thru 0x13ee1b9 (0xcfd bytes) 2024-09-13T05:11:26.010 INFO:teuthology.orchestra.run.smithi120.stdout:3596 punch from 0xf5c2e3 to 0xf5dce5, (0x1a02 bytes) 2024-09-13T05:11:26.015 INFO:teuthology.orchestra.run.smithi120.stdout:3597 trunc from 0x53bb3d7 to 0x25e31e3 2024-09-13T05:11:26.020 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:26.020 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:26.029 INFO:teuthology.orchestra.run.smithi120.stdout:3598 read 0x1c24dc thru 0x1c68b5 (0x43da bytes) 2024-09-13T05:11:26.031 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:11:26.056 INFO:teuthology.orchestra.run.smithi120.stdout:3599 write 0xc35783a thru 0xc35a56e (0x2d35 bytes) 2024-09-13T05:11:26.058 INFO:teuthology.orchestra.run.smithi120.stdout:3600 write 0x1a3d95c thru 0x1a451ff (0x78a4 bytes) 2024-09-13T05:11:26.066 INFO:teuthology.orchestra.run.smithi120.stdout:3601 read 0x89665ee thru 0x896a6d5 (0x40e8 bytes) 2024-09-13T05:11:26.067 INFO:teuthology.orchestra.run.smithi120.stdout:3602 writesame 0xefd1c1 thru 0xf0ca38 data_size 0x4(0xf878 bytes) 2024-09-13T05:11:26.084 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:26.084 INFO:teuthology.orchestra.run.smithi120.stdout:3604 punch from 0xaed7b85 to 0xaee4c53, (0xd0ce bytes) 2024-09-13T05:11:26.084 INFO:teuthology.orchestra.run.smithi120.stdout:3605 punch from 0xdca397 to 0xdd62cc, (0xbf35 bytes) 2024-09-13T05:11:26.084 INFO:teuthology.orchestra.run.smithi120.stdout:3606 read 0xa4b1557 thru 0xa4bbcf1 (0xa79b bytes) 2024-09-13T05:11:26.084 INFO:teuthology.orchestra.run.smithi120.stdout:3607 read 0x240337c thru 0x2407f7e (0x4c03 bytes) 2024-09-13T05:11:26.085 INFO:teuthology.orchestra.run.smithi120.stdout:3608 punch from 0x2616316 to 0x261e74a, (0x8434 bytes) 2024-09-13T05:11:26.085 INFO:teuthology.orchestra.run.smithi120.stdout:3610 read 0x45a8058 thru 0x45abbde (0x3b87 bytes) 2024-09-13T05:11:26.086 INFO:teuthology.orchestra.run.smithi120.stdout:3612 read 0x2edb37d thru 0x2ee26b5 (0x7339 bytes) 2024-09-13T05:11:26.086 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:26.104 INFO:teuthology.orchestra.run.smithi120.stdout:3614 trunc from 0xc35a56f to 0x1b8b92f 2024-09-13T05:11:26.104 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:26.097+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:26.119 INFO:teuthology.orchestra.run.smithi120.stdout:3615 punch from 0xf5b7dc to 0xf65a83, (0xa2a7 bytes) 2024-09-13T05:11:26.119 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:26.119 INFO:teuthology.orchestra.run.smithi120.stdout:3618 write 0x1421ba4 thru 0x14297be (0x7c1b bytes) 2024-09-13T05:11:26.121 INFO:teuthology.orchestra.run.smithi120.stdout:3619 read 0x3835ee thru 0x390c67 (0xd67a bytes) 2024-09-13T05:11:26.122 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:26.144 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:26.144 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:26.152 INFO:teuthology.orchestra.run.smithi120.stdout:3621 write 0xe5ba502 thru 0xe5c7e04 (0xd903 bytes) 2024-09-13T05:11:26.154 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:11:26.155 INFO:teuthology.orchestra.run.smithi120.stdout:3622 read 0xcec94c4 thru 0xced5050 (0xbb8d bytes) 2024-09-13T05:11:26.156 INFO:teuthology.orchestra.run.smithi120.stdout:3623 write 0x71b901e thru 0x71ba090 (0x1073 bytes) 2024-09-13T05:11:26.164 INFO:teuthology.orchestra.run.smithi120.stdout:3624 trunc from 0xe5c7e05 to 0xc6f319e 2024-09-13T05:11:26.179 INFO:teuthology.orchestra.run.smithi120.stdout:3625 write 0xa0fceec thru 0xa1005f0 (0x3705 bytes) 2024-09-13T05:11:26.182 INFO:teuthology.orchestra.run.smithi120.stdout:3626 read 0xb5c7c94 thru 0xb5cab17 (0x2e84 bytes) 2024-09-13T05:11:26.182 INFO:teuthology.orchestra.run.smithi120.stdout:3627 writesame 0x77f961b thru 0x77fbd1b data_size 0x1(0x2701 bytes) 2024-09-13T05:11:26.193 INFO:teuthology.orchestra.run.smithi120.stdout:3630 write 0x6f956d4 thru 0x6f9cddb (0x7708 bytes) 2024-09-13T05:11:26.196 INFO:teuthology.orchestra.run.smithi120.stdout:3632 write 0x3c1ac76 thru 0x3c1ba1b (0xda6 bytes) 2024-09-13T05:11:26.198 INFO:teuthology.orchestra.run.smithi120.stdout:3634 read 0xbc49663 thru 0xbc521e8 (0x8b86 bytes) 2024-09-13T05:11:26.199 INFO:teuthology.orchestra.run.smithi120.stdout:3635 punch from 0xb5c30a9 to 0xb5cda6f, (0xa9c6 bytes) 2024-09-13T05:11:26.204 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:26.197+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:26.211 INFO:teuthology.orchestra.run.smithi120.stdout:3636 trunc from 0xc6f319e to 0x726aa00 2024-09-13T05:11:26.227 INFO:teuthology.orchestra.run.smithi120.stdout:3638 read 0x3ef8400 thru 0x3f03e33 (0xba34 bytes) 2024-09-13T05:11:26.228 INFO:teuthology.orchestra.run.smithi120.stdout:3639 read 0x24522d5 thru 0x24556ed (0x3419 bytes) 2024-09-13T05:11:26.229 INFO:teuthology.orchestra.run.smithi120.stdout:3640 punch from 0x3d35756 to 0x3d40123, (0xa9cd bytes) 2024-09-13T05:11:26.229 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:26.234 INFO:teuthology.orchestra.run.smithi120.stdout:3642 trunc from 0x726aa00 to 0x48cf951 2024-09-13T05:11:26.248 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:26.250 INFO:teuthology.orchestra.run.smithi120.stdout:3644 trunc from 0x48cf951 to 0x37d20ae 2024-09-13T05:11:26.261 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:26.264 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:26.264 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:26.274 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:11:26.275 INFO:teuthology.orchestra.run.smithi120.stdout:3647 writesame 0x572f4df thru 0x573b479 data_size 0x1(0xbf9b bytes) 2024-09-13T05:11:26.297 INFO:teuthology.orchestra.run.smithi120.stdout:3648 write 0xa7a5d0c thru 0xa7aaa0f (0x4d04 bytes) 2024-09-13T05:11:26.299 INFO:teuthology.orchestra.run.smithi120.stdout:3649 punch from 0x1cf300f to 0x1cf3a87, (0xa78 bytes) 2024-09-13T05:11:26.299 INFO:teuthology.orchestra.run.smithi120.stdout:3650 read 0x3361550 thru 0x336cc15 (0xb6c6 bytes) 2024-09-13T05:11:26.300 INFO:teuthology.orchestra.run.smithi120.stdout:3651 read 0xa1c22be thru 0xa1cdc11 (0xb954 bytes) 2024-09-13T05:11:26.301 INFO:teuthology.orchestra.run.smithi120.stdout:3652 writesame 0x9b8bc7e thru 0x9b904d4 data_size 0x1(0x4857 bytes) 2024-09-13T05:11:26.305 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:26.301+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:26.319 INFO:teuthology.orchestra.run.smithi120.stdout:3654 read 0x9937e72 thru 0x993af06 (0x3095 bytes) 2024-09-13T05:11:26.321 INFO:teuthology.orchestra.run.smithi120.stdout:3656 write 0x91c8cf2 thru 0x91d3e77 (0xb186 bytes) 2024-09-13T05:11:26.327 INFO:teuthology.orchestra.run.smithi120.stdout:3657 read 0xe3f2eb thru 0xe43ddf (0x4af5 bytes) 2024-09-13T05:11:26.328 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:26.328 INFO:teuthology.orchestra.run.smithi120.stdout:3659 write 0x1747a4e thru 0x175519d (0xd750 bytes) 2024-09-13T05:11:26.331 INFO:teuthology.orchestra.run.smithi120.stdout:3662 write 0x7ed4709 thru 0x7ee1772 (0xd06a bytes) 2024-09-13T05:11:26.352 INFO:teuthology.orchestra.run.smithi120.stdout:3663 write 0xb896423 thru 0xb8a087d (0xa45b bytes) 2024-09-13T05:11:26.356 INFO:teuthology.orchestra.run.smithi120.stdout:3665 punch from 0x41dfe45 to 0x41e3078, (0x3233 bytes) 2024-09-13T05:11:26.356 INFO:teuthology.orchestra.run.smithi120.stdout:3666 read 0x5a0f5bc thru 0x5a1b8b2 (0xc2f7 bytes) 2024-09-13T05:11:26.357 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:26.375 INFO:teuthology.orchestra.run.smithi120.stdout:3669 write 0xed46f7f thru 0xed4c50a (0x558c bytes) 2024-09-13T05:11:26.378 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:26.378 INFO:teuthology.orchestra.run.smithi120.stdout:3674 write 0xf2d7b0 thru 0xf31edc (0x472d bytes) 2024-09-13T05:11:26.381 INFO:teuthology.orchestra.run.smithi120.stdout:3675 write 0x8fca3a thru 0x90a104 (0xd6cb bytes) 2024-09-13T05:11:26.385 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:26.385 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:26.386 INFO:teuthology.orchestra.run.smithi120.stdout:3676 writesame 0xa60d4ce thru 0xa61c606 data_size 0x1(0xf139 bytes) 2024-09-13T05:11:26.396 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:11:26.406 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:26.401+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:26.432 INFO:teuthology.orchestra.run.smithi120.stdout:3677 punch from 0x6a7137e to 0x6a78daa, (0x7a2c bytes) 2024-09-13T05:11:26.432 INFO:teuthology.orchestra.run.smithi120.stdout:3678 writesame 0xe97fb12 thru 0xe986760 data_size 0x11(0x6c4f bytes) 2024-09-13T05:11:26.435 INFO:teuthology.orchestra.run.smithi120.stdout:3679 write 0x2e423fa thru 0x2e4f52a (0xd131 bytes) 2024-09-13T05:11:26.438 INFO:teuthology.orchestra.run.smithi120.stdout:3680 trunc from 0xed4c50b to 0xe53c0f9 2024-09-13T05:11:26.453 INFO:teuthology.orchestra.run.smithi120.stdout:3682 read 0x7331b59 thru 0x733e12a (0xc5d2 bytes) 2024-09-13T05:11:26.453 INFO:teuthology.orchestra.run.smithi120.stdout:3683 write 0xd940b22 thru 0xd947e53 (0x7332 bytes) 2024-09-13T05:11:26.456 INFO:teuthology.orchestra.run.smithi120.stdout:3687 read 0x9e84432 thru 0x9e865ee (0x21bd bytes) 2024-09-13T05:11:26.457 INFO:teuthology.orchestra.run.smithi120.stdout:3690 write 0x6527d7a thru 0x6528721 (0x9a8 bytes) 2024-09-13T05:11:26.459 INFO:teuthology.orchestra.run.smithi120.stdout:3693 read 0x930042 thru 0x9302bf (0x27e bytes) 2024-09-13T05:11:26.460 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:26.461 INFO:teuthology.orchestra.run.smithi120.stdout:3695 write 0x7f77394 thru 0x7f85113 (0xdd80 bytes) 2024-09-13T05:11:26.464 INFO:teuthology.orchestra.run.smithi120.stdout:3696 read 0x18a4ddb thru 0x18aae92 (0x60b8 bytes) 2024-09-13T05:11:26.465 INFO:teuthology.orchestra.run.smithi120.stdout:3697 write 0x77ad3b2 thru 0x77bbb39 (0xe788 bytes) 2024-09-13T05:11:26.468 INFO:teuthology.orchestra.run.smithi120.stdout:3700 write 0x426c278 thru 0x426ee4b (0x2bd4 bytes) 2024-09-13T05:11:26.471 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:26.491 INFO:teuthology.orchestra.run.smithi120.stdout:3702 trunc from 0xe53c0f9 to 0x3231e23 2024-09-13T05:11:26.507 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:26.501+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:26.508 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:26.508 INFO:teuthology.orchestra.run.smithi120.stdout:3704 punch from 0x2e283c to 0x2f2713, (0xfed7 bytes) 2024-09-13T05:11:26.509 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:26.509 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:26.519 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:11:26.522 INFO:teuthology.orchestra.run.smithi120.stdout:3705 write 0x5ea4c6b thru 0x5eb3361 (0xe6f7 bytes) 2024-09-13T05:11:26.536 INFO:teuthology.orchestra.run.smithi120.stdout:3706 trunc from 0x5eb3362 to 0x23736e 2024-09-13T05:11:26.580 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:26.580 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:26.591 INFO:teuthology.orchestra.run.smithi120.stdout:3709 write 0x5e511b thru 0x5edfaa (0x8e90 bytes) 2024-09-13T05:11:26.597 INFO:teuthology.orchestra.run.smithi120.stdout:3710 read 0x2f8bcc thru 0x2fc9c1 (0x3df6 bytes) 2024-09-13T05:11:26.598 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:26.598 INFO:teuthology.orchestra.run.smithi120.stdout:3712 read 0x33788 thru 0x3dc51 (0xa4ca bytes) 2024-09-13T05:11:26.607 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:26.601+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:26.625 INFO:teuthology.orchestra.run.smithi120.stdout:3713 write 0x7eee32d thru 0x7eef5e5 (0x12b9 bytes) 2024-09-13T05:11:26.631 INFO:teuthology.orchestra.run.smithi120.stdout:3714 read 0x87699d thru 0x87ef9a (0x85fe bytes) 2024-09-13T05:11:26.631 INFO:teuthology.orchestra.run.smithi120.stdout:3715 read 0x4c4e9e1 thru 0x4c575d5 (0x8bf5 bytes) 2024-09-13T05:11:26.647 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T05:11:26.655 INFO:teuthology.orchestra.run.smithi120.stdout:3717 write 0xe42cb31 thru 0xe433d0b (0x71db bytes) 2024-09-13T05:11:26.662 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:26.662 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:26.673 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:11:26.681 INFO:teuthology.orchestra.run.smithi120.stdout:3718 trunc from 0xe433d0c to 0x38ba03d 2024-09-13T05:11:26.702 INFO:teuthology.orchestra.run.smithi120.stdout:3719 trunc from 0x38ba03d to 0x8cd32f4 2024-09-13T05:11:26.708 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:26.701+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:26.724 INFO:teuthology.orchestra.run.smithi120.stdout:3720 write 0x9c9b0d3 thru 0x9c9bbd3 (0xb01 bytes) 2024-09-13T05:11:26.727 INFO:teuthology.orchestra.run.smithi120.stdout:3721 punch from 0x6e1620d to 0x6e2473b, (0xe52e bytes) 2024-09-13T05:11:26.727 INFO:teuthology.orchestra.run.smithi120.stdout:3722 punch from 0x63a0a3e to 0x63a0a5e, (0x20 bytes) 2024-09-13T05:11:26.727 INFO:teuthology.orchestra.run.smithi120.stdout:3723 read 0x992c855 thru 0x993013e (0x38ea bytes) 2024-09-13T05:11:26.727 INFO:teuthology.orchestra.run.smithi120.stdout:3724 read 0x3b7690f thru 0x3b76b77 (0x269 bytes) 2024-09-13T05:11:26.727 INFO:teuthology.orchestra.run.smithi120.stdout:3725 read 0x588bf67 thru 0x5892ffe (0x7098 bytes) 2024-09-13T05:11:26.747 INFO:teuthology.orchestra.run.smithi120.stdout:3726 writesame 0xe50faec thru 0xe51b882 data_size 0x11(0xbd97 bytes) 2024-09-13T05:11:26.749 INFO:teuthology.orchestra.run.smithi120.stdout:3727 write 0x8eeec7a thru 0x8efd1e2 (0xe569 bytes) 2024-09-13T05:11:26.758 INFO:teuthology.orchestra.run.smithi120.stdout:3728 trunc from 0xe51b883 to 0xd52faeb 2024-09-13T05:11:26.774 INFO:teuthology.orchestra.run.smithi120.stdout:3729 trunc from 0xd52faeb to 0xafa6d7c 2024-09-13T05:11:26.780 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:26.780 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:26.789 INFO:teuthology.orchestra.run.smithi120.stdout:3730 read 0x1340b5 thru 0x13a8e4 (0x6830 bytes) 2024-09-13T05:11:26.790 INFO:teuthology.orchestra.run.smithi120.stdout:3731 punch from 0xa6e36c6 to 0xa6e45c4, (0xefe bytes) 2024-09-13T05:11:26.790 INFO:teuthology.orchestra.run.smithi120.stdout:3732 write 0x964a8a6 thru 0x9659f27 (0xf682 bytes) 2024-09-13T05:11:26.790 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:11:26.793 INFO:teuthology.orchestra.run.smithi120.stdout:3733 punch from 0xa7d426f to 0xa7db6b7, (0x7448 bytes) 2024-09-13T05:11:26.793 INFO:teuthology.orchestra.run.smithi120.stdout:3736 read 0x303a1b9 thru 0x3041ea5 (0x7ced bytes) 2024-09-13T05:11:26.793 INFO:teuthology.orchestra.run.smithi120.stdout:3737 clone 29 order 25 su 8388608 sc 3 2024-09-13T05:11:26.809 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:26.805+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:26.901 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:26.901 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:26.910 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:11:26.911 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:26.905+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:26.933 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:11:27.011 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:27.005+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:27.018 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:27.018 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:27.028 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:11:27.111 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:27.105+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:27.134 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:27.134 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:27.144 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:11:27.212 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:27.205+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:11:27.240 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:11:27.253 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2024-09-13T05:11:26.187420+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":842581438,"num_objects":2038,"num_object_clones":272,"num_object_copies":4076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2038,"num_whiteouts":982,"num_read":89597,"num_read_kb":405944,"num_write":12700,"num_write_kb":273436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1302,"num_bytes_recovered":45181655,"num_keys_recovered":167,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11070,"ondisk_log_size":11070,"up":82,"acting":76,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":452864,"kb_used_data":262716,"kb_used_omap":7,"kb_used_meta":189944,"kb_avail":471406336,"statfs":{"total":483183820800,"available":482720088064,"internally_reserved":0,"allocated":269021184,"data_stored":289648950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7962,"internal_metadata":194502886},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.834279"},"pg_stats":[{"pgid":"3.1f","version":"82'346","reported_seq":906,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350704+0000","last_change":"2024-09-13T05:10:37.993400+0000","last_active":"2024-09-13T05:11:20.350704+0000","last_peered":"2024-09-13T05:11:20.350704+0000","last_clean":"2024-09-13T05:11:20.350704+0000","last_became_active":"2024-09-13T05:10:37.864778+0000","last_became_peered":"2024-09-13T05:10:37.864778+0000","last_unstale":"2024-09-13T05:11:20.350704+0000","last_undegraded":"2024-09-13T05:11:20.350704+0000","last_fullsized":"2024-09-13T05:11:20.350704+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:56:24.801492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011835439999999999,"stat_sum":{"num_bytes":4432308,"num_objects":61,"num_object_clones":5,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":23,"num_read":1614,"num_read_kb":2891,"num_write":419,"num_write_kb":2370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":297202,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"82'194","reported_seq":1056,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.357588+0000","last_change":"2024-09-13T05:10:12.076857+0000","last_active":"2024-09-13T05:11:20.357588+0000","last_peered":"2024-09-13T05:11:20.357588+0000","last_clean":"2024-09-13T05:11:20.357588+0000","last_became_active":"2024-09-13T05:10:09.644293+0000","last_became_peered":"2024-09-13T05:10:09.644293+0000","last_unstale":"2024-09-13T05:11:20.357588+0000","last_undegraded":"2024-09-13T05:11:20.357588+0000","last_fullsized":"2024-09-13T05:11:20.357588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:45:32.561793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225439,"stat_sum":{"num_bytes":26552467,"num_objects":56,"num_object_clones":7,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":28,"num_read":1342,"num_read_kb":4732,"num_write":167,"num_write_kb":3206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"82'234","reported_seq":2154,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350503+0000","last_change":"2024-09-13T05:10:11.645342+0000","last_active":"2024-09-13T05:11:20.350503+0000","last_peered":"2024-09-13T05:11:20.350503+0000","last_clean":"2024-09-13T05:11:20.350503+0000","last_became_active":"2024-09-13T05:10:09.645791+0000","last_became_peered":"2024-09-13T05:10:09.645791+0000","last_unstale":"2024-09-13T05:11:20.350503+0000","last_undegraded":"2024-09-13T05:11:20.350503+0000","last_fullsized":"2024-09-13T05:11:20.350503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:49.028553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072691800000000001,"stat_sum":{"num_bytes":33288741,"num_objects":76,"num_object_clones":13,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":32,"num_read":1957,"num_read_kb":11839,"num_write":196,"num_write_kb":4852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"81'523","reported_seq":2510,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350868+0000","last_change":"2024-09-13T05:10:31.949427+0000","last_active":"2024-09-13T05:11:20.350868+0000","last_peered":"2024-09-13T05:11:20.350868+0000","last_clean":"2024-09-13T05:11:20.350868+0000","last_became_active":"2024-09-13T05:10:31.828206+0000","last_became_peered":"2024-09-13T05:10:31.828206+0000","last_unstale":"2024-09-13T05:11:20.350868+0000","last_undegraded":"2024-09-13T05:11:20.350868+0000","last_fullsized":"2024-09-13T05:11:20.350868+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:32:46.868249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078437299999999999,"stat_sum":{"num_bytes":14843968,"num_objects":57,"num_object_clones":9,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":23,"num_read":4135,"num_read_kb":16509,"num_write":687,"num_write_kb":7839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":372837,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'328","reported_seq":1326,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356100+0000","last_change":"2024-09-13T05:10:37.990899+0000","last_active":"2024-09-13T05:11:20.356100+0000","last_peered":"2024-09-13T05:11:20.356100+0000","last_clean":"2024-09-13T05:11:20.356100+0000","last_became_active":"2024-09-13T05:10:37.867842+0000","last_became_peered":"2024-09-13T05:10:37.867842+0000","last_unstale":"2024-09-13T05:11:20.356100+0000","last_undegraded":"2024-09-13T05:11:20.356100+0000","last_fullsized":"2024-09-13T05:11:20.356100+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:38:24.437617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065808499999999999,"stat_sum":{"num_bytes":10335452,"num_objects":66,"num_object_clones":8,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":33,"num_read":2088,"num_read_kb":5710,"num_write":339,"num_write_kb":8660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":612052,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"81'269","reported_seq":3250,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.352366+0000","last_change":"2024-09-13T05:10:37.948112+0000","last_active":"2024-09-13T05:11:20.352366+0000","last_peered":"2024-09-13T05:11:20.352366+0000","last_clean":"2024-09-13T05:11:20.352366+0000","last_became_active":"2024-09-13T05:10:37.863614+0000","last_became_peered":"2024-09-13T05:10:37.863614+0000","last_unstale":"2024-09-13T05:11:20.352366+0000","last_undegraded":"2024-09-13T05:11:20.352366+0000","last_fullsized":"2024-09-13T05:11:20.352366+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:15.873724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027226559999999999,"stat_sum":{"num_bytes":12785593,"num_objects":73,"num_object_clones":10,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":30,"num_read":3419,"num_read_kb":7048,"num_write":224,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":77,"num_bytes_recovered":1081937,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"82'550","reported_seq":2529,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356910+0000","last_change":"2024-09-13T05:10:34.613940+0000","last_active":"2024-09-13T05:11:20.356910+0000","last_peered":"2024-09-13T05:11:20.356910+0000","last_clean":"2024-09-13T05:11:20.356910+0000","last_became_active":"2024-09-13T05:10:34.612579+0000","last_became_peered":"2024-09-13T05:10:34.612579+0000","last_unstale":"2024-09-13T05:11:20.356910+0000","last_undegraded":"2024-09-13T05:11:20.356910+0000","last_fullsized":"2024-09-13T05:11:20.356910+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:43.339882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067403999999999999,"stat_sum":{"num_bytes":52132499,"num_objects":67,"num_object_clones":10,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":27,"num_read":4360,"num_read_kb":17477,"num_write":732,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":248973,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"82'312","reported_seq":1519,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.358136+0000","last_change":"2024-09-13T05:10:37.929523+0000","last_active":"2024-09-13T05:11:20.358136+0000","last_peered":"2024-09-13T05:11:20.358136+0000","last_clean":"2024-09-13T05:11:20.358136+0000","last_became_active":"2024-09-13T05:10:37.865440+0000","last_became_peered":"2024-09-13T05:10:37.865440+0000","last_unstale":"2024-09-13T05:11:20.358136+0000","last_undegraded":"2024-09-13T05:11:20.358136+0000","last_fullsized":"2024-09-13T05:11:20.358136+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:30:31.875141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087399999999998,"stat_sum":{"num_bytes":23966439,"num_objects":75,"num_object_clones":12,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":41,"num_read":1531,"num_read_kb":13147,"num_write":317,"num_write_kb":9444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":1513234,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"82'282","reported_seq":1906,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350868+0000","last_change":"2024-09-13T05:10:37.920810+0000","last_active":"2024-09-13T05:11:20.350868+0000","last_peered":"2024-09-13T05:11:20.350868+0000","last_clean":"2024-09-13T05:11:20.350868+0000","last_became_active":"2024-09-13T05:10:37.864816+0000","last_became_peered":"2024-09-13T05:10:37.864816+0000","last_unstale":"2024-09-13T05:11:20.350868+0000","last_undegraded":"2024-09-13T05:11:20.350868+0000","last_fullsized":"2024-09-13T05:11:20.350868+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:06.315864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096598599999999995,"stat_sum":{"num_bytes":8008426,"num_objects":49,"num_object_clones":5,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":23,"num_read":3422,"num_read_kb":5977,"num_write":249,"num_write_kb":2787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":37802,"num_keys_recovered":23,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"82'242","reported_seq":1792,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.359759+0000","last_change":"2024-09-13T05:11:21.359759+0000","last_active":"2024-09-13T05:11:21.359759+0000","last_peered":"2024-09-13T05:11:19.636191+0000","last_clean":"2024-09-13T05:11:19.636191+0000","last_became_active":"2024-09-13T05:11:16.318103+0000","last_became_peered":"2024-09-13T05:11:16.318103+0000","last_unstale":"2024-09-13T05:11:21.359759+0000","last_undegraded":"2024-09-13T05:11:21.359759+0000","last_fullsized":"2024-09-13T05:11:21.359759+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:26:59.453898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072236499999999999,"stat_sum":{"num_bytes":33427991,"num_objects":63,"num_object_clones":14,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":33,"num_read":1467,"num_read_kb":10421,"num_write":205,"num_write_kb":3380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":2367921,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"82'278","reported_seq":1494,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.357948+0000","last_change":"2024-09-13T05:10:11.681217+0000","last_active":"2024-09-13T05:11:20.357948+0000","last_peered":"2024-09-13T05:11:20.357948+0000","last_clean":"2024-09-13T05:11:20.357948+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:11:20.357948+0000","last_undegraded":"2024-09-13T05:11:20.357948+0000","last_fullsized":"2024-09-13T05:11:20.357948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:40.457636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095533399999999996,"stat_sum":{"num_bytes":15069163,"num_objects":59,"num_object_clones":11,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":31,"num_read":1761,"num_read_kb":10093,"num_write":332,"num_write_kb":6418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"82'252","reported_seq":3932,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356606+0000","last_change":"2024-09-13T05:10:11.681365+0000","last_active":"2024-09-13T05:11:20.356606+0000","last_peered":"2024-09-13T05:11:20.356606+0000","last_clean":"2024-09-13T05:11:20.356606+0000","last_became_active":"2024-09-13T05:10:09.645823+0000","last_became_peered":"2024-09-13T05:10:09.645823+0000","last_unstale":"2024-09-13T05:11:20.356606+0000","last_undegraded":"2024-09-13T05:11:20.356606+0000","last_fullsized":"2024-09-13T05:11:20.356606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:24.367358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011047369999999999,"stat_sum":{"num_bytes":40943795,"num_objects":70,"num_object_clones":11,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":36,"num_read":3719,"num_read_kb":26564,"num_write":218,"num_write_kb":5946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.354092+0000","last_change":"2024-09-13T05:10:01.383891+0000","last_active":"2024-09-13T05:11:20.354092+0000","last_peered":"2024-09-13T05:11:20.354092+0000","last_clean":"2024-09-13T05:11:20.354092+0000","last_became_active":"2024-09-13T05:09:59.374793+0000","last_became_peered":"2024-09-13T05:09:59.374793+0000","last_unstale":"2024-09-13T05:11:20.354092+0000","last_undegraded":"2024-09-13T05:11:20.354092+0000","last_fullsized":"2024-09-13T05:11:20.354092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:02.499446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065068999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"81'208","reported_seq":4630,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.355141+0000","last_change":"2024-09-13T05:11:21.355557+0000","last_active":"2024-09-13T05:11:20.356777+0000","last_peered":"2024-09-13T05:11:19.396360+0000","last_clean":"2024-09-13T05:11:19.396360+0000","last_became_active":"2024-09-13T05:11:16.320129+0000","last_became_peered":"2024-09-13T05:11:16.320129+0000","last_unstale":"2024-09-13T05:11:21.355141+0000","last_undegraded":"2024-09-13T05:11:21.355141+0000","last_fullsized":"2024-09-13T05:11:21.355141+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:46.094415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099899699999999995,"stat_sum":{"num_bytes":30257384,"num_objects":54,"num_object_clones":7,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":25,"num_read":3334,"num_read_kb":12021,"num_write":170,"num_write_kb":6871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":9357649,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.354122+0000","last_change":"2024-09-13T05:10:31.826927+0000","last_active":"2024-09-13T05:11:20.354122+0000","last_peered":"2024-09-13T05:11:20.354122+0000","last_clean":"2024-09-13T05:11:20.354122+0000","last_became_active":"2024-09-13T05:10:31.826431+0000","last_became_peered":"2024-09-13T05:10:31.826431+0000","last_unstale":"2024-09-13T05:11:20.354122+0000","last_undegraded":"2024-09-13T05:11:20.354122+0000","last_fullsized":"2024-09-13T05:11:20.354122+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:13:36.678853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"82'235","reported_seq":1353,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.357116+0000","last_change":"2024-09-13T05:10:12.077111+0000","last_active":"2024-09-13T05:11:20.357116+0000","last_peered":"2024-09-13T05:11:20.357116+0000","last_clean":"2024-09-13T05:11:20.357116+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:11:20.357116+0000","last_undegraded":"2024-09-13T05:11:20.357116+0000","last_fullsized":"2024-09-13T05:11:20.357116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:37.976147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001460444,"stat_sum":{"num_bytes":51840824,"num_objects":65,"num_object_clones":7,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":36,"num_read":1243,"num_read_kb":10722,"num_write":204,"num_write_kb":3289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":88,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.358251+0000","last_change":"2024-09-13T05:10:37.866953+0000","last_active":"2024-09-13T05:11:20.358251+0000","last_peered":"2024-09-13T05:11:20.358251+0000","last_clean":"2024-09-13T05:11:20.358251+0000","last_became_active":"2024-09-13T05:10:37.866624+0000","last_became_peered":"2024-09-13T05:10:37.866624+0000","last_unstale":"2024-09-13T05:11:20.358251+0000","last_undegraded":"2024-09-13T05:11:20.358251+0000","last_fullsized":"2024-09-13T05:11:20.358251+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:56:20.077971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"82'395","reported_seq":869,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.360669+0000","last_change":"2024-09-13T05:11:21.361787+0000","last_active":"2024-09-13T05:11:20.353207+0000","last_peered":"2024-09-13T05:11:19.588315+0000","last_clean":"2024-09-13T05:11:19.588315+0000","last_became_active":"2024-09-13T05:11:16.320218+0000","last_became_peered":"2024-09-13T05:11:16.320218+0000","last_unstale":"2024-09-13T05:11:21.360669+0000","last_undegraded":"2024-09-13T05:11:21.360669+0000","last_fullsized":"2024-09-13T05:11:21.360669+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:55.459490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076234800000000004,"stat_sum":{"num_bytes":12725004,"num_objects":62,"num_object_clones":5,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":32,"num_read":1423,"num_read_kb":2480,"num_write":544,"num_write_kb":3485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":1446352,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356542+0000","last_change":"2024-09-13T05:10:37.864940+0000","last_active":"2024-09-13T05:11:20.356542+0000","last_peered":"2024-09-13T05:11:20.356542+0000","last_clean":"2024-09-13T05:11:20.356542+0000","last_became_active":"2024-09-13T05:10:37.864623+0000","last_became_peered":"2024-09-13T05:10:37.864623+0000","last_unstale":"2024-09-13T05:11:20.356542+0000","last_undegraded":"2024-09-13T05:11:20.356542+0000","last_fullsized":"2024-09-13T05:11:20.356542+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:41.598490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.5","version":"82'304","reported_seq":2657,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350596+0000","last_change":"2024-09-13T05:10:11.645960+0000","last_active":"2024-09-13T05:11:20.350596+0000","last_peered":"2024-09-13T05:11:20.350596+0000","last_clean":"2024-09-13T05:11:20.350596+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:11:20.350596+0000","last_undegraded":"2024-09-13T05:11:20.350596+0000","last_fullsized":"2024-09-13T05:11:20.350596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:40.372741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001054028,"stat_sum":{"num_bytes":68392647,"num_objects":67,"num_object_clones":8,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":25,"num_read":3566,"num_read_kb":55119,"num_write":289,"num_write_kb":37660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"82'421","reported_seq":2245,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.352386+0000","last_change":"2024-09-13T05:10:37.979816+0000","last_active":"2024-09-13T05:11:20.352386+0000","last_peered":"2024-09-13T05:11:20.352386+0000","last_clean":"2024-09-13T05:11:20.352386+0000","last_became_active":"2024-09-13T05:10:37.863256+0000","last_became_peered":"2024-09-13T05:10:37.863256+0000","last_unstale":"2024-09-13T05:11:20.352386+0000","last_undegraded":"2024-09-13T05:11:20.352386+0000","last_fullsized":"2024-09-13T05:11:20.352386+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:58:55.928356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099335200000000008,"stat_sum":{"num_bytes":55125174,"num_objects":60,"num_object_clones":8,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":31,"num_read":3071,"num_read_kb":18570,"num_write":534,"num_write_kb":24635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":214109,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350590+0000","last_change":"2024-09-13T05:10:31.836193+0000","last_active":"2024-09-13T05:11:20.350590+0000","last_peered":"2024-09-13T05:11:20.350590+0000","last_clean":"2024-09-13T05:11:20.350590+0000","last_became_active":"2024-09-13T05:10:31.825663+0000","last_became_peered":"2024-09-13T05:10:31.825663+0000","last_unstale":"2024-09-13T05:11:20.350590+0000","last_undegraded":"2024-09-13T05:11:20.350590+0000","last_fullsized":"2024-09-13T05:11:20.350590+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:38:23.311570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"82'308","reported_seq":648,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.351978+0000","last_change":"2024-09-13T05:10:31.893494+0000","last_active":"2024-09-13T05:11:20.351978+0000","last_peered":"2024-09-13T05:11:20.351978+0000","last_clean":"2024-09-13T05:11:20.351978+0000","last_became_active":"2024-09-13T05:10:31.827657+0000","last_became_peered":"2024-09-13T05:10:31.827657+0000","last_unstale":"2024-09-13T05:11:20.351978+0000","last_undegraded":"2024-09-13T05:11:20.351978+0000","last_fullsized":"2024-09-13T05:11:20.351978+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:16:14.432049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045163499999999998,"stat_sum":{"num_bytes":9373413,"num_objects":64,"num_object_clones":10,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":30,"num_read":946,"num_read_kb":2010,"num_write":355,"num_write_kb":1595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":84179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.352208+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:11:20.352208+0000","last_peered":"2024-09-13T05:11:20.352208+0000","last_clean":"2024-09-13T05:11:20.352208+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:11:20.352208+0000","last_undegraded":"2024-09-13T05:11:20.352208+0000","last_fullsized":"2024-09-13T05:11:20.352208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"82'199","reported_seq":621,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356737+0000","last_change":"2024-09-13T05:10:38.111510+0000","last_active":"2024-09-13T05:11:20.356737+0000","last_peered":"2024-09-13T05:11:20.356737+0000","last_clean":"2024-09-13T05:11:20.356737+0000","last_became_active":"2024-09-13T05:10:37.869040+0000","last_became_peered":"2024-09-13T05:10:37.869040+0000","last_unstale":"2024-09-13T05:11:20.356737+0000","last_undegraded":"2024-09-13T05:11:20.356737+0000","last_fullsized":"2024-09-13T05:11:20.356737+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:48:18.385423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048152600000000002,"stat_sum":{"num_bytes":14153518,"num_objects":53,"num_object_clones":8,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":28,"num_read":372,"num_read_kb":6477,"num_write":183,"num_write_kb":7640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":383717,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.355963+0000","last_change":"2024-09-13T05:10:37.865514+0000","last_active":"2024-09-13T05:11:20.355963+0000","last_peered":"2024-09-13T05:11:20.355963+0000","last_clean":"2024-09-13T05:11:20.355963+0000","last_became_active":"2024-09-13T05:10:37.864299+0000","last_became_peered":"2024-09-13T05:10:37.864299+0000","last_unstale":"2024-09-13T05:11:20.355963+0000","last_undegraded":"2024-09-13T05:11:20.355963+0000","last_fullsized":"2024-09-13T05:11:20.355963+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:45:58.276509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"82'291","reported_seq":1424,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.361675+0000","last_change":"2024-09-13T05:11:21.361851+0000","last_active":"2024-09-13T05:11:20.357426+0000","last_peered":"2024-09-13T05:11:19.677565+0000","last_clean":"2024-09-13T05:11:19.677565+0000","last_became_active":"2024-09-13T05:11:16.318497+0000","last_became_peered":"2024-09-13T05:11:16.318497+0000","last_unstale":"2024-09-13T05:11:21.361675+0000","last_undegraded":"2024-09-13T05:11:21.361675+0000","last_fullsized":"2024-09-13T05:11:21.361675+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:41:26.275072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059320200000000003,"stat_sum":{"num_bytes":2453385,"num_objects":63,"num_object_clones":6,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":30,"num_read":2378,"num_read_kb":4246,"num_write":246,"num_write_kb":2311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":1411492,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350763+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:11:20.350763+0000","last_peered":"2024-09-13T05:11:20.350763+0000","last_clean":"2024-09-13T05:11:20.350763+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:11:20.350763+0000","last_undegraded":"2024-09-13T05:11:20.350763+0000","last_fullsized":"2024-09-13T05:11:20.350763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":249,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356133+0000","last_change":"2024-09-13T05:10:40.886011+0000","last_active":"2024-09-13T05:11:20.356133+0000","last_peered":"2024-09-13T05:11:20.356133+0000","last_clean":"2024-09-13T05:11:20.356133+0000","last_became_active":"2024-09-13T05:10:40.885587+0000","last_became_peered":"2024-09-13T05:10:40.885587+0000","last_unstale":"2024-09-13T05:11:20.356133+0000","last_undegraded":"2024-09-13T05:11:20.356133+0000","last_fullsized":"2024-09-13T05:11:20.356133+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:52:47.632734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"82'200","reported_seq":462,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.358238+0000","last_change":"2024-09-13T05:10:31.888827+0000","last_active":"2024-09-13T05:11:20.358238+0000","last_peered":"2024-09-13T05:11:20.358238+0000","last_clean":"2024-09-13T05:11:20.358238+0000","last_became_active":"2024-09-13T05:10:31.827016+0000","last_became_peered":"2024-09-13T05:10:31.827016+0000","last_unstale":"2024-09-13T05:11:20.358238+0000","last_undegraded":"2024-09-13T05:11:20.358238+0000","last_fullsized":"2024-09-13T05:11:20.358238+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:47.525525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000500144,"stat_sum":{"num_bytes":5421745,"num_objects":68,"num_object_clones":8,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":38,"num_read":219,"num_read_kb":1292,"num_write":156,"num_write_kb":24142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":58925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"82'242","reported_seq":5921,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.352030+0000","last_change":"2024-09-13T05:10:11.648218+0000","last_active":"2024-09-13T05:11:20.352030+0000","last_peered":"2024-09-13T05:11:20.352030+0000","last_clean":"2024-09-13T05:11:20.352030+0000","last_became_active":"2024-09-13T05:10:09.645408+0000","last_became_peered":"2024-09-13T05:10:09.645408+0000","last_unstale":"2024-09-13T05:11:20.352030+0000","last_undegraded":"2024-09-13T05:11:20.352030+0000","last_fullsized":"2024-09-13T05:11:20.352030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:59.846981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097828900000000002,"stat_sum":{"num_bytes":26732733,"num_objects":55,"num_object_clones":5,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":24,"num_read":6916,"num_read_kb":20339,"num_write":199,"num_write_kb":5391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"82'378","reported_seq":8606,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356790+0000","last_change":"2024-09-13T05:10:47.940550+0000","last_active":"2024-09-13T05:11:20.356790+0000","last_peered":"2024-09-13T05:11:20.356790+0000","last_clean":"2024-09-13T05:11:20.356790+0000","last_became_active":"2024-09-13T05:10:47.939220+0000","last_became_peered":"2024-09-13T05:10:47.939220+0000","last_unstale":"2024-09-13T05:11:20.356790+0000","last_undegraded":"2024-09-13T05:11:20.356790+0000","last_fullsized":"2024-09-13T05:11:20.356790+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:59.693041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013204619999999999,"stat_sum":{"num_bytes":5708351,"num_objects":63,"num_object_clones":9,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":33,"num_read":8750,"num_read_kb":12319,"num_write":427,"num_write_kb":6929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":59,"num_bytes_recovered":6203954,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"81'216","reported_seq":1693,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356722+0000","last_change":"2024-09-13T05:10:38.007507+0000","last_active":"2024-09-13T05:11:20.356722+0000","last_peered":"2024-09-13T05:11:20.356722+0000","last_clean":"2024-09-13T05:11:20.356722+0000","last_became_active":"2024-09-13T05:10:37.868643+0000","last_became_peered":"2024-09-13T05:10:37.868643+0000","last_unstale":"2024-09-13T05:11:20.356722+0000","last_undegraded":"2024-09-13T05:11:20.356722+0000","last_fullsized":"2024-09-13T05:11:20.356722+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:29:05.387242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055343700000000005,"stat_sum":{"num_bytes":6059553,"num_objects":62,"num_object_clones":11,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":35,"num_read":1443,"num_read_kb":3806,"num_write":176,"num_write_kb":6478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":15854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"82'152","reported_seq":514,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.350963+0000","last_change":"2024-09-13T05:10:11.647302+0000","last_active":"2024-09-13T05:11:20.350963+0000","last_peered":"2024-09-13T05:11:20.350963+0000","last_clean":"2024-09-13T05:11:20.350963+0000","last_became_active":"2024-09-13T05:10:09.647037+0000","last_became_peered":"2024-09-13T05:10:09.647037+0000","last_unstale":"2024-09-13T05:11:20.350963+0000","last_undegraded":"2024-09-13T05:11:20.350963+0000","last_fullsized":"2024-09-13T05:11:20.350963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:54:17.061326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069994199999999995,"stat_sum":{"num_bytes":23527409,"num_objects":54,"num_object_clones":7,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":27,"num_read":362,"num_read_kb":4460,"num_write":133,"num_write_kb":3240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"82'538","reported_seq":3722,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.355244+0000","last_change":"2024-09-13T05:11:21.355680+0000","last_active":"2024-09-13T05:11:20.356779+0000","last_peered":"2024-09-13T05:11:19.588900+0000","last_clean":"2024-09-13T05:11:19.588900+0000","last_became_active":"2024-09-13T05:11:16.320142+0000","last_became_peered":"2024-09-13T05:11:16.320142+0000","last_unstale":"2024-09-13T05:11:21.355244+0000","last_undegraded":"2024-09-13T05:11:21.355244+0000","last_fullsized":"2024-09-13T05:11:21.355244+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:22:28.513701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019283150000000001,"stat_sum":{"num_bytes":67865030,"num_objects":68,"num_object_clones":7,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":29,"num_read":4868,"num_read_kb":14274,"num_write":691,"num_write_kb":7824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":6390508,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"82'706","reported_seq":4976,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.356791+0000","last_change":"2024-09-13T05:11:21.357157+0000","last_active":"2024-09-13T05:11:20.357722+0000","last_peered":"2024-09-13T05:11:19.473240+0000","last_clean":"2024-09-13T05:11:19.473240+0000","last_became_active":"2024-09-13T05:11:17.320630+0000","last_became_peered":"2024-09-13T05:11:17.320630+0000","last_unstale":"2024-09-13T05:11:21.356791+0000","last_undegraded":"2024-09-13T05:11:21.356791+0000","last_fullsized":"2024-09-13T05:11:21.356791+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:59:37.099760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018982339999999999,"stat_sum":{"num_bytes":21050383,"num_objects":62,"num_object_clones":5,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":33,"num_read":5865,"num_read_kb":6503,"num_write":1074,"num_write_kb":5137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":5447772,"num_keys_recovered":27,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"81'571","reported_seq":1739,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356396+0000","last_change":"2024-09-13T05:10:40.885332+0000","last_active":"2024-09-13T05:11:20.356396+0000","last_peered":"2024-09-13T05:11:20.356396+0000","last_clean":"2024-09-13T05:11:20.356396+0000","last_became_active":"2024-09-13T05:10:40.884585+0000","last_became_peered":"2024-09-13T05:10:40.884585+0000","last_unstale":"2024-09-13T05:11:20.356396+0000","last_undegraded":"2024-09-13T05:11:20.356396+0000","last_fullsized":"2024-09-13T05:11:20.356396+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:31:19.596080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001164273,"stat_sum":{"num_bytes":16441807,"num_objects":62,"num_object_clones":8,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":33,"num_read":3424,"num_read_kb":11070,"num_write":814,"num_write_kb":6507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":296075,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"82'304","reported_seq":1645,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-13T05:11:21.360339+0000","last_change":"2024-09-13T05:11:21.360699+0000","last_active":"2024-09-13T05:11:20.351535+0000","last_peered":"2024-09-13T05:11:19.586024+0000","last_clean":"2024-09-13T05:11:19.586024+0000","last_became_active":"2024-09-13T05:11:16.318398+0000","last_became_peered":"2024-09-13T05:11:16.318398+0000","last_unstale":"2024-09-13T05:11:21.360339+0000","last_undegraded":"2024-09-13T05:11:21.360339+0000","last_fullsized":"2024-09-13T05:11:21.360339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:15.586596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009951719999999999,"stat_sum":{"num_bytes":34507347,"num_objects":70,"num_object_clones":5,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":30,"num_read":1883,"num_read_kb":13826,"num_write":314,"num_write_kb":6862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":6115400,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"82'208","reported_seq":550,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356242+0000","last_change":"2024-09-13T05:10:11.680757+0000","last_active":"2024-09-13T05:11:20.356242+0000","last_peered":"2024-09-13T05:11:20.356242+0000","last_clean":"2024-09-13T05:11:20.356242+0000","last_became_active":"2024-09-13T05:10:09.653444+0000","last_became_peered":"2024-09-13T05:10:09.653444+0000","last_unstale":"2024-09-13T05:11:20.356242+0000","last_undegraded":"2024-09-13T05:11:20.356242+0000","last_fullsized":"2024-09-13T05:11:20.356242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:17:06.303008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000625977,"stat_sum":{"num_bytes":11696067,"num_objects":69,"num_object_clones":9,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":37,"num_read":367,"num_read_kb":8786,"num_write":170,"num_write_kb":4690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"82'654","reported_seq":2276,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356098+0000","last_change":"2024-09-13T05:10:40.884306+0000","last_active":"2024-09-13T05:11:20.356098+0000","last_peered":"2024-09-13T05:11:20.356098+0000","last_clean":"2024-09-13T05:11:20.356098+0000","last_became_active":"2024-09-13T05:10:40.883543+0000","last_became_peered":"2024-09-13T05:10:40.883543+0000","last_unstale":"2024-09-13T05:11:20.356098+0000","last_undegraded":"2024-09-13T05:11:20.356098+0000","last_fullsized":"2024-09-13T05:11:20.356098+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:14:23.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048307200000000003,"stat_sum":{"num_bytes":57651425,"num_objects":62,"num_object_clones":10,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":28,"num_read":4555,"num_read_kb":19689,"num_write":918,"num_write_kb":5670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":633324,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"82'610","reported_seq":2086,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-13T05:11:20.356890+0000","last_change":"2024-09-13T05:10:11.680877+0000","last_active":"2024-09-13T05:11:20.356890+0000","last_peered":"2024-09-13T05:11:20.356890+0000","last_clean":"2024-09-13T05:11:20.356890+0000","last_became_active":"2024-09-13T05:10:09.649053+0000","last_became_peered":"2024-09-13T05:10:09.649053+0000","last_unstale":"2024-09-13T05:11:20.356890+0000","last_undegraded":"2024-09-13T05:11:20.356890+0000","last_fullsized":"2024-09-13T05:11:20.356890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:14.770260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062821800000000005,"stat_sum":{"num_bytes":45221010,"num_objects":79,"num_object_clones":14,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":38,"num_read":3681,"num_read_kb":45427,"num_write":857,"num_write_kb":38413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":841991051,"num_objects":2034,"num_object_clones":272,"num_object_copies":4068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2034,"num_whiteouts":982,"num_read":89481,"num_read_kb":405844,"num_write":12539,"num_write_kb":271018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1299,"num_bytes_recovered":44591268,"num_keys_recovered":167,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":279560192,"data_stored":308393489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10950,"ondisk_log_size":10950,"up":64,"acting":58,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120844,"kb_used_data":71680,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94250996,"statfs":{"total":96636764160,"available":96513019904,"internally_reserved":0,"allocated":73400320,"data_stored":79819178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":50330059},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.751}]},{"osd":1,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.88500000000000001}]},{"osd":2,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.0609999999999999}]},{"osd":3,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.95199999999999996}]},{"osd":4,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.97999999999999998}]},{"osd":5,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.117},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.92400000000000004}]},{"osd":6,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.0820000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79332,"kb_used_data":39900,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94292508,"statfs":{"total":96636764160,"available":96555528192,"internally_reserved":0,"allocated":40857600,"data_stored":45907384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.64500000000000002}]},{"osd":1,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.82999999999999996}]},{"osd":2,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":1.109},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.93600000000000005}]},{"osd":3,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.1719999999999999}]},{"osd":4,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.752}]},{"osd":5,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.014}]},{"osd":7,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.2350000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70344,"kb_used_data":39224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94301496,"statfs":{"total":96636764160,"available":96564731904,"internally_reserved":0,"allocated":40165376,"data_stored":40304922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.96799999999999997}]},{"osd":1,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.83599999999999997}]},{"osd":2,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.627},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.90500000000000003}]},{"osd":3,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.131}]},{"osd":4,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.014},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.153}]},{"osd":6,"last update":"Fri Sep 13 05:10:58 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.107}]},{"osd":7,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.079},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.2}]}]},{"osd":4,"up_from":0,"seq":55834574871,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102824,"kb_used_data":71704,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94269016,"statfs":{"total":96636764160,"available":96531472384,"internally_reserved":0,"allocated":73424896,"data_stored":79410349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.41699999999999998}]},{"osd":1,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.442}]},{"osd":2,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.54000000000000004}]},{"osd":4,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.71999999999999997}]},{"osd":5,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.65700000000000003}]},{"osd":6,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.70199999999999996}]},{"osd":7,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.878},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.80900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79520,"kb_used_data":40208,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94292320,"statfs":{"total":96636764160,"available":96555335680,"internally_reserved":0,"allocated":41172992,"data_stored":44207117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.69199999999999995}]},{"osd":1,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.90700000000000003}]},{"osd":3,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.84799999999999998}]},{"osd":4,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.997}]},{"osd":5,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.0209999999999999}]},{"osd":6,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.048}]},{"osd":7,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.093},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.98299999999999998}]}]},{"osd":1,"up_from":0,"seq":55834574869,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":0,"seq":55834574871,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10035200,"data_stored":11939429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6619136,"data_stored":10238144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40181760,"data_stored":43752921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":72433664,"data_stored":78956153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":39182336,"data_stored":39856947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":39280640,"data_stored":44869041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":71827456,"data_stored":78780854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:11:27.256 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T05:11:27.257 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:27.257 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:27.265 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:11:27.313 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:27.309+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:27.359 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:11:27.414 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:27.409+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:27.420 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:27.420 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:27.430 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:11:27.505 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:11:27.515 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:27.509+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:27.528 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:11:27.533 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:27.533 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:27.543 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:11:27.552 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:11:27.570 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:11:27.590 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:11:27.611 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:11:27.615 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:27.609+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:27.619 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:11:27.619 INFO:teuthology.orchestra.run.smithi120.stdout:{"fsid":"0a3759da-62bd-4704-8a4a-7c20eb3fc816","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noscrub,nodeep-scrub flag(s) set","count":20},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":108,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":89,"num_osds":8,"num_up_osds":8,"osd_up_since":1726204191,"num_in_osds":5,"osd_in_since":1726204236,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":34},{"state_name":"remapped+peering","count":7}],"num_pgs":41,"num_pools":3,"num_objects":2038,"data_bytes":842581438,"bytes_used":463732736,"bytes_avail":482720088064,"bytes_total":483183820800,"inactive_pgs_ratio":0.17073170840740204},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-09-13T05:10:52.177972+0000","services":{}},"progress_events":{}} 2024-09-13T05:11:27.638 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-13T05:11:27.639 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:11:27.640 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:11:27.649 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:27.649 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:27.649 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:27.650 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:27.651 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is unset 2024-09-13T05:11:27.663 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:11:27.672 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:11:27.673 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:11:27.674 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:11:27.674 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:11:27.674 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:11:27.674 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:11:27.674 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:11:27.674 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:11:27.674 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:11:27.729 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:27.725+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:27.771 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:27.771 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:27.771 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:27.771 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:27.771 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:27.782 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:11:27.817 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:27.809+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:27.825 INFO:teuthology.orchestra.run.smithi120.stdout:leaving image image_client.0-clone28 intact 2024-09-13T05:11:27.894 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:27.894 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:27.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:27.894 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:27.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14179 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1835008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:11:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.132714573000001, 2024-09-13T05:11:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0924508550000001, 2024-09-13T05:11:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14179 2024-09-13T05:11:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:11:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:11:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757551+0000", 2024-09-13T05:11:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757554+0000", 2024-09-13T05:11:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5440000000000001e-06 2024-09-13T05:11:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757560+0000", 2024-09-13T05:11:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6840000000000001e-06 2024-09-13T05:11:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757564+0000", 2024-09-13T05:11:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3529999999999997e-06 2024-09-13T05:11:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814931+0000", 2024-09-13T05:11:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057367564000000003 2024-09-13T05:11:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814938+0000", 2024-09-13T05:11:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1070000000000001e-06 2024-09-13T05:11:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.849802+0000", 2024-09-13T05:11:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348647849999999 2024-09-13T05:11:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.849885+0000", 2024-09-13T05:11:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2859000000000001e-05 2024-09-13T05:11:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850003+0000", 2024-09-13T05:11:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117279 2024-09-13T05:11:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14180 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1844224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.132698288, 2024-09-13T05:11:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.092637853, 2024-09-13T05:11:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14180 2024-09-13T05:11:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757570+0000", 2024-09-13T05:11:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3470000000000001e-06 2024-09-13T05:11:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757576+0000", 2024-09-13T05:11:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5550000000000002e-06 2024-09-13T05:11:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757580+0000", 2024-09-13T05:11:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6519999999999997e-06 2024-09-13T05:11:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814975+0000", 2024-09-13T05:11:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057394349999999997 2024-09-13T05:11:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814981+0000", 2024-09-13T05:11:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4119999999999998e-06 2024-09-13T05:11:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850042+0000", 2024-09-13T05:11:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0350611759999999 2024-09-13T05:11:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850103+0000", 2024-09-13T05:11:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0618000000000001e-05 2024-09-13T05:11:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850206+0000", 2024-09-13T05:11:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010309199999999999 2024-09-13T05:11:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14196 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1991680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.128899201999999, 2024-09-13T05:11:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0925442910000001, 2024-09-13T05:11:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14196 2024-09-13T05:11:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761368+0000", 2024-09-13T05:11:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3689999999999999e-06 2024-09-13T05:11:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761373+0000", 2024-09-13T05:11:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7180000000000004e-06 2024-09-13T05:11:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761376+0000", 2024-09-13T05:11:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0860000000000002e-06 2024-09-13T05:11:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815501+0000", 2024-09-13T05:11:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054125508000000003 2024-09-13T05:11:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815508+0000", 2024-09-13T05:11:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5570000000000001e-06 2024-09-13T05:11:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853689+0000", 2024-09-13T05:11:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0381811919999999 2024-09-13T05:11:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853764+0000", 2024-09-13T05:11:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4893000000000003e-05 2024-09-13T05:11:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853911+0000", 2024-09-13T05:11:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014721100000000001 2024-09-13T05:11:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14197 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2000896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.128887958, 2024-09-13T05:11:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.092841977, 2024-09-13T05:11:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14197 2024-09-13T05:11:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761403+0000", 2024-09-13T05:11:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5199e-05 2024-09-13T05:11:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761411+0000", 2024-09-13T05:11:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4540000000000001e-06 2024-09-13T05:11:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761418+0000", 2024-09-13T05:11:27.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9569999999999996e-06 2024-09-13T05:11:27.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815531+0000", 2024-09-13T05:11:27.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054113599999999998 2024-09-13T05:11:27.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815539+0000", 2024-09-13T05:11:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.481e-06 2024-09-13T05:11:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853949+0000", 2024-09-13T05:11:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.038410356 2024-09-13T05:11:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854022+0000", 2024-09-13T05:11:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2807999999999998e-05 2024-09-13T05:11:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854220+0000", 2024-09-13T05:11:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000198364 2024-09-13T05:11:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14198 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2010112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.128842949999999, 2024-09-13T05:11:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093063787, 2024-09-13T05:11:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14198 2024-09-13T05:11:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761426+0000", 2024-09-13T05:11:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8789999999999999e-06 2024-09-13T05:11:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761432+0000", 2024-09-13T05:11:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1399999999999997e-06 2024-09-13T05:11:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761437+0000", 2024-09-13T05:11:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8579999999999999e-06 2024-09-13T05:11:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815563+0000", 2024-09-13T05:11:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054125877000000003 2024-09-13T05:11:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815570+0000", 2024-09-13T05:11:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1169999999999998e-06 2024-09-13T05:11:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854265+0000", 2024-09-13T05:11:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0386955659999999 2024-09-13T05:11:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854338+0000", 2024-09-13T05:11:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2537e-05 2024-09-13T05:11:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854487+0000", 2024-09-13T05:11:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014927899999999999 2024-09-13T05:11:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14199 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.128824076999997, 2024-09-13T05:11:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0933252389999999, 2024-09-13T05:11:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14199 2024-09-13T05:11:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761445+0000", 2024-09-13T05:11:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7779999999999999e-06 2024-09-13T05:11:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761450+0000", 2024-09-13T05:11:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6350000000000003e-06 2024-09-13T05:11:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761455+0000", 2024-09-13T05:11:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9930000000000003e-06 2024-09-13T05:11:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815600+0000", 2024-09-13T05:11:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054144982000000001 2024-09-13T05:11:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815607+0000", 2024-09-13T05:11:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4749999999999998e-06 2024-09-13T05:11:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854527+0000", 2024-09-13T05:11:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.038920037 2024-09-13T05:11:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854637+0000", 2024-09-13T05:11:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011021700000000001 2024-09-13T05:11:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854767+0000", 2024-09-13T05:11:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130512 2024-09-13T05:11:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14200 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2028544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:11:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.128805563999997, 2024-09-13T05:11:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093541554, 2024-09-13T05:11:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14200 2024-09-13T05:11:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:11:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:11:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761460+0000", 2024-09-13T05:11:27.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:27.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:27.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761462+0000", 2024-09-13T05:11:27.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9659999999999999e-06 2024-09-13T05:11:27.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:27.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761466+0000", 2024-09-13T05:11:27.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6109999999999998e-06 2024-09-13T05:11:27.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:27.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761471+0000", 2024-09-13T05:11:27.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1019999999999996e-06 2024-09-13T05:11:27.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815631+0000", 2024-09-13T05:11:27.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054159680000000002 2024-09-13T05:11:27.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:27.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815637+0000", 2024-09-13T05:11:27.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-09-13T05:11:27.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854810+0000", 2024-09-13T05:11:27.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0391731930000001 2024-09-13T05:11:27.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:27.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854883+0000", 2024-09-13T05:11:27.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3109999999999996e-05 2024-09-13T05:11:27.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:27.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855002+0000", 2024-09-13T05:11:27.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011934600000000001 2024-09-13T05:11:27.932 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.932 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:27.932 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.932 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14201 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2037760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:27.932 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:27.932 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.128791133999997, 2024-09-13T05:11:27.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0937543320000001, 2024-09-13T05:11:27.932 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:27.932 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:27.932 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:27.932 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:27.933 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:27.933 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14201 2024-09-13T05:11:27.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.933 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:27.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:27.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:27.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:27.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:27.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:27.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:27.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:27.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:27.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761477+0000", 2024-09-13T05:11:27.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5620000000000002e-06 2024-09-13T05:11:27.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:27.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761483+0000", 2024-09-13T05:11:27.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7400000000000001e-06 2024-09-13T05:11:27.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:27.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761487+0000", 2024-09-13T05:11:27.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8130000000000002e-06 2024-09-13T05:11:27.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815697+0000", 2024-09-13T05:11:27.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054210253 2024-09-13T05:11:27.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:27.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815705+0000", 2024-09-13T05:11:27.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7049999999999999e-06 2024-09-13T05:11:27.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855036+0000", 2024-09-13T05:11:27.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.039330799 2024-09-13T05:11:27.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:27.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855110+0000", 2024-09-13T05:11:27.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4498000000000004e-05 2024-09-13T05:11:27.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:27.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855229+0000", 2024-09-13T05:11:27.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119282 2024-09-13T05:11:27.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.937 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:27.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.937 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14202 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:27.937 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:11:27.937 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.128726477000001, 2024-09-13T05:11:27.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093934027, 2024-09-13T05:11:27.938 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:27.938 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:27.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:27.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:27.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:27.938 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14202 2024-09-13T05:11:27.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.938 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:27.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:27.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:11:27.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:27.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:11:27.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:27.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761489+0000", 2024-09-13T05:11:27.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999495 2024-09-13T05:11:27.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:27.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761543+0000", 2024-09-13T05:11:27.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3983999999999997e-05 2024-09-13T05:11:27.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:27.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761552+0000", 2024-09-13T05:11:27.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-13T05:11:27.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:27.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761559+0000", 2024-09-13T05:11:27.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7710000000000001e-06 2024-09-13T05:11:27.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815742+0000", 2024-09-13T05:11:27.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054183488000000002 2024-09-13T05:11:27.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:27.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815749+0000", 2024-09-13T05:11:27.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1609999999999997e-06 2024-09-13T05:11:27.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855283+0000", 2024-09-13T05:11:27.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0395336230000001 2024-09-13T05:11:27.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:27.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855354+0000", 2024-09-13T05:11:27.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1456000000000002e-05 2024-09-13T05:11:27.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:27.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855474+0000", 2024-09-13T05:11:27.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119429 2024-09-13T05:11:27.942 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.942 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:27.942 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.943 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14294 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2113536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:27.943 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:11:27.943 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.125175562999999, 2024-09-13T05:11:27.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0923650330000001, 2024-09-13T05:11:27.943 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:27.943 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:27.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:27.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:27.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:27.943 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14294 2024-09-13T05:11:27.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.943 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:27.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:27.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:11:27.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:27.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:11:27.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:27.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765090+0000", 2024-09-13T05:11:27.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:27.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:27.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765092+0000", 2024-09-13T05:11:27.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.542e-06 2024-09-13T05:11:27.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:27.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765096+0000", 2024-09-13T05:11:27.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6179999999999999e-06 2024-09-13T05:11:27.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:27.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765098+0000", 2024-09-13T05:11:27.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8049999999999998e-06 2024-09-13T05:11:27.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816384+0000", 2024-09-13T05:11:27.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051285338999999999 2024-09-13T05:11:27.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:27.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816393+0000", 2024-09-13T05:11:27.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-09-13T05:11:27.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857258+0000", 2024-09-13T05:11:27.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0408652549999999 2024-09-13T05:11:27.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:27.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857327+0000", 2024-09-13T05:11:27.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8714000000000007e-05 2024-09-13T05:11:27.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:27.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857456+0000", 2024-09-13T05:11:27.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012909299999999999 2024-09-13T05:11:27.947 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.948 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:27.948 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.948 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14295 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2122752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:27.948 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:27.948 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.125165805000002, 2024-09-13T05:11:27.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0928006969999999, 2024-09-13T05:11:27.948 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:27.948 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:27.948 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:27.948 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:27.948 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:27.948 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14295 2024-09-13T05:11:27.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.949 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:27.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:27.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:27.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:27.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:27.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:27.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:27.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:27.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:27.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765102+0000", 2024-09-13T05:11:27.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3990000000000001e-06 2024-09-13T05:11:27.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:27.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765104+0000", 2024-09-13T05:11:27.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:11:27.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:27.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765107+0000", 2024-09-13T05:11:27.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.582e-06 2024-09-13T05:11:27.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816432+0000", 2024-09-13T05:11:27.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051325118000000003 2024-09-13T05:11:27.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:27.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816440+0000", 2024-09-13T05:11:27.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4679999999999992e-06 2024-09-13T05:11:27.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857495+0000", 2024-09-13T05:11:27.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.041054216 2024-09-13T05:11:27.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:27.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857644+0000", 2024-09-13T05:11:27.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014909400000000001 2024-09-13T05:11:27.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:27.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857901+0000", 2024-09-13T05:11:27.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025746200000000002 2024-09-13T05:11:27.953 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.953 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:27.953 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.953 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14296 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2131968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:27.953 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:11:27.953 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.125157559000002, 2024-09-13T05:11:27.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093120361, 2024-09-13T05:11:27.953 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:27.953 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:27.953 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:27.954 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:27.954 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:27.954 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14296 2024-09-13T05:11:27.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.954 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:27.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:27.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:11:27.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:27.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:11:27.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:27.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765108+0000", 2024-09-13T05:11:27.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:27.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765110+0000", 2024-09-13T05:11:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.226e-06 2024-09-13T05:11:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765112+0000", 2024-09-13T05:11:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6769999999999999e-06 2024-09-13T05:11:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765115+0000", 2024-09-13T05:11:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.712e-06 2024-09-13T05:11:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816479+0000", 2024-09-13T05:11:27.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051364102000000002 2024-09-13T05:11:27.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:27.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816503+0000", 2024-09-13T05:11:27.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3723999999999999e-05 2024-09-13T05:11:27.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857929+0000", 2024-09-13T05:11:27.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0414263180000001 2024-09-13T05:11:27.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:27.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858015+0000", 2024-09-13T05:11:27.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5730999999999996e-05 2024-09-13T05:11:27.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:27.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858229+0000", 2024-09-13T05:11:27.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021408700000000001 2024-09-13T05:11:27.959 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.959 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:27.959 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14297 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2141184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.125149213999997, 2024-09-13T05:11:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0936699510000001, 2024-09-13T05:11:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14297 2024-09-13T05:11:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:27.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765118+0000", 2024-09-13T05:11:27.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4190000000000001e-06 2024-09-13T05:11:27.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:27.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765121+0000", 2024-09-13T05:11:27.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6110000000000001e-06 2024-09-13T05:11:27.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:27.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765124+0000", 2024-09-13T05:11:27.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3720000000000001e-06 2024-09-13T05:11:27.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816535+0000", 2024-09-13T05:11:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051410890000000001 2024-09-13T05:11:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816556+0000", 2024-09-13T05:11:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0551e-05 2024-09-13T05:11:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858552+0000", 2024-09-13T05:11:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0419965529999999 2024-09-13T05:11:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858640+0000", 2024-09-13T05:11:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7907999999999999e-05 2024-09-13T05:11:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858787+0000", 2024-09-13T05:11:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000146864 2024-09-13T05:11:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14298 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2150400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.125139820999998, 2024-09-13T05:11:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0938958759999999, 2024-09-13T05:11:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14298 2024-09-13T05:11:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765128+0000", 2024-09-13T05:11:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4139999999999999e-06 2024-09-13T05:11:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765130+0000", 2024-09-13T05:11:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6809999999999998e-06 2024-09-13T05:11:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765133+0000", 2024-09-13T05:11:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9270000000000001e-06 2024-09-13T05:11:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816592+0000", 2024-09-13T05:11:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051459029000000003 2024-09-13T05:11:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816601+0000", 2024-09-13T05:11:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9819999999999997e-06 2024-09-13T05:11:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858818+0000", 2024-09-13T05:11:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0422167170000001 2024-09-13T05:11:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858896+0000", 2024-09-13T05:11:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8128999999999997e-05 2024-09-13T05:11:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859022+0000", 2024-09-13T05:11:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012619899999999999 2024-09-13T05:11:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14299 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2168832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.125131056999997, 2024-09-13T05:11:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0941207909999999, 2024-09-13T05:11:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:27.971 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:27.971 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:27.971 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14299 2024-09-13T05:11:27.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.971 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:27.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:27.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:27.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:27.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:27.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:27.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:27.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:27.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:27.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765136+0000", 2024-09-13T05:11:27.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5230000000000001e-06 2024-09-13T05:11:27.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765139+0000", 2024-09-13T05:11:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.672e-06 2024-09-13T05:11:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765142+0000", 2024-09-13T05:11:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6680000000000001e-06 2024-09-13T05:11:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816632+0000", 2024-09-13T05:11:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051489886999999998 2024-09-13T05:11:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816643+0000", 2024-09-13T05:11:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1457000000000001e-05 2024-09-13T05:11:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859061+0000", 2024-09-13T05:11:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.042417616 2024-09-13T05:11:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859138+0000", 2024-09-13T05:11:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7077999999999996e-05 2024-09-13T05:11:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859256+0000", 2024-09-13T05:11:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118108 2024-09-13T05:11:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14300 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2159616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.125122247, 2024-09-13T05:11:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0943386719999999, 2024-09-13T05:11:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14300 2024-09-13T05:11:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765145+0000", 2024-09-13T05:11:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.488e-06 2024-09-13T05:11:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765148+0000", 2024-09-13T05:11:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6620000000000001e-06 2024-09-13T05:11:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765151+0000", 2024-09-13T05:11:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6419999999999999e-06 2024-09-13T05:11:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816677+0000", 2024-09-13T05:11:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051526776000000003 2024-09-13T05:11:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816689+0000", 2024-09-13T05:11:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1634000000000001e-05 2024-09-13T05:11:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859296+0000", 2024-09-13T05:11:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0426066009999999 2024-09-13T05:11:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859364+0000", 2024-09-13T05:11:27.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8745999999999995e-05 2024-09-13T05:11:27.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:27.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859483+0000", 2024-09-13T05:11:27.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011833900000000001 2024-09-13T05:11:27.980 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.980 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:27.980 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.980 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14301 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2178048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:27.980 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:11:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.125113613000003, 2024-09-13T05:11:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0946233009999999, 2024-09-13T05:11:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14301 2024-09-13T05:11:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:11:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:11:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765152+0000", 2024-09-13T05:11:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765154+0000", 2024-09-13T05:11:27.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.449e-06 2024-09-13T05:11:27.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:27.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765157+0000", 2024-09-13T05:11:27.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6809999999999998e-06 2024-09-13T05:11:27.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:27.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765159+0000", 2024-09-13T05:11:27.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6060000000000001e-06 2024-09-13T05:11:27.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816722+0000", 2024-09-13T05:11:27.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051562535 2024-09-13T05:11:27.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:27.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816733+0000", 2024-09-13T05:11:27.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1678000000000001e-05 2024-09-13T05:11:27.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859521+0000", 2024-09-13T05:11:27.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0427879440000001 2024-09-13T05:11:27.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:27.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859655+0000", 2024-09-13T05:11:27.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134053 2024-09-13T05:11:27.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:27.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859776+0000", 2024-09-13T05:11:27.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012058299999999999 2024-09-13T05:11:27.985 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.985 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:27.985 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.985 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14302 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2187264~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.125105036000001, 2024-09-13T05:11:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.094937383, 2024-09-13T05:11:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14302 2024-09-13T05:11:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:27.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:27.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:27.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:27.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:27.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:27.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:27.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:27.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765162+0000", 2024-09-13T05:11:27.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4589999999999999e-06 2024-09-13T05:11:27.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:27.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765165+0000", 2024-09-13T05:11:27.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6019999999999998e-06 2024-09-13T05:11:27.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:27.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765168+0000", 2024-09-13T05:11:27.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.497e-06 2024-09-13T05:11:27.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816764+0000", 2024-09-13T05:11:27.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051596722999999997 2024-09-13T05:11:27.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:27.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816776+0000", 2024-09-13T05:11:27.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1967000000000001e-05 2024-09-13T05:11:27.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859810+0000", 2024-09-13T05:11:27.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0430338299999999 2024-09-13T05:11:27.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:27.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859901+0000", 2024-09-13T05:11:27.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1397999999999995e-05 2024-09-13T05:11:27.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:27.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860099+0000", 2024-09-13T05:11:27.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000197133 2024-09-13T05:11:27.990 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.990 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:27.990 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.991 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14303 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2196480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:27.991 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:11:27.991 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.125096698999997, 2024-09-13T05:11:27.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.095199152, 2024-09-13T05:11:27.991 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:27.991 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:27.991 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:27.991 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:27.991 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:27.991 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14303 2024-09-13T05:11:27.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.992 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:27.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:27.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:11:27.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:27.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:11:27.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:27.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765169+0000", 2024-09-13T05:11:27.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:27.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:27.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765171+0000", 2024-09-13T05:11:27.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2899999999999999e-06 2024-09-13T05:11:27.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:27.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765173+0000", 2024-09-13T05:11:27.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-13T05:11:27.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765176+0000", 2024-09-13T05:11:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.016e-06 2024-09-13T05:11:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816811+0000", 2024-09-13T05:11:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051634684 2024-09-13T05:11:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816840+0000", 2024-09-13T05:11:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8690000000000001e-05 2024-09-13T05:11:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860135+0000", 2024-09-13T05:11:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0432951029999999 2024-09-13T05:11:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860255+0000", 2024-09-13T05:11:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119936 2024-09-13T05:11:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860369+0000", 2024-09-13T05:11:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113978 2024-09-13T05:11:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14304 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2205696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.125073831000002, 2024-09-13T05:11:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0955512999999999, 2024-09-13T05:11:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14304 2024-09-13T05:11:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:27.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:27.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:27.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:27.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765195+0000", 2024-09-13T05:11:27.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6599999999999999e-06 2024-09-13T05:11:27.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:27.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765200+0000", 2024-09-13T05:11:27.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.356e-06 2024-09-13T05:11:27.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765205+0000", 2024-09-13T05:11:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3000000000000001e-06 2024-09-13T05:11:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816901+0000", 2024-09-13T05:11:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051695451000000003 2024-09-13T05:11:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816963+0000", 2024-09-13T05:11:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2694000000000007e-05 2024-09-13T05:11:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860434+0000", 2024-09-13T05:11:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.04347053 2024-09-13T05:11:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860592+0000", 2024-09-13T05:11:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015854199999999999 2024-09-13T05:11:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860744+0000", 2024-09-13T05:11:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015133 2024-09-13T05:11:28.001 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.001 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.001 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.001 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.001 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.001 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:28.003 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:11:28.004 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:11:28.005 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:11:28.006 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2024-09-13T05:11:27.642904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":941400420,"num_objects":2144,"num_object_clones":298,"num_object_copies":4288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2144,"num_whiteouts":1016,"num_read":94231,"num_read_kb":449874,"num_write":13430,"num_write_kb":290549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1981,"num_bytes_recovered":69865385,"num_keys_recovered":233,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11773,"ondisk_log_size":11773,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":511068,"kb_used_data":289132,"kb_used_omap":7,"kb_used_meta":220280,"kb_avail":471348132,"statfs":{"total":483183820800,"available":482660487168,"internally_reserved":0,"allocated":296071168,"data_stored":330434892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7962,"internal_metadata":225566950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":98818982,"num_objects":106,"num_object_clones":26,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":34,"num_read":4634,"num_read_kb":43930,"num_write":730,"num_write_kb":17113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":679,"num_bytes_recovered":24683730,"num_keys_recovered":66,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.261709"},"pg_stats":[{"pgid":"3.1f","version":"89'366","reported_seq":932,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.499428+0000","last_change":"2024-09-13T05:10:37.993400+0000","last_active":"2024-09-13T05:11:26.499428+0000","last_peered":"2024-09-13T05:11:26.499428+0000","last_clean":"2024-09-13T05:11:26.499428+0000","last_became_active":"2024-09-13T05:10:37.864778+0000","last_became_peered":"2024-09-13T05:10:37.864778+0000","last_unstale":"2024-09-13T05:11:26.499428+0000","last_undegraded":"2024-09-13T05:11:26.499428+0000","last_fullsized":"2024-09-13T05:11:26.499428+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:56:24.801492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011835439999999999,"stat_sum":{"num_bytes":4432308,"num_objects":62,"num_object_clones":6,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":24,"num_read":1632,"num_read_kb":2891,"num_write":437,"num_write_kb":3006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":297202,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"89'209","reported_seq":1078,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.497112+0000","last_change":"2024-09-13T05:10:12.076857+0000","last_active":"2024-09-13T05:11:26.497112+0000","last_peered":"2024-09-13T05:11:26.497112+0000","last_clean":"2024-09-13T05:11:26.497112+0000","last_became_active":"2024-09-13T05:10:09.644293+0000","last_became_peered":"2024-09-13T05:10:09.644293+0000","last_unstale":"2024-09-13T05:11:26.497112+0000","last_undegraded":"2024-09-13T05:11:26.497112+0000","last_fullsized":"2024-09-13T05:11:26.497112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:45:32.561793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225439,"stat_sum":{"num_bytes":26552467,"num_objects":56,"num_object_clones":7,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":28,"num_read":1358,"num_read_kb":4732,"num_write":178,"num_write_kb":3399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"85'236","reported_seq":2161,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.622954+0000","last_change":"2024-09-13T05:10:11.645342+0000","last_active":"2024-09-13T05:11:24.622954+0000","last_peered":"2024-09-13T05:11:24.622954+0000","last_clean":"2024-09-13T05:11:24.622954+0000","last_became_active":"2024-09-13T05:10:09.645791+0000","last_became_peered":"2024-09-13T05:10:09.645791+0000","last_unstale":"2024-09-13T05:11:24.622954+0000","last_undegraded":"2024-09-13T05:11:24.622954+0000","last_fullsized":"2024-09-13T05:11:24.622954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:49.028553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072691800000000001,"stat_sum":{"num_bytes":33288741,"num_objects":77,"num_object_clones":13,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":33,"num_read":1958,"num_read_kb":11839,"num_write":197,"num_write_kb":4852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"87'537","reported_seq":2562,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.622702+0000","last_change":"2024-09-13T05:10:31.949427+0000","last_active":"2024-09-13T05:11:24.622702+0000","last_peered":"2024-09-13T05:11:24.622702+0000","last_clean":"2024-09-13T05:11:24.622702+0000","last_became_active":"2024-09-13T05:10:31.828206+0000","last_became_peered":"2024-09-13T05:10:31.828206+0000","last_unstale":"2024-09-13T05:11:24.622702+0000","last_undegraded":"2024-09-13T05:11:24.622702+0000","last_fullsized":"2024-09-13T05:11:24.622702+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:32:46.868249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078437299999999999,"stat_sum":{"num_bytes":14844125,"num_objects":60,"num_object_clones":9,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":24,"num_read":4219,"num_read_kb":16578,"num_write":707,"num_write_kb":7858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":372837,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"89'358","reported_seq":1647,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.760209+0000","last_change":"2024-09-13T05:10:37.990899+0000","last_active":"2024-09-13T05:11:26.760209+0000","last_peered":"2024-09-13T05:11:26.760209+0000","last_clean":"2024-09-13T05:11:26.760209+0000","last_became_active":"2024-09-13T05:10:37.867842+0000","last_became_peered":"2024-09-13T05:10:37.867842+0000","last_unstale":"2024-09-13T05:11:26.760209+0000","last_undegraded":"2024-09-13T05:11:26.760209+0000","last_fullsized":"2024-09-13T05:11:26.760209+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:38:24.437617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065808499999999999,"stat_sum":{"num_bytes":23246044,"num_objects":72,"num_object_clones":8,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":36,"num_read":2516,"num_read_kb":13375,"num_write":364,"num_write_kb":9174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":612052,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"87'272","reported_seq":3423,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.770161+0000","last_change":"2024-09-13T05:10:37.948112+0000","last_active":"2024-09-13T05:11:26.770161+0000","last_peered":"2024-09-13T05:11:26.770161+0000","last_clean":"2024-09-13T05:11:26.770161+0000","last_became_active":"2024-09-13T05:10:37.863614+0000","last_became_peered":"2024-09-13T05:10:37.863614+0000","last_unstale":"2024-09-13T05:11:26.770161+0000","last_undegraded":"2024-09-13T05:11:26.770161+0000","last_fullsized":"2024-09-13T05:11:26.770161+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:15.873724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027226559999999999,"stat_sum":{"num_bytes":13047737,"num_objects":74,"num_object_clones":10,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":30,"num_read":3591,"num_read_kb":9445,"num_write":226,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":77,"num_bytes_recovered":1081937,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"89'582","reported_seq":2581,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.761298+0000","last_change":"2024-09-13T05:10:34.613940+0000","last_active":"2024-09-13T05:11:26.761298+0000","last_peered":"2024-09-13T05:11:26.761298+0000","last_clean":"2024-09-13T05:11:26.761298+0000","last_became_active":"2024-09-13T05:10:34.612579+0000","last_became_peered":"2024-09-13T05:10:34.612579+0000","last_unstale":"2024-09-13T05:11:26.761298+0000","last_undegraded":"2024-09-13T05:11:26.761298+0000","last_fullsized":"2024-09-13T05:11:26.761298+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":582,"log_dups_size":0,"ondisk_log_size":582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:43.339882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067403999999999999,"stat_sum":{"num_bytes":64977555,"num_objects":72,"num_object_clones":11,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":30,"num_read":4402,"num_read_kb":18284,"num_write":762,"num_write_kb":5835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":248973,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"87'376","reported_seq":1672,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:25.738418+0000","last_change":"2024-09-13T05:10:37.929523+0000","last_active":"2024-09-13T05:11:25.738418+0000","last_peered":"2024-09-13T05:11:25.738418+0000","last_clean":"2024-09-13T05:11:25.738418+0000","last_became_active":"2024-09-13T05:10:37.865440+0000","last_became_peered":"2024-09-13T05:10:37.865440+0000","last_unstale":"2024-09-13T05:11:25.738418+0000","last_undegraded":"2024-09-13T05:11:25.738418+0000","last_fullsized":"2024-09-13T05:11:25.738418+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:30:31.875141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087399999999998,"stat_sum":{"num_bytes":26063629,"num_objects":78,"num_object_clones":13,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":41,"num_read":1926,"num_read_kb":16725,"num_write":426,"num_write_kb":10613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":1513234,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"89'306","reported_seq":2010,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.499491+0000","last_change":"2024-09-13T05:10:37.920810+0000","last_active":"2024-09-13T05:11:26.499491+0000","last_peered":"2024-09-13T05:11:26.499491+0000","last_clean":"2024-09-13T05:11:26.499491+0000","last_became_active":"2024-09-13T05:10:37.864816+0000","last_became_peered":"2024-09-13T05:10:37.864816+0000","last_unstale":"2024-09-13T05:11:26.499491+0000","last_undegraded":"2024-09-13T05:11:26.499491+0000","last_fullsized":"2024-09-13T05:11:26.499491+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:06.315864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096598599999999995,"stat_sum":{"num_bytes":10171114,"num_objects":55,"num_object_clones":6,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":25,"num_read":3657,"num_read_kb":6154,"num_write":266,"num_write_kb":2787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":37802,"num_keys_recovered":23,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"85'245","reported_seq":1815,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:25.644111+0000","last_change":"2024-09-13T05:11:24.632224+0000","last_active":"2024-09-13T05:11:25.644111+0000","last_peered":"2024-09-13T05:11:25.644111+0000","last_clean":"2024-09-13T05:11:25.644111+0000","last_became_active":"2024-09-13T05:11:24.631079+0000","last_became_peered":"2024-09-13T05:11:24.631079+0000","last_unstale":"2024-09-13T05:11:25.644111+0000","last_undegraded":"2024-09-13T05:11:25.644111+0000","last_fullsized":"2024-09-13T05:11:25.644111+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:29.182802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072236499999999999,"stat_sum":{"num_bytes":33559063,"num_objects":65,"num_object_clones":15,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":33,"num_read":1475,"num_read_kb":10421,"num_write":207,"num_write_kb":3380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":4743569,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"85'281","reported_seq":1585,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.628437+0000","last_change":"2024-09-13T05:10:11.681217+0000","last_active":"2024-09-13T05:11:24.628437+0000","last_peered":"2024-09-13T05:11:24.628437+0000","last_clean":"2024-09-13T05:11:24.628437+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:11:24.628437+0000","last_undegraded":"2024-09-13T05:11:24.628437+0000","last_fullsized":"2024-09-13T05:11:24.628437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:40.457636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095533399999999996,"stat_sum":{"num_bytes":15134699,"num_objects":60,"num_object_clones":11,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":31,"num_read":1845,"num_read_kb":12717,"num_write":335,"num_write_kb":6466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"87'263","reported_seq":3958,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:25.732639+0000","last_change":"2024-09-13T05:10:11.681365+0000","last_active":"2024-09-13T05:11:25.732639+0000","last_peered":"2024-09-13T05:11:25.732639+0000","last_clean":"2024-09-13T05:11:25.732639+0000","last_became_active":"2024-09-13T05:10:09.645823+0000","last_became_peered":"2024-09-13T05:10:09.645823+0000","last_unstale":"2024-09-13T05:11:25.732639+0000","last_undegraded":"2024-09-13T05:11:25.732639+0000","last_fullsized":"2024-09-13T05:11:25.732639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:24.367358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011047369999999999,"stat_sum":{"num_bytes":43303091,"num_objects":75,"num_object_clones":13,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":38,"num_read":3735,"num_read_kb":26820,"num_write":225,"num_write_kb":6225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.633944+0000","last_change":"2024-09-13T05:10:01.383891+0000","last_active":"2024-09-13T05:11:24.633944+0000","last_peered":"2024-09-13T05:11:24.633944+0000","last_clean":"2024-09-13T05:11:24.633944+0000","last_became_active":"2024-09-13T05:09:59.374793+0000","last_became_peered":"2024-09-13T05:09:59.374793+0000","last_unstale":"2024-09-13T05:11:24.633944+0000","last_undegraded":"2024-09-13T05:11:24.633944+0000","last_fullsized":"2024-09-13T05:11:24.633944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:02.499446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065068999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"87'220","reported_seq":4848,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:25.733395+0000","last_change":"2024-09-13T05:11:25.647054+0000","last_active":"2024-09-13T05:11:25.733395+0000","last_peered":"2024-09-13T05:11:25.733395+0000","last_clean":"2024-09-13T05:11:25.733395+0000","last_became_active":"2024-09-13T05:11:25.645546+0000","last_became_peered":"2024-09-13T05:11:25.645546+0000","last_unstale":"2024-09-13T05:11:25.733395+0000","last_undegraded":"2024-09-13T05:11:25.733395+0000","last_fullsized":"2024-09-13T05:11:25.733395+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:33:49.392161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099899699999999995,"stat_sum":{"num_bytes":32485608,"num_objects":59,"num_object_clones":9,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":25,"num_read":3354,"num_read_kb":12021,"num_write":178,"num_write_kb":6920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":13680601,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.633955+0000","last_change":"2024-09-13T05:10:31.826927+0000","last_active":"2024-09-13T05:11:24.633955+0000","last_peered":"2024-09-13T05:11:24.633955+0000","last_clean":"2024-09-13T05:11:24.633955+0000","last_became_active":"2024-09-13T05:10:31.826431+0000","last_became_peered":"2024-09-13T05:10:31.826431+0000","last_unstale":"2024-09-13T05:11:24.633955+0000","last_undegraded":"2024-09-13T05:11:24.633955+0000","last_fullsized":"2024-09-13T05:11:24.633955+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:13:36.678853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"85'241","reported_seq":1366,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.632090+0000","last_change":"2024-09-13T05:10:12.077111+0000","last_active":"2024-09-13T05:11:24.632090+0000","last_peered":"2024-09-13T05:11:24.632090+0000","last_clean":"2024-09-13T05:11:24.632090+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:11:24.632090+0000","last_undegraded":"2024-09-13T05:11:24.632090+0000","last_fullsized":"2024-09-13T05:11:24.632090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:37.976147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001460444,"stat_sum":{"num_bytes":51938959,"num_objects":69,"num_object_clones":7,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":38,"num_read":1249,"num_read_kb":10754,"num_write":208,"num_write_kb":3289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":93,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.628551+0000","last_change":"2024-09-13T05:10:37.866953+0000","last_active":"2024-09-13T05:11:24.628551+0000","last_peered":"2024-09-13T05:11:24.628551+0000","last_clean":"2024-09-13T05:11:24.628551+0000","last_became_active":"2024-09-13T05:10:37.866624+0000","last_became_peered":"2024-09-13T05:10:37.866624+0000","last_unstale":"2024-09-13T05:11:24.628551+0000","last_undegraded":"2024-09-13T05:11:24.628551+0000","last_fullsized":"2024-09-13T05:11:24.628551+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:56:20.077971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"87'401","reported_seq":1080,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:25.732108+0000","last_change":"2024-09-13T05:11:23.618355+0000","last_active":"2024-09-13T05:11:25.732108+0000","last_peered":"2024-09-13T05:11:25.732108+0000","last_clean":"2024-09-13T05:11:25.732108+0000","last_became_active":"2024-09-13T05:11:23.616394+0000","last_became_peered":"2024-09-13T05:11:23.616394+0000","last_unstale":"2024-09-13T05:11:25.732108+0000","last_undegraded":"2024-09-13T05:11:25.732108+0000","last_fullsized":"2024-09-13T05:11:25.732108+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:12:03.977067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076234800000000004,"stat_sum":{"num_bytes":14822156,"num_objects":65,"num_object_clones":6,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":32,"num_read":1436,"num_read_kb":2480,"num_write":548,"num_write_kb":3551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":2629215,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.628233+0000","last_change":"2024-09-13T05:10:37.864940+0000","last_active":"2024-09-13T05:11:24.628233+0000","last_peered":"2024-09-13T05:11:24.628233+0000","last_clean":"2024-09-13T05:11:24.628233+0000","last_became_active":"2024-09-13T05:10:37.864623+0000","last_became_peered":"2024-09-13T05:10:37.864623+0000","last_unstale":"2024-09-13T05:11:24.628233+0000","last_undegraded":"2024-09-13T05:11:24.628233+0000","last_fullsized":"2024-09-13T05:11:24.628233+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:41.598490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.5","version":"89'330","reported_seq":2757,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.760457+0000","last_change":"2024-09-13T05:10:11.645960+0000","last_active":"2024-09-13T05:11:26.760457+0000","last_peered":"2024-09-13T05:11:26.760457+0000","last_clean":"2024-09-13T05:11:26.760457+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:11:26.760457+0000","last_undegraded":"2024-09-13T05:11:26.760457+0000","last_fullsized":"2024-09-13T05:11:26.760457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:40.372741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001054028,"stat_sum":{"num_bytes":83072727,"num_objects":75,"num_object_clones":10,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":27,"num_read":3783,"num_read_kb":55367,"num_write":310,"num_write_kb":38179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"89'448","reported_seq":2359,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.496232+0000","last_change":"2024-09-13T05:10:37.979816+0000","last_active":"2024-09-13T05:11:26.496232+0000","last_peered":"2024-09-13T05:11:26.496232+0000","last_clean":"2024-09-13T05:11:26.496232+0000","last_became_active":"2024-09-13T05:10:37.863256+0000","last_became_peered":"2024-09-13T05:10:37.863256+0000","last_unstale":"2024-09-13T05:11:26.496232+0000","last_undegraded":"2024-09-13T05:11:26.496232+0000","last_fullsized":"2024-09-13T05:11:26.496232+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:58:55.928356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099335200000000008,"stat_sum":{"num_bytes":57746614,"num_objects":65,"num_object_clones":9,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":34,"num_read":3165,"num_read_kb":22317,"num_write":551,"num_write_kb":26105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":214109,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":99,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.622403+0000","last_change":"2024-09-13T05:10:31.836193+0000","last_active":"2024-09-13T05:11:24.622403+0000","last_peered":"2024-09-13T05:11:24.622403+0000","last_clean":"2024-09-13T05:11:24.622403+0000","last_became_active":"2024-09-13T05:10:31.825663+0000","last_became_peered":"2024-09-13T05:10:31.825663+0000","last_unstale":"2024-09-13T05:11:24.622403+0000","last_undegraded":"2024-09-13T05:11:24.622403+0000","last_fullsized":"2024-09-13T05:11:24.622403+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:38:23.311570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"89'367","reported_seq":727,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.777407+0000","last_change":"2024-09-13T05:10:31.893494+0000","last_active":"2024-09-13T05:11:26.777407+0000","last_peered":"2024-09-13T05:11:26.777407+0000","last_clean":"2024-09-13T05:11:26.777407+0000","last_became_active":"2024-09-13T05:10:31.827657+0000","last_became_peered":"2024-09-13T05:10:31.827657+0000","last_unstale":"2024-09-13T05:11:26.777407+0000","last_undegraded":"2024-09-13T05:11:26.777407+0000","last_fullsized":"2024-09-13T05:11:26.777407+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:16:14.432049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045163499999999998,"stat_sum":{"num_bytes":13829861,"num_objects":70,"num_object_clones":12,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":33,"num_read":1008,"num_read_kb":2384,"num_write":395,"num_write_kb":3683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":84179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.624643+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:11:24.624643+0000","last_peered":"2024-09-13T05:11:24.624643+0000","last_clean":"2024-09-13T05:11:24.624643+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:11:24.624643+0000","last_undegraded":"2024-09-13T05:11:24.624643+0000","last_fullsized":"2024-09-13T05:11:24.624643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"87'207","reported_seq":732,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:25.737801+0000","last_change":"2024-09-13T05:10:38.111510+0000","last_active":"2024-09-13T05:11:25.737801+0000","last_peered":"2024-09-13T05:11:25.737801+0000","last_clean":"2024-09-13T05:11:25.737801+0000","last_became_active":"2024-09-13T05:10:37.869040+0000","last_became_peered":"2024-09-13T05:10:37.869040+0000","last_unstale":"2024-09-13T05:11:25.737801+0000","last_undegraded":"2024-09-13T05:11:25.737801+0000","last_fullsized":"2024-09-13T05:11:25.737801+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:48:18.385423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048152600000000002,"stat_sum":{"num_bytes":16774958,"num_objects":57,"num_object_clones":10,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":29,"num_read":482,"num_read_kb":10578,"num_write":188,"num_write_kb":8664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":383717,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":101,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.627920+0000","last_change":"2024-09-13T05:10:37.865514+0000","last_active":"2024-09-13T05:11:24.627920+0000","last_peered":"2024-09-13T05:11:24.627920+0000","last_clean":"2024-09-13T05:11:24.627920+0000","last_became_active":"2024-09-13T05:10:37.864299+0000","last_became_peered":"2024-09-13T05:10:37.864299+0000","last_unstale":"2024-09-13T05:11:24.627920+0000","last_undegraded":"2024-09-13T05:11:24.627920+0000","last_fullsized":"2024-09-13T05:11:24.627920+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:45:58.276509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"89'339","reported_seq":1822,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.789551+0000","last_change":"2024-09-13T05:11:23.619138+0000","last_active":"2024-09-13T05:11:26.789551+0000","last_peered":"2024-09-13T05:11:26.789551+0000","last_clean":"2024-09-13T05:11:26.789551+0000","last_became_active":"2024-09-13T05:11:23.617149+0000","last_became_peered":"2024-09-13T05:11:23.617149+0000","last_unstale":"2024-09-13T05:11:26.789551+0000","last_undegraded":"2024-09-13T05:11:26.789551+0000","last_fullsized":"2024-09-13T05:11:26.789551+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:55:46.203366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059320200000000003,"stat_sum":{"num_bytes":24461676,"num_objects":65,"num_object_clones":6,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":30,"num_read":2867,"num_read_kb":4727,"num_write":285,"num_write_kb":4635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":2822984,"num_keys_recovered":34,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":86,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.622607+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:11:24.622607+0000","last_peered":"2024-09-13T05:11:24.622607+0000","last_clean":"2024-09-13T05:11:24.622607+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:11:24.622607+0000","last_undegraded":"2024-09-13T05:11:24.622607+0000","last_fullsized":"2024-09-13T05:11:24.622607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":254,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.627940+0000","last_change":"2024-09-13T05:10:40.886011+0000","last_active":"2024-09-13T05:11:24.627940+0000","last_peered":"2024-09-13T05:11:24.627940+0000","last_clean":"2024-09-13T05:11:24.627940+0000","last_became_active":"2024-09-13T05:10:40.885587+0000","last_became_peered":"2024-09-13T05:10:40.885587+0000","last_unstale":"2024-09-13T05:11:24.627940+0000","last_undegraded":"2024-09-13T05:11:24.627940+0000","last_fullsized":"2024-09-13T05:11:24.627940+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:52:47.632734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"89'235","reported_seq":521,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.554743+0000","last_change":"2024-09-13T05:10:31.888827+0000","last_active":"2024-09-13T05:11:26.554743+0000","last_peered":"2024-09-13T05:11:26.554743+0000","last_clean":"2024-09-13T05:11:26.554743+0000","last_became_active":"2024-09-13T05:10:31.827016+0000","last_became_peered":"2024-09-13T05:10:31.827016+0000","last_unstale":"2024-09-13T05:11:26.554743+0000","last_undegraded":"2024-09-13T05:11:26.554743+0000","last_fullsized":"2024-09-13T05:11:26.554743+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:47.525525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000500144,"stat_sum":{"num_bytes":8108737,"num_objects":72,"num_object_clones":9,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":38,"num_read":267,"num_read_kb":3264,"num_write":190,"num_write_kb":25883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":58925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"87'249","reported_seq":5943,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:25.730515+0000","last_change":"2024-09-13T05:10:11.648218+0000","last_active":"2024-09-13T05:11:25.730515+0000","last_peered":"2024-09-13T05:11:25.730515+0000","last_clean":"2024-09-13T05:11:25.730515+0000","last_became_active":"2024-09-13T05:10:09.645408+0000","last_became_peered":"2024-09-13T05:10:09.645408+0000","last_unstale":"2024-09-13T05:11:25.730515+0000","last_undegraded":"2024-09-13T05:11:25.730515+0000","last_fullsized":"2024-09-13T05:11:25.730515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:59.846981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097828900000000002,"stat_sum":{"num_bytes":28865123,"num_objects":58,"num_object_clones":7,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":25,"num_read":6933,"num_read_kb":20348,"num_write":203,"num_write_kb":5400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"87'386","reported_seq":8630,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:25.738756+0000","last_change":"2024-09-13T05:10:47.940550+0000","last_active":"2024-09-13T05:11:25.738756+0000","last_peered":"2024-09-13T05:11:25.738756+0000","last_clean":"2024-09-13T05:11:25.738756+0000","last_became_active":"2024-09-13T05:10:47.939220+0000","last_became_peered":"2024-09-13T05:10:47.939220+0000","last_unstale":"2024-09-13T05:11:25.738756+0000","last_undegraded":"2024-09-13T05:11:25.738756+0000","last_fullsized":"2024-09-13T05:11:25.738756+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:59.693041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013204619999999999,"stat_sum":{"num_bytes":8329791,"num_objects":66,"num_object_clones":10,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":34,"num_read":8768,"num_read_kb":14369,"num_write":434,"num_write_kb":8000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":59,"num_bytes_recovered":6203954,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"89'268","reported_seq":2057,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.794145+0000","last_change":"2024-09-13T05:10:38.007507+0000","last_active":"2024-09-13T05:11:26.794145+0000","last_peered":"2024-09-13T05:11:26.794145+0000","last_clean":"2024-09-13T05:11:26.794145+0000","last_became_active":"2024-09-13T05:10:37.868643+0000","last_became_peered":"2024-09-13T05:10:37.868643+0000","last_unstale":"2024-09-13T05:11:26.794145+0000","last_undegraded":"2024-09-13T05:11:26.794145+0000","last_fullsized":"2024-09-13T05:11:26.794145+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:29:05.387242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055343700000000005,"stat_sum":{"num_bytes":6059553,"num_objects":65,"num_object_clones":11,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":36,"num_read":2160,"num_read_kb":6670,"num_write":222,"num_write_kb":6553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":15854,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"87'160","reported_seq":540,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:25.732927+0000","last_change":"2024-09-13T05:10:11.647302+0000","last_active":"2024-09-13T05:11:25.732927+0000","last_peered":"2024-09-13T05:11:25.732927+0000","last_clean":"2024-09-13T05:11:25.732927+0000","last_became_active":"2024-09-13T05:10:09.647037+0000","last_became_peered":"2024-09-13T05:10:09.647037+0000","last_unstale":"2024-09-13T05:11:25.732927+0000","last_undegraded":"2024-09-13T05:11:25.732927+0000","last_fullsized":"2024-09-13T05:11:25.732927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:54:17.061326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069994199999999995,"stat_sum":{"num_bytes":25886754,"num_objects":59,"num_object_clones":9,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":28,"num_read":383,"num_read_kb":4719,"num_write":138,"num_write_kb":3497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"85'546","reported_seq":3961,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.628455+0000","last_change":"2024-09-13T05:11:23.617596+0000","last_active":"2024-09-13T05:11:24.628455+0000","last_peered":"2024-09-13T05:11:24.628455+0000","last_clean":"2024-09-13T05:11:24.628455+0000","last_became_active":"2024-09-13T05:11:23.616962+0000","last_became_peered":"2024-09-13T05:11:23.616962+0000","last_unstale":"2024-09-13T05:11:24.628455+0000","last_undegraded":"2024-09-13T05:11:24.628455+0000","last_fullsized":"2024-09-13T05:11:24.628455+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:19.035337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019283150000000001,"stat_sum":{"num_bytes":68127174,"num_objects":71,"num_object_clones":8,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":31,"num_read":4875,"num_read_kb":14530,"num_write":695,"num_write_kb":8080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":12781016,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"89'735","reported_seq":5358,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.496496+0000","last_change":"2024-09-13T05:11:25.646827+0000","last_active":"2024-09-13T05:11:26.496496+0000","last_peered":"2024-09-13T05:11:26.496496+0000","last_clean":"2024-09-13T05:11:26.496496+0000","last_became_active":"2024-09-13T05:11:25.644857+0000","last_became_peered":"2024-09-13T05:11:25.644857+0000","last_unstale":"2024-09-13T05:11:26.496496+0000","last_undegraded":"2024-09-13T05:11:26.496496+0000","last_fullsized":"2024-09-13T05:11:26.496496+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:39.872264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018982339999999999,"stat_sum":{"num_bytes":21050383,"num_objects":63,"num_object_clones":5,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":33,"num_read":6254,"num_read_kb":6904,"num_write":1100,"num_write_kb":5201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":8639919,"num_keys_recovered":36,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"87'577","reported_seq":1759,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:25.733033+0000","last_change":"2024-09-13T05:10:40.885332+0000","last_active":"2024-09-13T05:11:25.733033+0000","last_peered":"2024-09-13T05:11:25.733033+0000","last_clean":"2024-09-13T05:11:25.733033+0000","last_became_active":"2024-09-13T05:10:40.884585+0000","last_became_peered":"2024-09-13T05:10:40.884585+0000","last_unstale":"2024-09-13T05:11:25.733033+0000","last_undegraded":"2024-09-13T05:11:25.733033+0000","last_fullsized":"2024-09-13T05:11:25.733033+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:31:19.596080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001164273,"stat_sum":{"num_bytes":18538959,"num_objects":65,"num_object_clones":9,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":34,"num_read":3439,"num_read_kb":11077,"num_write":818,"num_write_kb":6513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":296075,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"87'309","reported_seq":1880,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.633636+0000","last_change":"2024-09-13T05:11:23.617697+0000","last_active":"2024-09-13T05:11:24.633636+0000","last_peered":"2024-09-13T05:11:24.633636+0000","last_clean":"2024-09-13T05:11:24.633636+0000","last_became_active":"2024-09-13T05:11:23.617017+0000","last_became_peered":"2024-09-13T05:11:23.617017+0000","last_unstale":"2024-09-13T05:11:24.633636+0000","last_undegraded":"2024-09-13T05:11:24.633636+0000","last_fullsized":"2024-09-13T05:11:24.633636+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:26:44.551305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009951719999999999,"stat_sum":{"num_bytes":34835027,"num_objects":74,"num_object_clones":5,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":32,"num_read":1889,"num_read_kb":14082,"num_write":318,"num_write_kb":7118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":11923520,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"82'208","reported_seq":640,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.628021+0000","last_change":"2024-09-13T05:10:11.680757+0000","last_active":"2024-09-13T05:11:24.628021+0000","last_peered":"2024-09-13T05:11:24.628021+0000","last_clean":"2024-09-13T05:11:24.628021+0000","last_became_active":"2024-09-13T05:10:09.653444+0000","last_became_peered":"2024-09-13T05:10:09.653444+0000","last_unstale":"2024-09-13T05:11:24.628021+0000","last_undegraded":"2024-09-13T05:11:24.628021+0000","last_fullsized":"2024-09-13T05:11:24.628021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:17:06.303008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000625977,"stat_sum":{"num_bytes":11696067,"num_objects":69,"num_object_clones":9,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":37,"num_read":452,"num_read_kb":11506,"num_write":170,"num_write_kb":4690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"87'658","reported_seq":2298,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:25.733853+0000","last_change":"2024-09-13T05:10:40.884306+0000","last_active":"2024-09-13T05:11:25.733853+0000","last_peered":"2024-09-13T05:11:25.733853+0000","last_clean":"2024-09-13T05:11:25.733853+0000","last_became_active":"2024-09-13T05:10:40.883543+0000","last_became_peered":"2024-09-13T05:10:40.883543+0000","last_unstale":"2024-09-13T05:11:25.733853+0000","last_undegraded":"2024-09-13T05:11:25.733853+0000","last_fullsized":"2024-09-13T05:11:25.733853+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:14:23.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048307200000000003,"stat_sum":{"num_bytes":60338401,"num_objects":65,"num_object_clones":11,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":28,"num_read":4577,"num_read_kb":20718,"num_write":922,"num_write_kb":6694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":633324,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"89'738","reported_seq":2380,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.766471+0000","last_change":"2024-09-13T05:10:11.680877+0000","last_active":"2024-09-13T05:11:26.766471+0000","last_peered":"2024-09-13T05:11:26.766471+0000","last_clean":"2024-09-13T05:11:26.766471+0000","last_became_active":"2024-09-13T05:10:09.649053+0000","last_became_peered":"2024-09-13T05:10:09.649053+0000","last_unstale":"2024-09-13T05:11:26.766471+0000","last_undegraded":"2024-09-13T05:11:26.766471+0000","last_fullsized":"2024-09-13T05:11:26.766471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:14.770260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062821800000000005,"stat_sum":{"num_bytes":45220932,"num_objects":82,"num_object_clones":14,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":39,"num_read":4460,"num_read_kb":50978,"num_write":1066,"num_write_kb":38617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":940810033,"num_objects":2140,"num_object_clones":298,"num_object_copies":4280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2140,"num_whiteouts":1016,"num_read":94115,"num_read_kb":449774,"num_write":13269,"num_write_kb":288131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1978,"num_bytes_recovered":69274998,"num_keys_recovered":233,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":302874624,"data_stored":345644465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11653,"ondisk_log_size":11653,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128544,"kb_used_data":75288,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94243296,"statfs":{"total":96636764160,"available":96505135104,"internally_reserved":0,"allocated":77094912,"data_stored":85877130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":54524363},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":1.073},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.67600000000000005}]},{"osd":1,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.012}]},{"osd":2,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.878},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.1910000000000001}]},{"osd":3,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.252}]},{"osd":4,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.91700000000000004}]},{"osd":5,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.113},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.0469999999999999}]},{"osd":6,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.1619999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75224,"kb_used_data":31816,"kb_used_omap":1,"kb_used_meta":43390,"kb_avail":94296616,"statfs":{"total":96636764160,"available":96559734784,"internally_reserved":0,"allocated":32579584,"data_stored":36070496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44431815},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.075},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.3069999999999999}]},{"osd":1,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.85899999999999999}]},{"osd":2,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.1759999999999999}]},{"osd":3,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.98199999999999998}]},{"osd":4,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.258},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.04}]},{"osd":5,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1.333},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.357}]},{"osd":7,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.2809999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123376,"kb_used_data":70116,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94248464,"statfs":{"total":96636764160,"available":96510427136,"internally_reserved":0,"allocated":71798784,"data_stored":78219638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.745},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.83699999999999997}]},{"osd":2,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.878},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.85799999999999998}]},{"osd":3,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.67700000000000005}]},{"osd":4,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.80700000000000005}]},{"osd":6,"last update":"Fri Sep 13 05:10:58 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.63600000000000001}]},{"osd":7,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.90000000000000002}]}]},{"osd":4,"up_from":0,"seq":55834574872,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100148,"kb_used_data":69028,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94271692,"statfs":{"total":96636764160,"available":96534212608,"internally_reserved":0,"allocated":70684672,"data_stored":81271751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.93400000000000005}]},{"osd":1,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.73099999999999998}]},{"osd":2,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.78800000000000003}]},{"osd":4,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.874},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.236}]},{"osd":5,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.76300000000000001}]},{"osd":6,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.302},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.91500000000000004}]},{"osd":7,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.002},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.0669999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83776,"kb_used_data":42884,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94288064,"statfs":{"total":96636764160,"available":96550977536,"internally_reserved":0,"allocated":43913216,"data_stored":48995877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.94999999999999996}]},{"osd":1,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.73899999999999999}]},{"osd":3,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":1.169}]},{"osd":4,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":1.046},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.232}]},{"osd":5,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.278},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.256}]},{"osd":6,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.2030000000000001},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.353}]},{"osd":7,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.125},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.083}]}]},{"osd":1,"up_from":0,"seq":55834574870,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":0,"seq":55834574872,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10035200,"data_stored":11939429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6619136,"data_stored":10238144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42823680,"data_stored":48479819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69767168,"data_stored":80912116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69988352,"data_stored":76990845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28270592,"data_stored":32349608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":75370496,"data_stored":84734504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:11:28.008 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:27.997+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:28.103 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:28.097+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:28.121 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:28.122 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:28.122 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:28.122 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:28.131 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:11:28.147 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #27, image image_client.0-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent28 2024-09-13T05:11:28.204 INFO:teuthology.orchestra.run.smithi120.stdout:3738 read 0x2ee63d5 thru 0x2eecd2a (0x6956 bytes) 2024-09-13T05:11:28.204 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:28.197+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:28.212 INFO:teuthology.orchestra.run.smithi120.stdout:3740 read 0x8e33c52 thru 0x8e3da17 (0x9dc6 bytes) 2024-09-13T05:11:28.215 INFO:teuthology.orchestra.run.smithi120.stdout:3741 read 0x74ecc78 thru 0x74f6712 (0x9a9b bytes) 2024-09-13T05:11:28.215 INFO:teuthology.orchestra.run.smithi120.stdout:3742 read 0x22f6e55 thru 0x2300b83 (0x9d2f bytes) 2024-09-13T05:11:28.224 INFO:teuthology.orchestra.run.smithi120.stdout:3744 trunc from 0xafa6d7c to 0x738cf9c 2024-09-13T05:11:28.244 INFO:teuthology.orchestra.run.smithi120.stdout:3745 read 0xb31fe3 thru 0xb34613 (0x2631 bytes) 2024-09-13T05:11:28.245 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:28.245 INFO:teuthology.orchestra.run.smithi120.stdout:3747 punch from 0x5e676f to 0x5ee1e5, (0x7a76 bytes) 2024-09-13T05:11:28.251 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:28.251 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:28.251 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:28.251 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:28.252 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:28.254 INFO:teuthology.orchestra.run.smithi120.stdout:3748 trunc from 0x738cf9c to 0xced4d5e 2024-09-13T05:11:28.262 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:11:28.265 INFO:teuthology.orchestra.run.smithi120.stdout:3749 write 0xba4a7cd thru 0xba4b1d5 (0xa09 bytes) 2024-09-13T05:11:28.269 INFO:teuthology.orchestra.run.smithi120.stdout:3750 punch from 0x8b0686c to 0x8b1344e, (0xcbe2 bytes) 2024-09-13T05:11:28.269 INFO:teuthology.orchestra.run.smithi120.stdout:3751 punch from 0xc71102e to 0xc713171, (0x2143 bytes) 2024-09-13T05:11:28.269 INFO:teuthology.orchestra.run.smithi120.stdout:3752 punch from 0xb592582 to 0xb596a30, (0x44ae bytes) 2024-09-13T05:11:28.269 INFO:teuthology.orchestra.run.smithi120.stdout:3753 writesame 0x352c89 thru 0x356db9 data_size 0x1(0x4131 bytes) 2024-09-13T05:11:28.300 INFO:teuthology.orchestra.run.smithi120.stdout:3755 write 0xc051b8d thru 0xc05f85b (0xdccf bytes) 2024-09-13T05:11:28.305 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:28.301+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:28.308 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:28.308 INFO:teuthology.orchestra.run.smithi120.stdout:3758 read 0xc92302c thru 0xc92540b (0x23e0 bytes) 2024-09-13T05:11:28.320 INFO:teuthology.orchestra.run.smithi120.stdout:3760 write 0xd59417d thru 0xd59d81f (0x96a3 bytes) 2024-09-13T05:11:28.327 INFO:teuthology.orchestra.run.smithi120.stdout:3761 punch from 0x8908984 to 0x8912732, (0x9dae bytes) 2024-09-13T05:11:28.327 INFO:teuthology.orchestra.run.smithi120.stdout:3762 writesame 0x904d9cc thru 0x90529c3 data_size 0xc(0x4ff8 bytes) 2024-09-13T05:11:28.332 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:28.332 INFO:teuthology.orchestra.run.smithi120.stdout:3764 write 0x49a3aa3 thru 0x49a910a (0x5668 bytes) 2024-09-13T05:11:28.336 INFO:teuthology.orchestra.run.smithi120.stdout:3765 punch from 0x7a8f6ec to 0x7a9202d, (0x2941 bytes) 2024-09-13T05:11:28.337 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:28.337 INFO:teuthology.orchestra.run.smithi120.stdout:3767 read 0x950257 thru 0x9514f5 (0x129f bytes) 2024-09-13T05:11:28.337 INFO:teuthology.orchestra.run.smithi120.stdout:3769 punch from 0x5de2f4a to 0x5de4970, (0x1a26 bytes) 2024-09-13T05:11:28.337 INFO:teuthology.orchestra.run.smithi120.stdout:3770 read 0x827dbfd thru 0x828c557 (0xe95b bytes) 2024-09-13T05:11:28.338 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:28.338 INFO:teuthology.orchestra.run.smithi120.stdout:3773 read 0x2212812 thru 0x221f302 (0xcaf1 bytes) 2024-09-13T05:11:28.338 INFO:teuthology.orchestra.run.smithi120.stdout:3774 writesame 0x932c140 thru 0x93324e5 data_size 0x5(0x63a6 bytes) 2024-09-13T05:11:28.345 INFO:teuthology.orchestra.run.smithi120.stdout:3775 read 0x3d6f86 thru 0x3e5ec8 (0xef43 bytes) 2024-09-13T05:11:28.346 INFO:teuthology.orchestra.run.smithi120.stdout:3776 read 0xa0e3b1f thru 0xa0ed187 (0x9669 bytes) 2024-09-13T05:11:28.347 INFO:teuthology.orchestra.run.smithi120.stdout:3777 clone 30 order 20 su 131072 sc 8 2024-09-13T05:11:28.366 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:28.366 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:28.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:28.366 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:28.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.366 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10634 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 731136~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:28.367 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:28.367 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.962391017999998, 2024-09-13T05:11:28.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028136992999999999, 2024-09-13T05:11:28.367 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.367 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.367 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.367 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.368 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.368 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10634 2024-09-13T05:11:28.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.368 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:28.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:28.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:28.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401987+0000", 2024-09-13T05:11:28.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5090000000000001e-06 2024-09-13T05:11:28.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401997+0000", 2024-09-13T05:11:28.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8009999999999998e-06 2024-09-13T05:11:28.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402000+0000", 2024-09-13T05:11:28.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.756e-06 2024-09-13T05:11:28.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430035+0000", 2024-09-13T05:11:28.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028034967000000001 2024-09-13T05:11:28.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430081+0000", 2024-09-13T05:11:28.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6448e-05 2024-09-13T05:11:28.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430123+0000", 2024-09-13T05:11:28.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1758000000000002e-05 2024-09-13T05:11:28.371 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.371 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.372 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.372 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10635 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 740352~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:28.372 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:11:28.372 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.962374404000002, 2024-09-13T05:11:28.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028229890000000001, 2024-09-13T05:11:28.372 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.372 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.372 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.372 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.372 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.372 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10635 2024-09-13T05:11:28.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.373 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:11:28.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:11:28.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402002+0000", 2024-09-13T05:11:28.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402004+0000", 2024-09-13T05:11:28.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.575e-06 2024-09-13T05:11:28.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402007+0000", 2024-09-13T05:11:28.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1240000000000001e-06 2024-09-13T05:11:28.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402010+0000", 2024-09-13T05:11:28.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5859999999999999e-06 2024-09-13T05:11:28.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430146+0000", 2024-09-13T05:11:28.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028136746000000001 2024-09-13T05:11:28.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430195+0000", 2024-09-13T05:11:28.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8948e-05 2024-09-13T05:11:28.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430232+0000", 2024-09-13T05:11:28.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7159000000000001e-05 2024-09-13T05:11:28.376 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.376 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.376 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.376 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10636 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 749568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:28.376 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:11:28.376 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.962365298000002, 2024-09-13T05:11:28.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328440999999999, 2024-09-13T05:11:28.376 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.376 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.376 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.377 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10636 2024-09-13T05:11:28.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.377 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:11:28.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:11:28.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402011+0000", 2024-09-13T05:11:28.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:28.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402017+0000", 2024-09-13T05:11:28.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5620000000000003e-06 2024-09-13T05:11:28.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402020+0000", 2024-09-13T05:11:28.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1410000000000001e-06 2024-09-13T05:11:28.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402024+0000", 2024-09-13T05:11:28.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4489999999999999e-06 2024-09-13T05:11:28.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430256+0000", 2024-09-13T05:11:28.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028232363 2024-09-13T05:11:28.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430299+0000", 2024-09-13T05:11:28.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2830999999999997e-05 2024-09-13T05:11:28.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430340+0000", 2024-09-13T05:11:28.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1301000000000003e-05 2024-09-13T05:11:28.380 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.380 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.380 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.380 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10637 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 758784~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:28.380 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:28.380 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.962350184999998, 2024-09-13T05:11:28.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028441793, 2024-09-13T05:11:28.381 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.381 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.381 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.381 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.381 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.381 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10637 2024-09-13T05:11:28.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.381 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:28.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:28.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:28.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:28.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402031+0000", 2024-09-13T05:11:28.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6770000000000003e-06 2024-09-13T05:11:28.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402034+0000", 2024-09-13T05:11:28.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1540000000000002e-06 2024-09-13T05:11:28.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402038+0000", 2024-09-13T05:11:28.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4970000000000001e-06 2024-09-13T05:11:28.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430367+0000", 2024-09-13T05:11:28.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328906000000001 2024-09-13T05:11:28.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430416+0000", 2024-09-13T05:11:28.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:11:28.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430469+0000", 2024-09-13T05:11:28.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2284999999999998e-05 2024-09-13T05:11:28.384 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.384 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.384 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.385 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10638 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 768000~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:28.385 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:28.385 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.962336700999998, 2024-09-13T05:11:28.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028548740999999999, 2024-09-13T05:11:28.385 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.385 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.385 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.385 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.385 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.385 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10638 2024-09-13T05:11:28.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.385 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:28.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:28.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:28.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402041+0000", 2024-09-13T05:11:28.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4789999999999999e-06 2024-09-13T05:11:28.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402044+0000", 2024-09-13T05:11:28.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.694e-06 2024-09-13T05:11:28.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402047+0000", 2024-09-13T05:11:28.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.537e-06 2024-09-13T05:11:28.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430494+0000", 2024-09-13T05:11:28.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028447665 2024-09-13T05:11:28.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430544+0000", 2024-09-13T05:11:28.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9539000000000001e-05 2024-09-13T05:11:28.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430589+0000", 2024-09-13T05:11:28.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5071999999999998e-05 2024-09-13T05:11:28.389 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.389 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.389 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.389 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10639 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 777216~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:28.389 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:11:28.389 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.962326320000003, 2024-09-13T05:11:28.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028651769000000001, 2024-09-13T05:11:28.389 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.389 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.389 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.390 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.390 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.390 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10639 2024-09-13T05:11:28.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.390 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:11:28.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:11:28.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402050+0000", 2024-09-13T05:11:28.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402052+0000", 2024-09-13T05:11:28.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2249999999999999e-06 2024-09-13T05:11:28.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402054+0000", 2024-09-13T05:11:28.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8140000000000001e-06 2024-09-13T05:11:28.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402057+0000", 2024-09-13T05:11:28.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4889999999999998e-06 2024-09-13T05:11:28.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430607+0000", 2024-09-13T05:11:28.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028549896000000002 2024-09-13T05:11:28.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430651+0000", 2024-09-13T05:11:28.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4622000000000001e-05 2024-09-13T05:11:28.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430702+0000", 2024-09-13T05:11:28.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0980999999999999e-05 2024-09-13T05:11:28.393 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.393 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.393 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.393 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11151 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 779264~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:28.393 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:28.394 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.932555039, 2024-09-13T05:11:28.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028283188000000001, 2024-09-13T05:11:28.394 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.394 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.394 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.394 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.394 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.394 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11151 2024-09-13T05:11:28.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.394 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:28.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:28.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:28.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431827+0000", 2024-09-13T05:11:28.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0989999999999998e-06 2024-09-13T05:11:28.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431832+0000", 2024-09-13T05:11:28.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8829999999999997e-06 2024-09-13T05:11:28.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431835+0000", 2024-09-13T05:11:28.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.439e-06 2024-09-13T05:11:28.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.459955+0000", 2024-09-13T05:11:28.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028119858000000001 2024-09-13T05:11:28.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.460029+0000", 2024-09-13T05:11:28.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4264000000000006e-05 2024-09-13T05:11:28.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.460105+0000", 2024-09-13T05:11:28.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5906000000000001e-05 2024-09-13T05:11:28.398 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.398 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.398 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.398 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11897 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 579584~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:28.398 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:28.398 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.883405865, 2024-09-13T05:11:28.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028193354, 2024-09-13T05:11:28.398 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.398 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.398 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.398 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.398 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.398 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11897 2024-09-13T05:11:28.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.399 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:28.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:28.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:28.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480973+0000", 2024-09-13T05:11:28.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.934e-06 2024-09-13T05:11:28.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480976+0000", 2024-09-13T05:11:28.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.614e-06 2024-09-13T05:11:28.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480980+0000", 2024-09-13T05:11:28.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.377e-06 2024-09-13T05:11:28.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.508967+0000", 2024-09-13T05:11:28.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027987455000000001 2024-09-13T05:11:28.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509074+0000", 2024-09-13T05:11:28.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107379 2024-09-13T05:11:28.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509164+0000", 2024-09-13T05:11:28.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9979e-05 2024-09-13T05:11:28.402 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.402 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.402 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.402 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11898 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 588800~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:28.402 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:28.402 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.883393800999997, 2024-09-13T05:11:28.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028308628999999998, 2024-09-13T05:11:28.403 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.403 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.403 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11898 2024-09-13T05:11:28.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.403 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:28.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:28.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:28.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480984+0000", 2024-09-13T05:11:28.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:11:28.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480988+0000", 2024-09-13T05:11:28.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4640000000000002e-06 2024-09-13T05:11:28.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480991+0000", 2024-09-13T05:11:28.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3469999999999999e-06 2024-09-13T05:11:28.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509199+0000", 2024-09-13T05:11:28.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028207449999999998 2024-09-13T05:11:28.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509250+0000", 2024-09-13T05:11:28.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1375000000000002e-05 2024-09-13T05:11:28.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509292+0000", 2024-09-13T05:11:28.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1730000000000002e-05 2024-09-13T05:11:28.407 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.407 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.407 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.407 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11899 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 598016~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:28.407 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:28.407 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.883382959999999, 2024-09-13T05:11:28.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516703000000001, 2024-09-13T05:11:28.407 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.407 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.408 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.408 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.408 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11899 2024-09-13T05:11:28.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.408 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:28.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:28.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:28.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480995+0000", 2024-09-13T05:11:28.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7349999999999999e-06 2024-09-13T05:11:28.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481000+0000", 2024-09-13T05:11:28.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0289999999999996e-06 2024-09-13T05:11:28.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481004+0000", 2024-09-13T05:11:28.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3699999999999999e-06 2024-09-13T05:11:28.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509332+0000", 2024-09-13T05:11:28.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328320000000001 2024-09-13T05:11:28.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509428+0000", 2024-09-13T05:11:28.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6150999999999995e-05 2024-09-13T05:11:28.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509511+0000", 2024-09-13T05:11:28.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2396000000000002e-05 2024-09-13T05:11:28.411 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.411 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.411 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.412 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11900 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 607232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:28.412 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:11:28.412 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.883370370999998, 2024-09-13T05:11:28.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028621273999999999, 2024-09-13T05:11:28.412 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.412 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.412 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.412 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.412 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.412 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11900 2024-09-13T05:11:28.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.412 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:11:28.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:11:28.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481006+0000", 2024-09-13T05:11:28.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481008+0000", 2024-09-13T05:11:28.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.73e-06 2024-09-13T05:11:28.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481011+0000", 2024-09-13T05:11:28.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4000000000000001e-06 2024-09-13T05:11:28.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481015+0000", 2024-09-13T05:11:28.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2760000000000001e-06 2024-09-13T05:11:28.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509531+0000", 2024-09-13T05:11:28.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516102000000002 2024-09-13T05:11:28.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509588+0000", 2024-09-13T05:11:28.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7423999999999998e-05 2024-09-13T05:11:28.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509628+0000", 2024-09-13T05:11:28.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9644000000000002e-05 2024-09-13T05:11:28.416 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.416 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.416 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.416 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11901 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 616448~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:28.416 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:28.416 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.883359749999997, 2024-09-13T05:11:28.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028820500999999998, 2024-09-13T05:11:28.417 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.417 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.417 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.417 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.417 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.417 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11901 2024-09-13T05:11:28.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.417 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:28.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:28.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:28.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481022+0000", 2024-09-13T05:11:28.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0209999999999999e-06 2024-09-13T05:11:28.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481026+0000", 2024-09-13T05:11:28.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:11:28.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481029+0000", 2024-09-13T05:11:28.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.636e-06 2024-09-13T05:11:28.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509661+0000", 2024-09-13T05:11:28.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028631496999999999 2024-09-13T05:11:28.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509757+0000", 2024-09-13T05:11:28.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5780999999999997e-05 2024-09-13T05:11:28.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509838+0000", 2024-09-13T05:11:28.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1102999999999999e-05 2024-09-13T05:11:28.420 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.420 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.420 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.421 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11902 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 625664~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:28.421 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:28.421 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.883337888, 2024-09-13T05:11:28.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028894265999999998, 2024-09-13T05:11:28.421 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.421 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.421 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.421 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.421 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.421 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11902 2024-09-13T05:11:28.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.421 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:28.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:28.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:28.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481041+0000", 2024-09-13T05:11:28.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8020000000000001e-06 2024-09-13T05:11:28.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481044+0000", 2024-09-13T05:11:28.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7110000000000001e-06 2024-09-13T05:11:28.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481048+0000", 2024-09-13T05:11:28.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.411e-06 2024-09-13T05:11:28.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509851+0000", 2024-09-13T05:11:28.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028803295 2024-09-13T05:11:28.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509896+0000", 2024-09-13T05:11:28.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4963000000000003e-05 2024-09-13T05:11:28.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509933+0000", 2024-09-13T05:11:28.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7384e-05 2024-09-13T05:11:28.425 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.425 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.425 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.425 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11903 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 634880~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:28.425 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:28.425 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.883326652000001, 2024-09-13T05:11:28.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029118033000000001, 2024-09-13T05:11:28.425 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.425 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.425 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.425 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.426 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.426 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11903 2024-09-13T05:11:28.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.426 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:28.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:28.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:28.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481052+0000", 2024-09-13T05:11:28.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.581e-06 2024-09-13T05:11:28.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481055+0000", 2024-09-13T05:11:28.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4520000000000002e-06 2024-09-13T05:11:28.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481058+0000", 2024-09-13T05:11:28.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4599999999999999e-06 2024-09-13T05:11:28.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509967+0000", 2024-09-13T05:11:28.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028908257999999999 2024-09-13T05:11:28.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510062+0000", 2024-09-13T05:11:28.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5613999999999996e-05 2024-09-13T05:11:28.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510168+0000", 2024-09-13T05:11:28.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105951 2024-09-13T05:11:28.429 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.429 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.429 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.429 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11904 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 644096~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:28.430 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:28.430 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.883315756999998, 2024-09-13T05:11:28.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029301971, 2024-09-13T05:11:28.430 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.430 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.430 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.430 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.430 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.430 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11904 2024-09-13T05:11:28.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.430 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:28.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:28.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:28.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481063+0000", 2024-09-13T05:11:28.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6700000000000001e-06 2024-09-13T05:11:28.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481068+0000", 2024-09-13T05:11:28.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4519999999999996e-06 2024-09-13T05:11:28.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481074+0000", 2024-09-13T05:11:28.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8370000000000002e-06 2024-09-13T05:11:28.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510197+0000", 2024-09-13T05:11:28.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029123237999999999 2024-09-13T05:11:28.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510285+0000", 2024-09-13T05:11:28.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7676000000000006e-05 2024-09-13T05:11:28.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510363+0000", 2024-09-13T05:11:28.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8418999999999996e-05 2024-09-13T05:11:28.434 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.434 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.434 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.434 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11905 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 653312~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:28.434 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:11:28.434 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.883300017000003, 2024-09-13T05:11:28.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029480164, 2024-09-13T05:11:28.434 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.434 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.435 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11905 2024-09-13T05:11:28.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.435 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:11:28.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:11:28.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481076+0000", 2024-09-13T05:11:28.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481079+0000", 2024-09-13T05:11:28.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9629999999999998e-06 2024-09-13T05:11:28.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481087+0000", 2024-09-13T05:11:28.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6369999999999999e-06 2024-09-13T05:11:28.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481093+0000", 2024-09-13T05:11:28.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.857e-06 2024-09-13T05:11:28.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510408+0000", 2024-09-13T05:11:28.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029315213 2024-09-13T05:11:28.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510501+0000", 2024-09-13T05:11:28.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2916000000000003e-05 2024-09-13T05:11:28.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510557+0000", 2024-09-13T05:11:28.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6063999999999997e-05 2024-09-13T05:11:28.438 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.438 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.438 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.438 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11906 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 662528~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:28.438 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:11:28.438 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.883258003999998, 2024-09-13T05:11:28.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029575054999999999, 2024-09-13T05:11:28.439 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.439 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.439 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11906 2024-09-13T05:11:28.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.439 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:11:28.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:11:28.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481118+0000", 2024-09-13T05:11:28.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481122+0000", 2024-09-13T05:11:28.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2610000000000002e-06 2024-09-13T05:11:28.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481129+0000", 2024-09-13T05:11:28.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0079999999999996e-06 2024-09-13T05:11:28.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481135+0000", 2024-09-13T05:11:28.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0599999999999996e-06 2024-09-13T05:11:28.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510575+0000", 2024-09-13T05:11:28.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029440470999999999 2024-09-13T05:11:28.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510635+0000", 2024-09-13T05:11:28.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0177000000000003e-05 2024-09-13T05:11:28.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510694+0000", 2024-09-13T05:11:28.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8675999999999999e-05 2024-09-13T05:11:28.442 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.442 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.443 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.443 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11907 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 671744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:28.443 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:11:28.443 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.882997209000003, 2024-09-13T05:11:28.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029479490000000001, 2024-09-13T05:11:28.443 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.443 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.443 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.443 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.443 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.443 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11907 2024-09-13T05:11:28.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.444 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:11:28.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:11:28.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481140+0000", 2024-09-13T05:11:28.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997597 2024-09-13T05:11:28.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481383+0000", 2024-09-13T05:11:28.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024355399999999999 2024-09-13T05:11:28.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481390+0000", 2024-09-13T05:11:28.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3599999999999998e-06 2024-09-13T05:11:28.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481395+0000", 2024-09-13T05:11:28.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8940000000000001e-06 2024-09-13T05:11:28.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510722+0000", 2024-09-13T05:11:28.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029327143999999999 2024-09-13T05:11:28.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510802+0000", 2024-09-13T05:11:28.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9770000000000004e-05 2024-09-13T05:11:28.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510859+0000", 2024-09-13T05:11:28.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6957999999999999e-05 2024-09-13T05:11:28.447 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.447 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.447 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.447 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11908 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 680960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:28.447 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:11:28.447 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.882977296, 2024-09-13T05:11:28.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029617622, 2024-09-13T05:11:28.447 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.447 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.448 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11908 2024-09-13T05:11:28.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.448 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:11:28.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:11:28.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481399+0000", 2024-09-13T05:11:28.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481401+0000", 2024-09-13T05:11:28.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8729999999999999e-06 2024-09-13T05:11:28.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481413+0000", 2024-09-13T05:11:28.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1748e-05 2024-09-13T05:11:28.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481417+0000", 2024-09-13T05:11:28.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:11:28.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510908+0000", 2024-09-13T05:11:28.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029491129000000001 2024-09-13T05:11:28.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510955+0000", 2024-09-13T05:11:28.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7188000000000003e-05 2024-09-13T05:11:28.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511017+0000", 2024-09-13T05:11:28.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2288999999999999e-05 2024-09-13T05:11:28.451 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.451 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.451 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.451 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11909 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 690176~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:28.452 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:11:28.452 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.882956968999999, 2024-09-13T05:11:28.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029780699000000001, 2024-09-13T05:11:28.452 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.452 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.452 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.452 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.452 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.452 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11909 2024-09-13T05:11:28.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.452 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:11:28.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:11:28.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481419+0000", 2024-09-13T05:11:28.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481421+0000", 2024-09-13T05:11:28.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.035e-06 2024-09-13T05:11:28.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481427+0000", 2024-09-13T05:11:28.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2449999999999998e-06 2024-09-13T05:11:28.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481430+0000", 2024-09-13T05:11:28.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.366e-06 2024-09-13T05:11:28.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511064+0000", 2024-09-13T05:11:28.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029633711 2024-09-13T05:11:28.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511160+0000", 2024-09-13T05:11:28.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6399999999999999e-05 2024-09-13T05:11:28.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511201+0000", 2024-09-13T05:11:28.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0448000000000003e-05 2024-09-13T05:11:28.455 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.455 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.456 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.456 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:28.457 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:11:28.458 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:28.453+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:28.558 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:28.552+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:28.571 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:28.571 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:28.572 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:28.572 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:28.581 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:11:28.659 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:28.653+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:28.738 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:28.738 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:28.738 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:28.738 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:28.738 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:28.749 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:11:28.760 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:28.752+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:28.861 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:28.856+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:28.867 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:28.867 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:28.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:28.867 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:28.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26335 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1207296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.133469865999999, 2024-09-13T05:11:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055338125000000002, 2024-09-13T05:11:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26335 2024-09-13T05:11:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730550+0000", 2024-09-13T05:11:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998579 2024-09-13T05:11:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730705+0000", 2024-09-13T05:11:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015463400000000001 2024-09-13T05:11:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730713+0000", 2024-09-13T05:11:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1580000000000005e-06 2024-09-13T05:11:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730719+0000", 2024-09-13T05:11:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2740000000000004e-06 2024-09-13T05:11:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.785798+0000", 2024-09-13T05:11:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055079454 2024-09-13T05:11:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.785894+0000", 2024-09-13T05:11:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5896000000000005e-05 2024-09-13T05:11:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.786030+0000", 2024-09-13T05:11:28.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013586199999999999 2024-09-13T05:11:28.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.872 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.872 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26346 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1308672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:28.872 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:28.872 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.131328459000002, 2024-09-13T05:11:28.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055416737000000001, 2024-09-13T05:11:28.872 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.872 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.873 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.873 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.873 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.873 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26346 2024-09-13T05:11:28.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.873 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732833+0000", 2024-09-13T05:11:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732835+0000", 2024-09-13T05:11:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3719999999999999e-06 2024-09-13T05:11:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732839+0000", 2024-09-13T05:11:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1520000000000001e-06 2024-09-13T05:11:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732842+0000", 2024-09-13T05:11:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.061e-06 2024-09-13T05:11:28.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788126+0000", 2024-09-13T05:11:28.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055284489999999999 2024-09-13T05:11:28.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788183+0000", 2024-09-13T05:11:28.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7127999999999999e-05 2024-09-13T05:11:28.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788250+0000", 2024-09-13T05:11:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7001000000000004e-05 2024-09-13T05:11:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26348 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 800768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.130905634999998, 2024-09-13T05:11:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055321395000000002, 2024-09-13T05:11:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26348 2024-09-13T05:11:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733127+0000", 2024-09-13T05:11:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998703 2024-09-13T05:11:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733262+0000", 2024-09-13T05:11:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013484400000000001 2024-09-13T05:11:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733273+0000", 2024-09-13T05:11:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1824000000000001e-05 2024-09-13T05:11:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733281+0000", 2024-09-13T05:11:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9999999999999996e-06 2024-09-13T05:11:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788431+0000", 2024-09-13T05:11:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055149535 2024-09-13T05:11:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788490+0000", 2024-09-13T05:11:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9413999999999997e-05 2024-09-13T05:11:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788578+0000", 2024-09-13T05:11:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7418999999999998e-05 2024-09-13T05:11:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26368 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 985088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:11:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.126753438000001, 2024-09-13T05:11:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055320511000000003, 2024-09-13T05:11:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26368 2024-09-13T05:11:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:11:28.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:11:28.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737408+0000", 2024-09-13T05:11:28.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737412+0000", 2024-09-13T05:11:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6279999999999998e-06 2024-09-13T05:11:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737419+0000", 2024-09-13T05:11:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1770000000000001e-06 2024-09-13T05:11:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737425+0000", 2024-09-13T05:11:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6949999999999997e-06 2024-09-13T05:11:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792507+0000", 2024-09-13T05:11:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055082840000000001 2024-09-13T05:11:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792606+0000", 2024-09-13T05:11:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8697999999999996e-05 2024-09-13T05:11:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792729+0000", 2024-09-13T05:11:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012298499999999999 2024-09-13T05:11:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26417 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 903168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.122693177999999, 2024-09-13T05:11:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055375191999999997, 2024-09-13T05:11:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26417 2024-09-13T05:11:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741468+0000", 2024-09-13T05:11:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741472+0000", 2024-09-13T05:11:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4139999999999998e-06 2024-09-13T05:11:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741478+0000", 2024-09-13T05:11:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5230000000000001e-06 2024-09-13T05:11:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741483+0000", 2024-09-13T05:11:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8559999999999998e-06 2024-09-13T05:11:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796655+0000", 2024-09-13T05:11:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055172153000000002 2024-09-13T05:11:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796738+0000", 2024-09-13T05:11:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2912999999999997e-05 2024-09-13T05:11:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796844+0000", 2024-09-13T05:11:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105802 2024-09-13T05:11:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26419 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 912384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.122669313000003, 2024-09-13T05:11:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055570469999999997, 2024-09-13T05:11:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26419 2024-09-13T05:11:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741492+0000", 2024-09-13T05:11:28.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741495+0000", 2024-09-13T05:11:28.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6369999999999999e-06 2024-09-13T05:11:28.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741508+0000", 2024-09-13T05:11:28.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3319000000000001e-05 2024-09-13T05:11:28.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741527+0000", 2024-09-13T05:11:28.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8542e-05 2024-09-13T05:11:28.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796871+0000", 2024-09-13T05:11:28.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055344474999999997 2024-09-13T05:11:28.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796967+0000", 2024-09-13T05:11:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5963000000000003e-05 2024-09-13T05:11:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797063+0000", 2024-09-13T05:11:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5909999999999995e-05 2024-09-13T05:11:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26421 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 921600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.122626009999998, 2024-09-13T05:11:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055631152000000003, 2024-09-13T05:11:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26421 2024-09-13T05:11:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:28.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:28.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741535+0000", 2024-09-13T05:11:28.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741540+0000", 2024-09-13T05:11:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1690000000000002e-06 2024-09-13T05:11:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741547+0000", 2024-09-13T05:11:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3409999999999997e-06 2024-09-13T05:11:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741552+0000", 2024-09-13T05:11:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5639999999999996e-06 2024-09-13T05:11:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797079+0000", 2024-09-13T05:11:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055526038999999999 2024-09-13T05:11:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797121+0000", 2024-09-13T05:11:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2156000000000001e-05 2024-09-13T05:11:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797167+0000", 2024-09-13T05:11:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6445e-05 2024-09-13T05:11:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26423 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 930816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.122233016999999, 2024-09-13T05:11:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055364370000000003, 2024-09-13T05:11:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26423 2024-09-13T05:11:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741928+0000", 2024-09-13T05:11:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741933+0000", 2024-09-13T05:11:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9980000000000003e-06 2024-09-13T05:11:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741945+0000", 2024-09-13T05:11:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1761e-05 2024-09-13T05:11:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741958+0000", 2024-09-13T05:11:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2604e-05 2024-09-13T05:11:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797185+0000", 2024-09-13T05:11:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055227169 2024-09-13T05:11:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797226+0000", 2024-09-13T05:11:28.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1619000000000003e-05 2024-09-13T05:11:28.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797293+0000", 2024-09-13T05:11:28.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6952999999999994e-05 2024-09-13T05:11:28.904 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.904 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.904 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26424 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 940032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.122196080000002, 2024-09-13T05:11:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055448669999999999, 2024-09-13T05:11:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26424 2024-09-13T05:11:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741965+0000", 2024-09-13T05:11:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741969+0000", 2024-09-13T05:11:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3440000000000001e-06 2024-09-13T05:11:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741983+0000", 2024-09-13T05:11:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4600000000000001e-05 2024-09-13T05:11:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741989+0000", 2024-09-13T05:11:28.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5350000000000004e-06 2024-09-13T05:11:28.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797319+0000", 2024-09-13T05:11:28.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055330121000000003 2024-09-13T05:11:28.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797364+0000", 2024-09-13T05:11:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5670000000000002e-05 2024-09-13T05:11:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797415+0000", 2024-09-13T05:11:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0124000000000003e-05 2024-09-13T05:11:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26426 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 949248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.122168881, 2024-09-13T05:11:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055639981999999998, 2024-09-13T05:11:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26426 2024-09-13T05:11:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741995+0000", 2024-09-13T05:11:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.661e-06 2024-09-13T05:11:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742004+0000", 2024-09-13T05:11:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2009999999999999e-06 2024-09-13T05:11:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742008+0000", 2024-09-13T05:11:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7890000000000002e-06 2024-09-13T05:11:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797432+0000", 2024-09-13T05:11:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055423448 2024-09-13T05:11:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797516+0000", 2024-09-13T05:11:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4404e-05 2024-09-13T05:11:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797633+0000", 2024-09-13T05:11:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116898 2024-09-13T05:11:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26427 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 958464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.122148824999996, 2024-09-13T05:11:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055829295000000001, 2024-09-13T05:11:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.915 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.915 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26427 2024-09-13T05:11:28.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.915 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:28.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742015+0000", 2024-09-13T05:11:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.74e-06 2024-09-13T05:11:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742023+0000", 2024-09-13T05:11:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7039999999999994e-06 2024-09-13T05:11:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742028+0000", 2024-09-13T05:11:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7369999999999997e-06 2024-09-13T05:11:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797666+0000", 2024-09-13T05:11:28.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055637820999999997 2024-09-13T05:11:28.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797748+0000", 2024-09-13T05:11:28.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1787999999999997e-05 2024-09-13T05:11:28.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797842+0000", 2024-09-13T05:11:28.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4903999999999998e-05 2024-09-13T05:11:28.918 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.918 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.918 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26432 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 976896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.121355663999999, 2024-09-13T05:11:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055402077000000001, 2024-09-13T05:11:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26432 2024-09-13T05:11:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742808+0000", 2024-09-13T05:11:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3319999999999999e-06 2024-09-13T05:11:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742818+0000", 2024-09-13T05:11:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5380000000000008e-06 2024-09-13T05:11:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742821+0000", 2024-09-13T05:11:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2179999999999999e-06 2024-09-13T05:11:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798027+0000", 2024-09-13T05:11:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055206344999999997 2024-09-13T05:11:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798103+0000", 2024-09-13T05:11:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5786999999999998e-05 2024-09-13T05:11:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798208+0000", 2024-09-13T05:11:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010521700000000001 2024-09-13T05:11:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26434 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 986112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.121338440000002, 2024-09-13T05:11:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055610109999999997, 2024-09-13T05:11:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26434 2024-09-13T05:11:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742823+0000", 2024-09-13T05:11:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742825+0000", 2024-09-13T05:11:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6220000000000001e-06 2024-09-13T05:11:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742828+0000", 2024-09-13T05:11:28.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.926e-06 2024-09-13T05:11:28.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742831+0000", 2024-09-13T05:11:28.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-13T05:11:28.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798239+0000", 2024-09-13T05:11:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055408254999999997 2024-09-13T05:11:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798326+0000", 2024-09-13T05:11:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7168000000000003e-05 2024-09-13T05:11:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798434+0000", 2024-09-13T05:11:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010767100000000001 2024-09-13T05:11:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26442 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1032192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.120069100000002, 2024-09-13T05:11:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055422776, 2024-09-13T05:11:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26442 2024-09-13T05:11:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744061+0000", 2024-09-13T05:11:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999685 2024-09-13T05:11:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744096+0000", 2024-09-13T05:11:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4771999999999998e-05 2024-09-13T05:11:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744147+0000", 2024-09-13T05:11:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0696999999999999e-05 2024-09-13T05:11:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744154+0000", 2024-09-13T05:11:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8510000000000001e-06 2024-09-13T05:11:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799324+0000", 2024-09-13T05:11:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055170074999999999 2024-09-13T05:11:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799415+0000", 2024-09-13T05:11:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1197000000000001e-05 2024-09-13T05:11:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799516+0000", 2024-09-13T05:11:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100666 2024-09-13T05:11:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.933 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26443 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1041408~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:28.933 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:28.933 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.119788528999997, 2024-09-13T05:11:28.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055344195999999998, 2024-09-13T05:11:28.933 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.933 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.933 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.933 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.933 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26443 2024-09-13T05:11:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744159+0000", 2024-09-13T05:11:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997849 2024-09-13T05:11:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744379+0000", 2024-09-13T05:11:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022024800000000001 2024-09-13T05:11:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744390+0000", 2024-09-13T05:11:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1105e-05 2024-09-13T05:11:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744397+0000", 2024-09-13T05:11:28.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2740000000000002e-06 2024-09-13T05:11:28.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799543+0000", 2024-09-13T05:11:28.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055145441000000003 2024-09-13T05:11:28.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799619+0000", 2024-09-13T05:11:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6660000000000001e-05 2024-09-13T05:11:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799718+0000", 2024-09-13T05:11:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8331000000000004e-05 2024-09-13T05:11:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26547 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1318912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.119602211, 2024-09-13T05:11:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055355834, 2024-09-13T05:11:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26547 2024-09-13T05:11:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:28.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744404+0000", 2024-09-13T05:11:28.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998441 2024-09-13T05:11:28.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744564+0000", 2024-09-13T05:11:28.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016022200000000001 2024-09-13T05:11:28.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744579+0000", 2024-09-13T05:11:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5036e-05 2024-09-13T05:11:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744585+0000", 2024-09-13T05:11:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7880000000000003e-06 2024-09-13T05:11:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799747+0000", 2024-09-13T05:11:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055161804000000002 2024-09-13T05:11:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799823+0000", 2024-09-13T05:11:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5956000000000003e-05 2024-09-13T05:11:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799916+0000", 2024-09-13T05:11:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2733999999999997e-05 2024-09-13T05:11:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.942 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26550 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1328128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:28.942 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:11:28.942 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.119346051999997, 2024-09-13T05:11:28.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055315941, 2024-09-13T05:11:28.942 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.942 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.942 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.942 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.942 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.942 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26550 2024-09-13T05:11:28.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:11:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:11:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744591+0000", 2024-09-13T05:11:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997745 2024-09-13T05:11:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744821+0000", 2024-09-13T05:11:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023031899999999999 2024-09-13T05:11:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744833+0000", 2024-09-13T05:11:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1919000000000001e-05 2024-09-13T05:11:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744837+0000", 2024-09-13T05:11:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4989999999999996e-06 2024-09-13T05:11:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799947+0000", 2024-09-13T05:11:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055110120999999998 2024-09-13T05:11:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800030+0000", 2024-09-13T05:11:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2905999999999995e-05 2024-09-13T05:11:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800132+0000", 2024-09-13T05:11:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101529 2024-09-13T05:11:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26558 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1364992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.118611045000002, 2024-09-13T05:11:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055422765999999998, 2024-09-13T05:11:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.947 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.947 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.947 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.947 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.947 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26558 2024-09-13T05:11:28.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.947 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:28.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745550+0000", 2024-09-13T05:11:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745553+0000", 2024-09-13T05:11:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7690000000000001e-06 2024-09-13T05:11:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745559+0000", 2024-09-13T05:11:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3149999999999997e-06 2024-09-13T05:11:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745564+0000", 2024-09-13T05:11:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6670000000000004e-06 2024-09-13T05:11:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800791+0000", 2024-09-13T05:11:28.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055226711999999997 2024-09-13T05:11:28.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800865+0000", 2024-09-13T05:11:28.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4344000000000005e-05 2024-09-13T05:11:28.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800974+0000", 2024-09-13T05:11:28.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108606 2024-09-13T05:11:28.950 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26561 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1374208~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.118593992000001, 2024-09-13T05:11:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055549315000000002, 2024-09-13T05:11:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26561 2024-09-13T05:11:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745570+0000", 2024-09-13T05:11:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4719999999999998e-06 2024-09-13T05:11:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745575+0000", 2024-09-13T05:11:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1900000000000003e-06 2024-09-13T05:11:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745579+0000", 2024-09-13T05:11:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3250000000000001e-06 2024-09-13T05:11:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801000+0000", 2024-09-13T05:11:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055420432999999998 2024-09-13T05:11:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801061+0000", 2024-09-13T05:11:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1427000000000007e-05 2024-09-13T05:11:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801117+0000", 2024-09-13T05:11:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5933000000000001e-05 2024-09-13T05:11:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26582 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1447936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.117176352000001, 2024-09-13T05:11:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055394301, 2024-09-13T05:11:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26582 2024-09-13T05:11:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746985+0000", 2024-09-13T05:11:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746988+0000", 2024-09-13T05:11:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6479999999999999e-06 2024-09-13T05:11:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:28.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.747000+0000", 2024-09-13T05:11:28.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2009e-05 2024-09-13T05:11:28.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:28.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.747005+0000", 2024-09-13T05:11:28.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0039999999999999e-06 2024-09-13T05:11:28.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:28.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802232+0000", 2024-09-13T05:11:28.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055227762999999999 2024-09-13T05:11:28.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802320+0000", 2024-09-13T05:11:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7576000000000003e-05 2024-09-13T05:11:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802380+0000", 2024-09-13T05:11:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9888e-05 2024-09-13T05:11:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:28.960 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:28.960 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone29 from 0xd59d820 (overlap 0x738cf9c) to 0x39c67ce 2024-09-13T05:11:28.961 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:11:29.005 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:29.000+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:29.063 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:29.056+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:29.118 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:29.118 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:29.118 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:29.118 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:29.128 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:11:29.164 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:29.157+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:29.214 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #28, image image_client.0-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent29 2024-09-13T05:11:29.226 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:29.226 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:29.226 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:29.226 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:29.226 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:29.237 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:11:29.266 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:29.261+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:29.348 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:29.349 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:29.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:29.349 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:29.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.349 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:7961 3.18 3:184d9aea:::rbd_data.112db57f3a18.000000000000002b:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-13T05:11:29.349 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:11:29.349 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 63.268123295000002, 2024-09-13T05:11:29.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.040271084999999998, 2024-09-13T05:11:29.349 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:29.349 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:29.350 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:29.350 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:29.350 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:29.350 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7961 2024-09-13T05:11:29.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.350 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:29.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:29.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:11:29.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:29.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:11:29.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:29.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077003+0000", 2024-09-13T05:11:29.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:29.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:29.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077013+0000", 2024-09-13T05:11:29.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6870000000000006e-06 2024-09-13T05:11:29.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:29.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077029+0000", 2024-09-13T05:11:29.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6314e-05 2024-09-13T05:11:29.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:29.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077038+0000", 2024-09-13T05:11:29.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5019999999999992e-06 2024-09-13T05:11:29.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:29.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077099+0000", 2024-09-13T05:11:29.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1444000000000003e-05 2024-09-13T05:11:29.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:29.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077234+0000", 2024-09-13T05:11:29.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013461300000000001 2024-09-13T05:11:29.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-13T05:11:29.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.085202+0000", 2024-09-13T05:11:29.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079680140000000007 2024-09-13T05:11:29.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:29.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116860+0000", 2024-09-13T05:11:29.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.031658190000000003 2024-09-13T05:11:29.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:29.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116995+0000", 2024-09-13T05:11:29.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000135601 2024-09-13T05:11:29.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:29.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117152+0000", 2024-09-13T05:11:29.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015681700000000001 2024-09-13T05:11:29.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:29.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117276+0000", 2024-09-13T05:11:29.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012392699999999999 2024-09-13T05:11:29.356 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.356 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:29.356 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.356 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:8105 3.b 3:d2ae8f7b:::rbd_data.112db57f3a18.0000000000000028:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-13T05:11:29.357 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:11:29.357 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 63.033027488999998, 2024-09-13T05:11:29.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.040653913, 2024-09-13T05:11:29.357 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:29.357 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:29.357 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:29.357 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:29.357 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:29.357 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 8105 2024-09-13T05:11:29.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.357 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:29.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:29.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:11:29.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:29.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:11:29.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:29.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312099+0000", 2024-09-13T05:11:29.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:29.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:29.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312109+0000", 2024-09-13T05:11:29.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0244999999999999e-05 2024-09-13T05:11:29.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:29.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312129+0000", 2024-09-13T05:11:29.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9751000000000001e-05 2024-09-13T05:11:29.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:29.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312141+0000", 2024-09-13T05:11:29.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2201999999999999e-05 2024-09-13T05:11:29.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:29.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312230+0000", 2024-09-13T05:11:29.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9092999999999996e-05 2024-09-13T05:11:29.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:29.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312433+0000", 2024-09-13T05:11:29.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020240500000000001 2024-09-13T05:11:29.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-13T05:11:29.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.320357+0000", 2024-09-13T05:11:29.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079242630000000008 2024-09-13T05:11:29.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:29.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352488+0000", 2024-09-13T05:11:29.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032131588000000003 2024-09-13T05:11:29.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:29.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352533+0000", 2024-09-13T05:11:29.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4601999999999997e-05 2024-09-13T05:11:29.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:29.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352636+0000", 2024-09-13T05:11:29.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103041 2024-09-13T05:11:29.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:29.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352755+0000", 2024-09-13T05:11:29.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118814 2024-09-13T05:11:29.363 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.363 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:29.363 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.363 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:39305 3.1e 3:79249bf8:::rbd_data.112dcff96bbd.0000000000000003:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-13T05:11:29.364 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:41.473278+0000", 2024-09-13T05:11:29.364 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.871850893000001, 2024-09-13T05:11:29.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027037510000000001, 2024-09-13T05:11:29.364 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:29.364 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:29.364 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:29.364 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:29.364 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:29.364 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 39305 2024-09-13T05:11:29.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.364 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:29.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:29.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473278+0000", 2024-09-13T05:11:29.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:29.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473278+0000", 2024-09-13T05:11:29.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:29.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473276+0000", 2024-09-13T05:11:29.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:29.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:29.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473285+0000", 2024-09-13T05:11:29.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0129999999999999e-06 2024-09-13T05:11:29.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:29.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473304+0000", 2024-09-13T05:11:29.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8723e-05 2024-09-13T05:11:29.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:29.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473313+0000", 2024-09-13T05:11:29.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1419999999999999e-06 2024-09-13T05:11:29.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:29.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473390+0000", 2024-09-13T05:11:29.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7001000000000004e-05 2024-09-13T05:11:29.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:29.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473496+0000", 2024-09-13T05:11:29.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010577399999999999 2024-09-13T05:11:29.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:11:29.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.478499+0000", 2024-09-13T05:11:29.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050029260000000004 2024-09-13T05:11:29.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:29.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500153+0000", 2024-09-13T05:11:29.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021654421 2024-09-13T05:11:29.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:29.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500216+0000", 2024-09-13T05:11:29.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3233999999999998e-05 2024-09-13T05:11:29.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:29.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500273+0000", 2024-09-13T05:11:29.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6484000000000003e-05 2024-09-13T05:11:29.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:29.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500315+0000", 2024-09-13T05:11:29.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2342000000000002e-05 2024-09-13T05:11:29.370 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.371 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:29.371 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.371 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:40934 3.1 3:86cdeb48:::rbd_data.112d4ab2162d.0000000000000103:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-13T05:11:29.371 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:46.247357+0000", 2024-09-13T05:11:29.371 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.097771655000003, 2024-09-13T05:11:29.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028923379999999999, 2024-09-13T05:11:29.371 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:29.371 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:29.371 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:29.372 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:29.372 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:29.372 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 40934 2024-09-13T05:11:29.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.372 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:29.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:29.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247357+0000", 2024-09-13T05:11:29.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:29.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247357+0000", 2024-09-13T05:11:29.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:29.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247354+0000", 2024-09-13T05:11:29.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:11:29.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:29.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247371+0000", 2024-09-13T05:11:29.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6697e-05 2024-09-13T05:11:29.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:29.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247403+0000", 2024-09-13T05:11:29.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1649000000000001e-05 2024-09-13T05:11:29.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:29.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247417+0000", 2024-09-13T05:11:29.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.395e-05 2024-09-13T05:11:29.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:29.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247498+0000", 2024-09-13T05:11:29.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1011000000000001e-05 2024-09-13T05:11:29.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:29.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247757+0000", 2024-09-13T05:11:29.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000258872 2024-09-13T05:11:29.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:11:29.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.254874+0000", 2024-09-13T05:11:29.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071176449999999997 2024-09-13T05:11:29.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:29.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.275876+0000", 2024-09-13T05:11:29.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021001770999999999 2024-09-13T05:11:29.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:29.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.275989+0000", 2024-09-13T05:11:29.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011301199999999999 2024-09-13T05:11:29.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:29.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.276156+0000", 2024-09-13T05:11:29.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000167453 2024-09-13T05:11:29.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:29.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.276280+0000", 2024-09-13T05:11:29.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012369400000000001 2024-09-13T05:11:29.377 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.378 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:29.378 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.378 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:45910 3.a 3:56753852:::rbd_header.112d678e2955:head [call,call rbd.parent_overlap_get in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e58)", 2024-09-13T05:11:29.378 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:50.370028+0000", 2024-09-13T05:11:29.378 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.975100906999998, 2024-09-13T05:11:29.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048450024000000001, 2024-09-13T05:11:29.378 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:29.378 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:29.378 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:29.379 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:29.379 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:29.379 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45910 2024-09-13T05:11:29.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.379 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:29.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:29.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370028+0000", 2024-09-13T05:11:29.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:29.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370028+0000", 2024-09-13T05:11:29.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:29.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370027+0000", 2024-09-13T05:11:29.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:29.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:29.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370031+0000", 2024-09-13T05:11:29.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6530000000000002e-06 2024-09-13T05:11:29.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:29.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370038+0000", 2024-09-13T05:11:29.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8959999999999997e-06 2024-09-13T05:11:29.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:29.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370043+0000", 2024-09-13T05:11:29.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3680000000000004e-06 2024-09-13T05:11:29.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:29.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370076+0000", 2024-09-13T05:11:29.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3411000000000002e-05 2024-09-13T05:11:29.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:29.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370125+0000", 2024-09-13T05:11:29.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8593e-05 2024-09-13T05:11:29.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:29.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.418478+0000", 2024-09-13T05:11:29.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048352978999999997 2024-09-13T05:11:29.383 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.383 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:29.383 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.384 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:56276 3.1 3:8275684a:::rbd_data.112d667fb7f9.000000000000008f:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-13T05:11:29.384 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:04.698605+0000", 2024-09-13T05:11:29.384 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.646523191, 2024-09-13T05:11:29.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024657968999999998, 2024-09-13T05:11:29.384 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:29.384 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:29.384 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:29.384 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:29.384 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:29.384 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 56276 2024-09-13T05:11:29.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.384 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:29.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:29.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698605+0000", 2024-09-13T05:11:29.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:29.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698605+0000", 2024-09-13T05:11:29.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:29.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698602+0000", 2024-09-13T05:11:29.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999971 2024-09-13T05:11:29.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:29.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698621+0000", 2024-09-13T05:11:29.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8783e-05 2024-09-13T05:11:29.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:29.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698667+0000", 2024-09-13T05:11:29.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5509000000000001e-05 2024-09-13T05:11:29.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:29.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698684+0000", 2024-09-13T05:11:29.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7799999999999999e-05 2024-09-13T05:11:29.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:29.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698782+0000", 2024-09-13T05:11:29.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7534000000000005e-05 2024-09-13T05:11:29.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:29.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698905+0000", 2024-09-13T05:11:29.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012293699999999999 2024-09-13T05:11:29.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:11:29.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.707711+0000", 2024-09-13T05:11:29.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088062939999999992 2024-09-13T05:11:29.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:29.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.723142+0000", 2024-09-13T05:11:29.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015430413 2024-09-13T05:11:29.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:29.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.723156+0000", 2024-09-13T05:11:29.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4868999999999999e-05 2024-09-13T05:11:29.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:29.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.723214+0000", 2024-09-13T05:11:29.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7522000000000003e-05 2024-09-13T05:11:29.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:29.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.723263+0000", 2024-09-13T05:11:29.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9261999999999997e-05 2024-09-13T05:11:29.394 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.394 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:29.394 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.394 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:56368 3.1e 3:7d682469:::rbd_data.112d667fb7f9.0000000000000065:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-13T05:11:29.394 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:04.786960+0000", 2024-09-13T05:11:29.395 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.558168664, 2024-09-13T05:11:29.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027546363000000001, 2024-09-13T05:11:29.395 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:29.395 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:29.395 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:29.395 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:29.395 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:29.395 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 56368 2024-09-13T05:11:29.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.395 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:29.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:29.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786960+0000", 2024-09-13T05:11:29.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:29.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786960+0000", 2024-09-13T05:11:29.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:29.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786959+0000", 2024-09-13T05:11:29.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:29.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:29.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786967+0000", 2024-09-13T05:11:29.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6249999999999996e-06 2024-09-13T05:11:29.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:29.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786979+0000", 2024-09-13T05:11:29.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1982e-05 2024-09-13T05:11:29.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:29.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786986+0000", 2024-09-13T05:11:29.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.126e-06 2024-09-13T05:11:29.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:29.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.787039+0000", 2024-09-13T05:11:29.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2431e-05 2024-09-13T05:11:29.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:29.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.787180+0000", 2024-09-13T05:11:29.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014091 2024-09-13T05:11:29.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:11:29.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.793251+0000", 2024-09-13T05:11:29.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060717419999999998 2024-09-13T05:11:29.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:29.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.814381+0000", 2024-09-13T05:11:29.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021129267 2024-09-13T05:11:29.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:29.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.814430+0000", 2024-09-13T05:11:29.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8952000000000002e-05 2024-09-13T05:11:29.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:29.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.814476+0000", 2024-09-13T05:11:29.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6223000000000001e-05 2024-09-13T05:11:29.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:29.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.814506+0000", 2024-09-13T05:11:29.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0287999999999999e-05 2024-09-13T05:11:29.401 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.401 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:29.401 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.402 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58312 3.18 3:1e6e3be3:::rbd_data.112d667fb7f9.0000000000000012:19 [read 106496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:29.402 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615434+0000", 2024-09-13T05:11:29.402 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.729693928, 2024-09-13T05:11:29.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018590530000000001, 2024-09-13T05:11:29.402 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:29.402 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:29.402 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:29.402 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:29.402 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:29.402 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58312 2024-09-13T05:11:29.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.403 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:29.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:29.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615434+0000", 2024-09-13T05:11:29.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:29.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615434+0000", 2024-09-13T05:11:29.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:29.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615434+0000", 2024-09-13T05:11:29.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:29.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:29.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615436+0000", 2024-09-13T05:11:29.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2989999999999999e-06 2024-09-13T05:11:29.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:29.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615442+0000", 2024-09-13T05:11:29.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1200000000000001e-06 2024-09-13T05:11:29.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:29.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615445+0000", 2024-09-13T05:11:29.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6789999999999998e-06 2024-09-13T05:11:29.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:29.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.633861+0000", 2024-09-13T05:11:29.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018416218000000002 2024-09-13T05:11:29.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:29.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.633952+0000", 2024-09-13T05:11:29.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0558999999999998e-05 2024-09-13T05:11:29.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:29.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634025+0000", 2024-09-13T05:11:29.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2964000000000001e-05 2024-09-13T05:11:29.406 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.406 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:29.407 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.407 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58313 3.18 3:1e6e3be3:::rbd_data.112d667fb7f9.0000000000000012:19 [read 122880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:29.407 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615450+0000", 2024-09-13T05:11:29.407 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.729678787000001, 2024-09-13T05:11:29.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018740063000000001, 2024-09-13T05:11:29.407 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:29.407 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:29.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:29.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:29.408 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:29.408 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58313 2024-09-13T05:11:29.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.408 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:29.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:29.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615450+0000", 2024-09-13T05:11:29.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:29.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615450+0000", 2024-09-13T05:11:29.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:29.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615449+0000", 2024-09-13T05:11:29.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:29.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:29.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615455+0000", 2024-09-13T05:11:29.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2530000000000001e-06 2024-09-13T05:11:29.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:29.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615461+0000", 2024-09-13T05:11:29.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8259999999999998e-06 2024-09-13T05:11:29.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:29.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615466+0000", 2024-09-13T05:11:29.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6670000000000004e-06 2024-09-13T05:11:29.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:29.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634053+0000", 2024-09-13T05:11:29.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018586733000000001 2024-09-13T05:11:29.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:29.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634127+0000", 2024-09-13T05:11:29.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4327999999999997e-05 2024-09-13T05:11:29.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:29.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634190+0000", 2024-09-13T05:11:29.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2714999999999998e-05 2024-09-13T05:11:29.412 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.412 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:29.412 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.412 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58314 3.18 3:1e6e3be3:::rbd_data.112d667fb7f9.0000000000000012:19 [read 139264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:29.412 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615470+0000", 2024-09-13T05:11:29.412 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.729657949, 2024-09-13T05:11:29.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019039985999999998, 2024-09-13T05:11:29.412 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:29.412 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:29.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:29.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:29.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:29.413 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58314 2024-09-13T05:11:29.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.413 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:29.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:29.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615470+0000", 2024-09-13T05:11:29.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:29.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615470+0000", 2024-09-13T05:11:29.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:29.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615470+0000", 2024-09-13T05:11:29.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:29.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:29.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615473+0000", 2024-09-13T05:11:29.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7319999999999998e-06 2024-09-13T05:11:29.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:29.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615478+0000", 2024-09-13T05:11:29.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5899999999999998e-06 2024-09-13T05:11:29.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:29.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615483+0000", 2024-09-13T05:11:29.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5210000000000004e-06 2024-09-13T05:11:29.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:29.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634351+0000", 2024-09-13T05:11:29.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018867999 2024-09-13T05:11:29.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:29.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634446+0000", 2024-09-13T05:11:29.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5483999999999996e-05 2024-09-13T05:11:29.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:29.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634510+0000", 2024-09-13T05:11:29.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4049999999999998e-05 2024-09-13T05:11:29.417 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.417 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:29.417 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.417 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58315 3.18 3:1e6e3be3:::rbd_data.112d667fb7f9.0000000000000012:19 [read 155648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:29.417 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615487+0000", 2024-09-13T05:11:29.418 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.729641387000001, 2024-09-13T05:11:29.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019184718999999999, 2024-09-13T05:11:29.418 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:29.418 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:29.418 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:29.418 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:29.418 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:29.418 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58315 2024-09-13T05:11:29.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.418 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:29.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:29.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615487+0000", 2024-09-13T05:11:29.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:29.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615487+0000", 2024-09-13T05:11:29.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:29.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615487+0000", 2024-09-13T05:11:29.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:29.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:29.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615489+0000", 2024-09-13T05:11:29.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.469e-06 2024-09-13T05:11:29.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:29.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615495+0000", 2024-09-13T05:11:29.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4870000000000002e-06 2024-09-13T05:11:29.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:29.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615499+0000", 2024-09-13T05:11:29.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4530000000000004e-06 2024-09-13T05:11:29.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:29.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634536+0000", 2024-09-13T05:11:29.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019036507000000001 2024-09-13T05:11:29.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:29.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634610+0000", 2024-09-13T05:11:29.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4429000000000002e-05 2024-09-13T05:11:29.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:29.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634672+0000", 2024-09-13T05:11:29.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1682999999999999e-05 2024-09-13T05:11:29.422 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.423 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:29.423 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.423 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58316 3.18 3:1e6e3be3:::rbd_data.112d667fb7f9.0000000000000012:19 [read 172032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:29.423 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615505+0000", 2024-09-13T05:11:29.423 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.729623656000001, 2024-09-13T05:11:29.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01934669, 2024-09-13T05:11:29.423 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:29.423 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:29.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:29.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:29.424 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:29.424 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58316 2024-09-13T05:11:29.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.424 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:29.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:29.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615505+0000", 2024-09-13T05:11:29.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:29.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615505+0000", 2024-09-13T05:11:29.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:29.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615504+0000", 2024-09-13T05:11:29.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:29.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:29.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615507+0000", 2024-09-13T05:11:29.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7930000000000002e-06 2024-09-13T05:11:29.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:29.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615514+0000", 2024-09-13T05:11:29.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1169999999999998e-06 2024-09-13T05:11:29.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:29.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615519+0000", 2024-09-13T05:11:29.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6439999999999999e-06 2024-09-13T05:11:29.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:29.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634697+0000", 2024-09-13T05:11:29.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019177963999999999 2024-09-13T05:11:29.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:29.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634782+0000", 2024-09-13T05:11:29.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5198999999999995e-05 2024-09-13T05:11:29.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:29.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634851+0000", 2024-09-13T05:11:29.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9547000000000003e-05 2024-09-13T05:11:29.428 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.428 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:29.428 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.428 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58317 3.18 3:1e6e3be3:::rbd_data.112d667fb7f9.0000000000000012:19 [read 188416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:29.428 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615530+0000", 2024-09-13T05:11:29.428 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.729598701, 2024-09-13T05:11:29.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019487342000000001, 2024-09-13T05:11:29.429 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:29.429 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:29.429 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:29.429 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:29.429 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:29.429 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58317 2024-09-13T05:11:29.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.429 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:29.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:29.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615530+0000", 2024-09-13T05:11:29.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:29.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615530+0000", 2024-09-13T05:11:29.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:29.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615529+0000", 2024-09-13T05:11:29.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:29.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:29.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615532+0000", 2024-09-13T05:11:29.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.078e-06 2024-09-13T05:11:29.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:29.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615538+0000", 2024-09-13T05:11:29.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8799999999999996e-06 2024-09-13T05:11:29.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:29.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615543+0000", 2024-09-13T05:11:29.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1669999999999998e-06 2024-09-13T05:11:29.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:29.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634878+0000", 2024-09-13T05:11:29.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019334646 2024-09-13T05:11:29.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:29.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634954+0000", 2024-09-13T05:11:29.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6317999999999997e-05 2024-09-13T05:11:29.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:29.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.635017+0000", 2024-09-13T05:11:29.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2702999999999999e-05 2024-09-13T05:11:29.433 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.433 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:29.433 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.434 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:64721 3.2 3:4170fd18:::rbd_data.112d7bfe4877.0000000000000029:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-13T05:11:29.434 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:11.044325+0000", 2024-09-13T05:11:29.434 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.300803853000001, 2024-09-13T05:11:29.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.030376619000000001, 2024-09-13T05:11:29.434 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:29.434 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:29.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:29.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:29.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:29.434 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 64721 2024-09-13T05:11:29.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.435 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:29.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:29.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044325+0000", 2024-09-13T05:11:29.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:29.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044325+0000", 2024-09-13T05:11:29.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:29.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044324+0000", 2024-09-13T05:11:29.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:29.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:29.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044329+0000", 2024-09-13T05:11:29.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9009999999999999e-06 2024-09-13T05:11:29.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:29.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044343+0000", 2024-09-13T05:11:29.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3315999999999999e-05 2024-09-13T05:11:29.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:29.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044348+0000", 2024-09-13T05:11:29.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7320000000000003e-06 2024-09-13T05:11:29.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:29.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044411+0000", 2024-09-13T05:11:29.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2779000000000003e-05 2024-09-13T05:11:29.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:29.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044587+0000", 2024-09-13T05:11:29.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017561200000000001 2024-09-13T05:11:29.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:11:29.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.050936+0000", 2024-09-13T05:11:29.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006349543 2024-09-13T05:11:29.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:29.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.074487+0000", 2024-09-13T05:11:29.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023550564 2024-09-13T05:11:29.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:29.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.074506+0000", 2024-09-13T05:11:29.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9273e-05 2024-09-13T05:11:29.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:29.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.074606+0000", 2024-09-13T05:11:29.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9738e-05 2024-09-13T05:11:29.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:29.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.074701+0000", 2024-09-13T05:11:29.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.522e-05 2024-09-13T05:11:29.440 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.440 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:29.440 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.441 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:64754 3.1 3:85fb02f7:::rbd_data.112d7bfe4877.000000000000001c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-13T05:11:29.441 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:11.112788+0000", 2024-09-13T05:11:29.441 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.232340695000001, 2024-09-13T05:11:29.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021038556, 2024-09-13T05:11:29.441 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:29.441 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:29.441 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:29.441 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:29.441 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:29.441 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 64754 2024-09-13T05:11:29.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.442 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:29.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:29.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112788+0000", 2024-09-13T05:11:29.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:29.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112788+0000", 2024-09-13T05:11:29.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:29.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112786+0000", 2024-09-13T05:11:29.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:29.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:29.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112797+0000", 2024-09-13T05:11:29.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1153e-05 2024-09-13T05:11:29.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:29.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112818+0000", 2024-09-13T05:11:29.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0812e-05 2024-09-13T05:11:29.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:29.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112827+0000", 2024-09-13T05:11:29.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8140000000000007e-06 2024-09-13T05:11:29.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:29.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112928+0000", 2024-09-13T05:11:29.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010168800000000001 2024-09-13T05:11:29.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:29.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.113152+0000", 2024-09-13T05:11:29.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022388599999999999 2024-09-13T05:11:29.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:11:29.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.118142+0000", 2024-09-13T05:11:29.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049900020000000003 2024-09-13T05:11:29.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:29.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.133650+0000", 2024-09-13T05:11:29.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015508020000000001 2024-09-13T05:11:29.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:29.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.133666+0000", 2024-09-13T05:11:29.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6237000000000001e-05 2024-09-13T05:11:29.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:29.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.133740+0000", 2024-09-13T05:11:29.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3254e-05 2024-09-13T05:11:29.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:29.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.133826+0000", 2024-09-13T05:11:29.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6576000000000006e-05 2024-09-13T05:11:29.447 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.447 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:29.447 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.448 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:65398 3.b 3:d1d66040:::rbd_data.112d8ff9b77a.0000000000000010:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-13T05:11:29.448 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:14.634623+0000", 2024-09-13T05:11:29.448 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.710505329, 2024-09-13T05:11:29.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021311337, 2024-09-13T05:11:29.448 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:29.448 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:29.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:29.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:29.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:29.448 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65398 2024-09-13T05:11:29.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.448 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:29.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:29.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634623+0000", 2024-09-13T05:11:29.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:29.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634623+0000", 2024-09-13T05:11:29.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:29.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634622+0000", 2024-09-13T05:11:29.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:29.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:29.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634631+0000", 2024-09-13T05:11:29.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2019999999999993e-06 2024-09-13T05:11:29.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:29.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634648+0000", 2024-09-13T05:11:29.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7047000000000001e-05 2024-09-13T05:11:29.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:29.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634661+0000", 2024-09-13T05:11:29.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2828e-05 2024-09-13T05:11:29.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:29.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634727+0000", 2024-09-13T05:11:29.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6291999999999995e-05 2024-09-13T05:11:29.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:29.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634820+0000", 2024-09-13T05:11:29.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2665999999999997e-05 2024-09-13T05:11:29.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:11:29.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.639215+0000", 2024-09-13T05:11:29.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043956730000000001 2024-09-13T05:11:29.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:29.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.655864+0000", 2024-09-13T05:11:29.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016648169000000001 2024-09-13T05:11:29.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:29.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.655875+0000", 2024-09-13T05:11:29.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1289e-05 2024-09-13T05:11:29.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:29.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.655909+0000", 2024-09-13T05:11:29.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3794000000000002e-05 2024-09-13T05:11:29.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:29.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.655934+0000", 2024-09-13T05:11:29.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5749e-05 2024-09-13T05:11:29.454 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.454 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:29.454 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.454 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:66867 3.b 3:d5613bfd:::rbd_data.112d8ff9b77a.0000000000000003:head [stat,delete] snapc 1d=[1d] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-13T05:11:29.454 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:18.482131+0000", 2024-09-13T05:11:29.454 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.862997756, 2024-09-13T05:11:29.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020547362999999999, 2024-09-13T05:11:29.455 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:29.455 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:29.455 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:29.455 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:29.455 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:29.455 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66867 2024-09-13T05:11:29.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.455 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:29.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:29.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482131+0000", 2024-09-13T05:11:29.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:29.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482131+0000", 2024-09-13T05:11:29.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:29.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482129+0000", 2024-09-13T05:11:29.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:29.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:29.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482139+0000", 2024-09-13T05:11:29.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5489999999999995e-06 2024-09-13T05:11:29.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:29.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482167+0000", 2024-09-13T05:11:29.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7713e-05 2024-09-13T05:11:29.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:29.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482179+0000", 2024-09-13T05:11:29.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2631e-05 2024-09-13T05:11:29.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:29.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482318+0000", 2024-09-13T05:11:29.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013872 2024-09-13T05:11:29.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:29.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482492+0000", 2024-09-13T05:11:29.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017404200000000001 2024-09-13T05:11:29.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:11:29.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482879+0000", 2024-09-13T05:11:29.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038729999999999998 2024-09-13T05:11:29.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:29.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.487409+0000", 2024-09-13T05:11:29.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045295200000000004 2024-09-13T05:11:29.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:29.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.502507+0000", 2024-09-13T05:11:29.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015098555 2024-09-13T05:11:29.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:29.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.502569+0000", 2024-09-13T05:11:29.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1648000000000003e-05 2024-09-13T05:11:29.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:29.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.502678+0000", 2024-09-13T05:11:29.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109042 2024-09-13T05:11:29.461 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.461 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:29.461 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.461 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:69083 3.8 3:163ab646:::rbd_data.112d8d1317eb.0000000000000334:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-13T05:11:29.461 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:19.342089+0000", 2024-09-13T05:11:29.461 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.003039218, 2024-09-13T05:11:29.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018970701, 2024-09-13T05:11:29.462 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:29.462 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:29.462 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:29.462 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:29.462 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:29.462 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 69083 2024-09-13T05:11:29.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.462 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:29.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:29.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.342089+0000", 2024-09-13T05:11:29.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:29.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.342089+0000", 2024-09-13T05:11:29.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:29.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.342086+0000", 2024-09-13T05:11:29.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999967 2024-09-13T05:11:29.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:29.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.342103+0000", 2024-09-13T05:11:29.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6969999999999998e-05 2024-09-13T05:11:29.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:29.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.342138+0000", 2024-09-13T05:11:29.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5578999999999999e-05 2024-09-13T05:11:29.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:29.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.342154+0000", 2024-09-13T05:11:29.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5447999999999998e-05 2024-09-13T05:11:29.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:29.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.342259+0000", 2024-09-13T05:11:29.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105424 2024-09-13T05:11:29.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-13T05:11:29.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.342265+0000", 2024-09-13T05:11:29.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1879999999999999e-06 2024-09-13T05:11:29.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:29.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.344545+0000", 2024-09-13T05:11:29.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022793890000000002 2024-09-13T05:11:29.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:29.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.344617+0000", 2024-09-13T05:11:29.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2237999999999995e-05 2024-09-13T05:11:29.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:11:29.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.347321+0000", 2024-09-13T05:11:29.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027034670000000002 2024-09-13T05:11:29.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:29.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.360907+0000", 2024-09-13T05:11:29.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013586019 2024-09-13T05:11:29.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:29.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.360923+0000", 2024-09-13T05:11:29.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6719999999999999e-05 2024-09-13T05:11:29.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:29.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.361002+0000", 2024-09-13T05:11:29.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8924999999999994e-05 2024-09-13T05:11:29.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:29.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.361060+0000", 2024-09-13T05:11:29.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7652000000000003e-05 2024-09-13T05:11:29.469 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.469 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:29.469 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.469 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:70758 3.2 3:427d0469:::rbd_header.112d8d1317eb:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-13T05:11:29.469 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:11:29.469 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9164731479999997, 2024-09-13T05:11:29.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.190313603, 2024-09-13T05:11:29.470 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:29.470 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:29.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:29.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:29.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:29.470 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70758 2024-09-13T05:11:29.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.470 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:29.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:29.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:11:29.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:29.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:11:29.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:29.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428654+0000", 2024-09-13T05:11:29.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:29.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:29.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428664+0000", 2024-09-13T05:11:29.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0664e-05 2024-09-13T05:11:29.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:29.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428683+0000", 2024-09-13T05:11:29.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8377e-05 2024-09-13T05:11:29.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:29.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428691+0000", 2024-09-13T05:11:29.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9400000000000008e-06 2024-09-13T05:11:29.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:29.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428789+0000", 2024-09-13T05:11:29.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7165999999999998e-05 2024-09-13T05:11:29.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:29.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428811+0000", 2024-09-13T05:11:29.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1925000000000001e-05 2024-09-13T05:11:29.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:29.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.617921+0000", 2024-09-13T05:11:29.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.189110536 2024-09-13T05:11:29.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:29.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618344+0000", 2024-09-13T05:11:29.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042245800000000001 2024-09-13T05:11:29.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:29.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618969+0000", 2024-09-13T05:11:29.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062529299999999996 2024-09-13T05:11:29.475 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.475 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:29.475 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.476 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:70873 3.18 3:1e32bd38:::rbd_object_map.112db56bb33d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:11:29.476 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:23.712386+0000", 2024-09-13T05:11:29.476 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.632741953, 2024-09-13T05:11:29.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018744994000000001, 2024-09-13T05:11:29.476 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:29.476 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:29.476 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:29.476 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:29.476 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:29.476 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70873 2024-09-13T05:11:29.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.477 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:29.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:29.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.712386+0000", 2024-09-13T05:11:29.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:29.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.712386+0000", 2024-09-13T05:11:29.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:29.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:29.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.712386+0000", 2024-09-13T05:11:29.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:29.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:29.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.712389+0000", 2024-09-13T05:11:29.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3329999999999999e-06 2024-09-13T05:11:29.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:29.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.712393+0000", 2024-09-13T05:11:29.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1779999999999996e-06 2024-09-13T05:11:29.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:29.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.712396+0000", 2024-09-13T05:11:29.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.574e-06 2024-09-13T05:11:29.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:29.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.728415+0000", 2024-09-13T05:11:29.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016019038999999999 2024-09-13T05:11:29.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:29.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.728488+0000", 2024-09-13T05:11:29.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2235000000000002e-05 2024-09-13T05:11:29.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-13T05:11:29.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.728689+0000", 2024-09-13T05:11:29.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020100700000000001 2024-09-13T05:11:29.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:29.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.731052+0000", 2024-09-13T05:11:29.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023635399999999999 2024-09-13T05:11:29.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:29.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.731067+0000", 2024-09-13T05:11:29.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5126000000000001e-05 2024-09-13T05:11:29.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:29.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.731111+0000", 2024-09-13T05:11:29.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3736999999999998e-05 2024-09-13T05:11:29.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:29.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:29.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:29.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.731131+0000", 2024-09-13T05:11:29.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0465000000000001e-05 2024-09-13T05:11:29.482 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.482 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:29.482 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.483 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:29.483 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:29.483 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:29.484 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:11:29.485 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:29.476+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:29.549 INFO:teuthology.orchestra.run.smithi120.stdout:3780 read 0x5a957c6 thru 0x5a9a6d8 (0x4f13 bytes) 2024-09-13T05:11:29.559 INFO:teuthology.orchestra.run.smithi120.stdout:3782 write 0x7eb3788 thru 0x7ebcf08 (0x9781 bytes) 2024-09-13T05:11:29.572 INFO:teuthology.orchestra.run.smithi120.stdout:3783 punch from 0x87516fb to 0x8755045, (0x394a bytes) 2024-09-13T05:11:29.572 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:29.572 INFO:teuthology.orchestra.run.smithi120.stdout:3786 punch from 0x72ca07 to 0x730c94, (0x428d bytes) 2024-09-13T05:11:29.572 INFO:teuthology.orchestra.run.smithi120.stdout:3787 read 0x8576dd8 thru 0x857c405 (0x562e bytes) 2024-09-13T05:11:29.573 INFO:teuthology.orchestra.run.smithi120.stdout:3788 read 0x6d98463 thru 0x6d9a35d (0x1efb bytes) 2024-09-13T05:11:29.575 INFO:teuthology.orchestra.run.smithi120.stdout:3789 punch from 0xc328934 to 0xc337cbf, (0xf38b bytes) 2024-09-13T05:11:29.575 INFO:teuthology.orchestra.run.smithi120.stdout:3790 read 0x88ae0ba thru 0x88bdcd8 (0xfc1f bytes) 2024-09-13T05:11:29.576 INFO:teuthology.orchestra.run.smithi120.stdout:3792 write 0x4665d38 thru 0x46718a2 (0xbb6b bytes) 2024-09-13T05:11:29.585 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:29.580+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:29.593 INFO:teuthology.orchestra.run.smithi120.stdout:3794 trunc from 0xd59d820 to 0x96792ad 2024-09-13T05:11:29.612 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:29.612 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:29.612 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:11:29.612 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:29.623 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:11:29.628 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:29.628 INFO:teuthology.orchestra.run.smithi120.stdout:3797 read 0x57bfc0f thru 0x57c4d61 (0x5153 bytes) 2024-09-13T05:11:29.636 INFO:teuthology.orchestra.run.smithi120.stdout:3798 trunc from 0x96792ad to 0xc1d5165 2024-09-13T05:11:29.649 INFO:teuthology.orchestra.run.smithi120.stdout:3799 read 0xa44664f thru 0xa453bb0 (0xd562 bytes) 2024-09-13T05:11:29.649 INFO:teuthology.orchestra.run.smithi120.stdout:3801 read 0x67f43ff thru 0x6803cf5 (0xf8f7 bytes) 2024-09-13T05:11:29.650 INFO:teuthology.orchestra.run.smithi120.stdout:3802 punch from 0x63c39e2 to 0x63c63f2, (0x2a10 bytes) 2024-09-13T05:11:29.650 INFO:teuthology.orchestra.run.smithi120.stdout:3804 read 0x649bb0a thru 0x649f2e7 (0x37de bytes) 2024-09-13T05:11:29.667 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T05:11:29.670 INFO:teuthology.orchestra.run.smithi120.stdout:3805 writesame 0xea4e392 thru 0xea58236 data_size 0x1(0x9ea5 bytes) 2024-09-13T05:11:29.677 INFO:teuthology.orchestra.run.smithi120.stdout:3807 trunc from 0xea58237 to 0xb73c7b4 2024-09-13T05:11:29.686 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:29.681+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:29.687 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:11:29.687 INFO:teuthology.orchestra.run.smithi120.stdout:3808 writesame 0x5ea4966 thru 0x5eb1d88 data_size 0x1(0xd423 bytes) 2024-09-13T05:11:29.730 INFO:teuthology.orchestra.run.smithi120.stdout:3809 write 0x515abf thru 0x52270c (0xcc4e bytes) 2024-09-13T05:11:29.734 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:29.734 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:29.735 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:29.735 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:29.735 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:29.743 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:29.744 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:29.744 INFO:teuthology.orchestra.run.smithi120.stdout:3815 punch from 0x28c636 to 0x29458a, (0x7f54 bytes) 2024-09-13T05:11:29.745 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:11:29.747 INFO:teuthology.orchestra.run.smithi120.stdout:3816 trunc from 0xb73c7b4 to 0x97c1998 2024-09-13T05:11:29.757 INFO:teuthology.orchestra.run.smithi120.stdout:3817 read 0x25727d3 thru 0x257bf07 (0x9735 bytes) 2024-09-13T05:11:29.761 INFO:teuthology.orchestra.run.smithi120.stdout:3820 trunc from 0x97c1998 to 0xb1fa143 2024-09-13T05:11:29.773 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:29.773 INFO:teuthology.orchestra.run.smithi120.stdout:3822 read 0x353f4c1 thru 0x354f2bb (0xfdfb bytes) 2024-09-13T05:11:29.775 INFO:teuthology.orchestra.run.smithi120.stdout:3825 read 0x88d374d thru 0x88d618c (0x2a40 bytes) 2024-09-13T05:11:29.776 INFO:teuthology.orchestra.run.smithi120.stdout:3826 read 0x573b6ec thru 0x57463e6 (0xacfb bytes) 2024-09-13T05:11:29.779 INFO:teuthology.orchestra.run.smithi120.stdout:3827 write 0x601ac48 thru 0x601edc9 (0x4182 bytes) 2024-09-13T05:11:29.787 INFO:teuthology.orchestra.run.smithi120.stdout:3829 write 0x5987e29 thru 0x598f6b8 (0x7890 bytes) 2024-09-13T05:11:29.787 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:29.780+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:29.793 INFO:teuthology.orchestra.run.smithi120.stdout:3830 trunc from 0xb1fa143 to 0x8c9c07a 2024-09-13T05:11:29.824 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:11:29.826 INFO:teuthology.orchestra.run.smithi120.stdout:3831 read 0x6a5443f thru 0x6a6216f (0xdd31 bytes) 2024-09-13T05:11:29.827 INFO:teuthology.orchestra.run.smithi120.stdout:3832 write 0x2107737 thru 0x2114013 (0xc8dd bytes) 2024-09-13T05:11:29.838 INFO:teuthology.orchestra.run.smithi120.stdout:3835 punch from 0x5ef4185 to 0x5eff214, (0xb08f bytes) 2024-09-13T05:11:29.839 INFO:teuthology.orchestra.run.smithi120.stdout:3836 clone 31 order 25 su 1048576 sc 12 2024-09-13T05:11:29.845 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:11:29.859 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:29.859 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:29.859 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:29.859 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [] 2024-09-13T05:11:29.859 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:29.864 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:11:29.869 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:11:29.882 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:11:29.900 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:11:29.917 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:29.913+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:29.922 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:11:29.945 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:11:29.967 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:11:29.969 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:11:29.969 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:11:29.969 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:11:29.969 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:11:29.969 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:11:29.970 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:11:29.970 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:11:29.970 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:11:29.976 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:29.977 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:29.986 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:11:30.021 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:30.020+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:30.087 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:30.088 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:30.090 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:30.085+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:30.097 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:11:30.192 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:30.188+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:30.200 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:30.201 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:30.210 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:11:30.292 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:30.285+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:30.312 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:30.313 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:30.322 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:11:30.393 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:30.389+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:30.425 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:30.425 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:30.435 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:11:30.495 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:30.492+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:30.539 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:30.539 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:30.549 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:11:30.596 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:30.589+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:30.657 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:30.657 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:30.666 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:11:30.688 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is unset 2024-09-13T05:11:30.697 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:30.696+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:30.775 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:30.775 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:30.785 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:11:30.798 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:30.796+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:30.894 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:30.895 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:30.899 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:30.896+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:30.904 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:11:30.923 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone30 from 0x8c9c07a (overlap 0x8c9c07a) to 0x0 2024-09-13T05:11:31.000 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:30.996+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:31.009 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:11:31.052 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:31.052 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:31.066 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:11:31.113 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:31.112+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:31.202 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:31.197+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:31.224 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:31.224 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:31.235 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:11:31.303 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:31.300+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:11:31.325 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:11:31.341 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-09-13T05:11:30.678896+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":941400420,"num_objects":2144,"num_object_clones":298,"num_object_copies":4288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2144,"num_whiteouts":1016,"num_read":94231,"num_read_kb":449874,"num_write":13430,"num_write_kb":290549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1981,"num_bytes_recovered":69865385,"num_keys_recovered":233,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11773,"ondisk_log_size":11773,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":511068,"kb_used_data":289132,"kb_used_omap":7,"kb_used_meta":220280,"kb_avail":471348132,"statfs":{"total":483183820800,"available":482660487168,"internally_reserved":0,"allocated":296071168,"data_stored":330434892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7962,"internal_metadata":225566950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":98818982,"num_objects":106,"num_object_clones":26,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":34,"num_read":4634,"num_read_kb":43930,"num_write":730,"num_write_kb":17113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":679,"num_bytes_recovered":24683730,"num_keys_recovered":66,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.044710"},"pg_stats":[{"pgid":"3.1f","version":"89'366","reported_seq":932,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.499428+0000","last_change":"2024-09-13T05:10:37.993400+0000","last_active":"2024-09-13T05:11:26.499428+0000","last_peered":"2024-09-13T05:11:26.499428+0000","last_clean":"2024-09-13T05:11:26.499428+0000","last_became_active":"2024-09-13T05:10:37.864778+0000","last_became_peered":"2024-09-13T05:10:37.864778+0000","last_unstale":"2024-09-13T05:11:26.499428+0000","last_undegraded":"2024-09-13T05:11:26.499428+0000","last_fullsized":"2024-09-13T05:11:26.499428+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:56:24.801492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011835439999999999,"stat_sum":{"num_bytes":4432308,"num_objects":62,"num_object_clones":6,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":24,"num_read":1632,"num_read_kb":2891,"num_write":437,"num_write_kb":3006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":297202,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"89'209","reported_seq":1078,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.497112+0000","last_change":"2024-09-13T05:10:12.076857+0000","last_active":"2024-09-13T05:11:26.497112+0000","last_peered":"2024-09-13T05:11:26.497112+0000","last_clean":"2024-09-13T05:11:26.497112+0000","last_became_active":"2024-09-13T05:10:09.644293+0000","last_became_peered":"2024-09-13T05:10:09.644293+0000","last_unstale":"2024-09-13T05:11:26.497112+0000","last_undegraded":"2024-09-13T05:11:26.497112+0000","last_fullsized":"2024-09-13T05:11:26.497112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:45:32.561793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225439,"stat_sum":{"num_bytes":26552467,"num_objects":56,"num_object_clones":7,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":28,"num_read":1358,"num_read_kb":4732,"num_write":178,"num_write_kb":3399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"85'236","reported_seq":2161,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.622954+0000","last_change":"2024-09-13T05:10:11.645342+0000","last_active":"2024-09-13T05:11:24.622954+0000","last_peered":"2024-09-13T05:11:24.622954+0000","last_clean":"2024-09-13T05:11:24.622954+0000","last_became_active":"2024-09-13T05:10:09.645791+0000","last_became_peered":"2024-09-13T05:10:09.645791+0000","last_unstale":"2024-09-13T05:11:24.622954+0000","last_undegraded":"2024-09-13T05:11:24.622954+0000","last_fullsized":"2024-09-13T05:11:24.622954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:49.028553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072691800000000001,"stat_sum":{"num_bytes":33288741,"num_objects":77,"num_object_clones":13,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":33,"num_read":1958,"num_read_kb":11839,"num_write":197,"num_write_kb":4852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"87'537","reported_seq":2562,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.622702+0000","last_change":"2024-09-13T05:10:31.949427+0000","last_active":"2024-09-13T05:11:24.622702+0000","last_peered":"2024-09-13T05:11:24.622702+0000","last_clean":"2024-09-13T05:11:24.622702+0000","last_became_active":"2024-09-13T05:10:31.828206+0000","last_became_peered":"2024-09-13T05:10:31.828206+0000","last_unstale":"2024-09-13T05:11:24.622702+0000","last_undegraded":"2024-09-13T05:11:24.622702+0000","last_fullsized":"2024-09-13T05:11:24.622702+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:32:46.868249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078437299999999999,"stat_sum":{"num_bytes":14844125,"num_objects":60,"num_object_clones":9,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":24,"num_read":4219,"num_read_kb":16578,"num_write":707,"num_write_kb":7858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":372837,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"89'358","reported_seq":1647,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.760209+0000","last_change":"2024-09-13T05:10:37.990899+0000","last_active":"2024-09-13T05:11:26.760209+0000","last_peered":"2024-09-13T05:11:26.760209+0000","last_clean":"2024-09-13T05:11:26.760209+0000","last_became_active":"2024-09-13T05:10:37.867842+0000","last_became_peered":"2024-09-13T05:10:37.867842+0000","last_unstale":"2024-09-13T05:11:26.760209+0000","last_undegraded":"2024-09-13T05:11:26.760209+0000","last_fullsized":"2024-09-13T05:11:26.760209+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:38:24.437617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065808499999999999,"stat_sum":{"num_bytes":23246044,"num_objects":72,"num_object_clones":8,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":36,"num_read":2516,"num_read_kb":13375,"num_write":364,"num_write_kb":9174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":612052,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"87'272","reported_seq":3423,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.770161+0000","last_change":"2024-09-13T05:10:37.948112+0000","last_active":"2024-09-13T05:11:26.770161+0000","last_peered":"2024-09-13T05:11:26.770161+0000","last_clean":"2024-09-13T05:11:26.770161+0000","last_became_active":"2024-09-13T05:10:37.863614+0000","last_became_peered":"2024-09-13T05:10:37.863614+0000","last_unstale":"2024-09-13T05:11:26.770161+0000","last_undegraded":"2024-09-13T05:11:26.770161+0000","last_fullsized":"2024-09-13T05:11:26.770161+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:15.873724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027226559999999999,"stat_sum":{"num_bytes":13047737,"num_objects":74,"num_object_clones":10,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":30,"num_read":3591,"num_read_kb":9445,"num_write":226,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":77,"num_bytes_recovered":1081937,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"89'582","reported_seq":2581,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.761298+0000","last_change":"2024-09-13T05:10:34.613940+0000","last_active":"2024-09-13T05:11:26.761298+0000","last_peered":"2024-09-13T05:11:26.761298+0000","last_clean":"2024-09-13T05:11:26.761298+0000","last_became_active":"2024-09-13T05:10:34.612579+0000","last_became_peered":"2024-09-13T05:10:34.612579+0000","last_unstale":"2024-09-13T05:11:26.761298+0000","last_undegraded":"2024-09-13T05:11:26.761298+0000","last_fullsized":"2024-09-13T05:11:26.761298+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":582,"log_dups_size":0,"ondisk_log_size":582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:43.339882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067403999999999999,"stat_sum":{"num_bytes":64977555,"num_objects":72,"num_object_clones":11,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":30,"num_read":4402,"num_read_kb":18284,"num_write":762,"num_write_kb":5835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":248973,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"87'376","reported_seq":1672,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:25.738418+0000","last_change":"2024-09-13T05:10:37.929523+0000","last_active":"2024-09-13T05:11:25.738418+0000","last_peered":"2024-09-13T05:11:25.738418+0000","last_clean":"2024-09-13T05:11:25.738418+0000","last_became_active":"2024-09-13T05:10:37.865440+0000","last_became_peered":"2024-09-13T05:10:37.865440+0000","last_unstale":"2024-09-13T05:11:25.738418+0000","last_undegraded":"2024-09-13T05:11:25.738418+0000","last_fullsized":"2024-09-13T05:11:25.738418+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:30:31.875141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087399999999998,"stat_sum":{"num_bytes":26063629,"num_objects":78,"num_object_clones":13,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":41,"num_read":1926,"num_read_kb":16725,"num_write":426,"num_write_kb":10613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":1513234,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"89'306","reported_seq":2010,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.499491+0000","last_change":"2024-09-13T05:10:37.920810+0000","last_active":"2024-09-13T05:11:26.499491+0000","last_peered":"2024-09-13T05:11:26.499491+0000","last_clean":"2024-09-13T05:11:26.499491+0000","last_became_active":"2024-09-13T05:10:37.864816+0000","last_became_peered":"2024-09-13T05:10:37.864816+0000","last_unstale":"2024-09-13T05:11:26.499491+0000","last_undegraded":"2024-09-13T05:11:26.499491+0000","last_fullsized":"2024-09-13T05:11:26.499491+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:06.315864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096598599999999995,"stat_sum":{"num_bytes":10171114,"num_objects":55,"num_object_clones":6,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":25,"num_read":3657,"num_read_kb":6154,"num_write":266,"num_write_kb":2787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":37802,"num_keys_recovered":23,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"85'245","reported_seq":1815,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:25.644111+0000","last_change":"2024-09-13T05:11:24.632224+0000","last_active":"2024-09-13T05:11:25.644111+0000","last_peered":"2024-09-13T05:11:25.644111+0000","last_clean":"2024-09-13T05:11:25.644111+0000","last_became_active":"2024-09-13T05:11:24.631079+0000","last_became_peered":"2024-09-13T05:11:24.631079+0000","last_unstale":"2024-09-13T05:11:25.644111+0000","last_undegraded":"2024-09-13T05:11:25.644111+0000","last_fullsized":"2024-09-13T05:11:25.644111+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:29.182802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072236499999999999,"stat_sum":{"num_bytes":33559063,"num_objects":65,"num_object_clones":15,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":33,"num_read":1475,"num_read_kb":10421,"num_write":207,"num_write_kb":3380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":4743569,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"85'281","reported_seq":1585,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.628437+0000","last_change":"2024-09-13T05:10:11.681217+0000","last_active":"2024-09-13T05:11:24.628437+0000","last_peered":"2024-09-13T05:11:24.628437+0000","last_clean":"2024-09-13T05:11:24.628437+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:11:24.628437+0000","last_undegraded":"2024-09-13T05:11:24.628437+0000","last_fullsized":"2024-09-13T05:11:24.628437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:40.457636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095533399999999996,"stat_sum":{"num_bytes":15134699,"num_objects":60,"num_object_clones":11,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":31,"num_read":1845,"num_read_kb":12717,"num_write":335,"num_write_kb":6466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"87'263","reported_seq":3958,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:25.732639+0000","last_change":"2024-09-13T05:10:11.681365+0000","last_active":"2024-09-13T05:11:25.732639+0000","last_peered":"2024-09-13T05:11:25.732639+0000","last_clean":"2024-09-13T05:11:25.732639+0000","last_became_active":"2024-09-13T05:10:09.645823+0000","last_became_peered":"2024-09-13T05:10:09.645823+0000","last_unstale":"2024-09-13T05:11:25.732639+0000","last_undegraded":"2024-09-13T05:11:25.732639+0000","last_fullsized":"2024-09-13T05:11:25.732639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:24.367358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011047369999999999,"stat_sum":{"num_bytes":43303091,"num_objects":75,"num_object_clones":13,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":38,"num_read":3735,"num_read_kb":26820,"num_write":225,"num_write_kb":6225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.633944+0000","last_change":"2024-09-13T05:10:01.383891+0000","last_active":"2024-09-13T05:11:24.633944+0000","last_peered":"2024-09-13T05:11:24.633944+0000","last_clean":"2024-09-13T05:11:24.633944+0000","last_became_active":"2024-09-13T05:09:59.374793+0000","last_became_peered":"2024-09-13T05:09:59.374793+0000","last_unstale":"2024-09-13T05:11:24.633944+0000","last_undegraded":"2024-09-13T05:11:24.633944+0000","last_fullsized":"2024-09-13T05:11:24.633944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:02.499446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065068999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"87'220","reported_seq":4848,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:25.733395+0000","last_change":"2024-09-13T05:11:25.647054+0000","last_active":"2024-09-13T05:11:25.733395+0000","last_peered":"2024-09-13T05:11:25.733395+0000","last_clean":"2024-09-13T05:11:25.733395+0000","last_became_active":"2024-09-13T05:11:25.645546+0000","last_became_peered":"2024-09-13T05:11:25.645546+0000","last_unstale":"2024-09-13T05:11:25.733395+0000","last_undegraded":"2024-09-13T05:11:25.733395+0000","last_fullsized":"2024-09-13T05:11:25.733395+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:33:49.392161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099899699999999995,"stat_sum":{"num_bytes":32485608,"num_objects":59,"num_object_clones":9,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":25,"num_read":3354,"num_read_kb":12021,"num_write":178,"num_write_kb":6920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":13680601,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.633955+0000","last_change":"2024-09-13T05:10:31.826927+0000","last_active":"2024-09-13T05:11:24.633955+0000","last_peered":"2024-09-13T05:11:24.633955+0000","last_clean":"2024-09-13T05:11:24.633955+0000","last_became_active":"2024-09-13T05:10:31.826431+0000","last_became_peered":"2024-09-13T05:10:31.826431+0000","last_unstale":"2024-09-13T05:11:24.633955+0000","last_undegraded":"2024-09-13T05:11:24.633955+0000","last_fullsized":"2024-09-13T05:11:24.633955+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:13:36.678853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"85'241","reported_seq":1366,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.632090+0000","last_change":"2024-09-13T05:10:12.077111+0000","last_active":"2024-09-13T05:11:24.632090+0000","last_peered":"2024-09-13T05:11:24.632090+0000","last_clean":"2024-09-13T05:11:24.632090+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:11:24.632090+0000","last_undegraded":"2024-09-13T05:11:24.632090+0000","last_fullsized":"2024-09-13T05:11:24.632090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:37.976147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001460444,"stat_sum":{"num_bytes":51938959,"num_objects":69,"num_object_clones":7,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":38,"num_read":1249,"num_read_kb":10754,"num_write":208,"num_write_kb":3289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":93,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.628551+0000","last_change":"2024-09-13T05:10:37.866953+0000","last_active":"2024-09-13T05:11:24.628551+0000","last_peered":"2024-09-13T05:11:24.628551+0000","last_clean":"2024-09-13T05:11:24.628551+0000","last_became_active":"2024-09-13T05:10:37.866624+0000","last_became_peered":"2024-09-13T05:10:37.866624+0000","last_unstale":"2024-09-13T05:11:24.628551+0000","last_undegraded":"2024-09-13T05:11:24.628551+0000","last_fullsized":"2024-09-13T05:11:24.628551+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:56:20.077971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"87'401","reported_seq":1080,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:25.732108+0000","last_change":"2024-09-13T05:11:23.618355+0000","last_active":"2024-09-13T05:11:25.732108+0000","last_peered":"2024-09-13T05:11:25.732108+0000","last_clean":"2024-09-13T05:11:25.732108+0000","last_became_active":"2024-09-13T05:11:23.616394+0000","last_became_peered":"2024-09-13T05:11:23.616394+0000","last_unstale":"2024-09-13T05:11:25.732108+0000","last_undegraded":"2024-09-13T05:11:25.732108+0000","last_fullsized":"2024-09-13T05:11:25.732108+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:12:03.977067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076234800000000004,"stat_sum":{"num_bytes":14822156,"num_objects":65,"num_object_clones":6,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":32,"num_read":1436,"num_read_kb":2480,"num_write":548,"num_write_kb":3551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":2629215,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.628233+0000","last_change":"2024-09-13T05:10:37.864940+0000","last_active":"2024-09-13T05:11:24.628233+0000","last_peered":"2024-09-13T05:11:24.628233+0000","last_clean":"2024-09-13T05:11:24.628233+0000","last_became_active":"2024-09-13T05:10:37.864623+0000","last_became_peered":"2024-09-13T05:10:37.864623+0000","last_unstale":"2024-09-13T05:11:24.628233+0000","last_undegraded":"2024-09-13T05:11:24.628233+0000","last_fullsized":"2024-09-13T05:11:24.628233+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:41.598490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.5","version":"89'330","reported_seq":2757,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.760457+0000","last_change":"2024-09-13T05:10:11.645960+0000","last_active":"2024-09-13T05:11:26.760457+0000","last_peered":"2024-09-13T05:11:26.760457+0000","last_clean":"2024-09-13T05:11:26.760457+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:11:26.760457+0000","last_undegraded":"2024-09-13T05:11:26.760457+0000","last_fullsized":"2024-09-13T05:11:26.760457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:40.372741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001054028,"stat_sum":{"num_bytes":83072727,"num_objects":75,"num_object_clones":10,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":27,"num_read":3783,"num_read_kb":55367,"num_write":310,"num_write_kb":38179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"89'448","reported_seq":2359,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.496232+0000","last_change":"2024-09-13T05:10:37.979816+0000","last_active":"2024-09-13T05:11:26.496232+0000","last_peered":"2024-09-13T05:11:26.496232+0000","last_clean":"2024-09-13T05:11:26.496232+0000","last_became_active":"2024-09-13T05:10:37.863256+0000","last_became_peered":"2024-09-13T05:10:37.863256+0000","last_unstale":"2024-09-13T05:11:26.496232+0000","last_undegraded":"2024-09-13T05:11:26.496232+0000","last_fullsized":"2024-09-13T05:11:26.496232+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:58:55.928356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099335200000000008,"stat_sum":{"num_bytes":57746614,"num_objects":65,"num_object_clones":9,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":34,"num_read":3165,"num_read_kb":22317,"num_write":551,"num_write_kb":26105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":214109,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":99,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.622403+0000","last_change":"2024-09-13T05:10:31.836193+0000","last_active":"2024-09-13T05:11:24.622403+0000","last_peered":"2024-09-13T05:11:24.622403+0000","last_clean":"2024-09-13T05:11:24.622403+0000","last_became_active":"2024-09-13T05:10:31.825663+0000","last_became_peered":"2024-09-13T05:10:31.825663+0000","last_unstale":"2024-09-13T05:11:24.622403+0000","last_undegraded":"2024-09-13T05:11:24.622403+0000","last_fullsized":"2024-09-13T05:11:24.622403+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:38:23.311570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"89'367","reported_seq":727,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.777407+0000","last_change":"2024-09-13T05:10:31.893494+0000","last_active":"2024-09-13T05:11:26.777407+0000","last_peered":"2024-09-13T05:11:26.777407+0000","last_clean":"2024-09-13T05:11:26.777407+0000","last_became_active":"2024-09-13T05:10:31.827657+0000","last_became_peered":"2024-09-13T05:10:31.827657+0000","last_unstale":"2024-09-13T05:11:26.777407+0000","last_undegraded":"2024-09-13T05:11:26.777407+0000","last_fullsized":"2024-09-13T05:11:26.777407+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:16:14.432049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045163499999999998,"stat_sum":{"num_bytes":13829861,"num_objects":70,"num_object_clones":12,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":33,"num_read":1008,"num_read_kb":2384,"num_write":395,"num_write_kb":3683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":84179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.624643+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:11:24.624643+0000","last_peered":"2024-09-13T05:11:24.624643+0000","last_clean":"2024-09-13T05:11:24.624643+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:11:24.624643+0000","last_undegraded":"2024-09-13T05:11:24.624643+0000","last_fullsized":"2024-09-13T05:11:24.624643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"87'207","reported_seq":732,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:25.737801+0000","last_change":"2024-09-13T05:10:38.111510+0000","last_active":"2024-09-13T05:11:25.737801+0000","last_peered":"2024-09-13T05:11:25.737801+0000","last_clean":"2024-09-13T05:11:25.737801+0000","last_became_active":"2024-09-13T05:10:37.869040+0000","last_became_peered":"2024-09-13T05:10:37.869040+0000","last_unstale":"2024-09-13T05:11:25.737801+0000","last_undegraded":"2024-09-13T05:11:25.737801+0000","last_fullsized":"2024-09-13T05:11:25.737801+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:48:18.385423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048152600000000002,"stat_sum":{"num_bytes":16774958,"num_objects":57,"num_object_clones":10,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":29,"num_read":482,"num_read_kb":10578,"num_write":188,"num_write_kb":8664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":383717,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":101,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.627920+0000","last_change":"2024-09-13T05:10:37.865514+0000","last_active":"2024-09-13T05:11:24.627920+0000","last_peered":"2024-09-13T05:11:24.627920+0000","last_clean":"2024-09-13T05:11:24.627920+0000","last_became_active":"2024-09-13T05:10:37.864299+0000","last_became_peered":"2024-09-13T05:10:37.864299+0000","last_unstale":"2024-09-13T05:11:24.627920+0000","last_undegraded":"2024-09-13T05:11:24.627920+0000","last_fullsized":"2024-09-13T05:11:24.627920+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:45:58.276509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"89'339","reported_seq":1822,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.789551+0000","last_change":"2024-09-13T05:11:23.619138+0000","last_active":"2024-09-13T05:11:26.789551+0000","last_peered":"2024-09-13T05:11:26.789551+0000","last_clean":"2024-09-13T05:11:26.789551+0000","last_became_active":"2024-09-13T05:11:23.617149+0000","last_became_peered":"2024-09-13T05:11:23.617149+0000","last_unstale":"2024-09-13T05:11:26.789551+0000","last_undegraded":"2024-09-13T05:11:26.789551+0000","last_fullsized":"2024-09-13T05:11:26.789551+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:55:46.203366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059320200000000003,"stat_sum":{"num_bytes":24461676,"num_objects":65,"num_object_clones":6,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":30,"num_read":2867,"num_read_kb":4727,"num_write":285,"num_write_kb":4635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":2822984,"num_keys_recovered":34,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":86,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.622607+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:11:24.622607+0000","last_peered":"2024-09-13T05:11:24.622607+0000","last_clean":"2024-09-13T05:11:24.622607+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:11:24.622607+0000","last_undegraded":"2024-09-13T05:11:24.622607+0000","last_fullsized":"2024-09-13T05:11:24.622607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":254,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.627940+0000","last_change":"2024-09-13T05:10:40.886011+0000","last_active":"2024-09-13T05:11:24.627940+0000","last_peered":"2024-09-13T05:11:24.627940+0000","last_clean":"2024-09-13T05:11:24.627940+0000","last_became_active":"2024-09-13T05:10:40.885587+0000","last_became_peered":"2024-09-13T05:10:40.885587+0000","last_unstale":"2024-09-13T05:11:24.627940+0000","last_undegraded":"2024-09-13T05:11:24.627940+0000","last_fullsized":"2024-09-13T05:11:24.627940+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:52:47.632734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"89'235","reported_seq":521,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.554743+0000","last_change":"2024-09-13T05:10:31.888827+0000","last_active":"2024-09-13T05:11:26.554743+0000","last_peered":"2024-09-13T05:11:26.554743+0000","last_clean":"2024-09-13T05:11:26.554743+0000","last_became_active":"2024-09-13T05:10:31.827016+0000","last_became_peered":"2024-09-13T05:10:31.827016+0000","last_unstale":"2024-09-13T05:11:26.554743+0000","last_undegraded":"2024-09-13T05:11:26.554743+0000","last_fullsized":"2024-09-13T05:11:26.554743+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:47.525525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000500144,"stat_sum":{"num_bytes":8108737,"num_objects":72,"num_object_clones":9,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":38,"num_read":267,"num_read_kb":3264,"num_write":190,"num_write_kb":25883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":58925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"87'249","reported_seq":5943,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:25.730515+0000","last_change":"2024-09-13T05:10:11.648218+0000","last_active":"2024-09-13T05:11:25.730515+0000","last_peered":"2024-09-13T05:11:25.730515+0000","last_clean":"2024-09-13T05:11:25.730515+0000","last_became_active":"2024-09-13T05:10:09.645408+0000","last_became_peered":"2024-09-13T05:10:09.645408+0000","last_unstale":"2024-09-13T05:11:25.730515+0000","last_undegraded":"2024-09-13T05:11:25.730515+0000","last_fullsized":"2024-09-13T05:11:25.730515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:59.846981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097828900000000002,"stat_sum":{"num_bytes":28865123,"num_objects":58,"num_object_clones":7,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":25,"num_read":6933,"num_read_kb":20348,"num_write":203,"num_write_kb":5400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"87'386","reported_seq":8630,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:25.738756+0000","last_change":"2024-09-13T05:10:47.940550+0000","last_active":"2024-09-13T05:11:25.738756+0000","last_peered":"2024-09-13T05:11:25.738756+0000","last_clean":"2024-09-13T05:11:25.738756+0000","last_became_active":"2024-09-13T05:10:47.939220+0000","last_became_peered":"2024-09-13T05:10:47.939220+0000","last_unstale":"2024-09-13T05:11:25.738756+0000","last_undegraded":"2024-09-13T05:11:25.738756+0000","last_fullsized":"2024-09-13T05:11:25.738756+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:59.693041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013204619999999999,"stat_sum":{"num_bytes":8329791,"num_objects":66,"num_object_clones":10,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":34,"num_read":8768,"num_read_kb":14369,"num_write":434,"num_write_kb":8000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":59,"num_bytes_recovered":6203954,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"89'268","reported_seq":2057,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.794145+0000","last_change":"2024-09-13T05:10:38.007507+0000","last_active":"2024-09-13T05:11:26.794145+0000","last_peered":"2024-09-13T05:11:26.794145+0000","last_clean":"2024-09-13T05:11:26.794145+0000","last_became_active":"2024-09-13T05:10:37.868643+0000","last_became_peered":"2024-09-13T05:10:37.868643+0000","last_unstale":"2024-09-13T05:11:26.794145+0000","last_undegraded":"2024-09-13T05:11:26.794145+0000","last_fullsized":"2024-09-13T05:11:26.794145+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:29:05.387242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055343700000000005,"stat_sum":{"num_bytes":6059553,"num_objects":65,"num_object_clones":11,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":36,"num_read":2160,"num_read_kb":6670,"num_write":222,"num_write_kb":6553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":15854,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"87'160","reported_seq":540,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:25.732927+0000","last_change":"2024-09-13T05:10:11.647302+0000","last_active":"2024-09-13T05:11:25.732927+0000","last_peered":"2024-09-13T05:11:25.732927+0000","last_clean":"2024-09-13T05:11:25.732927+0000","last_became_active":"2024-09-13T05:10:09.647037+0000","last_became_peered":"2024-09-13T05:10:09.647037+0000","last_unstale":"2024-09-13T05:11:25.732927+0000","last_undegraded":"2024-09-13T05:11:25.732927+0000","last_fullsized":"2024-09-13T05:11:25.732927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:54:17.061326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069994199999999995,"stat_sum":{"num_bytes":25886754,"num_objects":59,"num_object_clones":9,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":28,"num_read":383,"num_read_kb":4719,"num_write":138,"num_write_kb":3497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"85'546","reported_seq":3961,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.628455+0000","last_change":"2024-09-13T05:11:23.617596+0000","last_active":"2024-09-13T05:11:24.628455+0000","last_peered":"2024-09-13T05:11:24.628455+0000","last_clean":"2024-09-13T05:11:24.628455+0000","last_became_active":"2024-09-13T05:11:23.616962+0000","last_became_peered":"2024-09-13T05:11:23.616962+0000","last_unstale":"2024-09-13T05:11:24.628455+0000","last_undegraded":"2024-09-13T05:11:24.628455+0000","last_fullsized":"2024-09-13T05:11:24.628455+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:19.035337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019283150000000001,"stat_sum":{"num_bytes":68127174,"num_objects":71,"num_object_clones":8,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":31,"num_read":4875,"num_read_kb":14530,"num_write":695,"num_write_kb":8080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":12781016,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"89'735","reported_seq":5358,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.496496+0000","last_change":"2024-09-13T05:11:25.646827+0000","last_active":"2024-09-13T05:11:26.496496+0000","last_peered":"2024-09-13T05:11:26.496496+0000","last_clean":"2024-09-13T05:11:26.496496+0000","last_became_active":"2024-09-13T05:11:25.644857+0000","last_became_peered":"2024-09-13T05:11:25.644857+0000","last_unstale":"2024-09-13T05:11:26.496496+0000","last_undegraded":"2024-09-13T05:11:26.496496+0000","last_fullsized":"2024-09-13T05:11:26.496496+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:39.872264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018982339999999999,"stat_sum":{"num_bytes":21050383,"num_objects":63,"num_object_clones":5,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":33,"num_read":6254,"num_read_kb":6904,"num_write":1100,"num_write_kb":5201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":8639919,"num_keys_recovered":36,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"87'577","reported_seq":1759,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:25.733033+0000","last_change":"2024-09-13T05:10:40.885332+0000","last_active":"2024-09-13T05:11:25.733033+0000","last_peered":"2024-09-13T05:11:25.733033+0000","last_clean":"2024-09-13T05:11:25.733033+0000","last_became_active":"2024-09-13T05:10:40.884585+0000","last_became_peered":"2024-09-13T05:10:40.884585+0000","last_unstale":"2024-09-13T05:11:25.733033+0000","last_undegraded":"2024-09-13T05:11:25.733033+0000","last_fullsized":"2024-09-13T05:11:25.733033+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:31:19.596080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001164273,"stat_sum":{"num_bytes":18538959,"num_objects":65,"num_object_clones":9,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":34,"num_read":3439,"num_read_kb":11077,"num_write":818,"num_write_kb":6513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":296075,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"87'309","reported_seq":1880,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.633636+0000","last_change":"2024-09-13T05:11:23.617697+0000","last_active":"2024-09-13T05:11:24.633636+0000","last_peered":"2024-09-13T05:11:24.633636+0000","last_clean":"2024-09-13T05:11:24.633636+0000","last_became_active":"2024-09-13T05:11:23.617017+0000","last_became_peered":"2024-09-13T05:11:23.617017+0000","last_unstale":"2024-09-13T05:11:24.633636+0000","last_undegraded":"2024-09-13T05:11:24.633636+0000","last_fullsized":"2024-09-13T05:11:24.633636+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:26:44.551305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009951719999999999,"stat_sum":{"num_bytes":34835027,"num_objects":74,"num_object_clones":5,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":32,"num_read":1889,"num_read_kb":14082,"num_write":318,"num_write_kb":7118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":11923520,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"82'208","reported_seq":640,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T05:11:24.628021+0000","last_change":"2024-09-13T05:10:11.680757+0000","last_active":"2024-09-13T05:11:24.628021+0000","last_peered":"2024-09-13T05:11:24.628021+0000","last_clean":"2024-09-13T05:11:24.628021+0000","last_became_active":"2024-09-13T05:10:09.653444+0000","last_became_peered":"2024-09-13T05:10:09.653444+0000","last_unstale":"2024-09-13T05:11:24.628021+0000","last_undegraded":"2024-09-13T05:11:24.628021+0000","last_fullsized":"2024-09-13T05:11:24.628021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:17:06.303008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000625977,"stat_sum":{"num_bytes":11696067,"num_objects":69,"num_object_clones":9,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":37,"num_read":452,"num_read_kb":11506,"num_write":170,"num_write_kb":4690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"87'658","reported_seq":2298,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:25.733853+0000","last_change":"2024-09-13T05:10:40.884306+0000","last_active":"2024-09-13T05:11:25.733853+0000","last_peered":"2024-09-13T05:11:25.733853+0000","last_clean":"2024-09-13T05:11:25.733853+0000","last_became_active":"2024-09-13T05:10:40.883543+0000","last_became_peered":"2024-09-13T05:10:40.883543+0000","last_unstale":"2024-09-13T05:11:25.733853+0000","last_undegraded":"2024-09-13T05:11:25.733853+0000","last_fullsized":"2024-09-13T05:11:25.733853+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:14:23.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048307200000000003,"stat_sum":{"num_bytes":60338401,"num_objects":65,"num_object_clones":11,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":28,"num_read":4577,"num_read_kb":20718,"num_write":922,"num_write_kb":6694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":633324,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"89'738","reported_seq":2380,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-13T05:11:26.766471+0000","last_change":"2024-09-13T05:10:11.680877+0000","last_active":"2024-09-13T05:11:26.766471+0000","last_peered":"2024-09-13T05:11:26.766471+0000","last_clean":"2024-09-13T05:11:26.766471+0000","last_became_active":"2024-09-13T05:10:09.649053+0000","last_became_peered":"2024-09-13T05:10:09.649053+0000","last_unstale":"2024-09-13T05:11:26.766471+0000","last_undegraded":"2024-09-13T05:11:26.766471+0000","last_fullsized":"2024-09-13T05:11:26.766471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:14.770260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062821800000000005,"stat_sum":{"num_bytes":45220932,"num_objects":82,"num_object_clones":14,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":39,"num_read":4460,"num_read_kb":50978,"num_write":1066,"num_write_kb":38617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":940810033,"num_objects":2140,"num_object_clones":298,"num_object_copies":4280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2140,"num_whiteouts":1016,"num_read":94115,"num_read_kb":449774,"num_write":13269,"num_write_kb":288131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1978,"num_bytes_recovered":69274998,"num_keys_recovered":233,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":302874624,"data_stored":345644465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11653,"ondisk_log_size":11653,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128544,"kb_used_data":75288,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94243296,"statfs":{"total":96636764160,"available":96505135104,"internally_reserved":0,"allocated":77094912,"data_stored":85877130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":54524363},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":1.073},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.67600000000000005}]},{"osd":1,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.012}]},{"osd":2,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.878},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.1910000000000001}]},{"osd":3,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.252}]},{"osd":4,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.91700000000000004}]},{"osd":5,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.113},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.0469999999999999}]},{"osd":6,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.1619999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75224,"kb_used_data":31816,"kb_used_omap":1,"kb_used_meta":43390,"kb_avail":94296616,"statfs":{"total":96636764160,"available":96559734784,"internally_reserved":0,"allocated":32579584,"data_stored":36070496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44431815},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.075},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.3069999999999999}]},{"osd":1,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.85899999999999999}]},{"osd":2,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.1759999999999999}]},{"osd":3,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.98199999999999998}]},{"osd":4,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.258},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.04}]},{"osd":5,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1.333},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.357}]},{"osd":7,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.2809999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123376,"kb_used_data":70116,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94248464,"statfs":{"total":96636764160,"available":96510427136,"internally_reserved":0,"allocated":71798784,"data_stored":78219638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.745},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.83699999999999997}]},{"osd":2,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.878},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.85799999999999998}]},{"osd":3,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.67700000000000005}]},{"osd":4,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.80700000000000005}]},{"osd":6,"last update":"Fri Sep 13 05:10:58 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.63600000000000001}]},{"osd":7,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.90000000000000002}]}]},{"osd":4,"up_from":0,"seq":55834574872,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100148,"kb_used_data":69028,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94271692,"statfs":{"total":96636764160,"available":96534212608,"internally_reserved":0,"allocated":70684672,"data_stored":81271751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.93400000000000005}]},{"osd":1,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.73099999999999998}]},{"osd":2,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.78800000000000003}]},{"osd":4,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.874},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.236}]},{"osd":5,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.76300000000000001}]},{"osd":6,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.302},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.91500000000000004}]},{"osd":7,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.002},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.0669999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83776,"kb_used_data":42884,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94288064,"statfs":{"total":96636764160,"available":96550977536,"internally_reserved":0,"allocated":43913216,"data_stored":48995877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.94999999999999996}]},{"osd":1,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.73899999999999999}]},{"osd":3,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":1.169}]},{"osd":4,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":1.046},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.232}]},{"osd":5,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.278},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.256}]},{"osd":6,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.2030000000000001},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.353}]},{"osd":7,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.125},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.083}]}]},{"osd":1,"up_from":0,"seq":55834574870,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":0,"seq":55834574872,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10035200,"data_stored":11939429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6619136,"data_stored":10238144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42823680,"data_stored":48479819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69767168,"data_stored":80912116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69988352,"data_stored":76990845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28270592,"data_stored":32349608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":75370496,"data_stored":84734504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:11:31.344 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-13T05:11:31.344 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:11:31.344 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-13T05:11:31.344 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-13T05:11:31.347 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:31.347 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:31.349 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #29, image image_client.0-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent30 2024-09-13T05:11:31.359 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:11:31.403 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:31.397+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:31.504 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:31.497+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:31.505 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:31.505 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:31.509 INFO:teuthology.orchestra.run.smithi120.stdout:3837 trunc from 0x8c9c07a to 0x4e03bfa 2024-09-13T05:11:31.518 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:11:31.605 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:31.604+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:31.653 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:31.653 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:31.656 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:31.656 INFO:teuthology.orchestra.run.smithi120.stdout:3839 read 0x3dc143 thru 0x3e39de (0x789c bytes) 2024-09-13T05:11:31.663 INFO:teuthology.orchestra.run.smithi120.stdout:3840 trunc from 0x4e03bfa to 0x8d33361 2024-09-13T05:11:31.665 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:11:31.674 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:31.674 INFO:teuthology.orchestra.run.smithi120.stdout:3842 write 0x72119e2 thru 0x721f164 (0xd783 bytes) 2024-09-13T05:11:31.678 INFO:teuthology.orchestra.run.smithi120.stdout:3843 read 0x76cec9f thru 0x76d636a (0x76cc bytes) 2024-09-13T05:11:31.681 INFO:teuthology.orchestra.run.smithi120.stdout:3844 trunc from 0x8d33361 to 0xaaea905 2024-09-13T05:11:31.702 INFO:teuthology.orchestra.run.smithi120.stdout:3845 writesame 0xcc46221 thru 0xcc55fea data_size 0x2(0xfdca bytes) 2024-09-13T05:11:31.706 INFO:teuthology.orchestra.run.smithi120.stdout:3846 read 0x64544da thru 0x645c285 (0x7dac bytes) 2024-09-13T05:11:31.706 INFO:teuthology.orchestra.run.smithi120.stdout:3847 write 0xb1e91e6 thru 0xb1ef1cb (0x5fe6 bytes) 2024-09-13T05:11:31.706 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:31.704+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:31.708 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:31.720 INFO:teuthology.orchestra.run.smithi120.stdout:3849 writesame 0xd9292e2 thru 0xd93443c data_size 0x1(0xb15b bytes) 2024-09-13T05:11:31.722 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:11:31.722 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:31.722 INFO:teuthology.orchestra.run.smithi120.stdout: "epoch": 92, 2024-09-13T05:11:31.722 INFO:teuthology.orchestra.run.smithi120.stdout: "fsid": "0a3759da-62bd-4704-8a4a-7c20eb3fc816", 2024-09-13T05:11:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: "created": "2024-09-13T05:09:38.849186+0000", 2024-09-13T05:11:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: "modified": "2024-09-13T05:11:30.661348+0000", 2024-09-13T05:11:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: "last_up_change": "2024-09-13T05:09:51.283212+0000", 2024-09-13T05:11:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: "last_in_change": "2024-09-13T05:10:36.835155+0000", 2024-09-13T05:11:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T05:11:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_num": 5799936, 2024-09-13T05:11:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_set": [ 2024-09-13T05:11:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: "pglog_hardlimit", 2024-09-13T05:11:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: "purged_snapdirs", 2024-09-13T05:11:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: "recovery_deletes", 2024-09-13T05:11:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: "sortbitwise" 2024-09-13T05:11:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:11:31.723 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_version": 4, 2024-09-13T05:11:31.724 INFO:teuthology.orchestra.run.smithi120.stdout: "full_ratio": 0.94999998807907104, 2024-09-13T05:11:31.724 INFO:teuthology.orchestra.run.smithi120.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-13T05:11:31.724 INFO:teuthology.orchestra.run.smithi120.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-13T05:11:31.724 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_snapshot": "", 2024-09-13T05:11:31.724 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_max": 3, 2024-09-13T05:11:31.724 INFO:teuthology.orchestra.run.smithi120.stdout: "max_osd": 8, 2024-09-13T05:11:31.724 INFO:teuthology.orchestra.run.smithi120.stdout: "require_min_compat_client": "luminous", 2024-09-13T05:11:31.724 INFO:teuthology.orchestra.run.smithi120.stdout: "min_compat_client": "luminous", 2024-09-13T05:11:31.724 INFO:teuthology.orchestra.run.smithi120.stdout: "require_osd_release": "reef", 2024-09-13T05:11:31.724 INFO:teuthology.orchestra.run.smithi120.stdout: "allow_crimson": false, 2024-09-13T05:11:31.724 INFO:teuthology.orchestra.run.smithi120.stdout: "pools": [ 2024-09-13T05:11:31.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.724 INFO:teuthology.orchestra.run.smithi120.stdout: "pool": 1, 2024-09-13T05:11:31.724 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": ".mgr", 2024-09-13T05:11:31.725 INFO:teuthology.orchestra.run.smithi120.stdout: "create_time": "2024-09-13T05:09:52.225455+0000", 2024-09-13T05:11:31.725 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-13T05:11:31.725 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_names": "hashpspool", 2024-09-13T05:11:31.725 INFO:teuthology.orchestra.run.smithi120.stdout: "type": 1, 2024-09-13T05:11:31.725 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 2, 2024-09-13T05:11:31.725 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": 1, 2024-09-13T05:11:31.725 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_rule": 0, 2024-09-13T05:11:31.725 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_count": 0, 2024-09-13T05:11:31.725 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_target": 0, 2024-09-13T05:11:31.725 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T05:11:31.725 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T05:11:31.725 INFO:teuthology.orchestra.run.smithi120.stdout: "object_hash": 2, 2024-09-13T05:11:31.726 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscale_mode": "off", 2024-09-13T05:11:31.726 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": 1, 2024-09-13T05:11:31.726 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num": 1, 2024-09-13T05:11:31.726 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num_target": 1, 2024-09-13T05:11:31.726 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_target": 1, 2024-09-13T05:11:31.726 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_pending": 1, 2024-09-13T05:11:31.726 INFO:teuthology.orchestra.run.smithi120.stdout: "last_pg_merge_meta": { 2024-09-13T05:11:31.726 INFO:teuthology.orchestra.run.smithi120.stdout: "source_pgid": "0.0", 2024-09-13T05:11:31.726 INFO:teuthology.orchestra.run.smithi120.stdout: "ready_epoch": 0, 2024-09-13T05:11:31.726 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_started": 0, 2024-09-13T05:11:31.726 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_clean": 0, 2024-09-13T05:11:31.726 INFO:teuthology.orchestra.run.smithi120.stdout: "source_version": "0'0", 2024-09-13T05:11:31.726 INFO:teuthology.orchestra.run.smithi120.stdout: "target_version": "0'0" 2024-09-13T05:11:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: "last_change": "16", 2024-09-13T05:11:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend": "0", 2024-09-13T05:11:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T05:11:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T05:11:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: "auid": 0, 2024-09-13T05:11:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_mode": "selfmanaged", 2024-09-13T05:11:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_seq": 0, 2024-09-13T05:11:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_epoch": 0, 2024-09-13T05:11:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_snaps": [], 2024-09-13T05:11:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: "removed_snaps": "[]", 2024-09-13T05:11:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_bytes": 0, 2024-09-13T05:11:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_objects": 0, 2024-09-13T05:11:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: "tiers": [], 2024-09-13T05:11:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: "tier_of": -1, 2024-09-13T05:11:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: "read_tier": -1, 2024-09-13T05:11:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: "write_tier": -1, 2024-09-13T05:11:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_mode": "none", 2024-09-13T05:11:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_bytes": 0, 2024-09-13T05:11:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_objects": 0, 2024-09-13T05:11:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T05:11:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T05:11:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T05:11:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_flush_age": 0, 2024-09-13T05:11:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_evict_age": 0, 2024-09-13T05:11:31.728 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_profile": "", 2024-09-13T05:11:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_params": { 2024-09-13T05:11:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "none" 2024-09-13T05:11:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_period": 0, 2024-09-13T05:11:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_count": 0, 2024-09-13T05:11:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: "use_gmt_hitset": true, 2024-09-13T05:11:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: "min_read_recency_for_promote": 0, 2024-09-13T05:11:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: "min_write_recency_for_promote": 0, 2024-09-13T05:11:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T05:11:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_search_last_n": 0, 2024-09-13T05:11:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: "grade_table": [], 2024-09-13T05:11:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: "stripe_width": 0, 2024-09-13T05:11:31.729 INFO:teuthology.orchestra.run.smithi120.stdout: "expected_num_objects": 0, 2024-09-13T05:11:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: "fast_read": false, 2024-09-13T05:11:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: "options": { 2024-09-13T05:11:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_max": 32, 2024-09-13T05:11:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_min": 1 2024-09-13T05:11:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: "application_metadata": { 2024-09-13T05:11:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": {} 2024-09-13T05:11:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: "read_balance": { 2024-09-13T05:11:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: "score_acting": 8, 2024-09-13T05:11:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: "score_stable": 8, 2024-09-13T05:11:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: "optimal_score": 0.25, 2024-09-13T05:11:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_acting": 2, 2024-09-13T05:11:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_stable": 2, 2024-09-13T05:11:31.730 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity_weighted": 0.97846031188964844, 2024-09-13T05:11:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-13T05:11:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-13T05:11:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: "pool": 2, 2024-09-13T05:11:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": "rbd", 2024-09-13T05:11:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: "create_time": "2024-09-13T05:09:57.858552+0000", 2024-09-13T05:11:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 8193, 2024-09-13T05:11:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T05:11:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: "type": 1, 2024-09-13T05:11:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 2, 2024-09-13T05:11:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": 1, 2024-09-13T05:11:31.731 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_rule": 0, 2024-09-13T05:11:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_count": 0, 2024-09-13T05:11:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_target": 0, 2024-09-13T05:11:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T05:11:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T05:11:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: "object_hash": 2, 2024-09-13T05:11:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscale_mode": "off", 2024-09-13T05:11:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": 8, 2024-09-13T05:11:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num": 8, 2024-09-13T05:11:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num_target": 8, 2024-09-13T05:11:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_target": 8, 2024-09-13T05:11:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_pending": 8, 2024-09-13T05:11:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: "last_pg_merge_meta": { 2024-09-13T05:11:31.732 INFO:teuthology.orchestra.run.smithi120.stdout: "source_pgid": "0.0", 2024-09-13T05:11:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: "ready_epoch": 0, 2024-09-13T05:11:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_started": 0, 2024-09-13T05:11:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_clean": 0, 2024-09-13T05:11:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: "source_version": "0'0", 2024-09-13T05:11:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: "target_version": "0'0" 2024-09-13T05:11:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: "last_change": "20", 2024-09-13T05:11:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend": "0", 2024-09-13T05:11:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T05:11:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T05:11:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: "auid": 0, 2024-09-13T05:11:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_mode": "selfmanaged", 2024-09-13T05:11:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_seq": 3, 2024-09-13T05:11:31.733 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_epoch": 20, 2024-09-13T05:11:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_snaps": [], 2024-09-13T05:11:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: "removed_snaps": "[]", 2024-09-13T05:11:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_bytes": 0, 2024-09-13T05:11:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_objects": 0, 2024-09-13T05:11:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: "tiers": [], 2024-09-13T05:11:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: "tier_of": -1, 2024-09-13T05:11:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: "read_tier": -1, 2024-09-13T05:11:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: "write_tier": -1, 2024-09-13T05:11:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_mode": "none", 2024-09-13T05:11:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_bytes": 0, 2024-09-13T05:11:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_objects": 0, 2024-09-13T05:11:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T05:11:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T05:11:31.734 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T05:11:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_flush_age": 0, 2024-09-13T05:11:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_evict_age": 0, 2024-09-13T05:11:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_profile": "", 2024-09-13T05:11:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_params": { 2024-09-13T05:11:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "none" 2024-09-13T05:11:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_period": 0, 2024-09-13T05:11:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_count": 0, 2024-09-13T05:11:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: "use_gmt_hitset": true, 2024-09-13T05:11:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: "min_read_recency_for_promote": 0, 2024-09-13T05:11:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: "min_write_recency_for_promote": 0, 2024-09-13T05:11:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T05:11:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_search_last_n": 0, 2024-09-13T05:11:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: "grade_table": [], 2024-09-13T05:11:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "stripe_width": 0, 2024-09-13T05:11:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "expected_num_objects": 0, 2024-09-13T05:11:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "fast_read": false, 2024-09-13T05:11:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "options": {}, 2024-09-13T05:11:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "application_metadata": { 2024-09-13T05:11:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd": {} 2024-09-13T05:11:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "read_balance": { 2024-09-13T05:11:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "score_acting": 2.9800000190734863, 2024-09-13T05:11:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "score_stable": 2.9800000190734863, 2024-09-13T05:11:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "optimal_score": 0.62999999523162842, 2024-09-13T05:11:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_acting": 1.8799999952316284, 2024-09-13T05:11:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_stable": 1.8799999952316284, 2024-09-13T05:11:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity_weighted": 0.97846031188964844, 2024-09-13T05:11:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-13T05:11:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-13T05:11:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "pool": 3, 2024-09-13T05:11:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": "pool_client.0", 2024-09-13T05:11:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "create_time": "2024-09-13T05:10:07.742110+0000", 2024-09-13T05:11:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 8193, 2024-09-13T05:11:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T05:11:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "type": 1, 2024-09-13T05:11:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 2, 2024-09-13T05:11:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": 1, 2024-09-13T05:11:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_rule": 0, 2024-09-13T05:11:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_count": 0, 2024-09-13T05:11:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_target": 0, 2024-09-13T05:11:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T05:11:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T05:11:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "object_hash": 2, 2024-09-13T05:11:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscale_mode": "off", 2024-09-13T05:11:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": 32, 2024-09-13T05:11:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num": 32, 2024-09-13T05:11:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num_target": 32, 2024-09-13T05:11:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_target": 32, 2024-09-13T05:11:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_pending": 32, 2024-09-13T05:11:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "last_pg_merge_meta": { 2024-09-13T05:11:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "source_pgid": "0.0", 2024-09-13T05:11:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "ready_epoch": 0, 2024-09-13T05:11:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_started": 0, 2024-09-13T05:11:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_clean": 0, 2024-09-13T05:11:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: "source_version": "0'0", 2024-09-13T05:11:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: "target_version": "0'0" 2024-09-13T05:11:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: "last_change": "92", 2024-09-13T05:11:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend": "0", 2024-09-13T05:11:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T05:11:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T05:11:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "auid": 0, 2024-09-13T05:11:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_mode": "selfmanaged", 2024-09-13T05:11:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_seq": 34, 2024-09-13T05:11:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_epoch": 92, 2024-09-13T05:11:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_snaps": [], 2024-09-13T05:11:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "removed_snaps": "[]", 2024-09-13T05:11:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_bytes": 0, 2024-09-13T05:11:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_objects": 0, 2024-09-13T05:11:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "tiers": [], 2024-09-13T05:11:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "tier_of": -1, 2024-09-13T05:11:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "read_tier": -1, 2024-09-13T05:11:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "write_tier": -1, 2024-09-13T05:11:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_mode": "none", 2024-09-13T05:11:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_bytes": 0, 2024-09-13T05:11:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_objects": 0, 2024-09-13T05:11:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T05:11:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T05:11:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T05:11:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_flush_age": 0, 2024-09-13T05:11:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_evict_age": 0, 2024-09-13T05:11:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_profile": "", 2024-09-13T05:11:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_params": { 2024-09-13T05:11:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "none" 2024-09-13T05:11:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_period": 0, 2024-09-13T05:11:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_count": 0, 2024-09-13T05:11:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "use_gmt_hitset": true, 2024-09-13T05:11:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "min_read_recency_for_promote": 0, 2024-09-13T05:11:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "min_write_recency_for_promote": 0, 2024-09-13T05:11:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T05:11:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_search_last_n": 0, 2024-09-13T05:11:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "grade_table": [], 2024-09-13T05:11:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "stripe_width": 0, 2024-09-13T05:11:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "expected_num_objects": 0, 2024-09-13T05:11:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "fast_read": false, 2024-09-13T05:11:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "options": {}, 2024-09-13T05:11:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "application_metadata": { 2024-09-13T05:11:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd": {} 2024-09-13T05:11:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "read_balance": { 2024-09-13T05:11:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "score_acting": 2.4800000190734863, 2024-09-13T05:11:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "score_stable": 2.4800000190734863, 2024-09-13T05:11:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "optimal_score": 0.62999999523162842, 2024-09-13T05:11:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_acting": 1.559999942779541, 2024-09-13T05:11:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_stable": 1.559999942779541, 2024-09-13T05:11:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity_weighted": 0.97846031188964844, 2024-09-13T05:11:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-13T05:11:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-13T05:11:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:11:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "osds": [ 2024-09-13T05:11:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 0, 2024-09-13T05:11:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "b304ec03-bb00-4b13-bf2d-71017b8a70a3", 2024-09-13T05:11:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:11:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 0, 2024-09-13T05:11:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 0, 2024-09-13T05:11:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:11:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:11:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:11:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:11:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 40, 2024-09-13T05:11:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:11:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:11:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:11:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6800", 2024-09-13T05:11:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3487103682 2024-09-13T05:11:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6801", 2024-09-13T05:11:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3487103682 2024-09-13T05:11:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:11:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6802", 2024-09-13T05:11:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3487103682 2024-09-13T05:11:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6803", 2024-09-13T05:11:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3487103682 2024-09-13T05:11:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:11:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6806", 2024-09-13T05:11:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3487103682 2024-09-13T05:11:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6807", 2024-09-13T05:11:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3487103682 2024-09-13T05:11:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:11:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6804", 2024-09-13T05:11:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3487103682 2024-09-13T05:11:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6805", 2024-09-13T05:11:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3487103682 2024-09-13T05:11:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.120:6801/3487103682", 2024-09-13T05:11:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.120:6803/3487103682", 2024-09-13T05:11:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.120:6807/3487103682", 2024-09-13T05:11:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.120:6805/3487103682", 2024-09-13T05:11:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:11:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:11:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:11:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 1, 2024-09-13T05:11:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "c09e84f3-3a70-46a4-b67b-c9bb52c887b7", 2024-09-13T05:11:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:11:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 0, 2024-09-13T05:11:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 0, 2024-09-13T05:11:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:11:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:11:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:11:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:11:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 22, 2024-09-13T05:11:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:11:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:11:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:11:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6808", 2024-09-13T05:11:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:11:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6809", 2024-09-13T05:11:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:11:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:11:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6810", 2024-09-13T05:11:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:11:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6811", 2024-09-13T05:11:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:11:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:11:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6814", 2024-09-13T05:11:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:11:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6815", 2024-09-13T05:11:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:11:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:11:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6812", 2024-09-13T05:11:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:11:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6813", 2024-09-13T05:11:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:11:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.120:6809/1023532100", 2024-09-13T05:11:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.120:6811/1023532100", 2024-09-13T05:11:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.120:6815/1023532100", 2024-09-13T05:11:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.120:6813/1023532100", 2024-09-13T05:11:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:11:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:11:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:11:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 2, 2024-09-13T05:11:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "3c2a0458-369c-4dac-90a3-fb20cb70d53f", 2024-09-13T05:11:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:11:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:11:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:11:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:11:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:11:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:11:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:11:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 86, 2024-09-13T05:11:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:11:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:11:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:11:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6816", 2024-09-13T05:11:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:11:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6817", 2024-09-13T05:11:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:11:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:11:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6818", 2024-09-13T05:11:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:11:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6819", 2024-09-13T05:11:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:11:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:11:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6822", 2024-09-13T05:11:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:11:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6823", 2024-09-13T05:11:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:11:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:11:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6820", 2024-09-13T05:11:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:11:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6821", 2024-09-13T05:11:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:11:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.120:6817/592498012", 2024-09-13T05:11:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.120:6819/592498012", 2024-09-13T05:11:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.120:6823/592498012", 2024-09-13T05:11:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.120:6821/592498012", 2024-09-13T05:11:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:11:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:11:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:11:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 3, 2024-09-13T05:11:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "edce3757-5e9d-4221-a1f1-3f356bb5218b", 2024-09-13T05:11:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:11:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:11:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:11:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:11:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:11:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:11:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:11:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 86, 2024-09-13T05:11:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:11:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:11:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:11:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6824", 2024-09-13T05:11:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:11:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6825", 2024-09-13T05:11:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:11:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:11:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6826", 2024-09-13T05:11:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:11:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6827", 2024-09-13T05:11:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:11:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:11:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6830", 2024-09-13T05:11:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:11:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6831", 2024-09-13T05:11:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:11:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:11:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6828", 2024-09-13T05:11:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:11:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6829", 2024-09-13T05:11:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:11:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.120:6825/1939753938", 2024-09-13T05:11:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.120:6827/1939753938", 2024-09-13T05:11:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.120:6831/1939753938", 2024-09-13T05:11:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.120:6829/1939753938", 2024-09-13T05:11:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:11:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:11:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:11:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 4, 2024-09-13T05:11:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "5fe378d2-578f-41ea-980a-4673a8b376df", 2024-09-13T05:11:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:11:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 0, 2024-09-13T05:11:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 0, 2024-09-13T05:11:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:11:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:11:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:11:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:11:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 0, 2024-09-13T05:11:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:11:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:11:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:11:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6824", 2024-09-13T05:11:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:11:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6825", 2024-09-13T05:11:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:11:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:11:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6826", 2024-09-13T05:11:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:11:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6827", 2024-09-13T05:11:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:11:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:11:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6830", 2024-09-13T05:11:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:11:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6831", 2024-09-13T05:11:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:11:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:11:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6828", 2024-09-13T05:11:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:11:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6829", 2024-09-13T05:11:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:11:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.137:6825/3005075615", 2024-09-13T05:11:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.137:6827/3005075615", 2024-09-13T05:11:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.137:6831/3005075615", 2024-09-13T05:11:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.137:6829/3005075615", 2024-09-13T05:11:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:11:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:11:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:11:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 5, 2024-09-13T05:11:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "6e6f7499-ae9e-4cb1-9db7-4d9f8fd9b257", 2024-09-13T05:11:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:11:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:11:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:11:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:11:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:11:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:11:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:11:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 87, 2024-09-13T05:11:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:11:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:11:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:11:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6800", 2024-09-13T05:11:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:11:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6801", 2024-09-13T05:11:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:11:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:11:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6802", 2024-09-13T05:11:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:11:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6803", 2024-09-13T05:11:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:11:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:11:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6806", 2024-09-13T05:11:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:11:31.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6807", 2024-09-13T05:11:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:11:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:11:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6804", 2024-09-13T05:11:31.777 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:11:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6805", 2024-09-13T05:11:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:11:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.137:6801/1108177522", 2024-09-13T05:11:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.137:6803/1108177522", 2024-09-13T05:11:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.137:6807/1108177522", 2024-09-13T05:11:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.137:6805/1108177522", 2024-09-13T05:11:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:11:31.779 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:11:31.779 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:11:31.779 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.779 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 6, 2024-09-13T05:11:31.779 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "e4c519e5-5df4-4d55-b12e-fbcfb1b0555c", 2024-09-13T05:11:31.779 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:11:31.779 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:11:31.779 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:11:31.779 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 0.8276824951171875, 2024-09-13T05:11:31.779 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:11:31.779 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:11:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:11:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 86, 2024-09-13T05:11:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:11:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:11:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:11:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6816", 2024-09-13T05:11:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:11:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.781 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.781 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6817", 2024-09-13T05:11:31.781 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:11:31.781 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.781 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.781 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:11:31.781 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.781 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.781 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6818", 2024-09-13T05:11:31.781 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:11:31.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6819", 2024-09-13T05:11:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:11:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:11:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6822", 2024-09-13T05:11:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:11:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6823", 2024-09-13T05:11:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:11:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:11:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6820", 2024-09-13T05:11:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:11:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.783 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.784 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6821", 2024-09-13T05:11:31.784 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:11:31.784 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.784 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.784 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.137:6817/2667039053", 2024-09-13T05:11:31.784 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.137:6819/2667039053", 2024-09-13T05:11:31.784 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.137:6823/2667039053", 2024-09-13T05:11:31.784 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.137:6821/2667039053", 2024-09-13T05:11:31.784 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:11:31.784 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:11:31.784 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:11:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 7, 2024-09-13T05:11:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "914648c2-7a6c-4e66-811d-936e250638db", 2024-09-13T05:11:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:11:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:11:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:11:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:11:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:11:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:11:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:11:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 88, 2024-09-13T05:11:31.785 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:11:31.786 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:11:31.786 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:11:31.786 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.786 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.786 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6808", 2024-09-13T05:11:31.786 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:11:31.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.786 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.786 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6809", 2024-09-13T05:11:31.786 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:11:31.786 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:11:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6810", 2024-09-13T05:11:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:11:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6811", 2024-09-13T05:11:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:11:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.788 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.788 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:11:31.788 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.788 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.788 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6814", 2024-09-13T05:11:31.788 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:11:31.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.788 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.788 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6815", 2024-09-13T05:11:31.788 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:11:31.788 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:11:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6812", 2024-09-13T05:11:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:11:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6813", 2024-09-13T05:11:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:11:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.137:6809/993764921", 2024-09-13T05:11:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.137:6811/993764921", 2024-09-13T05:11:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.137:6815/993764921", 2024-09-13T05:11:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.137:6813/993764921", 2024-09-13T05:11:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:11:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:11:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:11:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:11:31.790 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_xinfo": [ 2024-09-13T05:11:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 0, 2024-09-13T05:11:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:11:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:11:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:11:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:11:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 65536, 2024-09-13T05:11:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:46.914820+0000", 2024-09-13T05:11:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:11:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 1, 2024-09-13T05:11:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:11:31.791 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:11:31.792 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:11:31.792 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:11:31.792 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 65536, 2024-09-13T05:11:31.792 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.326286+0000", 2024-09-13T05:11:31.792 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:11:31.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.792 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 2, 2024-09-13T05:11:31.792 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:11:31.792 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:11:31.792 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:11:31.792 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:11:31.792 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:11:31.792 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.147193+0000", 2024-09-13T05:11:31.793 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:11:31.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.793 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 3, 2024-09-13T05:11:31.793 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:11:31.793 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:11:31.793 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:11:31.793 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:11:31.793 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:11:31.793 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.478655+0000", 2024-09-13T05:11:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:11:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 4, 2024-09-13T05:11:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:11:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:11:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:11:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:11:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 65536, 2024-09-13T05:11:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.388938+0000", 2024-09-13T05:11:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:11:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 5, 2024-09-13T05:11:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:11:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:11:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:11:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:11:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:11:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.127175+0000", 2024-09-13T05:11:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:11:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 6, 2024-09-13T05:11:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:11:31.795 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:11:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:11:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:11:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:11:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.187286+0000", 2024-09-13T05:11:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:11:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 7, 2024-09-13T05:11:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:11:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:11:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:11:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:11:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:11:31.796 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:46.962119+0000", 2024-09-13T05:11:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:11:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:11:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_upmap": [ 2024-09-13T05:11:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: "pgid": "3.a", 2024-09-13T05:11:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: "osds": [ 2024-09-13T05:11:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: 3, 2024-09-13T05:11:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: 2 2024-09-13T05:11:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:11:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_upmap_items": [], 2024-09-13T05:11:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_upmap_primaries": [], 2024-09-13T05:11:31.797 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_temp": [], 2024-09-13T05:11:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_temp": [], 2024-09-13T05:11:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: "blocklist": {}, 2024-09-13T05:11:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: "range_blocklist": {}, 2024-09-13T05:11:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_profiles": { 2024-09-13T05:11:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: "default": { 2024-09-13T05:11:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: "crush-failure-domain": "osd", 2024-09-13T05:11:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: "k": "2", 2024-09-13T05:11:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: "m": "1", 2024-09-13T05:11:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: "plugin": "jerasure", 2024-09-13T05:11:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: "technique": "reed_sol_van" 2024-09-13T05:11:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: "removed_snaps_queue": [], 2024-09-13T05:11:31.798 INFO:teuthology.orchestra.run.smithi120.stdout: "new_removed_snaps": [], 2024-09-13T05:11:31.799 INFO:teuthology.orchestra.run.smithi120.stdout: "new_purged_snaps": [], 2024-09-13T05:11:31.799 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_node_flags": {}, 2024-09-13T05:11:31.799 INFO:teuthology.orchestra.run.smithi120.stdout: "device_class_flags": {}, 2024-09-13T05:11:31.799 INFO:teuthology.orchestra.run.smithi120.stdout: "stretch_mode": { 2024-09-13T05:11:31.799 INFO:teuthology.orchestra.run.smithi120.stdout: "stretch_mode_enabled": false, 2024-09-13T05:11:31.799 INFO:teuthology.orchestra.run.smithi120.stdout: "stretch_bucket_count": 0, 2024-09-13T05:11:31.799 INFO:teuthology.orchestra.run.smithi120.stdout: "degraded_stretch_mode": 0, 2024-09-13T05:11:31.799 INFO:teuthology.orchestra.run.smithi120.stdout: "recovering_stretch_mode": 0, 2024-09-13T05:11:31.799 INFO:teuthology.orchestra.run.smithi120.stdout: "stretch_mode_bucket": 0 2024-09-13T05:11:31.799 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:31.799 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:31.800 INFO:teuthology.orchestra.run.smithi120.stdout:3851 writesame 0x1743b49 thru 0x174fe36 data_size 0x3(0xc2ee bytes) 2024-09-13T05:11:31.801 INFO:tasks.thrashosds.thrasher:j is {'epoch': 92, 'fsid': '0a3759da-62bd-4704-8a4a-7c20eb3fc816', 'created': '2024-09-13T05:09:38.849186+0000', 'modified': '2024-09-13T05:11:30.661348+0000', 'last_up_change': '2024-09-13T05:09:51.283212+0000', 'last_in_change': '2024-09-13T05:10:36.835155+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T05:09:52.225455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9784603118896484, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T05:09:57.858552+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.9800000190734863, 'score_stable': 2.9800000190734863, 'optimal_score': 0.6299999952316284, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9784603118896484, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-13T05:10:07.742110+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 34, 'snap_epoch': 92, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.4800000190734863, 'score_stable': 2.4800000190734863, 'optimal_score': 0.6299999952316284, 'raw_score_acting': 1.559999942779541, 'raw_score_stable': 1.559999942779541, 'primary_affinity_weighted': 0.9784603118896484, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}], 'osds': [{'osd': 0, 'uuid': 'b304ec03-bb00-4b13-bf2d-71017b8a70a3', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6800', 'nonce': 3487103682}, {'type': 'v1', 'addr': '172.21.15.120:6801', 'nonce': 3487103682}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6802', 'nonce': 3487103682}, {'type': 'v1', 'addr': '172.21.15.120:6803', 'nonce': 3487103682}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6806', 'nonce': 3487103682}, {'type': 'v1', 'addr': '172.21.15.120:6807', 'nonce': 3487103682}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6804', 'nonce': 3487103682}, {'type': 'v1', 'addr': '172.21.15.120:6805', 'nonce': 3487103682}]}, 'public_addr': '172.21.15.120:6801/3487103682', 'cluster_addr': '172.21.15.120:6803/3487103682', 'heartbeat_back_addr': '172.21.15.120:6807/3487103682', 'heartbeat_front_addr': '172.21.15.120:6805/3487103682', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'c09e84f3-3a70-46a4-b67b-c9bb52c887b7', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6808', 'nonce': 1023532100}, {'type': 'v1', 'addr': '172.21.15.120:6809', 'nonce': 1023532100}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6810', 'nonce': 1023532100}, {'type': 'v1', 'addr': '172.21.15.120:6811', 'nonce': 1023532100}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6814', 'nonce': 1023532100}, {'type': 'v1', 'addr': '172.21.15.120:6815', 'nonce': 1023532100}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6812', 'nonce': 1023532100}, {'type': 'v1', 'addr': '172.21.15.120:6813', 'nonce': 1023532100}]}, 'public_addr': '172.21.15.120:6809/1023532100', 'cluster_addr': '172.21.15.120:6811/1023532100', 'heartbeat_back_addr': '172.21.15.120:6815/1023532100', 'heartbeat_front_addr': '172.21.15.120:6813/1023532100', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '3c2a0458-369c-4dac-90a3-fb20cb70d53f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 86, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6816', 'nonce': 592498012}, {'type': 'v1', 'addr': '172.21.15.120:6817', 'nonce': 592498012}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6818', 'nonce': 592498012}, {'type': 'v1', 'addr': '172.21.15.120:6819', 'nonce': 592498012}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6822', 'nonce': 592498012}, {'type': 'v1', 'addr': '172.21.15.120:6823', 'nonce': 592498012}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6820', 'nonce': 592498012}, {'type': 'v1', 'addr': '172.21.15.120:6821', 'nonce': 592498012}]}, 'public_addr': '172.21.15.120:6817/592498012', 'cluster_addr': '172.21.15.120:6819/592498012', 'heartbeat_back_addr': '172.21.15.120:6823/592498012', 'heartbeat_front_addr': '172.21.15.120:6821/592498012', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'edce3757-5e9d-4221-a1f1-3f356bb5218b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 86, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6824', 'nonce': 1939753938}, {'type': 'v1', 'addr': '172.21.15.120:6825', 'nonce': 1939753938}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6826', 'nonce': 1939753938}, {'type': 'v1', 'addr': '172.21.15.120:6827', 'nonce': 1939753938}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6830', 'nonce': 1939753938}, {'type': 'v1', 'addr': '172.21.15.120:6831', 'nonce': 1939753938}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6828', 'nonce': 1939753938}, {'type': 'v1', 'addr': '172.21.15.120:6829', 'nonce': 1939753938}]}, 'public_addr': '172.21.15.120:6825/1939753938', 'cluster_addr': '172.21.15.120:6827/1939753938', 'heartbeat_back_addr': '172.21.15.120:6831/1939753938', 'heartbeat_front_addr': '172.21.15.120:6829/1939753938', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '5fe378d2-578f-41ea-980a-4673a8b376df', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6824', 'nonce': 3005075615}, {'type': 'v1', 'addr': '172.21.15.137:6825', 'nonce': 3005075615}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6826', 'nonce': 3005075615}, {'type': 'v1', 'addr': '172.21.15.137:6827', 'nonce': 3005075615}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6830', 'nonce': 3005075615}, {'type': 'v1', 'addr': '172.21.15.137:6831', 'nonce': 3005075615}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6828', 'nonce': 3005075615}, {'type': 'v1', 'addr': '172.21.15.137:6829', 'nonce': 3005075615}]}, 'public_addr': '172.21.15.137:6825/3005075615', 'cluster_addr': '172.21.15.137:6827/3005075615', 'heartbeat_back_addr': '172.21.15.137:6831/3005075615', 'heartbeat_front_addr': '172.21.15.137:6829/3005075615', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '6e6f7499-ae9e-4cb1-9db7-4d9f8fd9b257', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 87, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6800', 'nonce': 1108177522}, {'type': 'v1', 'addr': '172.21.15.137:6801', 'nonce': 1108177522}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6802', 'nonce': 1108177522}, {'type': 'v1', 'addr': '172.21.15.137:6803', 'nonce': 1108177522}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6806', 'nonce': 1108177522}, {'type': 'v1', 'addr': '172.21.15.137:6807', 'nonce': 1108177522}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6804', 'nonce': 1108177522}, {'type': 'v1', 'addr': '172.21.15.137:6805', 'nonce': 1108177522}]}, 'public_addr': '172.21.15.137:6801/1108177522', 'cluster_addr': '172.21.15.137:6803/1108177522', 'heartbeat_back_addr': '172.21.15.137:6807/1108177522', 'heartbeat_front_addr': '172.21.15.137:6805/1108177522', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e4c519e5-5df4-4d55-b12e-fbcfb1b0555c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.8276824951171875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 86, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6816', 'nonce': 2667039053}, {'type': 'v1', 'addr': '172.21.15.137:6817', 'nonce': 2667039053}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6818', 'nonce': 2667039053}, {'type': 'v1', 'addr': '172.21.15.137:6819', 'nonce': 2667039053}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6822', 'nonce': 2667039053}, {'type': 'v1', 'addr': '172.21.15.137:6823', 'nonce': 2667039053}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6820', 'nonce': 2667039053}, {'type': 'v1', 'addr': '172.21.15.137:6821', 'nonce': 2667039053}]}, 'public_addr': '172.21.15.137:6817/2667039053', 'cluster_addr': '172.21.15.137:6819/2667039053', 'heartbeat_back_addr': '172.21.15.137:6823/2667039053', 'heartbeat_front_addr': '172.21.15.137:6821/2667039053', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '914648c2-7a6c-4e66-811d-936e250638db', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 88, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6808', 'nonce': 993764921}, {'type': 'v1', 'addr': '172.21.15.137:6809', 'nonce': 993764921}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6810', 'nonce': 993764921}, {'type': 'v1', 'addr': '172.21.15.137:6811', 'nonce': 993764921}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6814', 'nonce': 993764921}, {'type': 'v1', 'addr': '172.21.15.137:6815', 'nonce': 993764921}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6812', 'nonce': 993764921}, {'type': 'v1', 'addr': '172.21.15.137:6813', 'nonce': 993764921}]}, 'public_addr': '172.21.15.137:6809/993764921', 'cluster_addr': '172.21.15.137:6811/993764921', 'heartbeat_back_addr': '172.21.15.137:6815/993764921', 'heartbeat_front_addr': '172.21.15.137:6813/993764921', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T05:09:46.914820+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.326286+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.147193+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.478655+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.388938+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.127175+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.187286+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:46.962119+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.a', 'osds': [3, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-13T05:11:31.801 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-13T05:11:31.802 INFO:teuthology.orchestra.run.smithi120.stdout:3852 trunc from 0xd93443d to 0x50fb0e4 2024-09-13T05:11:31.802 INFO:teuthology.orchestra.run.smithi120.stdout:3853 writesame 0x9c9fa7b thru 0x9caee0c data_size 0x1(0xf392 bytes) 2024-09-13T05:11:31.803 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:31.803 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:31.803 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:11:31.804 INFO:teuthology.orchestra.run.smithi120.stdout:3854 writesame 0xd42640d thru 0xd42cd44 data_size 0xe(0x6938 bytes) 2024-09-13T05:11:31.804 INFO:teuthology.orchestra.run.smithi120.stdout:3855 punch from 0x501bc06 to 0x501d0bf, (0x14b9 bytes) 2024-09-13T05:11:31.807 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:31.801+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:31.814 INFO:teuthology.orchestra.run.smithi120.stdout:3857 write 0xdf13644 thru 0xdf21b94 (0xe551 bytes) 2024-09-13T05:11:31.817 INFO:teuthology.orchestra.run.smithi120.stdout:3858 writesame 0xabfd341 thru 0xac005b9 data_size 0x3b(0x3279 bytes) 2024-09-13T05:11:31.820 INFO:teuthology.orchestra.run.smithi120.stdout:3859 write 0xa565a3e thru 0xa5671e4 (0x17a7 bytes) 2024-09-13T05:11:31.823 INFO:teuthology.orchestra.run.smithi120.stdout:3861 read 0x4f7043d thru 0x4f77194 (0x6d58 bytes) 2024-09-13T05:11:31.823 INFO:teuthology.orchestra.run.smithi120.stdout:3862 read 0xdc2a085 thru 0xdc33afc (0x9a78 bytes) 2024-09-13T05:11:31.824 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:31.824 INFO:teuthology.orchestra.run.smithi120.stdout:3865 write 0xc3a19bd thru 0xc3a2bc4 (0x1208 bytes) 2024-09-13T05:11:31.829 INFO:teuthology.orchestra.run.smithi120.stdout:3866 trunc from 0xdf21b95 to 0xcdb7aef 2024-09-13T05:11:31.843 INFO:teuthology.orchestra.run.smithi120.stdout:3867 write 0x79c5875 thru 0x79cb8c3 (0x604f bytes) 2024-09-13T05:11:31.846 INFO:teuthology.orchestra.run.smithi120.stdout:3869 punch from 0x8dc2f8d to 0x8dcce28, (0x9e9b bytes) 2024-09-13T05:11:31.846 INFO:teuthology.orchestra.run.smithi120.stdout:3870 writesame 0xa3b9c81 thru 0xa3ba37c data_size 0x1(0x6fc bytes) 2024-09-13T05:11:31.848 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:31.849 INFO:teuthology.orchestra.run.smithi120.stdout:3874 write 0x3e7c5b3 thru 0x3e89fde (0xda2c bytes) 2024-09-13T05:11:31.853 INFO:teuthology.orchestra.run.smithi120.stdout:3876 write 0x635d22f thru 0x6366aa5 (0x9877 bytes) 2024-09-13T05:11:31.855 INFO:teuthology.orchestra.run.smithi120.stdout:3878 trunc from 0xcdb7aef to 0xc2af913 2024-09-13T05:11:31.876 INFO:teuthology.orchestra.run.smithi120.stdout:3879 trunc from 0xc2af913 to 0x6d1dbec 2024-09-13T05:11:31.903 INFO:teuthology.orchestra.run.smithi120.stdout:3880 write 0x8066453 thru 0x806c378 (0x5f26 bytes) 2024-09-13T05:11:31.908 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:31.901+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:31.917 INFO:teuthology.orchestra.run.smithi120.stdout:3883 trunc from 0x806c379 to 0xdb3877c 2024-09-13T05:11:31.927 INFO:teuthology.orchestra.run.smithi120.stdout:3884 write 0xccf428b thru 0xcd03829 (0xf59f bytes) 2024-09-13T05:11:31.932 INFO:teuthology.orchestra.run.smithi120.stdout:3885 read 0x259e9b0 thru 0x25a66b9 (0x7d0a bytes) 2024-09-13T05:11:31.933 INFO:teuthology.orchestra.run.smithi120.stdout:3886 punch from 0xa0a9ea0 to 0xa0b8299, (0xe3f9 bytes) 2024-09-13T05:11:31.936 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:31.936 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:31.938 INFO:teuthology.orchestra.run.smithi120.stdout:3887 trunc from 0xdb3877c to 0xa78170c 2024-09-13T05:11:31.949 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:11:31.952 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:31.952 INFO:teuthology.orchestra.run.smithi120.stdout:3890 punch from 0x4113b26 to 0x41154fc, (0x19d6 bytes) 2024-09-13T05:11:31.952 INFO:teuthology.orchestra.run.smithi120.stdout:3894 write 0x76db480 thru 0x76ea994 (0xf515 bytes) 2024-09-13T05:11:31.954 INFO:teuthology.orchestra.run.smithi120.stdout:3895 writesame 0x2e4552a thru 0x2e4a08b data_size 0x1(0x4b62 bytes) 2024-09-13T05:11:31.969 INFO:teuthology.orchestra.run.smithi120.stdout:3897 read 0x5ec7ac4 thru 0x5ed3249 (0xb786 bytes) 2024-09-13T05:11:31.980 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:11:31.983 INFO:teuthology.orchestra.run.smithi120.stdout:3899 trunc from 0xa78170c to 0x28acc83 2024-09-13T05:11:32.009 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:32.008+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:32.018 INFO:teuthology.orchestra.run.smithi120.stdout:3901 writesame 0x721f9dc thru 0x722017a data_size 0x1(0x79f bytes) 2024-09-13T05:11:32.021 INFO:teuthology.orchestra.run.smithi120.stdout:3902 punch from 0x3bec575 to 0x3bef0ba, (0x2b45 bytes) 2024-09-13T05:11:32.037 INFO:teuthology.orchestra.run.smithi120.stdout:3904 write 0xb4e0083 thru 0xb4e4d08 (0x4c86 bytes) 2024-09-13T05:11:32.040 INFO:teuthology.orchestra.run.smithi120.stdout:3905 write 0x10b40ac thru 0x10c33a8 (0xf2fd bytes) 2024-09-13T05:11:32.043 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:32.043 INFO:teuthology.orchestra.run.smithi120.stdout:3907 writesame 0x5f81748 thru 0x5f8f11e data_size 0x3(0xd9d7 bytes) 2024-09-13T05:11:32.066 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:32.067 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:32.071 INFO:teuthology.orchestra.run.smithi120.stdout:3909 write 0xc01ac32 thru 0xc0285e4 (0xd9b3 bytes) 2024-09-13T05:11:32.075 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:32.075 INFO:teuthology.orchestra.run.smithi120.stdout:3912 punch from 0x6c5f45c to 0x6c63057, (0x3bfb bytes) 2024-09-13T05:11:32.075 INFO:teuthology.orchestra.run.smithi120.stdout:3913 punch from 0x288f7ee to 0x2899e8f, (0xa6a1 bytes) 2024-09-13T05:11:32.075 INFO:teuthology.orchestra.run.smithi120.stdout:3914 read 0x811747f thru 0x811f143 (0x7cc5 bytes) 2024-09-13T05:11:32.076 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:32.076 INFO:teuthology.orchestra.run.smithi120.stdout:3916 write 0x2f208f7 thru 0x2f303e0 (0xfaea bytes) 2024-09-13T05:11:32.079 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:11:32.093 INFO:teuthology.orchestra.run.smithi120.stdout:3917 trunc from 0xc0285e5 to 0x2b8eb7a 2024-09-13T05:11:32.107 INFO:teuthology.orchestra.run.smithi120.stdout:3918 read 0x1352ba4 thru 0x135e1e7 (0xb644 bytes) 2024-09-13T05:11:32.107 INFO:teuthology.orchestra.run.smithi120.stdout:3919 punch from 0x1f366d3 to 0x1f40464, (0x9d91 bytes) 2024-09-13T05:11:32.108 INFO:teuthology.orchestra.run.smithi120.stdout:3920 read 0x28a99ab thru 0x28b403a (0xa690 bytes) 2024-09-13T05:11:32.110 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:32.108+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:32.122 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:11:32.131 INFO:teuthology.orchestra.run.smithi120.stdout:3921 writesame 0xb45f7b8 thru 0xb46c774 data_size 0x13(0xcfbd bytes) 2024-09-13T05:11:32.142 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:11:32.150 INFO:teuthology.orchestra.run.smithi120.stdout:3922 trunc from 0xb46c775 to 0x1229ee8 2024-09-13T05:11:32.163 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:11:32.166 INFO:teuthology.orchestra.run.smithi120.stdout:3924 punch from 0xa2ccbd to 0xa32596, (0x58d9 bytes) 2024-09-13T05:11:32.174 INFO:teuthology.orchestra.run.smithi120.stdout:3927 write 0x186661f thru 0x186c70c (0x60ee bytes) 2024-09-13T05:11:32.177 INFO:teuthology.orchestra.run.smithi120.stdout:3929 punch from 0x1051c3f to 0x1053767, (0x1b28 bytes) 2024-09-13T05:11:32.177 INFO:teuthology.orchestra.run.smithi120.stdout:3930 trunc from 0x186c70d to 0x1972d4d 2024-09-13T05:11:32.184 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:11:32.205 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26335 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1207296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.471774175999997, 2024-09-13T05:11:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055338125000000002, 2024-09-13T05:11:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26335 2024-09-13T05:11:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730550+0000", 2024-09-13T05:11:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998579 2024-09-13T05:11:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730705+0000", 2024-09-13T05:11:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015463400000000001 2024-09-13T05:11:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730713+0000", 2024-09-13T05:11:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1580000000000005e-06 2024-09-13T05:11:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730719+0000", 2024-09-13T05:11:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2740000000000004e-06 2024-09-13T05:11:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.785798+0000", 2024-09-13T05:11:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055079454 2024-09-13T05:11:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.785894+0000", 2024-09-13T05:11:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5896000000000005e-05 2024-09-13T05:11:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.786030+0000", 2024-09-13T05:11:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013586199999999999 2024-09-13T05:11:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26346 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1308672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.469632769, 2024-09-13T05:11:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055416737000000001, 2024-09-13T05:11:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26346 2024-09-13T05:11:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732833+0000", 2024-09-13T05:11:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732835+0000", 2024-09-13T05:11:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3719999999999999e-06 2024-09-13T05:11:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732839+0000", 2024-09-13T05:11:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1520000000000001e-06 2024-09-13T05:11:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732842+0000", 2024-09-13T05:11:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.061e-06 2024-09-13T05:11:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788126+0000", 2024-09-13T05:11:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055284489999999999 2024-09-13T05:11:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788183+0000", 2024-09-13T05:11:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7127999999999999e-05 2024-09-13T05:11:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788250+0000", 2024-09-13T05:11:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7001000000000004e-05 2024-09-13T05:11:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26348 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 800768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.469209945000003, 2024-09-13T05:11:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055321395000000002, 2024-09-13T05:11:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26348 2024-09-13T05:11:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733127+0000", 2024-09-13T05:11:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998703 2024-09-13T05:11:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733262+0000", 2024-09-13T05:11:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013484400000000001 2024-09-13T05:11:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733273+0000", 2024-09-13T05:11:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1824000000000001e-05 2024-09-13T05:11:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733281+0000", 2024-09-13T05:11:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9999999999999996e-06 2024-09-13T05:11:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788431+0000", 2024-09-13T05:11:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055149535 2024-09-13T05:11:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788490+0000", 2024-09-13T05:11:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9413999999999997e-05 2024-09-13T05:11:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788578+0000", 2024-09-13T05:11:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7418999999999998e-05 2024-09-13T05:11:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26368 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 985088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:11:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.465057748, 2024-09-13T05:11:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055320511000000003, 2024-09-13T05:11:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26368 2024-09-13T05:11:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:11:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737409+0000", 2024-09-13T05:11:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737408+0000", 2024-09-13T05:11:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737412+0000", 2024-09-13T05:11:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6279999999999998e-06 2024-09-13T05:11:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737419+0000", 2024-09-13T05:11:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1770000000000001e-06 2024-09-13T05:11:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.737425+0000", 2024-09-13T05:11:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6949999999999997e-06 2024-09-13T05:11:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792507+0000", 2024-09-13T05:11:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055082840000000001 2024-09-13T05:11:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792606+0000", 2024-09-13T05:11:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8697999999999996e-05 2024-09-13T05:11:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.792729+0000", 2024-09-13T05:11:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012298499999999999 2024-09-13T05:11:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26417 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 903168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.460997487999997, 2024-09-13T05:11:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055375191999999997, 2024-09-13T05:11:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26417 2024-09-13T05:11:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741468+0000", 2024-09-13T05:11:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741472+0000", 2024-09-13T05:11:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4139999999999998e-06 2024-09-13T05:11:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741478+0000", 2024-09-13T05:11:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5230000000000001e-06 2024-09-13T05:11:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741483+0000", 2024-09-13T05:11:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8559999999999998e-06 2024-09-13T05:11:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796655+0000", 2024-09-13T05:11:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055172153000000002 2024-09-13T05:11:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796738+0000", 2024-09-13T05:11:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2912999999999997e-05 2024-09-13T05:11:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796844+0000", 2024-09-13T05:11:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105802 2024-09-13T05:11:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26419 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 912384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.460973623000001, 2024-09-13T05:11:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055570469999999997, 2024-09-13T05:11:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26419 2024-09-13T05:11:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741492+0000", 2024-09-13T05:11:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741495+0000", 2024-09-13T05:11:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6369999999999999e-06 2024-09-13T05:11:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741508+0000", 2024-09-13T05:11:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3319000000000001e-05 2024-09-13T05:11:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741527+0000", 2024-09-13T05:11:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8542e-05 2024-09-13T05:11:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796871+0000", 2024-09-13T05:11:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055344474999999997 2024-09-13T05:11:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796967+0000", 2024-09-13T05:11:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5963000000000003e-05 2024-09-13T05:11:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797063+0000", 2024-09-13T05:11:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5909999999999995e-05 2024-09-13T05:11:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26421 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 921600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.460930320000003, 2024-09-13T05:11:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055631152000000003, 2024-09-13T05:11:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26421 2024-09-13T05:11:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741535+0000", 2024-09-13T05:11:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741540+0000", 2024-09-13T05:11:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1690000000000002e-06 2024-09-13T05:11:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741547+0000", 2024-09-13T05:11:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3409999999999997e-06 2024-09-13T05:11:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741552+0000", 2024-09-13T05:11:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5639999999999996e-06 2024-09-13T05:11:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797079+0000", 2024-09-13T05:11:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055526038999999999 2024-09-13T05:11:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797121+0000", 2024-09-13T05:11:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2156000000000001e-05 2024-09-13T05:11:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797167+0000", 2024-09-13T05:11:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6445e-05 2024-09-13T05:11:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26423 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 930816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.460537326999997, 2024-09-13T05:11:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055364370000000003, 2024-09-13T05:11:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26423 2024-09-13T05:11:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741928+0000", 2024-09-13T05:11:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741933+0000", 2024-09-13T05:11:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9980000000000003e-06 2024-09-13T05:11:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741945+0000", 2024-09-13T05:11:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1761e-05 2024-09-13T05:11:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741958+0000", 2024-09-13T05:11:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2604e-05 2024-09-13T05:11:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797185+0000", 2024-09-13T05:11:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055227169 2024-09-13T05:11:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797226+0000", 2024-09-13T05:11:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1619000000000003e-05 2024-09-13T05:11:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797293+0000", 2024-09-13T05:11:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6952999999999994e-05 2024-09-13T05:11:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26424 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 940032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.46050039, 2024-09-13T05:11:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055448669999999999, 2024-09-13T05:11:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26424 2024-09-13T05:11:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741965+0000", 2024-09-13T05:11:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741969+0000", 2024-09-13T05:11:32.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3440000000000001e-06 2024-09-13T05:11:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741983+0000", 2024-09-13T05:11:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4600000000000001e-05 2024-09-13T05:11:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741989+0000", 2024-09-13T05:11:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5350000000000004e-06 2024-09-13T05:11:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797319+0000", 2024-09-13T05:11:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055330121000000003 2024-09-13T05:11:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797364+0000", 2024-09-13T05:11:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5670000000000002e-05 2024-09-13T05:11:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797415+0000", 2024-09-13T05:11:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0124000000000003e-05 2024-09-13T05:11:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.245 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26426 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 949248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.460473190999998, 2024-09-13T05:11:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055639981999999998, 2024-09-13T05:11:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26426 2024-09-13T05:11:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.246 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:32.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741995+0000", 2024-09-13T05:11:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.661e-06 2024-09-13T05:11:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742004+0000", 2024-09-13T05:11:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2009999999999999e-06 2024-09-13T05:11:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742008+0000", 2024-09-13T05:11:32.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7890000000000002e-06 2024-09-13T05:11:32.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797432+0000", 2024-09-13T05:11:32.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055423448 2024-09-13T05:11:32.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797516+0000", 2024-09-13T05:11:32.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4404e-05 2024-09-13T05:11:32.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797633+0000", 2024-09-13T05:11:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116898 2024-09-13T05:11:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26427 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 958464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.460453135000002, 2024-09-13T05:11:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055829295000000001, 2024-09-13T05:11:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.250 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26427 2024-09-13T05:11:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:32.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742015+0000", 2024-09-13T05:11:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.74e-06 2024-09-13T05:11:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742023+0000", 2024-09-13T05:11:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7039999999999994e-06 2024-09-13T05:11:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742028+0000", 2024-09-13T05:11:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7369999999999997e-06 2024-09-13T05:11:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797666+0000", 2024-09-13T05:11:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055637820999999997 2024-09-13T05:11:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797748+0000", 2024-09-13T05:11:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1787999999999997e-05 2024-09-13T05:11:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797842+0000", 2024-09-13T05:11:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4903999999999998e-05 2024-09-13T05:11:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26432 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 976896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:32.254 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.459659973999997, 2024-09-13T05:11:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055402077000000001, 2024-09-13T05:11:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26432 2024-09-13T05:11:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742808+0000", 2024-09-13T05:11:32.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3319999999999999e-06 2024-09-13T05:11:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742818+0000", 2024-09-13T05:11:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5380000000000008e-06 2024-09-13T05:11:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742821+0000", 2024-09-13T05:11:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2179999999999999e-06 2024-09-13T05:11:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798027+0000", 2024-09-13T05:11:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055206344999999997 2024-09-13T05:11:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798103+0000", 2024-09-13T05:11:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5786999999999998e-05 2024-09-13T05:11:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798208+0000", 2024-09-13T05:11:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010521700000000001 2024-09-13T05:11:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26434 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 986112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.45964275, 2024-09-13T05:11:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055610109999999997, 2024-09-13T05:11:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.262 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26434 2024-09-13T05:11:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742823+0000", 2024-09-13T05:11:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742825+0000", 2024-09-13T05:11:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6220000000000001e-06 2024-09-13T05:11:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742828+0000", 2024-09-13T05:11:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.926e-06 2024-09-13T05:11:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742831+0000", 2024-09-13T05:11:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-13T05:11:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798239+0000", 2024-09-13T05:11:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055408254999999997 2024-09-13T05:11:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798326+0000", 2024-09-13T05:11:32.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7168000000000003e-05 2024-09-13T05:11:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798434+0000", 2024-09-13T05:11:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010767100000000001 2024-09-13T05:11:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26442 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1032192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.45837341, 2024-09-13T05:11:32.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055422776, 2024-09-13T05:11:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26442 2024-09-13T05:11:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744061+0000", 2024-09-13T05:11:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999685 2024-09-13T05:11:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744096+0000", 2024-09-13T05:11:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4771999999999998e-05 2024-09-13T05:11:32.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744147+0000", 2024-09-13T05:11:32.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0696999999999999e-05 2024-09-13T05:11:32.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744154+0000", 2024-09-13T05:11:32.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8510000000000001e-06 2024-09-13T05:11:32.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799324+0000", 2024-09-13T05:11:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055170074999999999 2024-09-13T05:11:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799415+0000", 2024-09-13T05:11:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1197000000000001e-05 2024-09-13T05:11:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799516+0000", 2024-09-13T05:11:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100666 2024-09-13T05:11:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26443 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1041408~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.458092839000003, 2024-09-13T05:11:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055344195999999998, 2024-09-13T05:11:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26443 2024-09-13T05:11:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744159+0000", 2024-09-13T05:11:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997849 2024-09-13T05:11:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744379+0000", 2024-09-13T05:11:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022024800000000001 2024-09-13T05:11:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744390+0000", 2024-09-13T05:11:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1105e-05 2024-09-13T05:11:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744397+0000", 2024-09-13T05:11:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2740000000000002e-06 2024-09-13T05:11:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799543+0000", 2024-09-13T05:11:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055145441000000003 2024-09-13T05:11:32.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799619+0000", 2024-09-13T05:11:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6660000000000001e-05 2024-09-13T05:11:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799718+0000", 2024-09-13T05:11:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8331000000000004e-05 2024-09-13T05:11:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26547 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1318912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.457906520999998, 2024-09-13T05:11:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055355834, 2024-09-13T05:11:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26547 2024-09-13T05:11:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744404+0000", 2024-09-13T05:11:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998441 2024-09-13T05:11:32.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744564+0000", 2024-09-13T05:11:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016022200000000001 2024-09-13T05:11:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744579+0000", 2024-09-13T05:11:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5036e-05 2024-09-13T05:11:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744585+0000", 2024-09-13T05:11:32.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7880000000000003e-06 2024-09-13T05:11:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799747+0000", 2024-09-13T05:11:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055161804000000002 2024-09-13T05:11:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799823+0000", 2024-09-13T05:11:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5956000000000003e-05 2024-09-13T05:11:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799916+0000", 2024-09-13T05:11:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2733999999999997e-05 2024-09-13T05:11:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26550 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1328128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:11:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.457650362000003, 2024-09-13T05:11:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055315941, 2024-09-13T05:11:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.280 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26550 2024-09-13T05:11:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:11:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744816+0000", 2024-09-13T05:11:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744591+0000", 2024-09-13T05:11:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997745 2024-09-13T05:11:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744821+0000", 2024-09-13T05:11:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023031899999999999 2024-09-13T05:11:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744833+0000", 2024-09-13T05:11:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1919000000000001e-05 2024-09-13T05:11:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744837+0000", 2024-09-13T05:11:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4989999999999996e-06 2024-09-13T05:11:32.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799947+0000", 2024-09-13T05:11:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055110120999999998 2024-09-13T05:11:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800030+0000", 2024-09-13T05:11:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2905999999999995e-05 2024-09-13T05:11:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800132+0000", 2024-09-13T05:11:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101529 2024-09-13T05:11:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26558 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1364992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.456915355, 2024-09-13T05:11:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055422765999999998, 2024-09-13T05:11:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.285 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26558 2024-09-13T05:11:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745550+0000", 2024-09-13T05:11:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745553+0000", 2024-09-13T05:11:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7690000000000001e-06 2024-09-13T05:11:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745559+0000", 2024-09-13T05:11:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3149999999999997e-06 2024-09-13T05:11:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745564+0000", 2024-09-13T05:11:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6670000000000004e-06 2024-09-13T05:11:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800791+0000", 2024-09-13T05:11:32.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055226711999999997 2024-09-13T05:11:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800865+0000", 2024-09-13T05:11:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4344000000000005e-05 2024-09-13T05:11:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800974+0000", 2024-09-13T05:11:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108606 2024-09-13T05:11:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.289 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26561 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1374208~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.456898301999999, 2024-09-13T05:11:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055549315000000002, 2024-09-13T05:11:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26561 2024-09-13T05:11:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.290 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:32.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:32.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745570+0000", 2024-09-13T05:11:32.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4719999999999998e-06 2024-09-13T05:11:32.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745575+0000", 2024-09-13T05:11:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1900000000000003e-06 2024-09-13T05:11:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745579+0000", 2024-09-13T05:11:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3250000000000001e-06 2024-09-13T05:11:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801000+0000", 2024-09-13T05:11:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055420432999999998 2024-09-13T05:11:32.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801061+0000", 2024-09-13T05:11:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1427000000000007e-05 2024-09-13T05:11:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801117+0000", 2024-09-13T05:11:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5933000000000001e-05 2024-09-13T05:11:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.295 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26582 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1447936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:32.295 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.455480661999999, 2024-09-13T05:11:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055394301, 2024-09-13T05:11:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26582 2024-09-13T05:11:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746985+0000", 2024-09-13T05:11:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:32.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746988+0000", 2024-09-13T05:11:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6479999999999999e-06 2024-09-13T05:11:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.747000+0000", 2024-09-13T05:11:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2009e-05 2024-09-13T05:11:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.747005+0000", 2024-09-13T05:11:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0039999999999999e-06 2024-09-13T05:11:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802232+0000", 2024-09-13T05:11:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055227762999999999 2024-09-13T05:11:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802320+0000", 2024-09-13T05:11:32.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7576000000000003e-05 2024-09-13T05:11:32.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802380+0000", 2024-09-13T05:11:32.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9888e-05 2024-09-13T05:11:32.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.300 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.300 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.300 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:32.302 INFO:teuthology.orchestra.run.smithi120.stdout:3931 write 0xafd0732 thru 0xafd2434 (0x1d03 bytes) 2024-09-13T05:11:32.302 INFO:teuthology.orchestra.run.smithi120.stdout:3933 write 0x390de30 thru 0x3917b20 (0x9cf1 bytes) 2024-09-13T05:11:32.303 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:11:32.303 INFO:teuthology.orchestra.run.smithi120.stdout:3934 read 0x5c08bd6 thru 0x5c0ea55 (0x5e80 bytes) 2024-09-13T05:11:32.303 INFO:teuthology.orchestra.run.smithi120.stdout:3936 writesame 0x1106a88 thru 0x110d58c data_size 0x1(0x6b05 bytes) 2024-09-13T05:11:32.304 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:11:32.304 INFO:teuthology.orchestra.run.smithi120.stdout:3937 punch from 0xa0219d8 to 0xa02b2bd, (0x98e5 bytes) 2024-09-13T05:11:32.304 INFO:teuthology.orchestra.run.smithi120.stdout:3938 read 0x47cf0ae thru 0x47d6d22 (0x7c75 bytes) 2024-09-13T05:11:32.304 INFO:teuthology.orchestra.run.smithi120.stdout:3939 punch from 0xa8a2aea to 0xa8a6776, (0x3c8c bytes) 2024-09-13T05:11:32.305 INFO:teuthology.orchestra.run.smithi120.stdout:3940 write 0x7e9b32d thru 0x7ea579c (0xa470 bytes) 2024-09-13T05:11:32.305 INFO:teuthology.orchestra.run.smithi120.stdout:3942 read 0x1d97688 thru 0x1d9c06b (0x49e4 bytes) 2024-09-13T05:11:32.305 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:32.305 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:11:32.305 INFO:teuthology.orchestra.run.smithi120.stdout:3944 trunc from 0xafd2435 to 0x3d330e1 2024-09-13T05:11:32.306 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:11:32.306 INFO:teuthology.orchestra.run.smithi120.stdout:3945 write 0x47736ee thru 0x4781df8 (0xe70b bytes) 2024-09-13T05:11:32.306 INFO:teuthology.orchestra.run.smithi120.stdout:3947 read 0x10eeaf9 thru 0x10f7ef3 (0x93fb bytes) 2024-09-13T05:11:32.306 INFO:teuthology.orchestra.run.smithi120.stdout:3948 read 0x3ce9ef6 thru 0x3cf6c75 (0xcd80 bytes) 2024-09-13T05:11:32.307 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:11:32.307 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:11:32.307 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:11:32.307 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:11:32.307 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:11:32.307 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:11:32.307 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:11:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:11:32.308 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:11:32.308 INFO:teuthology.orchestra.run.smithi120.stdout:3949 write 0x6a9b3ab thru 0x6aa55f8 (0xa24e bytes) 2024-09-13T05:11:32.309 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:32.297+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:32.310 INFO:teuthology.orchestra.run.smithi120.stdout:3950 trunc from 0x6aa55f9 to 0xd1de5a3 2024-09-13T05:11:32.319 INFO:teuthology.orchestra.run.smithi120.stdout:3952 read 0x2afe651 thru 0x2b0d011 (0xe9c1 bytes) 2024-09-13T05:11:32.320 INFO:teuthology.orchestra.run.smithi120.stdout:3953 write 0x8e74d14 thru 0x8e7ecd9 (0x9fc6 bytes) 2024-09-13T05:11:32.322 INFO:teuthology.orchestra.run.smithi120.stdout:3955 writesame 0x2068fe8 thru 0x207582d data_size 0xf(0xc846 bytes) 2024-09-13T05:11:32.330 INFO:teuthology.orchestra.run.smithi120.stdout:3956 punch from 0x8845f27 to 0x88554d2, (0xf5ab bytes) 2024-09-13T05:11:32.330 INFO:teuthology.orchestra.run.smithi120.stdout:3958 writesame 0xa94be50 thru 0xa956fc7 data_size 0x18(0xb178 bytes) 2024-09-13T05:11:32.346 INFO:teuthology.orchestra.run.smithi120.stdout:3962 writesame 0xdfc2fcc thru 0xdfcdb93 data_size 0x5c(0xabc8 bytes) 2024-09-13T05:11:32.348 INFO:teuthology.orchestra.run.smithi120.stdout:3963 write 0xaca0122 thru 0xacace56 (0xcd35 bytes) 2024-09-13T05:11:32.351 INFO:teuthology.orchestra.run.smithi120.stdout:3964 writesame 0xc1e42e4 thru 0xc1ead16 data_size 0x1(0x6a33 bytes) 2024-09-13T05:11:32.377 INFO:teuthology.orchestra.run.smithi120.stdout:3965 writesame 0x1a47b2 thru 0x1aec0a data_size 0x1(0xa459 bytes) 2024-09-13T05:11:32.403 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:32.400+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:32.413 INFO:teuthology.orchestra.run.smithi120.stdout:3966 trunc from 0xdfcdb94 to 0x8475403 2024-09-13T05:11:32.418 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:32.418 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:76674 3.18 3:19248ec6:::rbd_data.112d1f830c0e.0000000000000009:head [stat out=16b,zero 11534336~7340032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-13T05:11:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:32.413677+0000", 2024-09-13T05:11:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0034870930000000001, 2024-09-13T05:11:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035137419999999998, 2024-09-13T05:11:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.419 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 76674 2024-09-13T05:11:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.413677+0000", 2024-09-13T05:11:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.413677+0000", 2024-09-13T05:11:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.413676+0000", 2024-09-13T05:11:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.413681+0000", 2024-09-13T05:11:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7849999999999999e-06 2024-09-13T05:11:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.413690+0000", 2024-09-13T05:11:32.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7320000000000004e-06 2024-09-13T05:11:32.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.413696+0000", 2024-09-13T05:11:32.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3770000000000001e-06 2024-09-13T05:11:32.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.413806+0000", 2024-09-13T05:11:32.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110128 2024-09-13T05:11:32.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.413990+0000", 2024-09-13T05:11:32.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018319899999999999 2024-09-13T05:11:32.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.417191+0000", 2024-09-13T05:11:32.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032012379999999999 2024-09-13T05:11:32.424 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.424 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.424 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.425 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:76675 3.18 3:19b85071:::rbd_data.112d1f830c0e.000000000000000a:head [stat out=16b,truncate 11534336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-13T05:11:32.425 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:32.413715+0000", 2024-09-13T05:11:32.425 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003449536, 2024-09-13T05:11:32.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036616439999999999, 2024-09-13T05:11:32.425 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.425 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-13T05:11:32.425 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.426 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.426 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.426 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 76675 2024-09-13T05:11:32.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.426 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.413715+0000", 2024-09-13T05:11:32.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.413715+0000", 2024-09-13T05:11:32.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.413714+0000", 2024-09-13T05:11:32.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:32.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.413718+0000", 2024-09-13T05:11:32.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6540000000000001e-06 2024-09-13T05:11:32.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.413724+0000", 2024-09-13T05:11:32.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6969999999999996e-06 2024-09-13T05:11:32.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.413730+0000", 2024-09-13T05:11:32.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6670000000000001e-06 2024-09-13T05:11:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.414932+0000", 2024-09-13T05:11:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00120206 2024-09-13T05:11:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.415131+0000", 2024-09-13T05:11:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019847199999999999 2024-09-13T05:11:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-13T05:11:32.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.415378+0000", 2024-09-13T05:11:32.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024783500000000001 2024-09-13T05:11:32.431 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.431 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.431 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.431 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:76676 3.1 3:878cd14c:::rbd_data.112d1f830c0e.000000000000000b:head [stat out=16b,zero 11534336~7340032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-13T05:11:32.432 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:32.414492+0000", 2024-09-13T05:11:32.432 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002672064, 2024-09-13T05:11:32.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030527449999999999, 2024-09-13T05:11:32.433 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.433 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.433 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.433 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.433 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.434 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 76676 2024-09-13T05:11:32.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.434 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.414492+0000", 2024-09-13T05:11:32.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.414492+0000", 2024-09-13T05:11:32.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.414491+0000", 2024-09-13T05:11:32.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:32.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.414497+0000", 2024-09-13T05:11:32.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1529999999999996e-06 2024-09-13T05:11:32.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.415089+0000", 2024-09-13T05:11:32.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00059272299999999997 2024-09-13T05:11:32.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.415112+0000", 2024-09-13T05:11:32.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2872999999999999e-05 2024-09-13T05:11:32.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.415810+0000", 2024-09-13T05:11:32.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00069752099999999999 2024-09-13T05:11:32.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.416057+0000", 2024-09-13T05:11:32.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000247562 2024-09-13T05:11:32.439 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.439 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.439 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.439 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "pg_update_log_missing(3.5 epoch 92/22 rep_tid 2026 entries 92'352 (0'0) error 3:a67a9a85:::rbd_data.112d1f830c0e.0000000000000008:head by client.4397.0:76673 0.000000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 92'350)", 2024-09-13T05:11:32.439 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:32.415763+0000", 2024-09-13T05:11:32.439 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001401563, 2024-09-13T05:11:32.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018906120000000001, 2024-09-13T05:11:32.440 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.440 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:11:32.440 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.415763+0000", 2024-09-13T05:11:32.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.415763+0000", 2024-09-13T05:11:32.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.415761+0000", 2024-09-13T05:11:32.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:32.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.415783+0000", 2024-09-13T05:11:32.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2082999999999998e-05 2024-09-13T05:11:32.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.415816+0000", 2024-09-13T05:11:32.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2719000000000003e-05 2024-09-13T05:11:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.415845+0000", 2024-09-13T05:11:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8940000000000001e-05 2024-09-13T05:11:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.416149+0000", 2024-09-13T05:11:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030409300000000002 2024-09-13T05:11:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.444 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "pg_update_log_missing_reply(3.1 epoch 92/46 rep_tid 2358 lcod 92'229)", 2024-09-13T05:11:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:32.417680+0000", 2024-09-13T05:11:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9994836, 2024-09-13T05:11:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010228100000000001, 2024-09-13T05:11:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:11:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.417680+0000", 2024-09-13T05:11:32.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.417680+0000", 2024-09-13T05:11:32.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.417680+0000", 2024-09-13T05:11:32.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:32.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.417684+0000", 2024-09-13T05:11:32.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6659999999999999e-06 2024-09-13T05:11:32.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.417693+0000", 2024-09-13T05:11:32.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4360000000000002e-06 2024-09-13T05:11:32.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.417700+0000", 2024-09-13T05:11:32.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1659999999999997e-06 2024-09-13T05:11:32.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:32.417745+0000", 2024-09-13T05:11:32.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5027000000000001e-05 2024-09-13T05:11:32.451 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.451 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.451 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.451 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.452 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:11:32.452 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 5 2024-09-13T05:11:32.452 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:32.453 INFO:teuthology.orchestra.run.smithi120.stdout:3968 write 0x5a51fe8 thru 0x5a55eb8 (0x3ed1 bytes) 2024-09-13T05:11:32.453 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:32.455 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:11:32.455 INFO:teuthology.orchestra.run.smithi120.stdout:3972 write 0xc980888 thru 0xc985729 (0x4ea2 bytes) 2024-09-13T05:11:32.456 INFO:teuthology.orchestra.run.smithi120.stdout:3973 read 0xaea4846 thru 0xaea8e03 (0x45be bytes) 2024-09-13T05:11:32.456 INFO:teuthology.orchestra.run.smithi120.stdout:3974 punch from 0xe3b35c to 0xe426a9, (0x734d bytes) 2024-09-13T05:11:32.458 INFO:teuthology.orchestra.run.smithi120.stdout:3975 write 0xd4a807a thru 0xd4ac5f6 (0x457d bytes) 2024-09-13T05:11:32.466 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:32.466 INFO:teuthology.orchestra.run.smithi120.stdout:3978 write 0xaeb9fe0 thru 0xaebb9da (0x19fb bytes) 2024-09-13T05:11:32.466 INFO:teuthology.orchestra.run.smithi120.stdout:3979 read 0xb26b814 thru 0xb275023 (0x9810 bytes) 2024-09-13T05:11:32.466 INFO:teuthology.orchestra.run.smithi120.stdout:3980 write 0x1e26ef9 thru 0x1e2a0e4 (0x31ec bytes) 2024-09-13T05:11:32.469 INFO:teuthology.orchestra.run.smithi120.stdout:3981 write 0x4836a50 thru 0x483d7dd (0x6d8e bytes) 2024-09-13T05:11:32.473 INFO:teuthology.orchestra.run.smithi120.stdout:3982 write 0xaae44d5 thru 0xaaf3523 (0xf04f bytes) 2024-09-13T05:11:32.476 INFO:teuthology.orchestra.run.smithi120.stdout:3983 punch from 0x135c2da to 0x135d7e7, (0x150d bytes) 2024-09-13T05:11:32.476 INFO:teuthology.orchestra.run.smithi120.stdout:3984 write 0x5335de8 thru 0x533a3d1 (0x45ea bytes) 2024-09-13T05:11:32.480 INFO:teuthology.orchestra.run.smithi120.stdout:3985 write 0x1c865bb thru 0x1c8dd85 (0x77cb bytes) 2024-09-13T05:11:32.483 INFO:teuthology.orchestra.run.smithi120.stdout:3986 writesame 0x63800a6 thru 0x638525e data_size 0x1(0x51b9 bytes) 2024-09-13T05:11:32.501 INFO:teuthology.orchestra.run.smithi120.stdout:3987 read 0x209bf7b thru 0x20a4a97 (0x8b1d bytes) 2024-09-13T05:11:32.502 INFO:teuthology.orchestra.run.smithi120.stdout:3988 write 0x19e9eac thru 0x19eb323 (0x1478 bytes) 2024-09-13T05:11:32.503 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:32.500+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:32.520 INFO:teuthology.orchestra.run.smithi120.stdout:3989 write 0xe009b5d thru 0xe00e74c (0x4bf0 bytes) 2024-09-13T05:11:32.538 INFO:teuthology.orchestra.run.smithi120.stdout:3991 trunc from 0xe00e74d to 0x5daadf7 2024-09-13T05:11:32.553 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:32.568 INFO:teuthology.orchestra.run.smithi120.stdout:3993 writesame 0xa0766b0 thru 0xa07f670 data_size 0x57(0x8fc1 bytes) 2024-09-13T05:11:32.570 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:32.577 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:32.577 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:32.578 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:32.578 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:32.578 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:32.585 INFO:teuthology.orchestra.run.smithi120.stdout:3997 writesame 0xe765030 thru 0xe7708dc data_size 0x33(0xb8ad bytes) 2024-09-13T05:11:32.588 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:11:32.589 INFO:teuthology.orchestra.run.smithi120.stdout:3998 read 0x772b449 thru 0x7738762 (0xd31a bytes) 2024-09-13T05:11:32.589 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:32.589 INFO:teuthology.orchestra.run.smithi120.stdout:4002 write 0xa226e7e thru 0xa2283cf (0x1552 bytes) 2024-09-13T05:11:32.592 INFO:teuthology.orchestra.run.smithi120.stdout:4005 write 0x7702b21 thru 0x7708516 (0x59f6 bytes) 2024-09-13T05:11:32.595 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:32.595 INFO:teuthology.orchestra.run.smithi120.stdout:4008 punch from 0xcc88f11 to 0xcc96d50, (0xde3f bytes) 2024-09-13T05:11:32.595 INFO:teuthology.orchestra.run.smithi120.stdout:4009 write 0x19487b0 thru 0x194bc70 (0x34c1 bytes) 2024-09-13T05:11:32.599 INFO:teuthology.orchestra.run.smithi120.stdout:4010 read 0xbf9e297 thru 0xbfabac2 (0xd82c bytes) 2024-09-13T05:11:32.600 INFO:teuthology.orchestra.run.smithi120.stdout:4011 write 0x6fd2d3c thru 0x6fd3e9f (0x1164 bytes) 2024-09-13T05:11:32.602 INFO:teuthology.orchestra.run.smithi120.stdout:4012 read 0xc5521b1 thru 0xc553a9e (0x18ee bytes) 2024-09-13T05:11:32.603 INFO:teuthology.orchestra.run.smithi120.stdout:4014 punch from 0xacbf42c to 0xacc5397, (0x5f6b bytes) 2024-09-13T05:11:32.603 INFO:teuthology.orchestra.run.smithi120.stdout:4015 trunc from 0xe7708dd to 0xe3e7da1 2024-09-13T05:11:32.604 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:32.600+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:32.618 INFO:teuthology.orchestra.run.smithi120.stdout:4017 punch from 0x73b9e68 to 0x73c1de3, (0x7f7b bytes) 2024-09-13T05:11:32.618 INFO:teuthology.orchestra.run.smithi120.stdout:4018 punch from 0x53948c to 0x53b2af, (0x1e23 bytes) 2024-09-13T05:11:32.628 INFO:teuthology.orchestra.run.smithi120.stdout:4019 writesame 0xe908767 thru 0xe916276 data_size 0x8(0xdb10 bytes) 2024-09-13T05:11:32.631 INFO:teuthology.orchestra.run.smithi120.stdout:4021 read 0xe2d0fd4 thru 0xe2d3860 (0x288d bytes) 2024-09-13T05:11:32.631 INFO:teuthology.orchestra.run.smithi120.stdout:4022 read 0xe5dea36 thru 0xe5e8a77 (0xa042 bytes) 2024-09-13T05:11:32.632 INFO:teuthology.orchestra.run.smithi120.stdout:4024 punch from 0x19b15aa to 0x19bd5f4, (0xc04a bytes) 2024-09-13T05:11:32.632 INFO:teuthology.orchestra.run.smithi120.stdout:4025 write 0x324f144 thru 0x32503e4 (0x12a1 bytes) 2024-09-13T05:11:32.635 INFO:teuthology.orchestra.run.smithi120.stdout:4027 write 0x58f849 thru 0x592ac2 (0x327a bytes) 2024-09-13T05:11:32.639 INFO:teuthology.orchestra.run.smithi120.stdout:4028 write 0x8c87d0a thru 0x8c8ece9 (0x6fe0 bytes) 2024-09-13T05:11:32.642 INFO:teuthology.orchestra.run.smithi120.stdout:4029 write 0xe2c2717 thru 0xe2cf89a (0xd184 bytes) 2024-09-13T05:11:32.645 INFO:teuthology.orchestra.run.smithi120.stdout:4033 write 0xa39a7be thru 0xa3a5851 (0xb094 bytes) 2024-09-13T05:11:32.649 INFO:teuthology.orchestra.run.smithi120.stdout:4034 read 0x3eccd11 thru 0x3edc0c6 (0xf3b6 bytes) 2024-09-13T05:11:32.649 INFO:teuthology.orchestra.run.smithi120.stdout:4035 writesame 0x8db87f7 thru 0x8dbe82a data_size 0x5e(0x6034 bytes) 2024-09-13T05:11:32.652 INFO:teuthology.orchestra.run.smithi120.stdout:4036 write 0x7e2cc0a thru 0x7e38784 (0xbb7b bytes) 2024-09-13T05:11:32.656 INFO:teuthology.orchestra.run.smithi120.stdout:4037 read 0xa9e9f1b thru 0xa9ec2d4 (0x23ba bytes) 2024-09-13T05:11:32.657 INFO:teuthology.orchestra.run.smithi120.stdout:4041 read 0x180a67a thru 0x180a692 (0x19 bytes) 2024-09-13T05:11:32.658 INFO:teuthology.orchestra.run.smithi120.stdout:4043 writesame 0x54557ac thru 0x54634df data_size 0x34(0xdd34 bytes) 2024-09-13T05:11:32.662 INFO:teuthology.orchestra.run.smithi120.stdout:4045 read 0x1ab351e thru 0x1ab7c57 (0x473a bytes) 2024-09-13T05:11:32.663 INFO:teuthology.orchestra.run.smithi120.stdout:4047 write 0x155576c thru 0x156113b (0xb9d0 bytes) 2024-09-13T05:11:32.669 INFO:teuthology.orchestra.run.smithi120.stdout:4048 write 0x9426f0b thru 0x942900c (0x2102 bytes) 2024-09-13T05:11:32.670 INFO:teuthology.orchestra.run.smithi120.stdout:4052 read 0xcc6ae43 thru 0xcc6e035 (0x31f3 bytes) 2024-09-13T05:11:32.670 INFO:teuthology.orchestra.run.smithi120.stdout:4053 writesame 0x56e57cb thru 0x56ee6ca data_size 0x8f(0x8f00 bytes) 2024-09-13T05:11:32.673 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:32.674 INFO:teuthology.orchestra.run.smithi120.stdout:4058 write 0x4e7ba8 thru 0x4f1ec4 (0xa31d bytes) 2024-09-13T05:11:32.679 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:32.679 INFO:teuthology.orchestra.run.smithi120.stdout:4060 read 0x75acae1 thru 0x75ad5d0 (0xaf0 bytes) 2024-09-13T05:11:32.679 INFO:teuthology.orchestra.run.smithi120.stdout:4061 write 0xa6fb268 thru 0xa6fe32c (0x30c5 bytes) 2024-09-13T05:11:32.680 INFO:teuthology.orchestra.run.smithi120.stdout:4063 write 0x2ffbc2 thru 0x30b801 (0xbc40 bytes) 2024-09-13T05:11:32.683 INFO:teuthology.orchestra.run.smithi120.stdout:4065 read 0x19748fd thru 0x19788cd (0x3fd1 bytes) 2024-09-13T05:11:32.691 INFO:teuthology.orchestra.run.smithi120.stdout:4066 trunc from 0xe916277 to 0xa135c45 2024-09-13T05:11:32.703 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T05:11:32.705 INFO:teuthology.orchestra.run.smithi120.stdout:4067 read 0x61cc91c thru 0x61d9b2a (0xd20f bytes) 2024-09-13T05:11:32.705 INFO:teuthology.orchestra.run.smithi120.stdout:4068 clone 32 order 20 su 262144 sc 2 2024-09-13T05:11:32.705 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:32.700+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:32.710 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:32.710 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:32.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:32.710 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:32.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.710 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:7961 3.18 3:184d9aea:::rbd_data.112db57f3a18.000000000000002b:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-13T05:11:32.710 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:11:32.710 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.630634674000007, 2024-09-13T05:11:32.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.040271084999999998, 2024-09-13T05:11:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7961 2024-09-13T05:11:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:11:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077005+0000", 2024-09-13T05:11:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077003+0000", 2024-09-13T05:11:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077013+0000", 2024-09-13T05:11:32.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6870000000000006e-06 2024-09-13T05:11:32.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077029+0000", 2024-09-13T05:11:32.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6314e-05 2024-09-13T05:11:32.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077038+0000", 2024-09-13T05:11:32.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5019999999999992e-06 2024-09-13T05:11:32.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077099+0000", 2024-09-13T05:11:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1444000000000003e-05 2024-09-13T05:11:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.077234+0000", 2024-09-13T05:11:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013461300000000001 2024-09-13T05:11:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-13T05:11:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.085202+0000", 2024-09-13T05:11:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079680140000000007 2024-09-13T05:11:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116860+0000", 2024-09-13T05:11:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.031658190000000003 2024-09-13T05:11:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.116995+0000", 2024-09-13T05:11:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000135601 2024-09-13T05:11:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117152+0000", 2024-09-13T05:11:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015681700000000001 2024-09-13T05:11:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.117276+0000", 2024-09-13T05:11:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012392699999999999 2024-09-13T05:11:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:8105 3.b 3:d2ae8f7b:::rbd_data.112db57f3a18.0000000000000028:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-13T05:11:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:11:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.395538868000003, 2024-09-13T05:11:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.040653913, 2024-09-13T05:11:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 8105 2024-09-13T05:11:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:11:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312101+0000", 2024-09-13T05:11:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312099+0000", 2024-09-13T05:11:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312109+0000", 2024-09-13T05:11:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0244999999999999e-05 2024-09-13T05:11:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312129+0000", 2024-09-13T05:11:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9751000000000001e-05 2024-09-13T05:11:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312141+0000", 2024-09-13T05:11:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2201999999999999e-05 2024-09-13T05:11:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312230+0000", 2024-09-13T05:11:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9092999999999996e-05 2024-09-13T05:11:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.312433+0000", 2024-09-13T05:11:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020240500000000001 2024-09-13T05:11:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-13T05:11:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.320357+0000", 2024-09-13T05:11:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079242630000000008 2024-09-13T05:11:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352488+0000", 2024-09-13T05:11:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032131588000000003 2024-09-13T05:11:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352533+0000", 2024-09-13T05:11:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4601999999999997e-05 2024-09-13T05:11:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352636+0000", 2024-09-13T05:11:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103041 2024-09-13T05:11:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:26.352755+0000", 2024-09-13T05:11:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118814 2024-09-13T05:11:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:39305 3.1e 3:79249bf8:::rbd_data.112dcff96bbd.0000000000000003:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-13T05:11:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:41.473278+0000", 2024-09-13T05:11:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.234362271999998, 2024-09-13T05:11:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027037510000000001, 2024-09-13T05:11:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 39305 2024-09-13T05:11:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473278+0000", 2024-09-13T05:11:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473278+0000", 2024-09-13T05:11:32.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473276+0000", 2024-09-13T05:11:32.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:32.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473285+0000", 2024-09-13T05:11:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0129999999999999e-06 2024-09-13T05:11:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473304+0000", 2024-09-13T05:11:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8723e-05 2024-09-13T05:11:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473313+0000", 2024-09-13T05:11:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1419999999999999e-06 2024-09-13T05:11:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473390+0000", 2024-09-13T05:11:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7001000000000004e-05 2024-09-13T05:11:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.473496+0000", 2024-09-13T05:11:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010577399999999999 2024-09-13T05:11:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:11:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.478499+0000", 2024-09-13T05:11:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050029260000000004 2024-09-13T05:11:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500153+0000", 2024-09-13T05:11:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021654421 2024-09-13T05:11:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500216+0000", 2024-09-13T05:11:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3233999999999998e-05 2024-09-13T05:11:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500273+0000", 2024-09-13T05:11:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6484000000000003e-05 2024-09-13T05:11:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:41.500315+0000", 2024-09-13T05:11:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2342000000000002e-05 2024-09-13T05:11:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:40934 3.1 3:86cdeb48:::rbd_data.112d4ab2162d.0000000000000103:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-13T05:11:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:46.247357+0000", 2024-09-13T05:11:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 46.460283034, 2024-09-13T05:11:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028923379999999999, 2024-09-13T05:11:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 40934 2024-09-13T05:11:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247357+0000", 2024-09-13T05:11:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247357+0000", 2024-09-13T05:11:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247354+0000", 2024-09-13T05:11:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:11:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247371+0000", 2024-09-13T05:11:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6697e-05 2024-09-13T05:11:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247403+0000", 2024-09-13T05:11:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1649000000000001e-05 2024-09-13T05:11:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247417+0000", 2024-09-13T05:11:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.395e-05 2024-09-13T05:11:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247498+0000", 2024-09-13T05:11:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1011000000000001e-05 2024-09-13T05:11:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.247757+0000", 2024-09-13T05:11:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000258872 2024-09-13T05:11:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:11:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.254874+0000", 2024-09-13T05:11:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071176449999999997 2024-09-13T05:11:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.275876+0000", 2024-09-13T05:11:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021001770999999999 2024-09-13T05:11:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.275989+0000", 2024-09-13T05:11:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011301199999999999 2024-09-13T05:11:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.276156+0000", 2024-09-13T05:11:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000167453 2024-09-13T05:11:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:46.276280+0000", 2024-09-13T05:11:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012369400000000001 2024-09-13T05:11:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:45910 3.a 3:56753852:::rbd_header.112d678e2955:head [call,call rbd.parent_overlap_get in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e58)", 2024-09-13T05:11:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:50.370028+0000", 2024-09-13T05:11:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.337612286000002, 2024-09-13T05:11:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048450024000000001, 2024-09-13T05:11:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45910 2024-09-13T05:11:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370028+0000", 2024-09-13T05:11:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370028+0000", 2024-09-13T05:11:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370027+0000", 2024-09-13T05:11:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370031+0000", 2024-09-13T05:11:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6530000000000002e-06 2024-09-13T05:11:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370038+0000", 2024-09-13T05:11:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8959999999999997e-06 2024-09-13T05:11:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370043+0000", 2024-09-13T05:11:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3680000000000004e-06 2024-09-13T05:11:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370076+0000", 2024-09-13T05:11:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3411000000000002e-05 2024-09-13T05:11:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.370125+0000", 2024-09-13T05:11:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8593e-05 2024-09-13T05:11:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:50.418478+0000", 2024-09-13T05:11:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048352978999999997 2024-09-13T05:11:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:56276 3.1 3:8275684a:::rbd_data.112d667fb7f9.000000000000008f:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-13T05:11:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:04.698605+0000", 2024-09-13T05:11:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.009034570000001, 2024-09-13T05:11:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024657968999999998, 2024-09-13T05:11:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 56276 2024-09-13T05:11:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698605+0000", 2024-09-13T05:11:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698605+0000", 2024-09-13T05:11:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698602+0000", 2024-09-13T05:11:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999971 2024-09-13T05:11:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698621+0000", 2024-09-13T05:11:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8783e-05 2024-09-13T05:11:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698667+0000", 2024-09-13T05:11:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5509000000000001e-05 2024-09-13T05:11:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698684+0000", 2024-09-13T05:11:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7799999999999999e-05 2024-09-13T05:11:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698782+0000", 2024-09-13T05:11:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7534000000000005e-05 2024-09-13T05:11:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.698905+0000", 2024-09-13T05:11:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012293699999999999 2024-09-13T05:11:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:11:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.707711+0000", 2024-09-13T05:11:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088062939999999992 2024-09-13T05:11:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.723142+0000", 2024-09-13T05:11:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015430413 2024-09-13T05:11:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.723156+0000", 2024-09-13T05:11:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4868999999999999e-05 2024-09-13T05:11:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.723214+0000", 2024-09-13T05:11:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7522000000000003e-05 2024-09-13T05:11:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.723263+0000", 2024-09-13T05:11:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9261999999999997e-05 2024-09-13T05:11:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:56368 3.1e 3:7d682469:::rbd_data.112d667fb7f9.0000000000000065:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-13T05:11:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:04.786960+0000", 2024-09-13T05:11:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.920680043000001, 2024-09-13T05:11:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027546363000000001, 2024-09-13T05:11:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 56368 2024-09-13T05:11:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786960+0000", 2024-09-13T05:11:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786960+0000", 2024-09-13T05:11:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786959+0000", 2024-09-13T05:11:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786967+0000", 2024-09-13T05:11:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6249999999999996e-06 2024-09-13T05:11:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786979+0000", 2024-09-13T05:11:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1982e-05 2024-09-13T05:11:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.786986+0000", 2024-09-13T05:11:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.126e-06 2024-09-13T05:11:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.787039+0000", 2024-09-13T05:11:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2431e-05 2024-09-13T05:11:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.787180+0000", 2024-09-13T05:11:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014091 2024-09-13T05:11:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:11:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.793251+0000", 2024-09-13T05:11:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060717419999999998 2024-09-13T05:11:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.814381+0000", 2024-09-13T05:11:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021129267 2024-09-13T05:11:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.814430+0000", 2024-09-13T05:11:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8952000000000002e-05 2024-09-13T05:11:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.814476+0000", 2024-09-13T05:11:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6223000000000001e-05 2024-09-13T05:11:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:04.814506+0000", 2024-09-13T05:11:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0287999999999999e-05 2024-09-13T05:11:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58313 3.18 3:1e6e3be3:::rbd_data.112d667fb7f9.0000000000000012:19 [read 122880~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615450+0000", 2024-09-13T05:11:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.092190166000002, 2024-09-13T05:11:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018740063000000001, 2024-09-13T05:11:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58313 2024-09-13T05:11:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615450+0000", 2024-09-13T05:11:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615450+0000", 2024-09-13T05:11:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615449+0000", 2024-09-13T05:11:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615455+0000", 2024-09-13T05:11:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2530000000000001e-06 2024-09-13T05:11:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615461+0000", 2024-09-13T05:11:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8259999999999998e-06 2024-09-13T05:11:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615466+0000", 2024-09-13T05:11:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6670000000000004e-06 2024-09-13T05:11:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634053+0000", 2024-09-13T05:11:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018586733000000001 2024-09-13T05:11:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634127+0000", 2024-09-13T05:11:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4327999999999997e-05 2024-09-13T05:11:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634190+0000", 2024-09-13T05:11:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2714999999999998e-05 2024-09-13T05:11:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58314 3.18 3:1e6e3be3:::rbd_data.112d667fb7f9.0000000000000012:19 [read 139264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615470+0000", 2024-09-13T05:11:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.092169328000001, 2024-09-13T05:11:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019039985999999998, 2024-09-13T05:11:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58314 2024-09-13T05:11:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615470+0000", 2024-09-13T05:11:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615470+0000", 2024-09-13T05:11:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615470+0000", 2024-09-13T05:11:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615473+0000", 2024-09-13T05:11:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7319999999999998e-06 2024-09-13T05:11:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615478+0000", 2024-09-13T05:11:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5899999999999998e-06 2024-09-13T05:11:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615483+0000", 2024-09-13T05:11:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5210000000000004e-06 2024-09-13T05:11:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634351+0000", 2024-09-13T05:11:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018867999 2024-09-13T05:11:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634446+0000", 2024-09-13T05:11:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5483999999999996e-05 2024-09-13T05:11:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634510+0000", 2024-09-13T05:11:32.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4049999999999998e-05 2024-09-13T05:11:32.760 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.760 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.760 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.760 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58315 3.18 3:1e6e3be3:::rbd_data.112d667fb7f9.0000000000000012:19 [read 155648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:32.760 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615487+0000", 2024-09-13T05:11:32.760 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.092152766000002, 2024-09-13T05:11:32.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019184718999999999, 2024-09-13T05:11:32.760 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.761 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.761 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.761 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.761 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.761 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58315 2024-09-13T05:11:32.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.761 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615487+0000", 2024-09-13T05:11:32.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615487+0000", 2024-09-13T05:11:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615487+0000", 2024-09-13T05:11:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615489+0000", 2024-09-13T05:11:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.469e-06 2024-09-13T05:11:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615495+0000", 2024-09-13T05:11:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4870000000000002e-06 2024-09-13T05:11:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615499+0000", 2024-09-13T05:11:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4530000000000004e-06 2024-09-13T05:11:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634536+0000", 2024-09-13T05:11:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019036507000000001 2024-09-13T05:11:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634610+0000", 2024-09-13T05:11:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4429000000000002e-05 2024-09-13T05:11:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634672+0000", 2024-09-13T05:11:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1682999999999999e-05 2024-09-13T05:11:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58316 3.18 3:1e6e3be3:::rbd_data.112d667fb7f9.0000000000000012:19 [read 172032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615505+0000", 2024-09-13T05:11:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.092135034999998, 2024-09-13T05:11:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01934669, 2024-09-13T05:11:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58316 2024-09-13T05:11:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615505+0000", 2024-09-13T05:11:32.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615505+0000", 2024-09-13T05:11:32.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615504+0000", 2024-09-13T05:11:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615507+0000", 2024-09-13T05:11:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7930000000000002e-06 2024-09-13T05:11:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615514+0000", 2024-09-13T05:11:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1169999999999998e-06 2024-09-13T05:11:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615519+0000", 2024-09-13T05:11:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6439999999999999e-06 2024-09-13T05:11:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634697+0000", 2024-09-13T05:11:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019177963999999999 2024-09-13T05:11:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634782+0000", 2024-09-13T05:11:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5198999999999995e-05 2024-09-13T05:11:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634851+0000", 2024-09-13T05:11:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9547000000000003e-05 2024-09-13T05:11:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:58317 3.18 3:1e6e3be3:::rbd_data.112d667fb7f9.0000000000000012:19 [read 188416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-09-13T05:11:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:05.615530+0000", 2024-09-13T05:11:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.092110080000001, 2024-09-13T05:11:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019487342000000001, 2024-09-13T05:11:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 58317 2024-09-13T05:11:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615530+0000", 2024-09-13T05:11:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615530+0000", 2024-09-13T05:11:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615529+0000", 2024-09-13T05:11:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615532+0000", 2024-09-13T05:11:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.078e-06 2024-09-13T05:11:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615538+0000", 2024-09-13T05:11:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8799999999999996e-06 2024-09-13T05:11:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.615543+0000", 2024-09-13T05:11:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1669999999999998e-06 2024-09-13T05:11:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634878+0000", 2024-09-13T05:11:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019334646 2024-09-13T05:11:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.634954+0000", 2024-09-13T05:11:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6317999999999997e-05 2024-09-13T05:11:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:05.635017+0000", 2024-09-13T05:11:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2702999999999999e-05 2024-09-13T05:11:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:64721 3.2 3:4170fd18:::rbd_data.112d7bfe4877.0000000000000029:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-13T05:11:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:11.044325+0000", 2024-09-13T05:11:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.663315231999999, 2024-09-13T05:11:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.030376619000000001, 2024-09-13T05:11:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 64721 2024-09-13T05:11:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044325+0000", 2024-09-13T05:11:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044325+0000", 2024-09-13T05:11:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044324+0000", 2024-09-13T05:11:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044329+0000", 2024-09-13T05:11:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9009999999999999e-06 2024-09-13T05:11:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044343+0000", 2024-09-13T05:11:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3315999999999999e-05 2024-09-13T05:11:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044348+0000", 2024-09-13T05:11:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7320000000000003e-06 2024-09-13T05:11:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044411+0000", 2024-09-13T05:11:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2779000000000003e-05 2024-09-13T05:11:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.044587+0000", 2024-09-13T05:11:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017561200000000001 2024-09-13T05:11:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:11:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.050936+0000", 2024-09-13T05:11:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006349543 2024-09-13T05:11:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.074487+0000", 2024-09-13T05:11:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023550564 2024-09-13T05:11:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.074506+0000", 2024-09-13T05:11:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9273e-05 2024-09-13T05:11:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.074606+0000", 2024-09-13T05:11:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9738e-05 2024-09-13T05:11:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.074701+0000", 2024-09-13T05:11:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.522e-05 2024-09-13T05:11:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:64754 3.1 3:85fb02f7:::rbd_data.112d7bfe4877.000000000000001c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-13T05:11:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:11.112788+0000", 2024-09-13T05:11:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.594852073999999, 2024-09-13T05:11:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021038556, 2024-09-13T05:11:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 64754 2024-09-13T05:11:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112788+0000", 2024-09-13T05:11:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112788+0000", 2024-09-13T05:11:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112786+0000", 2024-09-13T05:11:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112797+0000", 2024-09-13T05:11:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1153e-05 2024-09-13T05:11:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112818+0000", 2024-09-13T05:11:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0812e-05 2024-09-13T05:11:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112827+0000", 2024-09-13T05:11:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8140000000000007e-06 2024-09-13T05:11:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.112928+0000", 2024-09-13T05:11:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010168800000000001 2024-09-13T05:11:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.113152+0000", 2024-09-13T05:11:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022388599999999999 2024-09-13T05:11:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-13T05:11:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.118142+0000", 2024-09-13T05:11:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049900020000000003 2024-09-13T05:11:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.133650+0000", 2024-09-13T05:11:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015508020000000001 2024-09-13T05:11:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.133666+0000", 2024-09-13T05:11:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6237000000000001e-05 2024-09-13T05:11:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.133740+0000", 2024-09-13T05:11:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3254e-05 2024-09-13T05:11:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:11.133826+0000", 2024-09-13T05:11:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6576000000000006e-05 2024-09-13T05:11:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:65398 3.b 3:d1d66040:::rbd_data.112d8ff9b77a.0000000000000010:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-09-13T05:11:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:14.634623+0000", 2024-09-13T05:11:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.073016708000001, 2024-09-13T05:11:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021311337, 2024-09-13T05:11:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65398 2024-09-13T05:11:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634623+0000", 2024-09-13T05:11:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634623+0000", 2024-09-13T05:11:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634622+0000", 2024-09-13T05:11:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634631+0000", 2024-09-13T05:11:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2019999999999993e-06 2024-09-13T05:11:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634648+0000", 2024-09-13T05:11:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7047000000000001e-05 2024-09-13T05:11:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634661+0000", 2024-09-13T05:11:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2828e-05 2024-09-13T05:11:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634727+0000", 2024-09-13T05:11:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6291999999999995e-05 2024-09-13T05:11:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.634820+0000", 2024-09-13T05:11:32.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2665999999999997e-05 2024-09-13T05:11:32.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:11:32.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.639215+0000", 2024-09-13T05:11:32.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043956730000000001 2024-09-13T05:11:32.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:32.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.655864+0000", 2024-09-13T05:11:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016648169000000001 2024-09-13T05:11:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.655875+0000", 2024-09-13T05:11:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1289e-05 2024-09-13T05:11:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.655909+0000", 2024-09-13T05:11:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3794000000000002e-05 2024-09-13T05:11:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:14.655934+0000", 2024-09-13T05:11:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5749e-05 2024-09-13T05:11:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:66867 3.b 3:d5613bfd:::rbd_data.112d8ff9b77a.0000000000000003:head [stat,delete] snapc 1d=[1d] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-09-13T05:11:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:18.482131+0000", 2024-09-13T05:11:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.225509134999999, 2024-09-13T05:11:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020547362999999999, 2024-09-13T05:11:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 66867 2024-09-13T05:11:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482131+0000", 2024-09-13T05:11:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482131+0000", 2024-09-13T05:11:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482129+0000", 2024-09-13T05:11:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482139+0000", 2024-09-13T05:11:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5489999999999995e-06 2024-09-13T05:11:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482167+0000", 2024-09-13T05:11:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7713e-05 2024-09-13T05:11:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482179+0000", 2024-09-13T05:11:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2631e-05 2024-09-13T05:11:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482318+0000", 2024-09-13T05:11:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013872 2024-09-13T05:11:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482492+0000", 2024-09-13T05:11:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017404200000000001 2024-09-13T05:11:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:11:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.482879+0000", 2024-09-13T05:11:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038729999999999998 2024-09-13T05:11:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.487409+0000", 2024-09-13T05:11:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045295200000000004 2024-09-13T05:11:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.502507+0000", 2024-09-13T05:11:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015098555 2024-09-13T05:11:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.502569+0000", 2024-09-13T05:11:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1648000000000003e-05 2024-09-13T05:11:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:18.502678+0000", 2024-09-13T05:11:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109042 2024-09-13T05:11:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:69083 3.8 3:163ab646:::rbd_data.112d8d1317eb.0000000000000334:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-13T05:11:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:19.342089+0000", 2024-09-13T05:11:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.365550597, 2024-09-13T05:11:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018970701, 2024-09-13T05:11:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 69083 2024-09-13T05:11:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.342089+0000", 2024-09-13T05:11:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.342089+0000", 2024-09-13T05:11:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.342086+0000", 2024-09-13T05:11:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999967 2024-09-13T05:11:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.342103+0000", 2024-09-13T05:11:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6969999999999998e-05 2024-09-13T05:11:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.342138+0000", 2024-09-13T05:11:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5578999999999999e-05 2024-09-13T05:11:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.342154+0000", 2024-09-13T05:11:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5447999999999998e-05 2024-09-13T05:11:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.342259+0000", 2024-09-13T05:11:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105424 2024-09-13T05:11:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-13T05:11:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.342265+0000", 2024-09-13T05:11:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1879999999999999e-06 2024-09-13T05:11:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.344545+0000", 2024-09-13T05:11:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022793890000000002 2024-09-13T05:11:32.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.344617+0000", 2024-09-13T05:11:32.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2237999999999995e-05 2024-09-13T05:11:32.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:11:32.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.347321+0000", 2024-09-13T05:11:32.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027034670000000002 2024-09-13T05:11:32.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:32.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.360907+0000", 2024-09-13T05:11:32.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013586019 2024-09-13T05:11:32.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:32.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.360923+0000", 2024-09-13T05:11:32.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6719999999999999e-05 2024-09-13T05:11:32.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:32.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.361002+0000", 2024-09-13T05:11:32.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8924999999999994e-05 2024-09-13T05:11:32.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:19.361060+0000", 2024-09-13T05:11:32.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7652000000000003e-05 2024-09-13T05:11:32.805 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.805 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.805 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.805 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:70758 3.2 3:427d0469:::rbd_header.112d8d1317eb:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-13T05:11:32.805 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:11:32.805 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.2789845270000004, 2024-09-13T05:11:32.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.190313603, 2024-09-13T05:11:32.805 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.806 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:32.806 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.806 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.806 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.806 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70758 2024-09-13T05:11:32.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.806 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:11:32.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:11:32.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428654+0000", 2024-09-13T05:11:32.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:32.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428664+0000", 2024-09-13T05:11:32.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0664e-05 2024-09-13T05:11:32.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428683+0000", 2024-09-13T05:11:32.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8377e-05 2024-09-13T05:11:32.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428691+0000", 2024-09-13T05:11:32.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9400000000000008e-06 2024-09-13T05:11:32.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428789+0000", 2024-09-13T05:11:32.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7165999999999998e-05 2024-09-13T05:11:32.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:32.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428811+0000", 2024-09-13T05:11:32.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1925000000000001e-05 2024-09-13T05:11:32.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.617921+0000", 2024-09-13T05:11:32.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.189110536 2024-09-13T05:11:32.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618344+0000", 2024-09-13T05:11:32.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042245800000000001 2024-09-13T05:11:32.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618969+0000", 2024-09-13T05:11:32.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062529299999999996 2024-09-13T05:11:32.810 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.810 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.810 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.811 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:70873 3.18 3:1e32bd38:::rbd_object_map.112db56bb33d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:11:32.811 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:23.712386+0000", 2024-09-13T05:11:32.811 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.9952533320000008, 2024-09-13T05:11:32.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018744994000000001, 2024-09-13T05:11:32.811 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.811 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:32.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.811 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70873 2024-09-13T05:11:32.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.812 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.712386+0000", 2024-09-13T05:11:32.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.712386+0000", 2024-09-13T05:11:32.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.712386+0000", 2024-09-13T05:11:32.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:32.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.712389+0000", 2024-09-13T05:11:32.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3329999999999999e-06 2024-09-13T05:11:32.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.712393+0000", 2024-09-13T05:11:32.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1779999999999996e-06 2024-09-13T05:11:32.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.712396+0000", 2024-09-13T05:11:32.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.574e-06 2024-09-13T05:11:32.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.728415+0000", 2024-09-13T05:11:32.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016019038999999999 2024-09-13T05:11:32.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.728488+0000", 2024-09-13T05:11:32.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2235000000000002e-05 2024-09-13T05:11:32.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-13T05:11:32.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.728689+0000", 2024-09-13T05:11:32.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020100700000000001 2024-09-13T05:11:32.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:32.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.731052+0000", 2024-09-13T05:11:32.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023635399999999999 2024-09-13T05:11:32.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:32.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.731067+0000", 2024-09-13T05:11:32.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5126000000000001e-05 2024-09-13T05:11:32.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:32.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.731111+0000", 2024-09-13T05:11:32.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3736999999999998e-05 2024-09-13T05:11:32.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.731131+0000", 2024-09-13T05:11:32.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0465000000000001e-05 2024-09-13T05:11:32.816 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.816 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.816 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.817 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:73211 3.8 3:17b4dca4:::rbd_data.112d320b0440.000000000000005d:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-13T05:11:32.817 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:29.691215+0000", 2024-09-13T05:11:32.817 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.0164243750000002, 2024-09-13T05:11:32.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.038524151999999999, 2024-09-13T05:11:32.817 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:32.817 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:32.817 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:32.817 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:32.817 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:32.817 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 73211 2024-09-13T05:11:32.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.817 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:32.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:32.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:29.691215+0000", 2024-09-13T05:11:32.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:32.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:29.691215+0000", 2024-09-13T05:11:32.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:32.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:32.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:29.691213+0000", 2024-09-13T05:11:32.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:32.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:32.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:29.691225+0000", 2024-09-13T05:11:32.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1738e-05 2024-09-13T05:11:32.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:32.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:29.691250+0000", 2024-09-13T05:11:32.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4800999999999999e-05 2024-09-13T05:11:32.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:32.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:29.691260+0000", 2024-09-13T05:11:32.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7219999999999994e-06 2024-09-13T05:11:32.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:32.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:29.691366+0000", 2024-09-13T05:11:32.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106754 2024-09-13T05:11:32.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:32.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:29.691686+0000", 2024-09-13T05:11:32.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031960300000000001 2024-09-13T05:11:32.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:11:32.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:29.702368+0000", 2024-09-13T05:11:32.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010682189 2024-09-13T05:11:32.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:32.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:29.729618+0000", 2024-09-13T05:11:32.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027249915999999999 2024-09-13T05:11:32.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:11:32.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:29.729633+0000", 2024-09-13T05:11:32.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4644000000000001e-05 2024-09-13T05:11:32.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:11:32.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:29.729688+0000", 2024-09-13T05:11:32.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5470000000000003e-05 2024-09-13T05:11:32.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:32.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:32.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:32.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:29.729740+0000", 2024-09-13T05:11:32.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1337e-05 2024-09-13T05:11:32.822 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.822 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.822 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.822 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:32.822 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:32.822 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:32.824 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:11:32.824 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:32.817+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:32.925 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:32.917+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:32.939 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:32.939 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:32.940 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:11:32.940 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:32.950 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:11:33.026 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:33.021+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:33.054 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:33.054 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:33.054 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:33.054 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:33.054 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:33.065 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:11:33.127 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:33.124+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:33.171 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:33.171 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:33.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:33.171 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [] 2024-09-13T05:11:33.171 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:33.181 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:11:33.228 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:33.224+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:33.289 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:33.289 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:33.289 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:11:33.289 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:33.298 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:11:33.328 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:33.321+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:33.406 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:33.406 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:33.406 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:33.406 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:33.406 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:33.415 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:11:33.429 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:33.424+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:33.528 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:33.528 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:33.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:33.528 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:33.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.528 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47585 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16711680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:33.528 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440033+0000", 2024-09-13T05:11:33.528 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 42.084079178000003, 2024-09-13T05:11:33.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033917665999999999, 2024-09-13T05:11:33.528 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:33.528 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:33.529 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:33.529 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:33.529 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:33.529 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47585 2024-09-13T05:11:33.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.529 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:33.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.529 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:33.529 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440033+0000", 2024-09-13T05:11:33.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.529 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:33.530 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440033+0000", 2024-09-13T05:11:33.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.530 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:33.530 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440032+0000", 2024-09-13T05:11:33.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:33.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.530 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:33.530 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440036+0000", 2024-09-13T05:11:33.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.676e-06 2024-09-13T05:11:33.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:33.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440049+0000", 2024-09-13T05:11:33.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3142999999999999e-05 2024-09-13T05:11:33.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:33.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440056+0000", 2024-09-13T05:11:33.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.827e-06 2024-09-13T05:11:33.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:33.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473451+0000", 2024-09-13T05:11:33.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033395344 2024-09-13T05:11:33.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:33.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473565+0000", 2024-09-13T05:11:33.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011377700000000001 2024-09-13T05:11:33.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:33.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473950+0000", 2024-09-13T05:11:33.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00038550200000000002 2024-09-13T05:11:33.532 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.533 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:33.533 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.533 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47589 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15564800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:33.533 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440062+0000", 2024-09-13T05:11:33.533 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 42.084050191999999, 2024-09-13T05:11:33.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034520812999999997, 2024-09-13T05:11:33.533 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:33.533 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:33.533 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:33.533 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:33.533 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:33.533 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47589 2024-09-13T05:11:33.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.534 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:33.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:33.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440062+0000", 2024-09-13T05:11:33.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:33.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440062+0000", 2024-09-13T05:11:33.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:33.535 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440061+0000", 2024-09-13T05:11:33.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:33.535 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.535 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:33.535 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440064+0000", 2024-09-13T05:11:33.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4029999999999999e-06 2024-09-13T05:11:33.535 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.535 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:33.535 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440072+0000", 2024-09-13T05:11:33.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.79e-06 2024-09-13T05:11:33.535 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:33.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440079+0000", 2024-09-13T05:11:33.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.81e-06 2024-09-13T05:11:33.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:33.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474016+0000", 2024-09-13T05:11:33.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033936858 2024-09-13T05:11:33.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:33.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474143+0000", 2024-09-13T05:11:33.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012673599999999999 2024-09-13T05:11:33.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:33.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474582+0000", 2024-09-13T05:11:33.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00043982199999999998 2024-09-13T05:11:33.538 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.538 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:33.538 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.538 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47590 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15859712~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:33.538 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440085+0000", 2024-09-13T05:11:33.538 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 42.084027249000002, 2024-09-13T05:11:33.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035003000999999999, 2024-09-13T05:11:33.538 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:33.539 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:33.539 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:33.539 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:33.539 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:33.539 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47590 2024-09-13T05:11:33.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.539 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:33.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.539 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:33.539 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440085+0000", 2024-09-13T05:11:33.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.540 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:33.540 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440085+0000", 2024-09-13T05:11:33.540 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.540 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:33.540 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440084+0000", 2024-09-13T05:11:33.540 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:33.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.540 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:33.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440088+0000", 2024-09-13T05:11:33.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7759999999999999e-06 2024-09-13T05:11:33.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:33.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440100+0000", 2024-09-13T05:11:33.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2537e-05 2024-09-13T05:11:33.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:33.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440107+0000", 2024-09-13T05:11:33.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.046e-06 2024-09-13T05:11:33.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:33.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474648+0000", 2024-09-13T05:11:33.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034540803000000002 2024-09-13T05:11:33.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:33.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474721+0000", 2024-09-13T05:11:33.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2890000000000002e-05 2024-09-13T05:11:33.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:33.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475088+0000", 2024-09-13T05:11:33.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00036654199999999997 2024-09-13T05:11:33.543 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.543 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:33.543 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.543 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47591 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16154624~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:33.543 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440113+0000", 2024-09-13T05:11:33.543 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 42.083998673000004, 2024-09-13T05:11:33.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035632759, 2024-09-13T05:11:33.543 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:33.543 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:33.544 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:33.544 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:33.545 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:33.545 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47591 2024-09-13T05:11:33.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.545 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:33.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:33.545 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440113+0000", 2024-09-13T05:11:33.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:33.545 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440113+0000", 2024-09-13T05:11:33.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:33.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440112+0000", 2024-09-13T05:11:33.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:33.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:33.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440117+0000", 2024-09-13T05:11:33.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0199999999999996e-06 2024-09-13T05:11:33.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:33.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440129+0000", 2024-09-13T05:11:33.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2571999999999999e-05 2024-09-13T05:11:33.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:33.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440136+0000", 2024-09-13T05:11:33.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8870000000000003e-06 2024-09-13T05:11:33.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:33.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475160+0000", 2024-09-13T05:11:33.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035024287000000001 2024-09-13T05:11:33.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:33.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475294+0000", 2024-09-13T05:11:33.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013386600000000001 2024-09-13T05:11:33.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:33.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475746+0000", 2024-09-13T05:11:33.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00045173300000000001 2024-09-13T05:11:33.548 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.548 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:33.548 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.548 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47592 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16449536~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:33.548 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440142+0000", 2024-09-13T05:11:33.548 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 42.083970014000002, 2024-09-13T05:11:33.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036117556000000002, 2024-09-13T05:11:33.549 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:33.549 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:33.549 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:33.549 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:33.549 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:33.549 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47592 2024-09-13T05:11:33.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.549 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:33.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:33.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440142+0000", 2024-09-13T05:11:33.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:33.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440142+0000", 2024-09-13T05:11:33.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:33.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440141+0000", 2024-09-13T05:11:33.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:33.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:33.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440145+0000", 2024-09-13T05:11:33.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5939999999999998e-06 2024-09-13T05:11:33.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:33.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440162+0000", 2024-09-13T05:11:33.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7102999999999999e-05 2024-09-13T05:11:33.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:33.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440169+0000", 2024-09-13T05:11:33.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0330000000000003e-06 2024-09-13T05:11:33.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:33.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475812+0000", 2024-09-13T05:11:33.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035643542 2024-09-13T05:11:33.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:33.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475899+0000", 2024-09-13T05:11:33.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6827000000000001e-05 2024-09-13T05:11:33.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:33.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476259+0000", 2024-09-13T05:11:33.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000360057 2024-09-13T05:11:33.552 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.552 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:33.553 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.553 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47593 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16744448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:33.553 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440175+0000", 2024-09-13T05:11:33.553 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 42.083937057999997, 2024-09-13T05:11:33.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036661306999999997, 2024-09-13T05:11:33.553 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:33.553 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:33.553 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:33.553 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:33.553 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:33.553 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47593 2024-09-13T05:11:33.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.554 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:33.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:33.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440175+0000", 2024-09-13T05:11:33.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:33.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440175+0000", 2024-09-13T05:11:33.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:33.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440174+0000", 2024-09-13T05:11:33.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:33.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:33.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440178+0000", 2024-09-13T05:11:33.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.687e-06 2024-09-13T05:11:33.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:33.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440187+0000", 2024-09-13T05:11:33.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6029999999999994e-06 2024-09-13T05:11:33.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:33.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440194+0000", 2024-09-13T05:11:33.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8600000000000004e-06 2024-09-13T05:11:33.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:33.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476312+0000", 2024-09-13T05:11:33.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036117727000000002 2024-09-13T05:11:33.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:33.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476436+0000", 2024-09-13T05:11:33.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012370600000000001 2024-09-13T05:11:33.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:33.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476836+0000", 2024-09-13T05:11:33.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00040031399999999998 2024-09-13T05:11:33.557 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.557 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:33.557 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.557 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47597 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15597568~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:33.557 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440735+0000", 2024-09-13T05:11:33.557 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 42.083377065999997, 2024-09-13T05:11:33.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036742364, 2024-09-13T05:11:33.557 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:33.558 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:33.558 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:33.558 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:33.558 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:33.558 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47597 2024-09-13T05:11:33.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.558 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:33.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:33.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440735+0000", 2024-09-13T05:11:33.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:33.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440735+0000", 2024-09-13T05:11:33.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:33.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440733+0000", 2024-09-13T05:11:33.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:33.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:33.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440741+0000", 2024-09-13T05:11:33.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7100000000000007e-06 2024-09-13T05:11:33.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:33.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440774+0000", 2024-09-13T05:11:33.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3062999999999998e-05 2024-09-13T05:11:33.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:33.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440784+0000", 2024-09-13T05:11:33.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6630000000000005e-06 2024-09-13T05:11:33.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:33.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476899+0000", 2024-09-13T05:11:33.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036115188999999999 2024-09-13T05:11:33.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:33.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477036+0000", 2024-09-13T05:11:33.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000136907 2024-09-13T05:11:33.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:33.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477477+0000", 2024-09-13T05:11:33.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00044140899999999997 2024-09-13T05:11:33.561 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.561 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:33.561 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.562 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47598 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15892480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:33.562 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:11:33.562 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 42.083307331, 2024-09-13T05:11:33.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037255732, 2024-09-13T05:11:33.562 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:33.562 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:33.562 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:33.562 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:33.562 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:33.562 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47598 2024-09-13T05:11:33.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.562 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:33.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:33.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:11:33.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:33.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:11:33.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:33.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:11:33.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:33.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:33.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440809+0000", 2024-09-13T05:11:33.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.237e-06 2024-09-13T05:11:33.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:33.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440823+0000", 2024-09-13T05:11:33.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4426e-05 2024-09-13T05:11:33.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:33.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440831+0000", 2024-09-13T05:11:33.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6669999999999996e-06 2024-09-13T05:11:33.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:33.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477508+0000", 2024-09-13T05:11:33.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036677354000000002 2024-09-13T05:11:33.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:33.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477571+0000", 2024-09-13T05:11:33.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2271000000000001e-05 2024-09-13T05:11:33.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:33.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478060+0000", 2024-09-13T05:11:33.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00048954399999999996 2024-09-13T05:11:33.566 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.566 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:33.566 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.566 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47599 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16187392~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:33.566 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:11:33.566 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 42.083274389000003, 2024-09-13T05:11:33.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037806671, 2024-09-13T05:11:33.567 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:33.567 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:33.567 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:33.567 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:33.567 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:33.567 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47599 2024-09-13T05:11:33.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.567 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:33.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:33.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:11:33.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:33.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:11:33.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:33.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:11:33.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:33.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:33.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440841+0000", 2024-09-13T05:11:33.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1699999999999999e-06 2024-09-13T05:11:33.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:33.569 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440853+0000", 2024-09-13T05:11:33.569 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2466000000000001e-05 2024-09-13T05:11:33.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:33.569 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440860+0000", 2024-09-13T05:11:33.569 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8970000000000002e-06 2024-09-13T05:11:33.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:33.569 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478100+0000", 2024-09-13T05:11:33.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037239398 2024-09-13T05:11:33.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.570 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:33.570 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478173+0000", 2024-09-13T05:11:33.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3784999999999999e-05 2024-09-13T05:11:33.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.570 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:33.570 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478644+0000", 2024-09-13T05:11:33.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00047058100000000003 2024-09-13T05:11:33.570 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.570 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:33.570 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.571 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.571 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47600 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16482304~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:33.571 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:11:33.571 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 42.083245415, 2024-09-13T05:11:33.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038539524999999998, 2024-09-13T05:11:33.571 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:33.571 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:33.571 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:33.571 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:33.571 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:33.571 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47600 2024-09-13T05:11:33.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.571 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:33.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:33.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:11:33.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:33.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:11:33.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:33.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:11:33.573 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:33.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.573 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:33.573 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440869+0000", 2024-09-13T05:11:33.573 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6229999999999999e-06 2024-09-13T05:11:33.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.573 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:33.573 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440877+0000", 2024-09-13T05:11:33.573 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9289999999999998e-06 2024-09-13T05:11:33.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.574 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:33.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440884+0000", 2024-09-13T05:11:33.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9569999999999996e-06 2024-09-13T05:11:33.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.574 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.574 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:33.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478694+0000", 2024-09-13T05:11:33.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037809597 2024-09-13T05:11:33.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.574 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.574 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:33.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478907+0000", 2024-09-13T05:11:33.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021332799999999999 2024-09-13T05:11:33.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.575 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:33.575 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479406+0000", 2024-09-13T05:11:33.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00049870100000000005 2024-09-13T05:11:33.575 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.575 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:33.575 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.575 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47605 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15630336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:33.575 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.445919+0000", 2024-09-13T05:11:33.575 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 42.078193046000003, 2024-09-13T05:11:33.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034071010999999998, 2024-09-13T05:11:33.575 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:33.576 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:33.576 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:33.576 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:33.576 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:33.576 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47605 2024-09-13T05:11:33.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.576 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:33.576 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.576 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:33.576 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445919+0000", 2024-09-13T05:11:33.576 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.576 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:33.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445919+0000", 2024-09-13T05:11:33.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.577 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:33.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445917+0000", 2024-09-13T05:11:33.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:33.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.577 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:33.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445928+0000", 2024-09-13T05:11:33.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1413000000000001e-05 2024-09-13T05:11:33.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:33.578 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445965+0000", 2024-09-13T05:11:33.578 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6832999999999998e-05 2024-09-13T05:11:33.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:33.578 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445979+0000", 2024-09-13T05:11:33.578 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4112e-05 2024-09-13T05:11:33.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:33.578 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479481+0000", 2024-09-13T05:11:33.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033502394999999997 2024-09-13T05:11:33.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:33.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479577+0000", 2024-09-13T05:11:33.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5952999999999994e-05 2024-09-13T05:11:33.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:33.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479990+0000", 2024-09-13T05:11:33.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00041233799999999999 2024-09-13T05:11:33.579 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.579 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:33.579 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.580 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.580 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.580 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47606 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15925248~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:33.580 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.446006+0000", 2024-09-13T05:11:33.580 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 42.078105680999997, 2024-09-13T05:11:33.580 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034653819000000002, 2024-09-13T05:11:33.580 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:33.580 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:33.580 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:33.580 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:33.580 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:33.580 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47606 2024-09-13T05:11:33.580 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.580 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:33.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:33.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446006+0000", 2024-09-13T05:11:33.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:33.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446006+0000", 2024-09-13T05:11:33.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:33.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446005+0000", 2024-09-13T05:11:33.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:33.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:33.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446011+0000", 2024-09-13T05:11:33.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8039999999999998e-06 2024-09-13T05:11:33.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:33.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446027+0000", 2024-09-13T05:11:33.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6109000000000001e-05 2024-09-13T05:11:33.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:33.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446036+0000", 2024-09-13T05:11:33.583 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0100000000000001e-06 2024-09-13T05:11:33.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.583 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:33.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480068+0000", 2024-09-13T05:11:33.583 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034031516999999997 2024-09-13T05:11:33.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.583 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:33.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480216+0000", 2024-09-13T05:11:33.583 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000148701 2024-09-13T05:11:33.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.584 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:33.584 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480660+0000", 2024-09-13T05:11:33.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00044355499999999999 2024-09-13T05:11:33.584 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.584 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:33.584 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.584 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.584 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47607 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16220160~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:33.584 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.446044+0000", 2024-09-13T05:11:33.584 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 42.078068211999998, 2024-09-13T05:11:33.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035276967999999999, 2024-09-13T05:11:33.584 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:33.584 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:33.585 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:33.585 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:33.585 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:33.585 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47607 2024-09-13T05:11:33.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.585 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:33.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:33.585 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446044+0000", 2024-09-13T05:11:33.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:33.585 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446044+0000", 2024-09-13T05:11:33.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:33.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446043+0000", 2024-09-13T05:11:33.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:33.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:33.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446047+0000", 2024-09-13T05:11:33.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0729999999999998e-06 2024-09-13T05:11:33.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:33.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446055+0000", 2024-09-13T05:11:33.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0900000000000005e-06 2024-09-13T05:11:33.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.587 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:33.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446062+0000", 2024-09-13T05:11:33.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0169999999999999e-06 2024-09-13T05:11:33.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.587 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:33.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480714+0000", 2024-09-13T05:11:33.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034651380000000002 2024-09-13T05:11:33.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.588 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.588 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:33.588 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480859+0000", 2024-09-13T05:11:33.588 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014580300000000001 2024-09-13T05:11:33.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.588 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.588 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:33.588 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481321+0000", 2024-09-13T05:11:33.588 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000461218 2024-09-13T05:11:33.588 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.588 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:33.588 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.588 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.589 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47608 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16515072~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:33.589 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.446068+0000", 2024-09-13T05:11:33.589 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 42.078043766, 2024-09-13T05:11:33.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035881819000000002, 2024-09-13T05:11:33.589 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:33.589 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:33.589 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:33.589 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:33.589 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:33.589 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47608 2024-09-13T05:11:33.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.589 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:33.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:33.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446068+0000", 2024-09-13T05:11:33.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:33.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446068+0000", 2024-09-13T05:11:33.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:33.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446067+0000", 2024-09-13T05:11:33.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:33.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:33.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446071+0000", 2024-09-13T05:11:33.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9090000000000002e-06 2024-09-13T05:11:33.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:33.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446079+0000", 2024-09-13T05:11:33.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6869999999999994e-06 2024-09-13T05:11:33.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:33.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446088+0000", 2024-09-13T05:11:33.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0129999999999999e-06 2024-09-13T05:11:33.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.592 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:33.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481401+0000", 2024-09-13T05:11:33.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035313272999999999 2024-09-13T05:11:33.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.592 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:33.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481564+0000", 2024-09-13T05:11:33.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016223299999999999 2024-09-13T05:11:33.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.592 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:33.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481950+0000", 2024-09-13T05:11:33.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00038631000000000001 2024-09-13T05:11:33.593 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.593 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:33.593 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.593 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.593 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.593 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:67653 3.1f 3:f936ba4b:::rbd_object_map.112d7bfe4877:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e81)", 2024-09-13T05:11:33.593 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:18.704251+0000", 2024-09-13T05:11:33.594 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.819860401, 2024-09-13T05:11:33.594 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034028673000000002, 2024-09-13T05:11:33.594 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:33.594 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:33.594 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:33.594 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:33.594 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:33.594 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 67653 2024-09-13T05:11:33.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.594 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:33.594 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.594 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:33.594 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704251+0000", 2024-09-13T05:11:33.594 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.595 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:33.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704251+0000", 2024-09-13T05:11:33.595 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.595 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:33.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704251+0000", 2024-09-13T05:11:33.595 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:33.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.595 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:33.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704253+0000", 2024-09-13T05:11:33.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.136e-06 2024-09-13T05:11:33.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:33.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704256+0000", 2024-09-13T05:11:33.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7049999999999999e-06 2024-09-13T05:11:33.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:33.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704259+0000", 2024-09-13T05:11:33.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6970000000000002e-06 2024-09-13T05:11:33.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:33.597 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.729746+0000", 2024-09-13T05:11:33.597 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.025486892000000001 2024-09-13T05:11:33.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.597 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.597 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:33.597 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.729834+0000", 2024-09-13T05:11:33.597 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8864999999999997e-05 2024-09-13T05:11:33.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.597 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.597 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 2", 2024-09-13T05:11:33.597 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.730192+0000", 2024-09-13T05:11:33.597 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00035797100000000001 2024-09-13T05:11:33.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.597 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.598 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:11:33.598 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.734948+0000", 2024-09-13T05:11:33.598 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0047558139999999997 2024-09-13T05:11:33.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.598 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.598 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:33.598 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.738189+0000", 2024-09-13T05:11:33.598 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003241234 2024-09-13T05:11:33.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.598 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.598 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:11:33.598 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.738245+0000", 2024-09-13T05:11:33.598 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6001000000000001e-05 2024-09-13T05:11:33.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:33.599 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.738280+0000", 2024-09-13T05:11:33.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4567000000000003e-05 2024-09-13T05:11:33.599 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.599 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:33.599 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.599 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:67654 3.1f 3:f936ba4b:::rbd_object_map.112d7bfe4877:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e81)", 2024-09-13T05:11:33.599 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:18.704261+0000", 2024-09-13T05:11:33.600 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.819850865999999, 2024-09-13T05:11:33.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034141218000000001, 2024-09-13T05:11:33.600 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:33.600 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:33.600 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:33.600 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:33.600 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:33.600 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 67654 2024-09-13T05:11:33.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.600 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:33.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.600 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:33.601 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704261+0000", 2024-09-13T05:11:33.601 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.601 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.601 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:33.601 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704261+0000", 2024-09-13T05:11:33.601 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.601 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.601 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:33.601 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704261+0000", 2024-09-13T05:11:33.601 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:33.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.601 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:33.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704263+0000", 2024-09-13T05:11:33.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3999999999999999e-06 2024-09-13T05:11:33.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:33.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704266+0000", 2024-09-13T05:11:33.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7879999999999998e-06 2024-09-13T05:11:33.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:33.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704269+0000", 2024-09-13T05:11:33.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:11:33.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.603 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.603 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:33.603 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.730747+0000", 2024-09-13T05:11:33.603 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.026478224000000002 2024-09-13T05:11:33.603 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.603 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.603 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:33.603 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.730796+0000", 2024-09-13T05:11:33.603 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9137000000000001e-05 2024-09-13T05:11:33.603 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.603 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.603 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 2", 2024-09-13T05:11:33.603 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.731142+0000", 2024-09-13T05:11:33.603 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00034581500000000002 2024-09-13T05:11:33.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.604 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:11:33.604 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.734952+0000", 2024-09-13T05:11:33.604 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0038102909999999999 2024-09-13T05:11:33.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.604 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:33.604 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.738325+0000", 2024-09-13T05:11:33.604 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033727890000000002 2024-09-13T05:11:33.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.604 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:11:33.604 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.738369+0000", 2024-09-13T05:11:33.605 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4338999999999997e-05 2024-09-13T05:11:33.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.605 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:33.605 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.738402+0000", 2024-09-13T05:11:33.605 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2880999999999999e-05 2024-09-13T05:11:33.605 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.605 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:33.605 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.605 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3.bb1d1096 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:11:33.605 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:11:33.605 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.5803896999999996, 2024-09-13T05:11:33.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68834410099999999, 2024-09-13T05:11:33.606 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:33.606 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:33.606 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:33.606 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:33.606 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:33.606 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:11:33.606 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.606 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:33.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:33.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:11:33.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.606 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.607 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:33.607 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:11:33.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.607 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:33.607 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943719+0000", 2024-09-13T05:11:33.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:11:33.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.607 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:33.607 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943734+0000", 2024-09-13T05:11:33.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4793e-05 2024-09-13T05:11:33.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.608 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:33.608 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943765+0000", 2024-09-13T05:11:33.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0648999999999997e-05 2024-09-13T05:11:33.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.608 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:33.608 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943779+0000", 2024-09-13T05:11:33.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.447e-05 2024-09-13T05:11:33.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.608 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:33.608 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943872+0000", 2024-09-13T05:11:33.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3304e-05 2024-09-13T05:11:33.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:33.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943884+0000", 2024-09-13T05:11:33.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.167e-05 2024-09-13T05:11:33.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:33.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632042+0000", 2024-09-13T05:11:33.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68815832600000004 2024-09-13T05:11:33.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:33.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632066+0000", 2024-09-13T05:11:33.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3765999999999999e-05 2024-09-13T05:11:33.610 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.610 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:33.610 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.610 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3.b6bd6256 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:11:33.610 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:11:33.610 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.5802651999999995, 2024-09-13T05:11:33.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68852592499999998, 2024-09-13T05:11:33.610 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:33.610 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:33.610 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:33.611 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:33.611 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:33.611 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:11:33.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.611 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:33.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:33.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:11:33.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:33.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:11:33.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:33.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943846+0000", 2024-09-13T05:11:33.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:33.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:33.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943852+0000", 2024-09-13T05:11:33.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3820000000000001e-06 2024-09-13T05:11:33.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:33.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943876+0000", 2024-09-13T05:11:33.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3995e-05 2024-09-13T05:11:33.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.613 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:33.613 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943898+0000", 2024-09-13T05:11:33.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1838999999999999e-05 2024-09-13T05:11:33.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.613 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:33.613 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946457+0000", 2024-09-13T05:11:33.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025588910000000002 2024-09-13T05:11:33.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.613 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:33.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946499+0000", 2024-09-13T05:11:33.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2814e-05 2024-09-13T05:11:33.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:33.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632364+0000", 2024-09-13T05:11:33.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68586484999999997 2024-09-13T05:11:33.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:33.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632372+0000", 2024-09-13T05:11:33.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1659999999999994e-06 2024-09-13T05:11:33.614 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.614 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:33.615 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.615 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3:6908b8dd:::rbd_data.112d8d1317eb.000000000000000f:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:11:33.615 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:11:33.615 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.5431211220000005, 2024-09-13T05:11:33.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65181049499999999, 2024-09-13T05:11:33.615 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:33.615 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:33.615 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:33.615 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:33.615 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:33.615 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:11:33.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.616 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:33.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:33.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:11:33.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:33.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:11:33.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:33.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980989+0000", 2024-09-13T05:11:33.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:33.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:33.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980996+0000", 2024-09-13T05:11:33.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2200000000000003e-06 2024-09-13T05:11:33.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:33.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981011+0000", 2024-09-13T05:11:33.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4997000000000001e-05 2024-09-13T05:11:33.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:33.618 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981025+0000", 2024-09-13T05:11:33.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3604000000000001e-05 2024-09-13T05:11:33.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.618 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:33.618 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981110+0000", 2024-09-13T05:11:33.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4948000000000001e-05 2024-09-13T05:11:33.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.618 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:33.618 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981120+0000", 2024-09-13T05:11:33.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9399999999999997e-06 2024-09-13T05:11:33.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:33.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632425+0000", 2024-09-13T05:11:33.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65130460499999998 2024-09-13T05:11:33.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:33.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632587+0000", 2024-09-13T05:11:33.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016199500000000001 2024-09-13T05:11:33.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:33.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632801+0000", 2024-09-13T05:11:33.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021459499999999999 2024-09-13T05:11:33.619 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.620 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:33.620 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.620 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3:6a46bd6d:::rbd_data.112d8d1317eb.0000000000000010:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:11:33.620 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:11:33.620 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.5430634659999996, 2024-09-13T05:11:33.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65213695699999996, 2024-09-13T05:11:33.620 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:33.620 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:33.620 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:33.620 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:33.620 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:33.620 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:11:33.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.621 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:33.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:33.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:11:33.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:33.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:11:33.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:33.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:33.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:11:33.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:33.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:33.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981052+0000", 2024-09-13T05:11:33.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4469999999999999e-06 2024-09-13T05:11:33.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:33.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981066+0000", 2024-09-13T05:11:33.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3658e-05 2024-09-13T05:11:33.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:33.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981073+0000", 2024-09-13T05:11:33.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:11:33.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:33.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981150+0000", 2024-09-13T05:11:33.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7783999999999999e-05 2024-09-13T05:11:33.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:33.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981161+0000", 2024-09-13T05:11:33.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0197000000000001e-05 2024-09-13T05:11:33.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:33.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632926+0000", 2024-09-13T05:11:33.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65176517300000003 2024-09-13T05:11:33.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:33.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633081+0000", 2024-09-13T05:11:33.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000155172 2024-09-13T05:11:33.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:33.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:33.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:33.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633185+0000", 2024-09-13T05:11:33.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000104329 2024-09-13T05:11:33.625 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.625 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:33.625 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.625 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:33.625 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:33.625 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:33.626 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:11:33.627 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:33.621+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:33.689 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is set 2024-09-13T05:11:33.745 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:33.744+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:33.783 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:33.783 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:33.783 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:11:33.783 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:33.793 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:11:33.828 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:33.824+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:33.904 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:33.904 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:33.904 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:33.905 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:33.905 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:33.914 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:11:33.921 INFO:teuthology.orchestra.run.smithi120.stdout:flattening image image_client.0-clone31 2024-09-13T05:11:33.929 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:33.928+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:34.021 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:34.021 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:34.021 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:34.021 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:34.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.021 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29020 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2855936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.021 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:11:34.021 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.975869070999998, 2024-09-13T05:11:34.021 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060733743, 2024-09-13T05:11:34.022 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.022 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:34.022 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.022 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.022 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.022 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29020 2024-09-13T05:11:34.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.022 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:11:34.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:11:34.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041741+0000", 2024-09-13T05:11:34.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041749+0000", 2024-09-13T05:11:34.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6059999999999997e-06 2024-09-13T05:11:34.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.024 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041754+0000", 2024-09-13T05:11:34.024 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6740000000000002e-06 2024-09-13T05:11:34.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.024 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041760+0000", 2024-09-13T05:11:34.024 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0459999999999996e-06 2024-09-13T05:11:34.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.024 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102289+0000", 2024-09-13T05:11:34.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060529145999999999 2024-09-13T05:11:34.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.025 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:34.025 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102378+0000", 2024-09-13T05:11:34.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8901999999999997e-05 2024-09-13T05:11:34.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.025 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.025 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102476+0000", 2024-09-13T05:11:34.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7991000000000004e-05 2024-09-13T05:11:34.025 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.025 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.025 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.026 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29021 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2865152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.026 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:11:34.026 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.975847076000001, 2024-09-13T05:11:34.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060927993999999999, 2024-09-13T05:11:34.026 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.026 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:34.026 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.026 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.026 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.026 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29021 2024-09-13T05:11:34.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.026 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.027 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.027 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:11:34.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.027 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.027 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:11:34.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.027 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.027 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041763+0000", 2024-09-13T05:11:34.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.028 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041766+0000", 2024-09-13T05:11:34.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6800000000000002e-06 2024-09-13T05:11:34.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.028 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041771+0000", 2024-09-13T05:11:34.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:11:34.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041776+0000", 2024-09-13T05:11:34.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8489999999999997e-06 2024-09-13T05:11:34.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102513+0000", 2024-09-13T05:11:34.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060737102000000001 2024-09-13T05:11:34.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:34.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102597+0000", 2024-09-13T05:11:34.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4374000000000002e-05 2024-09-13T05:11:34.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.030 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102692+0000", 2024-09-13T05:11:34.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4436000000000002e-05 2024-09-13T05:11:34.030 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.030 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.030 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.030 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29022 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2874368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.030 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:11:34.030 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.975830776000002, 2024-09-13T05:11:34.031 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061135083999999999, 2024-09-13T05:11:34.031 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.031 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:34.031 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.031 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.031 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.031 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29022 2024-09-13T05:11:34.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.031 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.031 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.031 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:11:34.031 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:11:34.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:11:34.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041782+0000", 2024-09-13T05:11:34.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4959999999999999e-06 2024-09-13T05:11:34.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041787+0000", 2024-09-13T05:11:34.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1240000000000004e-06 2024-09-13T05:11:34.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041792+0000", 2024-09-13T05:11:34.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9200000000000003e-06 2024-09-13T05:11:34.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102738+0000", 2024-09-13T05:11:34.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060945581999999998 2024-09-13T05:11:34.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:34.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102821+0000", 2024-09-13T05:11:34.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2898999999999994e-05 2024-09-13T05:11:34.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102915+0000", 2024-09-13T05:11:34.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4523000000000003e-05 2024-09-13T05:11:34.034 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.034 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.034 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.035 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29067 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2764800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.035 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:11:34.035 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.972056559000002, 2024-09-13T05:11:34.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060816621000000001, 2024-09-13T05:11:34.035 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.035 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:34.035 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.035 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.035 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.035 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29067 2024-09-13T05:11:34.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.035 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.036 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.036 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.036 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:11:34.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.036 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.036 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.036 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.036 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:11:34.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.036 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.037 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.037 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:11:34.037 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.037 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.037 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045557+0000", 2024-09-13T05:11:34.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.898e-06 2024-09-13T05:11:34.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045575+0000", 2024-09-13T05:11:34.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8252000000000001e-05 2024-09-13T05:11:34.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045581+0000", 2024-09-13T05:11:34.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:11:34.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106183+0000", 2024-09-13T05:11:34.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060602630999999997 2024-09-13T05:11:34.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:34.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106271+0000", 2024-09-13T05:11:34.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7329000000000004e-05 2024-09-13T05:11:34.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106371+0000", 2024-09-13T05:11:34.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000100164 2024-09-13T05:11:34.040 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.040 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.040 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.040 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29068 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2774016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.041 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:11:34.041 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.972025324999997, 2024-09-13T05:11:34.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060994509000000002, 2024-09-13T05:11:34.041 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.041 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:34.041 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.041 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.041 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.041 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29068 2024-09-13T05:11:34.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.042 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:11:34.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:11:34.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045585+0000", 2024-09-13T05:11:34.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045588+0000", 2024-09-13T05:11:34.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:11:34.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045594+0000", 2024-09-13T05:11:34.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9329999999999998e-06 2024-09-13T05:11:34.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045599+0000", 2024-09-13T05:11:34.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3190000000000002e-06 2024-09-13T05:11:34.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106399+0000", 2024-09-13T05:11:34.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060800361999999997 2024-09-13T05:11:34.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:34.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106489+0000", 2024-09-13T05:11:34.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9301000000000004e-05 2024-09-13T05:11:34.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106580+0000", 2024-09-13T05:11:34.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1314e-05 2024-09-13T05:11:34.045 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.045 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.045 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.045 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29069 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2792448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.045 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:11:34.045 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.972006907999997, 2024-09-13T05:11:34.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061207599000000001, 2024-09-13T05:11:34.046 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.046 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:34.046 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.046 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.046 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.046 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29069 2024-09-13T05:11:34.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.046 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.046 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.046 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:11:34.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:11:34.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045603+0000", 2024-09-13T05:11:34.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045606+0000", 2024-09-13T05:11:34.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7300000000000001e-06 2024-09-13T05:11:34.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045612+0000", 2024-09-13T05:11:34.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9599999999999997e-06 2024-09-13T05:11:34.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045619+0000", 2024-09-13T05:11:34.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6019999999999996e-06 2024-09-13T05:11:34.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106619+0000", 2024-09-13T05:11:34.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061000029999999997 2024-09-13T05:11:34.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.049 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:34.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106713+0000", 2024-09-13T05:11:34.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4505000000000004e-05 2024-09-13T05:11:34.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.049 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106812+0000", 2024-09-13T05:11:34.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8264000000000007e-05 2024-09-13T05:11:34.049 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.049 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.049 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.050 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.050 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.050 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29070 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2783232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.050 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:11:34.050 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.971986448999999, 2024-09-13T05:11:34.050 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061389805999999998, 2024-09-13T05:11:34.050 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.050 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:34.050 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.050 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.050 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.050 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29070 2024-09-13T05:11:34.050 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.050 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:11:34.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:11:34.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:11:34.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045627+0000", 2024-09-13T05:11:34.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6579999999999998e-06 2024-09-13T05:11:34.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045632+0000", 2024-09-13T05:11:34.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8449999999999999e-06 2024-09-13T05:11:34.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.053 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045639+0000", 2024-09-13T05:11:34.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:11:34.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.053 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.053 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106837+0000", 2024-09-13T05:11:34.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061198529000000002 2024-09-13T05:11:34.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.053 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:34.053 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106922+0000", 2024-09-13T05:11:34.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4771999999999994e-05 2024-09-13T05:11:34.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107014+0000", 2024-09-13T05:11:34.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2009000000000006e-05 2024-09-13T05:11:34.054 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.054 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.054 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.054 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29071 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2801664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.054 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:11:34.054 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.971967372999998, 2024-09-13T05:11:34.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061582804999999997, 2024-09-13T05:11:34.054 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.054 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:34.055 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.055 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.055 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.055 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29071 2024-09-13T05:11:34.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.055 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.055 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.055 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:11:34.055 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.055 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.055 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:11:34.056 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.056 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.056 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.056 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045643+0000", 2024-09-13T05:11:34.056 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.056 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.056 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.056 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045646+0000", 2024-09-13T05:11:34.056 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:11:34.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.056 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045664+0000", 2024-09-13T05:11:34.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8408000000000001e-05 2024-09-13T05:11:34.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045670+0000", 2024-09-13T05:11:34.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7710000000000003e-06 2024-09-13T05:11:34.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107048+0000", 2024-09-13T05:11:34.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061378438 2024-09-13T05:11:34.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:34.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107134+0000", 2024-09-13T05:11:34.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5574000000000004e-05 2024-09-13T05:11:34.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107226+0000", 2024-09-13T05:11:34.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2262000000000005e-05 2024-09-13T05:11:34.058 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.058 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.058 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.059 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29072 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2810880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.059 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:11:34.059 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.971935989000002, 2024-09-13T05:11:34.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061762233999999999, 2024-09-13T05:11:34.059 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.059 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:34.059 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.059 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.059 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.059 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29072 2024-09-13T05:11:34.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.059 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.059 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.059 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.060 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:11:34.060 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.060 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.060 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.060 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:11:34.060 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.060 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.060 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.060 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045674+0000", 2024-09-13T05:11:34.060 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.060 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045677+0000", 2024-09-13T05:11:34.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9679999999999998e-06 2024-09-13T05:11:34.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045694+0000", 2024-09-13T05:11:34.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6801999999999999e-05 2024-09-13T05:11:34.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045700+0000", 2024-09-13T05:11:34.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8270000000000003e-06 2024-09-13T05:11:34.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107249+0000", 2024-09-13T05:11:34.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061549114000000002 2024-09-13T05:11:34.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:34.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107341+0000", 2024-09-13T05:11:34.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2390000000000001e-05 2024-09-13T05:11:34.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107437+0000", 2024-09-13T05:11:34.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5648000000000003e-05 2024-09-13T05:11:34.063 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.063 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.063 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.063 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.063 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29073 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2820096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.063 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:11:34.063 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.971894011000003, 2024-09-13T05:11:34.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061873910999999997, 2024-09-13T05:11:34.063 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.063 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:34.063 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.063 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.064 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.064 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29073 2024-09-13T05:11:34.064 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.064 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.064 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.064 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.064 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:11:34.064 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.064 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.064 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.064 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.064 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:11:34.064 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.064 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.065 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.065 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.065 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045716+0000", 2024-09-13T05:11:34.065 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.065 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.065 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.065 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.065 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045726+0000", 2024-09-13T05:11:34.065 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6350000000000001e-06 2024-09-13T05:11:34.065 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.065 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.065 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.065 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045739+0000", 2024-09-13T05:11:34.066 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3325e-05 2024-09-13T05:11:34.066 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.066 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.066 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.066 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045746+0000", 2024-09-13T05:11:34.066 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7399999999999998e-06 2024-09-13T05:11:34.066 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.066 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.066 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.066 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107457+0000", 2024-09-13T05:11:34.066 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061711038000000003 2024-09-13T05:11:34.066 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.066 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.066 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:34.067 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107522+0000", 2024-09-13T05:11:34.067 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4850000000000004e-05 2024-09-13T05:11:34.067 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.067 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.067 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.067 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107591+0000", 2024-09-13T05:11:34.067 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9029999999999995e-05 2024-09-13T05:11:34.067 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.067 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.068 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.068 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.068 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.068 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29074 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2829312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.068 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:11:34.068 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.971860102999997, 2024-09-13T05:11:34.068 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062055459, 2024-09-13T05:11:34.068 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.068 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:34.068 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.068 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.068 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.068 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29074 2024-09-13T05:11:34.069 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.069 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.069 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.069 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.069 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:11:34.069 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.069 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.069 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.069 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.069 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:11:34.069 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.069 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.069 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.070 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.070 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045750+0000", 2024-09-13T05:11:34.070 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.070 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.070 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.070 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045753+0000", 2024-09-13T05:11:34.070 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8399999999999999e-06 2024-09-13T05:11:34.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.070 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.070 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.070 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045759+0000", 2024-09-13T05:11:34.070 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8900000000000004e-06 2024-09-13T05:11:34.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045764+0000", 2024-09-13T05:11:34.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3850000000000001e-06 2024-09-13T05:11:34.071 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107623+0000", 2024-09-13T05:11:34.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061858817000000003 2024-09-13T05:11:34.071 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:34.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107710+0000", 2024-09-13T05:11:34.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7127999999999997e-05 2024-09-13T05:11:34.072 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.072 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.072 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.072 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107806+0000", 2024-09-13T05:11:34.072 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5886999999999999e-05 2024-09-13T05:11:34.072 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.072 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.072 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.072 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.072 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.072 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29075 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2838528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.072 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:11:34.072 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.971841648999998, 2024-09-13T05:11:34.073 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062188516999999999, 2024-09-13T05:11:34.073 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.073 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:34.073 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.073 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.073 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.073 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29075 2024-09-13T05:11:34.073 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.073 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.073 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.073 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.073 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:11:34.073 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.073 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.073 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.074 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.074 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:11:34.074 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.074 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.074 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.074 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:11:34.074 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.074 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.074 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.074 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045772+0000", 2024-09-13T05:11:34.074 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:11:34.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.075 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.075 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045778+0000", 2024-09-13T05:11:34.075 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9229999999999996e-06 2024-09-13T05:11:34.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.075 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.075 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045784+0000", 2024-09-13T05:11:34.075 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3800000000000002e-06 2024-09-13T05:11:34.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.075 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.075 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107823+0000", 2024-09-13T05:11:34.076 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062039331000000003 2024-09-13T05:11:34.076 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.076 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.076 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:34.076 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107886+0000", 2024-09-13T05:11:34.076 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2476000000000003e-05 2024-09-13T05:11:34.076 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.076 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.076 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.076 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107958+0000", 2024-09-13T05:11:34.076 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2089999999999996e-05 2024-09-13T05:11:34.076 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.076 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.076 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.077 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.077 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29115 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2682880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.077 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:11:34.077 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.968376122000002, 2024-09-13T05:11:34.077 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060847898999999997, 2024-09-13T05:11:34.077 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.077 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:34.077 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.077 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.077 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.077 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29115 2024-09-13T05:11:34.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.077 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.078 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.078 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:11:34.078 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.078 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.078 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:11:34.078 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.078 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.078 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049234+0000", 2024-09-13T05:11:34.078 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.079 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.079 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.079 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049237+0000", 2024-09-13T05:11:34.079 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9069999999999999e-06 2024-09-13T05:11:34.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.079 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.079 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.079 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049243+0000", 2024-09-13T05:11:34.079 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7459999999999997e-06 2024-09-13T05:11:34.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.079 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.079 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.080 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049248+0000", 2024-09-13T05:11:34.080 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1490000000000002e-06 2024-09-13T05:11:34.080 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.080 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.080 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.080 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.109945+0000", 2024-09-13T05:11:34.080 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060697299000000003 2024-09-13T05:11:34.080 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.080 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.080 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:34.080 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110013+0000", 2024-09-13T05:11:34.080 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8023999999999998e-05 2024-09-13T05:11:34.080 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.080 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.081 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.081 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110083+0000", 2024-09-13T05:11:34.081 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9296999999999997e-05 2024-09-13T05:11:34.081 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.081 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.081 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.081 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.081 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.081 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29116 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2692096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.081 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:11:34.081 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.968358277999997, 2024-09-13T05:11:34.081 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061040167999999999, 2024-09-13T05:11:34.081 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.081 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:34.082 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.082 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.082 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.082 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29116 2024-09-13T05:11:34.082 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.082 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.082 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.082 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.082 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:11:34.082 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.082 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.082 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.082 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.083 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:11:34.083 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.083 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.083 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.083 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.083 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049252+0000", 2024-09-13T05:11:34.083 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.083 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.083 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.083 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.083 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049255+0000", 2024-09-13T05:11:34.083 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7250000000000002e-06 2024-09-13T05:11:34.083 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.083 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.084 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.084 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049261+0000", 2024-09-13T05:11:34.084 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.755e-06 2024-09-13T05:11:34.084 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.084 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.084 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.084 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049266+0000", 2024-09-13T05:11:34.084 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2100000000000001e-06 2024-09-13T05:11:34.084 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.084 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.084 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.084 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110115+0000", 2024-09-13T05:11:34.084 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060849225999999999 2024-09-13T05:11:34.085 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.085 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.085 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:34.085 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110199+0000", 2024-09-13T05:11:34.085 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4339999999999995e-05 2024-09-13T05:11:34.085 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.085 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.085 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.085 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110293+0000", 2024-09-13T05:11:34.085 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3397e-05 2024-09-13T05:11:34.085 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.085 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.085 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.085 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.086 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.086 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29117 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2701312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.086 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:11:34.086 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.968340640999998, 2024-09-13T05:11:34.086 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.06118527, 2024-09-13T05:11:34.086 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.086 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:34.086 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.086 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.086 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.087 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29117 2024-09-13T05:11:34.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.087 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.087 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.087 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.087 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:11:34.087 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.087 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.087 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.087 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:11:34.087 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.088 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.088 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.088 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:11:34.088 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.088 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.088 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.088 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.088 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049273+0000", 2024-09-13T05:11:34.088 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.757e-06 2024-09-13T05:11:34.088 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.088 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.089 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.089 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049278+0000", 2024-09-13T05:11:34.089 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7830000000000004e-06 2024-09-13T05:11:34.089 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.089 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.089 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.089 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049284+0000", 2024-09-13T05:11:34.089 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3820000000000003e-06 2024-09-13T05:11:34.089 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.089 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.089 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.089 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110313+0000", 2024-09-13T05:11:34.090 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061029682000000002 2024-09-13T05:11:34.090 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.090 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.090 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:34.090 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110383+0000", 2024-09-13T05:11:34.090 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9406000000000006e-05 2024-09-13T05:11:34.090 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.090 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.090 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.090 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110456+0000", 2024-09-13T05:11:34.090 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2750000000000007e-05 2024-09-13T05:11:34.090 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.090 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.091 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.091 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.091 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.091 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29118 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2710528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.091 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:11:34.091 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.968322725999997, 2024-09-13T05:11:34.091 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061380698999999997, 2024-09-13T05:11:34.091 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.091 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:34.091 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.091 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.091 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.091 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29118 2024-09-13T05:11:34.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.092 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.092 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.092 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.092 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:11:34.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.092 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.092 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.092 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:11:34.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:11:34.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049291+0000", 2024-09-13T05:11:34.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8770000000000002e-06 2024-09-13T05:11:34.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049296+0000", 2024-09-13T05:11:34.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6799999999999998e-06 2024-09-13T05:11:34.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.094 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049302+0000", 2024-09-13T05:11:34.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2769999999999996e-06 2024-09-13T05:11:34.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.094 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110488+0000", 2024-09-13T05:11:34.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061186184999999997 2024-09-13T05:11:34.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.095 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:34.095 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110577+0000", 2024-09-13T05:11:34.095 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9246000000000006e-05 2024-09-13T05:11:34.095 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.095 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.095 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.095 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110669+0000", 2024-09-13T05:11:34.095 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1923999999999996e-05 2024-09-13T05:11:34.096 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.096 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.096 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.096 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.096 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.096 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29119 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2719744~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.096 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:11:34.096 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.968304981999999, 2024-09-13T05:11:34.096 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061521165000000003, 2024-09-13T05:11:34.096 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.096 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:34.096 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.096 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.096 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.097 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29119 2024-09-13T05:11:34.097 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.097 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.097 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.097 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.097 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:11:34.097 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.097 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.097 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.097 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.097 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:11:34.097 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.097 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.097 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.098 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.098 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049305+0000", 2024-09-13T05:11:34.098 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.098 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.098 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.098 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.098 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049308+0000", 2024-09-13T05:11:34.098 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7070000000000001e-06 2024-09-13T05:11:34.098 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.098 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.098 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.098 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049316+0000", 2024-09-13T05:11:34.098 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:11:34.098 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.099 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.099 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.099 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049322+0000", 2024-09-13T05:11:34.099 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3199999999999999e-06 2024-09-13T05:11:34.099 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.099 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.099 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.099 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110690+0000", 2024-09-13T05:11:34.099 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061368428000000003 2024-09-13T05:11:34.099 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.099 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.099 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:34.099 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110755+0000", 2024-09-13T05:11:34.099 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4893000000000004e-05 2024-09-13T05:11:34.099 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.100 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.100 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.100 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110827+0000", 2024-09-13T05:11:34.100 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2039000000000006e-05 2024-09-13T05:11:34.100 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.100 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.100 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.100 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.100 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.100 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29120 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2728960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.100 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:11:34.100 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.968284711999999, 2024-09-13T05:11:34.100 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061718420000000003, 2024-09-13T05:11:34.100 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.101 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:34.101 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.101 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.101 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.101 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29120 2024-09-13T05:11:34.101 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.102 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.102 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.102 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.102 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:11:34.102 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.102 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.102 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.102 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.102 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:11:34.102 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.102 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.102 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.102 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.102 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:11:34.103 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.103 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.103 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.103 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.103 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049329+0000", 2024-09-13T05:11:34.103 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.022e-06 2024-09-13T05:11:34.103 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.103 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.103 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.103 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049336+0000", 2024-09-13T05:11:34.103 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0720000000000002e-06 2024-09-13T05:11:34.103 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.103 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.103 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.104 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049341+0000", 2024-09-13T05:11:34.104 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:11:34.104 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.104 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.104 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.104 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110864+0000", 2024-09-13T05:11:34.104 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061523126999999997 2024-09-13T05:11:34.104 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.104 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.104 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:34.104 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110951+0000", 2024-09-13T05:11:34.104 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6557000000000005e-05 2024-09-13T05:11:34.104 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.105 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.105 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.105 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.111045+0000", 2024-09-13T05:11:34.105 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4043999999999996e-05 2024-09-13T05:11:34.105 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.105 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.105 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.105 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.105 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.105 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29136 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2876416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.105 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:11:34.105 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.964269287, 2024-09-13T05:11:34.105 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060742995000000001, 2024-09-13T05:11:34.105 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.106 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:34.106 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.106 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.106 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.106 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29136 2024-09-13T05:11:34.106 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.106 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.106 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.106 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.106 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:11:34.106 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.106 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.106 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.106 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.106 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:11:34.107 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.107 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.107 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.107 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.107 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053341+0000", 2024-09-13T05:11:34.107 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.107 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.107 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.107 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.107 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053344+0000", 2024-09-13T05:11:34.107 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:11:34.107 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.107 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.107 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.108 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053350+0000", 2024-09-13T05:11:34.108 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7200000000000003e-06 2024-09-13T05:11:34.108 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.108 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.108 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.108 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053355+0000", 2024-09-13T05:11:34.108 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0150000000000003e-06 2024-09-13T05:11:34.108 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.108 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.108 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.108 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113909+0000", 2024-09-13T05:11:34.108 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060554368999999997 2024-09-13T05:11:34.108 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.108 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.109 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:34.109 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113994+0000", 2024-09-13T05:11:34.109 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4658000000000002e-05 2024-09-13T05:11:34.109 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.109 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.109 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.109 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114085+0000", 2024-09-13T05:11:34.109 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0939000000000005e-05 2024-09-13T05:11:34.109 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.109 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.109 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.109 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.109 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.110 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29166 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2628608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.110 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:11:34.110 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.964251853, 2024-09-13T05:11:34.110 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060883127000000002, 2024-09-13T05:11:34.110 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.110 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:34.110 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.110 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.110 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.110 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29166 2024-09-13T05:11:34.110 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.110 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.110 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.110 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.110 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:11:34.111 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.111 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.111 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.111 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.111 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:11:34.111 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.111 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.111 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.111 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.111 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:11:34.111 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.111 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.111 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.111 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.112 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053361+0000", 2024-09-13T05:11:34.112 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:11:34.112 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.112 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.112 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.112 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053367+0000", 2024-09-13T05:11:34.112 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7350000000000001e-06 2024-09-13T05:11:34.112 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.112 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.112 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.112 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053372+0000", 2024-09-13T05:11:34.112 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7840000000000003e-06 2024-09-13T05:11:34.112 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.112 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.113 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.113 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114103+0000", 2024-09-13T05:11:34.113 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060730924999999998 2024-09-13T05:11:34.113 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.113 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.113 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:34.113 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114171+0000", 2024-09-13T05:11:34.113 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8021999999999993e-05 2024-09-13T05:11:34.113 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.113 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.113 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.113 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114242+0000", 2024-09-13T05:11:34.113 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1390999999999995e-05 2024-09-13T05:11:34.113 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.114 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.114 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.114 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.114 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.114 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:34.115 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #30, image image_client.0-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent31 2024-09-13T05:11:34.115 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:11:34.116 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:34.112+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:34.125 INFO:teuthology.orchestra.run.smithi120.stdout:4069 read 0x6be3143 thru 0x6be8a34 (0x58f2 bytes) 2024-09-13T05:11:34.134 INFO:teuthology.orchestra.run.smithi120.stdout:4070 write 0x1851bdd thru 0x18575aa (0x59ce bytes) 2024-09-13T05:11:34.144 INFO:teuthology.orchestra.run.smithi120.stdout:4071 read 0x47c9a39 thru 0x47cbcf3 (0x22bb bytes) 2024-09-13T05:11:34.144 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:34.144 INFO:teuthology.orchestra.run.smithi120.stdout:4073 read 0x30a8ff1 thru 0x30b1942 (0x8952 bytes) 2024-09-13T05:11:34.145 INFO:teuthology.orchestra.run.smithi120.stdout:4075 read 0x2b6542b thru 0x2b696f0 (0x42c6 bytes) 2024-09-13T05:11:34.151 INFO:teuthology.orchestra.run.smithi120.stdout:4076 trunc from 0xa135c45 to 0xc05e331 2024-09-13T05:11:34.164 INFO:teuthology.orchestra.run.smithi120.stdout:4078 punch from 0xab12bd8 to 0xab19192, (0x65ba bytes) 2024-09-13T05:11:34.165 INFO:teuthology.orchestra.run.smithi120.stdout:4079 read 0x3ae1e33 thru 0x3ae4666 (0x2834 bytes) 2024-09-13T05:11:34.165 INFO:teuthology.orchestra.run.smithi120.stdout:4080 read 0x9567c12 thru 0x95705e1 (0x89d0 bytes) 2024-09-13T05:11:34.171 INFO:teuthology.orchestra.run.smithi120.stdout:4081 trunc from 0xc05e331 to 0xde093c4 2024-09-13T05:11:34.185 INFO:teuthology.orchestra.run.smithi120.stdout:4082 punch from 0x5bd4e31 to 0x5bd9a7d, (0x4c4c bytes) 2024-09-13T05:11:34.185 INFO:teuthology.orchestra.run.smithi120.stdout:4083 read 0x17f3a08 thru 0x17f626a (0x2863 bytes) 2024-09-13T05:11:34.186 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:34.186 INFO:teuthology.orchestra.run.smithi120.stdout:4086 write 0xaf557e7 thru 0xaf55c15 (0x42f bytes) 2024-09-13T05:11:34.193 INFO:teuthology.orchestra.run.smithi120.stdout:4088 writesame 0xbcff40 thru 0xbd0b4e data_size 0x9(0xc0f bytes) 2024-09-13T05:11:34.202 INFO:teuthology.orchestra.run.smithi120.stdout:4089 write 0xcb9064b thru 0xcba01b4 (0xfb6a bytes) 2024-09-13T05:11:34.208 INFO:teuthology.orchestra.run.smithi120.stdout:4090 write 0x93b12ac thru 0x93baa23 (0x9778 bytes) 2024-09-13T05:11:34.215 INFO:teuthology.orchestra.run.smithi120.stdout:4091 punch from 0xbcf262 to 0xbd4eaa, (0x5c48 bytes) 2024-09-13T05:11:34.216 INFO:teuthology.orchestra.run.smithi120.stdout:4092 read 0xdbbb239 thru 0xdbc9d25 (0xeaed bytes) 2024-09-13T05:11:34.216 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:34.216 INFO:teuthology.orchestra.run.smithi120.stdout:4097 read 0xa2177c thru 0xa222d7 (0xb5c bytes) 2024-09-13T05:11:34.216 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:34.212+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:34.216 INFO:teuthology.orchestra.run.smithi120.stdout:4098 read 0x17feae7 thru 0x180ceaf (0xe3c9 bytes) 2024-09-13T05:11:34.217 INFO:teuthology.orchestra.run.smithi120.stdout:4099 writesame 0xcc77aea thru 0xcc7f26e data_size 0x15(0x7785 bytes) 2024-09-13T05:11:34.226 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:34.226 INFO:teuthology.orchestra.run.smithi120.stdout:4101 write 0xa398c86 thru 0xa39c897 (0x3c12 bytes) 2024-09-13T05:11:34.231 INFO:teuthology.orchestra.run.smithi120.stdout:4102 punch from 0x41347a9 to 0x413aa82, (0x62d9 bytes) 2024-09-13T05:11:34.231 INFO:teuthology.orchestra.run.smithi120.stdout:4104 write 0x33beafa thru 0x33c26e9 (0x3bf0 bytes) 2024-09-13T05:11:34.240 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:34.241 INFO:teuthology.orchestra.run.smithi120.stdout:4106 write 0xd04d10 thru 0xd13e56 (0xf147 bytes) 2024-09-13T05:11:34.241 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:34.241 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:34.241 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:11:34.241 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:34.250 INFO:teuthology.orchestra.run.smithi120.stdout:4107 read 0x132492f thru 0x1332a6b (0xe13d bytes) 2024-09-13T05:11:34.252 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:11:34.253 INFO:teuthology.orchestra.run.smithi120.stdout:4109 trunc from 0xde093c4 to 0xd2cc3a6 2024-09-13T05:11:34.269 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:34.269 INFO:teuthology.orchestra.run.smithi120.stdout:4113 write 0x832aa0b thru 0x8331280 (0x6876 bytes) 2024-09-13T05:11:34.276 INFO:teuthology.orchestra.run.smithi120.stdout:4114 write 0x9d1a43e thru 0x9d2576f (0xb332 bytes) 2024-09-13T05:11:34.284 INFO:teuthology.orchestra.run.smithi120.stdout:4115 punch from 0x10f434a to 0x10f635c, (0x2012 bytes) 2024-09-13T05:11:34.284 INFO:teuthology.orchestra.run.smithi120.stdout:4116 writesame 0x14d1fc2 thru 0x14d552f data_size 0x7(0x356e bytes) 2024-09-13T05:11:34.292 INFO:teuthology.orchestra.run.smithi120.stdout:4118 read 0xbd39bd4 thru 0xbd439c1 (0x9dee bytes) 2024-09-13T05:11:34.292 INFO:teuthology.orchestra.run.smithi120.stdout:4119 write 0x433baf3 thru 0x434374c (0x7c5a bytes) 2024-09-13T05:11:34.301 INFO:teuthology.orchestra.run.smithi120.stdout:4120 read 0x54c55f thru 0x550ffd (0x4a9f bytes) 2024-09-13T05:11:34.302 INFO:teuthology.orchestra.run.smithi120.stdout:4121 punch from 0xc7a0073 to 0xc7af0f3, (0xf080 bytes) 2024-09-13T05:11:34.302 INFO:teuthology.orchestra.run.smithi120.stdout:4122 writesame 0xb2ce85b thru 0xb2dc29e data_size 0x7a(0xda44 bytes) 2024-09-13T05:11:34.309 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:11:34.310 INFO:teuthology.orchestra.run.smithi120.stdout:4123 write 0xa757261 thru 0xa766ec7 (0xfc67 bytes) 2024-09-13T05:11:34.317 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:34.317 INFO:teuthology.orchestra.run.smithi120.stdout:4127 punch from 0x461cb2 to 0x46d86c, (0xbbba bytes) 2024-09-13T05:11:34.317 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:34.316+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:34.330 INFO:teuthology.orchestra.run.smithi120.stdout:4129 trunc from 0xd2cc3a6 to 0x6968a1b 2024-09-13T05:11:34.358 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:34.358 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:34.359 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:34.359 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:34.359 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:34.359 INFO:teuthology.orchestra.run.smithi120.stdout:4130 write 0x4bde3eb thru 0x4bdfd1a (0x1930 bytes) 2024-09-13T05:11:34.366 INFO:teuthology.orchestra.run.smithi120.stdout:4131 writesame 0x61f21f1 thru 0x61f3244 data_size 0x2c(0x1054 bytes) 2024-09-13T05:11:34.368 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:11:34.373 INFO:teuthology.orchestra.run.smithi120.stdout:4135 read 0x5f8671e thru 0x5f8d550 (0x6e33 bytes) 2024-09-13T05:11:34.373 INFO:teuthology.orchestra.run.smithi120.stdout:4136 read 0x40e9485 thru 0x40f6164 (0xcce0 bytes) 2024-09-13T05:11:34.375 INFO:teuthology.orchestra.run.smithi120.stdout:4137 punch from 0x3f20452 to 0x3f239b9, (0x3567 bytes) 2024-09-13T05:11:34.391 INFO:teuthology.orchestra.run.smithi120.stdout:4138 write 0x85b67f6 thru 0x85c2961 (0xc16c bytes) 2024-09-13T05:11:34.398 INFO:teuthology.orchestra.run.smithi120.stdout:4139 read 0xeaad2b thru 0xeaff1e (0x51f4 bytes) 2024-09-13T05:11:34.398 INFO:teuthology.orchestra.run.smithi120.stdout:4140 writesame 0x2cf3517 thru 0x2cf4cbb data_size 0x1(0x17a5 bytes) 2024-09-13T05:11:34.406 INFO:teuthology.orchestra.run.smithi120.stdout:4141 writesame 0x3d24bcd thru 0x3d3488a data_size 0x2(0xfcbe bytes) 2024-09-13T05:11:34.418 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:34.416+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:34.439 INFO:teuthology.orchestra.run.smithi120.stdout:4142 read 0x334f3d4 thru 0x3352e35 (0x3a62 bytes) 2024-09-13T05:11:34.450 INFO:teuthology.orchestra.run.smithi120.stdout:4143 write 0x967455b thru 0x967ad31 (0x67d7 bytes) 2024-09-13T05:11:34.455 INFO:teuthology.orchestra.run.smithi120.stdout:4144 writesame 0x61e447e thru 0x61eca9f data_size 0x3b(0x8622 bytes) 2024-09-13T05:11:34.457 INFO:teuthology.orchestra.run.smithi120.stdout:4145 writesame 0x2dc15a1 thru 0x2dc985c data_size 0x6(0x82bc bytes) 2024-09-13T05:11:34.463 INFO:teuthology.orchestra.run.smithi120.stdout:4146 read 0xb6bb34 thru 0xb6dea2 (0x236f bytes) 2024-09-13T05:11:34.464 INFO:teuthology.orchestra.run.smithi120.stdout:4147 writesame 0x32d44e2 thru 0x32dc65a data_size 0x7(0x8179 bytes) 2024-09-13T05:11:34.465 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:11:34.469 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:34.479 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:34.480 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:34.480 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:34.480 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:34.480 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.480 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.480 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:34.480 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 57.613723382000003, 2024-09-13T05:11:34.480 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:11:34.480 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.480 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:34.480 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.480 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.481 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.481 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:11:34.481 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.481 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.481 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.481 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.481 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:34.481 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.481 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.481 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.481 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.481 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:34.482 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.482 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.482 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.482 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.482 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:34.482 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:34.482 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.482 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.482 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.482 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:11:34.483 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:11:34.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.483 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.483 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.483 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:11:34.483 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:11:34.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.483 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.483 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.483 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:11:34.483 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:11:34.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.483 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.483 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.484 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:11:34.484 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:11:34.484 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.484 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.484 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:34.484 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:11:34.484 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:11:34.484 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.484 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.484 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.484 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:11:34.484 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:11:34.484 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.485 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.485 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:34.485 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:11:34.485 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:11:34.485 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.485 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.485 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.485 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:11:34.485 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:11:34.485 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.485 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.485 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.485 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.485 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.486 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.486 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:34.486 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 57.613698946, 2024-09-13T05:11:34.486 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:11:34.486 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.486 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:34.486 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.486 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.486 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.486 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:11:34.486 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.486 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.486 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.486 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.487 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:34.487 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.487 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.487 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.487 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.487 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:34.487 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.487 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.487 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.487 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.488 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:34.488 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:34.488 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.488 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.488 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.488 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:11:34.488 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:11:34.488 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.488 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.489 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.489 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:11:34.489 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:11:34.489 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.489 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.489 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.489 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:11:34.489 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:11:34.489 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.489 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.489 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.489 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:11:34.489 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:11:34.490 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.490 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.490 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:34.490 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:11:34.490 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:11:34.490 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.490 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.491 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.491 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:11:34.491 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:11:34.491 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.491 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.491 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:34.491 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:11:34.491 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:11:34.491 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.491 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.492 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.492 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:11:34.492 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:11:34.492 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.492 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.493 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.493 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.493 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.493 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.493 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:34.493 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 57.613689119999997, 2024-09-13T05:11:34.493 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:11:34.494 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.494 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:34.494 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.494 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.494 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.494 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:11:34.494 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.495 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.495 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.495 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.495 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:34.495 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.495 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.495 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.496 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.496 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:34.496 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.496 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.496 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.496 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.496 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:34.497 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:34.497 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.497 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.497 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.497 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:11:34.498 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:11:34.498 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.498 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.498 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.498 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:11:34.498 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:11:34.498 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.499 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.499 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.499 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:11:34.499 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:11:34.500 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.500 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.500 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.500 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:11:34.500 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:11:34.500 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.501 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.501 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:34.501 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:11:34.501 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:11:34.501 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.501 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.501 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.502 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:11:34.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:11:34.502 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.502 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.502 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.502 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:11:34.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:11:34.503 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.503 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.503 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.503 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.503 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.503 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.503 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:34.503 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 57.613680883999997, 2024-09-13T05:11:34.504 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:11:34.504 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.504 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:34.504 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.504 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.504 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.504 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:11:34.504 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.504 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.504 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.504 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.504 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:34.504 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.504 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.505 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.505 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.505 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:34.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.505 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.505 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.505 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:34.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:34.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.505 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.505 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.505 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:11:34.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:11:34.506 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.506 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.506 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:11:34.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:11:34.506 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.506 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.506 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:11:34.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:11:34.506 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.507 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.507 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:11:34.507 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:11:34.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.507 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:34.507 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:11:34.507 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:11:34.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.507 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.507 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:11:34.507 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:11:34.508 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.508 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.508 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.508 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:11:34.508 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:11:34.508 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.508 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.508 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.508 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.508 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.508 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.508 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:34.508 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 57.613658972000003, 2024-09-13T05:11:34.508 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:11:34.509 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.509 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:34.509 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.509 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.509 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.509 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:11:34.509 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.509 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.509 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.509 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.509 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:34.509 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.509 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.509 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.510 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.510 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:34.510 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.510 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.510 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.510 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.510 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:34.510 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:34.510 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.510 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.510 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.510 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:11:34.510 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:11:34.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.511 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.511 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.511 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:11:34.511 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:11:34.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.511 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.511 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.511 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:11:34.511 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:11:34.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.511 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.512 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.512 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:11:34.512 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:11:34.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.512 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.512 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:34.512 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:11:34.512 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:11:34.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.512 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.512 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.512 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:11:34.512 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:11:34.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.513 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.513 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:11:34.513 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:11:34.513 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.513 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.513 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.513 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.513 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.513 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:34.513 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 57.613650368000002, 2024-09-13T05:11:34.513 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:11:34.513 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.514 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:34.514 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.514 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.514 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.514 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:11:34.514 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.514 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.514 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.514 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.514 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:34.514 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.514 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.514 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.514 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.515 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:34.515 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.515 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.515 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:34.515 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:34.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.515 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.515 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:11:34.515 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:11:34.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.516 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.516 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:11:34.516 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:11:34.516 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.516 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.516 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.516 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:11:34.516 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:11:34.516 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.516 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.516 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.516 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:11:34.516 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:11:34.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.517 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:34.517 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:11:34.517 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:11:34.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.517 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.517 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:11:34.517 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:11:34.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.517 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.517 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:11:34.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:11:34.518 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.518 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.518 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.518 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.518 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:34.518 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 57.613640674000003, 2024-09-13T05:11:34.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:11:34.518 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.518 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:34.518 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.519 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.519 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.521 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:11:34.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.521 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.521 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:34.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:34.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:34.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:34.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.523 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:11:34.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:11:34.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.523 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:11:34.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:11:34.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:11:34.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:11:34.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.525 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.525 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:11:34.525 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:11:34.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.526 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:34.526 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:11:34.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:11:34.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.526 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:11:34.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:11:34.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.528 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.528 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:11:34.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:11:34.528 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.528 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.529 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.529 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.529 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:34.529 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 57.613631558999998, 2024-09-13T05:11:34.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:11:34.530 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.530 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:34.530 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.530 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.530 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.531 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:11:34.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.531 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:34.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:34.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:34.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:34.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:11:34.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:11:34.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.535 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.535 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:11:34.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:11:34.535 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:11:34.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:11:34.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:11:34.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:11:34.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:34.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:11:34.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:11:34.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:11:34.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:11:34.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.539 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.539 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:11:34.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:11:34.539 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.540 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.540 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.540 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.540 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:11:34.540 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 57.613623079999996, 2024-09-13T05:11:34.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:11:34.541 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.541 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:34.541 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.541 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.541 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.541 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:11:34.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.541 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:11:34.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:11:34.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:11:34.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:11:34.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:11:34.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:11:34.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:11:34.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:11:34.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:11:34.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.544 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:11:34.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:11:34.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.544 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:34.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:11:34.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:11:34.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.545 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:11:34.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:11:34.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.545 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:11:34.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:11:34.545 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.545 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.545 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.546 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.546 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:11:34.546 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 57.613611155000001, 2024-09-13T05:11:34.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:11:34.546 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.546 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:34.546 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.546 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.546 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.546 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:11:34.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.546 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:11:34.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:11:34.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:11:34.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:34.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:11:34.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:11:34.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:11:34.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:11:34.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:11:34.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:11:34.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:11:34.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:11:34.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:34.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:11:34.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:11:34.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:11:34.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:11:34.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:11:34.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:11:34.550 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.550 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.550 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.551 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.551 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:34.551 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 57.613589566000002, 2024-09-13T05:11:34.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:11:34.551 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.551 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:34.551 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.551 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.551 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.551 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:11:34.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.551 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:34.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:34.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.553 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:34.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.553 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.553 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:11:34.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:11:34.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.553 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.553 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:11:34.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:11:34.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:11:34.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:11:34.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:11:34.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:11:34.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:34.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:11:34.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:11:34.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:11:34.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:11:34.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:11:34.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:11:34.555 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.555 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.556 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.556 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.556 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:34.556 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 57.613566437999999, 2024-09-13T05:11:34.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:11:34.556 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.557 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:34.557 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.557 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.557 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.557 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:11:34.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.557 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:34.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:34.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:34.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:11:34.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:11:34.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:11:34.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:11:34.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:11:34.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:11:34.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.562 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:11:34.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:11:34.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:34.562 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:11:34.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:11:34.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:11:34.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:11:34.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:11:34.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:11:34.564 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.564 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.564 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.564 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.564 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:11:34.564 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 57.613551065000003, 2024-09-13T05:11:34.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:11:34.565 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.565 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:34.565 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.565 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.565 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.565 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:11:34.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.565 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:11:34.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:11:34.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:11:34.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:11:34.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:11:34.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:11:34.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:11:34.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.569 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:11:34.569 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:11:34.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.569 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:11:34.569 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:11:34.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.570 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:34.570 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:11:34.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:11:34.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.570 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.570 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:11:34.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:11:34.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.570 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.571 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:11:34.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:11:34.571 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.571 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.571 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.571 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.571 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.571 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:34.571 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 57.613530597, 2024-09-13T05:11:34.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:11:34.571 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.571 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:34.571 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.571 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:11:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.573 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.573 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:34.573 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.573 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.573 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:11:34.573 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:11:34.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.573 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:11:34.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:11:34.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.574 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.574 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:11:34.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:11:34.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.574 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.574 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:11:34.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:11:34.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.575 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:34.575 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:11:34.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:11:34.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.575 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.575 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:11:34.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:11:34.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.576 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.576 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:11:34.576 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:11:34.576 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.576 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.577 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.577 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.577 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.577 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:34.577 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 57.613513935999997, 2024-09-13T05:11:34.578 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:11:34.578 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.578 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:34.578 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.578 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.578 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.578 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:11:34.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.578 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.578 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:34.578 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:34.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:34.580 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.580 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.580 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.580 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.580 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:11:34.580 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:11:34.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:11:34.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:11:34.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:11:34.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:11:34.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.583 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:11:34.583 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:11:34.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.583 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:34.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:11:34.583 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:11:34.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.583 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:11:34.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:11:34.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.584 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.584 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.584 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:11:34.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:11:34.584 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.584 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.584 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.584 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.584 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.584 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:11:34.585 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 57.613487223, 2024-09-13T05:11:34.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:11:34.585 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.585 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:34.585 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.585 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.585 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.585 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:11:34.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.585 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.585 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:11:34.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:11:34.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:11:34.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:11:34.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:11:34.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.587 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:11:34.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:11:34.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.587 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:11:34.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:11:34.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.587 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.588 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:11:34.588 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:11:34.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.588 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.588 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:34.588 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:11:34.588 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:11:34.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.588 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.588 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:11:34.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:11:34.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:11:34.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:11:34.589 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.589 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.589 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.589 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.590 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:34.590 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 57.613468371000003, 2024-09-13T05:11:34.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:11:34.590 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.590 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:34.590 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.590 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.590 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.590 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:11:34.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.590 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:34.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:34.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.592 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:34.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.593 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.593 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.593 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:11:34.593 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:11:34.593 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.593 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.594 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.594 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:11:34.594 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:11:34.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.594 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.594 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:11:34.595 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:11:34.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.595 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:11:34.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:11:34.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:34.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:11:34.597 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:11:34.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.597 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.597 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.597 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:11:34.597 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:11:34.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.597 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.598 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.598 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:11:34.598 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:11:34.598 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.598 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.598 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.598 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.598 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.598 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:34.598 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 57.613450585000002, 2024-09-13T05:11:34.598 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:11:34.598 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.599 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:34.599 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.599 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.599 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.599 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:11:34.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.599 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.599 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:34.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:34.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.600 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:34.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.600 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:11:34.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:11:34.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.601 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.601 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.601 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:11:34.601 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:11:34.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.601 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.601 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.601 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:11:34.601 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:11:34.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.601 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:11:34.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:11:34.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:34.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:11:34.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:11:34.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:11:34.603 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:11:34.603 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.603 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.603 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.603 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:11:34.603 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:11:34.603 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.603 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.604 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.604 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.604 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:34.604 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 57.613415525000001, 2024-09-13T05:11:34.604 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:11:34.604 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.604 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:34.604 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.604 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.604 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.605 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:11:34.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.605 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.605 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.605 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:34.605 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.605 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.605 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:34.605 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:34.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.606 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:11:34.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:11:34.606 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:11:34.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:11:34.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.607 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.607 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:11:34.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:11:34.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.608 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.608 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:11:34.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:11:34.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.608 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:34.608 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:11:34.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:11:34.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.608 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.608 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:11:34.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:11:34.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:11:34.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:11:34.609 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.609 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.609 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.609 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:34.609 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:34.609 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 57.613398709999998, 2024-09-13T05:11:34.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:11:34.610 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:34.610 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:34.610 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:34.610 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:34.610 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:34.610 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:11:34.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.610 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:34.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:34.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:34.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:34.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:34.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:34.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:34.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:34.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:34.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:34.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:11:34.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:11:34.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:34.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:11:34.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:11:34.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:34.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:11:34.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:11:34.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.613 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:11:34.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:11:34.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.613 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:34.613 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:11:34.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:11:34.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.613 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:34.613 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:11:34.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:11:34.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:34.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:34.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:34.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:11:34.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:11:34.614 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.614 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.614 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.614 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:34.614 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:34.614 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:34.615 INFO:teuthology.orchestra.run.smithi120.stdout:4149 trunc from 0x967ad32 to 0x3a99a71 2024-09-13T05:11:34.616 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:11:34.616 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:11:34.616 INFO:teuthology.orchestra.run.smithi120.stdout:4151 punch from 0x7b3abb to 0x7bf604, (0xbb49 bytes) 2024-09-13T05:11:34.617 INFO:teuthology.orchestra.run.smithi120.stdout:4153 trunc from 0x3a99a71 to 0xac383de 2024-09-13T05:11:34.617 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:11:34.617 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:34.609+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:34.617 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:11:34.618 INFO:teuthology.orchestra.run.smithi120.stdout:4156 trunc from 0xac383de to 0x5240626 2024-09-13T05:11:34.618 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:11:34.619 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:34.619 INFO:teuthology.orchestra.run.smithi120.stdout:4161 trunc from 0x5240626 to 0xd56e6d 2024-09-13T05:11:34.619 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:11:34.619 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:11:34.619 INFO:teuthology.orchestra.run.smithi120.stdout:4162 write 0x698abc0 thru 0x69921df (0x7620 bytes) 2024-09-13T05:11:34.620 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:11:34.622 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:11:34.622 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:11:34.622 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:11:34.622 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:11:34.622 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:11:34.622 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:11:34.622 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:11:34.623 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:11:34.626 INFO:teuthology.orchestra.run.smithi120.stdout:4163 trunc from 0x69921e0 to 0xcc755c8 2024-09-13T05:11:34.638 INFO:teuthology.orchestra.run.smithi120.stdout:4166 writesame 0xb360000 thru 0xb36e50d data_size 0x57(0xe50e bytes) 2024-09-13T05:11:34.646 INFO:teuthology.orchestra.run.smithi120.stdout:4169 write 0x9b6c7e3 thru 0x9b7c06a (0xf888 bytes) 2024-09-13T05:11:34.653 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:34.653 INFO:teuthology.orchestra.run.smithi120.stdout:4176 read 0x2602196 thru 0x260a56a (0x83d5 bytes) 2024-09-13T05:11:34.669 INFO:teuthology.orchestra.run.smithi120.stdout:4177 writesame 0xdb1c538 thru 0xdb1e26b data_size 0x1(0x1d34 bytes) 2024-09-13T05:11:34.669 INFO:teuthology.orchestra.run.smithi120.stdout:4178 punch from 0x93f1667 to 0x93f37b1, (0x214a bytes) 2024-09-13T05:11:34.669 INFO:teuthology.orchestra.run.smithi120.stdout:4179 read 0xb380f11 thru 0xb38a9ae (0x9a9e bytes) 2024-09-13T05:11:34.669 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:34.669 INFO:teuthology.orchestra.run.smithi120.stdout:4184 read 0x5758456 thru 0x5760aef (0x869a bytes) 2024-09-13T05:11:34.669 INFO:teuthology.orchestra.run.smithi120.stdout:4185 read 0x9e73c75 thru 0x9e838e1 (0xfc6d bytes) 2024-09-13T05:11:34.669 INFO:teuthology.orchestra.run.smithi120.stdout:4187 write 0x628dd35 thru 0x6292e1a (0x50e6 bytes) 2024-09-13T05:11:34.675 INFO:teuthology.orchestra.run.smithi120.stdout:4189 writesame 0x96752e thru 0x96aa92 data_size 0x1(0x3565 bytes) 2024-09-13T05:11:34.707 INFO:teuthology.orchestra.run.smithi120.stdout:4190 trunc from 0xdb1e26c to 0x5594d8e 2024-09-13T05:11:34.716 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:34.709+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:34.730 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:34.730 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:34.740 INFO:teuthology.orchestra.run.smithi120.stdout:4191 trunc from 0x5594d8e to 0xcf76800 2024-09-13T05:11:34.743 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:11:34.753 INFO:teuthology.orchestra.run.smithi120.stdout:4192 punch from 0x96e54a4 to 0x96eceae, (0x7a0a bytes) 2024-09-13T05:11:34.753 INFO:teuthology.orchestra.run.smithi120.stdout:4193 writesame 0x4c5bb07 thru 0x4c65e38 data_size 0x21(0xa332 bytes) 2024-09-13T05:11:34.761 INFO:teuthology.orchestra.run.smithi120.stdout:4195 read 0x455c4f9 thru 0x456ae05 (0xe90d bytes) 2024-09-13T05:11:34.761 INFO:teuthology.orchestra.run.smithi120.stdout:4196 writesame 0xbeec13c thru 0xbeec1a0 data_size 0x1(0x65 bytes) 2024-09-13T05:11:34.771 INFO:teuthology.orchestra.run.smithi120.stdout:4197 trunc from 0xcf76800 to 0xaef4f8a 2024-09-13T05:11:34.792 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:34.792 INFO:teuthology.orchestra.run.smithi120.stdout:4199 read 0x98d58c2 thru 0x98d7114 (0x1853 bytes) 2024-09-13T05:11:34.792 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:34.792 INFO:teuthology.orchestra.run.smithi120.stdout:4201 read 0x8008a96 thru 0x8012169 (0x96d4 bytes) 2024-09-13T05:11:34.792 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:34.792 INFO:teuthology.orchestra.run.smithi120.stdout:4203 punch from 0xaca82ad to 0xacb3449, (0xb19c bytes) 2024-09-13T05:11:34.792 INFO:teuthology.orchestra.run.smithi120.stdout:4204 punch from 0x904e344 to 0x9056577, (0x8233 bytes) 2024-09-13T05:11:34.792 INFO:teuthology.orchestra.run.smithi120.stdout:4206 read 0xa2e4b7e thru 0xa2ed476 (0x88f9 bytes) 2024-09-13T05:11:34.808 INFO:teuthology.orchestra.run.smithi120.stdout:4207 writesame 0xc838d63 thru 0xc8394e7 data_size 0x1(0x785 bytes) 2024-09-13T05:11:34.808 INFO:teuthology.orchestra.run.smithi120.stdout:4208 write 0x202c6d2 thru 0x203b95b (0xf28a bytes) 2024-09-13T05:11:34.814 INFO:teuthology.orchestra.run.smithi120.stdout:4210 punch from 0x2bb73f3 to 0x2bc181b, (0xa428 bytes) 2024-09-13T05:11:34.814 INFO:teuthology.orchestra.run.smithi120.stdout:4211 write 0xc68cf3 thru 0xc7278d (0x9a9b bytes) 2024-09-13T05:11:34.818 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:34.813+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:34.818 INFO:teuthology.orchestra.run.smithi120.stdout:4212 read 0x5bd1149 thru 0x5be01fc (0xf0b4 bytes) 2024-09-13T05:11:34.818 INFO:teuthology.orchestra.run.smithi120.stdout:4213 write 0x15185f thru 0x160b4d (0xf2ef bytes) 2024-09-13T05:11:34.834 INFO:teuthology.orchestra.run.smithi120.stdout:4214 read 0x67cb55c thru 0x67cc3c6 (0xe6b bytes) 2024-09-13T05:11:34.835 INFO:teuthology.orchestra.run.smithi120.stdout:4216 write 0x278b637 thru 0x2797df1 (0xc7bb bytes) 2024-09-13T05:11:34.842 INFO:teuthology.orchestra.run.smithi120.stdout:4218 punch from 0x43936b1 to 0x43a1764, (0xe0b3 bytes) 2024-09-13T05:11:34.842 INFO:teuthology.orchestra.run.smithi120.stdout:4219 read 0x4e5e4b4 thru 0x4e65b64 (0x76b1 bytes) 2024-09-13T05:11:34.842 INFO:teuthology.orchestra.run.smithi120.stdout:4220 read 0x523aad6 thru 0x52424c9 (0x79f4 bytes) 2024-09-13T05:11:34.842 INFO:teuthology.orchestra.run.smithi120.stdout:4223 punch from 0x683570f to 0x683d2af, (0x7ba0 bytes) 2024-09-13T05:11:34.842 INFO:teuthology.orchestra.run.smithi120.stdout:4224 write 0x2c9b3a2 thru 0x2c9e00f (0x2c6e bytes) 2024-09-13T05:11:34.847 INFO:teuthology.orchestra.run.smithi120.stdout:4225 write 0x37550be thru 0x375a34b (0x528e bytes) 2024-09-13T05:11:34.852 INFO:teuthology.orchestra.run.smithi120.stdout:4227 write 0x8658e9e thru 0x865e297 (0x53fa bytes) 2024-09-13T05:11:34.858 INFO:teuthology.orchestra.run.smithi120.stdout:4230 write 0x3486a4d thru 0x348ef4d (0x8501 bytes) 2024-09-13T05:11:34.860 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:34.860 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:34.865 INFO:teuthology.orchestra.run.smithi120.stdout:4231 read 0x695bbbe thru 0x695c56f (0x9b2 bytes) 2024-09-13T05:11:34.865 INFO:teuthology.orchestra.run.smithi120.stdout:4232 read 0xc7a1d1f thru 0xc7a947a (0x775c bytes) 2024-09-13T05:11:34.865 INFO:teuthology.orchestra.run.smithi120.stdout:4233 punch from 0xc25d909 to 0xc26c3b9, (0xeab0 bytes) 2024-09-13T05:11:34.865 INFO:teuthology.orchestra.run.smithi120.stdout:4234 punch from 0xa6b7371 to 0xa6b7597, (0x226 bytes) 2024-09-13T05:11:34.875 INFO:teuthology.orchestra.run.smithi120.stdout:4235 trunc from 0xc8394e8 to 0x6a96348 2024-09-13T05:11:34.877 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:11:34.901 INFO:teuthology.orchestra.run.smithi120.stdout:4237 trunc from 0x6a96348 to 0x5ddc957 2024-09-13T05:11:34.914 INFO:teuthology.orchestra.run.smithi120.stdout:4238 punch from 0x5b54f6f to 0x5b6330b, (0xe39c bytes) 2024-09-13T05:11:34.914 INFO:teuthology.orchestra.run.smithi120.stdout:4239 punch from 0x4209acc to 0x4215f5b, (0xc48f bytes) 2024-09-13T05:11:34.914 INFO:teuthology.orchestra.run.smithi120.stdout:4240 punch from 0x2fcd8ab to 0x2fcfc4f, (0x23a4 bytes) 2024-09-13T05:11:34.914 INFO:teuthology.orchestra.run.smithi120.stdout:4242 read 0x5a3eb33 thru 0x5a4917f (0xa64d bytes) 2024-09-13T05:11:34.914 INFO:teuthology.orchestra.run.smithi120.stdout:4245 write 0x5626e42 thru 0x563102b (0xa1ea bytes) 2024-09-13T05:11:34.918 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:34.913+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:34.921 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:34.937 INFO:teuthology.orchestra.run.smithi120.stdout:4247 writesame 0x6a95d44 thru 0x6a99a49 data_size 0x2(0x3d06 bytes) 2024-09-13T05:11:34.937 INFO:teuthology.orchestra.run.smithi120.stdout:4248 read 0x56d4e8f thru 0x56d5131 (0x2a3 bytes) 2024-09-13T05:11:34.938 INFO:teuthology.orchestra.run.smithi120.stdout:4249 read 0x33ecfbb thru 0x33f772b (0xa771 bytes) 2024-09-13T05:11:34.938 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:34.947 INFO:teuthology.orchestra.run.smithi120.stdout:4251 trunc from 0x6a99a4a to 0xb8ee897 2024-09-13T05:11:34.962 INFO:teuthology.orchestra.run.smithi120.stdout:4252 read 0x14708db thru 0x147894e (0x8074 bytes) 2024-09-13T05:11:34.962 INFO:teuthology.orchestra.run.smithi120.stdout:4253 read 0x346709b thru 0x346fbc4 (0x8b2a bytes) 2024-09-13T05:11:34.963 INFO:teuthology.orchestra.run.smithi120.stdout:4254 read 0x89981f2 thru 0x899aabd (0x28cc bytes) 2024-09-13T05:11:34.975 INFO:teuthology.orchestra.run.smithi120.stdout:4255 write 0xbe73490 thru 0xbe73d0f (0x880 bytes) 2024-09-13T05:11:34.982 INFO:teuthology.orchestra.run.smithi120.stdout:4257 read 0x48894e4 thru 0x488c7cd (0x32ea bytes) 2024-09-13T05:11:34.983 INFO:teuthology.orchestra.run.smithi120.stdout:4259 write 0x7fb478 thru 0x7fd155 (0x1cde bytes) 2024-09-13T05:11:35.009 INFO:teuthology.orchestra.run.smithi120.stdout:4260 writesame 0xe91555d thru 0xe9199b6 data_size 0xd(0x445a bytes) 2024-09-13T05:11:35.009 INFO:teuthology.orchestra.run.smithi120.stdout:4261 write 0x67d0325 thru 0x67d89df (0x86bb bytes) 2024-09-13T05:11:35.015 INFO:teuthology.orchestra.run.smithi120.stdout:4262 punch from 0x37d10fc to 0x37dba43, (0xa947 bytes) 2024-09-13T05:11:35.016 INFO:teuthology.orchestra.run.smithi120.stdout:4263 read 0xb1a305f thru 0xb1aae62 (0x7e04 bytes) 2024-09-13T05:11:35.016 INFO:teuthology.orchestra.run.smithi120.stdout:4264 writesame 0xb776621 thru 0xb784bbe data_size 0x65(0xe59e bytes) 2024-09-13T05:11:35.019 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:35.013+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:35.024 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:35.024 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:35.025 INFO:teuthology.orchestra.run.smithi120.stdout:4265 read 0x3fecdb1 thru 0x3fee2b7 (0x1507 bytes) 2024-09-13T05:11:35.025 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:35.025 INFO:teuthology.orchestra.run.smithi120.stdout:4268 clone 33 order 21 su 65536 sc 3 2024-09-13T05:11:35.035 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:11:35.120 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:35.113+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:35.185 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:35.185 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:35.195 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:11:35.221 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:35.220+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:35.303 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:35.304 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:35.313 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:11:35.322 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:35.317+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:35.422 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:35.417+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:35.467 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:35.467 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:35.477 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:11:35.523 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:35.517+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:35.651 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:35.651 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:35.652 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:11:35.652 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:35.648+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:35.705 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T05:11:35.752 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:35.748+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:35.808 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:35.808 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:35.819 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:11:35.829 INFO:teuthology.orchestra.run.smithi120.stdout:flattening image image_client.0-clone32 2024-09-13T05:11:35.853 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:35.849+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:35.944 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:35.944 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:35.955 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:11:35.955 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:35.952+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:36.053 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #31, image image_client.0-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent32 2024-09-13T05:11:36.055 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:36.052+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:36.073 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:36.073 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:36.084 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:11:36.157 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:36.156+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:36.198 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:36.198 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:36.208 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:11:36.258 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:36.256+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:36.321 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:36.321 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:36.332 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:11:36.379 INFO:teuthology.orchestra.run.smithi120.stdout:4269 trunc from 0xe9199b7 to 0x8b93899 2024-09-13T05:11:36.381 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:36.377+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:36.434 INFO:teuthology.orchestra.run.smithi120.stdout:4270 writesame 0xe91555c thru 0xe92009c data_size 0x1(0xab41 bytes) 2024-09-13T05:11:36.434 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:36.441 INFO:teuthology.orchestra.run.smithi120.stdout:4272 trunc from 0xe92009d to 0xa71a84f 2024-09-13T05:11:36.452 INFO:teuthology.orchestra.run.smithi120.stdout:4273 read 0x91e673a thru 0x91ee69e (0x7f65 bytes) 2024-09-13T05:11:36.456 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:36.456 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:36.461 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:36.460+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:36.464 INFO:teuthology.orchestra.run.smithi120.stdout:4274 write 0xacda585 thru 0xacde65a (0x40d6 bytes) 2024-09-13T05:11:36.468 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:11:36.478 INFO:teuthology.orchestra.run.smithi120.stdout:4275 trunc from 0xacde65b to 0xea393cd 2024-09-13T05:11:36.505 INFO:teuthology.orchestra.run.smithi120.stdout:4277 trunc from 0xea393cd to 0x7052f59 2024-09-13T05:11:36.532 INFO:teuthology.orchestra.run.smithi120.stdout:4278 write 0x636fd54 thru 0x63708eb (0xb98 bytes) 2024-09-13T05:11:36.562 INFO:teuthology.orchestra.run.smithi120.stdout:4280 write 0xb7320b4 thru 0xb73d460 (0xb3ad bytes) 2024-09-13T05:11:36.562 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:36.560+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:36.568 INFO:teuthology.orchestra.run.smithi120.stdout:4281 write 0x2b9be94 thru 0x2ba5c07 (0x9d74 bytes) 2024-09-13T05:11:36.581 INFO:teuthology.orchestra.run.smithi120.stdout:4282 write 0x7f62640 thru 0x7f6f2c7 (0xcc88 bytes) 2024-09-13T05:11:36.584 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:36.584 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:36.587 INFO:teuthology.orchestra.run.smithi120.stdout:4283 read 0x1d1ee91 thru 0x1d2d0c4 (0xe234 bytes) 2024-09-13T05:11:36.587 INFO:teuthology.orchestra.run.smithi120.stdout:4284 read 0x6fd2beb thru 0x6fd8b0d (0x5f23 bytes) 2024-09-13T05:11:36.594 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:11:36.595 INFO:teuthology.orchestra.run.smithi120.stdout:4285 trunc from 0xb73d461 to 0xd827780 2024-09-13T05:11:36.604 INFO:teuthology.orchestra.run.smithi120.stdout:4286 write 0x71371bd thru 0x713df6d (0x6db1 bytes) 2024-09-13T05:11:36.607 INFO:teuthology.orchestra.run.smithi120.stdout:4287 write 0x21abc77 thru 0x21b3345 (0x76cf bytes) 2024-09-13T05:11:36.619 INFO:teuthology.orchestra.run.smithi120.stdout:4289 write 0xa01be90 thru 0xa0203f7 (0x4568 bytes) 2024-09-13T05:11:36.625 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:36.625 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:36.625 INFO:teuthology.orchestra.run.smithi120.stdout:4293 punch from 0x22e2270 to 0x22efb13, (0xd8a3 bytes) 2024-09-13T05:11:36.635 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:11:36.649 INFO:teuthology.orchestra.run.smithi120.stdout:4294 trunc from 0xd827780 to 0x1930f0 2024-09-13T05:11:36.663 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:36.657+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:36.690 INFO:teuthology.orchestra.run.smithi120.stdout:4295 punch from 0x11481c to 0x11a95d, (0x6141 bytes) 2024-09-13T05:11:36.690 INFO:teuthology.orchestra.run.smithi120.stdout:4296 read 0x14f7d4 thru 0x1529b9 (0x31e6 bytes) 2024-09-13T05:11:36.691 INFO:teuthology.orchestra.run.smithi120.stdout:4297 punch from 0xf2b2c to 0xf5dd8, (0x32ac bytes) 2024-09-13T05:11:36.700 INFO:teuthology.orchestra.run.smithi120.stdout:4299 writesame 0xb7c3ae thru 0xb84a79 data_size 0x2(0x86cc bytes) 2024-09-13T05:11:36.703 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:36.704 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:36.714 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:11:36.720 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is set 2024-09-13T05:11:36.729 INFO:teuthology.orchestra.run.smithi120.stdout:4300 write 0xaa01bfe thru 0xaa0e51d (0xc920 bytes) 2024-09-13T05:11:36.735 INFO:teuthology.orchestra.run.smithi120.stdout:4301 punch from 0x989b787 to 0x98a0100, (0x4979 bytes) 2024-09-13T05:11:36.745 INFO:teuthology.orchestra.run.smithi120.stdout:4302 write 0xbcb088d thru 0xbcbd39a (0xcb0e bytes) 2024-09-13T05:11:36.750 INFO:teuthology.orchestra.run.smithi120.stdout:4303 write 0x760b885 thru 0x7612f30 (0x76ac bytes) 2024-09-13T05:11:36.759 INFO:teuthology.orchestra.run.smithi120.stdout:4305 read 0xa91fd86 thru 0xa92a0c7 (0xa342 bytes) 2024-09-13T05:11:36.760 INFO:teuthology.orchestra.run.smithi120.stdout:4307 write 0xa188a30 thru 0xa18d92f (0x4f00 bytes) 2024-09-13T05:11:36.763 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:36.760+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:36.766 INFO:teuthology.orchestra.run.smithi120.stdout:4308 read 0x9fd6a8e thru 0x9fdb6a7 (0x4c1a bytes) 2024-09-13T05:11:36.766 INFO:teuthology.orchestra.run.smithi120.stdout:4309 read 0x296b32e thru 0x2972954 (0x7627 bytes) 2024-09-13T05:11:36.767 INFO:teuthology.orchestra.run.smithi120.stdout:4310 punch from 0xbb57099 to 0xbb5e81a, (0x7781 bytes) 2024-09-13T05:11:36.767 INFO:teuthology.orchestra.run.smithi120.stdout:4312 read 0xb54b2e0 thru 0xb54bff7 (0xd18 bytes) 2024-09-13T05:11:36.767 INFO:teuthology.orchestra.run.smithi120.stdout:4313 read 0x58ba5be thru 0x58c9dc1 (0xf804 bytes) 2024-09-13T05:11:36.767 INFO:teuthology.orchestra.run.smithi120.stdout:4314 write 0x424260b thru 0x4247265 (0x4c5b bytes) 2024-09-13T05:11:36.772 INFO:teuthology.orchestra.run.smithi120.stdout:4317 write 0xa5faf3f thru 0xa603aff (0x8bc1 bytes) 2024-09-13T05:11:36.779 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:36.780 INFO:teuthology.orchestra.run.smithi120.stdout:4319 read 0x3006676 thru 0x300e8ef (0x827a bytes) 2024-09-13T05:11:36.780 INFO:teuthology.orchestra.run.smithi120.stdout:4320 read 0x19e1d2b thru 0x19e580f (0x3ae5 bytes) 2024-09-13T05:11:36.780 INFO:teuthology.orchestra.run.smithi120.stdout:4324 write 0x5c9b640 thru 0x5caaebd (0xf87e bytes) 2024-09-13T05:11:36.786 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:36.786 INFO:teuthology.orchestra.run.smithi120.stdout:4326 write 0xbbd63ee thru 0xbbe19d4 (0xb5e7 bytes) 2024-09-13T05:11:36.791 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:11:36.793 INFO:teuthology.orchestra.run.smithi120.stdout:4327 punch from 0x4926b66 to 0x492c8b5, (0x5d4f bytes) 2024-09-13T05:11:36.793 INFO:teuthology.orchestra.run.smithi120.stdout:4328 writesame 0xaaf4f70 thru 0xab02f5a data_size 0x13(0xdfeb bytes) 2024-09-13T05:11:36.798 INFO:teuthology.orchestra.run.smithi120.stdout:4329 read 0x66457d1 thru 0x6655463 (0xfc93 bytes) 2024-09-13T05:11:36.803 INFO:tasks.thrashosds.thrasher:in_osds: [2, 3, 5, 6, 7] out_osds: [4, 1, 0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T05:11:36.803 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:11:36.803 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-13T05:11:36.803 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-13T05:11:36.810 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:11:36.813 INFO:teuthology.orchestra.run.smithi120.stdout:4330 writesame 0xe4a4e6c thru 0xe4ac1d3 data_size 0x8(0x7368 bytes) 2024-09-13T05:11:36.817 INFO:teuthology.orchestra.run.smithi120.stdout:4331 trunc from 0xe4ac1d4 to 0xc03e544 2024-09-13T05:11:36.828 INFO:teuthology.orchestra.run.smithi120.stdout:4333 write 0x841f3f1 thru 0x842ade8 (0xb9f8 bytes) 2024-09-13T05:11:36.840 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:11:36.848 INFO:teuthology.orchestra.run.smithi120.stdout:4334 write 0xd779e16 thru 0xd781635 (0x7820 bytes) 2024-09-13T05:11:36.855 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:36.856 INFO:teuthology.orchestra.run.smithi120.stdout:4337 write 0xb44d350 thru 0xb45487b (0x752c bytes) 2024-09-13T05:11:36.858 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:11:36.862 INFO:teuthology.orchestra.run.smithi120.stdout:4338 writesame 0x18ac8d1 thru 0x18ad491 data_size 0x11(0xbc1 bytes) 2024-09-13T05:11:36.864 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:36.857+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:36.867 INFO:teuthology.orchestra.run.smithi120.stdout:4339 write 0xafa2785 thru 0xafa4cd5 (0x2551 bytes) 2024-09-13T05:11:36.873 INFO:teuthology.orchestra.run.smithi120.stdout:4340 writesame 0x84a32d9 thru 0x84aa6fe data_size 0x1(0x7426 bytes) 2024-09-13T05:11:36.878 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:11:36.878 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:36.878 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:36.889 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:11:36.899 INFO:teuthology.orchestra.run.smithi120.stdout:4341 read 0x2e2f639 thru 0x2e37e13 (0x87db bytes) 2024-09-13T05:11:36.899 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:36.899 INFO:teuthology.orchestra.run.smithi120.stdout:4345 read 0x5b69d04 thru 0x5b729eb (0x8ce8 bytes) 2024-09-13T05:11:36.899 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:36.900 INFO:teuthology.orchestra.run.smithi120.stdout:4347 read 0xd30f27e thru 0xd30f8e3 (0x666 bytes) 2024-09-13T05:11:36.901 INFO:teuthology.orchestra.run.smithi120.stdout:4348 punch from 0xb560662 to 0xb569f0d, (0x98ab bytes) 2024-09-13T05:11:36.901 INFO:teuthology.orchestra.run.smithi120.stdout:4349 write 0x42a79ad thru 0x42ac211 (0x4865 bytes) 2024-09-13T05:11:36.901 INFO:teuthology.orchestra.run.smithi120.stdout:4351 write 0x970a6ea thru 0x9716beb (0xc502 bytes) 2024-09-13T05:11:36.903 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:11:36.909 INFO:teuthology.orchestra.run.smithi120.stdout:4352 read 0xcce86ef thru 0xccf05f9 (0x7f0b bytes) 2024-09-13T05:11:36.909 INFO:teuthology.orchestra.run.smithi120.stdout:4353 writesame 0xa2d02b3 thru 0xa2d81a8 data_size 0x3(0x7ef6 bytes) 2024-09-13T05:11:36.925 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:11:36.927 INFO:teuthology.orchestra.run.smithi120.stdout:4357 trunc from 0xd781636 to 0x87da029 2024-09-13T05:11:36.949 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:11:36.952 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:11:36.952 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:11:36.952 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:11:36.952 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:11:36.952 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:11:36.952 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:11:36.952 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:11:36.952 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:11:36.960 INFO:teuthology.orchestra.run.smithi120.stdout:4358 trunc from 0x87da029 to 0x41049 2024-09-13T05:11:36.966 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:36.961+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:36.982 INFO:teuthology.orchestra.run.smithi120.stdout:4359 read 0x1e874 thru 0x2ddba (0xf547 bytes) 2024-09-13T05:11:37.001 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:37.001 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:37.001 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:37.001 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:37.001 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:37.011 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:11:37.015 INFO:teuthology.orchestra.run.smithi120.stdout:4360 write 0xd2914ce thru 0xd296468 (0x4f9b bytes) 2024-09-13T05:11:37.022 INFO:teuthology.orchestra.run.smithi120.stdout:4361 trunc from 0xd296469 to 0xd44a15e 2024-09-13T05:11:37.055 INFO:teuthology.orchestra.run.smithi120.stdout:4362 trunc from 0xd44a15e to 0xd619eb 2024-09-13T05:11:37.066 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:37.061+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:37.091 INFO:teuthology.orchestra.run.smithi120.stdout:4363 trunc from 0xd619eb to 0xc3e2ba1 2024-09-13T05:11:37.103 INFO:teuthology.orchestra.run.smithi120.stdout:4364 read 0xaedeca8 thru 0xaee1d7a (0x30d3 bytes) 2024-09-13T05:11:37.104 INFO:teuthology.orchestra.run.smithi120.stdout:4366 read 0x12387c6 thru 0x124733e (0xeb79 bytes) 2024-09-13T05:11:37.104 INFO:teuthology.orchestra.run.smithi120.stdout:4367 writesame 0x9dcf34d thru 0x9dd7a12 data_size 0xd(0x86c6 bytes) 2024-09-13T05:11:37.109 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:11:37.109 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:37.109 INFO:teuthology.orchestra.run.smithi120.stdout: "epoch": 95, 2024-09-13T05:11:37.109 INFO:teuthology.orchestra.run.smithi120.stdout: "fsid": "0a3759da-62bd-4704-8a4a-7c20eb3fc816", 2024-09-13T05:11:37.109 INFO:teuthology.orchestra.run.smithi120.stdout: "created": "2024-09-13T05:09:38.849186+0000", 2024-09-13T05:11:37.109 INFO:teuthology.orchestra.run.smithi120.stdout: "modified": "2024-09-13T05:11:36.702131+0000", 2024-09-13T05:11:37.109 INFO:teuthology.orchestra.run.smithi120.stdout: "last_up_change": "2024-09-13T05:09:51.283212+0000", 2024-09-13T05:11:37.109 INFO:teuthology.orchestra.run.smithi120.stdout: "last_in_change": "2024-09-13T05:10:36.835155+0000", 2024-09-13T05:11:37.109 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T05:11:37.109 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_num": 5806080, 2024-09-13T05:11:37.109 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_set": [ 2024-09-13T05:11:37.109 INFO:teuthology.orchestra.run.smithi120.stdout: "nodeep-scrub", 2024-09-13T05:11:37.110 INFO:teuthology.orchestra.run.smithi120.stdout: "noscrub", 2024-09-13T05:11:37.110 INFO:teuthology.orchestra.run.smithi120.stdout: "pglog_hardlimit", 2024-09-13T05:11:37.110 INFO:teuthology.orchestra.run.smithi120.stdout: "purged_snapdirs", 2024-09-13T05:11:37.110 INFO:teuthology.orchestra.run.smithi120.stdout: "recovery_deletes", 2024-09-13T05:11:37.110 INFO:teuthology.orchestra.run.smithi120.stdout: "sortbitwise" 2024-09-13T05:11:37.110 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:11:37.110 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_version": 4, 2024-09-13T05:11:37.110 INFO:teuthology.orchestra.run.smithi120.stdout: "full_ratio": 0.94999998807907104, 2024-09-13T05:11:37.110 INFO:teuthology.orchestra.run.smithi120.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-13T05:11:37.110 INFO:teuthology.orchestra.run.smithi120.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-13T05:11:37.110 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_snapshot": "", 2024-09-13T05:11:37.110 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_max": 3, 2024-09-13T05:11:37.110 INFO:teuthology.orchestra.run.smithi120.stdout: "max_osd": 8, 2024-09-13T05:11:37.110 INFO:teuthology.orchestra.run.smithi120.stdout: "require_min_compat_client": "luminous", 2024-09-13T05:11:37.111 INFO:teuthology.orchestra.run.smithi120.stdout: "min_compat_client": "luminous", 2024-09-13T05:11:37.111 INFO:teuthology.orchestra.run.smithi120.stdout: "require_osd_release": "reef", 2024-09-13T05:11:37.111 INFO:teuthology.orchestra.run.smithi120.stdout: "allow_crimson": false, 2024-09-13T05:11:37.111 INFO:teuthology.orchestra.run.smithi120.stdout: "pools": [ 2024-09-13T05:11:37.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.111 INFO:teuthology.orchestra.run.smithi120.stdout: "pool": 1, 2024-09-13T05:11:37.111 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": ".mgr", 2024-09-13T05:11:37.111 INFO:teuthology.orchestra.run.smithi120.stdout: "create_time": "2024-09-13T05:09:52.225455+0000", 2024-09-13T05:11:37.112 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-13T05:11:37.112 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_names": "hashpspool", 2024-09-13T05:11:37.112 INFO:teuthology.orchestra.run.smithi120.stdout: "type": 1, 2024-09-13T05:11:37.112 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 2, 2024-09-13T05:11:37.112 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": 1, 2024-09-13T05:11:37.112 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_rule": 0, 2024-09-13T05:11:37.112 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_count": 0, 2024-09-13T05:11:37.112 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_target": 0, 2024-09-13T05:11:37.112 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T05:11:37.112 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T05:11:37.112 INFO:teuthology.orchestra.run.smithi120.stdout: "object_hash": 2, 2024-09-13T05:11:37.113 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscale_mode": "off", 2024-09-13T05:11:37.113 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": 1, 2024-09-13T05:11:37.113 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num": 1, 2024-09-13T05:11:37.113 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num_target": 1, 2024-09-13T05:11:37.113 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_target": 1, 2024-09-13T05:11:37.113 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_pending": 1, 2024-09-13T05:11:37.113 INFO:teuthology.orchestra.run.smithi120.stdout: "last_pg_merge_meta": { 2024-09-13T05:11:37.113 INFO:teuthology.orchestra.run.smithi120.stdout: "source_pgid": "0.0", 2024-09-13T05:11:37.113 INFO:teuthology.orchestra.run.smithi120.stdout: "ready_epoch": 0, 2024-09-13T05:11:37.113 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_started": 0, 2024-09-13T05:11:37.113 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_clean": 0, 2024-09-13T05:11:37.113 INFO:teuthology.orchestra.run.smithi120.stdout: "source_version": "0'0", 2024-09-13T05:11:37.113 INFO:teuthology.orchestra.run.smithi120.stdout: "target_version": "0'0" 2024-09-13T05:11:37.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.114 INFO:teuthology.orchestra.run.smithi120.stdout: "last_change": "16", 2024-09-13T05:11:37.114 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend": "0", 2024-09-13T05:11:37.114 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T05:11:37.114 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T05:11:37.114 INFO:teuthology.orchestra.run.smithi120.stdout: "auid": 0, 2024-09-13T05:11:37.114 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_mode": "selfmanaged", 2024-09-13T05:11:37.114 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_seq": 0, 2024-09-13T05:11:37.114 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_epoch": 0, 2024-09-13T05:11:37.115 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_snaps": [], 2024-09-13T05:11:37.115 INFO:teuthology.orchestra.run.smithi120.stdout: "removed_snaps": "[]", 2024-09-13T05:11:37.115 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_bytes": 0, 2024-09-13T05:11:37.115 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_objects": 0, 2024-09-13T05:11:37.115 INFO:teuthology.orchestra.run.smithi120.stdout: "tiers": [], 2024-09-13T05:11:37.115 INFO:teuthology.orchestra.run.smithi120.stdout: "tier_of": -1, 2024-09-13T05:11:37.115 INFO:teuthology.orchestra.run.smithi120.stdout: "read_tier": -1, 2024-09-13T05:11:37.115 INFO:teuthology.orchestra.run.smithi120.stdout: "write_tier": -1, 2024-09-13T05:11:37.115 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_mode": "none", 2024-09-13T05:11:37.115 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_bytes": 0, 2024-09-13T05:11:37.115 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_objects": 0, 2024-09-13T05:11:37.115 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T05:11:37.115 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T05:11:37.115 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T05:11:37.116 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_flush_age": 0, 2024-09-13T05:11:37.116 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_evict_age": 0, 2024-09-13T05:11:37.116 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_profile": "", 2024-09-13T05:11:37.116 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_params": { 2024-09-13T05:11:37.116 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "none" 2024-09-13T05:11:37.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.116 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_period": 0, 2024-09-13T05:11:37.117 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_count": 0, 2024-09-13T05:11:37.117 INFO:teuthology.orchestra.run.smithi120.stdout: "use_gmt_hitset": true, 2024-09-13T05:11:37.117 INFO:teuthology.orchestra.run.smithi120.stdout: "min_read_recency_for_promote": 0, 2024-09-13T05:11:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: "min_write_recency_for_promote": 0, 2024-09-13T05:11:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T05:11:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_search_last_n": 0, 2024-09-13T05:11:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: "grade_table": [], 2024-09-13T05:11:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: "stripe_width": 0, 2024-09-13T05:11:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: "expected_num_objects": 0, 2024-09-13T05:11:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: "fast_read": false, 2024-09-13T05:11:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: "options": { 2024-09-13T05:11:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_max": 32, 2024-09-13T05:11:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_min": 1 2024-09-13T05:11:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: "application_metadata": { 2024-09-13T05:11:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": {} 2024-09-13T05:11:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: "read_balance": { 2024-09-13T05:11:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: "score_acting": 8, 2024-09-13T05:11:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: "score_stable": 8, 2024-09-13T05:11:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: "optimal_score": 0.25, 2024-09-13T05:11:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_acting": 2, 2024-09-13T05:11:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_stable": 2, 2024-09-13T05:11:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity_weighted": 0.97846031188964844, 2024-09-13T05:11:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-13T05:11:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-13T05:11:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: "pool": 2, 2024-09-13T05:11:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": "rbd", 2024-09-13T05:11:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: "create_time": "2024-09-13T05:09:57.858552+0000", 2024-09-13T05:11:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 8193, 2024-09-13T05:11:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T05:11:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: "type": 1, 2024-09-13T05:11:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 2, 2024-09-13T05:11:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": 1, 2024-09-13T05:11:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_rule": 0, 2024-09-13T05:11:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_count": 0, 2024-09-13T05:11:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_target": 0, 2024-09-13T05:11:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T05:11:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T05:11:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: "object_hash": 2, 2024-09-13T05:11:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscale_mode": "off", 2024-09-13T05:11:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": 8, 2024-09-13T05:11:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num": 8, 2024-09-13T05:11:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num_target": 8, 2024-09-13T05:11:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_target": 8, 2024-09-13T05:11:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_pending": 8, 2024-09-13T05:11:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: "last_pg_merge_meta": { 2024-09-13T05:11:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: "source_pgid": "0.0", 2024-09-13T05:11:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: "ready_epoch": 0, 2024-09-13T05:11:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_started": 0, 2024-09-13T05:11:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_clean": 0, 2024-09-13T05:11:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: "source_version": "0'0", 2024-09-13T05:11:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: "target_version": "0'0" 2024-09-13T05:11:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: "last_change": "20", 2024-09-13T05:11:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend": "0", 2024-09-13T05:11:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T05:11:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T05:11:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: "auid": 0, 2024-09-13T05:11:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_mode": "selfmanaged", 2024-09-13T05:11:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_seq": 3, 2024-09-13T05:11:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_epoch": 20, 2024-09-13T05:11:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_snaps": [], 2024-09-13T05:11:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: "removed_snaps": "[]", 2024-09-13T05:11:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_bytes": 0, 2024-09-13T05:11:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_objects": 0, 2024-09-13T05:11:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: "tiers": [], 2024-09-13T05:11:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: "tier_of": -1, 2024-09-13T05:11:37.123 INFO:teuthology.orchestra.run.smithi120.stdout: "read_tier": -1, 2024-09-13T05:11:37.123 INFO:teuthology.orchestra.run.smithi120.stdout: "write_tier": -1, 2024-09-13T05:11:37.123 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_mode": "none", 2024-09-13T05:11:37.123 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_bytes": 0, 2024-09-13T05:11:37.123 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_objects": 0, 2024-09-13T05:11:37.123 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T05:11:37.123 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T05:11:37.123 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T05:11:37.123 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_flush_age": 0, 2024-09-13T05:11:37.123 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_evict_age": 0, 2024-09-13T05:11:37.123 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_profile": "", 2024-09-13T05:11:37.123 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_params": { 2024-09-13T05:11:37.123 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "none" 2024-09-13T05:11:37.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_period": 0, 2024-09-13T05:11:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_count": 0, 2024-09-13T05:11:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: "use_gmt_hitset": true, 2024-09-13T05:11:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: "min_read_recency_for_promote": 0, 2024-09-13T05:11:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: "min_write_recency_for_promote": 0, 2024-09-13T05:11:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T05:11:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_search_last_n": 0, 2024-09-13T05:11:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: "grade_table": [], 2024-09-13T05:11:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: "stripe_width": 0, 2024-09-13T05:11:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: "expected_num_objects": 0, 2024-09-13T05:11:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: "fast_read": false, 2024-09-13T05:11:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: "options": {}, 2024-09-13T05:11:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: "application_metadata": { 2024-09-13T05:11:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd": {} 2024-09-13T05:11:37.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.125 INFO:teuthology.orchestra.run.smithi120.stdout: "read_balance": { 2024-09-13T05:11:37.125 INFO:teuthology.orchestra.run.smithi120.stdout: "score_acting": 2.9800000190734863, 2024-09-13T05:11:37.125 INFO:teuthology.orchestra.run.smithi120.stdout: "score_stable": 2.9800000190734863, 2024-09-13T05:11:37.125 INFO:teuthology.orchestra.run.smithi120.stdout: "optimal_score": 0.62999999523162842, 2024-09-13T05:11:37.125 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_acting": 1.8799999952316284, 2024-09-13T05:11:37.125 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_stable": 1.8799999952316284, 2024-09-13T05:11:37.125 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity_weighted": 0.97846031188964844, 2024-09-13T05:11:37.126 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-13T05:11:37.126 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-13T05:11:37.126 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.126 INFO:teuthology.orchestra.run.smithi120.stdout: "pool": 3, 2024-09-13T05:11:37.126 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": "pool_client.0", 2024-09-13T05:11:37.126 INFO:teuthology.orchestra.run.smithi120.stdout: "create_time": "2024-09-13T05:10:07.742110+0000", 2024-09-13T05:11:37.126 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 8193, 2024-09-13T05:11:37.126 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T05:11:37.126 INFO:teuthology.orchestra.run.smithi120.stdout: "type": 1, 2024-09-13T05:11:37.127 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 2, 2024-09-13T05:11:37.127 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": 1, 2024-09-13T05:11:37.127 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_rule": 0, 2024-09-13T05:11:37.127 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_count": 0, 2024-09-13T05:11:37.127 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_target": 0, 2024-09-13T05:11:37.127 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T05:11:37.127 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T05:11:37.127 INFO:teuthology.orchestra.run.smithi120.stdout: "object_hash": 2, 2024-09-13T05:11:37.127 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscale_mode": "off", 2024-09-13T05:11:37.127 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": 32, 2024-09-13T05:11:37.127 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num": 32, 2024-09-13T05:11:37.128 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num_target": 32, 2024-09-13T05:11:37.128 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_target": 32, 2024-09-13T05:11:37.128 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_pending": 32, 2024-09-13T05:11:37.128 INFO:teuthology.orchestra.run.smithi120.stdout: "last_pg_merge_meta": { 2024-09-13T05:11:37.128 INFO:teuthology.orchestra.run.smithi120.stdout: "source_pgid": "0.0", 2024-09-13T05:11:37.128 INFO:teuthology.orchestra.run.smithi120.stdout: "ready_epoch": 0, 2024-09-13T05:11:37.128 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_started": 0, 2024-09-13T05:11:37.128 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_clean": 0, 2024-09-13T05:11:37.128 INFO:teuthology.orchestra.run.smithi120.stdout: "source_version": "0'0", 2024-09-13T05:11:37.128 INFO:teuthology.orchestra.run.smithi120.stdout: "target_version": "0'0" 2024-09-13T05:11:37.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.129 INFO:teuthology.orchestra.run.smithi120.stdout: "last_change": "94", 2024-09-13T05:11:37.129 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend": "0", 2024-09-13T05:11:37.129 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T05:11:37.129 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T05:11:37.129 INFO:teuthology.orchestra.run.smithi120.stdout: "auid": 0, 2024-09-13T05:11:37.129 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_mode": "selfmanaged", 2024-09-13T05:11:37.129 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_seq": 36, 2024-09-13T05:11:37.129 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_epoch": 94, 2024-09-13T05:11:37.129 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_snaps": [], 2024-09-13T05:11:37.129 INFO:teuthology.orchestra.run.smithi120.stdout: "removed_snaps": "[]", 2024-09-13T05:11:37.129 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_bytes": 0, 2024-09-13T05:11:37.129 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_objects": 0, 2024-09-13T05:11:37.129 INFO:teuthology.orchestra.run.smithi120.stdout: "tiers": [], 2024-09-13T05:11:37.130 INFO:teuthology.orchestra.run.smithi120.stdout: "tier_of": -1, 2024-09-13T05:11:37.130 INFO:teuthology.orchestra.run.smithi120.stdout: "read_tier": -1, 2024-09-13T05:11:37.130 INFO:teuthology.orchestra.run.smithi120.stdout: "write_tier": -1, 2024-09-13T05:11:37.130 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_mode": "none", 2024-09-13T05:11:37.130 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_bytes": 0, 2024-09-13T05:11:37.130 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_objects": 0, 2024-09-13T05:11:37.130 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T05:11:37.130 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T05:11:37.130 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T05:11:37.130 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_flush_age": 0, 2024-09-13T05:11:37.130 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_evict_age": 0, 2024-09-13T05:11:37.130 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_profile": "", 2024-09-13T05:11:37.130 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_params": { 2024-09-13T05:11:37.130 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "none" 2024-09-13T05:11:37.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.131 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_period": 0, 2024-09-13T05:11:37.131 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_count": 0, 2024-09-13T05:11:37.131 INFO:teuthology.orchestra.run.smithi120.stdout: "use_gmt_hitset": true, 2024-09-13T05:11:37.131 INFO:teuthology.orchestra.run.smithi120.stdout: "min_read_recency_for_promote": 0, 2024-09-13T05:11:37.131 INFO:teuthology.orchestra.run.smithi120.stdout: "min_write_recency_for_promote": 0, 2024-09-13T05:11:37.131 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T05:11:37.131 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_search_last_n": 0, 2024-09-13T05:11:37.131 INFO:teuthology.orchestra.run.smithi120.stdout: "grade_table": [], 2024-09-13T05:11:37.131 INFO:teuthology.orchestra.run.smithi120.stdout: "stripe_width": 0, 2024-09-13T05:11:37.131 INFO:teuthology.orchestra.run.smithi120.stdout: "expected_num_objects": 0, 2024-09-13T05:11:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "fast_read": false, 2024-09-13T05:11:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "options": {}, 2024-09-13T05:11:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "application_metadata": { 2024-09-13T05:11:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd": {} 2024-09-13T05:11:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "read_balance": { 2024-09-13T05:11:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "score_acting": 2.4800000190734863, 2024-09-13T05:11:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "score_stable": 2.4800000190734863, 2024-09-13T05:11:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "optimal_score": 0.62999999523162842, 2024-09-13T05:11:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_acting": 1.559999942779541, 2024-09-13T05:11:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_stable": 1.559999942779541, 2024-09-13T05:11:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity_weighted": 0.97846031188964844, 2024-09-13T05:11:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-13T05:11:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-13T05:11:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:11:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: "osds": [ 2024-09-13T05:11:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 0, 2024-09-13T05:11:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "b304ec03-bb00-4b13-bf2d-71017b8a70a3", 2024-09-13T05:11:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:11:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 0, 2024-09-13T05:11:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 0, 2024-09-13T05:11:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:11:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:11:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:11:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:11:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 40, 2024-09-13T05:11:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:11:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:11:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:11:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6800", 2024-09-13T05:11:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3487103682 2024-09-13T05:11:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6801", 2024-09-13T05:11:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3487103682 2024-09-13T05:11:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:11:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6802", 2024-09-13T05:11:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3487103682 2024-09-13T05:11:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6803", 2024-09-13T05:11:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3487103682 2024-09-13T05:11:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:11:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6806", 2024-09-13T05:11:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3487103682 2024-09-13T05:11:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6807", 2024-09-13T05:11:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3487103682 2024-09-13T05:11:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:11:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6804", 2024-09-13T05:11:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3487103682 2024-09-13T05:11:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6805", 2024-09-13T05:11:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3487103682 2024-09-13T05:11:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.120:6801/3487103682", 2024-09-13T05:11:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.120:6803/3487103682", 2024-09-13T05:11:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.120:6807/3487103682", 2024-09-13T05:11:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.120:6805/3487103682", 2024-09-13T05:11:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:11:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:11:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:11:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 1, 2024-09-13T05:11:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "c09e84f3-3a70-46a4-b67b-c9bb52c887b7", 2024-09-13T05:11:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:11:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 0, 2024-09-13T05:11:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 0, 2024-09-13T05:11:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:11:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:11:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:11:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:11:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 22, 2024-09-13T05:11:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:11:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:11:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:11:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6808", 2024-09-13T05:11:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:11:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6809", 2024-09-13T05:11:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:11:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:11:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6810", 2024-09-13T05:11:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:11:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6811", 2024-09-13T05:11:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:11:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:11:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6814", 2024-09-13T05:11:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:11:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6815", 2024-09-13T05:11:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:11:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:11:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6812", 2024-09-13T05:11:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:11:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6813", 2024-09-13T05:11:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:11:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.120:6809/1023532100", 2024-09-13T05:11:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.120:6811/1023532100", 2024-09-13T05:11:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.120:6815/1023532100", 2024-09-13T05:11:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.120:6813/1023532100", 2024-09-13T05:11:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:11:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:11:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:11:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 2, 2024-09-13T05:11:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "3c2a0458-369c-4dac-90a3-fb20cb70d53f", 2024-09-13T05:11:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:11:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:11:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:11:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:11:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:11:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:11:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:11:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 86, 2024-09-13T05:11:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:11:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:11:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:11:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6816", 2024-09-13T05:11:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:11:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6817", 2024-09-13T05:11:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:11:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:11:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6818", 2024-09-13T05:11:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:11:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6819", 2024-09-13T05:11:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:11:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:11:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6822", 2024-09-13T05:11:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:11:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6823", 2024-09-13T05:11:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:11:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:11:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6820", 2024-09-13T05:11:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:11:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6821", 2024-09-13T05:11:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:11:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.120:6817/592498012", 2024-09-13T05:11:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.120:6819/592498012", 2024-09-13T05:11:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.120:6823/592498012", 2024-09-13T05:11:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.120:6821/592498012", 2024-09-13T05:11:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:11:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:11:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:11:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 3, 2024-09-13T05:11:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "edce3757-5e9d-4221-a1f1-3f356bb5218b", 2024-09-13T05:11:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:11:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:11:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:11:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:11:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:11:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:11:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:11:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 86, 2024-09-13T05:11:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:11:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:11:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:11:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6824", 2024-09-13T05:11:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:11:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6825", 2024-09-13T05:11:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:11:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:11:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6826", 2024-09-13T05:11:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:11:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6827", 2024-09-13T05:11:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:11:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:11:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6830", 2024-09-13T05:11:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:11:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6831", 2024-09-13T05:11:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:11:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:11:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6828", 2024-09-13T05:11:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:11:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6829", 2024-09-13T05:11:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:11:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.120:6825/1939753938", 2024-09-13T05:11:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.120:6827/1939753938", 2024-09-13T05:11:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.120:6831/1939753938", 2024-09-13T05:11:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.120:6829/1939753938", 2024-09-13T05:11:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:11:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:11:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:11:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 4, 2024-09-13T05:11:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "5fe378d2-578f-41ea-980a-4673a8b376df", 2024-09-13T05:11:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:11:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 0, 2024-09-13T05:11:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 0, 2024-09-13T05:11:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:11:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:11:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:11:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:11:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 0, 2024-09-13T05:11:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:11:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:11:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:11:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6824", 2024-09-13T05:11:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:11:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6825", 2024-09-13T05:11:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:11:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:11:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6826", 2024-09-13T05:11:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:11:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6827", 2024-09-13T05:11:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:11:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:11:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6830", 2024-09-13T05:11:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:11:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6831", 2024-09-13T05:11:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:11:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:11:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6828", 2024-09-13T05:11:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:11:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6829", 2024-09-13T05:11:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:11:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.137:6825/3005075615", 2024-09-13T05:11:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.137:6827/3005075615", 2024-09-13T05:11:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.137:6831/3005075615", 2024-09-13T05:11:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.137:6829/3005075615", 2024-09-13T05:11:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:11:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:11:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:11:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 5, 2024-09-13T05:11:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "6e6f7499-ae9e-4cb1-9db7-4d9f8fd9b257", 2024-09-13T05:11:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:11:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:11:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:11:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:11:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:11:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:11:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:11:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 87, 2024-09-13T05:11:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:11:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:11:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:11:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6800", 2024-09-13T05:11:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:11:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6801", 2024-09-13T05:11:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:11:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:11:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6802", 2024-09-13T05:11:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:11:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6803", 2024-09-13T05:11:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:11:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:11:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6806", 2024-09-13T05:11:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:11:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6807", 2024-09-13T05:11:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:11:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:11:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6804", 2024-09-13T05:11:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:11:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6805", 2024-09-13T05:11:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:11:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.137:6801/1108177522", 2024-09-13T05:11:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.137:6803/1108177522", 2024-09-13T05:11:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.137:6807/1108177522", 2024-09-13T05:11:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.137:6805/1108177522", 2024-09-13T05:11:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:11:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:11:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:11:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 6, 2024-09-13T05:11:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "e4c519e5-5df4-4d55-b12e-fbcfb1b0555c", 2024-09-13T05:11:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:11:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:11:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:11:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 0.8276824951171875, 2024-09-13T05:11:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:11:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:11:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:11:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 86, 2024-09-13T05:11:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:11:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:11:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:11:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6816", 2024-09-13T05:11:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:11:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6817", 2024-09-13T05:11:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:11:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:11:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6818", 2024-09-13T05:11:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:11:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6819", 2024-09-13T05:11:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:11:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:11:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6822", 2024-09-13T05:11:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:11:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6823", 2024-09-13T05:11:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:11:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:11:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6820", 2024-09-13T05:11:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:11:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6821", 2024-09-13T05:11:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:11:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.137:6817/2667039053", 2024-09-13T05:11:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.137:6819/2667039053", 2024-09-13T05:11:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.137:6823/2667039053", 2024-09-13T05:11:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.137:6821/2667039053", 2024-09-13T05:11:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:11:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:11:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:11:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 7, 2024-09-13T05:11:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "914648c2-7a6c-4e66-811d-936e250638db", 2024-09-13T05:11:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:11:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:11:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:11:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:11:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:11:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:11:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:11:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 88, 2024-09-13T05:11:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:11:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:11:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:11:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6808", 2024-09-13T05:11:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:11:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6809", 2024-09-13T05:11:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:11:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:11:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6810", 2024-09-13T05:11:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:11:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6811", 2024-09-13T05:11:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:11:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:11:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6814", 2024-09-13T05:11:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:11:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6815", 2024-09-13T05:11:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:11:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:11:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:11:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:11:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6812", 2024-09-13T05:11:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:11:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:11:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6813", 2024-09-13T05:11:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:11:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.137:6809/993764921", 2024-09-13T05:11:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.137:6811/993764921", 2024-09-13T05:11:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.137:6815/993764921", 2024-09-13T05:11:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.137:6813/993764921", 2024-09-13T05:11:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:11:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:11:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:11:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:11:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_xinfo": [ 2024-09-13T05:11:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 0, 2024-09-13T05:11:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:11:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:11:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:11:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:11:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 65536, 2024-09-13T05:11:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:46.914820+0000", 2024-09-13T05:11:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:11:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 1, 2024-09-13T05:11:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:11:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:11:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:11:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:11:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 65536, 2024-09-13T05:11:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.326286+0000", 2024-09-13T05:11:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:11:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 2, 2024-09-13T05:11:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:11:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:11:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:11:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:11:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:11:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.147193+0000", 2024-09-13T05:11:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:11:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 3, 2024-09-13T05:11:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:11:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:11:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:11:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:11:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:11:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.478655+0000", 2024-09-13T05:11:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:11:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 4, 2024-09-13T05:11:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:11:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:11:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:11:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:11:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 65536, 2024-09-13T05:11:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.388938+0000", 2024-09-13T05:11:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:11:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 5, 2024-09-13T05:11:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:11:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:11:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:11:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:11:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:11:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.127175+0000", 2024-09-13T05:11:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:11:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 6, 2024-09-13T05:11:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:11:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:11:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:11:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:11:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:11:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.187286+0000", 2024-09-13T05:11:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:11:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 7, 2024-09-13T05:11:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:11:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:11:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:11:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:11:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:11:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:46.962119+0000", 2024-09-13T05:11:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:11:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:11:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_upmap": [ 2024-09-13T05:11:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: "pgid": "3.a", 2024-09-13T05:11:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: "osds": [ 2024-09-13T05:11:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: 3, 2024-09-13T05:11:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: 2 2024-09-13T05:11:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:11:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_upmap_items": [], 2024-09-13T05:11:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_upmap_primaries": [], 2024-09-13T05:11:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_temp": [], 2024-09-13T05:11:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_temp": [], 2024-09-13T05:11:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "blocklist": {}, 2024-09-13T05:11:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "range_blocklist": {}, 2024-09-13T05:11:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_profiles": { 2024-09-13T05:11:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "default": { 2024-09-13T05:11:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "crush-failure-domain": "osd", 2024-09-13T05:11:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "k": "2", 2024-09-13T05:11:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "m": "1", 2024-09-13T05:11:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "plugin": "jerasure", 2024-09-13T05:11:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "technique": "reed_sol_van" 2024-09-13T05:11:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "removed_snaps_queue": [], 2024-09-13T05:11:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "new_removed_snaps": [], 2024-09-13T05:11:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "new_purged_snaps": [], 2024-09-13T05:11:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_node_flags": {}, 2024-09-13T05:11:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: "device_class_flags": {}, 2024-09-13T05:11:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: "stretch_mode": { 2024-09-13T05:11:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: "stretch_mode_enabled": false, 2024-09-13T05:11:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: "stretch_bucket_count": 0, 2024-09-13T05:11:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: "degraded_stretch_mode": 0, 2024-09-13T05:11:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: "recovering_stretch_mode": 0, 2024-09-13T05:11:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: "stretch_mode_bucket": 0 2024-09-13T05:11:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:37.206 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:37.208 INFO:teuthology.orchestra.run.smithi120.stdout:4368 write 0x5bca1c7 thru 0x5bd8ac5 (0xe8ff bytes) 2024-09-13T05:11:37.208 INFO:teuthology.orchestra.run.smithi120.stdout:4369 punch from 0x8f5128b to 0x8f5e022, (0xcd97 bytes) 2024-09-13T05:11:37.210 INFO:tasks.thrashosds.thrasher:j is {'epoch': 95, 'fsid': '0a3759da-62bd-4704-8a4a-7c20eb3fc816', 'created': '2024-09-13T05:09:38.849186+0000', 'modified': '2024-09-13T05:11:36.702131+0000', 'last_up_change': '2024-09-13T05:09:51.283212+0000', 'last_in_change': '2024-09-13T05:10:36.835155+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T05:09:52.225455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9784603118896484, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T05:09:57.858552+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.9800000190734863, 'score_stable': 2.9800000190734863, 'optimal_score': 0.6299999952316284, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9784603118896484, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-13T05:10:07.742110+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 36, 'snap_epoch': 94, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.4800000190734863, 'score_stable': 2.4800000190734863, 'optimal_score': 0.6299999952316284, 'raw_score_acting': 1.559999942779541, 'raw_score_stable': 1.559999942779541, 'primary_affinity_weighted': 0.9784603118896484, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}], 'osds': [{'osd': 0, 'uuid': 'b304ec03-bb00-4b13-bf2d-71017b8a70a3', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6800', 'nonce': 3487103682}, {'type': 'v1', 'addr': '172.21.15.120:6801', 'nonce': 3487103682}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6802', 'nonce': 3487103682}, {'type': 'v1', 'addr': '172.21.15.120:6803', 'nonce': 3487103682}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6806', 'nonce': 3487103682}, {'type': 'v1', 'addr': '172.21.15.120:6807', 'nonce': 3487103682}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6804', 'nonce': 3487103682}, {'type': 'v1', 'addr': '172.21.15.120:6805', 'nonce': 3487103682}]}, 'public_addr': '172.21.15.120:6801/3487103682', 'cluster_addr': '172.21.15.120:6803/3487103682', 'heartbeat_back_addr': '172.21.15.120:6807/3487103682', 'heartbeat_front_addr': '172.21.15.120:6805/3487103682', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'c09e84f3-3a70-46a4-b67b-c9bb52c887b7', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6808', 'nonce': 1023532100}, {'type': 'v1', 'addr': '172.21.15.120:6809', 'nonce': 1023532100}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6810', 'nonce': 1023532100}, {'type': 'v1', 'addr': '172.21.15.120:6811', 'nonce': 1023532100}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6814', 'nonce': 1023532100}, {'type': 'v1', 'addr': '172.21.15.120:6815', 'nonce': 1023532100}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6812', 'nonce': 1023532100}, {'type': 'v1', 'addr': '172.21.15.120:6813', 'nonce': 1023532100}]}, 'public_addr': '172.21.15.120:6809/1023532100', 'cluster_addr': '172.21.15.120:6811/1023532100', 'heartbeat_back_addr': '172.21.15.120:6815/1023532100', 'heartbeat_front_addr': '172.21.15.120:6813/1023532100', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '3c2a0458-369c-4dac-90a3-fb20cb70d53f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 86, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6816', 'nonce': 592498012}, {'type': 'v1', 'addr': '172.21.15.120:6817', 'nonce': 592498012}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6818', 'nonce': 592498012}, {'type': 'v1', 'addr': '172.21.15.120:6819', 'nonce': 592498012}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6822', 'nonce': 592498012}, {'type': 'v1', 'addr': '172.21.15.120:6823', 'nonce': 592498012}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6820', 'nonce': 592498012}, {'type': 'v1', 'addr': '172.21.15.120:6821', 'nonce': 592498012}]}, 'public_addr': '172.21.15.120:6817/592498012', 'cluster_addr': '172.21.15.120:6819/592498012', 'heartbeat_back_addr': '172.21.15.120:6823/592498012', 'heartbeat_front_addr': '172.21.15.120:6821/592498012', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'edce3757-5e9d-4221-a1f1-3f356bb5218b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 86, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6824', 'nonce': 1939753938}, {'type': 'v1', 'addr': '172.21.15.120:6825', 'nonce': 1939753938}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6826', 'nonce': 1939753938}, {'type': 'v1', 'addr': '172.21.15.120:6827', 'nonce': 1939753938}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6830', 'nonce': 1939753938}, {'type': 'v1', 'addr': '172.21.15.120:6831', 'nonce': 1939753938}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6828', 'nonce': 1939753938}, {'type': 'v1', 'addr': '172.21.15.120:6829', 'nonce': 1939753938}]}, 'public_addr': '172.21.15.120:6825/1939753938', 'cluster_addr': '172.21.15.120:6827/1939753938', 'heartbeat_back_addr': '172.21.15.120:6831/1939753938', 'heartbeat_front_addr': '172.21.15.120:6829/1939753938', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '5fe378d2-578f-41ea-980a-4673a8b376df', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6824', 'nonce': 3005075615}, {'type': 'v1', 'addr': '172.21.15.137:6825', 'nonce': 3005075615}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6826', 'nonce': 3005075615}, {'type': 'v1', 'addr': '172.21.15.137:6827', 'nonce': 3005075615}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6830', 'nonce': 3005075615}, {'type': 'v1', 'addr': '172.21.15.137:6831', 'nonce': 3005075615}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6828', 'nonce': 3005075615}, {'type': 'v1', 'addr': '172.21.15.137:6829', 'nonce': 3005075615}]}, 'public_addr': '172.21.15.137:6825/3005075615', 'cluster_addr': '172.21.15.137:6827/3005075615', 'heartbeat_back_addr': '172.21.15.137:6831/3005075615', 'heartbeat_front_addr': '172.21.15.137:6829/3005075615', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '6e6f7499-ae9e-4cb1-9db7-4d9f8fd9b257', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 87, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6800', 'nonce': 1108177522}, {'type': 'v1', 'addr': '172.21.15.137:6801', 'nonce': 1108177522}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6802', 'nonce': 1108177522}, {'type': 'v1', 'addr': '172.21.15.137:6803', 'nonce': 1108177522}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6806', 'nonce': 1108177522}, {'type': 'v1', 'addr': '172.21.15.137:6807', 'nonce': 1108177522}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6804', 'nonce': 1108177522}, {'type': 'v1', 'addr': '172.21.15.137:6805', 'nonce': 1108177522}]}, 'public_addr': '172.21.15.137:6801/1108177522', 'cluster_addr': '172.21.15.137:6803/1108177522', 'heartbeat_back_addr': '172.21.15.137:6807/1108177522', 'heartbeat_front_addr': '172.21.15.137:6805/1108177522', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e4c519e5-5df4-4d55-b12e-fbcfb1b0555c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.8276824951171875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 86, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6816', 'nonce': 2667039053}, {'type': 'v1', 'addr': '172.21.15.137:6817', 'nonce': 2667039053}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6818', 'nonce': 2667039053}, {'type': 'v1', 'addr': '172.21.15.137:6819', 'nonce': 2667039053}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6822', 'nonce': 2667039053}, {'type': 'v1', 'addr': '172.21.15.137:6823', 'nonce': 2667039053}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6820', 'nonce': 2667039053}, {'type': 'v1', 'addr': '172.21.15.137:6821', 'nonce': 2667039053}]}, 'public_addr': '172.21.15.137:6817/2667039053', 'cluster_addr': '172.21.15.137:6819/2667039053', 'heartbeat_back_addr': '172.21.15.137:6823/2667039053', 'heartbeat_front_addr': '172.21.15.137:6821/2667039053', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '914648c2-7a6c-4e66-811d-936e250638db', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 88, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6808', 'nonce': 993764921}, {'type': 'v1', 'addr': '172.21.15.137:6809', 'nonce': 993764921}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6810', 'nonce': 993764921}, {'type': 'v1', 'addr': '172.21.15.137:6811', 'nonce': 993764921}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6814', 'nonce': 993764921}, {'type': 'v1', 'addr': '172.21.15.137:6815', 'nonce': 993764921}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6812', 'nonce': 993764921}, {'type': 'v1', 'addr': '172.21.15.137:6813', 'nonce': 993764921}]}, 'public_addr': '172.21.15.137:6809/993764921', 'cluster_addr': '172.21.15.137:6811/993764921', 'heartbeat_back_addr': '172.21.15.137:6815/993764921', 'heartbeat_front_addr': '172.21.15.137:6813/993764921', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T05:09:46.914820+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.326286+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.147193+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.478655+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.388938+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.127175+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.187286+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:46.962119+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.a', 'osds': [3, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-13T05:11:37.210 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-13T05:11:37.210 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:37.211 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:37.211 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:37.211 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:37.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.211 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47585 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16711680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:37.211 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440033+0000", 2024-09-13T05:11:37.211 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 45.678615407999999, 2024-09-13T05:11:37.211 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033917665999999999, 2024-09-13T05:11:37.211 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.211 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.211 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.211 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.211 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.212 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47585 2024-09-13T05:11:37.212 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.212 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.212 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.212 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.212 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440033+0000", 2024-09-13T05:11:37.212 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.212 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.212 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.212 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.212 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440033+0000", 2024-09-13T05:11:37.212 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.212 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.213 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.213 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.213 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440032+0000", 2024-09-13T05:11:37.213 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.213 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.213 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.213 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.213 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440036+0000", 2024-09-13T05:11:37.213 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.676e-06 2024-09-13T05:11:37.213 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.213 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.213 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.213 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440049+0000", 2024-09-13T05:11:37.213 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3142999999999999e-05 2024-09-13T05:11:37.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.214 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.214 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.214 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440056+0000", 2024-09-13T05:11:37.214 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.827e-06 2024-09-13T05:11:37.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.214 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.214 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.214 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473451+0000", 2024-09-13T05:11:37.214 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033395344 2024-09-13T05:11:37.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.214 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.214 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.214 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473565+0000", 2024-09-13T05:11:37.215 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011377700000000001 2024-09-13T05:11:37.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.215 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.215 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.473950+0000", 2024-09-13T05:11:37.215 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00038550200000000002 2024-09-13T05:11:37.215 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.215 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.215 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.215 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47589 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15564800~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:37.215 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440062+0000", 2024-09-13T05:11:37.215 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 45.678586422000002, 2024-09-13T05:11:37.215 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034520812999999997, 2024-09-13T05:11:37.216 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.216 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.216 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.216 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.216 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.216 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47589 2024-09-13T05:11:37.216 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.216 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.216 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.216 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.216 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440062+0000", 2024-09-13T05:11:37.217 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.217 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.217 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.217 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.217 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440062+0000", 2024-09-13T05:11:37.217 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.217 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.217 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.217 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.217 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440061+0000", 2024-09-13T05:11:37.217 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.217 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.217 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.218 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440064+0000", 2024-09-13T05:11:37.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4029999999999999e-06 2024-09-13T05:11:37.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.218 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.218 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440072+0000", 2024-09-13T05:11:37.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.79e-06 2024-09-13T05:11:37.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.218 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.218 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440079+0000", 2024-09-13T05:11:37.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.81e-06 2024-09-13T05:11:37.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.218 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.219 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.219 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474016+0000", 2024-09-13T05:11:37.219 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033936858 2024-09-13T05:11:37.219 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.219 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.219 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.219 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474143+0000", 2024-09-13T05:11:37.219 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012673599999999999 2024-09-13T05:11:37.219 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.219 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.219 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.219 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474582+0000", 2024-09-13T05:11:37.219 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00043982199999999998 2024-09-13T05:11:37.219 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.220 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.220 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.220 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.220 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.220 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47590 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15859712~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:37.220 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440085+0000", 2024-09-13T05:11:37.220 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 45.678563478999997, 2024-09-13T05:11:37.220 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035003000999999999, 2024-09-13T05:11:37.220 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.220 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.220 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.220 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.220 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.221 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47590 2024-09-13T05:11:37.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.221 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.221 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.221 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440085+0000", 2024-09-13T05:11:37.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.221 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.222 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.222 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440085+0000", 2024-09-13T05:11:37.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.222 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.222 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.222 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.222 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440084+0000", 2024-09-13T05:11:37.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.222 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.222 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.222 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.222 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440088+0000", 2024-09-13T05:11:37.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7759999999999999e-06 2024-09-13T05:11:37.222 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440100+0000", 2024-09-13T05:11:37.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2537e-05 2024-09-13T05:11:37.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440107+0000", 2024-09-13T05:11:37.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.046e-06 2024-09-13T05:11:37.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474648+0000", 2024-09-13T05:11:37.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034540803000000002 2024-09-13T05:11:37.224 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.224 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.224 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.474721+0000", 2024-09-13T05:11:37.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2890000000000002e-05 2024-09-13T05:11:37.224 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.224 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.224 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475088+0000", 2024-09-13T05:11:37.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00036654199999999997 2024-09-13T05:11:37.224 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.224 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.224 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.224 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.225 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.225 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47591 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16154624~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:37.225 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440113+0000", 2024-09-13T05:11:37.225 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 45.678534902999999, 2024-09-13T05:11:37.225 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035632759, 2024-09-13T05:11:37.225 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.225 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.225 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.225 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.225 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.225 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47591 2024-09-13T05:11:37.225 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.225 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440113+0000", 2024-09-13T05:11:37.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440113+0000", 2024-09-13T05:11:37.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440112+0000", 2024-09-13T05:11:37.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440117+0000", 2024-09-13T05:11:37.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0199999999999996e-06 2024-09-13T05:11:37.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440129+0000", 2024-09-13T05:11:37.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2571999999999999e-05 2024-09-13T05:11:37.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440136+0000", 2024-09-13T05:11:37.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8870000000000003e-06 2024-09-13T05:11:37.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.228 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.228 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475160+0000", 2024-09-13T05:11:37.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035024287000000001 2024-09-13T05:11:37.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.228 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.228 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475294+0000", 2024-09-13T05:11:37.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013386600000000001 2024-09-13T05:11:37.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.229 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.229 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475746+0000", 2024-09-13T05:11:37.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00045173300000000001 2024-09-13T05:11:37.229 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.229 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.229 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.229 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.229 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.229 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47592 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16449536~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:37.229 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440142+0000", 2024-09-13T05:11:37.229 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 45.678506243999998, 2024-09-13T05:11:37.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036117556000000002, 2024-09-13T05:11:37.229 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.229 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.230 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.230 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.230 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.230 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47592 2024-09-13T05:11:37.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.230 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.230 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440142+0000", 2024-09-13T05:11:37.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.230 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440142+0000", 2024-09-13T05:11:37.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440141+0000", 2024-09-13T05:11:37.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440145+0000", 2024-09-13T05:11:37.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5939999999999998e-06 2024-09-13T05:11:37.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.232 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440162+0000", 2024-09-13T05:11:37.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7102999999999999e-05 2024-09-13T05:11:37.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.232 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.232 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.232 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440169+0000", 2024-09-13T05:11:37.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0330000000000003e-06 2024-09-13T05:11:37.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.232 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.232 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.232 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475812+0000", 2024-09-13T05:11:37.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035643542 2024-09-13T05:11:37.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.232 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.475899+0000", 2024-09-13T05:11:37.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6827000000000001e-05 2024-09-13T05:11:37.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476259+0000", 2024-09-13T05:11:37.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000360057 2024-09-13T05:11:37.233 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.233 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.233 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.234 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47593 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16744448~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:37.234 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440175+0000", 2024-09-13T05:11:37.234 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 45.678473287999999, 2024-09-13T05:11:37.234 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036661306999999997, 2024-09-13T05:11:37.234 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.234 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.234 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.234 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.234 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.234 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47593 2024-09-13T05:11:37.234 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.234 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.234 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.234 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.235 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440175+0000", 2024-09-13T05:11:37.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.235 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440175+0000", 2024-09-13T05:11:37.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440174+0000", 2024-09-13T05:11:37.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440178+0000", 2024-09-13T05:11:37.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.687e-06 2024-09-13T05:11:37.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440187+0000", 2024-09-13T05:11:37.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6029999999999994e-06 2024-09-13T05:11:37.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440194+0000", 2024-09-13T05:11:37.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8600000000000004e-06 2024-09-13T05:11:37.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476312+0000", 2024-09-13T05:11:37.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036117727000000002 2024-09-13T05:11:37.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476436+0000", 2024-09-13T05:11:37.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012370600000000001 2024-09-13T05:11:37.238 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.238 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.238 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.238 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476836+0000", 2024-09-13T05:11:37.238 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00040031399999999998 2024-09-13T05:11:37.238 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.238 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.238 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.238 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.238 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.238 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47597 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15597568~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:37.238 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440735+0000", 2024-09-13T05:11:37.238 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 45.677913296, 2024-09-13T05:11:37.238 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036742364, 2024-09-13T05:11:37.239 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.239 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.239 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.239 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.239 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.239 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47597 2024-09-13T05:11:37.239 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.239 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.239 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.239 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.239 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440735+0000", 2024-09-13T05:11:37.239 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.239 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.239 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.240 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.240 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440735+0000", 2024-09-13T05:11:37.240 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.240 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.240 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.240 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440733+0000", 2024-09-13T05:11:37.240 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:37.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.240 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.240 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.240 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440741+0000", 2024-09-13T05:11:37.240 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7100000000000007e-06 2024-09-13T05:11:37.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440774+0000", 2024-09-13T05:11:37.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3062999999999998e-05 2024-09-13T05:11:37.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440784+0000", 2024-09-13T05:11:37.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6630000000000005e-06 2024-09-13T05:11:37.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.476899+0000", 2024-09-13T05:11:37.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036115188999999999 2024-09-13T05:11:37.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477036+0000", 2024-09-13T05:11:37.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000136907 2024-09-13T05:11:37.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477477+0000", 2024-09-13T05:11:37.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00044140899999999997 2024-09-13T05:11:37.242 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.242 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.242 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.243 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.243 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.243 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47598 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15892480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:37.243 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:11:37.243 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 45.677843561000003, 2024-09-13T05:11:37.243 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037255732, 2024-09-13T05:11:37.243 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.243 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.243 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.243 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.243 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.243 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47598 2024-09-13T05:11:37.243 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.244 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.244 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.244 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.244 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:11:37.244 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.244 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.244 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.244 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.244 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:11:37.244 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.244 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.244 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.244 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.244 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440804+0000", 2024-09-13T05:11:37.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:37.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.245 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.245 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.245 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440809+0000", 2024-09-13T05:11:37.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.237e-06 2024-09-13T05:11:37.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.245 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.245 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.245 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440823+0000", 2024-09-13T05:11:37.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4426e-05 2024-09-13T05:11:37.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.245 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.245 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440831+0000", 2024-09-13T05:11:37.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6669999999999996e-06 2024-09-13T05:11:37.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477508+0000", 2024-09-13T05:11:37.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036677354000000002 2024-09-13T05:11:37.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.477571+0000", 2024-09-13T05:11:37.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2271000000000001e-05 2024-09-13T05:11:37.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478060+0000", 2024-09-13T05:11:37.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00048954399999999996 2024-09-13T05:11:37.247 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.247 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.247 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.247 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47599 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16187392~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:37.247 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:11:37.247 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 45.677810618999999, 2024-09-13T05:11:37.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037806671, 2024-09-13T05:11:37.247 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.248 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.248 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.248 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.248 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.248 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47599 2024-09-13T05:11:37.248 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.248 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.248 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.248 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:11:37.248 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.248 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.248 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.249 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:11:37.249 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.249 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.249 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.249 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.249 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440837+0000", 2024-09-13T05:11:37.249 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.249 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.249 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.249 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.249 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440841+0000", 2024-09-13T05:11:37.249 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1699999999999999e-06 2024-09-13T05:11:37.249 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.249 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440853+0000", 2024-09-13T05:11:37.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2466000000000001e-05 2024-09-13T05:11:37.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440860+0000", 2024-09-13T05:11:37.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8970000000000002e-06 2024-09-13T05:11:37.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478100+0000", 2024-09-13T05:11:37.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037239398 2024-09-13T05:11:37.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478173+0000", 2024-09-13T05:11:37.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3784999999999999e-05 2024-09-13T05:11:37.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478644+0000", 2024-09-13T05:11:37.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00047058100000000003 2024-09-13T05:11:37.251 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.251 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.251 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.252 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47600 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16482304~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:37.252 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:11:37.252 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 45.677781645000003, 2024-09-13T05:11:37.252 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038539524999999998, 2024-09-13T05:11:37.252 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.252 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.252 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.252 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.252 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.252 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47600 2024-09-13T05:11:37.252 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.252 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.252 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.252 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.253 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:11:37.253 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.253 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.253 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.253 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.253 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:11:37.253 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.253 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.253 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.253 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.253 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440866+0000", 2024-09-13T05:11:37.253 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.253 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.253 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.254 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.254 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440869+0000", 2024-09-13T05:11:37.254 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6229999999999999e-06 2024-09-13T05:11:37.254 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.254 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.254 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.254 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440877+0000", 2024-09-13T05:11:37.254 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9289999999999998e-06 2024-09-13T05:11:37.254 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.254 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.254 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.254 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.440884+0000", 2024-09-13T05:11:37.254 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9569999999999996e-06 2024-09-13T05:11:37.254 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.255 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.255 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.255 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478694+0000", 2024-09-13T05:11:37.255 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037809597 2024-09-13T05:11:37.255 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.255 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.255 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.255 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.478907+0000", 2024-09-13T05:11:37.255 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021332799999999999 2024-09-13T05:11:37.255 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.255 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.255 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.255 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479406+0000", 2024-09-13T05:11:37.255 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00049870100000000005 2024-09-13T05:11:37.256 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.256 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.256 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.256 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.256 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.256 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47605 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15630336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:37.256 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.445919+0000", 2024-09-13T05:11:37.256 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 45.672729275999998, 2024-09-13T05:11:37.256 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034071010999999998, 2024-09-13T05:11:37.256 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.256 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.256 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.256 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.257 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.257 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47605 2024-09-13T05:11:37.257 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.257 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.257 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.257 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.257 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445919+0000", 2024-09-13T05:11:37.257 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.257 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.257 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.257 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.257 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445919+0000", 2024-09-13T05:11:37.257 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.257 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.258 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.258 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.258 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445917+0000", 2024-09-13T05:11:37.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:37.258 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.258 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.258 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.258 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445928+0000", 2024-09-13T05:11:37.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1413000000000001e-05 2024-09-13T05:11:37.258 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.258 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.258 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.258 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445965+0000", 2024-09-13T05:11:37.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6832999999999998e-05 2024-09-13T05:11:37.258 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.259 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.259 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.445979+0000", 2024-09-13T05:11:37.259 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4112e-05 2024-09-13T05:11:37.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.259 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.259 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479481+0000", 2024-09-13T05:11:37.259 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033502394999999997 2024-09-13T05:11:37.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.259 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.259 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479577+0000", 2024-09-13T05:11:37.259 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5952999999999994e-05 2024-09-13T05:11:37.260 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.260 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.260 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.260 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.479990+0000", 2024-09-13T05:11:37.260 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00041233799999999999 2024-09-13T05:11:37.260 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.260 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.260 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.260 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.260 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.260 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47606 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 15925248~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:37.260 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.446006+0000", 2024-09-13T05:11:37.260 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 45.672641910999999, 2024-09-13T05:11:37.261 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034653819000000002, 2024-09-13T05:11:37.261 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.261 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.261 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.261 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.261 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.261 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47606 2024-09-13T05:11:37.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.261 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.261 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.261 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.261 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446006+0000", 2024-09-13T05:11:37.261 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.262 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.262 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.262 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446006+0000", 2024-09-13T05:11:37.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.262 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.262 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.262 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.262 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446005+0000", 2024-09-13T05:11:37.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:37.263 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.263 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.263 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.263 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446011+0000", 2024-09-13T05:11:37.263 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8039999999999998e-06 2024-09-13T05:11:37.263 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.263 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.263 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.263 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446027+0000", 2024-09-13T05:11:37.263 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6109000000000001e-05 2024-09-13T05:11:37.263 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.264 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446036+0000", 2024-09-13T05:11:37.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0100000000000001e-06 2024-09-13T05:11:37.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.264 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480068+0000", 2024-09-13T05:11:37.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034031516999999997 2024-09-13T05:11:37.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.264 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480216+0000", 2024-09-13T05:11:37.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000148701 2024-09-13T05:11:37.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.265 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.265 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480660+0000", 2024-09-13T05:11:37.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00044355499999999999 2024-09-13T05:11:37.265 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.265 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.265 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.265 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47607 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16220160~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:37.265 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.446044+0000", 2024-09-13T05:11:37.265 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 45.672604442000001, 2024-09-13T05:11:37.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035276967999999999, 2024-09-13T05:11:37.266 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.266 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.266 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.266 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.266 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.266 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47607 2024-09-13T05:11:37.266 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.266 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.266 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.266 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446044+0000", 2024-09-13T05:11:37.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.266 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.267 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.267 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446044+0000", 2024-09-13T05:11:37.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.267 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.267 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.267 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446043+0000", 2024-09-13T05:11:37.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.267 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.267 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.267 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446047+0000", 2024-09-13T05:11:37.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0729999999999998e-06 2024-09-13T05:11:37.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.268 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.268 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.268 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446055+0000", 2024-09-13T05:11:37.268 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0900000000000005e-06 2024-09-13T05:11:37.268 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.268 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.268 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.268 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446062+0000", 2024-09-13T05:11:37.268 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0169999999999999e-06 2024-09-13T05:11:37.268 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.268 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.268 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.268 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480714+0000", 2024-09-13T05:11:37.269 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034651380000000002 2024-09-13T05:11:37.269 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.269 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.269 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.269 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.480859+0000", 2024-09-13T05:11:37.269 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014580300000000001 2024-09-13T05:11:37.269 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.269 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.269 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.269 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481321+0000", 2024-09-13T05:11:37.269 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000461218 2024-09-13T05:11:37.269 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.269 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.269 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.270 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.270 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.270 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:47608 3.5 3:a745e90a:::rbd_data.112df8453990.0000000000000001:11 [read 16515072~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-13T05:11:37.270 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:51.446068+0000", 2024-09-13T05:11:37.270 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 45.672579996000003, 2024-09-13T05:11:37.270 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035881819000000002, 2024-09-13T05:11:37.270 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.270 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.270 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.270 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.270 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.270 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 47608 2024-09-13T05:11:37.270 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.270 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.271 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.271 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.271 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446068+0000", 2024-09-13T05:11:37.271 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.271 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.271 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.271 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.271 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446068+0000", 2024-09-13T05:11:37.271 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.271 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.271 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.271 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.271 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446067+0000", 2024-09-13T05:11:37.271 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.272 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.272 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.272 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.272 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446071+0000", 2024-09-13T05:11:37.272 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9090000000000002e-06 2024-09-13T05:11:37.272 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.272 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.272 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.272 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446079+0000", 2024-09-13T05:11:37.272 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6869999999999994e-06 2024-09-13T05:11:37.272 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.272 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.272 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.272 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.446088+0000", 2024-09-13T05:11:37.273 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0129999999999999e-06 2024-09-13T05:11:37.273 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.273 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.273 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.273 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481401+0000", 2024-09-13T05:11:37.273 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035313272999999999 2024-09-13T05:11:37.273 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.273 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.273 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.273 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481564+0000", 2024-09-13T05:11:37.273 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016223299999999999 2024-09-13T05:11:37.273 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.273 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.273 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.274 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:51.481950+0000", 2024-09-13T05:11:37.274 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00038631000000000001 2024-09-13T05:11:37.274 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.274 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.274 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.274 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.274 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.274 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:67653 3.1f 3:f936ba4b:::rbd_object_map.112d7bfe4877:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e81)", 2024-09-13T05:11:37.274 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:18.704251+0000", 2024-09-13T05:11:37.274 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.414396630999999, 2024-09-13T05:11:37.274 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034028673000000002, 2024-09-13T05:11:37.274 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.274 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:37.275 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.275 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.275 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.275 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 67653 2024-09-13T05:11:37.275 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.275 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.275 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.275 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.275 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704251+0000", 2024-09-13T05:11:37.275 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.275 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.275 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.275 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.275 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704251+0000", 2024-09-13T05:11:37.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.276 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.276 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.276 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704251+0000", 2024-09-13T05:11:37.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:37.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.276 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.276 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.276 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704253+0000", 2024-09-13T05:11:37.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.136e-06 2024-09-13T05:11:37.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.276 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.276 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.277 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704256+0000", 2024-09-13T05:11:37.277 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7049999999999999e-06 2024-09-13T05:11:37.277 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.277 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.277 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.277 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704259+0000", 2024-09-13T05:11:37.277 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6970000000000002e-06 2024-09-13T05:11:37.277 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.277 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.277 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.277 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.729746+0000", 2024-09-13T05:11:37.277 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.025486892000000001 2024-09-13T05:11:37.277 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.277 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.278 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.278 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.729834+0000", 2024-09-13T05:11:37.278 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8864999999999997e-05 2024-09-13T05:11:37.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.278 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.278 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 2", 2024-09-13T05:11:37.278 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.730192+0000", 2024-09-13T05:11:37.278 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00035797100000000001 2024-09-13T05:11:37.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.278 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.278 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:11:37.278 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.734948+0000", 2024-09-13T05:11:37.278 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0047558139999999997 2024-09-13T05:11:37.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.279 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.279 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:37.279 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.738189+0000", 2024-09-13T05:11:37.279 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003241234 2024-09-13T05:11:37.279 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.279 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.279 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:11:37.279 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.738245+0000", 2024-09-13T05:11:37.279 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6001000000000001e-05 2024-09-13T05:11:37.279 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.279 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.279 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.279 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.738280+0000", 2024-09-13T05:11:37.279 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4567000000000003e-05 2024-09-13T05:11:37.280 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.280 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.280 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.280 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.280 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.280 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:67654 3.1f 3:f936ba4b:::rbd_object_map.112d7bfe4877:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e81)", 2024-09-13T05:11:37.280 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:18.704261+0000", 2024-09-13T05:11:37.280 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.414387095999999, 2024-09-13T05:11:37.280 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034141218000000001, 2024-09-13T05:11:37.280 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.280 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:11:37.280 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.280 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.280 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.281 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 67654 2024-09-13T05:11:37.281 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.281 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.281 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.281 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.281 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704261+0000", 2024-09-13T05:11:37.281 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.281 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.281 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.281 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.281 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704261+0000", 2024-09-13T05:11:37.281 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.281 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.281 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.282 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.282 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704261+0000", 2024-09-13T05:11:37.282 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:37.282 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.282 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.282 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.282 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704263+0000", 2024-09-13T05:11:37.282 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3999999999999999e-06 2024-09-13T05:11:37.282 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.282 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.282 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.282 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704266+0000", 2024-09-13T05:11:37.282 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7879999999999998e-06 2024-09-13T05:11:37.282 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.283 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.283 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.283 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.704269+0000", 2024-09-13T05:11:37.283 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:11:37.283 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.283 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.283 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.283 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.730747+0000", 2024-09-13T05:11:37.283 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.026478224000000002 2024-09-13T05:11:37.283 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.283 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.283 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.283 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.730796+0000", 2024-09-13T05:11:37.283 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9137000000000001e-05 2024-09-13T05:11:37.284 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.284 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.284 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 2", 2024-09-13T05:11:37.284 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.731142+0000", 2024-09-13T05:11:37.284 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00034581500000000002 2024-09-13T05:11:37.284 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.284 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.284 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:11:37.284 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.734952+0000", 2024-09-13T05:11:37.284 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0038102909999999999 2024-09-13T05:11:37.284 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.284 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.284 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:11:37.284 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.738325+0000", 2024-09-13T05:11:37.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033727890000000002 2024-09-13T05:11:37.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.285 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:11:37.285 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.738369+0000", 2024-09-13T05:11:37.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4338999999999997e-05 2024-09-13T05:11:37.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.285 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.285 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:18.738402+0000", 2024-09-13T05:11:37.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2880999999999999e-05 2024-09-13T05:11:37.285 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.285 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.285 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.286 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.286 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.286 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3.bb1d1096 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:11:37.286 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:11:37.286 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.174925930000001, 2024-09-13T05:11:37.286 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68834410099999999, 2024-09-13T05:11:37.286 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.286 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:37.286 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.287 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.287 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.287 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:11:37.287 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.287 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.287 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.287 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.287 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:11:37.287 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.287 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.287 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.287 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.287 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:11:37.287 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.288 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.288 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.288 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.288 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943719+0000", 2024-09-13T05:11:37.288 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:11:37.288 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.288 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.288 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.288 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943734+0000", 2024-09-13T05:11:37.288 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4793e-05 2024-09-13T05:11:37.288 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.288 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.288 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.288 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943765+0000", 2024-09-13T05:11:37.289 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0648999999999997e-05 2024-09-13T05:11:37.289 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.289 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.289 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.289 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943779+0000", 2024-09-13T05:11:37.289 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.447e-05 2024-09-13T05:11:37.289 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.289 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.289 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.289 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943872+0000", 2024-09-13T05:11:37.289 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3304e-05 2024-09-13T05:11:37.289 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.289 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.290 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:37.290 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943884+0000", 2024-09-13T05:11:37.290 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.167e-05 2024-09-13T05:11:37.290 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.290 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.290 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.290 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632042+0000", 2024-09-13T05:11:37.290 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68815832600000004 2024-09-13T05:11:37.290 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.290 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.290 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.290 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632066+0000", 2024-09-13T05:11:37.290 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3765999999999999e-05 2024-09-13T05:11:37.290 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.290 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.291 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.291 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.291 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.291 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3.b6bd6256 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:11:37.291 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:11:37.291 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.17480143, 2024-09-13T05:11:37.291 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68852592499999998, 2024-09-13T05:11:37.291 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.291 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:37.291 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.291 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.291 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.291 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:11:37.291 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.292 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.292 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.292 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.292 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:11:37.292 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.292 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.292 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.292 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.292 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:11:37.292 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.292 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.292 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.292 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.292 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943846+0000", 2024-09-13T05:11:37.293 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:37.293 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.293 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.293 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.293 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943852+0000", 2024-09-13T05:11:37.293 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3820000000000001e-06 2024-09-13T05:11:37.293 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.293 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.293 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.293 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943876+0000", 2024-09-13T05:11:37.293 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3995e-05 2024-09-13T05:11:37.293 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.293 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.293 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.294 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943898+0000", 2024-09-13T05:11:37.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1838999999999999e-05 2024-09-13T05:11:37.294 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.294 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.294 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.294 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946457+0000", 2024-09-13T05:11:37.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025588910000000002 2024-09-13T05:11:37.294 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.294 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.294 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:37.294 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946499+0000", 2024-09-13T05:11:37.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2814e-05 2024-09-13T05:11:37.294 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.294 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.295 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.295 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632364+0000", 2024-09-13T05:11:37.295 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68586484999999997 2024-09-13T05:11:37.295 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.295 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.295 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.295 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632372+0000", 2024-09-13T05:11:37.295 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1659999999999994e-06 2024-09-13T05:11:37.295 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.295 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.295 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.295 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.295 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.295 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3:6908b8dd:::rbd_data.112d8d1317eb.000000000000000f:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:11:37.296 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:11:37.296 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.137657352, 2024-09-13T05:11:37.296 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65181049499999999, 2024-09-13T05:11:37.296 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.296 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.296 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.296 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.296 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.296 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:11:37.296 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.296 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.296 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.296 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.297 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:11:37.297 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.297 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.297 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.297 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.297 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:11:37.297 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.297 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.297 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.297 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.297 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980989+0000", 2024-09-13T05:11:37.297 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:37.297 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.297 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.298 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.298 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980996+0000", 2024-09-13T05:11:37.298 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2200000000000003e-06 2024-09-13T05:11:37.298 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.298 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.298 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.298 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981011+0000", 2024-09-13T05:11:37.298 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4997000000000001e-05 2024-09-13T05:11:37.298 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.298 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.298 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.298 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981025+0000", 2024-09-13T05:11:37.298 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3604000000000001e-05 2024-09-13T05:11:37.298 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.299 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.299 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.299 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981110+0000", 2024-09-13T05:11:37.299 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4948000000000001e-05 2024-09-13T05:11:37.299 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.299 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.299 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:37.299 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981120+0000", 2024-09-13T05:11:37.299 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9399999999999997e-06 2024-09-13T05:11:37.299 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.299 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.299 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.299 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632425+0000", 2024-09-13T05:11:37.299 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65130460499999998 2024-09-13T05:11:37.300 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.300 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.300 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.300 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632587+0000", 2024-09-13T05:11:37.300 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016199500000000001 2024-09-13T05:11:37.300 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.300 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.300 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.300 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632801+0000", 2024-09-13T05:11:37.300 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021459499999999999 2024-09-13T05:11:37.300 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.300 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.300 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.300 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.301 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.301 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3:6a46bd6d:::rbd_data.112d8d1317eb.0000000000000010:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:11:37.301 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:11:37.301 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.137599696000001, 2024-09-13T05:11:37.301 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65213695699999996, 2024-09-13T05:11:37.301 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.301 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.301 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.301 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.301 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.301 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:11:37.301 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.301 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.302 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.302 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.302 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:11:37.302 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.302 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.302 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.302 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.302 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:11:37.302 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.302 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.302 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.302 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.302 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:11:37.302 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.302 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.303 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.303 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.303 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981052+0000", 2024-09-13T05:11:37.303 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4469999999999999e-06 2024-09-13T05:11:37.303 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.303 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.303 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.303 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981066+0000", 2024-09-13T05:11:37.303 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3658e-05 2024-09-13T05:11:37.303 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.303 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.303 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.303 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981073+0000", 2024-09-13T05:11:37.303 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:11:37.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.304 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.304 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.304 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981150+0000", 2024-09-13T05:11:37.304 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7783999999999999e-05 2024-09-13T05:11:37.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.304 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.304 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:37.304 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981161+0000", 2024-09-13T05:11:37.304 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0197000000000001e-05 2024-09-13T05:11:37.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.304 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.304 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.304 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632926+0000", 2024-09-13T05:11:37.305 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65176517300000003 2024-09-13T05:11:37.305 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.305 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.305 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.305 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633081+0000", 2024-09-13T05:11:37.305 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000155172 2024-09-13T05:11:37.305 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.305 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.305 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.305 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633185+0000", 2024-09-13T05:11:37.305 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000104329 2024-09-13T05:11:37.305 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.305 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.305 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.306 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.306 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.306 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:37.307 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:11:37.307 INFO:teuthology.orchestra.run.smithi120.stdout:4370 write 0xdc67a88 thru 0xdc6a924 (0x2e9d bytes) 2024-09-13T05:11:37.307 INFO:teuthology.orchestra.run.smithi120.stdout:4371 read 0x743ffee thru 0x74425f1 (0x2604 bytes) 2024-09-13T05:11:37.307 INFO:teuthology.orchestra.run.smithi120.stdout:4372 clone 34 order 20 su 524288 sc 11 2024-09-13T05:11:37.308 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:37.204+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:37.309 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:37.308+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:37.410 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:37.408+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:37.426 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:37.426 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:37.426 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:11:37.426 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:37.436 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:11:37.511 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:37.508+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:37.544 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:37.545 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:37.545 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:37.545 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:37.545 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:37.554 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:11:37.613 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:37.605+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:37.665 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:37.666 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:37.666 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:37.666 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:37.666 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.666 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29020 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2855936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:37.667 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:11:37.667 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 60.619527652999999, 2024-09-13T05:11:37.667 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060733743, 2024-09-13T05:11:37.667 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.667 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.667 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.668 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.668 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.668 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29020 2024-09-13T05:11:37.668 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.668 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.669 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.669 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.669 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:11:37.669 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.669 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.669 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.669 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.670 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:11:37.670 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.670 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.670 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.670 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.671 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041741+0000", 2024-09-13T05:11:37.671 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.671 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.671 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.672 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041749+0000", 2024-09-13T05:11:37.672 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6059999999999997e-06 2024-09-13T05:11:37.672 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.672 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.672 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.673 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041754+0000", 2024-09-13T05:11:37.673 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6740000000000002e-06 2024-09-13T05:11:37.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.673 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.674 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.674 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041760+0000", 2024-09-13T05:11:37.674 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0459999999999996e-06 2024-09-13T05:11:37.674 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.674 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.675 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.675 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102289+0000", 2024-09-13T05:11:37.675 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060529145999999999 2024-09-13T05:11:37.675 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.675 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.676 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.676 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102378+0000", 2024-09-13T05:11:37.676 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8901999999999997e-05 2024-09-13T05:11:37.676 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.679 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.679 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.679 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102476+0000", 2024-09-13T05:11:37.679 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7991000000000004e-05 2024-09-13T05:11:37.679 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.679 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.679 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.679 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.679 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.679 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29021 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2865152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:37.679 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:11:37.680 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 60.619505658000001, 2024-09-13T05:11:37.680 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060927993999999999, 2024-09-13T05:11:37.680 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.680 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.680 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.680 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.680 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.680 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29021 2024-09-13T05:11:37.680 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.680 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.680 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.680 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.680 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:11:37.681 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.681 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.681 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:11:37.681 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.681 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.681 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041763+0000", 2024-09-13T05:11:37.681 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.681 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.682 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041766+0000", 2024-09-13T05:11:37.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6800000000000002e-06 2024-09-13T05:11:37.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.682 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.682 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041771+0000", 2024-09-13T05:11:37.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:11:37.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.682 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.682 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041776+0000", 2024-09-13T05:11:37.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8489999999999997e-06 2024-09-13T05:11:37.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.683 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.683 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102513+0000", 2024-09-13T05:11:37.683 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060737102000000001 2024-09-13T05:11:37.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.683 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.683 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.683 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102597+0000", 2024-09-13T05:11:37.683 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4374000000000002e-05 2024-09-13T05:11:37.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.683 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.683 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.683 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102692+0000", 2024-09-13T05:11:37.683 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4436000000000002e-05 2024-09-13T05:11:37.683 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.684 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.684 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.684 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29022 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2874368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:37.684 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:11:37.684 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 60.619489358000003, 2024-09-13T05:11:37.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061135083999999999, 2024-09-13T05:11:37.684 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.684 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.684 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.684 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.684 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.685 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29022 2024-09-13T05:11:37.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.685 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.685 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.685 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:11:37.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.685 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.685 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:11:37.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.686 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.686 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:11:37.686 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.686 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.686 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.686 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.686 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041782+0000", 2024-09-13T05:11:37.686 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4959999999999999e-06 2024-09-13T05:11:37.686 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.686 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.686 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.686 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041787+0000", 2024-09-13T05:11:37.686 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1240000000000004e-06 2024-09-13T05:11:37.686 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.686 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041792+0000", 2024-09-13T05:11:37.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9200000000000003e-06 2024-09-13T05:11:37.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102738+0000", 2024-09-13T05:11:37.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060945581999999998 2024-09-13T05:11:37.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102821+0000", 2024-09-13T05:11:37.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2898999999999994e-05 2024-09-13T05:11:37.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.688 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.688 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.688 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102915+0000", 2024-09-13T05:11:37.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4523000000000003e-05 2024-09-13T05:11:37.688 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.688 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.688 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.688 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.688 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.688 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29067 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2764800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:37.688 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:11:37.688 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 60.615715141000003, 2024-09-13T05:11:37.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060816621000000001, 2024-09-13T05:11:37.689 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.689 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.689 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.689 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.689 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.689 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29067 2024-09-13T05:11:37.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.689 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.689 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.689 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.689 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:11:37.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:11:37.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:11:37.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045557+0000", 2024-09-13T05:11:37.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.898e-06 2024-09-13T05:11:37.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045575+0000", 2024-09-13T05:11:37.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8252000000000001e-05 2024-09-13T05:11:37.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.692 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045581+0000", 2024-09-13T05:11:37.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:11:37.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.692 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.692 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106183+0000", 2024-09-13T05:11:37.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060602630999999997 2024-09-13T05:11:37.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.692 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.692 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106271+0000", 2024-09-13T05:11:37.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7329000000000004e-05 2024-09-13T05:11:37.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106371+0000", 2024-09-13T05:11:37.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000100164 2024-09-13T05:11:37.693 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.693 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.693 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.693 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29068 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2774016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:37.693 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:11:37.693 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 60.615683906999998, 2024-09-13T05:11:37.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060994509000000002, 2024-09-13T05:11:37.693 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.694 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.694 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.694 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.694 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.694 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29068 2024-09-13T05:11:37.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.694 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:11:37.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.695 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:11:37.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.695 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.695 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045585+0000", 2024-09-13T05:11:37.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.695 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.695 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045588+0000", 2024-09-13T05:11:37.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:11:37.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045594+0000", 2024-09-13T05:11:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9329999999999998e-06 2024-09-13T05:11:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045599+0000", 2024-09-13T05:11:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3190000000000002e-06 2024-09-13T05:11:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106399+0000", 2024-09-13T05:11:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060800361999999997 2024-09-13T05:11:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106489+0000", 2024-09-13T05:11:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9301000000000004e-05 2024-09-13T05:11:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106580+0000", 2024-09-13T05:11:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1314e-05 2024-09-13T05:11:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29069 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2792448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:11:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 60.615665489999998, 2024-09-13T05:11:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061207599000000001, 2024-09-13T05:11:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29069 2024-09-13T05:11:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:11:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:11:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045603+0000", 2024-09-13T05:11:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045606+0000", 2024-09-13T05:11:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7300000000000001e-06 2024-09-13T05:11:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045612+0000", 2024-09-13T05:11:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9599999999999997e-06 2024-09-13T05:11:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045619+0000", 2024-09-13T05:11:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6019999999999996e-06 2024-09-13T05:11:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106619+0000", 2024-09-13T05:11:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061000029999999997 2024-09-13T05:11:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106713+0000", 2024-09-13T05:11:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4505000000000004e-05 2024-09-13T05:11:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106812+0000", 2024-09-13T05:11:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8264000000000007e-05 2024-09-13T05:11:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29070 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2783232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:11:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 60.615645031, 2024-09-13T05:11:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061389805999999998, 2024-09-13T05:11:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29070 2024-09-13T05:11:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:11:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:11:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:11:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045627+0000", 2024-09-13T05:11:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6579999999999998e-06 2024-09-13T05:11:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045632+0000", 2024-09-13T05:11:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8449999999999999e-06 2024-09-13T05:11:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045639+0000", 2024-09-13T05:11:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:11:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106837+0000", 2024-09-13T05:11:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061198529000000002 2024-09-13T05:11:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106922+0000", 2024-09-13T05:11:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4771999999999994e-05 2024-09-13T05:11:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107014+0000", 2024-09-13T05:11:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2009000000000006e-05 2024-09-13T05:11:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29071 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2801664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:11:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 60.615625954999999, 2024-09-13T05:11:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061582804999999997, 2024-09-13T05:11:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29071 2024-09-13T05:11:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:11:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:11:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045643+0000", 2024-09-13T05:11:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045646+0000", 2024-09-13T05:11:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:11:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045664+0000", 2024-09-13T05:11:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8408000000000001e-05 2024-09-13T05:11:37.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045670+0000", 2024-09-13T05:11:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7710000000000003e-06 2024-09-13T05:11:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107048+0000", 2024-09-13T05:11:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061378438 2024-09-13T05:11:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107134+0000", 2024-09-13T05:11:37.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5574000000000004e-05 2024-09-13T05:11:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107226+0000", 2024-09-13T05:11:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2262000000000005e-05 2024-09-13T05:11:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29072 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2810880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:11:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 60.615594571000003, 2024-09-13T05:11:37.711 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061762233999999999, 2024-09-13T05:11:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29072 2024-09-13T05:11:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:11:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:11:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045674+0000", 2024-09-13T05:11:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045677+0000", 2024-09-13T05:11:37.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9679999999999998e-06 2024-09-13T05:11:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045694+0000", 2024-09-13T05:11:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6801999999999999e-05 2024-09-13T05:11:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045700+0000", 2024-09-13T05:11:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8270000000000003e-06 2024-09-13T05:11:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.714 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107249+0000", 2024-09-13T05:11:37.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061549114000000002 2024-09-13T05:11:37.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.715 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107341+0000", 2024-09-13T05:11:37.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2390000000000001e-05 2024-09-13T05:11:37.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.715 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107437+0000", 2024-09-13T05:11:37.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5648000000000003e-05 2024-09-13T05:11:37.715 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.715 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.715 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29073 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2820096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:11:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 60.615552592999997, 2024-09-13T05:11:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061873910999999997, 2024-09-13T05:11:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29073 2024-09-13T05:11:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:11:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:11:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045716+0000", 2024-09-13T05:11:37.717 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045726+0000", 2024-09-13T05:11:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6350000000000001e-06 2024-09-13T05:11:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045739+0000", 2024-09-13T05:11:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3325e-05 2024-09-13T05:11:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045746+0000", 2024-09-13T05:11:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7399999999999998e-06 2024-09-13T05:11:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107457+0000", 2024-09-13T05:11:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061711038000000003 2024-09-13T05:11:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107522+0000", 2024-09-13T05:11:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4850000000000004e-05 2024-09-13T05:11:37.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107591+0000", 2024-09-13T05:11:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9029999999999995e-05 2024-09-13T05:11:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29074 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2829312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:11:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 60.615518684999998, 2024-09-13T05:11:37.720 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062055459, 2024-09-13T05:11:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29074 2024-09-13T05:11:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:11:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.721 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:11:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045750+0000", 2024-09-13T05:11:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045753+0000", 2024-09-13T05:11:37.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8399999999999999e-06 2024-09-13T05:11:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045759+0000", 2024-09-13T05:11:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8900000000000004e-06 2024-09-13T05:11:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045764+0000", 2024-09-13T05:11:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3850000000000001e-06 2024-09-13T05:11:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107623+0000", 2024-09-13T05:11:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061858817000000003 2024-09-13T05:11:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107710+0000", 2024-09-13T05:11:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7127999999999997e-05 2024-09-13T05:11:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107806+0000", 2024-09-13T05:11:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5886999999999999e-05 2024-09-13T05:11:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.724 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29075 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2838528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:11:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 60.615500230999999, 2024-09-13T05:11:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062188516999999999, 2024-09-13T05:11:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.725 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.726 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29075 2024-09-13T05:11:37.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.726 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.726 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.726 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.726 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:11:37.726 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.726 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.726 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.726 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:11:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:11:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045772+0000", 2024-09-13T05:11:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:11:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.727 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045778+0000", 2024-09-13T05:11:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9229999999999996e-06 2024-09-13T05:11:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045784+0000", 2024-09-13T05:11:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3800000000000002e-06 2024-09-13T05:11:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107823+0000", 2024-09-13T05:11:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062039331000000003 2024-09-13T05:11:37.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107886+0000", 2024-09-13T05:11:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2476000000000003e-05 2024-09-13T05:11:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107958+0000", 2024-09-13T05:11:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2089999999999996e-05 2024-09-13T05:11:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.729 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29115 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2682880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:11:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 60.612034704000003, 2024-09-13T05:11:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060847898999999997, 2024-09-13T05:11:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.730 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29115 2024-09-13T05:11:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:11:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:11:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049234+0000", 2024-09-13T05:11:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049237+0000", 2024-09-13T05:11:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9069999999999999e-06 2024-09-13T05:11:37.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049243+0000", 2024-09-13T05:11:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7459999999999997e-06 2024-09-13T05:11:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049248+0000", 2024-09-13T05:11:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1490000000000002e-06 2024-09-13T05:11:37.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.109945+0000", 2024-09-13T05:11:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060697299000000003 2024-09-13T05:11:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110013+0000", 2024-09-13T05:11:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8023999999999998e-05 2024-09-13T05:11:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110083+0000", 2024-09-13T05:11:37.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9296999999999997e-05 2024-09-13T05:11:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29116 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2692096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:11:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 60.612016859999997, 2024-09-13T05:11:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061040167999999999, 2024-09-13T05:11:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.735 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29116 2024-09-13T05:11:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:11:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.736 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:11:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049252+0000", 2024-09-13T05:11:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049255+0000", 2024-09-13T05:11:37.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7250000000000002e-06 2024-09-13T05:11:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049261+0000", 2024-09-13T05:11:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.755e-06 2024-09-13T05:11:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049266+0000", 2024-09-13T05:11:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2100000000000001e-06 2024-09-13T05:11:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110115+0000", 2024-09-13T05:11:37.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060849225999999999 2024-09-13T05:11:37.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110199+0000", 2024-09-13T05:11:37.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4339999999999995e-05 2024-09-13T05:11:37.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110293+0000", 2024-09-13T05:11:37.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3397e-05 2024-09-13T05:11:37.739 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.739 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.739 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.740 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29117 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2701312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:37.740 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:11:37.740 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 60.611999222999998, 2024-09-13T05:11:37.740 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.06118527, 2024-09-13T05:11:37.740 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.740 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.740 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.740 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.740 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.740 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29117 2024-09-13T05:11:37.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.740 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.741 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:11:37.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.741 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:11:37.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.741 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:11:37.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049273+0000", 2024-09-13T05:11:37.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.757e-06 2024-09-13T05:11:37.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049278+0000", 2024-09-13T05:11:37.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7830000000000004e-06 2024-09-13T05:11:37.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049284+0000", 2024-09-13T05:11:37.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3820000000000003e-06 2024-09-13T05:11:37.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110313+0000", 2024-09-13T05:11:37.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061029682000000002 2024-09-13T05:11:37.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110383+0000", 2024-09-13T05:11:37.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9406000000000006e-05 2024-09-13T05:11:37.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110456+0000", 2024-09-13T05:11:37.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2750000000000007e-05 2024-09-13T05:11:37.744 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.744 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.744 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.744 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29118 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2710528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:37.744 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:11:37.744 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 60.611981307999997, 2024-09-13T05:11:37.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061380698999999997, 2024-09-13T05:11:37.744 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.744 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.745 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.745 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.745 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.745 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29118 2024-09-13T05:11:37.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.745 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.745 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.745 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.745 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:11:37.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.746 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:11:37.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.746 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:11:37.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.746 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049291+0000", 2024-09-13T05:11:37.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8770000000000002e-06 2024-09-13T05:11:37.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049296+0000", 2024-09-13T05:11:37.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6799999999999998e-06 2024-09-13T05:11:37.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049302+0000", 2024-09-13T05:11:37.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2769999999999996e-06 2024-09-13T05:11:37.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110488+0000", 2024-09-13T05:11:37.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061186184999999997 2024-09-13T05:11:37.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110577+0000", 2024-09-13T05:11:37.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9246000000000006e-05 2024-09-13T05:11:37.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110669+0000", 2024-09-13T05:11:37.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1923999999999996e-05 2024-09-13T05:11:37.748 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.749 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.749 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.749 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29119 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2719744~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:37.749 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:11:37.749 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 60.611963564, 2024-09-13T05:11:37.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061521165000000003, 2024-09-13T05:11:37.749 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.749 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.749 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.749 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.749 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.749 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29119 2024-09-13T05:11:37.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.750 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:11:37.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:11:37.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049305+0000", 2024-09-13T05:11:37.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049308+0000", 2024-09-13T05:11:37.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7070000000000001e-06 2024-09-13T05:11:37.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049316+0000", 2024-09-13T05:11:37.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:11:37.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049322+0000", 2024-09-13T05:11:37.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3199999999999999e-06 2024-09-13T05:11:37.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110690+0000", 2024-09-13T05:11:37.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061368428000000003 2024-09-13T05:11:37.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110755+0000", 2024-09-13T05:11:37.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4893000000000004e-05 2024-09-13T05:11:37.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110827+0000", 2024-09-13T05:11:37.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2039000000000006e-05 2024-09-13T05:11:37.753 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.753 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.753 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.753 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29120 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2728960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:37.753 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:11:37.754 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 60.611943294, 2024-09-13T05:11:37.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061718420000000003, 2024-09-13T05:11:37.754 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.754 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.754 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.754 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.754 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.754 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29120 2024-09-13T05:11:37.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.754 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:11:37.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:11:37.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:11:37.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049329+0000", 2024-09-13T05:11:37.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.022e-06 2024-09-13T05:11:37.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049336+0000", 2024-09-13T05:11:37.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0720000000000002e-06 2024-09-13T05:11:37.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049341+0000", 2024-09-13T05:11:37.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:11:37.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110864+0000", 2024-09-13T05:11:37.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061523126999999997 2024-09-13T05:11:37.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110951+0000", 2024-09-13T05:11:37.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6557000000000005e-05 2024-09-13T05:11:37.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.111045+0000", 2024-09-13T05:11:37.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4043999999999996e-05 2024-09-13T05:11:37.757 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.757 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.758 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.758 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29136 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2876416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:37.758 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:11:37.758 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 60.607927869000001, 2024-09-13T05:11:37.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060742995000000001, 2024-09-13T05:11:37.758 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.758 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.758 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.758 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.758 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.758 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29136 2024-09-13T05:11:37.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.759 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:11:37.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:11:37.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053341+0000", 2024-09-13T05:11:37.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053344+0000", 2024-09-13T05:11:37.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:11:37.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053350+0000", 2024-09-13T05:11:37.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7200000000000003e-06 2024-09-13T05:11:37.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053355+0000", 2024-09-13T05:11:37.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0150000000000003e-06 2024-09-13T05:11:37.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113909+0000", 2024-09-13T05:11:37.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060554368999999997 2024-09-13T05:11:37.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113994+0000", 2024-09-13T05:11:37.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4658000000000002e-05 2024-09-13T05:11:37.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114085+0000", 2024-09-13T05:11:37.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0939000000000005e-05 2024-09-13T05:11:37.762 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.762 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.762 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.762 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29166 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2628608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:37.762 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:11:37.762 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 60.607910435000001, 2024-09-13T05:11:37.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060883127000000002, 2024-09-13T05:11:37.762 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:37.763 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:37.763 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:37.763 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:37.763 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:37.763 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29166 2024-09-13T05:11:37.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.763 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:37.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.763 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:37.763 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:11:37.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.763 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:37.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:11:37.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:37.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:37.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:11:37.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:37.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:37.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053361+0000", 2024-09-13T05:11:37.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:11:37.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:37.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053367+0000", 2024-09-13T05:11:37.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7350000000000001e-06 2024-09-13T05:11:37.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:37.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053372+0000", 2024-09-13T05:11:37.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7840000000000003e-06 2024-09-13T05:11:37.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:37.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114103+0000", 2024-09-13T05:11:37.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060730924999999998 2024-09-13T05:11:37.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:37.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114171+0000", 2024-09-13T05:11:37.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8021999999999993e-05 2024-09-13T05:11:37.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:37.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:37.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:37.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114242+0000", 2024-09-13T05:11:37.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1390999999999995e-05 2024-09-13T05:11:37.766 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.766 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.766 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.766 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:37.767 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:37.767 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:37.768 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:11:37.769 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:37.764+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:37.850 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone33 from 0xdc6a925 (overlap 0x41049) to 0x0 2024-09-13T05:11:37.869 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:37.868+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:37.885 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:37.885 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:37.885 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:11:37.885 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:37.895 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:11:37.962 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #32, image image_client.0-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent33 2024-09-13T05:11:37.970 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:37.965+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:37.995 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:37.995 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:37.996 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:37.996 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:37.996 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:38.006 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:11:38.071 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:38.065+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:38.167 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:38.167 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:38.167 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:38.167 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:38.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.167 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:38.167 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:38.168 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 61.300164782000003, 2024-09-13T05:11:38.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:11:38.168 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:38.168 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:38.168 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:38.168 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:38.168 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.169 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:11:38.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.169 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:38.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:38.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:38.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:38.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:38.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:38.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:38.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:38.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:38.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:11:38.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:11:38.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:38.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:11:38.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:11:38.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.171 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:11:38.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:11:38.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.171 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:11:38.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:11:38.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:11:38.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:11:38.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:11:38.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:11:38.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:38.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:11:38.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:11:38.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:38.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:11:38.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:11:38.173 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.173 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:38.174 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.174 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:38.174 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:38.174 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 61.300140345999999, 2024-09-13T05:11:38.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:11:38.174 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:38.175 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:38.175 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:38.175 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:38.175 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.175 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:11:38.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.176 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:38.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:38.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:38.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:38.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:38.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:38.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:38.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:38.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:38.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:11:38.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:11:38.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.179 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:38.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:11:38.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:11:38.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:11:38.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:11:38.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:11:38.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:11:38.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:11:38.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:11:38.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:11:38.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:11:38.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:38.184 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:11:38.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:11:38.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.184 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:38.185 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:11:38.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:11:38.185 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.185 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:38.185 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.186 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:38.186 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:38.186 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 61.300130520000003, 2024-09-13T05:11:38.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:11:38.186 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:38.187 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:38.187 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:38.187 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:38.187 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.187 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:11:38.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.188 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:38.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:38.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:38.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:38.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:38.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:38.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:38.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:38.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:38.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:11:38.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:11:38.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:38.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:11:38.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:11:38.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:11:38.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:11:38.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:11:38.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:11:38.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:11:38.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:11:38.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.195 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.195 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:11:38.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:11:38.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.196 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:38.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:11:38.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:11:38.197 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.197 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:38.197 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.198 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:38.198 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:38.198 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 61.300122283999997, 2024-09-13T05:11:38.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:11:38.198 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:38.198 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:38.199 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:38.199 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:38.199 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.199 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:11:38.199 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.199 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:38.200 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.200 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:38.200 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:38.200 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.200 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.200 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:38.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:38.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:38.202 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:38.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:38.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.202 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:38.203 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:11:38.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:11:38.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.203 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:38.203 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:11:38.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:11:38.204 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.204 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:11:38.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:11:38.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.205 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.205 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:11:38.205 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:11:38.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.205 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.209 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:11:38.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:11:38.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.209 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.209 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:11:38.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:11:38.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.210 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:38.211 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:11:38.211 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:11:38.211 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.211 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:38.211 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.212 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.212 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:38.212 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:38.212 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 61.300100372000003, 2024-09-13T05:11:38.212 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:11:38.212 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:38.212 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:38.212 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:38.213 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:38.213 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.213 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:11:38.213 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.213 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:38.213 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.213 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:38.213 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:38.214 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.214 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.214 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:38.214 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:38.214 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.214 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.215 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:38.215 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:38.215 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:38.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.215 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:38.215 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:11:38.216 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:11:38.216 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.216 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.216 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:38.216 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:11:38.216 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:11:38.216 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.216 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.217 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.217 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:11:38.217 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:11:38.217 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.218 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.218 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:11:38.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:11:38.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.218 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.218 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:11:38.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:11:38.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.219 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.219 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.219 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:11:38.219 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:11:38.219 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.219 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.219 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:38.219 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:11:38.219 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:11:38.219 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.219 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:38.219 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.219 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.219 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.219 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:38.220 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:38.220 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 61.300091768000001, 2024-09-13T05:11:38.220 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:11:38.220 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:38.220 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:38.220 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:38.220 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:38.220 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.220 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:11:38.220 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.220 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:38.220 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.220 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:38.220 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:38.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.221 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:38.221 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:38.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.221 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:38.221 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:38.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:38.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.221 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:38.222 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:11:38.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:11:38.222 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.222 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.222 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:38.222 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:11:38.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:11:38.222 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.222 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.222 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.222 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:11:38.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:11:38.222 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.222 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:11:38.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:11:38.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:11:38.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:11:38.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:11:38.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:11:38.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.224 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:38.224 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:11:38.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:11:38.224 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.224 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:38.224 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.224 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.224 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:38.224 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:38.224 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 61.300082074000002, 2024-09-13T05:11:38.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:11:38.225 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:38.225 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:38.225 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:38.225 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:38.225 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.225 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:11:38.225 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.225 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:38.225 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.225 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:38.225 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:38.225 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.225 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.225 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.225 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:38.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:38.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:38.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:38.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:38.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:38.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:11:38.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:11:38.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:38.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:11:38.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:11:38.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:11:38.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:11:38.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:11:38.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:11:38.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.228 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.228 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:11:38.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:11:38.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.228 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.228 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:11:38.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:11:38.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.228 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:38.228 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:11:38.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:11:38.229 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.229 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:38.229 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.229 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.229 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.229 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:38.229 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:38.229 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 61.300072958999998, 2024-09-13T05:11:38.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:11:38.229 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:38.229 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:38.229 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:38.229 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:38.229 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.230 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:11:38.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.230 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:38.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:38.230 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:38.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:38.230 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:38.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:38.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:38.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:38.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:38.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:11:38.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:11:38.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:38.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:11:38.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:11:38.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.232 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.232 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.232 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:11:38.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:11:38.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.232 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.232 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.232 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:11:38.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:11:38.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.232 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.232 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.232 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:11:38.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:11:38.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:11:38.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:11:38.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:38.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:11:38.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:11:38.233 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.233 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:38.233 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.234 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:38.234 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:11:38.234 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 61.300064480000003, 2024-09-13T05:11:38.234 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:11:38.234 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:38.234 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:38.234 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:38.234 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:38.234 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.234 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:11:38.234 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.234 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:38.234 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.234 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:38.235 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:11:38.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:38.235 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:11:38.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:38.235 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:11:38.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:38.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:38.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:11:38.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:11:38.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:38.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:11:38.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:11:38.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:11:38.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:11:38.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:11:38.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:11:38.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:11:38.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:11:38.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:11:38.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:11:38.238 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.238 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.238 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:38.238 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:11:38.238 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:11:38.238 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.238 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:38.238 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.238 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.238 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.238 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:38.238 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:11:38.238 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 61.300052555000001, 2024-09-13T05:11:38.238 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:11:38.238 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:38.239 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:38.239 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:38.239 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:38.239 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.239 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:11:38.239 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.239 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:38.239 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.239 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:38.239 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:11:38.239 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.239 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.239 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.239 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:38.240 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:11:38.240 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.240 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.240 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:38.240 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:11:38.240 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:38.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.240 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.240 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:38.240 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:11:38.240 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:11:38.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.240 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:38.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:11:38.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:11:38.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:11:38.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:11:38.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:11:38.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:11:38.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:11:38.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:11:38.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:11:38.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:11:38.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:38.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:11:38.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:11:38.242 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.243 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:38.243 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.243 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.243 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.243 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:38.243 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:38.243 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 61.300030966000001, 2024-09-13T05:11:38.243 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:11:38.243 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:38.243 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:38.243 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:38.243 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:38.243 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.243 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:11:38.243 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.244 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:38.244 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.244 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:38.244 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:38.244 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.244 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.244 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.244 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:38.244 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:38.244 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.244 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.244 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.244 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:38.244 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:38.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:38.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.245 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.245 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:38.245 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:11:38.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:11:38.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.245 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.245 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:38.245 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:11:38.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:11:38.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.245 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.245 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:11:38.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:11:38.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:11:38.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:11:38.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:11:38.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:11:38.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:11:38.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:11:38.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:38.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:11:38.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:11:38.247 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.247 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:38.247 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.247 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:38.247 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:38.248 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 61.300007837999999, 2024-09-13T05:11:38.248 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:11:38.248 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:38.248 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:38.248 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:38.248 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:38.248 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.248 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:11:38.248 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.248 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:38.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.248 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:38.249 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:38.249 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:38.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:38.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:38.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:38.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:38.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:38.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:11:38.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:11:38.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:38.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:11:38.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:11:38.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:11:38.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:11:38.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:11:38.252 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:11:38.252 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.252 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.252 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.252 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:11:38.252 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:11:38.252 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.252 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.252 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.252 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:11:38.252 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:11:38.252 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.253 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.253 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:38.253 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:11:38.253 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:11:38.253 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.253 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:38.253 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.253 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.253 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.253 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:38.253 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:11:38.254 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 61.299992465000003, 2024-09-13T05:11:38.254 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:11:38.254 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:38.254 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:38.254 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:38.254 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:38.254 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.254 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:11:38.254 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.254 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:38.254 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.254 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:38.254 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:11:38.255 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.255 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.255 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.255 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:38.255 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:11:38.255 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.255 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.255 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.255 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:38.255 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:11:38.255 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:38.255 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.255 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.255 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:38.255 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:11:38.256 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:11:38.256 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.256 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.256 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:38.256 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:11:38.256 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:11:38.256 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.256 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.256 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.256 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:11:38.256 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:11:38.256 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.256 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.257 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.257 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:11:38.257 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:11:38.257 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.257 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.257 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.257 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:11:38.257 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:11:38.257 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.257 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.257 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.257 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:11:38.257 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:11:38.257 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.257 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.258 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:38.258 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:11:38.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:11:38.258 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.258 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:38.258 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.258 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.258 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.258 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:38.258 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:38.258 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 61.299971997, 2024-09-13T05:11:38.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:11:38.258 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:38.259 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:38.259 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:38.259 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:38.259 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.259 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:11:38.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.259 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:38.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.259 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:38.259 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:38.259 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.259 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:38.260 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:38.260 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.260 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.260 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.260 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:38.260 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:38.260 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:38.260 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.260 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.260 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:38.260 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:11:38.260 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:11:38.260 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.260 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.261 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:38.261 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:11:38.261 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:11:38.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.261 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.261 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.261 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:11:38.261 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:11:38.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.261 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.261 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.261 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:11:38.261 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:11:38.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.262 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.262 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.262 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:11:38.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:11:38.262 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.262 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.262 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.262 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:11:38.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:11:38.262 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.262 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.262 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:38.262 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:11:38.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:11:38.263 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.263 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:38.263 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.263 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.263 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.263 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:38.263 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:38.263 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 61.299955335999996, 2024-09-13T05:11:38.263 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:11:38.263 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:38.263 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:38.263 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:38.263 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:38.263 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.263 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:11:38.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.264 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:38.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:38.264 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:38.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:38.264 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:38.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:38.265 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:38.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:38.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.265 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:38.265 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:11:38.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:11:38.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.265 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:38.265 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:11:38.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:11:38.266 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.266 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.266 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:11:38.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:11:38.266 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.266 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.266 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:11:38.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:11:38.266 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.266 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.267 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:11:38.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:11:38.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.267 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.267 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.267 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:11:38.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:11:38.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.267 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.267 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:38.267 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:11:38.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:11:38.267 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.268 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:38.268 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.268 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.268 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.268 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:38.268 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:11:38.268 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 61.299928623, 2024-09-13T05:11:38.268 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:11:38.268 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:38.268 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:38.268 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:38.268 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:38.268 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.268 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:11:38.269 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.269 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:38.269 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.269 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:38.269 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:11:38.269 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.269 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.269 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.269 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:38.269 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:11:38.269 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.269 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.269 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.269 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:38.270 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:11:38.270 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:38.270 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.270 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.270 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:38.270 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:11:38.270 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:11:38.270 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.270 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.270 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:38.270 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:11:38.270 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:11:38.270 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.270 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.271 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.271 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:11:38.271 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:11:38.271 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.271 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.271 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.271 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:11:38.271 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:11:38.271 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.271 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.271 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.271 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:11:38.271 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:11:38.271 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.271 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.272 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.272 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:11:38.272 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:11:38.272 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.272 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.272 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:38.272 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:11:38.272 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:11:38.272 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.272 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:38.272 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.272 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.272 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.272 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:38.273 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:38.273 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 61.299909771000003, 2024-09-13T05:11:38.273 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:11:38.273 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:38.273 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:38.273 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:38.273 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:38.273 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.273 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:11:38.273 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.273 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:38.273 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.273 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:38.273 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:38.274 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.274 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.274 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.274 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:38.274 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:38.274 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.274 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.274 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.274 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:38.274 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:38.274 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:38.274 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.274 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.274 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:38.275 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:11:38.275 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:11:38.275 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.275 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.275 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:38.275 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:11:38.275 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:11:38.275 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.275 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.275 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.275 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:11:38.275 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:11:38.275 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.275 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.275 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.276 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:11:38.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:11:38.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.276 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.276 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.276 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:11:38.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:11:38.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.276 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.276 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.276 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:11:38.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:11:38.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.276 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.277 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:38.277 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:11:38.277 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:11:38.277 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.277 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:38.277 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.277 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.277 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.277 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:38.277 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:38.277 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 61.299891985000002, 2024-09-13T05:11:38.277 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:11:38.277 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:38.277 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:38.278 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:38.278 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:38.278 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.278 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:11:38.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.278 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:38.278 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.278 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:38.278 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:38.278 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.278 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.278 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:38.278 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:38.279 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.279 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.279 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.279 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:38.279 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:38.279 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:38.279 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.279 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.279 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:38.279 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:11:38.279 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:11:38.279 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.279 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.279 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:38.279 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:11:38.280 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:11:38.280 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.280 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.280 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.280 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:11:38.280 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:11:38.280 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.280 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.280 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.280 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:11:38.280 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:11:38.280 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.280 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.281 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.281 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:11:38.281 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:11:38.281 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.281 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.281 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.281 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:11:38.281 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:11:38.281 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.281 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.281 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:38.281 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:11:38.281 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:11:38.281 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.282 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:38.282 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.282 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.282 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.282 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:38.282 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:38.282 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 61.299856925, 2024-09-13T05:11:38.282 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:11:38.282 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:38.282 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:38.282 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:38.282 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:38.282 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.283 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:11:38.283 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.283 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:38.283 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.283 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:38.283 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:38.283 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.283 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.283 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.283 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:38.283 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:38.283 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.283 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.283 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.283 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:38.284 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:38.284 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:38.284 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.284 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.284 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:38.284 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:11:38.284 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:11:38.284 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.284 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.284 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:38.284 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:11:38.284 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:11:38.284 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.285 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.285 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:11:38.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:11:38.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.285 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.285 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:11:38.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:11:38.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.285 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.285 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:11:38.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:11:38.286 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.286 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.286 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.286 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:11:38.286 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:11:38.286 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.286 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.286 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:38.286 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:11:38.286 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:11:38.286 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.286 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:38.286 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.286 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.286 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.287 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:38.287 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:38.287 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 61.299840109999998, 2024-09-13T05:11:38.287 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:11:38.287 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:38.287 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:38.287 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:38.287 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:38.287 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.287 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:11:38.287 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.287 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:38.287 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.287 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:38.288 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:38.288 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.288 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.288 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.288 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:38.288 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:38.288 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:38.288 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.288 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.288 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:38.288 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:38.288 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:38.288 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.288 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.289 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:38.289 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:11:38.289 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:11:38.289 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.289 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.289 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:38.289 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:11:38.289 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:11:38.289 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.289 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.289 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.289 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:11:38.289 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:11:38.289 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.290 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.290 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.290 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:11:38.290 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:11:38.290 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.290 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.290 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.290 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:11:38.290 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:11:38.290 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.290 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.290 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:38.290 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:11:38.290 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:11:38.291 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:38.291 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:38.291 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:38.291 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:11:38.291 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:11:38.291 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.291 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:38.291 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.291 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:38.291 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:38.291 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:38.293 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:38.285+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:38.293 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:11:38.389 INFO:teuthology.orchestra.run.smithi120.stdout:4374 write 0xcd7d63b thru 0xcd84a4d (0x7413 bytes) 2024-09-13T05:11:38.393 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:38.389+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:38.400 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:38.401 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:38.401 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:38.401 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:38.406 INFO:teuthology.orchestra.run.smithi120.stdout:4376 read 0x4dc5d49 thru 0x4dcbb30 (0x5de8 bytes) 2024-09-13T05:11:38.406 INFO:teuthology.orchestra.run.smithi120.stdout:4378 write 0x18761f6 thru 0x187e84f (0x865a bytes) 2024-09-13T05:11:38.411 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:11:38.436 INFO:teuthology.orchestra.run.smithi120.stdout:4380 trunc from 0xdc6a925 to 0x143aee6 2024-09-13T05:11:38.466 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:38.482 INFO:teuthology.orchestra.run.smithi120.stdout:4383 write 0x3fae95a thru 0x3faff43 (0x15ea bytes) 2024-09-13T05:11:38.495 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:38.489+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:38.506 INFO:teuthology.orchestra.run.smithi120.stdout:4384 trunc from 0x3faff44 to 0xe852c78 2024-09-13T05:11:38.519 INFO:teuthology.orchestra.run.smithi120.stdout:4388 read 0xd13f570 thru 0xd14abb5 (0xb646 bytes) 2024-09-13T05:11:38.519 INFO:teuthology.orchestra.run.smithi120.stdout:4392 flatten 2024-09-13T05:11:38.527 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:38.527 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:38.527 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:38.527 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:38.527 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:38.538 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:11:38.560 INFO:teuthology.orchestra.run.smithi120.stdout:4393 trunc from 0xe852c78 to 0x1b77102 2024-09-13T05:11:38.596 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:38.589+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:38.603 INFO:teuthology.orchestra.run.smithi120.stdout:4394 write 0x82db300 thru 0x82e8c39 (0xd93a bytes) 2024-09-13T05:11:38.621 INFO:teuthology.orchestra.run.smithi120.stdout:4397 trunc from 0x82e8c3a to 0x3436697 2024-09-13T05:11:38.642 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:38.651 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:38.652 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:38.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:38.652 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:38.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.652 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14179 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1835008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:38.652 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:11:38.652 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.889470127999999, 2024-09-13T05:11:38.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0924508550000001, 2024-09-13T05:11:38.652 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:38.652 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:38.653 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:38.653 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:38.653 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.653 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14179 2024-09-13T05:11:38.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.653 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:38.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:38.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:11:38.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:38.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:11:38.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:38.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757551+0000", 2024-09-13T05:11:38.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:38.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:38.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757554+0000", 2024-09-13T05:11:38.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5440000000000001e-06 2024-09-13T05:11:38.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:38.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757560+0000", 2024-09-13T05:11:38.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6840000000000001e-06 2024-09-13T05:11:38.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757564+0000", 2024-09-13T05:11:38.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3529999999999997e-06 2024-09-13T05:11:38.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814931+0000", 2024-09-13T05:11:38.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057367564000000003 2024-09-13T05:11:38.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814938+0000", 2024-09-13T05:11:38.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1070000000000001e-06 2024-09-13T05:11:38.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.849802+0000", 2024-09-13T05:11:38.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348647849999999 2024-09-13T05:11:38.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:38.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.849885+0000", 2024-09-13T05:11:38.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2859000000000001e-05 2024-09-13T05:11:38.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:38.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850003+0000", 2024-09-13T05:11:38.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117279 2024-09-13T05:11:38.657 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.657 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:38.658 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.658 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14180 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1844224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:38.658 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:38.658 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.889453842999998, 2024-09-13T05:11:38.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.092637853, 2024-09-13T05:11:38.658 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:38.658 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:38.658 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:38.658 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:38.658 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.658 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14180 2024-09-13T05:11:38.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.659 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:38.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:38.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:38.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:38.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:38.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:38.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:38.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:38.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:38.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757570+0000", 2024-09-13T05:11:38.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3470000000000001e-06 2024-09-13T05:11:38.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:38.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757576+0000", 2024-09-13T05:11:38.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5550000000000002e-06 2024-09-13T05:11:38.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757580+0000", 2024-09-13T05:11:38.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6519999999999997e-06 2024-09-13T05:11:38.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814975+0000", 2024-09-13T05:11:38.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057394349999999997 2024-09-13T05:11:38.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814981+0000", 2024-09-13T05:11:38.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4119999999999998e-06 2024-09-13T05:11:38.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850042+0000", 2024-09-13T05:11:38.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0350611759999999 2024-09-13T05:11:38.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:38.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850103+0000", 2024-09-13T05:11:38.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0618000000000001e-05 2024-09-13T05:11:38.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:38.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850206+0000", 2024-09-13T05:11:38.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010309199999999999 2024-09-13T05:11:38.663 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.663 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:38.663 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.663 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14196 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1991680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:38.663 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:38.663 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.885654756999998, 2024-09-13T05:11:38.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0925442910000001, 2024-09-13T05:11:38.664 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:38.664 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:38.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:38.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:38.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.664 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14196 2024-09-13T05:11:38.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.664 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:38.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:38.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:38.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:38.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:38.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:38.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:38.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:38.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:38.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761368+0000", 2024-09-13T05:11:38.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3689999999999999e-06 2024-09-13T05:11:38.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:38.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761373+0000", 2024-09-13T05:11:38.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7180000000000004e-06 2024-09-13T05:11:38.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761376+0000", 2024-09-13T05:11:38.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0860000000000002e-06 2024-09-13T05:11:38.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815501+0000", 2024-09-13T05:11:38.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054125508000000003 2024-09-13T05:11:38.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815508+0000", 2024-09-13T05:11:38.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5570000000000001e-06 2024-09-13T05:11:38.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853689+0000", 2024-09-13T05:11:38.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0381811919999999 2024-09-13T05:11:38.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:38.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853764+0000", 2024-09-13T05:11:38.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4893000000000003e-05 2024-09-13T05:11:38.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:38.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853911+0000", 2024-09-13T05:11:38.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014721100000000001 2024-09-13T05:11:38.668 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.668 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:38.668 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.669 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14197 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2000896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:38.669 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:38.669 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.885643513000005, 2024-09-13T05:11:38.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.092841977, 2024-09-13T05:11:38.669 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:38.669 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:38.669 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:38.669 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:38.669 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.669 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14197 2024-09-13T05:11:38.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.669 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:38.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:38.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:38.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:38.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:38.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:38.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:38.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:38.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:38.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761403+0000", 2024-09-13T05:11:38.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5199e-05 2024-09-13T05:11:38.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:38.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761411+0000", 2024-09-13T05:11:38.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4540000000000001e-06 2024-09-13T05:11:38.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761418+0000", 2024-09-13T05:11:38.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9569999999999996e-06 2024-09-13T05:11:38.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815531+0000", 2024-09-13T05:11:38.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054113599999999998 2024-09-13T05:11:38.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815539+0000", 2024-09-13T05:11:38.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.481e-06 2024-09-13T05:11:38.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853949+0000", 2024-09-13T05:11:38.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.038410356 2024-09-13T05:11:38.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:38.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854022+0000", 2024-09-13T05:11:38.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2807999999999998e-05 2024-09-13T05:11:38.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:38.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854220+0000", 2024-09-13T05:11:38.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000198364 2024-09-13T05:11:38.673 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.674 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:38.674 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.674 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14198 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2010112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:38.674 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:38.674 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.885598505000004, 2024-09-13T05:11:38.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093063787, 2024-09-13T05:11:38.674 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:38.674 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:38.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:38.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:38.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.674 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14198 2024-09-13T05:11:38.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.675 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:38.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:38.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:38.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:38.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:38.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:38.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:38.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:38.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:38.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761426+0000", 2024-09-13T05:11:38.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8789999999999999e-06 2024-09-13T05:11:38.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:38.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761432+0000", 2024-09-13T05:11:38.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1399999999999997e-06 2024-09-13T05:11:38.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761437+0000", 2024-09-13T05:11:38.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8579999999999999e-06 2024-09-13T05:11:38.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815563+0000", 2024-09-13T05:11:38.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054125877000000003 2024-09-13T05:11:38.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815570+0000", 2024-09-13T05:11:38.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1169999999999998e-06 2024-09-13T05:11:38.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854265+0000", 2024-09-13T05:11:38.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0386955659999999 2024-09-13T05:11:38.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:38.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854338+0000", 2024-09-13T05:11:38.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2537e-05 2024-09-13T05:11:38.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:38.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854487+0000", 2024-09-13T05:11:38.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014927899999999999 2024-09-13T05:11:38.679 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.679 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:38.679 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.679 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14199 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:38.679 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:38.679 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.885579632000002, 2024-09-13T05:11:38.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0933252389999999, 2024-09-13T05:11:38.679 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:38.679 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:38.679 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:38.679 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:38.680 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.680 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14199 2024-09-13T05:11:38.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.680 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:38.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:38.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:38.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:38.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:38.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:38.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:38.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:38.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:38.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761445+0000", 2024-09-13T05:11:38.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7779999999999999e-06 2024-09-13T05:11:38.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:38.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761450+0000", 2024-09-13T05:11:38.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6350000000000003e-06 2024-09-13T05:11:38.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761455+0000", 2024-09-13T05:11:38.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9930000000000003e-06 2024-09-13T05:11:38.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815600+0000", 2024-09-13T05:11:38.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054144982000000001 2024-09-13T05:11:38.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815607+0000", 2024-09-13T05:11:38.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4749999999999998e-06 2024-09-13T05:11:38.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854527+0000", 2024-09-13T05:11:38.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.038920037 2024-09-13T05:11:38.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:38.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854637+0000", 2024-09-13T05:11:38.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011021700000000001 2024-09-13T05:11:38.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:38.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854767+0000", 2024-09-13T05:11:38.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130512 2024-09-13T05:11:38.684 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.684 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:38.684 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.684 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14200 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2028544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:38.684 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:11:38.684 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.885561119000002, 2024-09-13T05:11:38.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093541554, 2024-09-13T05:11:38.684 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:38.685 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:38.685 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:38.685 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:38.685 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.685 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14200 2024-09-13T05:11:38.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.685 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:38.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:38.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:11:38.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:38.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:11:38.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:38.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761460+0000", 2024-09-13T05:11:38.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:38.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:38.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761462+0000", 2024-09-13T05:11:38.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9659999999999999e-06 2024-09-13T05:11:38.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:38.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761466+0000", 2024-09-13T05:11:38.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6109999999999998e-06 2024-09-13T05:11:38.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761471+0000", 2024-09-13T05:11:38.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1019999999999996e-06 2024-09-13T05:11:38.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815631+0000", 2024-09-13T05:11:38.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054159680000000002 2024-09-13T05:11:38.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815637+0000", 2024-09-13T05:11:38.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-09-13T05:11:38.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854810+0000", 2024-09-13T05:11:38.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0391731930000001 2024-09-13T05:11:38.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:38.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854883+0000", 2024-09-13T05:11:38.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3109999999999996e-05 2024-09-13T05:11:38.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:38.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855002+0000", 2024-09-13T05:11:38.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011934600000000001 2024-09-13T05:11:38.689 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.689 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:38.689 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.689 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14201 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2037760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:38.689 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:38.690 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.885546688999995, 2024-09-13T05:11:38.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0937543320000001, 2024-09-13T05:11:38.690 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:38.690 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:38.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:38.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:38.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.690 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14201 2024-09-13T05:11:38.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.690 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:38.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:38.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:38.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:38.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:38.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:38.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:38.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:38.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:38.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761477+0000", 2024-09-13T05:11:38.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5620000000000002e-06 2024-09-13T05:11:38.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:38.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761483+0000", 2024-09-13T05:11:38.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7400000000000001e-06 2024-09-13T05:11:38.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761487+0000", 2024-09-13T05:11:38.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8130000000000002e-06 2024-09-13T05:11:38.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815697+0000", 2024-09-13T05:11:38.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054210253 2024-09-13T05:11:38.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815705+0000", 2024-09-13T05:11:38.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7049999999999999e-06 2024-09-13T05:11:38.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855036+0000", 2024-09-13T05:11:38.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.039330799 2024-09-13T05:11:38.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:38.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855110+0000", 2024-09-13T05:11:38.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4498000000000004e-05 2024-09-13T05:11:38.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:38.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855229+0000", 2024-09-13T05:11:38.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119282 2024-09-13T05:11:38.694 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.694 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:38.694 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.695 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14202 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:38.695 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:11:38.695 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.885482031999999, 2024-09-13T05:11:38.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093934027, 2024-09-13T05:11:38.695 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:38.695 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:38.695 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:38.695 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:38.695 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.695 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14202 2024-09-13T05:11:38.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.695 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:38.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:38.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:11:38.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:38.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:11:38.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:38.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761489+0000", 2024-09-13T05:11:38.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999495 2024-09-13T05:11:38.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:38.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761543+0000", 2024-09-13T05:11:38.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3983999999999997e-05 2024-09-13T05:11:38.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:38.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761552+0000", 2024-09-13T05:11:38.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-13T05:11:38.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761559+0000", 2024-09-13T05:11:38.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7710000000000001e-06 2024-09-13T05:11:38.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815742+0000", 2024-09-13T05:11:38.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054183488000000002 2024-09-13T05:11:38.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815749+0000", 2024-09-13T05:11:38.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1609999999999997e-06 2024-09-13T05:11:38.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855283+0000", 2024-09-13T05:11:38.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0395336230000001 2024-09-13T05:11:38.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:38.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855354+0000", 2024-09-13T05:11:38.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1456000000000002e-05 2024-09-13T05:11:38.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:38.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855474+0000", 2024-09-13T05:11:38.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119429 2024-09-13T05:11:38.699 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.699 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:38.700 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.700 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14294 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2113536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:38.700 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:11:38.700 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.881931117999997, 2024-09-13T05:11:38.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0923650330000001, 2024-09-13T05:11:38.700 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:38.700 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:38.700 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:38.700 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:38.700 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.700 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14294 2024-09-13T05:11:38.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.701 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:38.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:38.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:11:38.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:38.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:11:38.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:38.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765090+0000", 2024-09-13T05:11:38.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:38.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:38.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765092+0000", 2024-09-13T05:11:38.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.542e-06 2024-09-13T05:11:38.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:38.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765096+0000", 2024-09-13T05:11:38.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6179999999999999e-06 2024-09-13T05:11:38.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765098+0000", 2024-09-13T05:11:38.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8049999999999998e-06 2024-09-13T05:11:38.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816384+0000", 2024-09-13T05:11:38.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051285338999999999 2024-09-13T05:11:38.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816393+0000", 2024-09-13T05:11:38.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-09-13T05:11:38.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857258+0000", 2024-09-13T05:11:38.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0408652549999999 2024-09-13T05:11:38.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:38.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857327+0000", 2024-09-13T05:11:38.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8714000000000007e-05 2024-09-13T05:11:38.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:38.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857456+0000", 2024-09-13T05:11:38.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012909299999999999 2024-09-13T05:11:38.704 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.705 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:38.705 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.705 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14295 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2122752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:38.705 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:38.705 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.881921360000007, 2024-09-13T05:11:38.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0928006969999999, 2024-09-13T05:11:38.705 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:38.705 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:38.705 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:38.705 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:38.705 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.705 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14295 2024-09-13T05:11:38.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.706 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:38.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:38.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:38.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:38.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:38.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:38.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:38.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:38.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:38.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765102+0000", 2024-09-13T05:11:38.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3990000000000001e-06 2024-09-13T05:11:38.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:38.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765104+0000", 2024-09-13T05:11:38.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:11:38.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765107+0000", 2024-09-13T05:11:38.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.582e-06 2024-09-13T05:11:38.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816432+0000", 2024-09-13T05:11:38.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051325118000000003 2024-09-13T05:11:38.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816440+0000", 2024-09-13T05:11:38.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4679999999999992e-06 2024-09-13T05:11:38.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857495+0000", 2024-09-13T05:11:38.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.041054216 2024-09-13T05:11:38.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:38.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857644+0000", 2024-09-13T05:11:38.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014909400000000001 2024-09-13T05:11:38.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:38.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857901+0000", 2024-09-13T05:11:38.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025746200000000002 2024-09-13T05:11:38.710 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.710 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:38.710 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.710 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14296 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2131968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:38.710 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:11:38.710 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.881913114, 2024-09-13T05:11:38.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093120361, 2024-09-13T05:11:38.710 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:38.710 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:38.710 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:38.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:38.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.711 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14296 2024-09-13T05:11:38.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.711 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:38.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:38.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:11:38.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:38.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:11:38.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:38.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765108+0000", 2024-09-13T05:11:38.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:38.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:38.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765110+0000", 2024-09-13T05:11:38.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.226e-06 2024-09-13T05:11:38.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:38.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765112+0000", 2024-09-13T05:11:38.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6769999999999999e-06 2024-09-13T05:11:38.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765115+0000", 2024-09-13T05:11:38.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.712e-06 2024-09-13T05:11:38.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816479+0000", 2024-09-13T05:11:38.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051364102000000002 2024-09-13T05:11:38.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816503+0000", 2024-09-13T05:11:38.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3723999999999999e-05 2024-09-13T05:11:38.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857929+0000", 2024-09-13T05:11:38.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0414263180000001 2024-09-13T05:11:38.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:38.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858015+0000", 2024-09-13T05:11:38.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5730999999999996e-05 2024-09-13T05:11:38.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:38.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858229+0000", 2024-09-13T05:11:38.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021408700000000001 2024-09-13T05:11:38.715 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.715 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:38.715 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.716 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14297 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2141184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:38.716 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:38.716 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.881904769000002, 2024-09-13T05:11:38.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0936699510000001, 2024-09-13T05:11:38.716 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:38.716 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:38.716 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:38.716 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:38.716 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.716 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14297 2024-09-13T05:11:38.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.716 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:38.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:38.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:38.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:38.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:38.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:38.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:38.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:38.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:38.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765118+0000", 2024-09-13T05:11:38.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4190000000000001e-06 2024-09-13T05:11:38.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:38.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765121+0000", 2024-09-13T05:11:38.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6110000000000001e-06 2024-09-13T05:11:38.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765124+0000", 2024-09-13T05:11:38.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3720000000000001e-06 2024-09-13T05:11:38.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816535+0000", 2024-09-13T05:11:38.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051410890000000001 2024-09-13T05:11:38.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816556+0000", 2024-09-13T05:11:38.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0551e-05 2024-09-13T05:11:38.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858552+0000", 2024-09-13T05:11:38.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0419965529999999 2024-09-13T05:11:38.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:38.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858640+0000", 2024-09-13T05:11:38.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7907999999999999e-05 2024-09-13T05:11:38.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:38.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858787+0000", 2024-09-13T05:11:38.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000146864 2024-09-13T05:11:38.720 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.720 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:38.720 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.721 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14298 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2150400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:38.721 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:38.721 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.881895376000003, 2024-09-13T05:11:38.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0938958759999999, 2024-09-13T05:11:38.721 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:38.721 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:38.722 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:38.722 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:38.722 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.722 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14298 2024-09-13T05:11:38.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.722 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:38.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:38.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:38.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:38.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:38.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:38.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:38.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:38.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:38.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765128+0000", 2024-09-13T05:11:38.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4139999999999999e-06 2024-09-13T05:11:38.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:38.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765130+0000", 2024-09-13T05:11:38.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6809999999999998e-06 2024-09-13T05:11:38.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765133+0000", 2024-09-13T05:11:38.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9270000000000001e-06 2024-09-13T05:11:38.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816592+0000", 2024-09-13T05:11:38.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051459029000000003 2024-09-13T05:11:38.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816601+0000", 2024-09-13T05:11:38.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9819999999999997e-06 2024-09-13T05:11:38.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858818+0000", 2024-09-13T05:11:38.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0422167170000001 2024-09-13T05:11:38.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:38.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858896+0000", 2024-09-13T05:11:38.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8128999999999997e-05 2024-09-13T05:11:38.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:38.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859022+0000", 2024-09-13T05:11:38.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012619899999999999 2024-09-13T05:11:38.726 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.726 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:38.726 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.726 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14299 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2168832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:38.726 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:38.726 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.881886612000002, 2024-09-13T05:11:38.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0941207909999999, 2024-09-13T05:11:38.727 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:38.727 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:38.727 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:38.727 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:38.727 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.727 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14299 2024-09-13T05:11:38.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.727 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:38.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:38.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:38.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:38.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:38.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:38.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:38.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:38.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:38.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765136+0000", 2024-09-13T05:11:38.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5230000000000001e-06 2024-09-13T05:11:38.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:38.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765139+0000", 2024-09-13T05:11:38.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.672e-06 2024-09-13T05:11:38.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765142+0000", 2024-09-13T05:11:38.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6680000000000001e-06 2024-09-13T05:11:38.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816632+0000", 2024-09-13T05:11:38.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051489886999999998 2024-09-13T05:11:38.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816643+0000", 2024-09-13T05:11:38.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1457000000000001e-05 2024-09-13T05:11:38.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859061+0000", 2024-09-13T05:11:38.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.042417616 2024-09-13T05:11:38.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:38.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859138+0000", 2024-09-13T05:11:38.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7077999999999996e-05 2024-09-13T05:11:38.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:38.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859256+0000", 2024-09-13T05:11:38.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118108 2024-09-13T05:11:38.731 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.731 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:38.731 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.731 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14300 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2159616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:38.732 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:38.732 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.881877802000005, 2024-09-13T05:11:38.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0943386719999999, 2024-09-13T05:11:38.732 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:38.732 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:38.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:38.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:38.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.732 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14300 2024-09-13T05:11:38.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.732 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:38.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:38.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:38.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:38.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:38.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:38.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:38.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:38.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:38.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765145+0000", 2024-09-13T05:11:38.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.488e-06 2024-09-13T05:11:38.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:38.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765148+0000", 2024-09-13T05:11:38.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6620000000000001e-06 2024-09-13T05:11:38.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765151+0000", 2024-09-13T05:11:38.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6419999999999999e-06 2024-09-13T05:11:38.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816677+0000", 2024-09-13T05:11:38.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051526776000000003 2024-09-13T05:11:38.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816689+0000", 2024-09-13T05:11:38.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1634000000000001e-05 2024-09-13T05:11:38.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859296+0000", 2024-09-13T05:11:38.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0426066009999999 2024-09-13T05:11:38.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:38.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859364+0000", 2024-09-13T05:11:38.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8745999999999995e-05 2024-09-13T05:11:38.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:38.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859483+0000", 2024-09-13T05:11:38.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011833900000000001 2024-09-13T05:11:38.737 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.737 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:38.737 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.738 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14301 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2178048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:38.738 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:11:38.738 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.881869167999994, 2024-09-13T05:11:38.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0946233009999999, 2024-09-13T05:11:38.738 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:38.738 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:38.738 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:38.738 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:38.738 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.738 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14301 2024-09-13T05:11:38.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.738 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:38.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:38.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:11:38.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:38.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:11:38.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:38.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765152+0000", 2024-09-13T05:11:38.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:38.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:38.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765154+0000", 2024-09-13T05:11:38.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.449e-06 2024-09-13T05:11:38.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:38.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765157+0000", 2024-09-13T05:11:38.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6809999999999998e-06 2024-09-13T05:11:38.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765159+0000", 2024-09-13T05:11:38.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6060000000000001e-06 2024-09-13T05:11:38.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816722+0000", 2024-09-13T05:11:38.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051562535 2024-09-13T05:11:38.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816733+0000", 2024-09-13T05:11:38.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1678000000000001e-05 2024-09-13T05:11:38.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859521+0000", 2024-09-13T05:11:38.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0427879440000001 2024-09-13T05:11:38.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:38.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859655+0000", 2024-09-13T05:11:38.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134053 2024-09-13T05:11:38.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:38.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859776+0000", 2024-09-13T05:11:38.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012058299999999999 2024-09-13T05:11:38.743 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.743 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:38.743 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.743 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14302 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2187264~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:38.743 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:38.743 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.881860591000006, 2024-09-13T05:11:38.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.094937383, 2024-09-13T05:11:38.743 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:38.743 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:38.743 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:38.743 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:38.743 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.744 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14302 2024-09-13T05:11:38.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.744 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:38.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:38.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:38.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:38.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:38.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:38.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:38.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:38.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:38.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765162+0000", 2024-09-13T05:11:38.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4589999999999999e-06 2024-09-13T05:11:38.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:38.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765165+0000", 2024-09-13T05:11:38.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6019999999999998e-06 2024-09-13T05:11:38.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765168+0000", 2024-09-13T05:11:38.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.497e-06 2024-09-13T05:11:38.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816764+0000", 2024-09-13T05:11:38.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051596722999999997 2024-09-13T05:11:38.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816776+0000", 2024-09-13T05:11:38.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1967000000000001e-05 2024-09-13T05:11:38.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859810+0000", 2024-09-13T05:11:38.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0430338299999999 2024-09-13T05:11:38.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:38.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859901+0000", 2024-09-13T05:11:38.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1397999999999995e-05 2024-09-13T05:11:38.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:38.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860099+0000", 2024-09-13T05:11:38.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000197133 2024-09-13T05:11:38.748 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.748 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:38.748 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.749 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14303 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2196480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:38.749 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:11:38.749 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.881852253999995, 2024-09-13T05:11:38.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.095199152, 2024-09-13T05:11:38.749 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:38.749 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:38.749 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:38.749 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:38.749 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.749 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14303 2024-09-13T05:11:38.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.749 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:38.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:38.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:11:38.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:38.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:11:38.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:38.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765169+0000", 2024-09-13T05:11:38.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:38.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:38.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765171+0000", 2024-09-13T05:11:38.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2899999999999999e-06 2024-09-13T05:11:38.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:38.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765173+0000", 2024-09-13T05:11:38.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-13T05:11:38.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765176+0000", 2024-09-13T05:11:38.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.016e-06 2024-09-13T05:11:38.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816811+0000", 2024-09-13T05:11:38.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051634684 2024-09-13T05:11:38.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816840+0000", 2024-09-13T05:11:38.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8690000000000001e-05 2024-09-13T05:11:38.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860135+0000", 2024-09-13T05:11:38.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0432951029999999 2024-09-13T05:11:38.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:38.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860255+0000", 2024-09-13T05:11:38.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119936 2024-09-13T05:11:38.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:38.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860369+0000", 2024-09-13T05:11:38.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113978 2024-09-13T05:11:38.754 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.754 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:38.754 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.754 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14304 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2205696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:38.754 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:38.755 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.881829386000007, 2024-09-13T05:11:38.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0955512999999999, 2024-09-13T05:11:38.755 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:38.755 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:38.756 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:38.756 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:38.756 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:38.756 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14304 2024-09-13T05:11:38.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.756 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:38.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:38.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:38.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:38.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:38.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:38.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:38.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:38.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:38.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:38.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765195+0000", 2024-09-13T05:11:38.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6599999999999999e-06 2024-09-13T05:11:38.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:38.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765200+0000", 2024-09-13T05:11:38.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.356e-06 2024-09-13T05:11:38.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:38.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765205+0000", 2024-09-13T05:11:38.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3000000000000001e-06 2024-09-13T05:11:38.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816901+0000", 2024-09-13T05:11:38.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051695451000000003 2024-09-13T05:11:38.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:38.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816963+0000", 2024-09-13T05:11:38.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2694000000000007e-05 2024-09-13T05:11:38.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:38.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860434+0000", 2024-09-13T05:11:38.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.04347053 2024-09-13T05:11:38.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:38.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860592+0000", 2024-09-13T05:11:38.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015854199999999999 2024-09-13T05:11:38.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:38.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:38.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:38.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860744+0000", 2024-09-13T05:11:38.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015133 2024-09-13T05:11:38.761 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.761 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:38.761 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.761 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:38.761 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:38.761 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:38.762 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T05:11:38.763 INFO:teuthology.orchestra.run.smithi120.stdout:4399 trunc from 0x3436697 to 0xc4c9adc 2024-09-13T05:11:38.764 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:38.757+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:38.765 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:11:38.766 INFO:teuthology.orchestra.run.smithi120.stdout:4400 read 0x97616d3 thru 0x9762351 (0xc7f bytes) 2024-09-13T05:11:38.767 INFO:teuthology.orchestra.run.smithi120.stdout:4402 write 0xe7743fa thru 0xe77e4f8 (0xa0ff bytes) 2024-09-13T05:11:38.767 INFO:teuthology.orchestra.run.smithi120.stdout:4403 clone 35 order 25 su 4194304 sc 12 2024-09-13T05:11:38.863 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:38.860+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:38.915 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:38.915 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:38.915 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:38.916 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:38.926 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:11:38.965 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:38.961+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:38.966 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:11:39.033 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:39.033 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:39.033 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:39.033 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:39.033 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:39.039 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #33, image image_client.0-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent34 2024-09-13T05:11:39.040 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:11:39.055 INFO:teuthology.orchestra.run.smithi120.stdout:4404 punch from 0x10b88ec to 0x10c0ee2, (0x85f6 bytes) 2024-09-13T05:11:39.061 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:39.061 INFO:teuthology.orchestra.run.smithi120.stdout:4406 write 0x4f1ff12 thru 0x4f27dd0 (0x7ebf bytes) 2024-09-13T05:11:39.065 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:39.064+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:39.068 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:39.068 INFO:teuthology.orchestra.run.smithi120.stdout:4409 write 0x4de2064 thru 0x4ded189 (0xb126 bytes) 2024-09-13T05:11:39.073 INFO:teuthology.orchestra.run.smithi120.stdout:4410 trunc from 0xe77e4f9 to 0xcd039b3 2024-09-13T05:11:39.098 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:39.099 INFO:teuthology.orchestra.run.smithi120.stdout:4413 read 0xacbff7c thru 0xacc07eb (0x870 bytes) 2024-09-13T05:11:39.099 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:39.108 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:11:39.108 INFO:teuthology.orchestra.run.smithi120.stdout:4419 trunc from 0xcd039b3 to 0x7228abb 2024-09-13T05:11:39.129 INFO:teuthology.orchestra.run.smithi120.stdout:4420 write 0x1ac4763 thru 0x1ad1954 (0xd1f2 bytes) 2024-09-13T05:11:39.132 INFO:teuthology.orchestra.run.smithi120.stdout:4421 write 0x4de774e thru 0x4df622e (0xeae1 bytes) 2024-09-13T05:11:39.134 INFO:teuthology.orchestra.run.smithi120.stdout:4422 write 0x4050f24 thru 0x405e70f (0xd7ec bytes) 2024-09-13T05:11:39.135 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:11:39.139 INFO:teuthology.orchestra.run.smithi120.stdout:4423 trunc from 0x7228abb to 0x89812e6 2024-09-13T05:11:39.148 INFO:teuthology.orchestra.run.smithi120.stdout:4425 punch from 0x6fe5512 to 0x6fe6dae, (0x189c bytes) 2024-09-13T05:11:39.148 INFO:teuthology.orchestra.run.smithi120.stdout:4426 read 0x69753e9 thru 0x6984da8 (0xf9c0 bytes) 2024-09-13T05:11:39.149 INFO:teuthology.orchestra.run.smithi120.stdout:4427 write 0x3f5c69b thru 0x3f5fbd6 (0x353c bytes) 2024-09-13T05:11:39.151 INFO:teuthology.orchestra.run.smithi120.stdout:4428 write 0x6e3a331 thru 0x6e3fa02 (0x56d2 bytes) 2024-09-13T05:11:39.154 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:11:39.166 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:39.164+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:39.170 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:39.170 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:39.172 INFO:teuthology.orchestra.run.smithi120.stdout:4429 writesame 0xd764b52 thru 0xd76d75a data_size 0x1(0x8c09 bytes) 2024-09-13T05:11:39.174 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:11:39.175 INFO:teuthology.orchestra.run.smithi120.stdout:4430 write 0x34738b8 thru 0x3476f23 (0x366c bytes) 2024-09-13T05:11:39.178 INFO:teuthology.orchestra.run.smithi120.stdout:4432 read 0x22ce848 thru 0x22d1d61 (0x351a bytes) 2024-09-13T05:11:39.181 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:11:39.195 INFO:teuthology.orchestra.run.smithi120.stdout:4433 trunc from 0xd76d75b to 0x3c2ee96 2024-09-13T05:11:39.197 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:11:39.210 INFO:teuthology.orchestra.run.smithi120.stdout:4434 punch from 0x2dabe62 to 0x2db5d44, (0x9ee2 bytes) 2024-09-13T05:11:39.223 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:11:39.226 INFO:teuthology.orchestra.run.smithi120.stdout:4435 write 0x8655b2f thru 0x86632f2 (0xd7c4 bytes) 2024-09-13T05:11:39.228 INFO:teuthology.orchestra.run.smithi120.stdout:4436 read 0xe74771 thru 0xe77620 (0x2eb0 bytes) 2024-09-13T05:11:39.229 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:39.229 INFO:teuthology.orchestra.run.smithi120.stdout:4439 read 0x10d654c thru 0x10e276a (0xc21f bytes) 2024-09-13T05:11:39.230 INFO:teuthology.orchestra.run.smithi120.stdout:4440 write 0x5b1804f thru 0x5b1be22 (0x3dd4 bytes) 2024-09-13T05:11:39.243 INFO:teuthology.orchestra.run.smithi120.stdout:4441 write 0x92164bb thru 0x922142c (0xaf72 bytes) 2024-09-13T05:11:39.246 INFO:teuthology.orchestra.run.smithi120.stdout:4442 read 0x4830299 thru 0x4837b71 (0x78d9 bytes) 2024-09-13T05:11:39.247 INFO:teuthology.orchestra.run.smithi120.stdout:4443 punch from 0x2781429 to 0x27913d4, (0xffab bytes) 2024-09-13T05:11:39.247 INFO:teuthology.orchestra.run.smithi120.stdout:4444 writesame 0xd63f15 thru 0xd70b38 data_size 0x3c(0xcc24 bytes) 2024-09-13T05:11:39.250 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:39.251 INFO:teuthology.orchestra.run.smithi120.stdout:4446 read 0x160b396 thru 0x16112af (0x5f1a bytes) 2024-09-13T05:11:39.251 INFO:teuthology.orchestra.run.smithi120.stdout:4447 read 0x3fe0082 thru 0x3fe3b17 (0x3a96 bytes) 2024-09-13T05:11:39.252 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:39.252 INFO:teuthology.orchestra.run.smithi120.stdout:4449 write 0x2b8f001 thru 0x2b903d4 (0x13d4 bytes) 2024-09-13T05:11:39.259 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:11:39.267 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:39.264+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:39.270 INFO:teuthology.orchestra.run.smithi120.stdout:4450 writesame 0xb1dac01 thru 0xb1e8989 data_size 0x1(0xdd89 bytes) 2024-09-13T05:11:39.273 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:39.285 INFO:teuthology.orchestra.run.smithi120.stdout:4452 trunc from 0xb1e898a to 0x3f0732d 2024-09-13T05:11:39.294 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:11:39.297 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:11:39.297 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:11:39.297 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:11:39.297 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:11:39.297 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:11:39.297 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:11:39.297 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:11:39.298 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:11:39.298 INFO:teuthology.orchestra.run.smithi120.stdout:4453 write 0x19d25e thru 0x1a71c8 (0x9f6b bytes) 2024-09-13T05:11:39.301 INFO:teuthology.orchestra.run.smithi120.stdout:4454 write 0x31a6b47 thru 0x31a7716 (0xbd0 bytes) 2024-09-13T05:11:39.302 INFO:teuthology.orchestra.run.smithi120.stdout:4456 read 0x37b59ff thru 0x37b60e9 (0x6eb bytes) 2024-09-13T05:11:39.303 INFO:teuthology.orchestra.run.smithi120.stdout:4459 read 0x1974b61 thru 0x19761d5 (0x1675 bytes) 2024-09-13T05:11:39.303 INFO:teuthology.orchestra.run.smithi120.stdout:4460 read 0x3e67d5b thru 0x3e6baaa (0x3d50 bytes) 2024-09-13T05:11:39.324 INFO:teuthology.orchestra.run.smithi120.stdout:4461 write 0xb37e13c thru 0xb3835e4 (0x54a9 bytes) 2024-09-13T05:11:39.326 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:39.326 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:39.327 INFO:teuthology.orchestra.run.smithi120.stdout:4463 write 0x57668bd thru 0x576fbc9 (0x930d bytes) 2024-09-13T05:11:39.331 INFO:teuthology.orchestra.run.smithi120.stdout:4464 writesame 0x2816853 thru 0x281db61 data_size 0x5(0x730f bytes) 2024-09-13T05:11:39.336 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:11:39.340 INFO:teuthology.orchestra.run.smithi120.stdout:4466 writesame 0x56a03c8 thru 0x56a1e8a data_size 0x11(0x1ac3 bytes) 2024-09-13T05:11:39.342 INFO:teuthology.orchestra.run.smithi120.stdout:4467 read 0x5488702 thru 0x548ddfb (0x56fa bytes) 2024-09-13T05:11:39.343 INFO:teuthology.orchestra.run.smithi120.stdout:4468 read 0x88e36ec thru 0x88e6a4c (0x3361 bytes) 2024-09-13T05:11:39.360 INFO:teuthology.orchestra.run.smithi120.stdout:4469 trunc from 0xb3835e5 to 0x23bef92 2024-09-13T05:11:39.369 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:39.368+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:39.407 INFO:teuthology.orchestra.run.smithi120.stdout:4470 writesame 0x75a1459 thru 0x75a36ac data_size 0xd(0x2254 bytes) 2024-09-13T05:11:39.409 INFO:teuthology.orchestra.run.smithi120.stdout:4471 punch from 0x3a5461e to 0x3a594ac, (0x4e8e bytes) 2024-09-13T05:11:39.415 INFO:teuthology.orchestra.run.smithi120.stdout:4472 trunc from 0x75a36ad to 0x4275260 2024-09-13T05:11:39.430 INFO:teuthology.orchestra.run.smithi120.stdout:4473 punch from 0xd3231c to 0xd3a0c7, (0x7dab bytes) 2024-09-13T05:11:39.430 INFO:teuthology.orchestra.run.smithi120.stdout:4475 punch from 0x100dcd2 to 0x1014cf4, (0x7022 bytes) 2024-09-13T05:11:39.445 INFO:teuthology.orchestra.run.smithi120.stdout:4476 writesame 0x56b12b5 thru 0x56b8807 data_size 0x1(0x7553 bytes) 2024-09-13T05:11:39.445 INFO:teuthology.orchestra.run.smithi120.stdout:4477 write 0x37cd58 thru 0x388589 (0xb832 bytes) 2024-09-13T05:11:39.446 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:39.447 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:39.457 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:11:39.458 INFO:teuthology.orchestra.run.smithi120.stdout:4478 write 0x609be34 thru 0x60a602f (0xa1fc bytes) 2024-09-13T05:11:39.460 INFO:teuthology.orchestra.run.smithi120.stdout:4480 read 0x33af270 thru 0x33be181 (0xef12 bytes) 2024-09-13T05:11:39.470 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:39.465+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:39.484 INFO:teuthology.orchestra.run.smithi120.stdout:4481 write 0xdc8dea2 thru 0xdc93e88 (0x5fe7 bytes) 2024-09-13T05:11:39.487 INFO:teuthology.orchestra.run.smithi120.stdout:4482 read 0xc616991 thru 0xc626174 (0xf7e4 bytes) 2024-09-13T05:11:39.488 INFO:teuthology.orchestra.run.smithi120.stdout:4484 read 0x4618e35 thru 0x461fb8b (0x6d57 bytes) 2024-09-13T05:11:39.489 INFO:teuthology.orchestra.run.smithi120.stdout:4486 punch from 0x54291db to 0x543254d, (0x9372 bytes) 2024-09-13T05:11:39.489 INFO:teuthology.orchestra.run.smithi120.stdout:4488 punch from 0x1fe325e to 0x1fed7a1, (0xa543 bytes) 2024-09-13T05:11:39.499 INFO:teuthology.orchestra.run.smithi120.stdout:4490 write 0xdc9b7d3 thru 0xdca9639 (0xde67 bytes) 2024-09-13T05:11:39.502 INFO:teuthology.orchestra.run.smithi120.stdout:4491 writesame 0x3f132e2 thru 0x3f1888f data_size 0xb(0x55ae bytes) 2024-09-13T05:11:39.507 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:39.507 INFO:teuthology.orchestra.run.smithi120.stdout:4493 punch from 0x82d954d to 0x82dd8a7, (0x435a bytes) 2024-09-13T05:11:39.507 INFO:teuthology.orchestra.run.smithi120.stdout:4495 punch from 0xe7c725 to 0xe83638, (0x6f13 bytes) 2024-09-13T05:11:39.507 INFO:teuthology.orchestra.run.smithi120.stdout:4496 write 0x8f184b0 thru 0x8f1fc6f (0x77c0 bytes) 2024-09-13T05:11:39.514 INFO:teuthology.orchestra.run.smithi120.stdout:4497 write 0x8a72f2 thru 0x8ab255 (0x3f64 bytes) 2024-09-13T05:11:39.518 INFO:teuthology.orchestra.run.smithi120.stdout:4498 read 0xd66e1c2 thru 0xd6788e1 (0xa720 bytes) 2024-09-13T05:11:39.519 INFO:teuthology.orchestra.run.smithi120.stdout:4499 read 0x4b4a3e1 thru 0x4b4bc69 (0x1889 bytes) 2024-09-13T05:11:39.519 INFO:teuthology.orchestra.run.smithi120.stdout:4500 write 0xb51ec91 thru 0xb520e63 (0x21d3 bytes) 2024-09-13T05:11:39.525 INFO:teuthology.orchestra.run.smithi120.stdout:4501 read 0x5ef7334 thru 0x5efd643 (0x6310 bytes) 2024-09-13T05:11:39.526 INFO:teuthology.orchestra.run.smithi120.stdout:4502 punch from 0x7faec50 to 0x7fba1d5, (0xb585 bytes) 2024-09-13T05:11:39.539 INFO:teuthology.orchestra.run.smithi120.stdout:4503 trunc from 0xdca963a to 0x7d3dce8 2024-09-13T05:11:39.552 INFO:teuthology.orchestra.run.smithi120.stdout:4504 write 0x63f8de1 thru 0x63fd933 (0x4b53 bytes) 2024-09-13T05:11:39.571 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:39.568+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:39.573 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:39.573 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:39.586 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:11:39.591 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:39.598 INFO:teuthology.orchestra.run.smithi120.stdout:4506 trunc from 0x7d3dce8 to 0x422278c 2024-09-13T05:11:39.621 INFO:teuthology.orchestra.run.smithi120.stdout:4507 trunc from 0x422278c to 0x86a9eba 2024-09-13T05:11:39.631 INFO:teuthology.orchestra.run.smithi120.stdout:4508 write 0x6455d2b thru 0x645e3b4 (0x868a bytes) 2024-09-13T05:11:39.639 INFO:teuthology.orchestra.run.smithi120.stdout:4510 trunc from 0x86a9eba to 0x4c31f83 2024-09-13T05:11:39.665 INFO:teuthology.orchestra.run.smithi120.stdout:4511 write 0x5c42e86 thru 0x5c50da9 (0xdf24 bytes) 2024-09-13T05:11:39.668 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:39.672 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:39.665+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:39.674 INFO:teuthology.orchestra.run.smithi120.stdout:4513 trunc from 0x5c50daa to 0x941a676 2024-09-13T05:11:39.683 INFO:teuthology.orchestra.run.smithi120.stdout:4514 read 0x313f4e thru 0x322763 (0xe816 bytes) 2024-09-13T05:11:39.699 INFO:teuthology.orchestra.run.smithi120.stdout:4515 trunc from 0x941a676 to 0x5271c9 2024-09-13T05:11:39.706 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:39.706 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:39.717 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:11:39.744 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is unset 2024-09-13T05:11:39.751 INFO:teuthology.orchestra.run.smithi120.stdout:4517 read 0x3984b2 thru 0x3a1738 (0x9287 bytes) 2024-09-13T05:11:39.751 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:39.751 INFO:teuthology.orchestra.run.smithi120.stdout:4519 read 0x1fa64a thru 0x1fec3a (0x45f1 bytes) 2024-09-13T05:11:39.752 INFO:teuthology.orchestra.run.smithi120.stdout:4521 read 0x10bed1 thru 0x110d1c (0x4e4c bytes) 2024-09-13T05:11:39.785 INFO:teuthology.orchestra.run.smithi120.stdout:4522 write 0xd1c32bd thru 0xd1c9921 (0x6665 bytes) 2024-09-13T05:11:39.786 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:39.784+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:39.810 INFO:teuthology.orchestra.run.smithi120.stdout:4525 trunc from 0xd1c9922 to 0x3da702d 2024-09-13T05:11:39.826 INFO:teuthology.orchestra.run.smithi120.stdout:4526 read 0x1c38293 thru 0x1c4473a (0xc4a8 bytes) 2024-09-13T05:11:39.827 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:39.827 INFO:teuthology.orchestra.run.smithi120.stdout:4529 writesame 0xd4db19 thru 0xd51b86 data_size 0x3(0x406e bytes) 2024-09-13T05:11:39.848 INFO:teuthology.orchestra.run.smithi120.stdout:4530 trunc from 0x3da702d to 0x9e1e01b 2024-09-13T05:11:39.857 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:39.858 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:39.865 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:11:39.870 INFO:teuthology.orchestra.run.smithi120.stdout:4532 write 0xb0044e6 thru 0xb0075ef (0x310a bytes) 2024-09-13T05:11:39.873 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:39.869+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:39.877 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:39.877 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:39.891 INFO:teuthology.orchestra.run.smithi120.stdout:4535 writesame 0xd3f72c7 thru 0xd404058 data_size 0xe(0xcd92 bytes) 2024-09-13T05:11:39.893 INFO:teuthology.orchestra.run.smithi120.stdout:4536 write 0x7a147d5 thru 0x7a179a1 (0x31cd bytes) 2024-09-13T05:11:39.900 INFO:teuthology.orchestra.run.smithi120.stdout:4540 read 0xcae1dce thru 0xcaecf15 (0xb148 bytes) 2024-09-13T05:11:39.900 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:39.913 INFO:teuthology.orchestra.run.smithi120.stdout:4544 writesame 0xe7f7a6c thru 0xe7f8664 data_size 0x1(0xbf9 bytes) 2024-09-13T05:11:39.914 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:39.914 INFO:teuthology.orchestra.run.smithi120.stdout:4546 write 0x16705a9 thru 0x167c2f2 (0xbd4a bytes) 2024-09-13T05:11:39.922 INFO:teuthology.orchestra.run.smithi120.stdout:4548 punch from 0xa0489b4 to 0xa04f49c, (0x6ae8 bytes) 2024-09-13T05:11:39.922 INFO:teuthology.orchestra.run.smithi120.stdout:4549 writesame 0xc87553f thru 0xc87fbdd data_size 0x13(0xa69f bytes) 2024-09-13T05:11:39.956 INFO:teuthology.orchestra.run.smithi120.stdout:4550 trunc from 0xe7f8665 to 0x210659 2024-09-13T05:11:39.974 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:39.969+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:39.983 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:39.983 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:39.994 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:11:40.011 INFO:teuthology.orchestra.run.smithi120.stdout:4551 trunc from 0x210659 to 0xc8ce604 2024-09-13T05:11:40.021 INFO:teuthology.orchestra.run.smithi120.stdout:4554 punch from 0x2c8956a to 0x2c949cb, (0xb461 bytes) 2024-09-13T05:11:40.021 INFO:teuthology.orchestra.run.smithi120.stdout:4555 write 0x39f84c1 thru 0x3a082a8 (0xfde8 bytes) 2024-09-13T05:11:40.028 INFO:teuthology.orchestra.run.smithi120.stdout:4556 write 0x6f6d9f9 thru 0x6f7ab44 (0xd14c bytes) 2024-09-13T05:11:40.035 INFO:teuthology.orchestra.run.smithi120.stdout:4558 punch from 0x18737cd to 0x1879e7b, (0x66ae bytes) 2024-09-13T05:11:40.035 INFO:teuthology.orchestra.run.smithi120.stdout:4559 read 0x1179008 thru 0x1188a7d (0xfa76 bytes) 2024-09-13T05:11:40.036 INFO:teuthology.orchestra.run.smithi120.stdout:4561 write 0x231a3cd thru 0x2328d63 (0xe997 bytes) 2024-09-13T05:11:40.042 INFO:teuthology.orchestra.run.smithi120.stdout:4562 write 0x6268e56 thru 0x6276fe5 (0xe190 bytes) 2024-09-13T05:11:40.046 INFO:teuthology.orchestra.run.smithi120.stdout:4563 writesame 0xa634fba thru 0xa63efa8 data_size 0x1(0x9fef bytes) 2024-09-13T05:11:40.075 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:40.072+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:40.105 INFO:teuthology.orchestra.run.smithi120.stdout:4564 trunc from 0xc8ce604 to 0x2af0408 2024-09-13T05:11:40.110 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:40.110 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:40.120 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:11:40.138 INFO:teuthology.orchestra.run.smithi120.stdout:4565 trunc from 0x2af0408 to 0xd497a92 2024-09-13T05:11:40.148 INFO:teuthology.orchestra.run.smithi120.stdout:4566 punch from 0x83e707c to 0x83e7b8b, (0xb0f bytes) 2024-09-13T05:11:40.148 INFO:teuthology.orchestra.run.smithi120.stdout:4567 punch from 0xc9b0b7 to 0xc9fafb, (0x4a44 bytes) 2024-09-13T05:11:40.171 INFO:teuthology.orchestra.run.smithi120.stdout:4568 trunc from 0xd497a92 to 0x86be68 2024-09-13T05:11:40.176 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:40.172+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:40.202 INFO:teuthology.orchestra.run.smithi120.stdout:4570 read 0x1acc19 thru 0x1bbebb (0xf2a3 bytes) 2024-09-13T05:11:40.203 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:40.203 INFO:teuthology.orchestra.run.smithi120.stdout:4572 punch from 0x6aaec7 to 0x6ab9e5, (0xb1e bytes) 2024-09-13T05:11:40.203 INFO:teuthology.orchestra.run.smithi120.stdout:4573 read 0x763f59 thru 0x772acb (0xeb73 bytes) 2024-09-13T05:11:40.218 INFO:teuthology.orchestra.run.smithi120.stdout:4574 write 0x22060e9 thru 0x220ce32 (0x6d4a bytes) 2024-09-13T05:11:40.223 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:40.224 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:40.238 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:11:40.258 INFO:teuthology.orchestra.run.smithi120.stdout:4575 write 0xe78baeb thru 0xe78e486 (0x299c bytes) 2024-09-13T05:11:40.265 INFO:teuthology.orchestra.run.smithi120.stdout:4576 write 0xd961c5b thru 0xd9690b2 (0x7458 bytes) 2024-09-13T05:11:40.271 INFO:teuthology.orchestra.run.smithi120.stdout:4578 read 0x2326d31 thru 0x232c020 (0x52f0 bytes) 2024-09-13T05:11:40.276 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:40.269+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:40.299 INFO:teuthology.orchestra.run.smithi120.stdout:4580 trunc from 0xe78e487 to 0x1caa0be 2024-09-13T05:11:40.320 INFO:teuthology.orchestra.run.smithi120.stdout:4581 punch from 0x1077662 to 0x1082abb, (0xb459 bytes) 2024-09-13T05:11:40.343 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:40.344 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:40.346 INFO:teuthology.orchestra.run.smithi120.stdout:4582 writesame 0x9b89063 thru 0x9b8b00e data_size 0x2(0x1fac bytes) 2024-09-13T05:11:40.354 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:11:40.363 INFO:teuthology.orchestra.run.smithi120.stdout:4583 writesame 0xa9e2402 thru 0xa9e57b6 data_size 0x1f(0x33b5 bytes) 2024-09-13T05:11:40.366 INFO:teuthology.orchestra.run.smithi120.stdout:4584 write 0xa15fb7a thru 0xa16758b (0x7a12 bytes) 2024-09-13T05:11:40.373 INFO:teuthology.orchestra.run.smithi120.stdout:4585 write 0x8c36ef2 thru 0x8c45a17 (0xeb26 bytes) 2024-09-13T05:11:40.377 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:40.376+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:40.379 INFO:teuthology.orchestra.run.smithi120.stdout:4586 write 0x123ae5b thru 0x123eda2 (0x3f48 bytes) 2024-09-13T05:11:40.381 INFO:teuthology.orchestra.run.smithi120.stdout:4587 read 0x2c54deb thru 0x2c5660c (0x1822 bytes) 2024-09-13T05:11:40.382 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:40.389 INFO:teuthology.orchestra.run.smithi120.stdout:4590 trunc from 0xa9e57b7 to 0x7c510a2 2024-09-13T05:11:40.405 INFO:teuthology.orchestra.run.smithi120.stdout:4592 punch from 0x69ea336 to 0x69f8c06, (0xe8d0 bytes) 2024-09-13T05:11:40.419 INFO:teuthology.orchestra.run.smithi120.stdout:4593 writesame 0x83ff00d thru 0x83ff2ca data_size 0x12(0x2be bytes) 2024-09-13T05:11:40.442 INFO:teuthology.orchestra.run.smithi120.stdout:4595 write 0xe2839d7 thru 0xe28e35c (0xa986 bytes) 2024-09-13T05:11:40.449 INFO:teuthology.orchestra.run.smithi120.stdout:4596 write 0x54ff4e1 thru 0x5508b30 (0x9650 bytes) 2024-09-13T05:11:40.457 INFO:teuthology.orchestra.run.smithi120.stdout:4597 write 0x17540ab thru 0x1762027 (0xdf7d bytes) 2024-09-13T05:11:40.462 INFO:teuthology.orchestra.run.smithi120.stdout:4598 write 0x88eec33 thru 0x88f11a1 (0x256f bytes) 2024-09-13T05:11:40.468 INFO:teuthology.orchestra.run.smithi120.stdout:4601 read 0x8e9ca6e thru 0x8e9ecfd (0x2290 bytes) 2024-09-13T05:11:40.469 INFO:teuthology.orchestra.run.smithi120.stdout:4602 write 0x881fbdd thru 0x882c0d1 (0xc4f5 bytes) 2024-09-13T05:11:40.470 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:40.471 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:40.472 INFO:teuthology.orchestra.run.smithi120.stdout:4603 read 0x323bfae thru 0x32423ad (0x6400 bytes) 2024-09-13T05:11:40.473 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:40.473 INFO:teuthology.orchestra.run.smithi120.stdout:4606 write 0x455cc1b thru 0x4564391 (0x7777 bytes) 2024-09-13T05:11:40.476 INFO:teuthology.orchestra.run.smithi120.stdout:4607 write 0x274b5f3 thru 0x274d1c0 (0x1bce bytes) 2024-09-13T05:11:40.478 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:40.473+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:40.478 INFO:teuthology.orchestra.run.smithi120.stdout:4610 read 0x3fa9aca thru 0x3fae408 (0x493f bytes) 2024-09-13T05:11:40.479 INFO:teuthology.orchestra.run.smithi120.stdout:4611 writesame 0x1db9747 thru 0x1dbf873 data_size 0x1(0x612d bytes) 2024-09-13T05:11:40.482 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:11:40.508 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:40.508 INFO:teuthology.orchestra.run.smithi120.stdout:4613 write 0x34a7690 thru 0x34b431e (0xcc8f bytes) 2024-09-13T05:11:40.514 INFO:teuthology.orchestra.run.smithi120.stdout:4615 read 0x75bea2b thru 0x75c1338 (0x290e bytes) 2024-09-13T05:11:40.515 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:40.537 INFO:teuthology.orchestra.run.smithi120.stdout:4620 trunc from 0xe28e35d to 0x2867d23 2024-09-13T05:11:40.558 INFO:teuthology.orchestra.run.smithi120.stdout:4622 punch from 0x241a96a to 0x2424f21, (0xa5b7 bytes) 2024-09-13T05:11:40.558 INFO:teuthology.orchestra.run.smithi120.stdout:4624 read 0x1caeb8a thru 0x1cb6b45 (0x7fbc bytes) 2024-09-13T05:11:40.572 INFO:teuthology.orchestra.run.smithi120.stdout:4625 writesame 0x3d37bd8 thru 0x3d41646 data_size 0x1(0x9a6f bytes) 2024-09-13T05:11:40.579 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:40.576+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:40.584 INFO:teuthology.orchestra.run.smithi120.stdout:4627 writesame 0x40aadb1 thru 0x40ae8f5 data_size 0x1(0x3b45 bytes) 2024-09-13T05:11:40.616 INFO:teuthology.orchestra.run.smithi120.stdout:4629 writesame 0xbe55dd1 thru 0xbe59969 data_size 0xb(0x3b99 bytes) 2024-09-13T05:11:40.616 INFO:teuthology.orchestra.run.smithi120.stdout:4631 punch from 0x6085488 to 0x6094145, (0xecbd bytes) 2024-09-13T05:11:40.616 INFO:teuthology.orchestra.run.smithi120.stdout:4633 write 0x62cdbaa thru 0x62d814c (0xa5a3 bytes) 2024-09-13T05:11:40.619 INFO:teuthology.orchestra.run.smithi120.stdout:4634 punch from 0x2d0b015 to 0x2d1a5f7, (0xf5e2 bytes) 2024-09-13T05:11:40.619 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:40.619 INFO:teuthology.orchestra.run.smithi120.stdout:4637 clone 36 order 18 su 1024 sc 14 2024-09-13T05:11:40.641 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:40.641 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:40.651 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:11:40.714 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:40.705+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:40.773 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:40.773 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:40.782 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:11:40.782 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:40.780+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:40.853 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone35 from 0xbe5996a (overlap 0x210659) to 0x34d6f 2024-09-13T05:11:40.884 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:40.880+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:40.896 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:40.896 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:40.910 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:11:40.971 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #34, image image_client.0-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent35 2024-09-13T05:11:40.987 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:40.981+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:41.026 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:41.026 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:41.035 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:11:41.087 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:41.084+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:41.141 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:41.141 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:41.151 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:11:41.187 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:41.181+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:41.258 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:41.258 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:41.268 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:11:41.310 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:41.305+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:41.315 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:11:41.391 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:41.388+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:41.408 INFO:teuthology.orchestra.run.smithi120.stdout:4638 write 0x7093fce thru 0x709b5d7 (0x760a bytes) 2024-09-13T05:11:41.417 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:41.417 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:41.427 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:11:41.469 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:11:41.494 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:11:41.494 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:41.492+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:41.513 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:11:41.541 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:41.541 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:41.551 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:11:41.555 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:11:41.588 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:11:41.595 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:41.589+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:41.623 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:11:41.656 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:11:41.680 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:11:41.682 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:11:41.682 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:11:41.682 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:11:41.682 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:11:41.682 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:11:41.682 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:11:41.682 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:11:41.682 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:11:41.690 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:41.690 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:41.690 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:41.690 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:41.704 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:11:41.704 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:41.700+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:41.761 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T05:11:41.799 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:41.793+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:41.866 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:41.866 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:41.866 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:41.866 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:41.866 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:41.879 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:11:41.902 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:41.897+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:42.003 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:41.997+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:42.039 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:42.039 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:42.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:42.039 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:42.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.039 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14179 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1835008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.039 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:11:42.040 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.277558155999998, 2024-09-13T05:11:42.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0924508550000001, 2024-09-13T05:11:42.040 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.040 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.040 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14179 2024-09-13T05:11:42.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.040 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:11:42.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757552+0000", 2024-09-13T05:11:42.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757551+0000", 2024-09-13T05:11:42.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757554+0000", 2024-09-13T05:11:42.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5440000000000001e-06 2024-09-13T05:11:42.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757560+0000", 2024-09-13T05:11:42.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6840000000000001e-06 2024-09-13T05:11:42.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757564+0000", 2024-09-13T05:11:42.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3529999999999997e-06 2024-09-13T05:11:42.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814931+0000", 2024-09-13T05:11:42.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057367564000000003 2024-09-13T05:11:42.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:42.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814938+0000", 2024-09-13T05:11:42.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1070000000000001e-06 2024-09-13T05:11:42.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.849802+0000", 2024-09-13T05:11:42.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348647849999999 2024-09-13T05:11:42.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.849885+0000", 2024-09-13T05:11:42.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2859000000000001e-05 2024-09-13T05:11:42.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850003+0000", 2024-09-13T05:11:42.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117279 2024-09-13T05:11:42.044 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.044 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.044 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.045 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14180 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1844224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.045 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:42.045 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.277541870999997, 2024-09-13T05:11:42.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.092637853, 2024-09-13T05:11:42.045 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.045 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.045 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14180 2024-09-13T05:11:42.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.046 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:42.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:42.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757568+0000", 2024-09-13T05:11:42.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757570+0000", 2024-09-13T05:11:42.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3470000000000001e-06 2024-09-13T05:11:42.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757576+0000", 2024-09-13T05:11:42.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5550000000000002e-06 2024-09-13T05:11:42.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.757580+0000", 2024-09-13T05:11:42.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6519999999999997e-06 2024-09-13T05:11:42.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814975+0000", 2024-09-13T05:11:42.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057394349999999997 2024-09-13T05:11:42.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:42.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.814981+0000", 2024-09-13T05:11:42.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4119999999999998e-06 2024-09-13T05:11:42.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850042+0000", 2024-09-13T05:11:42.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0350611759999999 2024-09-13T05:11:42.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850103+0000", 2024-09-13T05:11:42.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0618000000000001e-05 2024-09-13T05:11:42.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.850206+0000", 2024-09-13T05:11:42.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010309199999999999 2024-09-13T05:11:42.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.050 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.050 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14196 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 1991680~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.050 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:42.050 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.273742784999996, 2024-09-13T05:11:42.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0925442910000001, 2024-09-13T05:11:42.051 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.051 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.051 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14196 2024-09-13T05:11:42.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.051 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:42.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:42.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761367+0000", 2024-09-13T05:11:42.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761368+0000", 2024-09-13T05:11:42.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3689999999999999e-06 2024-09-13T05:11:42.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761373+0000", 2024-09-13T05:11:42.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7180000000000004e-06 2024-09-13T05:11:42.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761376+0000", 2024-09-13T05:11:42.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0860000000000002e-06 2024-09-13T05:11:42.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815501+0000", 2024-09-13T05:11:42.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054125508000000003 2024-09-13T05:11:42.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:42.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815508+0000", 2024-09-13T05:11:42.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5570000000000001e-06 2024-09-13T05:11:42.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853689+0000", 2024-09-13T05:11:42.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0381811919999999 2024-09-13T05:11:42.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853764+0000", 2024-09-13T05:11:42.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4893000000000003e-05 2024-09-13T05:11:42.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853911+0000", 2024-09-13T05:11:42.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014721100000000001 2024-09-13T05:11:42.056 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.056 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.056 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.056 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14197 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2000896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.056 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:42.056 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.273731541000004, 2024-09-13T05:11:42.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.092841977, 2024-09-13T05:11:42.056 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.056 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.057 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.057 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.057 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.057 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14197 2024-09-13T05:11:42.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.057 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:42.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:42.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761378+0000", 2024-09-13T05:11:42.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761403+0000", 2024-09-13T05:11:42.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5199e-05 2024-09-13T05:11:42.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761411+0000", 2024-09-13T05:11:42.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4540000000000001e-06 2024-09-13T05:11:42.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761418+0000", 2024-09-13T05:11:42.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9569999999999996e-06 2024-09-13T05:11:42.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815531+0000", 2024-09-13T05:11:42.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054113599999999998 2024-09-13T05:11:42.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:42.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815539+0000", 2024-09-13T05:11:42.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.481e-06 2024-09-13T05:11:42.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.853949+0000", 2024-09-13T05:11:42.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.038410356 2024-09-13T05:11:42.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854022+0000", 2024-09-13T05:11:42.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2807999999999998e-05 2024-09-13T05:11:42.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854220+0000", 2024-09-13T05:11:42.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000198364 2024-09-13T05:11:42.061 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.061 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.061 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.061 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14198 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2010112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.061 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:42.061 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.273686533000003, 2024-09-13T05:11:42.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093063787, 2024-09-13T05:11:42.061 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.062 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.062 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14198 2024-09-13T05:11:42.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.062 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:42.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:42.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761423+0000", 2024-09-13T05:11:42.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761426+0000", 2024-09-13T05:11:42.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8789999999999999e-06 2024-09-13T05:11:42.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761432+0000", 2024-09-13T05:11:42.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1399999999999997e-06 2024-09-13T05:11:42.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761437+0000", 2024-09-13T05:11:42.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8579999999999999e-06 2024-09-13T05:11:42.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815563+0000", 2024-09-13T05:11:42.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054125877000000003 2024-09-13T05:11:42.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:42.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815570+0000", 2024-09-13T05:11:42.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1169999999999998e-06 2024-09-13T05:11:42.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854265+0000", 2024-09-13T05:11:42.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0386955659999999 2024-09-13T05:11:42.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854338+0000", 2024-09-13T05:11:42.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2537e-05 2024-09-13T05:11:42.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854487+0000", 2024-09-13T05:11:42.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014927899999999999 2024-09-13T05:11:42.066 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.066 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.066 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.066 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14199 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2019328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.066 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:42.066 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.273667660000001, 2024-09-13T05:11:42.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0933252389999999, 2024-09-13T05:11:42.066 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.067 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.067 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14199 2024-09-13T05:11:42.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.067 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:42.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:42.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761442+0000", 2024-09-13T05:11:42.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761445+0000", 2024-09-13T05:11:42.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7779999999999999e-06 2024-09-13T05:11:42.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761450+0000", 2024-09-13T05:11:42.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6350000000000003e-06 2024-09-13T05:11:42.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761455+0000", 2024-09-13T05:11:42.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9930000000000003e-06 2024-09-13T05:11:42.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815600+0000", 2024-09-13T05:11:42.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054144982000000001 2024-09-13T05:11:42.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:42.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815607+0000", 2024-09-13T05:11:42.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4749999999999998e-06 2024-09-13T05:11:42.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854527+0000", 2024-09-13T05:11:42.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.038920037 2024-09-13T05:11:42.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854637+0000", 2024-09-13T05:11:42.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011021700000000001 2024-09-13T05:11:42.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854767+0000", 2024-09-13T05:11:42.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130512 2024-09-13T05:11:42.071 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.071 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.071 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.071 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14200 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2028544~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.071 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:11:42.071 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.273649147, 2024-09-13T05:11:42.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093541554, 2024-09-13T05:11:42.072 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.072 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.072 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14200 2024-09-13T05:11:42.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.072 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:11:42.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761461+0000", 2024-09-13T05:11:42.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761460+0000", 2024-09-13T05:11:42.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761462+0000", 2024-09-13T05:11:42.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9659999999999999e-06 2024-09-13T05:11:42.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761466+0000", 2024-09-13T05:11:42.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6109999999999998e-06 2024-09-13T05:11:42.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761471+0000", 2024-09-13T05:11:42.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1019999999999996e-06 2024-09-13T05:11:42.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815631+0000", 2024-09-13T05:11:42.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054159680000000002 2024-09-13T05:11:42.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:42.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815637+0000", 2024-09-13T05:11:42.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-09-13T05:11:42.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854810+0000", 2024-09-13T05:11:42.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0391731930000001 2024-09-13T05:11:42.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.854883+0000", 2024-09-13T05:11:42.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3109999999999996e-05 2024-09-13T05:11:42.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855002+0000", 2024-09-13T05:11:42.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011934600000000001 2024-09-13T05:11:42.076 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.076 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.076 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.077 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14201 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2037760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.077 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:42.077 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.273634716999993, 2024-09-13T05:11:42.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0937543320000001, 2024-09-13T05:11:42.077 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.077 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.077 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.077 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.077 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.077 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14201 2024-09-13T05:11:42.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.077 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:42.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:42.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761475+0000", 2024-09-13T05:11:42.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761477+0000", 2024-09-13T05:11:42.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5620000000000002e-06 2024-09-13T05:11:42.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761483+0000", 2024-09-13T05:11:42.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7400000000000001e-06 2024-09-13T05:11:42.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761487+0000", 2024-09-13T05:11:42.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8130000000000002e-06 2024-09-13T05:11:42.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815697+0000", 2024-09-13T05:11:42.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054210253 2024-09-13T05:11:42.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:42.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815705+0000", 2024-09-13T05:11:42.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7049999999999999e-06 2024-09-13T05:11:42.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855036+0000", 2024-09-13T05:11:42.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.039330799 2024-09-13T05:11:42.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855110+0000", 2024-09-13T05:11:42.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4498000000000004e-05 2024-09-13T05:11:42.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855229+0000", 2024-09-13T05:11:42.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119282 2024-09-13T05:11:42.081 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.081 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.081 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.082 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14202 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2056192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.082 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:11:42.082 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.273570059999997, 2024-09-13T05:11:42.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093934027, 2024-09-13T05:11:42.082 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.082 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.082 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.082 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.082 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.082 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14202 2024-09-13T05:11:42.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.082 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:11:42.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761540+0000", 2024-09-13T05:11:42.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761489+0000", 2024-09-13T05:11:42.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999495 2024-09-13T05:11:42.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761543+0000", 2024-09-13T05:11:42.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3983999999999997e-05 2024-09-13T05:11:42.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761552+0000", 2024-09-13T05:11:42.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4659999999999999e-06 2024-09-13T05:11:42.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.761559+0000", 2024-09-13T05:11:42.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7710000000000001e-06 2024-09-13T05:11:42.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815742+0000", 2024-09-13T05:11:42.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.054183488000000002 2024-09-13T05:11:42.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:42.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.815749+0000", 2024-09-13T05:11:42.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1609999999999997e-06 2024-09-13T05:11:42.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855283+0000", 2024-09-13T05:11:42.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0395336230000001 2024-09-13T05:11:42.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855354+0000", 2024-09-13T05:11:42.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1456000000000002e-05 2024-09-13T05:11:42.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.855474+0000", 2024-09-13T05:11:42.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119429 2024-09-13T05:11:42.086 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.086 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.087 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.087 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14294 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2113536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.087 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:11:42.087 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.270019145999996, 2024-09-13T05:11:42.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0923650330000001, 2024-09-13T05:11:42.087 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.087 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.087 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.087 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.087 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.087 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14294 2024-09-13T05:11:42.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.088 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:11:42.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765091+0000", 2024-09-13T05:11:42.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765090+0000", 2024-09-13T05:11:42.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:42.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765092+0000", 2024-09-13T05:11:42.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.542e-06 2024-09-13T05:11:42.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765096+0000", 2024-09-13T05:11:42.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6179999999999999e-06 2024-09-13T05:11:42.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765098+0000", 2024-09-13T05:11:42.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8049999999999998e-06 2024-09-13T05:11:42.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816384+0000", 2024-09-13T05:11:42.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051285338999999999 2024-09-13T05:11:42.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:42.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816393+0000", 2024-09-13T05:11:42.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-09-13T05:11:42.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857258+0000", 2024-09-13T05:11:42.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0408652549999999 2024-09-13T05:11:42.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857327+0000", 2024-09-13T05:11:42.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8714000000000007e-05 2024-09-13T05:11:42.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857456+0000", 2024-09-13T05:11:42.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012909299999999999 2024-09-13T05:11:42.091 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.092 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.092 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.092 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14295 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2122752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.092 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:42.092 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.270009388000005, 2024-09-13T05:11:42.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0928006969999999, 2024-09-13T05:11:42.092 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.092 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.092 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.092 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.092 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.092 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14295 2024-09-13T05:11:42.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.093 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:42.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:42.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765100+0000", 2024-09-13T05:11:42.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:42.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765102+0000", 2024-09-13T05:11:42.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3990000000000001e-06 2024-09-13T05:11:42.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765104+0000", 2024-09-13T05:11:42.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:11:42.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765107+0000", 2024-09-13T05:11:42.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.582e-06 2024-09-13T05:11:42.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816432+0000", 2024-09-13T05:11:42.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051325118000000003 2024-09-13T05:11:42.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:42.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816440+0000", 2024-09-13T05:11:42.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4679999999999992e-06 2024-09-13T05:11:42.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857495+0000", 2024-09-13T05:11:42.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.041054216 2024-09-13T05:11:42.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857644+0000", 2024-09-13T05:11:42.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014909400000000001 2024-09-13T05:11:42.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857901+0000", 2024-09-13T05:11:42.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025746200000000002 2024-09-13T05:11:42.097 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.097 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.097 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.097 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14296 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2131968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.097 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:11:42.097 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.270001141999998, 2024-09-13T05:11:42.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.093120361, 2024-09-13T05:11:42.097 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.097 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.097 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14296 2024-09-13T05:11:42.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.098 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:11:42.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765109+0000", 2024-09-13T05:11:42.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765108+0000", 2024-09-13T05:11:42.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:42.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765110+0000", 2024-09-13T05:11:42.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.226e-06 2024-09-13T05:11:42.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765112+0000", 2024-09-13T05:11:42.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6769999999999999e-06 2024-09-13T05:11:42.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765115+0000", 2024-09-13T05:11:42.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.712e-06 2024-09-13T05:11:42.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816479+0000", 2024-09-13T05:11:42.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051364102000000002 2024-09-13T05:11:42.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:42.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816503+0000", 2024-09-13T05:11:42.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3723999999999999e-05 2024-09-13T05:11:42.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.857929+0000", 2024-09-13T05:11:42.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0414263180000001 2024-09-13T05:11:42.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858015+0000", 2024-09-13T05:11:42.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5730999999999996e-05 2024-09-13T05:11:42.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858229+0000", 2024-09-13T05:11:42.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021408700000000001 2024-09-13T05:11:42.102 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.102 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.102 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.102 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14297 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2141184~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.105 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:42.105 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.269992797, 2024-09-13T05:11:42.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0936699510000001, 2024-09-13T05:11:42.105 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.105 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.105 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.105 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.105 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.105 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14297 2024-09-13T05:11:42.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.105 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:42.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:42.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765117+0000", 2024-09-13T05:11:42.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:42.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765118+0000", 2024-09-13T05:11:42.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4190000000000001e-06 2024-09-13T05:11:42.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765121+0000", 2024-09-13T05:11:42.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6110000000000001e-06 2024-09-13T05:11:42.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765124+0000", 2024-09-13T05:11:42.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3720000000000001e-06 2024-09-13T05:11:42.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816535+0000", 2024-09-13T05:11:42.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051410890000000001 2024-09-13T05:11:42.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:42.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816556+0000", 2024-09-13T05:11:42.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0551e-05 2024-09-13T05:11:42.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858552+0000", 2024-09-13T05:11:42.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0419965529999999 2024-09-13T05:11:42.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858640+0000", 2024-09-13T05:11:42.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7907999999999999e-05 2024-09-13T05:11:42.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858787+0000", 2024-09-13T05:11:42.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000146864 2024-09-13T05:11:42.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.109 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.110 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14298 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2150400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.110 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:42.110 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.269983404000001, 2024-09-13T05:11:42.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0938958759999999, 2024-09-13T05:11:42.110 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.110 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.110 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14298 2024-09-13T05:11:42.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.110 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:42.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:42.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765126+0000", 2024-09-13T05:11:42.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:42.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765128+0000", 2024-09-13T05:11:42.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4139999999999999e-06 2024-09-13T05:11:42.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765130+0000", 2024-09-13T05:11:42.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6809999999999998e-06 2024-09-13T05:11:42.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765133+0000", 2024-09-13T05:11:42.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9270000000000001e-06 2024-09-13T05:11:42.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816592+0000", 2024-09-13T05:11:42.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051459029000000003 2024-09-13T05:11:42.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:42.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816601+0000", 2024-09-13T05:11:42.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9819999999999997e-06 2024-09-13T05:11:42.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858818+0000", 2024-09-13T05:11:42.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0422167170000001 2024-09-13T05:11:42.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.858896+0000", 2024-09-13T05:11:42.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8128999999999997e-05 2024-09-13T05:11:42.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859022+0000", 2024-09-13T05:11:42.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012619899999999999 2024-09-13T05:11:42.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.114 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.115 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.115 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14299 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2168832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.115 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:42.115 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.269974640000001, 2024-09-13T05:11:42.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0941207909999999, 2024-09-13T05:11:42.115 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.115 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.115 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14299 2024-09-13T05:11:42.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.116 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:42.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:42.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765135+0000", 2024-09-13T05:11:42.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:42.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765136+0000", 2024-09-13T05:11:42.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5230000000000001e-06 2024-09-13T05:11:42.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765139+0000", 2024-09-13T05:11:42.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.672e-06 2024-09-13T05:11:42.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765142+0000", 2024-09-13T05:11:42.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6680000000000001e-06 2024-09-13T05:11:42.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816632+0000", 2024-09-13T05:11:42.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051489886999999998 2024-09-13T05:11:42.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:42.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816643+0000", 2024-09-13T05:11:42.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1457000000000001e-05 2024-09-13T05:11:42.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859061+0000", 2024-09-13T05:11:42.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.042417616 2024-09-13T05:11:42.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859138+0000", 2024-09-13T05:11:42.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7077999999999996e-05 2024-09-13T05:11:42.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859256+0000", 2024-09-13T05:11:42.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118108 2024-09-13T05:11:42.119 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14300 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2159616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.269965830000004, 2024-09-13T05:11:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0943386719999999, 2024-09-13T05:11:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14300 2024-09-13T05:11:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765144+0000", 2024-09-13T05:11:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765145+0000", 2024-09-13T05:11:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.488e-06 2024-09-13T05:11:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765148+0000", 2024-09-13T05:11:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6620000000000001e-06 2024-09-13T05:11:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765151+0000", 2024-09-13T05:11:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6419999999999999e-06 2024-09-13T05:11:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816677+0000", 2024-09-13T05:11:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051526776000000003 2024-09-13T05:11:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816689+0000", 2024-09-13T05:11:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1634000000000001e-05 2024-09-13T05:11:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859296+0000", 2024-09-13T05:11:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0426066009999999 2024-09-13T05:11:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859364+0000", 2024-09-13T05:11:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8745999999999995e-05 2024-09-13T05:11:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859483+0000", 2024-09-13T05:11:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011833900000000001 2024-09-13T05:11:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14301 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2178048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:11:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.269957196000007, 2024-09-13T05:11:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0946233009999999, 2024-09-13T05:11:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14301 2024-09-13T05:11:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:11:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765153+0000", 2024-09-13T05:11:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765152+0000", 2024-09-13T05:11:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765154+0000", 2024-09-13T05:11:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.449e-06 2024-09-13T05:11:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765157+0000", 2024-09-13T05:11:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6809999999999998e-06 2024-09-13T05:11:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765159+0000", 2024-09-13T05:11:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6060000000000001e-06 2024-09-13T05:11:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816722+0000", 2024-09-13T05:11:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051562535 2024-09-13T05:11:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816733+0000", 2024-09-13T05:11:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1678000000000001e-05 2024-09-13T05:11:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859521+0000", 2024-09-13T05:11:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0427879440000001 2024-09-13T05:11:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859655+0000", 2024-09-13T05:11:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134053 2024-09-13T05:11:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859776+0000", 2024-09-13T05:11:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012058299999999999 2024-09-13T05:11:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14302 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2187264~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.269948619000004, 2024-09-13T05:11:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.094937383, 2024-09-13T05:11:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14302 2024-09-13T05:11:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765161+0000", 2024-09-13T05:11:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765162+0000", 2024-09-13T05:11:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4589999999999999e-06 2024-09-13T05:11:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765165+0000", 2024-09-13T05:11:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6019999999999998e-06 2024-09-13T05:11:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765168+0000", 2024-09-13T05:11:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.497e-06 2024-09-13T05:11:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816764+0000", 2024-09-13T05:11:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051596722999999997 2024-09-13T05:11:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816776+0000", 2024-09-13T05:11:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1967000000000001e-05 2024-09-13T05:11:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859810+0000", 2024-09-13T05:11:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0430338299999999 2024-09-13T05:11:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.859901+0000", 2024-09-13T05:11:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1397999999999995e-05 2024-09-13T05:11:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860099+0000", 2024-09-13T05:11:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000197133 2024-09-13T05:11:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14303 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2196480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:11:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.269940281999993, 2024-09-13T05:11:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.095199152, 2024-09-13T05:11:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14303 2024-09-13T05:11:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:11:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765170+0000", 2024-09-13T05:11:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765169+0000", 2024-09-13T05:11:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765171+0000", 2024-09-13T05:11:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2899999999999999e-06 2024-09-13T05:11:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765173+0000", 2024-09-13T05:11:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-13T05:11:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765176+0000", 2024-09-13T05:11:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.016e-06 2024-09-13T05:11:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816811+0000", 2024-09-13T05:11:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051634684 2024-09-13T05:11:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816840+0000", 2024-09-13T05:11:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8690000000000001e-05 2024-09-13T05:11:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860135+0000", 2024-09-13T05:11:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0432951029999999 2024-09-13T05:11:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860255+0000", 2024-09-13T05:11:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119936 2024-09-13T05:11:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860369+0000", 2024-09-13T05:11:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113978 2024-09-13T05:11:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:14304 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2205696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.269917414000005, 2024-09-13T05:11:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0955512999999999, 2024-09-13T05:11:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 14304 2024-09-13T05:11:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765192+0000", 2024-09-13T05:11:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765195+0000", 2024-09-13T05:11:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6599999999999999e-06 2024-09-13T05:11:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765200+0000", 2024-09-13T05:11:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.356e-06 2024-09-13T05:11:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.765205+0000", 2024-09-13T05:11:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3000000000000001e-06 2024-09-13T05:11:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816901+0000", 2024-09-13T05:11:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051695451000000003 2024-09-13T05:11:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.816963+0000", 2024-09-13T05:11:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2694000000000007e-05 2024-09-13T05:11:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860434+0000", 2024-09-13T05:11:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.04347053 2024-09-13T05:11:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860592+0000", 2024-09-13T05:11:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015854199999999999 2024-09-13T05:11:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:31.860744+0000", 2024-09-13T05:11:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015133 2024-09-13T05:11:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.145 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:42.147 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:11:42.147 INFO:teuthology.orchestra.run.smithi120.stdout:4639 writesame 0x375c16e thru 0x37627c2 data_size 0x17(0x6655 bytes) 2024-09-13T05:11:42.148 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:42.141+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:42.211 INFO:tasks.thrashosds.thrasher:in_osds: [2, 3, 5, 6, 7] out_osds: [4, 1, 0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T05:11:42.211 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-13T05:11:42.248 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:42.244+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:42.268 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:42.268 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:42.268 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:42.268 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:42.282 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:11:42.350 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:42.345+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:42.442 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:42.442 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:42.442 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:42.443 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:42.443 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:42.450 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:42.445+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:42.454 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:11:42.551 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:42.548+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:42.601 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:42.602 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:42.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:42.602 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:42.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.602 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10634 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 731136~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.602 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:42.602 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.197083219999996, 2024-09-13T05:11:42.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028136992999999999, 2024-09-13T05:11:42.602 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.602 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.603 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.603 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.603 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.603 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10634 2024-09-13T05:11:42.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.603 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:42.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:42.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:42.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401987+0000", 2024-09-13T05:11:42.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5090000000000001e-06 2024-09-13T05:11:42.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401997+0000", 2024-09-13T05:11:42.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8009999999999998e-06 2024-09-13T05:11:42.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402000+0000", 2024-09-13T05:11:42.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.756e-06 2024-09-13T05:11:42.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430035+0000", 2024-09-13T05:11:42.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028034967000000001 2024-09-13T05:11:42.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430081+0000", 2024-09-13T05:11:42.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6448e-05 2024-09-13T05:11:42.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430123+0000", 2024-09-13T05:11:42.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1758000000000002e-05 2024-09-13T05:11:42.606 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.606 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.607 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.607 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10635 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 740352~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.607 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:11:42.607 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.197066606000007, 2024-09-13T05:11:42.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028229890000000001, 2024-09-13T05:11:42.607 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.608 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.608 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.608 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.608 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.608 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10635 2024-09-13T05:11:42.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.608 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:11:42.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:11:42.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402002+0000", 2024-09-13T05:11:42.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402004+0000", 2024-09-13T05:11:42.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.575e-06 2024-09-13T05:11:42.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402007+0000", 2024-09-13T05:11:42.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1240000000000001e-06 2024-09-13T05:11:42.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402010+0000", 2024-09-13T05:11:42.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5859999999999999e-06 2024-09-13T05:11:42.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430146+0000", 2024-09-13T05:11:42.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028136746000000001 2024-09-13T05:11:42.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430195+0000", 2024-09-13T05:11:42.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8948e-05 2024-09-13T05:11:42.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430232+0000", 2024-09-13T05:11:42.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7159000000000001e-05 2024-09-13T05:11:42.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.612 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.613 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10636 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 749568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.613 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:11:42.613 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.1970575, 2024-09-13T05:11:42.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328440999999999, 2024-09-13T05:11:42.614 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.614 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.614 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.614 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.614 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.614 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10636 2024-09-13T05:11:42.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.615 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:11:42.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:11:42.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402011+0000", 2024-09-13T05:11:42.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:42.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402017+0000", 2024-09-13T05:11:42.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5620000000000003e-06 2024-09-13T05:11:42.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402020+0000", 2024-09-13T05:11:42.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1410000000000001e-06 2024-09-13T05:11:42.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402024+0000", 2024-09-13T05:11:42.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4489999999999999e-06 2024-09-13T05:11:42.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430256+0000", 2024-09-13T05:11:42.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028232363 2024-09-13T05:11:42.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430299+0000", 2024-09-13T05:11:42.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2830999999999997e-05 2024-09-13T05:11:42.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430340+0000", 2024-09-13T05:11:42.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1301000000000003e-05 2024-09-13T05:11:42.618 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.618 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.618 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.618 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10637 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 758784~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.618 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:42.618 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.197042386999996, 2024-09-13T05:11:42.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028441793, 2024-09-13T05:11:42.619 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.619 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.619 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.619 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.619 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.619 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10637 2024-09-13T05:11:42.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.619 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:42.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:42.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:42.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:42.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402031+0000", 2024-09-13T05:11:42.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6770000000000003e-06 2024-09-13T05:11:42.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402034+0000", 2024-09-13T05:11:42.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1540000000000002e-06 2024-09-13T05:11:42.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402038+0000", 2024-09-13T05:11:42.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4970000000000001e-06 2024-09-13T05:11:42.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430367+0000", 2024-09-13T05:11:42.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328906000000001 2024-09-13T05:11:42.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430416+0000", 2024-09-13T05:11:42.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:11:42.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430469+0000", 2024-09-13T05:11:42.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2284999999999998e-05 2024-09-13T05:11:42.623 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.623 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.623 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.623 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10638 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 768000~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.623 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:42.624 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.197028903000003, 2024-09-13T05:11:42.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028548740999999999, 2024-09-13T05:11:42.624 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.624 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.624 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.624 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.624 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.624 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10638 2024-09-13T05:11:42.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.624 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:42.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:42.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:42.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402041+0000", 2024-09-13T05:11:42.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4789999999999999e-06 2024-09-13T05:11:42.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402044+0000", 2024-09-13T05:11:42.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.694e-06 2024-09-13T05:11:42.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402047+0000", 2024-09-13T05:11:42.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.537e-06 2024-09-13T05:11:42.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430494+0000", 2024-09-13T05:11:42.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028447665 2024-09-13T05:11:42.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430544+0000", 2024-09-13T05:11:42.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9539000000000001e-05 2024-09-13T05:11:42.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430589+0000", 2024-09-13T05:11:42.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5071999999999998e-05 2024-09-13T05:11:42.631 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.631 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.631 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.631 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10639 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 777216~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.631 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:11:42.631 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.197018521999993, 2024-09-13T05:11:42.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028651769000000001, 2024-09-13T05:11:42.631 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.631 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.632 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.632 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.632 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.632 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10639 2024-09-13T05:11:42.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.632 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:11:42.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:11:42.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402050+0000", 2024-09-13T05:11:42.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402052+0000", 2024-09-13T05:11:42.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2249999999999999e-06 2024-09-13T05:11:42.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402054+0000", 2024-09-13T05:11:42.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8140000000000001e-06 2024-09-13T05:11:42.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402057+0000", 2024-09-13T05:11:42.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4889999999999998e-06 2024-09-13T05:11:42.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430607+0000", 2024-09-13T05:11:42.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028549896000000002 2024-09-13T05:11:42.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430651+0000", 2024-09-13T05:11:42.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4622000000000001e-05 2024-09-13T05:11:42.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430702+0000", 2024-09-13T05:11:42.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0980999999999999e-05 2024-09-13T05:11:42.636 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.636 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.636 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.636 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11151 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 779264~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.636 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:42.636 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.167247240999998, 2024-09-13T05:11:42.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028283188000000001, 2024-09-13T05:11:42.636 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.637 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.637 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11151 2024-09-13T05:11:42.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.637 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:42.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:42.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:42.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431827+0000", 2024-09-13T05:11:42.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0989999999999998e-06 2024-09-13T05:11:42.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431832+0000", 2024-09-13T05:11:42.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8829999999999997e-06 2024-09-13T05:11:42.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431835+0000", 2024-09-13T05:11:42.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.439e-06 2024-09-13T05:11:42.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.459955+0000", 2024-09-13T05:11:42.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028119858000000001 2024-09-13T05:11:42.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.460029+0000", 2024-09-13T05:11:42.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4264000000000006e-05 2024-09-13T05:11:42.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.460105+0000", 2024-09-13T05:11:42.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5906000000000001e-05 2024-09-13T05:11:42.641 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.641 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.641 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.641 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11897 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 579584~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.641 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:42.641 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.118098067000005, 2024-09-13T05:11:42.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028193354, 2024-09-13T05:11:42.641 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.642 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.642 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.642 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.642 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.642 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11897 2024-09-13T05:11:42.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.642 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:42.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:42.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:42.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480973+0000", 2024-09-13T05:11:42.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.934e-06 2024-09-13T05:11:42.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480976+0000", 2024-09-13T05:11:42.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.614e-06 2024-09-13T05:11:42.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480980+0000", 2024-09-13T05:11:42.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.377e-06 2024-09-13T05:11:42.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.508967+0000", 2024-09-13T05:11:42.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027987455000000001 2024-09-13T05:11:42.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509074+0000", 2024-09-13T05:11:42.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107379 2024-09-13T05:11:42.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509164+0000", 2024-09-13T05:11:42.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9979e-05 2024-09-13T05:11:42.646 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.646 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.646 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.646 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11898 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 588800~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.646 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:42.646 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.118086003000002, 2024-09-13T05:11:42.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028308628999999998, 2024-09-13T05:11:42.646 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.646 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.646 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.646 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.647 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.647 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11898 2024-09-13T05:11:42.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.647 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:42.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:42.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:42.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480984+0000", 2024-09-13T05:11:42.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:11:42.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480988+0000", 2024-09-13T05:11:42.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4640000000000002e-06 2024-09-13T05:11:42.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480991+0000", 2024-09-13T05:11:42.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3469999999999999e-06 2024-09-13T05:11:42.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509199+0000", 2024-09-13T05:11:42.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028207449999999998 2024-09-13T05:11:42.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509250+0000", 2024-09-13T05:11:42.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1375000000000002e-05 2024-09-13T05:11:42.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509292+0000", 2024-09-13T05:11:42.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1730000000000002e-05 2024-09-13T05:11:42.651 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.651 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.651 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.651 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11899 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 598016~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.651 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:42.652 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.118075161999997, 2024-09-13T05:11:42.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516703000000001, 2024-09-13T05:11:42.652 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.652 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.652 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.652 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.652 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.652 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11899 2024-09-13T05:11:42.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.653 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:42.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:42.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:42.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480995+0000", 2024-09-13T05:11:42.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7349999999999999e-06 2024-09-13T05:11:42.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481000+0000", 2024-09-13T05:11:42.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0289999999999996e-06 2024-09-13T05:11:42.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481004+0000", 2024-09-13T05:11:42.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3699999999999999e-06 2024-09-13T05:11:42.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509332+0000", 2024-09-13T05:11:42.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328320000000001 2024-09-13T05:11:42.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509428+0000", 2024-09-13T05:11:42.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6150999999999995e-05 2024-09-13T05:11:42.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509511+0000", 2024-09-13T05:11:42.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2396000000000002e-05 2024-09-13T05:11:42.657 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.657 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.657 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.657 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11900 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 607232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.658 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:11:42.658 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.118062573000003, 2024-09-13T05:11:42.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028621273999999999, 2024-09-13T05:11:42.658 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.658 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.658 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.658 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.658 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.658 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11900 2024-09-13T05:11:42.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.658 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:11:42.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:11:42.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481006+0000", 2024-09-13T05:11:42.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481008+0000", 2024-09-13T05:11:42.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.73e-06 2024-09-13T05:11:42.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481011+0000", 2024-09-13T05:11:42.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4000000000000001e-06 2024-09-13T05:11:42.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481015+0000", 2024-09-13T05:11:42.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2760000000000001e-06 2024-09-13T05:11:42.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509531+0000", 2024-09-13T05:11:42.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516102000000002 2024-09-13T05:11:42.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509588+0000", 2024-09-13T05:11:42.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7423999999999998e-05 2024-09-13T05:11:42.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509628+0000", 2024-09-13T05:11:42.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9644000000000002e-05 2024-09-13T05:11:42.662 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.662 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.662 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.662 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11901 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 616448~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.662 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:42.662 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.118051952000002, 2024-09-13T05:11:42.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028820500999999998, 2024-09-13T05:11:42.662 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.662 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.663 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.663 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.663 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.663 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11901 2024-09-13T05:11:42.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.663 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:42.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:42.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:42.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481022+0000", 2024-09-13T05:11:42.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0209999999999999e-06 2024-09-13T05:11:42.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481026+0000", 2024-09-13T05:11:42.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:11:42.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481029+0000", 2024-09-13T05:11:42.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.636e-06 2024-09-13T05:11:42.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509661+0000", 2024-09-13T05:11:42.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028631496999999999 2024-09-13T05:11:42.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509757+0000", 2024-09-13T05:11:42.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5780999999999997e-05 2024-09-13T05:11:42.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509838+0000", 2024-09-13T05:11:42.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1102999999999999e-05 2024-09-13T05:11:42.667 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.667 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.667 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.667 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11902 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 625664~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.667 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:42.667 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.118030090000005, 2024-09-13T05:11:42.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028894265999999998, 2024-09-13T05:11:42.667 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.668 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.668 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11902 2024-09-13T05:11:42.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.668 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:42.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:42.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:42.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481041+0000", 2024-09-13T05:11:42.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8020000000000001e-06 2024-09-13T05:11:42.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481044+0000", 2024-09-13T05:11:42.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7110000000000001e-06 2024-09-13T05:11:42.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481048+0000", 2024-09-13T05:11:42.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.411e-06 2024-09-13T05:11:42.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509851+0000", 2024-09-13T05:11:42.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028803295 2024-09-13T05:11:42.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509896+0000", 2024-09-13T05:11:42.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4963000000000003e-05 2024-09-13T05:11:42.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509933+0000", 2024-09-13T05:11:42.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7384e-05 2024-09-13T05:11:42.671 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.671 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.672 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.672 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11903 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 634880~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.672 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:42.672 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.118018853999999, 2024-09-13T05:11:42.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029118033000000001, 2024-09-13T05:11:42.672 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.672 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.672 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.672 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.672 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.672 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11903 2024-09-13T05:11:42.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.673 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:42.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:42.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:42.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481052+0000", 2024-09-13T05:11:42.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.581e-06 2024-09-13T05:11:42.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481055+0000", 2024-09-13T05:11:42.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4520000000000002e-06 2024-09-13T05:11:42.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481058+0000", 2024-09-13T05:11:42.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4599999999999999e-06 2024-09-13T05:11:42.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509967+0000", 2024-09-13T05:11:42.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028908257999999999 2024-09-13T05:11:42.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510062+0000", 2024-09-13T05:11:42.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5613999999999996e-05 2024-09-13T05:11:42.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510168+0000", 2024-09-13T05:11:42.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105951 2024-09-13T05:11:42.677 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.677 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.677 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.677 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11904 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 644096~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.677 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:42.677 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.118007958999996, 2024-09-13T05:11:42.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029301971, 2024-09-13T05:11:42.677 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.677 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.677 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.677 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.677 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.678 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11904 2024-09-13T05:11:42.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.678 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:42.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:42.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:42.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481063+0000", 2024-09-13T05:11:42.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6700000000000001e-06 2024-09-13T05:11:42.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481068+0000", 2024-09-13T05:11:42.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4519999999999996e-06 2024-09-13T05:11:42.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481074+0000", 2024-09-13T05:11:42.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8370000000000002e-06 2024-09-13T05:11:42.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510197+0000", 2024-09-13T05:11:42.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029123237999999999 2024-09-13T05:11:42.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510285+0000", 2024-09-13T05:11:42.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7676000000000006e-05 2024-09-13T05:11:42.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510363+0000", 2024-09-13T05:11:42.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8418999999999996e-05 2024-09-13T05:11:42.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.681 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.682 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.682 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11905 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 653312~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.682 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:11:42.682 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.117992219000001, 2024-09-13T05:11:42.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029480164, 2024-09-13T05:11:42.682 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.682 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.682 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11905 2024-09-13T05:11:42.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.683 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:11:42.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:11:42.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481076+0000", 2024-09-13T05:11:42.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481079+0000", 2024-09-13T05:11:42.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9629999999999998e-06 2024-09-13T05:11:42.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481087+0000", 2024-09-13T05:11:42.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6369999999999999e-06 2024-09-13T05:11:42.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481093+0000", 2024-09-13T05:11:42.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.857e-06 2024-09-13T05:11:42.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510408+0000", 2024-09-13T05:11:42.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029315213 2024-09-13T05:11:42.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510501+0000", 2024-09-13T05:11:42.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2916000000000003e-05 2024-09-13T05:11:42.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510557+0000", 2024-09-13T05:11:42.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6063999999999997e-05 2024-09-13T05:11:42.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.686 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.686 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11906 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 662528~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.686 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:11:42.687 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.117950206000003, 2024-09-13T05:11:42.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029575054999999999, 2024-09-13T05:11:42.687 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.687 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.687 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11906 2024-09-13T05:11:42.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.687 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:11:42.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:11:42.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481118+0000", 2024-09-13T05:11:42.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481122+0000", 2024-09-13T05:11:42.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2610000000000002e-06 2024-09-13T05:11:42.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481129+0000", 2024-09-13T05:11:42.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0079999999999996e-06 2024-09-13T05:11:42.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481135+0000", 2024-09-13T05:11:42.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0599999999999996e-06 2024-09-13T05:11:42.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510575+0000", 2024-09-13T05:11:42.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029440470999999999 2024-09-13T05:11:42.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510635+0000", 2024-09-13T05:11:42.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0177000000000003e-05 2024-09-13T05:11:42.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510694+0000", 2024-09-13T05:11:42.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8675999999999999e-05 2024-09-13T05:11:42.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.691 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.691 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11907 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 671744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.691 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:11:42.691 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.117689411000001, 2024-09-13T05:11:42.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029479490000000001, 2024-09-13T05:11:42.691 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.691 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.691 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.692 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.692 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.692 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11907 2024-09-13T05:11:42.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.692 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:11:42.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:11:42.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481140+0000", 2024-09-13T05:11:42.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997597 2024-09-13T05:11:42.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481383+0000", 2024-09-13T05:11:42.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024355399999999999 2024-09-13T05:11:42.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481390+0000", 2024-09-13T05:11:42.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3599999999999998e-06 2024-09-13T05:11:42.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481395+0000", 2024-09-13T05:11:42.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8940000000000001e-06 2024-09-13T05:11:42.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510722+0000", 2024-09-13T05:11:42.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029327143999999999 2024-09-13T05:11:42.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510802+0000", 2024-09-13T05:11:42.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9770000000000004e-05 2024-09-13T05:11:42.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510859+0000", 2024-09-13T05:11:42.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6957999999999999e-05 2024-09-13T05:11:42.695 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.695 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.695 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.695 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11908 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 680960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.696 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:11:42.696 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.117669497999998, 2024-09-13T05:11:42.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029617622, 2024-09-13T05:11:42.696 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.696 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.696 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.696 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.696 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.696 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11908 2024-09-13T05:11:42.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.696 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:11:42.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:11:42.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481399+0000", 2024-09-13T05:11:42.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481401+0000", 2024-09-13T05:11:42.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8729999999999999e-06 2024-09-13T05:11:42.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481413+0000", 2024-09-13T05:11:42.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1748e-05 2024-09-13T05:11:42.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481417+0000", 2024-09-13T05:11:42.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:11:42.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510908+0000", 2024-09-13T05:11:42.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029491129000000001 2024-09-13T05:11:42.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510955+0000", 2024-09-13T05:11:42.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7188000000000003e-05 2024-09-13T05:11:42.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511017+0000", 2024-09-13T05:11:42.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2288999999999999e-05 2024-09-13T05:11:42.700 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.700 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.700 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.700 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11909 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 690176~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:42.700 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:11:42.700 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.117649170999996, 2024-09-13T05:11:42.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029780699000000001, 2024-09-13T05:11:42.701 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.701 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:42.701 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.701 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.701 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.701 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11909 2024-09-13T05:11:42.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.701 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:11:42.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:11:42.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481419+0000", 2024-09-13T05:11:42.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481421+0000", 2024-09-13T05:11:42.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.035e-06 2024-09-13T05:11:42.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481427+0000", 2024-09-13T05:11:42.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2449999999999998e-06 2024-09-13T05:11:42.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481430+0000", 2024-09-13T05:11:42.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.366e-06 2024-09-13T05:11:42.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511064+0000", 2024-09-13T05:11:42.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029633711 2024-09-13T05:11:42.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:42.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511160+0000", 2024-09-13T05:11:42.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6399999999999999e-05 2024-09-13T05:11:42.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:42.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511201+0000", 2024-09-13T05:11:42.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0448000000000003e-05 2024-09-13T05:11:42.704 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.704 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.704 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.705 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.705 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.705 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:42.706 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:11:42.707 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:42.701+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:42.755 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.2 to 1 (10000) 2024-09-13T05:11:42.755 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is unset 2024-09-13T05:11:42.770 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-13T05:11:42.807 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:42.804+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:42.879 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:42.879 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:42.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.879 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87003 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:42.879 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.837070+0000", 2024-09-13T05:11:42.879 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.037543254999999998, 2024-09-13T05:11:42.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.037560470999999998, 2024-09-13T05:11:42.880 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.880 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.880 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.880 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.880 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.880 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87003 2024-09-13T05:11:42.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.880 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837070+0000", 2024-09-13T05:11:42.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837070+0000", 2024-09-13T05:11:42.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837069+0000", 2024-09-13T05:11:42.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837071+0000", 2024-09-13T05:11:42.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.866e-06 2024-09-13T05:11:42.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837081+0000", 2024-09-13T05:11:42.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6639999999999993e-06 2024-09-13T05:11:42.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837091+0000", 2024-09-13T05:11:42.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7550000000000006e-06 2024-09-13T05:11:42.882 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.882 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.882 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.883 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87004 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:42.883 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.837102+0000", 2024-09-13T05:11:42.883 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.037510670000000003, 2024-09-13T05:11:42.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.037562377000000001, 2024-09-13T05:11:42.883 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.883 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.883 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.883 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.883 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.883 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87004 2024-09-13T05:11:42.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.883 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837102+0000", 2024-09-13T05:11:42.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837102+0000", 2024-09-13T05:11:42.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837102+0000", 2024-09-13T05:11:42.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837108+0000", 2024-09-13T05:11:42.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7130000000000002e-06 2024-09-13T05:11:42.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837112+0000", 2024-09-13T05:11:42.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.031e-06 2024-09-13T05:11:42.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837115+0000", 2024-09-13T05:11:42.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.467e-06 2024-09-13T05:11:42.887 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.888 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.888 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.888 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87035 3.1a 3.baaa5f7a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:42.888 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.844433+0000", 2024-09-13T05:11:42.888 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.030179807999999999, 2024-09-13T05:11:42.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.030258868000000001, 2024-09-13T05:11:42.888 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.888 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.888 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.888 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.889 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87035 2024-09-13T05:11:42.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.889 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.844433+0000", 2024-09-13T05:11:42.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.844433+0000", 2024-09-13T05:11:42.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.843369+0000", 2024-09-13T05:11:42.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9989357 2024-09-13T05:11:42.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.844438+0000", 2024-09-13T05:11:42.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001069593 2024-09-13T05:11:42.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.844447+0000", 2024-09-13T05:11:42.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6840000000000002e-06 2024-09-13T05:11:42.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.844454+0000", 2024-09-13T05:11:42.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0899999999999999e-06 2024-09-13T05:11:42.892 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.892 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.892 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.893 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87005 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:42.893 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.837120+0000", 2024-09-13T05:11:42.893 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.037493423999999997, 2024-09-13T05:11:42.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.037601898000000002, 2024-09-13T05:11:42.893 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.893 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.893 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87005 2024-09-13T05:11:42.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.893 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837120+0000", 2024-09-13T05:11:42.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837120+0000", 2024-09-13T05:11:42.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837119+0000", 2024-09-13T05:11:42.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837121+0000", 2024-09-13T05:11:42.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7060000000000001e-06 2024-09-13T05:11:42.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837132+0000", 2024-09-13T05:11:42.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1017e-05 2024-09-13T05:11:42.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837136+0000", 2024-09-13T05:11:42.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3279999999999999e-06 2024-09-13T05:11:42.895 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.895 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.896 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.896 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87037 3.1a 3.de01995a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:42.896 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.844464+0000", 2024-09-13T05:11:42.896 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.030148810000000002, 2024-09-13T05:11:42.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.030283932, 2024-09-13T05:11:42.896 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.896 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.896 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.896 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.896 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.896 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87037 2024-09-13T05:11:42.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.897 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.844464+0000", 2024-09-13T05:11:42.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.844464+0000", 2024-09-13T05:11:42.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.844463+0000", 2024-09-13T05:11:42.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:42.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.844468+0000", 2024-09-13T05:11:42.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.408e-06 2024-09-13T05:11:42.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.844475+0000", 2024-09-13T05:11:42.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2280000000000001e-06 2024-09-13T05:11:42.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.844481+0000", 2024-09-13T05:11:42.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1290000000000001e-06 2024-09-13T05:11:42.899 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.899 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.899 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.899 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87006 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:42.899 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.837139+0000", 2024-09-13T05:11:42.899 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.037473571999999997, 2024-09-13T05:11:42.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.03763586, 2024-09-13T05:11:42.899 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.900 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.900 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87006 2024-09-13T05:11:42.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.900 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837139+0000", 2024-09-13T05:11:42.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837139+0000", 2024-09-13T05:11:42.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837139+0000", 2024-09-13T05:11:42.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837141+0000", 2024-09-13T05:11:42.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6729999999999999e-06 2024-09-13T05:11:42.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837146+0000", 2024-09-13T05:11:42.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9169999999999997e-06 2024-09-13T05:11:42.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837149+0000", 2024-09-13T05:11:42.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.36e-06 2024-09-13T05:11:42.902 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.902 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.902 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.903 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87040 3.1a 3.de01995a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:42.903 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.844487+0000", 2024-09-13T05:11:42.903 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.030125572, 2024-09-13T05:11:42.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.030313462999999999, 2024-09-13T05:11:42.903 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.904 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.904 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87040 2024-09-13T05:11:42.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.905 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.844487+0000", 2024-09-13T05:11:42.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.844487+0000", 2024-09-13T05:11:42.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.844487+0000", 2024-09-13T05:11:42.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.844491+0000", 2024-09-13T05:11:42.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.715e-06 2024-09-13T05:11:42.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.844497+0000", 2024-09-13T05:11:42.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4749999999999998e-06 2024-09-13T05:11:42.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.844503+0000", 2024-09-13T05:11:42.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6590000000000004e-06 2024-09-13T05:11:42.909 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.909 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.910 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.910 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87007 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:42.910 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.837152+0000", 2024-09-13T05:11:42.910 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.037461135, 2024-09-13T05:11:42.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.037675259000000003, 2024-09-13T05:11:42.910 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.910 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.911 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.911 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.911 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87007 2024-09-13T05:11:42.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.911 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837152+0000", 2024-09-13T05:11:42.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837152+0000", 2024-09-13T05:11:42.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837152+0000", 2024-09-13T05:11:42.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837153+0000", 2024-09-13T05:11:42.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7129999999999999e-06 2024-09-13T05:11:42.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837162+0000", 2024-09-13T05:11:42.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5250000000000005e-06 2024-09-13T05:11:42.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837172+0000", 2024-09-13T05:11:42.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0393e-05 2024-09-13T05:11:42.913 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.913 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.913 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.914 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87042 3.1a 3.de01995a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:42.914 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.844514+0000", 2024-09-13T05:11:42.914 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.030098511000000001, 2024-09-13T05:11:42.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.030338516999999999, 2024-09-13T05:11:42.914 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.914 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.914 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.915 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87042 2024-09-13T05:11:42.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.916 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.844514+0000", 2024-09-13T05:11:42.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.844514+0000", 2024-09-13T05:11:42.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.844514+0000", 2024-09-13T05:11:42.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.844518+0000", 2024-09-13T05:11:42.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.676e-06 2024-09-13T05:11:42.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.844525+0000", 2024-09-13T05:11:42.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8099999999999998e-06 2024-09-13T05:11:42.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.844532+0000", 2024-09-13T05:11:42.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1299999999999998e-06 2024-09-13T05:11:42.926 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.926 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.926 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.927 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87008 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:42.927 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.837176+0000", 2024-09-13T05:11:42.928 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.037436811, 2024-09-13T05:11:42.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.037705146000000002, 2024-09-13T05:11:42.928 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.929 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.929 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87008 2024-09-13T05:11:42.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.930 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837176+0000", 2024-09-13T05:11:42.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837176+0000", 2024-09-13T05:11:42.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837176+0000", 2024-09-13T05:11:42.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837178+0000", 2024-09-13T05:11:42.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7999999999999999e-06 2024-09-13T05:11:42.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837187+0000", 2024-09-13T05:11:42.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5580000000000006e-06 2024-09-13T05:11:42.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837196+0000", 2024-09-13T05:11:42.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7069999999999998e-06 2024-09-13T05:11:42.935 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.935 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.935 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.935 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87009 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:42.936 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.837199+0000", 2024-09-13T05:11:42.936 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.037414120000000002, 2024-09-13T05:11:42.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.037708128, 2024-09-13T05:11:42.936 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.936 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.936 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.937 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87009 2024-09-13T05:11:42.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.937 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837199+0000", 2024-09-13T05:11:42.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837199+0000", 2024-09-13T05:11:42.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837199+0000", 2024-09-13T05:11:42.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837200+0000", 2024-09-13T05:11:42.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.784e-06 2024-09-13T05:11:42.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837204+0000", 2024-09-13T05:11:42.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4869999999999998e-06 2024-09-13T05:11:42.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837207+0000", 2024-09-13T05:11:42.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.393e-06 2024-09-13T05:11:42.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.943 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.944 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87010 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:42.944 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.837210+0000", 2024-09-13T05:11:42.944 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.037402953000000003, 2024-09-13T05:11:42.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.037726316000000003, 2024-09-13T05:11:42.944 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.944 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.945 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.945 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.945 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.945 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87010 2024-09-13T05:11:42.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.945 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837210+0000", 2024-09-13T05:11:42.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837210+0000", 2024-09-13T05:11:42.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837210+0000", 2024-09-13T05:11:42.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837211+0000", 2024-09-13T05:11:42.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6130000000000001e-06 2024-09-13T05:11:42.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837215+0000", 2024-09-13T05:11:42.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5149999999999998e-06 2024-09-13T05:11:42.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837221+0000", 2024-09-13T05:11:42.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7420000000000003e-06 2024-09-13T05:11:42.951 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.951 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.951 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.951 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:86979 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 7599104~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:42.952 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.833023+0000", 2024-09-13T05:11:42.952 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.041589934000000002, 2024-09-13T05:11:42.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.041942597999999998, 2024-09-13T05:11:42.952 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.952 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:11:42.952 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.953 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.953 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.953 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86979 2024-09-13T05:11:42.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.953 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833023+0000", 2024-09-13T05:11:42.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833023+0000", 2024-09-13T05:11:42.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833023+0000", 2024-09-13T05:11:42.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833025+0000", 2024-09-13T05:11:42.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.832e-06 2024-09-13T05:11:42.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833028+0000", 2024-09-13T05:11:42.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6040000000000001e-06 2024-09-13T05:11:42.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833031+0000", 2024-09-13T05:11:42.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:11:42.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:42.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.874930+0000", 2024-09-13T05:11:42.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.041898789999999998 2024-09-13T05:11:42.958 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.958 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.958 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.958 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87011 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:42.958 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.837224+0000", 2024-09-13T05:11:42.959 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.037388800999999999, 2024-09-13T05:11:42.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.037770070000000003, 2024-09-13T05:11:42.959 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.959 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.959 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87011 2024-09-13T05:11:42.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.959 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837224+0000", 2024-09-13T05:11:42.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837224+0000", 2024-09-13T05:11:42.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837224+0000", 2024-09-13T05:11:42.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837225+0000", 2024-09-13T05:11:42.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.522e-06 2024-09-13T05:11:42.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837229+0000", 2024-09-13T05:11:42.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.54e-06 2024-09-13T05:11:42.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837233+0000", 2024-09-13T05:11:42.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8500000000000004e-06 2024-09-13T05:11:42.961 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.962 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.962 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.962 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:86980 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:42.962 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.833038+0000", 2024-09-13T05:11:42.962 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.041574538000000001, 2024-09-13T05:11:42.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.041982630999999999, 2024-09-13T05:11:42.962 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.962 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.962 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86980 2024-09-13T05:11:42.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.963 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833038+0000", 2024-09-13T05:11:42.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833038+0000", 2024-09-13T05:11:42.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833038+0000", 2024-09-13T05:11:42.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833040+0000", 2024-09-13T05:11:42.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1129999999999999e-06 2024-09-13T05:11:42.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833048+0000", 2024-09-13T05:11:42.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8690000000000004e-06 2024-09-13T05:11:42.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833052+0000", 2024-09-13T05:11:42.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5549999999999998e-06 2024-09-13T05:11:42.965 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.965 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.965 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.965 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87012 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:42.965 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.837267+0000", 2024-09-13T05:11:42.965 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.037346197999999997, 2024-09-13T05:11:42.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.037779944000000003, 2024-09-13T05:11:42.966 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.966 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.966 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87012 2024-09-13T05:11:42.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.966 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837267+0000", 2024-09-13T05:11:42.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837267+0000", 2024-09-13T05:11:42.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837266+0000", 2024-09-13T05:11:42.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837269+0000", 2024-09-13T05:11:42.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.204e-06 2024-09-13T05:11:42.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837278+0000", 2024-09-13T05:11:42.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-09-13T05:11:42.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837288+0000", 2024-09-13T05:11:42.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5519999999999993e-06 2024-09-13T05:11:42.968 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.968 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.968 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.969 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:86981 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:42.969 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.833055+0000", 2024-09-13T05:11:42.969 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.041558457, 2024-09-13T05:11:42.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042017605, 2024-09-13T05:11:42.969 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.969 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.969 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.969 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.969 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.969 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86981 2024-09-13T05:11:42.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.969 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833055+0000", 2024-09-13T05:11:42.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833055+0000", 2024-09-13T05:11:42.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833054+0000", 2024-09-13T05:11:42.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833056+0000", 2024-09-13T05:11:42.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8500000000000001e-06 2024-09-13T05:11:42.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833068+0000", 2024-09-13T05:11:42.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1499e-05 2024-09-13T05:11:42.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833072+0000", 2024-09-13T05:11:42.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5220000000000001e-06 2024-09-13T05:11:42.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.972 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.972 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87013 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:42.972 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.837303+0000", 2024-09-13T05:11:42.972 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.037310115999999997, 2024-09-13T05:11:42.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.037794853000000003, 2024-09-13T05:11:42.972 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.972 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.972 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.973 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87013 2024-09-13T05:11:42.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.973 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837303+0000", 2024-09-13T05:11:42.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837303+0000", 2024-09-13T05:11:42.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837302+0000", 2024-09-13T05:11:42.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837305+0000", 2024-09-13T05:11:42.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1100000000000001e-06 2024-09-13T05:11:42.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837314+0000", 2024-09-13T05:11:42.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6940000000000007e-06 2024-09-13T05:11:42.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837319+0000", 2024-09-13T05:11:42.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.313e-06 2024-09-13T05:11:42.975 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.975 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.975 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.975 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:86982 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:42.975 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.833075+0000", 2024-09-13T05:11:42.975 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.041537643999999999, 2024-09-13T05:11:42.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042052232000000002, 2024-09-13T05:11:42.976 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.976 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.976 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86982 2024-09-13T05:11:42.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.976 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833075+0000", 2024-09-13T05:11:42.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833075+0000", 2024-09-13T05:11:42.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833075+0000", 2024-09-13T05:11:42.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833077+0000", 2024-09-13T05:11:42.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8679999999999999e-06 2024-09-13T05:11:42.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833081+0000", 2024-09-13T05:11:42.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8469999999999998e-06 2024-09-13T05:11:42.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833084+0000", 2024-09-13T05:11:42.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3969999999999998e-06 2024-09-13T05:11:42.978 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.978 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.978 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.979 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87014 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:42.979 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.837322+0000", 2024-09-13T05:11:42.979 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.037291383999999997, 2024-09-13T05:11:42.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.037831521, 2024-09-13T05:11:42.979 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.979 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.979 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87014 2024-09-13T05:11:42.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.979 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837322+0000", 2024-09-13T05:11:42.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837322+0000", 2024-09-13T05:11:42.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837321+0000", 2024-09-13T05:11:42.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837323+0000", 2024-09-13T05:11:42.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.767e-06 2024-09-13T05:11:42.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837331+0000", 2024-09-13T05:11:42.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3680000000000002e-06 2024-09-13T05:11:42.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837336+0000", 2024-09-13T05:11:42.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2509999999999996e-06 2024-09-13T05:11:42.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.982 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.982 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:86983 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:42.982 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.833087+0000", 2024-09-13T05:11:42.982 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.041526050000000002, 2024-09-13T05:11:42.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042091612, 2024-09-13T05:11:42.982 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.982 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.982 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.982 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.983 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86983 2024-09-13T05:11:42.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.983 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833087+0000", 2024-09-13T05:11:42.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833087+0000", 2024-09-13T05:11:42.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833087+0000", 2024-09-13T05:11:42.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833088+0000", 2024-09-13T05:11:42.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6509999999999999e-06 2024-09-13T05:11:42.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833094+0000", 2024-09-13T05:11:42.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0510000000000002e-06 2024-09-13T05:11:42.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833098+0000", 2024-09-13T05:11:42.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4070000000000002e-06 2024-09-13T05:11:42.985 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.985 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.985 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.985 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87015 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:42.985 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.837338+0000", 2024-09-13T05:11:42.985 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.037274545999999999, 2024-09-13T05:11:42.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.037866652000000001, 2024-09-13T05:11:42.986 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.986 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.986 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.986 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.986 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.986 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87015 2024-09-13T05:11:42.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.986 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837338+0000", 2024-09-13T05:11:42.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837338+0000", 2024-09-13T05:11:42.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837338+0000", 2024-09-13T05:11:42.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837340+0000", 2024-09-13T05:11:42.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8050000000000001e-06 2024-09-13T05:11:42.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837350+0000", 2024-09-13T05:11:42.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0506000000000001e-05 2024-09-13T05:11:42.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837362+0000", 2024-09-13T05:11:42.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1184e-05 2024-09-13T05:11:42.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.988 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.989 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:86984 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:42.989 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.833101+0000", 2024-09-13T05:11:42.989 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.041512464999999998, 2024-09-13T05:11:42.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042130360999999998, 2024-09-13T05:11:42.989 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.989 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.989 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.989 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.989 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.989 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86984 2024-09-13T05:11:42.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.990 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833101+0000", 2024-09-13T05:11:42.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833101+0000", 2024-09-13T05:11:42.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833100+0000", 2024-09-13T05:11:42.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833102+0000", 2024-09-13T05:11:42.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.809e-06 2024-09-13T05:11:42.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833106+0000", 2024-09-13T05:11:42.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.517e-06 2024-09-13T05:11:42.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833109+0000", 2024-09-13T05:11:42.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3139999999999999e-06 2024-09-13T05:11:42.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.992 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.992 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87016 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:42.992 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.841629+0000", 2024-09-13T05:11:42.992 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.032983514999999998, 2024-09-13T05:11:42.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.033628347000000003, 2024-09-13T05:11:42.992 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.992 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.993 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87016 2024-09-13T05:11:42.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.993 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841629+0000", 2024-09-13T05:11:42.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841629+0000", 2024-09-13T05:11:42.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837365+0000", 2024-09-13T05:11:42.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9957356 2024-09-13T05:11:42.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841639+0000", 2024-09-13T05:11:42.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042736140000000002 2024-09-13T05:11:42.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841647+0000", 2024-09-13T05:11:42.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6240000000000008e-06 2024-09-13T05:11:42.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841653+0000", 2024-09-13T05:11:42.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5130000000000004e-06 2024-09-13T05:11:42.995 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.996 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.996 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.996 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:86985 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:42.996 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.833113+0000", 2024-09-13T05:11:42.996 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.041499806, 2024-09-13T05:11:42.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042170646999999999, 2024-09-13T05:11:42.996 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.996 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.996 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:42.996 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:42.996 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:42.996 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86985 2024-09-13T05:11:42.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.997 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:42.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:42.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833113+0000", 2024-09-13T05:11:42.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:42.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833113+0000", 2024-09-13T05:11:42.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:42.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:42.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833113+0000", 2024-09-13T05:11:42.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:42.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:42.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833115+0000", 2024-09-13T05:11:42.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.716e-06 2024-09-13T05:11:42.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:42.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833120+0000", 2024-09-13T05:11:42.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7309999999999998e-06 2024-09-13T05:11:42.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:42.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833124+0000", 2024-09-13T05:11:42.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4400000000000001e-06 2024-09-13T05:11:42.999 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.999 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:42.999 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:42.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:42.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:42.999 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87017 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:42.999 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.841658+0000", 2024-09-13T05:11:42.999 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.032955235999999999, 2024-09-13T05:11:42.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.033653941, 2024-09-13T05:11:42.999 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:42.999 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:42.999 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.000 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.000 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.000 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87017 2024-09-13T05:11:43.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.000 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841658+0000", 2024-09-13T05:11:43.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841658+0000", 2024-09-13T05:11:43.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841657+0000", 2024-09-13T05:11:43.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841659+0000", 2024-09-13T05:11:43.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0190000000000001e-06 2024-09-13T05:11:43.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841663+0000", 2024-09-13T05:11:43.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.72e-06 2024-09-13T05:11:43.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841668+0000", 2024-09-13T05:11:43.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.288e-06 2024-09-13T05:11:43.002 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.002 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.002 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.002 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:86986 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.003 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.833126+0000", 2024-09-13T05:11:43.003 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.041486559999999999, 2024-09-13T05:11:43.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042212548000000003, 2024-09-13T05:11:43.003 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.003 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.003 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86986 2024-09-13T05:11:43.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.003 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833126+0000", 2024-09-13T05:11:43.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833126+0000", 2024-09-13T05:11:43.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833126+0000", 2024-09-13T05:11:43.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833128+0000", 2024-09-13T05:11:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5960000000000001e-06 2024-09-13T05:11:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833133+0000", 2024-09-13T05:11:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7039999999999999e-06 2024-09-13T05:11:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833137+0000", 2024-09-13T05:11:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2229999999999999e-06 2024-09-13T05:11:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87018 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.841671+0000", 2024-09-13T05:11:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.032941880999999999, 2024-09-13T05:11:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.033693729999999998, 2024-09-13T05:11:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87018 2024-09-13T05:11:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841671+0000", 2024-09-13T05:11:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841671+0000", 2024-09-13T05:11:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841671+0000", 2024-09-13T05:11:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841673+0000", 2024-09-13T05:11:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.832e-06 2024-09-13T05:11:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841676+0000", 2024-09-13T05:11:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3900000000000002e-06 2024-09-13T05:11:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841679+0000", 2024-09-13T05:11:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3249999999999999e-06 2024-09-13T05:11:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:86987 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.833170+0000", 2024-09-13T05:11:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.041443150999999998, 2024-09-13T05:11:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042220319999999999, 2024-09-13T05:11:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86987 2024-09-13T05:11:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833170+0000", 2024-09-13T05:11:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833170+0000", 2024-09-13T05:11:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833169+0000", 2024-09-13T05:11:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833172+0000", 2024-09-13T05:11:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0679999999999999e-06 2024-09-13T05:11:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833181+0000", 2024-09-13T05:11:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0909999999999999e-06 2024-09-13T05:11:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833184+0000", 2024-09-13T05:11:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6449999999999998e-06 2024-09-13T05:11:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87019 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.841682+0000", 2024-09-13T05:11:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.032930953999999998, 2024-09-13T05:11:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.033733515999999998, 2024-09-13T05:11:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87019 2024-09-13T05:11:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841682+0000", 2024-09-13T05:11:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841682+0000", 2024-09-13T05:11:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841682+0000", 2024-09-13T05:11:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841684+0000", 2024-09-13T05:11:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8139999999999999e-06 2024-09-13T05:11:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841687+0000", 2024-09-13T05:11:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3809999999999999e-06 2024-09-13T05:11:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841691+0000", 2024-09-13T05:11:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7519999999999998e-06 2024-09-13T05:11:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:86988 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.833187+0000", 2024-09-13T05:11:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.041425772, 2024-09-13T05:11:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042253470000000001, 2024-09-13T05:11:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86988 2024-09-13T05:11:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833187+0000", 2024-09-13T05:11:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833187+0000", 2024-09-13T05:11:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833187+0000", 2024-09-13T05:11:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833189+0000", 2024-09-13T05:11:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6920000000000001e-06 2024-09-13T05:11:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833197+0000", 2024-09-13T05:11:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1550000000000007e-06 2024-09-13T05:11:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833200+0000", 2024-09-13T05:11:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3569999999999998e-06 2024-09-13T05:11:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87020 3.1a 3.baaa5f7a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.841693+0000", 2024-09-13T05:11:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.032919622000000003, 2024-09-13T05:11:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.033772811, 2024-09-13T05:11:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87020 2024-09-13T05:11:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841693+0000", 2024-09-13T05:11:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841693+0000", 2024-09-13T05:11:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841693+0000", 2024-09-13T05:11:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841695+0000", 2024-09-13T05:11:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0159999999999998e-06 2024-09-13T05:11:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841699+0000", 2024-09-13T05:11:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6909999999999999e-06 2024-09-13T05:11:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841702+0000", 2024-09-13T05:11:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.157e-06 2024-09-13T05:11:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:86989 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.833203+0000", 2024-09-13T05:11:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.041409979999999999, 2024-09-13T05:11:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042288412999999997, 2024-09-13T05:11:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86989 2024-09-13T05:11:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833203+0000", 2024-09-13T05:11:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833203+0000", 2024-09-13T05:11:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833203+0000", 2024-09-13T05:11:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833204+0000", 2024-09-13T05:11:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.764e-06 2024-09-13T05:11:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833208+0000", 2024-09-13T05:11:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.507e-06 2024-09-13T05:11:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833212+0000", 2024-09-13T05:11:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4769999999999997e-06 2024-09-13T05:11:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87021 3.1a 3.baaa5f7a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.841705+0000", 2024-09-13T05:11:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.032908465999999997, 2024-09-13T05:11:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.033817121999999998, 2024-09-13T05:11:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87021 2024-09-13T05:11:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841705+0000", 2024-09-13T05:11:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841705+0000", 2024-09-13T05:11:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841704+0000", 2024-09-13T05:11:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841706+0000", 2024-09-13T05:11:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.824e-06 2024-09-13T05:11:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841709+0000", 2024-09-13T05:11:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.286e-06 2024-09-13T05:11:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841743+0000", 2024-09-13T05:11:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3544999999999998e-05 2024-09-13T05:11:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:86990 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.833215+0000", 2024-09-13T05:11:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.041397832000000002, 2024-09-13T05:11:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042332728, 2024-09-13T05:11:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86990 2024-09-13T05:11:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833215+0000", 2024-09-13T05:11:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833215+0000", 2024-09-13T05:11:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833215+0000", 2024-09-13T05:11:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833216+0000", 2024-09-13T05:11:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5710000000000001e-06 2024-09-13T05:11:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833225+0000", 2024-09-13T05:11:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4190000000000002e-06 2024-09-13T05:11:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833228+0000", 2024-09-13T05:11:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5549999999999998e-06 2024-09-13T05:11:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87022 3.1a 3.baaa5f7a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.841746+0000", 2024-09-13T05:11:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.032866921, 2024-09-13T05:11:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.033858553999999999, 2024-09-13T05:11:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87022 2024-09-13T05:11:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841746+0000", 2024-09-13T05:11:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841746+0000", 2024-09-13T05:11:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841746+0000", 2024-09-13T05:11:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841748+0000", 2024-09-13T05:11:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9759999999999998e-06 2024-09-13T05:11:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841754+0000", 2024-09-13T05:11:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9279999999999998e-06 2024-09-13T05:11:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841757+0000", 2024-09-13T05:11:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5389999999999999e-06 2024-09-13T05:11:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:86991 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.833231+0000", 2024-09-13T05:11:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.041381749000000002, 2024-09-13T05:11:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042399302999999999, 2024-09-13T05:11:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86991 2024-09-13T05:11:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833231+0000", 2024-09-13T05:11:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833231+0000", 2024-09-13T05:11:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833231+0000", 2024-09-13T05:11:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833233+0000", 2024-09-13T05:11:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.717e-06 2024-09-13T05:11:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833240+0000", 2024-09-13T05:11:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7039999999999994e-06 2024-09-13T05:11:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833244+0000", 2024-09-13T05:11:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.382e-06 2024-09-13T05:11:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87023 3.1a 3.baaa5f7a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.841760+0000", 2024-09-13T05:11:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.032853137999999997, 2024-09-13T05:11:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.033899367999999999, 2024-09-13T05:11:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87023 2024-09-13T05:11:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841760+0000", 2024-09-13T05:11:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841760+0000", 2024-09-13T05:11:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841760+0000", 2024-09-13T05:11:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841761+0000", 2024-09-13T05:11:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9230000000000001e-06 2024-09-13T05:11:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841765+0000", 2024-09-13T05:11:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4769999999999999e-06 2024-09-13T05:11:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841768+0000", 2024-09-13T05:11:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0730000000000001e-06 2024-09-13T05:11:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:86992 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.833247+0000", 2024-09-13T05:11:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.041366240999999998, 2024-09-13T05:11:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042438703000000001, 2024-09-13T05:11:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86992 2024-09-13T05:11:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833247+0000", 2024-09-13T05:11:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833247+0000", 2024-09-13T05:11:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833246+0000", 2024-09-13T05:11:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833251+0000", 2024-09-13T05:11:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3170000000000003e-06 2024-09-13T05:11:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833261+0000", 2024-09-13T05:11:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0631e-05 2024-09-13T05:11:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833273+0000", 2024-09-13T05:11:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1317e-05 2024-09-13T05:11:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87024 3.1a 3.baaa5f7a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.841771+0000", 2024-09-13T05:11:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.032842257, 2024-09-13T05:11:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.033958101999999997, 2024-09-13T05:11:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87024 2024-09-13T05:11:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841771+0000", 2024-09-13T05:11:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841771+0000", 2024-09-13T05:11:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841770+0000", 2024-09-13T05:11:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841772+0000", 2024-09-13T05:11:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.77e-06 2024-09-13T05:11:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841778+0000", 2024-09-13T05:11:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1759999999999998e-06 2024-09-13T05:11:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841782+0000", 2024-09-13T05:11:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.574e-06 2024-09-13T05:11:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:86993 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.833278+0000", 2024-09-13T05:11:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.041335416999999999, 2024-09-13T05:11:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042501171999999997, 2024-09-13T05:11:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86993 2024-09-13T05:11:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833278+0000", 2024-09-13T05:11:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833278+0000", 2024-09-13T05:11:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833277+0000", 2024-09-13T05:11:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833279+0000", 2024-09-13T05:11:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7439999999999999e-06 2024-09-13T05:11:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833283+0000", 2024-09-13T05:11:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.946e-06 2024-09-13T05:11:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833286+0000", 2024-09-13T05:11:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.427e-06 2024-09-13T05:11:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87025 3.1a 3.baaa5f7a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.841785+0000", 2024-09-13T05:11:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.032828342000000003, 2024-09-13T05:11:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.034047843000000001, 2024-09-13T05:11:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87025 2024-09-13T05:11:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841785+0000", 2024-09-13T05:11:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841785+0000", 2024-09-13T05:11:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841784+0000", 2024-09-13T05:11:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841786+0000", 2024-09-13T05:11:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7659999999999999e-06 2024-09-13T05:11:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841792+0000", 2024-09-13T05:11:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1970000000000001e-06 2024-09-13T05:11:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841796+0000", 2024-09-13T05:11:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6610000000000002e-06 2024-09-13T05:11:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:86994 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.833290+0000", 2024-09-13T05:11:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.041322721999999999, 2024-09-13T05:11:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042595269999999998, 2024-09-13T05:11:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86994 2024-09-13T05:11:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833290+0000", 2024-09-13T05:11:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833290+0000", 2024-09-13T05:11:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833290+0000", 2024-09-13T05:11:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833292+0000", 2024-09-13T05:11:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8109999999999999e-06 2024-09-13T05:11:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833302+0000", 2024-09-13T05:11:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9729999999999992e-06 2024-09-13T05:11:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833306+0000", 2024-09-13T05:11:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4649999999999996e-06 2024-09-13T05:11:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87026 3.1a 3.baaa5f7a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.841799+0000", 2024-09-13T05:11:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.032814336, 2024-09-13T05:11:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.034136674999999998, 2024-09-13T05:11:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87026 2024-09-13T05:11:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841799+0000", 2024-09-13T05:11:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841799+0000", 2024-09-13T05:11:43.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841798+0000", 2024-09-13T05:11:43.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841800+0000", 2024-09-13T05:11:43.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6750000000000001e-06 2024-09-13T05:11:43.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841806+0000", 2024-09-13T05:11:43.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6760000000000004e-06 2024-09-13T05:11:43.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841825+0000", 2024-09-13T05:11:43.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9718e-05 2024-09-13T05:11:43.063 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.063 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.063 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.064 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:86995 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.064 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.833310+0000", 2024-09-13T05:11:43.064 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.041302833999999997, 2024-09-13T05:11:43.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042667277000000003, 2024-09-13T05:11:43.064 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.064 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.064 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.064 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.064 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.064 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86995 2024-09-13T05:11:43.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.064 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833310+0000", 2024-09-13T05:11:43.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833310+0000", 2024-09-13T05:11:43.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833310+0000", 2024-09-13T05:11:43.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833312+0000", 2024-09-13T05:11:43.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7740000000000001e-06 2024-09-13T05:11:43.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833322+0000", 2024-09-13T05:11:43.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0322999999999999e-05 2024-09-13T05:11:43.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833325+0000", 2024-09-13T05:11:43.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4249999999999998e-06 2024-09-13T05:11:43.067 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.067 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.067 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.067 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87027 3.1a 3.baaa5f7a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.067 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.841831+0000", 2024-09-13T05:11:43.067 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.032782356999999998, 2024-09-13T05:11:43.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.034173092000000002, 2024-09-13T05:11:43.067 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.067 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.068 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.068 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.068 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87027 2024-09-13T05:11:43.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.068 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841831+0000", 2024-09-13T05:11:43.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841831+0000", 2024-09-13T05:11:43.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841830+0000", 2024-09-13T05:11:43.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841833+0000", 2024-09-13T05:11:43.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3539999999999998e-06 2024-09-13T05:11:43.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841837+0000", 2024-09-13T05:11:43.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7679999999999999e-06 2024-09-13T05:11:43.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841842+0000", 2024-09-13T05:11:43.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2119999999999997e-06 2024-09-13T05:11:43.070 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.070 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.070 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.070 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:86996 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.070 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.833328+0000", 2024-09-13T05:11:43.071 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.041284688, 2024-09-13T05:11:43.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042705372999999998, 2024-09-13T05:11:43.071 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.071 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.071 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.071 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.071 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.071 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86996 2024-09-13T05:11:43.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.071 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833328+0000", 2024-09-13T05:11:43.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833328+0000", 2024-09-13T05:11:43.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833328+0000", 2024-09-13T05:11:43.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833330+0000", 2024-09-13T05:11:43.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7630000000000001e-06 2024-09-13T05:11:43.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833342+0000", 2024-09-13T05:11:43.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2500000000000001e-05 2024-09-13T05:11:43.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833346+0000", 2024-09-13T05:11:43.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4209999999999999e-06 2024-09-13T05:11:43.073 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.073 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.074 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.074 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87028 3.1a 3.baaa5f7a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.074 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.841845+0000", 2024-09-13T05:11:43.074 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.032767707, 2024-09-13T05:11:43.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.034217161000000003, 2024-09-13T05:11:43.074 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.074 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.074 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87028 2024-09-13T05:11:43.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.075 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841845+0000", 2024-09-13T05:11:43.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841845+0000", 2024-09-13T05:11:43.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841845+0000", 2024-09-13T05:11:43.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841853+0000", 2024-09-13T05:11:43.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3720000000000005e-06 2024-09-13T05:11:43.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841861+0000", 2024-09-13T05:11:43.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9920000000000007e-06 2024-09-13T05:11:43.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841866+0000", 2024-09-13T05:11:43.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3660000000000002e-06 2024-09-13T05:11:43.077 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.077 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.077 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.077 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:86997 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.077 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.833349+0000", 2024-09-13T05:11:43.077 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.041263616000000003, 2024-09-13T05:11:43.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042764272999999998, 2024-09-13T05:11:43.077 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.077 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.078 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86997 2024-09-13T05:11:43.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.078 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833349+0000", 2024-09-13T05:11:43.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833349+0000", 2024-09-13T05:11:43.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833349+0000", 2024-09-13T05:11:43.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833351+0000", 2024-09-13T05:11:43.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9209999999999999e-06 2024-09-13T05:11:43.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833355+0000", 2024-09-13T05:11:43.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.771e-06 2024-09-13T05:11:43.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833358+0000", 2024-09-13T05:11:43.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.393e-06 2024-09-13T05:11:43.080 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.080 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.080 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.080 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87029 3.1a 3.baaa5f7a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.080 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.841871+0000", 2024-09-13T05:11:43.081 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.032741497000000001, 2024-09-13T05:11:43.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.034294505000000003, 2024-09-13T05:11:43.081 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.081 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.081 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.081 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.081 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.081 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87029 2024-09-13T05:11:43.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.081 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841871+0000", 2024-09-13T05:11:43.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841871+0000", 2024-09-13T05:11:43.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841871+0000", 2024-09-13T05:11:43.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841873+0000", 2024-09-13T05:11:43.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3530000000000002e-06 2024-09-13T05:11:43.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841881+0000", 2024-09-13T05:11:43.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6040000000000004e-06 2024-09-13T05:11:43.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841885+0000", 2024-09-13T05:11:43.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3100000000000002e-06 2024-09-13T05:11:43.083 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.083 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.084 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.084 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:86998 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.084 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.833361+0000", 2024-09-13T05:11:43.084 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.041252077999999998, 2024-09-13T05:11:43.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042859268999999998, 2024-09-13T05:11:43.084 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.084 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.084 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86998 2024-09-13T05:11:43.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.085 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833361+0000", 2024-09-13T05:11:43.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833361+0000", 2024-09-13T05:11:43.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833361+0000", 2024-09-13T05:11:43.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833362+0000", 2024-09-13T05:11:43.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.519e-06 2024-09-13T05:11:43.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833366+0000", 2024-09-13T05:11:43.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6550000000000002e-06 2024-09-13T05:11:43.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833369+0000", 2024-09-13T05:11:43.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4800000000000001e-06 2024-09-13T05:11:43.087 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.087 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.087 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.087 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87030 3.1a 3.baaa5f7a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.087 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.841890+0000", 2024-09-13T05:11:43.087 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.032722858000000001, 2024-09-13T05:11:43.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.034380554000000001, 2024-09-13T05:11:43.087 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.087 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.087 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.088 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87030 2024-09-13T05:11:43.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.088 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841890+0000", 2024-09-13T05:11:43.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841890+0000", 2024-09-13T05:11:43.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841890+0000", 2024-09-13T05:11:43.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841892+0000", 2024-09-13T05:11:43.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2220000000000001e-06 2024-09-13T05:11:43.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841899+0000", 2024-09-13T05:11:43.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.396e-06 2024-09-13T05:11:43.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841905+0000", 2024-09-13T05:11:43.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0739999999999998e-06 2024-09-13T05:11:43.090 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.090 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.090 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.090 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:86999 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.090 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.836973+0000", 2024-09-13T05:11:43.090 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.037639594999999998, 2024-09-13T05:11:43.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039334497000000003, 2024-09-13T05:11:43.091 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.091 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.091 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 86999 2024-09-13T05:11:43.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.091 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.836973+0000", 2024-09-13T05:11:43.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.836973+0000", 2024-09-13T05:11:43.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.833372+0000", 2024-09-13T05:11:43.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9963984 2024-09-13T05:11:43.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.836981+0000", 2024-09-13T05:11:43.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036098010000000002 2024-09-13T05:11:43.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.836995+0000", 2024-09-13T05:11:43.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4012000000000001e-05 2024-09-13T05:11:43.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837002+0000", 2024-09-13T05:11:43.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9770000000000003e-06 2024-09-13T05:11:43.093 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.093 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.093 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.094 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87031 3.1a 3.baaa5f7a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.094 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.843243+0000", 2024-09-13T05:11:43.094 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.031369645000000002, 2024-09-13T05:11:43.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.033091203, 2024-09-13T05:11:43.094 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.094 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.094 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.094 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.094 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.094 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87031 2024-09-13T05:11:43.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.094 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.843243+0000", 2024-09-13T05:11:43.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.843243+0000", 2024-09-13T05:11:43.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.841910+0000", 2024-09-13T05:11:43.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9986668 2024-09-13T05:11:43.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.843252+0000", 2024-09-13T05:11:43.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013417290000000001 2024-09-13T05:11:43.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.843268+0000", 2024-09-13T05:11:43.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6082e-05 2024-09-13T05:11:43.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.843281+0000", 2024-09-13T05:11:43.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3463e-05 2024-09-13T05:11:43.097 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.097 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.097 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.097 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87000 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.097 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.837009+0000", 2024-09-13T05:11:43.097 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.037603777999999997, 2024-09-13T05:11:43.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039352867999999999, 2024-09-13T05:11:43.097 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.097 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.098 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87000 2024-09-13T05:11:43.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.098 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837009+0000", 2024-09-13T05:11:43.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837009+0000", 2024-09-13T05:11:43.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837009+0000", 2024-09-13T05:11:43.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837011+0000", 2024-09-13T05:11:43.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6429999999999999e-06 2024-09-13T05:11:43.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837026+0000", 2024-09-13T05:11:43.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4273e-05 2024-09-13T05:11:43.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837031+0000", 2024-09-13T05:11:43.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8799999999999999e-06 2024-09-13T05:11:43.100 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.100 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.100 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.100 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87032 3.1a 3.de01995a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.100 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.843294+0000", 2024-09-13T05:11:43.100 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.031318869999999999, 2024-09-13T05:11:43.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.033094036, 2024-09-13T05:11:43.101 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.101 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.101 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.101 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.101 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.101 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87032 2024-09-13T05:11:43.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.101 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.843294+0000", 2024-09-13T05:11:43.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.843294+0000", 2024-09-13T05:11:43.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.843293+0000", 2024-09-13T05:11:43.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.843299+0000", 2024-09-13T05:11:43.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2870000000000004e-06 2024-09-13T05:11:43.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.843308+0000", 2024-09-13T05:11:43.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9770000000000006e-06 2024-09-13T05:11:43.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.843315+0000", 2024-09-13T05:11:43.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4240000000000004e-06 2024-09-13T05:11:43.103 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.103 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.103 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.104 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87001 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.104 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.837034+0000", 2024-09-13T05:11:43.104 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.037578677999999997, 2024-09-13T05:11:43.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039390445000000003, 2024-09-13T05:11:43.104 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.104 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.104 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.104 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.104 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.104 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87001 2024-09-13T05:11:43.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.104 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837034+0000", 2024-09-13T05:11:43.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837034+0000", 2024-09-13T05:11:43.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837034+0000", 2024-09-13T05:11:43.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837036+0000", 2024-09-13T05:11:43.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2369999999999999e-06 2024-09-13T05:11:43.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837046+0000", 2024-09-13T05:11:43.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0020000000000001e-05 2024-09-13T05:11:43.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837051+0000", 2024-09-13T05:11:43.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3599999999999998e-06 2024-09-13T05:11:43.107 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.107 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.107 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.107 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87033 3.1a 3.baaa5f7a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.107 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.843322+0000", 2024-09-13T05:11:43.107 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.031291118999999999, 2024-09-13T05:11:43.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.033157213999999997, 2024-09-13T05:11:43.107 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.107 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.107 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.107 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.107 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.108 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87033 2024-09-13T05:11:43.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.108 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.843322+0000", 2024-09-13T05:11:43.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.843322+0000", 2024-09-13T05:11:43.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.843321+0000", 2024-09-13T05:11:43.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.843325+0000", 2024-09-13T05:11:43.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7799999999999998e-06 2024-09-13T05:11:43.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.843333+0000", 2024-09-13T05:11:43.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.055e-06 2024-09-13T05:11:43.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.843340+0000", 2024-09-13T05:11:43.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7739999999999999e-06 2024-09-13T05:11:43.110 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.110 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.110 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.110 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87002 3.1a 3.baaa5f7a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.110 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.837054+0000", 2024-09-13T05:11:43.110 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.037559396000000002, 2024-09-13T05:11:43.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.039476719, 2024-09-13T05:11:43.111 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.111 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.111 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.111 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.111 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.111 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87002 2024-09-13T05:11:43.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.111 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837054+0000", 2024-09-13T05:11:43.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837054+0000", 2024-09-13T05:11:43.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837053+0000", 2024-09-13T05:11:43.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837055+0000", 2024-09-13T05:11:43.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9099999999999999e-06 2024-09-13T05:11:43.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837064+0000", 2024-09-13T05:11:43.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3950000000000001e-06 2024-09-13T05:11:43.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.837067+0000", 2024-09-13T05:11:43.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4230000000000001e-06 2024-09-13T05:11:43.113 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.113 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.113 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.114 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:87034 3.1a 3.baaa5f7a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.114 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.843346+0000", 2024-09-13T05:11:43.114 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.031266803000000003, 2024-09-13T05:11:43.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.033237887000000001, 2024-09-13T05:11:43.114 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.114 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.114 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 87034 2024-09-13T05:11:43.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.114 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.843346+0000", 2024-09-13T05:11:43.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.843346+0000", 2024-09-13T05:11:43.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.843346+0000", 2024-09-13T05:11:43.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.843349+0000", 2024-09-13T05:11:43.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4429999999999999e-06 2024-09-13T05:11:43.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.843357+0000", 2024-09-13T05:11:43.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7009999999999996e-06 2024-09-13T05:11:43.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.843363+0000", 2024-09-13T05:11:43.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5429999999999999e-06 2024-09-13T05:11:43.117 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.117 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.117 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.117 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.117 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:11:43.117 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 60 2024-09-13T05:11:43.117 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:43.119 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:11:43.119 INFO:teuthology.orchestra.run.smithi120.stdout:4640 write 0xdcb05aa thru 0xdcb7c10 (0x7667 bytes) 2024-09-13T05:11:43.119 INFO:teuthology.orchestra.run.smithi120.stdout:4641 punch from 0xae3946b to 0xae3e04e, (0x4be3 bytes) 2024-09-13T05:11:43.119 INFO:teuthology.orchestra.run.smithi120.stdout:4643 writesame 0xa810bed thru 0xa819382 data_size 0x82(0x8796 bytes) 2024-09-13T05:11:43.119 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:43.116+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:43.219 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:43.216+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:43.273 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:43.274 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:43.274 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:43.274 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:43.274 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:43.285 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:11:43.330 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:43.328+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:43.401 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:43.401 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:43.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:43.402 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:43.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.402 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26335 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1207296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:43.402 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:43.402 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.667205683999995, 2024-09-13T05:11:43.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055338125000000002, 2024-09-13T05:11:43.403 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.403 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:43.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.403 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26335 2024-09-13T05:11:43.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.403 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:43.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:43.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730550+0000", 2024-09-13T05:11:43.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998579 2024-09-13T05:11:43.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730705+0000", 2024-09-13T05:11:43.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015463400000000001 2024-09-13T05:11:43.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730713+0000", 2024-09-13T05:11:43.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1580000000000005e-06 2024-09-13T05:11:43.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730719+0000", 2024-09-13T05:11:43.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2740000000000004e-06 2024-09-13T05:11:43.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.785798+0000", 2024-09-13T05:11:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055079454 2024-09-13T05:11:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.785894+0000", 2024-09-13T05:11:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5896000000000005e-05 2024-09-13T05:11:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.786030+0000", 2024-09-13T05:11:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013586199999999999 2024-09-13T05:11:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26346 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1308672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.665064276999999, 2024-09-13T05:11:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055416737000000001, 2024-09-13T05:11:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26346 2024-09-13T05:11:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732833+0000", 2024-09-13T05:11:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732835+0000", 2024-09-13T05:11:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3719999999999999e-06 2024-09-13T05:11:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732839+0000", 2024-09-13T05:11:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1520000000000001e-06 2024-09-13T05:11:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732842+0000", 2024-09-13T05:11:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.061e-06 2024-09-13T05:11:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:43.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788126+0000", 2024-09-13T05:11:43.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055284489999999999 2024-09-13T05:11:43.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:43.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788183+0000", 2024-09-13T05:11:43.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7127999999999999e-05 2024-09-13T05:11:43.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:43.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788250+0000", 2024-09-13T05:11:43.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7001000000000004e-05 2024-09-13T05:11:43.414 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.414 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.414 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.415 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26348 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 800768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:43.415 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:43.415 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.664641453000002, 2024-09-13T05:11:43.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055321395000000002, 2024-09-13T05:11:43.415 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.415 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:43.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.417 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.417 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26348 2024-09-13T05:11:43.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.417 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:43.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:43.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733127+0000", 2024-09-13T05:11:43.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998703 2024-09-13T05:11:43.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733262+0000", 2024-09-13T05:11:43.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013484400000000001 2024-09-13T05:11:43.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733273+0000", 2024-09-13T05:11:43.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1824000000000001e-05 2024-09-13T05:11:43.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733281+0000", 2024-09-13T05:11:43.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9999999999999996e-06 2024-09-13T05:11:43.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:43.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788431+0000", 2024-09-13T05:11:43.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055149535 2024-09-13T05:11:43.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:43.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788490+0000", 2024-09-13T05:11:43.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9413999999999997e-05 2024-09-13T05:11:43.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:43.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788578+0000", 2024-09-13T05:11:43.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7418999999999998e-05 2024-09-13T05:11:43.426 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.426 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.426 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.427 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26417 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 903168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:43.427 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:43.427 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.656428996000002, 2024-09-13T05:11:43.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055375191999999997, 2024-09-13T05:11:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26417 2024-09-13T05:11:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741468+0000", 2024-09-13T05:11:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741472+0000", 2024-09-13T05:11:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4139999999999998e-06 2024-09-13T05:11:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741478+0000", 2024-09-13T05:11:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5230000000000001e-06 2024-09-13T05:11:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741483+0000", 2024-09-13T05:11:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8559999999999998e-06 2024-09-13T05:11:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796655+0000", 2024-09-13T05:11:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055172153000000002 2024-09-13T05:11:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796738+0000", 2024-09-13T05:11:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2912999999999997e-05 2024-09-13T05:11:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796844+0000", 2024-09-13T05:11:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105802 2024-09-13T05:11:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26419 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 912384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.656405131, 2024-09-13T05:11:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055570469999999997, 2024-09-13T05:11:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26419 2024-09-13T05:11:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741492+0000", 2024-09-13T05:11:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741495+0000", 2024-09-13T05:11:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6369999999999999e-06 2024-09-13T05:11:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741508+0000", 2024-09-13T05:11:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3319000000000001e-05 2024-09-13T05:11:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741527+0000", 2024-09-13T05:11:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8542e-05 2024-09-13T05:11:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796871+0000", 2024-09-13T05:11:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055344474999999997 2024-09-13T05:11:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796967+0000", 2024-09-13T05:11:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5963000000000003e-05 2024-09-13T05:11:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797063+0000", 2024-09-13T05:11:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5909999999999995e-05 2024-09-13T05:11:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26421 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 921600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.656361828000001, 2024-09-13T05:11:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055631152000000003, 2024-09-13T05:11:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26421 2024-09-13T05:11:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741535+0000", 2024-09-13T05:11:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741540+0000", 2024-09-13T05:11:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1690000000000002e-06 2024-09-13T05:11:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741547+0000", 2024-09-13T05:11:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3409999999999997e-06 2024-09-13T05:11:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741552+0000", 2024-09-13T05:11:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5639999999999996e-06 2024-09-13T05:11:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797079+0000", 2024-09-13T05:11:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055526038999999999 2024-09-13T05:11:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797121+0000", 2024-09-13T05:11:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2156000000000001e-05 2024-09-13T05:11:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797167+0000", 2024-09-13T05:11:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6445e-05 2024-09-13T05:11:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.442 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26423 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 930816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:43.442 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:43.442 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.655968834999996, 2024-09-13T05:11:43.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055364370000000003, 2024-09-13T05:11:43.442 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.442 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:43.442 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.442 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.443 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.443 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26423 2024-09-13T05:11:43.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.443 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:43.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741928+0000", 2024-09-13T05:11:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741933+0000", 2024-09-13T05:11:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9980000000000003e-06 2024-09-13T05:11:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741945+0000", 2024-09-13T05:11:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1761e-05 2024-09-13T05:11:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741958+0000", 2024-09-13T05:11:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2604e-05 2024-09-13T05:11:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797185+0000", 2024-09-13T05:11:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055227169 2024-09-13T05:11:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797226+0000", 2024-09-13T05:11:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1619000000000003e-05 2024-09-13T05:11:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797293+0000", 2024-09-13T05:11:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6952999999999994e-05 2024-09-13T05:11:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26424 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 940032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.655931898000006, 2024-09-13T05:11:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055448669999999999, 2024-09-13T05:11:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26424 2024-09-13T05:11:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741965+0000", 2024-09-13T05:11:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741969+0000", 2024-09-13T05:11:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3440000000000001e-06 2024-09-13T05:11:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741983+0000", 2024-09-13T05:11:43.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4600000000000001e-05 2024-09-13T05:11:43.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741989+0000", 2024-09-13T05:11:43.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5350000000000004e-06 2024-09-13T05:11:43.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:43.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797319+0000", 2024-09-13T05:11:43.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055330121000000003 2024-09-13T05:11:43.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:43.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797364+0000", 2024-09-13T05:11:43.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5670000000000002e-05 2024-09-13T05:11:43.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:43.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797415+0000", 2024-09-13T05:11:43.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0124000000000003e-05 2024-09-13T05:11:43.451 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.451 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.451 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.452 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26426 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 949248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:43.452 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:43.452 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.655904699000004, 2024-09-13T05:11:43.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055639981999999998, 2024-09-13T05:11:43.452 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.452 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:43.452 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.452 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.452 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.452 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26426 2024-09-13T05:11:43.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.452 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:43.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:43.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:43.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741995+0000", 2024-09-13T05:11:43.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.661e-06 2024-09-13T05:11:43.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742004+0000", 2024-09-13T05:11:43.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2009999999999999e-06 2024-09-13T05:11:43.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742008+0000", 2024-09-13T05:11:43.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7890000000000002e-06 2024-09-13T05:11:43.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:43.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797432+0000", 2024-09-13T05:11:43.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055423448 2024-09-13T05:11:43.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:43.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797516+0000", 2024-09-13T05:11:43.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4404e-05 2024-09-13T05:11:43.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:43.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797633+0000", 2024-09-13T05:11:43.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116898 2024-09-13T05:11:43.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.456 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.456 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26427 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 958464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:43.456 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:43.456 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.655884642999993, 2024-09-13T05:11:43.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055829295000000001, 2024-09-13T05:11:43.456 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.456 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:43.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.457 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26427 2024-09-13T05:11:43.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.457 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:43.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:43.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:43.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742015+0000", 2024-09-13T05:11:43.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.74e-06 2024-09-13T05:11:43.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742023+0000", 2024-09-13T05:11:43.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7039999999999994e-06 2024-09-13T05:11:43.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742028+0000", 2024-09-13T05:11:43.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7369999999999997e-06 2024-09-13T05:11:43.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:43.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797666+0000", 2024-09-13T05:11:43.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055637820999999997 2024-09-13T05:11:43.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:43.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797748+0000", 2024-09-13T05:11:43.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1787999999999997e-05 2024-09-13T05:11:43.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:43.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797842+0000", 2024-09-13T05:11:43.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4903999999999998e-05 2024-09-13T05:11:43.460 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.460 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.461 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.461 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26432 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 976896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:43.461 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:43.461 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.655091482000003, 2024-09-13T05:11:43.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055402077000000001, 2024-09-13T05:11:43.461 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.461 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:43.461 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.461 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.461 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.461 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26432 2024-09-13T05:11:43.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.462 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:43.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:43.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:43.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742808+0000", 2024-09-13T05:11:43.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3319999999999999e-06 2024-09-13T05:11:43.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742818+0000", 2024-09-13T05:11:43.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5380000000000008e-06 2024-09-13T05:11:43.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742821+0000", 2024-09-13T05:11:43.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2179999999999999e-06 2024-09-13T05:11:43.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:43.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798027+0000", 2024-09-13T05:11:43.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055206344999999997 2024-09-13T05:11:43.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:43.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798103+0000", 2024-09-13T05:11:43.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5786999999999998e-05 2024-09-13T05:11:43.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:43.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798208+0000", 2024-09-13T05:11:43.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010521700000000001 2024-09-13T05:11:43.465 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.465 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.465 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.466 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26434 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 986112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:43.466 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:43.466 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.655074257999999, 2024-09-13T05:11:43.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055610109999999997, 2024-09-13T05:11:43.466 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.466 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:43.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.467 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26434 2024-09-13T05:11:43.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.467 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:43.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:43.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742823+0000", 2024-09-13T05:11:43.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:43.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742825+0000", 2024-09-13T05:11:43.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6220000000000001e-06 2024-09-13T05:11:43.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742828+0000", 2024-09-13T05:11:43.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.926e-06 2024-09-13T05:11:43.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742831+0000", 2024-09-13T05:11:43.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-13T05:11:43.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:43.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798239+0000", 2024-09-13T05:11:43.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055408254999999997 2024-09-13T05:11:43.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:43.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798326+0000", 2024-09-13T05:11:43.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7168000000000003e-05 2024-09-13T05:11:43.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:43.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798434+0000", 2024-09-13T05:11:43.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010767100000000001 2024-09-13T05:11:43.471 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.471 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.471 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.471 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26442 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1032192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:43.471 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:43.471 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.653804918000006, 2024-09-13T05:11:43.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055422776, 2024-09-13T05:11:43.471 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.471 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:43.471 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.472 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.472 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.472 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26442 2024-09-13T05:11:43.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.472 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:43.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:43.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744061+0000", 2024-09-13T05:11:43.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999685 2024-09-13T05:11:43.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744096+0000", 2024-09-13T05:11:43.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4771999999999998e-05 2024-09-13T05:11:43.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744147+0000", 2024-09-13T05:11:43.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0696999999999999e-05 2024-09-13T05:11:43.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744154+0000", 2024-09-13T05:11:43.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8510000000000001e-06 2024-09-13T05:11:43.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:43.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799324+0000", 2024-09-13T05:11:43.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055170074999999999 2024-09-13T05:11:43.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:43.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799415+0000", 2024-09-13T05:11:43.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1197000000000001e-05 2024-09-13T05:11:43.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:43.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799516+0000", 2024-09-13T05:11:43.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100666 2024-09-13T05:11:43.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.476 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.477 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26443 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1041408~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:43.477 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:43.477 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.653524347000001, 2024-09-13T05:11:43.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055344195999999998, 2024-09-13T05:11:43.477 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.477 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:43.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.477 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26443 2024-09-13T05:11:43.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.477 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:43.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:43.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744159+0000", 2024-09-13T05:11:43.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997849 2024-09-13T05:11:43.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744379+0000", 2024-09-13T05:11:43.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022024800000000001 2024-09-13T05:11:43.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744390+0000", 2024-09-13T05:11:43.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1105e-05 2024-09-13T05:11:43.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744397+0000", 2024-09-13T05:11:43.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2740000000000002e-06 2024-09-13T05:11:43.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:43.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799543+0000", 2024-09-13T05:11:43.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055145441000000003 2024-09-13T05:11:43.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:43.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799619+0000", 2024-09-13T05:11:43.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6660000000000001e-05 2024-09-13T05:11:43.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:43.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799718+0000", 2024-09-13T05:11:43.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8331000000000004e-05 2024-09-13T05:11:43.481 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.481 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.481 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.481 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26547 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1318912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:43.481 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:43.481 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.653338028999997, 2024-09-13T05:11:43.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055355834, 2024-09-13T05:11:43.481 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.481 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:43.482 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.482 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.482 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.482 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26547 2024-09-13T05:11:43.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.482 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:43.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:43.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744404+0000", 2024-09-13T05:11:43.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998441 2024-09-13T05:11:43.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744564+0000", 2024-09-13T05:11:43.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016022200000000001 2024-09-13T05:11:43.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744579+0000", 2024-09-13T05:11:43.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5036e-05 2024-09-13T05:11:43.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744585+0000", 2024-09-13T05:11:43.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7880000000000003e-06 2024-09-13T05:11:43.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:43.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799747+0000", 2024-09-13T05:11:43.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055161804000000002 2024-09-13T05:11:43.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:43.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799823+0000", 2024-09-13T05:11:43.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5956000000000003e-05 2024-09-13T05:11:43.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:43.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799916+0000", 2024-09-13T05:11:43.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2733999999999997e-05 2024-09-13T05:11:43.485 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.485 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.485 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.486 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26558 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1364992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:43.486 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:43.486 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.652346863000005, 2024-09-13T05:11:43.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055422765999999998, 2024-09-13T05:11:43.486 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.486 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:43.486 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.486 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.486 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.486 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26558 2024-09-13T05:11:43.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.486 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:43.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:43.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745550+0000", 2024-09-13T05:11:43.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745553+0000", 2024-09-13T05:11:43.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7690000000000001e-06 2024-09-13T05:11:43.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745559+0000", 2024-09-13T05:11:43.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3149999999999997e-06 2024-09-13T05:11:43.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745564+0000", 2024-09-13T05:11:43.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6670000000000004e-06 2024-09-13T05:11:43.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:43.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800791+0000", 2024-09-13T05:11:43.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055226711999999997 2024-09-13T05:11:43.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:43.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800865+0000", 2024-09-13T05:11:43.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4344000000000005e-05 2024-09-13T05:11:43.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:43.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800974+0000", 2024-09-13T05:11:43.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108606 2024-09-13T05:11:43.490 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.490 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.490 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.490 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26561 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1374208~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:43.490 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:43.490 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.652329809999998, 2024-09-13T05:11:43.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055549315000000002, 2024-09-13T05:11:43.491 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.491 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:43.491 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.491 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.491 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.491 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26561 2024-09-13T05:11:43.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.491 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:43.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:43.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:43.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745570+0000", 2024-09-13T05:11:43.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4719999999999998e-06 2024-09-13T05:11:43.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745575+0000", 2024-09-13T05:11:43.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1900000000000003e-06 2024-09-13T05:11:43.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745579+0000", 2024-09-13T05:11:43.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3250000000000001e-06 2024-09-13T05:11:43.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:43.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801000+0000", 2024-09-13T05:11:43.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055420432999999998 2024-09-13T05:11:43.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:43.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801061+0000", 2024-09-13T05:11:43.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1427000000000007e-05 2024-09-13T05:11:43.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:43.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801117+0000", 2024-09-13T05:11:43.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5933000000000001e-05 2024-09-13T05:11:43.495 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.495 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.495 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.495 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26582 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1447936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:43.495 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:43.495 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.650912169999998, 2024-09-13T05:11:43.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055394301, 2024-09-13T05:11:43.495 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.495 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:43.495 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.495 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.496 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.496 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26582 2024-09-13T05:11:43.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.496 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:43.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:43.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746985+0000", 2024-09-13T05:11:43.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746988+0000", 2024-09-13T05:11:43.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6479999999999999e-06 2024-09-13T05:11:43.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.747000+0000", 2024-09-13T05:11:43.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2009e-05 2024-09-13T05:11:43.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.747005+0000", 2024-09-13T05:11:43.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0039999999999999e-06 2024-09-13T05:11:43.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:43.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802232+0000", 2024-09-13T05:11:43.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055227762999999999 2024-09-13T05:11:43.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:43.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802320+0000", 2024-09-13T05:11:43.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7576000000000003e-05 2024-09-13T05:11:43.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:43.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802380+0000", 2024-09-13T05:11:43.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9888e-05 2024-09-13T05:11:43.499 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.499 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.500 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.500 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:83780 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 5966848~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.500 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.161271+0000", 2024-09-13T05:11:43.500 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.2366267010000001, 2024-09-13T05:11:43.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055549792000000001, 2024-09-13T05:11:43.500 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.500 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:43.500 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.500 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.500 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.500 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83780 2024-09-13T05:11:43.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.501 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.161271+0000", 2024-09-13T05:11:43.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.161271+0000", 2024-09-13T05:11:43.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.161271+0000", 2024-09-13T05:11:43.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.161272+0000", 2024-09-13T05:11:43.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.576e-06 2024-09-13T05:11:43.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.161276+0000", 2024-09-13T05:11:43.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4999999999999999e-06 2024-09-13T05:11:43.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.161279+0000", 2024-09-13T05:11:43.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.168e-06 2024-09-13T05:11:43.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:43.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.216618+0000", 2024-09-13T05:11:43.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055339243000000003 2024-09-13T05:11:43.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:43.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.216729+0000", 2024-09-13T05:11:43.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111097 2024-09-13T05:11:43.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:43.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.216821+0000", 2024-09-13T05:11:43.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1502000000000006e-05 2024-09-13T05:11:43.504 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.504 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.504 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.504 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:83795 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 6181888~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:43.504 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.165224+0000", 2024-09-13T05:11:43.505 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.232674118, 2024-09-13T05:11:43.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055538606999999997, 2024-09-13T05:11:43.505 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.505 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:43.505 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.505 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.505 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.505 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83795 2024-09-13T05:11:43.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.505 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.165224+0000", 2024-09-13T05:11:43.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.165224+0000", 2024-09-13T05:11:43.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.165223+0000", 2024-09-13T05:11:43.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.165225+0000", 2024-09-13T05:11:43.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7379999999999999e-06 2024-09-13T05:11:43.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.165228+0000", 2024-09-13T05:11:43.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.191e-06 2024-09-13T05:11:43.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.165231+0000", 2024-09-13T05:11:43.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.101e-06 2024-09-13T05:11:43.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:43.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.220588+0000", 2024-09-13T05:11:43.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055356764000000003 2024-09-13T05:11:43.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:43.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.220681+0000", 2024-09-13T05:11:43.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2467999999999996e-05 2024-09-13T05:11:43.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:43.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.220762+0000", 2024-09-13T05:11:43.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1722000000000001e-05 2024-09-13T05:11:43.509 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.509 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.509 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.509 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.509 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.509 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:43.510 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:11:43.511 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:43.505+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:43.606 INFO:teuthology.orchestra.run.smithi120.stdout:4645 read 0xcaaad0e thru 0xcab3a4d (0x8d40 bytes) 2024-09-13T05:11:43.606 INFO:teuthology.orchestra.run.smithi120.stdout:4646 read 0xadeb409 thru 0xadf863b (0xd233 bytes) 2024-09-13T05:11:43.611 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:43.608+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:43.638 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:43.639 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:43.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.639 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90866 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.639 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610601+0000", 2024-09-13T05:11:43.639 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0084325689999999991, 2024-09-13T05:11:43.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084528499999999996, 2024-09-13T05:11:43.639 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.639 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.639 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.639 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.639 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.639 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90866 2024-09-13T05:11:43.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.640 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610601+0000", 2024-09-13T05:11:43.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610601+0000", 2024-09-13T05:11:43.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610601+0000", 2024-09-13T05:11:43.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610604+0000", 2024-09-13T05:11:43.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9409999999999999e-06 2024-09-13T05:11:43.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610610+0000", 2024-09-13T05:11:43.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3239999999999999e-06 2024-09-13T05:11:43.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610617+0000", 2024-09-13T05:11:43.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0149999999999998e-06 2024-09-13T05:11:43.642 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.642 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.642 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.642 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90898 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.642 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.612261+0000", 2024-09-13T05:11:43.642 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0067723530000000001, 2024-09-13T05:11:43.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068395929999999997, 2024-09-13T05:11:43.642 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.642 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.643 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90898 2024-09-13T05:11:43.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.643 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612261+0000", 2024-09-13T05:11:43.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612261+0000", 2024-09-13T05:11:43.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612260+0000", 2024-09-13T05:11:43.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:43.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612267+0000", 2024-09-13T05:11:43.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8850000000000001e-06 2024-09-13T05:11:43.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612281+0000", 2024-09-13T05:11:43.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4425e-05 2024-09-13T05:11:43.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612292+0000", 2024-09-13T05:11:43.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0572e-05 2024-09-13T05:11:43.645 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.645 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.645 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.646 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90930 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.646 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613793+0000", 2024-09-13T05:11:43.646 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0052405710000000003, 2024-09-13T05:11:43.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053472240000000002, 2024-09-13T05:11:43.646 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.646 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.646 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.646 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.646 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.646 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90930 2024-09-13T05:11:43.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613793+0000", 2024-09-13T05:11:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613793+0000", 2024-09-13T05:11:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613792+0000", 2024-09-13T05:11:43.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613797+0000", 2024-09-13T05:11:43.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0220000000000004e-06 2024-09-13T05:11:43.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613809+0000", 2024-09-13T05:11:43.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.148e-05 2024-09-13T05:11:43.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613818+0000", 2024-09-13T05:11:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.363e-06 2024-09-13T05:11:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90962 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614721+0000", 2024-09-13T05:11:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0043127110000000003, 2024-09-13T05:11:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004459757, 2024-09-13T05:11:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.650 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.650 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90962 2024-09-13T05:11:43.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.650 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614721+0000", 2024-09-13T05:11:43.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614721+0000", 2024-09-13T05:11:43.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614720+0000", 2024-09-13T05:11:43.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614723+0000", 2024-09-13T05:11:43.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.948e-06 2024-09-13T05:11:43.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614729+0000", 2024-09-13T05:11:43.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7919999999999998e-06 2024-09-13T05:11:43.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614734+0000", 2024-09-13T05:11:43.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0780000000000003e-06 2024-09-13T05:11:43.652 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.652 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.652 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.652 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90994 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.652 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615388+0000", 2024-09-13T05:11:43.652 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003645279, 2024-09-13T05:11:43.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038301989999999998, 2024-09-13T05:11:43.652 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.653 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.653 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.653 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.653 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.653 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90994 2024-09-13T05:11:43.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.653 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615388+0000", 2024-09-13T05:11:43.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615388+0000", 2024-09-13T05:11:43.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615388+0000", 2024-09-13T05:11:43.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615394+0000", 2024-09-13T05:11:43.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0850000000000002e-06 2024-09-13T05:11:43.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615402+0000", 2024-09-13T05:11:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3669999999999997e-06 2024-09-13T05:11:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615407+0000", 2024-09-13T05:11:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1800000000000004e-06 2024-09-13T05:11:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91026 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.655 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615993+0000", 2024-09-13T05:11:43.656 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0030408179999999998, 2024-09-13T05:11:43.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032650769999999999, 2024-09-13T05:11:43.656 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.656 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.656 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.656 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.656 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.656 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91026 2024-09-13T05:11:43.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.656 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615993+0000", 2024-09-13T05:11:43.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615993+0000", 2024-09-13T05:11:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615992+0000", 2024-09-13T05:11:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615994+0000", 2024-09-13T05:11:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5e-06 2024-09-13T05:11:43.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615997+0000", 2024-09-13T05:11:43.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8380000000000002e-06 2024-09-13T05:11:43.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615999+0000", 2024-09-13T05:11:43.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4619999999999999e-06 2024-09-13T05:11:43.658 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.658 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.658 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.659 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90867 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.659 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610622+0000", 2024-09-13T05:11:43.659 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0084111059999999998, 2024-09-13T05:11:43.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086736279999999992, 2024-09-13T05:11:43.659 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.659 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.659 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90867 2024-09-13T05:11:43.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.659 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610622+0000", 2024-09-13T05:11:43.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610622+0000", 2024-09-13T05:11:43.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610622+0000", 2024-09-13T05:11:43.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610625+0000", 2024-09-13T05:11:43.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7590000000000002e-06 2024-09-13T05:11:43.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610631+0000", 2024-09-13T05:11:43.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9780000000000002e-06 2024-09-13T05:11:43.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610636+0000", 2024-09-13T05:11:43.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0930000000000002e-06 2024-09-13T05:11:43.661 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.662 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.662 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.662 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90899 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.662 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.612301+0000", 2024-09-13T05:11:43.662 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0067321179999999996, 2024-09-13T05:11:43.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070331819999999998, 2024-09-13T05:11:43.662 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.662 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.662 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.662 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.662 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.662 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90899 2024-09-13T05:11:43.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612301+0000", 2024-09-13T05:11:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612301+0000", 2024-09-13T05:11:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612301+0000", 2024-09-13T05:11:43.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612306+0000", 2024-09-13T05:11:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0579999999999997e-06 2024-09-13T05:11:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612317+0000", 2024-09-13T05:11:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1649e-05 2024-09-13T05:11:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612336+0000", 2024-09-13T05:11:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8708000000000001e-05 2024-09-13T05:11:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90931 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613826+0000", 2024-09-13T05:11:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0052072489999999997, 2024-09-13T05:11:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055459439999999997, 2024-09-13T05:11:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.665 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90931 2024-09-13T05:11:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613826+0000", 2024-09-13T05:11:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613826+0000", 2024-09-13T05:11:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613826+0000", 2024-09-13T05:11:43.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613831+0000", 2024-09-13T05:11:43.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1800000000000004e-06 2024-09-13T05:11:43.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613842+0000", 2024-09-13T05:11:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.148e-05 2024-09-13T05:11:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613852+0000", 2024-09-13T05:11:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0145e-05 2024-09-13T05:11:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90963 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614764+0000", 2024-09-13T05:11:43.668 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0042694899999999999, 2024-09-13T05:11:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046486679999999999, 2024-09-13T05:11:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90963 2024-09-13T05:11:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614764+0000", 2024-09-13T05:11:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614764+0000", 2024-09-13T05:11:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614763+0000", 2024-09-13T05:11:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614766+0000", 2024-09-13T05:11:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0649999999999999e-06 2024-09-13T05:11:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614773+0000", 2024-09-13T05:11:43.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2369999999999997e-06 2024-09-13T05:11:43.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614778+0000", 2024-09-13T05:11:43.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-09-13T05:11:43.671 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.671 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.671 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.671 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90995 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615413+0000", 2024-09-13T05:11:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0036206189999999998, 2024-09-13T05:11:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040376600000000002, 2024-09-13T05:11:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90995 2024-09-13T05:11:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615413+0000", 2024-09-13T05:11:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615413+0000", 2024-09-13T05:11:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615412+0000", 2024-09-13T05:11:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615415+0000", 2024-09-13T05:11:43.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7530000000000002e-06 2024-09-13T05:11:43.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615421+0000", 2024-09-13T05:11:43.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9950000000000002e-06 2024-09-13T05:11:43.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615426+0000", 2024-09-13T05:11:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0479999999999998e-06 2024-09-13T05:11:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91027 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.616002+0000", 2024-09-13T05:11:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0030319520000000001, 2024-09-13T05:11:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034865109999999999, 2024-09-13T05:11:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.675 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91027 2024-09-13T05:11:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616002+0000", 2024-09-13T05:11:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616002+0000", 2024-09-13T05:11:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616001+0000", 2024-09-13T05:11:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616003+0000", 2024-09-13T05:11:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.469e-06 2024-09-13T05:11:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616006+0000", 2024-09-13T05:11:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8229999999999999e-06 2024-09-13T05:11:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616008+0000", 2024-09-13T05:11:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8100000000000002e-06 2024-09-13T05:11:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90804 3.19 3.affa599 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609216+0000", 2024-09-13T05:11:43.678 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0098177160000000006, 2024-09-13T05:11:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010310203, 2024-09-13T05:11:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90804 2024-09-13T05:11:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609216+0000", 2024-09-13T05:11:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609216+0000", 2024-09-13T05:11:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609215+0000", 2024-09-13T05:11:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609218+0000", 2024-09-13T05:11:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6680000000000001e-06 2024-09-13T05:11:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609224+0000", 2024-09-13T05:11:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0349999999999998e-06 2024-09-13T05:11:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609230+0000", 2024-09-13T05:11:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4750000000000001e-06 2024-09-13T05:11:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90836 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609919+0000", 2024-09-13T05:11:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0091146649999999992, 2024-09-13T05:11:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096454690000000003, 2024-09-13T05:11:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90836 2024-09-13T05:11:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.682 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609919+0000", 2024-09-13T05:11:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609919+0000", 2024-09-13T05:11:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609918+0000", 2024-09-13T05:11:43.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609926+0000", 2024-09-13T05:11:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4329999999999998e-06 2024-09-13T05:11:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609932+0000", 2024-09-13T05:11:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5880000000000003e-06 2024-09-13T05:11:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609938+0000", 2024-09-13T05:11:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6080000000000003e-06 2024-09-13T05:11:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90868 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610641+0000", 2024-09-13T05:11:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0083927180000000004, 2024-09-13T05:11:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089618230000000007, 2024-09-13T05:11:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.685 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90868 2024-09-13T05:11:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610641+0000", 2024-09-13T05:11:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610641+0000", 2024-09-13T05:11:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610640+0000", 2024-09-13T05:11:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610643+0000", 2024-09-13T05:11:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6840000000000001e-06 2024-09-13T05:11:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610649+0000", 2024-09-13T05:11:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1739999999999997e-06 2024-09-13T05:11:43.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610654+0000", 2024-09-13T05:11:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1440000000000002e-06 2024-09-13T05:11:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90900 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.612348+0000", 2024-09-13T05:11:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0066857629999999999, 2024-09-13T05:11:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072923570000000002, 2024-09-13T05:11:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.688 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90900 2024-09-13T05:11:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612348+0000", 2024-09-13T05:11:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612348+0000", 2024-09-13T05:11:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612347+0000", 2024-09-13T05:11:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612352+0000", 2024-09-13T05:11:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0900000000000004e-06 2024-09-13T05:11:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612364+0000", 2024-09-13T05:11:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1729000000000001e-05 2024-09-13T05:11:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612378+0000", 2024-09-13T05:11:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4605e-05 2024-09-13T05:11:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90932 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613861+0000", 2024-09-13T05:11:43.691 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0051720860000000002, 2024-09-13T05:11:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058165439999999999, 2024-09-13T05:11:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90932 2024-09-13T05:11:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613861+0000", 2024-09-13T05:11:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613861+0000", 2024-09-13T05:11:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613860+0000", 2024-09-13T05:11:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613865+0000", 2024-09-13T05:11:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8080000000000004e-06 2024-09-13T05:11:43.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613877+0000", 2024-09-13T05:11:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2102e-05 2024-09-13T05:11:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613887+0000", 2024-09-13T05:11:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8989999999999996e-06 2024-09-13T05:11:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90964 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614783+0000", 2024-09-13T05:11:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0042502399999999997, 2024-09-13T05:11:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004932128, 2024-09-13T05:11:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90964 2024-09-13T05:11:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614783+0000", 2024-09-13T05:11:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614783+0000", 2024-09-13T05:11:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614783+0000", 2024-09-13T05:11:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614786+0000", 2024-09-13T05:11:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9100000000000001e-06 2024-09-13T05:11:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614791+0000", 2024-09-13T05:11:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.806e-06 2024-09-13T05:11:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614796+0000", 2024-09-13T05:11:43.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0969999999999996e-06 2024-09-13T05:11:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90996 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615431+0000", 2024-09-13T05:11:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0036026439999999999, 2024-09-13T05:11:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043261710000000002, 2024-09-13T05:11:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.698 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90996 2024-09-13T05:11:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615431+0000", 2024-09-13T05:11:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615431+0000", 2024-09-13T05:11:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615430+0000", 2024-09-13T05:11:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615433+0000", 2024-09-13T05:11:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:11:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615439+0000", 2024-09-13T05:11:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.925e-06 2024-09-13T05:11:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615444+0000", 2024-09-13T05:11:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9300000000000002e-06 2024-09-13T05:11:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91028 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.616036+0000", 2024-09-13T05:11:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0029979730000000001, 2024-09-13T05:11:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037590570000000001, 2024-09-13T05:11:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.701 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91028 2024-09-13T05:11:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616036+0000", 2024-09-13T05:11:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616036+0000", 2024-09-13T05:11:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616035+0000", 2024-09-13T05:11:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616037+0000", 2024-09-13T05:11:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0389999999999999e-06 2024-09-13T05:11:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616041+0000", 2024-09-13T05:11:43.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4039999999999999e-06 2024-09-13T05:11:43.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616045+0000", 2024-09-13T05:11:43.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1239999999999998e-06 2024-09-13T05:11:43.704 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.704 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.704 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.704 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90805 3.19 3.affa599 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.704 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609235+0000", 2024-09-13T05:11:43.704 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0097989830000000007, 2024-09-13T05:11:43.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010597885, 2024-09-13T05:11:43.704 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.705 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.705 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.705 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.705 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.705 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90805 2024-09-13T05:11:43.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.705 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609235+0000", 2024-09-13T05:11:43.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609235+0000", 2024-09-13T05:11:43.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609234+0000", 2024-09-13T05:11:43.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609237+0000", 2024-09-13T05:11:43.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.999e-06 2024-09-13T05:11:43.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609243+0000", 2024-09-13T05:11:43.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2550000000000003e-06 2024-09-13T05:11:43.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609248+0000", 2024-09-13T05:11:43.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3319999999999999e-06 2024-09-13T05:11:43.707 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.707 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.707 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.707 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90837 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.707 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609943+0000", 2024-09-13T05:11:43.707 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0090906040000000004, 2024-09-13T05:11:43.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0099275209999999999, 2024-09-13T05:11:43.708 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.708 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.708 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90837 2024-09-13T05:11:43.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.708 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609943+0000", 2024-09-13T05:11:43.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609943+0000", 2024-09-13T05:11:43.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609942+0000", 2024-09-13T05:11:43.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609945+0000", 2024-09-13T05:11:43.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7779999999999999e-06 2024-09-13T05:11:43.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609951+0000", 2024-09-13T05:11:43.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9229999999999999e-06 2024-09-13T05:11:43.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609956+0000", 2024-09-13T05:11:43.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.853e-06 2024-09-13T05:11:43.710 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.710 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.710 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.711 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90869 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.711 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610659+0000", 2024-09-13T05:11:43.711 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0083744760000000005, 2024-09-13T05:11:43.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092491989999999996, 2024-09-13T05:11:43.711 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.711 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.711 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90869 2024-09-13T05:11:43.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.711 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610659+0000", 2024-09-13T05:11:43.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610659+0000", 2024-09-13T05:11:43.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610659+0000", 2024-09-13T05:11:43.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610661+0000", 2024-09-13T05:11:43.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5610000000000001e-06 2024-09-13T05:11:43.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610667+0000", 2024-09-13T05:11:43.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0270000000000001e-06 2024-09-13T05:11:43.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610673+0000", 2024-09-13T05:11:43.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1979999999999998e-06 2024-09-13T05:11:43.713 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.713 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.714 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.714 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90901 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.714 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.612392+0000", 2024-09-13T05:11:43.714 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0066413440000000004, 2024-09-13T05:11:43.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0075540310000000001, 2024-09-13T05:11:43.714 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.714 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.714 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.714 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.714 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.714 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90901 2024-09-13T05:11:43.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.714 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612392+0000", 2024-09-13T05:11:43.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612392+0000", 2024-09-13T05:11:43.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612391+0000", 2024-09-13T05:11:43.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612396+0000", 2024-09-13T05:11:43.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0719999999999999e-06 2024-09-13T05:11:43.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612432+0000", 2024-09-13T05:11:43.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5267e-05 2024-09-13T05:11:43.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612452+0000", 2024-09-13T05:11:43.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0004e-05 2024-09-13T05:11:43.717 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.717 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.717 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.717 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90933 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.717 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613898+0000", 2024-09-13T05:11:43.717 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0051350160000000001, 2024-09-13T05:11:43.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060854739999999996, 2024-09-13T05:11:43.717 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.717 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.717 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.718 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.718 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.718 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90933 2024-09-13T05:11:43.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.718 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613898+0000", 2024-09-13T05:11:43.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613898+0000", 2024-09-13T05:11:43.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613898+0000", 2024-09-13T05:11:43.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613903+0000", 2024-09-13T05:11:43.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8999999999999997e-06 2024-09-13T05:11:43.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613914+0000", 2024-09-13T05:11:43.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1681999999999999e-05 2024-09-13T05:11:43.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613924+0000", 2024-09-13T05:11:43.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7459999999999995e-06 2024-09-13T05:11:43.720 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.720 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.721 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.721 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90965 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.721 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614801+0000", 2024-09-13T05:11:43.721 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0042321360000000001, 2024-09-13T05:11:43.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052204440000000003, 2024-09-13T05:11:43.721 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.721 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.721 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.721 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.721 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.721 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90965 2024-09-13T05:11:43.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.722 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614801+0000", 2024-09-13T05:11:43.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614801+0000", 2024-09-13T05:11:43.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614801+0000", 2024-09-13T05:11:43.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614804+0000", 2024-09-13T05:11:43.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8499999999999998e-06 2024-09-13T05:11:43.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614809+0000", 2024-09-13T05:11:43.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6899999999999997e-06 2024-09-13T05:11:43.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614814+0000", 2024-09-13T05:11:43.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9389999999999996e-06 2024-09-13T05:11:43.724 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.724 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.724 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.724 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90997 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.724 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615448+0000", 2024-09-13T05:11:43.724 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0035851870000000001, 2024-09-13T05:11:43.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046111320000000004, 2024-09-13T05:11:43.724 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.724 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.725 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.725 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.725 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.725 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90997 2024-09-13T05:11:43.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.725 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615448+0000", 2024-09-13T05:11:43.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615448+0000", 2024-09-13T05:11:43.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615448+0000", 2024-09-13T05:11:43.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615451+0000", 2024-09-13T05:11:43.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6879999999999999e-06 2024-09-13T05:11:43.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615456+0000", 2024-09-13T05:11:43.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8869999999999997e-06 2024-09-13T05:11:43.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615463+0000", 2024-09-13T05:11:43.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1099999999999999e-06 2024-09-13T05:11:43.728 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.728 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.728 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.728 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91029 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.729 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.616047+0000", 2024-09-13T05:11:43.729 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0029864650000000002, 2024-09-13T05:11:43.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040501959999999998, 2024-09-13T05:11:43.729 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.729 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.729 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91029 2024-09-13T05:11:43.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.729 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616047+0000", 2024-09-13T05:11:43.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616047+0000", 2024-09-13T05:11:43.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616047+0000", 2024-09-13T05:11:43.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616048+0000", 2024-09-13T05:11:43.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.857e-06 2024-09-13T05:11:43.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616053+0000", 2024-09-13T05:11:43.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.092e-06 2024-09-13T05:11:43.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616055+0000", 2024-09-13T05:11:43.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5720000000000001e-06 2024-09-13T05:11:43.731 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.732 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.732 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.732 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90806 3.19 3.affa599 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.732 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609253+0000", 2024-09-13T05:11:43.732 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00978067, 2024-09-13T05:11:43.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010882523, 2024-09-13T05:11:43.732 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.732 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.733 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90806 2024-09-13T05:11:43.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.733 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609253+0000", 2024-09-13T05:11:43.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609253+0000", 2024-09-13T05:11:43.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609252+0000", 2024-09-13T05:11:43.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609255+0000", 2024-09-13T05:11:43.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4990000000000001e-06 2024-09-13T05:11:43.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609261+0000", 2024-09-13T05:11:43.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-09-13T05:11:43.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609266+0000", 2024-09-13T05:11:43.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1889999999999998e-06 2024-09-13T05:11:43.735 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.735 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.735 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.735 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90838 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.735 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609960+0000", 2024-09-13T05:11:43.735 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0090731939999999997, 2024-09-13T05:11:43.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010213547, 2024-09-13T05:11:43.736 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.736 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.736 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90838 2024-09-13T05:11:43.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.736 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609960+0000", 2024-09-13T05:11:43.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609960+0000", 2024-09-13T05:11:43.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609960+0000", 2024-09-13T05:11:43.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609963+0000", 2024-09-13T05:11:43.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8449999999999999e-06 2024-09-13T05:11:43.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609969+0000", 2024-09-13T05:11:43.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2600000000000002e-06 2024-09-13T05:11:43.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609974+0000", 2024-09-13T05:11:43.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2490000000000001e-06 2024-09-13T05:11:43.738 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.738 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.738 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.739 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90870 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.739 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610678+0000", 2024-09-13T05:11:43.739 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0083552309999999994, 2024-09-13T05:11:43.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095337830000000005, 2024-09-13T05:11:43.739 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.739 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.739 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.739 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.739 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.739 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90870 2024-09-13T05:11:43.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.739 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610678+0000", 2024-09-13T05:11:43.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610678+0000", 2024-09-13T05:11:43.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610678+0000", 2024-09-13T05:11:43.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610681+0000", 2024-09-13T05:11:43.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6400000000000001e-06 2024-09-13T05:11:43.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610687+0000", 2024-09-13T05:11:43.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0630000000000002e-06 2024-09-13T05:11:43.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610692+0000", 2024-09-13T05:11:43.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0189999999999997e-06 2024-09-13T05:11:43.742 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.742 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.742 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.742 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90902 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.742 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.612463+0000", 2024-09-13T05:11:43.742 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0065708770000000001, 2024-09-13T05:11:43.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0077898799999999999, 2024-09-13T05:11:43.742 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.742 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.742 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.742 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.743 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.743 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90902 2024-09-13T05:11:43.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.743 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612463+0000", 2024-09-13T05:11:43.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612463+0000", 2024-09-13T05:11:43.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612462+0000", 2024-09-13T05:11:43.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612467+0000", 2024-09-13T05:11:43.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.48e-06 2024-09-13T05:11:43.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612490+0000", 2024-09-13T05:11:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2949e-05 2024-09-13T05:11:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612500+0000", 2024-09-13T05:11:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0316000000000001e-05 2024-09-13T05:11:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90934 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613941+0000", 2024-09-13T05:11:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0050924519999999999, 2024-09-13T05:11:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006349103, 2024-09-13T05:11:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90934 2024-09-13T05:11:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613941+0000", 2024-09-13T05:11:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613941+0000", 2024-09-13T05:11:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613940+0000", 2024-09-13T05:11:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613946+0000", 2024-09-13T05:11:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7579999999999998e-06 2024-09-13T05:11:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613957+0000", 2024-09-13T05:11:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1524e-05 2024-09-13T05:11:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613970+0000", 2024-09-13T05:11:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2663000000000001e-05 2024-09-13T05:11:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90966 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614819+0000", 2024-09-13T05:11:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0042146290000000001, 2024-09-13T05:11:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055088769999999997, 2024-09-13T05:11:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90966 2024-09-13T05:11:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614819+0000", 2024-09-13T05:11:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614819+0000", 2024-09-13T05:11:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614818+0000", 2024-09-13T05:11:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614821+0000", 2024-09-13T05:11:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7930000000000002e-06 2024-09-13T05:11:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614827+0000", 2024-09-13T05:11:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9000000000000003e-06 2024-09-13T05:11:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614832+0000", 2024-09-13T05:11:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8940000000000001e-06 2024-09-13T05:11:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90998 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615498+0000", 2024-09-13T05:11:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0035355310000000002, 2024-09-13T05:11:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048674829999999997, 2024-09-13T05:11:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90998 2024-09-13T05:11:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615498+0000", 2024-09-13T05:11:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615498+0000", 2024-09-13T05:11:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615497+0000", 2024-09-13T05:11:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615501+0000", 2024-09-13T05:11:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4520000000000002e-06 2024-09-13T05:11:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615507+0000", 2024-09-13T05:11:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.798e-06 2024-09-13T05:11:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615513+0000", 2024-09-13T05:11:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:11:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91030 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.616059+0000", 2024-09-13T05:11:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002974647, 2024-09-13T05:11:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043922880000000003, 2024-09-13T05:11:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91030 2024-09-13T05:11:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616059+0000", 2024-09-13T05:11:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616059+0000", 2024-09-13T05:11:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616059+0000", 2024-09-13T05:11:43.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616060+0000", 2024-09-13T05:11:43.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.562e-06 2024-09-13T05:11:43.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616064+0000", 2024-09-13T05:11:43.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7220000000000001e-06 2024-09-13T05:11:43.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616066+0000", 2024-09-13T05:11:43.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4990000000000001e-06 2024-09-13T05:11:43.759 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.759 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.759 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.760 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90807 3.19 3.affa599 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.760 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609271+0000", 2024-09-13T05:11:43.760 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0097620880000000004, 2024-09-13T05:11:43.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011218123, 2024-09-13T05:11:43.760 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.760 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.760 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90807 2024-09-13T05:11:43.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.760 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609271+0000", 2024-09-13T05:11:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609271+0000", 2024-09-13T05:11:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609271+0000", 2024-09-13T05:11:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609274+0000", 2024-09-13T05:11:43.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9390000000000002e-06 2024-09-13T05:11:43.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609280+0000", 2024-09-13T05:11:43.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1489999999999999e-06 2024-09-13T05:11:43.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609286+0000", 2024-09-13T05:11:43.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7180000000000001e-06 2024-09-13T05:11:43.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.764 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.764 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90839 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.764 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609979+0000", 2024-09-13T05:11:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0090542260000000003, 2024-09-13T05:11:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010550221, 2024-09-13T05:11:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90839 2024-09-13T05:11:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609979+0000", 2024-09-13T05:11:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609979+0000", 2024-09-13T05:11:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609979+0000", 2024-09-13T05:11:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609982+0000", 2024-09-13T05:11:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8899999999999999e-06 2024-09-13T05:11:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609988+0000", 2024-09-13T05:11:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0120000000000002e-06 2024-09-13T05:11:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609993+0000", 2024-09-13T05:11:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0610000000000003e-06 2024-09-13T05:11:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.768 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90871 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.768 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610698+0000", 2024-09-13T05:11:43.768 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.008335716, 2024-09-13T05:11:43.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0098700049999999994, 2024-09-13T05:11:43.768 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.768 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.768 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.768 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.768 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.768 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90871 2024-09-13T05:11:43.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610698+0000", 2024-09-13T05:11:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610698+0000", 2024-09-13T05:11:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610697+0000", 2024-09-13T05:11:43.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610700+0000", 2024-09-13T05:11:43.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4609999999999998e-06 2024-09-13T05:11:43.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610707+0000", 2024-09-13T05:11:43.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4780000000000002e-06 2024-09-13T05:11:43.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610713+0000", 2024-09-13T05:11:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.643e-06 2024-09-13T05:11:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90903 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.612510+0000", 2024-09-13T05:11:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0065233679999999999, 2024-09-13T05:11:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081002320000000006, 2024-09-13T05:11:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90903 2024-09-13T05:11:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612510+0000", 2024-09-13T05:11:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612510+0000", 2024-09-13T05:11:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612509+0000", 2024-09-13T05:11:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612515+0000", 2024-09-13T05:11:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3669999999999996e-06 2024-09-13T05:11:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612528+0000", 2024-09-13T05:11:43.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3402e-05 2024-09-13T05:11:43.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612549+0000", 2024-09-13T05:11:43.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0613000000000001e-05 2024-09-13T05:11:43.774 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.774 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.774 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90935 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613980+0000", 2024-09-13T05:11:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0050538980000000002, 2024-09-13T05:11:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066678010000000001, 2024-09-13T05:11:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90935 2024-09-13T05:11:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613980+0000", 2024-09-13T05:11:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613980+0000", 2024-09-13T05:11:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613979+0000", 2024-09-13T05:11:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613984+0000", 2024-09-13T05:11:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0969999999999996e-06 2024-09-13T05:11:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613995+0000", 2024-09-13T05:11:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1398e-05 2024-09-13T05:11:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614005+0000", 2024-09-13T05:11:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0056e-05 2024-09-13T05:11:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.778 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.778 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.778 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90967 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.778 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614836+0000", 2024-09-13T05:11:43.778 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0041970039999999998, 2024-09-13T05:11:43.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058483390000000001, 2024-09-13T05:11:43.778 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.778 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.778 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.778 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.778 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.778 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90967 2024-09-13T05:11:43.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.779 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614836+0000", 2024-09-13T05:11:43.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614836+0000", 2024-09-13T05:11:43.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614836+0000", 2024-09-13T05:11:43.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614839+0000", 2024-09-13T05:11:43.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6299999999999998e-06 2024-09-13T05:11:43.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614845+0000", 2024-09-13T05:11:43.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8440000000000003e-06 2024-09-13T05:11:43.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614850+0000", 2024-09-13T05:11:43.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0200000000000002e-06 2024-09-13T05:11:43.781 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.781 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.781 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.781 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90999 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.781 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615522+0000", 2024-09-13T05:11:43.781 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003511686, 2024-09-13T05:11:43.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052017060000000004, 2024-09-13T05:11:43.781 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.781 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90999 2024-09-13T05:11:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615522+0000", 2024-09-13T05:11:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615522+0000", 2024-09-13T05:11:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615521+0000", 2024-09-13T05:11:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615524+0000", 2024-09-13T05:11:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.965e-06 2024-09-13T05:11:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615530+0000", 2024-09-13T05:11:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9850000000000003e-06 2024-09-13T05:11:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615535+0000", 2024-09-13T05:11:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2669999999999997e-06 2024-09-13T05:11:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91031 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.616068+0000", 2024-09-13T05:11:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002965025, 2024-09-13T05:11:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004691789, 2024-09-13T05:11:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91031 2024-09-13T05:11:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616068+0000", 2024-09-13T05:11:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616068+0000", 2024-09-13T05:11:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616068+0000", 2024-09-13T05:11:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616072+0000", 2024-09-13T05:11:43.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6169999999999998e-06 2024-09-13T05:11:43.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616075+0000", 2024-09-13T05:11:43.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0809999999999998e-06 2024-09-13T05:11:43.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616078+0000", 2024-09-13T05:11:43.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8420000000000001e-06 2024-09-13T05:11:43.787 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.787 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.787 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90808 3.19 3.affa599 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609306+0000", 2024-09-13T05:11:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0097275199999999999, 2024-09-13T05:11:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011495735999999999, 2024-09-13T05:11:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90808 2024-09-13T05:11:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609306+0000", 2024-09-13T05:11:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609306+0000", 2024-09-13T05:11:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609306+0000", 2024-09-13T05:11:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609309+0000", 2024-09-13T05:11:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9699999999999999e-06 2024-09-13T05:11:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609315+0000", 2024-09-13T05:11:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8050000000000001e-06 2024-09-13T05:11:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609321+0000", 2024-09-13T05:11:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9680000000000003e-06 2024-09-13T05:11:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90840 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609997+0000", 2024-09-13T05:11:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0090362979999999999, 2024-09-13T05:11:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010841923999999999, 2024-09-13T05:11:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90840 2024-09-13T05:11:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609997+0000", 2024-09-13T05:11:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609997+0000", 2024-09-13T05:11:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609997+0000", 2024-09-13T05:11:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610000+0000", 2024-09-13T05:11:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7199999999999998e-06 2024-09-13T05:11:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610006+0000", 2024-09-13T05:11:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4690000000000002e-06 2024-09-13T05:11:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610011+0000", 2024-09-13T05:11:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3190000000000002e-06 2024-09-13T05:11:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90872 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610718+0000", 2024-09-13T05:11:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0083157519999999992, 2024-09-13T05:11:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010161963, 2024-09-13T05:11:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90872 2024-09-13T05:11:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610718+0000", 2024-09-13T05:11:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610718+0000", 2024-09-13T05:11:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610717+0000", 2024-09-13T05:11:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610720+0000", 2024-09-13T05:11:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.661e-06 2024-09-13T05:11:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610726+0000", 2024-09-13T05:11:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1589999999999998e-06 2024-09-13T05:11:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610731+0000", 2024-09-13T05:11:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989999999999997e-06 2024-09-13T05:11:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90904 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.612567+0000", 2024-09-13T05:11:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0064669339999999997, 2024-09-13T05:11:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083502279999999995, 2024-09-13T05:11:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90904 2024-09-13T05:11:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612567+0000", 2024-09-13T05:11:43.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612567+0000", 2024-09-13T05:11:43.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612566+0000", 2024-09-13T05:11:43.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612571+0000", 2024-09-13T05:11:43.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6400000000000002e-06 2024-09-13T05:11:43.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612592+0000", 2024-09-13T05:11:43.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0789999999999999e-05 2024-09-13T05:11:43.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612613+0000", 2024-09-13T05:11:43.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0627000000000001e-05 2024-09-13T05:11:43.801 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.801 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.801 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.801 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90936 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.801 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614014+0000", 2024-09-13T05:11:43.801 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0050196390000000002, 2024-09-13T05:11:43.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0069504459999999999, 2024-09-13T05:11:43.801 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.801 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90936 2024-09-13T05:11:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614014+0000", 2024-09-13T05:11:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614014+0000", 2024-09-13T05:11:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614013+0000", 2024-09-13T05:11:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614018+0000", 2024-09-13T05:11:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3000000000000001e-06 2024-09-13T05:11:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614031+0000", 2024-09-13T05:11:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2999e-05 2024-09-13T05:11:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614042+0000", 2024-09-13T05:11:43.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:11:43.804 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.804 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.804 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.804 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90968 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.804 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614854+0000", 2024-09-13T05:11:43.804 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0041794220000000003, 2024-09-13T05:11:43.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061476309999999998, 2024-09-13T05:11:43.804 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90968 2024-09-13T05:11:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614854+0000", 2024-09-13T05:11:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614854+0000", 2024-09-13T05:11:43.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614854+0000", 2024-09-13T05:11:43.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614856+0000", 2024-09-13T05:11:43.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.745e-06 2024-09-13T05:11:43.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614862+0000", 2024-09-13T05:11:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8069999999999996e-06 2024-09-13T05:11:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614867+0000", 2024-09-13T05:11:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0529999999999997e-06 2024-09-13T05:11:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91000 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615540+0000", 2024-09-13T05:11:43.808 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0034931540000000001, 2024-09-13T05:11:43.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055013120000000004, 2024-09-13T05:11:43.808 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.808 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.808 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.808 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.808 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.808 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91000 2024-09-13T05:11:43.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.808 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615540+0000", 2024-09-13T05:11:43.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615540+0000", 2024-09-13T05:11:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615540+0000", 2024-09-13T05:11:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615543+0000", 2024-09-13T05:11:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.965e-06 2024-09-13T05:11:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615549+0000", 2024-09-13T05:11:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9370000000000001e-06 2024-09-13T05:11:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615554+0000", 2024-09-13T05:11:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8999999999999997e-06 2024-09-13T05:11:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.811 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91032 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.811 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.616081+0000", 2024-09-13T05:11:43.811 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0029527099999999999, 2024-09-13T05:11:43.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049988070000000001, 2024-09-13T05:11:43.811 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.811 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.811 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91032 2024-09-13T05:11:43.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.811 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616081+0000", 2024-09-13T05:11:43.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616081+0000", 2024-09-13T05:11:43.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616081+0000", 2024-09-13T05:11:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616082+0000", 2024-09-13T05:11:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4670000000000001e-06 2024-09-13T05:11:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616085+0000", 2024-09-13T05:11:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8279999999999999e-06 2024-09-13T05:11:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616087+0000", 2024-09-13T05:11:43.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4420000000000001e-06 2024-09-13T05:11:43.814 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.814 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.814 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.814 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90809 3.19 3.affa599 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.814 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609326+0000", 2024-09-13T05:11:43.814 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0097072970000000001, 2024-09-13T05:11:43.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0117933, 2024-09-13T05:11:43.814 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.814 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90809 2024-09-13T05:11:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609326+0000", 2024-09-13T05:11:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609326+0000", 2024-09-13T05:11:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609326+0000", 2024-09-13T05:11:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609329+0000", 2024-09-13T05:11:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0199999999999999e-06 2024-09-13T05:11:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609335+0000", 2024-09-13T05:11:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2049999999999999e-06 2024-09-13T05:11:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609340+0000", 2024-09-13T05:11:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2549999999999997e-06 2024-09-13T05:11:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90841 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610016+0000", 2024-09-13T05:11:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0090174859999999999, 2024-09-13T05:11:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011141131, 2024-09-13T05:11:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90841 2024-09-13T05:11:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610016+0000", 2024-09-13T05:11:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610016+0000", 2024-09-13T05:11:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610016+0000", 2024-09-13T05:11:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610018+0000", 2024-09-13T05:11:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6759999999999999e-06 2024-09-13T05:11:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610024+0000", 2024-09-13T05:11:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8839999999999999e-06 2024-09-13T05:11:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610029+0000", 2024-09-13T05:11:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8439999999999997e-06 2024-09-13T05:11:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90873 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610800+0000", 2024-09-13T05:11:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0082338159999999997, 2024-09-13T05:11:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010394868999999999, 2024-09-13T05:11:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90873 2024-09-13T05:11:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610800+0000", 2024-09-13T05:11:43.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610800+0000", 2024-09-13T05:11:43.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610799+0000", 2024-09-13T05:11:43.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610805+0000", 2024-09-13T05:11:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2040000000000002e-06 2024-09-13T05:11:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610812+0000", 2024-09-13T05:11:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4329999999999998e-06 2024-09-13T05:11:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610818+0000", 2024-09-13T05:11:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0220000000000001e-06 2024-09-13T05:11:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.824 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.824 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.824 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90905 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.824 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.612623+0000", 2024-09-13T05:11:43.824 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0064109090000000002, 2024-09-13T05:11:43.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086113030000000007, 2024-09-13T05:11:43.824 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.824 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.824 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.824 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.824 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.824 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90905 2024-09-13T05:11:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612623+0000", 2024-09-13T05:11:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612623+0000", 2024-09-13T05:11:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612622+0000", 2024-09-13T05:11:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612627+0000", 2024-09-13T05:11:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3600000000000004e-06 2024-09-13T05:11:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612639+0000", 2024-09-13T05:11:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2232000000000001e-05 2024-09-13T05:11:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612649+0000", 2024-09-13T05:11:43.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6719999999999999e-06 2024-09-13T05:11:43.827 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.827 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.827 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.827 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90937 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.827 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614051+0000", 2024-09-13T05:11:43.827 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0049827719999999999, 2024-09-13T05:11:43.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072211599999999999, 2024-09-13T05:11:43.827 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.827 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.827 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90937 2024-09-13T05:11:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614051+0000", 2024-09-13T05:11:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614051+0000", 2024-09-13T05:11:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614050+0000", 2024-09-13T05:11:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614055+0000", 2024-09-13T05:11:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8890000000000001e-06 2024-09-13T05:11:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614066+0000", 2024-09-13T05:11:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1455e-05 2024-09-13T05:11:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614076+0000", 2024-09-13T05:11:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4569999999999994e-06 2024-09-13T05:11:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90969 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614873+0000", 2024-09-13T05:11:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00416038, 2024-09-13T05:11:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064384790000000004, 2024-09-13T05:11:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90969 2024-09-13T05:11:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614873+0000", 2024-09-13T05:11:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614873+0000", 2024-09-13T05:11:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614872+0000", 2024-09-13T05:11:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614875+0000", 2024-09-13T05:11:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9720000000000001e-06 2024-09-13T05:11:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614882+0000", 2024-09-13T05:11:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.956e-06 2024-09-13T05:11:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614888+0000", 2024-09-13T05:11:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1170000000000003e-06 2024-09-13T05:11:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.834 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91001 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.834 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615558+0000", 2024-09-13T05:11:43.834 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0034751420000000001, 2024-09-13T05:11:43.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057906310000000001, 2024-09-13T05:11:43.834 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.834 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.834 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91001 2024-09-13T05:11:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615558+0000", 2024-09-13T05:11:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615558+0000", 2024-09-13T05:11:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615558+0000", 2024-09-13T05:11:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615561+0000", 2024-09-13T05:11:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7769999999999998e-06 2024-09-13T05:11:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615567+0000", 2024-09-13T05:11:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9320000000000001e-06 2024-09-13T05:11:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615572+0000", 2024-09-13T05:11:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:11:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91033 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.616090+0000", 2024-09-13T05:11:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0029437619999999999, 2024-09-13T05:11:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052984540000000002, 2024-09-13T05:11:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91033 2024-09-13T05:11:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616090+0000", 2024-09-13T05:11:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616090+0000", 2024-09-13T05:11:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616090+0000", 2024-09-13T05:11:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616091+0000", 2024-09-13T05:11:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4750000000000001e-06 2024-09-13T05:11:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616094+0000", 2024-09-13T05:11:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8169999999999999e-06 2024-09-13T05:11:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616096+0000", 2024-09-13T05:11:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4729999999999999e-06 2024-09-13T05:11:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90810 3.19 3.affa599 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609345+0000", 2024-09-13T05:11:43.841 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0096886569999999998, 2024-09-13T05:11:43.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012080729, 2024-09-13T05:11:43.841 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.841 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.841 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90810 2024-09-13T05:11:43.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.841 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609345+0000", 2024-09-13T05:11:43.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609345+0000", 2024-09-13T05:11:43.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609344+0000", 2024-09-13T05:11:43.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609347+0000", 2024-09-13T05:11:43.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9110000000000002e-06 2024-09-13T05:11:43.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609354+0000", 2024-09-13T05:11:43.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1279999999999996e-06 2024-09-13T05:11:43.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609359+0000", 2024-09-13T05:11:43.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1290000000000004e-06 2024-09-13T05:11:43.843 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.843 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.843 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.844 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90842 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.844 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610035+0000", 2024-09-13T05:11:43.844 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0089984079999999994, 2024-09-13T05:11:43.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011430658999999999, 2024-09-13T05:11:43.844 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.844 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.844 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.844 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.844 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.844 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90842 2024-09-13T05:11:43.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.845 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610035+0000", 2024-09-13T05:11:43.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610035+0000", 2024-09-13T05:11:43.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610035+0000", 2024-09-13T05:11:43.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610037+0000", 2024-09-13T05:11:43.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.734e-06 2024-09-13T05:11:43.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610044+0000", 2024-09-13T05:11:43.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2580000000000001e-06 2024-09-13T05:11:43.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610049+0000", 2024-09-13T05:11:43.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4399999999999996e-06 2024-09-13T05:11:43.847 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.847 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.847 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.847 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90874 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.847 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610823+0000", 2024-09-13T05:11:43.847 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0082100360000000004, 2024-09-13T05:11:43.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010679874000000001, 2024-09-13T05:11:43.848 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.848 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.848 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90874 2024-09-13T05:11:43.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.848 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610823+0000", 2024-09-13T05:11:43.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610823+0000", 2024-09-13T05:11:43.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610823+0000", 2024-09-13T05:11:43.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610826+0000", 2024-09-13T05:11:43.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9239999999999999e-06 2024-09-13T05:11:43.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610832+0000", 2024-09-13T05:11:43.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3409999999999999e-06 2024-09-13T05:11:43.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610837+0000", 2024-09-13T05:11:43.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0420000000000002e-06 2024-09-13T05:11:43.850 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.850 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.850 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.851 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90906 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.851 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.612696+0000", 2024-09-13T05:11:43.851 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0063377019999999997, 2024-09-13T05:11:43.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088468450000000007, 2024-09-13T05:11:43.851 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.851 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.851 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.851 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.851 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.851 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90906 2024-09-13T05:11:43.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.851 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612696+0000", 2024-09-13T05:11:43.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612696+0000", 2024-09-13T05:11:43.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612695+0000", 2024-09-13T05:11:43.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612700+0000", 2024-09-13T05:11:43.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.237e-06 2024-09-13T05:11:43.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612721+0000", 2024-09-13T05:11:43.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0699e-05 2024-09-13T05:11:43.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612732+0000", 2024-09-13T05:11:43.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0695e-05 2024-09-13T05:11:43.854 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.854 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.854 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.854 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90938 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.854 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614084+0000", 2024-09-13T05:11:43.854 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0049492470000000004, 2024-09-13T05:11:43.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0074953379999999998, 2024-09-13T05:11:43.854 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.854 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.855 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90938 2024-09-13T05:11:43.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.855 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614084+0000", 2024-09-13T05:11:43.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614084+0000", 2024-09-13T05:11:43.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614083+0000", 2024-09-13T05:11:43.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614088+0000", 2024-09-13T05:11:43.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9250000000000003e-06 2024-09-13T05:11:43.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614100+0000", 2024-09-13T05:11:43.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1752e-05 2024-09-13T05:11:43.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614109+0000", 2024-09-13T05:11:43.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3899999999999999e-06 2024-09-13T05:11:43.857 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.857 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.857 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.857 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90970 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.858 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614892+0000", 2024-09-13T05:11:43.858 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0041413179999999997, 2024-09-13T05:11:43.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067287290000000001, 2024-09-13T05:11:43.858 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.858 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.858 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.858 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.858 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.858 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90970 2024-09-13T05:11:43.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.858 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614892+0000", 2024-09-13T05:11:43.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614892+0000", 2024-09-13T05:11:43.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614892+0000", 2024-09-13T05:11:43.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614898+0000", 2024-09-13T05:11:43.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.84e-06 2024-09-13T05:11:43.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614903+0000", 2024-09-13T05:11:43.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8699999999999997e-06 2024-09-13T05:11:43.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614909+0000", 2024-09-13T05:11:43.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1200000000000001e-06 2024-09-13T05:11:43.860 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.860 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.861 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.861 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91002 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.861 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615576+0000", 2024-09-13T05:11:43.861 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003457267, 2024-09-13T05:11:43.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060816689999999996, 2024-09-13T05:11:43.861 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.861 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.861 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.861 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.861 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.861 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91002 2024-09-13T05:11:43.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.862 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615576+0000", 2024-09-13T05:11:43.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615576+0000", 2024-09-13T05:11:43.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615576+0000", 2024-09-13T05:11:43.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615578+0000", 2024-09-13T05:11:43.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.796e-06 2024-09-13T05:11:43.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615584+0000", 2024-09-13T05:11:43.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.767e-06 2024-09-13T05:11:43.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615589+0000", 2024-09-13T05:11:43.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1719999999999998e-06 2024-09-13T05:11:43.864 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.864 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.864 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.864 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91034 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.864 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.616098+0000", 2024-09-13T05:11:43.864 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0029350069999999999, 2024-09-13T05:11:43.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055963480000000001, 2024-09-13T05:11:43.864 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.864 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.864 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.865 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.865 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.865 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91034 2024-09-13T05:11:43.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.865 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616098+0000", 2024-09-13T05:11:43.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616098+0000", 2024-09-13T05:11:43.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616098+0000", 2024-09-13T05:11:43.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:43.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616100+0000", 2024-09-13T05:11:43.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6950000000000001e-06 2024-09-13T05:11:43.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616103+0000", 2024-09-13T05:11:43.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8550000000000002e-06 2024-09-13T05:11:43.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616105+0000", 2024-09-13T05:11:43.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.537e-06 2024-09-13T05:11:43.867 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.867 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.867 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.867 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90811 3.19 3.affa599 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.867 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609363+0000", 2024-09-13T05:11:43.867 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0096700109999999992, 2024-09-13T05:11:43.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012378164000000001, 2024-09-13T05:11:43.868 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.868 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.868 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90811 2024-09-13T05:11:43.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.868 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609363+0000", 2024-09-13T05:11:43.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609363+0000", 2024-09-13T05:11:43.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609363+0000", 2024-09-13T05:11:43.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609366+0000", 2024-09-13T05:11:43.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7149999999999998e-06 2024-09-13T05:11:43.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609372+0000", 2024-09-13T05:11:43.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4540000000000004e-06 2024-09-13T05:11:43.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609377+0000", 2024-09-13T05:11:43.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1749999999999996e-06 2024-09-13T05:11:43.870 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.870 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.870 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.871 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90843 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.871 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610053+0000", 2024-09-13T05:11:43.871 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.008980142, 2024-09-13T05:11:43.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011726528, 2024-09-13T05:11:43.871 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.871 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.871 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.871 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.871 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.871 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90843 2024-09-13T05:11:43.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.871 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610053+0000", 2024-09-13T05:11:43.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610053+0000", 2024-09-13T05:11:43.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610053+0000", 2024-09-13T05:11:43.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610056+0000", 2024-09-13T05:11:43.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6000000000000001e-06 2024-09-13T05:11:43.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610063+0000", 2024-09-13T05:11:43.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1230000000000002e-06 2024-09-13T05:11:43.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610068+0000", 2024-09-13T05:11:43.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7679999999999997e-06 2024-09-13T05:11:43.874 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.874 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.874 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.874 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90875 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.874 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610842+0000", 2024-09-13T05:11:43.874 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0081914339999999992, 2024-09-13T05:11:43.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011059922, 2024-09-13T05:11:43.874 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.874 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.874 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.874 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.874 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.875 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90875 2024-09-13T05:11:43.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.875 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610842+0000", 2024-09-13T05:11:43.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610842+0000", 2024-09-13T05:11:43.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610842+0000", 2024-09-13T05:11:43.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610844+0000", 2024-09-13T05:11:43.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5919999999999999e-06 2024-09-13T05:11:43.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610850+0000", 2024-09-13T05:11:43.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0190000000000003e-06 2024-09-13T05:11:43.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610856+0000", 2024-09-13T05:11:43.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5380000000000002e-06 2024-09-13T05:11:43.877 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.877 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.877 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.877 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90907 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.877 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.612749+0000", 2024-09-13T05:11:43.877 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0062847479999999997, 2024-09-13T05:11:43.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091908159999999992, 2024-09-13T05:11:43.877 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.878 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.878 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.878 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.878 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.878 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90907 2024-09-13T05:11:43.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.878 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612749+0000", 2024-09-13T05:11:43.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612749+0000", 2024-09-13T05:11:43.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612748+0000", 2024-09-13T05:11:43.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612753+0000", 2024-09-13T05:11:43.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8199999999999996e-06 2024-09-13T05:11:43.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612784+0000", 2024-09-13T05:11:43.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0861999999999997e-05 2024-09-13T05:11:43.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612797+0000", 2024-09-13T05:11:43.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3196999999999999e-05 2024-09-13T05:11:43.880 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.880 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.880 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.880 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90939 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.881 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614118+0000", 2024-09-13T05:11:43.881 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0049157360000000004, 2024-09-13T05:11:43.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078620080000000002, 2024-09-13T05:11:43.881 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.881 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.881 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.881 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.881 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.881 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90939 2024-09-13T05:11:43.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.881 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614118+0000", 2024-09-13T05:11:43.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614118+0000", 2024-09-13T05:11:43.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614117+0000", 2024-09-13T05:11:43.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614122+0000", 2024-09-13T05:11:43.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5519999999999998e-06 2024-09-13T05:11:43.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614133+0000", 2024-09-13T05:11:43.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1382e-05 2024-09-13T05:11:43.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614143+0000", 2024-09-13T05:11:43.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6320000000000003e-06 2024-09-13T05:11:43.883 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.883 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.883 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.884 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90971 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.884 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614917+0000", 2024-09-13T05:11:43.884 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0041164849999999996, 2024-09-13T05:11:43.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071002000000000001, 2024-09-13T05:11:43.884 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.884 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.884 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.884 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.884 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.884 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90971 2024-09-13T05:11:43.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.884 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614917+0000", 2024-09-13T05:11:43.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614917+0000", 2024-09-13T05:11:43.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614916+0000", 2024-09-13T05:11:43.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614919+0000", 2024-09-13T05:11:43.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1599999999999998e-06 2024-09-13T05:11:43.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614925+0000", 2024-09-13T05:11:43.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9340000000000003e-06 2024-09-13T05:11:43.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614930+0000", 2024-09-13T05:11:43.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0730000000000004e-06 2024-09-13T05:11:43.887 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.887 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.887 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.887 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91003 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.887 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615594+0000", 2024-09-13T05:11:43.887 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0034397379999999999, 2024-09-13T05:11:43.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064626409999999999, 2024-09-13T05:11:43.887 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.887 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.888 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.888 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91003 2024-09-13T05:11:43.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.888 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615594+0000", 2024-09-13T05:11:43.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615594+0000", 2024-09-13T05:11:43.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615593+0000", 2024-09-13T05:11:43.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615596+0000", 2024-09-13T05:11:43.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:11:43.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615603+0000", 2024-09-13T05:11:43.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1369999999999996e-06 2024-09-13T05:11:43.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615608+0000", 2024-09-13T05:11:43.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0760000000000002e-06 2024-09-13T05:11:43.890 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.890 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.890 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.890 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91035 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.890 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.616107+0000", 2024-09-13T05:11:43.890 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0029260200000000001, 2024-09-13T05:11:43.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059865040000000001, 2024-09-13T05:11:43.890 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.891 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.891 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91035 2024-09-13T05:11:43.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.891 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616107+0000", 2024-09-13T05:11:43.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616107+0000", 2024-09-13T05:11:43.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616107+0000", 2024-09-13T05:11:43.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:43.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616109+0000", 2024-09-13T05:11:43.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4279999999999999e-06 2024-09-13T05:11:43.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616112+0000", 2024-09-13T05:11:43.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4589999999999998e-06 2024-09-13T05:11:43.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616115+0000", 2024-09-13T05:11:43.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6019999999999998e-06 2024-09-13T05:11:43.893 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.893 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.893 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.893 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90812 3.19 3.affa599 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.894 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609382+0000", 2024-09-13T05:11:43.894 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0096513870000000009, 2024-09-13T05:11:43.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012754741, 2024-09-13T05:11:43.894 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.894 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.894 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.894 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.894 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.894 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90812 2024-09-13T05:11:43.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.894 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609382+0000", 2024-09-13T05:11:43.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609382+0000", 2024-09-13T05:11:43.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609382+0000", 2024-09-13T05:11:43.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609412+0000", 2024-09-13T05:11:43.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9886000000000002e-05 2024-09-13T05:11:43.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609421+0000", 2024-09-13T05:11:43.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1099999999999992e-06 2024-09-13T05:11:43.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609427+0000", 2024-09-13T05:11:43.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7100000000000001e-06 2024-09-13T05:11:43.896 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.896 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.896 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.897 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90844 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.897 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610073+0000", 2024-09-13T05:11:43.897 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0089601460000000004, 2024-09-13T05:11:43.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012103478000000001, 2024-09-13T05:11:43.897 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.897 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.897 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.897 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.897 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.897 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90844 2024-09-13T05:11:43.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.897 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610073+0000", 2024-09-13T05:11:43.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610073+0000", 2024-09-13T05:11:43.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610073+0000", 2024-09-13T05:11:43.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610076+0000", 2024-09-13T05:11:43.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7379999999999999e-06 2024-09-13T05:11:43.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610082+0000", 2024-09-13T05:11:43.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9909999999999999e-06 2024-09-13T05:11:43.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610087+0000", 2024-09-13T05:11:43.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1649999999999997e-06 2024-09-13T05:11:43.900 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.900 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.900 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.900 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90876 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.900 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610860+0000", 2024-09-13T05:11:43.900 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0081730640000000007, 2024-09-13T05:11:43.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011356463000000001, 2024-09-13T05:11:43.900 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.900 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.901 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90876 2024-09-13T05:11:43.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.901 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610860+0000", 2024-09-13T05:11:43.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610860+0000", 2024-09-13T05:11:43.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610860+0000", 2024-09-13T05:11:43.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610863+0000", 2024-09-13T05:11:43.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8499999999999998e-06 2024-09-13T05:11:43.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610869+0000", 2024-09-13T05:11:43.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3589999999999996e-06 2024-09-13T05:11:43.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610874+0000", 2024-09-13T05:11:43.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2179999999999998e-06 2024-09-13T05:11:43.903 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.903 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.903 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.903 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90908 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.903 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.612807+0000", 2024-09-13T05:11:43.903 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0062267570000000003, 2024-09-13T05:11:43.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094475649999999998, 2024-09-13T05:11:43.903 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.903 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.904 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90908 2024-09-13T05:11:43.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.904 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612807+0000", 2024-09-13T05:11:43.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612807+0000", 2024-09-13T05:11:43.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612806+0000", 2024-09-13T05:11:43.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612811+0000", 2024-09-13T05:11:43.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0329999999999999e-06 2024-09-13T05:11:43.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612823+0000", 2024-09-13T05:11:43.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2062000000000001e-05 2024-09-13T05:11:43.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612832+0000", 2024-09-13T05:11:43.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1030000000000008e-06 2024-09-13T05:11:43.906 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.906 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.906 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.906 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90940 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.906 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614151+0000", 2024-09-13T05:11:43.907 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0048823260000000002, 2024-09-13T05:11:43.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081424440000000004, 2024-09-13T05:11:43.907 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.907 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.907 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90940 2024-09-13T05:11:43.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.907 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614151+0000", 2024-09-13T05:11:43.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614151+0000", 2024-09-13T05:11:43.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614150+0000", 2024-09-13T05:11:43.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614155+0000", 2024-09-13T05:11:43.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8500000000000002e-06 2024-09-13T05:11:43.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614167+0000", 2024-09-13T05:11:43.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1219999999999999e-05 2024-09-13T05:11:43.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614177+0000", 2024-09-13T05:11:43.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0859999999999999e-05 2024-09-13T05:11:43.909 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.909 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.909 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.910 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90972 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.910 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614945+0000", 2024-09-13T05:11:43.910 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0040885410000000002, 2024-09-13T05:11:43.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0073859269999999996, 2024-09-13T05:11:43.910 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.910 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.910 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90972 2024-09-13T05:11:43.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.910 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614945+0000", 2024-09-13T05:11:43.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614945+0000", 2024-09-13T05:11:43.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614944+0000", 2024-09-13T05:11:43.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614947+0000", 2024-09-13T05:11:43.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1149999999999998e-06 2024-09-13T05:11:43.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614954+0000", 2024-09-13T05:11:43.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.207e-06 2024-09-13T05:11:43.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614959+0000", 2024-09-13T05:11:43.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1270000000000002e-06 2024-09-13T05:11:43.913 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.913 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.913 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.913 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91004 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.913 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615613+0000", 2024-09-13T05:11:43.913 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003420906, 2024-09-13T05:11:43.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067548879999999997, 2024-09-13T05:11:43.913 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.913 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.913 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.913 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.913 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.914 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91004 2024-09-13T05:11:43.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.914 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615613+0000", 2024-09-13T05:11:43.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615613+0000", 2024-09-13T05:11:43.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615612+0000", 2024-09-13T05:11:43.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615615+0000", 2024-09-13T05:11:43.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7159999999999999e-06 2024-09-13T05:11:43.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615621+0000", 2024-09-13T05:11:43.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9200000000000001e-06 2024-09-13T05:11:43.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615626+0000", 2024-09-13T05:11:43.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0119999999999996e-06 2024-09-13T05:11:43.916 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.916 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.916 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.916 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91036 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.916 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.616117+0000", 2024-09-13T05:11:43.916 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0029164579999999998, 2024-09-13T05:11:43.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062892699999999996, 2024-09-13T05:11:43.917 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.917 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.917 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.917 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.917 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.917 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91036 2024-09-13T05:11:43.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.917 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616117+0000", 2024-09-13T05:11:43.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616117+0000", 2024-09-13T05:11:43.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616117+0000", 2024-09-13T05:11:43.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:43.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616118+0000", 2024-09-13T05:11:43.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.392e-06 2024-09-13T05:11:43.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616121+0000", 2024-09-13T05:11:43.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7930000000000002e-06 2024-09-13T05:11:43.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616124+0000", 2024-09-13T05:11:43.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1829999999999998e-06 2024-09-13T05:11:43.919 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.919 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.919 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.920 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90813 3.19 3.affa599 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.920 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609433+0000", 2024-09-13T05:11:43.920 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0096003670000000003, 2024-09-13T05:11:43.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013012673000000001, 2024-09-13T05:11:43.920 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.920 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.920 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.920 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.920 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.920 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90813 2024-09-13T05:11:43.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.920 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609433+0000", 2024-09-13T05:11:43.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609433+0000", 2024-09-13T05:11:43.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609433+0000", 2024-09-13T05:11:43.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609436+0000", 2024-09-13T05:11:43.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2830000000000002e-06 2024-09-13T05:11:43.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609442+0000", 2024-09-13T05:11:43.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3640000000000004e-06 2024-09-13T05:11:43.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609448+0000", 2024-09-13T05:11:43.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3319999999999999e-06 2024-09-13T05:11:43.922 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.922 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.923 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.923 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90845 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.923 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610092+0000", 2024-09-13T05:11:43.923 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0089419419999999996, 2024-09-13T05:11:43.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01239522, 2024-09-13T05:11:43.923 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.923 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.923 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.923 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.923 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.923 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90845 2024-09-13T05:11:43.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.924 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610092+0000", 2024-09-13T05:11:43.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610092+0000", 2024-09-13T05:11:43.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610091+0000", 2024-09-13T05:11:43.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610094+0000", 2024-09-13T05:11:43.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5220000000000002e-06 2024-09-13T05:11:43.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610100+0000", 2024-09-13T05:11:43.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.178e-06 2024-09-13T05:11:43.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610105+0000", 2024-09-13T05:11:43.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8949999999999997e-06 2024-09-13T05:11:43.926 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.926 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.926 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.926 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90877 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.926 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610879+0000", 2024-09-13T05:11:43.926 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0081545960000000001, 2024-09-13T05:11:43.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011645287000000001, 2024-09-13T05:11:43.926 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.926 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.927 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.927 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.927 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.927 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90877 2024-09-13T05:11:43.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.927 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610879+0000", 2024-09-13T05:11:43.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610879+0000", 2024-09-13T05:11:43.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610879+0000", 2024-09-13T05:11:43.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610881+0000", 2024-09-13T05:11:43.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5170000000000002e-06 2024-09-13T05:11:43.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610887+0000", 2024-09-13T05:11:43.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3470000000000004e-06 2024-09-13T05:11:43.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610893+0000", 2024-09-13T05:11:43.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1329999999999998e-06 2024-09-13T05:11:43.929 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.929 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.929 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.929 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90909 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.929 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.612841+0000", 2024-09-13T05:11:43.930 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0061924279999999998, 2024-09-13T05:11:43.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097227809999999998, 2024-09-13T05:11:43.930 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.930 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.930 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.930 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.930 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.930 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90909 2024-09-13T05:11:43.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.930 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612841+0000", 2024-09-13T05:11:43.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612841+0000", 2024-09-13T05:11:43.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612840+0000", 2024-09-13T05:11:43.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612880+0000", 2024-09-13T05:11:43.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9916999999999997e-05 2024-09-13T05:11:43.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612894+0000", 2024-09-13T05:11:43.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3890000000000001e-05 2024-09-13T05:11:43.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612917+0000", 2024-09-13T05:11:43.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2476999999999998e-05 2024-09-13T05:11:43.932 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.932 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.932 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.933 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90941 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.933 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614187+0000", 2024-09-13T05:11:43.933 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0048469949999999998, 2024-09-13T05:11:43.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084146110000000007, 2024-09-13T05:11:43.933 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.933 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.933 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.933 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.933 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.933 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90941 2024-09-13T05:11:43.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.933 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614187+0000", 2024-09-13T05:11:43.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614187+0000", 2024-09-13T05:11:43.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614185+0000", 2024-09-13T05:11:43.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614191+0000", 2024-09-13T05:11:43.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2669999999999997e-06 2024-09-13T05:11:43.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614202+0000", 2024-09-13T05:11:43.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1647e-05 2024-09-13T05:11:43.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614213+0000", 2024-09-13T05:11:43.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0808000000000001e-05 2024-09-13T05:11:43.936 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.936 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.936 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.936 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90973 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.936 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614963+0000", 2024-09-13T05:11:43.936 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0040701019999999999, 2024-09-13T05:11:43.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076770800000000002, 2024-09-13T05:11:43.936 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.936 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.936 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.937 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90973 2024-09-13T05:11:43.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.937 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614963+0000", 2024-09-13T05:11:43.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614963+0000", 2024-09-13T05:11:43.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614963+0000", 2024-09-13T05:11:43.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614966+0000", 2024-09-13T05:11:43.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8839999999999998e-06 2024-09-13T05:11:43.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614972+0000", 2024-09-13T05:11:43.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.818e-06 2024-09-13T05:11:43.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614976+0000", 2024-09-13T05:11:43.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8620000000000002e-06 2024-09-13T05:11:43.939 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.939 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.939 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.939 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91005 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.939 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615630+0000", 2024-09-13T05:11:43.939 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0034033560000000002, 2024-09-13T05:11:43.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070483079999999997, 2024-09-13T05:11:43.939 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.940 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.940 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.940 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.940 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.940 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91005 2024-09-13T05:11:43.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.940 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615630+0000", 2024-09-13T05:11:43.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615630+0000", 2024-09-13T05:11:43.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615630+0000", 2024-09-13T05:11:43.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615632+0000", 2024-09-13T05:11:43.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6919999999999998e-06 2024-09-13T05:11:43.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615638+0000", 2024-09-13T05:11:43.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9699999999999996e-06 2024-09-13T05:11:43.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615643+0000", 2024-09-13T05:11:43.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.04e-06 2024-09-13T05:11:43.942 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.942 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.942 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.943 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91037 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.943 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.616126+0000", 2024-09-13T05:11:43.943 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002907167, 2024-09-13T05:11:43.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065918219999999998, 2024-09-13T05:11:43.943 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.943 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.943 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91037 2024-09-13T05:11:43.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.943 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616126+0000", 2024-09-13T05:11:43.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616126+0000", 2024-09-13T05:11:43.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616126+0000", 2024-09-13T05:11:43.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:43.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616127+0000", 2024-09-13T05:11:43.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.223e-06 2024-09-13T05:11:43.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616130+0000", 2024-09-13T05:11:43.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8590000000000001e-06 2024-09-13T05:11:43.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616134+0000", 2024-09-13T05:11:43.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9519999999999996e-06 2024-09-13T05:11:43.945 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.946 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.946 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.946 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90814 3.19 3.affa599 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.946 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609453+0000", 2024-09-13T05:11:43.946 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0095807329999999993, 2024-09-13T05:11:43.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013304757, 2024-09-13T05:11:43.946 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.946 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.946 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.946 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.946 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.947 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90814 2024-09-13T05:11:43.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.947 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609453+0000", 2024-09-13T05:11:43.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609453+0000", 2024-09-13T05:11:43.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609452+0000", 2024-09-13T05:11:43.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609455+0000", 2024-09-13T05:11:43.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7989999999999998e-06 2024-09-13T05:11:43.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609461+0000", 2024-09-13T05:11:43.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2110000000000003e-06 2024-09-13T05:11:43.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609467+0000", 2024-09-13T05:11:43.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7799999999999997e-06 2024-09-13T05:11:43.949 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.949 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.949 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.949 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90846 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.949 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610110+0000", 2024-09-13T05:11:43.949 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0089236060000000006, 2024-09-13T05:11:43.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012689423, 2024-09-13T05:11:43.950 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.950 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.950 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90846 2024-09-13T05:11:43.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.950 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610110+0000", 2024-09-13T05:11:43.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610110+0000", 2024-09-13T05:11:43.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610109+0000", 2024-09-13T05:11:43.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610112+0000", 2024-09-13T05:11:43.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7750000000000001e-06 2024-09-13T05:11:43.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610118+0000", 2024-09-13T05:11:43.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1709999999999999e-06 2024-09-13T05:11:43.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610123+0000", 2024-09-13T05:11:43.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2159999999999997e-06 2024-09-13T05:11:43.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.955 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.955 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90878 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.955 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610897+0000", 2024-09-13T05:11:43.955 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0081365340000000008, 2024-09-13T05:11:43.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011939956999999999, 2024-09-13T05:11:43.955 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.956 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.956 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90878 2024-09-13T05:11:43.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.956 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610897+0000", 2024-09-13T05:11:43.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610897+0000", 2024-09-13T05:11:43.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610897+0000", 2024-09-13T05:11:43.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610899+0000", 2024-09-13T05:11:43.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7209999999999999e-06 2024-09-13T05:11:43.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610905+0000", 2024-09-13T05:11:43.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0639999999999999e-06 2024-09-13T05:11:43.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610911+0000", 2024-09-13T05:11:43.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1959999999999999e-06 2024-09-13T05:11:43.958 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.958 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.958 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.958 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90910 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.959 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.612962+0000", 2024-09-13T05:11:43.959 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0060717760000000001, 2024-09-13T05:11:43.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0099125729999999992, 2024-09-13T05:11:43.959 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.959 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.959 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90910 2024-09-13T05:11:43.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.959 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612962+0000", 2024-09-13T05:11:43.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612962+0000", 2024-09-13T05:11:43.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612961+0000", 2024-09-13T05:11:43.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612966+0000", 2024-09-13T05:11:43.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8470000000000001e-06 2024-09-13T05:11:43.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612981+0000", 2024-09-13T05:11:43.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.487e-05 2024-09-13T05:11:43.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612992+0000", 2024-09-13T05:11:43.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0642000000000001e-05 2024-09-13T05:11:43.961 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.962 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.962 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.962 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90942 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.962 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614222+0000", 2024-09-13T05:11:43.962 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0048115459999999999, 2024-09-13T05:11:43.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086966950000000008, 2024-09-13T05:11:43.962 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.962 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.962 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90942 2024-09-13T05:11:43.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.963 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614222+0000", 2024-09-13T05:11:43.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614222+0000", 2024-09-13T05:11:43.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614221+0000", 2024-09-13T05:11:43.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614226+0000", 2024-09-13T05:11:43.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0699999999999997e-06 2024-09-13T05:11:43.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614237+0000", 2024-09-13T05:11:43.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1172000000000001e-05 2024-09-13T05:11:43.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614247+0000", 2024-09-13T05:11:43.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3000000000000007e-06 2024-09-13T05:11:43.965 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.965 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.965 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.965 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90974 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.965 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614981+0000", 2024-09-13T05:11:43.965 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0040525969999999998, 2024-09-13T05:11:43.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079758079999999992, 2024-09-13T05:11:43.965 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.966 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.966 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90974 2024-09-13T05:11:43.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.966 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614981+0000", 2024-09-13T05:11:43.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614981+0000", 2024-09-13T05:11:43.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614980+0000", 2024-09-13T05:11:43.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614983+0000", 2024-09-13T05:11:43.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5799999999999999e-06 2024-09-13T05:11:43.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614989+0000", 2024-09-13T05:11:43.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.755e-06 2024-09-13T05:11:43.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614994+0000", 2024-09-13T05:11:43.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0250000000000002e-06 2024-09-13T05:11:43.968 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.968 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.968 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.969 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91006 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.969 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615650+0000", 2024-09-13T05:11:43.969 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0033830090000000002, 2024-09-13T05:11:43.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0073454089999999998, 2024-09-13T05:11:43.969 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.969 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.969 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.969 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.969 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.969 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91006 2024-09-13T05:11:43.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.969 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615650+0000", 2024-09-13T05:11:43.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615650+0000", 2024-09-13T05:11:43.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615650+0000", 2024-09-13T05:11:43.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615656+0000", 2024-09-13T05:11:43.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.472e-06 2024-09-13T05:11:43.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615664+0000", 2024-09-13T05:11:43.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6340000000000001e-06 2024-09-13T05:11:43.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615669+0000", 2024-09-13T05:11:43.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0980000000000001e-06 2024-09-13T05:11:43.971 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.971 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.972 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91038 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.972 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.616136+0000", 2024-09-13T05:11:43.972 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0028971610000000001, 2024-09-13T05:11:43.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068970560000000004, 2024-09-13T05:11:43.972 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.972 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.972 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.972 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.972 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.972 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91038 2024-09-13T05:11:43.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.973 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616136+0000", 2024-09-13T05:11:43.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616136+0000", 2024-09-13T05:11:43.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616136+0000", 2024-09-13T05:11:43.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616137+0000", 2024-09-13T05:11:43.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2759999999999999e-06 2024-09-13T05:11:43.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616140+0000", 2024-09-13T05:11:43.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0800000000000002e-06 2024-09-13T05:11:43.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616143+0000", 2024-09-13T05:11:43.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6079999999999998e-06 2024-09-13T05:11:43.975 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.975 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.975 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.975 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90815 3.19 3.affa599 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.975 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609472+0000", 2024-09-13T05:11:43.975 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0095617429999999993, 2024-09-13T05:11:43.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013604059999999999, 2024-09-13T05:11:43.975 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.976 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.976 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90815 2024-09-13T05:11:43.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.976 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609472+0000", 2024-09-13T05:11:43.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609472+0000", 2024-09-13T05:11:43.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609471+0000", 2024-09-13T05:11:43.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609474+0000", 2024-09-13T05:11:43.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.571e-06 2024-09-13T05:11:43.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609480+0000", 2024-09-13T05:11:43.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3570000000000003e-06 2024-09-13T05:11:43.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609486+0000", 2024-09-13T05:11:43.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:11:43.978 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.978 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.978 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.978 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90847 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.978 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610128+0000", 2024-09-13T05:11:43.979 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0089055609999999993, 2024-09-13T05:11:43.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01298564, 2024-09-13T05:11:43.979 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.979 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.979 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90847 2024-09-13T05:11:43.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.979 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610128+0000", 2024-09-13T05:11:43.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610128+0000", 2024-09-13T05:11:43.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610128+0000", 2024-09-13T05:11:43.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610130+0000", 2024-09-13T05:11:43.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3410000000000001e-06 2024-09-13T05:11:43.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610136+0000", 2024-09-13T05:11:43.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0909999999999998e-06 2024-09-13T05:11:43.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610141+0000", 2024-09-13T05:11:43.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1100000000000002e-06 2024-09-13T05:11:43.981 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.981 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.982 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90879 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.982 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610915+0000", 2024-09-13T05:11:43.982 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0081183620000000005, 2024-09-13T05:11:43.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012237570999999999, 2024-09-13T05:11:43.982 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.982 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.982 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.982 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.982 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.982 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90879 2024-09-13T05:11:43.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.983 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610915+0000", 2024-09-13T05:11:43.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610915+0000", 2024-09-13T05:11:43.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610915+0000", 2024-09-13T05:11:43.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610917+0000", 2024-09-13T05:11:43.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6630000000000002e-06 2024-09-13T05:11:43.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610924+0000", 2024-09-13T05:11:43.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2349999999999996e-06 2024-09-13T05:11:43.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610929+0000", 2024-09-13T05:11:43.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2070000000000003e-06 2024-09-13T05:11:43.985 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.985 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.985 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.985 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90911 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.985 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613001+0000", 2024-09-13T05:11:43.985 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0060323190000000004, 2024-09-13T05:11:43.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010188706, 2024-09-13T05:11:43.985 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.985 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.985 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.985 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.986 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.986 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90911 2024-09-13T05:11:43.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.986 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613001+0000", 2024-09-13T05:11:43.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613001+0000", 2024-09-13T05:11:43.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613000+0000", 2024-09-13T05:11:43.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613005+0000", 2024-09-13T05:11:43.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9370000000000003e-06 2024-09-13T05:11:43.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613031+0000", 2024-09-13T05:11:43.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5386999999999999e-05 2024-09-13T05:11:43.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613041+0000", 2024-09-13T05:11:43.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8970000000000003e-06 2024-09-13T05:11:43.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.988 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.988 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90943 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.988 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614256+0000", 2024-09-13T05:11:43.988 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0047779390000000001, 2024-09-13T05:11:43.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089734979999999999, 2024-09-13T05:11:43.989 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.989 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.989 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.989 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.989 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.989 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90943 2024-09-13T05:11:43.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.989 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614256+0000", 2024-09-13T05:11:43.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614256+0000", 2024-09-13T05:11:43.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614255+0000", 2024-09-13T05:11:43.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:43.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614259+0000", 2024-09-13T05:11:43.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6099999999999999e-06 2024-09-13T05:11:43.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614272+0000", 2024-09-13T05:11:43.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.219e-05 2024-09-13T05:11:43.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614281+0000", 2024-09-13T05:11:43.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2289999999999992e-06 2024-09-13T05:11:43.991 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.991 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.991 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.992 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90975 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.992 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614998+0000", 2024-09-13T05:11:43.992 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0040350969999999996, 2024-09-13T05:11:43.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082681109999999999, 2024-09-13T05:11:43.992 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.992 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.992 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.992 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.992 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.992 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90975 2024-09-13T05:11:43.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.992 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614998+0000", 2024-09-13T05:11:43.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614998+0000", 2024-09-13T05:11:43.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614998+0000", 2024-09-13T05:11:43.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615001+0000", 2024-09-13T05:11:43.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8219999999999998e-06 2024-09-13T05:11:43.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615007+0000", 2024-09-13T05:11:43.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7760000000000003e-06 2024-09-13T05:11:43.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615012+0000", 2024-09-13T05:11:43.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2739999999999998e-06 2024-09-13T05:11:43.995 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.995 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.995 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.995 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91007 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.995 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615674+0000", 2024-09-13T05:11:43.995 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0033597499999999999, 2024-09-13T05:11:43.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007631774, 2024-09-13T05:11:43.995 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.995 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.995 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.995 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.995 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.996 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91007 2024-09-13T05:11:43.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.996 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615674+0000", 2024-09-13T05:11:43.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:43.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615674+0000", 2024-09-13T05:11:43.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:43.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615673+0000", 2024-09-13T05:11:43.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:43.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:43.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615676+0000", 2024-09-13T05:11:43.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0019999999999998e-06 2024-09-13T05:11:43.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:43.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615682+0000", 2024-09-13T05:11:43.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0599999999999996e-06 2024-09-13T05:11:43.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:43.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615687+0000", 2024-09-13T05:11:43.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9799999999999998e-06 2024-09-13T05:11:43.998 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.998 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:43.998 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:43.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.998 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91039 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:43.998 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.616147+0000", 2024-09-13T05:11:43.998 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0028867139999999999, 2024-09-13T05:11:43.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071960599999999998, 2024-09-13T05:11:43.999 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:43.999 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:43.999 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:43.999 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:43.999 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:43.999 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91039 2024-09-13T05:11:43.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.999 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:43.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:43.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616147+0000", 2024-09-13T05:11:43.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:43.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:43.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:43.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616147+0000", 2024-09-13T05:11:44.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616146+0000", 2024-09-13T05:11:44.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616148+0000", 2024-09-13T05:11:44.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.674e-06 2024-09-13T05:11:44.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616151+0000", 2024-09-13T05:11:44.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9790000000000002e-06 2024-09-13T05:11:44.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616153+0000", 2024-09-13T05:11:44.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4719999999999998e-06 2024-09-13T05:11:44.001 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.001 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.001 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.002 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90816 3.19 3.affa599 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.002 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609490+0000", 2024-09-13T05:11:44.002 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0095430459999999995, 2024-09-13T05:11:44.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013889884, 2024-09-13T05:11:44.002 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.002 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.002 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90816 2024-09-13T05:11:44.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.003 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609490+0000", 2024-09-13T05:11:44.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609490+0000", 2024-09-13T05:11:44.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609490+0000", 2024-09-13T05:11:44.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609493+0000", 2024-09-13T05:11:44.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1159999999999999e-06 2024-09-13T05:11:44.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609499+0000", 2024-09-13T05:11:44.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4269999999999996e-06 2024-09-13T05:11:44.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609505+0000", 2024-09-13T05:11:44.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4419999999999997e-06 2024-09-13T05:11:44.005 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.005 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.005 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.005 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90848 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.005 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610146+0000", 2024-09-13T05:11:44.005 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0088877179999999993, 2024-09-13T05:11:44.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013274449000000001, 2024-09-13T05:11:44.005 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.005 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.006 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.006 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.006 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.006 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90848 2024-09-13T05:11:44.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.006 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610146+0000", 2024-09-13T05:11:44.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610146+0000", 2024-09-13T05:11:44.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610145+0000", 2024-09-13T05:11:44.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610152+0000", 2024-09-13T05:11:44.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9260000000000003e-06 2024-09-13T05:11:44.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610159+0000", 2024-09-13T05:11:44.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0330000000000003e-06 2024-09-13T05:11:44.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610165+0000", 2024-09-13T05:11:44.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3870000000000003e-06 2024-09-13T05:11:44.008 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.008 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.008 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.008 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90880 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.009 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610933+0000", 2024-09-13T05:11:44.009 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0080999999999999996, 2024-09-13T05:11:44.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012524092000000001, 2024-09-13T05:11:44.009 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.009 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.009 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90880 2024-09-13T05:11:44.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.009 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610933+0000", 2024-09-13T05:11:44.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610933+0000", 2024-09-13T05:11:44.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610933+0000", 2024-09-13T05:11:44.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610936+0000", 2024-09-13T05:11:44.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7410000000000001e-06 2024-09-13T05:11:44.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610942+0000", 2024-09-13T05:11:44.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0950000000000001e-06 2024-09-13T05:11:44.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610947+0000", 2024-09-13T05:11:44.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.079e-06 2024-09-13T05:11:44.011 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.011 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.011 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.012 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90912 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.012 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613050+0000", 2024-09-13T05:11:44.012 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0059837980000000002, 2024-09-13T05:11:44.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010447592, 2024-09-13T05:11:44.012 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.012 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.012 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.012 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.012 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.012 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90912 2024-09-13T05:11:44.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.012 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613050+0000", 2024-09-13T05:11:44.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613050+0000", 2024-09-13T05:11:44.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613049+0000", 2024-09-13T05:11:44.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:44.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613055+0000", 2024-09-13T05:11:44.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9399999999999999e-06 2024-09-13T05:11:44.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613077+0000", 2024-09-13T05:11:44.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2558999999999999e-05 2024-09-13T05:11:44.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613099+0000", 2024-09-13T05:11:44.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.19e-05 2024-09-13T05:11:44.015 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.015 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.015 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.015 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90944 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.015 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614290+0000", 2024-09-13T05:11:44.015 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0047437989999999999, 2024-09-13T05:11:44.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092448849999999996, 2024-09-13T05:11:44.015 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.015 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.016 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.016 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90944 2024-09-13T05:11:44.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.016 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614290+0000", 2024-09-13T05:11:44.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614290+0000", 2024-09-13T05:11:44.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614289+0000", 2024-09-13T05:11:44.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:44.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614294+0000", 2024-09-13T05:11:44.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8949999999999997e-06 2024-09-13T05:11:44.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614306+0000", 2024-09-13T05:11:44.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1695000000000001e-05 2024-09-13T05:11:44.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614315+0000", 2024-09-13T05:11:44.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.312e-06 2024-09-13T05:11:44.018 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.018 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.018 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.018 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90976 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.018 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615016+0000", 2024-09-13T05:11:44.018 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0040170409999999998, 2024-09-13T05:11:44.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0085574239999999992, 2024-09-13T05:11:44.019 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.019 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.019 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.019 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.019 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.019 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90976 2024-09-13T05:11:44.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.019 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615016+0000", 2024-09-13T05:11:44.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615016+0000", 2024-09-13T05:11:44.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615016+0000", 2024-09-13T05:11:44.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615019+0000", 2024-09-13T05:11:44.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7369999999999998e-06 2024-09-13T05:11:44.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615024+0000", 2024-09-13T05:11:44.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6869999999999999e-06 2024-09-13T05:11:44.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615029+0000", 2024-09-13T05:11:44.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8600000000000001e-06 2024-09-13T05:11:44.021 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.021 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.021 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.022 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91008 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.022 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615694+0000", 2024-09-13T05:11:44.022 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0033393400000000001, 2024-09-13T05:11:44.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079169229999999993, 2024-09-13T05:11:44.022 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.022 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.022 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.022 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.022 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.022 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91008 2024-09-13T05:11:44.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.022 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615694+0000", 2024-09-13T05:11:44.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615694+0000", 2024-09-13T05:11:44.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615694+0000", 2024-09-13T05:11:44.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615696+0000", 2024-09-13T05:11:44.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.728e-06 2024-09-13T05:11:44.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615702+0000", 2024-09-13T05:11:44.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7400000000000001e-06 2024-09-13T05:11:44.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615707+0000", 2024-09-13T05:11:44.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8019999999999999e-06 2024-09-13T05:11:44.024 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.025 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.025 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.025 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91040 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.025 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.616156+0000", 2024-09-13T05:11:44.025 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0028778570000000002, 2024-09-13T05:11:44.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0074946759999999996, 2024-09-13T05:11:44.025 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.025 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.025 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.025 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.025 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.025 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91040 2024-09-13T05:11:44.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.026 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616156+0000", 2024-09-13T05:11:44.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616156+0000", 2024-09-13T05:11:44.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616155+0000", 2024-09-13T05:11:44.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:44.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616157+0000", 2024-09-13T05:11:44.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.364e-06 2024-09-13T05:11:44.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616160+0000", 2024-09-13T05:11:44.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8430000000000001e-06 2024-09-13T05:11:44.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616162+0000", 2024-09-13T05:11:44.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4200000000000001e-06 2024-09-13T05:11:44.028 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.028 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.028 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.028 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90817 3.19 3.affa599 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.028 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609509+0000", 2024-09-13T05:11:44.028 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0095240099999999994, 2024-09-13T05:11:44.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014178517999999999, 2024-09-13T05:11:44.028 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.028 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.028 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.029 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.029 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.029 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90817 2024-09-13T05:11:44.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.029 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609509+0000", 2024-09-13T05:11:44.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609509+0000", 2024-09-13T05:11:44.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609509+0000", 2024-09-13T05:11:44.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609512+0000", 2024-09-13T05:11:44.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7319999999999998e-06 2024-09-13T05:11:44.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609518+0000", 2024-09-13T05:11:44.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3149999999999997e-06 2024-09-13T05:11:44.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609523+0000", 2024-09-13T05:11:44.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0679999999999996e-06 2024-09-13T05:11:44.031 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.031 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.031 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.032 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90849 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.032 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610170+0000", 2024-09-13T05:11:44.032 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0088638439999999992, 2024-09-13T05:11:44.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013557629999999999, 2024-09-13T05:11:44.032 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.032 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.032 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.032 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.032 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.032 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90849 2024-09-13T05:11:44.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.032 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610170+0000", 2024-09-13T05:11:44.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610170+0000", 2024-09-13T05:11:44.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610169+0000", 2024-09-13T05:11:44.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610172+0000", 2024-09-13T05:11:44.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6680000000000001e-06 2024-09-13T05:11:44.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610179+0000", 2024-09-13T05:11:44.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5299999999999999e-06 2024-09-13T05:11:44.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610185+0000", 2024-09-13T05:11:44.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6210000000000001e-06 2024-09-13T05:11:44.034 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.035 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.035 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.035 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90881 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.035 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610951+0000", 2024-09-13T05:11:44.035 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0080820240000000002, 2024-09-13T05:11:44.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012813735999999999, 2024-09-13T05:11:44.035 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.035 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.035 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.035 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.035 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.035 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90881 2024-09-13T05:11:44.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.036 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610951+0000", 2024-09-13T05:11:44.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610951+0000", 2024-09-13T05:11:44.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610951+0000", 2024-09-13T05:11:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610954+0000", 2024-09-13T05:11:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6790000000000001e-06 2024-09-13T05:11:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610960+0000", 2024-09-13T05:11:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7479999999999999e-06 2024-09-13T05:11:44.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610965+0000", 2024-09-13T05:11:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.587e-06 2024-09-13T05:11:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90913 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613119+0000", 2024-09-13T05:11:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0059146889999999999, 2024-09-13T05:11:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010685600999999999, 2024-09-13T05:11:44.038 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90913 2024-09-13T05:11:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613119+0000", 2024-09-13T05:11:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613119+0000", 2024-09-13T05:11:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613118+0000", 2024-09-13T05:11:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613123+0000", 2024-09-13T05:11:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3299999999999998e-06 2024-09-13T05:11:44.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613139+0000", 2024-09-13T05:11:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5726000000000002e-05 2024-09-13T05:11:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613149+0000", 2024-09-13T05:11:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8279999999999998e-06 2024-09-13T05:11:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90945 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614327+0000", 2024-09-13T05:11:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0047064979999999999, 2024-09-13T05:11:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095160379999999992, 2024-09-13T05:11:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90945 2024-09-13T05:11:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614327+0000", 2024-09-13T05:11:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614327+0000", 2024-09-13T05:11:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614326+0000", 2024-09-13T05:11:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614331+0000", 2024-09-13T05:11:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7299999999999996e-06 2024-09-13T05:11:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614343+0000", 2024-09-13T05:11:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2057e-05 2024-09-13T05:11:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614353+0000", 2024-09-13T05:11:44.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7049999999999994e-06 2024-09-13T05:11:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90977 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615034+0000", 2024-09-13T05:11:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0039995559999999996, 2024-09-13T05:11:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088510299999999993, 2024-09-13T05:11:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90977 2024-09-13T05:11:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615034+0000", 2024-09-13T05:11:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615034+0000", 2024-09-13T05:11:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615033+0000", 2024-09-13T05:11:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615036+0000", 2024-09-13T05:11:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7870000000000002e-06 2024-09-13T05:11:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615042+0000", 2024-09-13T05:11:44.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8619999999999999e-06 2024-09-13T05:11:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615047+0000", 2024-09-13T05:11:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9980000000000003e-06 2024-09-13T05:11:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91009 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615712+0000", 2024-09-13T05:11:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0033219579999999999, 2024-09-13T05:11:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082129899999999999, 2024-09-13T05:11:44.048 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91009 2024-09-13T05:11:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615712+0000", 2024-09-13T05:11:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615712+0000", 2024-09-13T05:11:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615711+0000", 2024-09-13T05:11:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615714+0000", 2024-09-13T05:11:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8219999999999998e-06 2024-09-13T05:11:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615720+0000", 2024-09-13T05:11:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8549999999999998e-06 2024-09-13T05:11:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615725+0000", 2024-09-13T05:11:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9099999999999996e-06 2024-09-13T05:11:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.051 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91041 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.616164+0000", 2024-09-13T05:11:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0028692959999999999, 2024-09-13T05:11:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0077973590000000002, 2024-09-13T05:11:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91041 2024-09-13T05:11:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616164+0000", 2024-09-13T05:11:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616164+0000", 2024-09-13T05:11:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616164+0000", 2024-09-13T05:11:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616165+0000", 2024-09-13T05:11:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.44e-06 2024-09-13T05:11:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616168+0000", 2024-09-13T05:11:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8310000000000001e-06 2024-09-13T05:11:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616171+0000", 2024-09-13T05:11:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:11:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.054 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90818 3.19 3.affa599 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609556+0000", 2024-09-13T05:11:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0094775139999999994, 2024-09-13T05:11:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014445368, 2024-09-13T05:11:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90818 2024-09-13T05:11:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.055 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609556+0000", 2024-09-13T05:11:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609556+0000", 2024-09-13T05:11:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609555+0000", 2024-09-13T05:11:44.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609559+0000", 2024-09-13T05:11:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.45e-06 2024-09-13T05:11:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609566+0000", 2024-09-13T05:11:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.764e-06 2024-09-13T05:11:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609572+0000", 2024-09-13T05:11:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.066e-06 2024-09-13T05:11:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90850 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610190+0000", 2024-09-13T05:11:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0088433409999999994, 2024-09-13T05:11:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013848263, 2024-09-13T05:11:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.058 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90850 2024-09-13T05:11:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610190+0000", 2024-09-13T05:11:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610190+0000", 2024-09-13T05:11:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610190+0000", 2024-09-13T05:11:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610193+0000", 2024-09-13T05:11:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9720000000000001e-06 2024-09-13T05:11:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610198+0000", 2024-09-13T05:11:44.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8470000000000001e-06 2024-09-13T05:11:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610204+0000", 2024-09-13T05:11:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1819999999999997e-06 2024-09-13T05:11:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90882 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.611000+0000", 2024-09-13T05:11:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0080338609999999998, 2024-09-13T05:11:44.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013077963, 2024-09-13T05:11:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90882 2024-09-13T05:11:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611000+0000", 2024-09-13T05:11:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611000+0000", 2024-09-13T05:11:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610999+0000", 2024-09-13T05:11:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611002+0000", 2024-09-13T05:11:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9629999999999998e-06 2024-09-13T05:11:44.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611010+0000", 2024-09-13T05:11:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0360000000000006e-06 2024-09-13T05:11:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611016+0000", 2024-09-13T05:11:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2480000000000001e-06 2024-09-13T05:11:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90914 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613158+0000", 2024-09-13T05:11:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0058753269999999996, 2024-09-13T05:11:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010956663, 2024-09-13T05:11:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90914 2024-09-13T05:11:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.065 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613158+0000", 2024-09-13T05:11:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613158+0000", 2024-09-13T05:11:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613157+0000", 2024-09-13T05:11:44.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613162+0000", 2024-09-13T05:11:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0150000000000003e-06 2024-09-13T05:11:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613174+0000", 2024-09-13T05:11:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1766999999999999e-05 2024-09-13T05:11:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613197+0000", 2024-09-13T05:11:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3247e-05 2024-09-13T05:11:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90946 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614362+0000", 2024-09-13T05:11:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0046716860000000004, 2024-09-13T05:11:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097994510000000007, 2024-09-13T05:11:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.068 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90946 2024-09-13T05:11:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614362+0000", 2024-09-13T05:11:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614362+0000", 2024-09-13T05:11:44.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614361+0000", 2024-09-13T05:11:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614372+0000", 2024-09-13T05:11:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0752e-05 2024-09-13T05:11:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614387+0000", 2024-09-13T05:11:44.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.524e-05 2024-09-13T05:11:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614396+0000", 2024-09-13T05:11:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3950000000000007e-06 2024-09-13T05:11:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90978 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615052+0000", 2024-09-13T05:11:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0039816979999999997, 2024-09-13T05:11:44.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091473209999999999, 2024-09-13T05:11:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90978 2024-09-13T05:11:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615052+0000", 2024-09-13T05:11:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615052+0000", 2024-09-13T05:11:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615051+0000", 2024-09-13T05:11:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615054+0000", 2024-09-13T05:11:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8669999999999998e-06 2024-09-13T05:11:44.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615060+0000", 2024-09-13T05:11:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6370000000000004e-06 2024-09-13T05:11:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615065+0000", 2024-09-13T05:11:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9250000000000003e-06 2024-09-13T05:11:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91010 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615729+0000", 2024-09-13T05:11:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0033045980000000002, 2024-09-13T05:11:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0085098629999999995, 2024-09-13T05:11:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91010 2024-09-13T05:11:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615729+0000", 2024-09-13T05:11:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615729+0000", 2024-09-13T05:11:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615728+0000", 2024-09-13T05:11:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615731+0000", 2024-09-13T05:11:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6170000000000001e-06 2024-09-13T05:11:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615737+0000", 2024-09-13T05:11:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8880000000000002e-06 2024-09-13T05:11:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615742+0000", 2024-09-13T05:11:44.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9699999999999998e-06 2024-09-13T05:11:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91042 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.616387+0000", 2024-09-13T05:11:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0026460260000000001, 2024-09-13T05:11:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078883210000000002, 2024-09-13T05:11:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91042 2024-09-13T05:11:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616387+0000", 2024-09-13T05:11:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616387+0000", 2024-09-13T05:11:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616173+0000", 2024-09-13T05:11:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997854 2024-09-13T05:11:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616390+0000", 2024-09-13T05:11:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000217307 2024-09-13T05:11:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616395+0000", 2024-09-13T05:11:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:11:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616399+0000", 2024-09-13T05:11:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8460000000000001e-06 2024-09-13T05:11:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90819 3.19 3.affa599 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609577+0000", 2024-09-13T05:11:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0094566379999999998, 2024-09-13T05:11:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014738535000000001, 2024-09-13T05:11:44.081 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90819 2024-09-13T05:11:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609577+0000", 2024-09-13T05:11:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609577+0000", 2024-09-13T05:11:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609576+0000", 2024-09-13T05:11:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609579+0000", 2024-09-13T05:11:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.819e-06 2024-09-13T05:11:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609586+0000", 2024-09-13T05:11:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2539999999999998e-06 2024-09-13T05:11:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609591+0000", 2024-09-13T05:11:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4389999999999999e-06 2024-09-13T05:11:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90851 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.084 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610208+0000", 2024-09-13T05:11:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0088252980000000005, 2024-09-13T05:11:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014145335, 2024-09-13T05:11:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90851 2024-09-13T05:11:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610208+0000", 2024-09-13T05:11:44.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610208+0000", 2024-09-13T05:11:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610208+0000", 2024-09-13T05:11:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610210+0000", 2024-09-13T05:11:44.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5679999999999998e-06 2024-09-13T05:11:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610216+0000", 2024-09-13T05:11:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0689999999999998e-06 2024-09-13T05:11:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610222+0000", 2024-09-13T05:11:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3419999999999998e-06 2024-09-13T05:11:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90883 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.611021+0000", 2024-09-13T05:11:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0080120439999999994, 2024-09-13T05:11:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013369702000000001, 2024-09-13T05:11:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90883 2024-09-13T05:11:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.088 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611021+0000", 2024-09-13T05:11:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611021+0000", 2024-09-13T05:11:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611021+0000", 2024-09-13T05:11:44.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611024+0000", 2024-09-13T05:11:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8870000000000001e-06 2024-09-13T05:11:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611030+0000", 2024-09-13T05:11:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8919999999999997e-06 2024-09-13T05:11:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611035+0000", 2024-09-13T05:11:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2660000000000001e-06 2024-09-13T05:11:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90915 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613208+0000", 2024-09-13T05:11:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0058250810000000002, 2024-09-13T05:11:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011222331, 2024-09-13T05:11:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90915 2024-09-13T05:11:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613208+0000", 2024-09-13T05:11:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613208+0000", 2024-09-13T05:11:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613207+0000", 2024-09-13T05:11:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613213+0000", 2024-09-13T05:11:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3000000000000001e-06 2024-09-13T05:11:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613225+0000", 2024-09-13T05:11:44.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2149e-05 2024-09-13T05:11:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613245+0000", 2024-09-13T05:11:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0485000000000001e-05 2024-09-13T05:11:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90947 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614405+0000", 2024-09-13T05:11:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0046284170000000001, 2024-09-13T05:11:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010062816, 2024-09-13T05:11:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90947 2024-09-13T05:11:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614405+0000", 2024-09-13T05:11:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614405+0000", 2024-09-13T05:11:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614404+0000", 2024-09-13T05:11:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614409+0000", 2024-09-13T05:11:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1970000000000004e-06 2024-09-13T05:11:44.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614421+0000", 2024-09-13T05:11:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2038000000000001e-05 2024-09-13T05:11:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614431+0000", 2024-09-13T05:11:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4399999999999994e-06 2024-09-13T05:11:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90979 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615069+0000", 2024-09-13T05:11:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0039644140000000003, 2024-09-13T05:11:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094378659999999996, 2024-09-13T05:11:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90979 2024-09-13T05:11:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615069+0000", 2024-09-13T05:11:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615069+0000", 2024-09-13T05:11:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615069+0000", 2024-09-13T05:11:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615071+0000", 2024-09-13T05:11:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6230000000000001e-06 2024-09-13T05:11:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615077+0000", 2024-09-13T05:11:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.767e-06 2024-09-13T05:11:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615082+0000", 2024-09-13T05:11:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9799999999999998e-06 2024-09-13T05:11:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91011 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615746+0000", 2024-09-13T05:11:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0032870270000000001, 2024-09-13T05:11:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0087992839999999992, 2024-09-13T05:11:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91011 2024-09-13T05:11:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615746+0000", 2024-09-13T05:11:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615746+0000", 2024-09-13T05:11:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615746+0000", 2024-09-13T05:11:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615749+0000", 2024-09-13T05:11:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.988e-06 2024-09-13T05:11:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615755+0000", 2024-09-13T05:11:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.874e-06 2024-09-13T05:11:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615760+0000", 2024-09-13T05:11:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8280000000000002e-06 2024-09-13T05:11:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91043 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.616405+0000", 2024-09-13T05:11:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0026282290000000002, 2024-09-13T05:11:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083448440000000006, 2024-09-13T05:11:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91043 2024-09-13T05:11:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616405+0000", 2024-09-13T05:11:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616405+0000", 2024-09-13T05:11:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616405+0000", 2024-09-13T05:11:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616410+0000", 2024-09-13T05:11:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4029999999999998e-06 2024-09-13T05:11:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616416+0000", 2024-09-13T05:11:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.823e-06 2024-09-13T05:11:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616421+0000", 2024-09-13T05:11:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.826e-06 2024-09-13T05:11:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90820 3.19 3.affa599 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609596+0000", 2024-09-13T05:11:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0094372480000000005, 2024-09-13T05:11:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015193256, 2024-09-13T05:11:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90820 2024-09-13T05:11:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609596+0000", 2024-09-13T05:11:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609596+0000", 2024-09-13T05:11:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609596+0000", 2024-09-13T05:11:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609599+0000", 2024-09-13T05:11:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8739999999999999e-06 2024-09-13T05:11:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609605+0000", 2024-09-13T05:11:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3899999999999998e-06 2024-09-13T05:11:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609610+0000", 2024-09-13T05:11:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.118e-06 2024-09-13T05:11:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90852 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610309+0000", 2024-09-13T05:11:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0087249920000000009, 2024-09-13T05:11:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014521312, 2024-09-13T05:11:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90852 2024-09-13T05:11:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610309+0000", 2024-09-13T05:11:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610309+0000", 2024-09-13T05:11:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610308+0000", 2024-09-13T05:11:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610311+0000", 2024-09-13T05:11:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4039999999999999e-06 2024-09-13T05:11:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610319+0000", 2024-09-13T05:11:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2189999999999998e-06 2024-09-13T05:11:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610326+0000", 2024-09-13T05:11:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3019999999999997e-06 2024-09-13T05:11:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90884 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.611040+0000", 2024-09-13T05:11:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0079938779999999994, 2024-09-13T05:11:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013827812, 2024-09-13T05:11:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90884 2024-09-13T05:11:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611040+0000", 2024-09-13T05:11:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611040+0000", 2024-09-13T05:11:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611039+0000", 2024-09-13T05:11:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611042+0000", 2024-09-13T05:11:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7760000000000002e-06 2024-09-13T05:11:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611048+0000", 2024-09-13T05:11:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:11:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611053+0000", 2024-09-13T05:11:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.797e-06 2024-09-13T05:11:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90916 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613255+0000", 2024-09-13T05:11:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0057782950000000001, 2024-09-13T05:11:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011650901, 2024-09-13T05:11:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90916 2024-09-13T05:11:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613255+0000", 2024-09-13T05:11:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613255+0000", 2024-09-13T05:11:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613254+0000", 2024-09-13T05:11:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613260+0000", 2024-09-13T05:11:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3669999999999996e-06 2024-09-13T05:11:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613271+0000", 2024-09-13T05:11:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1737e-05 2024-09-13T05:11:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613281+0000", 2024-09-13T05:11:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8179999999999999e-06 2024-09-13T05:11:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90948 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614436+0000", 2024-09-13T05:11:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0045970100000000003, 2024-09-13T05:11:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010506638, 2024-09-13T05:11:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90948 2024-09-13T05:11:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614436+0000", 2024-09-13T05:11:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614436+0000", 2024-09-13T05:11:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614436+0000", 2024-09-13T05:11:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614439+0000", 2024-09-13T05:11:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0230000000000001e-06 2024-09-13T05:11:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614445+0000", 2024-09-13T05:11:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8919999999999997e-06 2024-09-13T05:11:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614452+0000", 2024-09-13T05:11:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3950000000000003e-06 2024-09-13T05:11:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.123 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90980 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615088+0000", 2024-09-13T05:11:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0039459940000000004, 2024-09-13T05:11:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0099002799999999992, 2024-09-13T05:11:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90980 2024-09-13T05:11:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615088+0000", 2024-09-13T05:11:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615088+0000", 2024-09-13T05:11:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615087+0000", 2024-09-13T05:11:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615090+0000", 2024-09-13T05:11:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9270000000000001e-06 2024-09-13T05:11:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615096+0000", 2024-09-13T05:11:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8479999999999997e-06 2024-09-13T05:11:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615103+0000", 2024-09-13T05:11:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2540000000000003e-06 2024-09-13T05:11:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.126 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91012 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615764+0000", 2024-09-13T05:11:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0032693269999999998, 2024-09-13T05:11:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092607379999999993, 2024-09-13T05:11:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91012 2024-09-13T05:11:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.127 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615764+0000", 2024-09-13T05:11:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615764+0000", 2024-09-13T05:11:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615764+0000", 2024-09-13T05:11:44.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615766+0000", 2024-09-13T05:11:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7829999999999999e-06 2024-09-13T05:11:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615772+0000", 2024-09-13T05:11:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8019999999999997e-06 2024-09-13T05:11:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615777+0000", 2024-09-13T05:11:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0250000000000002e-06 2024-09-13T05:11:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91044 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.616424+0000", 2024-09-13T05:11:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0026097550000000001, 2024-09-13T05:11:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086384670000000004, 2024-09-13T05:11:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.130 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91044 2024-09-13T05:11:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616424+0000", 2024-09-13T05:11:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616424+0000", 2024-09-13T05:11:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616423+0000", 2024-09-13T05:11:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616426+0000", 2024-09-13T05:11:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5749999999999999e-06 2024-09-13T05:11:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616431+0000", 2024-09-13T05:11:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8690000000000003e-06 2024-09-13T05:11:44.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616435+0000", 2024-09-13T05:11:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.07e-06 2024-09-13T05:11:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90853 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610331+0000", 2024-09-13T05:11:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.008702507, 2024-09-13T05:11:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014771413000000001, 2024-09-13T05:11:44.133 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90853 2024-09-13T05:11:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610331+0000", 2024-09-13T05:11:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610331+0000", 2024-09-13T05:11:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610330+0000", 2024-09-13T05:11:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610333+0000", 2024-09-13T05:11:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7719999999999999e-06 2024-09-13T05:11:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610340+0000", 2024-09-13T05:11:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7800000000000003e-06 2024-09-13T05:11:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610345+0000", 2024-09-13T05:11:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3229999999999997e-06 2024-09-13T05:11:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.136 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90885 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.611060+0000", 2024-09-13T05:11:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0079732480000000005, 2024-09-13T05:11:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014079707, 2024-09-13T05:11:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90885 2024-09-13T05:11:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611060+0000", 2024-09-13T05:11:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611060+0000", 2024-09-13T05:11:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611060+0000", 2024-09-13T05:11:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611066+0000", 2024-09-13T05:11:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6130000000000003e-06 2024-09-13T05:11:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611072+0000", 2024-09-13T05:11:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0800000000000002e-06 2024-09-13T05:11:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611077+0000", 2024-09-13T05:11:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2220000000000001e-06 2024-09-13T05:11:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.139 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90917 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613290+0000", 2024-09-13T05:11:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0057432749999999999, 2024-09-13T05:11:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011891709, 2024-09-13T05:11:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90917 2024-09-13T05:11:44.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613290+0000", 2024-09-13T05:11:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613290+0000", 2024-09-13T05:11:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613289+0000", 2024-09-13T05:11:44.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613294+0000", 2024-09-13T05:11:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.775e-06 2024-09-13T05:11:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613305+0000", 2024-09-13T05:11:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.132e-05 2024-09-13T05:11:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613315+0000", 2024-09-13T05:11:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3589999999999997e-06 2024-09-13T05:11:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90949 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614458+0000", 2024-09-13T05:11:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0045756989999999999, 2024-09-13T05:11:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0107616, 2024-09-13T05:11:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.143 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90949 2024-09-13T05:11:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614458+0000", 2024-09-13T05:11:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614458+0000", 2024-09-13T05:11:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614457+0000", 2024-09-13T05:11:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614460+0000", 2024-09-13T05:11:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8080000000000001e-06 2024-09-13T05:11:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614466+0000", 2024-09-13T05:11:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9159999999999998e-06 2024-09-13T05:11:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614471+0000", 2024-09-13T05:11:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.006e-06 2024-09-13T05:11:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90981 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.146 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615122+0000", 2024-09-13T05:11:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0039110949999999998, 2024-09-13T05:11:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010142174, 2024-09-13T05:11:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90981 2024-09-13T05:11:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615122+0000", 2024-09-13T05:11:44.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615122+0000", 2024-09-13T05:11:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615122+0000", 2024-09-13T05:11:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615125+0000", 2024-09-13T05:11:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0879999999999999e-06 2024-09-13T05:11:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615131+0000", 2024-09-13T05:11:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1500000000000004e-06 2024-09-13T05:11:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615136+0000", 2024-09-13T05:11:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.215e-06 2024-09-13T05:11:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.149 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91013 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615783+0000", 2024-09-13T05:11:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0032506000000000002, 2024-09-13T05:11:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095190269999999993, 2024-09-13T05:11:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91013 2024-09-13T05:11:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.150 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615783+0000", 2024-09-13T05:11:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615783+0000", 2024-09-13T05:11:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615782+0000", 2024-09-13T05:11:44.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615785+0000", 2024-09-13T05:11:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.712e-06 2024-09-13T05:11:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615791+0000", 2024-09-13T05:11:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9800000000000003e-06 2024-09-13T05:11:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615796+0000", 2024-09-13T05:11:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7500000000000003e-06 2024-09-13T05:11:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91045 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.617065+0000", 2024-09-13T05:11:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0019688000000000002, 2024-09-13T05:11:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082760449999999992, 2024-09-13T05:11:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.153 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91045 2024-09-13T05:11:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617065+0000", 2024-09-13T05:11:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617065+0000", 2024-09-13T05:11:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.616438+0000", 2024-09-13T05:11:44.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9993734 2024-09-13T05:11:44.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617071+0000", 2024-09-13T05:11:44.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00063246199999999998 2024-09-13T05:11:44.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617083+0000", 2024-09-13T05:11:44.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2587e-05 2024-09-13T05:11:44.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617091+0000", 2024-09-13T05:11:44.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7379999999999994e-06 2024-09-13T05:11:44.156 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.156 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.156 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.156 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90822 3.19 3.affa599 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.156 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609634+0000", 2024-09-13T05:11:44.156 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0093998399999999996, 2024-09-13T05:11:44.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01574532, 2024-09-13T05:11:44.157 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.157 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.157 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.157 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.157 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.157 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90822 2024-09-13T05:11:44.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.157 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609634+0000", 2024-09-13T05:11:44.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609634+0000", 2024-09-13T05:11:44.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609633+0000", 2024-09-13T05:11:44.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609636+0000", 2024-09-13T05:11:44.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.52e-06 2024-09-13T05:11:44.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609642+0000", 2024-09-13T05:11:44.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1e-06 2024-09-13T05:11:44.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609648+0000", 2024-09-13T05:11:44.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.592e-06 2024-09-13T05:11:44.162 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.162 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.162 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.163 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90854 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.163 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610351+0000", 2024-09-13T05:11:44.163 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0086826509999999996, 2024-09-13T05:11:44.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015067527000000001, 2024-09-13T05:11:44.163 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.163 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.163 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.163 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.163 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.163 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90854 2024-09-13T05:11:44.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.163 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610351+0000", 2024-09-13T05:11:44.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610351+0000", 2024-09-13T05:11:44.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610350+0000", 2024-09-13T05:11:44.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610353+0000", 2024-09-13T05:11:44.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8320000000000002e-06 2024-09-13T05:11:44.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610359+0000", 2024-09-13T05:11:44.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.117e-06 2024-09-13T05:11:44.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610365+0000", 2024-09-13T05:11:44.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.181e-06 2024-09-13T05:11:44.166 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.166 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.166 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.166 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90886 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.166 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.611082+0000", 2024-09-13T05:11:44.166 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.007951629, 2024-09-13T05:11:44.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014374629, 2024-09-13T05:11:44.166 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.166 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.166 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.167 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.167 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.167 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90886 2024-09-13T05:11:44.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.167 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611082+0000", 2024-09-13T05:11:44.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611082+0000", 2024-09-13T05:11:44.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611081+0000", 2024-09-13T05:11:44.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611084+0000", 2024-09-13T05:11:44.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0510000000000001e-06 2024-09-13T05:11:44.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611091+0000", 2024-09-13T05:11:44.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3439999999999997e-06 2024-09-13T05:11:44.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611096+0000", 2024-09-13T05:11:44.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4240000000000001e-06 2024-09-13T05:11:44.169 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.169 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.169 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.169 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90918 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.169 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613323+0000", 2024-09-13T05:11:44.170 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0057101560000000001, 2024-09-13T05:11:44.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012170202999999999, 2024-09-13T05:11:44.170 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.170 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.170 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.170 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.170 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.170 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90918 2024-09-13T05:11:44.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.170 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613323+0000", 2024-09-13T05:11:44.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613323+0000", 2024-09-13T05:11:44.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613323+0000", 2024-09-13T05:11:44.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:44.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613327+0000", 2024-09-13T05:11:44.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8080000000000004e-06 2024-09-13T05:11:44.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613339+0000", 2024-09-13T05:11:44.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1362000000000001e-05 2024-09-13T05:11:44.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613348+0000", 2024-09-13T05:11:44.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1770000000000004e-06 2024-09-13T05:11:44.172 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.172 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.172 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.173 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90950 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.173 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614477+0000", 2024-09-13T05:11:44.173 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.004556821, 2024-09-13T05:11:44.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011056188, 2024-09-13T05:11:44.173 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.173 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.173 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.173 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.173 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.173 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90950 2024-09-13T05:11:44.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.173 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614477+0000", 2024-09-13T05:11:44.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614477+0000", 2024-09-13T05:11:44.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614476+0000", 2024-09-13T05:11:44.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614479+0000", 2024-09-13T05:11:44.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8720000000000002e-06 2024-09-13T05:11:44.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614486+0000", 2024-09-13T05:11:44.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.81e-06 2024-09-13T05:11:44.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614491+0000", 2024-09-13T05:11:44.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.87e-06 2024-09-13T05:11:44.176 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.176 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.176 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.176 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90982 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.176 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615141+0000", 2024-09-13T05:11:44.176 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0038925779999999998, 2024-09-13T05:11:44.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010428949, 2024-09-13T05:11:44.176 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.176 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.176 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.176 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.176 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.177 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90982 2024-09-13T05:11:44.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.177 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615141+0000", 2024-09-13T05:11:44.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615141+0000", 2024-09-13T05:11:44.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615140+0000", 2024-09-13T05:11:44.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615146+0000", 2024-09-13T05:11:44.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9179999999999999e-06 2024-09-13T05:11:44.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615152+0000", 2024-09-13T05:11:44.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8540000000000002e-06 2024-09-13T05:11:44.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615159+0000", 2024-09-13T05:11:44.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3499999999999999e-06 2024-09-13T05:11:44.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.179 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.179 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91014 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.179 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615800+0000", 2024-09-13T05:11:44.179 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0032331320000000001, 2024-09-13T05:11:44.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0098084560000000001, 2024-09-13T05:11:44.179 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.179 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.180 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.180 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.180 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.180 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91014 2024-09-13T05:11:44.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.180 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615800+0000", 2024-09-13T05:11:44.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615800+0000", 2024-09-13T05:11:44.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615800+0000", 2024-09-13T05:11:44.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615803+0000", 2024-09-13T05:11:44.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6599999999999999e-06 2024-09-13T05:11:44.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615808+0000", 2024-09-13T05:11:44.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7819999999999999e-06 2024-09-13T05:11:44.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615813+0000", 2024-09-13T05:11:44.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8729999999999998e-06 2024-09-13T05:11:44.182 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.182 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.182 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.182 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91046 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.182 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.617098+0000", 2024-09-13T05:11:44.183 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0019356130000000001, 2024-09-13T05:11:44.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0085481559999999995, 2024-09-13T05:11:44.183 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.183 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.183 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.183 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.183 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.183 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91046 2024-09-13T05:11:44.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.183 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617098+0000", 2024-09-13T05:11:44.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617098+0000", 2024-09-13T05:11:44.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617097+0000", 2024-09-13T05:11:44.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617100+0000", 2024-09-13T05:11:44.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0079999999999998e-06 2024-09-13T05:11:44.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617107+0000", 2024-09-13T05:11:44.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2920000000000001e-06 2024-09-13T05:11:44.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617112+0000", 2024-09-13T05:11:44.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8060000000000002e-06 2024-09-13T05:11:44.185 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.185 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.186 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.186 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90855 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.186 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610370+0000", 2024-09-13T05:11:44.186 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.008663792, 2024-09-13T05:11:44.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015315584, 2024-09-13T05:11:44.186 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.186 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.186 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.186 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.186 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.186 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90855 2024-09-13T05:11:44.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.187 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610370+0000", 2024-09-13T05:11:44.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610370+0000", 2024-09-13T05:11:44.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610369+0000", 2024-09-13T05:11:44.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:44.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610372+0000", 2024-09-13T05:11:44.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-09-13T05:11:44.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610379+0000", 2024-09-13T05:11:44.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2269999999999998e-06 2024-09-13T05:11:44.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610384+0000", 2024-09-13T05:11:44.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2580000000000003e-06 2024-09-13T05:11:44.189 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.189 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.189 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.189 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90887 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.189 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.611101+0000", 2024-09-13T05:11:44.189 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0079328230000000003, 2024-09-13T05:11:44.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014622466000000001, 2024-09-13T05:11:44.189 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.189 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.190 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.190 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90887 2024-09-13T05:11:44.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.190 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611101+0000", 2024-09-13T05:11:44.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611101+0000", 2024-09-13T05:11:44.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611100+0000", 2024-09-13T05:11:44.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611103+0000", 2024-09-13T05:11:44.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0769999999999999e-06 2024-09-13T05:11:44.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611110+0000", 2024-09-13T05:11:44.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4999999999999996e-06 2024-09-13T05:11:44.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611115+0000", 2024-09-13T05:11:44.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2170000000000002e-06 2024-09-13T05:11:44.192 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.192 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.192 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.192 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90919 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.192 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613357+0000", 2024-09-13T05:11:44.192 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0056767270000000003, 2024-09-13T05:11:44.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012405363000000001, 2024-09-13T05:11:44.193 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.193 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.193 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.193 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.193 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.193 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90919 2024-09-13T05:11:44.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.193 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613357+0000", 2024-09-13T05:11:44.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613357+0000", 2024-09-13T05:11:44.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613356+0000", 2024-09-13T05:11:44.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:44.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613361+0000", 2024-09-13T05:11:44.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9130000000000002e-06 2024-09-13T05:11:44.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613372+0000", 2024-09-13T05:11:44.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1620000000000001e-05 2024-09-13T05:11:44.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613382+0000", 2024-09-13T05:11:44.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.217e-06 2024-09-13T05:11:44.195 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.195 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.195 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.195 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90951 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.196 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614495+0000", 2024-09-13T05:11:44.196 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.004538182, 2024-09-13T05:11:44.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011304282000000001, 2024-09-13T05:11:44.196 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.196 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.196 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.196 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.196 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.196 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90951 2024-09-13T05:11:44.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.196 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614495+0000", 2024-09-13T05:11:44.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614495+0000", 2024-09-13T05:11:44.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614495+0000", 2024-09-13T05:11:44.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614498+0000", 2024-09-13T05:11:44.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9440000000000001e-06 2024-09-13T05:11:44.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614504+0000", 2024-09-13T05:11:44.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7780000000000004e-06 2024-09-13T05:11:44.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614509+0000", 2024-09-13T05:11:44.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2379999999999997e-06 2024-09-13T05:11:44.198 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.198 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.199 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.199 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90983 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.199 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615164+0000", 2024-09-13T05:11:44.199 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0038694039999999999, 2024-09-13T05:11:44.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010674692, 2024-09-13T05:11:44.199 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.199 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.199 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.199 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.199 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.199 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90983 2024-09-13T05:11:44.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.200 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615164+0000", 2024-09-13T05:11:44.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615164+0000", 2024-09-13T05:11:44.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615164+0000", 2024-09-13T05:11:44.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615167+0000", 2024-09-13T05:11:44.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9790000000000002e-06 2024-09-13T05:11:44.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615172+0000", 2024-09-13T05:11:44.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.755e-06 2024-09-13T05:11:44.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615177+0000", 2024-09-13T05:11:44.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9779999999999996e-06 2024-09-13T05:11:44.202 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.202 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.202 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.202 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91015 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.202 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615818+0000", 2024-09-13T05:11:44.202 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0032157700000000002, 2024-09-13T05:11:44.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0100582, 2024-09-13T05:11:44.202 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.202 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.202 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.202 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.202 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.203 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91015 2024-09-13T05:11:44.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.203 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615818+0000", 2024-09-13T05:11:44.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615818+0000", 2024-09-13T05:11:44.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615817+0000", 2024-09-13T05:11:44.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615820+0000", 2024-09-13T05:11:44.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9550000000000001e-06 2024-09-13T05:11:44.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615826+0000", 2024-09-13T05:11:44.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8649999999999998e-06 2024-09-13T05:11:44.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615831+0000", 2024-09-13T05:11:44.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9799999999999998e-06 2024-09-13T05:11:44.205 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.205 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.205 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.205 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91047 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.205 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.617117+0000", 2024-09-13T05:11:44.205 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001916926, 2024-09-13T05:11:44.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0087989709999999992, 2024-09-13T05:11:44.206 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.206 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.206 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.206 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.206 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.206 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91047 2024-09-13T05:11:44.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.206 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617117+0000", 2024-09-13T05:11:44.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617117+0000", 2024-09-13T05:11:44.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617116+0000", 2024-09-13T05:11:44.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617119+0000", 2024-09-13T05:11:44.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1070000000000001e-06 2024-09-13T05:11:44.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617125+0000", 2024-09-13T05:11:44.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9939999999999997e-06 2024-09-13T05:11:44.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617130+0000", 2024-09-13T05:11:44.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7659999999999998e-06 2024-09-13T05:11:44.208 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.208 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.208 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.209 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90824 3.19 3.affa599 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.209 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609671+0000", 2024-09-13T05:11:44.209 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0093627169999999996, 2024-09-13T05:11:44.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016283103, 2024-09-13T05:11:44.209 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.209 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.209 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.209 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.209 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.209 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90824 2024-09-13T05:11:44.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.209 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609671+0000", 2024-09-13T05:11:44.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609671+0000", 2024-09-13T05:11:44.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609670+0000", 2024-09-13T05:11:44.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609676+0000", 2024-09-13T05:11:44.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9179999999999999e-06 2024-09-13T05:11:44.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609683+0000", 2024-09-13T05:11:44.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4479999999999999e-06 2024-09-13T05:11:44.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609688+0000", 2024-09-13T05:11:44.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2270000000000001e-06 2024-09-13T05:11:44.211 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.211 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.212 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.212 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90856 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.212 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610389+0000", 2024-09-13T05:11:44.212 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0086447290000000003, 2024-09-13T05:11:44.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015602201, 2024-09-13T05:11:44.212 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.212 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.212 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.212 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.212 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.212 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90856 2024-09-13T05:11:44.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.213 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610389+0000", 2024-09-13T05:11:44.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610389+0000", 2024-09-13T05:11:44.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610388+0000", 2024-09-13T05:11:44.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610391+0000", 2024-09-13T05:11:44.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.514e-06 2024-09-13T05:11:44.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610397+0000", 2024-09-13T05:11:44.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0909999999999998e-06 2024-09-13T05:11:44.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610402+0000", 2024-09-13T05:11:44.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3059999999999997e-06 2024-09-13T05:11:44.215 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.215 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.215 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.215 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90888 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.215 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.611120+0000", 2024-09-13T05:11:44.215 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0079139680000000004, 2024-09-13T05:11:44.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014911102000000001, 2024-09-13T05:11:44.215 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.215 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.215 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.216 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.216 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.216 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90888 2024-09-13T05:11:44.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.216 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611120+0000", 2024-09-13T05:11:44.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611120+0000", 2024-09-13T05:11:44.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611119+0000", 2024-09-13T05:11:44.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611122+0000", 2024-09-13T05:11:44.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6429999999999999e-06 2024-09-13T05:11:44.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611128+0000", 2024-09-13T05:11:44.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9909999999999999e-06 2024-09-13T05:11:44.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611133+0000", 2024-09-13T05:11:44.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1220000000000003e-06 2024-09-13T05:11:44.218 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.218 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.218 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.218 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90920 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.218 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613390+0000", 2024-09-13T05:11:44.219 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.005643108, 2024-09-13T05:11:44.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012677623000000001, 2024-09-13T05:11:44.219 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.219 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.219 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.219 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.219 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.219 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90920 2024-09-13T05:11:44.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.219 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613390+0000", 2024-09-13T05:11:44.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613390+0000", 2024-09-13T05:11:44.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613390+0000", 2024-09-13T05:11:44.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:44.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613394+0000", 2024-09-13T05:11:44.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.792e-06 2024-09-13T05:11:44.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613406+0000", 2024-09-13T05:11:44.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1772e-05 2024-09-13T05:11:44.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613416+0000", 2024-09-13T05:11:44.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9250000000000007e-06 2024-09-13T05:11:44.221 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.221 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.222 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.222 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90952 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.222 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614514+0000", 2024-09-13T05:11:44.222 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0045198970000000002, 2024-09-13T05:11:44.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011593368, 2024-09-13T05:11:44.222 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.222 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.222 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.222 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.222 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.222 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90952 2024-09-13T05:11:44.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.223 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614514+0000", 2024-09-13T05:11:44.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614514+0000", 2024-09-13T05:11:44.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614513+0000", 2024-09-13T05:11:44.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614516+0000", 2024-09-13T05:11:44.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:11:44.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614522+0000", 2024-09-13T05:11:44.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.66e-06 2024-09-13T05:11:44.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614526+0000", 2024-09-13T05:11:44.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:11:44.225 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.225 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.225 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.225 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90984 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.225 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615182+0000", 2024-09-13T05:11:44.225 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0038517740000000001, 2024-09-13T05:11:44.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010962349999999999, 2024-09-13T05:11:44.225 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.225 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.225 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.226 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.226 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.226 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90984 2024-09-13T05:11:44.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.226 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615182+0000", 2024-09-13T05:11:44.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615182+0000", 2024-09-13T05:11:44.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615181+0000", 2024-09-13T05:11:44.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615184+0000", 2024-09-13T05:11:44.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6800000000000002e-06 2024-09-13T05:11:44.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615190+0000", 2024-09-13T05:11:44.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8869999999999997e-06 2024-09-13T05:11:44.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615195+0000", 2024-09-13T05:11:44.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0350000000000001e-06 2024-09-13T05:11:44.228 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.228 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.228 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.228 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91016 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.228 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615851+0000", 2024-09-13T05:11:44.228 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0031822410000000001, 2024-09-13T05:11:44.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010331557999999999, 2024-09-13T05:11:44.229 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.229 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.229 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.229 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.229 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.229 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91016 2024-09-13T05:11:44.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.229 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615851+0000", 2024-09-13T05:11:44.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615851+0000", 2024-09-13T05:11:44.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615851+0000", 2024-09-13T05:11:44.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:44.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615854+0000", 2024-09-13T05:11:44.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4350000000000001e-06 2024-09-13T05:11:44.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615861+0000", 2024-09-13T05:11:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9870000000000002e-06 2024-09-13T05:11:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615866+0000", 2024-09-13T05:11:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2499999999999997e-06 2024-09-13T05:11:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91048 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.617135+0000", 2024-09-13T05:11:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0018987400000000001, 2024-09-13T05:11:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0090854449999999993, 2024-09-13T05:11:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91048 2024-09-13T05:11:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617135+0000", 2024-09-13T05:11:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617135+0000", 2024-09-13T05:11:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617134+0000", 2024-09-13T05:11:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617137+0000", 2024-09-13T05:11:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4660000000000002e-06 2024-09-13T05:11:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617143+0000", 2024-09-13T05:11:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8950000000000003e-06 2024-09-13T05:11:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617148+0000", 2024-09-13T05:11:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8829999999999997e-06 2024-09-13T05:11:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90825 3.19 3.affa599 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609695+0000", 2024-09-13T05:11:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0093387190000000005, 2024-09-13T05:11:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016564756999999999, 2024-09-13T05:11:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90825 2024-09-13T05:11:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609695+0000", 2024-09-13T05:11:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609695+0000", 2024-09-13T05:11:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609694+0000", 2024-09-13T05:11:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609697+0000", 2024-09-13T05:11:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.993e-06 2024-09-13T05:11:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609704+0000", 2024-09-13T05:11:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.229e-06 2024-09-13T05:11:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609709+0000", 2024-09-13T05:11:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2310000000000004e-06 2024-09-13T05:11:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90857 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610407+0000", 2024-09-13T05:11:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0086262230000000006, 2024-09-13T05:11:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015889997999999999, 2024-09-13T05:11:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90857 2024-09-13T05:11:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610407+0000", 2024-09-13T05:11:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610407+0000", 2024-09-13T05:11:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610407+0000", 2024-09-13T05:11:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610410+0000", 2024-09-13T05:11:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0410000000000002e-06 2024-09-13T05:11:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610416+0000", 2024-09-13T05:11:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.144e-06 2024-09-13T05:11:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610421+0000", 2024-09-13T05:11:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2750000000000003e-06 2024-09-13T05:11:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90889 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.611137+0000", 2024-09-13T05:11:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0078960300000000001, 2024-09-13T05:11:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015199839, 2024-09-13T05:11:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90889 2024-09-13T05:11:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611137+0000", 2024-09-13T05:11:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611137+0000", 2024-09-13T05:11:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611137+0000", 2024-09-13T05:11:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611140+0000", 2024-09-13T05:11:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5689999999999999e-06 2024-09-13T05:11:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611146+0000", 2024-09-13T05:11:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0050000000000001e-06 2024-09-13T05:11:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611151+0000", 2024-09-13T05:11:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.198e-06 2024-09-13T05:11:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90921 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613426+0000", 2024-09-13T05:11:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0056072860000000004, 2024-09-13T05:11:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012947734000000001, 2024-09-13T05:11:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90921 2024-09-13T05:11:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613426+0000", 2024-09-13T05:11:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613426+0000", 2024-09-13T05:11:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613425+0000", 2024-09-13T05:11:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613437+0000", 2024-09-13T05:11:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1272e-05 2024-09-13T05:11:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613449+0000", 2024-09-13T05:11:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2086000000000001e-05 2024-09-13T05:11:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613459+0000", 2024-09-13T05:11:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8919999999999995e-06 2024-09-13T05:11:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90953 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614531+0000", 2024-09-13T05:11:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0045022619999999999, 2024-09-13T05:11:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011882306, 2024-09-13T05:11:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90953 2024-09-13T05:11:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614531+0000", 2024-09-13T05:11:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614531+0000", 2024-09-13T05:11:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614531+0000", 2024-09-13T05:11:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614533+0000", 2024-09-13T05:11:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.852e-06 2024-09-13T05:11:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614539+0000", 2024-09-13T05:11:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7780000000000004e-06 2024-09-13T05:11:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614544+0000", 2024-09-13T05:11:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1869999999999996e-06 2024-09-13T05:11:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90985 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615202+0000", 2024-09-13T05:11:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0038317820000000002, 2024-09-13T05:11:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011249449999999999, 2024-09-13T05:11:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90985 2024-09-13T05:11:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615202+0000", 2024-09-13T05:11:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615202+0000", 2024-09-13T05:11:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615201+0000", 2024-09-13T05:11:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615204+0000", 2024-09-13T05:11:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7920000000000001e-06 2024-09-13T05:11:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615210+0000", 2024-09-13T05:11:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8279999999999999e-06 2024-09-13T05:11:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615215+0000", 2024-09-13T05:11:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9119999999999997e-06 2024-09-13T05:11:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91017 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615871+0000", 2024-09-13T05:11:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0031623620000000002, 2024-09-13T05:11:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010617453000000001, 2024-09-13T05:11:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91017 2024-09-13T05:11:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615871+0000", 2024-09-13T05:11:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615871+0000", 2024-09-13T05:11:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615871+0000", 2024-09-13T05:11:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615873+0000", 2024-09-13T05:11:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8080000000000001e-06 2024-09-13T05:11:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615879+0000", 2024-09-13T05:11:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7339999999999996e-06 2024-09-13T05:11:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615884+0000", 2024-09-13T05:11:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.916e-06 2024-09-13T05:11:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91049 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.617151+0000", 2024-09-13T05:11:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0018820320000000001, 2024-09-13T05:11:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093804289999999992, 2024-09-13T05:11:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91049 2024-09-13T05:11:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617151+0000", 2024-09-13T05:11:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617151+0000", 2024-09-13T05:11:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617151+0000", 2024-09-13T05:11:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617154+0000", 2024-09-13T05:11:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5890000000000001e-06 2024-09-13T05:11:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617160+0000", 2024-09-13T05:11:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7749999999999998e-06 2024-09-13T05:11:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617164+0000", 2024-09-13T05:11:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8359999999999999e-06 2024-09-13T05:11:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90826 3.19 3.affa599 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609714+0000", 2024-09-13T05:11:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0093199770000000001, 2024-09-13T05:11:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016855991000000001, 2024-09-13T05:11:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90826 2024-09-13T05:11:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609714+0000", 2024-09-13T05:11:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609714+0000", 2024-09-13T05:11:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609713+0000", 2024-09-13T05:11:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609716+0000", 2024-09-13T05:11:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7039999999999999e-06 2024-09-13T05:11:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609722+0000", 2024-09-13T05:11:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3539999999999996e-06 2024-09-13T05:11:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609727+0000", 2024-09-13T05:11:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1290000000000004e-06 2024-09-13T05:11:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90858 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610426+0000", 2024-09-13T05:11:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0086076209999999993, 2024-09-13T05:11:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016183598, 2024-09-13T05:11:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90858 2024-09-13T05:11:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610426+0000", 2024-09-13T05:11:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610426+0000", 2024-09-13T05:11:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610426+0000", 2024-09-13T05:11:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610428+0000", 2024-09-13T05:11:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5019999999999999e-06 2024-09-13T05:11:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610434+0000", 2024-09-13T05:11:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.088e-06 2024-09-13T05:11:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610439+0000", 2024-09-13T05:11:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3360000000000002e-06 2024-09-13T05:11:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90890 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.611155+0000", 2024-09-13T05:11:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0078781930000000003, 2024-09-13T05:11:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015491944000000001, 2024-09-13T05:11:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90890 2024-09-13T05:11:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611155+0000", 2024-09-13T05:11:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611155+0000", 2024-09-13T05:11:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611155+0000", 2024-09-13T05:11:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611157+0000", 2024-09-13T05:11:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5440000000000001e-06 2024-09-13T05:11:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611163+0000", 2024-09-13T05:11:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8449999999999999e-06 2024-09-13T05:11:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611169+0000", 2024-09-13T05:11:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4020000000000001e-06 2024-09-13T05:11:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90922 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613487+0000", 2024-09-13T05:11:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0055461219999999997, 2024-09-13T05:11:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013199555, 2024-09-13T05:11:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90922 2024-09-13T05:11:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613487+0000", 2024-09-13T05:11:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613487+0000", 2024-09-13T05:11:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613486+0000", 2024-09-13T05:11:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613491+0000", 2024-09-13T05:11:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1120000000000004e-06 2024-09-13T05:11:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613515+0000", 2024-09-13T05:11:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3447000000000001e-05 2024-09-13T05:11:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613526+0000", 2024-09-13T05:11:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0864e-05 2024-09-13T05:11:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90954 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614549+0000", 2024-09-13T05:11:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0044846299999999999, 2024-09-13T05:11:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012175508999999999, 2024-09-13T05:11:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90954 2024-09-13T05:11:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614549+0000", 2024-09-13T05:11:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614549+0000", 2024-09-13T05:11:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614548+0000", 2024-09-13T05:11:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614551+0000", 2024-09-13T05:11:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6730000000000001e-06 2024-09-13T05:11:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614557+0000", 2024-09-13T05:11:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6620000000000002e-06 2024-09-13T05:11:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614562+0000", 2024-09-13T05:11:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9620000000000001e-06 2024-09-13T05:11:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90986 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615219+0000", 2024-09-13T05:11:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0038144770000000001, 2024-09-13T05:11:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011543944, 2024-09-13T05:11:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90986 2024-09-13T05:11:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615219+0000", 2024-09-13T05:11:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615219+0000", 2024-09-13T05:11:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615219+0000", 2024-09-13T05:11:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615221+0000", 2024-09-13T05:11:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.65e-06 2024-09-13T05:11:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615227+0000", 2024-09-13T05:11:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6470000000000003e-06 2024-09-13T05:11:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615232+0000", 2024-09-13T05:11:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.006e-06 2024-09-13T05:11:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91018 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615889+0000", 2024-09-13T05:11:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0031448219999999998, 2024-09-13T05:11:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010911479999999999, 2024-09-13T05:11:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91018 2024-09-13T05:11:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615889+0000", 2024-09-13T05:11:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615889+0000", 2024-09-13T05:11:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615888+0000", 2024-09-13T05:11:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615891+0000", 2024-09-13T05:11:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.672e-06 2024-09-13T05:11:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615897+0000", 2024-09-13T05:11:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7570000000000001e-06 2024-09-13T05:11:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615902+0000", 2024-09-13T05:11:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9150000000000004e-06 2024-09-13T05:11:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91050 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.617169+0000", 2024-09-13T05:11:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00186495, 2024-09-13T05:11:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096703099999999997, 2024-09-13T05:11:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91050 2024-09-13T05:11:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617169+0000", 2024-09-13T05:11:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617169+0000", 2024-09-13T05:11:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617168+0000", 2024-09-13T05:11:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617171+0000", 2024-09-13T05:11:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4150000000000002e-06 2024-09-13T05:11:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617176+0000", 2024-09-13T05:11:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7819999999999999e-06 2024-09-13T05:11:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617181+0000", 2024-09-13T05:11:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9359999999999998e-06 2024-09-13T05:11:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90827 3.19 3.affa599 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.609732+0000", 2024-09-13T05:11:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0093017159999999998, 2024-09-13T05:11:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017144706999999999, 2024-09-13T05:11:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90827 2024-09-13T05:11:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609732+0000", 2024-09-13T05:11:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609732+0000", 2024-09-13T05:11:44.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609731+0000", 2024-09-13T05:11:44.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609734+0000", 2024-09-13T05:11:44.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5129999999999999e-06 2024-09-13T05:11:44.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609740+0000", 2024-09-13T05:11:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4230000000000002e-06 2024-09-13T05:11:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.609746+0000", 2024-09-13T05:11:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2129999999999999e-06 2024-09-13T05:11:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90859 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610444+0000", 2024-09-13T05:11:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0085892669999999994, 2024-09-13T05:11:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016472723000000002, 2024-09-13T05:11:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90859 2024-09-13T05:11:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610444+0000", 2024-09-13T05:11:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610444+0000", 2024-09-13T05:11:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610444+0000", 2024-09-13T05:11:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610447+0000", 2024-09-13T05:11:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8030000000000001e-06 2024-09-13T05:11:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610453+0000", 2024-09-13T05:11:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9889999999999997e-06 2024-09-13T05:11:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610458+0000", 2024-09-13T05:11:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9840000000000001e-06 2024-09-13T05:11:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90891 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.611174+0000", 2024-09-13T05:11:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0078594770000000001, 2024-09-13T05:11:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015780411000000001, 2024-09-13T05:11:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90891 2024-09-13T05:11:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611174+0000", 2024-09-13T05:11:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611174+0000", 2024-09-13T05:11:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611174+0000", 2024-09-13T05:11:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611176+0000", 2024-09-13T05:11:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.869e-06 2024-09-13T05:11:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611183+0000", 2024-09-13T05:11:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2879999999999998e-06 2024-09-13T05:11:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611188+0000", 2024-09-13T05:11:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1789999999999999e-06 2024-09-13T05:11:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90923 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613539+0000", 2024-09-13T05:11:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0054949090000000001, 2024-09-13T05:11:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013453506, 2024-09-13T05:11:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90923 2024-09-13T05:11:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613539+0000", 2024-09-13T05:11:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613539+0000", 2024-09-13T05:11:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613538+0000", 2024-09-13T05:11:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613543+0000", 2024-09-13T05:11:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0939999999999998e-06 2024-09-13T05:11:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613558+0000", 2024-09-13T05:11:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5475e-05 2024-09-13T05:11:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613568+0000", 2024-09-13T05:11:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3619999999999995e-06 2024-09-13T05:11:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90955 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614583+0000", 2024-09-13T05:11:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0044504540000000004, 2024-09-13T05:11:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012447859, 2024-09-13T05:11:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90955 2024-09-13T05:11:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614583+0000", 2024-09-13T05:11:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614583+0000", 2024-09-13T05:11:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614582+0000", 2024-09-13T05:11:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614586+0000", 2024-09-13T05:11:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4300000000000002e-06 2024-09-13T05:11:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614593+0000", 2024-09-13T05:11:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:11:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614598+0000", 2024-09-13T05:11:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4160000000000003e-06 2024-09-13T05:11:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90987 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615236+0000", 2024-09-13T05:11:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0037971749999999999, 2024-09-13T05:11:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011831794, 2024-09-13T05:11:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90987 2024-09-13T05:11:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615236+0000", 2024-09-13T05:11:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615236+0000", 2024-09-13T05:11:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615236+0000", 2024-09-13T05:11:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615238+0000", 2024-09-13T05:11:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.695e-06 2024-09-13T05:11:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615244+0000", 2024-09-13T05:11:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8649999999999998e-06 2024-09-13T05:11:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615249+0000", 2024-09-13T05:11:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7520000000000004e-06 2024-09-13T05:11:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91019 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615909+0000", 2024-09-13T05:11:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0031241099999999998, 2024-09-13T05:11:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011198283, 2024-09-13T05:11:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91019 2024-09-13T05:11:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615909+0000", 2024-09-13T05:11:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615909+0000", 2024-09-13T05:11:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615909+0000", 2024-09-13T05:11:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615912+0000", 2024-09-13T05:11:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3299999999999999e-06 2024-09-13T05:11:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615918+0000", 2024-09-13T05:11:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2269999999999998e-06 2024-09-13T05:11:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615936+0000", 2024-09-13T05:11:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.732e-05 2024-09-13T05:11:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91051 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.617208+0000", 2024-09-13T05:11:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001825754, 2024-09-13T05:11:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0099368770000000002, 2024-09-13T05:11:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91051 2024-09-13T05:11:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617208+0000", 2024-09-13T05:11:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617208+0000", 2024-09-13T05:11:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617207+0000", 2024-09-13T05:11:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617210+0000", 2024-09-13T05:11:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1659999999999998e-06 2024-09-13T05:11:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617217+0000", 2024-09-13T05:11:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5370000000000003e-06 2024-09-13T05:11:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617222+0000", 2024-09-13T05:11:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2719999999999997e-06 2024-09-13T05:11:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90860 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610464+0000", 2024-09-13T05:11:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0085694499999999993, 2024-09-13T05:11:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016720565, 2024-09-13T05:11:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90860 2024-09-13T05:11:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610464+0000", 2024-09-13T05:11:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610464+0000", 2024-09-13T05:11:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610464+0000", 2024-09-13T05:11:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610466+0000", 2024-09-13T05:11:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6879999999999999e-06 2024-09-13T05:11:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610473+0000", 2024-09-13T05:11:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6499999999999999e-06 2024-09-13T05:11:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610479+0000", 2024-09-13T05:11:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6099999999999997e-06 2024-09-13T05:11:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90892 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.611193+0000", 2024-09-13T05:11:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0078406280000000005, 2024-09-13T05:11:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016029646000000002, 2024-09-13T05:11:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90892 2024-09-13T05:11:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611193+0000", 2024-09-13T05:11:44.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611193+0000", 2024-09-13T05:11:44.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611192+0000", 2024-09-13T05:11:44.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611195+0000", 2024-09-13T05:11:44.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7030000000000002e-06 2024-09-13T05:11:44.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611201+0000", 2024-09-13T05:11:44.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9950000000000002e-06 2024-09-13T05:11:44.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611206+0000", 2024-09-13T05:11:44.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1930000000000001e-06 2024-09-13T05:11:44.320 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.320 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.320 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.320 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90924 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.320 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613576+0000", 2024-09-13T05:11:44.320 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0054570640000000002, 2024-09-13T05:11:44.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013685295, 2024-09-13T05:11:44.320 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.320 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.320 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.320 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.320 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.321 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90924 2024-09-13T05:11:44.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.321 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613576+0000", 2024-09-13T05:11:44.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613576+0000", 2024-09-13T05:11:44.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613576+0000", 2024-09-13T05:11:44.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613581+0000", 2024-09-13T05:11:44.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9019999999999998e-06 2024-09-13T05:11:44.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613593+0000", 2024-09-13T05:11:44.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1919999999999999e-05 2024-09-13T05:11:44.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613602+0000", 2024-09-13T05:11:44.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6039999999999999e-06 2024-09-13T05:11:44.323 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.323 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.323 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.323 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90956 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.323 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614604+0000", 2024-09-13T05:11:44.323 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0044296789999999997, 2024-09-13T05:11:44.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01269545, 2024-09-13T05:11:44.323 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.324 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.324 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.324 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.324 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.324 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90956 2024-09-13T05:11:44.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.324 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614604+0000", 2024-09-13T05:11:44.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614604+0000", 2024-09-13T05:11:44.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614603+0000", 2024-09-13T05:11:44.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614606+0000", 2024-09-13T05:11:44.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8499999999999998e-06 2024-09-13T05:11:44.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614612+0000", 2024-09-13T05:11:44.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8000000000000004e-06 2024-09-13T05:11:44.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614617+0000", 2024-09-13T05:11:44.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1599999999999997e-06 2024-09-13T05:11:44.326 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.326 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.326 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.326 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90988 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.326 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615254+0000", 2024-09-13T05:11:44.327 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0037798879999999999, 2024-09-13T05:11:44.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012084676000000001, 2024-09-13T05:11:44.327 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.327 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.327 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90988 2024-09-13T05:11:44.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.327 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615254+0000", 2024-09-13T05:11:44.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615254+0000", 2024-09-13T05:11:44.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615253+0000", 2024-09-13T05:11:44.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615256+0000", 2024-09-13T05:11:44.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.605e-06 2024-09-13T05:11:44.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615262+0000", 2024-09-13T05:11:44.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8449999999999999e-06 2024-09-13T05:11:44.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615267+0000", 2024-09-13T05:11:44.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1019999999999996e-06 2024-09-13T05:11:44.329 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.329 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.329 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.330 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91020 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.330 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615938+0000", 2024-09-13T05:11:44.330 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0030955790000000002, 2024-09-13T05:11:44.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011438195999999999, 2024-09-13T05:11:44.330 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.330 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.330 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.330 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.330 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.330 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91020 2024-09-13T05:11:44.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.330 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615938+0000", 2024-09-13T05:11:44.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615938+0000", 2024-09-13T05:11:44.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615938+0000", 2024-09-13T05:11:44.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:44.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615939+0000", 2024-09-13T05:11:44.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.455e-06 2024-09-13T05:11:44.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615942+0000", 2024-09-13T05:11:44.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8329999999999998e-06 2024-09-13T05:11:44.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615945+0000", 2024-09-13T05:11:44.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6970000000000002e-06 2024-09-13T05:11:44.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.333 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.333 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91052 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.333 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.617227+0000", 2024-09-13T05:11:44.333 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0018065150000000001, 2024-09-13T05:11:44.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010188529999999999, 2024-09-13T05:11:44.333 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.333 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.333 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.333 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.334 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91052 2024-09-13T05:11:44.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.334 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617227+0000", 2024-09-13T05:11:44.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617227+0000", 2024-09-13T05:11:44.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617226+0000", 2024-09-13T05:11:44.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617229+0000", 2024-09-13T05:11:44.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8090000000000001e-06 2024-09-13T05:11:44.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617235+0000", 2024-09-13T05:11:44.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9660000000000001e-06 2024-09-13T05:11:44.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617240+0000", 2024-09-13T05:11:44.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1170000000000003e-06 2024-09-13T05:11:44.336 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.336 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.336 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.336 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90861 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.336 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610502+0000", 2024-09-13T05:11:44.336 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0085315649999999996, 2024-09-13T05:11:44.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016950979000000001, 2024-09-13T05:11:44.337 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.337 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.337 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.337 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.337 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.337 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90861 2024-09-13T05:11:44.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.337 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610502+0000", 2024-09-13T05:11:44.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610502+0000", 2024-09-13T05:11:44.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610501+0000", 2024-09-13T05:11:44.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610505+0000", 2024-09-13T05:11:44.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:11:44.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610513+0000", 2024-09-13T05:11:44.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5920000000000003e-06 2024-09-13T05:11:44.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610520+0000", 2024-09-13T05:11:44.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9840000000000004e-06 2024-09-13T05:11:44.339 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.339 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.339 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.339 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90893 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.340 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.611211+0000", 2024-09-13T05:11:44.340 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0078227379999999992, 2024-09-13T05:11:44.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016279604999999999, 2024-09-13T05:11:44.340 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.340 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.340 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.340 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.340 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.340 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90893 2024-09-13T05:11:44.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.340 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611211+0000", 2024-09-13T05:11:44.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611211+0000", 2024-09-13T05:11:44.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611210+0000", 2024-09-13T05:11:44.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611213+0000", 2024-09-13T05:11:44.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5409999999999999e-06 2024-09-13T05:11:44.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611219+0000", 2024-09-13T05:11:44.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8540000000000002e-06 2024-09-13T05:11:44.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611224+0000", 2024-09-13T05:11:44.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9060000000000001e-06 2024-09-13T05:11:44.342 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.342 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.343 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.343 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90925 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.343 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613618+0000", 2024-09-13T05:11:44.343 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0054156070000000002, 2024-09-13T05:11:44.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013913234999999999, 2024-09-13T05:11:44.343 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.343 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.343 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90925 2024-09-13T05:11:44.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.344 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613618+0000", 2024-09-13T05:11:44.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613618+0000", 2024-09-13T05:11:44.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613617+0000", 2024-09-13T05:11:44.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:44.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613622+0000", 2024-09-13T05:11:44.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8319999999999996e-06 2024-09-13T05:11:44.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613633+0000", 2024-09-13T05:11:44.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1440000000000001e-05 2024-09-13T05:11:44.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613643+0000", 2024-09-13T05:11:44.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.662e-06 2024-09-13T05:11:44.346 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.346 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.346 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.346 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90957 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.346 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614622+0000", 2024-09-13T05:11:44.346 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0044118619999999999, 2024-09-13T05:11:44.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012946833, 2024-09-13T05:11:44.346 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.346 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.347 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.347 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90957 2024-09-13T05:11:44.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.347 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614622+0000", 2024-09-13T05:11:44.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614622+0000", 2024-09-13T05:11:44.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614621+0000", 2024-09-13T05:11:44.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614624+0000", 2024-09-13T05:11:44.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7520000000000001e-06 2024-09-13T05:11:44.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614630+0000", 2024-09-13T05:11:44.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.75e-06 2024-09-13T05:11:44.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614635+0000", 2024-09-13T05:11:44.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9099999999999996e-06 2024-09-13T05:11:44.349 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.349 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.349 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.349 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90989 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.349 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615271+0000", 2024-09-13T05:11:44.350 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0037621960000000002, 2024-09-13T05:11:44.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012336078, 2024-09-13T05:11:44.350 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.350 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.350 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.350 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.350 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.350 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90989 2024-09-13T05:11:44.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.350 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615271+0000", 2024-09-13T05:11:44.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615271+0000", 2024-09-13T05:11:44.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615271+0000", 2024-09-13T05:11:44.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615274+0000", 2024-09-13T05:11:44.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7599999999999998e-06 2024-09-13T05:11:44.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615279+0000", 2024-09-13T05:11:44.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8420000000000001e-06 2024-09-13T05:11:44.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615285+0000", 2024-09-13T05:11:44.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.22e-06 2024-09-13T05:11:44.352 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.352 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.352 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.353 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91021 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.353 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615947+0000", 2024-09-13T05:11:44.353 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003086671, 2024-09-13T05:11:44.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011697585999999999, 2024-09-13T05:11:44.353 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.353 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.353 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.353 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.353 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.353 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91021 2024-09-13T05:11:44.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.353 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615947+0000", 2024-09-13T05:11:44.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615947+0000", 2024-09-13T05:11:44.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615947+0000", 2024-09-13T05:11:44.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:44.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615948+0000", 2024-09-13T05:11:44.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.429e-06 2024-09-13T05:11:44.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615951+0000", 2024-09-13T05:11:44.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7879999999999998e-06 2024-09-13T05:11:44.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615953+0000", 2024-09-13T05:11:44.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6280000000000001e-06 2024-09-13T05:11:44.356 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.356 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.356 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.356 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91053 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.356 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.621145+0000", 2024-09-13T05:11:44.356 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9978886, 2024-09-13T05:11:44.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065390229999999997, 2024-09-13T05:11:44.356 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.356 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.356 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.356 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.357 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.357 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91053 2024-09-13T05:11:44.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.357 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621145+0000", 2024-09-13T05:11:44.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621145+0000", 2024-09-13T05:11:44.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.617246+0000", 2024-09-13T05:11:44.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9961014 2024-09-13T05:11:44.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621151+0000", 2024-09-13T05:11:44.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039044850000000001 2024-09-13T05:11:44.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621162+0000", 2024-09-13T05:11:44.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0725e-05 2024-09-13T05:11:44.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621174+0000", 2024-09-13T05:11:44.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1936999999999999e-05 2024-09-13T05:11:44.359 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.359 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.359 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.359 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90862 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.359 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610525+0000", 2024-09-13T05:11:44.359 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0085085170000000002, 2024-09-13T05:11:44.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017196956999999999, 2024-09-13T05:11:44.359 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.360 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.360 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.360 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.360 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.360 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90862 2024-09-13T05:11:44.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.360 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610525+0000", 2024-09-13T05:11:44.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610525+0000", 2024-09-13T05:11:44.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610524+0000", 2024-09-13T05:11:44.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610527+0000", 2024-09-13T05:11:44.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8600000000000001e-06 2024-09-13T05:11:44.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610534+0000", 2024-09-13T05:11:44.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5220000000000004e-06 2024-09-13T05:11:44.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610539+0000", 2024-09-13T05:11:44.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2599999999999996e-06 2024-09-13T05:11:44.366 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.366 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.366 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.366 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90894 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.367 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.611228+0000", 2024-09-13T05:11:44.367 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0078051780000000003, 2024-09-13T05:11:44.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016538603999999998, 2024-09-13T05:11:44.367 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.367 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.367 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.367 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.367 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.367 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90894 2024-09-13T05:11:44.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.367 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611228+0000", 2024-09-13T05:11:44.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611228+0000", 2024-09-13T05:11:44.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611228+0000", 2024-09-13T05:11:44.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611231+0000", 2024-09-13T05:11:44.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5959999999999998e-06 2024-09-13T05:11:44.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611237+0000", 2024-09-13T05:11:44.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3570000000000003e-06 2024-09-13T05:11:44.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611245+0000", 2024-09-13T05:11:44.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.174e-06 2024-09-13T05:11:44.369 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.369 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.370 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.370 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90926 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.370 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613654+0000", 2024-09-13T05:11:44.370 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0053791910000000002, 2024-09-13T05:11:44.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014149633, 2024-09-13T05:11:44.370 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.370 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.370 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.370 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.370 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.370 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90926 2024-09-13T05:11:44.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.371 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613654+0000", 2024-09-13T05:11:44.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613654+0000", 2024-09-13T05:11:44.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613653+0000", 2024-09-13T05:11:44.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:44.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613658+0000", 2024-09-13T05:11:44.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6369999999999998e-06 2024-09-13T05:11:44.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613670+0000", 2024-09-13T05:11:44.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1572e-05 2024-09-13T05:11:44.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613679+0000", 2024-09-13T05:11:44.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4579999999999999e-06 2024-09-13T05:11:44.373 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.373 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.373 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.373 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90958 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.373 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614639+0000", 2024-09-13T05:11:44.373 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0043940250000000002, 2024-09-13T05:11:44.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013203731999999999, 2024-09-13T05:11:44.373 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.373 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.373 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.373 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.374 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.374 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90958 2024-09-13T05:11:44.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.374 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614639+0000", 2024-09-13T05:11:44.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614639+0000", 2024-09-13T05:11:44.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614639+0000", 2024-09-13T05:11:44.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614646+0000", 2024-09-13T05:11:44.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8739999999999997e-06 2024-09-13T05:11:44.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614654+0000", 2024-09-13T05:11:44.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6399999999999997e-06 2024-09-13T05:11:44.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614659+0000", 2024-09-13T05:11:44.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9919999999999998e-06 2024-09-13T05:11:44.376 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.376 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.376 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.376 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90990 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.376 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615311+0000", 2024-09-13T05:11:44.376 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0037226590000000001, 2024-09-13T05:11:44.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012569194000000001, 2024-09-13T05:11:44.377 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.377 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.377 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90990 2024-09-13T05:11:44.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.377 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615311+0000", 2024-09-13T05:11:44.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615311+0000", 2024-09-13T05:11:44.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615310+0000", 2024-09-13T05:11:44.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615313+0000", 2024-09-13T05:11:44.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9620000000000002e-06 2024-09-13T05:11:44.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615321+0000", 2024-09-13T05:11:44.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3849999999999996e-06 2024-09-13T05:11:44.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615326+0000", 2024-09-13T05:11:44.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1769999999999997e-06 2024-09-13T05:11:44.379 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.379 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.379 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.380 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91022 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.380 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615956+0000", 2024-09-13T05:11:44.380 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003077813, 2024-09-13T05:11:44.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011963552000000001, 2024-09-13T05:11:44.380 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.380 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.380 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.380 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.380 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.380 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91022 2024-09-13T05:11:44.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.380 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615956+0000", 2024-09-13T05:11:44.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615956+0000", 2024-09-13T05:11:44.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615955+0000", 2024-09-13T05:11:44.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:44.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615957+0000", 2024-09-13T05:11:44.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5009999999999999e-06 2024-09-13T05:11:44.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615960+0000", 2024-09-13T05:11:44.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7999999999999999e-06 2024-09-13T05:11:44.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615962+0000", 2024-09-13T05:11:44.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5019999999999999e-06 2024-09-13T05:11:44.383 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.383 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.383 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.383 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91054 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.383 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.621182+0000", 2024-09-13T05:11:44.383 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9978514, 2024-09-13T05:11:44.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067745949999999996, 2024-09-13T05:11:44.383 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.383 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.383 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.383 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.384 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.384 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91054 2024-09-13T05:11:44.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.384 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621182+0000", 2024-09-13T05:11:44.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621182+0000", 2024-09-13T05:11:44.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621182+0000", 2024-09-13T05:11:44.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621185+0000", 2024-09-13T05:11:44.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6830000000000001e-06 2024-09-13T05:11:44.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621191+0000", 2024-09-13T05:11:44.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2729999999999999e-06 2024-09-13T05:11:44.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621198+0000", 2024-09-13T05:11:44.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0299999999999999e-06 2024-09-13T05:11:44.386 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.386 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.386 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.386 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90863 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.386 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610544+0000", 2024-09-13T05:11:44.386 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0084897670000000005, 2024-09-13T05:11:44.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017451103999999999, 2024-09-13T05:11:44.387 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.387 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.387 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.387 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.387 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.387 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90863 2024-09-13T05:11:44.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.387 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610544+0000", 2024-09-13T05:11:44.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610544+0000", 2024-09-13T05:11:44.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610543+0000", 2024-09-13T05:11:44.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610546+0000", 2024-09-13T05:11:44.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.644e-06 2024-09-13T05:11:44.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610552+0000", 2024-09-13T05:11:44.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4829999999999996e-06 2024-09-13T05:11:44.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610558+0000", 2024-09-13T05:11:44.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:11:44.389 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.389 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.389 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.389 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90895 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.390 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.611275+0000", 2024-09-13T05:11:44.390 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0077584259999999997, 2024-09-13T05:11:44.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016759506, 2024-09-13T05:11:44.390 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.390 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.390 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.390 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.390 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.390 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90895 2024-09-13T05:11:44.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.390 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611275+0000", 2024-09-13T05:11:44.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611275+0000", 2024-09-13T05:11:44.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611274+0000", 2024-09-13T05:11:44.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611278+0000", 2024-09-13T05:11:44.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4809999999999998e-06 2024-09-13T05:11:44.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611285+0000", 2024-09-13T05:11:44.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8499999999999996e-06 2024-09-13T05:11:44.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611290+0000", 2024-09-13T05:11:44.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6930000000000004e-06 2024-09-13T05:11:44.392 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.392 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.393 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.393 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90927 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.393 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613688+0000", 2024-09-13T05:11:44.393 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0053450019999999997, 2024-09-13T05:11:44.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014383653999999999, 2024-09-13T05:11:44.393 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.393 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.393 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.393 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.393 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.393 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90927 2024-09-13T05:11:44.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.393 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613688+0000", 2024-09-13T05:11:44.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613688+0000", 2024-09-13T05:11:44.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613687+0000", 2024-09-13T05:11:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613693+0000", 2024-09-13T05:11:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7769999999999999e-06 2024-09-13T05:11:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613704+0000", 2024-09-13T05:11:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1246999999999999e-05 2024-09-13T05:11:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613714+0000", 2024-09-13T05:11:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8770000000000005e-06 2024-09-13T05:11:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90959 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614665+0000", 2024-09-13T05:11:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0043681529999999996, 2024-09-13T05:11:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013446850999999999, 2024-09-13T05:11:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90959 2024-09-13T05:11:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614665+0000", 2024-09-13T05:11:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614665+0000", 2024-09-13T05:11:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614665+0000", 2024-09-13T05:11:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614668+0000", 2024-09-13T05:11:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6900000000000001e-06 2024-09-13T05:11:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614673+0000", 2024-09-13T05:11:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6969999999999998e-06 2024-09-13T05:11:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614678+0000", 2024-09-13T05:11:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0350000000000001e-06 2024-09-13T05:11:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90991 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615330+0000", 2024-09-13T05:11:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003703114, 2024-09-13T05:11:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01281906, 2024-09-13T05:11:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90991 2024-09-13T05:11:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615330+0000", 2024-09-13T05:11:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615330+0000", 2024-09-13T05:11:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615330+0000", 2024-09-13T05:11:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615333+0000", 2024-09-13T05:11:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.818e-06 2024-09-13T05:11:44.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615339+0000", 2024-09-13T05:11:44.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0440000000000001e-06 2024-09-13T05:11:44.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615345+0000", 2024-09-13T05:11:44.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3550000000000001e-06 2024-09-13T05:11:44.402 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.402 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.402 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91023 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615965+0000", 2024-09-13T05:11:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0030689900000000002, 2024-09-13T05:11:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012224273000000001, 2024-09-13T05:11:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91023 2024-09-13T05:11:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615965+0000", 2024-09-13T05:11:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615965+0000", 2024-09-13T05:11:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615964+0000", 2024-09-13T05:11:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615966+0000", 2024-09-13T05:11:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.455e-06 2024-09-13T05:11:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615970+0000", 2024-09-13T05:11:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0550000000000001e-06 2024-09-13T05:11:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615972+0000", 2024-09-13T05:11:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.65e-06 2024-09-13T05:11:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91055 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.621203+0000", 2024-09-13T05:11:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9978304, 2024-09-13T05:11:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070228779999999998, 2024-09-13T05:11:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91055 2024-09-13T05:11:44.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.407 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621203+0000", 2024-09-13T05:11:44.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621203+0000", 2024-09-13T05:11:44.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621202+0000", 2024-09-13T05:11:44.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621210+0000", 2024-09-13T05:11:44.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.515e-06 2024-09-13T05:11:44.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621216+0000", 2024-09-13T05:11:44.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3899999999999998e-06 2024-09-13T05:11:44.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621225+0000", 2024-09-13T05:11:44.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.901e-06 2024-09-13T05:11:44.409 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.409 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.409 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.409 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90864 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.409 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610563+0000", 2024-09-13T05:11:44.409 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0084709469999999995, 2024-09-13T05:11:44.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017703364999999999, 2024-09-13T05:11:44.409 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.410 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.410 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.410 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.410 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.410 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90864 2024-09-13T05:11:44.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.410 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610563+0000", 2024-09-13T05:11:44.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610563+0000", 2024-09-13T05:11:44.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610562+0000", 2024-09-13T05:11:44.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610565+0000", 2024-09-13T05:11:44.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8030000000000001e-06 2024-09-13T05:11:44.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610571+0000", 2024-09-13T05:11:44.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.251e-06 2024-09-13T05:11:44.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610576+0000", 2024-09-13T05:11:44.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3839999999999996e-06 2024-09-13T05:11:44.412 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.412 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.412 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.412 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90896 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.611295+0000", 2024-09-13T05:11:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0077383419999999996, 2024-09-13T05:11:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017008129, 2024-09-13T05:11:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90896 2024-09-13T05:11:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611295+0000", 2024-09-13T05:11:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611295+0000", 2024-09-13T05:11:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611295+0000", 2024-09-13T05:11:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611297+0000", 2024-09-13T05:11:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6419999999999999e-06 2024-09-13T05:11:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611303+0000", 2024-09-13T05:11:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8250000000000001e-06 2024-09-13T05:11:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611308+0000", 2024-09-13T05:11:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3129999999999998e-06 2024-09-13T05:11:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90928 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613723+0000", 2024-09-13T05:11:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0053102389999999996, 2024-09-13T05:11:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014618924, 2024-09-13T05:11:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90928 2024-09-13T05:11:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613723+0000", 2024-09-13T05:11:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613723+0000", 2024-09-13T05:11:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613722+0000", 2024-09-13T05:11:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613727+0000", 2024-09-13T05:11:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6439999999999999e-06 2024-09-13T05:11:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613739+0000", 2024-09-13T05:11:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.181e-05 2024-09-13T05:11:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613750+0000", 2024-09-13T05:11:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0745e-05 2024-09-13T05:11:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90960 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614684+0000", 2024-09-13T05:11:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0043496059999999998, 2024-09-13T05:11:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013695397999999999, 2024-09-13T05:11:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90960 2024-09-13T05:11:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614684+0000", 2024-09-13T05:11:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614684+0000", 2024-09-13T05:11:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614683+0000", 2024-09-13T05:11:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614686+0000", 2024-09-13T05:11:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6869999999999999e-06 2024-09-13T05:11:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614692+0000", 2024-09-13T05:11:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7189999999999998e-06 2024-09-13T05:11:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614697+0000", 2024-09-13T05:11:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8999999999999997e-06 2024-09-13T05:11:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90992 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615351+0000", 2024-09-13T05:11:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0036828680000000002, 2024-09-13T05:11:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013068526, 2024-09-13T05:11:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90992 2024-09-13T05:11:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615351+0000", 2024-09-13T05:11:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615351+0000", 2024-09-13T05:11:44.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615350+0000", 2024-09-13T05:11:44.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615353+0000", 2024-09-13T05:11:44.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.695e-06 2024-09-13T05:11:44.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615359+0000", 2024-09-13T05:11:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7799999999999997e-06 2024-09-13T05:11:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615364+0000", 2024-09-13T05:11:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8749999999999999e-06 2024-09-13T05:11:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91024 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615975+0000", 2024-09-13T05:11:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0030581229999999998, 2024-09-13T05:11:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012480936, 2024-09-13T05:11:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91024 2024-09-13T05:11:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615975+0000", 2024-09-13T05:11:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615975+0000", 2024-09-13T05:11:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615975+0000", 2024-09-13T05:11:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615977+0000", 2024-09-13T05:11:44.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4410000000000001e-06 2024-09-13T05:11:44.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615979+0000", 2024-09-13T05:11:44.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8629999999999999e-06 2024-09-13T05:11:44.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615982+0000", 2024-09-13T05:11:44.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4609999999999998e-06 2024-09-13T05:11:44.428 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.428 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.428 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91056 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.621230+0000", 2024-09-13T05:11:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9978032, 2024-09-13T05:11:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072634980000000002, 2024-09-13T05:11:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91056 2024-09-13T05:11:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621230+0000", 2024-09-13T05:11:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621230+0000", 2024-09-13T05:11:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621230+0000", 2024-09-13T05:11:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621233+0000", 2024-09-13T05:11:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0240000000000002e-06 2024-09-13T05:11:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621240+0000", 2024-09-13T05:11:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3690000000000001e-06 2024-09-13T05:11:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621247+0000", 2024-09-13T05:11:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3339999999999998e-06 2024-09-13T05:11:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90865 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.610581+0000", 2024-09-13T05:11:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0084524560000000006, 2024-09-13T05:11:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017952374, 2024-09-13T05:11:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90865 2024-09-13T05:11:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610581+0000", 2024-09-13T05:11:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610581+0000", 2024-09-13T05:11:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610581+0000", 2024-09-13T05:11:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610583+0000", 2024-09-13T05:11:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6290000000000002e-06 2024-09-13T05:11:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610591+0000", 2024-09-13T05:11:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7770000000000002e-06 2024-09-13T05:11:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.610596+0000", 2024-09-13T05:11:44.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2789999999999998e-06 2024-09-13T05:11:44.435 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.435 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.435 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.435 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90897 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.435 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.611313+0000", 2024-09-13T05:11:44.435 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0077202080000000001, 2024-09-13T05:11:44.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017257404, 2024-09-13T05:11:44.435 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.435 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90897 2024-09-13T05:11:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611313+0000", 2024-09-13T05:11:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611313+0000", 2024-09-13T05:11:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.611313+0000", 2024-09-13T05:11:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612196+0000", 2024-09-13T05:11:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00088290199999999997 2024-09-13T05:11:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612218+0000", 2024-09-13T05:11:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2424000000000001e-05 2024-09-13T05:11:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.612245+0000", 2024-09-13T05:11:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7219000000000001e-05 2024-09-13T05:11:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90929 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.613759+0000", 2024-09-13T05:11:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.005274773, 2024-09-13T05:11:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014850996999999999, 2024-09-13T05:11:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90929 2024-09-13T05:11:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613759+0000", 2024-09-13T05:11:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613759+0000", 2024-09-13T05:11:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613758+0000", 2024-09-13T05:11:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613763+0000", 2024-09-13T05:11:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0130000000000001e-06 2024-09-13T05:11:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613774+0000", 2024-09-13T05:11:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1449e-05 2024-09-13T05:11:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.613784+0000", 2024-09-13T05:11:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6160000000000008e-06 2024-09-13T05:11:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90961 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.614703+0000", 2024-09-13T05:11:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0043308909999999999, 2024-09-13T05:11:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013944296, 2024-09-13T05:11:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90961 2024-09-13T05:11:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614703+0000", 2024-09-13T05:11:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614703+0000", 2024-09-13T05:11:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614702+0000", 2024-09-13T05:11:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614705+0000", 2024-09-13T05:11:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8499999999999998e-06 2024-09-13T05:11:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614711+0000", 2024-09-13T05:11:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.767e-06 2024-09-13T05:11:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.614716+0000", 2024-09-13T05:11:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2480000000000004e-06 2024-09-13T05:11:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:90993 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615369+0000", 2024-09-13T05:11:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003664315, 2024-09-13T05:11:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013316856, 2024-09-13T05:11:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 90993 2024-09-13T05:11:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615369+0000", 2024-09-13T05:11:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615369+0000", 2024-09-13T05:11:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615369+0000", 2024-09-13T05:11:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615371+0000", 2024-09-13T05:11:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7439999999999999e-06 2024-09-13T05:11:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615377+0000", 2024-09-13T05:11:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9920000000000004e-06 2024-09-13T05:11:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615383+0000", 2024-09-13T05:11:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0399999999999998e-06 2024-09-13T05:11:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91025 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.615984+0000", 2024-09-13T05:11:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0030494799999999998, 2024-09-13T05:11:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012739485, 2024-09-13T05:11:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91025 2024-09-13T05:11:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615984+0000", 2024-09-13T05:11:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615984+0000", 2024-09-13T05:11:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615984+0000", 2024-09-13T05:11:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615985+0000", 2024-09-13T05:11:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.511e-06 2024-09-13T05:11:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615988+0000", 2024-09-13T05:11:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8279999999999999e-06 2024-09-13T05:11:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.615991+0000", 2024-09-13T05:11:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4269999999999998e-06 2024-09-13T05:11:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:91057 3.1e 3.913cf2de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.621252+0000", 2024-09-13T05:11:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9977818, 2024-09-13T05:11:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0075114719999999999, 2024-09-13T05:11:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91057 2024-09-13T05:11:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621252+0000", 2024-09-13T05:11:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621252+0000", 2024-09-13T05:11:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621251+0000", 2024-09-13T05:11:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621254+0000", 2024-09-13T05:11:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.599e-06 2024-09-13T05:11:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621260+0000", 2024-09-13T05:11:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.584e-06 2024-09-13T05:11:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.621267+0000", 2024-09-13T05:11:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3579999999999999e-06 2024-09-13T05:11:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:44.455 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:11:44.455 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 244 2024-09-13T05:11:44.455 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:44.455 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:11:44.457 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:11:44.458 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.3 to 1 (10000) 2024-09-13T05:11:44.458 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-13T05:11:44.458 INFO:teuthology.orchestra.run.smithi120.stdout:4648 write 0x3974235 thru 0x397d558 (0x9324 bytes) 2024-09-13T05:11:44.459 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:44.449+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:44.557 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:44.556+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:44.573 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:44.574 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:44.585 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:11:44.601 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:11:44.623 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:11:44.646 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:11:44.658 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:44.656+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:44.664 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:11:44.687 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:11:44.706 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:44.706 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:44.715 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:11:44.716 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:11:44.720 INFO:teuthology.orchestra.run.smithi120.stdout:4650 writesame 0x8ad1c48 thru 0x8ae01f7 data_size 0xd2(0xe5b0 bytes) 2024-09-13T05:11:44.741 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:11:44.759 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:44.756+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:44.762 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:11:44.763 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:11:44.763 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:11:44.763 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:11:44.764 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:11:44.764 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:11:44.764 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:11:44.764 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:11:44.764 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:11:44.771 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T05:11:44.822 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:44.822 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:44.835 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:11:44.859 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:44.856+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:44.948 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:44.949 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:44.959 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:11:44.960 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:44.956+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:45.059 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:45.059 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:45.061 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:45.060+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:45.070 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:11:45.162 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:45.157+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:45.186 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:45.186 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:45.198 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:11:45.263 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:45.260+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:45.312 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:45.312 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:45.322 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:11:45.364 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:45.360+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:45.409 INFO:teuthology.orchestra.run.smithi120.stdout:4651 write 0x7a58533 thru 0x7a652e6 (0xcdb4 bytes) 2024-09-13T05:11:45.428 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:45.428 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:45.439 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:11:45.465 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:45.461+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:45.554 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:45.554 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:45.564 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:11:45.566 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:45.561+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:45.667 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:45.661+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:45.669 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:45.669 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:45.681 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:11:45.768 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:45.761+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:45.769 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is set 2024-09-13T05:11:45.778 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.5 to 1 (10000) 2024-09-13T05:11:45.783 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:45.783 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:45.791 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-13T05:11:45.799 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:11:45.869 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:45.861+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:45.933 INFO:teuthology.orchestra.run.smithi120.stdout:4652 write 0xb6174d thru 0xb6230c (0xbc0 bytes) 2024-09-13T05:11:45.957 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:45.957 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:45.969 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:11:45.970 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:45.968+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:46.038 INFO:teuthology.orchestra.run.smithi120.stdout:4654 punch from 0x6626b06 to 0x662c4c6, (0x59c0 bytes) 2024-09-13T05:11:46.039 INFO:teuthology.orchestra.run.smithi120.stdout:4655 punch from 0x2ca60e8 to 0x2ca9e21, (0x3d39 bytes) 2024-09-13T05:11:46.039 INFO:teuthology.orchestra.run.smithi120.stdout:4656 writesame 0xcc817dc thru 0xcc82b0f data_size 0x2(0x1334 bytes) 2024-09-13T05:11:46.055 INFO:teuthology.orchestra.run.smithi120.stdout:4657 read 0xbe4d7e8 thru 0xbe52472 (0x4c8b bytes) 2024-09-13T05:11:46.057 INFO:teuthology.orchestra.run.smithi120.stdout:4658 write 0x3c5bd thru 0x46a1a (0xa45e bytes) 2024-09-13T05:11:46.071 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:46.068+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:46.080 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:46.080 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:46.090 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:11:46.172 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:46.168+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:46.190 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:46.191 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:46.201 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:11:46.275 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:46.273+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:46.318 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:46.318 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:46.330 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:11:46.375 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:46.372+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:46.439 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:46.439 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:46.451 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:11:46.476 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:46.469+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:46.568 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:46.569 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:46.577 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:46.573+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:46.579 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:11:46.678 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:46.676+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:46.693 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:46.693 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:46.705 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:11:46.776 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:11:46.778 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:46.776+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:46.789 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.6 to 1 (10000) 2024-09-13T05:11:46.794 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-13T05:11:46.812 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:46.812 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:46.825 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:11:46.879 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:46.876+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:46.885 INFO:teuthology.orchestra.run.smithi120.stdout:4659 read 0x79289f4 thru 0x792e7c8 (0x5dd5 bytes) 2024-09-13T05:11:46.886 INFO:teuthology.orchestra.run.smithi120.stdout:4662 read 0x411e758 thru 0x4126549 (0x7df2 bytes) 2024-09-13T05:11:46.941 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:11:46.950 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:46.951 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:46.961 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:11:46.967 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:11:46.998 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:11:46.998 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:46.996+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:47.030 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:11:47.065 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:11:47.081 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:47.080+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:47.098 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:47.098 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:47.098 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:47.098 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:47.098 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:11:47.110 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:11:47.132 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:11:47.167 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:11:47.169 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:11:47.169 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:11:47.169 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:11:47.169 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:11:47.169 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:11:47.169 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:11:47.169 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:11:47.170 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:11:47.182 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:47.177+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:47.194 INFO:teuthology.orchestra.run.smithi120.stdout:4664 punch from 0xc0a48d7 to 0xc0ad896, (0x8fbf bytes) 2024-09-13T05:11:47.194 INFO:teuthology.orchestra.run.smithi120.stdout:4667 read 0x844cb01 thru 0x844d981 (0xe81 bytes) 2024-09-13T05:11:47.244 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:47.245 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:47.245 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:47.245 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:47.245 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:47.255 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:11:47.301 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:47.300+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:47.361 INFO:teuthology.orchestra.run.smithi120.stdout:4669 writesame 0x5a0140d thru 0x5a05b6d data_size 0x1(0x4761 bytes) 2024-09-13T05:11:47.384 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:47.380+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:47.433 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:47.433 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:47.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:47.433 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:47.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.433 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26335 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1207296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:47.433 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:47.434 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.699537743999997, 2024-09-13T05:11:47.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055338125000000002, 2024-09-13T05:11:47.434 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.434 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.434 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26335 2024-09-13T05:11:47.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.434 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:47.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:47.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730550+0000", 2024-09-13T05:11:47.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998579 2024-09-13T05:11:47.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730705+0000", 2024-09-13T05:11:47.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015463400000000001 2024-09-13T05:11:47.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730713+0000", 2024-09-13T05:11:47.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1580000000000005e-06 2024-09-13T05:11:47.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730719+0000", 2024-09-13T05:11:47.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2740000000000004e-06 2024-09-13T05:11:47.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.785798+0000", 2024-09-13T05:11:47.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055079454 2024-09-13T05:11:47.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.785894+0000", 2024-09-13T05:11:47.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5896000000000005e-05 2024-09-13T05:11:47.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.786030+0000", 2024-09-13T05:11:47.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013586199999999999 2024-09-13T05:11:47.438 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.438 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.438 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.438 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26346 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1308672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:47.438 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:47.438 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.697396337000001, 2024-09-13T05:11:47.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055416737000000001, 2024-09-13T05:11:47.438 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.438 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.438 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.439 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26346 2024-09-13T05:11:47.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.439 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:47.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:47.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732833+0000", 2024-09-13T05:11:47.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732835+0000", 2024-09-13T05:11:47.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3719999999999999e-06 2024-09-13T05:11:47.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732839+0000", 2024-09-13T05:11:47.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1520000000000001e-06 2024-09-13T05:11:47.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732842+0000", 2024-09-13T05:11:47.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.061e-06 2024-09-13T05:11:47.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788126+0000", 2024-09-13T05:11:47.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055284489999999999 2024-09-13T05:11:47.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788183+0000", 2024-09-13T05:11:47.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7127999999999999e-05 2024-09-13T05:11:47.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788250+0000", 2024-09-13T05:11:47.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7001000000000004e-05 2024-09-13T05:11:47.443 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.443 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.443 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.443 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26348 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 800768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:47.443 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:47.443 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.696973513000003, 2024-09-13T05:11:47.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055321395000000002, 2024-09-13T05:11:47.444 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.444 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.444 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26348 2024-09-13T05:11:47.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.444 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:47.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:47.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733127+0000", 2024-09-13T05:11:47.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998703 2024-09-13T05:11:47.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733262+0000", 2024-09-13T05:11:47.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013484400000000001 2024-09-13T05:11:47.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733273+0000", 2024-09-13T05:11:47.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1824000000000001e-05 2024-09-13T05:11:47.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733281+0000", 2024-09-13T05:11:47.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9999999999999996e-06 2024-09-13T05:11:47.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788431+0000", 2024-09-13T05:11:47.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055149535 2024-09-13T05:11:47.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788490+0000", 2024-09-13T05:11:47.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9413999999999997e-05 2024-09-13T05:11:47.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788578+0000", 2024-09-13T05:11:47.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7418999999999998e-05 2024-09-13T05:11:47.448 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.448 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.448 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.449 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26417 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 903168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:47.449 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:47.449 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.688761056000004, 2024-09-13T05:11:47.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055375191999999997, 2024-09-13T05:11:47.449 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.449 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.449 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.449 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.449 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.449 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26417 2024-09-13T05:11:47.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.450 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:47.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:47.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741468+0000", 2024-09-13T05:11:47.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741472+0000", 2024-09-13T05:11:47.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4139999999999998e-06 2024-09-13T05:11:47.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741478+0000", 2024-09-13T05:11:47.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5230000000000001e-06 2024-09-13T05:11:47.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741483+0000", 2024-09-13T05:11:47.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8559999999999998e-06 2024-09-13T05:11:47.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796655+0000", 2024-09-13T05:11:47.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055172153000000002 2024-09-13T05:11:47.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796738+0000", 2024-09-13T05:11:47.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2912999999999997e-05 2024-09-13T05:11:47.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796844+0000", 2024-09-13T05:11:47.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105802 2024-09-13T05:11:47.453 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.453 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.453 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.453 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26419 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 912384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:47.453 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:47.453 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.688737191000001, 2024-09-13T05:11:47.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055570469999999997, 2024-09-13T05:11:47.454 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.454 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.454 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.454 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.454 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.454 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26419 2024-09-13T05:11:47.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.454 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:47.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:47.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741492+0000", 2024-09-13T05:11:47.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741495+0000", 2024-09-13T05:11:47.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6369999999999999e-06 2024-09-13T05:11:47.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741508+0000", 2024-09-13T05:11:47.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3319000000000001e-05 2024-09-13T05:11:47.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741527+0000", 2024-09-13T05:11:47.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8542e-05 2024-09-13T05:11:47.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796871+0000", 2024-09-13T05:11:47.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055344474999999997 2024-09-13T05:11:47.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796967+0000", 2024-09-13T05:11:47.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5963000000000003e-05 2024-09-13T05:11:47.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797063+0000", 2024-09-13T05:11:47.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5909999999999995e-05 2024-09-13T05:11:47.457 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.457 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.458 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.458 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26421 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 921600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:47.458 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:47.458 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.688693888000003, 2024-09-13T05:11:47.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055631152000000003, 2024-09-13T05:11:47.458 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.458 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.458 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.458 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.458 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.458 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26421 2024-09-13T05:11:47.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.458 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:47.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:47.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741535+0000", 2024-09-13T05:11:47.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741540+0000", 2024-09-13T05:11:47.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1690000000000002e-06 2024-09-13T05:11:47.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741547+0000", 2024-09-13T05:11:47.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3409999999999997e-06 2024-09-13T05:11:47.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741552+0000", 2024-09-13T05:11:47.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5639999999999996e-06 2024-09-13T05:11:47.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797079+0000", 2024-09-13T05:11:47.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055526038999999999 2024-09-13T05:11:47.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797121+0000", 2024-09-13T05:11:47.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2156000000000001e-05 2024-09-13T05:11:47.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797167+0000", 2024-09-13T05:11:47.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6445e-05 2024-09-13T05:11:47.462 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.462 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.462 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.462 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26423 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 930816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:47.462 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:47.462 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.688300894999998, 2024-09-13T05:11:47.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055364370000000003, 2024-09-13T05:11:47.463 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.463 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.463 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.463 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.463 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.463 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26423 2024-09-13T05:11:47.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.463 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:47.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:47.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741928+0000", 2024-09-13T05:11:47.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:47.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741933+0000", 2024-09-13T05:11:47.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9980000000000003e-06 2024-09-13T05:11:47.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741945+0000", 2024-09-13T05:11:47.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1761e-05 2024-09-13T05:11:47.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741958+0000", 2024-09-13T05:11:47.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2604e-05 2024-09-13T05:11:47.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797185+0000", 2024-09-13T05:11:47.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055227169 2024-09-13T05:11:47.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797226+0000", 2024-09-13T05:11:47.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1619000000000003e-05 2024-09-13T05:11:47.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797293+0000", 2024-09-13T05:11:47.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6952999999999994e-05 2024-09-13T05:11:47.467 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.467 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.467 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.467 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26424 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 940032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:47.467 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:47.467 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.688263957999993, 2024-09-13T05:11:47.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055448669999999999, 2024-09-13T05:11:47.467 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.467 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.467 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.467 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.468 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.468 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26424 2024-09-13T05:11:47.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.468 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:47.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:47.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741965+0000", 2024-09-13T05:11:47.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:47.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741969+0000", 2024-09-13T05:11:47.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3440000000000001e-06 2024-09-13T05:11:47.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741983+0000", 2024-09-13T05:11:47.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4600000000000001e-05 2024-09-13T05:11:47.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741989+0000", 2024-09-13T05:11:47.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5350000000000004e-06 2024-09-13T05:11:47.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797319+0000", 2024-09-13T05:11:47.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055330121000000003 2024-09-13T05:11:47.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797364+0000", 2024-09-13T05:11:47.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5670000000000002e-05 2024-09-13T05:11:47.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797415+0000", 2024-09-13T05:11:47.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0124000000000003e-05 2024-09-13T05:11:47.471 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.471 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.471 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.471 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26426 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 949248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:47.471 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:47.472 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.688236759000006, 2024-09-13T05:11:47.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055639981999999998, 2024-09-13T05:11:47.472 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.472 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.472 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.472 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.472 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.472 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26426 2024-09-13T05:11:47.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.472 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:47.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:47.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:47.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741995+0000", 2024-09-13T05:11:47.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.661e-06 2024-09-13T05:11:47.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742004+0000", 2024-09-13T05:11:47.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2009999999999999e-06 2024-09-13T05:11:47.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742008+0000", 2024-09-13T05:11:47.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7890000000000002e-06 2024-09-13T05:11:47.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797432+0000", 2024-09-13T05:11:47.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055423448 2024-09-13T05:11:47.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797516+0000", 2024-09-13T05:11:47.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4404e-05 2024-09-13T05:11:47.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797633+0000", 2024-09-13T05:11:47.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116898 2024-09-13T05:11:47.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.476 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.476 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26427 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 958464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:47.476 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:47.476 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.688216702999995, 2024-09-13T05:11:47.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055829295000000001, 2024-09-13T05:11:47.476 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.476 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.476 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.476 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.476 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.477 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26427 2024-09-13T05:11:47.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.477 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:47.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:47.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:47.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742015+0000", 2024-09-13T05:11:47.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.74e-06 2024-09-13T05:11:47.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742023+0000", 2024-09-13T05:11:47.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7039999999999994e-06 2024-09-13T05:11:47.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742028+0000", 2024-09-13T05:11:47.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7369999999999997e-06 2024-09-13T05:11:47.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797666+0000", 2024-09-13T05:11:47.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055637820999999997 2024-09-13T05:11:47.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797748+0000", 2024-09-13T05:11:47.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1787999999999997e-05 2024-09-13T05:11:47.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797842+0000", 2024-09-13T05:11:47.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4903999999999998e-05 2024-09-13T05:11:47.483 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.483 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.483 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.483 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26432 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 976896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:47.483 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:47.483 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.687423542000005, 2024-09-13T05:11:47.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055402077000000001, 2024-09-13T05:11:47.483 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.483 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.483 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.483 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.484 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.484 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26432 2024-09-13T05:11:47.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.484 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:47.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:47.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:47.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742808+0000", 2024-09-13T05:11:47.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3319999999999999e-06 2024-09-13T05:11:47.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742818+0000", 2024-09-13T05:11:47.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5380000000000008e-06 2024-09-13T05:11:47.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742821+0000", 2024-09-13T05:11:47.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2179999999999999e-06 2024-09-13T05:11:47.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798027+0000", 2024-09-13T05:11:47.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055206344999999997 2024-09-13T05:11:47.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798103+0000", 2024-09-13T05:11:47.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5786999999999998e-05 2024-09-13T05:11:47.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798208+0000", 2024-09-13T05:11:47.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010521700000000001 2024-09-13T05:11:47.488 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.488 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.488 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.488 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26434 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 986112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:47.488 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:47.488 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.687406318000001, 2024-09-13T05:11:47.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055610109999999997, 2024-09-13T05:11:47.488 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.488 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.488 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.488 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.489 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.489 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26434 2024-09-13T05:11:47.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.489 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:47.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:47.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742823+0000", 2024-09-13T05:11:47.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:47.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742825+0000", 2024-09-13T05:11:47.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6220000000000001e-06 2024-09-13T05:11:47.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742828+0000", 2024-09-13T05:11:47.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.926e-06 2024-09-13T05:11:47.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742831+0000", 2024-09-13T05:11:47.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-13T05:11:47.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798239+0000", 2024-09-13T05:11:47.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055408254999999997 2024-09-13T05:11:47.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798326+0000", 2024-09-13T05:11:47.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7168000000000003e-05 2024-09-13T05:11:47.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798434+0000", 2024-09-13T05:11:47.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010767100000000001 2024-09-13T05:11:47.492 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.492 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.492 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.492 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26442 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1032192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:47.493 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:47.493 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.686136977999993, 2024-09-13T05:11:47.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055422776, 2024-09-13T05:11:47.493 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.493 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.493 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.493 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.493 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.493 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26442 2024-09-13T05:11:47.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.493 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:47.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:47.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744061+0000", 2024-09-13T05:11:47.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999685 2024-09-13T05:11:47.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744096+0000", 2024-09-13T05:11:47.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4771999999999998e-05 2024-09-13T05:11:47.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744147+0000", 2024-09-13T05:11:47.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0696999999999999e-05 2024-09-13T05:11:47.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744154+0000", 2024-09-13T05:11:47.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8510000000000001e-06 2024-09-13T05:11:47.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799324+0000", 2024-09-13T05:11:47.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055170074999999999 2024-09-13T05:11:47.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799415+0000", 2024-09-13T05:11:47.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1197000000000001e-05 2024-09-13T05:11:47.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799516+0000", 2024-09-13T05:11:47.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100666 2024-09-13T05:11:47.497 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.497 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.497 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.497 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26443 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1041408~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:47.497 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:47.497 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.685856407000003, 2024-09-13T05:11:47.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055344195999999998, 2024-09-13T05:11:47.497 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.497 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.497 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.497 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.497 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.498 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26443 2024-09-13T05:11:47.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.498 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:47.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:47.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744159+0000", 2024-09-13T05:11:47.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997849 2024-09-13T05:11:47.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744379+0000", 2024-09-13T05:11:47.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022024800000000001 2024-09-13T05:11:47.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744390+0000", 2024-09-13T05:11:47.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1105e-05 2024-09-13T05:11:47.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744397+0000", 2024-09-13T05:11:47.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2740000000000002e-06 2024-09-13T05:11:47.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799543+0000", 2024-09-13T05:11:47.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055145441000000003 2024-09-13T05:11:47.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799619+0000", 2024-09-13T05:11:47.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6660000000000001e-05 2024-09-13T05:11:47.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799718+0000", 2024-09-13T05:11:47.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8331000000000004e-05 2024-09-13T05:11:47.501 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.501 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.501 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.501 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26547 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1318912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:47.501 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:47.501 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.685670088999998, 2024-09-13T05:11:47.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055355834, 2024-09-13T05:11:47.502 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.502 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.502 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.502 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.502 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.502 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26547 2024-09-13T05:11:47.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.502 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:47.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:47.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744404+0000", 2024-09-13T05:11:47.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998441 2024-09-13T05:11:47.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744564+0000", 2024-09-13T05:11:47.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016022200000000001 2024-09-13T05:11:47.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744579+0000", 2024-09-13T05:11:47.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5036e-05 2024-09-13T05:11:47.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744585+0000", 2024-09-13T05:11:47.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7880000000000003e-06 2024-09-13T05:11:47.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799747+0000", 2024-09-13T05:11:47.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055161804000000002 2024-09-13T05:11:47.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799823+0000", 2024-09-13T05:11:47.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5956000000000003e-05 2024-09-13T05:11:47.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799916+0000", 2024-09-13T05:11:47.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2733999999999997e-05 2024-09-13T05:11:47.506 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.506 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.506 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.507 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26558 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1364992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:47.507 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:47.507 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.684678923000007, 2024-09-13T05:11:47.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055422765999999998, 2024-09-13T05:11:47.507 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.507 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.507 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.507 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.507 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.507 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26558 2024-09-13T05:11:47.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.507 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:47.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:47.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745550+0000", 2024-09-13T05:11:47.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745553+0000", 2024-09-13T05:11:47.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7690000000000001e-06 2024-09-13T05:11:47.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745559+0000", 2024-09-13T05:11:47.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3149999999999997e-06 2024-09-13T05:11:47.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745564+0000", 2024-09-13T05:11:47.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6670000000000004e-06 2024-09-13T05:11:47.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800791+0000", 2024-09-13T05:11:47.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055226711999999997 2024-09-13T05:11:47.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800865+0000", 2024-09-13T05:11:47.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4344000000000005e-05 2024-09-13T05:11:47.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800974+0000", 2024-09-13T05:11:47.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108606 2024-09-13T05:11:47.511 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.511 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.511 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.511 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26561 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1374208~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:47.512 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:47.512 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.684661869999999, 2024-09-13T05:11:47.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055549315000000002, 2024-09-13T05:11:47.512 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.512 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.512 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.512 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.512 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.512 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26561 2024-09-13T05:11:47.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.512 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:47.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:47.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:47.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745570+0000", 2024-09-13T05:11:47.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4719999999999998e-06 2024-09-13T05:11:47.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745575+0000", 2024-09-13T05:11:47.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1900000000000003e-06 2024-09-13T05:11:47.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745579+0000", 2024-09-13T05:11:47.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3250000000000001e-06 2024-09-13T05:11:47.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801000+0000", 2024-09-13T05:11:47.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055420432999999998 2024-09-13T05:11:47.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801061+0000", 2024-09-13T05:11:47.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1427000000000007e-05 2024-09-13T05:11:47.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801117+0000", 2024-09-13T05:11:47.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5933000000000001e-05 2024-09-13T05:11:47.516 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.516 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.516 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.516 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26582 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1447936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:47.516 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:47.517 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.68324423, 2024-09-13T05:11:47.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055394301, 2024-09-13T05:11:47.517 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.517 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.517 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.517 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.517 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.517 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26582 2024-09-13T05:11:47.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.517 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:47.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:47.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746985+0000", 2024-09-13T05:11:47.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746988+0000", 2024-09-13T05:11:47.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6479999999999999e-06 2024-09-13T05:11:47.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.747000+0000", 2024-09-13T05:11:47.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2009e-05 2024-09-13T05:11:47.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.747005+0000", 2024-09-13T05:11:47.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0039999999999999e-06 2024-09-13T05:11:47.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802232+0000", 2024-09-13T05:11:47.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055227762999999999 2024-09-13T05:11:47.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802320+0000", 2024-09-13T05:11:47.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7576000000000003e-05 2024-09-13T05:11:47.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802380+0000", 2024-09-13T05:11:47.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9888e-05 2024-09-13T05:11:47.521 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.521 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.521 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.521 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:83780 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 5966848~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:47.521 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.161271+0000", 2024-09-13T05:11:47.521 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.2689587610000004, 2024-09-13T05:11:47.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055549792000000001, 2024-09-13T05:11:47.521 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.521 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.521 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.521 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.522 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.522 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83780 2024-09-13T05:11:47.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.522 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.161271+0000", 2024-09-13T05:11:47.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.161271+0000", 2024-09-13T05:11:47.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.161271+0000", 2024-09-13T05:11:47.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.161272+0000", 2024-09-13T05:11:47.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.576e-06 2024-09-13T05:11:47.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.161276+0000", 2024-09-13T05:11:47.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4999999999999999e-06 2024-09-13T05:11:47.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.161279+0000", 2024-09-13T05:11:47.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.168e-06 2024-09-13T05:11:47.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.216618+0000", 2024-09-13T05:11:47.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055339243000000003 2024-09-13T05:11:47.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.216729+0000", 2024-09-13T05:11:47.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111097 2024-09-13T05:11:47.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.216821+0000", 2024-09-13T05:11:47.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1502000000000006e-05 2024-09-13T05:11:47.525 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.525 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.525 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.526 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:83795 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 6181888~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:47.526 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.165224+0000", 2024-09-13T05:11:47.526 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.2650061780000001, 2024-09-13T05:11:47.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055538606999999997, 2024-09-13T05:11:47.526 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.526 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.526 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83795 2024-09-13T05:11:47.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.526 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.165224+0000", 2024-09-13T05:11:47.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.165224+0000", 2024-09-13T05:11:47.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.165223+0000", 2024-09-13T05:11:47.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.165225+0000", 2024-09-13T05:11:47.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7379999999999999e-06 2024-09-13T05:11:47.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.165228+0000", 2024-09-13T05:11:47.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.191e-06 2024-09-13T05:11:47.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.165231+0000", 2024-09-13T05:11:47.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.101e-06 2024-09-13T05:11:47.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.220588+0000", 2024-09-13T05:11:47.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055356764000000003 2024-09-13T05:11:47.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.220681+0000", 2024-09-13T05:11:47.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2467999999999996e-05 2024-09-13T05:11:47.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.220762+0000", 2024-09-13T05:11:47.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1722000000000001e-05 2024-09-13T05:11:47.529 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.530 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.530 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.530 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.530 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.530 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:47.532 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:11:47.532 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:47.525+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:47.632 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:47.625+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:47.642 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:47.642 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:47.642 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:47.654 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:11:47.733 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:47.728+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:47.763 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:47.763 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:47.763 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:47.763 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:47.763 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:47.773 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:11:47.784 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T05:11:47.794 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.7 to 1 (10000) 2024-09-13T05:11:47.807 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-13T05:11:47.807 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:11:47.833 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:47.825+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:47.888 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:47.889 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:47.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:47.889 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:47.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.889 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:70758 3.2 3:427d0469:::rbd_header.112d8d1317eb:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-13T05:11:47.889 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:11:47.889 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.455442711, 2024-09-13T05:11:47.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.190313603, 2024-09-13T05:11:47.889 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.889 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.890 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.890 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.890 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.890 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70758 2024-09-13T05:11:47.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.890 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:11:47.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:11:47.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428654+0000", 2024-09-13T05:11:47.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:47.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428664+0000", 2024-09-13T05:11:47.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0664e-05 2024-09-13T05:11:47.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428683+0000", 2024-09-13T05:11:47.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8377e-05 2024-09-13T05:11:47.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428691+0000", 2024-09-13T05:11:47.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9400000000000008e-06 2024-09-13T05:11:47.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428789+0000", 2024-09-13T05:11:47.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7165999999999998e-05 2024-09-13T05:11:47.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:47.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428811+0000", 2024-09-13T05:11:47.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1925000000000001e-05 2024-09-13T05:11:47.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.617921+0000", 2024-09-13T05:11:47.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.189110536 2024-09-13T05:11:47.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618344+0000", 2024-09-13T05:11:47.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042245800000000001 2024-09-13T05:11:47.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618969+0000", 2024-09-13T05:11:47.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062529299999999996 2024-09-13T05:11:47.894 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.894 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.894 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.895 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88612 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 16071680~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:47.895 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.157549+0000", 2024-09-13T05:11:47.895 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7265488690000002, 2024-09-13T05:11:47.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058248488000000001, 2024-09-13T05:11:47.895 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.895 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.895 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.895 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.895 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.895 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88612 2024-09-13T05:11:47.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.895 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.157549+0000", 2024-09-13T05:11:47.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.157549+0000", 2024-09-13T05:11:47.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.157548+0000", 2024-09-13T05:11:47.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.157552+0000", 2024-09-13T05:11:47.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.118e-06 2024-09-13T05:11:47.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.157559+0000", 2024-09-13T05:11:47.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0330000000000003e-06 2024-09-13T05:11:47.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.157576+0000", 2024-09-13T05:11:47.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6926e-05 2024-09-13T05:11:47.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.215637+0000", 2024-09-13T05:11:47.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058061631000000002 2024-09-13T05:11:47.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.215721+0000", 2024-09-13T05:11:47.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3885000000000001e-05 2024-09-13T05:11:47.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.215798+0000", 2024-09-13T05:11:47.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6575000000000005e-05 2024-09-13T05:11:47.898 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.899 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.899 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.899 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88613 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 16086016~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:47.899 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.157587+0000", 2024-09-13T05:11:47.899 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7265114620000004, 2024-09-13T05:11:47.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058449474000000001, 2024-09-13T05:11:47.899 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.899 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.899 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.899 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.899 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.899 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88613 2024-09-13T05:11:47.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.900 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.157587+0000", 2024-09-13T05:11:47.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.157587+0000", 2024-09-13T05:11:47.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.157586+0000", 2024-09-13T05:11:47.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.157589+0000", 2024-09-13T05:11:47.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7039999999999999e-06 2024-09-13T05:11:47.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.157596+0000", 2024-09-13T05:11:47.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.622e-06 2024-09-13T05:11:47.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.157601+0000", 2024-09-13T05:11:47.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6149999999999999e-06 2024-09-13T05:11:47.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.215839+0000", 2024-09-13T05:11:47.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058238189000000003 2024-09-13T05:11:47.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.215947+0000", 2024-09-13T05:11:47.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107877 2024-09-13T05:11:47.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.216036+0000", 2024-09-13T05:11:47.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8979000000000003e-05 2024-09-13T05:11:47.903 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.903 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.903 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.903 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88630 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12646400~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:47.903 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.161326+0000", 2024-09-13T05:11:47.904 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7227721779999996, 2024-09-13T05:11:47.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058271943999999999, 2024-09-13T05:11:47.904 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.904 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.904 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88630 2024-09-13T05:11:47.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.904 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161326+0000", 2024-09-13T05:11:47.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161326+0000", 2024-09-13T05:11:47.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161326+0000", 2024-09-13T05:11:47.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161328+0000", 2024-09-13T05:11:47.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0099999999999998e-06 2024-09-13T05:11:47.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161331+0000", 2024-09-13T05:11:47.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7450000000000001e-06 2024-09-13T05:11:47.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161335+0000", 2024-09-13T05:11:47.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.495e-06 2024-09-13T05:11:47.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.219395+0000", 2024-09-13T05:11:47.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058060575000000003 2024-09-13T05:11:47.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.219502+0000", 2024-09-13T05:11:47.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010689200000000001 2024-09-13T05:11:47.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.219598+0000", 2024-09-13T05:11:47.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5518000000000003e-05 2024-09-13T05:11:47.908 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.908 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.908 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.909 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88631 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12660736~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:47.909 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.161338+0000", 2024-09-13T05:11:47.909 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7227602810000002, 2024-09-13T05:11:47.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058501347000000002, 2024-09-13T05:11:47.909 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.909 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.909 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.909 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.909 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.909 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88631 2024-09-13T05:11:47.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.909 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161338+0000", 2024-09-13T05:11:47.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161338+0000", 2024-09-13T05:11:47.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161337+0000", 2024-09-13T05:11:47.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161339+0000", 2024-09-13T05:11:47.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9570000000000001e-06 2024-09-13T05:11:47.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161343+0000", 2024-09-13T05:11:47.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7400000000000002e-06 2024-09-13T05:11:47.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161346+0000", 2024-09-13T05:11:47.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3330000000000001e-06 2024-09-13T05:11:47.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.219706+0000", 2024-09-13T05:11:47.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058359837999999997 2024-09-13T05:11:47.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.219782+0000", 2024-09-13T05:11:47.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5714e-05 2024-09-13T05:11:47.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.219839+0000", 2024-09-13T05:11:47.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7061000000000001e-05 2024-09-13T05:11:47.915 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.915 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.915 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.915 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88632 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12675072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:47.915 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.161370+0000", 2024-09-13T05:11:47.915 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7227278330000004, 2024-09-13T05:11:47.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058612957, 2024-09-13T05:11:47.916 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.916 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.916 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.916 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.916 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.916 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88632 2024-09-13T05:11:47.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.916 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161370+0000", 2024-09-13T05:11:47.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161370+0000", 2024-09-13T05:11:47.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161370+0000", 2024-09-13T05:11:47.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161372+0000", 2024-09-13T05:11:47.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2730000000000001e-06 2024-09-13T05:11:47.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161376+0000", 2024-09-13T05:11:47.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1710000000000004e-06 2024-09-13T05:11:47.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161380+0000", 2024-09-13T05:11:47.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6830000000000001e-06 2024-09-13T05:11:47.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.219867+0000", 2024-09-13T05:11:47.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058487329999999997 2024-09-13T05:11:47.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.219927+0000", 2024-09-13T05:11:47.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0256e-05 2024-09-13T05:11:47.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.219983+0000", 2024-09-13T05:11:47.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5717000000000002e-05 2024-09-13T05:11:47.920 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.920 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.920 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.920 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88633 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12689408~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:47.920 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.161383+0000", 2024-09-13T05:11:47.920 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7227150260000004, 2024-09-13T05:11:47.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058808522000000002, 2024-09-13T05:11:47.921 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.921 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.921 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.921 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.921 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.921 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88633 2024-09-13T05:11:47.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.921 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161383+0000", 2024-09-13T05:11:47.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161383+0000", 2024-09-13T05:11:47.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161383+0000", 2024-09-13T05:11:47.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161385+0000", 2024-09-13T05:11:47.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9539999999999998e-06 2024-09-13T05:11:47.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161388+0000", 2024-09-13T05:11:47.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7500000000000001e-06 2024-09-13T05:11:47.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161392+0000", 2024-09-13T05:11:47.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4479999999999999e-06 2024-09-13T05:11:47.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.220027+0000", 2024-09-13T05:11:47.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058635442000000003 2024-09-13T05:11:47.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.220113+0000", 2024-09-13T05:11:47.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5809999999999993e-05 2024-09-13T05:11:47.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.220191+0000", 2024-09-13T05:11:47.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8515000000000003e-05 2024-09-13T05:11:47.924 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.924 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.924 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.924 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88634 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12703744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:47.925 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.161395+0000", 2024-09-13T05:11:47.925 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7227025239999998, 2024-09-13T05:11:47.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058939760000000001, 2024-09-13T05:11:47.925 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.925 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.925 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.925 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.925 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.925 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88634 2024-09-13T05:11:47.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.926 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161395+0000", 2024-09-13T05:11:47.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161395+0000", 2024-09-13T05:11:47.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161395+0000", 2024-09-13T05:11:47.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161397+0000", 2024-09-13T05:11:47.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.855e-06 2024-09-13T05:11:47.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161401+0000", 2024-09-13T05:11:47.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6830000000000001e-06 2024-09-13T05:11:47.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161404+0000", 2024-09-13T05:11:47.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3210000000000001e-06 2024-09-13T05:11:47.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.220237+0000", 2024-09-13T05:11:47.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058832607000000002 2024-09-13T05:11:47.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.220290+0000", 2024-09-13T05:11:47.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3650999999999998e-05 2024-09-13T05:11:47.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.220335+0000", 2024-09-13T05:11:47.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4938000000000002e-05 2024-09-13T05:11:47.929 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.929 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.929 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.929 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88635 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12718080~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:47.929 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.161407+0000", 2024-09-13T05:11:47.929 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7226907870000003, 2024-09-13T05:11:47.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059130823999999998, 2024-09-13T05:11:47.929 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.930 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.930 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.930 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.930 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.930 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88635 2024-09-13T05:11:47.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.930 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161407+0000", 2024-09-13T05:11:47.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161407+0000", 2024-09-13T05:11:47.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161407+0000", 2024-09-13T05:11:47.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161409+0000", 2024-09-13T05:11:47.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.885e-06 2024-09-13T05:11:47.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161412+0000", 2024-09-13T05:11:47.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6950000000000002e-06 2024-09-13T05:11:47.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161416+0000", 2024-09-13T05:11:47.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.467e-06 2024-09-13T05:11:47.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.220375+0000", 2024-09-13T05:11:47.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058958695999999998 2024-09-13T05:11:47.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.220462+0000", 2024-09-13T05:11:47.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7378000000000003e-05 2024-09-13T05:11:47.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.220538+0000", 2024-09-13T05:11:47.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5995999999999995e-05 2024-09-13T05:11:47.933 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.933 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.933 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.934 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88636 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12732416~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:47.934 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.161419+0000", 2024-09-13T05:11:47.934 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7226791700000001, 2024-09-13T05:11:47.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059241000000000002, 2024-09-13T05:11:47.934 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.934 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.935 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88636 2024-09-13T05:11:47.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.935 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161419+0000", 2024-09-13T05:11:47.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161419+0000", 2024-09-13T05:11:47.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161419+0000", 2024-09-13T05:11:47.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161420+0000", 2024-09-13T05:11:47.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8610000000000001e-06 2024-09-13T05:11:47.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161424+0000", 2024-09-13T05:11:47.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.76e-06 2024-09-13T05:11:47.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161428+0000", 2024-09-13T05:11:47.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.41e-06 2024-09-13T05:11:47.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.220554+0000", 2024-09-13T05:11:47.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059126744000000002 2024-09-13T05:11:47.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.220604+0000", 2024-09-13T05:11:47.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9830999999999998e-05 2024-09-13T05:11:47.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.220660+0000", 2024-09-13T05:11:47.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5695000000000001e-05 2024-09-13T05:11:47.938 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.938 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.938 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.938 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88637 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12746752~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:47.939 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.161431+0000", 2024-09-13T05:11:47.939 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7226674700000002, 2024-09-13T05:11:47.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060093617000000002, 2024-09-13T05:11:47.939 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.939 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.939 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.939 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.939 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.939 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88637 2024-09-13T05:11:47.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.939 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161431+0000", 2024-09-13T05:11:47.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161431+0000", 2024-09-13T05:11:47.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161430+0000", 2024-09-13T05:11:47.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161432+0000", 2024-09-13T05:11:47.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8560000000000001e-06 2024-09-13T05:11:47.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161436+0000", 2024-09-13T05:11:47.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6710000000000001e-06 2024-09-13T05:11:47.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161439+0000", 2024-09-13T05:11:47.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1999999999999999e-06 2024-09-13T05:11:47.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.221064+0000", 2024-09-13T05:11:47.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059625154 2024-09-13T05:11:47.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.221266+0000", 2024-09-13T05:11:47.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020158400000000001 2024-09-13T05:11:47.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.221524+0000", 2024-09-13T05:11:47.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025845099999999998 2024-09-13T05:11:47.942 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.943 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.943 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88638 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12761088~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:47.943 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.161444+0000", 2024-09-13T05:11:47.943 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7226541879999999, 2024-09-13T05:11:47.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060254165999999998, 2024-09-13T05:11:47.943 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.943 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.943 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88638 2024-09-13T05:11:47.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.944 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161444+0000", 2024-09-13T05:11:47.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161444+0000", 2024-09-13T05:11:47.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161443+0000", 2024-09-13T05:11:47.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161446+0000", 2024-09-13T05:11:47.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0389999999999999e-06 2024-09-13T05:11:47.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161449+0000", 2024-09-13T05:11:47.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.687e-06 2024-09-13T05:11:47.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161452+0000", 2024-09-13T05:11:47.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0800000000000002e-06 2024-09-13T05:11:47.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.221552+0000", 2024-09-13T05:11:47.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060099695000000002 2024-09-13T05:11:47.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.221630+0000", 2024-09-13T05:11:47.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7795999999999999e-05 2024-09-13T05:11:47.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.221698+0000", 2024-09-13T05:11:47.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8189999999999996e-05 2024-09-13T05:11:47.947 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.947 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.947 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.947 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88639 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12775424~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:47.947 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.161478+0000", 2024-09-13T05:11:47.947 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7226195039999999, 2024-09-13T05:11:47.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060598694000000002, 2024-09-13T05:11:47.948 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.948 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.948 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.948 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.948 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.948 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88639 2024-09-13T05:11:47.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.948 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161478+0000", 2024-09-13T05:11:47.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161478+0000", 2024-09-13T05:11:47.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161478+0000", 2024-09-13T05:11:47.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161480+0000", 2024-09-13T05:11:47.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1679999999999998e-06 2024-09-13T05:11:47.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161484+0000", 2024-09-13T05:11:47.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1649999999999999e-06 2024-09-13T05:11:47.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161488+0000", 2024-09-13T05:11:47.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5250000000000001e-06 2024-09-13T05:11:47.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.221750+0000", 2024-09-13T05:11:47.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060262201000000001 2024-09-13T05:11:47.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.221886+0000", 2024-09-13T05:11:47.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013624899999999999 2024-09-13T05:11:47.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.222077+0000", 2024-09-13T05:11:47.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000190853 2024-09-13T05:11:47.951 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.951 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.951 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.952 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88640 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12789760~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:47.952 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.161491+0000", 2024-09-13T05:11:47.952 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7226068840000002, 2024-09-13T05:11:47.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060722693000000001, 2024-09-13T05:11:47.952 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.952 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.952 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.952 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.952 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.952 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88640 2024-09-13T05:11:47.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.952 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161491+0000", 2024-09-13T05:11:47.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161491+0000", 2024-09-13T05:11:47.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161491+0000", 2024-09-13T05:11:47.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161493+0000", 2024-09-13T05:11:47.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0899999999999999e-06 2024-09-13T05:11:47.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161497+0000", 2024-09-13T05:11:47.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:11:47.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161500+0000", 2024-09-13T05:11:47.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3100000000000001e-06 2024-09-13T05:11:47.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.222104+0000", 2024-09-13T05:11:47.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060604191000000002 2024-09-13T05:11:47.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.222166+0000", 2024-09-13T05:11:47.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2127999999999999e-05 2024-09-13T05:11:47.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.222214+0000", 2024-09-13T05:11:47.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7527000000000001e-05 2024-09-13T05:11:47.956 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.956 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.956 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.956 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88650 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12918784~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:47.956 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.165303+0000", 2024-09-13T05:11:47.956 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7187945630000003, 2024-09-13T05:11:47.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058396485999999997, 2024-09-13T05:11:47.956 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.956 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.957 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88650 2024-09-13T05:11:47.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.957 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165303+0000", 2024-09-13T05:11:47.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165303+0000", 2024-09-13T05:11:47.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165303+0000", 2024-09-13T05:11:47.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165305+0000", 2024-09-13T05:11:47.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0150000000000002e-06 2024-09-13T05:11:47.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165309+0000", 2024-09-13T05:11:47.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0489999999999997e-06 2024-09-13T05:11:47.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165313+0000", 2024-09-13T05:11:47.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6030000000000001e-06 2024-09-13T05:11:47.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.223555+0000", 2024-09-13T05:11:47.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058242467999999999 2024-09-13T05:11:47.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.223638+0000", 2024-09-13T05:11:47.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3227999999999997e-05 2024-09-13T05:11:47.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.223700+0000", 2024-09-13T05:11:47.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1427000000000007e-05 2024-09-13T05:11:47.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.960 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.960 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88651 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12933120~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:47.960 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.165317+0000", 2024-09-13T05:11:47.960 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7187809029999999, 2024-09-13T05:11:47.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058511328000000001, 2024-09-13T05:11:47.961 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.961 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.961 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88651 2024-09-13T05:11:47.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.961 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165317+0000", 2024-09-13T05:11:47.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165317+0000", 2024-09-13T05:11:47.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165317+0000", 2024-09-13T05:11:47.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165319+0000", 2024-09-13T05:11:47.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1050000000000002e-06 2024-09-13T05:11:47.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165323+0000", 2024-09-13T05:11:47.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0049999999999998e-06 2024-09-13T05:11:47.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165326+0000", 2024-09-13T05:11:47.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6169999999999998e-06 2024-09-13T05:11:47.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.223737+0000", 2024-09-13T05:11:47.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058410713000000003 2024-09-13T05:11:47.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.223786+0000", 2024-09-13T05:11:47.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8636e-05 2024-09-13T05:11:47.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.223828+0000", 2024-09-13T05:11:47.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2561999999999997e-05 2024-09-13T05:11:47.965 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.965 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.965 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.965 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88652 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12947456~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:47.965 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.165330+0000", 2024-09-13T05:11:47.965 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.718768345, 2024-09-13T05:11:47.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058688487999999997, 2024-09-13T05:11:47.965 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.965 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.965 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.965 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.966 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88652 2024-09-13T05:11:47.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.966 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165330+0000", 2024-09-13T05:11:47.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165330+0000", 2024-09-13T05:11:47.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165329+0000", 2024-09-13T05:11:47.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165331+0000", 2024-09-13T05:11:47.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9599999999999999e-06 2024-09-13T05:11:47.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165336+0000", 2024-09-13T05:11:47.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.69e-06 2024-09-13T05:11:47.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165340+0000", 2024-09-13T05:11:47.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8229999999999997e-06 2024-09-13T05:11:47.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.223876+0000", 2024-09-13T05:11:47.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058535996 2024-09-13T05:11:47.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.223958+0000", 2024-09-13T05:11:47.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1939000000000003e-05 2024-09-13T05:11:47.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.224018+0000", 2024-09-13T05:11:47.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0439999999999997e-05 2024-09-13T05:11:47.969 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.969 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.969 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.969 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88653 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12961792~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:47.969 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.165343+0000", 2024-09-13T05:11:47.969 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7187547319999998, 2024-09-13T05:11:47.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058803240999999999, 2024-09-13T05:11:47.970 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.970 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.970 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.970 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.970 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.970 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88653 2024-09-13T05:11:47.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.970 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165343+0000", 2024-09-13T05:11:47.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165343+0000", 2024-09-13T05:11:47.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165343+0000", 2024-09-13T05:11:47.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165345+0000", 2024-09-13T05:11:47.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0559999999999999e-06 2024-09-13T05:11:47.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165349+0000", 2024-09-13T05:11:47.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8800000000000001e-06 2024-09-13T05:11:47.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165352+0000", 2024-09-13T05:11:47.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.597e-06 2024-09-13T05:11:47.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.224048+0000", 2024-09-13T05:11:47.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058695863000000001 2024-09-13T05:11:47.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.224103+0000", 2024-09-13T05:11:47.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4945999999999999e-05 2024-09-13T05:11:47.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.224146+0000", 2024-09-13T05:11:47.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3401e-05 2024-09-13T05:11:47.973 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.973 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.973 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.974 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88654 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12976128~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:47.974 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.165371+0000", 2024-09-13T05:11:47.974 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7187273520000002, 2024-09-13T05:11:47.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058967203000000003, 2024-09-13T05:11:47.974 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.974 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.974 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88654 2024-09-13T05:11:47.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.975 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165371+0000", 2024-09-13T05:11:47.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165371+0000", 2024-09-13T05:11:47.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165370+0000", 2024-09-13T05:11:47.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165375+0000", 2024-09-13T05:11:47.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0490000000000003e-06 2024-09-13T05:11:47.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165380+0000", 2024-09-13T05:11:47.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5410000000000002e-06 2024-09-13T05:11:47.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165384+0000", 2024-09-13T05:11:47.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9140000000000001e-06 2024-09-13T05:11:47.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.224192+0000", 2024-09-13T05:11:47.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058807922999999998 2024-09-13T05:11:47.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.224277+0000", 2024-09-13T05:11:47.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4955000000000002e-05 2024-09-13T05:11:47.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.224338+0000", 2024-09-13T05:11:47.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1174999999999996e-05 2024-09-13T05:11:47.978 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.978 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.978 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.978 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88655 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12990464~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:47.978 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.165387+0000", 2024-09-13T05:11:47.978 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7187108689999997, 2024-09-13T05:11:47.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059082956999999998, 2024-09-13T05:11:47.979 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:47.979 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:47.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:47.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:47.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:47.979 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88655 2024-09-13T05:11:47.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.979 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:47.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:47.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165387+0000", 2024-09-13T05:11:47.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:47.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165387+0000", 2024-09-13T05:11:47.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:47.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:47.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165387+0000", 2024-09-13T05:11:47.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:47.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:47.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165389+0000", 2024-09-13T05:11:47.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.137e-06 2024-09-13T05:11:47.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:47.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165393+0000", 2024-09-13T05:11:47.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9419999999999997e-06 2024-09-13T05:11:47.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:47.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165397+0000", 2024-09-13T05:11:47.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8290000000000001e-06 2024-09-13T05:11:47.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:47.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.224372+0000", 2024-09-13T05:11:47.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058974811000000002 2024-09-13T05:11:47.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:47.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.224428+0000", 2024-09-13T05:11:47.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6138999999999999e-05 2024-09-13T05:11:47.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:47.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:47.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:47.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.224470+0000", 2024-09-13T05:11:47.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2401999999999998e-05 2024-09-13T05:11:47.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.983 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.983 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.983 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:47.983 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:47.983 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:47.984 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:11:47.985 INFO:teuthology.orchestra.run.smithi120.stdout:4671 read 0xbdc5e2e thru 0xbdc7aea (0x1cbd bytes) 2024-09-13T05:11:47.985 INFO:teuthology.orchestra.run.smithi120.stdout:4672 writesame 0x21becaf thru 0x21cad37 data_size 0x1(0xc089 bytes) 2024-09-13T05:11:47.985 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:11:47.980+0000 7f8fc8b18700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22154) UID: 0 2024-09-13T05:11:48.085 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:48.081+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:48.089 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:48.089 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:48.089 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:11:48.089 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:48.098 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:11:48.169 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:11:48.173 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:11:48.185 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-13T05:11:47.782021+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1271539958,"num_objects":2601,"num_object_clones":363,"num_object_copies":5202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2601,"num_whiteouts":1182,"num_read":138980,"num_read_kb":508257,"num_write":15815,"num_write_kb":346869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1981,"num_bytes_recovered":69865385,"num_keys_recovered":233,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14043,"ondisk_log_size":14043,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":563044,"kb_used_data":322992,"kb_used_omap":7,"kb_used_meta":239992,"kb_avail":471296156,"statfs":{"total":483183820800,"available":482607263744,"internally_reserved":0,"allocated":330743808,"data_stored":370597085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7962,"internal_metadata":245752038},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15722443,"num_objects":139,"num_object_clones":0,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":0,"num_read":27786,"num_read_kb":4362,"num_write":421,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.034877"},"pg_stats":[{"pgid":"3.1f","version":"100'385","reported_seq":999,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.790451+0000","last_change":"2024-09-13T05:10:37.993400+0000","last_active":"2024-09-13T05:11:45.790451+0000","last_peered":"2024-09-13T05:11:45.790451+0000","last_clean":"2024-09-13T05:11:45.790451+0000","last_became_active":"2024-09-13T05:10:37.864778+0000","last_became_peered":"2024-09-13T05:10:37.864778+0000","last_unstale":"2024-09-13T05:11:45.790451+0000","last_undegraded":"2024-09-13T05:11:45.790451+0000","last_fullsized":"2024-09-13T05:11:45.790451+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:56:24.801492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011835439999999999,"stat_sum":{"num_bytes":7262464,"num_objects":72,"num_object_clones":7,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":28,"num_read":1675,"num_read_kb":5320,"num_write":454,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":297202,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"102'285","reported_seq":4329,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.538502+0000","last_change":"2024-09-13T05:10:12.076857+0000","last_active":"2024-09-13T05:11:46.538502+0000","last_peered":"2024-09-13T05:11:46.538502+0000","last_clean":"2024-09-13T05:11:46.538502+0000","last_became_active":"2024-09-13T05:10:09.644293+0000","last_became_peered":"2024-09-13T05:10:09.644293+0000","last_unstale":"2024-09-13T05:11:46.538502+0000","last_undegraded":"2024-09-13T05:11:46.538502+0000","last_fullsized":"2024-09-13T05:11:46.538502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:45:32.561793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225439,"stat_sum":{"num_bytes":29283683,"num_objects":69,"num_object_clones":8,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":35,"num_read":4683,"num_read_kb":4873,"num_write":260,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"102'438","reported_seq":2412,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.885625+0000","last_change":"2024-09-13T05:10:11.645342+0000","last_active":"2024-09-13T05:11:46.885625+0000","last_peered":"2024-09-13T05:11:46.885625+0000","last_clean":"2024-09-13T05:11:46.885625+0000","last_became_active":"2024-09-13T05:10:09.645791+0000","last_became_peered":"2024-09-13T05:10:09.645791+0000","last_unstale":"2024-09-13T05:11:46.885625+0000","last_undegraded":"2024-09-13T05:11:46.885625+0000","last_fullsized":"2024-09-13T05:11:46.885625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:49.028553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072691800000000001,"stat_sum":{"num_bytes":35478438,"num_objects":96,"num_object_clones":13,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":39,"num_read":2840,"num_read_kb":12651,"num_write":494,"num_write_kb":5315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"102'585","reported_seq":3235,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.775477+0000","last_change":"2024-09-13T05:10:31.949427+0000","last_active":"2024-09-13T05:11:46.775477+0000","last_peered":"2024-09-13T05:11:46.775477+0000","last_clean":"2024-09-13T05:11:46.775477+0000","last_became_active":"2024-09-13T05:10:31.828206+0000","last_became_peered":"2024-09-13T05:10:31.828206+0000","last_unstale":"2024-09-13T05:11:46.775477+0000","last_undegraded":"2024-09-13T05:11:46.775477+0000","last_fullsized":"2024-09-13T05:11:46.775477+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:32:46.868249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078437299999999999,"stat_sum":{"num_bytes":48667851,"num_objects":74,"num_object_clones":11,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":25,"num_read":4889,"num_read_kb":20630,"num_write":748,"num_write_kb":14561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":372837,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"101'391","reported_seq":2022,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.787605+0000","last_change":"2024-09-13T05:10:37.990899+0000","last_active":"2024-09-13T05:11:45.787605+0000","last_peered":"2024-09-13T05:11:45.787605+0000","last_clean":"2024-09-13T05:11:45.787605+0000","last_became_active":"2024-09-13T05:10:37.867842+0000","last_became_peered":"2024-09-13T05:10:37.867842+0000","last_unstale":"2024-09-13T05:11:45.787605+0000","last_undegraded":"2024-09-13T05:11:45.787605+0000","last_fullsized":"2024-09-13T05:11:45.787605+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:38:24.437617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065808499999999999,"stat_sum":{"num_bytes":52798208,"num_objects":90,"num_object_clones":10,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":40,"num_read":3112,"num_read_kb":14189,"num_write":392,"num_write_kb":9484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":612052,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"103'518","reported_seq":11820,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.879839+0000","last_change":"2024-09-13T05:10:37.948112+0000","last_active":"2024-09-13T05:11:46.879839+0000","last_peered":"2024-09-13T05:11:46.879839+0000","last_clean":"2024-09-13T05:11:46.879839+0000","last_became_active":"2024-09-13T05:10:37.863614+0000","last_became_peered":"2024-09-13T05:10:37.863614+0000","last_unstale":"2024-09-13T05:11:46.879839+0000","last_undegraded":"2024-09-13T05:11:46.879839+0000","last_fullsized":"2024-09-13T05:11:46.879839+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:15.873724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027226559999999999,"stat_sum":{"num_bytes":56752568,"num_objects":96,"num_object_clones":14,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":37,"num_read":12722,"num_read_kb":16611,"num_write":588,"num_write_kb":9892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":77,"num_bytes_recovered":1081937,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"103'623","reported_seq":9364,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.787340+0000","last_change":"2024-09-13T05:10:34.613940+0000","last_active":"2024-09-13T05:11:46.787340+0000","last_peered":"2024-09-13T05:11:46.787340+0000","last_clean":"2024-09-13T05:11:46.787340+0000","last_became_active":"2024-09-13T05:10:34.612579+0000","last_became_peered":"2024-09-13T05:10:34.612579+0000","last_unstale":"2024-09-13T05:11:46.787340+0000","last_undegraded":"2024-09-13T05:11:46.787340+0000","last_fullsized":"2024-09-13T05:11:46.787340+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:43.339882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067403999999999999,"stat_sum":{"num_bytes":70207468,"num_objects":85,"num_object_clones":13,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":35,"num_read":11164,"num_read_kb":18306,"num_write":790,"num_write_kb":6532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":248973,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"103'446","reported_seq":1837,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.787107+0000","last_change":"2024-09-13T05:10:37.929523+0000","last_active":"2024-09-13T05:11:46.787107+0000","last_peered":"2024-09-13T05:11:46.787107+0000","last_clean":"2024-09-13T05:11:46.787107+0000","last_became_active":"2024-09-13T05:10:37.865440+0000","last_became_peered":"2024-09-13T05:10:37.865440+0000","last_unstale":"2024-09-13T05:11:46.787107+0000","last_undegraded":"2024-09-13T05:11:46.787107+0000","last_fullsized":"2024-09-13T05:11:46.787107+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:30:31.875141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087399999999998,"stat_sum":{"num_bytes":54587136,"num_objects":94,"num_object_clones":16,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":46,"num_read":2076,"num_read_kb":23632,"num_write":486,"num_write_kb":23675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":1513234,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"102'329","reported_seq":2156,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.080043+0000","last_change":"2024-09-13T05:10:37.920810+0000","last_active":"2024-09-13T05:11:46.080043+0000","last_peered":"2024-09-13T05:11:46.080043+0000","last_clean":"2024-09-13T05:11:46.080043+0000","last_became_active":"2024-09-13T05:10:37.864816+0000","last_became_peered":"2024-09-13T05:10:37.864816+0000","last_unstale":"2024-09-13T05:11:46.080043+0000","last_undegraded":"2024-09-13T05:11:46.080043+0000","last_fullsized":"2024-09-13T05:11:46.080043+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:06.315864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096598599999999995,"stat_sum":{"num_bytes":10679864,"num_objects":67,"num_object_clones":7,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":31,"num_read":4021,"num_read_kb":6478,"num_write":279,"num_write_kb":2856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":37802,"num_keys_recovered":23,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"101'334","reported_seq":2448,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.790456+0000","last_change":"2024-09-13T05:11:24.632224+0000","last_active":"2024-09-13T05:11:45.790456+0000","last_peered":"2024-09-13T05:11:45.790456+0000","last_clean":"2024-09-13T05:11:45.790456+0000","last_became_active":"2024-09-13T05:11:24.631079+0000","last_became_peered":"2024-09-13T05:11:24.631079+0000","last_unstale":"2024-09-13T05:11:45.790456+0000","last_undegraded":"2024-09-13T05:11:45.790456+0000","last_fullsized":"2024-09-13T05:11:45.790456+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:29.182802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072236499999999999,"stat_sum":{"num_bytes":58047229,"num_objects":78,"num_object_clones":18,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":39,"num_read":2440,"num_read_kb":11072,"num_write":278,"num_write_kb":3798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":4743569,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"102'309","reported_seq":5255,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.090759+0000","last_change":"2024-09-13T05:10:11.681217+0000","last_active":"2024-09-13T05:11:46.090759+0000","last_peered":"2024-09-13T05:11:46.090759+0000","last_clean":"2024-09-13T05:11:46.090759+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:11:46.090759+0000","last_undegraded":"2024-09-13T05:11:46.090759+0000","last_fullsized":"2024-09-13T05:11:46.090759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:40.457636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095533399999999996,"stat_sum":{"num_bytes":16647075,"num_objects":73,"num_object_clones":15,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":37,"num_read":5490,"num_read_kb":12758,"num_write":353,"num_write_kb":6676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"102'301","reported_seq":5044,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.054123+0000","last_change":"2024-09-13T05:10:11.681365+0000","last_active":"2024-09-13T05:11:46.054123+0000","last_peered":"2024-09-13T05:11:46.054123+0000","last_clean":"2024-09-13T05:11:46.054123+0000","last_became_active":"2024-09-13T05:10:09.645823+0000","last_became_peered":"2024-09-13T05:10:09.645823+0000","last_unstale":"2024-09-13T05:11:46.054123+0000","last_undegraded":"2024-09-13T05:11:46.054123+0000","last_fullsized":"2024-09-13T05:11:46.054123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:24.367358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011047369999999999,"stat_sum":{"num_bytes":48986789,"num_objects":86,"num_object_clones":14,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":41,"num_read":4791,"num_read_kb":26870,"num_write":249,"num_write_kb":6506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":99,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.794317+0000","last_change":"2024-09-13T05:10:01.383891+0000","last_active":"2024-09-13T05:11:45.794317+0000","last_peered":"2024-09-13T05:11:45.794317+0000","last_clean":"2024-09-13T05:11:45.794317+0000","last_became_active":"2024-09-13T05:09:59.374793+0000","last_became_peered":"2024-09-13T05:09:59.374793+0000","last_unstale":"2024-09-13T05:11:45.794317+0000","last_undegraded":"2024-09-13T05:11:45.794317+0000","last_fullsized":"2024-09-13T05:11:45.794317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:02.499446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065068999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"102'295","reported_seq":5266,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.788687+0000","last_change":"2024-09-13T05:11:25.647054+0000","last_active":"2024-09-13T05:11:46.788687+0000","last_peered":"2024-09-13T05:11:46.788687+0000","last_clean":"2024-09-13T05:11:46.788687+0000","last_became_active":"2024-09-13T05:11:25.645546+0000","last_became_peered":"2024-09-13T05:11:25.645546+0000","last_unstale":"2024-09-13T05:11:46.788687+0000","last_undegraded":"2024-09-13T05:11:46.788687+0000","last_fullsized":"2024-09-13T05:11:46.788687+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:33:49.392161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099899699999999995,"stat_sum":{"num_bytes":33984796,"num_objects":74,"num_object_clones":11,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":30,"num_read":4311,"num_read_kb":12860,"num_write":245,"num_write_kb":7958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":13680601,"num_keys_recovered":22,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.794295+0000","last_change":"2024-09-13T05:10:31.826927+0000","last_active":"2024-09-13T05:11:45.794295+0000","last_peered":"2024-09-13T05:11:45.794295+0000","last_clean":"2024-09-13T05:11:45.794295+0000","last_became_active":"2024-09-13T05:10:31.826431+0000","last_became_peered":"2024-09-13T05:10:31.826431+0000","last_unstale":"2024-09-13T05:11:45.794295+0000","last_undegraded":"2024-09-13T05:11:45.794295+0000","last_fullsized":"2024-09-13T05:11:45.794295+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:13:36.678853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"102'292","reported_seq":1690,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.080037+0000","last_change":"2024-09-13T05:10:12.077111+0000","last_active":"2024-09-13T05:11:46.080037+0000","last_peered":"2024-09-13T05:11:46.080037+0000","last_clean":"2024-09-13T05:11:46.080037+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:11:46.080037+0000","last_undegraded":"2024-09-13T05:11:46.080037+0000","last_fullsized":"2024-09-13T05:11:46.080037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:37.976147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001460444,"stat_sum":{"num_bytes":56807087,"num_objects":80,"num_object_clones":9,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":42,"num_read":1533,"num_read_kb":10835,"num_write":245,"num_write_kb":3689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":107,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.787909+0000","last_change":"2024-09-13T05:10:37.866953+0000","last_active":"2024-09-13T05:11:45.787909+0000","last_peered":"2024-09-13T05:11:45.787909+0000","last_clean":"2024-09-13T05:11:45.787909+0000","last_became_active":"2024-09-13T05:10:37.866624+0000","last_became_peered":"2024-09-13T05:10:37.866624+0000","last_unstale":"2024-09-13T05:11:45.787909+0000","last_undegraded":"2024-09-13T05:11:45.787909+0000","last_fullsized":"2024-09-13T05:11:45.787909+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:56:20.077971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"102'430","reported_seq":1148,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.243435+0000","last_change":"2024-09-13T05:11:23.618355+0000","last_active":"2024-09-13T05:11:46.243435+0000","last_peered":"2024-09-13T05:11:46.243435+0000","last_clean":"2024-09-13T05:11:46.243435+0000","last_became_active":"2024-09-13T05:11:23.616394+0000","last_became_peered":"2024-09-13T05:11:23.616394+0000","last_unstale":"2024-09-13T05:11:46.243435+0000","last_undegraded":"2024-09-13T05:11:46.243435+0000","last_fullsized":"2024-09-13T05:11:46.243435+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:12:03.977067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076234800000000004,"stat_sum":{"num_bytes":17697565,"num_objects":75,"num_object_clones":8,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":34,"num_read":1487,"num_read_kb":4210,"num_write":569,"num_write_kb":9594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":2629215,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":69,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.787614+0000","last_change":"2024-09-13T05:10:37.864940+0000","last_active":"2024-09-13T05:11:45.787614+0000","last_peered":"2024-09-13T05:11:45.787614+0000","last_clean":"2024-09-13T05:11:45.787614+0000","last_became_active":"2024-09-13T05:10:37.864623+0000","last_became_peered":"2024-09-13T05:10:37.864623+0000","last_unstale":"2024-09-13T05:11:45.787614+0000","last_undegraded":"2024-09-13T05:11:45.787614+0000","last_fullsized":"2024-09-13T05:11:45.787614+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:41.598490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.5","version":"102'375","reported_seq":2971,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.775983+0000","last_change":"2024-09-13T05:10:11.645960+0000","last_active":"2024-09-13T05:11:46.775983+0000","last_peered":"2024-09-13T05:11:46.775983+0000","last_clean":"2024-09-13T05:11:46.775983+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:11:46.775983+0000","last_undegraded":"2024-09-13T05:11:46.775983+0000","last_fullsized":"2024-09-13T05:11:46.775983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:40.372741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001054028,"stat_sum":{"num_bytes":97147739,"num_objects":88,"num_object_clones":11,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":32,"num_read":4214,"num_read_kb":56743,"num_write":344,"num_write_kb":39096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"102'500","reported_seq":2467,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.962030+0000","last_change":"2024-09-13T05:10:37.979816+0000","last_active":"2024-09-13T05:11:45.962030+0000","last_peered":"2024-09-13T05:11:45.962030+0000","last_clean":"2024-09-13T05:11:45.962030+0000","last_became_active":"2024-09-13T05:10:37.863256+0000","last_became_peered":"2024-09-13T05:10:37.863256+0000","last_unstale":"2024-09-13T05:11:45.962030+0000","last_undegraded":"2024-09-13T05:11:45.962030+0000","last_fullsized":"2024-09-13T05:11:45.962030+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:58:55.928356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099335200000000008,"stat_sum":{"num_bytes":66872889,"num_objects":80,"num_object_clones":11,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":40,"num_read":3246,"num_read_kb":28216,"num_write":587,"num_write_kb":33171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":214109,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":113,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.790158+0000","last_change":"2024-09-13T05:10:31.836193+0000","last_active":"2024-09-13T05:11:45.790158+0000","last_peered":"2024-09-13T05:11:45.790158+0000","last_clean":"2024-09-13T05:11:45.790158+0000","last_became_active":"2024-09-13T05:10:31.825663+0000","last_became_peered":"2024-09-13T05:10:31.825663+0000","last_unstale":"2024-09-13T05:11:45.790158+0000","last_undegraded":"2024-09-13T05:11:45.790158+0000","last_fullsized":"2024-09-13T05:11:45.790158+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:38:23.311570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"102'466","reported_seq":874,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.787310+0000","last_change":"2024-09-13T05:10:31.893494+0000","last_active":"2024-09-13T05:11:46.787310+0000","last_peered":"2024-09-13T05:11:46.787310+0000","last_clean":"2024-09-13T05:11:46.787310+0000","last_became_active":"2024-09-13T05:10:31.827657+0000","last_became_peered":"2024-09-13T05:10:31.827657+0000","last_unstale":"2024-09-13T05:11:46.787310+0000","last_undegraded":"2024-09-13T05:11:46.787310+0000","last_fullsized":"2024-09-13T05:11:46.787310+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:16:14.432049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045163499999999998,"stat_sum":{"num_bytes":24243801,"num_objects":84,"num_object_clones":13,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":40,"num_read":1276,"num_read_kb":2695,"num_write":488,"num_write_kb":3959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":84179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":99,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.783056+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:11:45.783056+0000","last_peered":"2024-09-13T05:11:45.783056+0000","last_clean":"2024-09-13T05:11:45.783056+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:11:45.783056+0000","last_undegraded":"2024-09-13T05:11:45.783056+0000","last_fullsized":"2024-09-13T05:11:45.783056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"101'361","reported_seq":958,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.847823+0000","last_change":"2024-09-13T05:10:38.111510+0000","last_active":"2024-09-13T05:11:45.847823+0000","last_peered":"2024-09-13T05:11:45.847823+0000","last_clean":"2024-09-13T05:11:45.847823+0000","last_became_active":"2024-09-13T05:10:37.869040+0000","last_became_peered":"2024-09-13T05:10:37.869040+0000","last_unstale":"2024-09-13T05:11:45.847823+0000","last_undegraded":"2024-09-13T05:11:45.847823+0000","last_fullsized":"2024-09-13T05:11:45.847823+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:48:18.385423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048152600000000002,"stat_sum":{"num_bytes":28663837,"num_objects":73,"num_object_clones":13,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":34,"num_read":1136,"num_read_kb":12355,"num_write":402,"num_write_kb":9333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":383717,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":115,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.787308+0000","last_change":"2024-09-13T05:10:37.865514+0000","last_active":"2024-09-13T05:11:45.787308+0000","last_peered":"2024-09-13T05:11:45.787308+0000","last_clean":"2024-09-13T05:11:45.787308+0000","last_became_active":"2024-09-13T05:10:37.864299+0000","last_became_peered":"2024-09-13T05:10:37.864299+0000","last_unstale":"2024-09-13T05:11:45.787308+0000","last_undegraded":"2024-09-13T05:11:45.787308+0000","last_fullsized":"2024-09-13T05:11:45.787308+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:45:58.276509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"102'397","reported_seq":2277,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.787179+0000","last_change":"2024-09-13T05:11:23.619138+0000","last_active":"2024-09-13T05:11:46.787179+0000","last_peered":"2024-09-13T05:11:46.787179+0000","last_clean":"2024-09-13T05:11:46.787179+0000","last_became_active":"2024-09-13T05:11:23.617149+0000","last_became_peered":"2024-09-13T05:11:23.617149+0000","last_unstale":"2024-09-13T05:11:46.787179+0000","last_undegraded":"2024-09-13T05:11:46.787179+0000","last_fullsized":"2024-09-13T05:11:46.787179+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:55:46.203366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059320200000000003,"stat_sum":{"num_bytes":26350904,"num_objects":82,"num_object_clones":9,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":36,"num_read":4070,"num_read_kb":10419,"num_write":333,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":2822984,"num_keys_recovered":34,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":100,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.790125+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:11:45.790125+0000","last_peered":"2024-09-13T05:11:45.790125+0000","last_clean":"2024-09-13T05:11:45.790125+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:11:45.790125+0000","last_undegraded":"2024-09-13T05:11:45.790125+0000","last_fullsized":"2024-09-13T05:11:45.790125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":268,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.787409+0000","last_change":"2024-09-13T05:10:40.886011+0000","last_active":"2024-09-13T05:11:45.787409+0000","last_peered":"2024-09-13T05:11:45.787409+0000","last_clean":"2024-09-13T05:11:45.787409+0000","last_became_active":"2024-09-13T05:10:40.885587+0000","last_became_peered":"2024-09-13T05:10:40.885587+0000","last_unstale":"2024-09-13T05:11:45.787409+0000","last_undegraded":"2024-09-13T05:11:45.787409+0000","last_fullsized":"2024-09-13T05:11:45.787409+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:52:47.632734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"102'281","reported_seq":4385,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.928739+0000","last_change":"2024-09-13T05:10:31.888827+0000","last_active":"2024-09-13T05:11:46.928739+0000","last_peered":"2024-09-13T05:11:46.928739+0000","last_clean":"2024-09-13T05:11:46.928739+0000","last_became_active":"2024-09-13T05:10:31.827016+0000","last_became_peered":"2024-09-13T05:10:31.827016+0000","last_unstale":"2024-09-13T05:11:46.928739+0000","last_undegraded":"2024-09-13T05:11:46.928739+0000","last_fullsized":"2024-09-13T05:11:46.928739+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:47.525525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000500144,"stat_sum":{"num_bytes":14389322,"num_objects":87,"num_object_clones":12,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":48,"num_read":4099,"num_read_kb":5192,"num_write":219,"num_write_kb":26795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":58925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"102'405","reported_seq":6508,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.885773+0000","last_change":"2024-09-13T05:10:11.648218+0000","last_active":"2024-09-13T05:11:46.885773+0000","last_peered":"2024-09-13T05:11:46.885773+0000","last_clean":"2024-09-13T05:11:46.885773+0000","last_became_active":"2024-09-13T05:10:09.645408+0000","last_became_peered":"2024-09-13T05:10:09.645408+0000","last_unstale":"2024-09-13T05:11:46.885773+0000","last_undegraded":"2024-09-13T05:11:46.885773+0000","last_fullsized":"2024-09-13T05:11:46.885773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:59.846981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097828900000000002,"stat_sum":{"num_bytes":44563905,"num_objects":76,"num_object_clones":8,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":31,"num_read":8301,"num_read_kb":21682,"num_write":391,"num_write_kb":5705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"101'444","reported_seq":8737,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.787097+0000","last_change":"2024-09-13T05:10:47.940550+0000","last_active":"2024-09-13T05:11:46.787097+0000","last_peered":"2024-09-13T05:11:46.787097+0000","last_clean":"2024-09-13T05:11:46.787097+0000","last_became_active":"2024-09-13T05:10:47.939220+0000","last_became_peered":"2024-09-13T05:10:47.939220+0000","last_unstale":"2024-09-13T05:11:46.787097+0000","last_undegraded":"2024-09-13T05:11:46.787097+0000","last_fullsized":"2024-09-13T05:11:46.787097+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:59.693041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013204619999999999,"stat_sum":{"num_bytes":22481119,"num_objects":78,"num_object_clones":12,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":38,"num_read":8849,"num_read_kb":15959,"num_write":476,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":59,"num_bytes_recovered":6203954,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"103'357","reported_seq":2639,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.885772+0000","last_change":"2024-09-13T05:10:38.007507+0000","last_active":"2024-09-13T05:11:46.885772+0000","last_peered":"2024-09-13T05:11:46.885772+0000","last_clean":"2024-09-13T05:11:46.885772+0000","last_became_active":"2024-09-13T05:10:37.868643+0000","last_became_peered":"2024-09-13T05:10:37.868643+0000","last_unstale":"2024-09-13T05:11:46.885772+0000","last_undegraded":"2024-09-13T05:11:46.885772+0000","last_fullsized":"2024-09-13T05:11:46.885772+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:29:05.387242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055343700000000005,"stat_sum":{"num_bytes":7450493,"num_objects":74,"num_object_clones":11,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":38,"num_read":3548,"num_read_kb":7991,"num_write":306,"num_write_kb":7258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":15854,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"102'190","reported_seq":1058,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.775689+0000","last_change":"2024-09-13T05:10:11.647302+0000","last_active":"2024-09-13T05:11:46.775689+0000","last_peered":"2024-09-13T05:11:46.775689+0000","last_clean":"2024-09-13T05:11:46.775689+0000","last_became_active":"2024-09-13T05:10:09.647037+0000","last_became_peered":"2024-09-13T05:10:09.647037+0000","last_unstale":"2024-09-13T05:11:46.775689+0000","last_undegraded":"2024-09-13T05:11:46.775689+0000","last_fullsized":"2024-09-13T05:11:46.775689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:54:17.061326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069994199999999995,"stat_sum":{"num_bytes":54607699,"num_objects":75,"num_object_clones":11,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":31,"num_read":912,"num_read_kb":12410,"num_write":167,"num_write_kb":5908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"102'577","reported_seq":4030,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.989138+0000","last_change":"2024-09-13T05:11:23.617596+0000","last_active":"2024-09-13T05:11:45.989138+0000","last_peered":"2024-09-13T05:11:45.989138+0000","last_clean":"2024-09-13T05:11:45.989138+0000","last_became_active":"2024-09-13T05:11:23.616962+0000","last_became_peered":"2024-09-13T05:11:23.616962+0000","last_unstale":"2024-09-13T05:11:45.989138+0000","last_undegraded":"2024-09-13T05:11:45.989138+0000","last_fullsized":"2024-09-13T05:11:45.989138+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:19.035337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019283150000000001,"stat_sum":{"num_bytes":70782133,"num_objects":90,"num_object_clones":12,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":40,"num_read":4923,"num_read_kb":14805,"num_write":715,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":12781016,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"103'873","reported_seq":5647,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.788777+0000","last_change":"2024-09-13T05:11:25.646827+0000","last_active":"2024-09-13T05:11:46.788777+0000","last_peered":"2024-09-13T05:11:46.788777+0000","last_clean":"2024-09-13T05:11:46.788777+0000","last_became_active":"2024-09-13T05:11:25.644857+0000","last_became_peered":"2024-09-13T05:11:25.644857+0000","last_unstale":"2024-09-13T05:11:46.788777+0000","last_undegraded":"2024-09-13T05:11:46.788777+0000","last_fullsized":"2024-09-13T05:11:46.788777+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:39.872264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018982339999999999,"stat_sum":{"num_bytes":35255341,"num_objects":79,"num_object_clones":7,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":38,"num_read":7120,"num_read_kb":7649,"num_write":1286,"num_write_kb":6111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":8639919,"num_keys_recovered":36,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"102'613","reported_seq":1836,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.054622+0000","last_change":"2024-09-13T05:10:40.885332+0000","last_active":"2024-09-13T05:11:46.054622+0000","last_peered":"2024-09-13T05:11:46.054622+0000","last_clean":"2024-09-13T05:11:46.054622+0000","last_became_active":"2024-09-13T05:10:40.884585+0000","last_became_peered":"2024-09-13T05:10:40.884585+0000","last_unstale":"2024-09-13T05:11:46.054622+0000","last_undegraded":"2024-09-13T05:11:46.054622+0000","last_fullsized":"2024-09-13T05:11:46.054622+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:31:19.596080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001164273,"stat_sum":{"num_bytes":19064120,"num_objects":83,"num_object_clones":11,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":44,"num_read":3493,"num_read_kb":11176,"num_write":846,"num_write_kb":7085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":296075,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"100'390","reported_seq":2262,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.794148+0000","last_change":"2024-09-13T05:11:23.617697+0000","last_active":"2024-09-13T05:11:45.794148+0000","last_peered":"2024-09-13T05:11:45.794148+0000","last_clean":"2024-09-13T05:11:45.794148+0000","last_became_active":"2024-09-13T05:11:23.617017+0000","last_became_peered":"2024-09-13T05:11:23.617017+0000","last_unstale":"2024-09-13T05:11:45.794148+0000","last_undegraded":"2024-09-13T05:11:45.794148+0000","last_fullsized":"2024-09-13T05:11:45.794148+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:26:44.551305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009951719999999999,"stat_sum":{"num_bytes":36432312,"num_objects":86,"num_object_clones":7,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":35,"num_read":2777,"num_read_kb":15157,"num_write":409,"num_write_kb":7442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":11923520,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"102'265","reported_seq":4772,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.069397+0000","last_change":"2024-09-13T05:10:11.680757+0000","last_active":"2024-09-13T05:11:46.069397+0000","last_peered":"2024-09-13T05:11:46.069397+0000","last_clean":"2024-09-13T05:11:46.069397+0000","last_became_active":"2024-09-13T05:10:09.653444+0000","last_became_peered":"2024-09-13T05:10:09.653444+0000","last_unstale":"2024-09-13T05:11:46.069397+0000","last_undegraded":"2024-09-13T05:11:46.069397+0000","last_fullsized":"2024-09-13T05:11:46.069397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:17:06.303008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000625977,"stat_sum":{"num_bytes":13312241,"num_objects":84,"num_object_clones":13,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":44,"num_read":4541,"num_read_kb":11518,"num_write":203,"num_write_kb":5055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"103'699","reported_seq":2367,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.818720+0000","last_change":"2024-09-13T05:10:40.884306+0000","last_active":"2024-09-13T05:11:46.818720+0000","last_peered":"2024-09-13T05:11:46.818720+0000","last_clean":"2024-09-13T05:11:46.818720+0000","last_became_active":"2024-09-13T05:10:40.883543+0000","last_became_peered":"2024-09-13T05:10:40.883543+0000","last_unstale":"2024-09-13T05:11:46.818720+0000","last_undegraded":"2024-09-13T05:11:46.818720+0000","last_fullsized":"2024-09-13T05:11:46.818720+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:14:23.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048307200000000003,"stat_sum":{"num_bytes":62278263,"num_objects":73,"num_object_clones":12,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":31,"num_read":4626,"num_read_kb":21825,"num_write":958,"num_write_kb":7545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":633324,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"102'769","reported_seq":2440,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.582796+0000","last_change":"2024-09-13T05:10:11.680877+0000","last_active":"2024-09-13T05:11:46.582796+0000","last_peered":"2024-09-13T05:11:46.582796+0000","last_clean":"2024-09-13T05:11:46.582796+0000","last_became_active":"2024-09-13T05:10:09.649053+0000","last_became_peered":"2024-09-13T05:10:09.649053+0000","last_unstale":"2024-09-13T05:11:46.582796+0000","last_undegraded":"2024-09-13T05:11:46.582796+0000","last_fullsized":"2024-09-13T05:11:46.582796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:14.770260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062821800000000005,"stat_sum":{"num_bytes":49165232,"num_objects":96,"num_object_clones":16,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":43,"num_read":4499,"num_read_kb":51070,"num_write":1094,"num_write_kb":39019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1270949571,"num_objects":2597,"num_object_clones":363,"num_object_copies":5194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2597,"num_whiteouts":1182,"num_read":138864,"num_read_kb":508157,"num_write":15654,"num_write_kb":344451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1978,"num_bytes_recovered":69274998,"num_keys_recovered":233,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":346955776,"data_stored":395595343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13923,"ondisk_log_size":13923,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":154268,"kb_used_data":78868,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94217572,"statfs":{"total":96636764160,"available":96478793728,"internally_reserved":0,"allocated":80760832,"data_stored":89290403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":77199819},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.69099999999999995}]},{"osd":1,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.66600000000000004}]},{"osd":2,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.629},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.59299999999999997}]},{"osd":3,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.749}]},{"osd":4,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.64900000000000002}]},{"osd":6,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.83099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61464,"kb_used_data":34444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94310376,"statfs":{"total":96636764160,"available":96573825024,"internally_reserved":0,"allocated":35270656,"data_stored":38668547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.65400000000000003}]},{"osd":1,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.53100000000000003}]},{"osd":2,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.0089999999999999}]},{"osd":4,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.88900000000000001}]},{"osd":5,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.91400000000000003}]},{"osd":7,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.94999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138384,"kb_used_data":81028,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94233456,"statfs":{"total":96636764160,"available":96495058944,"internally_reserved":0,"allocated":82972672,"data_stored":91654287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.61599999999999999}]},{"osd":1,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.64100000000000001}]},{"osd":2,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.84199999999999997}]},{"osd":3,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.86899999999999999}]},{"osd":4,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.71299999999999997}]},{"osd":6,"last update":"Fri Sep 13 05:10:58 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.77800000000000002}]},{"osd":7,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.0660000000000001}]}]},{"osd":4,"up_from":0,"seq":55834574876,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131152,"kb_used_data":77892,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94240688,"statfs":{"total":96636764160,"available":96502464512,"internally_reserved":0,"allocated":79761408,"data_stored":93218618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":54524360},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.501},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.52600000000000002}]},{"osd":1,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.72699999999999998}]},{"osd":2,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.65500000000000003}]},{"osd":4,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.63600000000000001}]},{"osd":6,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.62},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.93400000000000005}]},{"osd":7,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.88200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77776,"kb_used_data":50760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94294064,"statfs":{"total":96636764160,"available":96557121536,"internally_reserved":0,"allocated":51978240,"data_stored":57765230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.85999999999999999}]},{"osd":3,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.73599999999999999}]},{"osd":4,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.94399999999999995}]},{"osd":5,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.81799999999999995}]},{"osd":6,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.0009999999999999}]},{"osd":7,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.099},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.629}]}]},{"osd":1,"up_from":0,"seq":55834574874,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":0,"seq":55834574876,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10035200,"data_stored":11939429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6619136,"data_stored":10238144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51290112,"data_stored":57726661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":80384000,"data_stored":94490769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":82804736,"data_stored":92139987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":34246656,"data_stored":38301735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":81575936,"data_stored":90758618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:11:48.188 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:11:48.189 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:48.185+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:48.211 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:48.211 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:48.211 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:48.211 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:48.211 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:48.225 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:11:48.290 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:48.288+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:48.323 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:48.324 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:48.324 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:48.324 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [] 2024-09-13T05:11:48.324 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:48.333 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:11:48.391 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:48.388+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:48.471 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:48.472 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:48.472 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.472 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118395 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.472 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393453+0000", 2024-09-13T05:11:48.472 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.056546522000000002, 2024-09-13T05:11:48.472 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.056575603000000002, 2024-09-13T05:11:48.472 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.472 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.472 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.472 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.472 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.472 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118395 2024-09-13T05:11:48.473 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.473 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.473 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.473 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.473 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393453+0000", 2024-09-13T05:11:48.473 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.473 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.473 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.473 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.473 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393453+0000", 2024-09-13T05:11:48.473 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.473 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.473 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.473 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.474 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393452+0000", 2024-09-13T05:11:48.474 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.474 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.474 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.474 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.474 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393455+0000", 2024-09-13T05:11:48.474 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6740000000000001e-06 2024-09-13T05:11:48.474 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.474 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.474 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.474 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393460+0000", 2024-09-13T05:11:48.474 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5860000000000004e-06 2024-09-13T05:11:48.474 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.474 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.475 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.475 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393465+0000", 2024-09-13T05:11:48.475 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7140000000000001e-06 2024-09-13T05:11:48.475 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.475 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.475 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.475 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.475 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.475 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118464 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.475 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.401214+0000", 2024-09-13T05:11:48.475 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.048785042000000001, 2024-09-13T05:11:48.475 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048899447999999998, 2024-09-13T05:11:48.475 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.475 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.476 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.476 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.476 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.476 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118464 2024-09-13T05:11:48.476 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.476 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.476 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.476 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.476 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401214+0000", 2024-09-13T05:11:48.476 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.476 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.476 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.476 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.476 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401214+0000", 2024-09-13T05:11:48.477 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.477 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.477 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.477 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.477 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401214+0000", 2024-09-13T05:11:48.477 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.477 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.477 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.477 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.477 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401216+0000", 2024-09-13T05:11:48.477 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5979999999999999e-06 2024-09-13T05:11:48.477 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.477 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.477 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.478 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401222+0000", 2024-09-13T05:11:48.478 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3530000000000002e-06 2024-09-13T05:11:48.478 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.478 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.478 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.478 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401226+0000", 2024-09-13T05:11:48.478 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8119999999999998e-06 2024-09-13T05:11:48.478 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.478 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.478 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.478 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.478 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.478 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118496 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.478 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.405376+0000", 2024-09-13T05:11:48.478 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.044622820000000001, 2024-09-13T05:11:48.479 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.044792222999999999, 2024-09-13T05:11:48.479 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.479 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.479 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.479 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.479 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.479 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118496 2024-09-13T05:11:48.479 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.479 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.479 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.479 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.479 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405376+0000", 2024-09-13T05:11:48.479 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.479 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.480 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.480 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.480 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405376+0000", 2024-09-13T05:11:48.480 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.480 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.480 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.480 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.480 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405376+0000", 2024-09-13T05:11:48.480 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:48.480 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.480 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.480 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.480 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405378+0000", 2024-09-13T05:11:48.481 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4169999999999999e-06 2024-09-13T05:11:48.481 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.481 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.481 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.481 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405380+0000", 2024-09-13T05:11:48.481 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.689e-06 2024-09-13T05:11:48.481 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.481 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.481 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.481 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405383+0000", 2024-09-13T05:11:48.481 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6690000000000002e-06 2024-09-13T05:11:48.481 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.481 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.482 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.482 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.482 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.482 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118528 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.482 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.413589+0000", 2024-09-13T05:11:48.482 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.036409839999999999, 2024-09-13T05:11:48.482 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036632752999999997, 2024-09-13T05:11:48.482 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.482 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.482 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.482 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.482 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.482 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118528 2024-09-13T05:11:48.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.483 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.483 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.483 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.483 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413589+0000", 2024-09-13T05:11:48.483 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.483 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.483 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.483 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413589+0000", 2024-09-13T05:11:48.483 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.483 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.484 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.484 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413589+0000", 2024-09-13T05:11:48.484 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.484 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.484 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.484 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.484 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413592+0000", 2024-09-13T05:11:48.484 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5949999999999999e-06 2024-09-13T05:11:48.484 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.484 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.484 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.484 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413608+0000", 2024-09-13T05:11:48.484 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5647000000000001e-05 2024-09-13T05:11:48.484 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.485 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.485 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.485 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413616+0000", 2024-09-13T05:11:48.485 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.3659999999999992e-06 2024-09-13T05:11:48.485 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.485 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.485 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.485 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.485 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.485 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118560 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.485 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.421544+0000", 2024-09-13T05:11:48.485 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.028455662999999999, 2024-09-13T05:11:48.485 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.028731059, 2024-09-13T05:11:48.485 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.486 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.486 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.486 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.486 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.486 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118560 2024-09-13T05:11:48.486 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.486 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.486 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.486 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.486 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421544+0000", 2024-09-13T05:11:48.486 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.486 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.486 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.487 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.487 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421544+0000", 2024-09-13T05:11:48.487 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.487 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.487 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.487 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.487 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421543+0000", 2024-09-13T05:11:48.487 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.487 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.487 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.487 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.487 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421546+0000", 2024-09-13T05:11:48.487 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1300000000000001e-06 2024-09-13T05:11:48.488 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.488 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.488 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.488 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421554+0000", 2024-09-13T05:11:48.488 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1370000000000002e-06 2024-09-13T05:11:48.488 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.488 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.488 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.488 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421561+0000", 2024-09-13T05:11:48.488 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8299999999999998e-06 2024-09-13T05:11:48.488 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.488 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.488 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.488 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.489 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.489 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118593 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.489 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.433197+0000", 2024-09-13T05:11:48.489 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.016802493000000002, 2024-09-13T05:11:48.489 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.017133638999999999, 2024-09-13T05:11:48.489 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.489 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.489 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.489 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.489 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.489 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118593 2024-09-13T05:11:48.489 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.489 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.490 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.490 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.490 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433197+0000", 2024-09-13T05:11:48.490 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.490 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.490 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.490 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.490 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433197+0000", 2024-09-13T05:11:48.490 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.490 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.490 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.490 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.490 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433196+0000", 2024-09-13T05:11:48.490 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:48.491 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.491 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.491 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.491 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433199+0000", 2024-09-13T05:11:48.491 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1609999999999999e-06 2024-09-13T05:11:48.491 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.491 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.491 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.491 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433211+0000", 2024-09-13T05:11:48.491 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2310000000000001e-05 2024-09-13T05:11:48.491 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.491 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.491 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.491 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433217+0000", 2024-09-13T05:11:48.491 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4559999999999999e-06 2024-09-13T05:11:48.492 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.492 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.492 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.492 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.492 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.492 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118626 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.492 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.441090+0000", 2024-09-13T05:11:48.492 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0089087390000000006, 2024-09-13T05:11:48.492 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0092923069999999997, 2024-09-13T05:11:48.492 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.492 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.492 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.492 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.492 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.493 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118626 2024-09-13T05:11:48.493 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.493 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.493 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.493 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.493 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441090+0000", 2024-09-13T05:11:48.493 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.493 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.493 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.493 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.493 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441090+0000", 2024-09-13T05:11:48.493 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.493 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.493 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.494 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.494 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441090+0000", 2024-09-13T05:11:48.494 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.494 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.494 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.494 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.494 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441093+0000", 2024-09-13T05:11:48.494 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7140000000000002e-06 2024-09-13T05:11:48.494 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.494 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.494 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.494 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441105+0000", 2024-09-13T05:11:48.494 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2199e-05 2024-09-13T05:11:48.495 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.495 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.495 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.495 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441110+0000", 2024-09-13T05:11:48.495 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.78e-06 2024-09-13T05:11:48.495 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.495 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.495 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.495 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.495 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.495 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118695 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.495 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.449076+0000", 2024-09-13T05:11:48.495 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.00092272999999999997, 2024-09-13T05:11:48.496 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0013606779999999999, 2024-09-13T05:11:48.496 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.496 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.496 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.496 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.496 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.496 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118695 2024-09-13T05:11:48.496 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.496 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.496 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.496 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.496 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449076+0000", 2024-09-13T05:11:48.496 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.496 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.497 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.497 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.497 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449076+0000", 2024-09-13T05:11:48.497 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.497 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.497 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.497 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.497 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449076+0000", 2024-09-13T05:11:48.497 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.497 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.497 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.497 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.497 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449079+0000", 2024-09-13T05:11:48.498 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6800000000000002e-06 2024-09-13T05:11:48.498 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.498 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.498 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.498 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449085+0000", 2024-09-13T05:11:48.498 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8980000000000001e-06 2024-09-13T05:11:48.498 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.498 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.498 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.498 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449090+0000", 2024-09-13T05:11:48.498 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1209999999999998e-06 2024-09-13T05:11:48.498 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.498 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.498 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.499 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.499 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.499 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118433 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.499 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393469+0000", 2024-09-13T05:11:48.499 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.056529909000000003, 2024-09-13T05:11:48.499 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.057021754000000001, 2024-09-13T05:11:48.499 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.499 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.499 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.499 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.499 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.499 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118433 2024-09-13T05:11:48.499 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.500 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.500 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.500 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.500 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393469+0000", 2024-09-13T05:11:48.500 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.500 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.500 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.500 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.500 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393469+0000", 2024-09-13T05:11:48.500 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.500 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.500 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.500 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.501 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393469+0000", 2024-09-13T05:11:48.501 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.501 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.501 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.501 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.501 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393471+0000", 2024-09-13T05:11:48.501 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3350000000000001e-06 2024-09-13T05:11:48.501 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.501 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.501 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.501 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393477+0000", 2024-09-13T05:11:48.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3639999999999998e-06 2024-09-13T05:11:48.502 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.502 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.502 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.502 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393481+0000", 2024-09-13T05:11:48.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6020000000000002e-06 2024-09-13T05:11:48.502 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.502 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.502 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.502 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.502 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.502 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118465 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.503 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.401232+0000", 2024-09-13T05:11:48.503 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.048767656999999999, 2024-09-13T05:11:48.503 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.049314997999999999, 2024-09-13T05:11:48.503 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.503 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.503 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.503 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.503 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.503 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118465 2024-09-13T05:11:48.503 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.503 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.503 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.503 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.504 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401232+0000", 2024-09-13T05:11:48.504 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.504 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.504 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.504 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.504 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401232+0000", 2024-09-13T05:11:48.504 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.504 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.504 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.504 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.504 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401231+0000", 2024-09-13T05:11:48.504 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.504 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.505 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.505 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.505 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401234+0000", 2024-09-13T05:11:48.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5900000000000002e-06 2024-09-13T05:11:48.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.505 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.505 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.505 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401246+0000", 2024-09-13T05:11:48.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2337999999999999e-05 2024-09-13T05:11:48.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.505 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.505 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.505 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401251+0000", 2024-09-13T05:11:48.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6140000000000002e-06 2024-09-13T05:11:48.506 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.506 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.506 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.506 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.506 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118497 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.506 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.405385+0000", 2024-09-13T05:11:48.506 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.044614184000000001, 2024-09-13T05:11:48.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.045213511999999997, 2024-09-13T05:11:48.506 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.506 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.506 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.506 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.507 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.507 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118497 2024-09-13T05:11:48.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.507 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.507 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.507 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405385+0000", 2024-09-13T05:11:48.507 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.507 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.507 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405385+0000", 2024-09-13T05:11:48.507 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.508 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.508 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.508 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.508 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405385+0000", 2024-09-13T05:11:48.508 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:48.508 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.508 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.508 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.508 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405386+0000", 2024-09-13T05:11:48.509 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3519999999999999e-06 2024-09-13T05:11:48.509 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.509 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.509 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.509 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405389+0000", 2024-09-13T05:11:48.509 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7549999999999999e-06 2024-09-13T05:11:48.509 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.509 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.509 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.509 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405392+0000", 2024-09-13T05:11:48.509 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9100000000000001e-06 2024-09-13T05:11:48.509 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.510 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.510 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.510 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.510 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.510 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118529 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.510 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.413623+0000", 2024-09-13T05:11:48.510 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.036376682, 2024-09-13T05:11:48.510 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037027364, 2024-09-13T05:11:48.510 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.510 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.510 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.510 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.510 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.510 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118529 2024-09-13T05:11:48.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.511 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.511 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.511 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.511 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413623+0000", 2024-09-13T05:11:48.511 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.511 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.511 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.511 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413623+0000", 2024-09-13T05:11:48.511 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.511 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.511 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.511 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413622+0000", 2024-09-13T05:11:48.512 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.512 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.512 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.512 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413625+0000", 2024-09-13T05:11:48.512 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2389999999999998e-06 2024-09-13T05:11:48.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.512 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.512 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.512 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413634+0000", 2024-09-13T05:11:48.512 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8340000000000005e-06 2024-09-13T05:11:48.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.512 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.512 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.513 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413642+0000", 2024-09-13T05:11:48.513 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2800000000000003e-06 2024-09-13T05:11:48.513 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.513 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.513 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.513 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.513 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118561 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.513 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.425060+0000", 2024-09-13T05:11:48.513 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.024938947, 2024-09-13T05:11:48.513 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.025641548, 2024-09-13T05:11:48.513 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.513 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.513 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.514 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.514 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.514 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118561 2024-09-13T05:11:48.514 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.514 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.514 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.514 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.514 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425060+0000", 2024-09-13T05:11:48.514 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.514 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.514 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.514 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.514 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425060+0000", 2024-09-13T05:11:48.514 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.515 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.515 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421567+0000", 2024-09-13T05:11:48.515 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9965067 2024-09-13T05:11:48.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.515 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.515 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425065+0000", 2024-09-13T05:11:48.515 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003498564 2024-09-13T05:11:48.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.515 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.516 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425083+0000", 2024-09-13T05:11:48.516 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7563000000000001e-05 2024-09-13T05:11:48.516 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.516 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.516 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.516 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425091+0000", 2024-09-13T05:11:48.516 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8010000000000004e-06 2024-09-13T05:11:48.516 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.516 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.516 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.516 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.516 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.517 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118594 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.517 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.433221+0000", 2024-09-13T05:11:48.517 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.016777772999999999, 2024-09-13T05:11:48.517 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.017532078999999999, 2024-09-13T05:11:48.517 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.517 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.517 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.517 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.517 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.517 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118594 2024-09-13T05:11:48.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.517 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.517 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.518 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433221+0000", 2024-09-13T05:11:48.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.518 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.518 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433221+0000", 2024-09-13T05:11:48.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.518 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.518 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433221+0000", 2024-09-13T05:11:48.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.518 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433224+0000", 2024-09-13T05:11:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0290000000000001e-06 2024-09-13T05:11:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433230+0000", 2024-09-13T05:11:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1190000000000002e-06 2024-09-13T05:11:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433235+0000", 2024-09-13T05:11:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9339999999999997e-06 2024-09-13T05:11:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118627 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.441116+0000", 2024-09-13T05:11:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0088832400000000006, 2024-09-13T05:11:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0096899659999999995, 2024-09-13T05:11:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118627 2024-09-13T05:11:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441116+0000", 2024-09-13T05:11:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441116+0000", 2024-09-13T05:11:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441115+0000", 2024-09-13T05:11:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441118+0000", 2024-09-13T05:11:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7310000000000002e-06 2024-09-13T05:11:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441125+0000", 2024-09-13T05:11:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9240000000000001e-06 2024-09-13T05:11:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441130+0000", 2024-09-13T05:11:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8180000000000003e-06 2024-09-13T05:11:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118696 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.449094+0000", 2024-09-13T05:11:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.00090494700000000002, 2024-09-13T05:11:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0017638269999999999, 2024-09-13T05:11:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118696 2024-09-13T05:11:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449094+0000", 2024-09-13T05:11:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449094+0000", 2024-09-13T05:11:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.525 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.525 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449094+0000", 2024-09-13T05:11:48.525 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.525 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.525 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449096+0000", 2024-09-13T05:11:48.525 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4619999999999999e-06 2024-09-13T05:11:48.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.525 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.525 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449102+0000", 2024-09-13T05:11:48.525 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2140000000000004e-06 2024-09-13T05:11:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449108+0000", 2024-09-13T05:11:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7939999999999997e-06 2024-09-13T05:11:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118434 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393485+0000", 2024-09-13T05:11:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.056513766, 2024-09-13T05:11:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.057425735999999998, 2024-09-13T05:11:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118434 2024-09-13T05:11:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393485+0000", 2024-09-13T05:11:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393485+0000", 2024-09-13T05:11:48.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.528 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.528 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393485+0000", 2024-09-13T05:11:48.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.528 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.528 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393488+0000", 2024-09-13T05:11:48.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8090000000000001e-06 2024-09-13T05:11:48.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393494+0000", 2024-09-13T05:11:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7780000000000004e-06 2024-09-13T05:11:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393498+0000", 2024-09-13T05:11:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.668e-06 2024-09-13T05:11:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118466 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.530 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.401256+0000", 2024-09-13T05:11:48.530 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.048743470999999997, 2024-09-13T05:11:48.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.049708482999999998, 2024-09-13T05:11:48.530 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.530 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.530 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.530 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.530 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.530 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118466 2024-09-13T05:11:48.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.530 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401256+0000", 2024-09-13T05:11:48.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401256+0000", 2024-09-13T05:11:48.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401255+0000", 2024-09-13T05:11:48.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401258+0000", 2024-09-13T05:11:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9459999999999998e-06 2024-09-13T05:11:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401266+0000", 2024-09-13T05:11:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3930000000000002e-06 2024-09-13T05:11:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401270+0000", 2024-09-13T05:11:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5600000000000004e-06 2024-09-13T05:11:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118498 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.405414+0000", 2024-09-13T05:11:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.044585115000000002, 2024-09-13T05:11:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.045606773000000003, 2024-09-13T05:11:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118498 2024-09-13T05:11:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405414+0000", 2024-09-13T05:11:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405414+0000", 2024-09-13T05:11:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.535 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.535 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405414+0000", 2024-09-13T05:11:48.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.535 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.535 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.535 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405416+0000", 2024-09-13T05:11:48.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1849999999999998e-06 2024-09-13T05:11:48.535 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.535 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.535 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405420+0000", 2024-09-13T05:11:48.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4979999999999998e-06 2024-09-13T05:11:48.535 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405422+0000", 2024-09-13T05:11:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6860000000000002e-06 2024-09-13T05:11:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118530 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.413650+0000", 2024-09-13T05:11:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.036349457000000002, 2024-09-13T05:11:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037422934999999997, 2024-09-13T05:11:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118530 2024-09-13T05:11:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413650+0000", 2024-09-13T05:11:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413650+0000", 2024-09-13T05:11:48.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413649+0000", 2024-09-13T05:11:48.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413653+0000", 2024-09-13T05:11:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.371e-06 2024-09-13T05:11:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413668+0000", 2024-09-13T05:11:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5063e-05 2024-09-13T05:11:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413675+0000", 2024-09-13T05:11:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.4490000000000002e-06 2024-09-13T05:11:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118562 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.425119+0000", 2024-09-13T05:11:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.024879839000000001, 2024-09-13T05:11:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.026005515, 2024-09-13T05:11:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118562 2024-09-13T05:11:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.541 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425119+0000", 2024-09-13T05:11:48.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425119+0000", 2024-09-13T05:11:48.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425119+0000", 2024-09-13T05:11:48.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425121+0000", 2024-09-13T05:11:48.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3530000000000002e-06 2024-09-13T05:11:48.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425133+0000", 2024-09-13T05:11:48.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1249e-05 2024-09-13T05:11:48.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425139+0000", 2024-09-13T05:11:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8129999999999998e-06 2024-09-13T05:11:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118595 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.433240+0000", 2024-09-13T05:11:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.016759574999999999, 2024-09-13T05:11:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.017936713999999999, 2024-09-13T05:11:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.544 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.544 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118595 2024-09-13T05:11:48.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.544 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.544 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433240+0000", 2024-09-13T05:11:48.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.544 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433240+0000", 2024-09-13T05:11:48.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.545 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433239+0000", 2024-09-13T05:11:48.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.545 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433242+0000", 2024-09-13T05:11:48.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8310000000000001e-06 2024-09-13T05:11:48.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.545 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433248+0000", 2024-09-13T05:11:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0939999999999996e-06 2024-09-13T05:11:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433254+0000", 2024-09-13T05:11:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4029999999999998e-06 2024-09-13T05:11:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118628 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.441136+0000", 2024-09-13T05:11:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0088636619999999996, 2024-09-13T05:11:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010092373999999999, 2024-09-13T05:11:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118628 2024-09-13T05:11:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441136+0000", 2024-09-13T05:11:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441136+0000", 2024-09-13T05:11:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441135+0000", 2024-09-13T05:11:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441145+0000", 2024-09-13T05:11:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0026e-05 2024-09-13T05:11:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441153+0000", 2024-09-13T05:11:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9200000000000004e-06 2024-09-13T05:11:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441159+0000", 2024-09-13T05:11:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7039999999999999e-06 2024-09-13T05:11:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118697 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.449112+0000", 2024-09-13T05:11:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.00088683700000000002, 2024-09-13T05:11:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002167212, 2024-09-13T05:11:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118697 2024-09-13T05:11:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449112+0000", 2024-09-13T05:11:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449112+0000", 2024-09-13T05:11:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449112+0000", 2024-09-13T05:11:48.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449115+0000", 2024-09-13T05:11:48.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.762e-06 2024-09-13T05:11:48.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449120+0000", 2024-09-13T05:11:48.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4620000000000004e-06 2024-09-13T05:11:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449126+0000", 2024-09-13T05:11:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4530000000000001e-06 2024-09-13T05:11:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118435 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393503+0000", 2024-09-13T05:11:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.056496378999999999, 2024-09-13T05:11:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.057832926, 2024-09-13T05:11:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118435 2024-09-13T05:11:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393503+0000", 2024-09-13T05:11:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393503+0000", 2024-09-13T05:11:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393502+0000", 2024-09-13T05:11:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393505+0000", 2024-09-13T05:11:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4279999999999999e-06 2024-09-13T05:11:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393510+0000", 2024-09-13T05:11:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.04e-06 2024-09-13T05:11:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393515+0000", 2024-09-13T05:11:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6809999999999997e-06 2024-09-13T05:11:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118467 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.401298+0000", 2024-09-13T05:11:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.048700899999999998, 2024-09-13T05:11:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.050089489000000001, 2024-09-13T05:11:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118467 2024-09-13T05:11:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401298+0000", 2024-09-13T05:11:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401298+0000", 2024-09-13T05:11:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401298+0000", 2024-09-13T05:11:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401301+0000", 2024-09-13T05:11:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.236e-06 2024-09-13T05:11:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401307+0000", 2024-09-13T05:11:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0100000000000001e-06 2024-09-13T05:11:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401313+0000", 2024-09-13T05:11:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0170000000000002e-06 2024-09-13T05:11:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118499 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.408981+0000", 2024-09-13T05:11:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.041017968000000002, 2024-09-13T05:11:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.042459255000000001, 2024-09-13T05:11:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118499 2024-09-13T05:11:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.408981+0000", 2024-09-13T05:11:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.408981+0000", 2024-09-13T05:11:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405424+0000", 2024-09-13T05:11:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9964433 2024-09-13T05:11:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.408987+0000", 2024-09-13T05:11:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0035623349999999998 2024-09-13T05:11:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.408997+0000", 2024-09-13T05:11:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0034000000000001e-05 2024-09-13T05:11:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409003+0000", 2024-09-13T05:11:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8299999999999998e-06 2024-09-13T05:11:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118531 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.413687+0000", 2024-09-13T05:11:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.036312613000000001, 2024-09-13T05:11:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037805829999999999, 2024-09-13T05:11:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118531 2024-09-13T05:11:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413687+0000", 2024-09-13T05:11:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413687+0000", 2024-09-13T05:11:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413686+0000", 2024-09-13T05:11:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413690+0000", 2024-09-13T05:11:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7680000000000002e-06 2024-09-13T05:11:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413708+0000", 2024-09-13T05:11:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7929999999999999e-05 2024-09-13T05:11:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413715+0000", 2024-09-13T05:11:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1840000000000002e-06 2024-09-13T05:11:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.567 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118563 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.567 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.425145+0000", 2024-09-13T05:11:48.567 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.024853943, 2024-09-13T05:11:48.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.026398728, 2024-09-13T05:11:48.567 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.567 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.567 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.567 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.567 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.567 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118563 2024-09-13T05:11:48.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.567 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425145+0000", 2024-09-13T05:11:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425145+0000", 2024-09-13T05:11:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425145+0000", 2024-09-13T05:11:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.569 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425148+0000", 2024-09-13T05:11:48.569 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.162e-06 2024-09-13T05:11:48.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.569 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425155+0000", 2024-09-13T05:11:48.569 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9859999999999997e-06 2024-09-13T05:11:48.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.570 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425161+0000", 2024-09-13T05:11:48.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.879e-06 2024-09-13T05:11:48.570 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.570 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.570 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.570 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118596 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.570 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.433258+0000", 2024-09-13T05:11:48.570 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.016741140000000002, 2024-09-13T05:11:48.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.018337155000000001, 2024-09-13T05:11:48.570 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.570 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.571 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.571 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.571 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.571 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118596 2024-09-13T05:11:48.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.571 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.571 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.571 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.571 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433258+0000", 2024-09-13T05:11:48.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.571 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.571 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433258+0000", 2024-09-13T05:11:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433258+0000", 2024-09-13T05:11:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433265+0000", 2024-09-13T05:11:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.4120000000000004e-06 2024-09-13T05:11:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.573 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.573 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433271+0000", 2024-09-13T05:11:48.573 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2770000000000002e-06 2024-09-13T05:11:48.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.573 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.573 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433277+0000", 2024-09-13T05:11:48.573 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7010000000000001e-06 2024-09-13T05:11:48.573 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.573 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.573 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.573 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118629 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.574 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.441163+0000", 2024-09-13T05:11:48.574 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0088359969999999999, 2024-09-13T05:11:48.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010484706999999999, 2024-09-13T05:11:48.574 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.574 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.574 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.574 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.574 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.574 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118629 2024-09-13T05:11:48.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.574 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.574 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.575 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.575 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441163+0000", 2024-09-13T05:11:48.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.575 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.575 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441163+0000", 2024-09-13T05:11:48.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.575 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.575 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441163+0000", 2024-09-13T05:11:48.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.576 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.576 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441165+0000", 2024-09-13T05:11:48.576 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4480000000000001e-06 2024-09-13T05:11:48.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.576 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.576 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.576 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441171+0000", 2024-09-13T05:11:48.576 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0920000000000003e-06 2024-09-13T05:11:48.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.576 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.576 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.576 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441177+0000", 2024-09-13T05:11:48.576 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0419999999999999e-06 2024-09-13T05:11:48.577 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.577 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.577 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.577 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.577 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118698 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.577 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.449130+0000", 2024-09-13T05:11:48.577 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.00086936499999999998, 2024-09-13T05:11:48.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025699849999999999, 2024-09-13T05:11:48.577 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.577 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.577 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.577 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.577 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.578 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118698 2024-09-13T05:11:48.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.578 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.578 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449130+0000", 2024-09-13T05:11:48.578 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.578 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449130+0000", 2024-09-13T05:11:48.578 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449129+0000", 2024-09-13T05:11:48.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449132+0000", 2024-09-13T05:11:48.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.773e-06 2024-09-13T05:11:48.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449138+0000", 2024-09-13T05:11:48.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2129999999999996e-06 2024-09-13T05:11:48.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449143+0000", 2024-09-13T05:11:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9840000000000001e-06 2024-09-13T05:11:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118436 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393520+0000", 2024-09-13T05:11:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.056478935000000001, 2024-09-13T05:11:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.058231194, 2024-09-13T05:11:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118436 2024-09-13T05:11:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393520+0000", 2024-09-13T05:11:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393520+0000", 2024-09-13T05:11:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393520+0000", 2024-09-13T05:11:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393523+0000", 2024-09-13T05:11:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6220000000000001e-06 2024-09-13T05:11:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393528+0000", 2024-09-13T05:11:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5339999999999999e-06 2024-09-13T05:11:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393533+0000", 2024-09-13T05:11:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8060000000000002e-06 2024-09-13T05:11:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118468 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.401317+0000", 2024-09-13T05:11:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.048682159000000003, 2024-09-13T05:11:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.050486929999999999, 2024-09-13T05:11:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118468 2024-09-13T05:11:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401317+0000", 2024-09-13T05:11:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401317+0000", 2024-09-13T05:11:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401317+0000", 2024-09-13T05:11:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401319+0000", 2024-09-13T05:11:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6460000000000002e-06 2024-09-13T05:11:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401324+0000", 2024-09-13T05:11:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1839999999999998e-06 2024-09-13T05:11:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401329+0000", 2024-09-13T05:11:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5879999999999999e-06 2024-09-13T05:11:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118500 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.409025+0000", 2024-09-13T05:11:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.040974472999999997, 2024-09-13T05:11:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.042830768999999998, 2024-09-13T05:11:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118500 2024-09-13T05:11:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409025+0000", 2024-09-13T05:11:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409025+0000", 2024-09-13T05:11:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409024+0000", 2024-09-13T05:11:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409026+0000", 2024-09-13T05:11:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0320000000000002e-06 2024-09-13T05:11:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409036+0000", 2024-09-13T05:11:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4369999999999996e-06 2024-09-13T05:11:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409039+0000", 2024-09-13T05:11:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0029999999999999e-06 2024-09-13T05:11:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118532 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.413745+0000", 2024-09-13T05:11:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.036254244999999997, 2024-09-13T05:11:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038219897000000003, 2024-09-13T05:11:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118532 2024-09-13T05:11:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413745+0000", 2024-09-13T05:11:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413745+0000", 2024-09-13T05:11:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413744+0000", 2024-09-13T05:11:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413748+0000", 2024-09-13T05:11:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8929999999999998e-06 2024-09-13T05:11:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413769+0000", 2024-09-13T05:11:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0899000000000001e-05 2024-09-13T05:11:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413776+0000", 2024-09-13T05:11:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2189999999999998e-06 2024-09-13T05:11:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118564 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.425165+0000", 2024-09-13T05:11:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.024833744000000001, 2024-09-13T05:11:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.026851788000000001, 2024-09-13T05:11:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118564 2024-09-13T05:11:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425165+0000", 2024-09-13T05:11:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425165+0000", 2024-09-13T05:11:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425165+0000", 2024-09-13T05:11:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425168+0000", 2024-09-13T05:11:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8890000000000002e-06 2024-09-13T05:11:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425174+0000", 2024-09-13T05:11:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1009999999999997e-06 2024-09-13T05:11:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425179+0000", 2024-09-13T05:11:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1170000000000003e-06 2024-09-13T05:11:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118597 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.433283+0000", 2024-09-13T05:11:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.016716117999999999, 2024-09-13T05:11:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.018789921000000001, 2024-09-13T05:11:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118597 2024-09-13T05:11:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433283+0000", 2024-09-13T05:11:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433283+0000", 2024-09-13T05:11:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433283+0000", 2024-09-13T05:11:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433285+0000", 2024-09-13T05:11:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7530000000000002e-06 2024-09-13T05:11:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433292+0000", 2024-09-13T05:11:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8299999999999998e-06 2024-09-13T05:11:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433298+0000", 2024-09-13T05:11:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4260000000000002e-06 2024-09-13T05:11:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118630 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.441182+0000", 2024-09-13T05:11:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0088176420000000005, 2024-09-13T05:11:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010942486, 2024-09-13T05:11:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118630 2024-09-13T05:11:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.601 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.601 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.601 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441182+0000", 2024-09-13T05:11:48.601 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.601 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.601 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.601 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441182+0000", 2024-09-13T05:11:48.601 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.601 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.601 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.601 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441181+0000", 2024-09-13T05:11:48.601 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441184+0000", 2024-09-13T05:11:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4569999999999999e-06 2024-09-13T05:11:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441189+0000", 2024-09-13T05:11:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4349999999999996e-06 2024-09-13T05:11:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441194+0000", 2024-09-13T05:11:48.603 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7029999999999997e-06 2024-09-13T05:11:48.603 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.603 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.603 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.603 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.603 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.603 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118699 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.603 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.449147+0000", 2024-09-13T05:11:48.603 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.00085181000000000005, 2024-09-13T05:11:48.603 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0030309130000000001, 2024-09-13T05:11:48.603 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.603 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.603 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.603 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.603 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118699 2024-09-13T05:11:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449147+0000", 2024-09-13T05:11:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449147+0000", 2024-09-13T05:11:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.605 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.605 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449147+0000", 2024-09-13T05:11:48.605 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.605 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.605 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449150+0000", 2024-09-13T05:11:48.605 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5749999999999999e-06 2024-09-13T05:11:48.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.605 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.605 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449155+0000", 2024-09-13T05:11:48.605 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1159999999999998e-06 2024-09-13T05:11:48.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449160+0000", 2024-09-13T05:11:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9269999999999996e-06 2024-09-13T05:11:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118437 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393561+0000", 2024-09-13T05:11:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.056438490000000001, 2024-09-13T05:11:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.058671289000000001, 2024-09-13T05:11:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.607 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.607 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.607 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.607 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.607 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118437 2024-09-13T05:11:48.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.607 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.607 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.607 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393561+0000", 2024-09-13T05:11:48.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.607 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.608 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393561+0000", 2024-09-13T05:11:48.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.608 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.608 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393560+0000", 2024-09-13T05:11:48.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.608 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.608 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393573+0000", 2024-09-13T05:11:48.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2893e-05 2024-09-13T05:11:48.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393588+0000", 2024-09-13T05:11:48.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4810000000000001e-05 2024-09-13T05:11:48.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393593+0000", 2024-09-13T05:11:48.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4829999999999999e-06 2024-09-13T05:11:48.609 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.609 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.609 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.609 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118469 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.610 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.401333+0000", 2024-09-13T05:11:48.610 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.048666421000000001, 2024-09-13T05:11:48.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.050954105999999999, 2024-09-13T05:11:48.610 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.610 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.610 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.610 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.610 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.610 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118469 2024-09-13T05:11:48.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.610 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401333+0000", 2024-09-13T05:11:48.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401333+0000", 2024-09-13T05:11:48.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401332+0000", 2024-09-13T05:11:48.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401335+0000", 2024-09-13T05:11:48.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.294e-06 2024-09-13T05:11:48.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401340+0000", 2024-09-13T05:11:48.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0479999999999998e-06 2024-09-13T05:11:48.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401344+0000", 2024-09-13T05:11:48.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4780000000000002e-06 2024-09-13T05:11:48.612 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.612 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.612 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.613 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118501 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.613 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.409041+0000", 2024-09-13T05:11:48.613 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.040957741999999998, 2024-09-13T05:11:48.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.043297117000000003, 2024-09-13T05:11:48.613 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.613 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.613 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.613 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.613 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.613 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118501 2024-09-13T05:11:48.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.613 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409041+0000", 2024-09-13T05:11:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409041+0000", 2024-09-13T05:11:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409041+0000", 2024-09-13T05:11:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409043+0000", 2024-09-13T05:11:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.75e-06 2024-09-13T05:11:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409046+0000", 2024-09-13T05:11:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9840000000000001e-06 2024-09-13T05:11:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409049+0000", 2024-09-13T05:11:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7690000000000001e-06 2024-09-13T05:11:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118533 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.413782+0000", 2024-09-13T05:11:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.036216871999999997, 2024-09-13T05:11:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038610685999999998, 2024-09-13T05:11:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118533 2024-09-13T05:11:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413782+0000", 2024-09-13T05:11:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413782+0000", 2024-09-13T05:11:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.618 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.618 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413782+0000", 2024-09-13T05:11:48.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.618 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.618 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413785+0000", 2024-09-13T05:11:48.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4359999999999998e-06 2024-09-13T05:11:48.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.618 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.618 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413799+0000", 2024-09-13T05:11:48.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3709999999999999e-05 2024-09-13T05:11:48.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413806+0000", 2024-09-13T05:11:48.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7209999999999997e-06 2024-09-13T05:11:48.619 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.619 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.619 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.619 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118565 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.619 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.425184+0000", 2024-09-13T05:11:48.619 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.024815185999999999, 2024-09-13T05:11:48.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.027260703000000001, 2024-09-13T05:11:48.619 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.620 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.620 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.620 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.620 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.620 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118565 2024-09-13T05:11:48.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.620 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425184+0000", 2024-09-13T05:11:48.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425184+0000", 2024-09-13T05:11:48.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425184+0000", 2024-09-13T05:11:48.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425186+0000", 2024-09-13T05:11:48.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.632e-06 2024-09-13T05:11:48.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425193+0000", 2024-09-13T05:11:48.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9349999999999997e-06 2024-09-13T05:11:48.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425200+0000", 2024-09-13T05:11:48.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7190000000000004e-06 2024-09-13T05:11:48.622 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.622 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.622 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.622 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118598 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.622 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.433302+0000", 2024-09-13T05:11:48.623 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.016696814000000001, 2024-09-13T05:11:48.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019193407999999999, 2024-09-13T05:11:48.623 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.623 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.623 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.623 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.623 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.623 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118598 2024-09-13T05:11:48.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.623 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433302+0000", 2024-09-13T05:11:48.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433302+0000", 2024-09-13T05:11:48.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433302+0000", 2024-09-13T05:11:48.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433305+0000", 2024-09-13T05:11:48.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6290000000000002e-06 2024-09-13T05:11:48.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433311+0000", 2024-09-13T05:11:48.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0310000000000004e-06 2024-09-13T05:11:48.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433316+0000", 2024-09-13T05:11:48.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8860000000000003e-06 2024-09-13T05:11:48.625 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.625 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.625 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.626 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.626 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118631 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.626 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.441198+0000", 2024-09-13T05:11:48.626 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0088015309999999996, 2024-09-13T05:11:48.626 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.011352027000000001, 2024-09-13T05:11:48.626 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.626 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.626 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.626 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.626 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.626 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118631 2024-09-13T05:11:48.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.626 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.627 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.627 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441198+0000", 2024-09-13T05:11:48.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.627 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.627 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441198+0000", 2024-09-13T05:11:48.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.627 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.627 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441197+0000", 2024-09-13T05:11:48.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.628 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.628 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441200+0000", 2024-09-13T05:11:48.628 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3690000000000001e-06 2024-09-13T05:11:48.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.628 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.628 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441205+0000", 2024-09-13T05:11:48.628 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.626e-06 2024-09-13T05:11:48.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.628 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.628 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441210+0000", 2024-09-13T05:11:48.628 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8359999999999999e-06 2024-09-13T05:11:48.629 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.629 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.629 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.629 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118700 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.629 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.449164+0000", 2024-09-13T05:11:48.629 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.00083551999999999997, 2024-09-13T05:11:48.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0034386379999999999, 2024-09-13T05:11:48.629 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.629 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.629 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.629 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.629 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.630 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118700 2024-09-13T05:11:48.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.630 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.630 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.630 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449164+0000", 2024-09-13T05:11:48.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.630 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.630 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449164+0000", 2024-09-13T05:11:48.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.631 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.631 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.631 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449163+0000", 2024-09-13T05:11:48.631 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.631 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.631 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.631 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449166+0000", 2024-09-13T05:11:48.631 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5509999999999998e-06 2024-09-13T05:11:48.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.631 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.631 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.631 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449171+0000", 2024-09-13T05:11:48.631 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2429999999999996e-06 2024-09-13T05:11:48.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.632 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.632 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449176+0000", 2024-09-13T05:11:48.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8219999999999997e-06 2024-09-13T05:11:48.632 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.632 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.632 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.632 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118438 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.632 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.397052+0000", 2024-09-13T05:11:48.632 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.052947186, 2024-09-13T05:11:48.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.055604742999999998, 2024-09-13T05:11:48.632 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.633 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.633 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.633 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.633 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.633 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118438 2024-09-13T05:11:48.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.633 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.633 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.633 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397052+0000", 2024-09-13T05:11:48.633 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.633 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.634 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397052+0000", 2024-09-13T05:11:48.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.634 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.634 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393598+0000", 2024-09-13T05:11:48.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9965458 2024-09-13T05:11:48.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.634 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.634 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397060+0000", 2024-09-13T05:11:48.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003461801 2024-09-13T05:11:48.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.635 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.635 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397077+0000", 2024-09-13T05:11:48.635 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7688000000000001e-05 2024-09-13T05:11:48.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.635 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.635 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.635 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397088+0000", 2024-09-13T05:11:48.635 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0448000000000001e-05 2024-09-13T05:11:48.635 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.635 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.635 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.635 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.635 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118470 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.635 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.401348+0000", 2024-09-13T05:11:48.636 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.048651261000000001, 2024-09-13T05:11:48.636 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.051362639000000002, 2024-09-13T05:11:48.636 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.636 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.636 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.636 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.636 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.636 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118470 2024-09-13T05:11:48.636 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.636 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.636 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.636 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.636 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401348+0000", 2024-09-13T05:11:48.636 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.637 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.637 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.637 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401348+0000", 2024-09-13T05:11:48.637 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.637 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.637 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.637 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401348+0000", 2024-09-13T05:11:48.637 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.637 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.637 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.637 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401350+0000", 2024-09-13T05:11:48.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5799999999999999e-06 2024-09-13T05:11:48.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401355+0000", 2024-09-13T05:11:48.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1039999999999998e-06 2024-09-13T05:11:48.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401360+0000", 2024-09-13T05:11:48.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5140000000000003e-06 2024-09-13T05:11:48.638 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.638 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.638 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.639 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.639 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118502 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.639 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.409051+0000", 2024-09-13T05:11:48.639 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.040948195, 2024-09-13T05:11:48.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.043714547999999999, 2024-09-13T05:11:48.639 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.639 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.639 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.639 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.639 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.639 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118502 2024-09-13T05:11:48.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.639 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.639 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.640 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.640 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409051+0000", 2024-09-13T05:11:48.640 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.640 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.640 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.640 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.640 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409051+0000", 2024-09-13T05:11:48.640 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.640 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.640 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.640 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.640 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409051+0000", 2024-09-13T05:11:48.640 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.640 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409052+0000", 2024-09-13T05:11:48.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.505e-06 2024-09-13T05:11:48.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409055+0000", 2024-09-13T05:11:48.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7590000000000002e-06 2024-09-13T05:11:48.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409058+0000", 2024-09-13T05:11:48.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6220000000000001e-06 2024-09-13T05:11:48.642 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.642 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.642 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.642 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118534 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.642 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.417009+0000", 2024-09-13T05:11:48.642 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.032989734999999999, 2024-09-13T05:11:48.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035807973, 2024-09-13T05:11:48.642 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.642 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.642 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.642 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.642 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.643 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118534 2024-09-13T05:11:48.643 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.643 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.643 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.643 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.643 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417009+0000", 2024-09-13T05:11:48.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.643 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.643 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.643 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.643 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417009+0000", 2024-09-13T05:11:48.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.643 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.643 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.644 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.644 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413810+0000", 2024-09-13T05:11:48.644 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9968004 2024-09-13T05:11:48.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.644 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.644 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.644 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417020+0000", 2024-09-13T05:11:48.644 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0032105810000000001 2024-09-13T05:11:48.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.644 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.644 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.644 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417033+0000", 2024-09-13T05:11:48.644 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2322e-05 2024-09-13T05:11:48.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.645 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417042+0000", 2024-09-13T05:11:48.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4979999999999995e-06 2024-09-13T05:11:48.645 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.645 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.645 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.645 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118566 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.645 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.425205+0000", 2024-09-13T05:11:48.645 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.024794545000000001, 2024-09-13T05:11:48.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.027666982, 2024-09-13T05:11:48.646 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.646 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.646 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.646 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.646 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.646 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118566 2024-09-13T05:11:48.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.646 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.646 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.646 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.646 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425205+0000", 2024-09-13T05:11:48.646 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.646 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.647 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.647 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425205+0000", 2024-09-13T05:11:48.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.647 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.647 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425204+0000", 2024-09-13T05:11:48.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.647 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.647 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425207+0000", 2024-09-13T05:11:48.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7159999999999999e-06 2024-09-13T05:11:48.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.648 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.648 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.648 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425213+0000", 2024-09-13T05:11:48.648 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9880000000000001e-06 2024-09-13T05:11:48.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.648 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.648 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.648 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425220+0000", 2024-09-13T05:11:48.648 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9029999999999998e-06 2024-09-13T05:11:48.648 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.648 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.648 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.648 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.649 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118599 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.649 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.433321+0000", 2024-09-13T05:11:48.649 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.016678011999999999, 2024-09-13T05:11:48.649 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019603274, 2024-09-13T05:11:48.649 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.649 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.649 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.649 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.649 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.649 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118599 2024-09-13T05:11:48.649 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.649 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.649 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.649 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.650 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433321+0000", 2024-09-13T05:11:48.650 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.650 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.650 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.650 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.650 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433321+0000", 2024-09-13T05:11:48.650 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.650 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.650 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.650 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.650 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433321+0000", 2024-09-13T05:11:48.650 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.650 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.650 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.651 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.651 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433323+0000", 2024-09-13T05:11:48.651 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6350000000000002e-06 2024-09-13T05:11:48.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.651 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.651 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.651 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433329+0000", 2024-09-13T05:11:48.651 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0360000000000003e-06 2024-09-13T05:11:48.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.651 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.651 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.651 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433335+0000", 2024-09-13T05:11:48.651 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3079999999999998e-06 2024-09-13T05:11:48.651 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.652 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.652 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.652 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.652 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.652 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118632 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.652 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.441214+0000", 2024-09-13T05:11:48.652 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.008784966, 2024-09-13T05:11:48.652 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.01178889, 2024-09-13T05:11:48.652 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.652 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.652 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.652 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.652 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.653 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118632 2024-09-13T05:11:48.653 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.653 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.653 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.653 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.653 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441214+0000", 2024-09-13T05:11:48.653 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.653 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.653 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.653 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.653 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441214+0000", 2024-09-13T05:11:48.653 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.653 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.653 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.654 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.654 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441214+0000", 2024-09-13T05:11:48.654 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.654 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.654 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.654 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441217+0000", 2024-09-13T05:11:48.654 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7379999999999999e-06 2024-09-13T05:11:48.654 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.654 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.654 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441222+0000", 2024-09-13T05:11:48.654 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0930000000000002e-06 2024-09-13T05:11:48.654 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.655 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.655 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441226+0000", 2024-09-13T05:11:48.655 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6569999999999996e-06 2024-09-13T05:11:48.655 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.655 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.655 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.655 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.655 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.655 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118701 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.655 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.449182+0000", 2024-09-13T05:11:48.655 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.00081769000000000004, 2024-09-13T05:11:48.655 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0038738129999999998, 2024-09-13T05:11:48.655 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.655 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.656 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.656 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.656 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.656 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118701 2024-09-13T05:11:48.656 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.656 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.656 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.656 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.656 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449182+0000", 2024-09-13T05:11:48.656 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.656 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.656 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.656 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.656 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449182+0000", 2024-09-13T05:11:48.656 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.657 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.657 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.657 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.657 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449181+0000", 2024-09-13T05:11:48.657 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.657 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.657 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.657 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.657 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449184+0000", 2024-09-13T05:11:48.657 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4889999999999998e-06 2024-09-13T05:11:48.657 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.657 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.657 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.657 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449189+0000", 2024-09-13T05:11:48.658 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3190000000000002e-06 2024-09-13T05:11:48.658 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.658 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.658 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.658 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449194+0000", 2024-09-13T05:11:48.658 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.758e-06 2024-09-13T05:11:48.658 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.658 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.658 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.658 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.658 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.658 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118439 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.658 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.397097+0000", 2024-09-13T05:11:48.659 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.052902448999999997, 2024-09-13T05:11:48.659 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.056014205999999997, 2024-09-13T05:11:48.659 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.659 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.659 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.659 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.659 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.659 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118439 2024-09-13T05:11:48.659 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.659 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.659 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.659 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.659 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397097+0000", 2024-09-13T05:11:48.660 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.660 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.660 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.660 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.660 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397097+0000", 2024-09-13T05:11:48.660 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.660 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.660 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.660 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.660 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397096+0000", 2024-09-13T05:11:48.660 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.660 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.660 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.660 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.661 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397100+0000", 2024-09-13T05:11:48.661 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4400000000000001e-06 2024-09-13T05:11:48.661 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.661 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.661 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.661 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397114+0000", 2024-09-13T05:11:48.661 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4139e-05 2024-09-13T05:11:48.661 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.661 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.661 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.661 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397120+0000", 2024-09-13T05:11:48.661 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0739999999999998e-06 2024-09-13T05:11:48.661 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.661 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.662 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.662 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.662 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.662 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118471 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.662 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.401364+0000", 2024-09-13T05:11:48.662 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.048635638000000002, 2024-09-13T05:11:48.662 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.051799181999999999, 2024-09-13T05:11:48.662 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.662 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.662 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.662 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.662 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.662 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118471 2024-09-13T05:11:48.662 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.662 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.663 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.663 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.663 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401364+0000", 2024-09-13T05:11:48.663 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.663 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.663 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.663 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.663 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401364+0000", 2024-09-13T05:11:48.663 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.663 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.663 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.663 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.663 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401363+0000", 2024-09-13T05:11:48.663 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.664 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.664 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.664 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.664 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401366+0000", 2024-09-13T05:11:48.664 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.576e-06 2024-09-13T05:11:48.664 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.664 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.664 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.664 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401371+0000", 2024-09-13T05:11:48.664 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0980000000000001e-06 2024-09-13T05:11:48.664 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.664 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.664 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.664 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401375+0000", 2024-09-13T05:11:48.665 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3760000000000001e-06 2024-09-13T05:11:48.665 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.665 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.665 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.665 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.665 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.665 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118503 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.665 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.409060+0000", 2024-09-13T05:11:48.665 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.040939641999999998, 2024-09-13T05:11:48.665 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.044155825000000003, 2024-09-13T05:11:48.665 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.665 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.665 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.665 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.666 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.666 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118503 2024-09-13T05:11:48.666 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.666 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.666 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.666 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.666 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409060+0000", 2024-09-13T05:11:48.666 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.667 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.667 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.668 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.668 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409060+0000", 2024-09-13T05:11:48.668 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.668 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.668 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.668 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.668 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409059+0000", 2024-09-13T05:11:48.668 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:48.668 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.668 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.668 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.668 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409061+0000", 2024-09-13T05:11:48.668 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3790000000000001e-06 2024-09-13T05:11:48.668 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.669 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.669 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.669 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409063+0000", 2024-09-13T05:11:48.669 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7439999999999999e-06 2024-09-13T05:11:48.669 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.669 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.669 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.669 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409067+0000", 2024-09-13T05:11:48.669 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7000000000000002e-06 2024-09-13T05:11:48.669 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.669 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.669 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.669 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.669 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.670 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118535 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.670 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.417071+0000", 2024-09-13T05:11:48.670 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.032928447, 2024-09-13T05:11:48.670 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036199614999999997, 2024-09-13T05:11:48.670 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.670 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.670 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.670 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.670 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.670 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118535 2024-09-13T05:11:48.670 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.670 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.670 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.670 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.671 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417071+0000", 2024-09-13T05:11:48.671 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.671 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.671 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.671 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417071+0000", 2024-09-13T05:11:48.671 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.671 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.671 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.671 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417070+0000", 2024-09-13T05:11:48.671 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.671 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.671 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.672 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417074+0000", 2024-09-13T05:11:48.672 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7419999999999999e-06 2024-09-13T05:11:48.672 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.672 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.672 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.672 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417080+0000", 2024-09-13T05:11:48.672 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9850000000000003e-06 2024-09-13T05:11:48.672 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.672 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.672 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.672 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417087+0000", 2024-09-13T05:11:48.672 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3089999999999998e-06 2024-09-13T05:11:48.672 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.672 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.673 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.673 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.673 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118567 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.673 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.425225+0000", 2024-09-13T05:11:48.673 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.024774506000000002, 2024-09-13T05:11:48.673 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.028097437999999999, 2024-09-13T05:11:48.673 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.673 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.673 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.673 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.673 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.673 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118567 2024-09-13T05:11:48.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.673 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.674 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.674 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.674 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425225+0000", 2024-09-13T05:11:48.674 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.674 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.674 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.674 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.674 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425225+0000", 2024-09-13T05:11:48.674 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.674 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.674 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.674 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.674 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425224+0000", 2024-09-13T05:11:48.675 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.675 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.675 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.675 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.675 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425227+0000", 2024-09-13T05:11:48.675 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6259999999999999e-06 2024-09-13T05:11:48.675 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.675 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.675 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.675 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425233+0000", 2024-09-13T05:11:48.675 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2570000000000004e-06 2024-09-13T05:11:48.675 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.675 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.675 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.676 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425239+0000", 2024-09-13T05:11:48.676 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2730000000000002e-06 2024-09-13T05:11:48.676 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.676 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.676 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.676 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.676 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.676 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118600 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.676 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.433339+0000", 2024-09-13T05:11:48.676 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.016659809000000001, 2024-09-13T05:11:48.676 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020036687000000001, 2024-09-13T05:11:48.676 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.676 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.676 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.677 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.677 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.677 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118600 2024-09-13T05:11:48.677 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.677 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.677 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.677 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.677 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433339+0000", 2024-09-13T05:11:48.677 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.677 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.677 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.677 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.677 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433339+0000", 2024-09-13T05:11:48.677 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.677 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.678 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.678 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433339+0000", 2024-09-13T05:11:48.678 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.678 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.678 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.678 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433342+0000", 2024-09-13T05:11:48.678 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7609999999999999e-06 2024-09-13T05:11:48.678 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.678 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.678 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433348+0000", 2024-09-13T05:11:48.678 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9279999999999998e-06 2024-09-13T05:11:48.679 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.679 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.679 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.679 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433353+0000", 2024-09-13T05:11:48.679 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9540000000000003e-06 2024-09-13T05:11:48.679 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.679 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.679 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.679 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.679 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.679 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118633 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.679 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.441232+0000", 2024-09-13T05:11:48.679 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0087675619999999996, 2024-09-13T05:11:48.679 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012195965, 2024-09-13T05:11:48.680 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.680 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.680 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.680 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.680 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.680 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118633 2024-09-13T05:11:48.680 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.680 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.680 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.680 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.680 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441232+0000", 2024-09-13T05:11:48.680 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.680 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.680 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.681 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441232+0000", 2024-09-13T05:11:48.681 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.681 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.681 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441231+0000", 2024-09-13T05:11:48.681 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.681 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.681 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441238+0000", 2024-09-13T05:11:48.681 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5209999999999999e-06 2024-09-13T05:11:48.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.682 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.682 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441243+0000", 2024-09-13T05:11:48.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5480000000000001e-06 2024-09-13T05:11:48.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.682 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.682 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441248+0000", 2024-09-13T05:11:48.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9010000000000002e-06 2024-09-13T05:11:48.682 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.682 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.682 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.682 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118702 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.683 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.449198+0000", 2024-09-13T05:11:48.683 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.000801106, 2024-09-13T05:11:48.683 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0043065810000000003, 2024-09-13T05:11:48.683 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.683 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.683 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.683 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.683 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.683 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118702 2024-09-13T05:11:48.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.683 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.683 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.683 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.683 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449198+0000", 2024-09-13T05:11:48.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.684 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.684 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449198+0000", 2024-09-13T05:11:48.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.684 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.684 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449197+0000", 2024-09-13T05:11:48.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.684 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.685 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449200+0000", 2024-09-13T05:11:48.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7199999999999998e-06 2024-09-13T05:11:48.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.685 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.685 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449206+0000", 2024-09-13T05:11:48.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7479999999999999e-06 2024-09-13T05:11:48.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.685 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.685 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449211+0000", 2024-09-13T05:11:48.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7550000000000002e-06 2024-09-13T05:11:48.685 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.685 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.685 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.686 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.686 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.686 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118440 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.686 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.397125+0000", 2024-09-13T05:11:48.686 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.052874588, 2024-09-13T05:11:48.686 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.056442959000000001, 2024-09-13T05:11:48.686 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.686 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.686 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.686 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.686 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.686 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118440 2024-09-13T05:11:48.686 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.686 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397125+0000", 2024-09-13T05:11:48.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397125+0000", 2024-09-13T05:11:48.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397124+0000", 2024-09-13T05:11:48.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.688 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.688 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.688 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397127+0000", 2024-09-13T05:11:48.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.864e-06 2024-09-13T05:11:48.688 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.688 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.688 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.688 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397132+0000", 2024-09-13T05:11:48.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4399999999999996e-06 2024-09-13T05:11:48.688 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.688 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.688 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.689 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397137+0000", 2024-09-13T05:11:48.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8520000000000003e-06 2024-09-13T05:11:48.689 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.689 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.689 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.689 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.689 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118472 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.689 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.401379+0000", 2024-09-13T05:11:48.689 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.048620337999999999, 2024-09-13T05:11:48.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052257695999999999, 2024-09-13T05:11:48.689 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.689 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.690 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.690 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.690 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.690 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118472 2024-09-13T05:11:48.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.690 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401379+0000", 2024-09-13T05:11:48.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401379+0000", 2024-09-13T05:11:48.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401378+0000", 2024-09-13T05:11:48.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401381+0000", 2024-09-13T05:11:48.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3520000000000001e-06 2024-09-13T05:11:48.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.692 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.692 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401386+0000", 2024-09-13T05:11:48.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0440000000000003e-06 2024-09-13T05:11:48.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.692 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.692 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401390+0000", 2024-09-13T05:11:48.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.284e-06 2024-09-13T05:11:48.692 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.692 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.692 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.693 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118504 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.693 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.409069+0000", 2024-09-13T05:11:48.693 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.040929898999999999, 2024-09-13T05:11:48.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.044630218999999999, 2024-09-13T05:11:48.693 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.693 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.693 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.693 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.693 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.693 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118504 2024-09-13T05:11:48.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.693 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409069+0000", 2024-09-13T05:11:48.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409069+0000", 2024-09-13T05:11:48.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409069+0000", 2024-09-13T05:11:48.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:48.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.695 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409070+0000", 2024-09-13T05:11:48.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3510000000000001e-06 2024-09-13T05:11:48.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.695 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.695 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409073+0000", 2024-09-13T05:11:48.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.729e-06 2024-09-13T05:11:48.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.695 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.695 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409076+0000", 2024-09-13T05:11:48.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5179999999999999e-06 2024-09-13T05:11:48.695 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.695 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.696 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.696 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.696 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118536 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.696 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.417093+0000", 2024-09-13T05:11:48.696 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.032905863, 2024-09-13T05:11:48.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036671581000000002, 2024-09-13T05:11:48.696 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.696 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.696 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.696 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.696 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.696 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118536 2024-09-13T05:11:48.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.697 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417093+0000", 2024-09-13T05:11:48.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417093+0000", 2024-09-13T05:11:48.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417093+0000", 2024-09-13T05:11:48.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417096+0000", 2024-09-13T05:11:48.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.157e-06 2024-09-13T05:11:48.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417105+0000", 2024-09-13T05:11:48.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7390000000000005e-06 2024-09-13T05:11:48.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417112+0000", 2024-09-13T05:11:48.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2899999999999997e-06 2024-09-13T05:11:48.699 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.699 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.699 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.699 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118568 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.699 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.425243+0000", 2024-09-13T05:11:48.699 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.02475635, 2024-09-13T05:11:48.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.028585144, 2024-09-13T05:11:48.699 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.699 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.699 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.699 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.699 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.700 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118568 2024-09-13T05:11:48.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.700 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.700 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.700 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425243+0000", 2024-09-13T05:11:48.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.700 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.700 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425243+0000", 2024-09-13T05:11:48.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425243+0000", 2024-09-13T05:11:48.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425245+0000", 2024-09-13T05:11:48.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7870000000000002e-06 2024-09-13T05:11:48.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425251+0000", 2024-09-13T05:11:48.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8409999999999996e-06 2024-09-13T05:11:48.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.702 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.702 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425257+0000", 2024-09-13T05:11:48.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6110000000000001e-06 2024-09-13T05:11:48.702 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.702 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.702 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.702 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118602 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.702 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.433357+0000", 2024-09-13T05:11:48.702 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.016642172, 2024-09-13T05:11:48.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020655858999999999, 2024-09-13T05:11:48.702 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.703 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.703 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.703 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.703 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.703 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118602 2024-09-13T05:11:48.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.703 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433357+0000", 2024-09-13T05:11:48.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433357+0000", 2024-09-13T05:11:48.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433357+0000", 2024-09-13T05:11:48.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433359+0000", 2024-09-13T05:11:48.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.616e-06 2024-09-13T05:11:48.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.705 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433365+0000", 2024-09-13T05:11:48.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2110000000000003e-06 2024-09-13T05:11:48.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.705 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433371+0000", 2024-09-13T05:11:48.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3140000000000003e-06 2024-09-13T05:11:48.705 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.705 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.705 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.705 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118634 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.705 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.441253+0000", 2024-09-13T05:11:48.706 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0087466620000000005, 2024-09-13T05:11:48.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012824031, 2024-09-13T05:11:48.706 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.706 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.706 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.706 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.706 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.706 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118634 2024-09-13T05:11:48.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.706 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.706 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441253+0000", 2024-09-13T05:11:48.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441253+0000", 2024-09-13T05:11:48.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441252+0000", 2024-09-13T05:11:48.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441255+0000", 2024-09-13T05:11:48.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5560000000000002e-06 2024-09-13T05:11:48.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441260+0000", 2024-09-13T05:11:48.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3850000000000001e-06 2024-09-13T05:11:48.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441265+0000", 2024-09-13T05:11:48.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5510000000000001e-06 2024-09-13T05:11:48.708 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.708 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.708 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.709 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118703 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.709 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.449244+0000", 2024-09-13T05:11:48.709 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.00075506800000000002, 2024-09-13T05:11:48.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00489487, 2024-09-13T05:11:48.709 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.709 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.709 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.709 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.709 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.709 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118703 2024-09-13T05:11:48.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.709 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449244+0000", 2024-09-13T05:11:48.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449244+0000", 2024-09-13T05:11:48.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449244+0000", 2024-09-13T05:11:48.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.711 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.711 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449246+0000", 2024-09-13T05:11:48.711 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.605e-06 2024-09-13T05:11:48.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.711 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.711 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449255+0000", 2024-09-13T05:11:48.711 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9730000000000003e-06 2024-09-13T05:11:48.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.712 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.712 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449260+0000", 2024-09-13T05:11:48.712 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9710000000000003e-06 2024-09-13T05:11:48.712 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.712 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.712 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.712 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.712 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118441 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.712 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.397141+0000", 2024-09-13T05:11:48.712 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.052857731999999998, 2024-09-13T05:11:48.712 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.057063869000000003, 2024-09-13T05:11:48.712 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.712 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.713 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.713 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.713 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.713 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118441 2024-09-13T05:11:48.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.713 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397141+0000", 2024-09-13T05:11:48.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397141+0000", 2024-09-13T05:11:48.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.714 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397141+0000", 2024-09-13T05:11:48.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.714 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397143+0000", 2024-09-13T05:11:48.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3740000000000001e-06 2024-09-13T05:11:48.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397149+0000", 2024-09-13T05:11:48.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1630000000000004e-06 2024-09-13T05:11:48.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.715 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397153+0000", 2024-09-13T05:11:48.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6959999999999996e-06 2024-09-13T05:11:48.715 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.715 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.715 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.715 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118473 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.715 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.401394+0000", 2024-09-13T05:11:48.716 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.048605370000000002, 2024-09-13T05:11:48.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.052874394999999998, 2024-09-13T05:11:48.716 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.716 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.716 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.716 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.716 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.716 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118473 2024-09-13T05:11:48.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.716 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.716 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.716 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.717 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401394+0000", 2024-09-13T05:11:48.717 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.717 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.717 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401394+0000", 2024-09-13T05:11:48.717 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.717 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.717 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401393+0000", 2024-09-13T05:11:48.717 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.718 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.718 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401401+0000", 2024-09-13T05:11:48.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7999999999999999e-06 2024-09-13T05:11:48.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.718 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.718 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401407+0000", 2024-09-13T05:11:48.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6060000000000002e-06 2024-09-13T05:11:48.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.718 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.718 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401411+0000", 2024-09-13T05:11:48.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5390000000000001e-06 2024-09-13T05:11:48.719 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.719 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.719 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.719 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.719 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118505 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.719 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.409078+0000", 2024-09-13T05:11:48.719 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.040921576000000001, 2024-09-13T05:11:48.719 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.045256414000000002, 2024-09-13T05:11:48.719 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.719 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.719 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.719 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.719 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.720 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118505 2024-09-13T05:11:48.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.720 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.720 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.720 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.720 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409078+0000", 2024-09-13T05:11:48.720 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.720 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.720 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.720 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409078+0000", 2024-09-13T05:11:48.720 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.721 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.721 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.721 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409077+0000", 2024-09-13T05:11:48.721 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:48.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.721 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.721 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.721 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409079+0000", 2024-09-13T05:11:48.721 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1710000000000001e-06 2024-09-13T05:11:48.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.721 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.721 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.721 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409081+0000", 2024-09-13T05:11:48.721 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6970000000000002e-06 2024-09-13T05:11:48.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409084+0000", 2024-09-13T05:11:48.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4229999999999999e-06 2024-09-13T05:11:48.722 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.722 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.722 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.722 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118537 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.722 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.417121+0000", 2024-09-13T05:11:48.722 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.032878223999999998, 2024-09-13T05:11:48.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037275134000000001, 2024-09-13T05:11:48.723 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.723 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.723 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.723 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.723 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.723 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118537 2024-09-13T05:11:48.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.723 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.723 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.723 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417121+0000", 2024-09-13T05:11:48.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417121+0000", 2024-09-13T05:11:48.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417120+0000", 2024-09-13T05:11:48.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417124+0000", 2024-09-13T05:11:48.725 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5300000000000001e-06 2024-09-13T05:11:48.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.725 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.725 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417132+0000", 2024-09-13T05:11:48.725 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0199999999999994e-06 2024-09-13T05:11:48.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.725 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.725 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417139+0000", 2024-09-13T05:11:48.725 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2779999999999996e-06 2024-09-13T05:11:48.725 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.725 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.726 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.726 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.726 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118569 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.726 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.425261+0000", 2024-09-13T05:11:48.726 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.024738025, 2024-09-13T05:11:48.726 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.029200602999999999, 2024-09-13T05:11:48.726 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.726 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.726 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.726 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.726 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.726 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118569 2024-09-13T05:11:48.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.727 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.727 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.727 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425261+0000", 2024-09-13T05:11:48.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.727 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.727 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425261+0000", 2024-09-13T05:11:48.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425261+0000", 2024-09-13T05:11:48.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425264+0000", 2024-09-13T05:11:48.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7599999999999998e-06 2024-09-13T05:11:48.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425270+0000", 2024-09-13T05:11:48.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0920000000000003e-06 2024-09-13T05:11:48.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425275+0000", 2024-09-13T05:11:48.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3499999999999996e-06 2024-09-13T05:11:48.729 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.729 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.729 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.729 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118603 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.729 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.433390+0000", 2024-09-13T05:11:48.730 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.016609395999999998, 2024-09-13T05:11:48.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.021134377999999999, 2024-09-13T05:11:48.730 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.730 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.730 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.730 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.730 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.730 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118603 2024-09-13T05:11:48.730 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.730 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.730 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.730 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.730 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433390+0000", 2024-09-13T05:11:48.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433390+0000", 2024-09-13T05:11:48.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433389+0000", 2024-09-13T05:11:48.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.732 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433393+0000", 2024-09-13T05:11:48.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3809999999999999e-06 2024-09-13T05:11:48.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.732 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433400+0000", 2024-09-13T05:11:48.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.058e-06 2024-09-13T05:11:48.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.732 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433405+0000", 2024-09-13T05:11:48.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2039999999999996e-06 2024-09-13T05:11:48.732 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.732 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.733 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.733 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118635 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.733 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.441269+0000", 2024-09-13T05:11:48.733 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0087302769999999998, 2024-09-13T05:11:48.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013323229000000001, 2024-09-13T05:11:48.733 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.733 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.733 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.733 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.733 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.733 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118635 2024-09-13T05:11:48.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.734 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441269+0000", 2024-09-13T05:11:48.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441269+0000", 2024-09-13T05:11:48.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441269+0000", 2024-09-13T05:11:48.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441271+0000", 2024-09-13T05:11:48.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4339999999999999e-06 2024-09-13T05:11:48.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441276+0000", 2024-09-13T05:11:48.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2909999999999998e-06 2024-09-13T05:11:48.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441281+0000", 2024-09-13T05:11:48.736 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5739999999999997e-06 2024-09-13T05:11:48.736 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.736 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.736 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.736 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118704 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.736 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.449265+0000", 2024-09-13T05:11:48.736 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.00073419499999999999, 2024-09-13T05:11:48.736 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0053894709999999998, 2024-09-13T05:11:48.736 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.736 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.736 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.736 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.737 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.737 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118704 2024-09-13T05:11:48.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.737 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449265+0000", 2024-09-13T05:11:48.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449265+0000", 2024-09-13T05:11:48.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449265+0000", 2024-09-13T05:11:48.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449267+0000", 2024-09-13T05:11:48.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7709999999999998e-06 2024-09-13T05:11:48.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449273+0000", 2024-09-13T05:11:48.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9170000000000003e-06 2024-09-13T05:11:48.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449278+0000", 2024-09-13T05:11:48.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.977e-06 2024-09-13T05:11:48.739 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.739 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.739 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.739 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118442 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.739 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.397157+0000", 2024-09-13T05:11:48.739 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.052841936999999999, 2024-09-13T05:11:48.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.057563106000000003, 2024-09-13T05:11:48.739 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.740 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.740 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.740 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.740 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.740 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118442 2024-09-13T05:11:48.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.740 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.740 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.740 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397157+0000", 2024-09-13T05:11:48.740 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.740 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397157+0000", 2024-09-13T05:11:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397157+0000", 2024-09-13T05:11:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397159+0000", 2024-09-13T05:11:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4059999999999999e-06 2024-09-13T05:11:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397164+0000", 2024-09-13T05:11:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1100000000000002e-06 2024-09-13T05:11:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397170+0000", 2024-09-13T05:11:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7540000000000003e-06 2024-09-13T05:11:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118474 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.742 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.401415+0000", 2024-09-13T05:11:48.743 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.048583963000000001, 2024-09-13T05:11:48.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.053369185, 2024-09-13T05:11:48.743 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.743 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.743 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.743 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.743 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.743 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118474 2024-09-13T05:11:48.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.743 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401415+0000", 2024-09-13T05:11:48.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.744 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401415+0000", 2024-09-13T05:11:48.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.744 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401415+0000", 2024-09-13T05:11:48.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.744 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401417+0000", 2024-09-13T05:11:48.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3539999999999998e-06 2024-09-13T05:11:48.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.745 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.745 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.745 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401422+0000", 2024-09-13T05:11:48.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1220000000000003e-06 2024-09-13T05:11:48.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.745 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.745 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.745 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401427+0000", 2024-09-13T05:11:48.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5220000000000001e-06 2024-09-13T05:11:48.745 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.745 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.745 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.746 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118506 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.746 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.409086+0000", 2024-09-13T05:11:48.746 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.040913377000000001, 2024-09-13T05:11:48.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.045767635000000001, 2024-09-13T05:11:48.746 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.746 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.746 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.746 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.746 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.746 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118506 2024-09-13T05:11:48.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.746 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409086+0000", 2024-09-13T05:11:48.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409086+0000", 2024-09-13T05:11:48.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409086+0000", 2024-09-13T05:11:48.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:48.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409087+0000", 2024-09-13T05:11:48.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.818e-06 2024-09-13T05:11:48.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409090+0000", 2024-09-13T05:11:48.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7350000000000001e-06 2024-09-13T05:11:48.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409093+0000", 2024-09-13T05:11:48.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6800000000000002e-06 2024-09-13T05:11:48.749 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.749 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.749 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.749 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118538 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.749 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.417145+0000", 2024-09-13T05:11:48.749 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.032854134, 2024-09-13T05:11:48.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037770419, 2024-09-13T05:11:48.749 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.749 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.749 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.750 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.750 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.750 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118538 2024-09-13T05:11:48.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.750 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417145+0000", 2024-09-13T05:11:48.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417145+0000", 2024-09-13T05:11:48.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417145+0000", 2024-09-13T05:11:48.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417148+0000", 2024-09-13T05:11:48.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.275e-06 2024-09-13T05:11:48.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417156+0000", 2024-09-13T05:11:48.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2160000000000006e-06 2024-09-13T05:11:48.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417163+0000", 2024-09-13T05:11:48.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8249999999999999e-06 2024-09-13T05:11:48.752 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.752 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.752 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.752 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118570 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.752 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.425280+0000", 2024-09-13T05:11:48.752 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.024719507000000002, 2024-09-13T05:11:48.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.029701016, 2024-09-13T05:11:48.753 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.753 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.753 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.753 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.753 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.753 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118570 2024-09-13T05:11:48.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.753 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425280+0000", 2024-09-13T05:11:48.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425280+0000", 2024-09-13T05:11:48.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425279+0000", 2024-09-13T05:11:48.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425287+0000", 2024-09-13T05:11:48.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3640000000000001e-06 2024-09-13T05:11:48.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425293+0000", 2024-09-13T05:11:48.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2469999999999997e-06 2024-09-13T05:11:48.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425299+0000", 2024-09-13T05:11:48.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6760000000000004e-06 2024-09-13T05:11:48.755 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.755 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.755 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.756 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118604 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.756 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.433410+0000", 2024-09-13T05:11:48.756 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.016589328, 2024-09-13T05:11:48.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.021633329999999999, 2024-09-13T05:11:48.756 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.756 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.756 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.756 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.756 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.756 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118604 2024-09-13T05:11:48.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.756 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433410+0000", 2024-09-13T05:11:48.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433410+0000", 2024-09-13T05:11:48.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433409+0000", 2024-09-13T05:11:48.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433412+0000", 2024-09-13T05:11:48.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8320000000000002e-06 2024-09-13T05:11:48.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433418+0000", 2024-09-13T05:11:48.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0039999999999996e-06 2024-09-13T05:11:48.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433423+0000", 2024-09-13T05:11:48.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1359999999999996e-06 2024-09-13T05:11:48.759 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.759 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.759 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.759 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118636 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.759 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.441287+0000", 2024-09-13T05:11:48.759 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0087125780000000003, 2024-09-13T05:11:48.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013818555999999999, 2024-09-13T05:11:48.759 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.759 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.759 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.759 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.760 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.760 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118636 2024-09-13T05:11:48.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.760 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441287+0000", 2024-09-13T05:11:48.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441287+0000", 2024-09-13T05:11:48.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441286+0000", 2024-09-13T05:11:48.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441289+0000", 2024-09-13T05:11:48.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3329999999999999e-06 2024-09-13T05:11:48.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441304+0000", 2024-09-13T05:11:48.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5121e-05 2024-09-13T05:11:48.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441309+0000", 2024-09-13T05:11:48.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2290000000000002e-06 2024-09-13T05:11:48.762 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.762 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.762 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.762 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118705 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.762 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.453016+0000", 2024-09-13T05:11:48.763 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9969831, 2024-09-13T05:11:48.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002155789, 2024-09-13T05:11:48.763 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.763 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.763 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.763 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.763 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.763 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118705 2024-09-13T05:11:48.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.763 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.763 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.763 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453016+0000", 2024-09-13T05:11:48.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453016+0000", 2024-09-13T05:11:48.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449282+0000", 2024-09-13T05:11:48.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9962659 2024-09-13T05:11:48.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453020+0000", 2024-09-13T05:11:48.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0037384570000000002 2024-09-13T05:11:48.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453029+0000", 2024-09-13T05:11:48.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.225e-06 2024-09-13T05:11:48.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453035+0000", 2024-09-13T05:11:48.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4320000000000004e-06 2024-09-13T05:11:48.766 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.766 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.766 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.766 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118443 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.766 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.397174+0000", 2024-09-13T05:11:48.766 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.052825168999999998, 2024-09-13T05:11:48.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.058060422, 2024-09-13T05:11:48.766 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.766 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.766 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.766 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.766 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.767 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118443 2024-09-13T05:11:48.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.767 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397174+0000", 2024-09-13T05:11:48.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397174+0000", 2024-09-13T05:11:48.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397174+0000", 2024-09-13T05:11:48.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397176+0000", 2024-09-13T05:11:48.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4779999999999998e-06 2024-09-13T05:11:48.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.769 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397181+0000", 2024-09-13T05:11:48.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.994e-06 2024-09-13T05:11:48.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.769 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.769 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397186+0000", 2024-09-13T05:11:48.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6519999999999997e-06 2024-09-13T05:11:48.769 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.769 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.769 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.769 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118475 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.770 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.401432+0000", 2024-09-13T05:11:48.770 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.048567367, 2024-09-13T05:11:48.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.053873774999999999, 2024-09-13T05:11:48.770 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.770 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.770 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.770 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.770 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.770 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118475 2024-09-13T05:11:48.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.770 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401432+0000", 2024-09-13T05:11:48.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401432+0000", 2024-09-13T05:11:48.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401431+0000", 2024-09-13T05:11:48.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401434+0000", 2024-09-13T05:11:48.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4619999999999999e-06 2024-09-13T05:11:48.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401439+0000", 2024-09-13T05:11:48.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.074e-06 2024-09-13T05:11:48.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401443+0000", 2024-09-13T05:11:48.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4340000000000002e-06 2024-09-13T05:11:48.772 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.772 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.772 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.773 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118507 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.773 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.409095+0000", 2024-09-13T05:11:48.773 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.040904202000000001, 2024-09-13T05:11:48.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.046274215, 2024-09-13T05:11:48.773 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.773 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.773 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.773 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.773 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.773 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118507 2024-09-13T05:11:48.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.773 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409095+0000", 2024-09-13T05:11:48.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409095+0000", 2024-09-13T05:11:48.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409095+0000", 2024-09-13T05:11:48.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:48.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409096+0000", 2024-09-13T05:11:48.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.367e-06 2024-09-13T05:11:48.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409099+0000", 2024-09-13T05:11:48.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7089999999999998e-06 2024-09-13T05:11:48.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409101+0000", 2024-09-13T05:11:48.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.553e-06 2024-09-13T05:11:48.776 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.776 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.776 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.776 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118539 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.776 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.417169+0000", 2024-09-13T05:11:48.776 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.032830250999999998, 2024-09-13T05:11:48.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038266293999999999, 2024-09-13T05:11:48.776 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.776 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.776 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.776 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.777 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.777 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118539 2024-09-13T05:11:48.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.777 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417169+0000", 2024-09-13T05:11:48.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417169+0000", 2024-09-13T05:11:48.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417168+0000", 2024-09-13T05:11:48.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417172+0000", 2024-09-13T05:11:48.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6059999999999999e-06 2024-09-13T05:11:48.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417180+0000", 2024-09-13T05:11:48.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1179999999999992e-06 2024-09-13T05:11:48.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417187+0000", 2024-09-13T05:11:48.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7889999999999997e-06 2024-09-13T05:11:48.779 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.779 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.779 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.779 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118571 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.779 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.425303+0000", 2024-09-13T05:11:48.779 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.024695868999999999, 2024-09-13T05:11:48.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.030237618000000001, 2024-09-13T05:11:48.779 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.780 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.780 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.780 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.780 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.780 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118571 2024-09-13T05:11:48.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.780 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425303+0000", 2024-09-13T05:11:48.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425303+0000", 2024-09-13T05:11:48.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425303+0000", 2024-09-13T05:11:48.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:48.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425306+0000", 2024-09-13T05:11:48.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4240000000000002e-06 2024-09-13T05:11:48.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425313+0000", 2024-09-13T05:11:48.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5470000000000002e-06 2024-09-13T05:11:48.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425318+0000", 2024-09-13T05:11:48.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5300000000000004e-06 2024-09-13T05:11:48.782 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.782 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.782 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.783 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118605 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.783 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.433428+0000", 2024-09-13T05:11:48.783 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.016571236, 2024-09-13T05:11:48.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.022252442000000001, 2024-09-13T05:11:48.783 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.783 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.783 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.783 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.783 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.783 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118605 2024-09-13T05:11:48.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.783 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433428+0000", 2024-09-13T05:11:48.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433428+0000", 2024-09-13T05:11:48.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433428+0000", 2024-09-13T05:11:48.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433430+0000", 2024-09-13T05:11:48.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.672e-06 2024-09-13T05:11:48.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433436+0000", 2024-09-13T05:11:48.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9170000000000003e-06 2024-09-13T05:11:48.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433442+0000", 2024-09-13T05:11:48.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4110000000000004e-06 2024-09-13T05:11:48.785 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.786 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.786 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.786 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118637 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.786 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.441353+0000", 2024-09-13T05:11:48.786 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0086458279999999995, 2024-09-13T05:11:48.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.01439615, 2024-09-13T05:11:48.786 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.786 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.786 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.786 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.786 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.786 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118637 2024-09-13T05:11:48.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.787 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441353+0000", 2024-09-13T05:11:48.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441353+0000", 2024-09-13T05:11:48.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441353+0000", 2024-09-13T05:11:48.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441355+0000", 2024-09-13T05:11:48.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7439999999999999e-06 2024-09-13T05:11:48.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441370+0000", 2024-09-13T05:11:48.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4829e-05 2024-09-13T05:11:48.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441377+0000", 2024-09-13T05:11:48.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8399999999999997e-06 2024-09-13T05:11:48.789 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.789 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.789 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.789 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118706 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.789 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.453051+0000", 2024-09-13T05:11:48.789 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9969478, 2024-09-13T05:11:48.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0027664019999999998, 2024-09-13T05:11:48.789 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.789 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.789 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.790 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.790 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.790 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118706 2024-09-13T05:11:48.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.790 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453051+0000", 2024-09-13T05:11:48.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453051+0000", 2024-09-13T05:11:48.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453051+0000", 2024-09-13T05:11:48.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453054+0000", 2024-09-13T05:11:48.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3620000000000002e-06 2024-09-13T05:11:48.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453062+0000", 2024-09-13T05:11:48.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.559e-06 2024-09-13T05:11:48.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.792 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.792 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453067+0000", 2024-09-13T05:11:48.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3029999999999999e-06 2024-09-13T05:11:48.792 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.792 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.792 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.792 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118476 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.792 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.401447+0000", 2024-09-13T05:11:48.792 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.048551931, 2024-09-13T05:11:48.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.054441107000000002, 2024-09-13T05:11:48.793 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.793 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.793 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.793 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.793 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.793 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118476 2024-09-13T05:11:48.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.793 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.793 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401447+0000", 2024-09-13T05:11:48.793 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401447+0000", 2024-09-13T05:11:48.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401447+0000", 2024-09-13T05:11:48.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401449+0000", 2024-09-13T05:11:48.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2460000000000002e-06 2024-09-13T05:11:48.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401454+0000", 2024-09-13T05:11:48.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.152e-06 2024-09-13T05:11:48.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401459+0000", 2024-09-13T05:11:48.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6770000000000003e-06 2024-09-13T05:11:48.795 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.795 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.795 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.796 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118508 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.796 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.409103+0000", 2024-09-13T05:11:48.796 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.040895938999999999, 2024-09-13T05:11:48.796 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.046851064999999997, 2024-09-13T05:11:48.796 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.796 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.796 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.796 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.796 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.796 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118508 2024-09-13T05:11:48.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.796 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409103+0000", 2024-09-13T05:11:48.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409103+0000", 2024-09-13T05:11:48.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409103+0000", 2024-09-13T05:11:48.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:48.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.798 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409104+0000", 2024-09-13T05:11:48.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.184e-06 2024-09-13T05:11:48.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.798 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.798 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409107+0000", 2024-09-13T05:11:48.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.807e-06 2024-09-13T05:11:48.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.798 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.798 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409110+0000", 2024-09-13T05:11:48.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4240000000000002e-06 2024-09-13T05:11:48.798 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.798 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.799 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.799 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.799 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118540 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.799 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.417195+0000", 2024-09-13T05:11:48.799 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.032804659999999999, 2024-09-13T05:11:48.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038822910000000002, 2024-09-13T05:11:48.799 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.799 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.799 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.799 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.799 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.799 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118540 2024-09-13T05:11:48.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.799 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417195+0000", 2024-09-13T05:11:48.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417195+0000", 2024-09-13T05:11:48.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417194+0000", 2024-09-13T05:11:48.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.801 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417197+0000", 2024-09-13T05:11:48.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.242e-06 2024-09-13T05:11:48.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.801 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417205+0000", 2024-09-13T05:11:48.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7219999999999999e-06 2024-09-13T05:11:48.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.801 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417213+0000", 2024-09-13T05:11:48.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5120000000000002e-06 2024-09-13T05:11:48.802 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.802 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.802 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.802 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.802 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118572 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.802 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.425340+0000", 2024-09-13T05:11:48.802 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.024659525000000002, 2024-09-13T05:11:48.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.030740494, 2024-09-13T05:11:48.802 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.802 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.802 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.802 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.803 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.803 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118572 2024-09-13T05:11:48.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.803 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.803 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.803 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.803 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425340+0000", 2024-09-13T05:11:48.803 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.803 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.803 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.803 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425340+0000", 2024-09-13T05:11:48.803 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.804 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.804 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.804 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425339+0000", 2024-09-13T05:11:48.804 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.804 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.804 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.804 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425341+0000", 2024-09-13T05:11:48.804 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.069e-06 2024-09-13T05:11:48.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.804 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.804 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.804 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425352+0000", 2024-09-13T05:11:48.804 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0169e-05 2024-09-13T05:11:48.805 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.805 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.805 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425358+0000", 2024-09-13T05:11:48.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0569999999999998e-06 2024-09-13T05:11:48.805 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.805 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.805 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.805 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.805 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118606 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.805 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.433446+0000", 2024-09-13T05:11:48.805 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.016553087000000001, 2024-09-13T05:11:48.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.022699112, 2024-09-13T05:11:48.805 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.806 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.806 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.806 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.806 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.806 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118606 2024-09-13T05:11:48.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.806 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.806 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.806 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433446+0000", 2024-09-13T05:11:48.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.806 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433446+0000", 2024-09-13T05:11:48.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433446+0000", 2024-09-13T05:11:48.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433449+0000", 2024-09-13T05:11:48.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.796e-06 2024-09-13T05:11:48.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.808 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.808 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433454+0000", 2024-09-13T05:11:48.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9390000000000002e-06 2024-09-13T05:11:48.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.808 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.808 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433460+0000", 2024-09-13T05:11:48.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4659999999999998e-06 2024-09-13T05:11:48.808 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.808 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.808 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.808 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118638 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.809 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.441382+0000", 2024-09-13T05:11:48.809 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0086176169999999993, 2024-09-13T05:11:48.809 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.014825792000000001, 2024-09-13T05:11:48.809 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.809 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.809 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.809 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.809 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.809 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118638 2024-09-13T05:11:48.809 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.809 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.809 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.809 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.809 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441382+0000", 2024-09-13T05:11:48.809 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.810 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.810 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.810 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441382+0000", 2024-09-13T05:11:48.810 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.810 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.810 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.810 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441381+0000", 2024-09-13T05:11:48.810 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.810 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.810 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.810 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441384+0000", 2024-09-13T05:11:48.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4200000000000001e-06 2024-09-13T05:11:48.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441389+0000", 2024-09-13T05:11:48.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8279999999999999e-06 2024-09-13T05:11:48.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441394+0000", 2024-09-13T05:11:48.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6659999999999999e-06 2024-09-13T05:11:48.811 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.811 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.811 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.812 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118707 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.812 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.453072+0000", 2024-09-13T05:11:48.812 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9969277, 2024-09-13T05:11:48.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0032026110000000002, 2024-09-13T05:11:48.812 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.812 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.812 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.812 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.812 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.812 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118707 2024-09-13T05:11:48.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.812 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453072+0000", 2024-09-13T05:11:48.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453072+0000", 2024-09-13T05:11:48.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453071+0000", 2024-09-13T05:11:48.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453078+0000", 2024-09-13T05:11:48.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.4869999999999996e-06 2024-09-13T05:11:48.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453084+0000", 2024-09-13T05:11:48.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6030000000000004e-06 2024-09-13T05:11:48.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453089+0000", 2024-09-13T05:11:48.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.95e-06 2024-09-13T05:11:48.815 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.815 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.815 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.815 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.815 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118477 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.815 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.401463+0000", 2024-09-13T05:11:48.815 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.048536283999999999, 2024-09-13T05:11:48.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.054873996000000001, 2024-09-13T05:11:48.815 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.815 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.815 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.815 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.815 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.816 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118477 2024-09-13T05:11:48.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.816 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401463+0000", 2024-09-13T05:11:48.816 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401463+0000", 2024-09-13T05:11:48.816 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401463+0000", 2024-09-13T05:11:48.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401465+0000", 2024-09-13T05:11:48.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3999999999999999e-06 2024-09-13T05:11:48.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401470+0000", 2024-09-13T05:11:48.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1059999999999999e-06 2024-09-13T05:11:48.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401474+0000", 2024-09-13T05:11:48.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4660000000000001e-06 2024-09-13T05:11:48.818 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.818 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.818 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.818 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.818 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118509 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.818 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.409113+0000", 2024-09-13T05:11:48.818 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.040886675999999997, 2024-09-13T05:11:48.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.047292318, 2024-09-13T05:11:48.818 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.819 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.819 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.819 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.819 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.819 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118509 2024-09-13T05:11:48.819 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.819 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.819 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.819 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.819 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409113+0000", 2024-09-13T05:11:48.819 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.819 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.819 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.819 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.819 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409113+0000", 2024-09-13T05:11:48.820 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.820 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.820 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409112+0000", 2024-09-13T05:11:48.820 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:48.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.820 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.820 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409114+0000", 2024-09-13T05:11:48.820 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.203e-06 2024-09-13T05:11:48.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.820 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.821 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409116+0000", 2024-09-13T05:11:48.821 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7099999999999999e-06 2024-09-13T05:11:48.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.821 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.821 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.821 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409119+0000", 2024-09-13T05:11:48.821 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5160000000000001e-06 2024-09-13T05:11:48.821 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.821 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.821 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.821 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.821 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118541 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.821 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.417219+0000", 2024-09-13T05:11:48.822 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.032780541000000003, 2024-09-13T05:11:48.822 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.039248162000000003, 2024-09-13T05:11:48.822 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.822 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.822 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.822 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.822 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.822 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118541 2024-09-13T05:11:48.822 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.822 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.822 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.822 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.822 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417219+0000", 2024-09-13T05:11:48.822 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417219+0000", 2024-09-13T05:11:48.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417218+0000", 2024-09-13T05:11:48.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.824 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417221+0000", 2024-09-13T05:11:48.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1030000000000002e-06 2024-09-13T05:11:48.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.824 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.824 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417231+0000", 2024-09-13T05:11:48.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3500000000000003e-06 2024-09-13T05:11:48.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.824 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.824 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417237+0000", 2024-09-13T05:11:48.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6429999999999998e-06 2024-09-13T05:11:48.824 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.824 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.825 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.825 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.825 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118573 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.825 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.425363+0000", 2024-09-13T05:11:48.825 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.024636313999999999, 2024-09-13T05:11:48.825 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031169545, 2024-09-13T05:11:48.825 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.825 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.825 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.825 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.825 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.825 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118573 2024-09-13T05:11:48.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.826 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.826 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.826 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.826 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425363+0000", 2024-09-13T05:11:48.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.826 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.826 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.826 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425363+0000", 2024-09-13T05:11:48.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.826 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.826 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.826 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425362+0000", 2024-09-13T05:11:48.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.827 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.827 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.827 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425365+0000", 2024-09-13T05:11:48.827 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9620000000000002e-06 2024-09-13T05:11:48.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.827 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.827 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.827 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425372+0000", 2024-09-13T05:11:48.827 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3539999999999996e-06 2024-09-13T05:11:48.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.827 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.827 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.827 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425377+0000", 2024-09-13T05:11:48.828 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5099999999999998e-06 2024-09-13T05:11:48.828 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.828 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.828 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.828 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.828 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.828 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118607 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.828 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.433464+0000", 2024-09-13T05:11:48.828 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.016534994000000001, 2024-09-13T05:11:48.828 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.023131638, 2024-09-13T05:11:48.828 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.828 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.828 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.828 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.829 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.829 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118607 2024-09-13T05:11:48.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.829 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.829 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433464+0000", 2024-09-13T05:11:48.829 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.829 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433464+0000", 2024-09-13T05:11:48.829 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.830 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.830 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433464+0000", 2024-09-13T05:11:48.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.830 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.830 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.830 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433467+0000", 2024-09-13T05:11:48.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7389999999999999e-06 2024-09-13T05:11:48.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.830 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.830 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.830 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433473+0000", 2024-09-13T05:11:48.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1820000000000003e-06 2024-09-13T05:11:48.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.831 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.831 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.831 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433479+0000", 2024-09-13T05:11:48.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9039999999999997e-06 2024-09-13T05:11:48.831 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.831 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.831 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.831 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.831 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118639 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.831 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.445102+0000", 2024-09-13T05:11:48.832 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0048971309999999999, 2024-09-13T05:11:48.832 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.01155901, 2024-09-13T05:11:48.832 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.832 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.832 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.832 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.832 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.832 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118639 2024-09-13T05:11:48.832 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.832 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.832 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.832 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.832 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445102+0000", 2024-09-13T05:11:48.832 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.833 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.833 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.833 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445102+0000", 2024-09-13T05:11:48.833 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.833 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.833 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.833 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441398+0000", 2024-09-13T05:11:48.833 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9962959 2024-09-13T05:11:48.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.833 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.833 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.833 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445105+0000", 2024-09-13T05:11:48.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0037071309999999998 2024-09-13T05:11:48.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445113+0000", 2024-09-13T05:11:48.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9149999999999996e-06 2024-09-13T05:11:48.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445120+0000", 2024-09-13T05:11:48.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6619999999999999e-06 2024-09-13T05:11:48.834 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.834 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.834 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.835 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118708 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.835 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.453093+0000", 2024-09-13T05:11:48.835 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9969058, 2024-09-13T05:11:48.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0036315840000000002, 2024-09-13T05:11:48.835 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.835 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.835 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.835 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.835 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.835 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118708 2024-09-13T05:11:48.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.835 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.836 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453093+0000", 2024-09-13T05:11:48.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.836 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453093+0000", 2024-09-13T05:11:48.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.836 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453093+0000", 2024-09-13T05:11:48.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.837 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.837 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.837 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.837 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453095+0000", 2024-09-13T05:11:48.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.497e-06 2024-09-13T05:11:48.837 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.837 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.837 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.837 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453101+0000", 2024-09-13T05:11:48.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7010000000000001e-06 2024-09-13T05:11:48.837 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.837 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.837 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.837 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453106+0000", 2024-09-13T05:11:48.838 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8799999999999999e-06 2024-09-13T05:11:48.838 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.838 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.838 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.838 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.838 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.838 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118478 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.838 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.401478+0000", 2024-09-13T05:11:48.838 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.048520965999999999, 2024-09-13T05:11:48.838 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.055313605000000002, 2024-09-13T05:11:48.838 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.838 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.838 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.838 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.838 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.839 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118478 2024-09-13T05:11:48.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.839 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.839 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.839 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.839 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401478+0000", 2024-09-13T05:11:48.839 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.839 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.839 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.839 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401478+0000", 2024-09-13T05:11:48.839 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.839 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.840 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401478+0000", 2024-09-13T05:11:48.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.840 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401480+0000", 2024-09-13T05:11:48.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2759999999999999e-06 2024-09-13T05:11:48.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.840 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401485+0000", 2024-09-13T05:11:48.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.028e-06 2024-09-13T05:11:48.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.841 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.841 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.841 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401492+0000", 2024-09-13T05:11:48.841 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7039999999999997e-06 2024-09-13T05:11:48.841 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.841 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.841 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.841 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.841 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118510 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.841 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.409121+0000", 2024-09-13T05:11:48.841 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.040878269000000002, 2024-09-13T05:11:48.841 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.047733241000000003, 2024-09-13T05:11:48.841 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.841 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.842 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.842 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.842 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.842 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118510 2024-09-13T05:11:48.842 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.842 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.842 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.842 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.842 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409121+0000", 2024-09-13T05:11:48.842 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.842 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.842 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.842 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.842 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409121+0000", 2024-09-13T05:11:48.843 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.843 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.843 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409121+0000", 2024-09-13T05:11:48.843 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:48.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.843 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.843 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409126+0000", 2024-09-13T05:11:48.843 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9699999999999998e-06 2024-09-13T05:11:48.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.843 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.843 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409129+0000", 2024-09-13T05:11:48.844 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0460000000000001e-06 2024-09-13T05:11:48.844 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.844 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.844 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.844 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409131+0000", 2024-09-13T05:11:48.844 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5339999999999998e-06 2024-09-13T05:11:48.844 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.844 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.844 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.844 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.844 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.844 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118542 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.844 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.417243+0000", 2024-09-13T05:11:48.844 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.032755991999999998, 2024-09-13T05:11:48.845 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.039672728999999997, 2024-09-13T05:11:48.845 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.845 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.845 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.845 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.845 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.845 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118542 2024-09-13T05:11:48.845 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.845 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.845 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.845 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.845 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417243+0000", 2024-09-13T05:11:48.845 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.846 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417243+0000", 2024-09-13T05:11:48.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.846 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417243+0000", 2024-09-13T05:11:48.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.846 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417246+0000", 2024-09-13T05:11:48.847 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.151e-06 2024-09-13T05:11:48.847 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.847 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.847 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.847 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417254+0000", 2024-09-13T05:11:48.847 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0490000000000004e-06 2024-09-13T05:11:48.847 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.847 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.847 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.847 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417261+0000", 2024-09-13T05:11:48.847 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0659999999999998e-06 2024-09-13T05:11:48.847 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.847 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.847 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.847 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.848 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.848 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118574 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.848 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.425382+0000", 2024-09-13T05:11:48.848 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.024617360000000001, 2024-09-13T05:11:48.848 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031631589000000002, 2024-09-13T05:11:48.848 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.848 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.848 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.848 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.848 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.848 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118574 2024-09-13T05:11:48.848 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.848 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.848 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.849 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.849 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425382+0000", 2024-09-13T05:11:48.849 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.849 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.849 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.849 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.849 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425382+0000", 2024-09-13T05:11:48.849 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.849 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.849 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.849 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.849 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425381+0000", 2024-09-13T05:11:48.849 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.849 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.850 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.850 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.850 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425384+0000", 2024-09-13T05:11:48.850 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6170000000000001e-06 2024-09-13T05:11:48.850 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.850 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.850 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.850 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425390+0000", 2024-09-13T05:11:48.850 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0220000000000001e-06 2024-09-13T05:11:48.850 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.850 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.850 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.850 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425395+0000", 2024-09-13T05:11:48.850 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4009999999999996e-06 2024-09-13T05:11:48.851 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.851 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.851 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.851 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.851 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.851 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118608 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.851 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.433484+0000", 2024-09-13T05:11:48.851 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.016515698999999998, 2024-09-13T05:11:48.851 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.023658810999999998, 2024-09-13T05:11:48.851 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.851 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.851 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.851 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.851 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.852 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118608 2024-09-13T05:11:48.852 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.852 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.852 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.852 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.852 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433484+0000", 2024-09-13T05:11:48.852 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.852 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.852 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.852 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.852 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433484+0000", 2024-09-13T05:11:48.852 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.852 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.852 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.853 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.853 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433483+0000", 2024-09-13T05:11:48.853 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.853 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.853 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.853 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.853 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433486+0000", 2024-09-13T05:11:48.853 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6369999999999999e-06 2024-09-13T05:11:48.853 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.853 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.853 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.853 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433492+0000", 2024-09-13T05:11:48.853 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1380000000000004e-06 2024-09-13T05:11:48.853 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.853 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.854 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.854 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433497+0000", 2024-09-13T05:11:48.854 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9130000000000002e-06 2024-09-13T05:11:48.854 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.854 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.854 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.854 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.854 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.854 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118640 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.854 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.445125+0000", 2024-09-13T05:11:48.854 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0048737779999999996, 2024-09-13T05:11:48.854 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012126141999999999, 2024-09-13T05:11:48.854 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.854 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.855 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.855 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.855 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.855 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118640 2024-09-13T05:11:48.855 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.855 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.855 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.855 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.855 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445125+0000", 2024-09-13T05:11:48.855 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.855 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.855 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.855 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.855 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445125+0000", 2024-09-13T05:11:48.855 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.856 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.856 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.856 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.856 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445125+0000", 2024-09-13T05:11:48.856 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.856 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.856 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.856 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.856 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445128+0000", 2024-09-13T05:11:48.856 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1329999999999999e-06 2024-09-13T05:11:48.856 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.856 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.856 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.856 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445139+0000", 2024-09-13T05:11:48.857 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1487e-05 2024-09-13T05:11:48.857 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.857 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.857 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.857 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445144+0000", 2024-09-13T05:11:48.857 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0420000000000002e-06 2024-09-13T05:11:48.857 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.857 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.857 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.857 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.857 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.857 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118709 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.857 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.453110+0000", 2024-09-13T05:11:48.857 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9968891, 2024-09-13T05:11:48.858 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0042350460000000001, 2024-09-13T05:11:48.858 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.858 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.858 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.858 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.858 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.858 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118709 2024-09-13T05:11:48.859 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.859 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.859 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.859 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.859 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453110+0000", 2024-09-13T05:11:48.859 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.859 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.859 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.859 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.860 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453110+0000", 2024-09-13T05:11:48.860 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.860 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.860 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.860 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.860 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453110+0000", 2024-09-13T05:11:48.860 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.860 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.860 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.860 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.860 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453112+0000", 2024-09-13T05:11:48.861 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3479999999999998e-06 2024-09-13T05:11:48.861 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.861 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.861 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.861 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453117+0000", 2024-09-13T05:11:48.861 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0250000000000002e-06 2024-09-13T05:11:48.861 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.861 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.861 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.861 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453123+0000", 2024-09-13T05:11:48.861 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8869999999999997e-06 2024-09-13T05:11:48.861 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.861 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.861 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.862 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.862 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.862 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118479 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.862 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.401496+0000", 2024-09-13T05:11:48.862 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.048503193999999999, 2024-09-13T05:11:48.862 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.055922589000000002, 2024-09-13T05:11:48.862 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.862 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.862 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.862 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.862 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.862 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118479 2024-09-13T05:11:48.862 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.862 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.863 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.863 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.863 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401496+0000", 2024-09-13T05:11:48.863 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.863 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.863 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.863 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.863 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401496+0000", 2024-09-13T05:11:48.863 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.863 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.863 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.863 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.863 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401495+0000", 2024-09-13T05:11:48.864 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.864 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.864 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.864 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.864 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401498+0000", 2024-09-13T05:11:48.864 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6960000000000001e-06 2024-09-13T05:11:48.864 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.864 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.865 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.865 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401503+0000", 2024-09-13T05:11:48.865 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1089999999999997e-06 2024-09-13T05:11:48.865 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.865 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.865 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.865 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401508+0000", 2024-09-13T05:11:48.865 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1379999999999998e-06 2024-09-13T05:11:48.865 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.865 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.865 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.865 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.865 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.866 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118511 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.866 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.409134+0000", 2024-09-13T05:11:48.866 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.040865615000000001, 2024-09-13T05:11:48.866 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048353180000000003, 2024-09-13T05:11:48.866 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.866 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.866 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.866 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.866 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.866 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118511 2024-09-13T05:11:48.866 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.866 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.866 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.866 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.866 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409134+0000", 2024-09-13T05:11:48.867 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.867 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.867 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.867 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.867 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409134+0000", 2024-09-13T05:11:48.867 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.867 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.867 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.867 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.867 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409133+0000", 2024-09-13T05:11:48.867 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:48.867 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.867 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.867 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.868 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409135+0000", 2024-09-13T05:11:48.868 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4360000000000001e-06 2024-09-13T05:11:48.868 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.868 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.868 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.868 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409138+0000", 2024-09-13T05:11:48.868 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7350000000000001e-06 2024-09-13T05:11:48.868 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.868 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.868 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.868 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409140+0000", 2024-09-13T05:11:48.868 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6620000000000001e-06 2024-09-13T05:11:48.868 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.869 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.869 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.869 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.869 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.869 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118543 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.869 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.417267+0000", 2024-09-13T05:11:48.869 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.032731906999999998, 2024-09-13T05:11:48.869 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040301392999999998, 2024-09-13T05:11:48.869 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.869 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.869 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.869 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.869 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.869 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118543 2024-09-13T05:11:48.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.870 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.870 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.870 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.870 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417267+0000", 2024-09-13T05:11:48.870 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.870 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.870 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.870 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417267+0000", 2024-09-13T05:11:48.870 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.870 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.871 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.871 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417267+0000", 2024-09-13T05:11:48.871 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.871 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.872 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.872 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.872 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417270+0000", 2024-09-13T05:11:48.872 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5930000000000002e-06 2024-09-13T05:11:48.872 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.872 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.872 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.872 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417278+0000", 2024-09-13T05:11:48.872 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9689999999999994e-06 2024-09-13T05:11:48.872 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.872 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.872 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.872 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417285+0000", 2024-09-13T05:11:48.873 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0149999999999998e-06 2024-09-13T05:11:48.873 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.873 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.873 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.873 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.873 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.873 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118575 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.873 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.425400+0000", 2024-09-13T05:11:48.873 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.024599151, 2024-09-13T05:11:48.873 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032231927, 2024-09-13T05:11:48.873 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.873 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.873 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.873 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.874 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.874 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118575 2024-09-13T05:11:48.874 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.874 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.874 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.874 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.874 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425400+0000", 2024-09-13T05:11:48.874 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.874 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.874 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.874 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.874 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425400+0000", 2024-09-13T05:11:48.874 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.875 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.875 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.875 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425400+0000", 2024-09-13T05:11:48.875 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.875 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.875 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.875 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425402+0000", 2024-09-13T05:11:48.875 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6259999999999999e-06 2024-09-13T05:11:48.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.875 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.876 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.876 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425408+0000", 2024-09-13T05:11:48.876 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8669999999999999e-06 2024-09-13T05:11:48.876 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.876 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.876 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.876 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425414+0000", 2024-09-13T05:11:48.876 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4500000000000003e-06 2024-09-13T05:11:48.876 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.876 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.876 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.876 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.876 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.877 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118609 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.877 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.437076+0000", 2024-09-13T05:11:48.877 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.012923473, 2024-09-13T05:11:48.877 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020622305, 2024-09-13T05:11:48.877 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.877 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.877 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.877 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.877 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.877 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118609 2024-09-13T05:11:48.877 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.877 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.877 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.877 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.878 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437076+0000", 2024-09-13T05:11:48.878 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.878 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.878 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.878 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437076+0000", 2024-09-13T05:11:48.878 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.878 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.878 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.878 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433501+0000", 2024-09-13T05:11:48.878 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9964252 2024-09-13T05:11:48.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.878 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.879 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437082+0000", 2024-09-13T05:11:48.879 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0035815180000000001 2024-09-13T05:11:48.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.879 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437097+0000", 2024-09-13T05:11:48.879 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4175999999999999e-05 2024-09-13T05:11:48.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.879 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437104+0000", 2024-09-13T05:11:48.879 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7330000000000003e-06 2024-09-13T05:11:48.879 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.879 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.880 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.880 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.880 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.880 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118641 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.880 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.445160+0000", 2024-09-13T05:11:48.880 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0048392399999999999, 2024-09-13T05:11:48.880 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012604519, 2024-09-13T05:11:48.880 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.880 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.880 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.880 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.880 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.880 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118641 2024-09-13T05:11:48.881 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.881 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.881 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.881 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.881 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445160+0000", 2024-09-13T05:11:48.881 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.881 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.881 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.881 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.881 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445160+0000", 2024-09-13T05:11:48.881 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.881 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.881 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.881 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.882 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445159+0000", 2024-09-13T05:11:48.882 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.882 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.882 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445162+0000", 2024-09-13T05:11:48.882 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9210000000000001e-06 2024-09-13T05:11:48.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.882 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.882 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445170+0000", 2024-09-13T05:11:48.882 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9289999999999998e-06 2024-09-13T05:11:48.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.882 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.883 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445175+0000", 2024-09-13T05:11:48.883 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1900000000000003e-06 2024-09-13T05:11:48.883 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.883 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.883 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.883 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.883 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.883 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118710 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.883 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.453127+0000", 2024-09-13T05:11:48.883 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9968719, 2024-09-13T05:11:48.883 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0047043579999999996, 2024-09-13T05:11:48.883 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.883 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.883 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.884 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.884 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.884 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118710 2024-09-13T05:11:48.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.884 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.884 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.884 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.884 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453127+0000", 2024-09-13T05:11:48.884 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.884 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.884 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.884 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453127+0000", 2024-09-13T05:11:48.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.885 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.885 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453127+0000", 2024-09-13T05:11:48.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.885 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.885 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453129+0000", 2024-09-13T05:11:48.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5189999999999999e-06 2024-09-13T05:11:48.885 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.886 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453135+0000", 2024-09-13T05:11:48.886 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3240000000000002e-06 2024-09-13T05:11:48.886 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.886 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.886 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.886 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453139+0000", 2024-09-13T05:11:48.886 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7829999999999998e-06 2024-09-13T05:11:48.886 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.886 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.886 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.886 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.886 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.886 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118480 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.886 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.401515+0000", 2024-09-13T05:11:48.886 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.048483936999999998, 2024-09-13T05:11:48.887 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.056383601999999998, 2024-09-13T05:11:48.887 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.887 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.887 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.887 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.887 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.887 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118480 2024-09-13T05:11:48.887 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.887 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.887 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.887 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.887 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401515+0000", 2024-09-13T05:11:48.887 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.887 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.888 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.888 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.888 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401515+0000", 2024-09-13T05:11:48.888 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.888 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.888 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.888 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.888 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401515+0000", 2024-09-13T05:11:48.888 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.888 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.888 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.888 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.888 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401518+0000", 2024-09-13T05:11:48.888 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4259999999999999e-06 2024-09-13T05:11:48.889 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.889 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.889 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.889 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401528+0000", 2024-09-13T05:11:48.889 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9140000000000003e-06 2024-09-13T05:11:48.889 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.889 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.889 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.889 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401536+0000", 2024-09-13T05:11:48.889 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0080000000000002e-06 2024-09-13T05:11:48.889 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.889 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.889 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.889 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.889 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.890 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118512 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.890 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.409142+0000", 2024-09-13T05:11:48.890 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.040856776999999997, 2024-09-13T05:11:48.890 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048823320000000003, 2024-09-13T05:11:48.890 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.890 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.890 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.890 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.890 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.890 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118512 2024-09-13T05:11:48.890 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.890 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.890 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.891 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.891 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409142+0000", 2024-09-13T05:11:48.891 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.891 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.891 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.891 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.891 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409142+0000", 2024-09-13T05:11:48.891 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.891 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.891 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.891 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.891 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409142+0000", 2024-09-13T05:11:48.891 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:48.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.892 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.892 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409144+0000", 2024-09-13T05:11:48.892 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5120000000000001e-06 2024-09-13T05:11:48.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.892 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.892 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409146+0000", 2024-09-13T05:11:48.892 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.734e-06 2024-09-13T05:11:48.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.892 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.892 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409149+0000", 2024-09-13T05:11:48.893 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5809999999999999e-06 2024-09-13T05:11:48.893 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.893 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.893 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.893 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.893 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.893 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118544 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.893 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.417291+0000", 2024-09-13T05:11:48.893 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.032707743999999997, 2024-09-13T05:11:48.893 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040736890999999997, 2024-09-13T05:11:48.893 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.893 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.893 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.893 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.893 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.894 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118544 2024-09-13T05:11:48.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.894 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.894 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.894 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.894 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417291+0000", 2024-09-13T05:11:48.894 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.894 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.894 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.894 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417291+0000", 2024-09-13T05:11:48.894 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.894 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.895 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.895 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417291+0000", 2024-09-13T05:11:48.895 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.895 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.895 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417294+0000", 2024-09-13T05:11:48.895 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4709999999999999e-06 2024-09-13T05:11:48.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.895 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.895 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417302+0000", 2024-09-13T05:11:48.895 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8499999999999994e-06 2024-09-13T05:11:48.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.896 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.896 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.896 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417309+0000", 2024-09-13T05:11:48.896 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1409999999999999e-06 2024-09-13T05:11:48.896 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.896 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.896 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.896 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.896 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.896 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118576 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.896 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.429218+0000", 2024-09-13T05:11:48.896 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.020780724, 2024-09-13T05:11:48.896 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.028872566999999998, 2024-09-13T05:11:48.897 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.897 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.897 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.897 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.897 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.897 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118576 2024-09-13T05:11:48.897 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.897 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.897 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.897 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.897 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429218+0000", 2024-09-13T05:11:48.897 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.897 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.897 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.898 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.898 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429218+0000", 2024-09-13T05:11:48.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.898 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.898 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.425418+0000", 2024-09-13T05:11:48.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9961996 2024-09-13T05:11:48.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.898 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.898 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429222+0000", 2024-09-13T05:11:48.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0038040370000000001 2024-09-13T05:11:48.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.899 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.899 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.899 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429238+0000", 2024-09-13T05:11:48.899 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5846e-05 2024-09-13T05:11:48.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.899 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.899 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.899 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429245+0000", 2024-09-13T05:11:48.899 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.542e-06 2024-09-13T05:11:48.899 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.899 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.899 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.899 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.900 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118610 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.900 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.437110+0000", 2024-09-13T05:11:48.900 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.012888816000000001, 2024-09-13T05:11:48.900 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.021046575000000001, 2024-09-13T05:11:48.900 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.900 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.900 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.900 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.900 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.900 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118610 2024-09-13T05:11:48.900 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.900 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.900 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437110+0000", 2024-09-13T05:11:48.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437110+0000", 2024-09-13T05:11:48.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437110+0000", 2024-09-13T05:11:48.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437113+0000", 2024-09-13T05:11:48.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1480000000000002e-06 2024-09-13T05:11:48.902 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437119+0000", 2024-09-13T05:11:48.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8409999999999996e-06 2024-09-13T05:11:48.902 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437124+0000", 2024-09-13T05:11:48.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2619999999999998e-06 2024-09-13T05:11:48.903 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.903 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.903 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.903 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.903 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.903 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118642 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.903 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.445180+0000", 2024-09-13T05:11:48.903 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0048195, 2024-09-13T05:11:48.903 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013039680999999999, 2024-09-13T05:11:48.903 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.903 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.903 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.903 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.903 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.904 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118642 2024-09-13T05:11:48.904 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.904 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.904 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.904 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.904 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445180+0000", 2024-09-13T05:11:48.904 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.904 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.904 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.904 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.904 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445180+0000", 2024-09-13T05:11:48.904 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.904 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.905 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.905 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.905 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445179+0000", 2024-09-13T05:11:48.905 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.905 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.905 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.905 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.905 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445182+0000", 2024-09-13T05:11:48.905 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9909999999999998e-06 2024-09-13T05:11:48.905 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.905 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.905 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.905 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445196+0000", 2024-09-13T05:11:48.905 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3582e-05 2024-09-13T05:11:48.906 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.906 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.906 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.906 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445201+0000", 2024-09-13T05:11:48.906 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5910000000000003e-06 2024-09-13T05:11:48.906 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.906 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.906 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.906 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.906 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.906 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118711 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.906 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.453143+0000", 2024-09-13T05:11:48.906 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9968557, 2024-09-13T05:11:48.906 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00514432, 2024-09-13T05:11:48.906 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.907 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.907 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.907 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.907 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.907 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118711 2024-09-13T05:11:48.907 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.907 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.907 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.907 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.907 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453143+0000", 2024-09-13T05:11:48.907 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.907 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.907 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.907 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.908 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453143+0000", 2024-09-13T05:11:48.908 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.908 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.908 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.908 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.908 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453143+0000", 2024-09-13T05:11:48.908 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.908 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.908 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.908 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.908 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453146+0000", 2024-09-13T05:11:48.908 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5050000000000002e-06 2024-09-13T05:11:48.908 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.908 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.909 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.909 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453151+0000", 2024-09-13T05:11:48.909 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0030000000000002e-06 2024-09-13T05:11:48.909 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.909 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.909 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.909 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453155+0000", 2024-09-13T05:11:48.909 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5249999999999999e-06 2024-09-13T05:11:48.909 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.909 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.909 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.909 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.909 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.909 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118481 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.910 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.405056+0000", 2024-09-13T05:11:48.910 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.044943337, 2024-09-13T05:11:48.910 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.053297718000000001, 2024-09-13T05:11:48.910 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.910 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.910 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.910 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.910 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.910 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118481 2024-09-13T05:11:48.910 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.910 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.910 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.910 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.910 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405056+0000", 2024-09-13T05:11:48.910 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.911 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.911 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405056+0000", 2024-09-13T05:11:48.911 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.911 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.911 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.401543+0000", 2024-09-13T05:11:48.911 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9964871 2024-09-13T05:11:48.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.911 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.911 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405061+0000", 2024-09-13T05:11:48.912 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0035176449999999998 2024-09-13T05:11:48.912 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.912 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.912 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.912 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405076+0000", 2024-09-13T05:11:48.912 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5038999999999999e-05 2024-09-13T05:11:48.912 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.912 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.912 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.912 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405086+0000", 2024-09-13T05:11:48.912 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0672999999999999e-05 2024-09-13T05:11:48.912 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.912 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.912 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.913 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.913 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.913 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118513 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.913 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.409151+0000", 2024-09-13T05:11:48.913 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.040847757999999998, 2024-09-13T05:11:48.913 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.04927202, 2024-09-13T05:11:48.913 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.913 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.913 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.913 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.913 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.913 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118513 2024-09-13T05:11:48.913 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.913 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.914 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.914 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.914 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409151+0000", 2024-09-13T05:11:48.914 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.914 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.914 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.914 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.914 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409151+0000", 2024-09-13T05:11:48.914 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.914 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.914 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.914 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.914 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409151+0000", 2024-09-13T05:11:48.915 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:48.915 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.915 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.915 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.915 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409152+0000", 2024-09-13T05:11:48.915 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.237e-06 2024-09-13T05:11:48.915 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.915 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.915 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.915 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409155+0000", 2024-09-13T05:11:48.915 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8169999999999999e-06 2024-09-13T05:11:48.915 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.915 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.915 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.916 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409158+0000", 2024-09-13T05:11:48.916 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:11:48.916 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.916 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.916 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.916 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.916 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.916 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118545 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.916 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.417358+0000", 2024-09-13T05:11:48.916 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.032641396000000003, 2024-09-13T05:11:48.916 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.041128247999999999, 2024-09-13T05:11:48.916 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.916 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.917 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.917 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.917 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.917 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118545 2024-09-13T05:11:48.917 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.917 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.917 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.917 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.917 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417358+0000", 2024-09-13T05:11:48.917 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.917 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.917 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.917 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.917 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417358+0000", 2024-09-13T05:11:48.917 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.918 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.918 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.918 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.918 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417357+0000", 2024-09-13T05:11:48.918 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:48.918 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.918 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.918 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.918 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417361+0000", 2024-09-13T05:11:48.918 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6780000000000002e-06 2024-09-13T05:11:48.918 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.918 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.918 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.919 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417369+0000", 2024-09-13T05:11:48.919 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7280000000000001e-06 2024-09-13T05:11:48.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.919 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.919 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.919 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417377+0000", 2024-09-13T05:11:48.919 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.481e-06 2024-09-13T05:11:48.919 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.919 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.919 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.919 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.919 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118577 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.919 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.429273+0000", 2024-09-13T05:11:48.920 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.020726389000000001, 2024-09-13T05:11:48.920 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.029281971, 2024-09-13T05:11:48.920 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.920 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.920 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.920 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.920 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.920 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118577 2024-09-13T05:11:48.920 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.920 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.920 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.920 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.920 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429273+0000", 2024-09-13T05:11:48.920 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.921 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.921 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.921 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.921 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429273+0000", 2024-09-13T05:11:48.921 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.921 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.921 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.921 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.921 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429272+0000", 2024-09-13T05:11:48.921 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.921 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.921 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.921 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.921 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429276+0000", 2024-09-13T05:11:48.922 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5779999999999999e-06 2024-09-13T05:11:48.922 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.922 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.922 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.922 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429290+0000", 2024-09-13T05:11:48.922 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.438e-05 2024-09-13T05:11:48.922 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.922 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.922 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.922 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429296+0000", 2024-09-13T05:11:48.922 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1e-06 2024-09-13T05:11:48.922 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.922 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.922 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.923 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.923 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.923 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118611 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.923 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.437129+0000", 2024-09-13T05:11:48.923 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.012869864, 2024-09-13T05:11:48.923 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.021488338999999999, 2024-09-13T05:11:48.923 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.923 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.923 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.923 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.923 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.923 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118611 2024-09-13T05:11:48.923 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.923 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.923 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.924 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.924 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437129+0000", 2024-09-13T05:11:48.924 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.924 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.924 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.924 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.924 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437129+0000", 2024-09-13T05:11:48.924 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.924 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.924 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.924 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.924 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437129+0000", 2024-09-13T05:11:48.924 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.925 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.925 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.925 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.925 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437132+0000", 2024-09-13T05:11:48.925 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:11:48.925 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.925 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.925 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.925 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437138+0000", 2024-09-13T05:11:48.925 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0419999999999999e-06 2024-09-13T05:11:48.925 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.925 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.925 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.925 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437143+0000", 2024-09-13T05:11:48.926 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0039999999999999e-06 2024-09-13T05:11:48.926 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.926 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.926 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.926 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.926 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.926 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118643 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.926 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.445206+0000", 2024-09-13T05:11:48.926 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0047935820000000002, 2024-09-13T05:11:48.926 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013485867, 2024-09-13T05:11:48.926 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.926 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.926 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.926 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.926 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.927 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118643 2024-09-13T05:11:48.927 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.927 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.927 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.927 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.927 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445206+0000", 2024-09-13T05:11:48.927 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.927 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.927 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.927 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.927 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445206+0000", 2024-09-13T05:11:48.927 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.927 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.927 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.928 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.928 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445205+0000", 2024-09-13T05:11:48.928 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.928 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.928 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.928 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.928 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445208+0000", 2024-09-13T05:11:48.928 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7580000000000001e-06 2024-09-13T05:11:48.928 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.928 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.928 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.928 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445214+0000", 2024-09-13T05:11:48.928 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8440000000000003e-06 2024-09-13T05:11:48.928 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.929 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.929 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.929 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445219+0000", 2024-09-13T05:11:48.929 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7829999999999998e-06 2024-09-13T05:11:48.929 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.929 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.929 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.929 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.929 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118712 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.929 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.453160+0000", 2024-09-13T05:11:48.929 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.996839, 2024-09-13T05:11:48.929 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0055957810000000002, 2024-09-13T05:11:48.929 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.930 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.930 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.930 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.930 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.930 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118712 2024-09-13T05:11:48.930 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.930 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.930 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.930 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.930 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453160+0000", 2024-09-13T05:11:48.930 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.930 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.930 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.931 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.931 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453160+0000", 2024-09-13T05:11:48.931 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.931 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.931 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.931 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.931 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453160+0000", 2024-09-13T05:11:48.931 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.931 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.931 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.931 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.931 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453162+0000", 2024-09-13T05:11:48.931 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4889999999999998e-06 2024-09-13T05:11:48.931 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.931 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.932 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.932 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453167+0000", 2024-09-13T05:11:48.932 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4399999999999996e-06 2024-09-13T05:11:48.932 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.932 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.932 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.932 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453173+0000", 2024-09-13T05:11:48.932 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0599999999999998e-06 2024-09-13T05:11:48.932 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.932 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.932 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.932 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.932 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.932 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118482 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.933 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.405100+0000", 2024-09-13T05:11:48.933 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.044899491, 2024-09-13T05:11:48.933 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.053952903000000003, 2024-09-13T05:11:48.933 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.933 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.933 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.933 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.933 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.933 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118482 2024-09-13T05:11:48.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.933 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.933 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.933 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405100+0000", 2024-09-13T05:11:48.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.934 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.934 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405100+0000", 2024-09-13T05:11:48.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.934 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.934 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405099+0000", 2024-09-13T05:11:48.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.934 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.935 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.935 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405102+0000", 2024-09-13T05:11:48.935 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9119999999999998e-06 2024-09-13T05:11:48.935 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.935 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.935 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.935 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405109+0000", 2024-09-13T05:11:48.935 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0319999999999998e-06 2024-09-13T05:11:48.935 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.935 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.935 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.935 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405114+0000", 2024-09-13T05:11:48.935 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9339999999999997e-06 2024-09-13T05:11:48.935 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.936 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.936 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.936 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.936 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.936 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118514 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.936 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.409160+0000", 2024-09-13T05:11:48.936 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.040839286000000002, 2024-09-13T05:11:48.936 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.049959287999999998, 2024-09-13T05:11:48.936 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.936 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.936 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.936 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.936 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.936 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118514 2024-09-13T05:11:48.937 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.937 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.937 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.937 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.937 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409160+0000", 2024-09-13T05:11:48.937 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.937 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.937 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.937 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.937 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409160+0000", 2024-09-13T05:11:48.937 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.937 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.937 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.938 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.938 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409160+0000", 2024-09-13T05:11:48.938 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:48.938 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.938 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.938 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.938 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409161+0000", 2024-09-13T05:11:48.938 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1930000000000001e-06 2024-09-13T05:11:48.938 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.938 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.938 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.938 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409164+0000", 2024-09-13T05:11:48.938 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8380000000000002e-06 2024-09-13T05:11:48.938 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.939 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.939 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.939 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409166+0000", 2024-09-13T05:11:48.939 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.345e-06 2024-09-13T05:11:48.939 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.939 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.939 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.939 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.939 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.939 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118546 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.939 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.421142+0000", 2024-09-13T05:11:48.939 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.028857602999999999, 2024-09-13T05:11:48.939 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038041572000000003, 2024-09-13T05:11:48.939 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.940 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.940 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.940 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.940 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.940 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118546 2024-09-13T05:11:48.940 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.940 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.940 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.940 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.940 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421142+0000", 2024-09-13T05:11:48.940 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.940 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.940 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.941 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.941 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421142+0000", 2024-09-13T05:11:48.941 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.941 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.941 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.941 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.941 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.417383+0000", 2024-09-13T05:11:48.941 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9962411 2024-09-13T05:11:48.941 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.941 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.941 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.941 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421162+0000", 2024-09-13T05:11:48.941 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003779297 2024-09-13T05:11:48.942 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.942 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.942 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.942 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421184+0000", 2024-09-13T05:11:48.942 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1753999999999999e-05 2024-09-13T05:11:48.942 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.942 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.942 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.942 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421195+0000", 2024-09-13T05:11:48.942 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1107999999999999e-05 2024-09-13T05:11:48.942 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.942 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.942 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.942 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.943 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118578 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.943 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.429302+0000", 2024-09-13T05:11:48.943 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.020697594, 2024-09-13T05:11:48.943 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.029949646999999999, 2024-09-13T05:11:48.943 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.943 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.943 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.943 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.943 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.943 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118578 2024-09-13T05:11:48.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.943 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.944 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429302+0000", 2024-09-13T05:11:48.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.944 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429302+0000", 2024-09-13T05:11:48.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.944 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429301+0000", 2024-09-13T05:11:48.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.945 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.945 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.945 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.945 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429305+0000", 2024-09-13T05:11:48.945 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4400000000000001e-06 2024-09-13T05:11:48.945 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.945 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.945 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.945 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429311+0000", 2024-09-13T05:11:48.945 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3419999999999996e-06 2024-09-13T05:11:48.945 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.945 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.945 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.945 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429316+0000", 2024-09-13T05:11:48.946 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.288e-06 2024-09-13T05:11:48.946 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.946 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.946 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.946 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.946 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.946 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118612 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.946 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.437149+0000", 2024-09-13T05:11:48.946 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.012850360999999999, 2024-09-13T05:11:48.946 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.022165316000000001, 2024-09-13T05:11:48.946 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.946 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.946 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.946 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.947 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.947 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118612 2024-09-13T05:11:48.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.947 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.947 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.947 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.947 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437149+0000", 2024-09-13T05:11:48.947 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.947 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.947 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.947 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437149+0000", 2024-09-13T05:11:48.947 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.948 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.948 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437148+0000", 2024-09-13T05:11:48.948 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.948 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.948 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437151+0000", 2024-09-13T05:11:48.948 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.672e-06 2024-09-13T05:11:48.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.948 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.948 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437156+0000", 2024-09-13T05:11:48.948 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3020000000000002e-06 2024-09-13T05:11:48.949 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.949 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.949 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.949 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437161+0000", 2024-09-13T05:11:48.949 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.814e-06 2024-09-13T05:11:48.949 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.949 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.949 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.949 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.949 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.949 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118644 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.949 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.445223+0000", 2024-09-13T05:11:48.949 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0047763739999999999, 2024-09-13T05:11:48.949 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.014157378999999999, 2024-09-13T05:11:48.950 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.950 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.950 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.950 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.950 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.950 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118644 2024-09-13T05:11:48.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.950 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.950 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.950 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445223+0000", 2024-09-13T05:11:48.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.951 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.951 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445223+0000", 2024-09-13T05:11:48.951 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.951 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.951 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.951 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445222+0000", 2024-09-13T05:11:48.951 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.951 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.951 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.951 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445225+0000", 2024-09-13T05:11:48.951 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7250000000000002e-06 2024-09-13T05:11:48.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.952 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.952 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445231+0000", 2024-09-13T05:11:48.952 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4990000000000002e-06 2024-09-13T05:11:48.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.952 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.952 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445235+0000", 2024-09-13T05:11:48.952 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.724e-06 2024-09-13T05:11:48.952 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.952 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.952 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.953 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118713 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.953 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.453177+0000", 2024-09-13T05:11:48.953 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9968224, 2024-09-13T05:11:48.953 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0062704459999999998, 2024-09-13T05:11:48.953 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.953 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.953 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.953 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.953 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.953 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118713 2024-09-13T05:11:48.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.953 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.953 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453177+0000", 2024-09-13T05:11:48.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453177+0000", 2024-09-13T05:11:48.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453176+0000", 2024-09-13T05:11:48.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.955 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453179+0000", 2024-09-13T05:11:48.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7530000000000002e-06 2024-09-13T05:11:48.955 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.955 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.955 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.955 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453184+0000", 2024-09-13T05:11:48.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1880000000000001e-06 2024-09-13T05:11:48.955 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.955 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.955 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.955 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453189+0000", 2024-09-13T05:11:48.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7979999999999996e-06 2024-09-13T05:11:48.955 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.955 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.956 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.956 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.956 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.956 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118483 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.956 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.405119+0000", 2024-09-13T05:11:48.956 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.044880354999999997, 2024-09-13T05:11:48.956 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.054398608000000001, 2024-09-13T05:11:48.956 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.956 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.956 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.956 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.957 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.957 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118483 2024-09-13T05:11:48.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.957 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.957 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405119+0000", 2024-09-13T05:11:48.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.957 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405119+0000", 2024-09-13T05:11:48.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405118+0000", 2024-09-13T05:11:48.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405121+0000", 2024-09-13T05:11:48.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3810000000000002e-06 2024-09-13T05:11:48.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.959 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405130+0000", 2024-09-13T05:11:48.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5289999999999997e-06 2024-09-13T05:11:48.959 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.959 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.959 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405136+0000", 2024-09-13T05:11:48.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1789999999999999e-06 2024-09-13T05:11:48.959 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.959 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.959 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.959 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.959 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118515 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.959 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.409168+0000", 2024-09-13T05:11:48.959 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.040831014999999998, 2024-09-13T05:11:48.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.050415698000000002, 2024-09-13T05:11:48.960 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.960 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.960 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.960 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.960 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.960 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118515 2024-09-13T05:11:48.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.960 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409168+0000", 2024-09-13T05:11:48.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409168+0000", 2024-09-13T05:11:48.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409168+0000", 2024-09-13T05:11:48.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:48.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409169+0000", 2024-09-13T05:11:48.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2109999999999999e-06 2024-09-13T05:11:48.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409172+0000", 2024-09-13T05:11:48.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7300000000000001e-06 2024-09-13T05:11:48.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409175+0000", 2024-09-13T05:11:48.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.858e-06 2024-09-13T05:11:48.962 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.962 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.962 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.963 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118547 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.963 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.421205+0000", 2024-09-13T05:11:48.963 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.028794686, 2024-09-13T05:11:48.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038444844999999998, 2024-09-13T05:11:48.963 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.963 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.963 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.963 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.963 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.963 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118547 2024-09-13T05:11:48.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.963 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421205+0000", 2024-09-13T05:11:48.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421205+0000", 2024-09-13T05:11:48.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421204+0000", 2024-09-13T05:11:48.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:48.965 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.965 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.965 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.965 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421208+0000", 2024-09-13T05:11:48.965 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3630000000000004e-06 2024-09-13T05:11:48.965 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.965 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.965 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.965 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421217+0000", 2024-09-13T05:11:48.965 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6819999999999992e-06 2024-09-13T05:11:48.965 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.965 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.965 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.965 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421224+0000", 2024-09-13T05:11:48.965 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3560000000000004e-06 2024-09-13T05:11:48.966 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.966 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.966 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.966 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.966 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.966 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118579 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.966 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.429321+0000", 2024-09-13T05:11:48.966 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.020678414999999999, 2024-09-13T05:11:48.966 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.030393144, 2024-09-13T05:11:48.966 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.966 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.966 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.966 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.966 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.967 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118579 2024-09-13T05:11:48.967 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.967 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.967 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429321+0000", 2024-09-13T05:11:48.967 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.967 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.967 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429321+0000", 2024-09-13T05:11:48.967 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.967 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.968 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429320+0000", 2024-09-13T05:11:48.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.968 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.968 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429323+0000", 2024-09-13T05:11:48.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8109999999999999e-06 2024-09-13T05:11:48.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.968 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.968 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429329+0000", 2024-09-13T05:11:48.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9519999999999999e-06 2024-09-13T05:11:48.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.969 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.969 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429335+0000", 2024-09-13T05:11:48.969 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.49e-06 2024-09-13T05:11:48.969 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.969 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.969 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.969 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118613 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.969 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.437165+0000", 2024-09-13T05:11:48.969 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.012834213000000001, 2024-09-13T05:11:48.969 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.022614685999999998, 2024-09-13T05:11:48.969 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.970 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.970 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.970 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.970 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.970 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118613 2024-09-13T05:11:48.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.970 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.970 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.970 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437165+0000", 2024-09-13T05:11:48.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.970 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437165+0000", 2024-09-13T05:11:48.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.971 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.971 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437165+0000", 2024-09-13T05:11:48.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.971 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.971 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437167+0000", 2024-09-13T05:11:48.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.593e-06 2024-09-13T05:11:48.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.971 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.972 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.972 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437173+0000", 2024-09-13T05:11:48.972 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4729999999999999e-06 2024-09-13T05:11:48.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.972 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.972 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.972 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437177+0000", 2024-09-13T05:11:48.972 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7010000000000004e-06 2024-09-13T05:11:48.972 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.972 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.972 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.972 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.972 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118645 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.973 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.445239+0000", 2024-09-13T05:11:48.973 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0047598609999999998, 2024-09-13T05:11:48.973 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.014603167, 2024-09-13T05:11:48.973 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.973 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.973 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.973 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.973 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.973 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118645 2024-09-13T05:11:48.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.973 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.973 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.974 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445239+0000", 2024-09-13T05:11:48.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.974 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.974 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445239+0000", 2024-09-13T05:11:48.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445239+0000", 2024-09-13T05:11:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445246+0000", 2024-09-13T05:11:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6529999999999997e-06 2024-09-13T05:11:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445252+0000", 2024-09-13T05:11:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9750000000000004e-06 2024-09-13T05:11:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.975 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.976 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.976 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445257+0000", 2024-09-13T05:11:48.976 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0490000000000003e-06 2024-09-13T05:11:48.976 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.976 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.976 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.976 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.976 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.976 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118714 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.977 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.453193+0000", 2024-09-13T05:11:48.977 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9968057, 2024-09-13T05:11:48.977 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0067191070000000002, 2024-09-13T05:11:48.977 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.977 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.977 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.977 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.977 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.977 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118714 2024-09-13T05:11:48.977 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.977 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.977 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.977 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453193+0000", 2024-09-13T05:11:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453193+0000", 2024-09-13T05:11:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453193+0000", 2024-09-13T05:11:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453195+0000", 2024-09-13T05:11:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6860000000000002e-06 2024-09-13T05:11:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453201+0000", 2024-09-13T05:11:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4550000000000003e-06 2024-09-13T05:11:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453206+0000", 2024-09-13T05:11:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.741e-06 2024-09-13T05:11:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118484 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 743424~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.405141+0000", 2024-09-13T05:11:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.044858149999999999, 2024-09-13T05:11:48.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.054850641999999998, 2024-09-13T05:11:48.981 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.981 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:48.981 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.981 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.981 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.981 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118484 2024-09-13T05:11:48.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.981 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405141+0000", 2024-09-13T05:11:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405141+0000", 2024-09-13T05:11:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405141+0000", 2024-09-13T05:11:48.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.983 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.983 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405143+0000", 2024-09-13T05:11:48.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:11:48.983 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.983 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405154+0000", 2024-09-13T05:11:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0210999999999999e-05 2024-09-13T05:11:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.405158+0000", 2024-09-13T05:11:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7790000000000003e-06 2024-09-13T05:11:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.459962+0000", 2024-09-13T05:11:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.054803785000000001 2024-09-13T05:11:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.460001+0000", 2024-09-13T05:11:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9016e-05 2024-09-13T05:11:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118516 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.409177+0000", 2024-09-13T05:11:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.040822308000000002, 2024-09-13T05:11:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.050905904000000002, 2024-09-13T05:11:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118516 2024-09-13T05:11:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409177+0000", 2024-09-13T05:11:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409177+0000", 2024-09-13T05:11:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409177+0000", 2024-09-13T05:11:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409178+0000", 2024-09-13T05:11:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3519999999999999e-06 2024-09-13T05:11:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409181+0000", 2024-09-13T05:11:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7920000000000001e-06 2024-09-13T05:11:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409183+0000", 2024-09-13T05:11:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3829999999999999e-06 2024-09-13T05:11:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118548 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.421230+0000", 2024-09-13T05:11:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.028768873, 2024-09-13T05:11:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038915087000000001, 2024-09-13T05:11:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118548 2024-09-13T05:11:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421230+0000", 2024-09-13T05:11:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421230+0000", 2024-09-13T05:11:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421230+0000", 2024-09-13T05:11:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421233+0000", 2024-09-13T05:11:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3119999999999998e-06 2024-09-13T05:11:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421241+0000", 2024-09-13T05:11:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.3559999999999993e-06 2024-09-13T05:11:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421250+0000", 2024-09-13T05:11:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7809999999999994e-06 2024-09-13T05:11:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118580 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.429339+0000", 2024-09-13T05:11:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.020659917, 2024-09-13T05:11:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.030872058000000001, 2024-09-13T05:11:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118580 2024-09-13T05:11:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429339+0000", 2024-09-13T05:11:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429339+0000", 2024-09-13T05:11:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429339+0000", 2024-09-13T05:11:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429342+0000", 2024-09-13T05:11:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6450000000000001e-06 2024-09-13T05:11:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429348+0000", 2024-09-13T05:11:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0419999999999999e-06 2024-09-13T05:11:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429353+0000", 2024-09-13T05:11:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3249999999999998e-06 2024-09-13T05:11:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118614 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.437182+0000", 2024-09-13T05:11:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.012817487000000001, 2024-09-13T05:11:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.023094818, 2024-09-13T05:11:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118614 2024-09-13T05:11:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437182+0000", 2024-09-13T05:11:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437182+0000", 2024-09-13T05:11:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437181+0000", 2024-09-13T05:11:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437184+0000", 2024-09-13T05:11:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5359999999999999e-06 2024-09-13T05:11:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437189+0000", 2024-09-13T05:11:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4430000000000002e-06 2024-09-13T05:11:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437194+0000", 2024-09-13T05:11:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7940000000000002e-06 2024-09-13T05:11:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118646 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.445261+0000", 2024-09-13T05:11:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0047382129999999998, 2024-09-13T05:11:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.015078596999999999, 2024-09-13T05:11:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118646 2024-09-13T05:11:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445261+0000", 2024-09-13T05:11:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445261+0000", 2024-09-13T05:11:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445261+0000", 2024-09-13T05:11:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445263+0000", 2024-09-13T05:11:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:11:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445268+0000", 2024-09-13T05:11:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3040000000000004e-06 2024-09-13T05:11:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445273+0000", 2024-09-13T05:11:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8130000000000003e-06 2024-09-13T05:11:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118715 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.453210+0000", 2024-09-13T05:11:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.996789, 2024-09-13T05:11:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0071988030000000001, 2024-09-13T05:11:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118715 2024-09-13T05:11:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453210+0000", 2024-09-13T05:11:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453210+0000", 2024-09-13T05:11:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453210+0000", 2024-09-13T05:11:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453212+0000", 2024-09-13T05:11:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.554e-06 2024-09-13T05:11:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453217+0000", 2024-09-13T05:11:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2009999999999998e-06 2024-09-13T05:11:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453224+0000", 2024-09-13T05:11:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3770000000000001e-06 2024-09-13T05:11:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.005 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118517 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.005 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.413158+0000", 2024-09-13T05:11:49.005 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.036841435999999998, 2024-09-13T05:11:49.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.047317377000000001, 2024-09-13T05:11:49.005 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.005 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.005 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.005 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.005 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118517 2024-09-13T05:11:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413158+0000", 2024-09-13T05:11:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413158+0000", 2024-09-13T05:11:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.409185+0000", 2024-09-13T05:11:49.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9960275 2024-09-13T05:11:49.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413165+0000", 2024-09-13T05:11:49.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0039792910000000003 2024-09-13T05:11:49.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413189+0000", 2024-09-13T05:11:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4890999999999999e-05 2024-09-13T05:11:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413199+0000", 2024-09-13T05:11:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9790000000000005e-06 2024-09-13T05:11:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118549 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.009 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.421257+0000", 2024-09-13T05:11:49.009 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.028742383999999999, 2024-09-13T05:11:49.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.039287504000000001, 2024-09-13T05:11:49.009 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.009 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.009 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.009 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.009 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.009 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118549 2024-09-13T05:11:49.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421257+0000", 2024-09-13T05:11:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421257+0000", 2024-09-13T05:11:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.011 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.011 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421256+0000", 2024-09-13T05:11:49.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.011 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.011 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421260+0000", 2024-09-13T05:11:49.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5729999999999999e-06 2024-09-13T05:11:49.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.011 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421269+0000", 2024-09-13T05:11:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8459999999999997e-06 2024-09-13T05:11:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421276+0000", 2024-09-13T05:11:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9120000000000001e-06 2024-09-13T05:11:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118581 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.429357+0000", 2024-09-13T05:11:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.020642038000000001, 2024-09-13T05:11:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031250342, 2024-09-13T05:11:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118581 2024-09-13T05:11:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.014 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.014 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.014 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429357+0000", 2024-09-13T05:11:49.014 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.014 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.014 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429357+0000", 2024-09-13T05:11:49.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429357+0000", 2024-09-13T05:11:49.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429359+0000", 2024-09-13T05:11:49.016 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6529999999999998e-06 2024-09-13T05:11:49.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.016 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.016 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429366+0000", 2024-09-13T05:11:49.016 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0939999999999996e-06 2024-09-13T05:11:49.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.016 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.016 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429371+0000", 2024-09-13T05:11:49.017 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0440000000000003e-06 2024-09-13T05:11:49.017 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.017 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.017 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.017 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.017 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118615 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.017 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.437198+0000", 2024-09-13T05:11:49.017 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.012801144, 2024-09-13T05:11:49.017 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.023476535999999999, 2024-09-13T05:11:49.017 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118615 2024-09-13T05:11:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437198+0000", 2024-09-13T05:11:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437198+0000", 2024-09-13T05:11:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437198+0000", 2024-09-13T05:11:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437200+0000", 2024-09-13T05:11:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5059999999999998e-06 2024-09-13T05:11:49.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.020 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.020 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437206+0000", 2024-09-13T05:11:49.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6570000000000002e-06 2024-09-13T05:11:49.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.020 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.020 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437210+0000", 2024-09-13T05:11:49.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5310000000000003e-06 2024-09-13T05:11:49.020 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.020 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.020 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.021 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118647 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.021 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.445277+0000", 2024-09-13T05:11:49.021 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0047217609999999997, 2024-09-13T05:11:49.021 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.015461397, 2024-09-13T05:11:49.021 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.021 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.021 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.021 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.021 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.021 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118647 2024-09-13T05:11:49.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.021 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445277+0000", 2024-09-13T05:11:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445277+0000", 2024-09-13T05:11:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445277+0000", 2024-09-13T05:11:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445280+0000", 2024-09-13T05:11:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2150000000000001e-06 2024-09-13T05:11:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445285+0000", 2024-09-13T05:11:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0560000000000004e-06 2024-09-13T05:11:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445290+0000", 2024-09-13T05:11:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6469999999999997e-06 2024-09-13T05:11:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118717 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.453228+0000", 2024-09-13T05:11:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9967713, 2024-09-13T05:11:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0075779159999999996, 2024-09-13T05:11:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118717 2024-09-13T05:11:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453228+0000", 2024-09-13T05:11:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453228+0000", 2024-09-13T05:11:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453227+0000", 2024-09-13T05:11:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453230+0000", 2024-09-13T05:11:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4540000000000001e-06 2024-09-13T05:11:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453235+0000", 2024-09-13T05:11:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4380000000000003e-06 2024-09-13T05:11:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453240+0000", 2024-09-13T05:11:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6820000000000002e-06 2024-09-13T05:11:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118518 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.413210+0000", 2024-09-13T05:11:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.036788916999999997, 2024-09-13T05:11:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.047660736000000002, 2024-09-13T05:11:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118518 2024-09-13T05:11:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413210+0000", 2024-09-13T05:11:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413210+0000", 2024-09-13T05:11:49.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413209+0000", 2024-09-13T05:11:49.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:49.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413214+0000", 2024-09-13T05:11:49.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2050000000000001e-06 2024-09-13T05:11:49.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413232+0000", 2024-09-13T05:11:49.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7861999999999999e-05 2024-09-13T05:11:49.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.030 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413239+0000", 2024-09-13T05:11:49.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1640000000000004e-06 2024-09-13T05:11:49.030 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.030 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.030 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.030 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118550 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.030 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.421282+0000", 2024-09-13T05:11:49.030 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.028717678, 2024-09-13T05:11:49.031 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.039655487000000003, 2024-09-13T05:11:49.031 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.031 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.031 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.031 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.031 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.031 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118550 2024-09-13T05:11:49.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.031 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.031 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.031 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421282+0000", 2024-09-13T05:11:49.031 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421282+0000", 2024-09-13T05:11:49.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421281+0000", 2024-09-13T05:11:49.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421284+0000", 2024-09-13T05:11:49.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.326e-06 2024-09-13T05:11:49.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421293+0000", 2024-09-13T05:11:49.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4270000000000008e-06 2024-09-13T05:11:49.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421299+0000", 2024-09-13T05:11:49.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.601e-06 2024-09-13T05:11:49.033 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.033 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.033 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.033 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118582 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.034 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.429375+0000", 2024-09-13T05:11:49.034 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.020623823999999999, 2024-09-13T05:11:49.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031643188000000003, 2024-09-13T05:11:49.034 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.034 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.034 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.034 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.034 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.034 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118582 2024-09-13T05:11:49.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.034 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429375+0000", 2024-09-13T05:11:49.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.035 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429375+0000", 2024-09-13T05:11:49.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.035 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429375+0000", 2024-09-13T05:11:49.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.036 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429378+0000", 2024-09-13T05:11:49.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8559999999999998e-06 2024-09-13T05:11:49.036 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.036 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.036 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.036 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429384+0000", 2024-09-13T05:11:49.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0419999999999999e-06 2024-09-13T05:11:49.036 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.036 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.036 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.036 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429389+0000", 2024-09-13T05:11:49.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0660000000000003e-06 2024-09-13T05:11:49.036 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.037 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.037 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.037 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118616 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.037 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.437214+0000", 2024-09-13T05:11:49.037 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.012784726, 2024-09-13T05:11:49.037 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.023870236999999999, 2024-09-13T05:11:49.037 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.037 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.037 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.037 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.037 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.037 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118616 2024-09-13T05:11:49.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.038 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437214+0000", 2024-09-13T05:11:49.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437214+0000", 2024-09-13T05:11:49.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437214+0000", 2024-09-13T05:11:49.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437217+0000", 2024-09-13T05:11:49.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5459999999999998e-06 2024-09-13T05:11:49.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437222+0000", 2024-09-13T05:11:49.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3310000000000003e-06 2024-09-13T05:11:49.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437227+0000", 2024-09-13T05:11:49.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5329999999999996e-06 2024-09-13T05:11:49.040 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.040 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.040 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.040 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118648 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.040 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.445294+0000", 2024-09-13T05:11:49.040 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0047052960000000003, 2024-09-13T05:11:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.015853638, 2024-09-13T05:11:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118648 2024-09-13T05:11:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445294+0000", 2024-09-13T05:11:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445294+0000", 2024-09-13T05:11:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445294+0000", 2024-09-13T05:11:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445296+0000", 2024-09-13T05:11:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6340000000000001e-06 2024-09-13T05:11:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445302+0000", 2024-09-13T05:11:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3009999999999997e-06 2024-09-13T05:11:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445312+0000", 2024-09-13T05:11:49.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0698e-05 2024-09-13T05:11:49.044 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.044 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.044 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.044 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118718 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.044 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.453244+0000", 2024-09-13T05:11:49.044 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9967551, 2024-09-13T05:11:49.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0079688390000000001, 2024-09-13T05:11:49.044 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118718 2024-09-13T05:11:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453244+0000", 2024-09-13T05:11:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.046 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.046 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453244+0000", 2024-09-13T05:11:49.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.046 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.046 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453244+0000", 2024-09-13T05:11:49.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.046 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453246+0000", 2024-09-13T05:11:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5100000000000001e-06 2024-09-13T05:11:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453252+0000", 2024-09-13T05:11:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5110000000000003e-06 2024-09-13T05:11:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453259+0000", 2024-09-13T05:11:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1930000000000004e-06 2024-09-13T05:11:49.048 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.048 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.048 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.048 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118519 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.048 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.413247+0000", 2024-09-13T05:11:49.048 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.036752358999999998, 2024-09-13T05:11:49.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048016377999999998, 2024-09-13T05:11:49.048 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.048 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.049 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.049 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.049 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.049 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118519 2024-09-13T05:11:49.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.049 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.049 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413247+0000", 2024-09-13T05:11:49.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413247+0000", 2024-09-13T05:11:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413246+0000", 2024-09-13T05:11:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413250+0000", 2024-09-13T05:11:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:11:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413258+0000", 2024-09-13T05:11:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2009999999999999e-06 2024-09-13T05:11:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413265+0000", 2024-09-13T05:11:49.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4960000000000001e-06 2024-09-13T05:11:49.052 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.052 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.052 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.052 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118551 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.052 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.421306+0000", 2024-09-13T05:11:49.053 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.028693699, 2024-09-13T05:11:49.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.039983584000000003, 2024-09-13T05:11:49.053 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.053 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.053 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.053 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.053 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.053 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118551 2024-09-13T05:11:49.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.053 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.053 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.053 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421306+0000", 2024-09-13T05:11:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421306+0000", 2024-09-13T05:11:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421305+0000", 2024-09-13T05:11:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421308+0000", 2024-09-13T05:11:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3129999999999999e-06 2024-09-13T05:11:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421317+0000", 2024-09-13T05:11:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2460000000000003e-06 2024-09-13T05:11:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421323+0000", 2024-09-13T05:11:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9280000000000004e-06 2024-09-13T05:11:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118583 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.429398+0000", 2024-09-13T05:11:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.020601120000000001, 2024-09-13T05:11:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031918396000000002, 2024-09-13T05:11:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118583 2024-09-13T05:11:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429398+0000", 2024-09-13T05:11:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429398+0000", 2024-09-13T05:11:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429398+0000", 2024-09-13T05:11:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429401+0000", 2024-09-13T05:11:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9469999999999999e-06 2024-09-13T05:11:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429407+0000", 2024-09-13T05:11:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6780000000000003e-06 2024-09-13T05:11:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429414+0000", 2024-09-13T05:11:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7009999999999999e-06 2024-09-13T05:11:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118617 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.437231+0000", 2024-09-13T05:11:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.012768610999999999, 2024-09-13T05:11:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.024114126, 2024-09-13T05:11:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118617 2024-09-13T05:11:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437231+0000", 2024-09-13T05:11:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437231+0000", 2024-09-13T05:11:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437230+0000", 2024-09-13T05:11:49.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437233+0000", 2024-09-13T05:11:49.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4439999999999998e-06 2024-09-13T05:11:49.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437239+0000", 2024-09-13T05:11:49.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2689999999999996e-06 2024-09-13T05:11:49.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437244+0000", 2024-09-13T05:11:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5669999999999996e-06 2024-09-13T05:11:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118649 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.445316+0000", 2024-09-13T05:11:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0046830680000000003, 2024-09-13T05:11:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.016056991999999999, 2024-09-13T05:11:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118649 2024-09-13T05:11:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445316+0000", 2024-09-13T05:11:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445316+0000", 2024-09-13T05:11:49.064 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.064 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.064 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.064 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.064 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445316+0000", 2024-09-13T05:11:49.064 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.064 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.064 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.064 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.064 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445318+0000", 2024-09-13T05:11:49.064 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.418e-06 2024-09-13T05:11:49.064 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.064 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445324+0000", 2024-09-13T05:11:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4859999999999997e-06 2024-09-13T05:11:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445328+0000", 2024-09-13T05:11:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3680000000000004e-06 2024-09-13T05:11:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118719 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.453264+0000", 2024-09-13T05:11:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9967356, 2024-09-13T05:11:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0081358249999999993, 2024-09-13T05:11:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118719 2024-09-13T05:11:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453264+0000", 2024-09-13T05:11:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453264+0000", 2024-09-13T05:11:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453263+0000", 2024-09-13T05:11:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453266+0000", 2024-09-13T05:11:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.407e-06 2024-09-13T05:11:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453271+0000", 2024-09-13T05:11:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2959999999999998e-06 2024-09-13T05:11:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453275+0000", 2024-09-13T05:11:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5460000000000002e-06 2024-09-13T05:11:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118520 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.413270+0000", 2024-09-13T05:11:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.036728703000000001, 2024-09-13T05:11:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048158395, 2024-09-13T05:11:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118520 2024-09-13T05:11:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413270+0000", 2024-09-13T05:11:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413270+0000", 2024-09-13T05:11:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413270+0000", 2024-09-13T05:11:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413273+0000", 2024-09-13T05:11:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.219e-06 2024-09-13T05:11:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413282+0000", 2024-09-13T05:11:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8359999999999998e-06 2024-09-13T05:11:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413289+0000", 2024-09-13T05:11:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.934e-06 2024-09-13T05:11:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118552 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.421332+0000", 2024-09-13T05:11:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.028667555000000001, 2024-09-13T05:11:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040123332999999997, 2024-09-13T05:11:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118552 2024-09-13T05:11:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421332+0000", 2024-09-13T05:11:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421332+0000", 2024-09-13T05:11:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.074 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.074 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.074 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421331+0000", 2024-09-13T05:11:49.074 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.074 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.074 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.074 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421334+0000", 2024-09-13T05:11:49.074 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3749999999999999e-06 2024-09-13T05:11:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421342+0000", 2024-09-13T05:11:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9740000000000002e-06 2024-09-13T05:11:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421349+0000", 2024-09-13T05:11:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7440000000000001e-06 2024-09-13T05:11:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.076 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.076 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.076 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118585 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.076 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.429419+0000", 2024-09-13T05:11:49.076 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.020580594000000001, 2024-09-13T05:11:49.076 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032064742, 2024-09-13T05:11:49.076 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.076 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.076 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.076 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118585 2024-09-13T05:11:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429419+0000", 2024-09-13T05:11:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429419+0000", 2024-09-13T05:11:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.078 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.078 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429418+0000", 2024-09-13T05:11:49.078 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.078 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.078 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429421+0000", 2024-09-13T05:11:49.078 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8380000000000002e-06 2024-09-13T05:11:49.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429427+0000", 2024-09-13T05:11:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3060000000000003e-06 2024-09-13T05:11:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429433+0000", 2024-09-13T05:11:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8109999999999999e-06 2024-09-13T05:11:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.080 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.080 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118618 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.080 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.437248+0000", 2024-09-13T05:11:49.080 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.012751459, 2024-09-13T05:11:49.080 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.024261793, 2024-09-13T05:11:49.080 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.080 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.080 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.080 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.080 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.081 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118618 2024-09-13T05:11:49.081 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.081 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.081 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.081 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.081 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437248+0000", 2024-09-13T05:11:49.081 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.081 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.081 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.081 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.081 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437248+0000", 2024-09-13T05:11:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437247+0000", 2024-09-13T05:11:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437250+0000", 2024-09-13T05:11:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.667e-06 2024-09-13T05:11:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437257+0000", 2024-09-13T05:11:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:11:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437262+0000", 2024-09-13T05:11:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8620000000000002e-06 2024-09-13T05:11:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.084 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.084 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.084 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.084 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118650 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.084 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.445332+0000", 2024-09-13T05:11:49.084 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0046670410000000002, 2024-09-13T05:11:49.084 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.016204415999999999, 2024-09-13T05:11:49.084 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.084 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.085 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.085 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.085 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.085 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118650 2024-09-13T05:11:49.085 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.085 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.085 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.085 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.085 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445332+0000", 2024-09-13T05:11:49.085 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445332+0000", 2024-09-13T05:11:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445332+0000", 2024-09-13T05:11:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445334+0000", 2024-09-13T05:11:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4899999999999999e-06 2024-09-13T05:11:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445340+0000", 2024-09-13T05:11:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5040000000000002e-06 2024-09-13T05:11:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445345+0000", 2024-09-13T05:11:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9139999999999999e-06 2024-09-13T05:11:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118720 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.453279+0000", 2024-09-13T05:11:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9967198, 2024-09-13T05:11:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0082831190000000002, 2024-09-13T05:11:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118720 2024-09-13T05:11:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453279+0000", 2024-09-13T05:11:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453279+0000", 2024-09-13T05:11:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453279+0000", 2024-09-13T05:11:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.090 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.090 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.090 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.090 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453293+0000", 2024-09-13T05:11:49.090 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3565e-05 2024-09-13T05:11:49.090 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.090 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.090 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.090 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453299+0000", 2024-09-13T05:11:49.090 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0340000000000002e-06 2024-09-13T05:11:49.090 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.090 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.090 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.090 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453304+0000", 2024-09-13T05:11:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0579999999999997e-06 2024-09-13T05:11:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118521 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.413295+0000", 2024-09-13T05:11:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.036704332999999999, 2024-09-13T05:11:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048295474999999997, 2024-09-13T05:11:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118521 2024-09-13T05:11:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413295+0000", 2024-09-13T05:11:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413295+0000", 2024-09-13T05:11:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413294+0000", 2024-09-13T05:11:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413298+0000", 2024-09-13T05:11:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5590000000000001e-06 2024-09-13T05:11:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413307+0000", 2024-09-13T05:11:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3300000000000005e-06 2024-09-13T05:11:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413314+0000", 2024-09-13T05:11:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0659999999999998e-06 2024-09-13T05:11:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118553 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.421355+0000", 2024-09-13T05:11:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.028643806000000001, 2024-09-13T05:11:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040262680000000002, 2024-09-13T05:11:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118553 2024-09-13T05:11:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421355+0000", 2024-09-13T05:11:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421355+0000", 2024-09-13T05:11:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421355+0000", 2024-09-13T05:11:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421358+0000", 2024-09-13T05:11:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5580000000000001e-06 2024-09-13T05:11:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.097 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421367+0000", 2024-09-13T05:11:49.097 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.3350000000000007e-06 2024-09-13T05:11:49.097 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.097 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.097 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.097 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421373+0000", 2024-09-13T05:11:49.097 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6590000000000001e-06 2024-09-13T05:11:49.097 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.097 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.097 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.097 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.097 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.097 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118586 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.097 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.429439+0000", 2024-09-13T05:11:49.098 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.020560419, 2024-09-13T05:11:49.098 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032205175000000003, 2024-09-13T05:11:49.098 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.098 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.098 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.098 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.098 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.098 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118586 2024-09-13T05:11:49.098 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.098 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.098 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.098 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.098 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429439+0000", 2024-09-13T05:11:49.098 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.099 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.099 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.099 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.099 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429439+0000", 2024-09-13T05:11:49.099 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.099 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.099 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.099 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.099 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429438+0000", 2024-09-13T05:11:49.099 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.099 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.099 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.099 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.099 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429441+0000", 2024-09-13T05:11:49.100 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6359999999999998e-06 2024-09-13T05:11:49.100 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.100 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.100 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.100 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429447+0000", 2024-09-13T05:11:49.100 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1929999999999998e-06 2024-09-13T05:11:49.100 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.100 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.100 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.100 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429452+0000", 2024-09-13T05:11:49.100 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2349999999999999e-06 2024-09-13T05:11:49.100 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.100 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.100 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.101 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.101 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.101 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118619 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.101 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.437266+0000", 2024-09-13T05:11:49.101 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.012733214, 2024-09-13T05:11:49.101 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.024405262, 2024-09-13T05:11:49.101 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.101 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.101 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.101 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.101 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.101 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118619 2024-09-13T05:11:49.101 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.101 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.101 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.102 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.102 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437266+0000", 2024-09-13T05:11:49.102 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.102 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.102 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.102 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.102 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437266+0000", 2024-09-13T05:11:49.102 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.102 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.102 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.102 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.102 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437266+0000", 2024-09-13T05:11:49.102 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.102 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.103 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.103 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.103 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437268+0000", 2024-09-13T05:11:49.103 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.695e-06 2024-09-13T05:11:49.103 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.103 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.103 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.103 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437274+0000", 2024-09-13T05:11:49.103 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4410000000000001e-06 2024-09-13T05:11:49.103 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.103 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.103 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.103 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437279+0000", 2024-09-13T05:11:49.103 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7480000000000001e-06 2024-09-13T05:11:49.103 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.104 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.104 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.104 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.104 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.104 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118651 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.104 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.445374+0000", 2024-09-13T05:11:49.104 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.004625334, 2024-09-13T05:11:49.104 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.016323114999999999, 2024-09-13T05:11:49.104 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.104 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.104 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.104 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.104 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.105 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118651 2024-09-13T05:11:49.105 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.105 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.105 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.105 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.105 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445374+0000", 2024-09-13T05:11:49.105 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.105 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.105 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.105 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.105 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445374+0000", 2024-09-13T05:11:49.105 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.105 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.105 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.106 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.106 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445373+0000", 2024-09-13T05:11:49.106 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.106 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.106 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.106 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.106 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445376+0000", 2024-09-13T05:11:49.106 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9000000000000002e-06 2024-09-13T05:11:49.106 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.106 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.106 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.106 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445382+0000", 2024-09-13T05:11:49.107 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0260000000000004e-06 2024-09-13T05:11:49.107 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.107 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.107 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.107 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445387+0000", 2024-09-13T05:11:49.107 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5759999999999999e-06 2024-09-13T05:11:49.107 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.107 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.107 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.107 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.107 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.107 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118721 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.107 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.453318+0000", 2024-09-13T05:11:49.108 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9966817, 2024-09-13T05:11:49.108 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0084079010000000006, 2024-09-13T05:11:49.108 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.108 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.108 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.108 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.108 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.108 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118721 2024-09-13T05:11:49.108 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.108 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.108 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.108 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.108 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453318+0000", 2024-09-13T05:11:49.108 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.109 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.109 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.109 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.109 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453318+0000", 2024-09-13T05:11:49.109 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.109 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.109 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.109 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.109 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453317+0000", 2024-09-13T05:11:49.109 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.109 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.109 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.109 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.109 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453320+0000", 2024-09-13T05:11:49.110 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.168e-06 2024-09-13T05:11:49.110 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.110 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.110 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.110 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453326+0000", 2024-09-13T05:11:49.110 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3629999999999999e-06 2024-09-13T05:11:49.110 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.110 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.110 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.110 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453332+0000", 2024-09-13T05:11:49.110 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0690000000000001e-06 2024-09-13T05:11:49.110 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.110 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.110 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.110 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.111 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.111 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118522 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.111 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.413320+0000", 2024-09-13T05:11:49.111 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.036678794000000001, 2024-09-13T05:11:49.111 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048434049, 2024-09-13T05:11:49.111 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.111 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.111 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.111 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.111 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.111 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118522 2024-09-13T05:11:49.112 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.112 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.112 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.112 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.112 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413320+0000", 2024-09-13T05:11:49.112 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.112 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.112 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.112 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.112 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413320+0000", 2024-09-13T05:11:49.112 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.112 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.113 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.113 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.113 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413320+0000", 2024-09-13T05:11:49.113 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.113 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.113 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.113 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.113 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413330+0000", 2024-09-13T05:11:49.113 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6169999999999996e-06 2024-09-13T05:11:49.113 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.113 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.114 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.114 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413343+0000", 2024-09-13T05:11:49.114 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3076e-05 2024-09-13T05:11:49.114 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.114 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.114 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.114 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413350+0000", 2024-09-13T05:11:49.114 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3560000000000004e-06 2024-09-13T05:11:49.114 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.114 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.114 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.114 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.115 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.115 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118554 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.115 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.421379+0000", 2024-09-13T05:11:49.115 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.028620191, 2024-09-13T05:11:49.115 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040411321, 2024-09-13T05:11:49.115 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.115 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.115 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.115 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.115 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.115 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118554 2024-09-13T05:11:49.116 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.116 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.116 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.116 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.116 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421379+0000", 2024-09-13T05:11:49.116 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.116 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.116 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.116 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.116 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421379+0000", 2024-09-13T05:11:49.116 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.116 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.117 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.117 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.117 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421379+0000", 2024-09-13T05:11:49.117 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.117 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.117 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.117 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.117 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421382+0000", 2024-09-13T05:11:49.117 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.331e-06 2024-09-13T05:11:49.117 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.117 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.118 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.118 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421390+0000", 2024-09-13T05:11:49.118 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8709999999999997e-06 2024-09-13T05:11:49.118 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.118 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.118 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.118 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421396+0000", 2024-09-13T05:11:49.118 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6370000000000002e-06 2024-09-13T05:11:49.118 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.118 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.118 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.119 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.119 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.119 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118587 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.119 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.429495+0000", 2024-09-13T05:11:49.119 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.020504191000000001, 2024-09-13T05:11:49.119 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032321225000000002, 2024-09-13T05:11:49.119 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.119 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.119 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.119 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.120 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.120 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118587 2024-09-13T05:11:49.120 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.120 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.120 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.120 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.120 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429495+0000", 2024-09-13T05:11:49.120 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.120 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.121 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.121 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.121 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429495+0000", 2024-09-13T05:11:49.121 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.121 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.121 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.121 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.121 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429494+0000", 2024-09-13T05:11:49.121 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.121 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.121 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.122 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.122 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429498+0000", 2024-09-13T05:11:49.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.428e-06 2024-09-13T05:11:49.122 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.122 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.122 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.122 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429504+0000", 2024-09-13T05:11:49.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6460000000000004e-06 2024-09-13T05:11:49.122 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.122 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.122 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.122 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429510+0000", 2024-09-13T05:11:49.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4179999999999996e-06 2024-09-13T05:11:49.122 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.122 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.123 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.123 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.123 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.123 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118620 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.123 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.437313+0000", 2024-09-13T05:11:49.123 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.012686586999999999, 2024-09-13T05:11:49.123 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.024532445, 2024-09-13T05:11:49.123 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.123 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.123 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.123 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.123 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.123 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118620 2024-09-13T05:11:49.123 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.124 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.124 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.124 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.124 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437313+0000", 2024-09-13T05:11:49.124 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.124 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.124 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.124 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.124 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437313+0000", 2024-09-13T05:11:49.124 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.124 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.124 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.124 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.124 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437312+0000", 2024-09-13T05:11:49.124 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.125 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.125 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.125 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.125 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437315+0000", 2024-09-13T05:11:49.125 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0429999999999999e-06 2024-09-13T05:11:49.125 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.125 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.125 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.125 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437319+0000", 2024-09-13T05:11:49.125 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3320000000000002e-06 2024-09-13T05:11:49.125 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.125 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.125 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.125 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437324+0000", 2024-09-13T05:11:49.126 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9919999999999998e-06 2024-09-13T05:11:49.126 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.126 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.126 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.126 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.126 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.126 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118652 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.126 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.445391+0000", 2024-09-13T05:11:49.126 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0046081100000000003, 2024-09-13T05:11:49.126 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.016480201, 2024-09-13T05:11:49.126 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.126 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.126 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.126 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.126 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.127 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118652 2024-09-13T05:11:49.127 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.127 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.127 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.127 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.127 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445391+0000", 2024-09-13T05:11:49.127 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.127 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.127 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.127 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.127 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445391+0000", 2024-09-13T05:11:49.127 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.127 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.127 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.128 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.128 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445391+0000", 2024-09-13T05:11:49.128 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.128 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.128 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.128 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.128 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445393+0000", 2024-09-13T05:11:49.128 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.576e-06 2024-09-13T05:11:49.128 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.128 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.128 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.128 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445399+0000", 2024-09-13T05:11:49.128 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2140000000000001e-06 2024-09-13T05:11:49.128 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.129 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.129 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.129 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445404+0000", 2024-09-13T05:11:49.129 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9509999999999997e-06 2024-09-13T05:11:49.129 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.129 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.129 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.129 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.129 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118722 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.129 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.453336+0000", 2024-09-13T05:11:49.129 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9966626, 2024-09-13T05:11:49.129 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0085631040000000002, 2024-09-13T05:11:49.129 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.130 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.130 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.130 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.130 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.130 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118722 2024-09-13T05:11:49.130 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.130 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.130 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.130 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.130 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453336+0000", 2024-09-13T05:11:49.130 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.130 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.130 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.130 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.130 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453336+0000", 2024-09-13T05:11:49.131 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.131 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.131 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.131 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.131 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453336+0000", 2024-09-13T05:11:49.131 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.131 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.131 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.131 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.131 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453339+0000", 2024-09-13T05:11:49.131 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6299999999999998e-06 2024-09-13T05:11:49.131 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.131 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.131 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.132 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453344+0000", 2024-09-13T05:11:49.132 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0719999999999999e-06 2024-09-13T05:11:49.132 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.132 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.132 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.132 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453349+0000", 2024-09-13T05:11:49.132 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8910000000000003e-06 2024-09-13T05:11:49.132 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.132 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.132 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.132 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.132 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.132 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118523 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.132 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.413365+0000", 2024-09-13T05:11:49.133 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.036634187999999998, 2024-09-13T05:11:49.133 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048562602000000003, 2024-09-13T05:11:49.133 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.133 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.133 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.133 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.133 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.133 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118523 2024-09-13T05:11:49.133 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.133 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.133 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.133 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.133 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413365+0000", 2024-09-13T05:11:49.133 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.133 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.134 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.134 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.134 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413365+0000", 2024-09-13T05:11:49.134 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.134 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.134 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.134 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.134 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413364+0000", 2024-09-13T05:11:49.134 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:49.134 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.134 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.134 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.134 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413368+0000", 2024-09-13T05:11:49.134 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.907e-06 2024-09-13T05:11:49.134 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.135 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.135 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.135 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413384+0000", 2024-09-13T05:11:49.135 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5688999999999998e-05 2024-09-13T05:11:49.135 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.135 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.135 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.135 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413395+0000", 2024-09-13T05:11:49.135 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1459e-05 2024-09-13T05:11:49.135 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.135 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.135 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.135 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.135 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.135 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118555 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.136 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.421403+0000", 2024-09-13T05:11:49.136 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.028596204, 2024-09-13T05:11:49.136 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040553685999999999, 2024-09-13T05:11:49.136 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.136 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.136 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.136 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.136 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.136 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118555 2024-09-13T05:11:49.136 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.136 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.136 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.136 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.136 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421403+0000", 2024-09-13T05:11:49.137 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.137 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.137 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.137 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421403+0000", 2024-09-13T05:11:49.137 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.137 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.137 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.137 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421402+0000", 2024-09-13T05:11:49.137 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:49.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.137 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.137 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.138 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421406+0000", 2024-09-13T05:11:49.138 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4640000000000002e-06 2024-09-13T05:11:49.138 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.138 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.138 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.138 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421415+0000", 2024-09-13T05:11:49.138 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3039999999999994e-06 2024-09-13T05:11:49.138 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.138 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.138 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.138 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421423+0000", 2024-09-13T05:11:49.138 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5549999999999997e-06 2024-09-13T05:11:49.138 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.138 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.138 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.139 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.139 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.139 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118588 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.139 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.429517+0000", 2024-09-13T05:11:49.139 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.020482449, 2024-09-13T05:11:49.139 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032465798999999997, 2024-09-13T05:11:49.139 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.139 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.139 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.139 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.139 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.139 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118588 2024-09-13T05:11:49.139 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.139 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.140 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.140 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.140 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429517+0000", 2024-09-13T05:11:49.140 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.140 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.140 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.140 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.140 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429517+0000", 2024-09-13T05:11:49.140 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.140 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.140 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.140 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.140 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429516+0000", 2024-09-13T05:11:49.140 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.141 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.141 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.141 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.141 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429520+0000", 2024-09-13T05:11:49.141 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2169999999999999e-06 2024-09-13T05:11:49.141 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.141 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.141 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.141 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429526+0000", 2024-09-13T05:11:49.141 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.511e-06 2024-09-13T05:11:49.141 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.141 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.141 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.141 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429531+0000", 2024-09-13T05:11:49.142 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1039999999999998e-06 2024-09-13T05:11:49.142 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.142 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.142 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.142 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.142 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.142 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118621 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.142 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.437329+0000", 2024-09-13T05:11:49.142 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.012670561, 2024-09-13T05:11:49.142 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.024679698999999999, 2024-09-13T05:11:49.143 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.143 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.143 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.143 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.143 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.143 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118621 2024-09-13T05:11:49.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.143 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.143 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.143 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.143 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437329+0000", 2024-09-13T05:11:49.143 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.143 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.144 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.144 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437329+0000", 2024-09-13T05:11:49.144 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.144 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.144 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.144 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.144 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437328+0000", 2024-09-13T05:11:49.144 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.144 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.144 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.145 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.145 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437343+0000", 2024-09-13T05:11:49.145 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4778e-05 2024-09-13T05:11:49.145 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.145 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.145 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.145 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437352+0000", 2024-09-13T05:11:49.145 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7649999999999999e-06 2024-09-13T05:11:49.145 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.145 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.145 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.145 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437357+0000", 2024-09-13T05:11:49.145 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6119999999999998e-06 2024-09-13T05:11:49.145 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.146 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.146 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.146 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.146 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.146 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118653 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.146 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.445408+0000", 2024-09-13T05:11:49.146 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0045907350000000003, 2024-09-13T05:11:49.146 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.016627157, 2024-09-13T05:11:49.146 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.146 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.146 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.147 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.147 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.147 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118653 2024-09-13T05:11:49.147 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.147 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.147 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.147 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.147 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445408+0000", 2024-09-13T05:11:49.147 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.147 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.147 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.147 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.147 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445408+0000", 2024-09-13T05:11:49.148 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.148 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.148 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.148 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445408+0000", 2024-09-13T05:11:49.148 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.148 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.148 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.148 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445411+0000", 2024-09-13T05:11:49.148 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.661e-06 2024-09-13T05:11:49.149 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.149 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.149 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.149 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445416+0000", 2024-09-13T05:11:49.149 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.271e-06 2024-09-13T05:11:49.149 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.149 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.149 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.149 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445421+0000", 2024-09-13T05:11:49.149 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7999999999999998e-06 2024-09-13T05:11:49.149 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.149 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.149 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.150 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.150 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.150 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118723 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.150 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.453353+0000", 2024-09-13T05:11:49.150 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9966464, 2024-09-13T05:11:49.150 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0087088140000000005, 2024-09-13T05:11:49.150 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.150 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.150 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.150 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.150 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.150 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118723 2024-09-13T05:11:49.151 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.151 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.151 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.151 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.151 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453353+0000", 2024-09-13T05:11:49.151 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.151 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.151 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.151 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.151 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453353+0000", 2024-09-13T05:11:49.152 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.152 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.152 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.152 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.152 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453353+0000", 2024-09-13T05:11:49.152 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.152 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.152 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.152 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.152 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453355+0000", 2024-09-13T05:11:49.153 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.413e-06 2024-09-13T05:11:49.153 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.153 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.153 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.153 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453360+0000", 2024-09-13T05:11:49.153 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2639999999999999e-06 2024-09-13T05:11:49.153 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.153 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.153 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.154 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453365+0000", 2024-09-13T05:11:49.154 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7169999999999999e-06 2024-09-13T05:11:49.154 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.154 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.154 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.154 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.154 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118524 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.154 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.413403+0000", 2024-09-13T05:11:49.154 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.036596455, 2024-09-13T05:11:49.154 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048688314000000003, 2024-09-13T05:11:49.155 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.155 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.155 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.155 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.155 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.155 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118524 2024-09-13T05:11:49.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.155 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413403+0000", 2024-09-13T05:11:49.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.156 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413403+0000", 2024-09-13T05:11:49.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.156 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.156 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413402+0000", 2024-09-13T05:11:49.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.156 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.156 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413406+0000", 2024-09-13T05:11:49.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9179999999999996e-06 2024-09-13T05:11:49.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.157 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.157 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413420+0000", 2024-09-13T05:11:49.157 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4414e-05 2024-09-13T05:11:49.157 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.157 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.157 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413428+0000", 2024-09-13T05:11:49.157 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7510000000000008e-06 2024-09-13T05:11:49.157 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.157 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.157 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.157 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.157 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118556 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.158 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.421429+0000", 2024-09-13T05:11:49.158 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.028570410000000001, 2024-09-13T05:11:49.158 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040688385000000001, 2024-09-13T05:11:49.158 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.158 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.158 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.158 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.158 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.158 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118556 2024-09-13T05:11:49.158 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.158 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.158 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.158 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.158 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421429+0000", 2024-09-13T05:11:49.159 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.159 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.159 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.159 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421429+0000", 2024-09-13T05:11:49.159 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.159 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.159 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.159 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421428+0000", 2024-09-13T05:11:49.159 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.159 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.159 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421432+0000", 2024-09-13T05:11:49.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5530000000000001e-06 2024-09-13T05:11:49.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421440+0000", 2024-09-13T05:11:49.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7889999999999995e-06 2024-09-13T05:11:49.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421447+0000", 2024-09-13T05:11:49.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9550000000000003e-06 2024-09-13T05:11:49.160 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.160 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.160 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.161 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118589 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.161 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.429537+0000", 2024-09-13T05:11:49.161 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.020462109999999999, 2024-09-13T05:11:49.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032609001999999998, 2024-09-13T05:11:49.161 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.161 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.161 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.161 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.161 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.161 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118589 2024-09-13T05:11:49.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.161 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.162 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.162 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.162 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429537+0000", 2024-09-13T05:11:49.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.162 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.162 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.162 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.162 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429537+0000", 2024-09-13T05:11:49.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.162 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.162 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.162 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.162 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429537+0000", 2024-09-13T05:11:49.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.163 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.163 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429539+0000", 2024-09-13T05:11:49.163 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:11:49.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.163 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.163 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429545+0000", 2024-09-13T05:11:49.163 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9850000000000003e-06 2024-09-13T05:11:49.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.163 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.163 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429551+0000", 2024-09-13T05:11:49.164 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3469999999999998e-06 2024-09-13T05:11:49.164 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.164 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.164 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.164 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.164 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.164 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118622 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.164 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.437362+0000", 2024-09-13T05:11:49.164 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.012637035, 2024-09-13T05:11:49.164 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.024811362, 2024-09-13T05:11:49.164 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.164 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.164 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.164 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.165 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.165 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118622 2024-09-13T05:11:49.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.165 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.165 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.165 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437362+0000", 2024-09-13T05:11:49.165 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.165 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.165 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437362+0000", 2024-09-13T05:11:49.165 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.166 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.166 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437362+0000", 2024-09-13T05:11:49.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.166 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.166 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.166 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437365+0000", 2024-09-13T05:11:49.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9859999999999999e-06 2024-09-13T05:11:49.166 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.166 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.166 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437370+0000", 2024-09-13T05:11:49.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5999999999999997e-06 2024-09-13T05:11:49.167 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.167 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.167 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437375+0000", 2024-09-13T05:11:49.167 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6659999999999999e-06 2024-09-13T05:11:49.167 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.167 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.167 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.167 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.167 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118691 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.167 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.448960+0000", 2024-09-13T05:11:49.167 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0010391420000000001, 2024-09-13T05:11:49.167 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013240681000000001, 2024-09-13T05:11:49.168 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.168 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.168 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.168 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.168 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.168 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118691 2024-09-13T05:11:49.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.168 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.168 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.168 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.168 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.448960+0000", 2024-09-13T05:11:49.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.448960+0000", 2024-09-13T05:11:49.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.445424+0000", 2024-09-13T05:11:49.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9964643 2024-09-13T05:11:49.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.448963+0000", 2024-09-13T05:11:49.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0035389559999999998 2024-09-13T05:11:49.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.448971+0000", 2024-09-13T05:11:49.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.588e-06 2024-09-13T05:11:49.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.448977+0000", 2024-09-13T05:11:49.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5379999999999999e-06 2024-09-13T05:11:49.170 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.170 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.170 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.170 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118724 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.171 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.453369+0000", 2024-09-13T05:11:49.171 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9966302, 2024-09-13T05:11:49.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0088578259999999992, 2024-09-13T05:11:49.171 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.171 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.171 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.171 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.171 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.171 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118724 2024-09-13T05:11:49.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.171 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.171 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453369+0000", 2024-09-13T05:11:49.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453369+0000", 2024-09-13T05:11:49.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453368+0000", 2024-09-13T05:11:49.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453371+0000", 2024-09-13T05:11:49.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7609999999999999e-06 2024-09-13T05:11:49.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453376+0000", 2024-09-13T05:11:49.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2469999999999999e-06 2024-09-13T05:11:49.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453381+0000", 2024-09-13T05:11:49.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8620000000000002e-06 2024-09-13T05:11:49.173 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.173 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.174 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.174 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118525 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.174 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.413434+0000", 2024-09-13T05:11:49.174 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.036565337000000003, 2024-09-13T05:11:49.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048822180999999999, 2024-09-13T05:11:49.174 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.174 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.174 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.174 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.174 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.174 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118525 2024-09-13T05:11:49.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.175 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.175 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.175 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413434+0000", 2024-09-13T05:11:49.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.175 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.175 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413434+0000", 2024-09-13T05:11:49.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413433+0000", 2024-09-13T05:11:49.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413437+0000", 2024-09-13T05:11:49.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4400000000000001e-06 2024-09-13T05:11:49.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413454+0000", 2024-09-13T05:11:49.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7051999999999999e-05 2024-09-13T05:11:49.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413477+0000", 2024-09-13T05:11:49.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3402999999999999e-05 2024-09-13T05:11:49.177 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.177 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.177 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.178 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118557 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.178 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.421453+0000", 2024-09-13T05:11:49.178 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.028546245000000001, 2024-09-13T05:11:49.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040834267, 2024-09-13T05:11:49.178 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.178 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.178 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.178 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.178 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.178 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118557 2024-09-13T05:11:49.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.178 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.179 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421453+0000", 2024-09-13T05:11:49.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.179 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421453+0000", 2024-09-13T05:11:49.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421452+0000", 2024-09-13T05:11:49.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:49.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421456+0000", 2024-09-13T05:11:49.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5489999999999998e-06 2024-09-13T05:11:49.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421467+0000", 2024-09-13T05:11:49.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1551e-05 2024-09-13T05:11:49.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421474+0000", 2024-09-13T05:11:49.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0419999999999997e-06 2024-09-13T05:11:49.181 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.181 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.181 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.181 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118590 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.181 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.429555+0000", 2024-09-13T05:11:49.181 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.020443717, 2024-09-13T05:11:49.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032778142000000003, 2024-09-13T05:11:49.181 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.182 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.182 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.182 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.182 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.182 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118590 2024-09-13T05:11:49.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.182 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429555+0000", 2024-09-13T05:11:49.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429555+0000", 2024-09-13T05:11:49.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429555+0000", 2024-09-13T05:11:49.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429558+0000", 2024-09-13T05:11:49.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8729999999999999e-06 2024-09-13T05:11:49.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.184 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.184 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429564+0000", 2024-09-13T05:11:49.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9549999999999997e-06 2024-09-13T05:11:49.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.184 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.184 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429570+0000", 2024-09-13T05:11:49.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3589999999999996e-06 2024-09-13T05:11:49.184 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.184 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.185 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.185 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118623 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.185 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.437380+0000", 2024-09-13T05:11:49.185 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.012619619, 2024-09-13T05:11:49.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.024980656, 2024-09-13T05:11:49.185 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.185 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.185 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.186 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.186 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.186 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118623 2024-09-13T05:11:49.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.186 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437380+0000", 2024-09-13T05:11:49.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.187 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437380+0000", 2024-09-13T05:11:49.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.187 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437379+0000", 2024-09-13T05:11:49.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437382+0000", 2024-09-13T05:11:49.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.627e-06 2024-09-13T05:11:49.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437388+0000", 2024-09-13T05:11:49.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5039999999999999e-06 2024-09-13T05:11:49.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437393+0000", 2024-09-13T05:11:49.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8849999999999998e-06 2024-09-13T05:11:49.189 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.189 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.189 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.189 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118692 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.189 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.449016+0000", 2024-09-13T05:11:49.190 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.00098300800000000006, 2024-09-13T05:11:49.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013370170000000001, 2024-09-13T05:11:49.190 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.190 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.190 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.190 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.190 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.190 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118692 2024-09-13T05:11:49.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.190 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449016+0000", 2024-09-13T05:11:49.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449016+0000", 2024-09-13T05:11:49.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449016+0000", 2024-09-13T05:11:49.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449019+0000", 2024-09-13T05:11:49.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0359999999999998e-06 2024-09-13T05:11:49.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449028+0000", 2024-09-13T05:11:49.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2499999999999995e-06 2024-09-13T05:11:49.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449033+0000", 2024-09-13T05:11:49.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3290000000000001e-06 2024-09-13T05:11:49.192 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.192 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.192 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.193 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118725 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.193 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.453385+0000", 2024-09-13T05:11:49.193 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.996614, 2024-09-13T05:11:49.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0090291940000000008, 2024-09-13T05:11:49.193 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.193 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.193 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.193 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.193 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.193 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118725 2024-09-13T05:11:49.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.193 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453385+0000", 2024-09-13T05:11:49.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453385+0000", 2024-09-13T05:11:49.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453385+0000", 2024-09-13T05:11:49.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.195 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.195 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453388+0000", 2024-09-13T05:11:49.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7429999999999998e-06 2024-09-13T05:11:49.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.195 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.195 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453393+0000", 2024-09-13T05:11:49.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1950000000000002e-06 2024-09-13T05:11:49.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.195 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.195 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453398+0000", 2024-09-13T05:11:49.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8459999999999999e-06 2024-09-13T05:11:49.196 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.196 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.196 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.196 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118526 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.196 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.413487+0000", 2024-09-13T05:11:49.196 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.036512361, 2024-09-13T05:11:49.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048956410999999998, 2024-09-13T05:11:49.196 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.196 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.196 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.196 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.197 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.197 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118526 2024-09-13T05:11:49.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.197 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.197 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413487+0000", 2024-09-13T05:11:49.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.197 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413487+0000", 2024-09-13T05:11:49.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.198 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.198 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413486+0000", 2024-09-13T05:11:49.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.198 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.198 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413490+0000", 2024-09-13T05:11:49.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.726e-06 2024-09-13T05:11:49.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.198 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.198 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413511+0000", 2024-09-13T05:11:49.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1149e-05 2024-09-13T05:11:49.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.199 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.199 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.199 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413530+0000", 2024-09-13T05:11:49.199 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9093000000000002e-05 2024-09-13T05:11:49.199 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.199 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.199 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.199 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.199 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.199 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118558 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.199 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.421480+0000", 2024-09-13T05:11:49.199 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.028519112999999999, 2024-09-13T05:11:49.199 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040991327000000001, 2024-09-13T05:11:49.199 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.199 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.200 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.200 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.200 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.200 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118558 2024-09-13T05:11:49.200 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.200 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.200 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.200 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.200 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421480+0000", 2024-09-13T05:11:49.200 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.200 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.200 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.200 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.200 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421480+0000", 2024-09-13T05:11:49.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421480+0000", 2024-09-13T05:11:49.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421496+0000", 2024-09-13T05:11:49.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6806000000000001e-05 2024-09-13T05:11:49.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421506+0000", 2024-09-13T05:11:49.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2399999999999996e-06 2024-09-13T05:11:49.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.202 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.202 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421513+0000", 2024-09-13T05:11:49.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.4880000000000001e-06 2024-09-13T05:11:49.202 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.202 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.202 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.202 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118591 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.202 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.429575+0000", 2024-09-13T05:11:49.202 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.020424392999999999, 2024-09-13T05:11:49.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032923147999999999, 2024-09-13T05:11:49.203 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.203 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.203 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.203 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.203 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.203 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118591 2024-09-13T05:11:49.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.203 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.203 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.203 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429575+0000", 2024-09-13T05:11:49.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.204 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429575+0000", 2024-09-13T05:11:49.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.204 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.204 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429574+0000", 2024-09-13T05:11:49.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.204 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.204 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429577+0000", 2024-09-13T05:11:49.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8339999999999999e-06 2024-09-13T05:11:49.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.205 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.205 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429583+0000", 2024-09-13T05:11:49.205 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8540000000000002e-06 2024-09-13T05:11:49.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.205 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.205 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429588+0000", 2024-09-13T05:11:49.205 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9710000000000003e-06 2024-09-13T05:11:49.205 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.205 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.205 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.206 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118624 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.206 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.441030+0000", 2024-09-13T05:11:49.206 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0089693800000000008, 2024-09-13T05:11:49.206 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.021495818999999999, 2024-09-13T05:11:49.206 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.206 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.206 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.206 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.206 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.206 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118624 2024-09-13T05:11:49.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.206 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.206 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.207 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441030+0000", 2024-09-13T05:11:49.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.207 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.207 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441030+0000", 2024-09-13T05:11:49.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.207 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.207 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.437397+0000", 2024-09-13T05:11:49.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.996367 2024-09-13T05:11:49.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441034+0000", 2024-09-13T05:11:49.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0036369219999999999 2024-09-13T05:11:49.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.208 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441045+0000", 2024-09-13T05:11:49.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1022999999999999e-05 2024-09-13T05:11:49.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.208 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441051+0000", 2024-09-13T05:11:49.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7299999999999999e-06 2024-09-13T05:11:49.209 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.209 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.209 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.209 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118693 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.209 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.449038+0000", 2024-09-13T05:11:49.209 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.00096144199999999996, 2024-09-13T05:11:49.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013515084, 2024-09-13T05:11:49.209 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.209 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.209 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.210 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.210 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.210 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118693 2024-09-13T05:11:49.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.210 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.210 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.210 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.210 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449038+0000", 2024-09-13T05:11:49.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.211 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449038+0000", 2024-09-13T05:11:49.211 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.211 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449037+0000", 2024-09-13T05:11:49.211 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.211 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449040+0000", 2024-09-13T05:11:49.212 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8119999999999999e-06 2024-09-13T05:11:49.212 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.212 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.212 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.212 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449046+0000", 2024-09-13T05:11:49.212 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8459999999999996e-06 2024-09-13T05:11:49.212 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.212 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.212 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.212 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449051+0000", 2024-09-13T05:11:49.212 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0429999999999998e-06 2024-09-13T05:11:49.212 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.212 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.213 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.213 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.213 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.213 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118726 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.213 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.453402+0000", 2024-09-13T05:11:49.213 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9965973, 2024-09-13T05:11:49.213 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0091801680000000007, 2024-09-13T05:11:49.213 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.213 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.213 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.214 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.214 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.214 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118726 2024-09-13T05:11:49.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.214 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.214 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.214 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.214 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453402+0000", 2024-09-13T05:11:49.214 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.214 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.214 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.214 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453402+0000", 2024-09-13T05:11:49.215 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.215 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.215 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453401+0000", 2024-09-13T05:11:49.215 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.215 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.215 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453404+0000", 2024-09-13T05:11:49.215 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6010000000000002e-06 2024-09-13T05:11:49.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.216 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.216 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.216 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453409+0000", 2024-09-13T05:11:49.216 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.13e-06 2024-09-13T05:11:49.216 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.216 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.216 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.216 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453414+0000", 2024-09-13T05:11:49.216 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3549999999999998e-06 2024-09-13T05:11:49.216 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.216 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.216 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.217 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.217 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.217 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118527 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.217 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.413537+0000", 2024-09-13T05:11:49.217 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.036462219999999997, 2024-09-13T05:11:49.217 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.049073360000000003, 2024-09-13T05:11:49.217 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.217 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.217 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.217 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.217 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.218 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118527 2024-09-13T05:11:49.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.218 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.218 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.218 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413537+0000", 2024-09-13T05:11:49.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.218 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.218 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413537+0000", 2024-09-13T05:11:49.219 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.219 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.219 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.219 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.219 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413536+0000", 2024-09-13T05:11:49.219 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.219 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.219 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.219 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.219 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413540+0000", 2024-09-13T05:11:49.220 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6380000000000002e-06 2024-09-13T05:11:49.220 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.220 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.220 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.220 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413548+0000", 2024-09-13T05:11:49.220 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.3860000000000007e-06 2024-09-13T05:11:49.220 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.220 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.221 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.413562+0000", 2024-09-13T05:11:49.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3457e-05 2024-09-13T05:11:49.221 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.221 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.221 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.221 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.221 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118559 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.221 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.421520+0000", 2024-09-13T05:11:49.222 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.028479285999999999, 2024-09-13T05:11:49.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.041118867000000003, 2024-09-13T05:11:49.222 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.222 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.222 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.222 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.222 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.222 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118559 2024-09-13T05:11:49.222 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.223 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421520+0000", 2024-09-13T05:11:49.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421520+0000", 2024-09-13T05:11:49.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421519+0000", 2024-09-13T05:11:49.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.224 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.224 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.224 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421523+0000", 2024-09-13T05:11:49.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2380000000000002e-06 2024-09-13T05:11:49.224 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.224 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.224 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421530+0000", 2024-09-13T05:11:49.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8399999999999995e-06 2024-09-13T05:11:49.224 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.224 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.225 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.421538+0000", 2024-09-13T05:11:49.225 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0539999999999997e-06 2024-09-13T05:11:49.225 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.225 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.225 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.225 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.225 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.225 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118592 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.225 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.433146+0000", 2024-09-13T05:11:49.225 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.016853156000000001, 2024-09-13T05:11:49.225 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.029518723, 2024-09-13T05:11:49.225 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.225 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.225 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.226 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.226 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.226 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118592 2024-09-13T05:11:49.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.226 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433146+0000", 2024-09-13T05:11:49.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433146+0000", 2024-09-13T05:11:49.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.429593+0000", 2024-09-13T05:11:49.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9964466 2024-09-13T05:11:49.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433149+0000", 2024-09-13T05:11:49.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0035569019999999998 2024-09-13T05:11:49.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433166+0000", 2024-09-13T05:11:49.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6430999999999999e-05 2024-09-13T05:11:49.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.228 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.228 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.433173+0000", 2024-09-13T05:11:49.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:11:49.228 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.228 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.228 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.228 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118625 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.228 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.441061+0000", 2024-09-13T05:11:49.228 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0089377840000000007, 2024-09-13T05:11:49.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.021631991, 2024-09-13T05:11:49.229 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.229 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.229 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.229 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.229 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.229 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118625 2024-09-13T05:11:49.229 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.229 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.229 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.229 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.229 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441061+0000", 2024-09-13T05:11:49.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.229 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.229 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.230 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441061+0000", 2024-09-13T05:11:49.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.230 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441061+0000", 2024-09-13T05:11:49.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.230 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441064+0000", 2024-09-13T05:11:49.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9490000000000001e-06 2024-09-13T05:11:49.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441070+0000", 2024-09-13T05:11:49.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4540000000000004e-06 2024-09-13T05:11:49.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.441075+0000", 2024-09-13T05:11:49.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.921e-06 2024-09-13T05:11:49.231 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.231 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.231 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.231 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118694 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.232 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.449055+0000", 2024-09-13T05:11:49.232 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.00094371400000000001, 2024-09-13T05:11:49.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013663498, 2024-09-13T05:11:49.232 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.232 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.232 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.232 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.232 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.232 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118694 2024-09-13T05:11:49.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.232 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.232 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.232 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.232 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449055+0000", 2024-09-13T05:11:49.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449055+0000", 2024-09-13T05:11:49.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449055+0000", 2024-09-13T05:11:49.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449058+0000", 2024-09-13T05:11:49.234 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.413e-06 2024-09-13T05:11:49.234 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.234 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.234 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.234 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449063+0000", 2024-09-13T05:11:49.234 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2429999999999996e-06 2024-09-13T05:11:49.234 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.234 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.234 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.234 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449068+0000", 2024-09-13T05:11:49.234 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2580000000000003e-06 2024-09-13T05:11:49.234 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.234 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.234 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.234 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.235 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118727 3.16 3.6ac112b6 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.235 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.453419+0000", 2024-09-13T05:11:49.235 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9965801, 2024-09-13T05:11:49.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0093256480000000006, 2024-09-13T05:11:49.235 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.235 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:49.235 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.235 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.235 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.235 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118727 2024-09-13T05:11:49.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.235 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453419+0000", 2024-09-13T05:11:49.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453419+0000", 2024-09-13T05:11:49.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453419+0000", 2024-09-13T05:11:49.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453421+0000", 2024-09-13T05:11:49.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.559e-06 2024-09-13T05:11:49.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453427+0000", 2024-09-13T05:11:49.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.609e-06 2024-09-13T05:11:49.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453431+0000", 2024-09-13T05:11:49.238 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5970000000000002e-06 2024-09-13T05:11:49.238 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.238 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.238 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.238 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.238 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-09-13T05:11:49.238 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 225 2024-09-13T05:11:49.238 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:49.239 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:11:49.241 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:11:49.242 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:49.233+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:49.242 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:11:49.243 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:11:49.244 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-09-13T05:11:48.193042+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1271539958,"num_objects":2601,"num_object_clones":363,"num_object_copies":5202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2601,"num_whiteouts":1182,"num_read":138980,"num_read_kb":508257,"num_write":15815,"num_write_kb":346869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1981,"num_bytes_recovered":69865385,"num_keys_recovered":233,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14043,"ondisk_log_size":14043,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":563044,"kb_used_data":322992,"kb_used_omap":7,"kb_used_meta":239992,"kb_avail":471296156,"statfs":{"total":483183820800,"available":482607263744,"internally_reserved":0,"allocated":330743808,"data_stored":370597085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7962,"internal_metadata":245752038},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15722443,"num_objects":139,"num_object_clones":0,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":0,"num_read":27786,"num_read_kb":4362,"num_write":421,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.442644"},"pg_stats":[{"pgid":"3.1f","version":"100'385","reported_seq":999,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.790451+0000","last_change":"2024-09-13T05:10:37.993400+0000","last_active":"2024-09-13T05:11:45.790451+0000","last_peered":"2024-09-13T05:11:45.790451+0000","last_clean":"2024-09-13T05:11:45.790451+0000","last_became_active":"2024-09-13T05:10:37.864778+0000","last_became_peered":"2024-09-13T05:10:37.864778+0000","last_unstale":"2024-09-13T05:11:45.790451+0000","last_undegraded":"2024-09-13T05:11:45.790451+0000","last_fullsized":"2024-09-13T05:11:45.790451+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:56:24.801492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011835439999999999,"stat_sum":{"num_bytes":7262464,"num_objects":72,"num_object_clones":7,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":28,"num_read":1675,"num_read_kb":5320,"num_write":454,"num_write_kb":4260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":297202,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"102'285","reported_seq":4329,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.538502+0000","last_change":"2024-09-13T05:10:12.076857+0000","last_active":"2024-09-13T05:11:46.538502+0000","last_peered":"2024-09-13T05:11:46.538502+0000","last_clean":"2024-09-13T05:11:46.538502+0000","last_became_active":"2024-09-13T05:10:09.644293+0000","last_became_peered":"2024-09-13T05:10:09.644293+0000","last_unstale":"2024-09-13T05:11:46.538502+0000","last_undegraded":"2024-09-13T05:11:46.538502+0000","last_fullsized":"2024-09-13T05:11:46.538502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:45:32.561793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225439,"stat_sum":{"num_bytes":29283683,"num_objects":69,"num_object_clones":8,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":35,"num_read":4683,"num_read_kb":4873,"num_write":260,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"102'438","reported_seq":2412,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.885625+0000","last_change":"2024-09-13T05:10:11.645342+0000","last_active":"2024-09-13T05:11:46.885625+0000","last_peered":"2024-09-13T05:11:46.885625+0000","last_clean":"2024-09-13T05:11:46.885625+0000","last_became_active":"2024-09-13T05:10:09.645791+0000","last_became_peered":"2024-09-13T05:10:09.645791+0000","last_unstale":"2024-09-13T05:11:46.885625+0000","last_undegraded":"2024-09-13T05:11:46.885625+0000","last_fullsized":"2024-09-13T05:11:46.885625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:49.028553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072691800000000001,"stat_sum":{"num_bytes":35478438,"num_objects":96,"num_object_clones":13,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":39,"num_read":2840,"num_read_kb":12651,"num_write":494,"num_write_kb":5315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"102'585","reported_seq":3235,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.775477+0000","last_change":"2024-09-13T05:10:31.949427+0000","last_active":"2024-09-13T05:11:46.775477+0000","last_peered":"2024-09-13T05:11:46.775477+0000","last_clean":"2024-09-13T05:11:46.775477+0000","last_became_active":"2024-09-13T05:10:31.828206+0000","last_became_peered":"2024-09-13T05:10:31.828206+0000","last_unstale":"2024-09-13T05:11:46.775477+0000","last_undegraded":"2024-09-13T05:11:46.775477+0000","last_fullsized":"2024-09-13T05:11:46.775477+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:32:46.868249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078437299999999999,"stat_sum":{"num_bytes":48667851,"num_objects":74,"num_object_clones":11,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":25,"num_read":4889,"num_read_kb":20630,"num_write":748,"num_write_kb":14561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":372837,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"101'391","reported_seq":2022,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.787605+0000","last_change":"2024-09-13T05:10:37.990899+0000","last_active":"2024-09-13T05:11:45.787605+0000","last_peered":"2024-09-13T05:11:45.787605+0000","last_clean":"2024-09-13T05:11:45.787605+0000","last_became_active":"2024-09-13T05:10:37.867842+0000","last_became_peered":"2024-09-13T05:10:37.867842+0000","last_unstale":"2024-09-13T05:11:45.787605+0000","last_undegraded":"2024-09-13T05:11:45.787605+0000","last_fullsized":"2024-09-13T05:11:45.787605+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:38:24.437617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065808499999999999,"stat_sum":{"num_bytes":52798208,"num_objects":90,"num_object_clones":10,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":40,"num_read":3112,"num_read_kb":14189,"num_write":392,"num_write_kb":9484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":612052,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"103'518","reported_seq":11820,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.879839+0000","last_change":"2024-09-13T05:10:37.948112+0000","last_active":"2024-09-13T05:11:46.879839+0000","last_peered":"2024-09-13T05:11:46.879839+0000","last_clean":"2024-09-13T05:11:46.879839+0000","last_became_active":"2024-09-13T05:10:37.863614+0000","last_became_peered":"2024-09-13T05:10:37.863614+0000","last_unstale":"2024-09-13T05:11:46.879839+0000","last_undegraded":"2024-09-13T05:11:46.879839+0000","last_fullsized":"2024-09-13T05:11:46.879839+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:39:15.873724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027226559999999999,"stat_sum":{"num_bytes":56752568,"num_objects":96,"num_object_clones":14,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":37,"num_read":12722,"num_read_kb":16611,"num_write":588,"num_write_kb":9892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":77,"num_bytes_recovered":1081937,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"103'623","reported_seq":9364,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.787340+0000","last_change":"2024-09-13T05:10:34.613940+0000","last_active":"2024-09-13T05:11:46.787340+0000","last_peered":"2024-09-13T05:11:46.787340+0000","last_clean":"2024-09-13T05:11:46.787340+0000","last_became_active":"2024-09-13T05:10:34.612579+0000","last_became_peered":"2024-09-13T05:10:34.612579+0000","last_unstale":"2024-09-13T05:11:46.787340+0000","last_undegraded":"2024-09-13T05:11:46.787340+0000","last_fullsized":"2024-09-13T05:11:46.787340+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:44:43.339882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067403999999999999,"stat_sum":{"num_bytes":70207468,"num_objects":85,"num_object_clones":13,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":35,"num_read":11164,"num_read_kb":18306,"num_write":790,"num_write_kb":6532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":248973,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"103'446","reported_seq":1837,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.787107+0000","last_change":"2024-09-13T05:10:37.929523+0000","last_active":"2024-09-13T05:11:46.787107+0000","last_peered":"2024-09-13T05:11:46.787107+0000","last_clean":"2024-09-13T05:11:46.787107+0000","last_became_active":"2024-09-13T05:10:37.865440+0000","last_became_peered":"2024-09-13T05:10:37.865440+0000","last_unstale":"2024-09-13T05:11:46.787107+0000","last_undegraded":"2024-09-13T05:11:46.787107+0000","last_fullsized":"2024-09-13T05:11:46.787107+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:30:31.875141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087399999999998,"stat_sum":{"num_bytes":54587136,"num_objects":94,"num_object_clones":16,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":46,"num_read":2076,"num_read_kb":23632,"num_write":486,"num_write_kb":23675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":1513234,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"102'329","reported_seq":2156,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.080043+0000","last_change":"2024-09-13T05:10:37.920810+0000","last_active":"2024-09-13T05:11:46.080043+0000","last_peered":"2024-09-13T05:11:46.080043+0000","last_clean":"2024-09-13T05:11:46.080043+0000","last_became_active":"2024-09-13T05:10:37.864816+0000","last_became_peered":"2024-09-13T05:10:37.864816+0000","last_unstale":"2024-09-13T05:11:46.080043+0000","last_undegraded":"2024-09-13T05:11:46.080043+0000","last_fullsized":"2024-09-13T05:11:46.080043+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:06.315864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096598599999999995,"stat_sum":{"num_bytes":10679864,"num_objects":67,"num_object_clones":7,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":31,"num_read":4021,"num_read_kb":6478,"num_write":279,"num_write_kb":2856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":37802,"num_keys_recovered":23,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"101'334","reported_seq":2448,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.790456+0000","last_change":"2024-09-13T05:11:24.632224+0000","last_active":"2024-09-13T05:11:45.790456+0000","last_peered":"2024-09-13T05:11:45.790456+0000","last_clean":"2024-09-13T05:11:45.790456+0000","last_became_active":"2024-09-13T05:11:24.631079+0000","last_became_peered":"2024-09-13T05:11:24.631079+0000","last_unstale":"2024-09-13T05:11:45.790456+0000","last_undegraded":"2024-09-13T05:11:45.790456+0000","last_fullsized":"2024-09-13T05:11:45.790456+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:29.182802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072236499999999999,"stat_sum":{"num_bytes":58047229,"num_objects":78,"num_object_clones":18,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":39,"num_read":2440,"num_read_kb":11072,"num_write":278,"num_write_kb":3798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":4743569,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"102'309","reported_seq":5255,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.090759+0000","last_change":"2024-09-13T05:10:11.681217+0000","last_active":"2024-09-13T05:11:46.090759+0000","last_peered":"2024-09-13T05:11:46.090759+0000","last_clean":"2024-09-13T05:11:46.090759+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:11:46.090759+0000","last_undegraded":"2024-09-13T05:11:46.090759+0000","last_fullsized":"2024-09-13T05:11:46.090759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:40.457636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095533399999999996,"stat_sum":{"num_bytes":16647075,"num_objects":73,"num_object_clones":15,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":37,"num_read":5490,"num_read_kb":12758,"num_write":353,"num_write_kb":6676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"102'301","reported_seq":5044,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.054123+0000","last_change":"2024-09-13T05:10:11.681365+0000","last_active":"2024-09-13T05:11:46.054123+0000","last_peered":"2024-09-13T05:11:46.054123+0000","last_clean":"2024-09-13T05:11:46.054123+0000","last_became_active":"2024-09-13T05:10:09.645823+0000","last_became_peered":"2024-09-13T05:10:09.645823+0000","last_unstale":"2024-09-13T05:11:46.054123+0000","last_undegraded":"2024-09-13T05:11:46.054123+0000","last_fullsized":"2024-09-13T05:11:46.054123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:29:24.367358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011047369999999999,"stat_sum":{"num_bytes":48986789,"num_objects":86,"num_object_clones":14,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":41,"num_read":4791,"num_read_kb":26870,"num_write":249,"num_write_kb":6506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":99,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.794317+0000","last_change":"2024-09-13T05:10:01.383891+0000","last_active":"2024-09-13T05:11:45.794317+0000","last_peered":"2024-09-13T05:11:45.794317+0000","last_clean":"2024-09-13T05:11:45.794317+0000","last_became_active":"2024-09-13T05:09:59.374793+0000","last_became_peered":"2024-09-13T05:09:59.374793+0000","last_unstale":"2024-09-13T05:11:45.794317+0000","last_undegraded":"2024-09-13T05:11:45.794317+0000","last_fullsized":"2024-09-13T05:11:45.794317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:02.499446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065068999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"102'295","reported_seq":5266,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.788687+0000","last_change":"2024-09-13T05:11:25.647054+0000","last_active":"2024-09-13T05:11:46.788687+0000","last_peered":"2024-09-13T05:11:46.788687+0000","last_clean":"2024-09-13T05:11:46.788687+0000","last_became_active":"2024-09-13T05:11:25.645546+0000","last_became_peered":"2024-09-13T05:11:25.645546+0000","last_unstale":"2024-09-13T05:11:46.788687+0000","last_undegraded":"2024-09-13T05:11:46.788687+0000","last_fullsized":"2024-09-13T05:11:46.788687+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:33:49.392161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099899699999999995,"stat_sum":{"num_bytes":33984796,"num_objects":74,"num_object_clones":11,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":30,"num_read":4311,"num_read_kb":12860,"num_write":245,"num_write_kb":7958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":13680601,"num_keys_recovered":22,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.794295+0000","last_change":"2024-09-13T05:10:31.826927+0000","last_active":"2024-09-13T05:11:45.794295+0000","last_peered":"2024-09-13T05:11:45.794295+0000","last_clean":"2024-09-13T05:11:45.794295+0000","last_became_active":"2024-09-13T05:10:31.826431+0000","last_became_peered":"2024-09-13T05:10:31.826431+0000","last_unstale":"2024-09-13T05:11:45.794295+0000","last_undegraded":"2024-09-13T05:11:45.794295+0000","last_fullsized":"2024-09-13T05:11:45.794295+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:13:36.678853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"102'292","reported_seq":1690,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.080037+0000","last_change":"2024-09-13T05:10:12.077111+0000","last_active":"2024-09-13T05:11:46.080037+0000","last_peered":"2024-09-13T05:11:46.080037+0000","last_clean":"2024-09-13T05:11:46.080037+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:11:46.080037+0000","last_undegraded":"2024-09-13T05:11:46.080037+0000","last_fullsized":"2024-09-13T05:11:46.080037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:37.976147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001460444,"stat_sum":{"num_bytes":56807087,"num_objects":80,"num_object_clones":9,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":42,"num_read":1533,"num_read_kb":10835,"num_write":245,"num_write_kb":3689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":107,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.787909+0000","last_change":"2024-09-13T05:10:37.866953+0000","last_active":"2024-09-13T05:11:45.787909+0000","last_peered":"2024-09-13T05:11:45.787909+0000","last_clean":"2024-09-13T05:11:45.787909+0000","last_became_active":"2024-09-13T05:10:37.866624+0000","last_became_peered":"2024-09-13T05:10:37.866624+0000","last_unstale":"2024-09-13T05:11:45.787909+0000","last_undegraded":"2024-09-13T05:11:45.787909+0000","last_fullsized":"2024-09-13T05:11:45.787909+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:56:20.077971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"102'430","reported_seq":1148,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.243435+0000","last_change":"2024-09-13T05:11:23.618355+0000","last_active":"2024-09-13T05:11:46.243435+0000","last_peered":"2024-09-13T05:11:46.243435+0000","last_clean":"2024-09-13T05:11:46.243435+0000","last_became_active":"2024-09-13T05:11:23.616394+0000","last_became_peered":"2024-09-13T05:11:23.616394+0000","last_unstale":"2024-09-13T05:11:46.243435+0000","last_undegraded":"2024-09-13T05:11:46.243435+0000","last_fullsized":"2024-09-13T05:11:46.243435+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:12:03.977067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076234800000000004,"stat_sum":{"num_bytes":17697565,"num_objects":75,"num_object_clones":8,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":34,"num_read":1487,"num_read_kb":4210,"num_write":569,"num_write_kb":9594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":2629215,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":69,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.787614+0000","last_change":"2024-09-13T05:10:37.864940+0000","last_active":"2024-09-13T05:11:45.787614+0000","last_peered":"2024-09-13T05:11:45.787614+0000","last_clean":"2024-09-13T05:11:45.787614+0000","last_became_active":"2024-09-13T05:10:37.864623+0000","last_became_peered":"2024-09-13T05:10:37.864623+0000","last_unstale":"2024-09-13T05:11:45.787614+0000","last_undegraded":"2024-09-13T05:11:45.787614+0000","last_fullsized":"2024-09-13T05:11:45.787614+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:41.598490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.5","version":"102'375","reported_seq":2971,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.775983+0000","last_change":"2024-09-13T05:10:11.645960+0000","last_active":"2024-09-13T05:11:46.775983+0000","last_peered":"2024-09-13T05:11:46.775983+0000","last_clean":"2024-09-13T05:11:46.775983+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:11:46.775983+0000","last_undegraded":"2024-09-13T05:11:46.775983+0000","last_fullsized":"2024-09-13T05:11:46.775983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:40.372741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001054028,"stat_sum":{"num_bytes":97147739,"num_objects":88,"num_object_clones":11,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":32,"num_read":4214,"num_read_kb":56743,"num_write":344,"num_write_kb":39096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"102'500","reported_seq":2467,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.962030+0000","last_change":"2024-09-13T05:10:37.979816+0000","last_active":"2024-09-13T05:11:45.962030+0000","last_peered":"2024-09-13T05:11:45.962030+0000","last_clean":"2024-09-13T05:11:45.962030+0000","last_became_active":"2024-09-13T05:10:37.863256+0000","last_became_peered":"2024-09-13T05:10:37.863256+0000","last_unstale":"2024-09-13T05:11:45.962030+0000","last_undegraded":"2024-09-13T05:11:45.962030+0000","last_fullsized":"2024-09-13T05:11:45.962030+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:58:55.928356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099335200000000008,"stat_sum":{"num_bytes":66872889,"num_objects":80,"num_object_clones":11,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":40,"num_read":3246,"num_read_kb":28216,"num_write":587,"num_write_kb":33171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":214109,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":113,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.790158+0000","last_change":"2024-09-13T05:10:31.836193+0000","last_active":"2024-09-13T05:11:45.790158+0000","last_peered":"2024-09-13T05:11:45.790158+0000","last_clean":"2024-09-13T05:11:45.790158+0000","last_became_active":"2024-09-13T05:10:31.825663+0000","last_became_peered":"2024-09-13T05:10:31.825663+0000","last_unstale":"2024-09-13T05:11:45.790158+0000","last_undegraded":"2024-09-13T05:11:45.790158+0000","last_fullsized":"2024-09-13T05:11:45.790158+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:38:23.311570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"102'466","reported_seq":874,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.787310+0000","last_change":"2024-09-13T05:10:31.893494+0000","last_active":"2024-09-13T05:11:46.787310+0000","last_peered":"2024-09-13T05:11:46.787310+0000","last_clean":"2024-09-13T05:11:46.787310+0000","last_became_active":"2024-09-13T05:10:31.827657+0000","last_became_peered":"2024-09-13T05:10:31.827657+0000","last_unstale":"2024-09-13T05:11:46.787310+0000","last_undegraded":"2024-09-13T05:11:46.787310+0000","last_fullsized":"2024-09-13T05:11:46.787310+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:16:14.432049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045163499999999998,"stat_sum":{"num_bytes":24243801,"num_objects":84,"num_object_clones":13,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":40,"num_read":1276,"num_read_kb":2695,"num_write":488,"num_write_kb":3959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":84179,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":99,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.783056+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:11:45.783056+0000","last_peered":"2024-09-13T05:11:45.783056+0000","last_clean":"2024-09-13T05:11:45.783056+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:11:45.783056+0000","last_undegraded":"2024-09-13T05:11:45.783056+0000","last_fullsized":"2024-09-13T05:11:45.783056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"101'361","reported_seq":958,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.847823+0000","last_change":"2024-09-13T05:10:38.111510+0000","last_active":"2024-09-13T05:11:45.847823+0000","last_peered":"2024-09-13T05:11:45.847823+0000","last_clean":"2024-09-13T05:11:45.847823+0000","last_became_active":"2024-09-13T05:10:37.869040+0000","last_became_peered":"2024-09-13T05:10:37.869040+0000","last_unstale":"2024-09-13T05:11:45.847823+0000","last_undegraded":"2024-09-13T05:11:45.847823+0000","last_fullsized":"2024-09-13T05:11:45.847823+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:48:18.385423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048152600000000002,"stat_sum":{"num_bytes":28663837,"num_objects":73,"num_object_clones":13,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":34,"num_read":1136,"num_read_kb":12355,"num_write":402,"num_write_kb":9333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":383717,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":115,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.787308+0000","last_change":"2024-09-13T05:10:37.865514+0000","last_active":"2024-09-13T05:11:45.787308+0000","last_peered":"2024-09-13T05:11:45.787308+0000","last_clean":"2024-09-13T05:11:45.787308+0000","last_became_active":"2024-09-13T05:10:37.864299+0000","last_became_peered":"2024-09-13T05:10:37.864299+0000","last_unstale":"2024-09-13T05:11:45.787308+0000","last_undegraded":"2024-09-13T05:11:45.787308+0000","last_fullsized":"2024-09-13T05:11:45.787308+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:45:58.276509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"102'397","reported_seq":2277,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.787179+0000","last_change":"2024-09-13T05:11:23.619138+0000","last_active":"2024-09-13T05:11:46.787179+0000","last_peered":"2024-09-13T05:11:46.787179+0000","last_clean":"2024-09-13T05:11:46.787179+0000","last_became_active":"2024-09-13T05:11:23.617149+0000","last_became_peered":"2024-09-13T05:11:23.617149+0000","last_unstale":"2024-09-13T05:11:46.787179+0000","last_undegraded":"2024-09-13T05:11:46.787179+0000","last_fullsized":"2024-09-13T05:11:46.787179+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:55:46.203366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059320200000000003,"stat_sum":{"num_bytes":26350904,"num_objects":82,"num_object_clones":9,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":36,"num_read":4070,"num_read_kb":10419,"num_write":333,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":2822984,"num_keys_recovered":34,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":100,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.790125+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:11:45.790125+0000","last_peered":"2024-09-13T05:11:45.790125+0000","last_clean":"2024-09-13T05:11:45.790125+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:11:45.790125+0000","last_undegraded":"2024-09-13T05:11:45.790125+0000","last_fullsized":"2024-09-13T05:11:45.790125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":268,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.787409+0000","last_change":"2024-09-13T05:10:40.886011+0000","last_active":"2024-09-13T05:11:45.787409+0000","last_peered":"2024-09-13T05:11:45.787409+0000","last_clean":"2024-09-13T05:11:45.787409+0000","last_became_active":"2024-09-13T05:10:40.885587+0000","last_became_peered":"2024-09-13T05:10:40.885587+0000","last_unstale":"2024-09-13T05:11:45.787409+0000","last_undegraded":"2024-09-13T05:11:45.787409+0000","last_fullsized":"2024-09-13T05:11:45.787409+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:52:47.632734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"102'281","reported_seq":4385,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.928739+0000","last_change":"2024-09-13T05:10:31.888827+0000","last_active":"2024-09-13T05:11:46.928739+0000","last_peered":"2024-09-13T05:11:46.928739+0000","last_clean":"2024-09-13T05:11:46.928739+0000","last_became_active":"2024-09-13T05:10:31.827016+0000","last_became_peered":"2024-09-13T05:10:31.827016+0000","last_unstale":"2024-09-13T05:11:46.928739+0000","last_undegraded":"2024-09-13T05:11:46.928739+0000","last_fullsized":"2024-09-13T05:11:46.928739+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:47.525525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000500144,"stat_sum":{"num_bytes":14389322,"num_objects":87,"num_object_clones":12,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":48,"num_read":4099,"num_read_kb":5192,"num_write":219,"num_write_kb":26795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":58925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"102'405","reported_seq":6508,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.885773+0000","last_change":"2024-09-13T05:10:11.648218+0000","last_active":"2024-09-13T05:11:46.885773+0000","last_peered":"2024-09-13T05:11:46.885773+0000","last_clean":"2024-09-13T05:11:46.885773+0000","last_became_active":"2024-09-13T05:10:09.645408+0000","last_became_peered":"2024-09-13T05:10:09.645408+0000","last_unstale":"2024-09-13T05:11:46.885773+0000","last_undegraded":"2024-09-13T05:11:46.885773+0000","last_fullsized":"2024-09-13T05:11:46.885773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:59.846981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097828900000000002,"stat_sum":{"num_bytes":44563905,"num_objects":76,"num_object_clones":8,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":31,"num_read":8301,"num_read_kb":21682,"num_write":391,"num_write_kb":5705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"101'444","reported_seq":8737,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.787097+0000","last_change":"2024-09-13T05:10:47.940550+0000","last_active":"2024-09-13T05:11:46.787097+0000","last_peered":"2024-09-13T05:11:46.787097+0000","last_clean":"2024-09-13T05:11:46.787097+0000","last_became_active":"2024-09-13T05:10:47.939220+0000","last_became_peered":"2024-09-13T05:10:47.939220+0000","last_unstale":"2024-09-13T05:11:46.787097+0000","last_undegraded":"2024-09-13T05:11:46.787097+0000","last_fullsized":"2024-09-13T05:11:46.787097+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:59.693041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013204619999999999,"stat_sum":{"num_bytes":22481119,"num_objects":78,"num_object_clones":12,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":38,"num_read":8849,"num_read_kb":15959,"num_write":476,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":59,"num_bytes_recovered":6203954,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"103'357","reported_seq":2639,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.885772+0000","last_change":"2024-09-13T05:10:38.007507+0000","last_active":"2024-09-13T05:11:46.885772+0000","last_peered":"2024-09-13T05:11:46.885772+0000","last_clean":"2024-09-13T05:11:46.885772+0000","last_became_active":"2024-09-13T05:10:37.868643+0000","last_became_peered":"2024-09-13T05:10:37.868643+0000","last_unstale":"2024-09-13T05:11:46.885772+0000","last_undegraded":"2024-09-13T05:11:46.885772+0000","last_fullsized":"2024-09-13T05:11:46.885772+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:29:05.387242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055343700000000005,"stat_sum":{"num_bytes":7450493,"num_objects":74,"num_object_clones":11,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":38,"num_read":3548,"num_read_kb":7991,"num_write":306,"num_write_kb":7258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":15854,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"102'190","reported_seq":1058,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.775689+0000","last_change":"2024-09-13T05:10:11.647302+0000","last_active":"2024-09-13T05:11:46.775689+0000","last_peered":"2024-09-13T05:11:46.775689+0000","last_clean":"2024-09-13T05:11:46.775689+0000","last_became_active":"2024-09-13T05:10:09.647037+0000","last_became_peered":"2024-09-13T05:10:09.647037+0000","last_unstale":"2024-09-13T05:11:46.775689+0000","last_undegraded":"2024-09-13T05:11:46.775689+0000","last_fullsized":"2024-09-13T05:11:46.775689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:54:17.061326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069994199999999995,"stat_sum":{"num_bytes":54607699,"num_objects":75,"num_object_clones":11,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":31,"num_read":912,"num_read_kb":12410,"num_write":167,"num_write_kb":5908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"102'577","reported_seq":4030,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.989138+0000","last_change":"2024-09-13T05:11:23.617596+0000","last_active":"2024-09-13T05:11:45.989138+0000","last_peered":"2024-09-13T05:11:45.989138+0000","last_clean":"2024-09-13T05:11:45.989138+0000","last_became_active":"2024-09-13T05:11:23.616962+0000","last_became_peered":"2024-09-13T05:11:23.616962+0000","last_unstale":"2024-09-13T05:11:45.989138+0000","last_undegraded":"2024-09-13T05:11:45.989138+0000","last_fullsized":"2024-09-13T05:11:45.989138+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:19.035337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019283150000000001,"stat_sum":{"num_bytes":70782133,"num_objects":90,"num_object_clones":12,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":40,"num_read":4923,"num_read_kb":14805,"num_write":715,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":12781016,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"103'873","reported_seq":5647,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.788777+0000","last_change":"2024-09-13T05:11:25.646827+0000","last_active":"2024-09-13T05:11:46.788777+0000","last_peered":"2024-09-13T05:11:46.788777+0000","last_clean":"2024-09-13T05:11:46.788777+0000","last_became_active":"2024-09-13T05:11:25.644857+0000","last_became_peered":"2024-09-13T05:11:25.644857+0000","last_unstale":"2024-09-13T05:11:46.788777+0000","last_undegraded":"2024-09-13T05:11:46.788777+0000","last_fullsized":"2024-09-13T05:11:46.788777+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:39.872264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018982339999999999,"stat_sum":{"num_bytes":35255341,"num_objects":79,"num_object_clones":7,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":38,"num_read":7120,"num_read_kb":7649,"num_write":1286,"num_write_kb":6111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":8639919,"num_keys_recovered":36,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"102'613","reported_seq":1836,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.054622+0000","last_change":"2024-09-13T05:10:40.885332+0000","last_active":"2024-09-13T05:11:46.054622+0000","last_peered":"2024-09-13T05:11:46.054622+0000","last_clean":"2024-09-13T05:11:46.054622+0000","last_became_active":"2024-09-13T05:10:40.884585+0000","last_became_peered":"2024-09-13T05:10:40.884585+0000","last_unstale":"2024-09-13T05:11:46.054622+0000","last_undegraded":"2024-09-13T05:11:46.054622+0000","last_fullsized":"2024-09-13T05:11:46.054622+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:31:19.596080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001164273,"stat_sum":{"num_bytes":19064120,"num_objects":83,"num_object_clones":11,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":44,"num_read":3493,"num_read_kb":11176,"num_write":846,"num_write_kb":7085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":296075,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"100'390","reported_seq":2262,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:45.794148+0000","last_change":"2024-09-13T05:11:23.617697+0000","last_active":"2024-09-13T05:11:45.794148+0000","last_peered":"2024-09-13T05:11:45.794148+0000","last_clean":"2024-09-13T05:11:45.794148+0000","last_became_active":"2024-09-13T05:11:23.617017+0000","last_became_peered":"2024-09-13T05:11:23.617017+0000","last_unstale":"2024-09-13T05:11:45.794148+0000","last_undegraded":"2024-09-13T05:11:45.794148+0000","last_fullsized":"2024-09-13T05:11:45.794148+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:26:44.551305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009951719999999999,"stat_sum":{"num_bytes":36432312,"num_objects":86,"num_object_clones":7,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":35,"num_read":2777,"num_read_kb":15157,"num_write":409,"num_write_kb":7442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":11923520,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"102'265","reported_seq":4772,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.069397+0000","last_change":"2024-09-13T05:10:11.680757+0000","last_active":"2024-09-13T05:11:46.069397+0000","last_peered":"2024-09-13T05:11:46.069397+0000","last_clean":"2024-09-13T05:11:46.069397+0000","last_became_active":"2024-09-13T05:10:09.653444+0000","last_became_peered":"2024-09-13T05:10:09.653444+0000","last_unstale":"2024-09-13T05:11:46.069397+0000","last_undegraded":"2024-09-13T05:11:46.069397+0000","last_fullsized":"2024-09-13T05:11:46.069397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:17:06.303008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000625977,"stat_sum":{"num_bytes":13312241,"num_objects":84,"num_object_clones":13,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":44,"num_read":4541,"num_read_kb":11518,"num_write":203,"num_write_kb":5055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"103'699","reported_seq":2367,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.818720+0000","last_change":"2024-09-13T05:10:40.884306+0000","last_active":"2024-09-13T05:11:46.818720+0000","last_peered":"2024-09-13T05:11:46.818720+0000","last_clean":"2024-09-13T05:11:46.818720+0000","last_became_active":"2024-09-13T05:10:40.883543+0000","last_became_peered":"2024-09-13T05:10:40.883543+0000","last_unstale":"2024-09-13T05:11:46.818720+0000","last_undegraded":"2024-09-13T05:11:46.818720+0000","last_fullsized":"2024-09-13T05:11:46.818720+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:14:23.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048307200000000003,"stat_sum":{"num_bytes":62278263,"num_objects":73,"num_object_clones":12,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":31,"num_read":4626,"num_read_kb":21825,"num_write":958,"num_write_kb":7545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":633324,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"102'769","reported_seq":2440,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-13T05:11:46.582796+0000","last_change":"2024-09-13T05:10:11.680877+0000","last_active":"2024-09-13T05:11:46.582796+0000","last_peered":"2024-09-13T05:11:46.582796+0000","last_clean":"2024-09-13T05:11:46.582796+0000","last_became_active":"2024-09-13T05:10:09.649053+0000","last_became_peered":"2024-09-13T05:10:09.649053+0000","last_unstale":"2024-09-13T05:11:46.582796+0000","last_undegraded":"2024-09-13T05:11:46.582796+0000","last_fullsized":"2024-09-13T05:11:46.582796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:14.770260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062821800000000005,"stat_sum":{"num_bytes":49165232,"num_objects":96,"num_object_clones":16,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":43,"num_read":4499,"num_read_kb":51070,"num_write":1094,"num_write_kb":39019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1270949571,"num_objects":2597,"num_object_clones":363,"num_object_copies":5194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2597,"num_whiteouts":1182,"num_read":138864,"num_read_kb":508157,"num_write":15654,"num_write_kb":344451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1978,"num_bytes_recovered":69274998,"num_keys_recovered":233,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":346955776,"data_stored":395595343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13923,"ondisk_log_size":13923,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":154268,"kb_used_data":78868,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94217572,"statfs":{"total":96636764160,"available":96478793728,"internally_reserved":0,"allocated":80760832,"data_stored":89290403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":77199819},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.69099999999999995}]},{"osd":1,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.66600000000000004}]},{"osd":2,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.629},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.59299999999999997}]},{"osd":3,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.749}]},{"osd":4,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.64900000000000002}]},{"osd":6,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.83099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61464,"kb_used_data":34444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94310376,"statfs":{"total":96636764160,"available":96573825024,"internally_reserved":0,"allocated":35270656,"data_stored":38668547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.65400000000000003}]},{"osd":1,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.53100000000000003}]},{"osd":2,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.0089999999999999}]},{"osd":4,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.88900000000000001}]},{"osd":5,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.91400000000000003}]},{"osd":7,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.94999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138384,"kb_used_data":81028,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94233456,"statfs":{"total":96636764160,"available":96495058944,"internally_reserved":0,"allocated":82972672,"data_stored":91654287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.61599999999999999}]},{"osd":1,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.64100000000000001}]},{"osd":2,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.84199999999999997}]},{"osd":3,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.86899999999999999}]},{"osd":4,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.71299999999999997}]},{"osd":6,"last update":"Fri Sep 13 05:10:58 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.77800000000000002}]},{"osd":7,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.0660000000000001}]}]},{"osd":4,"up_from":0,"seq":55834574876,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131152,"kb_used_data":77892,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94240688,"statfs":{"total":96636764160,"available":96502464512,"internally_reserved":0,"allocated":79761408,"data_stored":93218618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":54524360},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.501},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.52600000000000002}]},{"osd":1,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.72699999999999998}]},{"osd":2,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.65500000000000003}]},{"osd":4,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.63600000000000001}]},{"osd":6,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.62},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.93400000000000005}]},{"osd":7,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.88200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77776,"kb_used_data":50760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94294064,"statfs":{"total":96636764160,"available":96557121536,"internally_reserved":0,"allocated":51978240,"data_stored":57765230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.85999999999999999}]},{"osd":3,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.73599999999999999}]},{"osd":4,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.94399999999999995}]},{"osd":5,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.81799999999999995}]},{"osd":6,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.0009999999999999}]},{"osd":7,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.099},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.629}]}]},{"osd":1,"up_from":0,"seq":55834574874,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":0,"seq":55834574876,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10035200,"data_stored":11939429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6619136,"data_stored":10238144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51290112,"data_stored":57726661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":80384000,"data_stored":94490769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":82804736,"data_stored":92139987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":34246656,"data_stored":38301735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":81575936,"data_stored":90758618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:11:49.247 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-13T05:11:49.247 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:11:49.247 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T05:11:49.247 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T05:11:49.248 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T05:11:49.249 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is set 2024-09-13T05:11:49.249 INFO:teuthology.orchestra.run.smithi120.stdout:4673 read 0x21fb596 thru 0x220a85e (0xf2c9 bytes) 2024-09-13T05:11:49.249 INFO:teuthology.orchestra.run.smithi120.stdout:4674 writesame 0x4f8b603 thru 0x4f939c0 data_size 0x4d(0x83be bytes) 2024-09-13T05:11:49.340 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:49.333+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:49.365 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:49.366 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:49.366 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:49.366 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:49.366 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:49.376 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:11:49.441 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:49.440+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:49.464 INFO:teuthology.orchestra.run.smithi120.stdout:4675 writesame 0x599c0e6 thru 0x59abe07 data_size 0x1(0xfd22 bytes) 2024-09-13T05:11:49.479 INFO:teuthology.orchestra.run.smithi120.stdout:4677 writesame 0xb59f796 thru 0xb5a16d3 data_size 0x2b(0x1f3e bytes) 2024-09-13T05:11:49.492 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:49.492 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:49.493 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:49.493 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:49.493 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.493 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3.bb1d1096 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:11:49.493 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:11:49.493 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 25.545191735, 2024-09-13T05:11:49.493 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68834410099999999, 2024-09-13T05:11:49.493 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.493 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:49.493 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.493 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.494 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.494 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:11:49.494 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.494 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.494 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.494 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.494 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:11:49.494 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.494 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.495 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.495 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.495 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:11:49.495 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.495 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.495 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.495 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.495 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943719+0000", 2024-09-13T05:11:49.495 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:11:49.495 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.495 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.496 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.496 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943734+0000", 2024-09-13T05:11:49.496 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4793e-05 2024-09-13T05:11:49.496 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.496 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.496 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.496 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943765+0000", 2024-09-13T05:11:49.496 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0648999999999997e-05 2024-09-13T05:11:49.496 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.497 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.497 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.497 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943779+0000", 2024-09-13T05:11:49.497 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.447e-05 2024-09-13T05:11:49.497 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.497 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.497 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.497 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943872+0000", 2024-09-13T05:11:49.497 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3304e-05 2024-09-13T05:11:49.497 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.497 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.497 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:49.497 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943884+0000", 2024-09-13T05:11:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.167e-05 2024-09-13T05:11:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632042+0000", 2024-09-13T05:11:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68815832600000004 2024-09-13T05:11:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632066+0000", 2024-09-13T05:11:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3765999999999999e-05 2024-09-13T05:11:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.498 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3.b6bd6256 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:11:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:11:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 25.545067235000001, 2024-09-13T05:11:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68852592499999998, 2024-09-13T05:11:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:11:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:11:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:11:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943846+0000", 2024-09-13T05:11:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943852+0000", 2024-09-13T05:11:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3820000000000001e-06 2024-09-13T05:11:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943876+0000", 2024-09-13T05:11:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3995e-05 2024-09-13T05:11:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943898+0000", 2024-09-13T05:11:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1838999999999999e-05 2024-09-13T05:11:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946457+0000", 2024-09-13T05:11:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025588910000000002 2024-09-13T05:11:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946499+0000", 2024-09-13T05:11:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2814e-05 2024-09-13T05:11:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632364+0000", 2024-09-13T05:11:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68586484999999997 2024-09-13T05:11:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632372+0000", 2024-09-13T05:11:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1659999999999994e-06 2024-09-13T05:11:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3:6908b8dd:::rbd_data.112d8d1317eb.000000000000000f:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:11:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:11:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 25.507923157, 2024-09-13T05:11:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65181049499999999, 2024-09-13T05:11:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:11:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:11:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:11:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980989+0000", 2024-09-13T05:11:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980996+0000", 2024-09-13T05:11:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2200000000000003e-06 2024-09-13T05:11:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981011+0000", 2024-09-13T05:11:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4997000000000001e-05 2024-09-13T05:11:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981025+0000", 2024-09-13T05:11:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3604000000000001e-05 2024-09-13T05:11:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981110+0000", 2024-09-13T05:11:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4948000000000001e-05 2024-09-13T05:11:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981120+0000", 2024-09-13T05:11:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9399999999999997e-06 2024-09-13T05:11:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632425+0000", 2024-09-13T05:11:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65130460499999998 2024-09-13T05:11:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632587+0000", 2024-09-13T05:11:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016199500000000001 2024-09-13T05:11:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632801+0000", 2024-09-13T05:11:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021459499999999999 2024-09-13T05:11:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3:6a46bd6d:::rbd_data.112d8d1317eb.0000000000000010:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:11:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:11:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 25.507865501000001, 2024-09-13T05:11:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65213695699999996, 2024-09-13T05:11:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:11:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:11:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:11:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:11:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981052+0000", 2024-09-13T05:11:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4469999999999999e-06 2024-09-13T05:11:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981066+0000", 2024-09-13T05:11:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3658e-05 2024-09-13T05:11:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981073+0000", 2024-09-13T05:11:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:11:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981150+0000", 2024-09-13T05:11:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7783999999999999e-05 2024-09-13T05:11:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981161+0000", 2024-09-13T05:11:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0197000000000001e-05 2024-09-13T05:11:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632926+0000", 2024-09-13T05:11:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65176517300000003 2024-09-13T05:11:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633081+0000", 2024-09-13T05:11:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000155172 2024-09-13T05:11:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633185+0000", 2024-09-13T05:11:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000104329 2024-09-13T05:11:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118368 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 2806784~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.389513+0000", 2024-09-13T05:11:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.099400403, 2024-09-13T05:11:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059680972999999998, 2024-09-13T05:11:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118368 2024-09-13T05:11:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389513+0000", 2024-09-13T05:11:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389513+0000", 2024-09-13T05:11:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389513+0000", 2024-09-13T05:11:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389515+0000", 2024-09-13T05:11:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3949999999999999e-06 2024-09-13T05:11:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389523+0000", 2024-09-13T05:11:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2139999999999999e-06 2024-09-13T05:11:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389528+0000", 2024-09-13T05:11:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0209999999999999e-06 2024-09-13T05:11:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449026+0000", 2024-09-13T05:11:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059498589999999997 2024-09-13T05:11:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449108+0000", 2024-09-13T05:11:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1488000000000003e-05 2024-09-13T05:11:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449194+0000", 2024-09-13T05:11:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6645999999999997e-05 2024-09-13T05:11:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118369 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 2821120~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.389532+0000", 2024-09-13T05:11:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.0993819330000001, 2024-09-13T05:11:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059952904000000001, 2024-09-13T05:11:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118369 2024-09-13T05:11:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389532+0000", 2024-09-13T05:11:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389532+0000", 2024-09-13T05:11:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389532+0000", 2024-09-13T05:11:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389534+0000", 2024-09-13T05:11:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.615e-06 2024-09-13T05:11:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389540+0000", 2024-09-13T05:11:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5969999999999999e-06 2024-09-13T05:11:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389544+0000", 2024-09-13T05:11:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5580000000000002e-06 2024-09-13T05:11:49.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.523 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449254+0000", 2024-09-13T05:11:49.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059709275999999999 2024-09-13T05:11:49.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.523 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:49.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449348+0000", 2024-09-13T05:11:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4812e-05 2024-09-13T05:11:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449485+0000", 2024-09-13T05:11:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000136382 2024-09-13T05:11:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118370 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 2835456~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.389549+0000", 2024-09-13T05:11:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.099364958, 2024-09-13T05:11:49.525 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060184400999999998, 2024-09-13T05:11:49.525 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.525 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:49.525 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.525 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.525 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.525 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118370 2024-09-13T05:11:49.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.525 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389549+0000", 2024-09-13T05:11:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389549+0000", 2024-09-13T05:11:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389548+0000", 2024-09-13T05:11:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389551+0000", 2024-09-13T05:11:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2479999999999999e-06 2024-09-13T05:11:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389557+0000", 2024-09-13T05:11:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6080000000000001e-06 2024-09-13T05:11:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389562+0000", 2024-09-13T05:11:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8670000000000002e-06 2024-09-13T05:11:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449531+0000", 2024-09-13T05:11:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059968606000000001 2024-09-13T05:11:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449623+0000", 2024-09-13T05:11:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2464000000000001e-05 2024-09-13T05:11:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449733+0000", 2024-09-13T05:11:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010996 2024-09-13T05:11:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118393 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 3107840~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393407+0000", 2024-09-13T05:11:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.0955066769999999, 2024-09-13T05:11:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059784062999999998, 2024-09-13T05:11:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.530 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:49.530 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.530 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.530 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.530 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118393 2024-09-13T05:11:49.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.530 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393407+0000", 2024-09-13T05:11:49.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393407+0000", 2024-09-13T05:11:49.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393406+0000", 2024-09-13T05:11:49.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393409+0000", 2024-09-13T05:11:49.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6369999999999999e-06 2024-09-13T05:11:49.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393414+0000", 2024-09-13T05:11:49.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2129999999999999e-06 2024-09-13T05:11:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393419+0000", 2024-09-13T05:11:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7160000000000002e-06 2024-09-13T05:11:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453054+0000", 2024-09-13T05:11:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059634468000000003 2024-09-13T05:11:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:49.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453118+0000", 2024-09-13T05:11:49.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4271999999999997e-05 2024-09-13T05:11:49.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453191+0000", 2024-09-13T05:11:49.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3406999999999997e-05 2024-09-13T05:11:49.534 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.534 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118394 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 3122176~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393434+0000", 2024-09-13T05:11:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.0954798939999999, 2024-09-13T05:11:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059854255000000002, 2024-09-13T05:11:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118394 2024-09-13T05:11:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393434+0000", 2024-09-13T05:11:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393434+0000", 2024-09-13T05:11:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393433+0000", 2024-09-13T05:11:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393436+0000", 2024-09-13T05:11:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5639999999999999e-06 2024-09-13T05:11:49.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393442+0000", 2024-09-13T05:11:49.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1920000000000002e-06 2024-09-13T05:11:49.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393448+0000", 2024-09-13T05:11:49.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2219999999999999e-06 2024-09-13T05:11:49.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.539 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.539 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453202+0000", 2024-09-13T05:11:49.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059753891000000003 2024-09-13T05:11:49.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.539 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:49.539 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453242+0000", 2024-09-13T05:11:49.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9410999999999999e-05 2024-09-13T05:11:49.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.540 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.540 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453288+0000", 2024-09-13T05:11:49.540 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6519e-05 2024-09-13T05:11:49.540 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.540 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.540 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.541 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118395 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 3136512~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.541 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393453+0000", 2024-09-13T05:11:49.541 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.095461126, 2024-09-13T05:11:49.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059998586, 2024-09-13T05:11:49.541 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.541 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:49.541 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.541 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.541 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.541 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118395 2024-09-13T05:11:49.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393453+0000", 2024-09-13T05:11:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393453+0000", 2024-09-13T05:11:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393452+0000", 2024-09-13T05:11:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393455+0000", 2024-09-13T05:11:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6740000000000001e-06 2024-09-13T05:11:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393460+0000", 2024-09-13T05:11:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5860000000000004e-06 2024-09-13T05:11:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393465+0000", 2024-09-13T05:11:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7140000000000001e-06 2024-09-13T05:11:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453320+0000", 2024-09-13T05:11:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059854737999999998 2024-09-13T05:11:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453382+0000", 2024-09-13T05:11:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2147e-05 2024-09-13T05:11:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453451+0000", 2024-09-13T05:11:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9226000000000004e-05 2024-09-13T05:11:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118433 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 12288~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393469+0000", 2024-09-13T05:11:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.0954445129999999, 2024-09-13T05:11:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060123661000000002, 2024-09-13T05:11:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118433 2024-09-13T05:11:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393469+0000", 2024-09-13T05:11:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393469+0000", 2024-09-13T05:11:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393469+0000", 2024-09-13T05:11:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393471+0000", 2024-09-13T05:11:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3350000000000001e-06 2024-09-13T05:11:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393477+0000", 2024-09-13T05:11:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3639999999999998e-06 2024-09-13T05:11:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393481+0000", 2024-09-13T05:11:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6020000000000002e-06 2024-09-13T05:11:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453477+0000", 2024-09-13T05:11:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059995615000000002 2024-09-13T05:11:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453522+0000", 2024-09-13T05:11:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5139999999999998e-05 2024-09-13T05:11:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453593+0000", 2024-09-13T05:11:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0963000000000005e-05 2024-09-13T05:11:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118434 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 26624~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393485+0000", 2024-09-13T05:11:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.09542837, 2024-09-13T05:11:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060351620000000002, 2024-09-13T05:11:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118434 2024-09-13T05:11:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393485+0000", 2024-09-13T05:11:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393485+0000", 2024-09-13T05:11:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393485+0000", 2024-09-13T05:11:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393488+0000", 2024-09-13T05:11:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8090000000000001e-06 2024-09-13T05:11:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393494+0000", 2024-09-13T05:11:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7780000000000004e-06 2024-09-13T05:11:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393498+0000", 2024-09-13T05:11:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.668e-06 2024-09-13T05:11:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453628+0000", 2024-09-13T05:11:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060129969999999998 2024-09-13T05:11:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453733+0000", 2024-09-13T05:11:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000105157 2024-09-13T05:11:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453837+0000", 2024-09-13T05:11:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000103596 2024-09-13T05:11:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118435 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 40960~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393503+0000", 2024-09-13T05:11:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.0954109830000001, 2024-09-13T05:11:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060548137000000002, 2024-09-13T05:11:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118435 2024-09-13T05:11:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393503+0000", 2024-09-13T05:11:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393503+0000", 2024-09-13T05:11:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393502+0000", 2024-09-13T05:11:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393505+0000", 2024-09-13T05:11:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4279999999999999e-06 2024-09-13T05:11:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393510+0000", 2024-09-13T05:11:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.04e-06 2024-09-13T05:11:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393515+0000", 2024-09-13T05:11:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6809999999999997e-06 2024-09-13T05:11:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453862+0000", 2024-09-13T05:11:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060347849000000002 2024-09-13T05:11:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453951+0000", 2024-09-13T05:11:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8121999999999994e-05 2024-09-13T05:11:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.454051+0000", 2024-09-13T05:11:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010035399999999999 2024-09-13T05:11:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118436 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 55296~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393520+0000", 2024-09-13T05:11:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.095393539, 2024-09-13T05:11:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060673151000000002, 2024-09-13T05:11:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118436 2024-09-13T05:11:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393520+0000", 2024-09-13T05:11:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393520+0000", 2024-09-13T05:11:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393520+0000", 2024-09-13T05:11:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393523+0000", 2024-09-13T05:11:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6220000000000001e-06 2024-09-13T05:11:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393528+0000", 2024-09-13T05:11:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5339999999999999e-06 2024-09-13T05:11:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393533+0000", 2024-09-13T05:11:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8060000000000002e-06 2024-09-13T05:11:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.454087+0000", 2024-09-13T05:11:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060554502000000003 2024-09-13T05:11:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.454138+0000", 2024-09-13T05:11:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0398000000000001e-05 2024-09-13T05:11:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.454193+0000", 2024-09-13T05:11:49.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5661000000000001e-05 2024-09-13T05:11:49.563 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.563 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.563 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.563 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118437 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 69632~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.563 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393561+0000", 2024-09-13T05:11:49.564 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.095353094, 2024-09-13T05:11:49.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060852235999999997, 2024-09-13T05:11:49.564 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.564 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:49.564 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.564 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.564 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.564 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118437 2024-09-13T05:11:49.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.564 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393561+0000", 2024-09-13T05:11:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393561+0000", 2024-09-13T05:11:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393560+0000", 2024-09-13T05:11:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393573+0000", 2024-09-13T05:11:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2893e-05 2024-09-13T05:11:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393588+0000", 2024-09-13T05:11:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4810000000000001e-05 2024-09-13T05:11:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393593+0000", 2024-09-13T05:11:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4829999999999999e-06 2024-09-13T05:11:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.454229+0000", 2024-09-13T05:11:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060635823999999998 2024-09-13T05:11:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:49.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.454316+0000", 2024-09-13T05:11:49.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6328000000000004e-05 2024-09-13T05:11:49.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.454413+0000", 2024-09-13T05:11:49.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7428000000000003e-05 2024-09-13T05:11:49.568 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.569 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.569 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.569 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118457 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 356352~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.570 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.397421+0000", 2024-09-13T05:11:49.570 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.0914928180000001, 2024-09-13T05:11:49.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059721492000000001, 2024-09-13T05:11:49.570 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.571 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:49.571 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.571 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.571 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.572 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118457 2024-09-13T05:11:49.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.572 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397421+0000", 2024-09-13T05:11:49.573 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.573 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.573 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397421+0000", 2024-09-13T05:11:49.573 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.574 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.574 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397421+0000", 2024-09-13T05:11:49.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.574 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.574 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.575 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397423+0000", 2024-09-13T05:11:49.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3360000000000002e-06 2024-09-13T05:11:49.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.575 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.575 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397428+0000", 2024-09-13T05:11:49.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1019999999999996e-06 2024-09-13T05:11:49.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397433+0000", 2024-09-13T05:11:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5369999999999999e-06 2024-09-13T05:11:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457050+0000", 2024-09-13T05:11:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059617268000000001 2024-09-13T05:11:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457088+0000", 2024-09-13T05:11:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8586e-05 2024-09-13T05:11:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457142+0000", 2024-09-13T05:11:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4101000000000003e-05 2024-09-13T05:11:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118458 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 370688~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.397453+0000", 2024-09-13T05:11:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.091460823, 2024-09-13T05:11:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059799484, 2024-09-13T05:11:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118458 2024-09-13T05:11:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397453+0000", 2024-09-13T05:11:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397453+0000", 2024-09-13T05:11:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397452+0000", 2024-09-13T05:11:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397456+0000", 2024-09-13T05:11:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:11:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397461+0000", 2024-09-13T05:11:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9000000000000003e-06 2024-09-13T05:11:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397466+0000", 2024-09-13T05:11:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6659999999999999e-06 2024-09-13T05:11:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457167+0000", 2024-09-13T05:11:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059700955 2024-09-13T05:11:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457209+0000", 2024-09-13T05:11:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1758000000000002e-05 2024-09-13T05:11:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457252+0000", 2024-09-13T05:11:49.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3661000000000001e-05 2024-09-13T05:11:49.582 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.582 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.582 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.582 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118459 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 385024~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.582 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.397470+0000", 2024-09-13T05:11:49.582 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.091443653, 2024-09-13T05:11:49.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059892342000000001, 2024-09-13T05:11:49.582 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118459 2024-09-13T05:11:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397470+0000", 2024-09-13T05:11:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397470+0000", 2024-09-13T05:11:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397470+0000", 2024-09-13T05:11:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397472+0000", 2024-09-13T05:11:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4839999999999998e-06 2024-09-13T05:11:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397477+0000", 2024-09-13T05:11:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0819999999999998e-06 2024-09-13T05:11:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397482+0000", 2024-09-13T05:11:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5090000000000004e-06 2024-09-13T05:11:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457277+0000", 2024-09-13T05:11:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059795607000000001 2024-09-13T05:11:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457316+0000", 2024-09-13T05:11:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9004999999999997e-05 2024-09-13T05:11:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457362+0000", 2024-09-13T05:11:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6149000000000001e-05 2024-09-13T05:11:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.587 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.587 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.587 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118460 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 399360~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.587 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.397486+0000", 2024-09-13T05:11:49.587 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.091428246, 2024-09-13T05:11:49.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059990031999999999, 2024-09-13T05:11:49.587 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118460 2024-09-13T05:11:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397486+0000", 2024-09-13T05:11:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397486+0000", 2024-09-13T05:11:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397485+0000", 2024-09-13T05:11:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397488+0000", 2024-09-13T05:11:49.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:11:49.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397493+0000", 2024-09-13T05:11:49.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0919999999999997e-06 2024-09-13T05:11:49.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397497+0000", 2024-09-13T05:11:49.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4100000000000001e-06 2024-09-13T05:11:49.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457390+0000", 2024-09-13T05:11:49.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059892327000000002 2024-09-13T05:11:49.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:49.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457430+0000", 2024-09-13T05:11:49.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0590999999999998e-05 2024-09-13T05:11:49.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457476+0000", 2024-09-13T05:11:49.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5342000000000001e-05 2024-09-13T05:11:49.592 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.592 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.592 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.592 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118461 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 413696~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:49.592 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.397501+0000", 2024-09-13T05:11:49.592 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.0914126159999999, 2024-09-13T05:11:49.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060091361000000003, 2024-09-13T05:11:49.592 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.592 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:49.593 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.593 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.593 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.593 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118461 2024-09-13T05:11:49.593 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.593 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.593 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.593 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.593 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397501+0000", 2024-09-13T05:11:49.593 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.593 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.593 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.593 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.594 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397501+0000", 2024-09-13T05:11:49.594 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.594 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.594 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.594 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397501+0000", 2024-09-13T05:11:49.594 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:49.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.594 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.594 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.594 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397507+0000", 2024-09-13T05:11:49.594 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3940000000000001e-06 2024-09-13T05:11:49.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.595 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397512+0000", 2024-09-13T05:11:49.595 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2780000000000001e-06 2024-09-13T05:11:49.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.595 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397517+0000", 2024-09-13T05:11:49.595 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7219999999999999e-06 2024-09-13T05:11:49.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.595 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457502+0000", 2024-09-13T05:11:49.595 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059985199000000003 2024-09-13T05:11:49.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:49.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457545+0000", 2024-09-13T05:11:49.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2398000000000003e-05 2024-09-13T05:11:49.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457593+0000", 2024-09-13T05:11:49.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7768000000000001e-05 2024-09-13T05:11:49.596 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.596 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.596 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.597 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.597 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.597 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:49.598 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:49.596+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:49.599 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:11:49.700 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:49.700 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:49.700 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:11:49.700 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:49.701 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:49.693+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:49.710 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:11:49.736 INFO:teuthology.orchestra.run.smithi120.stdout:4679 writesame 0x58ac147 thru 0x58b88e3 data_size 0x1(0xc79d bytes) 2024-09-13T05:11:49.749 INFO:teuthology.orchestra.run.smithi120.stdout:4681 write 0x424f68b thru 0x4250c93 (0x1609 bytes) 2024-09-13T05:11:49.752 INFO:teuthology.orchestra.run.smithi120.stdout:4683 write 0xac0d238 thru 0xac107e9 (0x35b2 bytes) 2024-09-13T05:11:49.758 INFO:teuthology.orchestra.run.smithi120.stdout:4684 punch from 0xc3bb549 to 0xc3c6342, (0xadf9 bytes) 2024-09-13T05:11:49.758 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:49.758 INFO:teuthology.orchestra.run.smithi120.stdout:4686 punch from 0xa3b74da to 0xa3c09e3, (0x9509 bytes) 2024-09-13T05:11:49.758 INFO:teuthology.orchestra.run.smithi120.stdout:4687 writesame 0xc498ccd thru 0xc49d6c4 data_size 0x24(0x49f8 bytes) 2024-09-13T05:11:49.776 INFO:teuthology.orchestra.run.smithi120.stdout:4688 write 0x5a0728f thru 0x5a13654 (0xc3c6 bytes) 2024-09-13T05:11:49.781 INFO:teuthology.orchestra.run.smithi120.stdout:4689 punch from 0xc6bef0 to 0xc6c1d2, (0x2e2 bytes) 2024-09-13T05:11:49.782 INFO:teuthology.orchestra.run.smithi120.stdout:4690 punch from 0xc05a58f to 0xc06291b, (0x838c bytes) 2024-09-13T05:11:49.783 INFO:teuthology.orchestra.run.smithi120.stdout:4691 trunc from 0xdcb7c11 to 0xd02c7f3 2024-09-13T05:11:49.801 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:49.793+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:49.813 INFO:teuthology.orchestra.run.smithi120.stdout:4692 trunc from 0xd02c7f3 to 0x7a703de 2024-09-13T05:11:49.829 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:49.829 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:49.829 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:49.829 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:49.829 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:49.843 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:11:49.859 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:49.874 INFO:teuthology.orchestra.run.smithi120.stdout:4694 writesame 0xb230d79 thru 0xb234305 data_size 0x1(0x358d bytes) 2024-09-13T05:11:49.874 INFO:teuthology.orchestra.run.smithi120.stdout:4695 read 0xaffa91a thru 0xb0022d2 (0x79b9 bytes) 2024-09-13T05:11:49.874 INFO:teuthology.orchestra.run.smithi120.stdout:4696 trunc from 0xb234306 to 0xb9ad377 2024-09-13T05:11:49.902 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:49.900+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:49.903 INFO:teuthology.orchestra.run.smithi120.stdout:4697 trunc from 0xb9ad377 to 0x2c08517 2024-09-13T05:11:49.956 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:49.957 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:49.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:49.957 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:49.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.957 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:49.957 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:49.957 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 73.091061748000001, 2024-09-13T05:11:49.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:11:49.957 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:11:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:11:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:11:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:11:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:11:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:11:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:11:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:11:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:11:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:11:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:11:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:11:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:11:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:11:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:11:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:11:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:11:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 73.091037311999997, 2024-09-13T05:11:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:11:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:11:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:11:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:11:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:11:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:11:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:11:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:11:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:11:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:11:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:11:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:11:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:11:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:11:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:11:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:11:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:11:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:11:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 73.091027486000002, 2024-09-13T05:11:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:11:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:11:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:11:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:11:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:11:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:11:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:11:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:11:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:11:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:11:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:11:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:11:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:11:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:11:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:11:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:11:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 73.091019250000002, 2024-09-13T05:11:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:11:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:11:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:11:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:11:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.976 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.976 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:11:49.976 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:11:49.976 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.976 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.976 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.976 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:11:49.976 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:11:49.976 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.976 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.976 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.976 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:11:49.976 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:11:49.976 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:11:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:11:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:11:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:11:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:11:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:11:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 73.090997337999994, 2024-09-13T05:11:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:11:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:11:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:11:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:11:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:11:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:11:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:11:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:11:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:11:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:11:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:11:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:11:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:11:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:11:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.983 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:11:49.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:11:49.983 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.983 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.983 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.983 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.983 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:49.983 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:49.983 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 73.090988734000007, 2024-09-13T05:11:49.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:11:49.984 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.984 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:49.984 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.984 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.984 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.984 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:11:49.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.984 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.986 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:11:49.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:11:49.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.986 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:11:49.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:11:49.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:11:49.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:11:49.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:11:49.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:11:49.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:11:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:11:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:11:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:11:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:11:49.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:11:49.989 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.989 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.989 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.989 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:49.989 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:49.989 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 73.090979039999993, 2024-09-13T05:11:49.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:11:49.990 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.990 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:49.990 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.990 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.990 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.990 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:11:49.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.990 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.991 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.991 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:49.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.991 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.991 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:49.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:11:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:11:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:11:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:11:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:11:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:11:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:11:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:11:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:11:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:11:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:11:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:11:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:11:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:11:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 73.090969924999996, 2024-09-13T05:11:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:11:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:11:49.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.996 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:49.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:49.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:49.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:49.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:49.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:49.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:11:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:11:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:11:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:11:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:11:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:11:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:11:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:11:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:11:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:11:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:11:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:11:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:11:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:11:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:11:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 73.090961445999994, 2024-09-13T05:11:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:11:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:11:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:11:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:11:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:11:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:11:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:11:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:11:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:11:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:11:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:11:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:11:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:11:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:11:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:11:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:11:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:11:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:11:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:11:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:11:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 73.090949520999999, 2024-09-13T05:11:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:11:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:11:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:11:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:11:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:11:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:11:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:11:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:11:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:11:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:11:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:11:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:11:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:11:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:11:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:11:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:11:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:11:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:11:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:11:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 73.090927932, 2024-09-13T05:11:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:11:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:11:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:11:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:11:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:11:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:11:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:11:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:11:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:11:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:11:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:50.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:11:50.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:11:50.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:50.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:11:50.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:11:50.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:11:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:11:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 73.090904804000004, 2024-09-13T05:11:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:11:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:11:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:11:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:11:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:11:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:11:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:11:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:11:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:11:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:11:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:11:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:11:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:11:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:11:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:11:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:11:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:11:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 73.090889430999994, 2024-09-13T05:11:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:11:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:50.020 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.020 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:11:50.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.020 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:50.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.020 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:50.020 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:11:50.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:50.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.021 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:50.021 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:11:50.021 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:50.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.021 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:50.021 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:11:50.021 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:50.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:11:50.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:11:50.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:50.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:11:50.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:11:50.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:11:50.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:11:50.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:50.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:11:50.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:11:50.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:50.024 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:11:50.024 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:11:50.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:50.024 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:11:50.024 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:11:50.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.025 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:50.025 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:11:50.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:11:50.025 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.025 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:50.025 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.025 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:50.026 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:50.026 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 73.090868963000005, 2024-09-13T05:11:50.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:11:50.026 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:50.026 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:50.026 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:50.026 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:50.026 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.026 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:11:50.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.027 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:50.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.027 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:50.027 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:50.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:50.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.027 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:50.027 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:11:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:11:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:11:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:11:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:11:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:11:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:11:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:11:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.030 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:50.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:11:50.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:11:50.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.030 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:50.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:11:50.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:11:50.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.030 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:50.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:11:50.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:11:50.030 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 73.090852302000002, 2024-09-13T05:11:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:11:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:11:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:11:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:11:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:11:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:11:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:11:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:11:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:11:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:11:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:11:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:11:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:11:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:11:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:11:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:11:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:11:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 73.090825589000005, 2024-09-13T05:11:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:11:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:11:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:11:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:11:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:11:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:11:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:11:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:11:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:11:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:11:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:11:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:11:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:11:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:11:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:11:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:11:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:11:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:11:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:11:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:50.041 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:50.041 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 73.090806736999994, 2024-09-13T05:11:50.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:11:50.041 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:50.041 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:50.041 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:50.041 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:50.041 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.041 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:11:50.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:11:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:11:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:11:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:11:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:11:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:11:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:11:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:11:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:11:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:11:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:50.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:11:50.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:11:50.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:50.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:11:50.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:11:50.045 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.045 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:50.045 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.046 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:50.046 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:50.046 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 73.090788950999993, 2024-09-13T05:11:50.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:11:50.046 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:50.046 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:50.046 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:50.046 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:50.046 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.046 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:11:50.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.047 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:50.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:50.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:50.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:50.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:50.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:50.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:50.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:50.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:50.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:50.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:11:50.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:11:50.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:50.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:11:50.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:11:50.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.049 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:11:50.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:11:50.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.049 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:50.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:11:50.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:11:50.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.050 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:50.050 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:11:50.050 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:11:50.050 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.050 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.050 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:50.050 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:11:50.050 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:11:50.050 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.050 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.050 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:50.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:11:50.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:11:50.051 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.051 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:50.051 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.051 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:50.051 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:50.051 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 73.090753891000006, 2024-09-13T05:11:50.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:11:50.051 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:50.052 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:50.052 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:50.052 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:50.052 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.052 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:11:50.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.052 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:50.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:50.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:50.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:50.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.053 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:50.053 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:50.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:50.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.053 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:50.053 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:50.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:50.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:11:50.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:11:50.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:50.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:11:50.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:11:50.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.055 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:11:50.055 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:11:50.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.055 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:50.055 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:11:50.055 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:11:50.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.055 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:50.055 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:11:50.056 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:11:50.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.056 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.056 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:50.056 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:11:50.056 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:11:50.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.056 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.056 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:50.056 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:11:50.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:11:50.057 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.057 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:50.057 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.057 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:50.057 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:50.057 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 73.090737075999996, 2024-09-13T05:11:50.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:11:50.057 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:50.058 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:50.058 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:50.058 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:50.058 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.058 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:11:50.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.058 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:50.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:50.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:50.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:50.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.059 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.059 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:50.059 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:50.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:50.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.059 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.059 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:50.059 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:50.060 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.060 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.060 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:50.060 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:11:50.060 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:11:50.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.060 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.060 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:50.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:11:50.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:11:50.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:11:50.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:11:50.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:50.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:11:50.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:11:50.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:50.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:11:50.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:11:50.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:50.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:11:50.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:11:50.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:50.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:50.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:50.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:11:50.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:11:50.062 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.062 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:50.063 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.063 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:50.063 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:50.063 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:50.064 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:50.057+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:50.065 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:11:50.165 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:50.161+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:50.186 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:50.186 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:50.186 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:50.186 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:50.196 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:11:50.266 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:50.261+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:50.311 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:50.311 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:50.311 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:50.311 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:50.311 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:50.321 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:11:50.368 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:50.361+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:50.438 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:50.438 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:50.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:50.438 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:50.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.439 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10634 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 731136~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:50.439 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:50.439 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 80.031175325999996, 2024-09-13T05:11:50.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028136992999999999, 2024-09-13T05:11:50.439 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:50.439 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:50.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:50.440 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:50.440 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.440 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10634 2024-09-13T05:11:50.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.440 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:50.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:50.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:50.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:50.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:50.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:50.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:50.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:50.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401987+0000", 2024-09-13T05:11:50.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5090000000000001e-06 2024-09-13T05:11:50.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:50.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401997+0000", 2024-09-13T05:11:50.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8009999999999998e-06 2024-09-13T05:11:50.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402000+0000", 2024-09-13T05:11:50.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.756e-06 2024-09-13T05:11:50.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:50.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430035+0000", 2024-09-13T05:11:50.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028034967000000001 2024-09-13T05:11:50.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:50.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430081+0000", 2024-09-13T05:11:50.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6448e-05 2024-09-13T05:11:50.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:50.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430123+0000", 2024-09-13T05:11:50.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1758000000000002e-05 2024-09-13T05:11:50.446 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.447 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:50.447 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.447 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10635 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 740352~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:50.447 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:11:50.447 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 80.031158712000007, 2024-09-13T05:11:50.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028229890000000001, 2024-09-13T05:11:50.447 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:50.447 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:50.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:50.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:50.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.448 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10635 2024-09-13T05:11:50.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.448 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:50.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:50.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:11:50.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:50.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:11:50.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:50.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402002+0000", 2024-09-13T05:11:50.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:50.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402004+0000", 2024-09-13T05:11:50.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.575e-06 2024-09-13T05:11:50.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:50.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402007+0000", 2024-09-13T05:11:50.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1240000000000001e-06 2024-09-13T05:11:50.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402010+0000", 2024-09-13T05:11:50.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5859999999999999e-06 2024-09-13T05:11:50.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:50.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430146+0000", 2024-09-13T05:11:50.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028136746000000001 2024-09-13T05:11:50.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:50.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430195+0000", 2024-09-13T05:11:50.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8948e-05 2024-09-13T05:11:50.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:50.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430232+0000", 2024-09-13T05:11:50.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7159000000000001e-05 2024-09-13T05:11:50.452 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.452 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:50.452 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.453 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10636 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 749568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:50.453 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:11:50.453 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 80.031149606, 2024-09-13T05:11:50.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328440999999999, 2024-09-13T05:11:50.453 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:50.453 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:50.453 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:50.453 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:50.453 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.453 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10636 2024-09-13T05:11:50.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.454 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:50.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:50.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:11:50.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:50.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:11:50.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:50.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402011+0000", 2024-09-13T05:11:50.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:50.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:50.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402017+0000", 2024-09-13T05:11:50.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5620000000000003e-06 2024-09-13T05:11:50.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:50.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402020+0000", 2024-09-13T05:11:50.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1410000000000001e-06 2024-09-13T05:11:50.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402024+0000", 2024-09-13T05:11:50.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4489999999999999e-06 2024-09-13T05:11:50.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:50.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430256+0000", 2024-09-13T05:11:50.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028232363 2024-09-13T05:11:50.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:50.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430299+0000", 2024-09-13T05:11:50.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2830999999999997e-05 2024-09-13T05:11:50.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:50.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430340+0000", 2024-09-13T05:11:50.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1301000000000003e-05 2024-09-13T05:11:50.457 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.458 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:50.458 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.458 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10637 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 758784~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:50.458 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:50.458 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 80.031134492999996, 2024-09-13T05:11:50.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028441793, 2024-09-13T05:11:50.458 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:50.458 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:50.458 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:50.458 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:50.458 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.459 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10637 2024-09-13T05:11:50.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.459 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:50.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:50.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:50.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:50.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:50.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:50.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:50.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:50.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:50.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402031+0000", 2024-09-13T05:11:50.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6770000000000003e-06 2024-09-13T05:11:50.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:50.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402034+0000", 2024-09-13T05:11:50.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1540000000000002e-06 2024-09-13T05:11:50.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402038+0000", 2024-09-13T05:11:50.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4970000000000001e-06 2024-09-13T05:11:50.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:50.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430367+0000", 2024-09-13T05:11:50.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328906000000001 2024-09-13T05:11:50.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:50.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430416+0000", 2024-09-13T05:11:50.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:11:50.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:50.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430469+0000", 2024-09-13T05:11:50.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2284999999999998e-05 2024-09-13T05:11:50.463 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.463 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:50.464 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.464 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10638 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 768000~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:50.464 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:50.464 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 80.031121009000003, 2024-09-13T05:11:50.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028548740999999999, 2024-09-13T05:11:50.464 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:50.464 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:50.464 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:50.465 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:50.465 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.465 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10638 2024-09-13T05:11:50.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.465 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:50.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:50.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:50.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:50.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:50.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:50.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:50.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:50.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402041+0000", 2024-09-13T05:11:50.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4789999999999999e-06 2024-09-13T05:11:50.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:50.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402044+0000", 2024-09-13T05:11:50.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.694e-06 2024-09-13T05:11:50.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402047+0000", 2024-09-13T05:11:50.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.537e-06 2024-09-13T05:11:50.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:50.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430494+0000", 2024-09-13T05:11:50.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028447665 2024-09-13T05:11:50.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:50.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430544+0000", 2024-09-13T05:11:50.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9539000000000001e-05 2024-09-13T05:11:50.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:50.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430589+0000", 2024-09-13T05:11:50.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5071999999999998e-05 2024-09-13T05:11:50.469 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.469 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:50.469 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.469 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10639 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 777216~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:50.469 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:11:50.470 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 80.031110627999993, 2024-09-13T05:11:50.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028651769000000001, 2024-09-13T05:11:50.470 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:50.470 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:50.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:50.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:50.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.470 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10639 2024-09-13T05:11:50.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.470 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:50.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:50.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:11:50.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:50.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:11:50.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:50.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402050+0000", 2024-09-13T05:11:50.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:50.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402052+0000", 2024-09-13T05:11:50.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2249999999999999e-06 2024-09-13T05:11:50.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:50.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402054+0000", 2024-09-13T05:11:50.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8140000000000001e-06 2024-09-13T05:11:50.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402057+0000", 2024-09-13T05:11:50.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4889999999999998e-06 2024-09-13T05:11:50.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:50.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430607+0000", 2024-09-13T05:11:50.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028549896000000002 2024-09-13T05:11:50.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:50.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430651+0000", 2024-09-13T05:11:50.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4622000000000001e-05 2024-09-13T05:11:50.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:50.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430702+0000", 2024-09-13T05:11:50.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0980999999999999e-05 2024-09-13T05:11:50.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.476 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:50.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.476 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11151 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 779264~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:50.476 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:50.476 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 80.001339346999998, 2024-09-13T05:11:50.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028283188000000001, 2024-09-13T05:11:50.477 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:50.477 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:50.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:50.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:50.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.477 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11151 2024-09-13T05:11:50.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.478 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:50.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:50.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:50.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:50.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:50.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:50.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:50.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:50.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431827+0000", 2024-09-13T05:11:50.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0989999999999998e-06 2024-09-13T05:11:50.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:50.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431832+0000", 2024-09-13T05:11:50.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8829999999999997e-06 2024-09-13T05:11:50.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431835+0000", 2024-09-13T05:11:50.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.439e-06 2024-09-13T05:11:50.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:50.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.459955+0000", 2024-09-13T05:11:50.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028119858000000001 2024-09-13T05:11:50.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:50.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.460029+0000", 2024-09-13T05:11:50.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4264000000000006e-05 2024-09-13T05:11:50.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:50.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.460105+0000", 2024-09-13T05:11:50.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5906000000000001e-05 2024-09-13T05:11:50.483 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.483 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:50.483 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.483 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11897 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 579584~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:50.483 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:50.483 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.952190173000005, 2024-09-13T05:11:50.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028193354, 2024-09-13T05:11:50.483 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:50.483 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:50.484 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:50.484 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:50.484 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.484 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11897 2024-09-13T05:11:50.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.484 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:50.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:50.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:50.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:50.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:50.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:50.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:50.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:50.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480973+0000", 2024-09-13T05:11:50.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.934e-06 2024-09-13T05:11:50.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:50.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480976+0000", 2024-09-13T05:11:50.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.614e-06 2024-09-13T05:11:50.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480980+0000", 2024-09-13T05:11:50.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.377e-06 2024-09-13T05:11:50.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:50.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.508967+0000", 2024-09-13T05:11:50.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027987455000000001 2024-09-13T05:11:50.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:50.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509074+0000", 2024-09-13T05:11:50.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107379 2024-09-13T05:11:50.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:50.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509164+0000", 2024-09-13T05:11:50.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9979e-05 2024-09-13T05:11:50.489 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.489 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:50.489 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.489 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11898 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 588800~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:50.489 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:50.489 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.952178109000002, 2024-09-13T05:11:50.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028308628999999998, 2024-09-13T05:11:50.490 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:50.490 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:50.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:50.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:50.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.490 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11898 2024-09-13T05:11:50.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.490 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:50.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:50.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:50.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:50.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:50.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:50.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:50.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:50.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480984+0000", 2024-09-13T05:11:50.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:11:50.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:50.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480988+0000", 2024-09-13T05:11:50.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4640000000000002e-06 2024-09-13T05:11:50.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480991+0000", 2024-09-13T05:11:50.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3469999999999999e-06 2024-09-13T05:11:50.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:50.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509199+0000", 2024-09-13T05:11:50.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028207449999999998 2024-09-13T05:11:50.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:50.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509250+0000", 2024-09-13T05:11:50.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1375000000000002e-05 2024-09-13T05:11:50.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:50.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509292+0000", 2024-09-13T05:11:50.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1730000000000002e-05 2024-09-13T05:11:50.494 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.494 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:50.494 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.494 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11899 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 598016~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:50.495 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:50.495 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.952167267999997, 2024-09-13T05:11:50.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516703000000001, 2024-09-13T05:11:50.495 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:50.495 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:50.495 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:50.495 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:50.495 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.495 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11899 2024-09-13T05:11:50.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.496 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:50.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:50.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:50.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:50.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:50.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:50.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:50.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:50.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480995+0000", 2024-09-13T05:11:50.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7349999999999999e-06 2024-09-13T05:11:50.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:50.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481000+0000", 2024-09-13T05:11:50.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0289999999999996e-06 2024-09-13T05:11:50.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481004+0000", 2024-09-13T05:11:50.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3699999999999999e-06 2024-09-13T05:11:50.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:50.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509332+0000", 2024-09-13T05:11:50.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328320000000001 2024-09-13T05:11:50.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:50.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509428+0000", 2024-09-13T05:11:50.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6150999999999995e-05 2024-09-13T05:11:50.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:50.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509511+0000", 2024-09-13T05:11:50.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2396000000000002e-05 2024-09-13T05:11:50.499 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.499 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:50.499 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.499 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11900 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 607232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:50.500 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:11:50.500 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.952154679000003, 2024-09-13T05:11:50.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028621273999999999, 2024-09-13T05:11:50.500 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:50.500 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:50.500 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:50.500 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:50.500 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.500 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11900 2024-09-13T05:11:50.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.500 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:50.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:50.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:11:50.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:50.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:11:50.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:50.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481006+0000", 2024-09-13T05:11:50.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:50.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481008+0000", 2024-09-13T05:11:50.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.73e-06 2024-09-13T05:11:50.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:50.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481011+0000", 2024-09-13T05:11:50.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4000000000000001e-06 2024-09-13T05:11:50.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481015+0000", 2024-09-13T05:11:50.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2760000000000001e-06 2024-09-13T05:11:50.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:50.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509531+0000", 2024-09-13T05:11:50.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516102000000002 2024-09-13T05:11:50.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:50.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509588+0000", 2024-09-13T05:11:50.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7423999999999998e-05 2024-09-13T05:11:50.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:50.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509628+0000", 2024-09-13T05:11:50.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9644000000000002e-05 2024-09-13T05:11:50.504 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.504 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:50.504 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.505 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11901 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 616448~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:50.505 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:50.505 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.952144058000002, 2024-09-13T05:11:50.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028820500999999998, 2024-09-13T05:11:50.505 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:50.505 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:50.506 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:50.506 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:50.506 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.506 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11901 2024-09-13T05:11:50.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.506 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:50.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:50.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:50.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:50.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:50.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:50.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:50.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:50.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481022+0000", 2024-09-13T05:11:50.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0209999999999999e-06 2024-09-13T05:11:50.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:50.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481026+0000", 2024-09-13T05:11:50.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:11:50.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481029+0000", 2024-09-13T05:11:50.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.636e-06 2024-09-13T05:11:50.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:50.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509661+0000", 2024-09-13T05:11:50.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028631496999999999 2024-09-13T05:11:50.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:50.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509757+0000", 2024-09-13T05:11:50.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5780999999999997e-05 2024-09-13T05:11:50.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:50.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509838+0000", 2024-09-13T05:11:50.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1102999999999999e-05 2024-09-13T05:11:50.511 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.511 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:50.511 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.512 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11902 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 625664~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:50.512 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:50.512 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.952122196000005, 2024-09-13T05:11:50.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028894265999999998, 2024-09-13T05:11:50.512 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:50.512 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:50.512 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:50.512 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:50.512 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.513 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11902 2024-09-13T05:11:50.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.513 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:50.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:50.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:50.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:50.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:50.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:50.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:50.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:50.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481041+0000", 2024-09-13T05:11:50.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8020000000000001e-06 2024-09-13T05:11:50.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:50.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481044+0000", 2024-09-13T05:11:50.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7110000000000001e-06 2024-09-13T05:11:50.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481048+0000", 2024-09-13T05:11:50.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.411e-06 2024-09-13T05:11:50.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:50.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509851+0000", 2024-09-13T05:11:50.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028803295 2024-09-13T05:11:50.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:50.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509896+0000", 2024-09-13T05:11:50.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4963000000000003e-05 2024-09-13T05:11:50.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:50.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509933+0000", 2024-09-13T05:11:50.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7384e-05 2024-09-13T05:11:50.518 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.518 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:50.518 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.518 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11903 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 634880~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:50.518 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:50.518 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.952110959999999, 2024-09-13T05:11:50.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029118033000000001, 2024-09-13T05:11:50.519 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:50.519 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:50.519 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:50.519 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:50.519 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.519 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11903 2024-09-13T05:11:50.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.519 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:50.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:50.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:50.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:50.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:50.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:50.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:50.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:50.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481052+0000", 2024-09-13T05:11:50.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.581e-06 2024-09-13T05:11:50.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:50.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481055+0000", 2024-09-13T05:11:50.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4520000000000002e-06 2024-09-13T05:11:50.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481058+0000", 2024-09-13T05:11:50.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4599999999999999e-06 2024-09-13T05:11:50.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:50.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509967+0000", 2024-09-13T05:11:50.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028908257999999999 2024-09-13T05:11:50.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:50.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510062+0000", 2024-09-13T05:11:50.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5613999999999996e-05 2024-09-13T05:11:50.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:50.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510168+0000", 2024-09-13T05:11:50.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105951 2024-09-13T05:11:50.522 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.522 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:50.523 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.523 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11904 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 644096~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:50.523 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:50.523 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.952100064999996, 2024-09-13T05:11:50.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029301971, 2024-09-13T05:11:50.523 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:50.523 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:50.523 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:50.523 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:50.523 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.523 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11904 2024-09-13T05:11:50.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.524 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:50.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:50.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:50.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:50.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:50.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:50.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:50.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:50.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481063+0000", 2024-09-13T05:11:50.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6700000000000001e-06 2024-09-13T05:11:50.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:50.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481068+0000", 2024-09-13T05:11:50.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4519999999999996e-06 2024-09-13T05:11:50.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481074+0000", 2024-09-13T05:11:50.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8370000000000002e-06 2024-09-13T05:11:50.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:50.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510197+0000", 2024-09-13T05:11:50.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029123237999999999 2024-09-13T05:11:50.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:50.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510285+0000", 2024-09-13T05:11:50.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7676000000000006e-05 2024-09-13T05:11:50.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:50.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510363+0000", 2024-09-13T05:11:50.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8418999999999996e-05 2024-09-13T05:11:50.527 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.527 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:50.527 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.527 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11905 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 653312~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:50.528 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:11:50.528 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.952084325000001, 2024-09-13T05:11:50.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029480164, 2024-09-13T05:11:50.528 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:50.528 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:50.528 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:50.528 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:50.528 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.528 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11905 2024-09-13T05:11:50.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.528 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:50.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:50.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:11:50.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:50.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:11:50.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:50.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481076+0000", 2024-09-13T05:11:50.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:50.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481079+0000", 2024-09-13T05:11:50.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9629999999999998e-06 2024-09-13T05:11:50.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:50.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481087+0000", 2024-09-13T05:11:50.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6369999999999999e-06 2024-09-13T05:11:50.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481093+0000", 2024-09-13T05:11:50.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.857e-06 2024-09-13T05:11:50.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:50.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510408+0000", 2024-09-13T05:11:50.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029315213 2024-09-13T05:11:50.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:50.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510501+0000", 2024-09-13T05:11:50.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2916000000000003e-05 2024-09-13T05:11:50.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:50.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510557+0000", 2024-09-13T05:11:50.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6063999999999997e-05 2024-09-13T05:11:50.532 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.532 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:50.532 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.532 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11906 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 662528~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:50.532 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:11:50.532 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.952042312000003, 2024-09-13T05:11:50.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029575054999999999, 2024-09-13T05:11:50.532 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:50.532 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:50.533 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:50.533 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:50.533 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.533 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11906 2024-09-13T05:11:50.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.533 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:50.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:50.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:11:50.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:50.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:11:50.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:50.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481118+0000", 2024-09-13T05:11:50.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:50.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481122+0000", 2024-09-13T05:11:50.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2610000000000002e-06 2024-09-13T05:11:50.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:50.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481129+0000", 2024-09-13T05:11:50.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0079999999999996e-06 2024-09-13T05:11:50.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481135+0000", 2024-09-13T05:11:50.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0599999999999996e-06 2024-09-13T05:11:50.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:50.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510575+0000", 2024-09-13T05:11:50.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029440470999999999 2024-09-13T05:11:50.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:50.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510635+0000", 2024-09-13T05:11:50.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0177000000000003e-05 2024-09-13T05:11:50.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:50.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510694+0000", 2024-09-13T05:11:50.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8675999999999999e-05 2024-09-13T05:11:50.537 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.537 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:50.537 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.537 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11907 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 671744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:50.538 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:11:50.538 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.951781517000001, 2024-09-13T05:11:50.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029479490000000001, 2024-09-13T05:11:50.538 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:50.538 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:50.538 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:50.538 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:50.538 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.538 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11907 2024-09-13T05:11:50.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.538 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:50.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:50.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:11:50.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:50.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:11:50.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:50.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481140+0000", 2024-09-13T05:11:50.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997597 2024-09-13T05:11:50.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:50.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481383+0000", 2024-09-13T05:11:50.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024355399999999999 2024-09-13T05:11:50.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:50.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481390+0000", 2024-09-13T05:11:50.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3599999999999998e-06 2024-09-13T05:11:50.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481395+0000", 2024-09-13T05:11:50.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8940000000000001e-06 2024-09-13T05:11:50.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:50.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510722+0000", 2024-09-13T05:11:50.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029327143999999999 2024-09-13T05:11:50.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:50.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510802+0000", 2024-09-13T05:11:50.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9770000000000004e-05 2024-09-13T05:11:50.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:50.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510859+0000", 2024-09-13T05:11:50.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6957999999999999e-05 2024-09-13T05:11:50.543 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.543 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:50.543 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.543 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11908 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 680960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:50.543 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:11:50.543 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.951761603999998, 2024-09-13T05:11:50.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029617622, 2024-09-13T05:11:50.544 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:50.544 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:50.544 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:50.544 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:50.544 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.544 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11908 2024-09-13T05:11:50.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.544 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:50.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:50.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:11:50.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:50.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:11:50.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:50.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481399+0000", 2024-09-13T05:11:50.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:50.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481401+0000", 2024-09-13T05:11:50.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8729999999999999e-06 2024-09-13T05:11:50.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:50.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481413+0000", 2024-09-13T05:11:50.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1748e-05 2024-09-13T05:11:50.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481417+0000", 2024-09-13T05:11:50.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:11:50.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:50.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510908+0000", 2024-09-13T05:11:50.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029491129000000001 2024-09-13T05:11:50.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:50.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510955+0000", 2024-09-13T05:11:50.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7188000000000003e-05 2024-09-13T05:11:50.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:50.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511017+0000", 2024-09-13T05:11:50.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2288999999999999e-05 2024-09-13T05:11:50.549 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.549 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:50.549 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.549 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11909 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 690176~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:50.549 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:11:50.550 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.951741276999996, 2024-09-13T05:11:50.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029780699000000001, 2024-09-13T05:11:50.550 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:50.550 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:50.550 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:50.550 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:50.550 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.551 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11909 2024-09-13T05:11:50.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.551 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:50.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:50.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:11:50.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:50.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:11:50.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:50.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481419+0000", 2024-09-13T05:11:50.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:50.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:50.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481421+0000", 2024-09-13T05:11:50.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.035e-06 2024-09-13T05:11:50.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:50.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481427+0000", 2024-09-13T05:11:50.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2449999999999998e-06 2024-09-13T05:11:50.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481430+0000", 2024-09-13T05:11:50.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.366e-06 2024-09-13T05:11:50.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:50.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511064+0000", 2024-09-13T05:11:50.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029633711 2024-09-13T05:11:50.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:50.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511160+0000", 2024-09-13T05:11:50.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6399999999999999e-05 2024-09-13T05:11:50.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:50.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511201+0000", 2024-09-13T05:11:50.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0448000000000003e-05 2024-09-13T05:11:50.556 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.557 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:50.557 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.557 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.557 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:50.557 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:50.558 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:11:50.559 INFO:teuthology.orchestra.run.smithi120.stdout:4698 write 0x57218c5 thru 0x57279a9 (0x60e5 bytes) 2024-09-13T05:11:50.559 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:50.556+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:50.584 INFO:teuthology.orchestra.run.smithi120.stdout:4699 punch from 0x3b169b9 to 0x3b1f278, (0x88bf bytes) 2024-09-13T05:11:50.595 INFO:teuthology.orchestra.run.smithi120.stdout:4701 trunc from 0x57279aa to 0xade6a16 2024-09-13T05:11:50.605 INFO:teuthology.orchestra.run.smithi120.stdout:4702 writesame 0x2a8c91c thru 0x2a94ff9 data_size 0x3d(0x86de bytes) 2024-09-13T05:11:50.612 INFO:teuthology.orchestra.run.smithi120.stdout:4704 read 0x200e2f0 thru 0x201cbbb (0xe8cc bytes) 2024-09-13T05:11:50.627 INFO:teuthology.orchestra.run.smithi120.stdout:4705 writesame 0xc27bdc8 thru 0xc280aa6 data_size 0x1(0x4cdf bytes) 2024-09-13T05:11:50.627 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:50.628 INFO:teuthology.orchestra.run.smithi120.stdout:4708 writesame 0x6ef004b thru 0x6efb5f7 data_size 0x25(0xb5ad bytes) 2024-09-13T05:11:50.648 INFO:teuthology.orchestra.run.smithi120.stdout:4710 write 0x716ec03 thru 0x717a83e (0xbc3c bytes) 2024-09-13T05:11:50.659 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:50.653+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:50.668 INFO:teuthology.orchestra.run.smithi120.stdout:4711 writesame 0x22f455f thru 0x22f69c0 data_size 0x1(0x2462 bytes) 2024-09-13T05:11:50.672 INFO:teuthology.orchestra.run.smithi120.stdout:4712 read 0xc012e54 thru 0xc01aee1 (0x808e bytes) 2024-09-13T05:11:50.677 INFO:teuthology.orchestra.run.smithi120.stdout:4713 trunc from 0xc280aa7 to 0xea86259 2024-09-13T05:11:50.685 INFO:teuthology.orchestra.run.smithi120.stdout:4714 read 0x64df057 thru 0x64eaf91 (0xbf3b bytes) 2024-09-13T05:11:50.685 INFO:teuthology.orchestra.run.smithi120.stdout:4715 writesame 0xd3aeaea thru 0xd3b89f5 data_size 0x3a(0x9f0c bytes) 2024-09-13T05:11:50.709 INFO:teuthology.orchestra.run.smithi120.stdout:4716 punch from 0xcca517c to 0xcca6ec7, (0x1d4b bytes) 2024-09-13T05:11:50.715 INFO:teuthology.orchestra.run.smithi120.stdout:4717 trunc from 0xea86259 to 0xac5a8ce 2024-09-13T05:11:50.717 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:50.717 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:50.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.717 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:129047 3.1a 3:5a99807b:::rbd_object_map.112dbd21872d:head [call lock.assert_locked in=44b,call rbd.object_map_update in=39b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:50.717 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:50.715369+0000", 2024-09-13T05:11:50.717 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0014134110000000001, 2024-09-13T05:11:50.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014369280000000001, 2024-09-13T05:11:50.718 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:50.718 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-13T05:11:50.718 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:50.718 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:50.718 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:50.718 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 129047 2024-09-13T05:11:50.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.719 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:50.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:50.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:50.715369+0000", 2024-09-13T05:11:50.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:50.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:50.715369+0000", 2024-09-13T05:11:50.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:50.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:50.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:50.715366+0000", 2024-09-13T05:11:50.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999971 2024-09-13T05:11:50.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:50.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:50.715381+0000", 2024-09-13T05:11:50.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.464e-05 2024-09-13T05:11:50.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:50.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:50.715405+0000", 2024-09-13T05:11:50.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3981999999999998e-05 2024-09-13T05:11:50.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:50.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:50.715416+0000", 2024-09-13T05:11:50.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0655999999999999e-05 2024-09-13T05:11:50.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:50.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:50.715469+0000", 2024-09-13T05:11:50.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3786000000000003e-05 2024-09-13T05:11:50.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:50.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:50.715568+0000", 2024-09-13T05:11:50.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8361000000000002e-05 2024-09-13T05:11:50.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:50.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:50.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-13T05:11:50.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:50.715847+0000", 2024-09-13T05:11:50.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027896699999999997 2024-09-13T05:11:50.722 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.722 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:50.722 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.722 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:50.723 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:11:50.723 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 1 2024-09-13T05:11:50.723 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:50.728 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:11:50.735 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:50.735 INFO:teuthology.orchestra.run.smithi120.stdout:4719 punch from 0x460f03a to 0x461264e, (0x3614 bytes) 2024-09-13T05:11:50.735 INFO:teuthology.orchestra.run.smithi120.stdout:4720 read 0x2a5c2f thru 0x2ab90a (0x5cdc bytes) 2024-09-13T05:11:50.737 INFO:teuthology.orchestra.run.smithi120.stdout:4721 write 0x55f4a56 thru 0x56023a6 (0xd951 bytes) 2024-09-13T05:11:50.743 INFO:teuthology.orchestra.run.smithi120.stdout:4722 punch from 0xa6a6b41 to 0xa6b1429, (0xa8e8 bytes) 2024-09-13T05:11:50.743 INFO:teuthology.orchestra.run.smithi120.stdout:4723 write 0x8660775 thru 0x866ca36 (0xc2c2 bytes) 2024-09-13T05:11:50.759 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:50.756+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:50.776 INFO:teuthology.orchestra.run.smithi120.stdout:4725 write 0xe619a2e thru 0xe62134c (0x791f bytes) 2024-09-13T05:11:50.818 INFO:teuthology.orchestra.run.smithi120.stdout:4727 trunc from 0xe62134d to 0x1409f91 2024-09-13T05:11:50.861 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:50.853+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:50.864 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:50.864 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:50.864 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:50.865 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:50.865 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:50.876 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:11:50.962 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:50.957+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:51.056 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:51.056 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:51.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:51.056 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:51.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.056 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26335 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1207296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:51.056 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:51.056 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.322511965000004, 2024-09-13T05:11:51.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055338125000000002, 2024-09-13T05:11:51.056 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.057 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.057 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.057 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.057 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.057 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26335 2024-09-13T05:11:51.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.057 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:51.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730692+0000", 2024-09-13T05:11:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730550+0000", 2024-09-13T05:11:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998579 2024-09-13T05:11:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730705+0000", 2024-09-13T05:11:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015463400000000001 2024-09-13T05:11:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730713+0000", 2024-09-13T05:11:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1580000000000005e-06 2024-09-13T05:11:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.730719+0000", 2024-09-13T05:11:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2740000000000004e-06 2024-09-13T05:11:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.785798+0000", 2024-09-13T05:11:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055079454 2024-09-13T05:11:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.785894+0000", 2024-09-13T05:11:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5896000000000005e-05 2024-09-13T05:11:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.786030+0000", 2024-09-13T05:11:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013586199999999999 2024-09-13T05:11:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.061 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26346 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1308672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:51.061 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:51.061 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.320370557999993, 2024-09-13T05:11:51.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055416737000000001, 2024-09-13T05:11:51.061 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26346 2024-09-13T05:11:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732834+0000", 2024-09-13T05:11:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732833+0000", 2024-09-13T05:11:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732835+0000", 2024-09-13T05:11:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3719999999999999e-06 2024-09-13T05:11:51.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732839+0000", 2024-09-13T05:11:51.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1520000000000001e-06 2024-09-13T05:11:51.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.732842+0000", 2024-09-13T05:11:51.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.061e-06 2024-09-13T05:11:51.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788126+0000", 2024-09-13T05:11:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055284489999999999 2024-09-13T05:11:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788183+0000", 2024-09-13T05:11:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7127999999999999e-05 2024-09-13T05:11:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788250+0000", 2024-09-13T05:11:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7001000000000004e-05 2024-09-13T05:11:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26348 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 800768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.319947733999996, 2024-09-13T05:11:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055321395000000002, 2024-09-13T05:11:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26348 2024-09-13T05:11:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733256+0000", 2024-09-13T05:11:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733127+0000", 2024-09-13T05:11:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998703 2024-09-13T05:11:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733262+0000", 2024-09-13T05:11:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013484400000000001 2024-09-13T05:11:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733273+0000", 2024-09-13T05:11:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1824000000000001e-05 2024-09-13T05:11:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.733281+0000", 2024-09-13T05:11:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9999999999999996e-06 2024-09-13T05:11:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788431+0000", 2024-09-13T05:11:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055149535 2024-09-13T05:11:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788490+0000", 2024-09-13T05:11:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9413999999999997e-05 2024-09-13T05:11:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.788578+0000", 2024-09-13T05:11:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7418999999999998e-05 2024-09-13T05:11:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26417 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 903168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.311735276999997, 2024-09-13T05:11:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055375191999999997, 2024-09-13T05:11:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26417 2024-09-13T05:11:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741469+0000", 2024-09-13T05:11:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741468+0000", 2024-09-13T05:11:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741472+0000", 2024-09-13T05:11:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4139999999999998e-06 2024-09-13T05:11:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741478+0000", 2024-09-13T05:11:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5230000000000001e-06 2024-09-13T05:11:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741483+0000", 2024-09-13T05:11:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8559999999999998e-06 2024-09-13T05:11:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796655+0000", 2024-09-13T05:11:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055172153000000002 2024-09-13T05:11:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796738+0000", 2024-09-13T05:11:51.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2912999999999997e-05 2024-09-13T05:11:51.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796844+0000", 2024-09-13T05:11:51.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105802 2024-09-13T05:11:51.074 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.074 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26419 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 912384~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.311711411999994, 2024-09-13T05:11:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055570469999999997, 2024-09-13T05:11:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26419 2024-09-13T05:11:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741493+0000", 2024-09-13T05:11:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741492+0000", 2024-09-13T05:11:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741495+0000", 2024-09-13T05:11:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6369999999999999e-06 2024-09-13T05:11:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741508+0000", 2024-09-13T05:11:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3319000000000001e-05 2024-09-13T05:11:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741527+0000", 2024-09-13T05:11:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8542e-05 2024-09-13T05:11:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796871+0000", 2024-09-13T05:11:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055344474999999997 2024-09-13T05:11:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.796967+0000", 2024-09-13T05:11:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5963000000000003e-05 2024-09-13T05:11:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797063+0000", 2024-09-13T05:11:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5909999999999995e-05 2024-09-13T05:11:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26421 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 921600~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.311668108999996, 2024-09-13T05:11:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055631152000000003, 2024-09-13T05:11:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26421 2024-09-13T05:11:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741536+0000", 2024-09-13T05:11:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741535+0000", 2024-09-13T05:11:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741540+0000", 2024-09-13T05:11:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1690000000000002e-06 2024-09-13T05:11:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741547+0000", 2024-09-13T05:11:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3409999999999997e-06 2024-09-13T05:11:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741552+0000", 2024-09-13T05:11:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5639999999999996e-06 2024-09-13T05:11:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797079+0000", 2024-09-13T05:11:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055526038999999999 2024-09-13T05:11:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797121+0000", 2024-09-13T05:11:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2156000000000001e-05 2024-09-13T05:11:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797167+0000", 2024-09-13T05:11:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6445e-05 2024-09-13T05:11:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26423 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 930816~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.311275116000004, 2024-09-13T05:11:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055364370000000003, 2024-09-13T05:11:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26423 2024-09-13T05:11:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741929+0000", 2024-09-13T05:11:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741928+0000", 2024-09-13T05:11:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741933+0000", 2024-09-13T05:11:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9980000000000003e-06 2024-09-13T05:11:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741945+0000", 2024-09-13T05:11:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1761e-05 2024-09-13T05:11:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741958+0000", 2024-09-13T05:11:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2604e-05 2024-09-13T05:11:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797185+0000", 2024-09-13T05:11:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055227169 2024-09-13T05:11:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797226+0000", 2024-09-13T05:11:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1619000000000003e-05 2024-09-13T05:11:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797293+0000", 2024-09-13T05:11:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6952999999999994e-05 2024-09-13T05:11:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26424 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 940032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.311238179, 2024-09-13T05:11:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055448669999999999, 2024-09-13T05:11:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26424 2024-09-13T05:11:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741966+0000", 2024-09-13T05:11:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741965+0000", 2024-09-13T05:11:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741969+0000", 2024-09-13T05:11:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3440000000000001e-06 2024-09-13T05:11:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741983+0000", 2024-09-13T05:11:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4600000000000001e-05 2024-09-13T05:11:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741989+0000", 2024-09-13T05:11:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5350000000000004e-06 2024-09-13T05:11:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797319+0000", 2024-09-13T05:11:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055330121000000003 2024-09-13T05:11:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797364+0000", 2024-09-13T05:11:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5670000000000002e-05 2024-09-13T05:11:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797415+0000", 2024-09-13T05:11:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0124000000000003e-05 2024-09-13T05:11:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26426 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 949248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.311210979999998, 2024-09-13T05:11:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055639981999999998, 2024-09-13T05:11:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26426 2024-09-13T05:11:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741993+0000", 2024-09-13T05:11:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.741995+0000", 2024-09-13T05:11:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.661e-06 2024-09-13T05:11:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742004+0000", 2024-09-13T05:11:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2009999999999999e-06 2024-09-13T05:11:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742008+0000", 2024-09-13T05:11:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7890000000000002e-06 2024-09-13T05:11:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797432+0000", 2024-09-13T05:11:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055423448 2024-09-13T05:11:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797516+0000", 2024-09-13T05:11:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4404e-05 2024-09-13T05:11:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797633+0000", 2024-09-13T05:11:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116898 2024-09-13T05:11:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26427 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 958464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.311190924000002, 2024-09-13T05:11:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055829295000000001, 2024-09-13T05:11:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26427 2024-09-13T05:11:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742013+0000", 2024-09-13T05:11:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742015+0000", 2024-09-13T05:11:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.74e-06 2024-09-13T05:11:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742023+0000", 2024-09-13T05:11:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7039999999999994e-06 2024-09-13T05:11:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742028+0000", 2024-09-13T05:11:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7369999999999997e-06 2024-09-13T05:11:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797666+0000", 2024-09-13T05:11:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055637820999999997 2024-09-13T05:11:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797748+0000", 2024-09-13T05:11:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1787999999999997e-05 2024-09-13T05:11:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.797842+0000", 2024-09-13T05:11:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4903999999999998e-05 2024-09-13T05:11:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26432 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 976896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.310397762999997, 2024-09-13T05:11:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055402077000000001, 2024-09-13T05:11:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26432 2024-09-13T05:11:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742806+0000", 2024-09-13T05:11:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742808+0000", 2024-09-13T05:11:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3319999999999999e-06 2024-09-13T05:11:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742818+0000", 2024-09-13T05:11:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5380000000000008e-06 2024-09-13T05:11:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742821+0000", 2024-09-13T05:11:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2179999999999999e-06 2024-09-13T05:11:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798027+0000", 2024-09-13T05:11:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055206344999999997 2024-09-13T05:11:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798103+0000", 2024-09-13T05:11:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5786999999999998e-05 2024-09-13T05:11:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798208+0000", 2024-09-13T05:11:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010521700000000001 2024-09-13T05:11:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26434 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 986112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.310380538999993, 2024-09-13T05:11:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055610109999999997, 2024-09-13T05:11:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26434 2024-09-13T05:11:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742824+0000", 2024-09-13T05:11:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742823+0000", 2024-09-13T05:11:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742825+0000", 2024-09-13T05:11:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6220000000000001e-06 2024-09-13T05:11:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742828+0000", 2024-09-13T05:11:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.926e-06 2024-09-13T05:11:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.742831+0000", 2024-09-13T05:11:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-13T05:11:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798239+0000", 2024-09-13T05:11:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055408254999999997 2024-09-13T05:11:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798326+0000", 2024-09-13T05:11:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7168000000000003e-05 2024-09-13T05:11:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.798434+0000", 2024-09-13T05:11:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010767100000000001 2024-09-13T05:11:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26442 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1032192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.309111199, 2024-09-13T05:11:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055422776, 2024-09-13T05:11:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26442 2024-09-13T05:11:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744093+0000", 2024-09-13T05:11:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744061+0000", 2024-09-13T05:11:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999685 2024-09-13T05:11:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744096+0000", 2024-09-13T05:11:51.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4771999999999998e-05 2024-09-13T05:11:51.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744147+0000", 2024-09-13T05:11:51.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0696999999999999e-05 2024-09-13T05:11:51.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744154+0000", 2024-09-13T05:11:51.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8510000000000001e-06 2024-09-13T05:11:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799324+0000", 2024-09-13T05:11:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055170074999999999 2024-09-13T05:11:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799415+0000", 2024-09-13T05:11:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1197000000000001e-05 2024-09-13T05:11:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799516+0000", 2024-09-13T05:11:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100666 2024-09-13T05:11:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26443 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1041408~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.308830627999995, 2024-09-13T05:11:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055344195999999998, 2024-09-13T05:11:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26443 2024-09-13T05:11:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744373+0000", 2024-09-13T05:11:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744159+0000", 2024-09-13T05:11:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997849 2024-09-13T05:11:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744379+0000", 2024-09-13T05:11:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022024800000000001 2024-09-13T05:11:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744390+0000", 2024-09-13T05:11:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1105e-05 2024-09-13T05:11:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744397+0000", 2024-09-13T05:11:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2740000000000002e-06 2024-09-13T05:11:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799543+0000", 2024-09-13T05:11:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055145441000000003 2024-09-13T05:11:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799619+0000", 2024-09-13T05:11:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6660000000000001e-05 2024-09-13T05:11:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799718+0000", 2024-09-13T05:11:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8331000000000004e-05 2024-09-13T05:11:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26547 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1318912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.308644310000005, 2024-09-13T05:11:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055355834, 2024-09-13T05:11:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26547 2024-09-13T05:11:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744560+0000", 2024-09-13T05:11:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744404+0000", 2024-09-13T05:11:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998441 2024-09-13T05:11:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744564+0000", 2024-09-13T05:11:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016022200000000001 2024-09-13T05:11:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744579+0000", 2024-09-13T05:11:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5036e-05 2024-09-13T05:11:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.744585+0000", 2024-09-13T05:11:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7880000000000003e-06 2024-09-13T05:11:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799747+0000", 2024-09-13T05:11:51.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055161804000000002 2024-09-13T05:11:51.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799823+0000", 2024-09-13T05:11:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5956000000000003e-05 2024-09-13T05:11:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.799916+0000", 2024-09-13T05:11:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2733999999999997e-05 2024-09-13T05:11:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26558 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1364992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.307653144, 2024-09-13T05:11:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055422765999999998, 2024-09-13T05:11:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26558 2024-09-13T05:11:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745551+0000", 2024-09-13T05:11:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745550+0000", 2024-09-13T05:11:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745553+0000", 2024-09-13T05:11:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7690000000000001e-06 2024-09-13T05:11:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745559+0000", 2024-09-13T05:11:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3149999999999997e-06 2024-09-13T05:11:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745564+0000", 2024-09-13T05:11:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6670000000000004e-06 2024-09-13T05:11:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800791+0000", 2024-09-13T05:11:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055226711999999997 2024-09-13T05:11:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800865+0000", 2024-09-13T05:11:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4344000000000005e-05 2024-09-13T05:11:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.800974+0000", 2024-09-13T05:11:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108606 2024-09-13T05:11:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26561 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1374208~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.307636091000006, 2024-09-13T05:11:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055549315000000002, 2024-09-13T05:11:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26561 2024-09-13T05:11:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745568+0000", 2024-09-13T05:11:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745570+0000", 2024-09-13T05:11:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4719999999999998e-06 2024-09-13T05:11:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745575+0000", 2024-09-13T05:11:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1900000000000003e-06 2024-09-13T05:11:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.745579+0000", 2024-09-13T05:11:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3250000000000001e-06 2024-09-13T05:11:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801000+0000", 2024-09-13T05:11:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055420432999999998 2024-09-13T05:11:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801061+0000", 2024-09-13T05:11:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1427000000000007e-05 2024-09-13T05:11:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.801117+0000", 2024-09-13T05:11:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5933000000000001e-05 2024-09-13T05:11:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:26582 3.9 3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a [read 1447936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-13T05:11:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.306218451000007, 2024-09-13T05:11:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055394301, 2024-09-13T05:11:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 26582 2024-09-13T05:11:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746986+0000", 2024-09-13T05:11:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746985+0000", 2024-09-13T05:11:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.746988+0000", 2024-09-13T05:11:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6479999999999999e-06 2024-09-13T05:11:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.747000+0000", 2024-09-13T05:11:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2009e-05 2024-09-13T05:11:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.747005+0000", 2024-09-13T05:11:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0039999999999999e-06 2024-09-13T05:11:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802232+0000", 2024-09-13T05:11:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055227762999999999 2024-09-13T05:11:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802320+0000", 2024-09-13T05:11:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7576000000000003e-05 2024-09-13T05:11:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:36.802380+0000", 2024-09-13T05:11:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9888e-05 2024-09-13T05:11:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:83780 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 5966848~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.161271+0000", 2024-09-13T05:11:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8919329820000002, 2024-09-13T05:11:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055549792000000001, 2024-09-13T05:11:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83780 2024-09-13T05:11:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.161271+0000", 2024-09-13T05:11:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.161271+0000", 2024-09-13T05:11:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.161271+0000", 2024-09-13T05:11:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.161272+0000", 2024-09-13T05:11:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.576e-06 2024-09-13T05:11:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.161276+0000", 2024-09-13T05:11:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4999999999999999e-06 2024-09-13T05:11:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.161279+0000", 2024-09-13T05:11:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.168e-06 2024-09-13T05:11:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.216618+0000", 2024-09-13T05:11:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055339243000000003 2024-09-13T05:11:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.216729+0000", 2024-09-13T05:11:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111097 2024-09-13T05:11:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.216821+0000", 2024-09-13T05:11:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1502000000000006e-05 2024-09-13T05:11:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:83795 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 6181888~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e99)", 2024-09-13T05:11:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:42.165224+0000", 2024-09-13T05:11:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8879803989999999, 2024-09-13T05:11:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055538606999999997, 2024-09-13T05:11:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83795 2024-09-13T05:11:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.165224+0000", 2024-09-13T05:11:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.165224+0000", 2024-09-13T05:11:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.165223+0000", 2024-09-13T05:11:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.165225+0000", 2024-09-13T05:11:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7379999999999999e-06 2024-09-13T05:11:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.165228+0000", 2024-09-13T05:11:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.191e-06 2024-09-13T05:11:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.165231+0000", 2024-09-13T05:11:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.101e-06 2024-09-13T05:11:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.220588+0000", 2024-09-13T05:11:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055356764000000003 2024-09-13T05:11:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.220681+0000", 2024-09-13T05:11:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2467999999999996e-05 2024-09-13T05:11:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:42.220762+0000", 2024-09-13T05:11:51.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1722000000000001e-05 2024-09-13T05:11:51.146 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.146 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.146 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.146 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.146 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.146 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:51.148 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:11:51.148 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:51.144+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:51.248 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:51.244+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:51.249 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T05:11:51.278 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:51.278 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:51.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.278 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131967 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.278 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.241287+0000", 2024-09-13T05:11:51.278 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.028761231000000002, 2024-09-13T05:11:51.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028794192999999999, 2024-09-13T05:11:51.278 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.278 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.279 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131967 2024-09-13T05:11:51.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.279 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.241287+0000", 2024-09-13T05:11:51.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.241287+0000", 2024-09-13T05:11:51.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.241287+0000", 2024-09-13T05:11:51.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.241289+0000", 2024-09-13T05:11:51.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3379999999999999e-06 2024-09-13T05:11:51.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.241296+0000", 2024-09-13T05:11:51.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6800000000000004e-06 2024-09-13T05:11:51.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.241301+0000", 2024-09-13T05:11:51.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9840000000000001e-06 2024-09-13T05:11:51.281 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.281 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.281 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.282 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131999 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.282 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.249048+0000", 2024-09-13T05:11:51.282 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.021000444, 2024-09-13T05:11:51.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021115268, 2024-09-13T05:11:51.282 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.282 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.282 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.282 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.282 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.282 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131999 2024-09-13T05:11:51.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.283 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.249048+0000", 2024-09-13T05:11:51.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.249048+0000", 2024-09-13T05:11:51.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.249048+0000", 2024-09-13T05:11:51.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:51.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.249049+0000", 2024-09-13T05:11:51.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.457e-06 2024-09-13T05:11:51.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.249052+0000", 2024-09-13T05:11:51.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8229999999999999e-06 2024-09-13T05:11:51.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.249055+0000", 2024-09-13T05:11:51.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8289999999999999e-06 2024-09-13T05:11:51.285 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.285 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.285 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.285 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:132104 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.285 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.257206+0000", 2024-09-13T05:11:51.285 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.012842788000000001, 2024-09-13T05:11:51.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013030600999999999, 2024-09-13T05:11:51.286 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.286 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.286 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 132104 2024-09-13T05:11:51.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.286 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.257206+0000", 2024-09-13T05:11:51.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.257206+0000", 2024-09-13T05:11:51.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.257205+0000", 2024-09-13T05:11:51.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.257208+0000", 2024-09-13T05:11:51.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8569999999999999e-06 2024-09-13T05:11:51.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.257214+0000", 2024-09-13T05:11:51.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1670000000000004e-06 2024-09-13T05:11:51.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.257220+0000", 2024-09-13T05:11:51.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.502e-06 2024-09-13T05:11:51.289 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.289 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.289 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.290 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:132136 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.290 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.261604+0000", 2024-09-13T05:11:51.290 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0084442130000000008, 2024-09-13T05:11:51.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0087041229999999994, 2024-09-13T05:11:51.290 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.290 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.290 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.290 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.290 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.290 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 132136 2024-09-13T05:11:51.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.290 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.261604+0000", 2024-09-13T05:11:51.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.261604+0000", 2024-09-13T05:11:51.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.261604+0000", 2024-09-13T05:11:51.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.261608+0000", 2024-09-13T05:11:51.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5480000000000003e-06 2024-09-13T05:11:51.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.261619+0000", 2024-09-13T05:11:51.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0849000000000001e-05 2024-09-13T05:11:51.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.261627+0000", 2024-09-13T05:11:51.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1680000000000004e-06 2024-09-13T05:11:51.293 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.293 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.293 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.293 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131836 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.293 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.266572+0000", 2024-09-13T05:11:51.293 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003476317, 2024-09-13T05:11:51.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038048539999999999, 2024-09-13T05:11:51.293 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.293 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.293 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.293 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.294 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.294 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131836 2024-09-13T05:11:51.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.294 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266572+0000", 2024-09-13T05:11:51.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266572+0000", 2024-09-13T05:11:51.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266572+0000", 2024-09-13T05:11:51.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266578+0000", 2024-09-13T05:11:51.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7250000000000002e-06 2024-09-13T05:11:51.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266584+0000", 2024-09-13T05:11:51.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5239999999999997e-06 2024-09-13T05:11:51.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266588+0000", 2024-09-13T05:11:51.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8020000000000002e-06 2024-09-13T05:11:51.296 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.296 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.296 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.296 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131868 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.296 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.267508+0000", 2024-09-13T05:11:51.297 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0025408980000000002, 2024-09-13T05:11:51.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029401789999999998, 2024-09-13T05:11:51.297 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.297 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.297 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131868 2024-09-13T05:11:51.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.297 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267508+0000", 2024-09-13T05:11:51.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267508+0000", 2024-09-13T05:11:51.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267507+0000", 2024-09-13T05:11:51.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267509+0000", 2024-09-13T05:11:51.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1129999999999999e-06 2024-09-13T05:11:51.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267515+0000", 2024-09-13T05:11:51.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0050000000000001e-06 2024-09-13T05:11:51.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267519+0000", 2024-09-13T05:11:51.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5599999999999998e-06 2024-09-13T05:11:51.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.300 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.301 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131900 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.301 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.268375+0000", 2024-09-13T05:11:51.301 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0016734009999999999, 2024-09-13T05:11:51.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021393089999999998, 2024-09-13T05:11:51.301 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.301 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.301 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131900 2024-09-13T05:11:51.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.302 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268375+0000", 2024-09-13T05:11:51.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268375+0000", 2024-09-13T05:11:51.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268375+0000", 2024-09-13T05:11:51.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268377+0000", 2024-09-13T05:11:51.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1569999999999998e-06 2024-09-13T05:11:51.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268391+0000", 2024-09-13T05:11:51.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4248e-05 2024-09-13T05:11:51.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268395+0000", 2024-09-13T05:11:51.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0589999999999996e-06 2024-09-13T05:11:51.304 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.304 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.304 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.304 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:132000 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.304 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.249057+0000", 2024-09-13T05:11:51.304 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.020991302, 2024-09-13T05:11:51.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021531003999999999, 2024-09-13T05:11:51.305 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.305 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.305 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 132000 2024-09-13T05:11:51.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.305 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.249057+0000", 2024-09-13T05:11:51.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.249057+0000", 2024-09-13T05:11:51.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.249057+0000", 2024-09-13T05:11:51.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:51.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.249058+0000", 2024-09-13T05:11:51.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:11:51.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.249061+0000", 2024-09-13T05:11:51.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7640000000000001e-06 2024-09-13T05:11:51.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.249064+0000", 2024-09-13T05:11:51.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6220000000000001e-06 2024-09-13T05:11:51.308 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.308 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.308 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.308 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:132105 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.308 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.257225+0000", 2024-09-13T05:11:51.308 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.012823792000000001, 2024-09-13T05:11:51.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013432216, 2024-09-13T05:11:51.309 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.309 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.309 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.309 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.309 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.309 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 132105 2024-09-13T05:11:51.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.309 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.257225+0000", 2024-09-13T05:11:51.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.257225+0000", 2024-09-13T05:11:51.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.257224+0000", 2024-09-13T05:11:51.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.257227+0000", 2024-09-13T05:11:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9390000000000002e-06 2024-09-13T05:11:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.257233+0000", 2024-09-13T05:11:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1680000000000001e-06 2024-09-13T05:11:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.257239+0000", 2024-09-13T05:11:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.395e-06 2024-09-13T05:11:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.311 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:132137 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.261634+0000", 2024-09-13T05:11:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0084139539999999995, 2024-09-13T05:11:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0090975640000000007, 2024-09-13T05:11:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 132137 2024-09-13T05:11:51.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.261634+0000", 2024-09-13T05:11:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.261634+0000", 2024-09-13T05:11:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.261634+0000", 2024-09-13T05:11:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.261637+0000", 2024-09-13T05:11:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6490000000000001e-06 2024-09-13T05:11:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.261647+0000", 2024-09-13T05:11:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7259999999999997e-06 2024-09-13T05:11:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.261655+0000", 2024-09-13T05:11:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0050000000000004e-06 2024-09-13T05:11:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131837 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.266605+0000", 2024-09-13T05:11:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0034438210000000001, 2024-09-13T05:11:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041950609999999999, 2024-09-13T05:11:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.315 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131837 2024-09-13T05:11:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266605+0000", 2024-09-13T05:11:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266605+0000", 2024-09-13T05:11:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266604+0000", 2024-09-13T05:11:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266607+0000", 2024-09-13T05:11:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.331e-06 2024-09-13T05:11:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266615+0000", 2024-09-13T05:11:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3760000000000002e-06 2024-09-13T05:11:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266621+0000", 2024-09-13T05:11:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9850000000000003e-06 2024-09-13T05:11:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131869 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.318 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.267523+0000", 2024-09-13T05:11:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0025250580000000002, 2024-09-13T05:11:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033461250000000001, 2024-09-13T05:11:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131869 2024-09-13T05:11:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267523+0000", 2024-09-13T05:11:51.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267523+0000", 2024-09-13T05:11:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267523+0000", 2024-09-13T05:11:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267525+0000", 2024-09-13T05:11:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.199e-06 2024-09-13T05:11:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267540+0000", 2024-09-13T05:11:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4346e-05 2024-09-13T05:11:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267544+0000", 2024-09-13T05:11:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6500000000000004e-06 2024-09-13T05:11:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.321 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131901 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.268414+0000", 2024-09-13T05:11:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00163441, 2024-09-13T05:11:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025285759999999998, 2024-09-13T05:11:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131901 2024-09-13T05:11:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.322 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268414+0000", 2024-09-13T05:11:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268414+0000", 2024-09-13T05:11:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268413+0000", 2024-09-13T05:11:51.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268417+0000", 2024-09-13T05:11:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2150000000000001e-06 2024-09-13T05:11:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268424+0000", 2024-09-13T05:11:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1779999999999997e-06 2024-09-13T05:11:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268430+0000", 2024-09-13T05:11:51.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0839999999999997e-06 2024-09-13T05:11:51.325 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.325 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.325 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:132001 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.249066+0000", 2024-09-13T05:11:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.020982666000000001, 2024-09-13T05:11:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021950272999999999, 2024-09-13T05:11:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:11:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.328 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 132001 2024-09-13T05:11:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.249066+0000", 2024-09-13T05:11:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.249066+0000", 2024-09-13T05:11:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.249066+0000", 2024-09-13T05:11:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.249067+0000", 2024-09-13T05:11:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5060000000000001e-06 2024-09-13T05:11:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.249070+0000", 2024-09-13T05:11:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8729999999999999e-06 2024-09-13T05:11:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.249073+0000", 2024-09-13T05:11:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.717e-06 2024-09-13T05:11:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.271017+0000", 2024-09-13T05:11:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021944515000000001 2024-09-13T05:11:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.271028+0000", 2024-09-13T05:11:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1065e-05 2024-09-13T05:11:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:132106 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.257277+0000", 2024-09-13T05:11:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.012771012, 2024-09-13T05:11:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01382007, 2024-09-13T05:11:51.332 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.333 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.333 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.333 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.333 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.333 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 132106 2024-09-13T05:11:51.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.333 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.257277+0000", 2024-09-13T05:11:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.257277+0000", 2024-09-13T05:11:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.257277+0000", 2024-09-13T05:11:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.257281+0000", 2024-09-13T05:11:51.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8909999999999997e-06 2024-09-13T05:11:51.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.257288+0000", 2024-09-13T05:11:51.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4209999999999998e-06 2024-09-13T05:11:51.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.257294+0000", 2024-09-13T05:11:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7420000000000003e-06 2024-09-13T05:11:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:132138 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.264526+0000", 2024-09-13T05:11:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0055224979999999998, 2024-09-13T05:11:51.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066394280000000002, 2024-09-13T05:11:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 132138 2024-09-13T05:11:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.264526+0000", 2024-09-13T05:11:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.264526+0000", 2024-09-13T05:11:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.261662+0000", 2024-09-13T05:11:51.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9971356 2024-09-13T05:11:51.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.264535+0000", 2024-09-13T05:11:51.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002873685 2024-09-13T05:11:51.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.264555+0000", 2024-09-13T05:11:51.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9613e-05 2024-09-13T05:11:51.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.264562+0000", 2024-09-13T05:11:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6239999999999996e-06 2024-09-13T05:11:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131838 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.266650+0000", 2024-09-13T05:11:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0033985819999999998, 2024-09-13T05:11:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045876709999999998, 2024-09-13T05:11:51.340 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131838 2024-09-13T05:11:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266650+0000", 2024-09-13T05:11:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266650+0000", 2024-09-13T05:11:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266650+0000", 2024-09-13T05:11:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266652+0000", 2024-09-13T05:11:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1519999999999999e-06 2024-09-13T05:11:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266662+0000", 2024-09-13T05:11:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0567000000000001e-05 2024-09-13T05:11:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266666+0000", 2024-09-13T05:11:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9129999999999996e-06 2024-09-13T05:11:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.343 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131870 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.267560+0000", 2024-09-13T05:11:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00248825, 2024-09-13T05:11:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003752348, 2024-09-13T05:11:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131870 2024-09-13T05:11:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267560+0000", 2024-09-13T05:11:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267560+0000", 2024-09-13T05:11:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267560+0000", 2024-09-13T05:11:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267563+0000", 2024-09-13T05:11:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1499999999999999e-06 2024-09-13T05:11:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267570+0000", 2024-09-13T05:11:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3919999999999997e-06 2024-09-13T05:11:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267576+0000", 2024-09-13T05:11:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1419999999999998e-06 2024-09-13T05:11:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131902 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.268435+0000", 2024-09-13T05:11:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0016130090000000001, 2024-09-13T05:11:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029477980000000002, 2024-09-13T05:11:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131902 2024-09-13T05:11:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268435+0000", 2024-09-13T05:11:51.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268435+0000", 2024-09-13T05:11:51.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268435+0000", 2024-09-13T05:11:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268438+0000", 2024-09-13T05:11:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.588e-06 2024-09-13T05:11:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268444+0000", 2024-09-13T05:11:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1589999999999998e-06 2024-09-13T05:11:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268447+0000", 2024-09-13T05:11:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4580000000000002e-06 2024-09-13T05:11:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:132107 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.257299+0000", 2024-09-13T05:11:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.012749587, 2024-09-13T05:11:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01416044, 2024-09-13T05:11:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.350 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 132107 2024-09-13T05:11:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.257299+0000", 2024-09-13T05:11:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.257299+0000", 2024-09-13T05:11:51.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.257298+0000", 2024-09-13T05:11:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.257301+0000", 2024-09-13T05:11:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.044e-06 2024-09-13T05:11:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.257308+0000", 2024-09-13T05:11:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2500000000000003e-06 2024-09-13T05:11:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.257313+0000", 2024-09-13T05:11:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3170000000000001e-06 2024-09-13T05:11:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:132139 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.264568+0000", 2024-09-13T05:11:51.353 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0054808050000000001, 2024-09-13T05:11:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0069638180000000001, 2024-09-13T05:11:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 132139 2024-09-13T05:11:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.264568+0000", 2024-09-13T05:11:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.264568+0000", 2024-09-13T05:11:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.264567+0000", 2024-09-13T05:11:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.264570+0000", 2024-09-13T05:11:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.96e-06 2024-09-13T05:11:51.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.264580+0000", 2024-09-13T05:11:51.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0011e-05 2024-09-13T05:11:51.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.264585+0000", 2024-09-13T05:11:51.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6829999999999999e-06 2024-09-13T05:11:51.356 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131839 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.266670+0000", 2024-09-13T05:11:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0033788490000000002, 2024-09-13T05:11:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049326630000000003, 2024-09-13T05:11:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.357 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131839 2024-09-13T05:11:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266670+0000", 2024-09-13T05:11:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266670+0000", 2024-09-13T05:11:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266669+0000", 2024-09-13T05:11:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266672+0000", 2024-09-13T05:11:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.852e-06 2024-09-13T05:11:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266678+0000", 2024-09-13T05:11:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3419999999999996e-06 2024-09-13T05:11:51.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266682+0000", 2024-09-13T05:11:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6909999999999999e-06 2024-09-13T05:11:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131871 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.267582+0000", 2024-09-13T05:11:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0024669029999999999, 2024-09-13T05:11:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040882560000000002, 2024-09-13T05:11:51.360 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131871 2024-09-13T05:11:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267582+0000", 2024-09-13T05:11:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267582+0000", 2024-09-13T05:11:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267581+0000", 2024-09-13T05:11:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267584+0000", 2024-09-13T05:11:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8870000000000001e-06 2024-09-13T05:11:51.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267592+0000", 2024-09-13T05:11:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1100000000000003e-06 2024-09-13T05:11:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267598+0000", 2024-09-13T05:11:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6670000000000001e-06 2024-09-13T05:11:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.364 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131903 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.364 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.268463+0000", 2024-09-13T05:11:51.364 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001585298, 2024-09-13T05:11:51.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032729980000000001, 2024-09-13T05:11:51.364 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.364 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.364 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.364 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.364 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131903 2024-09-13T05:11:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268463+0000", 2024-09-13T05:11:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268463+0000", 2024-09-13T05:11:51.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268463+0000", 2024-09-13T05:11:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268465+0000", 2024-09-13T05:11:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2239999999999998e-06 2024-09-13T05:11:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268477+0000", 2024-09-13T05:11:51.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2252999999999999e-05 2024-09-13T05:11:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268491+0000", 2024-09-13T05:11:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4132e-05 2024-09-13T05:11:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:132140 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.264588+0000", 2024-09-13T05:11:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0054600600000000001, 2024-09-13T05:11:51.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007222277, 2024-09-13T05:11:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 132140 2024-09-13T05:11:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.264588+0000", 2024-09-13T05:11:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.264588+0000", 2024-09-13T05:11:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.264588+0000", 2024-09-13T05:11:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.264590+0000", 2024-09-13T05:11:51.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1749999999999999e-06 2024-09-13T05:11:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.264594+0000", 2024-09-13T05:11:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9759999999999997e-06 2024-09-13T05:11:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.264598+0000", 2024-09-13T05:11:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6830000000000001e-06 2024-09-13T05:11:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131840 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.266699+0000", 2024-09-13T05:11:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003349196, 2024-09-13T05:11:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051805610000000002, 2024-09-13T05:11:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131840 2024-09-13T05:11:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266699+0000", 2024-09-13T05:11:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266699+0000", 2024-09-13T05:11:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266699+0000", 2024-09-13T05:11:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266702+0000", 2024-09-13T05:11:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0690000000000002e-06 2024-09-13T05:11:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266709+0000", 2024-09-13T05:11:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4699999999999996e-06 2024-09-13T05:11:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266715+0000", 2024-09-13T05:11:51.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0809999999999999e-06 2024-09-13T05:11:51.374 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.374 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.374 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.374 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131872 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.374 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.267614+0000", 2024-09-13T05:11:51.374 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0024342930000000001, 2024-09-13T05:11:51.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043375899999999997, 2024-09-13T05:11:51.374 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.374 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.374 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.374 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.375 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.375 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131872 2024-09-13T05:11:51.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.375 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267614+0000", 2024-09-13T05:11:51.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267614+0000", 2024-09-13T05:11:51.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267614+0000", 2024-09-13T05:11:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267618+0000", 2024-09-13T05:11:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1590000000000003e-06 2024-09-13T05:11:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267623+0000", 2024-09-13T05:11:51.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6380000000000003e-06 2024-09-13T05:11:51.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267626+0000", 2024-09-13T05:11:51.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.58e-06 2024-09-13T05:11:51.377 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.377 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.377 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.378 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131904 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.378 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.268549+0000", 2024-09-13T05:11:51.378 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001499822, 2024-09-13T05:11:51.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034708809999999999, 2024-09-13T05:11:51.378 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.378 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.378 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.378 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.378 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.378 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131904 2024-09-13T05:11:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268549+0000", 2024-09-13T05:11:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268549+0000", 2024-09-13T05:11:51.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268548+0000", 2024-09-13T05:11:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268550+0000", 2024-09-13T05:11:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:11:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268555+0000", 2024-09-13T05:11:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6999999999999999e-06 2024-09-13T05:11:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268559+0000", 2024-09-13T05:11:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6200000000000001e-06 2024-09-13T05:11:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:132141 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.381 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.264601+0000", 2024-09-13T05:11:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0054473070000000002, 2024-09-13T05:11:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0074907419999999999, 2024-09-13T05:11:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 132141 2024-09-13T05:11:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.264601+0000", 2024-09-13T05:11:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.264601+0000", 2024-09-13T05:11:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.264601+0000", 2024-09-13T05:11:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.264603+0000", 2024-09-13T05:11:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0269999999999998e-06 2024-09-13T05:11:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.264607+0000", 2024-09-13T05:11:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8700000000000002e-06 2024-09-13T05:11:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.264610+0000", 2024-09-13T05:11:51.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2820000000000001e-06 2024-09-13T05:11:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131841 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.266721+0000", 2024-09-13T05:11:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003327843, 2024-09-13T05:11:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005444908, 2024-09-13T05:11:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.385 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131841 2024-09-13T05:11:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266721+0000", 2024-09-13T05:11:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266721+0000", 2024-09-13T05:11:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266720+0000", 2024-09-13T05:11:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266723+0000", 2024-09-13T05:11:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.982e-06 2024-09-13T05:11:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266730+0000", 2024-09-13T05:11:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2019999999999998e-06 2024-09-13T05:11:51.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266736+0000", 2024-09-13T05:11:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9549999999999997e-06 2024-09-13T05:11:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131873 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.267631+0000", 2024-09-13T05:11:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0024173670000000001, 2024-09-13T05:11:51.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046001430000000001, 2024-09-13T05:11:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131873 2024-09-13T05:11:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267631+0000", 2024-09-13T05:11:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267631+0000", 2024-09-13T05:11:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267631+0000", 2024-09-13T05:11:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267634+0000", 2024-09-13T05:11:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9919999999999999e-06 2024-09-13T05:11:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267640+0000", 2024-09-13T05:11:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0390000000000001e-06 2024-09-13T05:11:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267643+0000", 2024-09-13T05:11:51.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4130000000000002e-06 2024-09-13T05:11:51.392 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.392 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.392 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.392 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131905 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.392 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.268562+0000", 2024-09-13T05:11:51.392 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001486011, 2024-09-13T05:11:51.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037406459999999998, 2024-09-13T05:11:51.392 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.392 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131905 2024-09-13T05:11:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268562+0000", 2024-09-13T05:11:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268562+0000", 2024-09-13T05:11:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268562+0000", 2024-09-13T05:11:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268564+0000", 2024-09-13T05:11:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8840000000000001e-06 2024-09-13T05:11:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268576+0000", 2024-09-13T05:11:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1508999999999999e-05 2024-09-13T05:11:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268579+0000", 2024-09-13T05:11:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5700000000000001e-06 2024-09-13T05:11:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131842 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.266753+0000", 2024-09-13T05:11:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0032955039999999999, 2024-09-13T05:11:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056249200000000003, 2024-09-13T05:11:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131842 2024-09-13T05:11:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266753+0000", 2024-09-13T05:11:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266753+0000", 2024-09-13T05:11:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266753+0000", 2024-09-13T05:11:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266755+0000", 2024-09-13T05:11:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0700000000000001e-06 2024-09-13T05:11:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266765+0000", 2024-09-13T05:11:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0325e-05 2024-09-13T05:11:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266770+0000", 2024-09-13T05:11:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2580000000000003e-06 2024-09-13T05:11:51.398 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.399 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.399 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.399 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131874 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.399 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.267664+0000", 2024-09-13T05:11:51.399 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002384602, 2024-09-13T05:11:51.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047825259999999996, 2024-09-13T05:11:51.399 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131874 2024-09-13T05:11:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267664+0000", 2024-09-13T05:11:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267664+0000", 2024-09-13T05:11:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267663+0000", 2024-09-13T05:11:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267666+0000", 2024-09-13T05:11:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.044e-06 2024-09-13T05:11:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267674+0000", 2024-09-13T05:11:51.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3429999999999998e-06 2024-09-13T05:11:51.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267680+0000", 2024-09-13T05:11:51.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.241e-06 2024-09-13T05:11:51.402 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.402 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.402 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.403 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131906 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.403 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.268603+0000", 2024-09-13T05:11:51.403 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0014458299999999999, 2024-09-13T05:11:51.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039117359999999999, 2024-09-13T05:11:51.403 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.403 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.403 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131906 2024-09-13T05:11:51.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.403 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268603+0000", 2024-09-13T05:11:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268603+0000", 2024-09-13T05:11:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268602+0000", 2024-09-13T05:11:51.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268605+0000", 2024-09-13T05:11:51.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.19e-06 2024-09-13T05:11:51.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268613+0000", 2024-09-13T05:11:51.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5009999999999998e-06 2024-09-13T05:11:51.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268620+0000", 2024-09-13T05:11:51.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8870000000000003e-06 2024-09-13T05:11:51.406 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.406 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.406 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.406 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131843 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.406 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.266774+0000", 2024-09-13T05:11:51.406 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0032747890000000002, 2024-09-13T05:11:51.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058740550000000004, 2024-09-13T05:11:51.406 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.406 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.406 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.407 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131843 2024-09-13T05:11:51.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.407 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266774+0000", 2024-09-13T05:11:51.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266774+0000", 2024-09-13T05:11:51.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266773+0000", 2024-09-13T05:11:51.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266776+0000", 2024-09-13T05:11:51.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9440000000000001e-06 2024-09-13T05:11:51.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266783+0000", 2024-09-13T05:11:51.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2770000000000002e-06 2024-09-13T05:11:51.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266786+0000", 2024-09-13T05:11:51.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5839999999999999e-06 2024-09-13T05:11:51.409 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.409 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.409 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.409 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131875 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.409 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.267685+0000", 2024-09-13T05:11:51.409 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0023631699999999999, 2024-09-13T05:11:51.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050307169999999997, 2024-09-13T05:11:51.410 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.410 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.410 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.410 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.410 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.410 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131875 2024-09-13T05:11:51.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.410 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267685+0000", 2024-09-13T05:11:51.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267685+0000", 2024-09-13T05:11:51.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267685+0000", 2024-09-13T05:11:51.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267688+0000", 2024-09-13T05:11:51.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7870000000000002e-06 2024-09-13T05:11:51.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267697+0000", 2024-09-13T05:11:51.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1339999999999993e-06 2024-09-13T05:11:51.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267703+0000", 2024-09-13T05:11:51.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8629999999999996e-06 2024-09-13T05:11:51.412 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.412 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.413 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.413 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131907 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.413 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.268625+0000", 2024-09-13T05:11:51.413 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0014235859999999999, 2024-09-13T05:11:51.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041622880000000001, 2024-09-13T05:11:51.413 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.413 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.413 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131907 2024-09-13T05:11:51.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.413 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268625+0000", 2024-09-13T05:11:51.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268625+0000", 2024-09-13T05:11:51.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268624+0000", 2024-09-13T05:11:51.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268628+0000", 2024-09-13T05:11:51.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1030000000000002e-06 2024-09-13T05:11:51.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268633+0000", 2024-09-13T05:11:51.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3890000000000004e-06 2024-09-13T05:11:51.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268637+0000", 2024-09-13T05:11:51.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.087e-06 2024-09-13T05:11:51.416 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.416 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.416 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.416 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131844 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.416 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.266803+0000", 2024-09-13T05:11:51.416 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0032453709999999999, 2024-09-13T05:11:51.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060586499999999996, 2024-09-13T05:11:51.416 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.416 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.417 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.417 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131844 2024-09-13T05:11:51.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.417 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266803+0000", 2024-09-13T05:11:51.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266803+0000", 2024-09-13T05:11:51.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266802+0000", 2024-09-13T05:11:51.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266806+0000", 2024-09-13T05:11:51.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2990000000000001e-06 2024-09-13T05:11:51.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266813+0000", 2024-09-13T05:11:51.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3019999999999997e-06 2024-09-13T05:11:51.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.266819+0000", 2024-09-13T05:11:51.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1059999999999996e-06 2024-09-13T05:11:51.419 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.419 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.419 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.419 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131876 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.419 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.267723+0000", 2024-09-13T05:11:51.419 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002325775, 2024-09-13T05:11:51.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052086069999999996, 2024-09-13T05:11:51.420 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.420 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.420 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.420 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.420 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.420 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131876 2024-09-13T05:11:51.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.420 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267723+0000", 2024-09-13T05:11:51.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267723+0000", 2024-09-13T05:11:51.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267722+0000", 2024-09-13T05:11:51.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267724+0000", 2024-09-13T05:11:51.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.967e-06 2024-09-13T05:11:51.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267730+0000", 2024-09-13T05:11:51.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.823e-06 2024-09-13T05:11:51.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267734+0000", 2024-09-13T05:11:51.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5880000000000002e-06 2024-09-13T05:11:51.422 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.422 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.422 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.423 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131908 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.423 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.268652+0000", 2024-09-13T05:11:51.423 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0013969410000000001, 2024-09-13T05:11:51.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043681559999999998, 2024-09-13T05:11:51.423 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.423 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.423 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131908 2024-09-13T05:11:51.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.423 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268652+0000", 2024-09-13T05:11:51.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268652+0000", 2024-09-13T05:11:51.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268651+0000", 2024-09-13T05:11:51.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268653+0000", 2024-09-13T05:11:51.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9609999999999999e-06 2024-09-13T05:11:51.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268665+0000", 2024-09-13T05:11:51.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1753000000000001e-05 2024-09-13T05:11:51.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268669+0000", 2024-09-13T05:11:51.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8990000000000003e-06 2024-09-13T05:11:51.425 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.425 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.426 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.426 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131877 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.426 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.267737+0000", 2024-09-13T05:11:51.426 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0023116170000000002, 2024-09-13T05:11:51.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053589529999999996, 2024-09-13T05:11:51.426 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.426 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.426 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.426 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.426 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.426 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131877 2024-09-13T05:11:51.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.427 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267737+0000", 2024-09-13T05:11:51.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267737+0000", 2024-09-13T05:11:51.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267737+0000", 2024-09-13T05:11:51.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267738+0000", 2024-09-13T05:11:51.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8980000000000001e-06 2024-09-13T05:11:51.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267745+0000", 2024-09-13T05:11:51.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1430000000000003e-06 2024-09-13T05:11:51.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267749+0000", 2024-09-13T05:11:51.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3279999999999999e-06 2024-09-13T05:11:51.429 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.429 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.429 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.429 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131909 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.429 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.268695+0000", 2024-09-13T05:11:51.429 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0013537620000000001, 2024-09-13T05:11:51.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044696789999999998, 2024-09-13T05:11:51.429 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.429 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.429 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.430 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.430 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.430 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131909 2024-09-13T05:11:51.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.430 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268695+0000", 2024-09-13T05:11:51.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268695+0000", 2024-09-13T05:11:51.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268694+0000", 2024-09-13T05:11:51.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268697+0000", 2024-09-13T05:11:51.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3859999999999999e-06 2024-09-13T05:11:51.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268710+0000", 2024-09-13T05:11:51.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2979000000000001e-05 2024-09-13T05:11:51.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268718+0000", 2024-09-13T05:11:51.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6399999999999997e-06 2024-09-13T05:11:51.432 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.432 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.432 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.432 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131878 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.432 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.267753+0000", 2024-09-13T05:11:51.433 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0022958689999999999, 2024-09-13T05:11:51.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054860600000000001, 2024-09-13T05:11:51.433 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.433 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.433 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.433 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.433 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.433 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131878 2024-09-13T05:11:51.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.433 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267753+0000", 2024-09-13T05:11:51.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267753+0000", 2024-09-13T05:11:51.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267752+0000", 2024-09-13T05:11:51.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267755+0000", 2024-09-13T05:11:51.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.18e-06 2024-09-13T05:11:51.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267768+0000", 2024-09-13T05:11:51.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3081000000000001e-05 2024-09-13T05:11:51.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267775+0000", 2024-09-13T05:11:51.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0469999999999996e-06 2024-09-13T05:11:51.435 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.435 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.436 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.436 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131910 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.436 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.268746+0000", 2024-09-13T05:11:51.436 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0013026660000000001, 2024-09-13T05:11:51.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045626659999999999, 2024-09-13T05:11:51.436 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.436 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.436 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.436 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.436 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.436 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131910 2024-09-13T05:11:51.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.437 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268746+0000", 2024-09-13T05:11:51.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268746+0000", 2024-09-13T05:11:51.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268745+0000", 2024-09-13T05:11:51.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268748+0000", 2024-09-13T05:11:51.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5110000000000002e-06 2024-09-13T05:11:51.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268762+0000", 2024-09-13T05:11:51.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3560000000000001e-05 2024-09-13T05:11:51.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268767+0000", 2024-09-13T05:11:51.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9880000000000004e-06 2024-09-13T05:11:51.439 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.439 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.439 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.439 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131879 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.439 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.267782+0000", 2024-09-13T05:11:51.439 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002266686, 2024-09-13T05:11:51.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056242640000000003, 2024-09-13T05:11:51.439 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.439 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.440 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.440 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.440 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131879 2024-09-13T05:11:51.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.440 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267782+0000", 2024-09-13T05:11:51.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267782+0000", 2024-09-13T05:11:51.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267781+0000", 2024-09-13T05:11:51.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267784+0000", 2024-09-13T05:11:51.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0869999999999998e-06 2024-09-13T05:11:51.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267793+0000", 2024-09-13T05:11:51.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2470000000000008e-06 2024-09-13T05:11:51.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267804+0000", 2024-09-13T05:11:51.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1321999999999999e-05 2024-09-13T05:11:51.442 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.442 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.442 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.442 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131911 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.442 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.268783+0000", 2024-09-13T05:11:51.442 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0012657510000000001, 2024-09-13T05:11:51.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046914640000000002, 2024-09-13T05:11:51.443 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.443 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.443 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.443 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.443 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.443 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131911 2024-09-13T05:11:51.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.443 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268783+0000", 2024-09-13T05:11:51.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268783+0000", 2024-09-13T05:11:51.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268782+0000", 2024-09-13T05:11:51.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268785+0000", 2024-09-13T05:11:51.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2480000000000001e-06 2024-09-13T05:11:51.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268793+0000", 2024-09-13T05:11:51.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4569999999999999e-06 2024-09-13T05:11:51.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268799+0000", 2024-09-13T05:11:51.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0820000000000004e-06 2024-09-13T05:11:51.445 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.445 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.445 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.446 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131880 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.446 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.267833+0000", 2024-09-13T05:11:51.446 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002215453, 2024-09-13T05:11:51.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057116420000000003, 2024-09-13T05:11:51.446 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.446 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.446 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.446 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.446 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.446 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131880 2024-09-13T05:11:51.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.446 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267833+0000", 2024-09-13T05:11:51.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267833+0000", 2024-09-13T05:11:51.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267833+0000", 2024-09-13T05:11:51.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267835+0000", 2024-09-13T05:11:51.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.063e-06 2024-09-13T05:11:51.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267841+0000", 2024-09-13T05:11:51.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9089999999999997e-06 2024-09-13T05:11:51.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.267844+0000", 2024-09-13T05:11:51.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5899999999999999e-06 2024-09-13T05:11:51.449 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.449 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.449 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.449 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131912 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.449 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.268805+0000", 2024-09-13T05:11:51.449 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001243804, 2024-09-13T05:11:51.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048195499999999997, 2024-09-13T05:11:51.449 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.449 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.449 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.449 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.450 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.450 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131912 2024-09-13T05:11:51.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.450 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268805+0000", 2024-09-13T05:11:51.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268805+0000", 2024-09-13T05:11:51.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268804+0000", 2024-09-13T05:11:51.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268807+0000", 2024-09-13T05:11:51.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9469999999999999e-06 2024-09-13T05:11:51.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268814+0000", 2024-09-13T05:11:51.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1239999999999999e-06 2024-09-13T05:11:51.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268820+0000", 2024-09-13T05:11:51.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:11:51.452 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.452 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.452 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.452 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131913 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.452 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.268835+0000", 2024-09-13T05:11:51.452 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001213251, 2024-09-13T05:11:51.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048625719999999999, 2024-09-13T05:11:51.453 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.453 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.453 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.453 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.453 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.453 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131913 2024-09-13T05:11:51.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.453 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268835+0000", 2024-09-13T05:11:51.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268835+0000", 2024-09-13T05:11:51.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268835+0000", 2024-09-13T05:11:51.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268837+0000", 2024-09-13T05:11:51.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.136e-06 2024-09-13T05:11:51.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268841+0000", 2024-09-13T05:11:51.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4070000000000003e-06 2024-09-13T05:11:51.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268845+0000", 2024-09-13T05:11:51.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6200000000000001e-06 2024-09-13T05:11:51.455 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.455 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.455 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.456 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131914 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.456 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.268848+0000", 2024-09-13T05:11:51.456 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001200095, 2024-09-13T05:11:51.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049243990000000003, 2024-09-13T05:11:51.456 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.457 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.457 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131914 2024-09-13T05:11:51.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.457 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268848+0000", 2024-09-13T05:11:51.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268848+0000", 2024-09-13T05:11:51.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268848+0000", 2024-09-13T05:11:51.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268850+0000", 2024-09-13T05:11:51.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.809e-06 2024-09-13T05:11:51.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268861+0000", 2024-09-13T05:11:51.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1421e-05 2024-09-13T05:11:51.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268865+0000", 2024-09-13T05:11:51.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6370000000000001e-06 2024-09-13T05:11:51.459 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.460 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.460 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.460 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131915 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.460 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.268886+0000", 2024-09-13T05:11:51.460 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001162216, 2024-09-13T05:11:51.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049591549999999998, 2024-09-13T05:11:51.460 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.460 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.460 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.460 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.461 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.461 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131915 2024-09-13T05:11:51.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.461 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268886+0000", 2024-09-13T05:11:51.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268886+0000", 2024-09-13T05:11:51.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268886+0000", 2024-09-13T05:11:51.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268889+0000", 2024-09-13T05:11:51.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2650000000000001e-06 2024-09-13T05:11:51.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268896+0000", 2024-09-13T05:11:51.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3459999999999996e-06 2024-09-13T05:11:51.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268902+0000", 2024-09-13T05:11:51.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1700000000000002e-06 2024-09-13T05:11:51.463 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.463 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.463 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.464 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131916 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.464 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.268908+0000", 2024-09-13T05:11:51.464 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001140605, 2024-09-13T05:11:51.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050135639999999999, 2024-09-13T05:11:51.464 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.464 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.464 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.464 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.465 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.465 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131916 2024-09-13T05:11:51.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.465 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268908+0000", 2024-09-13T05:11:51.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268908+0000", 2024-09-13T05:11:51.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268907+0000", 2024-09-13T05:11:51.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268910+0000", 2024-09-13T05:11:51.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0740000000000001e-06 2024-09-13T05:11:51.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268918+0000", 2024-09-13T05:11:51.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0520000000000004e-06 2024-09-13T05:11:51.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.268923+0000", 2024-09-13T05:11:51.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8250000000000001e-06 2024-09-13T05:11:51.467 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.467 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.467 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.467 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131751 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.467 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.270018+0000", 2024-09-13T05:11:51.468 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.0731000000000001e-05, 2024-09-13T05:11:51.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039755470000000003, 2024-09-13T05:11:51.468 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.468 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.468 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.468 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.468 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.468 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131751 2024-09-13T05:11:51.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.468 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270018+0000", 2024-09-13T05:11:51.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270018+0000", 2024-09-13T05:11:51.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270017+0000", 2024-09-13T05:11:51.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:51.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270022+0000", 2024-09-13T05:11:51.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2020000000000003e-06 2024-09-13T05:11:51.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270032+0000", 2024-09-13T05:11:51.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0192e-05 2024-09-13T05:11:51.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270040+0000", 2024-09-13T05:11:51.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.729e-06 2024-09-13T05:11:51.470 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.470 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.470 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.471 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131752 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.471 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.270047+0000", 2024-09-13T05:11:51.471 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.612e-06, 2024-09-13T05:11:51.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040193640000000001, 2024-09-13T05:11:51.471 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.471 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.471 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.471 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.471 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.471 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131752 2024-09-13T05:11:51.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.472 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270047+0000", 2024-09-13T05:11:51.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270047+0000", 2024-09-13T05:11:51.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270046+0000", 2024-09-13T05:11:51.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270050+0000", 2024-09-13T05:11:51.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4180000000000001e-06 2024-09-13T05:11:51.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270056+0000", 2024-09-13T05:11:51.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4049999999999997e-06 2024-09-13T05:11:51.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270061+0000", 2024-09-13T05:11:51.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2979999999999999e-06 2024-09-13T05:11:51.474 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.474 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.474 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.474 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131753 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.474 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.270067+0000", 2024-09-13T05:11:51.474 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9999814, 2024-09-13T05:11:51.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004073035, 2024-09-13T05:11:51.474 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.474 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.474 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.475 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.475 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.475 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131753 2024-09-13T05:11:51.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.475 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270067+0000", 2024-09-13T05:11:51.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270067+0000", 2024-09-13T05:11:51.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270066+0000", 2024-09-13T05:11:51.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270069+0000", 2024-09-13T05:11:51.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0359999999999998e-06 2024-09-13T05:11:51.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270076+0000", 2024-09-13T05:11:51.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6850000000000004e-06 2024-09-13T05:11:51.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270081+0000", 2024-09-13T05:11:51.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3920000000000002e-06 2024-09-13T05:11:51.477 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.477 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.477 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.477 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131754 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.477 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.270097+0000", 2024-09-13T05:11:51.478 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9999514, 2024-09-13T05:11:51.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00412285, 2024-09-13T05:11:51.478 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.478 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.478 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.478 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.478 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.478 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131754 2024-09-13T05:11:51.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.478 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270097+0000", 2024-09-13T05:11:51.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270097+0000", 2024-09-13T05:11:51.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270096+0000", 2024-09-13T05:11:51.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270100+0000", 2024-09-13T05:11:51.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5659999999999998e-06 2024-09-13T05:11:51.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270106+0000", 2024-09-13T05:11:51.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5529999999999998e-06 2024-09-13T05:11:51.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270110+0000", 2024-09-13T05:11:51.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4699999999999998e-06 2024-09-13T05:11:51.480 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.480 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.481 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.481 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131755 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.481 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.270127+0000", 2024-09-13T05:11:51.481 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9999218, 2024-09-13T05:11:51.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041676439999999999, 2024-09-13T05:11:51.481 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.481 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.481 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.481 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.481 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.481 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131755 2024-09-13T05:11:51.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.482 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270127+0000", 2024-09-13T05:11:51.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270127+0000", 2024-09-13T05:11:51.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270126+0000", 2024-09-13T05:11:51.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270129+0000", 2024-09-13T05:11:51.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.332e-06 2024-09-13T05:11:51.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270134+0000", 2024-09-13T05:11:51.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7979999999999996e-06 2024-09-13T05:11:51.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270140+0000", 2024-09-13T05:11:51.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5729999999999998e-06 2024-09-13T05:11:51.484 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.484 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.484 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.484 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131829 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.484 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.270152+0000", 2024-09-13T05:11:51.484 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9998965, 2024-09-13T05:11:51.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042168600000000002, 2024-09-13T05:11:51.484 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.484 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.485 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.485 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.485 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.485 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131829 2024-09-13T05:11:51.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.485 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270152+0000", 2024-09-13T05:11:51.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270152+0000", 2024-09-13T05:11:51.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270151+0000", 2024-09-13T05:11:51.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270154+0000", 2024-09-13T05:11:51.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8700000000000001e-06 2024-09-13T05:11:51.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270160+0000", 2024-09-13T05:11:51.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3389999999999998e-06 2024-09-13T05:11:51.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270166+0000", 2024-09-13T05:11:51.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1970000000000004e-06 2024-09-13T05:11:51.487 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.487 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.487 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.487 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131830 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.487 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.270203+0000", 2024-09-13T05:11:51.488 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.999846, 2024-09-13T05:11:51.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042404030000000002, 2024-09-13T05:11:51.488 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.488 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.488 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.488 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.488 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.488 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131830 2024-09-13T05:11:51.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.488 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270203+0000", 2024-09-13T05:11:51.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270203+0000", 2024-09-13T05:11:51.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270202+0000", 2024-09-13T05:11:51.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270206+0000", 2024-09-13T05:11:51.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5899999999999999e-06 2024-09-13T05:11:51.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270213+0000", 2024-09-13T05:11:51.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2280000000000001e-06 2024-09-13T05:11:51.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270218+0000", 2024-09-13T05:11:51.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4790000000000004e-06 2024-09-13T05:11:51.490 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.490 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.490 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.491 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131831 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.491 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.270259+0000", 2024-09-13T05:11:51.491 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9997892, 2024-09-13T05:11:51.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042574279999999997, 2024-09-13T05:11:51.491 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.491 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.491 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.491 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.491 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.491 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131831 2024-09-13T05:11:51.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.491 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270259+0000", 2024-09-13T05:11:51.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270259+0000", 2024-09-13T05:11:51.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270259+0000", 2024-09-13T05:11:51.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270261+0000", 2024-09-13T05:11:51.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1270000000000001e-06 2024-09-13T05:11:51.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270266+0000", 2024-09-13T05:11:51.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6650000000000002e-06 2024-09-13T05:11:51.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270271+0000", 2024-09-13T05:11:51.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6760000000000004e-06 2024-09-13T05:11:51.494 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.494 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.494 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.494 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131832 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.494 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.270286+0000", 2024-09-13T05:11:51.494 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9997625, 2024-09-13T05:11:51.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043072279999999998, 2024-09-13T05:11:51.494 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.494 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.494 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.494 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.494 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.495 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131832 2024-09-13T05:11:51.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.495 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270286+0000", 2024-09-13T05:11:51.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270286+0000", 2024-09-13T05:11:51.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270285+0000", 2024-09-13T05:11:51.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270288+0000", 2024-09-13T05:11:51.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0860000000000002e-06 2024-09-13T05:11:51.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270295+0000", 2024-09-13T05:11:51.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4869999999999999e-06 2024-09-13T05:11:51.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270300+0000", 2024-09-13T05:11:51.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0220000000000004e-06 2024-09-13T05:11:51.497 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.497 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.497 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.497 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131833 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.497 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.270326+0000", 2024-09-13T05:11:51.497 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9997225, 2024-09-13T05:11:51.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043392969999999998, 2024-09-13T05:11:51.497 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.497 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.498 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.498 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.498 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.498 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131833 2024-09-13T05:11:51.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.498 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270326+0000", 2024-09-13T05:11:51.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270326+0000", 2024-09-13T05:11:51.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270326+0000", 2024-09-13T05:11:51.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270329+0000", 2024-09-13T05:11:51.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1e-06 2024-09-13T05:11:51.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270336+0000", 2024-09-13T05:11:51.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.759e-06 2024-09-13T05:11:51.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270341+0000", 2024-09-13T05:11:51.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989999999999997e-06 2024-09-13T05:11:51.500 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.500 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.500 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.500 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131834 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.501 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.270358+0000", 2024-09-13T05:11:51.501 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9996901, 2024-09-13T05:11:51.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043814220000000003, 2024-09-13T05:11:51.501 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.501 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.501 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.501 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.501 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.501 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131834 2024-09-13T05:11:51.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.501 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270358+0000", 2024-09-13T05:11:51.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270358+0000", 2024-09-13T05:11:51.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270358+0000", 2024-09-13T05:11:51.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270361+0000", 2024-09-13T05:11:51.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9280000000000002e-06 2024-09-13T05:11:51.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270367+0000", 2024-09-13T05:11:51.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6440000000000003e-06 2024-09-13T05:11:51.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270372+0000", 2024-09-13T05:11:51.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9760000000000003e-06 2024-09-13T05:11:51.503 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.503 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.503 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.504 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131835 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.504 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.270390+0000", 2024-09-13T05:11:51.504 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9996586, 2024-09-13T05:11:51.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044196640000000002, 2024-09-13T05:11:51.504 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.504 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.504 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.504 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.504 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.504 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131835 2024-09-13T05:11:51.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.504 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270390+0000", 2024-09-13T05:11:51.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270390+0000", 2024-09-13T05:11:51.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270389+0000", 2024-09-13T05:11:51.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270392+0000", 2024-09-13T05:11:51.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9359999999999999e-06 2024-09-13T05:11:51.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270399+0000", 2024-09-13T05:11:51.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4729999999999997e-06 2024-09-13T05:11:51.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270404+0000", 2024-09-13T05:11:51.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.994e-06 2024-09-13T05:11:51.507 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.507 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.507 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.507 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131836 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.507 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.270422+0000", 2024-09-13T05:11:51.507 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9996262, 2024-09-13T05:11:51.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044610730000000003, 2024-09-13T05:11:51.507 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.507 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.507 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.507 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.508 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.508 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131836 2024-09-13T05:11:51.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.508 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270422+0000", 2024-09-13T05:11:51.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270422+0000", 2024-09-13T05:11:51.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270422+0000", 2024-09-13T05:11:51.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270428+0000", 2024-09-13T05:11:51.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0789999999999997e-06 2024-09-13T05:11:51.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270435+0000", 2024-09-13T05:11:51.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8070000000000002e-06 2024-09-13T05:11:51.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270440+0000", 2024-09-13T05:11:51.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0379999999999999e-06 2024-09-13T05:11:51.510 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.510 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.510 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.510 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131837 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.510 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.270459+0000", 2024-09-13T05:11:51.510 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9995894, 2024-09-13T05:11:51.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044954440000000003, 2024-09-13T05:11:51.510 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.511 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.511 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.511 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.511 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.511 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131837 2024-09-13T05:11:51.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.511 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270459+0000", 2024-09-13T05:11:51.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270459+0000", 2024-09-13T05:11:51.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270459+0000", 2024-09-13T05:11:51.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270462+0000", 2024-09-13T05:11:51.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8569999999999999e-06 2024-09-13T05:11:51.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270468+0000", 2024-09-13T05:11:51.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5169999999999996e-06 2024-09-13T05:11:51.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270473+0000", 2024-09-13T05:11:51.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3650000000000003e-06 2024-09-13T05:11:51.513 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.513 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.513 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.513 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:131838 3.8 3.c3af3168 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e106)", 2024-09-13T05:11:51.513 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:51.270493+0000", 2024-09-13T05:11:51.514 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9995556, 2024-09-13T05:11:51.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045398180000000002, 2024-09-13T05:11:51.514 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.514 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:51.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.514 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 131838 2024-09-13T05:11:51.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.514 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270493+0000", 2024-09-13T05:11:51.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270493+0000", 2024-09-13T05:11:51.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270493+0000", 2024-09-13T05:11:51.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270495+0000", 2024-09-13T05:11:51.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8830000000000002e-06 2024-09-13T05:11:51.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270502+0000", 2024-09-13T05:11:51.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7050000000000002e-06 2024-09-13T05:11:51.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:51.270507+0000", 2024-09-13T05:11:51.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.288e-06 2024-09-13T05:11:51.516 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.516 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.516 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.516 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.517 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:11:51.517 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 68 2024-09-13T05:11:51.517 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:51.518 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:11:51.519 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:51.519 INFO:teuthology.orchestra.run.smithi120.stdout:4729 punch from 0x83fee3 to 0x84b995, (0xbab2 bytes) 2024-09-13T05:11:51.519 INFO:teuthology.orchestra.run.smithi120.stdout:4730 punch from 0x10b2229 to 0x10ba734, (0x850b bytes) 2024-09-13T05:11:51.520 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:51.520 INFO:teuthology.orchestra.run.smithi120.stdout:4734 trunc from 0x1409f91 to 0xe9b5717 2024-09-13T05:11:51.520 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:51.520 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:51.520 INFO:teuthology.orchestra.run.smithi120.stdout:4737 trunc from 0xe9b5717 to 0x9c1ee44 2024-09-13T05:11:51.520 INFO:teuthology.orchestra.run.smithi120.stdout:4739 trunc from 0x9c1ee44 to 0x1eeee18 2024-09-13T05:11:51.520 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:51.513+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:51.561 INFO:teuthology.orchestra.run.smithi120.stdout:4740 write 0xc408454 thru 0xc414750 (0xc2fd bytes) 2024-09-13T05:11:51.595 INFO:teuthology.orchestra.run.smithi120.stdout:4741 writesame 0xdaf996f thru 0xdb050d0 data_size 0x1(0xb762 bytes) 2024-09-13T05:11:51.595 INFO:teuthology.orchestra.run.smithi120.stdout:4742 write 0xd3fba36 thru 0xd4038b5 (0x7e80 bytes) 2024-09-13T05:11:51.619 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:51.613+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:51.622 INFO:teuthology.orchestra.run.smithi120.stdout:4743 punch from 0xd03d110 to 0xd04bd0d, (0xebfd bytes) 2024-09-13T05:11:51.622 INFO:teuthology.orchestra.run.smithi120.stdout:4745 writesame 0x417f057 thru 0x4186917 data_size 0x1(0x78c1 bytes) 2024-09-13T05:11:51.640 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:51.640 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:51.640 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:51.640 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:51.640 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:51.646 INFO:teuthology.orchestra.run.smithi120.stdout:4746 read 0x2f8951d thru 0x2f9380a (0xa2ee bytes) 2024-09-13T05:11:51.646 INFO:teuthology.orchestra.run.smithi120.stdout:4747 write 0x3e5771b thru 0x3e63bd2 (0xc4b8 bytes) 2024-09-13T05:11:51.651 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:11:51.668 INFO:teuthology.orchestra.run.smithi120.stdout:4749 read 0xc1cc34d thru 0xc1d3425 (0x70d9 bytes) 2024-09-13T05:11:51.679 INFO:teuthology.orchestra.run.smithi120.stdout:4750 write 0xe8e874a thru 0xe8f31de (0xaa95 bytes) 2024-09-13T05:11:51.701 INFO:teuthology.orchestra.run.smithi120.stdout:4753 read 0x6512d34 thru 0x651abdd (0x7eaa bytes) 2024-09-13T05:11:51.702 INFO:teuthology.orchestra.run.smithi120.stdout:4754 read 0x4294751 thru 0x4296cf1 (0x25a1 bytes) 2024-09-13T05:11:51.702 INFO:teuthology.orchestra.run.smithi120.stdout:4755 write 0x81ed585 thru 0x81fccb0 (0xf72c bytes) 2024-09-13T05:11:51.720 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:51.713+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:51.721 INFO:teuthology.orchestra.run.smithi120.stdout:4756 writesame 0x2ead9fa thru 0x2eb60bd data_size 0x73(0x86c4 bytes) 2024-09-13T05:11:51.741 INFO:teuthology.orchestra.run.smithi120.stdout:4757 write 0x771fdb6 thru 0x7721e7b (0x20c6 bytes) 2024-09-13T05:11:51.755 INFO:teuthology.orchestra.run.smithi120.stdout:4758 write 0x47dd70a thru 0x47e13f9 (0x3cf0 bytes) 2024-09-13T05:11:51.776 INFO:teuthology.orchestra.run.smithi120.stdout:4762 punch from 0x3493878 to 0x349efa1, (0xb729 bytes) 2024-09-13T05:11:51.776 INFO:teuthology.orchestra.run.smithi120.stdout:4764 write 0x2472b49 thru 0x247d3db (0xa893 bytes) 2024-09-13T05:11:51.792 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:51.792 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:51.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:51.792 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:51.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.792 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:70758 3.2 3:427d0469:::rbd_header.112d8d1317eb:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-13T05:11:51.792 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:11:51.792 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.361233318, 2024-09-13T05:11:51.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.190313603, 2024-09-13T05:11:51.793 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.793 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.793 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.793 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.793 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.793 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70758 2024-09-13T05:11:51.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.793 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:11:51.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:11:51.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428654+0000", 2024-09-13T05:11:51.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:51.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428664+0000", 2024-09-13T05:11:51.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0664e-05 2024-09-13T05:11:51.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428683+0000", 2024-09-13T05:11:51.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8377e-05 2024-09-13T05:11:51.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428691+0000", 2024-09-13T05:11:51.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9400000000000008e-06 2024-09-13T05:11:51.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428789+0000", 2024-09-13T05:11:51.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7165999999999998e-05 2024-09-13T05:11:51.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:51.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428811+0000", 2024-09-13T05:11:51.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1925000000000001e-05 2024-09-13T05:11:51.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.617921+0000", 2024-09-13T05:11:51.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.189110536 2024-09-13T05:11:51.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618344+0000", 2024-09-13T05:11:51.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042245800000000001 2024-09-13T05:11:51.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618969+0000", 2024-09-13T05:11:51.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062529299999999996 2024-09-13T05:11:51.797 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.797 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.797 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.797 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88613 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 16086016~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:51.798 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.157587+0000", 2024-09-13T05:11:51.798 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.6323020689999996, 2024-09-13T05:11:51.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058449474000000001, 2024-09-13T05:11:51.798 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.798 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.798 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.798 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.798 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.798 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88613 2024-09-13T05:11:51.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.798 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.157587+0000", 2024-09-13T05:11:51.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.157587+0000", 2024-09-13T05:11:51.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.157586+0000", 2024-09-13T05:11:51.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.157589+0000", 2024-09-13T05:11:51.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7039999999999999e-06 2024-09-13T05:11:51.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.157596+0000", 2024-09-13T05:11:51.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.622e-06 2024-09-13T05:11:51.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.157601+0000", 2024-09-13T05:11:51.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6149999999999999e-06 2024-09-13T05:11:51.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.215839+0000", 2024-09-13T05:11:51.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058238189000000003 2024-09-13T05:11:51.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.215947+0000", 2024-09-13T05:11:51.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107877 2024-09-13T05:11:51.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.216036+0000", 2024-09-13T05:11:51.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8979000000000003e-05 2024-09-13T05:11:51.802 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.802 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.802 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.802 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88630 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12646400~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:51.802 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.161326+0000", 2024-09-13T05:11:51.802 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.6285627849999997, 2024-09-13T05:11:51.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058271943999999999, 2024-09-13T05:11:51.802 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.802 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88630 2024-09-13T05:11:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161326+0000", 2024-09-13T05:11:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161326+0000", 2024-09-13T05:11:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161326+0000", 2024-09-13T05:11:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161328+0000", 2024-09-13T05:11:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0099999999999998e-06 2024-09-13T05:11:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161331+0000", 2024-09-13T05:11:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7450000000000001e-06 2024-09-13T05:11:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161335+0000", 2024-09-13T05:11:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.495e-06 2024-09-13T05:11:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.219395+0000", 2024-09-13T05:11:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058060575000000003 2024-09-13T05:11:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.219502+0000", 2024-09-13T05:11:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010689200000000001 2024-09-13T05:11:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.219598+0000", 2024-09-13T05:11:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5518000000000003e-05 2024-09-13T05:11:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88631 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12660736~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.161338+0000", 2024-09-13T05:11:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.6285508879999995, 2024-09-13T05:11:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058501347000000002, 2024-09-13T05:11:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88631 2024-09-13T05:11:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161338+0000", 2024-09-13T05:11:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161338+0000", 2024-09-13T05:11:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161337+0000", 2024-09-13T05:11:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161339+0000", 2024-09-13T05:11:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9570000000000001e-06 2024-09-13T05:11:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161343+0000", 2024-09-13T05:11:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7400000000000002e-06 2024-09-13T05:11:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161346+0000", 2024-09-13T05:11:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3330000000000001e-06 2024-09-13T05:11:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.219706+0000", 2024-09-13T05:11:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058359837999999997 2024-09-13T05:11:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.219782+0000", 2024-09-13T05:11:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5714e-05 2024-09-13T05:11:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.219839+0000", 2024-09-13T05:11:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7061000000000001e-05 2024-09-13T05:11:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88632 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12675072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.161370+0000", 2024-09-13T05:11:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.6285184400000006, 2024-09-13T05:11:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058612957, 2024-09-13T05:11:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88632 2024-09-13T05:11:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161370+0000", 2024-09-13T05:11:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161370+0000", 2024-09-13T05:11:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161370+0000", 2024-09-13T05:11:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161372+0000", 2024-09-13T05:11:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2730000000000001e-06 2024-09-13T05:11:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161376+0000", 2024-09-13T05:11:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1710000000000004e-06 2024-09-13T05:11:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161380+0000", 2024-09-13T05:11:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6830000000000001e-06 2024-09-13T05:11:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.219867+0000", 2024-09-13T05:11:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058487329999999997 2024-09-13T05:11:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.219927+0000", 2024-09-13T05:11:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0256e-05 2024-09-13T05:11:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.219983+0000", 2024-09-13T05:11:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5717000000000002e-05 2024-09-13T05:11:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88633 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12689408~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.161383+0000", 2024-09-13T05:11:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.6285056329999996, 2024-09-13T05:11:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058808522000000002, 2024-09-13T05:11:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88633 2024-09-13T05:11:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161383+0000", 2024-09-13T05:11:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161383+0000", 2024-09-13T05:11:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161383+0000", 2024-09-13T05:11:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161385+0000", 2024-09-13T05:11:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9539999999999998e-06 2024-09-13T05:11:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161388+0000", 2024-09-13T05:11:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7500000000000001e-06 2024-09-13T05:11:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161392+0000", 2024-09-13T05:11:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4479999999999999e-06 2024-09-13T05:11:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.220027+0000", 2024-09-13T05:11:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058635442000000003 2024-09-13T05:11:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.220113+0000", 2024-09-13T05:11:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5809999999999993e-05 2024-09-13T05:11:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.220191+0000", 2024-09-13T05:11:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8515000000000003e-05 2024-09-13T05:11:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88634 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12703744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.161395+0000", 2024-09-13T05:11:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.6284931310000008, 2024-09-13T05:11:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058939760000000001, 2024-09-13T05:11:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88634 2024-09-13T05:11:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161395+0000", 2024-09-13T05:11:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161395+0000", 2024-09-13T05:11:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161395+0000", 2024-09-13T05:11:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161397+0000", 2024-09-13T05:11:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.855e-06 2024-09-13T05:11:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161401+0000", 2024-09-13T05:11:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6830000000000001e-06 2024-09-13T05:11:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161404+0000", 2024-09-13T05:11:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3210000000000001e-06 2024-09-13T05:11:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.220237+0000", 2024-09-13T05:11:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058832607000000002 2024-09-13T05:11:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.220290+0000", 2024-09-13T05:11:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3650999999999998e-05 2024-09-13T05:11:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.220335+0000", 2024-09-13T05:11:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4938000000000002e-05 2024-09-13T05:11:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88635 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12718080~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.161407+0000", 2024-09-13T05:11:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.6284813939999996, 2024-09-13T05:11:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059130823999999998, 2024-09-13T05:11:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88635 2024-09-13T05:11:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161407+0000", 2024-09-13T05:11:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161407+0000", 2024-09-13T05:11:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161407+0000", 2024-09-13T05:11:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161409+0000", 2024-09-13T05:11:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.885e-06 2024-09-13T05:11:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161412+0000", 2024-09-13T05:11:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6950000000000002e-06 2024-09-13T05:11:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161416+0000", 2024-09-13T05:11:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.467e-06 2024-09-13T05:11:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.220375+0000", 2024-09-13T05:11:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058958695999999998 2024-09-13T05:11:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.220462+0000", 2024-09-13T05:11:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7378000000000003e-05 2024-09-13T05:11:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.220538+0000", 2024-09-13T05:11:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5995999999999995e-05 2024-09-13T05:11:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88636 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12732416~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.161419+0000", 2024-09-13T05:11:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.6284697769999994, 2024-09-13T05:11:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059241000000000002, 2024-09-13T05:11:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88636 2024-09-13T05:11:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161419+0000", 2024-09-13T05:11:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161419+0000", 2024-09-13T05:11:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161419+0000", 2024-09-13T05:11:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161420+0000", 2024-09-13T05:11:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8610000000000001e-06 2024-09-13T05:11:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161424+0000", 2024-09-13T05:11:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.76e-06 2024-09-13T05:11:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161428+0000", 2024-09-13T05:11:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.41e-06 2024-09-13T05:11:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.220554+0000", 2024-09-13T05:11:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059126744000000002 2024-09-13T05:11:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.220604+0000", 2024-09-13T05:11:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9830999999999998e-05 2024-09-13T05:11:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.220660+0000", 2024-09-13T05:11:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5695000000000001e-05 2024-09-13T05:11:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88637 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12746752~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.161431+0000", 2024-09-13T05:11:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.6284580769999994, 2024-09-13T05:11:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060093617000000002, 2024-09-13T05:11:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88637 2024-09-13T05:11:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161431+0000", 2024-09-13T05:11:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161431+0000", 2024-09-13T05:11:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161430+0000", 2024-09-13T05:11:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161432+0000", 2024-09-13T05:11:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8560000000000001e-06 2024-09-13T05:11:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161436+0000", 2024-09-13T05:11:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6710000000000001e-06 2024-09-13T05:11:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161439+0000", 2024-09-13T05:11:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1999999999999999e-06 2024-09-13T05:11:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.221064+0000", 2024-09-13T05:11:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059625154 2024-09-13T05:11:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.221266+0000", 2024-09-13T05:11:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020158400000000001 2024-09-13T05:11:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.221524+0000", 2024-09-13T05:11:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025845099999999998 2024-09-13T05:11:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88638 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12761088~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.161444+0000", 2024-09-13T05:11:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.6284447950000001, 2024-09-13T05:11:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060254165999999998, 2024-09-13T05:11:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88638 2024-09-13T05:11:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161444+0000", 2024-09-13T05:11:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161444+0000", 2024-09-13T05:11:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161443+0000", 2024-09-13T05:11:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161446+0000", 2024-09-13T05:11:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0389999999999999e-06 2024-09-13T05:11:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161449+0000", 2024-09-13T05:11:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.687e-06 2024-09-13T05:11:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161452+0000", 2024-09-13T05:11:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0800000000000002e-06 2024-09-13T05:11:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.221552+0000", 2024-09-13T05:11:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060099695000000002 2024-09-13T05:11:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.221630+0000", 2024-09-13T05:11:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7795999999999999e-05 2024-09-13T05:11:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.221698+0000", 2024-09-13T05:11:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8189999999999996e-05 2024-09-13T05:11:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88639 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12775424~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.161478+0000", 2024-09-13T05:11:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.6284101110000009, 2024-09-13T05:11:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060598694000000002, 2024-09-13T05:11:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88639 2024-09-13T05:11:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161478+0000", 2024-09-13T05:11:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161478+0000", 2024-09-13T05:11:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161478+0000", 2024-09-13T05:11:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161480+0000", 2024-09-13T05:11:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1679999999999998e-06 2024-09-13T05:11:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161484+0000", 2024-09-13T05:11:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1649999999999999e-06 2024-09-13T05:11:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161488+0000", 2024-09-13T05:11:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5250000000000001e-06 2024-09-13T05:11:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.221750+0000", 2024-09-13T05:11:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060262201000000001 2024-09-13T05:11:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.221886+0000", 2024-09-13T05:11:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013624899999999999 2024-09-13T05:11:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.222077+0000", 2024-09-13T05:11:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000190853 2024-09-13T05:11:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88640 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12789760~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.161491+0000", 2024-09-13T05:11:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.6283974909999994, 2024-09-13T05:11:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060722693000000001, 2024-09-13T05:11:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88640 2024-09-13T05:11:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161491+0000", 2024-09-13T05:11:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161491+0000", 2024-09-13T05:11:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161491+0000", 2024-09-13T05:11:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161493+0000", 2024-09-13T05:11:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0899999999999999e-06 2024-09-13T05:11:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161497+0000", 2024-09-13T05:11:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:11:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.161500+0000", 2024-09-13T05:11:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3100000000000001e-06 2024-09-13T05:11:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.222104+0000", 2024-09-13T05:11:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.060604191000000002 2024-09-13T05:11:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.222166+0000", 2024-09-13T05:11:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2127999999999999e-05 2024-09-13T05:11:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.222214+0000", 2024-09-13T05:11:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7527000000000001e-05 2024-09-13T05:11:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88650 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12918784~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.165303+0000", 2024-09-13T05:11:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.6245851699999996, 2024-09-13T05:11:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058396485999999997, 2024-09-13T05:11:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88650 2024-09-13T05:11:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165303+0000", 2024-09-13T05:11:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165303+0000", 2024-09-13T05:11:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165303+0000", 2024-09-13T05:11:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165305+0000", 2024-09-13T05:11:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0150000000000002e-06 2024-09-13T05:11:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165309+0000", 2024-09-13T05:11:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0489999999999997e-06 2024-09-13T05:11:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165313+0000", 2024-09-13T05:11:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6030000000000001e-06 2024-09-13T05:11:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.223555+0000", 2024-09-13T05:11:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058242467999999999 2024-09-13T05:11:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.223638+0000", 2024-09-13T05:11:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3227999999999997e-05 2024-09-13T05:11:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.223700+0000", 2024-09-13T05:11:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1427000000000007e-05 2024-09-13T05:11:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88651 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12933120~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.165317+0000", 2024-09-13T05:11:51.854 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.6245715099999991, 2024-09-13T05:11:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058511328000000001, 2024-09-13T05:11:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88651 2024-09-13T05:11:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165317+0000", 2024-09-13T05:11:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165317+0000", 2024-09-13T05:11:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165317+0000", 2024-09-13T05:11:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165319+0000", 2024-09-13T05:11:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1050000000000002e-06 2024-09-13T05:11:51.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165323+0000", 2024-09-13T05:11:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0049999999999998e-06 2024-09-13T05:11:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165326+0000", 2024-09-13T05:11:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6169999999999998e-06 2024-09-13T05:11:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.223737+0000", 2024-09-13T05:11:51.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058410713000000003 2024-09-13T05:11:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.223786+0000", 2024-09-13T05:11:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8636e-05 2024-09-13T05:11:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.223828+0000", 2024-09-13T05:11:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2561999999999997e-05 2024-09-13T05:11:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88652 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12947456~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.165330+0000", 2024-09-13T05:11:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.6245589519999992, 2024-09-13T05:11:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058688487999999997, 2024-09-13T05:11:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88652 2024-09-13T05:11:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165330+0000", 2024-09-13T05:11:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165330+0000", 2024-09-13T05:11:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165329+0000", 2024-09-13T05:11:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165331+0000", 2024-09-13T05:11:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9599999999999999e-06 2024-09-13T05:11:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165336+0000", 2024-09-13T05:11:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.69e-06 2024-09-13T05:11:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165340+0000", 2024-09-13T05:11:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8229999999999997e-06 2024-09-13T05:11:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.223876+0000", 2024-09-13T05:11:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058535996 2024-09-13T05:11:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.223958+0000", 2024-09-13T05:11:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1939000000000003e-05 2024-09-13T05:11:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.224018+0000", 2024-09-13T05:11:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0439999999999997e-05 2024-09-13T05:11:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88653 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12961792~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.165343+0000", 2024-09-13T05:11:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.6245453390000009, 2024-09-13T05:11:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058803240999999999, 2024-09-13T05:11:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.863 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88653 2024-09-13T05:11:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165343+0000", 2024-09-13T05:11:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165343+0000", 2024-09-13T05:11:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165343+0000", 2024-09-13T05:11:51.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165345+0000", 2024-09-13T05:11:51.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0559999999999999e-06 2024-09-13T05:11:51.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165349+0000", 2024-09-13T05:11:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8800000000000001e-06 2024-09-13T05:11:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165352+0000", 2024-09-13T05:11:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.597e-06 2024-09-13T05:11:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.224048+0000", 2024-09-13T05:11:51.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058695863000000001 2024-09-13T05:11:51.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.224103+0000", 2024-09-13T05:11:51.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4945999999999999e-05 2024-09-13T05:11:51.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.224146+0000", 2024-09-13T05:11:51.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3401e-05 2024-09-13T05:11:51.867 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88654 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12976128~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.165371+0000", 2024-09-13T05:11:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.6245179590000003, 2024-09-13T05:11:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058967203000000003, 2024-09-13T05:11:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88654 2024-09-13T05:11:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165371+0000", 2024-09-13T05:11:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165371+0000", 2024-09-13T05:11:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165370+0000", 2024-09-13T05:11:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165375+0000", 2024-09-13T05:11:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0490000000000003e-06 2024-09-13T05:11:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165380+0000", 2024-09-13T05:11:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5410000000000002e-06 2024-09-13T05:11:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165384+0000", 2024-09-13T05:11:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9140000000000001e-06 2024-09-13T05:11:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.224192+0000", 2024-09-13T05:11:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058807922999999998 2024-09-13T05:11:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.224277+0000", 2024-09-13T05:11:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4955000000000002e-05 2024-09-13T05:11:51.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.224338+0000", 2024-09-13T05:11:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1174999999999996e-05 2024-09-13T05:11:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:88655 3.19 3:99a5ff50:::rbd_data.112d52e08ead.0000000000000006:27 [read 12990464~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e100)", 2024-09-13T05:11:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:43.165387+0000", 2024-09-13T05:11:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.6245014760000007, 2024-09-13T05:11:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.059082956999999998, 2024-09-13T05:11:51.872 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 88655 2024-09-13T05:11:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165387+0000", 2024-09-13T05:11:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165387+0000", 2024-09-13T05:11:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165387+0000", 2024-09-13T05:11:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165389+0000", 2024-09-13T05:11:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.137e-06 2024-09-13T05:11:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165393+0000", 2024-09-13T05:11:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9419999999999997e-06 2024-09-13T05:11:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.165397+0000", 2024-09-13T05:11:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8290000000000001e-06 2024-09-13T05:11:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.224372+0000", 2024-09-13T05:11:51.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058974811000000002 2024-09-13T05:11:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.224428+0000", 2024-09-13T05:11:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6138999999999999e-05 2024-09-13T05:11:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:43.224470+0000", 2024-09-13T05:11:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2401999999999998e-05 2024-09-13T05:11:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:123632 3.1e 3:7b4f3c89:::rbd_data.112d52e08ead.0000000000000007:27 [read 6029312~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e105)", 2024-09-13T05:11:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:49.331243+0000", 2024-09-13T05:11:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.4586451130000002, 2024-09-13T05:11:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058343304999999998, 2024-09-13T05:11:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 123632 2024-09-13T05:11:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:51.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:49.331243+0000", 2024-09-13T05:11:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:49.331243+0000", 2024-09-13T05:11:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:49.331243+0000", 2024-09-13T05:11:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:51.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:49.331245+0000", 2024-09-13T05:11:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2740000000000002e-06 2024-09-13T05:11:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:49.331249+0000", 2024-09-13T05:11:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9670000000000003e-06 2024-09-13T05:11:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:49.331253+0000", 2024-09-13T05:11:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5389999999999999e-06 2024-09-13T05:11:51.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:49.389468+0000", 2024-09-13T05:11:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.058214983999999997 2024-09-13T05:11:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:49.389537+0000", 2024-09-13T05:11:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9379000000000001e-05 2024-09-13T05:11:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:51.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:49.389587+0000", 2024-09-13T05:11:51.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9691999999999998e-05 2024-09-13T05:11:51.881 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.881 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.881 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.881 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:51.881 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:51.881 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:51.882 INFO:teuthology.orchestra.run.smithi120.stdout:4765 writesame 0x27dfd27 thru 0x27ec538 data_size 0x1(0xc812 bytes) 2024-09-13T05:11:51.883 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:11:51.884 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is unset 2024-09-13T05:11:51.884 INFO:teuthology.orchestra.run.smithi120.stdout:4767 trunc from 0xe8f31df to 0x1e7e5f5 2024-09-13T05:11:51.884 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:51.880+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:51.916 INFO:teuthology.orchestra.run.smithi120.stdout:4768 write 0x50befd2 thru 0x50c2999 (0x39c8 bytes) 2024-09-13T05:11:51.941 INFO:teuthology.orchestra.run.smithi120.stdout:4769 write 0x3e92ac1 thru 0x3e95b8e (0x30ce bytes) 2024-09-13T05:11:51.982 INFO:teuthology.orchestra.run.smithi120.stdout:4770 write 0x8c02c08 thru 0x8c0f696 (0xca8f bytes) 2024-09-13T05:11:51.982 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:51.980+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:51.997 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:51.997 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:51.997 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:11:51.997 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:52.008 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:11:52.017 INFO:teuthology.orchestra.run.smithi120.stdout:4772 trunc from 0x8c0f697 to 0xb283bfe 2024-09-13T05:11:52.026 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:52.026 INFO:teuthology.orchestra.run.smithi120.stdout:4775 write 0x3a57521 thru 0x3a6545d (0xdf3d bytes) 2024-09-13T05:11:52.057 INFO:teuthology.orchestra.run.smithi120.stdout:4776 writesame 0x57a5a4e thru 0x57a9db8 data_size 0xb(0x436b bytes) 2024-09-13T05:11:52.081 INFO:teuthology.orchestra.run.smithi120.stdout:4777 write 0x6e71e3f thru 0x6e7ceec (0xb0ae bytes) 2024-09-13T05:11:52.083 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:52.080+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:52.118 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:52.119 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:52.119 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:52.119 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:52.119 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:52.121 INFO:teuthology.orchestra.run.smithi120.stdout:4779 write 0xd6c8340 thru 0xd6d52df (0xcfa0 bytes) 2024-09-13T05:11:52.129 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:11:52.145 INFO:teuthology.orchestra.run.smithi120.stdout:4780 punch from 0x5e15900 to 0x5e19ae5, (0x41e5 bytes) 2024-09-13T05:11:52.145 INFO:teuthology.orchestra.run.smithi120.stdout:4782 write 0x70cea42 thru 0x70cee17 (0x3d6 bytes) 2024-09-13T05:11:52.150 INFO:teuthology.orchestra.run.smithi120.stdout:4783 writesame 0x2a170c3 thru 0x2a21075 data_size 0x1(0x9fb3 bytes) 2024-09-13T05:11:52.175 INFO:teuthology.orchestra.run.smithi120.stdout:4784 writesame 0xadca201 thru 0xadd458c data_size 0x12(0xa38c bytes) 2024-09-13T05:11:52.184 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:52.180+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:52.199 INFO:teuthology.orchestra.run.smithi120.stdout:4785 write 0x9b3171e thru 0x9b39d5a (0x863d bytes) 2024-09-13T05:11:52.222 INFO:teuthology.orchestra.run.smithi120.stdout:4786 punch from 0xd4fe44 to 0xd5b62d, (0xb7e9 bytes) 2024-09-13T05:11:52.222 INFO:teuthology.orchestra.run.smithi120.stdout:4787 write 0x3a3b22b thru 0x3a3b5b5 (0x38b bytes) 2024-09-13T05:11:52.224 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:52.224 INFO:teuthology.orchestra.run.smithi120.stdout:4792 writesame 0x7fa775f thru 0x7fb3f48 data_size 0x1(0xc7ea bytes) 2024-09-13T05:11:52.244 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:52.245 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:52.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:52.245 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [] 2024-09-13T05:11:52.245 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:52.254 INFO:teuthology.orchestra.run.smithi120.stdout:4795 read 0xd402732 thru 0xd40cef8 (0xa7c7 bytes) 2024-09-13T05:11:52.254 INFO:teuthology.orchestra.run.smithi120.stdout:4796 writesame 0x123977 thru 0x12554e data_size 0x24(0x1bd8 bytes) 2024-09-13T05:11:52.256 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:11:52.259 INFO:teuthology.orchestra.run.smithi120.stdout:4797 punch from 0x423865 to 0x429f82, (0x671d bytes) 2024-09-13T05:11:52.260 INFO:teuthology.orchestra.run.smithi120.stdout:4798 write 0x8bdf7ea thru 0x8be925e (0x9a75 bytes) 2024-09-13T05:11:52.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-13T05:11:52.286 INFO:teuthology.orchestra.run.smithi120.stdout:4799 punch from 0x2244acd to 0x224cfb0, (0x84e3 bytes) 2024-09-13T05:11:52.286 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:52.286 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:52.286 INFO:teuthology.orchestra.run.smithi120.stdout:4804 read 0xcd6a824 thru 0xcd7704a (0xc827 bytes) 2024-09-13T05:11:52.286 INFO:teuthology.orchestra.run.smithi120.stdout:4806 read 0xb59a767 thru 0xb5a1b51 (0x73eb bytes) 2024-09-13T05:11:52.286 INFO:teuthology.orchestra.run.smithi120.stdout:4807 punch from 0x156a88d to 0x156e16c, (0x38df bytes) 2024-09-13T05:11:52.286 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:52.286 INFO:teuthology.orchestra.run.smithi120.stdout:4811 writesame 0x95cc949 thru 0x95d4a45 data_size 0x9(0x80fd bytes) 2024-09-13T05:11:52.305 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:52.301+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:52.311 INFO:teuthology.orchestra.run.smithi120.stdout:4812 read 0x4d6546f thru 0x4d68b73 (0x3705 bytes) 2024-09-13T05:11:52.312 INFO:teuthology.orchestra.run.smithi120.stdout:4814 punch from 0x8b2f28f to 0x8b302de, (0x104f bytes) 2024-09-13T05:11:52.319 INFO:teuthology.orchestra.run.smithi120.stdout:4816 writesame 0xd7ec0bd thru 0xd7ee986 data_size 0x2(0x28ca bytes) 2024-09-13T05:11:52.323 INFO:teuthology.orchestra.run.smithi120.stdout:4817 write 0xb3fc3b3 thru 0xb408fc3 (0xcc11 bytes) 2024-09-13T05:11:52.353 INFO:teuthology.orchestra.run.smithi120.stdout:4818 write 0x3772b56 thru 0x3782255 (0xf700 bytes) 2024-09-13T05:11:52.375 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:52.376 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:52.376 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.376 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:133886 3.5 3:a3541d05:::rbd_data.112dbd21872d.00000000000000df:head [set-alloc-hint object_size 262144 write_size 262144,write 220160~5120 in=5120b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:52.376 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:52.373963+0000", 2024-09-13T05:11:52.376 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.00071386699999999997, 2024-09-13T05:11:52.376 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00075117599999999999, 2024-09-13T05:11:52.376 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:52.376 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "waiting for sub ops", 2024-09-13T05:11:52.376 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:52.376 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:52.376 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:52.377 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 133886 2024-09-13T05:11:52.377 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.377 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:52.377 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.377 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:52.377 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:52.373963+0000", 2024-09-13T05:11:52.377 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.377 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.377 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.377 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:52.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:52.373963+0000", 2024-09-13T05:11:52.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:52.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:52.373961+0000", 2024-09-13T05:11:52.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:52.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:52.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:52.373972+0000", 2024-09-13T05:11:52.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0485e-05 2024-09-13T05:11:52.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:52.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:52.373984+0000", 2024-09-13T05:11:52.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2651e-05 2024-09-13T05:11:52.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:52.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:52.373990+0000", 2024-09-13T05:11:52.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7429999999999999e-06 2024-09-13T05:11:52.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.380 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.380 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:52.374033+0000", 2024-09-13T05:11:52.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3099999999999997e-05 2024-09-13T05:11:52.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.380 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:52.380 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:52.374082+0000", 2024-09-13T05:11:52.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9166000000000003e-05 2024-09-13T05:11:52.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.380 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 3", 2024-09-13T05:11:52.381 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:52.374173+0000", 2024-09-13T05:11:52.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0459999999999998e-05 2024-09-13T05:11:52.381 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.381 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:52.381 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.381 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:133885 3.d e107/86 3:b39dfa20:::rbd_data.112dbd21872d.00000000000000de:head v 107'611, mlcod=107'609)", 2024-09-13T05:11:52.381 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:52.374149+0000", 2024-09-13T05:11:52.382 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.00052762200000000005, 2024-09-13T05:11:52.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00067737099999999996, 2024-09-13T05:11:52.382 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:52.382 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:52.382 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:52.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:52.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:52.374149+0000", 2024-09-13T05:11:52.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:52.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:52.374149+0000", 2024-09-13T05:11:52.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:52.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:52.374148+0000", 2024-09-13T05:11:52.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:52.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:52.384 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:52.374159+0000", 2024-09-13T05:11:52.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0818999999999999e-05 2024-09-13T05:11:52.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.384 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:52.384 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:52.374170+0000", 2024-09-13T05:11:52.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0445000000000001e-05 2024-09-13T05:11:52.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.384 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:52.384 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:52.374175+0000", 2024-09-13T05:11:52.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7559999999999996e-06 2024-09-13T05:11:52.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:52.374212+0000", 2024-09-13T05:11:52.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6646000000000001e-05 2024-09-13T05:11:52.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:52.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:52.374231+0000", 2024-09-13T05:11:52.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8742000000000001e-05 2024-09-13T05:11:52.386 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.386 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:52.386 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.386 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.386 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-09-13T05:11:52.386 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 2 2024-09-13T05:11:52.386 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:52.388 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:11:52.388 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:52.381+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:52.389 INFO:teuthology.orchestra.run.smithi120.stdout:4819 trunc from 0xd7ee987 to 0x74762d0 2024-09-13T05:11:52.433 INFO:teuthology.orchestra.run.smithi120.stdout:4820 write 0x10f8724 thru 0x110084b (0x8128 bytes) 2024-09-13T05:11:52.488 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:52.481+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:52.496 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:52.496 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:52.496 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:52.496 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:52.496 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:52.506 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:11:52.590 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:52.585+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:52.612 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:52.612 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:52.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:52.613 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:52.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.613 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3.bb1d1096 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:11:52.613 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:11:52.613 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.665101561, 2024-09-13T05:11:52.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68834410099999999, 2024-09-13T05:11:52.613 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:52.613 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:52.613 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:52.613 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:52.613 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:52.613 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:11:52.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.614 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:52.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:52.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:11:52.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:52.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:11:52.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:52.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943719+0000", 2024-09-13T05:11:52.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:11:52.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:52.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943734+0000", 2024-09-13T05:11:52.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4793e-05 2024-09-13T05:11:52.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:52.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943765+0000", 2024-09-13T05:11:52.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0648999999999997e-05 2024-09-13T05:11:52.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:52.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943779+0000", 2024-09-13T05:11:52.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.447e-05 2024-09-13T05:11:52.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943872+0000", 2024-09-13T05:11:52.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3304e-05 2024-09-13T05:11:52.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:52.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943884+0000", 2024-09-13T05:11:52.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.167e-05 2024-09-13T05:11:52.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632042+0000", 2024-09-13T05:11:52.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68815832600000004 2024-09-13T05:11:52.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:52.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632066+0000", 2024-09-13T05:11:52.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3765999999999999e-05 2024-09-13T05:11:52.617 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.617 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:52.618 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.618 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3.b6bd6256 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:11:52.618 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:11:52.618 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.664977060999998, 2024-09-13T05:11:52.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68852592499999998, 2024-09-13T05:11:52.618 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:52.618 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:52.618 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:52.618 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:52.618 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:52.618 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:11:52.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.619 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:52.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:52.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:11:52.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:52.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:11:52.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943846+0000", 2024-09-13T05:11:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943852+0000", 2024-09-13T05:11:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3820000000000001e-06 2024-09-13T05:11:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943876+0000", 2024-09-13T05:11:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3995e-05 2024-09-13T05:11:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943898+0000", 2024-09-13T05:11:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1838999999999999e-05 2024-09-13T05:11:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946457+0000", 2024-09-13T05:11:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025588910000000002 2024-09-13T05:11:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946499+0000", 2024-09-13T05:11:52.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2814e-05 2024-09-13T05:11:52.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632364+0000", 2024-09-13T05:11:52.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68586484999999997 2024-09-13T05:11:52.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632372+0000", 2024-09-13T05:11:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1659999999999994e-06 2024-09-13T05:11:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3:6908b8dd:::rbd_data.112d8d1317eb.000000000000000f:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:11:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:11:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.627832983000001, 2024-09-13T05:11:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65181049499999999, 2024-09-13T05:11:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:11:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:11:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:11:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980989+0000", 2024-09-13T05:11:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980996+0000", 2024-09-13T05:11:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2200000000000003e-06 2024-09-13T05:11:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981011+0000", 2024-09-13T05:11:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4997000000000001e-05 2024-09-13T05:11:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981025+0000", 2024-09-13T05:11:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3604000000000001e-05 2024-09-13T05:11:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981110+0000", 2024-09-13T05:11:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4948000000000001e-05 2024-09-13T05:11:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981120+0000", 2024-09-13T05:11:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9399999999999997e-06 2024-09-13T05:11:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.628 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632425+0000", 2024-09-13T05:11:52.628 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65130460499999998 2024-09-13T05:11:52.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.628 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:52.628 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632587+0000", 2024-09-13T05:11:52.628 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016199500000000001 2024-09-13T05:11:52.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.628 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:52.628 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632801+0000", 2024-09-13T05:11:52.628 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021459499999999999 2024-09-13T05:11:52.629 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.629 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:52.629 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.629 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3:6a46bd6d:::rbd_data.112d8d1317eb.0000000000000010:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:11:52.629 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:11:52.629 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.627775326999998, 2024-09-13T05:11:52.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65213695699999996, 2024-09-13T05:11:52.629 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:52.629 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:52.629 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:52.629 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:52.630 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:52.630 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:11:52.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.630 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:52.630 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.630 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:52.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:11:52.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.630 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.630 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:52.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:11:52.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.631 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.631 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:52.631 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:11:52.631 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:52.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.631 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.631 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:52.631 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981052+0000", 2024-09-13T05:11:52.631 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4469999999999999e-06 2024-09-13T05:11:52.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.631 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.631 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:52.632 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981066+0000", 2024-09-13T05:11:52.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3658e-05 2024-09-13T05:11:52.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.632 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:52.632 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981073+0000", 2024-09-13T05:11:52.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:11:52.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.632 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.632 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981150+0000", 2024-09-13T05:11:52.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7783999999999999e-05 2024-09-13T05:11:52.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.633 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:52.633 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981161+0000", 2024-09-13T05:11:52.633 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0197000000000001e-05 2024-09-13T05:11:52.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.633 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.633 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632926+0000", 2024-09-13T05:11:52.633 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65176517300000003 2024-09-13T05:11:52.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.633 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:52.633 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633081+0000", 2024-09-13T05:11:52.633 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000155172 2024-09-13T05:11:52.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.634 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:52.634 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633185+0000", 2024-09-13T05:11:52.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000104329 2024-09-13T05:11:52.634 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.634 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:52.634 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.634 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118368 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 2806784~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:52.634 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.389513+0000", 2024-09-13T05:11:52.634 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.2193102290000004, 2024-09-13T05:11:52.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059680972999999998, 2024-09-13T05:11:52.635 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:52.635 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:52.635 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:52.635 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:52.635 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:52.635 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118368 2024-09-13T05:11:52.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.635 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:52.635 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.635 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:52.635 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389513+0000", 2024-09-13T05:11:52.635 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.636 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.636 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.636 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:52.636 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389513+0000", 2024-09-13T05:11:52.636 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.636 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.636 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.636 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:52.636 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389513+0000", 2024-09-13T05:11:52.636 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:52.636 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.636 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.636 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:52.637 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389515+0000", 2024-09-13T05:11:52.637 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3949999999999999e-06 2024-09-13T05:11:52.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.637 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.637 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:52.637 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389523+0000", 2024-09-13T05:11:52.637 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2139999999999999e-06 2024-09-13T05:11:52.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.637 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.637 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:52.637 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389528+0000", 2024-09-13T05:11:52.637 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0209999999999999e-06 2024-09-13T05:11:52.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449026+0000", 2024-09-13T05:11:52.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059498589999999997 2024-09-13T05:11:52.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:52.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449108+0000", 2024-09-13T05:11:52.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1488000000000003e-05 2024-09-13T05:11:52.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:52.639 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449194+0000", 2024-09-13T05:11:52.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6645999999999997e-05 2024-09-13T05:11:52.639 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.639 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:52.639 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.639 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.639 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118369 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 2821120~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:52.639 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.389532+0000", 2024-09-13T05:11:52.639 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.2192917589999999, 2024-09-13T05:11:52.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059952904000000001, 2024-09-13T05:11:52.639 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:52.639 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:52.640 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:52.640 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:52.640 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:52.640 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118369 2024-09-13T05:11:52.640 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.640 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:52.640 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.640 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:52.640 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389532+0000", 2024-09-13T05:11:52.640 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.640 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.640 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.640 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:52.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389532+0000", 2024-09-13T05:11:52.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:52.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389532+0000", 2024-09-13T05:11:52.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:52.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:52.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389534+0000", 2024-09-13T05:11:52.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.615e-06 2024-09-13T05:11:52.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.642 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:52.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389540+0000", 2024-09-13T05:11:52.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5969999999999999e-06 2024-09-13T05:11:52.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.642 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:52.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389544+0000", 2024-09-13T05:11:52.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5580000000000002e-06 2024-09-13T05:11:52.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.642 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449254+0000", 2024-09-13T05:11:52.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059709275999999999 2024-09-13T05:11:52.643 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.643 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.643 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:52.643 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449348+0000", 2024-09-13T05:11:52.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4812e-05 2024-09-13T05:11:52.643 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.643 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.643 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:52.643 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449485+0000", 2024-09-13T05:11:52.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000136382 2024-09-13T05:11:52.643 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.643 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:52.643 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.644 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.644 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118370 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 2835456~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:52.644 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.389549+0000", 2024-09-13T05:11:52.644 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.2192747839999996, 2024-09-13T05:11:52.644 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060184400999999998, 2024-09-13T05:11:52.644 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:52.644 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:52.644 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:52.644 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:52.644 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:52.644 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118370 2024-09-13T05:11:52.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.645 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:52.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.645 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:52.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389549+0000", 2024-09-13T05:11:52.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.645 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:52.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389549+0000", 2024-09-13T05:11:52.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.646 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:52.646 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389548+0000", 2024-09-13T05:11:52.646 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:52.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.646 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.646 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:52.646 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389551+0000", 2024-09-13T05:11:52.646 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2479999999999999e-06 2024-09-13T05:11:52.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.646 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.646 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:52.646 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389557+0000", 2024-09-13T05:11:52.646 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6080000000000001e-06 2024-09-13T05:11:52.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.647 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:52.647 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389562+0000", 2024-09-13T05:11:52.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8670000000000002e-06 2024-09-13T05:11:52.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.647 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.647 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449531+0000", 2024-09-13T05:11:52.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059968606000000001 2024-09-13T05:11:52.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.647 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:52.647 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449623+0000", 2024-09-13T05:11:52.648 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2464000000000001e-05 2024-09-13T05:11:52.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.648 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.648 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:52.648 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449733+0000", 2024-09-13T05:11:52.648 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010996 2024-09-13T05:11:52.648 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.648 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:52.648 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.648 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.648 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118393 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 3107840~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:52.648 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393407+0000", 2024-09-13T05:11:52.649 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.2154165030000001, 2024-09-13T05:11:52.649 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059784062999999998, 2024-09-13T05:11:52.649 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:52.649 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:52.649 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:52.649 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:52.649 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:52.649 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118393 2024-09-13T05:11:52.649 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.649 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:52.649 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.649 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:52.649 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393407+0000", 2024-09-13T05:11:52.649 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.650 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.650 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.650 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:52.650 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393407+0000", 2024-09-13T05:11:52.650 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.650 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.650 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.650 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:52.650 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393406+0000", 2024-09-13T05:11:52.650 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:52.650 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.650 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.650 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:52.651 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393409+0000", 2024-09-13T05:11:52.651 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6369999999999999e-06 2024-09-13T05:11:52.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.651 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.651 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:52.651 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393414+0000", 2024-09-13T05:11:52.651 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2129999999999999e-06 2024-09-13T05:11:52.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.651 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.651 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:52.651 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393419+0000", 2024-09-13T05:11:52.651 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7160000000000002e-06 2024-09-13T05:11:52.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.651 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.652 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.652 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453054+0000", 2024-09-13T05:11:52.652 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059634468000000003 2024-09-13T05:11:52.652 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.652 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.652 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:52.652 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453118+0000", 2024-09-13T05:11:52.652 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4271999999999997e-05 2024-09-13T05:11:52.652 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.652 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.652 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:52.652 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453191+0000", 2024-09-13T05:11:52.653 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3406999999999997e-05 2024-09-13T05:11:52.653 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.653 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:52.653 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.653 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.653 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.653 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118394 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 3122176~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:52.653 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393434+0000", 2024-09-13T05:11:52.653 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.2153897200000001, 2024-09-13T05:11:52.653 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059854255000000002, 2024-09-13T05:11:52.653 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:52.653 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:52.653 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:52.654 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:52.654 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:52.654 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118394 2024-09-13T05:11:52.654 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.654 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:52.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.654 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:52.654 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393434+0000", 2024-09-13T05:11:52.654 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.654 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.654 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:52.654 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393434+0000", 2024-09-13T05:11:52.654 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.655 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.655 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.655 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:52.655 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393433+0000", 2024-09-13T05:11:52.655 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:52.655 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.655 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.655 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:52.655 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393436+0000", 2024-09-13T05:11:52.655 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5639999999999999e-06 2024-09-13T05:11:52.655 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.655 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.655 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:52.655 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393442+0000", 2024-09-13T05:11:52.656 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1920000000000002e-06 2024-09-13T05:11:52.656 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.656 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.656 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:52.656 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393448+0000", 2024-09-13T05:11:52.656 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2219999999999999e-06 2024-09-13T05:11:52.656 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.656 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.656 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.656 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453202+0000", 2024-09-13T05:11:52.656 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059753891000000003 2024-09-13T05:11:52.656 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.656 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.657 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:52.657 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453242+0000", 2024-09-13T05:11:52.657 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9410999999999999e-05 2024-09-13T05:11:52.657 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.657 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.657 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:52.657 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453288+0000", 2024-09-13T05:11:52.657 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6519e-05 2024-09-13T05:11:52.657 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.657 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:52.657 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.657 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.657 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.658 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118395 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 3136512~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:52.658 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393453+0000", 2024-09-13T05:11:52.658 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.2153709519999998, 2024-09-13T05:11:52.658 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059998586, 2024-09-13T05:11:52.658 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:52.658 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:52.658 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:52.658 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:52.658 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:52.658 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118395 2024-09-13T05:11:52.658 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.658 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:52.658 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.659 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:52.659 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393453+0000", 2024-09-13T05:11:52.659 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.659 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.659 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.659 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:52.659 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393453+0000", 2024-09-13T05:11:52.659 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.659 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.659 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.659 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:52.659 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393452+0000", 2024-09-13T05:11:52.659 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:52.659 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.660 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.660 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:52.660 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393455+0000", 2024-09-13T05:11:52.660 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6740000000000001e-06 2024-09-13T05:11:52.660 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.660 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.660 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:52.660 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393460+0000", 2024-09-13T05:11:52.660 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5860000000000004e-06 2024-09-13T05:11:52.661 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.661 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.661 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:52.661 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393465+0000", 2024-09-13T05:11:52.661 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7140000000000001e-06 2024-09-13T05:11:52.661 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.661 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.661 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.661 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453320+0000", 2024-09-13T05:11:52.662 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059854737999999998 2024-09-13T05:11:52.662 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.662 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.662 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:52.662 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453382+0000", 2024-09-13T05:11:52.662 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2147e-05 2024-09-13T05:11:52.662 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.662 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.662 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:52.662 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453451+0000", 2024-09-13T05:11:52.662 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9226000000000004e-05 2024-09-13T05:11:52.662 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.663 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:52.663 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.663 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.663 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.663 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118433 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 12288~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:52.663 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393469+0000", 2024-09-13T05:11:52.663 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.2153543390000001, 2024-09-13T05:11:52.663 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060123661000000002, 2024-09-13T05:11:52.663 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:52.663 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:52.663 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:52.663 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:52.663 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:52.663 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118433 2024-09-13T05:11:52.664 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.664 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:52.664 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.664 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:52.664 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393469+0000", 2024-09-13T05:11:52.664 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.664 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.664 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.664 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:52.664 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393469+0000", 2024-09-13T05:11:52.664 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.665 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.665 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.665 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:52.665 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393469+0000", 2024-09-13T05:11:52.665 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:52.665 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.665 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.665 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:52.665 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393471+0000", 2024-09-13T05:11:52.665 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3350000000000001e-06 2024-09-13T05:11:52.665 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.665 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.665 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:52.666 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393477+0000", 2024-09-13T05:11:52.666 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3639999999999998e-06 2024-09-13T05:11:52.666 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.666 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.666 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:52.666 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393481+0000", 2024-09-13T05:11:52.666 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6020000000000002e-06 2024-09-13T05:11:52.666 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.666 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.666 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.666 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453477+0000", 2024-09-13T05:11:52.666 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059995615000000002 2024-09-13T05:11:52.666 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.666 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.667 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:52.667 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453522+0000", 2024-09-13T05:11:52.667 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5139999999999998e-05 2024-09-13T05:11:52.667 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.667 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.667 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:52.667 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453593+0000", 2024-09-13T05:11:52.667 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0963000000000005e-05 2024-09-13T05:11:52.667 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.667 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:52.667 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.667 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.667 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.667 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118434 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 26624~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:52.668 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393485+0000", 2024-09-13T05:11:52.668 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.2153381960000003, 2024-09-13T05:11:52.668 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060351620000000002, 2024-09-13T05:11:52.668 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:52.668 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:52.668 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:52.668 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:52.668 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:52.668 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118434 2024-09-13T05:11:52.668 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.668 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:52.669 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.669 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:52.669 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393485+0000", 2024-09-13T05:11:52.669 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.669 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.669 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.669 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:52.669 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393485+0000", 2024-09-13T05:11:52.669 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.669 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.670 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.670 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:52.670 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393485+0000", 2024-09-13T05:11:52.670 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:52.670 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.670 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.670 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:52.670 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393488+0000", 2024-09-13T05:11:52.670 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8090000000000001e-06 2024-09-13T05:11:52.670 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.670 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.670 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:52.670 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393494+0000", 2024-09-13T05:11:52.671 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7780000000000004e-06 2024-09-13T05:11:52.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.671 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.671 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:52.671 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393498+0000", 2024-09-13T05:11:52.671 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.668e-06 2024-09-13T05:11:52.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.671 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.671 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.671 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453628+0000", 2024-09-13T05:11:52.671 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060129969999999998 2024-09-13T05:11:52.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.671 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.671 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:52.672 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453733+0000", 2024-09-13T05:11:52.672 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000105157 2024-09-13T05:11:52.672 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.672 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.672 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:52.672 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453837+0000", 2024-09-13T05:11:52.672 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000103596 2024-09-13T05:11:52.672 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.672 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:52.672 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.672 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.672 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.672 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118435 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 40960~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:52.673 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393503+0000", 2024-09-13T05:11:52.673 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.2153208089999996, 2024-09-13T05:11:52.673 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060548137000000002, 2024-09-13T05:11:52.673 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:52.673 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:52.673 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:52.673 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:52.673 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:52.673 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118435 2024-09-13T05:11:52.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.673 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:52.673 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.674 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:52.674 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393503+0000", 2024-09-13T05:11:52.674 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.674 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.674 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.674 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:52.674 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393503+0000", 2024-09-13T05:11:52.674 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.674 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.674 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.674 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:52.674 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393502+0000", 2024-09-13T05:11:52.674 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:52.675 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.675 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.675 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:52.675 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393505+0000", 2024-09-13T05:11:52.675 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4279999999999999e-06 2024-09-13T05:11:52.675 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.675 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.675 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:52.675 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393510+0000", 2024-09-13T05:11:52.675 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.04e-06 2024-09-13T05:11:52.675 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.675 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.675 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:52.676 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393515+0000", 2024-09-13T05:11:52.676 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6809999999999997e-06 2024-09-13T05:11:52.676 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.676 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.676 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.676 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453862+0000", 2024-09-13T05:11:52.676 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060347849000000002 2024-09-13T05:11:52.676 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.676 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.676 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:52.676 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453951+0000", 2024-09-13T05:11:52.676 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8121999999999994e-05 2024-09-13T05:11:52.677 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.677 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.677 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:52.677 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.454051+0000", 2024-09-13T05:11:52.677 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010035399999999999 2024-09-13T05:11:52.677 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.677 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:52.677 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.677 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.677 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.677 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118436 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 55296~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:52.677 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393520+0000", 2024-09-13T05:11:52.678 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.2153033649999996, 2024-09-13T05:11:52.678 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060673151000000002, 2024-09-13T05:11:52.678 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:52.678 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:52.678 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:52.678 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:52.678 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:52.678 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118436 2024-09-13T05:11:52.678 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.678 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:52.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.678 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:52.678 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393520+0000", 2024-09-13T05:11:52.679 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.679 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.679 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.679 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:52.679 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393520+0000", 2024-09-13T05:11:52.679 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.679 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.679 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.679 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:52.679 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393520+0000", 2024-09-13T05:11:52.679 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:52.679 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.679 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.680 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:52.680 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393523+0000", 2024-09-13T05:11:52.680 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6220000000000001e-06 2024-09-13T05:11:52.680 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.680 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.680 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:52.680 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393528+0000", 2024-09-13T05:11:52.680 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5339999999999999e-06 2024-09-13T05:11:52.680 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.680 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.680 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:52.680 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393533+0000", 2024-09-13T05:11:52.681 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8060000000000002e-06 2024-09-13T05:11:52.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.681 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.681 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.454087+0000", 2024-09-13T05:11:52.681 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060554502000000003 2024-09-13T05:11:52.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.681 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:52.681 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.454138+0000", 2024-09-13T05:11:52.681 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0398000000000001e-05 2024-09-13T05:11:52.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.682 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:52.682 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.454193+0000", 2024-09-13T05:11:52.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5661000000000001e-05 2024-09-13T05:11:52.682 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.682 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:52.682 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.682 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118437 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 69632~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:52.682 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393561+0000", 2024-09-13T05:11:52.682 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.2152629199999998, 2024-09-13T05:11:52.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060852235999999997, 2024-09-13T05:11:52.683 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:52.683 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:52.683 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:52.683 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:52.683 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:52.683 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118437 2024-09-13T05:11:52.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.683 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:52.683 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.683 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:52.683 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393561+0000", 2024-09-13T05:11:52.683 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.684 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:52.684 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393561+0000", 2024-09-13T05:11:52.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.684 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:52.684 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393560+0000", 2024-09-13T05:11:52.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:52.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.684 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:52.684 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393573+0000", 2024-09-13T05:11:52.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2893e-05 2024-09-13T05:11:52.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.685 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:52.685 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393588+0000", 2024-09-13T05:11:52.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4810000000000001e-05 2024-09-13T05:11:52.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.685 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:52.685 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393593+0000", 2024-09-13T05:11:52.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4829999999999999e-06 2024-09-13T05:11:52.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.686 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.686 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.454229+0000", 2024-09-13T05:11:52.686 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060635823999999998 2024-09-13T05:11:52.686 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.686 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.686 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:52.686 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.454316+0000", 2024-09-13T05:11:52.686 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6328000000000004e-05 2024-09-13T05:11:52.686 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.686 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.686 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:52.686 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.454413+0000", 2024-09-13T05:11:52.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7428000000000003e-05 2024-09-13T05:11:52.687 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.687 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:52.687 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.687 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118457 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 356352~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:52.687 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.397421+0000", 2024-09-13T05:11:52.687 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.2114026439999996, 2024-09-13T05:11:52.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059721492000000001, 2024-09-13T05:11:52.687 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:52.687 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:52.687 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:52.688 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:52.688 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:52.688 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118457 2024-09-13T05:11:52.688 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.688 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:52.688 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.688 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:52.688 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397421+0000", 2024-09-13T05:11:52.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.688 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.688 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.688 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:52.689 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397421+0000", 2024-09-13T05:11:52.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.689 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.689 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:52.689 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397421+0000", 2024-09-13T05:11:52.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:52.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.689 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.689 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:52.689 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397423+0000", 2024-09-13T05:11:52.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3360000000000002e-06 2024-09-13T05:11:52.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:52.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397428+0000", 2024-09-13T05:11:52.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1019999999999996e-06 2024-09-13T05:11:52.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:52.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397433+0000", 2024-09-13T05:11:52.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5369999999999999e-06 2024-09-13T05:11:52.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457050+0000", 2024-09-13T05:11:52.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059617268000000001 2024-09-13T05:11:52.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:52.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457088+0000", 2024-09-13T05:11:52.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8586e-05 2024-09-13T05:11:52.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:52.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457142+0000", 2024-09-13T05:11:52.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4101000000000003e-05 2024-09-13T05:11:52.691 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.691 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:52.692 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.692 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118458 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 370688~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:52.692 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.397453+0000", 2024-09-13T05:11:52.692 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.211370649, 2024-09-13T05:11:52.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059799484, 2024-09-13T05:11:52.692 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:52.692 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:52.692 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:52.692 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:52.692 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:52.693 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118458 2024-09-13T05:11:52.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.693 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:52.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:52.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397453+0000", 2024-09-13T05:11:52.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:52.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397453+0000", 2024-09-13T05:11:52.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:52.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397452+0000", 2024-09-13T05:11:52.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:52.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:52.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397456+0000", 2024-09-13T05:11:52.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:11:52.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:52.695 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397461+0000", 2024-09-13T05:11:52.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9000000000000003e-06 2024-09-13T05:11:52.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.695 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:52.695 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397466+0000", 2024-09-13T05:11:52.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6659999999999999e-06 2024-09-13T05:11:52.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.695 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.695 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457167+0000", 2024-09-13T05:11:52.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059700955 2024-09-13T05:11:52.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.696 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.696 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:52.696 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457209+0000", 2024-09-13T05:11:52.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1758000000000002e-05 2024-09-13T05:11:52.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.696 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.696 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:52.696 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457252+0000", 2024-09-13T05:11:52.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3661000000000001e-05 2024-09-13T05:11:52.696 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.696 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:52.696 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.697 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118459 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 385024~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:52.697 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.397470+0000", 2024-09-13T05:11:52.697 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.2113534789999996, 2024-09-13T05:11:52.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059892342000000001, 2024-09-13T05:11:52.697 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:52.697 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:52.697 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:52.697 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:52.697 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:52.697 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118459 2024-09-13T05:11:52.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.698 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:52.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:52.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397470+0000", 2024-09-13T05:11:52.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:52.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397470+0000", 2024-09-13T05:11:52.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:52.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397470+0000", 2024-09-13T05:11:52.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:52.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.699 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:52.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397472+0000", 2024-09-13T05:11:52.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4839999999999998e-06 2024-09-13T05:11:52.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.699 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:52.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397477+0000", 2024-09-13T05:11:52.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0819999999999998e-06 2024-09-13T05:11:52.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.700 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:52.700 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397482+0000", 2024-09-13T05:11:52.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5090000000000004e-06 2024-09-13T05:11:52.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.700 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.700 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457277+0000", 2024-09-13T05:11:52.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059795607000000001 2024-09-13T05:11:52.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.700 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:52.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457316+0000", 2024-09-13T05:11:52.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9004999999999997e-05 2024-09-13T05:11:52.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:52.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457362+0000", 2024-09-13T05:11:52.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6149000000000001e-05 2024-09-13T05:11:52.701 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.701 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:52.701 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.701 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118460 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 399360~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:52.702 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.397486+0000", 2024-09-13T05:11:52.702 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.2113380720000002, 2024-09-13T05:11:52.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059990031999999999, 2024-09-13T05:11:52.702 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:52.702 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:52.702 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:52.702 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:52.702 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:52.702 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118460 2024-09-13T05:11:52.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.702 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:52.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.702 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:52.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397486+0000", 2024-09-13T05:11:52.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:52.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397486+0000", 2024-09-13T05:11:52.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:52.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397485+0000", 2024-09-13T05:11:52.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:52.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:52.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397488+0000", 2024-09-13T05:11:52.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:11:52.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:52.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397493+0000", 2024-09-13T05:11:52.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0919999999999997e-06 2024-09-13T05:11:52.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:52.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397497+0000", 2024-09-13T05:11:52.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4100000000000001e-06 2024-09-13T05:11:52.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.705 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457390+0000", 2024-09-13T05:11:52.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059892327000000002 2024-09-13T05:11:52.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:52.705 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457430+0000", 2024-09-13T05:11:52.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0590999999999998e-05 2024-09-13T05:11:52.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.706 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:52.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457476+0000", 2024-09-13T05:11:52.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5342000000000001e-05 2024-09-13T05:11:52.706 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.706 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:52.706 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.706 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118461 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 413696~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:11:52.706 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.397501+0000", 2024-09-13T05:11:52.706 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.2113224420000002, 2024-09-13T05:11:52.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060091361000000003, 2024-09-13T05:11:52.706 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:52.706 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:52.707 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:52.707 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:52.707 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:52.707 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118461 2024-09-13T05:11:52.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.707 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:52.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:52.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397501+0000", 2024-09-13T05:11:52.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:52.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397501+0000", 2024-09-13T05:11:52.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:52.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:52.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397501+0000", 2024-09-13T05:11:52.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:52.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:52.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397507+0000", 2024-09-13T05:11:52.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3940000000000001e-06 2024-09-13T05:11:52.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.709 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:52.709 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397512+0000", 2024-09-13T05:11:52.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2780000000000001e-06 2024-09-13T05:11:52.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.709 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:52.709 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397517+0000", 2024-09-13T05:11:52.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7219999999999999e-06 2024-09-13T05:11:52.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.709 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:52.709 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457502+0000", 2024-09-13T05:11:52.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059985199000000003 2024-09-13T05:11:52.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:52.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457545+0000", 2024-09-13T05:11:52.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2398000000000003e-05 2024-09-13T05:11:52.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:52.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:52.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:52.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457593+0000", 2024-09-13T05:11:52.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7768000000000001e-05 2024-09-13T05:11:52.710 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.710 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:52.711 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.711 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:52.711 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:52.711 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:52.712 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:11:52.713 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:52.708+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:52.813 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:52.809+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:52.831 INFO:teuthology.orchestra.run.smithi120.stdout:4821 write 0xe62afc9 thru 0xe6383a5 (0xd3dd bytes) 2024-09-13T05:11:52.834 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:52.834 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:52.835 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:11:52.835 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:52.846 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:11:52.857 INFO:teuthology.orchestra.run.smithi120.stdout:4822 punch from 0x86ceae3 to 0x86cf32e, (0x84b bytes) 2024-09-13T05:11:52.870 INFO:teuthology.orchestra.run.smithi120.stdout:4823 trunc from 0xe6383a6 to 0x6404fb7 2024-09-13T05:11:52.907 INFO:teuthology.orchestra.run.smithi120.stdout:4824 write 0x7915137 thru 0x7923834 (0xe6fe bytes) 2024-09-13T05:11:52.914 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:52.912+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:52.935 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:52.935 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:52.935 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:52.935 INFO:teuthology.orchestra.run.smithi120.stdout:4829 writesame 0x49d332a thru 0x49dca13 data_size 0x89(0x96ea bytes) 2024-09-13T05:11:52.960 INFO:teuthology.orchestra.run.smithi120.stdout:4830 punch from 0x453916c to 0x4540cf6, (0x7b8a bytes) 2024-09-13T05:11:52.960 INFO:teuthology.orchestra.run.smithi120.stdout:4831 writesame 0x6484462 thru 0x648d083 data_size 0x9(0x8c22 bytes) 2024-09-13T05:11:52.960 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:52.961 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:52.961 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:52.961 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:52.961 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:52.971 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:11:52.986 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:52.986 INFO:teuthology.orchestra.run.smithi120.stdout:4834 write 0x6588a76 thru 0x659274b (0x9cd6 bytes) 2024-09-13T05:11:53.010 INFO:teuthology.orchestra.run.smithi120.stdout:4835 punch from 0x572c156 to 0x5731d7d, (0x5c27 bytes) 2024-09-13T05:11:53.011 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:53.011 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:53.011 INFO:teuthology.orchestra.run.smithi120.stdout:4841 write 0x5b8603a thru 0x5b91286 (0xb24d bytes) 2024-09-13T05:11:53.015 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:53.012+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:53.057 INFO:teuthology.orchestra.run.smithi120.stdout:4844 writesame 0xe9e11fb thru 0xe9e813d data_size 0x7(0x6f43 bytes) 2024-09-13T05:11:53.068 INFO:teuthology.orchestra.run.smithi120.stdout:4845 trunc from 0xe9e813e to 0x94a9880 2024-09-13T05:11:53.080 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:53.080 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:53.080 INFO:teuthology.orchestra.run.smithi120.stdout:4849 read 0x832616 thru 0x83a9e3 (0x83ce bytes) 2024-09-13T05:11:53.084 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:53.085 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:53.085 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:53.085 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:53.085 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.085 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29020 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2855936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:53.085 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:11:53.085 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 76.040637942999993, 2024-09-13T05:11:53.085 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060733743, 2024-09-13T05:11:53.085 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.086 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:53.086 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.086 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.086 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.086 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29020 2024-09-13T05:11:53.086 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.086 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.086 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.086 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.086 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:11:53.086 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.087 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.087 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.087 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:11:53.087 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.087 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.087 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.087 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041741+0000", 2024-09-13T05:11:53.087 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.088 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.088 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.088 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041749+0000", 2024-09-13T05:11:53.088 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6059999999999997e-06 2024-09-13T05:11:53.088 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.088 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.088 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.088 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041754+0000", 2024-09-13T05:11:53.088 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6740000000000002e-06 2024-09-13T05:11:53.089 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.089 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.089 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.089 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041760+0000", 2024-09-13T05:11:53.089 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0459999999999996e-06 2024-09-13T05:11:53.089 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.089 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.089 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:53.089 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102289+0000", 2024-09-13T05:11:53.089 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060529145999999999 2024-09-13T05:11:53.089 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.090 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.090 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:53.090 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102378+0000", 2024-09-13T05:11:53.090 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8901999999999997e-05 2024-09-13T05:11:53.090 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.090 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.090 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:53.090 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102476+0000", 2024-09-13T05:11:53.090 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7991000000000004e-05 2024-09-13T05:11:53.090 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.090 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.091 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.091 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.091 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.091 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29021 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2865152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:53.091 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:11:53.091 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 76.040615947999996, 2024-09-13T05:11:53.091 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060927993999999999, 2024-09-13T05:11:53.091 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.091 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:53.091 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.092 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.092 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.092 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29021 2024-09-13T05:11:53.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.092 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.092 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.092 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.092 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:11:53.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:11:53.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041763+0000", 2024-09-13T05:11:53.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.094 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041766+0000", 2024-09-13T05:11:53.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6800000000000002e-06 2024-09-13T05:11:53.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.094 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041771+0000", 2024-09-13T05:11:53.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:11:53.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.095 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.095 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041776+0000", 2024-09-13T05:11:53.095 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8489999999999997e-06 2024-09-13T05:11:53.095 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.095 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.095 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:53.095 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102513+0000", 2024-09-13T05:11:53.095 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060737102000000001 2024-09-13T05:11:53.096 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.096 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.096 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:53.096 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102597+0000", 2024-09-13T05:11:53.096 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4374000000000002e-05 2024-09-13T05:11:53.096 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.096 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.096 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:53.096 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102692+0000", 2024-09-13T05:11:53.096 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4436000000000002e-05 2024-09-13T05:11:53.097 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.097 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.097 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.097 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.097 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.097 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29022 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2874368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:53.097 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:11:53.097 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 76.040599647999997, 2024-09-13T05:11:53.097 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061135083999999999, 2024-09-13T05:11:53.097 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.097 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:53.098 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.098 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.098 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.098 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29022 2024-09-13T05:11:53.098 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.098 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.098 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.098 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.098 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:11:53.098 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.099 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.099 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.099 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.099 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:11:53.099 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.099 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.099 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.099 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.099 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:11:53.099 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.099 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.100 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.100 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.100 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041782+0000", 2024-09-13T05:11:53.100 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4959999999999999e-06 2024-09-13T05:11:53.100 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.100 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.100 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.100 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041787+0000", 2024-09-13T05:11:53.100 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1240000000000004e-06 2024-09-13T05:11:53.100 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.100 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.101 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.101 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041792+0000", 2024-09-13T05:11:53.101 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9200000000000003e-06 2024-09-13T05:11:53.101 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.101 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.101 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:53.101 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102738+0000", 2024-09-13T05:11:53.101 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060945581999999998 2024-09-13T05:11:53.101 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.102 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.102 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:53.102 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102821+0000", 2024-09-13T05:11:53.102 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2898999999999994e-05 2024-09-13T05:11:53.102 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.102 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.102 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:53.102 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102915+0000", 2024-09-13T05:11:53.102 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4523000000000003e-05 2024-09-13T05:11:53.102 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.102 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.102 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.103 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.103 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.103 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29067 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2764800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:53.103 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:11:53.103 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 76.036825430999997, 2024-09-13T05:11:53.103 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060816621000000001, 2024-09-13T05:11:53.103 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.103 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:53.103 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.103 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.104 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.104 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29067 2024-09-13T05:11:53.104 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.104 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.104 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.104 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.104 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:11:53.104 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.104 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.104 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.105 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.105 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:11:53.105 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.105 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.105 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.105 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.105 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:11:53.105 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.105 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.105 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.105 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.106 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045557+0000", 2024-09-13T05:11:53.106 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.898e-06 2024-09-13T05:11:53.106 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.106 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.106 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.106 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045575+0000", 2024-09-13T05:11:53.106 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8252000000000001e-05 2024-09-13T05:11:53.106 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.106 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.106 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.107 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045581+0000", 2024-09-13T05:11:53.107 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:11:53.107 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.107 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.107 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:53.107 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106183+0000", 2024-09-13T05:11:53.107 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060602630999999997 2024-09-13T05:11:53.107 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.107 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.107 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:53.108 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106271+0000", 2024-09-13T05:11:53.108 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7329000000000004e-05 2024-09-13T05:11:53.108 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.108 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.108 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:53.108 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106371+0000", 2024-09-13T05:11:53.108 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000100164 2024-09-13T05:11:53.108 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.108 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.108 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.109 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.109 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.109 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29068 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2774016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:53.109 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:11:53.109 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 76.036794197000006, 2024-09-13T05:11:53.109 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060994509000000002, 2024-09-13T05:11:53.109 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.109 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:53.109 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.109 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.110 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.110 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29068 2024-09-13T05:11:53.110 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.110 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.110 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.110 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.110 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:11:53.110 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.110 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.110 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.111 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.111 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:11:53.111 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.111 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.111 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.111 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.111 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045585+0000", 2024-09-13T05:11:53.111 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.111 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.111 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.111 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.111 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045588+0000", 2024-09-13T05:11:53.112 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:11:53.112 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.112 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.112 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.112 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045594+0000", 2024-09-13T05:11:53.112 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9329999999999998e-06 2024-09-13T05:11:53.112 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.112 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.112 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.112 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045599+0000", 2024-09-13T05:11:53.113 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3190000000000002e-06 2024-09-13T05:11:53.113 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.113 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.113 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:53.113 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106399+0000", 2024-09-13T05:11:53.113 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060800361999999997 2024-09-13T05:11:53.113 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.113 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.113 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:53.113 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106489+0000", 2024-09-13T05:11:53.113 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9301000000000004e-05 2024-09-13T05:11:53.113 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.114 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.114 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:53.114 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106580+0000", 2024-09-13T05:11:53.114 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1314e-05 2024-09-13T05:11:53.114 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.114 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.114 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.114 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.114 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.115 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29069 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2792448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:53.115 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:11:53.115 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 76.036775779999999, 2024-09-13T05:11:53.115 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061207599000000001, 2024-09-13T05:11:53.115 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.115 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:53.115 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.115 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.115 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.115 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29069 2024-09-13T05:11:53.115 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.115 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.116 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.116 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.116 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:11:53.116 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.116 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.116 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.116 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.116 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:11:53.116 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.116 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.117 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.117 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.117 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045603+0000", 2024-09-13T05:11:53.117 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.117 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.117 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.117 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.117 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045606+0000", 2024-09-13T05:11:53.117 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7300000000000001e-06 2024-09-13T05:11:53.117 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.117 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.118 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.118 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045612+0000", 2024-09-13T05:11:53.118 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9599999999999997e-06 2024-09-13T05:11:53.118 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.118 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.118 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.118 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045619+0000", 2024-09-13T05:11:53.118 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6019999999999996e-06 2024-09-13T05:11:53.118 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.118 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.118 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:53.119 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106619+0000", 2024-09-13T05:11:53.119 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061000029999999997 2024-09-13T05:11:53.119 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.119 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.119 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:53.119 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106713+0000", 2024-09-13T05:11:53.119 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4505000000000004e-05 2024-09-13T05:11:53.119 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.119 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.119 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:53.119 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106812+0000", 2024-09-13T05:11:53.120 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8264000000000007e-05 2024-09-13T05:11:53.120 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.120 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.120 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.120 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.120 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.120 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29070 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2783232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:53.120 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:11:53.120 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 76.036755321000001, 2024-09-13T05:11:53.120 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061389805999999998, 2024-09-13T05:11:53.120 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.121 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:53.121 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.121 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.121 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.121 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29070 2024-09-13T05:11:53.121 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.121 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.121 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.121 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.121 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:11:53.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.122 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.122 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.122 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.122 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:11:53.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.122 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.122 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.122 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.122 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:11:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045627+0000", 2024-09-13T05:11:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6579999999999998e-06 2024-09-13T05:11:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045632+0000", 2024-09-13T05:11:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8449999999999999e-06 2024-09-13T05:11:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.124 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.124 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.124 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045639+0000", 2024-09-13T05:11:53.124 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:11:53.124 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.124 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.124 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:53.125 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106837+0000", 2024-09-13T05:11:53.125 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061198529000000002 2024-09-13T05:11:53.125 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.125 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.125 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:53.125 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106922+0000", 2024-09-13T05:11:53.125 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4771999999999994e-05 2024-09-13T05:11:53.125 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.125 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.125 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107014+0000", 2024-09-13T05:11:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2009000000000006e-05 2024-09-13T05:11:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29071 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2801664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:11:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 76.036736245, 2024-09-13T05:11:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061582804999999997, 2024-09-13T05:11:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.127 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:53.127 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.127 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.127 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.127 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29071 2024-09-13T05:11:53.127 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.127 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.127 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.127 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.127 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:11:53.128 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.128 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.128 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.128 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.128 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:11:53.128 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.128 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.128 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.128 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.128 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045643+0000", 2024-09-13T05:11:53.129 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.129 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.129 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.129 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045646+0000", 2024-09-13T05:11:53.129 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:11:53.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.129 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.129 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.129 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045664+0000", 2024-09-13T05:11:53.129 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8408000000000001e-05 2024-09-13T05:11:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045670+0000", 2024-09-13T05:11:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7710000000000003e-06 2024-09-13T05:11:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107048+0000", 2024-09-13T05:11:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061378438 2024-09-13T05:11:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.131 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:53.131 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107134+0000", 2024-09-13T05:11:53.131 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5574000000000004e-05 2024-09-13T05:11:53.131 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.131 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.131 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:53.131 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107226+0000", 2024-09-13T05:11:53.131 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2262000000000005e-05 2024-09-13T05:11:53.131 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.131 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.131 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.132 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.132 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.132 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29072 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2810880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:53.132 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:11:53.132 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 76.036704861000004, 2024-09-13T05:11:53.132 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061762233999999999, 2024-09-13T05:11:53.132 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.132 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:53.132 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.132 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.133 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.133 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29072 2024-09-13T05:11:53.133 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.133 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.133 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.133 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.133 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:11:53.133 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.133 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.133 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.133 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:11:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045674+0000", 2024-09-13T05:11:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045677+0000", 2024-09-13T05:11:53.135 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9679999999999998e-06 2024-09-13T05:11:53.135 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.135 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.135 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.135 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045694+0000", 2024-09-13T05:11:53.135 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6801999999999999e-05 2024-09-13T05:11:53.135 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.135 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.135 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.135 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045700+0000", 2024-09-13T05:11:53.136 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8270000000000003e-06 2024-09-13T05:11:53.136 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.136 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.136 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:53.136 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107249+0000", 2024-09-13T05:11:53.136 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061549114000000002 2024-09-13T05:11:53.136 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.136 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.136 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:53.136 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107341+0000", 2024-09-13T05:11:53.137 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2390000000000001e-05 2024-09-13T05:11:53.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.137 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.137 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:53.137 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107437+0000", 2024-09-13T05:11:53.137 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5648000000000003e-05 2024-09-13T05:11:53.137 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.137 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.137 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.137 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.138 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29073 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2820096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:53.138 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:11:53.138 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 76.036662883000005, 2024-09-13T05:11:53.138 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061873910999999997, 2024-09-13T05:11:53.138 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.138 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:53.138 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.138 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.138 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.138 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29073 2024-09-13T05:11:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:11:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:11:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.140 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.140 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.140 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045716+0000", 2024-09-13T05:11:53.140 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.140 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.140 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.140 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.140 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045726+0000", 2024-09-13T05:11:53.140 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6350000000000001e-06 2024-09-13T05:11:53.141 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.141 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.141 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.141 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045739+0000", 2024-09-13T05:11:53.141 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3325e-05 2024-09-13T05:11:53.141 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.141 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.141 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.142 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045746+0000", 2024-09-13T05:11:53.142 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7399999999999998e-06 2024-09-13T05:11:53.142 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.142 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.142 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:53.142 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107457+0000", 2024-09-13T05:11:53.142 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061711038000000003 2024-09-13T05:11:53.142 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.142 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.143 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:53.143 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107522+0000", 2024-09-13T05:11:53.143 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4850000000000004e-05 2024-09-13T05:11:53.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.143 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.143 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:53.143 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107591+0000", 2024-09-13T05:11:53.143 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9029999999999995e-05 2024-09-13T05:11:53.143 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.143 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.143 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.144 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.144 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29074 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2829312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:53.144 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:11:53.144 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 76.036628974999999, 2024-09-13T05:11:53.144 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062055459, 2024-09-13T05:11:53.144 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.144 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:53.144 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.144 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29074 2024-09-13T05:11:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:11:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.146 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:11:53.146 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.146 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.146 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.146 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.146 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045750+0000", 2024-09-13T05:11:53.146 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.146 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.146 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.146 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045753+0000", 2024-09-13T05:11:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8399999999999999e-06 2024-09-13T05:11:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045759+0000", 2024-09-13T05:11:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8900000000000004e-06 2024-09-13T05:11:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045764+0000", 2024-09-13T05:11:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3850000000000001e-06 2024-09-13T05:11:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107623+0000", 2024-09-13T05:11:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061858817000000003 2024-09-13T05:11:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107710+0000", 2024-09-13T05:11:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7127999999999997e-05 2024-09-13T05:11:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:53.149 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107806+0000", 2024-09-13T05:11:53.149 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5886999999999999e-05 2024-09-13T05:11:53.149 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.149 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.149 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.149 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.149 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.149 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29075 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2838528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:53.149 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:11:53.149 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 76.036610521, 2024-09-13T05:11:53.149 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062188516999999999, 2024-09-13T05:11:53.149 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.150 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:53.150 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.150 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.150 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.150 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29075 2024-09-13T05:11:53.150 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.150 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.150 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.150 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.150 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:11:53.150 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.150 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.150 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.150 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.151 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:11:53.151 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.151 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.151 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.151 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.151 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:11:53.151 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.151 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.151 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.151 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.151 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045772+0000", 2024-09-13T05:11:53.151 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:11:53.151 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.151 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.152 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.152 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045778+0000", 2024-09-13T05:11:53.152 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9229999999999996e-06 2024-09-13T05:11:53.152 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.152 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.152 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.152 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045784+0000", 2024-09-13T05:11:53.152 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3800000000000002e-06 2024-09-13T05:11:53.152 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.152 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.152 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:53.152 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107823+0000", 2024-09-13T05:11:53.152 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062039331000000003 2024-09-13T05:11:53.152 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.153 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.153 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:53.153 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107886+0000", 2024-09-13T05:11:53.153 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2476000000000003e-05 2024-09-13T05:11:53.153 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.153 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.153 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:53.153 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107958+0000", 2024-09-13T05:11:53.153 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2089999999999996e-05 2024-09-13T05:11:53.153 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.153 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.153 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.153 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.153 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29115 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2682880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:11:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 76.033144993999997, 2024-09-13T05:11:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060847898999999997, 2024-09-13T05:11:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29115 2024-09-13T05:11:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:11:53.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:11:53.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.156 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.156 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049234+0000", 2024-09-13T05:11:53.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.156 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.156 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.157 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049237+0000", 2024-09-13T05:11:53.157 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9069999999999999e-06 2024-09-13T05:11:53.157 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.157 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.157 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049243+0000", 2024-09-13T05:11:53.157 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7459999999999997e-06 2024-09-13T05:11:53.157 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.157 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.157 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049248+0000", 2024-09-13T05:11:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1490000000000002e-06 2024-09-13T05:11:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.109945+0000", 2024-09-13T05:11:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060697299000000003 2024-09-13T05:11:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110013+0000", 2024-09-13T05:11:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8023999999999998e-05 2024-09-13T05:11:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110083+0000", 2024-09-13T05:11:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9296999999999997e-05 2024-09-13T05:11:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29116 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2692096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:11:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 76.033127149999999, 2024-09-13T05:11:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061040167999999999, 2024-09-13T05:11:53.160 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.160 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:53.160 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.160 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.160 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.160 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29116 2024-09-13T05:11:53.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.160 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:11:53.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:11:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049252+0000", 2024-09-13T05:11:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049255+0000", 2024-09-13T05:11:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7250000000000002e-06 2024-09-13T05:11:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049261+0000", 2024-09-13T05:11:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.755e-06 2024-09-13T05:11:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049266+0000", 2024-09-13T05:11:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2100000000000001e-06 2024-09-13T05:11:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110115+0000", 2024-09-13T05:11:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060849225999999999 2024-09-13T05:11:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110199+0000", 2024-09-13T05:11:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4339999999999995e-05 2024-09-13T05:11:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110293+0000", 2024-09-13T05:11:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3397e-05 2024-09-13T05:11:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29117 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2701312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:11:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 76.033109512999999, 2024-09-13T05:11:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.06118527, 2024-09-13T05:11:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29117 2024-09-13T05:11:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:11:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:11:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:11:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049273+0000", 2024-09-13T05:11:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.757e-06 2024-09-13T05:11:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049278+0000", 2024-09-13T05:11:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7830000000000004e-06 2024-09-13T05:11:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049284+0000", 2024-09-13T05:11:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3820000000000003e-06 2024-09-13T05:11:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110313+0000", 2024-09-13T05:11:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061029682000000002 2024-09-13T05:11:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110383+0000", 2024-09-13T05:11:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9406000000000006e-05 2024-09-13T05:11:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110456+0000", 2024-09-13T05:11:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2750000000000007e-05 2024-09-13T05:11:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29118 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2710528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:11:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 76.033091597999999, 2024-09-13T05:11:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061380698999999997, 2024-09-13T05:11:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29118 2024-09-13T05:11:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:11:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:11:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:11:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049291+0000", 2024-09-13T05:11:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8770000000000002e-06 2024-09-13T05:11:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049296+0000", 2024-09-13T05:11:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6799999999999998e-06 2024-09-13T05:11:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049302+0000", 2024-09-13T05:11:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2769999999999996e-06 2024-09-13T05:11:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110488+0000", 2024-09-13T05:11:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061186184999999997 2024-09-13T05:11:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110577+0000", 2024-09-13T05:11:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9246000000000006e-05 2024-09-13T05:11:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110669+0000", 2024-09-13T05:11:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1923999999999996e-05 2024-09-13T05:11:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29119 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2719744~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:11:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 76.033073853999994, 2024-09-13T05:11:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061521165000000003, 2024-09-13T05:11:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29119 2024-09-13T05:11:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:11:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:11:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049305+0000", 2024-09-13T05:11:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049308+0000", 2024-09-13T05:11:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7070000000000001e-06 2024-09-13T05:11:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049316+0000", 2024-09-13T05:11:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:11:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049322+0000", 2024-09-13T05:11:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3199999999999999e-06 2024-09-13T05:11:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110690+0000", 2024-09-13T05:11:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061368428000000003 2024-09-13T05:11:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110755+0000", 2024-09-13T05:11:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4893000000000004e-05 2024-09-13T05:11:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110827+0000", 2024-09-13T05:11:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2039000000000006e-05 2024-09-13T05:11:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29120 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2728960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:11:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 76.033053584000001, 2024-09-13T05:11:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061718420000000003, 2024-09-13T05:11:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29120 2024-09-13T05:11:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:11:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:11:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:11:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049329+0000", 2024-09-13T05:11:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.022e-06 2024-09-13T05:11:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049336+0000", 2024-09-13T05:11:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0720000000000002e-06 2024-09-13T05:11:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049341+0000", 2024-09-13T05:11:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:11:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:53.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110864+0000", 2024-09-13T05:11:53.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061523126999999997 2024-09-13T05:11:53.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:53.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110951+0000", 2024-09-13T05:11:53.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6557000000000005e-05 2024-09-13T05:11:53.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:53.184 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.111045+0000", 2024-09-13T05:11:53.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4043999999999996e-05 2024-09-13T05:11:53.184 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.184 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.184 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.184 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29136 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2876416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:53.184 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:11:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 76.029038158999995, 2024-09-13T05:11:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060742995000000001, 2024-09-13T05:11:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29136 2024-09-13T05:11:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:11:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:11:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053341+0000", 2024-09-13T05:11:53.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.187 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053344+0000", 2024-09-13T05:11:53.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:11:53.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053350+0000", 2024-09-13T05:11:53.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7200000000000003e-06 2024-09-13T05:11:53.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053355+0000", 2024-09-13T05:11:53.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0150000000000003e-06 2024-09-13T05:11:53.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:53.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113909+0000", 2024-09-13T05:11:53.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060554368999999997 2024-09-13T05:11:53.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:53.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113994+0000", 2024-09-13T05:11:53.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4658000000000002e-05 2024-09-13T05:11:53.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:53.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114085+0000", 2024-09-13T05:11:53.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0939000000000005e-05 2024-09-13T05:11:53.189 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.189 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.189 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29166 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2628608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:11:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 76.029020724999995, 2024-09-13T05:11:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060883127000000002, 2024-09-13T05:11:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29166 2024-09-13T05:11:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:11:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:11:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:11:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053361+0000", 2024-09-13T05:11:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:11:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053367+0000", 2024-09-13T05:11:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7350000000000001e-06 2024-09-13T05:11:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053372+0000", 2024-09-13T05:11:53.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7840000000000003e-06 2024-09-13T05:11:53.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:53.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114103+0000", 2024-09-13T05:11:53.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060730924999999998 2024-09-13T05:11:53.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:53.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114171+0000", 2024-09-13T05:11:53.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8021999999999993e-05 2024-09-13T05:11:53.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:53.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114242+0000", 2024-09-13T05:11:53.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1390999999999995e-05 2024-09-13T05:11:53.194 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.194 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.194 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.194 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.194 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.194 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:53.196 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:11:53.196 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:53.189+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:53.296 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:53.292+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:53.342 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:53.342 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:53.342 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.342 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137584 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.343 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.265001+0000", 2024-09-13T05:11:53.343 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.056132109999999999, 2024-09-13T05:11:53.343 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.056162864, 2024-09-13T05:11:53.343 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.343 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.343 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.343 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.343 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.343 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137584 2024-09-13T05:11:53.343 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.343 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.343 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.343 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.343 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.265001+0000", 2024-09-13T05:11:53.344 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.344 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.344 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.344 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.344 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.265001+0000", 2024-09-13T05:11:53.344 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.344 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.344 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.344 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.344 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.261655+0000", 2024-09-13T05:11:53.344 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9966536 2024-09-13T05:11:53.344 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.344 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.344 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.345 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.265011+0000", 2024-09-13T05:11:53.345 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033566450000000001 2024-09-13T05:11:53.345 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.345 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.345 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.345 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.265045+0000", 2024-09-13T05:11:53.345 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3803000000000001e-05 2024-09-13T05:11:53.345 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.345 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.345 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.345 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.265069+0000", 2024-09-13T05:11:53.345 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3736000000000001e-05 2024-09-13T05:11:53.345 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.346 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.346 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.346 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.346 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.346 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137620 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.346 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.273143+0000", 2024-09-13T05:11:53.346 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.047990432, 2024-09-13T05:11:53.346 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048096142000000001, 2024-09-13T05:11:53.346 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.346 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.346 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.346 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.346 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.347 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137620 2024-09-13T05:11:53.347 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.347 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.347 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.347 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.347 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273143+0000", 2024-09-13T05:11:53.347 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.347 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.347 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.347 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.347 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273143+0000", 2024-09-13T05:11:53.347 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.347 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.347 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.348 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.348 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273142+0000", 2024-09-13T05:11:53.348 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:53.348 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.348 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.348 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.348 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273162+0000", 2024-09-13T05:11:53.348 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9701999999999999e-05 2024-09-13T05:11:53.348 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.348 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.348 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.348 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273172+0000", 2024-09-13T05:11:53.348 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0190999999999999e-05 2024-09-13T05:11:53.348 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.349 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.349 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.349 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273178+0000", 2024-09-13T05:11:53.349 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.173e-06 2024-09-13T05:11:53.349 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.349 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.349 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.349 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.349 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.349 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137652 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.349 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.281291+0000", 2024-09-13T05:11:53.349 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.039842803000000003, 2024-09-13T05:11:53.349 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040013154000000002, 2024-09-13T05:11:53.350 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.350 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.350 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.350 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.350 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.350 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137652 2024-09-13T05:11:53.350 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.350 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.350 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.350 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.350 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281291+0000", 2024-09-13T05:11:53.350 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.350 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.351 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.351 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.351 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281291+0000", 2024-09-13T05:11:53.351 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.351 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.351 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.351 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.351 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281290+0000", 2024-09-13T05:11:53.351 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.351 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.351 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.351 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.351 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281293+0000", 2024-09-13T05:11:53.352 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3060000000000002e-06 2024-09-13T05:11:53.352 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.352 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.352 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.352 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281300+0000", 2024-09-13T05:11:53.352 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8539999999999999e-06 2024-09-13T05:11:53.352 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.352 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.352 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.352 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281311+0000", 2024-09-13T05:11:53.352 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0386e-05 2024-09-13T05:11:53.352 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.352 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.353 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.353 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.353 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.353 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137684 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.353 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.285573+0000", 2024-09-13T05:11:53.353 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.035560752000000001, 2024-09-13T05:11:53.353 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035795132, 2024-09-13T05:11:53.353 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.353 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.353 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.353 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.353 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.353 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137684 2024-09-13T05:11:53.354 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.354 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.354 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.354 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.354 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285573+0000", 2024-09-13T05:11:53.354 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.354 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.354 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.354 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.354 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285573+0000", 2024-09-13T05:11:53.354 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.354 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.354 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.354 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.354 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285572+0000", 2024-09-13T05:11:53.355 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.355 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.355 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.355 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.355 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285575+0000", 2024-09-13T05:11:53.355 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1489999999999998e-06 2024-09-13T05:11:53.355 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.355 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.355 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.355 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285582+0000", 2024-09-13T05:11:53.355 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6769999999999998e-06 2024-09-13T05:11:53.355 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.355 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.356 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.356 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285588+0000", 2024-09-13T05:11:53.356 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1510000000000001e-06 2024-09-13T05:11:53.356 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.356 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.356 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.356 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.356 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.356 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137716 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.356 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.297155+0000", 2024-09-13T05:11:53.356 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.023978956999999999, 2024-09-13T05:11:53.356 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.024275423000000001, 2024-09-13T05:11:53.356 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.357 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.357 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.357 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.357 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.357 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137716 2024-09-13T05:11:53.357 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.357 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.357 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.357 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.357 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297155+0000", 2024-09-13T05:11:53.357 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.357 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.357 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.358 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.358 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297155+0000", 2024-09-13T05:11:53.358 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.358 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.358 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.358 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.358 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293416+0000", 2024-09-13T05:11:53.358 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9962616 2024-09-13T05:11:53.358 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.358 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.358 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.358 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297160+0000", 2024-09-13T05:11:53.359 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003744004 2024-09-13T05:11:53.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.359 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.359 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.359 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297174+0000", 2024-09-13T05:11:53.359 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.358e-05 2024-09-13T05:11:53.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.359 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.359 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.359 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297183+0000", 2024-09-13T05:11:53.359 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2879999999999998e-06 2024-09-13T05:11:53.359 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.359 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.359 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.360 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.360 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.360 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137748 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.360 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.301571+0000", 2024-09-13T05:11:53.360 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.019561993, 2024-09-13T05:11:53.360 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019919023000000001, 2024-09-13T05:11:53.360 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.360 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.360 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.360 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.360 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.360 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137748 2024-09-13T05:11:53.361 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.361 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.361 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.361 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.361 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301571+0000", 2024-09-13T05:11:53.361 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.361 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.361 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.361 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.361 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301571+0000", 2024-09-13T05:11:53.361 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.361 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.361 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.362 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.362 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301571+0000", 2024-09-13T05:11:53.362 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.362 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.362 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.362 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.362 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301574+0000", 2024-09-13T05:11:53.362 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3000000000000002e-06 2024-09-13T05:11:53.362 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.362 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.362 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.363 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301581+0000", 2024-09-13T05:11:53.363 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8199999999999999e-06 2024-09-13T05:11:53.363 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.363 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.363 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.363 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301587+0000", 2024-09-13T05:11:53.363 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.246e-06 2024-09-13T05:11:53.363 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.363 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.363 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.363 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.363 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.363 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137780 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.364 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.309450+0000", 2024-09-13T05:11:53.364 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.011683343000000001, 2024-09-13T05:11:53.364 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012099281, 2024-09-13T05:11:53.364 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.364 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.364 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.364 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.364 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.364 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137780 2024-09-13T05:11:53.364 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.364 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.364 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.364 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.365 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309450+0000", 2024-09-13T05:11:53.365 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.365 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.365 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.365 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.365 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309450+0000", 2024-09-13T05:11:53.365 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.365 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.365 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.365 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.365 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309450+0000", 2024-09-13T05:11:53.365 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.365 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.366 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.366 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.366 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309453+0000", 2024-09-13T05:11:53.366 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0429999999999999e-06 2024-09-13T05:11:53.366 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.366 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.366 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.366 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309459+0000", 2024-09-13T05:11:53.366 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6340000000000003e-06 2024-09-13T05:11:53.366 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.366 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.366 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.366 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309465+0000", 2024-09-13T05:11:53.366 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.083e-06 2024-09-13T05:11:53.367 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.367 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.367 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.367 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.367 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.367 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137812 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.367 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.317351+0000", 2024-09-13T05:11:53.367 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0037822139999999999, 2024-09-13T05:11:53.367 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0042581809999999998, 2024-09-13T05:11:53.367 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.367 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.367 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.367 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.368 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.368 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137812 2024-09-13T05:11:53.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.368 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.368 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.368 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.368 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317351+0000", 2024-09-13T05:11:53.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.368 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.368 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.368 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317351+0000", 2024-09-13T05:11:53.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317351+0000", 2024-09-13T05:11:53.369 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317354+0000", 2024-09-13T05:11:53.369 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.988e-06 2024-09-13T05:11:53.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317361+0000", 2024-09-13T05:11:53.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5109999999999997e-06 2024-09-13T05:11:53.370 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.370 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.370 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.370 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317369+0000", 2024-09-13T05:11:53.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0059999999999992e-06 2024-09-13T05:11:53.370 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.370 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.370 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.370 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.370 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.370 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137586 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.370 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.265103+0000", 2024-09-13T05:11:53.371 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.056030391999999998, 2024-09-13T05:11:53.371 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.056565065999999997, 2024-09-13T05:11:53.371 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.371 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.371 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.371 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.371 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.371 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137586 2024-09-13T05:11:53.371 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.371 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.371 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.371 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.371 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.265103+0000", 2024-09-13T05:11:53.371 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.371 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.372 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.372 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.372 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.265103+0000", 2024-09-13T05:11:53.372 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.372 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.372 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.372 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.372 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.265102+0000", 2024-09-13T05:11:53.372 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:53.372 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.372 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.372 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.373 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.265119+0000", 2024-09-13T05:11:53.373 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6956000000000002e-05 2024-09-13T05:11:53.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.373 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.373 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.373 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.265152+0000", 2024-09-13T05:11:53.373 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3541999999999998e-05 2024-09-13T05:11:53.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.373 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.373 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.374 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.265174+0000", 2024-09-13T05:11:53.374 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1863999999999999e-05 2024-09-13T05:11:53.374 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.374 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.374 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.374 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.374 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137621 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.374 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.273186+0000", 2024-09-13T05:11:53.374 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.047947885000000003, 2024-09-13T05:11:53.374 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048543647000000002, 2024-09-13T05:11:53.374 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.374 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.374 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.375 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.375 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.375 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137621 2024-09-13T05:11:53.375 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.375 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.375 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.375 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.375 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273186+0000", 2024-09-13T05:11:53.375 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.375 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.375 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.375 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.375 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273186+0000", 2024-09-13T05:11:53.375 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.376 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.376 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.376 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.376 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273185+0000", 2024-09-13T05:11:53.376 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.376 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.376 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.376 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.376 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273188+0000", 2024-09-13T05:11:53.376 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9730000000000002e-06 2024-09-13T05:11:53.376 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.376 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.376 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.377 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273195+0000", 2024-09-13T05:11:53.377 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3969999999999999e-06 2024-09-13T05:11:53.377 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.377 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.377 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.377 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273200+0000", 2024-09-13T05:11:53.377 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3410000000000002e-06 2024-09-13T05:11:53.377 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.377 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.377 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.377 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.377 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.377 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137653 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.377 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.281338+0000", 2024-09-13T05:11:53.377 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.039795380999999998, 2024-09-13T05:11:53.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040450167000000002, 2024-09-13T05:11:53.378 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.378 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.378 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.378 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.378 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.378 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137653 2024-09-13T05:11:53.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.378 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281338+0000", 2024-09-13T05:11:53.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281338+0000", 2024-09-13T05:11:53.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281337+0000", 2024-09-13T05:11:53.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:53.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281341+0000", 2024-09-13T05:11:53.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3230000000000002e-06 2024-09-13T05:11:53.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.380 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.380 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281349+0000", 2024-09-13T05:11:53.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4649999999999994e-06 2024-09-13T05:11:53.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.380 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.380 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281359+0000", 2024-09-13T05:11:53.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7200000000000001e-06 2024-09-13T05:11:53.380 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.380 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.380 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.380 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137685 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.288989+0000", 2024-09-13T05:11:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.032144266999999997, 2024-09-13T05:11:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032858351000000001, 2024-09-13T05:11:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137685 2024-09-13T05:11:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.288989+0000", 2024-09-13T05:11:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.288989+0000", 2024-09-13T05:11:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285593+0000", 2024-09-13T05:11:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.996604 2024-09-13T05:11:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.288994+0000", 2024-09-13T05:11:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0034010970000000001 2024-09-13T05:11:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289006+0000", 2024-09-13T05:11:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1678999999999999e-05 2024-09-13T05:11:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289014+0000", 2024-09-13T05:11:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7549999999999994e-06 2024-09-13T05:11:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137717 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.297209+0000", 2024-09-13T05:11:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.023924860999999999, 2024-09-13T05:11:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.024700593999999999, 2024-09-13T05:11:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137717 2024-09-13T05:11:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297209+0000", 2024-09-13T05:11:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297209+0000", 2024-09-13T05:11:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297208+0000", 2024-09-13T05:11:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297212+0000", 2024-09-13T05:11:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0829999999999997e-06 2024-09-13T05:11:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297219+0000", 2024-09-13T05:11:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.542e-06 2024-09-13T05:11:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297234+0000", 2024-09-13T05:11:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4214e-05 2024-09-13T05:11:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137749 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.301594+0000", 2024-09-13T05:11:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.019539437, 2024-09-13T05:11:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020374297, 2024-09-13T05:11:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137749 2024-09-13T05:11:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301594+0000", 2024-09-13T05:11:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301594+0000", 2024-09-13T05:11:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301593+0000", 2024-09-13T05:11:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301597+0000", 2024-09-13T05:11:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1200000000000002e-06 2024-09-13T05:11:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301603+0000", 2024-09-13T05:11:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6120000000000004e-06 2024-09-13T05:11:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301624+0000", 2024-09-13T05:11:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1148000000000001e-05 2024-09-13T05:11:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137781 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.309472+0000", 2024-09-13T05:11:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.01166179, 2024-09-13T05:11:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012556187999999999, 2024-09-13T05:11:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137781 2024-09-13T05:11:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.392 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309472+0000", 2024-09-13T05:11:53.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.392 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.392 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309472+0000", 2024-09-13T05:11:53.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.392 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.392 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309471+0000", 2024-09-13T05:11:53.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.393 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.393 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.393 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.393 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309474+0000", 2024-09-13T05:11:53.393 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0369999999999999e-06 2024-09-13T05:11:53.393 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.393 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.393 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.393 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309481+0000", 2024-09-13T05:11:53.393 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.657e-06 2024-09-13T05:11:53.393 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.393 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.393 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.394 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309487+0000", 2024-09-13T05:11:53.394 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8540000000000002e-06 2024-09-13T05:11:53.394 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.394 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.394 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.394 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137813 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.394 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.317375+0000", 2024-09-13T05:11:53.394 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0037580719999999999, 2024-09-13T05:11:53.394 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0047102489999999997, 2024-09-13T05:11:53.394 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.394 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.395 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.395 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.395 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.395 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137813 2024-09-13T05:11:53.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.395 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317375+0000", 2024-09-13T05:11:53.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317375+0000", 2024-09-13T05:11:53.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317375+0000", 2024-09-13T05:11:53.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317378+0000", 2024-09-13T05:11:53.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9059999999999998e-06 2024-09-13T05:11:53.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.397 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.397 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317384+0000", 2024-09-13T05:11:53.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2140000000000001e-06 2024-09-13T05:11:53.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.397 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.397 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317390+0000", 2024-09-13T05:11:53.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5280000000000003e-06 2024-09-13T05:11:53.397 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.397 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.397 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.397 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137588 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.398 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.265192+0000", 2024-09-13T05:11:53.398 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.055941258000000001, 2024-09-13T05:11:53.398 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.056952825999999998, 2024-09-13T05:11:53.398 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.398 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.398 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.398 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.398 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.398 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137588 2024-09-13T05:11:53.398 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.398 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.398 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.398 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.265192+0000", 2024-09-13T05:11:53.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.265192+0000", 2024-09-13T05:11:53.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.265191+0000", 2024-09-13T05:11:53.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:53.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.400 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.265198+0000", 2024-09-13T05:11:53.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5400000000000001e-06 2024-09-13T05:11:53.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.400 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.265218+0000", 2024-09-13T05:11:53.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0642999999999999e-05 2024-09-13T05:11:53.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.400 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.265240+0000", 2024-09-13T05:11:53.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1956000000000001e-05 2024-09-13T05:11:53.400 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.401 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.401 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.401 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137622 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.401 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.273205+0000", 2024-09-13T05:11:53.401 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.047928724999999998, 2024-09-13T05:11:53.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.049001439000000001, 2024-09-13T05:11:53.401 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.401 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.401 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.401 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.401 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.401 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137622 2024-09-13T05:11:53.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.402 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.402 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.402 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273205+0000", 2024-09-13T05:11:53.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.402 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.402 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273205+0000", 2024-09-13T05:11:53.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.402 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.402 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273204+0000", 2024-09-13T05:11:53.403 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.403 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.403 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273207+0000", 2024-09-13T05:11:53.403 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7530000000000002e-06 2024-09-13T05:11:53.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.403 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.403 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273214+0000", 2024-09-13T05:11:53.403 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6610000000000003e-06 2024-09-13T05:11:53.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.403 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.404 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273220+0000", 2024-09-13T05:11:53.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4829999999999996e-06 2024-09-13T05:11:53.404 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.404 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.404 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.404 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137654 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.404 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.281365+0000", 2024-09-13T05:11:53.404 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.039768963999999997, 2024-09-13T05:11:53.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040905827999999998, 2024-09-13T05:11:53.404 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.404 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.404 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.405 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.405 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.405 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137654 2024-09-13T05:11:53.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.405 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.405 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281365+0000", 2024-09-13T05:11:53.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.405 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281365+0000", 2024-09-13T05:11:53.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281364+0000", 2024-09-13T05:11:53.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281367+0000", 2024-09-13T05:11:53.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2109999999999998e-06 2024-09-13T05:11:53.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.407 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.407 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281374+0000", 2024-09-13T05:11:53.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6290000000000004e-06 2024-09-13T05:11:53.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.407 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.407 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.407 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281393+0000", 2024-09-13T05:11:53.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9171e-05 2024-09-13T05:11:53.407 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.407 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.407 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.407 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.407 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137686 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.408 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.289021+0000", 2024-09-13T05:11:53.408 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.032112764000000002, 2024-09-13T05:11:53.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033309340999999999, 2024-09-13T05:11:53.408 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.408 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.408 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.408 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.408 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.408 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137686 2024-09-13T05:11:53.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.408 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.408 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.408 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289021+0000", 2024-09-13T05:11:53.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.409 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289021+0000", 2024-09-13T05:11:53.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.409 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289020+0000", 2024-09-13T05:11:53.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.410 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.410 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289030+0000", 2024-09-13T05:11:53.410 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0243e-05 2024-09-13T05:11:53.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.410 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.410 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289050+0000", 2024-09-13T05:11:53.410 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9519999999999999e-05 2024-09-13T05:11:53.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289056+0000", 2024-09-13T05:11:53.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3509999999999998e-06 2024-09-13T05:11:53.411 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.411 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.411 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.411 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137718 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.411 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.297241+0000", 2024-09-13T05:11:53.411 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.023892902000000001, 2024-09-13T05:11:53.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.025147645999999999, 2024-09-13T05:11:53.411 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.411 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.412 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.412 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.412 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.412 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137718 2024-09-13T05:11:53.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.412 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.412 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297241+0000", 2024-09-13T05:11:53.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297241+0000", 2024-09-13T05:11:53.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297240+0000", 2024-09-13T05:11:53.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297243+0000", 2024-09-13T05:11:53.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3349999999999998e-06 2024-09-13T05:11:53.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297250+0000", 2024-09-13T05:11:53.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7649999999999996e-06 2024-09-13T05:11:53.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297257+0000", 2024-09-13T05:11:53.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3089999999999998e-06 2024-09-13T05:11:53.414 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.414 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.414 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.415 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137750 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.415 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.301644+0000", 2024-09-13T05:11:53.415 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.019489695000000001, 2024-09-13T05:11:53.415 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020802595, 2024-09-13T05:11:53.415 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.415 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.415 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.415 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.415 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.415 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137750 2024-09-13T05:11:53.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.415 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.415 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.416 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301644+0000", 2024-09-13T05:11:53.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.416 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.416 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301644+0000", 2024-09-13T05:11:53.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.416 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.416 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301643+0000", 2024-09-13T05:11:53.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301646+0000", 2024-09-13T05:11:53.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0429999999999999e-06 2024-09-13T05:11:53.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.417 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301657+0000", 2024-09-13T05:11:53.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0576e-05 2024-09-13T05:11:53.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.417 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301670+0000", 2024-09-13T05:11:53.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2792000000000001e-05 2024-09-13T05:11:53.418 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.418 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.418 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.418 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137782 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.418 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.309492+0000", 2024-09-13T05:11:53.418 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.011641744000000001, 2024-09-13T05:11:53.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013012599999999999, 2024-09-13T05:11:53.418 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.418 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.418 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.418 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.418 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.419 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137782 2024-09-13T05:11:53.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.419 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.419 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.419 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309492+0000", 2024-09-13T05:11:53.419 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.419 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.419 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309492+0000", 2024-09-13T05:11:53.419 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.420 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.420 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309491+0000", 2024-09-13T05:11:53.420 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.420 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.420 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.420 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.420 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309494+0000", 2024-09-13T05:11:53.420 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0649999999999999e-06 2024-09-13T05:11:53.420 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.420 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.420 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.420 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309501+0000", 2024-09-13T05:11:53.420 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6259999999999997e-06 2024-09-13T05:11:53.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.421 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.421 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.421 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309507+0000", 2024-09-13T05:11:53.421 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9170000000000003e-06 2024-09-13T05:11:53.421 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.421 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.421 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.421 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.421 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137814 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.421 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.317405+0000", 2024-09-13T05:11:53.421 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0037281520000000002, 2024-09-13T05:11:53.421 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.005156964, 2024-09-13T05:11:53.422 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.422 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.422 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.422 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.422 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.422 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137814 2024-09-13T05:11:53.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.422 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.422 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.422 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317405+0000", 2024-09-13T05:11:53.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317405+0000", 2024-09-13T05:11:53.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317405+0000", 2024-09-13T05:11:53.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317409+0000", 2024-09-13T05:11:53.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5460000000000002e-06 2024-09-13T05:11:53.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.424 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.424 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.424 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317421+0000", 2024-09-13T05:11:53.424 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1914e-05 2024-09-13T05:11:53.424 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.424 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.424 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.424 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317431+0000", 2024-09-13T05:11:53.424 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0346000000000001e-05 2024-09-13T05:11:53.424 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.424 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.424 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.424 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.425 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.425 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137623 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.425 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.273226+0000", 2024-09-13T05:11:53.425 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.047907651000000002, 2024-09-13T05:11:53.425 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.049399867, 2024-09-13T05:11:53.425 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.425 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.425 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.425 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.425 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.425 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137623 2024-09-13T05:11:53.425 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.425 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273226+0000", 2024-09-13T05:11:53.426 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.426 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273226+0000", 2024-09-13T05:11:53.426 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.426 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273225+0000", 2024-09-13T05:11:53.426 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.427 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273228+0000", 2024-09-13T05:11:53.427 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9019999999999999e-06 2024-09-13T05:11:53.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.427 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273235+0000", 2024-09-13T05:11:53.427 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.725e-06 2024-09-13T05:11:53.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.427 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273252+0000", 2024-09-13T05:11:53.428 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7104000000000001e-05 2024-09-13T05:11:53.428 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.428 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.428 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.428 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.428 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.428 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137655 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.428 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.281399+0000", 2024-09-13T05:11:53.428 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.039734336000000002, 2024-09-13T05:11:53.428 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.041285207999999997, 2024-09-13T05:11:53.428 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.428 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.428 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.429 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.429 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.429 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137655 2024-09-13T05:11:53.429 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.429 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.429 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.429 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.429 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281399+0000", 2024-09-13T05:11:53.429 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.429 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.429 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.429 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.429 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281399+0000", 2024-09-13T05:11:53.429 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.430 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.430 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.430 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.430 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281399+0000", 2024-09-13T05:11:53.430 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.430 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.430 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.430 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.430 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281402+0000", 2024-09-13T05:11:53.430 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1650000000000002e-06 2024-09-13T05:11:53.430 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.430 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.430 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.430 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281424+0000", 2024-09-13T05:11:53.431 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2439999999999999e-05 2024-09-13T05:11:53.431 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.431 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.431 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.431 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281431+0000", 2024-09-13T05:11:53.431 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5629999999999997e-06 2024-09-13T05:11:53.431 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.431 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.431 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.431 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.431 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.431 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137687 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.431 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.289062+0000", 2024-09-13T05:11:53.432 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.032071420000000003, 2024-09-13T05:11:53.432 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.033680565000000003, 2024-09-13T05:11:53.432 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.432 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.432 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.432 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.432 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.432 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137687 2024-09-13T05:11:53.432 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.432 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.432 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.432 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.432 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289062+0000", 2024-09-13T05:11:53.433 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.433 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.433 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.433 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.433 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289062+0000", 2024-09-13T05:11:53.433 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.433 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.433 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.433 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.433 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289061+0000", 2024-09-13T05:11:53.433 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.433 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.433 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.433 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.434 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289065+0000", 2024-09-13T05:11:53.434 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6169999999999998e-06 2024-09-13T05:11:53.434 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.434 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.434 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.434 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289072+0000", 2024-09-13T05:11:53.434 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8820000000000003e-06 2024-09-13T05:11:53.434 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.434 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.434 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.434 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289078+0000", 2024-09-13T05:11:53.434 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8950000000000003e-06 2024-09-13T05:11:53.434 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.434 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.435 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.435 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.435 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.435 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137719 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.435 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.297263+0000", 2024-09-13T05:11:53.435 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.023870824999999998, 2024-09-13T05:11:53.435 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.025537931999999999, 2024-09-13T05:11:53.435 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.435 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.435 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.435 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.435 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.435 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137719 2024-09-13T05:11:53.436 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.436 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.436 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.436 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.436 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297263+0000", 2024-09-13T05:11:53.436 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.436 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.436 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.436 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.436 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297263+0000", 2024-09-13T05:11:53.436 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.436 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.437 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.437 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.437 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297262+0000", 2024-09-13T05:11:53.437 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.437 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.437 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.437 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.437 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297265+0000", 2024-09-13T05:11:53.437 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.128e-06 2024-09-13T05:11:53.437 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.437 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.438 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.438 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297277+0000", 2024-09-13T05:11:53.438 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1848000000000001e-05 2024-09-13T05:11:53.438 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.438 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.438 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.438 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297283+0000", 2024-09-13T05:11:53.438 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9229999999999999e-06 2024-09-13T05:11:53.438 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.438 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.438 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.438 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.438 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.439 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137751 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.439 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.305041+0000", 2024-09-13T05:11:53.439 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.016092707000000001, 2024-09-13T05:11:53.439 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.017817771999999999, 2024-09-13T05:11:53.439 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.439 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.439 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.439 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.439 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.439 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137751 2024-09-13T05:11:53.439 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.439 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.439 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.440 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.440 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305041+0000", 2024-09-13T05:11:53.440 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.440 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.440 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.440 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.440 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305041+0000", 2024-09-13T05:11:53.440 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.440 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.440 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.440 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.440 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301675+0000", 2024-09-13T05:11:53.440 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9966345 2024-09-13T05:11:53.441 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.441 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.441 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.441 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305047+0000", 2024-09-13T05:11:53.441 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033718789999999999 2024-09-13T05:11:53.441 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.441 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.441 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.441 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305059+0000", 2024-09-13T05:11:53.441 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.242e-05 2024-09-13T05:11:53.441 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.441 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.441 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.442 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305071+0000", 2024-09-13T05:11:53.442 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1223000000000001e-05 2024-09-13T05:11:53.442 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.442 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.442 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.442 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.442 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.442 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137783 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.442 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.309512+0000", 2024-09-13T05:11:53.442 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.011621802000000001, 2024-09-13T05:11:53.442 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013405011999999999, 2024-09-13T05:11:53.442 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.442 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.443 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.443 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.443 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.443 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137783 2024-09-13T05:11:53.443 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.443 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.443 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.443 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.443 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309512+0000", 2024-09-13T05:11:53.443 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.443 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.443 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.443 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.443 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309512+0000", 2024-09-13T05:11:53.444 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.444 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.444 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309511+0000", 2024-09-13T05:11:53.444 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.444 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.444 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309520+0000", 2024-09-13T05:11:53.444 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8459999999999997e-06 2024-09-13T05:11:53.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.444 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.445 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309527+0000", 2024-09-13T05:11:53.445 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3200000000000002e-06 2024-09-13T05:11:53.445 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.445 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.445 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.445 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309533+0000", 2024-09-13T05:11:53.445 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1789999999999996e-06 2024-09-13T05:11:53.445 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.445 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.445 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.445 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.445 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.445 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137815 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.446 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.317444+0000", 2024-09-13T05:11:53.446 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0036897789999999998, 2024-09-13T05:11:53.446 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0055321249999999997, 2024-09-13T05:11:53.446 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.446 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.446 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.446 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.446 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.446 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137815 2024-09-13T05:11:53.446 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.446 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.446 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.447 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.447 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317444+0000", 2024-09-13T05:11:53.447 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.447 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.447 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.447 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.447 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317444+0000", 2024-09-13T05:11:53.447 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.447 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.447 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.447 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.447 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317443+0000", 2024-09-13T05:11:53.447 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.447 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.448 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.448 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.448 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317446+0000", 2024-09-13T05:11:53.448 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.145e-06 2024-09-13T05:11:53.448 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.448 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.448 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.448 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317459+0000", 2024-09-13T05:11:53.448 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3191e-05 2024-09-13T05:11:53.448 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.448 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.448 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.448 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317465+0000", 2024-09-13T05:11:53.448 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6969999999999998e-06 2024-09-13T05:11:53.449 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.449 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.449 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.449 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.449 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.449 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137624 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.449 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.273258+0000", 2024-09-13T05:11:53.449 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.047875499000000002, 2024-09-13T05:11:53.449 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.049776468999999997, 2024-09-13T05:11:53.449 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.449 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.449 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.449 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.450 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.450 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137624 2024-09-13T05:11:53.450 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.450 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.450 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.450 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.450 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273258+0000", 2024-09-13T05:11:53.450 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.450 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.450 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.450 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.450 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273258+0000", 2024-09-13T05:11:53.450 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.450 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.451 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.451 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.451 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273258+0000", 2024-09-13T05:11:53.451 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.451 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.451 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.451 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.451 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273261+0000", 2024-09-13T05:11:53.451 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9660000000000001e-06 2024-09-13T05:11:53.451 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.451 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.451 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.451 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273278+0000", 2024-09-13T05:11:53.452 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7985000000000001e-05 2024-09-13T05:11:53.452 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.452 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.452 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.452 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273290+0000", 2024-09-13T05:11:53.452 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1618e-05 2024-09-13T05:11:53.452 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.452 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.452 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.452 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.452 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.452 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137656 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.452 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.281436+0000", 2024-09-13T05:11:53.453 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.039697303000000003, 2024-09-13T05:11:53.453 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.041656738999999998, 2024-09-13T05:11:53.453 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.453 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.453 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.453 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.453 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.453 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137656 2024-09-13T05:11:53.453 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.453 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.453 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.453 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.453 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281436+0000", 2024-09-13T05:11:53.453 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.454 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.454 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.454 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.454 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281436+0000", 2024-09-13T05:11:53.454 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.454 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.454 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.454 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.454 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281436+0000", 2024-09-13T05:11:53.454 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.454 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.454 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.455 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.455 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281439+0000", 2024-09-13T05:11:53.455 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3000000000000002e-06 2024-09-13T05:11:53.455 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.455 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.455 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.455 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281446+0000", 2024-09-13T05:11:53.455 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9770000000000003e-06 2024-09-13T05:11:53.455 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.455 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.455 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.455 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281453+0000", 2024-09-13T05:11:53.455 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3050000000000004e-06 2024-09-13T05:11:53.456 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.456 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.456 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.456 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.456 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.456 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137688 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.456 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.289083+0000", 2024-09-13T05:11:53.456 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.032050266000000001, 2024-09-13T05:11:53.456 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034069467999999999, 2024-09-13T05:11:53.456 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.456 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.456 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.456 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.456 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.457 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137688 2024-09-13T05:11:53.457 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.457 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.457 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.457 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.457 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289083+0000", 2024-09-13T05:11:53.457 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.457 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.457 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.457 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.457 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289083+0000", 2024-09-13T05:11:53.457 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.457 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.458 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.458 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.458 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289083+0000", 2024-09-13T05:11:53.458 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.458 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.458 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.458 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.458 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289086+0000", 2024-09-13T05:11:53.458 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2140000000000001e-06 2024-09-13T05:11:53.458 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.458 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.458 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.458 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289093+0000", 2024-09-13T05:11:53.458 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7309999999999996e-06 2024-09-13T05:11:53.459 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.459 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.459 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.459 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289099+0000", 2024-09-13T05:11:53.459 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9349999999999999e-06 2024-09-13T05:11:53.459 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.459 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.459 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.459 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.459 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.459 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137720 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.459 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.297288+0000", 2024-09-13T05:11:53.459 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.023845449000000001, 2024-09-13T05:11:53.460 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.025922431999999999, 2024-09-13T05:11:53.460 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.460 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.460 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.460 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.460 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.460 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137720 2024-09-13T05:11:53.460 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.460 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.460 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.460 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.460 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297288+0000", 2024-09-13T05:11:53.460 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.460 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.460 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.461 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.461 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297288+0000", 2024-09-13T05:11:53.461 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.461 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.461 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.461 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.461 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297287+0000", 2024-09-13T05:11:53.461 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.461 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.461 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.461 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.461 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297290+0000", 2024-09-13T05:11:53.462 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0000000000000001e-06 2024-09-13T05:11:53.462 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.462 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.462 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.462 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297304+0000", 2024-09-13T05:11:53.462 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3354e-05 2024-09-13T05:11:53.462 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.462 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.462 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.462 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297317+0000", 2024-09-13T05:11:53.462 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3148e-05 2024-09-13T05:11:53.462 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.462 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.462 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.463 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.463 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.463 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137752 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.463 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.305079+0000", 2024-09-13T05:11:53.463 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.01605494, 2024-09-13T05:11:53.463 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.018199354000000001, 2024-09-13T05:11:53.463 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.463 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.463 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.463 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.464 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.464 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137752 2024-09-13T05:11:53.464 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.464 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.464 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.464 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.464 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305079+0000", 2024-09-13T05:11:53.464 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.464 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.464 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.464 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.464 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305079+0000", 2024-09-13T05:11:53.464 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.465 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.465 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.465 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.465 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305078+0000", 2024-09-13T05:11:53.465 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.465 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.465 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.465 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.465 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305081+0000", 2024-09-13T05:11:53.465 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6059999999999999e-06 2024-09-13T05:11:53.465 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.465 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.465 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.466 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305089+0000", 2024-09-13T05:11:53.466 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0999999999999998e-06 2024-09-13T05:11:53.466 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.466 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.466 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.466 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305095+0000", 2024-09-13T05:11:53.466 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2940000000000002e-06 2024-09-13T05:11:53.466 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.466 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.466 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.466 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.466 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.466 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137784 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.466 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.309572+0000", 2024-09-13T05:11:53.467 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.011561655000000001, 2024-09-13T05:11:53.467 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013766792999999999, 2024-09-13T05:11:53.467 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.467 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.467 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.467 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.467 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.467 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137784 2024-09-13T05:11:53.467 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.467 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.467 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.467 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.467 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309572+0000", 2024-09-13T05:11:53.467 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.468 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.468 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.468 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.468 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309572+0000", 2024-09-13T05:11:53.468 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.468 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.468 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.468 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.468 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309571+0000", 2024-09-13T05:11:53.468 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.468 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.468 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.468 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.468 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309575+0000", 2024-09-13T05:11:53.469 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.782e-06 2024-09-13T05:11:53.469 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.469 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.469 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.469 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309595+0000", 2024-09-13T05:11:53.469 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9763e-05 2024-09-13T05:11:53.469 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.469 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.469 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.469 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309605+0000", 2024-09-13T05:11:53.469 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0434e-05 2024-09-13T05:11:53.469 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.470 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.470 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.470 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.470 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.470 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137816 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.470 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.317470+0000", 2024-09-13T05:11:53.470 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.003663122, 2024-09-13T05:11:53.470 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0059261990000000001, 2024-09-13T05:11:53.470 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.470 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.470 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.470 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.470 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.471 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137816 2024-09-13T05:11:53.471 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.471 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.471 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.471 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.471 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317470+0000", 2024-09-13T05:11:53.471 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.471 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.471 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.471 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.471 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317470+0000", 2024-09-13T05:11:53.471 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.471 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.471 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.472 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.472 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317470+0000", 2024-09-13T05:11:53.472 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.472 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.472 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.472 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.472 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317473+0000", 2024-09-13T05:11:53.472 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9110000000000002e-06 2024-09-13T05:11:53.472 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.472 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.472 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.472 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317479+0000", 2024-09-13T05:11:53.472 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1770000000000003e-06 2024-09-13T05:11:53.473 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.473 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.473 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.473 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317485+0000", 2024-09-13T05:11:53.473 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7799999999999997e-06 2024-09-13T05:11:53.473 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.473 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.473 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.473 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.473 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.474 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137625 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.474 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.273301+0000", 2024-09-13T05:11:53.474 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.047832947000000001, 2024-09-13T05:11:53.474 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.050154823000000001, 2024-09-13T05:11:53.474 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.474 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.474 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.474 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.474 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.474 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137625 2024-09-13T05:11:53.474 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.474 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.474 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.475 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.475 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273301+0000", 2024-09-13T05:11:53.475 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.475 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.475 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.475 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.475 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273301+0000", 2024-09-13T05:11:53.475 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.475 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.475 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.475 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.475 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273300+0000", 2024-09-13T05:11:53.475 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.475 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.476 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.476 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.476 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273310+0000", 2024-09-13T05:11:53.476 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0338e-05 2024-09-13T05:11:53.476 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.476 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.476 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.476 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273325+0000", 2024-09-13T05:11:53.476 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.435e-05 2024-09-13T05:11:53.476 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.476 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.476 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.477 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273336+0000", 2024-09-13T05:11:53.477 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1104000000000001e-05 2024-09-13T05:11:53.477 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.477 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.477 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.477 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.477 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.477 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137657 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.477 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.281461+0000", 2024-09-13T05:11:53.477 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.039672315, 2024-09-13T05:11:53.477 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.042063194999999998, 2024-09-13T05:11:53.477 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.477 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.478 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.478 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.478 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.478 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137657 2024-09-13T05:11:53.478 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.478 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.478 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.478 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.478 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281461+0000", 2024-09-13T05:11:53.478 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.478 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.478 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.478 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.478 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281461+0000", 2024-09-13T05:11:53.479 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.479 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.479 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.479 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.479 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281461+0000", 2024-09-13T05:11:53.479 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.479 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.479 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.479 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.479 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281464+0000", 2024-09-13T05:11:53.479 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0769999999999999e-06 2024-09-13T05:11:53.479 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.479 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.479 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.480 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281486+0000", 2024-09-13T05:11:53.480 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2251000000000001e-05 2024-09-13T05:11:53.480 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.480 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.480 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.480 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281494+0000", 2024-09-13T05:11:53.480 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2029999999999992e-06 2024-09-13T05:11:53.480 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.480 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.480 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.480 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.480 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.480 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137689 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.481 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.289104+0000", 2024-09-13T05:11:53.481 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.032029949000000002, 2024-09-13T05:11:53.481 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034479540000000003, 2024-09-13T05:11:53.481 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.481 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.481 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.481 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.481 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.481 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137689 2024-09-13T05:11:53.481 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.481 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.481 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.481 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.481 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289104+0000", 2024-09-13T05:11:53.482 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.482 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.482 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.482 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.482 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289104+0000", 2024-09-13T05:11:53.482 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.482 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.482 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.482 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.482 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289103+0000", 2024-09-13T05:11:53.482 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.482 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.482 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.482 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.482 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289106+0000", 2024-09-13T05:11:53.483 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1709999999999998e-06 2024-09-13T05:11:53.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.483 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.483 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.483 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289113+0000", 2024-09-13T05:11:53.483 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7510000000000002e-06 2024-09-13T05:11:53.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.483 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.483 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.483 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289119+0000", 2024-09-13T05:11:53.483 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1720000000000004e-06 2024-09-13T05:11:53.483 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.483 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.483 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.484 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.484 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.484 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137721 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.484 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.297323+0000", 2024-09-13T05:11:53.484 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.023810778000000001, 2024-09-13T05:11:53.484 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.026327461999999999, 2024-09-13T05:11:53.484 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.484 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.484 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.484 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.484 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.484 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137721 2024-09-13T05:11:53.484 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.485 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.485 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.485 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.485 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297323+0000", 2024-09-13T05:11:53.485 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.485 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.485 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.485 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.485 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297323+0000", 2024-09-13T05:11:53.485 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.485 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.485 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.485 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.485 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297322+0000", 2024-09-13T05:11:53.486 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.486 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.486 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.486 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.486 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297325+0000", 2024-09-13T05:11:53.486 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.157e-06 2024-09-13T05:11:53.486 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.486 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.486 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.486 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297332+0000", 2024-09-13T05:11:53.486 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.888e-06 2024-09-13T05:11:53.486 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.486 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.486 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.486 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297339+0000", 2024-09-13T05:11:53.487 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5629999999999997e-06 2024-09-13T05:11:53.487 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.487 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.487 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.487 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.487 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.487 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137753 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.487 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.305100+0000", 2024-09-13T05:11:53.487 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.016033499999999999, 2024-09-13T05:11:53.487 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.01860856, 2024-09-13T05:11:53.487 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.487 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.487 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.487 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.488 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.488 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137753 2024-09-13T05:11:53.488 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.488 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.488 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.488 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.488 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305100+0000", 2024-09-13T05:11:53.488 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.488 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.488 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.488 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.488 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305100+0000", 2024-09-13T05:11:53.488 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.488 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.489 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.489 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.489 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305099+0000", 2024-09-13T05:11:53.489 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.489 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.489 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.489 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.489 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305103+0000", 2024-09-13T05:11:53.489 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3170000000000002e-06 2024-09-13T05:11:53.489 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.489 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.489 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.489 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305118+0000", 2024-09-13T05:11:53.489 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4926000000000001e-05 2024-09-13T05:11:53.490 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.490 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.490 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.490 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305124+0000", 2024-09-13T05:11:53.490 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.725e-06 2024-09-13T05:11:53.490 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.490 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.490 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.490 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.490 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.490 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137785 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.490 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.309611+0000", 2024-09-13T05:11:53.490 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.011522918, 2024-09-13T05:11:53.491 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.014156963999999999, 2024-09-13T05:11:53.491 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.491 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.491 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.491 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.491 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.491 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137785 2024-09-13T05:11:53.491 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.491 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.491 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.491 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.491 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309611+0000", 2024-09-13T05:11:53.491 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.492 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.492 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.492 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.492 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309611+0000", 2024-09-13T05:11:53.492 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.492 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.492 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.492 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.492 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309610+0000", 2024-09-13T05:11:53.492 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.492 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.492 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.492 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.493 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309613+0000", 2024-09-13T05:11:53.493 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4199999999999999e-06 2024-09-13T05:11:53.493 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.493 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.493 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.493 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309620+0000", 2024-09-13T05:11:53.493 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:11:53.493 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.493 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.493 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.493 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309626+0000", 2024-09-13T05:11:53.493 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0950000000000001e-06 2024-09-13T05:11:53.493 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.493 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.494 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.494 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.494 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.494 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137817 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.494 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.317490+0000", 2024-09-13T05:11:53.494 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0036437940000000001, 2024-09-13T05:11:53.494 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0063387590000000002, 2024-09-13T05:11:53.494 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.494 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.494 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.494 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.494 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.494 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137817 2024-09-13T05:11:53.494 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.495 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.495 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.495 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.495 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317490+0000", 2024-09-13T05:11:53.495 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.495 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.495 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.495 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.495 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317490+0000", 2024-09-13T05:11:53.495 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.495 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.495 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.495 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.495 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317489+0000", 2024-09-13T05:11:53.496 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.496 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.496 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.496 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.496 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317492+0000", 2024-09-13T05:11:53.496 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0920000000000002e-06 2024-09-13T05:11:53.496 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.496 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.496 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.496 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317498+0000", 2024-09-13T05:11:53.496 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2079999999999997e-06 2024-09-13T05:11:53.496 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.496 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.497 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.497 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317504+0000", 2024-09-13T05:11:53.497 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0340000000000002e-06 2024-09-13T05:11:53.497 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.497 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.497 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.497 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.497 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.497 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137626 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.497 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.273374+0000", 2024-09-13T05:11:53.497 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.047759132000000003, 2024-09-13T05:11:53.497 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.050512159000000001, 2024-09-13T05:11:53.497 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.497 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.498 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.498 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.498 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.498 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137626 2024-09-13T05:11:53.498 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.498 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.498 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.498 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.498 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273374+0000", 2024-09-13T05:11:53.498 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.498 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.498 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.498 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.498 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273374+0000", 2024-09-13T05:11:53.499 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.499 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.499 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.499 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.499 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273374+0000", 2024-09-13T05:11:53.499 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.499 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.499 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.499 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.499 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273377+0000", 2024-09-13T05:11:53.499 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5440000000000001e-06 2024-09-13T05:11:53.499 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.499 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.500 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.500 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273381+0000", 2024-09-13T05:11:53.500 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2749999999999997e-06 2024-09-13T05:11:53.500 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.500 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.500 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.500 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273384+0000", 2024-09-13T05:11:53.500 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6169999999999998e-06 2024-09-13T05:11:53.500 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.500 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.500 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.500 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.500 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.500 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137658 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.501 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.281500+0000", 2024-09-13T05:11:53.501 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.039633877999999997, 2024-09-13T05:11:53.501 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.042448015999999998, 2024-09-13T05:11:53.501 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.501 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.501 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.501 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.501 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.501 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137658 2024-09-13T05:11:53.501 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.501 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.501 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.501 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.501 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281500+0000", 2024-09-13T05:11:53.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.502 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.502 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.502 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.502 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281500+0000", 2024-09-13T05:11:53.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.502 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.502 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.502 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.502 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281499+0000", 2024-09-13T05:11:53.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.502 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.502 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.502 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.502 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281502+0000", 2024-09-13T05:11:53.503 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2169999999999999e-06 2024-09-13T05:11:53.503 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.503 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.503 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.503 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281509+0000", 2024-09-13T05:11:53.503 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9480000000000002e-06 2024-09-13T05:11:53.503 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.503 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.503 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.503 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281523+0000", 2024-09-13T05:11:53.503 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4063000000000001e-05 2024-09-13T05:11:53.503 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.503 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.504 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.504 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.504 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.504 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137690 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.504 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.289124+0000", 2024-09-13T05:11:53.504 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.032009375, 2024-09-13T05:11:53.504 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.034881954, 2024-09-13T05:11:53.504 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.504 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.504 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.504 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.504 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.504 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137690 2024-09-13T05:11:53.504 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.505 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.505 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.505 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.505 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289124+0000", 2024-09-13T05:11:53.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.505 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.505 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.505 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289124+0000", 2024-09-13T05:11:53.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.505 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.506 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.506 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289124+0000", 2024-09-13T05:11:53.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.506 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.506 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.506 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289127+0000", 2024-09-13T05:11:53.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2799999999999999e-06 2024-09-13T05:11:53.506 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.506 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.506 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289134+0000", 2024-09-13T05:11:53.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7479999999999996e-06 2024-09-13T05:11:53.506 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.507 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.507 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289140+0000", 2024-09-13T05:11:53.507 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1369999999999999e-06 2024-09-13T05:11:53.507 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.507 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.507 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.507 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137722 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.507 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.297345+0000", 2024-09-13T05:11:53.507 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.023788413000000001, 2024-09-13T05:11:53.507 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.026722884999999998, 2024-09-13T05:11:53.507 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.508 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.508 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.508 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.508 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.508 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137722 2024-09-13T05:11:53.508 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.508 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.508 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.508 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.508 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297345+0000", 2024-09-13T05:11:53.508 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.508 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.508 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.509 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.509 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297345+0000", 2024-09-13T05:11:53.509 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.509 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.509 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.509 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.509 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297345+0000", 2024-09-13T05:11:53.509 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.509 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.509 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.509 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.509 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297364+0000", 2024-09-13T05:11:53.509 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9000000000000001e-05 2024-09-13T05:11:53.509 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.510 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.510 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.510 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297373+0000", 2024-09-13T05:11:53.510 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4429999999999992e-06 2024-09-13T05:11:53.510 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.510 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.510 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.510 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297381+0000", 2024-09-13T05:11:53.510 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6109999999999996e-06 2024-09-13T05:11:53.510 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.510 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.510 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.510 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.511 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.511 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137754 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.511 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.305129+0000", 2024-09-13T05:11:53.511 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.016004068999999999, 2024-09-13T05:11:53.511 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019014683000000001, 2024-09-13T05:11:53.511 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.511 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.511 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.511 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.511 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.511 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137754 2024-09-13T05:11:53.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.511 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.511 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.512 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.512 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305129+0000", 2024-09-13T05:11:53.512 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.512 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.512 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.512 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305129+0000", 2024-09-13T05:11:53.512 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.512 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.512 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.512 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305129+0000", 2024-09-13T05:11:53.512 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.513 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.513 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.513 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305132+0000", 2024-09-13T05:11:53.513 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3170000000000002e-06 2024-09-13T05:11:53.513 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.513 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.513 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305139+0000", 2024-09-13T05:11:53.513 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6649999999999997e-06 2024-09-13T05:11:53.513 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.513 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.514 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305145+0000", 2024-09-13T05:11:53.514 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9290000000000003e-06 2024-09-13T05:11:53.514 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.514 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.514 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.514 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.514 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.514 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137786 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.514 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.309631+0000", 2024-09-13T05:11:53.514 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.011502004, 2024-09-13T05:11:53.514 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.014577626999999999, 2024-09-13T05:11:53.514 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.514 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.514 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.515 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.515 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.515 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137786 2024-09-13T05:11:53.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.515 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.515 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.515 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309631+0000", 2024-09-13T05:11:53.515 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.515 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.515 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309631+0000", 2024-09-13T05:11:53.515 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.516 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.516 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.516 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.516 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309631+0000", 2024-09-13T05:11:53.516 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.516 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.516 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.516 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.516 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309634+0000", 2024-09-13T05:11:53.516 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0019999999999998e-06 2024-09-13T05:11:53.516 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.516 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.516 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.516 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309644+0000", 2024-09-13T05:11:53.517 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6569999999999992e-06 2024-09-13T05:11:53.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.517 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.517 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309664+0000", 2024-09-13T05:11:53.517 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0003000000000001e-05 2024-09-13T05:11:53.517 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.517 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.517 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.517 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137818 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.517 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.317509+0000", 2024-09-13T05:11:53.518 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0036244599999999999, 2024-09-13T05:11:53.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0067582629999999996, 2024-09-13T05:11:53.518 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.518 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.518 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.518 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.518 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.518 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137818 2024-09-13T05:11:53.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.518 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.518 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.518 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317509+0000", 2024-09-13T05:11:53.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.519 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317509+0000", 2024-09-13T05:11:53.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.519 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317508+0000", 2024-09-13T05:11:53.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.519 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317511+0000", 2024-09-13T05:11:53.520 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.886e-06 2024-09-13T05:11:53.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.520 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.520 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317518+0000", 2024-09-13T05:11:53.520 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2079999999999997e-06 2024-09-13T05:11:53.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.520 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.520 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317523+0000", 2024-09-13T05:11:53.520 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.823e-06 2024-09-13T05:11:53.520 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.521 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.521 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.521 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137627 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.521 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.273388+0000", 2024-09-13T05:11:53.521 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.047745506, 2024-09-13T05:11:53.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.050940592999999999, 2024-09-13T05:11:53.521 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.521 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.521 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.521 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.521 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.521 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137627 2024-09-13T05:11:53.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.522 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273388+0000", 2024-09-13T05:11:53.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273388+0000", 2024-09-13T05:11:53.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273388+0000", 2024-09-13T05:11:53.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.523 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273389+0000", 2024-09-13T05:11:53.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.795e-06 2024-09-13T05:11:53.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.523 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273394+0000", 2024-09-13T05:11:53.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2150000000000003e-06 2024-09-13T05:11:53.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273397+0000", 2024-09-13T05:11:53.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2289999999999999e-06 2024-09-13T05:11:53.524 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.524 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.524 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.524 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137659 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.524 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.281541+0000", 2024-09-13T05:11:53.524 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.039592556000000001, 2024-09-13T05:11:53.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.042846461000000002, 2024-09-13T05:11:53.524 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.524 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.525 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.525 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.525 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.525 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137659 2024-09-13T05:11:53.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.525 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.525 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.525 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281541+0000", 2024-09-13T05:11:53.525 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.525 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.526 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281541+0000", 2024-09-13T05:11:53.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.526 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.526 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281540+0000", 2024-09-13T05:11:53.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.526 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.526 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281544+0000", 2024-09-13T05:11:53.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.348e-06 2024-09-13T05:11:53.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281563+0000", 2024-09-13T05:11:53.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9363000000000001e-05 2024-09-13T05:11:53.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281569+0000", 2024-09-13T05:11:53.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0079999999999999e-06 2024-09-13T05:11:53.527 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.527 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.527 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.527 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137691 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.528 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.289145+0000", 2024-09-13T05:11:53.528 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.031988480999999999, 2024-09-13T05:11:53.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035303532999999998, 2024-09-13T05:11:53.528 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.528 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.528 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.528 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.528 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.528 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137691 2024-09-13T05:11:53.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.528 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.528 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.529 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289145+0000", 2024-09-13T05:11:53.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.529 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.529 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289145+0000", 2024-09-13T05:11:53.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.529 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.529 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289144+0000", 2024-09-13T05:11:53.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.530 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.530 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289148+0000", 2024-09-13T05:11:53.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2780000000000002e-06 2024-09-13T05:11:53.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.530 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.530 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289154+0000", 2024-09-13T05:11:53.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7710000000000001e-06 2024-09-13T05:11:53.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.530 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.530 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289160+0000", 2024-09-13T05:11:53.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8080000000000001e-06 2024-09-13T05:11:53.531 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.531 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.531 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.531 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137723 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.531 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.297386+0000", 2024-09-13T05:11:53.531 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.023747201999999999, 2024-09-13T05:11:53.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.027120853, 2024-09-13T05:11:53.531 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.531 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.531 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.531 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.531 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.532 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137723 2024-09-13T05:11:53.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.532 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297386+0000", 2024-09-13T05:11:53.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297386+0000", 2024-09-13T05:11:53.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297386+0000", 2024-09-13T05:11:53.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297389+0000", 2024-09-13T05:11:53.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2969999999999999e-06 2024-09-13T05:11:53.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297397+0000", 2024-09-13T05:11:53.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0630000000000006e-06 2024-09-13T05:11:53.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297404+0000", 2024-09-13T05:11:53.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6619999999999999e-06 2024-09-13T05:11:53.534 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.534 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.534 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.534 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137755 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.534 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.305150+0000", 2024-09-13T05:11:53.535 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.015983501000000001, 2024-09-13T05:11:53.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019418728, 2024-09-13T05:11:53.535 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.535 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.535 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.535 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.535 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.535 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137755 2024-09-13T05:11:53.535 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.535 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.535 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.535 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305150+0000", 2024-09-13T05:11:53.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305150+0000", 2024-09-13T05:11:53.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305149+0000", 2024-09-13T05:11:53.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305153+0000", 2024-09-13T05:11:53.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.117e-06 2024-09-13T05:11:53.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305159+0000", 2024-09-13T05:11:53.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5799999999999997e-06 2024-09-13T05:11:53.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305165+0000", 2024-09-13T05:11:53.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7189999999999998e-06 2024-09-13T05:11:53.538 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.538 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.538 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.538 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137787 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.538 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.309682+0000", 2024-09-13T05:11:53.538 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.011451951, 2024-09-13T05:11:53.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.014944531, 2024-09-13T05:11:53.538 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.538 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.538 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.538 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.539 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.539 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137787 2024-09-13T05:11:53.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.539 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.539 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.539 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309682+0000", 2024-09-13T05:11:53.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.539 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.539 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309682+0000", 2024-09-13T05:11:53.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.540 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.540 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309681+0000", 2024-09-13T05:11:53.540 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.540 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.540 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309684+0000", 2024-09-13T05:11:53.540 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:11:53.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.540 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.540 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309691+0000", 2024-09-13T05:11:53.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9550000000000003e-06 2024-09-13T05:11:53.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309698+0000", 2024-09-13T05:11:53.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.4019999999999996e-06 2024-09-13T05:11:53.541 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.541 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.541 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.541 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137819 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.541 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.317528+0000", 2024-09-13T05:11:53.542 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0036055039999999998, 2024-09-13T05:11:53.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0071557440000000003, 2024-09-13T05:11:53.542 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.542 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.542 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.542 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.542 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.542 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137819 2024-09-13T05:11:53.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.542 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317528+0000", 2024-09-13T05:11:53.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317528+0000", 2024-09-13T05:11:53.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317527+0000", 2024-09-13T05:11:53.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317530+0000", 2024-09-13T05:11:53.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8770000000000002e-06 2024-09-13T05:11:53.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.544 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317537+0000", 2024-09-13T05:11:53.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1800000000000001e-06 2024-09-13T05:11:53.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.544 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317542+0000", 2024-09-13T05:11:53.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5770000000000001e-06 2024-09-13T05:11:53.544 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.544 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.545 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.545 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137628 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.545 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.273401+0000", 2024-09-13T05:11:53.545 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.047732318000000003, 2024-09-13T05:11:53.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.051343501, 2024-09-13T05:11:53.545 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.545 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.545 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.545 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.545 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.545 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137628 2024-09-13T05:11:53.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.546 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273401+0000", 2024-09-13T05:11:53.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273401+0000", 2024-09-13T05:11:53.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273401+0000", 2024-09-13T05:11:53.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273403+0000", 2024-09-13T05:11:53.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9269999999999999e-06 2024-09-13T05:11:53.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273411+0000", 2024-09-13T05:11:53.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0190000000000006e-06 2024-09-13T05:11:53.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273418+0000", 2024-09-13T05:11:53.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6899999999999992e-06 2024-09-13T05:11:53.548 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.548 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.548 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.548 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137660 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.548 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.281603+0000", 2024-09-13T05:11:53.548 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.039530058, 2024-09-13T05:11:53.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.043199568000000001, 2024-09-13T05:11:53.548 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.549 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.549 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.549 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.549 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.549 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137660 2024-09-13T05:11:53.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.549 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281603+0000", 2024-09-13T05:11:53.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281603+0000", 2024-09-13T05:11:53.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281603+0000", 2024-09-13T05:11:53.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281606+0000", 2024-09-13T05:11:53.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2720000000000002e-06 2024-09-13T05:11:53.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281620+0000", 2024-09-13T05:11:53.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3961999999999999e-05 2024-09-13T05:11:53.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281630+0000", 2024-09-13T05:11:53.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5920000000000007e-06 2024-09-13T05:11:53.551 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.551 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.551 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.552 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137692 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.552 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.289166+0000", 2024-09-13T05:11:53.552 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.031967958999999997, 2024-09-13T05:11:53.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035698044999999998, 2024-09-13T05:11:53.552 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.552 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.552 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.552 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.552 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.552 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137692 2024-09-13T05:11:53.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.552 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.553 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.553 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289166+0000", 2024-09-13T05:11:53.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.553 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.553 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289166+0000", 2024-09-13T05:11:53.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.553 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.553 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289165+0000", 2024-09-13T05:11:53.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289168+0000", 2024-09-13T05:11:53.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0800000000000002e-06 2024-09-13T05:11:53.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289175+0000", 2024-09-13T05:11:53.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7139999999999996e-06 2024-09-13T05:11:53.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289181+0000", 2024-09-13T05:11:53.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8510000000000004e-06 2024-09-13T05:11:53.555 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.555 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.555 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.555 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137724 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.555 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.297409+0000", 2024-09-13T05:11:53.555 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.023724648000000001, 2024-09-13T05:11:53.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.02751259, 2024-09-13T05:11:53.555 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.555 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.555 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.555 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.556 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.556 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137724 2024-09-13T05:11:53.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.556 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297409+0000", 2024-09-13T05:11:53.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297409+0000", 2024-09-13T05:11:53.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297408+0000", 2024-09-13T05:11:53.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297411+0000", 2024-09-13T05:11:53.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0599999999999999e-06 2024-09-13T05:11:53.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297429+0000", 2024-09-13T05:11:53.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7577000000000001e-05 2024-09-13T05:11:53.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297436+0000", 2024-09-13T05:11:53.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1799999999999999e-06 2024-09-13T05:11:53.558 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.558 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.558 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.558 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137756 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.558 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.305170+0000", 2024-09-13T05:11:53.559 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.015963683999999999, 2024-09-13T05:11:53.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.019828018999999999, 2024-09-13T05:11:53.559 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.559 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.559 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.559 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.559 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.559 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137756 2024-09-13T05:11:53.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.559 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305170+0000", 2024-09-13T05:11:53.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305170+0000", 2024-09-13T05:11:53.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305169+0000", 2024-09-13T05:11:53.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305172+0000", 2024-09-13T05:11:53.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2430000000000001e-06 2024-09-13T05:11:53.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305179+0000", 2024-09-13T05:11:53.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6889999999999998e-06 2024-09-13T05:11:53.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305185+0000", 2024-09-13T05:11:53.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.879e-06 2024-09-13T05:11:53.561 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.562 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.562 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.562 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137788 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.562 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.309705+0000", 2024-09-13T05:11:53.562 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.011428377, 2024-09-13T05:11:53.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.015350344, 2024-09-13T05:11:53.562 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.562 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.562 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.562 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.562 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.562 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137788 2024-09-13T05:11:53.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.563 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309705+0000", 2024-09-13T05:11:53.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309705+0000", 2024-09-13T05:11:53.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309705+0000", 2024-09-13T05:11:53.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309707+0000", 2024-09-13T05:11:53.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8940000000000002e-06 2024-09-13T05:11:53.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309729+0000", 2024-09-13T05:11:53.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1237e-05 2024-09-13T05:11:53.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309736+0000", 2024-09-13T05:11:53.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9029999999999998e-06 2024-09-13T05:11:53.565 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.565 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.565 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.565 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137820 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.566 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.317547+0000", 2024-09-13T05:11:53.566 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0035864149999999999, 2024-09-13T05:11:53.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0075761759999999996, 2024-09-13T05:11:53.566 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.566 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.566 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.566 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.566 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.566 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137820 2024-09-13T05:11:53.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.566 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317547+0000", 2024-09-13T05:11:53.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317547+0000", 2024-09-13T05:11:53.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317547+0000", 2024-09-13T05:11:53.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317554+0000", 2024-09-13T05:11:53.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7349999999999996e-06 2024-09-13T05:11:53.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317561+0000", 2024-09-13T05:11:53.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4649999999999999e-06 2024-09-13T05:11:53.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317566+0000", 2024-09-13T05:11:53.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6030000000000004e-06 2024-09-13T05:11:53.569 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.569 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.569 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.569 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137629 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.569 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.273421+0000", 2024-09-13T05:11:53.569 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.04771222, 2024-09-13T05:11:53.569 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.051760142000000002, 2024-09-13T05:11:53.569 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.569 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.569 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.569 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.570 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.570 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137629 2024-09-13T05:11:53.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.570 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.570 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.570 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273421+0000", 2024-09-13T05:11:53.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.570 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.570 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273421+0000", 2024-09-13T05:11:53.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.571 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.571 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.571 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273421+0000", 2024-09-13T05:11:53.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.571 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.571 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.571 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273423+0000", 2024-09-13T05:11:53.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8479999999999999e-06 2024-09-13T05:11:53.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.571 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.571 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.571 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273429+0000", 2024-09-13T05:11:53.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9730000000000002e-06 2024-09-13T05:11:53.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273432+0000", 2024-09-13T05:11:53.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:11:53.572 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.572 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.572 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.572 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137661 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.572 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.281635+0000", 2024-09-13T05:11:53.572 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.039498015999999997, 2024-09-13T05:11:53.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.043606732000000002, 2024-09-13T05:11:53.573 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.573 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.573 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.573 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.573 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.573 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137661 2024-09-13T05:11:53.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.573 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.574 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281635+0000", 2024-09-13T05:11:53.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.574 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.574 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281635+0000", 2024-09-13T05:11:53.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.574 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.574 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281635+0000", 2024-09-13T05:11:53.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.575 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.575 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281638+0000", 2024-09-13T05:11:53.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3349999999999998e-06 2024-09-13T05:11:53.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.575 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.575 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281645+0000", 2024-09-13T05:11:53.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7789999999999998e-06 2024-09-13T05:11:53.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.575 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.575 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281659+0000", 2024-09-13T05:11:53.576 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4432e-05 2024-09-13T05:11:53.576 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.576 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.576 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.576 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.576 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137693 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.576 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.289187+0000", 2024-09-13T05:11:53.576 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.031946157000000003, 2024-09-13T05:11:53.576 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036118010999999998, 2024-09-13T05:11:53.576 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.576 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.577 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.577 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.577 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.577 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137693 2024-09-13T05:11:53.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.577 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.577 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289187+0000", 2024-09-13T05:11:53.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.577 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289187+0000", 2024-09-13T05:11:53.578 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.578 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289187+0000", 2024-09-13T05:11:53.578 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.578 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289190+0000", 2024-09-13T05:11:53.578 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:11:53.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289197+0000", 2024-09-13T05:11:53.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8090000000000004e-06 2024-09-13T05:11:53.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289202+0000", 2024-09-13T05:11:53.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7309999999999998e-06 2024-09-13T05:11:53.579 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.579 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.579 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.579 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137725 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.580 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.297460+0000", 2024-09-13T05:11:53.580 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.023673377999999998, 2024-09-13T05:11:53.580 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.027923656000000002, 2024-09-13T05:11:53.580 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.580 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.580 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.580 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.580 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.580 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137725 2024-09-13T05:11:53.580 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.580 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.580 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.580 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297460+0000", 2024-09-13T05:11:53.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297460+0000", 2024-09-13T05:11:53.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297459+0000", 2024-09-13T05:11:53.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297463+0000", 2024-09-13T05:11:53.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0339999999999998e-06 2024-09-13T05:11:53.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297472+0000", 2024-09-13T05:11:53.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6400000000000003e-06 2024-09-13T05:11:53.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.584 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.584 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.584 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297478+0000", 2024-09-13T05:11:53.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0939999999999996e-06 2024-09-13T05:11:53.584 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.584 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.584 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.584 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.585 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137757 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.585 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.305192+0000", 2024-09-13T05:11:53.585 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.015941515999999999, 2024-09-13T05:11:53.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020250502, 2024-09-13T05:11:53.585 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.585 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.585 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.585 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.585 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.585 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137757 2024-09-13T05:11:53.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.585 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305192+0000", 2024-09-13T05:11:53.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305192+0000", 2024-09-13T05:11:53.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305191+0000", 2024-09-13T05:11:53.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.587 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305195+0000", 2024-09-13T05:11:53.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2370000000000001e-06 2024-09-13T05:11:53.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.587 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305201+0000", 2024-09-13T05:11:53.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7109999999999998e-06 2024-09-13T05:11:53.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.587 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305207+0000", 2024-09-13T05:11:53.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8259999999999998e-06 2024-09-13T05:11:53.587 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.588 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.588 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.588 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.588 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137789 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.588 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.313001+0000", 2024-09-13T05:11:53.588 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0081324640000000007, 2024-09-13T05:11:53.588 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.012501817, 2024-09-13T05:11:53.588 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.588 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.588 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.588 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.588 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.588 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137789 2024-09-13T05:11:53.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.589 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313001+0000", 2024-09-13T05:11:53.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313001+0000", 2024-09-13T05:11:53.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309740+0000", 2024-09-13T05:11:53.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9967394 2024-09-13T05:11:53.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313007+0000", 2024-09-13T05:11:53.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003266925 2024-09-13T05:11:53.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313019+0000", 2024-09-13T05:11:53.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2217e-05 2024-09-13T05:11:53.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313027+0000", 2024-09-13T05:11:53.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6879999999999999e-06 2024-09-13T05:11:53.591 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.591 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.591 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.591 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137821 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.591 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.317573+0000", 2024-09-13T05:11:53.591 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.003560976, 2024-09-13T05:11:53.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0079883119999999991, 2024-09-13T05:11:53.591 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.591 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.591 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.592 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.592 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.592 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137821 2024-09-13T05:11:53.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.592 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.592 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317573+0000", 2024-09-13T05:11:53.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.592 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317573+0000", 2024-09-13T05:11:53.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.593 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.593 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.593 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.593 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317572+0000", 2024-09-13T05:11:53.593 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.593 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.593 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.593 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.593 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317575+0000", 2024-09-13T05:11:53.593 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0060000000000001e-06 2024-09-13T05:11:53.593 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.593 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.593 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.593 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317581+0000", 2024-09-13T05:11:53.594 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1879999999999999e-06 2024-09-13T05:11:53.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.594 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.594 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.594 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317587+0000", 2024-09-13T05:11:53.594 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7969999999999997e-06 2024-09-13T05:11:53.594 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.594 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.594 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.594 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.594 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137630 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.594 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.277148+0000", 2024-09-13T05:11:53.594 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.043985103999999997, 2024-09-13T05:11:53.594 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048475599000000001, 2024-09-13T05:11:53.595 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.595 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.595 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.595 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.595 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.595 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137630 2024-09-13T05:11:53.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.595 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.595 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277148+0000", 2024-09-13T05:11:53.595 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277148+0000", 2024-09-13T05:11:53.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.273435+0000", 2024-09-13T05:11:53.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9962864 2024-09-13T05:11:53.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277153+0000", 2024-09-13T05:11:53.597 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0037180220000000001 2024-09-13T05:11:53.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.597 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.597 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.597 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277169+0000", 2024-09-13T05:11:53.597 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5858e-05 2024-09-13T05:11:53.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.597 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.597 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.597 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277181+0000", 2024-09-13T05:11:53.597 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2896e-05 2024-09-13T05:11:53.597 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.597 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.597 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.598 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.598 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137662 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.598 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.281672+0000", 2024-09-13T05:11:53.598 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.039461608000000002, 2024-09-13T05:11:53.598 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.044010589000000003, 2024-09-13T05:11:53.598 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.598 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.598 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.598 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.598 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.598 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137662 2024-09-13T05:11:53.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.598 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.598 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.599 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281672+0000", 2024-09-13T05:11:53.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.599 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281672+0000", 2024-09-13T05:11:53.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.599 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281671+0000", 2024-09-13T05:11:53.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.600 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281680+0000", 2024-09-13T05:11:53.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9029999999999993e-06 2024-09-13T05:11:53.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.600 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281691+0000", 2024-09-13T05:11:53.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1103e-05 2024-09-13T05:11:53.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.600 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281698+0000", 2024-09-13T05:11:53.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4509999999999997e-06 2024-09-13T05:11:53.601 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.601 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.601 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.601 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.601 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137694 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.601 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.289208+0000", 2024-09-13T05:11:53.601 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.031925663, 2024-09-13T05:11:53.601 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036532864999999998, 2024-09-13T05:11:53.601 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.601 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.601 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.601 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.601 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.602 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137694 2024-09-13T05:11:53.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.602 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289208+0000", 2024-09-13T05:11:53.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289208+0000", 2024-09-13T05:11:53.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.603 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289207+0000", 2024-09-13T05:11:53.603 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.603 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.603 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.603 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.603 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289210+0000", 2024-09-13T05:11:53.603 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2030000000000001e-06 2024-09-13T05:11:53.603 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.603 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.603 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.603 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289217+0000", 2024-09-13T05:11:53.603 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7449999999999998e-06 2024-09-13T05:11:53.603 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.603 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.604 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.604 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289223+0000", 2024-09-13T05:11:53.604 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8340000000000004e-06 2024-09-13T05:11:53.604 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.604 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.604 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.604 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137726 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.604 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.297483+0000", 2024-09-13T05:11:53.604 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.023650021, 2024-09-13T05:11:53.604 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.028315269000000001, 2024-09-13T05:11:53.604 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.604 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.605 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.605 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.605 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.605 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137726 2024-09-13T05:11:53.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.605 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.605 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.605 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297483+0000", 2024-09-13T05:11:53.605 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.605 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.605 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297483+0000", 2024-09-13T05:11:53.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.606 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297483+0000", 2024-09-13T05:11:53.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.606 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297486+0000", 2024-09-13T05:11:53.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.18e-06 2024-09-13T05:11:53.606 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.607 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297504+0000", 2024-09-13T05:11:53.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7697e-05 2024-09-13T05:11:53.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.607 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.607 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297512+0000", 2024-09-13T05:11:53.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0970000000000006e-06 2024-09-13T05:11:53.607 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.607 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.607 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.607 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137758 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.607 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.305212+0000", 2024-09-13T05:11:53.607 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.015921185000000001, 2024-09-13T05:11:53.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020644142000000001, 2024-09-13T05:11:53.608 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.608 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.608 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.608 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.608 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.608 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137758 2024-09-13T05:11:53.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.608 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.608 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.608 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305212+0000", 2024-09-13T05:11:53.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305212+0000", 2024-09-13T05:11:53.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305212+0000", 2024-09-13T05:11:53.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305215+0000", 2024-09-13T05:11:53.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:11:53.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305221+0000", 2024-09-13T05:11:53.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6830000000000002e-06 2024-09-13T05:11:53.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305227+0000", 2024-09-13T05:11:53.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7649999999999999e-06 2024-09-13T05:11:53.610 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.610 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.610 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.611 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137790 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.611 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.313037+0000", 2024-09-13T05:11:53.611 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0080968759999999994, 2024-09-13T05:11:53.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.01287773, 2024-09-13T05:11:53.611 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.611 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.611 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.611 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.611 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.611 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137790 2024-09-13T05:11:53.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.611 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313037+0000", 2024-09-13T05:11:53.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313037+0000", 2024-09-13T05:11:53.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313036+0000", 2024-09-13T05:11:53.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:53.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.613 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.613 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313039+0000", 2024-09-13T05:11:53.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4860000000000002e-06 2024-09-13T05:11:53.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.613 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.613 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313046+0000", 2024-09-13T05:11:53.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8859999999999998e-06 2024-09-13T05:11:53.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.613 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.613 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313052+0000", 2024-09-13T05:11:53.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2999999999999998e-06 2024-09-13T05:11:53.614 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.614 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.614 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.614 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137822 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.614 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.320996+0000", 2024-09-13T05:11:53.614 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.00013781399999999999, 2024-09-13T05:11:53.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.004977853, 2024-09-13T05:11:53.614 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.614 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.614 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.614 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.614 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.615 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137822 2024-09-13T05:11:53.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.615 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.320996+0000", 2024-09-13T05:11:53.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.320996+0000", 2024-09-13T05:11:53.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317591+0000", 2024-09-13T05:11:53.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9965954 2024-09-13T05:11:53.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321002+0000", 2024-09-13T05:11:53.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0034107909999999998 2024-09-13T05:11:53.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321022+0000", 2024-09-13T05:11:53.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0401999999999999e-05 2024-09-13T05:11:53.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321031+0000", 2024-09-13T05:11:53.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6540000000000005e-06 2024-09-13T05:11:53.617 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.617 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.617 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.617 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137631 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.617 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.277194+0000", 2024-09-13T05:11:53.617 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.043939735000000001, 2024-09-13T05:11:53.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048840821, 2024-09-13T05:11:53.617 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.617 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.618 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.618 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.618 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.618 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137631 2024-09-13T05:11:53.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.618 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.618 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.618 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277194+0000", 2024-09-13T05:11:53.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.618 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.618 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277194+0000", 2024-09-13T05:11:53.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277193+0000", 2024-09-13T05:11:53.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277197+0000", 2024-09-13T05:11:53.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4850000000000001e-06 2024-09-13T05:11:53.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277203+0000", 2024-09-13T05:11:53.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7619999999999998e-06 2024-09-13T05:11:53.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277209+0000", 2024-09-13T05:11:53.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8969999999999996e-06 2024-09-13T05:11:53.620 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.620 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.620 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.620 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137663 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.620 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.281704+0000", 2024-09-13T05:11:53.621 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.039429939999999997, 2024-09-13T05:11:53.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.044389186999999997, 2024-09-13T05:11:53.621 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.621 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.621 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.621 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.621 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.621 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137663 2024-09-13T05:11:53.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.621 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281704+0000", 2024-09-13T05:11:53.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281704+0000", 2024-09-13T05:11:53.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281703+0000", 2024-09-13T05:11:53.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281706+0000", 2024-09-13T05:11:53.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.405e-06 2024-09-13T05:11:53.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281713+0000", 2024-09-13T05:11:53.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6969999999999996e-06 2024-09-13T05:11:53.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281719+0000", 2024-09-13T05:11:53.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1829999999999999e-06 2024-09-13T05:11:53.623 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.623 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.623 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.624 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137695 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.624 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.289230+0000", 2024-09-13T05:11:53.624 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.031903803000000001, 2024-09-13T05:11:53.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036920754, 2024-09-13T05:11:53.624 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.624 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.624 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.624 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.624 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.624 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137695 2024-09-13T05:11:53.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.624 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289230+0000", 2024-09-13T05:11:53.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289230+0000", 2024-09-13T05:11:53.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289229+0000", 2024-09-13T05:11:53.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.626 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.626 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.626 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289232+0000", 2024-09-13T05:11:53.626 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2169999999999999e-06 2024-09-13T05:11:53.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.626 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.626 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.626 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289239+0000", 2024-09-13T05:11:53.626 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8170000000000001e-06 2024-09-13T05:11:53.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.626 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.626 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.626 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289245+0000", 2024-09-13T05:11:53.626 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9059999999999999e-06 2024-09-13T05:11:53.627 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.627 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.627 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.627 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137727 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.627 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.297519+0000", 2024-09-13T05:11:53.627 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.023614362, 2024-09-13T05:11:53.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.028689294000000001, 2024-09-13T05:11:53.627 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.627 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.627 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.627 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.627 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.628 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137727 2024-09-13T05:11:53.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.628 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.628 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.628 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297519+0000", 2024-09-13T05:11:53.628 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.628 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.628 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297519+0000", 2024-09-13T05:11:53.628 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.629 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.629 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297519+0000", 2024-09-13T05:11:53.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.629 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.629 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297522+0000", 2024-09-13T05:11:53.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4290000000000001e-06 2024-09-13T05:11:53.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.629 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.629 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297529+0000", 2024-09-13T05:11:53.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8990000000000004e-06 2024-09-13T05:11:53.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.630 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.630 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297535+0000", 2024-09-13T05:11:53.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8830000000000003e-06 2024-09-13T05:11:53.630 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.630 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.630 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.630 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.630 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137759 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.630 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.305232+0000", 2024-09-13T05:11:53.630 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.015900991999999999, 2024-09-13T05:11:53.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.021033863, 2024-09-13T05:11:53.630 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.630 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.631 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.631 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.631 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.631 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137759 2024-09-13T05:11:53.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.631 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.631 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.631 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.631 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305232+0000", 2024-09-13T05:11:53.631 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.631 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.631 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.631 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305232+0000", 2024-09-13T05:11:53.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.632 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.632 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305232+0000", 2024-09-13T05:11:53.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:53.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.632 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.632 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305241+0000", 2024-09-13T05:11:53.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5619999999999993e-06 2024-09-13T05:11:53.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.632 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.632 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305248+0000", 2024-09-13T05:11:53.633 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0859999999999996e-06 2024-09-13T05:11:53.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.633 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.633 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305254+0000", 2024-09-13T05:11:53.633 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7849999999999997e-06 2024-09-13T05:11:53.633 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.633 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.633 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.633 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137791 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.633 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.313059+0000", 2024-09-13T05:11:53.633 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0080743340000000007, 2024-09-13T05:11:53.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013264859, 2024-09-13T05:11:53.634 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.634 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.634 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.634 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.634 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.634 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137791 2024-09-13T05:11:53.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.634 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.634 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.634 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313059+0000", 2024-09-13T05:11:53.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.635 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.635 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313059+0000", 2024-09-13T05:11:53.635 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.635 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.635 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.635 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313059+0000", 2024-09-13T05:11:53.635 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.635 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.635 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.635 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313062+0000", 2024-09-13T05:11:53.635 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0860000000000002e-06 2024-09-13T05:11:53.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.636 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.636 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.636 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313069+0000", 2024-09-13T05:11:53.636 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8399999999999997e-06 2024-09-13T05:11:53.636 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.636 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.636 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.636 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313074+0000", 2024-09-13T05:11:53.636 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.874e-06 2024-09-13T05:11:53.636 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.636 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.636 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.636 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.636 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.637 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137823 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.637 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.321038+0000", 2024-09-13T05:11:53.637 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.5549000000000003e-05, 2024-09-13T05:11:53.637 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0053434299999999997, 2024-09-13T05:11:53.637 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.637 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.637 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.637 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.637 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.637 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137823 2024-09-13T05:11:53.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.637 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.637 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.637 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321038+0000", 2024-09-13T05:11:53.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321038+0000", 2024-09-13T05:11:53.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321037+0000", 2024-09-13T05:11:53.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.639 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.639 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321041+0000", 2024-09-13T05:11:53.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3079999999999999e-06 2024-09-13T05:11:53.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.639 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.639 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.639 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321047+0000", 2024-09-13T05:11:53.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2890000000000003e-06 2024-09-13T05:11:53.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.639 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.639 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.639 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321060+0000", 2024-09-13T05:11:53.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.278e-05 2024-09-13T05:11:53.639 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.640 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.640 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.640 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.640 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.640 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137632 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.640 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.277217+0000", 2024-09-13T05:11:53.640 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.043916094000000003, 2024-09-13T05:11:53.640 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.049227403000000003, 2024-09-13T05:11:53.640 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.640 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.640 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.640 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.640 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.640 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137632 2024-09-13T05:11:53.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.641 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277217+0000", 2024-09-13T05:11:53.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277217+0000", 2024-09-13T05:11:53.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277217+0000", 2024-09-13T05:11:53.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.642 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277220+0000", 2024-09-13T05:11:53.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9890000000000001e-06 2024-09-13T05:11:53.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.642 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277228+0000", 2024-09-13T05:11:53.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.3410000000000003e-06 2024-09-13T05:11:53.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.642 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.643 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277237+0000", 2024-09-13T05:11:53.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.3110000000000006e-06 2024-09-13T05:11:53.643 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.643 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.643 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.643 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.643 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.643 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137664 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.643 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.281724+0000", 2024-09-13T05:11:53.643 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.039409096999999997, 2024-09-13T05:11:53.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.044778888000000003, 2024-09-13T05:11:53.643 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.643 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.643 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.644 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.644 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.644 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137664 2024-09-13T05:11:53.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.644 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.644 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.644 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.644 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281724+0000", 2024-09-13T05:11:53.644 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.644 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.644 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.644 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281724+0000", 2024-09-13T05:11:53.644 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.645 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281724+0000", 2024-09-13T05:11:53.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.645 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281727+0000", 2024-09-13T05:11:53.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.988e-06 2024-09-13T05:11:53.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.645 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281734+0000", 2024-09-13T05:11:53.646 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7429999999999996e-06 2024-09-13T05:11:53.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.646 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.646 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.646 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281740+0000", 2024-09-13T05:11:53.646 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0109999999999997e-06 2024-09-13T05:11:53.646 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.646 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.646 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.646 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.646 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137696 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.646 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.289292+0000", 2024-09-13T05:11:53.646 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.031841899, 2024-09-13T05:11:53.646 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037269800999999998, 2024-09-13T05:11:53.647 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.647 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.647 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.647 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.647 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.647 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137696 2024-09-13T05:11:53.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.647 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.647 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.647 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289292+0000", 2024-09-13T05:11:53.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.648 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.648 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289292+0000", 2024-09-13T05:11:53.648 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.648 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.648 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.648 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289291+0000", 2024-09-13T05:11:53.648 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:53.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.648 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.648 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.648 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289295+0000", 2024-09-13T05:11:53.648 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9199999999999997e-06 2024-09-13T05:11:53.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.649 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.649 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.649 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289311+0000", 2024-09-13T05:11:53.649 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6336000000000001e-05 2024-09-13T05:11:53.649 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.649 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.649 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.649 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289317+0000", 2024-09-13T05:11:53.649 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2149999999999998e-06 2024-09-13T05:11:53.649 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.649 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.649 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.649 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.649 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.649 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137728 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.650 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.297540+0000", 2024-09-13T05:11:53.650 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.023593304999999998, 2024-09-13T05:11:53.650 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.029079313999999998, 2024-09-13T05:11:53.650 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.650 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.650 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.650 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.650 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.650 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137728 2024-09-13T05:11:53.650 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.650 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.650 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.650 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.650 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297540+0000", 2024-09-13T05:11:53.651 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.651 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.651 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.651 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297540+0000", 2024-09-13T05:11:53.651 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.651 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.651 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.651 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297540+0000", 2024-09-13T05:11:53.651 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.651 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.651 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.652 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297543+0000", 2024-09-13T05:11:53.652 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2030000000000001e-06 2024-09-13T05:11:53.652 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.652 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.652 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.652 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297549+0000", 2024-09-13T05:11:53.652 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7229999999999998e-06 2024-09-13T05:11:53.652 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.652 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.652 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.652 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297555+0000", 2024-09-13T05:11:53.652 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5820000000000001e-06 2024-09-13T05:11:53.652 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.652 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.653 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.653 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.653 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.653 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137760 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.653 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.305271+0000", 2024-09-13T05:11:53.653 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.015862078000000002, 2024-09-13T05:11:53.653 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.021405885999999999, 2024-09-13T05:11:53.653 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.653 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.653 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.653 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.653 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.653 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137760 2024-09-13T05:11:53.653 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.653 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.654 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.654 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305271+0000", 2024-09-13T05:11:53.654 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.654 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.654 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.654 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305271+0000", 2024-09-13T05:11:53.654 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.654 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.654 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.654 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305271+0000", 2024-09-13T05:11:53.654 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.655 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.655 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.655 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.655 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305274+0000", 2024-09-13T05:11:53.655 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4259999999999999e-06 2024-09-13T05:11:53.655 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.655 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.655 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.655 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305288+0000", 2024-09-13T05:11:53.655 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4025e-05 2024-09-13T05:11:53.655 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.655 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.655 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.655 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305296+0000", 2024-09-13T05:11:53.656 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3860000000000001e-06 2024-09-13T05:11:53.656 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.656 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.656 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.656 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.656 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.656 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137792 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.656 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.313080+0000", 2024-09-13T05:11:53.656 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.00805378, 2024-09-13T05:11:53.656 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.013656321000000001, 2024-09-13T05:11:53.656 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.656 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.656 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.656 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.657 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.657 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137792 2024-09-13T05:11:53.657 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.657 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.657 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.657 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.657 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313080+0000", 2024-09-13T05:11:53.657 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.657 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.657 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.657 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.657 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313080+0000", 2024-09-13T05:11:53.657 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.657 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.657 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.658 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.658 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313079+0000", 2024-09-13T05:11:53.658 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.658 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.658 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.658 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.658 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313082+0000", 2024-09-13T05:11:53.658 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9229999999999998e-06 2024-09-13T05:11:53.658 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.658 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.658 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.658 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313089+0000", 2024-09-13T05:11:53.658 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7769999999999997e-06 2024-09-13T05:11:53.658 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.659 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.659 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.659 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313096+0000", 2024-09-13T05:11:53.659 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2080000000000003e-06 2024-09-13T05:11:53.659 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.659 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.659 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.659 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.659 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.659 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137824 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.659 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.321072+0000", 2024-09-13T05:11:53.659 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 6.1286999999999998e-05, 2024-09-13T05:11:53.659 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0057214789999999998, 2024-09-13T05:11:53.659 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.660 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.660 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.660 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.660 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.660 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137824 2024-09-13T05:11:53.660 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.660 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.660 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.660 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.660 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321072+0000", 2024-09-13T05:11:53.660 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.660 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.660 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.660 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.661 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321072+0000", 2024-09-13T05:11:53.661 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.661 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.661 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.661 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.661 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321072+0000", 2024-09-13T05:11:53.661 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.661 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.661 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.661 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.661 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321075+0000", 2024-09-13T05:11:53.661 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1370000000000002e-06 2024-09-13T05:11:53.661 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.661 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.662 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.662 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321084+0000", 2024-09-13T05:11:53.662 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9369999999999993e-06 2024-09-13T05:11:53.662 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.662 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.662 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.662 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321090+0000", 2024-09-13T05:11:53.662 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2570000000000004e-06 2024-09-13T05:11:53.662 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.662 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.662 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.662 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.662 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.662 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137633 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.662 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.277242+0000", 2024-09-13T05:11:53.663 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.043891761000000001, 2024-09-13T05:11:53.663 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.049612604999999997, 2024-09-13T05:11:53.663 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.663 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.663 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.663 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.663 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.663 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137633 2024-09-13T05:11:53.663 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.663 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.663 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.663 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.663 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277242+0000", 2024-09-13T05:11:53.664 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.664 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.664 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.664 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.664 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277242+0000", 2024-09-13T05:11:53.664 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.664 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.664 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.664 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.664 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277241+0000", 2024-09-13T05:11:53.664 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.664 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.664 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.664 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.665 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277244+0000", 2024-09-13T05:11:53.665 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0699999999999998e-06 2024-09-13T05:11:53.665 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.665 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.665 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.665 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277254+0000", 2024-09-13T05:11:53.665 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4539999999999996e-06 2024-09-13T05:11:53.665 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.665 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.665 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.665 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277259+0000", 2024-09-13T05:11:53.665 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2859999999999999e-06 2024-09-13T05:11:53.665 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.665 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.666 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.666 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.666 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.666 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137665 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.666 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.281745+0000", 2024-09-13T05:11:53.666 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.039388932000000001, 2024-09-13T05:11:53.666 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.045167906000000001, 2024-09-13T05:11:53.666 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.666 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.666 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.666 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.666 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.666 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137665 2024-09-13T05:11:53.666 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.667 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.667 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.667 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.667 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281745+0000", 2024-09-13T05:11:53.667 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.667 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.667 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.667 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.667 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281745+0000", 2024-09-13T05:11:53.667 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.667 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.667 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.667 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.667 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281744+0000", 2024-09-13T05:11:53.667 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.668 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.668 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.668 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.668 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281747+0000", 2024-09-13T05:11:53.668 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.954e-06 2024-09-13T05:11:53.668 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.668 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.668 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.668 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281754+0000", 2024-09-13T05:11:53.668 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7510000000000002e-06 2024-09-13T05:11:53.668 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.668 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.668 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.669 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281760+0000", 2024-09-13T05:11:53.669 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1630000000000001e-06 2024-09-13T05:11:53.669 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.669 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.669 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.669 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.669 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.669 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137697 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.669 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.289323+0000", 2024-09-13T05:11:53.669 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.031810236999999998, 2024-09-13T05:11:53.669 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037647233000000002, 2024-09-13T05:11:53.669 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.670 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.670 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.670 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.670 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.670 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137697 2024-09-13T05:11:53.670 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.670 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.670 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.670 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.670 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289323+0000", 2024-09-13T05:11:53.670 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.670 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.670 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.670 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.671 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289323+0000", 2024-09-13T05:11:53.671 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.671 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.671 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.671 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289322+0000", 2024-09-13T05:11:53.671 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:53.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.671 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.671 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.671 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289326+0000", 2024-09-13T05:11:53.671 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5659999999999998e-06 2024-09-13T05:11:53.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.671 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.672 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.672 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289340+0000", 2024-09-13T05:11:53.672 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3719e-05 2024-09-13T05:11:53.672 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.672 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.672 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.672 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289346+0000", 2024-09-13T05:11:53.672 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9549999999999997e-06 2024-09-13T05:11:53.672 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.672 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.672 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.672 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.672 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.672 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137729 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.673 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.297560+0000", 2024-09-13T05:11:53.673 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0235731, 2024-09-13T05:11:53.673 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.029468850000000001, 2024-09-13T05:11:53.673 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.673 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.673 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.673 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.673 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.673 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137729 2024-09-13T05:11:53.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.673 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.673 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.673 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.673 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297560+0000", 2024-09-13T05:11:53.674 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.674 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.674 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.674 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.674 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297560+0000", 2024-09-13T05:11:53.674 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.674 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.674 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.674 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.674 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297560+0000", 2024-09-13T05:11:53.674 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.674 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.674 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.674 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.675 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297563+0000", 2024-09-13T05:11:53.675 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9969999999999999e-06 2024-09-13T05:11:53.675 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.675 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.675 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.675 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297570+0000", 2024-09-13T05:11:53.675 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.737e-06 2024-09-13T05:11:53.675 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.675 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.675 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.675 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297575+0000", 2024-09-13T05:11:53.675 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6520000000000003e-06 2024-09-13T05:11:53.675 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.675 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.675 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.676 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.676 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.676 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137761 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.676 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.305302+0000", 2024-09-13T05:11:53.676 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.015831135999999999, 2024-09-13T05:11:53.676 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.021785011999999999, 2024-09-13T05:11:53.676 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.676 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.676 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.676 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.676 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.676 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137761 2024-09-13T05:11:53.676 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.676 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.677 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.677 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.677 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305302+0000", 2024-09-13T05:11:53.677 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.677 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.677 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.677 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.677 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305302+0000", 2024-09-13T05:11:53.677 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.677 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.677 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.677 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.677 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305302+0000", 2024-09-13T05:11:53.677 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.678 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.678 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.678 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305305+0000", 2024-09-13T05:11:53.678 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1599999999999998e-06 2024-09-13T05:11:53.678 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.678 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.678 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305318+0000", 2024-09-13T05:11:53.678 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3587999999999999e-05 2024-09-13T05:11:53.678 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.678 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.678 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305330+0000", 2024-09-13T05:11:53.679 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1191e-05 2024-09-13T05:11:53.679 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.679 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.679 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.679 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.679 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.679 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137793 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.679 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.313102+0000", 2024-09-13T05:11:53.679 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0080319009999999993, 2024-09-13T05:11:53.679 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.014043811, 2024-09-13T05:11:53.679 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.679 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.679 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.679 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.680 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.680 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137793 2024-09-13T05:11:53.680 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.680 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.680 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.680 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.680 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313102+0000", 2024-09-13T05:11:53.680 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.680 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.680 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.680 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.680 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313102+0000", 2024-09-13T05:11:53.680 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.680 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.681 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.681 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313101+0000", 2024-09-13T05:11:53.681 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.681 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.681 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313104+0000", 2024-09-13T05:11:53.681 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0429999999999999e-06 2024-09-13T05:11:53.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.681 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.681 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313112+0000", 2024-09-13T05:11:53.681 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9140000000000008e-06 2024-09-13T05:11:53.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.682 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.682 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313122+0000", 2024-09-13T05:11:53.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0322999999999999e-05 2024-09-13T05:11:53.682 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.682 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.682 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.682 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137825 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.682 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.321095+0000", 2024-09-13T05:11:53.682 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.8756e-05, 2024-09-13T05:11:53.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0061083220000000002, 2024-09-13T05:11:53.682 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.683 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.683 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.683 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.683 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.683 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137825 2024-09-13T05:11:53.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.683 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.683 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.683 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.683 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321095+0000", 2024-09-13T05:11:53.683 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.683 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.683 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.684 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321095+0000", 2024-09-13T05:11:53.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.684 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.684 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321094+0000", 2024-09-13T05:11:53.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.684 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.684 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321097+0000", 2024-09-13T05:11:53.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.931e-06 2024-09-13T05:11:53.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.685 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.685 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321104+0000", 2024-09-13T05:11:53.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4320000000000004e-06 2024-09-13T05:11:53.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.685 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.685 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321109+0000", 2024-09-13T05:11:53.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4049999999999999e-06 2024-09-13T05:11:53.685 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.685 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.685 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.686 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137634 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.686 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.277264+0000", 2024-09-13T05:11:53.686 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.043869152000000002, 2024-09-13T05:11:53.686 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.050001019000000001, 2024-09-13T05:11:53.686 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.686 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.686 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.686 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.686 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.686 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137634 2024-09-13T05:11:53.686 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.686 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.686 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.686 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277264+0000", 2024-09-13T05:11:53.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277264+0000", 2024-09-13T05:11:53.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277264+0000", 2024-09-13T05:11:53.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.688 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277267+0000", 2024-09-13T05:11:53.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.875e-06 2024-09-13T05:11:53.688 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.688 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.688 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.688 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277280+0000", 2024-09-13T05:11:53.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3084999999999999e-05 2024-09-13T05:11:53.688 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.688 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.688 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.688 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277291+0000", 2024-09-13T05:11:53.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1574e-05 2024-09-13T05:11:53.688 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.688 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.689 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.689 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.689 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137666 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.689 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.281765+0000", 2024-09-13T05:11:53.689 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.039368601000000003, 2024-09-13T05:11:53.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.045559289000000003, 2024-09-13T05:11:53.689 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.689 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.689 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.689 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.689 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.689 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137666 2024-09-13T05:11:53.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.690 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281765+0000", 2024-09-13T05:11:53.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281765+0000", 2024-09-13T05:11:53.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281764+0000", 2024-09-13T05:11:53.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281768+0000", 2024-09-13T05:11:53.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1889999999999999e-06 2024-09-13T05:11:53.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281774+0000", 2024-09-13T05:11:53.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7139999999999996e-06 2024-09-13T05:11:53.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281787+0000", 2024-09-13T05:11:53.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2822e-05 2024-09-13T05:11:53.692 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.692 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.692 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.692 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137698 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.692 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.289351+0000", 2024-09-13T05:11:53.692 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.031782531000000003, 2024-09-13T05:11:53.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038031004, 2024-09-13T05:11:53.692 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.692 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.692 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.692 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.693 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.693 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137698 2024-09-13T05:11:53.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.693 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289351+0000", 2024-09-13T05:11:53.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289351+0000", 2024-09-13T05:11:53.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289350+0000", 2024-09-13T05:11:53.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289359+0000", 2024-09-13T05:11:53.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5569999999999996e-06 2024-09-13T05:11:53.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.696 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.696 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.696 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289368+0000", 2024-09-13T05:11:53.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9970000000000004e-06 2024-09-13T05:11:53.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.696 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.696 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.696 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289375+0000", 2024-09-13T05:11:53.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.657e-06 2024-09-13T05:11:53.697 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.697 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.697 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.697 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137730 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.697 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.297582+0000", 2024-09-13T05:11:53.697 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.023551372000000001, 2024-09-13T05:11:53.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.029858308, 2024-09-13T05:11:53.697 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.697 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.697 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.697 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.698 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.698 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137730 2024-09-13T05:11:53.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.698 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297582+0000", 2024-09-13T05:11:53.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297582+0000", 2024-09-13T05:11:53.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.699 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297582+0000", 2024-09-13T05:11:53.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.699 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297585+0000", 2024-09-13T05:11:53.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.275e-06 2024-09-13T05:11:53.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.699 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297591+0000", 2024-09-13T05:11:53.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6370000000000002e-06 2024-09-13T05:11:53.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.700 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.700 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297597+0000", 2024-09-13T05:11:53.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9680000000000003e-06 2024-09-13T05:11:53.700 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.700 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.700 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.700 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137762 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.700 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.305335+0000", 2024-09-13T05:11:53.700 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.015798597000000001, 2024-09-13T05:11:53.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.022163196, 2024-09-13T05:11:53.701 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.701 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.701 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.701 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.701 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.701 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137762 2024-09-13T05:11:53.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.701 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305335+0000", 2024-09-13T05:11:53.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.702 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.702 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305335+0000", 2024-09-13T05:11:53.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.702 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.702 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305334+0000", 2024-09-13T05:11:53.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.702 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.702 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305337+0000", 2024-09-13T05:11:53.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0920000000000002e-06 2024-09-13T05:11:53.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305351+0000", 2024-09-13T05:11:53.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3328e-05 2024-09-13T05:11:53.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305357+0000", 2024-09-13T05:11:53.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9680000000000003e-06 2024-09-13T05:11:53.703 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.703 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.703 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.703 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137794 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.704 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.313132+0000", 2024-09-13T05:11:53.704 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0080018299999999997, 2024-09-13T05:11:53.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.014423765999999999, 2024-09-13T05:11:53.704 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.704 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.704 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.704 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.704 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.704 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137794 2024-09-13T05:11:53.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.704 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313132+0000", 2024-09-13T05:11:53.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.705 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313132+0000", 2024-09-13T05:11:53.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.705 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313131+0000", 2024-09-13T05:11:53.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:53.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313136+0000", 2024-09-13T05:11:53.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0080000000000002e-06 2024-09-13T05:11:53.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.706 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313147+0000", 2024-09-13T05:11:53.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0891e-05 2024-09-13T05:11:53.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.706 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313153+0000", 2024-09-13T05:11:53.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3060000000000003e-06 2024-09-13T05:11:53.706 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.706 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.707 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.707 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137826 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.707 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.321114+0000", 2024-09-13T05:11:53.707 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.9741999999999998e-05, 2024-09-13T05:11:53.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0065015669999999998, 2024-09-13T05:11:53.707 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.707 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.707 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.707 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.707 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.707 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137826 2024-09-13T05:11:53.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.708 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321114+0000", 2024-09-13T05:11:53.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321114+0000", 2024-09-13T05:11:53.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.709 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321113+0000", 2024-09-13T05:11:53.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.709 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.709 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321116+0000", 2024-09-13T05:11:53.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8909999999999999e-06 2024-09-13T05:11:53.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.709 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.709 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321122+0000", 2024-09-13T05:11:53.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3289999999999999e-06 2024-09-13T05:11:53.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321128+0000", 2024-09-13T05:11:53.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3619999999999997e-06 2024-09-13T05:11:53.710 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.710 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.710 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.710 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137635 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.710 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.277297+0000", 2024-09-13T05:11:53.710 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.043836132, 2024-09-13T05:11:53.711 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.050378342999999999, 2024-09-13T05:11:53.711 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.711 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.711 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.711 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.711 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.711 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137635 2024-09-13T05:11:53.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.711 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.711 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.711 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277297+0000", 2024-09-13T05:11:53.711 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.712 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.712 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.712 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277297+0000", 2024-09-13T05:11:53.712 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.712 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.712 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.712 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277297+0000", 2024-09-13T05:11:53.712 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.712 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.712 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.712 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277300+0000", 2024-09-13T05:11:53.712 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.044e-06 2024-09-13T05:11:53.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277312+0000", 2024-09-13T05:11:53.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2465e-05 2024-09-13T05:11:53.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277324+0000", 2024-09-13T05:11:53.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1537e-05 2024-09-13T05:11:53.713 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.713 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.713 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.714 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137667 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.714 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.281805+0000", 2024-09-13T05:11:53.714 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.039328396000000002, 2024-09-13T05:11:53.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.045929296000000001, 2024-09-13T05:11:53.714 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.714 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.714 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.714 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.714 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.714 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137667 2024-09-13T05:11:53.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.714 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281805+0000", 2024-09-13T05:11:53.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.715 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281805+0000", 2024-09-13T05:11:53.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.715 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281804+0000", 2024-09-13T05:11:53.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.716 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.716 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281808+0000", 2024-09-13T05:11:53.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1429999999999998e-06 2024-09-13T05:11:53.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.716 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.716 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.716 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281829+0000", 2024-09-13T05:11:53.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0973999999999999e-05 2024-09-13T05:11:53.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.716 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.716 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.716 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281839+0000", 2024-09-13T05:11:53.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0691e-05 2024-09-13T05:11:53.716 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.717 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.717 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.717 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137699 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.717 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.289380+0000", 2024-09-13T05:11:53.717 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.031753485999999997, 2024-09-13T05:11:53.717 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038412518999999999, 2024-09-13T05:11:53.717 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.717 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.717 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.717 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.717 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.717 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137699 2024-09-13T05:11:53.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.718 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.718 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.718 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289380+0000", 2024-09-13T05:11:53.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.718 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.718 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289380+0000", 2024-09-13T05:11:53.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.718 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.719 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289379+0000", 2024-09-13T05:11:53.719 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.719 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.719 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.719 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289382+0000", 2024-09-13T05:11:53.719 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0800000000000002e-06 2024-09-13T05:11:53.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.719 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.719 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.719 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289396+0000", 2024-09-13T05:11:53.719 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.342e-05 2024-09-13T05:11:53.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.719 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.719 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.720 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289404+0000", 2024-09-13T05:11:53.720 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8679999999999999e-06 2024-09-13T05:11:53.720 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.720 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.720 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.720 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.720 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137731 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.720 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.297603+0000", 2024-09-13T05:11:53.720 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.023530769, 2024-09-13T05:11:53.720 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.030247861000000001, 2024-09-13T05:11:53.720 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.720 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.720 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.721 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.721 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.721 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137731 2024-09-13T05:11:53.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.721 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.721 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.721 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.721 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297603+0000", 2024-09-13T05:11:53.721 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.721 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.721 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.721 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297603+0000", 2024-09-13T05:11:53.721 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297602+0000", 2024-09-13T05:11:53.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297605+0000", 2024-09-13T05:11:53.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0429999999999999e-06 2024-09-13T05:11:53.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297612+0000", 2024-09-13T05:11:53.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5740000000000001e-06 2024-09-13T05:11:53.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.723 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.723 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297618+0000", 2024-09-13T05:11:53.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.823e-06 2024-09-13T05:11:53.723 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.723 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.723 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.723 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137763 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.723 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.305362+0000", 2024-09-13T05:11:53.723 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.015771423, 2024-09-13T05:11:53.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.022547603999999999, 2024-09-13T05:11:53.723 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.724 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.724 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.724 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.724 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.724 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137763 2024-09-13T05:11:53.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.724 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305362+0000", 2024-09-13T05:11:53.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.725 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.725 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305362+0000", 2024-09-13T05:11:53.725 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.725 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.725 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305362+0000", 2024-09-13T05:11:53.725 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.725 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.725 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305365+0000", 2024-09-13T05:11:53.725 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1310000000000002e-06 2024-09-13T05:11:53.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.726 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.726 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.726 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305371+0000", 2024-09-13T05:11:53.726 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.674e-06 2024-09-13T05:11:53.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.726 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.726 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.726 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305384+0000", 2024-09-13T05:11:53.726 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2566e-05 2024-09-13T05:11:53.726 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.726 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.726 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.727 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137795 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.727 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.313158+0000", 2024-09-13T05:11:53.727 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0079750359999999996, 2024-09-13T05:11:53.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.014809948, 2024-09-13T05:11:53.727 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.727 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.727 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.727 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.727 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.727 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137795 2024-09-13T05:11:53.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.727 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313158+0000", 2024-09-13T05:11:53.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313158+0000", 2024-09-13T05:11:53.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313158+0000", 2024-09-13T05:11:53.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313177+0000", 2024-09-13T05:11:53.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8694000000000001e-05 2024-09-13T05:11:53.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313193+0000", 2024-09-13T05:11:53.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6150999999999998e-05 2024-09-13T05:11:53.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313199+0000", 2024-09-13T05:11:53.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.703e-06 2024-09-13T05:11:53.730 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.730 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.730 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.730 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.730 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.730 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137827 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.730 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.321132+0000", 2024-09-13T05:11:53.730 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.034e-06, 2024-09-13T05:11:53.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0068934699999999996, 2024-09-13T05:11:53.730 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.730 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.730 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.730 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.730 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.730 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137827 2024-09-13T05:11:53.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.731 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321132+0000", 2024-09-13T05:11:53.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321132+0000", 2024-09-13T05:11:53.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.732 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321132+0000", 2024-09-13T05:11:53.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.732 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321135+0000", 2024-09-13T05:11:53.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7659999999999999e-06 2024-09-13T05:11:53.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.732 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321141+0000", 2024-09-13T05:11:53.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1140000000000002e-06 2024-09-13T05:11:53.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.733 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.733 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321146+0000", 2024-09-13T05:11:53.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5199999999999997e-06 2024-09-13T05:11:53.733 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.733 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.733 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.733 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137636 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.733 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.277329+0000", 2024-09-13T05:11:53.733 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.043804149000000001, 2024-09-13T05:11:53.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.050757350999999999, 2024-09-13T05:11:53.734 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.734 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.734 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.734 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.734 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.734 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137636 2024-09-13T05:11:53.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.734 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277329+0000", 2024-09-13T05:11:53.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277329+0000", 2024-09-13T05:11:53.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277329+0000", 2024-09-13T05:11:53.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277332+0000", 2024-09-13T05:11:53.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.146e-06 2024-09-13T05:11:53.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.736 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.736 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277339+0000", 2024-09-13T05:11:53.736 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7000000000000002e-06 2024-09-13T05:11:53.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.736 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.736 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277355+0000", 2024-09-13T05:11:53.736 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5826999999999999e-05 2024-09-13T05:11:53.736 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.736 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.736 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.737 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137668 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.737 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.281860+0000", 2024-09-13T05:11:53.737 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.039273172000000002, 2024-09-13T05:11:53.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.046284567999999998, 2024-09-13T05:11:53.737 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.737 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.737 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.737 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.737 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.737 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137668 2024-09-13T05:11:53.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.737 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281860+0000", 2024-09-13T05:11:53.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281860+0000", 2024-09-13T05:11:53.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281860+0000", 2024-09-13T05:11:53.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281863+0000", 2024-09-13T05:11:53.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5489999999999998e-06 2024-09-13T05:11:53.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281873+0000", 2024-09-13T05:11:53.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0022e-05 2024-09-13T05:11:53.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.740 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281880+0000", 2024-09-13T05:11:53.740 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5799999999999997e-06 2024-09-13T05:11:53.740 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.740 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.740 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.740 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137700 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.740 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.289409+0000", 2024-09-13T05:11:53.740 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.031724370000000002, 2024-09-13T05:11:53.740 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038794624999999999, 2024-09-13T05:11:53.740 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.740 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.740 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.741 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.741 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.741 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137700 2024-09-13T05:11:53.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.741 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.741 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289409+0000", 2024-09-13T05:11:53.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.741 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289409+0000", 2024-09-13T05:11:53.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289409+0000", 2024-09-13T05:11:53.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289412+0000", 2024-09-13T05:11:53.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1149999999999998e-06 2024-09-13T05:11:53.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289418+0000", 2024-09-13T05:11:53.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7619999999999998e-06 2024-09-13T05:11:53.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289426+0000", 2024-09-13T05:11:53.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1799999999999999e-06 2024-09-13T05:11:53.743 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.743 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.743 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.743 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137732 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.743 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.297664+0000", 2024-09-13T05:11:53.743 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.023468985000000001, 2024-09-13T05:11:53.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.030599723999999998, 2024-09-13T05:11:53.744 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.744 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.744 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.744 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.744 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.744 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137732 2024-09-13T05:11:53.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.744 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.744 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297664+0000", 2024-09-13T05:11:53.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.745 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.745 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.745 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297664+0000", 2024-09-13T05:11:53.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.745 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.745 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.745 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297622+0000", 2024-09-13T05:11:53.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999576 2024-09-13T05:11:53.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.745 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.745 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.745 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297668+0000", 2024-09-13T05:11:53.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6221999999999999e-05 2024-09-13T05:11:53.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.746 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297684+0000", 2024-09-13T05:11:53.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6124999999999999e-05 2024-09-13T05:11:53.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.746 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297697+0000", 2024-09-13T05:11:53.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2591e-05 2024-09-13T05:11:53.746 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.746 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.746 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.747 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137764 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.747 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.305405+0000", 2024-09-13T05:11:53.747 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.015728071999999999, 2024-09-13T05:11:53.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.022917878999999999, 2024-09-13T05:11:53.747 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.747 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.747 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.747 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.747 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.747 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137764 2024-09-13T05:11:53.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.747 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305405+0000", 2024-09-13T05:11:53.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305405+0000", 2024-09-13T05:11:53.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305405+0000", 2024-09-13T05:11:53.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305408+0000", 2024-09-13T05:11:53.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2490000000000001e-06 2024-09-13T05:11:53.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305422+0000", 2024-09-13T05:11:53.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3900000000000001e-05 2024-09-13T05:11:53.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305428+0000", 2024-09-13T05:11:53.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0050000000000001e-06 2024-09-13T05:11:53.749 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.750 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.750 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.750 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137796 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.750 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.313240+0000", 2024-09-13T05:11:53.750 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0078934120000000007, 2024-09-13T05:11:53.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.015140964999999999, 2024-09-13T05:11:53.750 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.750 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.750 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.750 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.750 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.750 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137796 2024-09-13T05:11:53.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.751 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313240+0000", 2024-09-13T05:11:53.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313240+0000", 2024-09-13T05:11:53.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313239+0000", 2024-09-13T05:11:53.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:53.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313244+0000", 2024-09-13T05:11:53.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2660000000000003e-06 2024-09-13T05:11:53.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313251+0000", 2024-09-13T05:11:53.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.4939999999999997e-06 2024-09-13T05:11:53.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313257+0000", 2024-09-13T05:11:53.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0310000000000004e-06 2024-09-13T05:11:53.753 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.753 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.753 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.753 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137828 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.753 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.321151+0000", 2024-09-13T05:11:53.753 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9999824, 2024-09-13T05:11:53.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0072899499999999999, 2024-09-13T05:11:53.753 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.754 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.754 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.754 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.754 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.754 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137828 2024-09-13T05:11:53.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.754 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321151+0000", 2024-09-13T05:11:53.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321151+0000", 2024-09-13T05:11:53.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321150+0000", 2024-09-13T05:11:53.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321153+0000", 2024-09-13T05:11:53.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0000000000000001e-06 2024-09-13T05:11:53.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321160+0000", 2024-09-13T05:11:53.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2369999999999997e-06 2024-09-13T05:11:53.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321165+0000", 2024-09-13T05:11:53.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4310000000000002e-06 2024-09-13T05:11:53.756 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.756 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.756 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.756 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137637 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.756 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.277360+0000", 2024-09-13T05:11:53.757 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.043773250999999999, 2024-09-13T05:11:53.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.051141608999999998, 2024-09-13T05:11:53.757 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.757 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.757 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.757 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.757 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.757 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137637 2024-09-13T05:11:53.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.757 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277360+0000", 2024-09-13T05:11:53.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277360+0000", 2024-09-13T05:11:53.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277360+0000", 2024-09-13T05:11:53.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277368+0000", 2024-09-13T05:11:53.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4360000000000002e-06 2024-09-13T05:11:53.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277381+0000", 2024-09-13T05:11:53.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2850000000000001e-05 2024-09-13T05:11:53.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277396+0000", 2024-09-13T05:11:53.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4746000000000001e-05 2024-09-13T05:11:53.759 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.759 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.760 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.760 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137669 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.760 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.281886+0000", 2024-09-13T05:11:53.760 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.039247152, 2024-09-13T05:11:53.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.046676254, 2024-09-13T05:11:53.760 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.760 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.760 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.760 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.760 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.760 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137669 2024-09-13T05:11:53.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.761 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281886+0000", 2024-09-13T05:11:53.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281886+0000", 2024-09-13T05:11:53.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281886+0000", 2024-09-13T05:11:53.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281889+0000", 2024-09-13T05:11:53.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1949999999999999e-06 2024-09-13T05:11:53.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281910+0000", 2024-09-13T05:11:53.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1410999999999999e-05 2024-09-13T05:11:53.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.763 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281931+0000", 2024-09-13T05:11:53.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0718999999999999e-05 2024-09-13T05:11:53.763 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.763 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.763 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.763 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137701 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.763 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.292998+0000", 2024-09-13T05:11:53.763 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.028135072000000001, 2024-09-13T05:11:53.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035623436000000001, 2024-09-13T05:11:53.763 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.763 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.763 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.764 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.764 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.764 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137701 2024-09-13T05:11:53.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.764 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.292998+0000", 2024-09-13T05:11:53.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.292998+0000", 2024-09-13T05:11:53.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.289430+0000", 2024-09-13T05:11:53.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9964318 2024-09-13T05:11:53.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293003+0000", 2024-09-13T05:11:53.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0035728040000000002 2024-09-13T05:11:53.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293025+0000", 2024-09-13T05:11:53.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1756e-05 2024-09-13T05:11:53.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293034+0000", 2024-09-13T05:11:53.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0690000000000008e-06 2024-09-13T05:11:53.766 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.766 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.766 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.766 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137733 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.766 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.301115+0000", 2024-09-13T05:11:53.766 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.020018668999999999, 2024-09-13T05:11:53.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.027565194000000001, 2024-09-13T05:11:53.767 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.767 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.767 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.767 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.767 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.767 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137733 2024-09-13T05:11:53.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.767 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301115+0000", 2024-09-13T05:11:53.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301115+0000", 2024-09-13T05:11:53.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.297703+0000", 2024-09-13T05:11:53.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9965882 2024-09-13T05:11:53.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301121+0000", 2024-09-13T05:11:53.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0034180360000000002 2024-09-13T05:11:53.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.769 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.769 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301133+0000", 2024-09-13T05:11:53.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2377e-05 2024-09-13T05:11:53.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.769 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.769 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301141+0000", 2024-09-13T05:11:53.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7049999999999999e-06 2024-09-13T05:11:53.769 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.769 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.769 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.770 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137765 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.770 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.305435+0000", 2024-09-13T05:11:53.770 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.015698921000000001, 2024-09-13T05:11:53.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.023305999000000001, 2024-09-13T05:11:53.770 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.770 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.770 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.770 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.770 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.770 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137765 2024-09-13T05:11:53.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.770 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305435+0000", 2024-09-13T05:11:53.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305435+0000", 2024-09-13T05:11:53.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305434+0000", 2024-09-13T05:11:53.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305437+0000", 2024-09-13T05:11:53.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0740000000000001e-06 2024-09-13T05:11:53.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305445+0000", 2024-09-13T05:11:53.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0320000000000003e-06 2024-09-13T05:11:53.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305451+0000", 2024-09-13T05:11:53.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9739999999999999e-06 2024-09-13T05:11:53.772 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.772 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.773 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.773 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137797 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.773 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.313264+0000", 2024-09-13T05:11:53.773 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0078698359999999998, 2024-09-13T05:11:53.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.015534721, 2024-09-13T05:11:53.773 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.773 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.773 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.773 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.773 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.773 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137797 2024-09-13T05:11:53.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.773 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313264+0000", 2024-09-13T05:11:53.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313264+0000", 2024-09-13T05:11:53.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313263+0000", 2024-09-13T05:11:53.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313266+0000", 2024-09-13T05:11:53.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2830000000000002e-06 2024-09-13T05:11:53.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313273+0000", 2024-09-13T05:11:53.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6710000000000002e-06 2024-09-13T05:11:53.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313279+0000", 2024-09-13T05:11:53.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7880000000000003e-06 2024-09-13T05:11:53.776 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.776 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.776 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.776 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137829 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.776 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.321170+0000", 2024-09-13T05:11:53.776 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9999633, 2024-09-13T05:11:53.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0076891290000000003, 2024-09-13T05:11:53.776 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.776 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.776 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.776 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.776 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.777 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137829 2024-09-13T05:11:53.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.777 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321170+0000", 2024-09-13T05:11:53.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321170+0000", 2024-09-13T05:11:53.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321170+0000", 2024-09-13T05:11:53.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321172+0000", 2024-09-13T05:11:53.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9170000000000002e-06 2024-09-13T05:11:53.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321179+0000", 2024-09-13T05:11:53.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0909999999999998e-06 2024-09-13T05:11:53.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321184+0000", 2024-09-13T05:11:53.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3369999999999999e-06 2024-09-13T05:11:53.779 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.779 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.779 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.779 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137638 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.779 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.277401+0000", 2024-09-13T05:11:53.779 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.043732143000000001, 2024-09-13T05:11:53.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.051518618000000002, 2024-09-13T05:11:53.779 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.779 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.780 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.780 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.780 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.780 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137638 2024-09-13T05:11:53.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.780 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277401+0000", 2024-09-13T05:11:53.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277401+0000", 2024-09-13T05:11:53.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277401+0000", 2024-09-13T05:11:53.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277404+0000", 2024-09-13T05:11:53.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.393e-06 2024-09-13T05:11:53.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277411+0000", 2024-09-13T05:11:53.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6839999999999999e-06 2024-09-13T05:11:53.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277417+0000", 2024-09-13T05:11:53.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7710000000000003e-06 2024-09-13T05:11:53.782 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.782 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.782 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.782 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137670 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.782 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.285125+0000", 2024-09-13T05:11:53.783 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.036008538999999999, 2024-09-13T05:11:53.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.043868586000000001, 2024-09-13T05:11:53.783 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.783 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.783 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.783 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.783 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.783 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137670 2024-09-13T05:11:53.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.783 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285125+0000", 2024-09-13T05:11:53.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285125+0000", 2024-09-13T05:11:53.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.281951+0000", 2024-09-13T05:11:53.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9968262 2024-09-13T05:11:53.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285132+0000", 2024-09-13T05:11:53.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0031810570000000002 2024-09-13T05:11:53.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285146+0000", 2024-09-13T05:11:53.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3766e-05 2024-09-13T05:11:53.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285158+0000", 2024-09-13T05:11:53.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1768e-05 2024-09-13T05:11:53.785 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.785 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.785 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.786 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137702 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.786 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.293057+0000", 2024-09-13T05:11:53.786 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.028076159, 2024-09-13T05:11:53.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.035995231000000003, 2024-09-13T05:11:53.786 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.786 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.786 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.786 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.786 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.786 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137702 2024-09-13T05:11:53.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.786 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293057+0000", 2024-09-13T05:11:53.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293057+0000", 2024-09-13T05:11:53.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293057+0000", 2024-09-13T05:11:53.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:53.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293061+0000", 2024-09-13T05:11:53.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2350000000000001e-06 2024-09-13T05:11:53.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293083+0000", 2024-09-13T05:11:53.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1916000000000002e-05 2024-09-13T05:11:53.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293089+0000", 2024-09-13T05:11:53.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3690000000000003e-06 2024-09-13T05:11:53.789 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.789 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.789 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.789 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137734 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.789 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.301150+0000", 2024-09-13T05:11:53.789 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.019982983999999999, 2024-09-13T05:11:53.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.027960749, 2024-09-13T05:11:53.789 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.789 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.789 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.789 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.789 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.789 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137734 2024-09-13T05:11:53.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.790 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301150+0000", 2024-09-13T05:11:53.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301150+0000", 2024-09-13T05:11:53.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301150+0000", 2024-09-13T05:11:53.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301153+0000", 2024-09-13T05:11:53.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3720000000000001e-06 2024-09-13T05:11:53.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301160+0000", 2024-09-13T05:11:53.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6880000000000002e-06 2024-09-13T05:11:53.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.792 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.792 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301166+0000", 2024-09-13T05:11:53.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0939999999999996e-06 2024-09-13T05:11:53.792 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.792 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.792 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.792 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137766 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.792 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.305456+0000", 2024-09-13T05:11:53.792 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.015677056000000002, 2024-09-13T05:11:53.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.023713878000000001, 2024-09-13T05:11:53.792 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.792 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.793 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.793 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.793 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.793 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137766 2024-09-13T05:11:53.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.793 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.793 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305456+0000", 2024-09-13T05:11:53.793 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305456+0000", 2024-09-13T05:11:53.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305456+0000", 2024-09-13T05:11:53.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305459+0000", 2024-09-13T05:11:53.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9830000000000001e-06 2024-09-13T05:11:53.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305465+0000", 2024-09-13T05:11:53.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6510000000000004e-06 2024-09-13T05:11:53.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305475+0000", 2024-09-13T05:11:53.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3859999999999996e-06 2024-09-13T05:11:53.795 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.795 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.795 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.795 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137798 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.796 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.313285+0000", 2024-09-13T05:11:53.796 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0078483389999999993, 2024-09-13T05:11:53.796 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.015943399, 2024-09-13T05:11:53.796 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.796 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.796 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.796 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.796 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.796 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137798 2024-09-13T05:11:53.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.796 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.796 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313285+0000", 2024-09-13T05:11:53.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313285+0000", 2024-09-13T05:11:53.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313285+0000", 2024-09-13T05:11:53.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313288+0000", 2024-09-13T05:11:53.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.128e-06 2024-09-13T05:11:53.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.798 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.798 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313298+0000", 2024-09-13T05:11:53.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0209e-05 2024-09-13T05:11:53.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.798 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.798 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313321+0000", 2024-09-13T05:11:53.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3139e-05 2024-09-13T05:11:53.798 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.798 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.798 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.799 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.799 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137830 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.799 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.321189+0000", 2024-09-13T05:11:53.799 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9999447, 2024-09-13T05:11:53.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0080989909999999998, 2024-09-13T05:11:53.799 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.799 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.799 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.799 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.799 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.799 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137830 2024-09-13T05:11:53.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.799 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321189+0000", 2024-09-13T05:11:53.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321189+0000", 2024-09-13T05:11:53.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321188+0000", 2024-09-13T05:11:53.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.801 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321191+0000", 2024-09-13T05:11:53.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.74e-06 2024-09-13T05:11:53.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.801 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321197+0000", 2024-09-13T05:11:53.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2829999999999998e-06 2024-09-13T05:11:53.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.801 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321202+0000", 2024-09-13T05:11:53.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3539999999999999e-06 2024-09-13T05:11:53.802 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.802 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.802 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.802 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.802 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137639 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.802 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.277422+0000", 2024-09-13T05:11:53.802 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.043711937999999999, 2024-09-13T05:11:53.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.051928365999999997, 2024-09-13T05:11:53.802 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.802 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.802 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.802 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.802 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.802 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137639 2024-09-13T05:11:53.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.803 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.803 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.803 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.803 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277422+0000", 2024-09-13T05:11:53.803 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.803 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.803 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.803 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277422+0000", 2024-09-13T05:11:53.803 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.803 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.803 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.804 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277421+0000", 2024-09-13T05:11:53.804 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.804 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.804 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.804 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277424+0000", 2024-09-13T05:11:53.804 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9330000000000001e-06 2024-09-13T05:11:53.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.804 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.804 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.804 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277430+0000", 2024-09-13T05:11:53.804 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0279999999999997e-06 2024-09-13T05:11:53.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.804 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.805 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.805 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.277442+0000", 2024-09-13T05:11:53.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2309e-05 2024-09-13T05:11:53.805 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.805 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.805 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.805 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.805 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137671 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.805 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.285166+0000", 2024-09-13T05:11:53.805 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.035967457000000001, 2024-09-13T05:11:53.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.044245937999999999, 2024-09-13T05:11:53.805 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.805 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.805 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.806 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.806 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.806 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137671 2024-09-13T05:11:53.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.806 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.806 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.806 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285166+0000", 2024-09-13T05:11:53.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.806 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.806 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285166+0000", 2024-09-13T05:11:53.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285165+0000", 2024-09-13T05:11:53.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285169+0000", 2024-09-13T05:11:53.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4000000000000001e-06 2024-09-13T05:11:53.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285191+0000", 2024-09-13T05:11:53.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2192999999999999e-05 2024-09-13T05:11:53.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.808 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.808 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285205+0000", 2024-09-13T05:11:53.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4352000000000001e-05 2024-09-13T05:11:53.808 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.808 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.808 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.808 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137703 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.808 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.293095+0000", 2024-09-13T05:11:53.808 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.028038642999999999, 2024-09-13T05:11:53.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036391201999999997, 2024-09-13T05:11:53.809 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.809 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.809 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.809 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.809 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.809 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137703 2024-09-13T05:11:53.809 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.809 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.809 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.809 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.809 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293095+0000", 2024-09-13T05:11:53.809 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.809 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.810 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.810 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.810 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293095+0000", 2024-09-13T05:11:53.810 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.810 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.810 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.810 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293094+0000", 2024-09-13T05:11:53.810 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.810 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.810 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.810 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293098+0000", 2024-09-13T05:11:53.810 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5030000000000002e-06 2024-09-13T05:11:53.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293113+0000", 2024-09-13T05:11:53.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5116999999999999e-05 2024-09-13T05:11:53.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293122+0000", 2024-09-13T05:11:53.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8510000000000005e-06 2024-09-13T05:11:53.811 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.811 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.811 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.812 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137735 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.812 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.301177+0000", 2024-09-13T05:11:53.812 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.019956275999999998, 2024-09-13T05:11:53.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.02841343, 2024-09-13T05:11:53.812 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.812 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.812 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.812 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.812 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.812 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137735 2024-09-13T05:11:53.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.812 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.812 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301177+0000", 2024-09-13T05:11:53.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301177+0000", 2024-09-13T05:11:53.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301177+0000", 2024-09-13T05:11:53.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301180+0000", 2024-09-13T05:11:53.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5109999999999999e-06 2024-09-13T05:11:53.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301187+0000", 2024-09-13T05:11:53.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0049999999999998e-06 2024-09-13T05:11:53.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301195+0000", 2024-09-13T05:11:53.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5320000000000001e-06 2024-09-13T05:11:53.814 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.814 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.815 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.815 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.815 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137767 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.815 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.305480+0000", 2024-09-13T05:11:53.815 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.015653294000000002, 2024-09-13T05:11:53.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.024172769, 2024-09-13T05:11:53.815 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.815 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.815 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.815 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.815 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.815 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137767 2024-09-13T05:11:53.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.815 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305480+0000", 2024-09-13T05:11:53.816 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305480+0000", 2024-09-13T05:11:53.816 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305480+0000", 2024-09-13T05:11:53.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305483+0000", 2024-09-13T05:11:53.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0510000000000001e-06 2024-09-13T05:11:53.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305489+0000", 2024-09-13T05:11:53.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8059999999999997e-06 2024-09-13T05:11:53.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305495+0000", 2024-09-13T05:11:53.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7309999999999998e-06 2024-09-13T05:11:53.818 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.818 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.818 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.818 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.818 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137799 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.818 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.313332+0000", 2024-09-13T05:11:53.818 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0078010079999999999, 2024-09-13T05:11:53.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.016382699000000001, 2024-09-13T05:11:53.818 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.818 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.818 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.819 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.819 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.819 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137799 2024-09-13T05:11:53.819 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.819 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.819 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.819 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.819 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313332+0000", 2024-09-13T05:11:53.819 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.819 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.819 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.819 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.819 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313332+0000", 2024-09-13T05:11:53.820 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.820 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.820 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313332+0000", 2024-09-13T05:11:53.820 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.820 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.820 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313335+0000", 2024-09-13T05:11:53.820 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3969999999999998e-06 2024-09-13T05:11:53.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.820 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.821 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313349+0000", 2024-09-13T05:11:53.821 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3951000000000001e-05 2024-09-13T05:11:53.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.821 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.821 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.821 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313357+0000", 2024-09-13T05:11:53.821 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.4340000000000003e-06 2024-09-13T05:11:53.821 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.821 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.821 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.821 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.821 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137831 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.821 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.321229+0000", 2024-09-13T05:11:53.822 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9999046, 2024-09-13T05:11:53.822 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.008549526, 2024-09-13T05:11:53.822 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.822 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.822 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.822 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.822 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.822 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137831 2024-09-13T05:11:53.822 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.822 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.822 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.822 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.822 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321229+0000", 2024-09-13T05:11:53.822 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321229+0000", 2024-09-13T05:11:53.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321228+0000", 2024-09-13T05:11:53.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321231+0000", 2024-09-13T05:11:53.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0850000000000001e-06 2024-09-13T05:11:53.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.824 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.824 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321238+0000", 2024-09-13T05:11:53.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7290000000000003e-06 2024-09-13T05:11:53.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.824 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.824 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321252+0000", 2024-09-13T05:11:53.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4377e-05 2024-09-13T05:11:53.824 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.824 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.824 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.825 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.825 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137672 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.825 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.285239+0000", 2024-09-13T05:11:53.825 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.035894407000000003, 2024-09-13T05:11:53.825 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.044605587000000002, 2024-09-13T05:11:53.825 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.825 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.825 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.825 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.825 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.825 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137672 2024-09-13T05:11:53.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.825 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.826 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.826 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.826 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285239+0000", 2024-09-13T05:11:53.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.826 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.826 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.826 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285239+0000", 2024-09-13T05:11:53.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.826 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.826 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.826 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285238+0000", 2024-09-13T05:11:53.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.827 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.827 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.827 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285242+0000", 2024-09-13T05:11:53.827 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4369999999999999e-06 2024-09-13T05:11:53.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.827 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.827 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.827 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285249+0000", 2024-09-13T05:11:53.827 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2919999999999998e-06 2024-09-13T05:11:53.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.827 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.827 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.827 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285255+0000", 2024-09-13T05:11:53.827 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.088e-06 2024-09-13T05:11:53.828 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.828 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.828 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.828 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.828 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.828 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137704 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.828 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.293127+0000", 2024-09-13T05:11:53.828 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.028006508999999999, 2024-09-13T05:11:53.828 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.036780159, 2024-09-13T05:11:53.828 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.828 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.828 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.828 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.828 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.829 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137704 2024-09-13T05:11:53.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.829 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.829 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293127+0000", 2024-09-13T05:11:53.829 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.829 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293127+0000", 2024-09-13T05:11:53.829 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.830 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293126+0000", 2024-09-13T05:11:53.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.830 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.830 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.830 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293130+0000", 2024-09-13T05:11:53.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1370000000000002e-06 2024-09-13T05:11:53.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.830 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.830 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.830 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293143+0000", 2024-09-13T05:11:53.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3402e-05 2024-09-13T05:11:53.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.830 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.831 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.831 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293149+0000", 2024-09-13T05:11:53.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0290000000000002e-06 2024-09-13T05:11:53.831 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.831 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.831 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.831 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.831 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137736 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.831 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.301200+0000", 2024-09-13T05:11:53.831 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.019933566, 2024-09-13T05:11:53.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.028769414, 2024-09-13T05:11:53.831 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.831 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.831 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.832 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.832 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.832 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137736 2024-09-13T05:11:53.832 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.832 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.832 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.832 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.832 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301200+0000", 2024-09-13T05:11:53.832 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.832 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.832 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.832 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.832 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301200+0000", 2024-09-13T05:11:53.832 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.833 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.833 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.833 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301199+0000", 2024-09-13T05:11:53.833 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.833 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.833 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.833 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301203+0000", 2024-09-13T05:11:53.833 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1829999999999998e-06 2024-09-13T05:11:53.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.833 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.833 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.833 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301212+0000", 2024-09-13T05:11:53.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9340000000000001e-06 2024-09-13T05:11:53.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301220+0000", 2024-09-13T05:11:53.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9889999999999992e-06 2024-09-13T05:11:53.834 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.834 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.834 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.834 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137768 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.834 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.305500+0000", 2024-09-13T05:11:53.834 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.015633102999999999, 2024-09-13T05:11:53.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.024536299000000001, 2024-09-13T05:11:53.835 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.835 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.835 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.835 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.835 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.835 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137768 2024-09-13T05:11:53.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.835 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.835 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.835 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305500+0000", 2024-09-13T05:11:53.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.836 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305500+0000", 2024-09-13T05:11:53.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.836 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305500+0000", 2024-09-13T05:11:53.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.836 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305503+0000", 2024-09-13T05:11:53.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0460000000000001e-06 2024-09-13T05:11:53.837 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.837 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.837 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.837 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305516+0000", 2024-09-13T05:11:53.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3288000000000001e-05 2024-09-13T05:11:53.837 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.837 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.837 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.837 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305523+0000", 2024-09-13T05:11:53.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3050000000000004e-06 2024-09-13T05:11:53.837 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.837 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.837 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.837 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.838 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.838 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137800 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.838 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.313362+0000", 2024-09-13T05:11:53.838 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0077714780000000001, 2024-09-13T05:11:53.838 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.016737378000000001, 2024-09-13T05:11:53.838 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.838 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.838 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.838 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.838 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.838 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137800 2024-09-13T05:11:53.838 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.838 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.838 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.838 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.839 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313362+0000", 2024-09-13T05:11:53.839 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.839 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.839 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.839 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313362+0000", 2024-09-13T05:11:53.839 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.839 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.839 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.839 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313361+0000", 2024-09-13T05:11:53.839 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.840 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313365+0000", 2024-09-13T05:11:53.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.134e-06 2024-09-13T05:11:53.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.840 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313371+0000", 2024-09-13T05:11:53.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8630000000000002e-06 2024-09-13T05:11:53.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.840 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313378+0000", 2024-09-13T05:11:53.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.985e-06 2024-09-13T05:11:53.841 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.841 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.841 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.841 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.841 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137832 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.841 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.321258+0000", 2024-09-13T05:11:53.841 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9998755, 2024-09-13T05:11:53.841 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0089046520000000007, 2024-09-13T05:11:53.841 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.841 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.841 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.841 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.841 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.842 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137832 2024-09-13T05:11:53.842 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.842 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.842 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.842 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.842 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321258+0000", 2024-09-13T05:11:53.842 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.842 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.842 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.842 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.842 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321258+0000", 2024-09-13T05:11:53.842 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.842 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.842 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.843 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.843 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321257+0000", 2024-09-13T05:11:53.843 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.843 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.843 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321266+0000", 2024-09-13T05:11:53.843 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1079999999999999e-06 2024-09-13T05:11:53.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.843 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.843 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321301+0000", 2024-09-13T05:11:53.843 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4925000000000002e-05 2024-09-13T05:11:53.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.844 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.844 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.844 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321307+0000", 2024-09-13T05:11:53.844 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8289999999999996e-06 2024-09-13T05:11:53.844 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.844 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.844 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.844 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.844 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.844 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137673 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.844 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.285261+0000", 2024-09-13T05:11:53.844 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.035872791000000001, 2024-09-13T05:11:53.844 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.044968573999999997, 2024-09-13T05:11:53.844 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.845 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.845 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.845 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.845 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.845 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137673 2024-09-13T05:11:53.845 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.845 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.845 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.845 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.845 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285261+0000", 2024-09-13T05:11:53.845 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.845 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.845 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.845 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.845 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285261+0000", 2024-09-13T05:11:53.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.846 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285260+0000", 2024-09-13T05:11:53.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.846 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285263+0000", 2024-09-13T05:11:53.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0740000000000001e-06 2024-09-13T05:11:53.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.846 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285270+0000", 2024-09-13T05:11:53.847 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8569999999999997e-06 2024-09-13T05:11:53.847 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.847 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.847 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.847 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285276+0000", 2024-09-13T05:11:53.847 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9059999999999999e-06 2024-09-13T05:11:53.847 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.847 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.847 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.847 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.847 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.847 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137705 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.847 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.293154+0000", 2024-09-13T05:11:53.847 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.027979489999999999, 2024-09-13T05:11:53.848 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037139871999999997, 2024-09-13T05:11:53.848 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.848 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.848 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.848 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.848 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.848 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137705 2024-09-13T05:11:53.848 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.848 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.848 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.848 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.848 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293154+0000", 2024-09-13T05:11:53.848 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.848 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.848 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.849 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.849 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293154+0000", 2024-09-13T05:11:53.849 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.849 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.849 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.849 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.849 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293153+0000", 2024-09-13T05:11:53.849 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.849 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.849 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.849 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.849 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293157+0000", 2024-09-13T05:11:53.849 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1489999999999998e-06 2024-09-13T05:11:53.849 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.850 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.850 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.850 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293171+0000", 2024-09-13T05:11:53.850 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3998999999999999e-05 2024-09-13T05:11:53.850 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.850 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.850 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.850 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293178+0000", 2024-09-13T05:11:53.850 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3719999999999999e-06 2024-09-13T05:11:53.850 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.850 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.850 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.850 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.850 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.850 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137737 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.851 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.301226+0000", 2024-09-13T05:11:53.851 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.019907438, 2024-09-13T05:11:53.851 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.029131366999999998, 2024-09-13T05:11:53.851 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.851 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.851 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.851 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.851 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.851 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137737 2024-09-13T05:11:53.851 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.851 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.851 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.851 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.851 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301226+0000", 2024-09-13T05:11:53.852 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.852 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.852 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.852 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.852 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301226+0000", 2024-09-13T05:11:53.852 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.852 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.852 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.852 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.852 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301225+0000", 2024-09-13T05:11:53.852 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:53.852 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.852 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.853 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.853 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301229+0000", 2024-09-13T05:11:53.853 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1939999999999998e-06 2024-09-13T05:11:53.853 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.853 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.853 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.853 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301235+0000", 2024-09-13T05:11:53.853 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.64e-06 2024-09-13T05:11:53.853 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.853 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.853 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.853 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301241+0000", 2024-09-13T05:11:53.853 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1140000000000002e-06 2024-09-13T05:11:53.853 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.854 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.854 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.854 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.854 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.854 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137769 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.854 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.305544+0000", 2024-09-13T05:11:53.854 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.01558911, 2024-09-13T05:11:53.854 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.024875062999999999, 2024-09-13T05:11:53.854 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.854 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.854 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.854 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.854 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.854 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137769 2024-09-13T05:11:53.854 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.855 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.855 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.855 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.855 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305544+0000", 2024-09-13T05:11:53.855 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.855 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.855 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.855 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.855 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305544+0000", 2024-09-13T05:11:53.855 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.855 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.855 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.855 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.855 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305544+0000", 2024-09-13T05:11:53.856 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:53.856 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.856 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.856 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.856 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305547+0000", 2024-09-13T05:11:53.856 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2260000000000001e-06 2024-09-13T05:11:53.856 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.856 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.856 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.856 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305554+0000", 2024-09-13T05:11:53.856 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2169999999999997e-06 2024-09-13T05:11:53.856 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.856 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.856 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.857 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305560+0000", 2024-09-13T05:11:53.857 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9630000000000003e-06 2024-09-13T05:11:53.857 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.857 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.857 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.857 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.857 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.857 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137801 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.857 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.313384+0000", 2024-09-13T05:11:53.857 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0077499270000000002, 2024-09-13T05:11:53.857 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.017100007, 2024-09-13T05:11:53.857 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.857 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.857 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.858 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.858 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.858 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137801 2024-09-13T05:11:53.858 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.858 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.858 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.858 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.858 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313384+0000", 2024-09-13T05:11:53.858 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.858 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.858 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.858 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.858 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313384+0000", 2024-09-13T05:11:53.858 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.859 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.859 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.859 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.859 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313383+0000", 2024-09-13T05:11:53.859 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.859 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.859 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.859 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.859 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313386+0000", 2024-09-13T05:11:53.859 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1259999999999998e-06 2024-09-13T05:11:53.859 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.859 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.859 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.859 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313400+0000", 2024-09-13T05:11:53.859 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3385e-05 2024-09-13T05:11:53.860 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.860 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.860 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.860 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313406+0000", 2024-09-13T05:11:53.860 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.032e-06 2024-09-13T05:11:53.860 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.860 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.860 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.860 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.860 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.860 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137833 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.860 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.321312+0000", 2024-09-13T05:11:53.860 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9998217, 2024-09-13T05:11:53.860 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0092348889999999996, 2024-09-13T05:11:53.861 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.861 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.861 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.861 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.861 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.861 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137833 2024-09-13T05:11:53.861 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.861 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.861 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.861 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.861 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321312+0000", 2024-09-13T05:11:53.861 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.861 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.862 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.862 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.862 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321312+0000", 2024-09-13T05:11:53.862 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.862 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.862 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.862 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.862 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321311+0000", 2024-09-13T05:11:53.862 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.862 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.862 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.862 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.862 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321315+0000", 2024-09-13T05:11:53.862 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.095e-06 2024-09-13T05:11:53.862 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.863 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.863 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.863 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321321+0000", 2024-09-13T05:11:53.863 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6050000000000003e-06 2024-09-13T05:11:53.863 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.863 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.863 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.863 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321328+0000", 2024-09-13T05:11:53.863 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8000000000000001e-06 2024-09-13T05:11:53.863 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.863 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.863 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.863 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.863 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.864 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137674 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.864 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.285281+0000", 2024-09-13T05:11:53.864 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.035852188, 2024-09-13T05:11:53.864 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.045330557, 2024-09-13T05:11:53.864 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.864 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.864 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.864 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.864 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.864 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137674 2024-09-13T05:11:53.864 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.864 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.864 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.865 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.865 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285281+0000", 2024-09-13T05:11:53.865 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.865 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.865 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.865 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.865 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285281+0000", 2024-09-13T05:11:53.865 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.865 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.865 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.865 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.865 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285281+0000", 2024-09-13T05:11:53.865 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.865 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.866 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.866 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.866 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285301+0000", 2024-09-13T05:11:53.866 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0383000000000001e-05 2024-09-13T05:11:53.866 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.866 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.866 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.866 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285309+0000", 2024-09-13T05:11:53.866 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8709999999999997e-06 2024-09-13T05:11:53.866 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.866 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.866 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.866 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285317+0000", 2024-09-13T05:11:53.866 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7970000000000001e-06 2024-09-13T05:11:53.867 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.867 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.867 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.867 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.867 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.867 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137706 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.867 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.293183+0000", 2024-09-13T05:11:53.867 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.027950379000000001, 2024-09-13T05:11:53.867 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037493747000000001, 2024-09-13T05:11:53.867 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.867 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.867 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.867 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.867 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.868 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137706 2024-09-13T05:11:53.868 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.868 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.868 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.868 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.868 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293183+0000", 2024-09-13T05:11:53.868 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.868 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.868 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.868 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.868 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293183+0000", 2024-09-13T05:11:53.868 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.868 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.868 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.869 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.869 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293183+0000", 2024-09-13T05:11:53.869 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.869 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.869 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.869 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.869 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293186+0000", 2024-09-13T05:11:53.869 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0570000000000001e-06 2024-09-13T05:11:53.869 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.869 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.869 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.869 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293199+0000", 2024-09-13T05:11:53.869 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3525e-05 2024-09-13T05:11:53.869 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.869 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.870 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.870 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293205+0000", 2024-09-13T05:11:53.870 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0630000000000002e-06 2024-09-13T05:11:53.870 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.870 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.870 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.870 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.870 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137738 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.870 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.301246+0000", 2024-09-13T05:11:53.870 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.019886986999999998, 2024-09-13T05:11:53.870 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.029492655999999999, 2024-09-13T05:11:53.870 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.870 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.871 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.871 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.871 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.871 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137738 2024-09-13T05:11:53.871 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.871 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.871 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.871 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.871 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301246+0000", 2024-09-13T05:11:53.871 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.871 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.871 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.871 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.871 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301246+0000", 2024-09-13T05:11:53.871 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.872 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.872 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.872 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.872 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301246+0000", 2024-09-13T05:11:53.872 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.872 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.872 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.872 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.872 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301249+0000", 2024-09-13T05:11:53.872 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.18e-06 2024-09-13T05:11:53.872 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.872 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.872 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.872 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301256+0000", 2024-09-13T05:11:53.873 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7660000000000001e-06 2024-09-13T05:11:53.873 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.873 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.873 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.873 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301262+0000", 2024-09-13T05:11:53.873 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8830000000000003e-06 2024-09-13T05:11:53.873 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.873 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.873 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.873 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.873 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.873 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137770 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.873 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.309124+0000", 2024-09-13T05:11:53.873 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.012009328, 2024-09-13T05:11:53.874 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.021678425000000001, 2024-09-13T05:11:53.874 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.874 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.874 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.874 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.874 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.874 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137770 2024-09-13T05:11:53.874 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.874 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.874 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.874 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.874 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309124+0000", 2024-09-13T05:11:53.874 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.874 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.875 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.875 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.875 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309124+0000", 2024-09-13T05:11:53.875 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.875 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.875 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.875 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.305565+0000", 2024-09-13T05:11:53.875 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9964404 2024-09-13T05:11:53.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.875 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.875 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.875 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309131+0000", 2024-09-13T05:11:53.875 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0035661730000000002 2024-09-13T05:11:53.876 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.876 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.876 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.876 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309153+0000", 2024-09-13T05:11:53.876 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1926e-05 2024-09-13T05:11:53.876 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.876 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.876 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.876 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309163+0000", 2024-09-13T05:11:53.876 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0094e-05 2024-09-13T05:11:53.876 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.876 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.876 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.876 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.877 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.877 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137802 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.877 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.313416+0000", 2024-09-13T05:11:53.877 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0077171219999999999, 2024-09-13T05:11:53.877 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.017448297000000001, 2024-09-13T05:11:53.877 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.877 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.877 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.877 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.877 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.877 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137802 2024-09-13T05:11:53.877 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.877 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.877 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.878 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.878 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313416+0000", 2024-09-13T05:11:53.878 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.878 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.878 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.878 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313416+0000", 2024-09-13T05:11:53.878 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.878 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.878 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.878 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313416+0000", 2024-09-13T05:11:53.878 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.879 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313419+0000", 2024-09-13T05:11:53.879 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.252e-06 2024-09-13T05:11:53.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.879 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313428+0000", 2024-09-13T05:11:53.879 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3279999999999995e-06 2024-09-13T05:11:53.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.879 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313441+0000", 2024-09-13T05:11:53.879 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2846e-05 2024-09-13T05:11:53.880 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.880 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.880 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.880 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.880 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.880 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137834 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.880 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.321333+0000", 2024-09-13T05:11:53.880 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9998007, 2024-09-13T05:11:53.880 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0095965259999999993, 2024-09-13T05:11:53.880 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.880 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.880 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.880 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.881 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.881 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137834 2024-09-13T05:11:53.881 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.881 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.881 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.881 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.881 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321333+0000", 2024-09-13T05:11:53.881 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.881 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.881 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.881 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.881 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321333+0000", 2024-09-13T05:11:53.881 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.881 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.882 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.882 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321332+0000", 2024-09-13T05:11:53.882 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.882 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.882 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321335+0000", 2024-09-13T05:11:53.882 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.937e-06 2024-09-13T05:11:53.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.882 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.882 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321341+0000", 2024-09-13T05:11:53.882 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3459999999999999e-06 2024-09-13T05:11:53.883 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.883 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.883 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.883 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321347+0000", 2024-09-13T05:11:53.883 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:11:53.883 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.883 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.883 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.883 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.883 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.883 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137675 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.883 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.285322+0000", 2024-09-13T05:11:53.883 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.035810982999999998, 2024-09-13T05:11:53.883 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.045672755000000002, 2024-09-13T05:11:53.884 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.884 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.884 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.884 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.884 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.884 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137675 2024-09-13T05:11:53.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.884 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.884 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.884 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.884 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285322+0000", 2024-09-13T05:11:53.884 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.884 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.885 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285322+0000", 2024-09-13T05:11:53.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.885 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.885 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285322+0000", 2024-09-13T05:11:53.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.885 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.885 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285325+0000", 2024-09-13T05:11:53.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0920000000000002e-06 2024-09-13T05:11:53.885 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.886 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.886 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.886 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285332+0000", 2024-09-13T05:11:53.886 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8480000000000003e-06 2024-09-13T05:11:53.886 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.886 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.886 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.886 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285338+0000", 2024-09-13T05:11:53.886 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7660000000000004e-06 2024-09-13T05:11:53.886 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.886 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.886 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.886 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.886 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.887 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137707 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.887 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.293212+0000", 2024-09-13T05:11:53.887 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.027921725000000001, 2024-09-13T05:11:53.887 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.037848518999999997, 2024-09-13T05:11:53.887 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.887 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.887 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.887 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.887 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.887 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137707 2024-09-13T05:11:53.887 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.887 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.887 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.887 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.888 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293212+0000", 2024-09-13T05:11:53.888 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.888 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.888 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.888 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.888 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293212+0000", 2024-09-13T05:11:53.888 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.888 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.888 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.888 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.888 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293211+0000", 2024-09-13T05:11:53.888 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.888 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.888 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.888 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.889 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293214+0000", 2024-09-13T05:11:53.889 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.14e-06 2024-09-13T05:11:53.889 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.889 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.889 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.889 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293221+0000", 2024-09-13T05:11:53.889 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7229999999999998e-06 2024-09-13T05:11:53.889 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.889 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.889 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.889 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293227+0000", 2024-09-13T05:11:53.889 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9030000000000001e-06 2024-09-13T05:11:53.889 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.889 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.890 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.890 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.890 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.890 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137739 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.890 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.301267+0000", 2024-09-13T05:11:53.890 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.019866123999999999, 2024-09-13T05:11:53.890 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.029855288000000001, 2024-09-13T05:11:53.890 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.890 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.890 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.890 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.890 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.890 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137739 2024-09-13T05:11:53.891 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.891 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.891 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.891 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.891 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301267+0000", 2024-09-13T05:11:53.891 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.891 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.891 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.891 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.891 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301267+0000", 2024-09-13T05:11:53.891 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.891 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.891 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.891 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.892 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301267+0000", 2024-09-13T05:11:53.892 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.892 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.892 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301270+0000", 2024-09-13T05:11:53.892 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.146e-06 2024-09-13T05:11:53.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.892 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.892 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301276+0000", 2024-09-13T05:11:53.892 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.64e-06 2024-09-13T05:11:53.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.893 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.893 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301283+0000", 2024-09-13T05:11:53.893 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1569999999999997e-06 2024-09-13T05:11:53.893 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.893 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.893 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.893 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.893 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.893 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137771 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.893 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.309171+0000", 2024-09-13T05:11:53.893 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.011962555, 2024-09-13T05:11:53.893 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.022014338000000001, 2024-09-13T05:11:53.893 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.893 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.894 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.894 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.894 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.894 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137771 2024-09-13T05:11:53.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.894 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.894 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.894 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.894 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309171+0000", 2024-09-13T05:11:53.894 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.894 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.894 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.894 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309171+0000", 2024-09-13T05:11:53.895 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.895 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.895 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309170+0000", 2024-09-13T05:11:53.895 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.895 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.895 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309181+0000", 2024-09-13T05:11:53.895 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0205e-05 2024-09-13T05:11:53.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.895 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.896 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309196+0000", 2024-09-13T05:11:53.896 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5048000000000001e-05 2024-09-13T05:11:53.896 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.896 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.896 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.896 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309203+0000", 2024-09-13T05:11:53.896 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9829999999999999e-06 2024-09-13T05:11:53.896 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.896 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.896 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.896 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.896 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.896 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137803 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.896 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.313461+0000", 2024-09-13T05:11:53.897 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0076721030000000004, 2024-09-13T05:11:53.897 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.017789116000000001, 2024-09-13T05:11:53.897 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.897 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.897 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.897 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.897 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.897 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137803 2024-09-13T05:11:53.897 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.897 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.897 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.897 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.897 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313461+0000", 2024-09-13T05:11:53.897 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.898 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.898 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313461+0000", 2024-09-13T05:11:53.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.898 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.898 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313461+0000", 2024-09-13T05:11:53.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.898 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.898 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313464+0000", 2024-09-13T05:11:53.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1219999999999999e-06 2024-09-13T05:11:53.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.899 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.899 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.899 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313471+0000", 2024-09-13T05:11:53.899 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0230000000000004e-06 2024-09-13T05:11:53.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.899 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.899 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.899 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313489+0000", 2024-09-13T05:11:53.899 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8274000000000002e-05 2024-09-13T05:11:53.899 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.899 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.899 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.900 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.900 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137835 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.900 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.321378+0000", 2024-09-13T05:11:53.900 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9997554, 2024-09-13T05:11:53.900 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0099381049999999992, 2024-09-13T05:11:53.900 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.900 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.900 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.900 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.900 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.900 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137835 2024-09-13T05:11:53.900 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.900 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.900 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321378+0000", 2024-09-13T05:11:53.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321378+0000", 2024-09-13T05:11:53.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321377+0000", 2024-09-13T05:11:53.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321381+0000", 2024-09-13T05:11:53.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.151e-06 2024-09-13T05:11:53.902 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321387+0000", 2024-09-13T05:11:53.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6250000000000001e-06 2024-09-13T05:11:53.902 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321393+0000", 2024-09-13T05:11:53.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4949999999999999e-06 2024-09-13T05:11:53.902 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.903 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.903 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.903 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.903 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.903 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137676 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.903 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.285343+0000", 2024-09-13T05:11:53.903 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.035790866999999997, 2024-09-13T05:11:53.903 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.046038677, 2024-09-13T05:11:53.903 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.903 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.903 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.903 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.903 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.903 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137676 2024-09-13T05:11:53.904 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.904 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.904 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.904 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.904 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285343+0000", 2024-09-13T05:11:53.904 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.904 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.904 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.904 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.904 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285343+0000", 2024-09-13T05:11:53.904 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.904 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.904 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.904 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.905 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285342+0000", 2024-09-13T05:11:53.905 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.905 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.905 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.905 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.905 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285346+0000", 2024-09-13T05:11:53.905 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7969999999999998e-06 2024-09-13T05:11:53.905 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.905 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.905 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.905 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285354+0000", 2024-09-13T05:11:53.905 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0479999999999999e-06 2024-09-13T05:11:53.905 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.905 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.905 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.906 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285360+0000", 2024-09-13T05:11:53.906 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9030000000000001e-06 2024-09-13T05:11:53.906 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.906 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.906 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.906 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.906 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.906 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137708 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.906 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.293232+0000", 2024-09-13T05:11:53.906 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.027901509000000001, 2024-09-13T05:11:53.906 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038211781, 2024-09-13T05:11:53.906 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.906 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.906 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.907 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.907 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.907 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137708 2024-09-13T05:11:53.907 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.907 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.907 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.907 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.907 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293232+0000", 2024-09-13T05:11:53.907 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.907 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.907 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.907 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.907 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293232+0000", 2024-09-13T05:11:53.907 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.908 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.908 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.908 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.908 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293231+0000", 2024-09-13T05:11:53.908 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.908 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.908 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.908 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.908 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293235+0000", 2024-09-13T05:11:53.908 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3280000000000002e-06 2024-09-13T05:11:53.908 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.908 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.908 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.908 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293246+0000", 2024-09-13T05:11:53.909 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0913999999999999e-05 2024-09-13T05:11:53.909 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.909 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.909 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.909 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293252+0000", 2024-09-13T05:11:53.909 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9719999999999997e-06 2024-09-13T05:11:53.909 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.909 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.909 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.909 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.909 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.909 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137740 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.909 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.301288+0000", 2024-09-13T05:11:53.909 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.019845801999999999, 2024-09-13T05:11:53.909 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.030221146000000001, 2024-09-13T05:11:53.910 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.910 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.910 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.910 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.910 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.910 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137740 2024-09-13T05:11:53.910 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.910 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.910 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.910 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.910 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301288+0000", 2024-09-13T05:11:53.910 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.910 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.910 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.911 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.911 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301288+0000", 2024-09-13T05:11:53.911 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.911 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.911 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301287+0000", 2024-09-13T05:11:53.911 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.911 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.911 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301291+0000", 2024-09-13T05:11:53.911 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.517e-06 2024-09-13T05:11:53.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.912 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.912 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301297+0000", 2024-09-13T05:11:53.912 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8079999999999999e-06 2024-09-13T05:11:53.912 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.912 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.912 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.912 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301303+0000", 2024-09-13T05:11:53.912 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.037e-06 2024-09-13T05:11:53.912 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.912 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.912 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.912 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.912 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.912 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137772 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.913 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.309208+0000", 2024-09-13T05:11:53.913 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.011925473000000001, 2024-09-13T05:11:53.913 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.022365142000000001, 2024-09-13T05:11:53.913 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.913 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.913 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.913 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.913 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.913 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137772 2024-09-13T05:11:53.913 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.913 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.913 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.913 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.913 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309208+0000", 2024-09-13T05:11:53.914 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.914 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.914 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.914 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.914 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309208+0000", 2024-09-13T05:11:53.914 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.914 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.914 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.914 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.914 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309207+0000", 2024-09-13T05:11:53.914 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.914 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.914 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.914 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.914 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309211+0000", 2024-09-13T05:11:53.915 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6169999999999998e-06 2024-09-13T05:11:53.915 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.915 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.915 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.915 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309231+0000", 2024-09-13T05:11:53.915 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9766e-05 2024-09-13T05:11:53.915 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.915 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.915 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.915 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309251+0000", 2024-09-13T05:11:53.915 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9765000000000001e-05 2024-09-13T05:11:53.915 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.915 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.915 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.916 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.916 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.916 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137804 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.916 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.313495+0000", 2024-09-13T05:11:53.916 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0076383290000000001, 2024-09-13T05:11:53.916 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.018139875999999999, 2024-09-13T05:11:53.916 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.916 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.916 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.916 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.916 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.916 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137804 2024-09-13T05:11:53.916 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.916 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.917 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.917 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.917 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313495+0000", 2024-09-13T05:11:53.917 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.917 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.917 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.917 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.917 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313495+0000", 2024-09-13T05:11:53.917 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.917 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.917 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.917 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.917 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313494+0000", 2024-09-13T05:11:53.918 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:53.918 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.918 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.918 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.918 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313498+0000", 2024-09-13T05:11:53.918 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6540000000000001e-06 2024-09-13T05:11:53.918 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.918 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.918 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.918 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313505+0000", 2024-09-13T05:11:53.918 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8279999999999997e-06 2024-09-13T05:11:53.918 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.918 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.918 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.919 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313511+0000", 2024-09-13T05:11:53.919 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0290000000000002e-06 2024-09-13T05:11:53.919 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.919 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.919 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.919 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.919 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137836 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.919 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.321398+0000", 2024-09-13T05:11:53.919 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9997358, 2024-09-13T05:11:53.919 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010300531, 2024-09-13T05:11:53.919 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.919 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.919 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.919 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.920 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.920 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137836 2024-09-13T05:11:53.920 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.920 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.920 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.920 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.920 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321398+0000", 2024-09-13T05:11:53.920 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.920 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.920 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.920 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.920 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321398+0000", 2024-09-13T05:11:53.920 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.920 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.921 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.921 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.921 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321397+0000", 2024-09-13T05:11:53.921 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.921 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.921 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.921 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.921 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321400+0000", 2024-09-13T05:11:53.921 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2770000000000001e-06 2024-09-13T05:11:53.921 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.921 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.921 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.921 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321407+0000", 2024-09-13T05:11:53.921 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2539999999999998e-06 2024-09-13T05:11:53.922 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.922 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.922 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.922 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321412+0000", 2024-09-13T05:11:53.922 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4310000000000002e-06 2024-09-13T05:11:53.922 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.922 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.922 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.922 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.922 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.922 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137677 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.922 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.285367+0000", 2024-09-13T05:11:53.922 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.035766393, 2024-09-13T05:11:53.922 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.046399163, 2024-09-13T05:11:53.923 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.923 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.923 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.923 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.923 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.923 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137677 2024-09-13T05:11:53.923 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.923 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.923 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.923 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.923 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285367+0000", 2024-09-13T05:11:53.923 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.923 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.923 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.923 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.924 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285367+0000", 2024-09-13T05:11:53.924 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.924 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.924 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.924 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.924 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285366+0000", 2024-09-13T05:11:53.924 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:53.924 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.924 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.924 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.924 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285370+0000", 2024-09-13T05:11:53.924 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.411e-06 2024-09-13T05:11:53.924 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.924 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.925 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.925 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285376+0000", 2024-09-13T05:11:53.925 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6200000000000001e-06 2024-09-13T05:11:53.925 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.925 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.925 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.925 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285382+0000", 2024-09-13T05:11:53.925 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8889999999999999e-06 2024-09-13T05:11:53.925 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.925 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.925 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.925 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.925 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.925 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137709 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.926 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.293258+0000", 2024-09-13T05:11:53.926 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.027875034999999999, 2024-09-13T05:11:53.926 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038569947, 2024-09-13T05:11:53.926 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.926 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.926 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.926 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.926 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.926 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137709 2024-09-13T05:11:53.926 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.926 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.926 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.926 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.926 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293258+0000", 2024-09-13T05:11:53.927 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.927 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.927 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.927 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.927 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293258+0000", 2024-09-13T05:11:53.927 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.927 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.927 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.927 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.927 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293258+0000", 2024-09-13T05:11:53.927 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.927 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.927 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.927 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.928 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293261+0000", 2024-09-13T05:11:53.928 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4199999999999999e-06 2024-09-13T05:11:53.928 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.928 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.928 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.928 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293272+0000", 2024-09-13T05:11:53.928 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1e-05 2024-09-13T05:11:53.928 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.928 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.928 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.928 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293278+0000", 2024-09-13T05:11:53.928 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0689999999999998e-06 2024-09-13T05:11:53.928 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.928 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.929 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.929 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.929 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137741 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.929 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.301310+0000", 2024-09-13T05:11:53.929 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.019823922000000001, 2024-09-13T05:11:53.929 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.030581164000000001, 2024-09-13T05:11:53.929 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.929 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.929 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.929 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.929 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.929 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137741 2024-09-13T05:11:53.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.930 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.930 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.930 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.930 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301310+0000", 2024-09-13T05:11:53.930 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.930 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.930 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.930 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.930 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301310+0000", 2024-09-13T05:11:53.930 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.930 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.930 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.930 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.930 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301309+0000", 2024-09-13T05:11:53.930 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:53.931 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.931 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.931 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.931 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301314+0000", 2024-09-13T05:11:53.931 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9799999999999998e-06 2024-09-13T05:11:53.931 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.931 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.931 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.931 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301346+0000", 2024-09-13T05:11:53.931 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2672999999999997e-05 2024-09-13T05:11:53.931 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.931 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.931 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.931 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301353+0000", 2024-09-13T05:11:53.932 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8059999999999997e-06 2024-09-13T05:11:53.932 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.932 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.932 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.932 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.932 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.932 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137773 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.932 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.309256+0000", 2024-09-13T05:11:53.932 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.011877008, 2024-09-13T05:11:53.932 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.022695920000000001, 2024-09-13T05:11:53.932 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.932 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.932 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.932 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.932 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.933 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137773 2024-09-13T05:11:53.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.933 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.933 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.933 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.933 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309256+0000", 2024-09-13T05:11:53.933 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.933 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.933 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.933 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309256+0000", 2024-09-13T05:11:53.933 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.933 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.934 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309256+0000", 2024-09-13T05:11:53.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.934 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.934 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309259+0000", 2024-09-13T05:11:53.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.32e-06 2024-09-13T05:11:53.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.934 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.934 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309266+0000", 2024-09-13T05:11:53.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.905e-06 2024-09-13T05:11:53.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.935 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.935 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.935 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309284+0000", 2024-09-13T05:11:53.935 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8026e-05 2024-09-13T05:11:53.935 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.935 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.935 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.935 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.935 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.935 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137805 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.935 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.313516+0000", 2024-09-13T05:11:53.935 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.007617024, 2024-09-13T05:11:53.935 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.018499181, 2024-09-13T05:11:53.935 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.936 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.936 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.936 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.936 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.936 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137805 2024-09-13T05:11:53.936 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.936 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.936 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.936 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.936 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313516+0000", 2024-09-13T05:11:53.936 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.936 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.936 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.936 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.937 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313516+0000", 2024-09-13T05:11:53.937 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.937 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.937 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.937 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.937 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313516+0000", 2024-09-13T05:11:53.937 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.937 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.937 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.937 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.937 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313519+0000", 2024-09-13T05:11:53.937 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.163e-06 2024-09-13T05:11:53.937 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.937 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.938 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.938 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313526+0000", 2024-09-13T05:11:53.938 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6630000000000004e-06 2024-09-13T05:11:53.938 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.938 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.938 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.938 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313533+0000", 2024-09-13T05:11:53.938 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2710000000000003e-06 2024-09-13T05:11:53.938 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.938 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.938 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.938 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.938 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.938 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137837 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.939 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.321417+0000", 2024-09-13T05:11:53.939 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9997168, 2024-09-13T05:11:53.939 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010661999, 2024-09-13T05:11:53.939 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.939 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.939 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.939 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.939 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.939 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137837 2024-09-13T05:11:53.939 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.939 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.939 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.939 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.939 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321417+0000", 2024-09-13T05:11:53.939 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.940 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.940 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.940 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.940 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321417+0000", 2024-09-13T05:11:53.940 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.940 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.940 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.940 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.940 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321416+0000", 2024-09-13T05:11:53.940 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.940 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.940 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.940 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.941 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321419+0000", 2024-09-13T05:11:53.941 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7769999999999998e-06 2024-09-13T05:11:53.941 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.941 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.941 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.941 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321425+0000", 2024-09-13T05:11:53.941 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1630000000000001e-06 2024-09-13T05:11:53.941 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.941 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.941 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.941 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321431+0000", 2024-09-13T05:11:53.941 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4480000000000002e-06 2024-09-13T05:11:53.941 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.941 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.942 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.942 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.942 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.942 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137678 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.942 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.285445+0000", 2024-09-13T05:11:53.942 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.035688131999999997, 2024-09-13T05:11:53.942 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.046697912000000001, 2024-09-13T05:11:53.942 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.942 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.942 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.942 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.942 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.942 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137678 2024-09-13T05:11:53.942 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.943 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.943 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.943 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285445+0000", 2024-09-13T05:11:53.943 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.943 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.943 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285445+0000", 2024-09-13T05:11:53.943 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.943 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.943 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285445+0000", 2024-09-13T05:11:53.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.944 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285449+0000", 2024-09-13T05:11:53.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8569999999999997e-06 2024-09-13T05:11:53.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.944 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285456+0000", 2024-09-13T05:11:53.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.4000000000000003e-06 2024-09-13T05:11:53.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.944 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.945 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285462+0000", 2024-09-13T05:11:53.945 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1249999999999998e-06 2024-09-13T05:11:53.945 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.945 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.945 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.945 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.945 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.945 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137710 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.945 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.293286+0000", 2024-09-13T05:11:53.945 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.027847912999999998, 2024-09-13T05:11:53.945 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038920751000000003, 2024-09-13T05:11:53.945 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.945 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.945 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.946 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.946 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.946 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137710 2024-09-13T05:11:53.946 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.946 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.946 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.946 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.946 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293286+0000", 2024-09-13T05:11:53.946 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.946 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.946 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.946 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.946 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293286+0000", 2024-09-13T05:11:53.946 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.947 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.947 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.947 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293285+0000", 2024-09-13T05:11:53.947 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.947 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.947 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.947 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293294+0000", 2024-09-13T05:11:53.947 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3230000000000004e-06 2024-09-13T05:11:53.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.947 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.947 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.947 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293301+0000", 2024-09-13T05:11:53.948 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1849999999999998e-06 2024-09-13T05:11:53.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.948 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.948 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293308+0000", 2024-09-13T05:11:53.948 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3169999999999998e-06 2024-09-13T05:11:53.948 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.948 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.948 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.948 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137742 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.948 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.301359+0000", 2024-09-13T05:11:53.948 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.019774514999999999, 2024-09-13T05:11:53.949 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.030909761000000001, 2024-09-13T05:11:53.949 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.949 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.949 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.949 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.949 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.949 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137742 2024-09-13T05:11:53.949 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.949 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.949 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.949 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.949 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301359+0000", 2024-09-13T05:11:53.949 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.949 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.950 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.950 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301359+0000", 2024-09-13T05:11:53.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.950 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.950 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301358+0000", 2024-09-13T05:11:53.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.950 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.950 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301362+0000", 2024-09-13T05:11:53.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4170000000000001e-06 2024-09-13T05:11:53.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.951 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.951 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.951 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301369+0000", 2024-09-13T05:11:53.951 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.097e-06 2024-09-13T05:11:53.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.951 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.951 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.951 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301375+0000", 2024-09-13T05:11:53.951 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0569999999999998e-06 2024-09-13T05:11:53.951 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.951 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.951 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.952 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137774 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.952 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.309290+0000", 2024-09-13T05:11:53.952 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.011843772000000001, 2024-09-13T05:11:53.952 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.023041915999999999, 2024-09-13T05:11:53.952 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.952 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.952 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.952 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.952 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.952 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137774 2024-09-13T05:11:53.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.953 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.953 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.953 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309290+0000", 2024-09-13T05:11:53.953 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.953 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.953 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309290+0000", 2024-09-13T05:11:53.953 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.953 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309289+0000", 2024-09-13T05:11:53.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309292+0000", 2024-09-13T05:11:53.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2049999999999998e-06 2024-09-13T05:11:53.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309299+0000", 2024-09-13T05:11:53.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9859999999999997e-06 2024-09-13T05:11:53.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.955 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.955 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309305+0000", 2024-09-13T05:11:53.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.925e-06 2024-09-13T05:11:53.955 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.955 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.955 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.955 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.955 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.955 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137806 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.955 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.317116+0000", 2024-09-13T05:11:53.955 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0040171119999999998, 2024-09-13T05:11:53.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.015278280999999999, 2024-09-13T05:11:53.955 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.955 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.956 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.956 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.956 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.956 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137806 2024-09-13T05:11:53.956 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.956 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.956 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.956 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.956 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317116+0000", 2024-09-13T05:11:53.956 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.956 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.956 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.956 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.956 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317116+0000", 2024-09-13T05:11:53.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.957 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.313538+0000", 2024-09-13T05:11:53.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9964213 2024-09-13T05:11:53.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.957 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317122+0000", 2024-09-13T05:11:53.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003584383 2024-09-13T05:11:53.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317134+0000", 2024-09-13T05:11:53.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1576999999999999e-05 2024-09-13T05:11:53.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317156+0000", 2024-09-13T05:11:53.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2717e-05 2024-09-13T05:11:53.958 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.958 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.958 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.958 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137838 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.958 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.321435+0000", 2024-09-13T05:11:53.958 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9996982, 2024-09-13T05:11:53.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.011022873000000001, 2024-09-13T05:11:53.959 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.959 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.959 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.959 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.959 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.959 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137838 2024-09-13T05:11:53.959 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.959 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.959 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.959 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321435+0000", 2024-09-13T05:11:53.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.959 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321435+0000", 2024-09-13T05:11:53.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321435+0000", 2024-09-13T05:11:53.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321438+0000", 2024-09-13T05:11:53.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8940000000000002e-06 2024-09-13T05:11:53.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321445+0000", 2024-09-13T05:11:53.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5059999999999998e-06 2024-09-13T05:11:53.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321450+0000", 2024-09-13T05:11:53.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:11:53.961 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.961 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.961 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.962 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137679 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.962 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.285468+0000", 2024-09-13T05:11:53.962 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.035665891999999998, 2024-09-13T05:11:53.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.047055397999999998, 2024-09-13T05:11:53.962 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.962 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.962 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.962 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.962 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.962 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137679 2024-09-13T05:11:53.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.962 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285468+0000", 2024-09-13T05:11:53.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285468+0000", 2024-09-13T05:11:53.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285467+0000", 2024-09-13T05:11:53.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285470+0000", 2024-09-13T05:11:53.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4309999999999998e-06 2024-09-13T05:11:53.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285477+0000", 2024-09-13T05:11:53.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7259999999999996e-06 2024-09-13T05:11:53.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285483+0000", 2024-09-13T05:11:53.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9569999999999999e-06 2024-09-13T05:11:53.965 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.965 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.965 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.965 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.965 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.965 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137711 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.965 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.293313+0000", 2024-09-13T05:11:53.965 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.027820522, 2024-09-13T05:11:53.965 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.039272268999999999, 2024-09-13T05:11:53.965 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.965 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.965 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.965 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.966 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.966 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137711 2024-09-13T05:11:53.966 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.966 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.966 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.966 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.966 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293313+0000", 2024-09-13T05:11:53.966 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.966 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.966 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.966 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.966 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293313+0000", 2024-09-13T05:11:53.966 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.966 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.967 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293312+0000", 2024-09-13T05:11:53.967 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.967 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.967 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293316+0000", 2024-09-13T05:11:53.967 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.546e-06 2024-09-13T05:11:53.967 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.967 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293323+0000", 2024-09-13T05:11:53.967 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6170000000000003e-06 2024-09-13T05:11:53.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.968 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.968 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293329+0000", 2024-09-13T05:11:53.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0249999999999999e-06 2024-09-13T05:11:53.968 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.968 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.968 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.968 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137743 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.968 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.301380+0000", 2024-09-13T05:11:53.968 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.019753401, 2024-09-13T05:11:53.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031267093000000003, 2024-09-13T05:11:53.969 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.969 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.969 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.969 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.969 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.969 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137743 2024-09-13T05:11:53.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.969 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.969 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.969 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301380+0000", 2024-09-13T05:11:53.969 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.970 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301380+0000", 2024-09-13T05:11:53.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.970 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.970 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301379+0000", 2024-09-13T05:11:53.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.970 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.970 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301383+0000", 2024-09-13T05:11:53.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5769999999999998e-06 2024-09-13T05:11:53.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.970 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.971 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301390+0000", 2024-09-13T05:11:53.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6170000000000003e-06 2024-09-13T05:11:53.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.971 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.971 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301396+0000", 2024-09-13T05:11:53.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0109999999999997e-06 2024-09-13T05:11:53.971 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.971 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.971 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.971 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.971 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137775 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.972 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.309312+0000", 2024-09-13T05:11:53.972 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.011821375, 2024-09-13T05:11:53.972 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.023397030999999999, 2024-09-13T05:11:53.972 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.972 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.972 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.972 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.972 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.972 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137775 2024-09-13T05:11:53.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.972 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.972 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.972 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.972 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309312+0000", 2024-09-13T05:11:53.973 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.973 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.973 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309312+0000", 2024-09-13T05:11:53.973 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.973 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.973 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309312+0000", 2024-09-13T05:11:53.973 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.973 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.974 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309315+0000", 2024-09-13T05:11:53.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4680000000000001e-06 2024-09-13T05:11:53.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.974 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.974 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309322+0000", 2024-09-13T05:11:53.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7599999999999997e-06 2024-09-13T05:11:53.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.974 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.974 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309328+0000", 2024-09-13T05:11:53.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8490000000000002e-06 2024-09-13T05:11:53.974 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.974 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.974 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.975 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.975 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137807 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.975 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.317176+0000", 2024-09-13T05:11:53.975 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0039579680000000001, 2024-09-13T05:11:53.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.015597994, 2024-09-13T05:11:53.975 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.975 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.975 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.975 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.975 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.975 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137807 2024-09-13T05:11:53.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.975 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.976 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.976 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.976 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317176+0000", 2024-09-13T05:11:53.976 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.976 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.976 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.976 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.976 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317176+0000", 2024-09-13T05:11:53.976 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.976 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.976 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.976 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.976 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317175+0000", 2024-09-13T05:11:53.976 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.977 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.977 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.977 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.977 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317178+0000", 2024-09-13T05:11:53.977 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4369999999999999e-06 2024-09-13T05:11:53.977 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.977 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.977 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.977 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317188+0000", 2024-09-13T05:11:53.977 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3910000000000004e-06 2024-09-13T05:11:53.977 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.977 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.977 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.978 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317201+0000", 2024-09-13T05:11:53.978 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3614e-05 2024-09-13T05:11:53.978 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.978 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.978 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.978 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.978 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137839 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.978 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.321455+0000", 2024-09-13T05:11:53.978 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9996781, 2024-09-13T05:11:53.978 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.011381565999999999, 2024-09-13T05:11:53.978 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.978 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.978 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.979 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.979 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.979 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137839 2024-09-13T05:11:53.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.979 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321455+0000", 2024-09-13T05:11:53.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321455+0000", 2024-09-13T05:11:53.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.980 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.980 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.980 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321455+0000", 2024-09-13T05:11:53.980 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.980 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.980 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.980 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321458+0000", 2024-09-13T05:11:53.980 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2090000000000001e-06 2024-09-13T05:11:53.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.980 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.980 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.980 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321467+0000", 2024-09-13T05:11:53.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7509999999999997e-06 2024-09-13T05:11:53.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.981 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.981 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321472+0000", 2024-09-13T05:11:53.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3970000000000002e-06 2024-09-13T05:11:53.981 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.981 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.981 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.981 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137680 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.981 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.285488+0000", 2024-09-13T05:11:53.981 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.035645255000000001, 2024-09-13T05:11:53.982 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.047413161000000002, 2024-09-13T05:11:53.982 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.982 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.982 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.982 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.982 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.982 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137680 2024-09-13T05:11:53.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.982 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.982 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.982 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.982 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285488+0000", 2024-09-13T05:11:53.982 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.983 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285488+0000", 2024-09-13T05:11:53.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.983 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.983 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285488+0000", 2024-09-13T05:11:53.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.983 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.983 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285491+0000", 2024-09-13T05:11:53.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1889999999999999e-06 2024-09-13T05:11:53.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285497+0000", 2024-09-13T05:11:53.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5479999999999998e-06 2024-09-13T05:11:53.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285506+0000", 2024-09-13T05:11:53.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7399999999999993e-06 2024-09-13T05:11:53.984 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.984 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.984 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.985 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137712 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.985 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.293334+0000", 2024-09-13T05:11:53.985 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.027799665000000001, 2024-09-13T05:11:53.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.039643277999999997, 2024-09-13T05:11:53.985 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.985 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.985 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.985 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.985 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.985 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137712 2024-09-13T05:11:53.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.985 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.986 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293334+0000", 2024-09-13T05:11:53.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.986 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293334+0000", 2024-09-13T05:11:53.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.986 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293333+0000", 2024-09-13T05:11:53.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293336+0000", 2024-09-13T05:11:53.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2339999999999999e-06 2024-09-13T05:11:53.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293343+0000", 2024-09-13T05:11:53.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6710000000000002e-06 2024-09-13T05:11:53.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293349+0000", 2024-09-13T05:11:53.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.195e-06 2024-09-13T05:11:53.988 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.988 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.988 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.988 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137744 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.988 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.301401+0000", 2024-09-13T05:11:53.988 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.019732544000000001, 2024-09-13T05:11:53.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031640385, 2024-09-13T05:11:53.988 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.988 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.988 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.988 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.989 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.989 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137744 2024-09-13T05:11:53.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.989 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301401+0000", 2024-09-13T05:11:53.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301401+0000", 2024-09-13T05:11:53.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.990 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.990 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301400+0000", 2024-09-13T05:11:53.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.990 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.990 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301403+0000", 2024-09-13T05:11:53.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1259999999999998e-06 2024-09-13T05:11:53.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.990 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.990 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301410+0000", 2024-09-13T05:11:53.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5860000000000001e-06 2024-09-13T05:11:53.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.991 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.991 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301416+0000", 2024-09-13T05:11:53.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0589999999999999e-06 2024-09-13T05:11:53.991 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.991 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.991 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.991 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137776 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.991 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.309333+0000", 2024-09-13T05:11:53.991 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.011800481, 2024-09-13T05:11:53.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.023770689000000001, 2024-09-13T05:11:53.991 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.992 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.992 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.992 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.992 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.992 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137776 2024-09-13T05:11:53.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.992 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.992 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.992 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309333+0000", 2024-09-13T05:11:53.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.992 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309333+0000", 2024-09-13T05:11:53.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309332+0000", 2024-09-13T05:11:53.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309336+0000", 2024-09-13T05:11:53.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0970000000000002e-06 2024-09-13T05:11:53.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:53.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309342+0000", 2024-09-13T05:11:53.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7259999999999996e-06 2024-09-13T05:11:53.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:53.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309355+0000", 2024-09-13T05:11:53.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3114e-05 2024-09-13T05:11:53.997 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.997 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:53.997 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:53.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.997 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137808 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:53.997 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.317221+0000", 2024-09-13T05:11:53.997 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0039129170000000001, 2024-09-13T05:11:53.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.015945001, 2024-09-13T05:11:53.998 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:53.998 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:53.998 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:53.998 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:53.998 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:53.998 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137808 2024-09-13T05:11:53.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.998 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:53.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:53.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317221+0000", 2024-09-13T05:11:53.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:53.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317221+0000", 2024-09-13T05:11:53.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:53.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:53.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317220+0000", 2024-09-13T05:11:53.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:53.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:53.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:53.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:53.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317223+0000", 2024-09-13T05:11:53.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2399999999999999e-06 2024-09-13T05:11:53.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.000 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317233+0000", 2024-09-13T05:11:54.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3370000000000006e-06 2024-09-13T05:11:54.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.000 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317245+0000", 2024-09-13T05:11:54.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2109e-05 2024-09-13T05:11:54.000 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.000 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.000 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.001 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137840 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:54.001 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.325024+0000", 2024-09-13T05:11:54.001 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9961095, 2024-09-13T05:11:54.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0082049099999999993, 2024-09-13T05:11:54.001 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.001 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:54.001 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.001 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.001 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.001 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137840 2024-09-13T05:11:54.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.001 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.001 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.325024+0000", 2024-09-13T05:11:54.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.325024+0000", 2024-09-13T05:11:54.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.321476+0000", 2024-09-13T05:11:54.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9964523 2024-09-13T05:11:54.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.325029+0000", 2024-09-13T05:11:54.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0035531959999999998 2024-09-13T05:11:54.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.325041+0000", 2024-09-13T05:11:54.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1266e-05 2024-09-13T05:11:54.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.325048+0000", 2024-09-13T05:11:54.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2960000000000001e-06 2024-09-13T05:11:54.003 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.003 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.004 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.004 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137681 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:54.004 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.285511+0000", 2024-09-13T05:11:54.004 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.035622173, 2024-09-13T05:11:54.004 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.047785197000000001, 2024-09-13T05:11:54.004 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.004 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:54.004 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.004 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.004 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.005 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137681 2024-09-13T05:11:54.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.005 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.005 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285511+0000", 2024-09-13T05:11:54.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.005 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285511+0000", 2024-09-13T05:11:54.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285511+0000", 2024-09-13T05:11:54.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285514+0000", 2024-09-13T05:11:54.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.14e-06 2024-09-13T05:11:54.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285521+0000", 2024-09-13T05:11:54.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8940000000000004e-06 2024-09-13T05:11:54.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285527+0000", 2024-09-13T05:11:54.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8860000000000001e-06 2024-09-13T05:11:54.007 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.007 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.007 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.007 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137713 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:54.007 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.293356+0000", 2024-09-13T05:11:54.007 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.027777340000000001, 2024-09-13T05:11:54.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040005893000000001, 2024-09-13T05:11:54.007 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.007 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:54.008 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.008 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.008 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.008 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137713 2024-09-13T05:11:54.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.008 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.008 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.008 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293356+0000", 2024-09-13T05:11:54.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.008 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.008 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293356+0000", 2024-09-13T05:11:54.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.009 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.009 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293356+0000", 2024-09-13T05:11:54.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.009 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.009 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293359+0000", 2024-09-13T05:11:54.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.083e-06 2024-09-13T05:11:54.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.010 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293365+0000", 2024-09-13T05:11:54.010 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.64e-06 2024-09-13T05:11:54.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.010 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293371+0000", 2024-09-13T05:11:54.010 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8279999999999999e-06 2024-09-13T05:11:54.010 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.010 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.010 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.010 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137745 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:54.010 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.301423+0000", 2024-09-13T05:11:54.011 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.019710113000000001, 2024-09-13T05:11:54.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.031965309999999997, 2024-09-13T05:11:54.011 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.011 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:54.011 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.011 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.011 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.011 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137745 2024-09-13T05:11:54.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.011 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.011 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.011 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301423+0000", 2024-09-13T05:11:54.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.012 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.012 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.012 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301423+0000", 2024-09-13T05:11:54.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.012 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.012 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.012 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301423+0000", 2024-09-13T05:11:54.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:54.012 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.012 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.012 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301426+0000", 2024-09-13T05:11:54.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4479999999999999e-06 2024-09-13T05:11:54.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301455+0000", 2024-09-13T05:11:54.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9187999999999999e-05 2024-09-13T05:11:54.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301478+0000", 2024-09-13T05:11:54.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2748e-05 2024-09-13T05:11:54.013 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.013 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.013 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.014 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137777 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:54.014 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.309373+0000", 2024-09-13T05:11:54.014 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.01176019, 2024-09-13T05:11:54.014 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.024040588000000002, 2024-09-13T05:11:54.014 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.014 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:54.014 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.014 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.014 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.014 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137777 2024-09-13T05:11:54.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.014 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309373+0000", 2024-09-13T05:11:54.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309373+0000", 2024-09-13T05:11:54.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309373+0000", 2024-09-13T05:11:54.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.016 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.016 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309376+0000", 2024-09-13T05:11:54.016 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.18e-06 2024-09-13T05:11:54.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.016 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.016 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309383+0000", 2024-09-13T05:11:54.016 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0740000000000004e-06 2024-09-13T05:11:54.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.016 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.016 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309389+0000", 2024-09-13T05:11:54.016 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9370000000000001e-06 2024-09-13T05:11:54.017 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.017 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.017 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.017 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.017 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137809 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:54.017 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.317263+0000", 2024-09-13T05:11:54.017 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0038708750000000002, 2024-09-13T05:11:54.017 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.016177767999999999, 2024-09-13T05:11:54.017 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.017 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:54.017 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.017 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.018 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.018 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137809 2024-09-13T05:11:54.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.018 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317263+0000", 2024-09-13T05:11:54.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317263+0000", 2024-09-13T05:11:54.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317262+0000", 2024-09-13T05:11:54.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317265+0000", 2024-09-13T05:11:54.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.208e-06 2024-09-13T05:11:54.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317272+0000", 2024-09-13T05:11:54.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7150000000000001e-06 2024-09-13T05:11:54.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.020 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.020 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317278+0000", 2024-09-13T05:11:54.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7080000000000002e-06 2024-09-13T05:11:54.020 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.020 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.020 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.020 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137841 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:54.020 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.325055+0000", 2024-09-13T05:11:54.020 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9960785, 2024-09-13T05:11:54.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0084112479999999996, 2024-09-13T05:11:54.020 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.021 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:54.021 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.021 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.021 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.021 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137841 2024-09-13T05:11:54.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.021 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.021 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.021 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.325055+0000", 2024-09-13T05:11:54.021 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.021 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.325055+0000", 2024-09-13T05:11:54.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.325054+0000", 2024-09-13T05:11:54.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.325058+0000", 2024-09-13T05:11:54.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2940000000000001e-06 2024-09-13T05:11:54.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.325064+0000", 2024-09-13T05:11:54.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2829999999999998e-06 2024-09-13T05:11:54.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.325069+0000", 2024-09-13T05:11:54.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.451e-06 2024-09-13T05:11:54.023 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.023 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.023 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.023 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137682 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:54.024 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.285532+0000", 2024-09-13T05:11:54.024 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.035601610999999998, 2024-09-13T05:11:54.024 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.047963147999999997, 2024-09-13T05:11:54.024 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.024 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:54.024 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.024 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.024 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.024 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137682 2024-09-13T05:11:54.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.024 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.025 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285532+0000", 2024-09-13T05:11:54.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.025 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.025 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285532+0000", 2024-09-13T05:11:54.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.025 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.025 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285531+0000", 2024-09-13T05:11:54.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.026 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.026 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285534+0000", 2024-09-13T05:11:54.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1140000000000002e-06 2024-09-13T05:11:54.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.026 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.026 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285541+0000", 2024-09-13T05:11:54.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5830000000000003e-06 2024-09-13T05:11:54.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.026 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.026 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285547+0000", 2024-09-13T05:11:54.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0399999999999998e-06 2024-09-13T05:11:54.026 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.027 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.027 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.027 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137714 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:54.027 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.293376+0000", 2024-09-13T05:11:54.027 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.027757291999999999, 2024-09-13T05:11:54.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040144359999999997, 2024-09-13T05:11:54.027 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.027 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:54.027 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.027 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.027 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.027 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137714 2024-09-13T05:11:54.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.028 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.028 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293376+0000", 2024-09-13T05:11:54.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.028 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293376+0000", 2024-09-13T05:11:54.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293376+0000", 2024-09-13T05:11:54.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293379+0000", 2024-09-13T05:11:54.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9909999999999998e-06 2024-09-13T05:11:54.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293385+0000", 2024-09-13T05:11:54.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7349999999999999e-06 2024-09-13T05:11:54.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.030 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293391+0000", 2024-09-13T05:11:54.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0510000000000002e-06 2024-09-13T05:11:54.030 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.030 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.030 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.030 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137746 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:54.030 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.301487+0000", 2024-09-13T05:11:54.030 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.019646859999999999, 2024-09-13T05:11:54.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032059746, 2024-09-13T05:11:54.030 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.030 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:54.031 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.031 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.031 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.031 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137746 2024-09-13T05:11:54.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.031 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.031 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.031 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301487+0000", 2024-09-13T05:11:54.031 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.031 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.031 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301487+0000", 2024-09-13T05:11:54.031 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301486+0000", 2024-09-13T05:11:54.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:54.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301490+0000", 2024-09-13T05:11:54.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6710000000000001e-06 2024-09-13T05:11:54.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301497+0000", 2024-09-13T05:11:54.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.109e-06 2024-09-13T05:11:54.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301510+0000", 2024-09-13T05:11:54.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3422e-05 2024-09-13T05:11:54.033 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.033 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.033 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.033 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137778 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:54.033 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.309408+0000", 2024-09-13T05:11:54.033 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.011725225000000001, 2024-09-13T05:11:54.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.024163311999999999, 2024-09-13T05:11:54.034 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.034 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:54.034 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.034 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.034 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.034 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137778 2024-09-13T05:11:54.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.034 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309408+0000", 2024-09-13T05:11:54.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.035 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309408+0000", 2024-09-13T05:11:54.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.035 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309408+0000", 2024-09-13T05:11:54.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:11:54.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.035 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309411+0000", 2024-09-13T05:11:54.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7850000000000002e-06 2024-09-13T05:11:54.036 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.036 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.036 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.036 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309419+0000", 2024-09-13T05:11:54.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.4549999999999998e-06 2024-09-13T05:11:54.036 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.036 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.036 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.036 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309425+0000", 2024-09-13T05:11:54.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9619999999999998e-06 2024-09-13T05:11:54.036 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.036 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.036 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.036 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.036 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.037 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137810 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:54.037 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.317282+0000", 2024-09-13T05:11:54.037 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0038511499999999998, 2024-09-13T05:11:54.037 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.016314319000000001, 2024-09-13T05:11:54.037 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.037 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:54.037 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.037 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.037 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.037 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137810 2024-09-13T05:11:54.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.037 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.037 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317282+0000", 2024-09-13T05:11:54.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317282+0000", 2024-09-13T05:11:54.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317282+0000", 2024-09-13T05:11:54.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317285+0000", 2024-09-13T05:11:54.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8679999999999999e-06 2024-09-13T05:11:54.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317291+0000", 2024-09-13T05:11:54.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2829999999999998e-06 2024-09-13T05:11:54.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317314+0000", 2024-09-13T05:11:54.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2982000000000001e-05 2024-09-13T05:11:54.039 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.039 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.040 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.040 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137842 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:54.040 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.325074+0000", 2024-09-13T05:11:54.040 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9960594, 2024-09-13T05:11:54.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0085479460000000007, 2024-09-13T05:11:54.040 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.040 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:54.040 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.040 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.040 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.040 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137842 2024-09-13T05:11:54.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.041 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.041 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.041 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.041 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.325074+0000", 2024-09-13T05:11:54.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.041 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.041 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.041 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.325074+0000", 2024-09-13T05:11:54.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.041 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.041 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.041 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.325074+0000", 2024-09-13T05:11:54.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.325077+0000", 2024-09-13T05:11:54.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9340000000000002e-06 2024-09-13T05:11:54.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.325085+0000", 2024-09-13T05:11:54.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8520000000000004e-06 2024-09-13T05:11:54.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.325104+0000", 2024-09-13T05:11:54.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9006000000000001e-05 2024-09-13T05:11:54.043 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.043 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.043 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.043 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137683 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:54.043 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.285552+0000", 2024-09-13T05:11:54.043 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.035581371000000001, 2024-09-13T05:11:54.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048097657000000002, 2024-09-13T05:11:54.043 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.043 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:54.043 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.043 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.044 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.044 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137683 2024-09-13T05:11:54.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.044 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285552+0000", 2024-09-13T05:11:54.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285552+0000", 2024-09-13T05:11:54.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285552+0000", 2024-09-13T05:11:54.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285555+0000", 2024-09-13T05:11:54.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3950000000000001e-06 2024-09-13T05:11:54.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285562+0000", 2024-09-13T05:11:54.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6479999999999997e-06 2024-09-13T05:11:54.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.046 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.046 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.285567+0000", 2024-09-13T05:11:54.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8680000000000004e-06 2024-09-13T05:11:54.046 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.046 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.046 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.046 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137715 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:54.046 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.293397+0000", 2024-09-13T05:11:54.046 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.027736849000000001, 2024-09-13T05:11:54.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.040280269, 2024-09-13T05:11:54.047 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.047 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:54.047 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.047 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.047 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.047 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137715 2024-09-13T05:11:54.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.047 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293397+0000", 2024-09-13T05:11:54.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293397+0000", 2024-09-13T05:11:54.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293396+0000", 2024-09-13T05:11:54.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293399+0000", 2024-09-13T05:11:54.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0400000000000001e-06 2024-09-13T05:11:54.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.049 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293406+0000", 2024-09-13T05:11:54.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6540000000000002e-06 2024-09-13T05:11:54.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.049 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.293412+0000", 2024-09-13T05:11:54.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9200000000000001e-06 2024-09-13T05:11:54.049 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.049 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.049 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.050 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137747 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:54.050 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.301528+0000", 2024-09-13T05:11:54.050 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.019605029999999999, 2024-09-13T05:11:54.050 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.032173805999999999, 2024-09-13T05:11:54.050 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.050 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:54.050 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.050 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.050 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.050 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137747 2024-09-13T05:11:54.050 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.050 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.050 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.050 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.050 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301528+0000", 2024-09-13T05:11:54.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301528+0000", 2024-09-13T05:11:54.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301528+0000", 2024-09-13T05:11:54.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301536+0000", 2024-09-13T05:11:54.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6309999999999992e-06 2024-09-13T05:11:54.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301559+0000", 2024-09-13T05:11:54.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2745999999999999e-05 2024-09-13T05:11:54.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.301566+0000", 2024-09-13T05:11:54.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.302e-06 2024-09-13T05:11:54.052 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.052 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.053 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.053 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137779 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:54.053 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.309430+0000", 2024-09-13T05:11:54.053 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.011703517, 2024-09-13T05:11:54.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.024297696000000001, 2024-09-13T05:11:54.053 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.053 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:54.053 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.053 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.053 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.053 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137779 2024-09-13T05:11:54.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.054 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309430+0000", 2024-09-13T05:11:54.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309430+0000", 2024-09-13T05:11:54.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309429+0000", 2024-09-13T05:11:54.055 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.055 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.055 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309433+0000", 2024-09-13T05:11:54.055 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:11:54.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.055 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.055 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309439+0000", 2024-09-13T05:11:54.055 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.64e-06 2024-09-13T05:11:54.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.055 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.056 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.309445+0000", 2024-09-13T05:11:54.056 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7969999999999997e-06 2024-09-13T05:11:54.056 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.056 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.056 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.056 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.056 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137811 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:54.056 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.317322+0000", 2024-09-13T05:11:54.056 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0038111880000000001, 2024-09-13T05:11:54.056 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.016430112, 2024-09-13T05:11:54.056 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.056 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:54.056 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.057 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.057 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.057 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137811 2024-09-13T05:11:54.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.057 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317322+0000", 2024-09-13T05:11:54.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317322+0000", 2024-09-13T05:11:54.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317322+0000", 2024-09-13T05:11:54.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317325+0000", 2024-09-13T05:11:54.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.225e-06 2024-09-13T05:11:54.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317338+0000", 2024-09-13T05:11:54.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3193999999999999e-05 2024-09-13T05:11:54.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.059 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.059 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.059 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.317346+0000", 2024-09-13T05:11:54.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1030000000000002e-06 2024-09-13T05:11:54.059 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.059 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.059 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.059 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.059 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:137843 3.11 3.961dc691 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:54.059 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:53.325109+0000", 2024-09-13T05:11:54.060 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4294967295.9960246, 2024-09-13T05:11:54.060 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.008669019, 2024-09-13T05:11:54.060 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.060 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "queued for pg", 2024-09-13T05:11:54.060 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.060 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.060 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.060 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 137843 2024-09-13T05:11:54.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.060 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.060 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.060 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.060 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.325109+0000", 2024-09-13T05:11:54.060 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.325109+0000", 2024-09-13T05:11:54.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.325108+0000", 2024-09-13T05:11:54.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.325112+0000", 2024-09-13T05:11:54.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3170000000000002e-06 2024-09-13T05:11:54.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.325122+0000", 2024-09-13T05:11:54.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0223e-05 2024-09-13T05:11:54.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:53.325129+0000", 2024-09-13T05:11:54.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5769999999999999e-06 2024-09-13T05:11:54.063 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.063 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.063 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.063 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.063 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-09-13T05:11:54.063 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 215 2024-09-13T05:11:54.063 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:54.063 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T05:11:54.066 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:11:54.066 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:54.057+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:54.068 INFO:teuthology.orchestra.run.smithi120.stdout:4851 trunc from 0x94a9880 to 0xd9ebf90 2024-09-13T05:11:54.068 INFO:teuthology.orchestra.run.smithi120.stdout:4852 write 0xa7fbc3a thru 0xa80562a (0x99f1 bytes) 2024-09-13T05:11:54.068 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:54.069 INFO:teuthology.orchestra.run.smithi120.stdout:4854 write 0x846fcc3 thru 0x847278f (0x2acd bytes) 2024-09-13T05:11:54.069 INFO:teuthology.orchestra.run.smithi120.stdout:4855 read 0x9fb8cfa thru 0x9fc7ab9 (0xedc0 bytes) 2024-09-13T05:11:54.069 INFO:teuthology.orchestra.run.smithi120.stdout:4856 read 0x8e648a1 thru 0x8e66fc4 (0x2724 bytes) 2024-09-13T05:11:54.069 INFO:teuthology.orchestra.run.smithi120.stdout:4857 write 0x56bfc30 thru 0x56cd7e2 (0xdbb3 bytes) 2024-09-13T05:11:54.069 INFO:teuthology.orchestra.run.smithi120.stdout:4859 read 0x3047d23 thru 0x3055dc4 (0xe0a2 bytes) 2024-09-13T05:11:54.069 INFO:teuthology.orchestra.run.smithi120.stdout:4860 write 0xa34b2d5 thru 0xa3577d0 (0xc4fc bytes) 2024-09-13T05:11:54.069 INFO:teuthology.orchestra.run.smithi120.stdout:4862 punch from 0x49cbede to 0x49ce17f, (0x22a1 bytes) 2024-09-13T05:11:54.069 INFO:teuthology.orchestra.run.smithi120.stdout:4863 read 0x274af49 thru 0x275812f (0xd1e7 bytes) 2024-09-13T05:11:54.069 INFO:teuthology.orchestra.run.smithi120.stdout:4864 trunc from 0xd9ebf90 to 0xe064510 2024-09-13T05:11:54.069 INFO:teuthology.orchestra.run.smithi120.stdout:4866 writesame 0xb4088bf thru 0xb4111c8 data_size 0x9(0x890a bytes) 2024-09-13T05:11:54.069 INFO:teuthology.orchestra.run.smithi120.stdout:4867 write 0x6fd99ca thru 0x6fe47c5 (0xadfc bytes) 2024-09-13T05:11:54.069 INFO:teuthology.orchestra.run.smithi120.stdout:4868 punch from 0x242e2bd to 0x243c610, (0xe353 bytes) 2024-09-13T05:11:54.069 INFO:teuthology.orchestra.run.smithi120.stdout:4870 punch from 0x203a670 to 0x2049e85, (0xf815 bytes) 2024-09-13T05:11:54.069 INFO:teuthology.orchestra.run.smithi120.stdout:4872 read 0x7d09a20 thru 0x7d15b2c (0xc10d bytes) 2024-09-13T05:11:54.070 INFO:teuthology.orchestra.run.smithi120.stdout:4873 read 0x7fff484 thru 0x800d821 (0xe39e bytes) 2024-09-13T05:11:54.070 INFO:teuthology.orchestra.run.smithi120.stdout:4874 write 0x8c08307 thru 0x8c12bb5 (0xa8af bytes) 2024-09-13T05:11:54.070 INFO:teuthology.orchestra.run.smithi120.stdout:4875 trunc from 0xe064510 to 0x411d606 2024-09-13T05:11:54.070 INFO:teuthology.orchestra.run.smithi120.stdout:4876 writesame 0xc517c79 thru 0xc51d4fa data_size 0x1(0x5882 bytes) 2024-09-13T05:11:54.070 INFO:teuthology.orchestra.run.smithi120.stdout:4877 write 0x9d7e34d thru 0x9d868fd (0x85b1 bytes) 2024-09-13T05:11:54.070 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:54.070 INFO:teuthology.orchestra.run.smithi120.stdout:4880 punch from 0x82a3b9 to 0x836ecc, (0xcb13 bytes) 2024-09-13T05:11:54.070 INFO:teuthology.orchestra.run.smithi120.stdout:4881 punch from 0x2481521 to 0x2486877, (0x5356 bytes) 2024-09-13T05:11:54.070 INFO:teuthology.orchestra.run.smithi120.stdout:4882 read 0x11b2d08 thru 0x11bed46 (0xc03f bytes) 2024-09-13T05:11:54.070 INFO:teuthology.orchestra.run.smithi120.stdout:4883 punch from 0x4122279 to 0x41318d0, (0xf657 bytes) 2024-09-13T05:11:54.070 INFO:teuthology.orchestra.run.smithi120.stdout:4884 punch from 0x4bb2f39 to 0x4bb3149, (0x210 bytes) 2024-09-13T05:11:54.070 INFO:teuthology.orchestra.run.smithi120.stdout:4885 trunc from 0xc51d4fb to 0xa47682a 2024-09-13T05:11:54.070 INFO:teuthology.orchestra.run.smithi120.stdout:4886 write 0xecb41b0 thru 0xecb5d53 (0x1ba4 bytes) 2024-09-13T05:11:54.070 INFO:teuthology.orchestra.run.smithi120.stdout:4888 read 0x66ea679 thru 0x66f7889 (0xd211 bytes) 2024-09-13T05:11:54.070 INFO:teuthology.orchestra.run.smithi120.stdout:4889 punch from 0x4a408e1 to 0x4a4f50f, (0xec2e bytes) 2024-09-13T05:11:54.071 INFO:teuthology.orchestra.run.smithi120.stdout:4890 write 0xb27e1b6 thru 0xb28a451 (0xc29c bytes) 2024-09-13T05:11:54.101 INFO:teuthology.orchestra.run.smithi120.stdout:4891 punch from 0x1c4cae9 to 0x1c56abe, (0x9fd5 bytes) 2024-09-13T05:11:54.101 INFO:teuthology.orchestra.run.smithi120.stdout:4892 write 0xb8b83aa thru 0xb8c3a23 (0xb67a bytes) 2024-09-13T05:11:54.133 INFO:teuthology.orchestra.run.smithi120.stdout:4893 trunc from 0xecb5d54 to 0xac10565 2024-09-13T05:11:54.159 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:54.159 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:54.165 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:54.157+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:54.165 INFO:teuthology.orchestra.run.smithi120.stdout:4899 trunc from 0xac10565 to 0x74d299a 2024-09-13T05:11:54.185 INFO:teuthology.orchestra.run.smithi120.stdout:4900 punch from 0x12758ac to 0x127a7cc, (0x4f20 bytes) 2024-09-13T05:11:54.189 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:54.189 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:54.190 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:54.190 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:54.190 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:54.201 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:11:54.201 INFO:teuthology.orchestra.run.smithi120.stdout:4903 write 0xb6603f6 thru 0xb66d943 (0xd54e bytes) 2024-09-13T05:11:54.231 INFO:teuthology.orchestra.run.smithi120.stdout:4904 punch from 0x49595aa to 0x4961fd7, (0x8a2d bytes) 2024-09-13T05:11:54.231 INFO:teuthology.orchestra.run.smithi120.stdout:4905 write 0x18e2b61 thru 0x18ed367 (0xa807 bytes) 2024-09-13T05:11:54.266 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:54.264+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:54.268 INFO:teuthology.orchestra.run.smithi120.stdout:4906 write 0xd74daae thru 0xd751986 (0x3ed9 bytes) 2024-09-13T05:11:54.295 INFO:teuthology.orchestra.run.smithi120.stdout:4907 read 0x1bd0417 thru 0x1bd2f9e (0x2b88 bytes) 2024-09-13T05:11:54.296 INFO:teuthology.orchestra.run.smithi120.stdout:4908 punch from 0x49c477a to 0x49d421a, (0xfaa0 bytes) 2024-09-13T05:11:54.296 INFO:teuthology.orchestra.run.smithi120.stdout:4909 read 0x2557c29 thru 0x255f1ee (0x75c6 bytes) 2024-09-13T05:11:54.296 INFO:teuthology.orchestra.run.smithi120.stdout:4910 punch from 0x9d70317 to 0x9d75730, (0x5419 bytes) 2024-09-13T05:11:54.296 INFO:teuthology.orchestra.run.smithi120.stdout:4911 write 0xbb743da thru 0xbb7f54d (0xb174 bytes) 2024-09-13T05:11:54.318 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:54.319 INFO:teuthology.orchestra.run.smithi120.stdout:4913 read 0x4bcddea thru 0x4bd4ded (0x7004 bytes) 2024-09-13T05:11:54.319 INFO:teuthology.orchestra.run.smithi120.stdout:4914 read 0x5d4d5c3 thru 0x5d4e582 (0xfc0 bytes) 2024-09-13T05:11:54.319 INFO:teuthology.orchestra.run.smithi120.stdout:4915 read 0xabdb640 thru 0xabe1918 (0x62d9 bytes) 2024-09-13T05:11:54.323 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:54.323 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:54.323 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:54.323 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:54.323 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.323 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:54.323 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:54.323 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 77.456891756000005, 2024-09-13T05:11:54.323 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:11:54.324 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.324 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:54.324 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.324 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.324 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.324 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:11:54.324 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.324 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.324 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.324 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.324 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:54.324 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.324 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.325 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.325 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.325 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:54.325 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.325 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.325 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.325 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.325 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:54.325 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:54.325 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.325 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.325 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.325 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:11:54.325 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:11:54.326 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.326 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.326 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.326 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:11:54.326 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:11:54.326 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.326 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.326 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.326 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:11:54.326 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:11:54.326 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.326 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.326 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.326 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:11:54.327 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:11:54.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.327 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.327 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:54.327 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:11:54.327 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:11:54.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.327 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.327 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.327 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:11:54.327 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:11:54.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.327 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.328 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:54.328 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:11:54.328 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:11:54.328 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.328 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.328 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:54.328 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:11:54.328 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:11:54.328 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.328 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.328 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.328 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.328 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.328 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:54.329 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:54.329 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 77.456867320000001, 2024-09-13T05:11:54.329 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:11:54.329 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.329 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:54.329 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.329 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.329 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.329 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:11:54.329 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.329 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.329 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.329 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.329 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:54.330 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.330 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.330 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.330 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:54.330 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.330 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.330 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.330 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:54.330 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:54.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.330 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.330 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.331 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:11:54.331 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:11:54.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.331 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.331 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.331 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:11:54.331 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:11:54.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.331 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.331 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.331 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:11:54.331 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:11:54.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.332 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.332 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.332 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:11:54.332 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:11:54.332 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.332 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.332 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:54.332 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:11:54.332 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:11:54.332 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.332 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.332 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.332 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:11:54.332 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:11:54.333 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.333 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.333 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:54.333 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:11:54.333 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:11:54.333 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.333 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.333 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:54.333 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:11:54.333 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:11:54.333 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.333 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.333 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.333 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.334 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.334 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:54.334 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:54.334 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 77.456857494000005, 2024-09-13T05:11:54.334 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:11:54.334 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.334 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:54.334 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.334 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.334 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.334 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:11:54.334 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.334 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.334 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.335 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.335 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:54.335 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.335 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.335 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.335 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.335 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:54.335 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.335 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.335 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.335 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.335 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:54.335 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:54.335 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.336 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.336 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.336 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:11:54.336 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:11:54.336 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.336 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.336 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.336 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:11:54.336 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:11:54.336 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.336 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.336 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.336 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:11:54.337 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:11:54.337 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.337 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.337 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.337 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:11:54.337 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:11:54.337 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.337 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.337 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:54.337 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:11:54.337 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:11:54.337 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.337 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.337 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.338 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:11:54.338 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:11:54.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.338 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.338 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:54.338 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:11:54.338 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:11:54.338 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.338 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.338 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.338 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.338 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:54.338 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:54.339 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 77.456849258000005, 2024-09-13T05:11:54.339 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:11:54.339 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.339 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:54.339 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.339 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.339 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.339 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:11:54.339 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.339 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.339 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.340 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.340 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:54.340 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.340 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.340 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.340 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.340 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:54.340 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.340 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.340 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.340 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.340 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:54.341 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:54.341 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.341 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.341 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.341 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:11:54.341 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:11:54.341 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.341 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.341 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.341 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:11:54.341 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:11:54.341 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.342 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.342 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.342 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:11:54.342 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:11:54.342 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.342 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.342 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.342 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:11:54.342 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:11:54.342 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.342 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.342 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:54.342 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:11:54.343 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:11:54.343 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.343 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.343 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.343 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:11:54.343 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:11:54.343 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.343 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.343 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:54.343 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:11:54.343 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:11:54.343 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.343 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.343 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.344 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.344 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.344 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:54.344 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:54.344 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 77.456827345999997, 2024-09-13T05:11:54.344 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:11:54.344 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.344 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:54.344 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.345 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.345 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.345 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:11:54.345 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.345 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.345 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.345 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.345 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:54.345 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.345 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.345 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.345 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.345 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:54.345 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.346 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.346 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.346 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.346 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:54.346 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:54.346 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.346 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.346 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.346 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:11:54.346 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:11:54.346 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.346 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.346 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.347 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:11:54.347 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:11:54.347 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.347 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.347 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.347 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:11:54.347 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:11:54.347 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.347 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.348 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.348 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:11:54.348 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:11:54.348 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.348 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.348 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:54.348 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:11:54.348 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:11:54.348 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.348 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.348 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.348 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:11:54.348 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:11:54.348 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.349 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.349 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:54.349 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:11:54.349 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:11:54.349 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.349 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.349 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.349 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.349 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.349 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:54.349 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:54.349 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 77.456818741999996, 2024-09-13T05:11:54.349 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:11:54.350 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.350 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:54.350 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.350 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.350 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.350 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:11:54.350 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.350 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.350 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.350 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.350 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:54.350 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.350 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.351 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.351 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.351 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:54.351 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.351 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.351 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.351 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.351 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:54.351 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:54.351 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.351 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.351 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.351 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:11:54.352 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:11:54.352 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.352 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.352 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.352 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:11:54.352 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:11:54.352 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.352 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.352 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.352 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:11:54.352 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:11:54.352 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.352 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.352 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.353 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:11:54.353 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:11:54.353 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.353 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.353 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:54.353 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:11:54.353 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:11:54.353 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.353 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.353 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.353 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:11:54.353 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:11:54.353 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.354 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.354 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:54.354 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:11:54.354 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:11:54.354 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.354 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.354 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.354 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.354 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.354 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:54.354 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:54.354 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 77.456809047999997, 2024-09-13T05:11:54.354 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:11:54.354 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.355 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:54.355 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.355 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.355 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.355 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:11:54.355 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.355 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.355 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.355 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.355 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:54.356 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.356 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.356 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.356 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.356 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:54.356 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.356 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.356 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.356 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.356 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:54.356 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:54.356 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.356 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.356 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.357 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:11:54.357 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:11:54.357 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.357 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.357 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.357 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:11:54.357 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:11:54.357 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.357 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.357 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.357 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:11:54.357 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:11:54.357 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.358 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.358 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.358 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:11:54.358 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:11:54.358 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.358 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.358 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:54.358 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:11:54.358 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:11:54.358 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.358 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.358 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.358 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:11:54.358 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:11:54.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.359 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.359 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:54.359 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:11:54.359 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:11:54.359 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.359 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.359 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.359 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.359 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:54.359 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:54.359 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 77.456799932999999, 2024-09-13T05:11:54.359 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:11:54.360 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.360 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:54.360 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.360 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.360 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.360 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:11:54.360 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.360 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.360 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.360 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.360 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:54.360 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.360 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.361 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.361 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.361 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:54.361 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.361 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.361 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.361 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.361 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:54.361 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:54.361 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.361 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.361 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.361 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:11:54.361 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:11:54.362 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.362 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.362 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.362 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:11:54.362 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:11:54.362 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.362 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.362 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.362 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:11:54.362 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:11:54.362 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.362 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.362 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.363 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:11:54.363 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:11:54.363 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.363 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.363 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:54.363 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:11:54.363 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:11:54.363 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.363 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.363 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.363 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:11:54.363 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:11:54.363 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.363 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.364 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:54.364 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:11:54.364 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:11:54.364 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.364 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.364 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.364 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.364 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.364 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:54.364 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:11:54.364 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 77.456791453999998, 2024-09-13T05:11:54.364 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:11:54.364 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.364 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:54.365 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.365 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.365 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.365 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:11:54.365 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.365 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.365 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.365 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.365 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:11:54.365 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.365 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.365 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.365 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.365 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:11:54.366 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.366 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.366 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.366 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.366 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:11:54.366 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.366 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.366 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.366 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.366 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:11:54.367 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:11:54.367 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.367 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.367 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.367 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:11:54.367 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:11:54.367 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.367 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.367 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.367 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:11:54.367 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:11:54.367 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.367 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.368 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.368 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:11:54.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:11:54.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.368 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.368 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:54.368 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:11:54.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:11:54.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:11:54.369 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:11:54.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:54.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:11:54.369 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:11:54.369 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.369 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.369 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.370 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.370 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.370 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:54.370 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:11:54.370 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 77.456779529000002, 2024-09-13T05:11:54.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:11:54.370 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.370 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:54.370 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.370 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.370 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.370 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:11:54.370 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.370 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.371 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.371 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.371 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:11:54.371 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.371 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.371 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.371 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.371 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:11:54.371 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.371 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.371 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.371 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.372 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:11:54.372 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:54.372 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.372 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.372 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.372 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:11:54.372 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:11:54.372 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.372 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.372 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.372 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:11:54.372 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:11:54.372 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.373 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.373 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.373 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:11:54.373 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:11:54.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.373 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.373 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.373 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:11:54.373 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:11:54.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.373 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.373 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:54.373 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:11:54.373 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:11:54.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.374 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.374 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.374 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:11:54.374 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:11:54.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.374 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.374 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:54.374 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:11:54.374 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:11:54.374 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.374 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.374 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.375 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.375 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:54.375 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:54.375 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 77.456757940000003, 2024-09-13T05:11:54.375 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:11:54.375 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.375 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:54.375 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.375 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.375 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.375 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:11:54.375 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.375 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.375 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.376 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.376 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:54.376 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.376 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.376 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.376 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.376 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:54.376 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.376 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.376 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.376 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.376 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:54.376 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.376 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.377 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.377 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.377 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:11:54.377 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:11:54.377 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.377 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.377 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.377 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:11:54.377 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:11:54.377 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:11:54.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:11:54.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:11:54.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:11:54.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:54.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:11:54.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:11:54.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:11:54.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:11:54.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:54.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:11:54.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:11:54.379 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.379 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.379 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.380 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:54.380 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:54.380 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 77.456734811999993, 2024-09-13T05:11:54.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:11:54.380 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.380 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:54.380 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.380 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.380 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.380 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:11:54.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.380 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.381 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.381 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:54.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.381 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.381 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:54.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.381 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.381 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:54.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:11:54.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:11:54.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:11:54.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:11:54.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:11:54.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:11:54.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:11:54.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:11:54.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:54.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:11:54.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:11:54.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.384 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.384 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:11:54.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:11:54.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.384 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:54.384 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:11:54.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:11:54.384 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.384 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.384 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.385 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:54.385 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:11:54.385 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 77.456719438999997, 2024-09-13T05:11:54.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:11:54.385 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.385 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:54.385 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.385 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.385 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.385 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:11:54.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.385 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:11:54.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:11:54.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:11:54.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:11:54.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:11:54.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:11:54.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:11:54.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.388 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:11:54.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:11:54.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.388 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.388 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:11:54.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:11:54.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.388 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:54.388 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:11:54.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:11:54.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:11:54.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:11:54.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:54.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:11:54.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:11:54.389 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.389 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.389 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.390 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:54.390 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:54.390 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 77.456698970999994, 2024-09-13T05:11:54.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:11:54.390 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.390 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:54.390 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.390 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.390 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.390 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:11:54.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.391 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.391 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.391 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:54.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.391 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.391 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:54.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.392 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:54.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.392 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.392 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:11:54.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:11:54.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.392 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.392 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:11:54.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:11:54.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.393 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.393 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.393 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:11:54.393 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:11:54.393 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.393 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.393 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.393 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:11:54.393 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:11:54.393 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.393 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.393 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:54.393 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:11:54.393 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:11:54.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.394 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:11:54.394 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:11:54.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:54.394 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:11:54.394 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:11:54.394 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.394 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.394 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.395 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:54.395 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:54.395 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 77.456682310000005, 2024-09-13T05:11:54.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:11:54.395 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.395 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:54.395 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.395 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.395 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.395 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:11:54.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.395 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:54.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:54.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:54.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.397 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.397 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:11:54.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:11:54.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.397 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.397 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:11:54.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:11:54.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.398 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.398 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:11:54.398 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:11:54.398 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.398 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.398 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.398 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:11:54.398 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:11:54.398 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.398 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.398 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:54.398 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:11:54.398 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:11:54.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:11:54.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:11:54.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:54.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:11:54.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:11:54.399 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.399 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.399 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.400 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:54.400 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:11:54.400 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 77.456655596999994, 2024-09-13T05:11:54.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:11:54.400 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.400 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:54.400 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.400 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.400 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.400 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:11:54.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.401 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:11:54.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:11:54.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.402 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:11:54.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.402 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.402 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:11:54.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:11:54.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.402 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.402 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:11:54.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:11:54.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.403 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.403 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:11:54.403 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:11:54.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.403 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.403 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:11:54.403 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:11:54.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.403 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:54.403 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:11:54.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:11:54.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.404 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.404 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:11:54.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:11:54.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.404 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:54.404 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:11:54.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:11:54.404 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.404 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.404 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.405 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:54.405 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:54.405 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 77.456636744999997, 2024-09-13T05:11:54.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:11:54.405 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.405 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:54.405 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.405 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.405 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.405 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:11:54.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.406 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:54.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:54.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:54.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.407 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.407 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.407 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:11:54.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:11:54.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.407 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.407 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.407 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:11:54.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:11:54.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.407 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.408 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.408 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:11:54.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:11:54.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.408 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.408 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.408 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:11:54.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:11:54.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.408 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.408 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:54.408 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:11:54.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:11:54.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.409 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:11:54.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:11:54.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.409 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:54.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:11:54.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:11:54.409 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.409 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.409 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.410 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:54.410 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:54.410 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 77.456618958999996, 2024-09-13T05:11:54.410 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:11:54.410 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.410 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:54.410 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.410 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.410 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.410 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:11:54.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.410 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:54.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:54.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:54.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.412 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:11:54.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:11:54.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.412 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:11:54.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:11:54.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.412 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:11:54.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:11:54.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:11:54.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:11:54.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:54.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:11:54.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:11:54.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:11:54.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:11:54.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:54.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:11:54.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:11:54.414 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.414 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.414 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.414 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:54.415 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:54.415 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 77.456583898999995, 2024-09-13T05:11:54.415 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:11:54.415 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.415 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:54.415 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.415 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.415 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.415 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:11:54.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.415 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.415 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.415 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:54.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.416 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.416 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:54.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.416 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.416 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:54.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:11:54.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:11:54.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.417 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:11:54.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:11:54.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.417 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:11:54.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:11:54.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:11:54.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:11:54.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:54.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:11:54.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:11:54.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:11:54.419 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:11:54.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.419 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:54.419 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:11:54.419 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:11:54.419 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.419 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.419 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.420 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.420 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.420 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:54.420 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:54.420 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 77.456567084, 2024-09-13T05:11:54.420 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:11:54.420 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:54.420 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:54.420 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:54.420 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:54.420 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:54.420 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:11:54.420 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.420 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:54.421 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.421 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:54.421 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:54.421 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.421 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.421 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:54.421 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:54.421 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:54.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.421 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.421 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:54.422 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:54.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:54.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.422 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:54.422 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:11:54.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:11:54.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.422 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:54.422 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:11:54.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:11:54.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:54.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:11:54.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:11:54.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:11:54.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:11:54.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:54.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:11:54.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:11:54.424 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.424 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.424 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:54.424 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:11:54.424 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:11:54.424 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:54.424 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:54.424 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:54.424 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:11:54.424 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:11:54.424 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.424 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.425 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.425 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:54.425 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:54.425 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:54.427 INFO:teuthology.orchestra.run.smithi120.stdout:4916 write 0xde1cc7c thru 0xde2b9c2 (0xed47 bytes) 2024-09-13T05:11:54.427 INFO:teuthology.orchestra.run.smithi120.stdout:4917 trunc from 0xde2b9c3 to 0x707df96 2024-09-13T05:11:54.427 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:54.427 INFO:teuthology.orchestra.run.smithi120.stdout:4919 punch from 0x32b61a to 0x32c142, (0xb28 bytes) 2024-09-13T05:11:54.427 INFO:teuthology.orchestra.run.smithi120.stdout:4920 trunc from 0x707df96 to 0xd93690a 2024-09-13T05:11:54.427 INFO:teuthology.orchestra.run.smithi120.stdout:4921 write 0x1207dce thru 0x120c130 (0x4363 bytes) 2024-09-13T05:11:54.427 INFO:teuthology.orchestra.run.smithi120.stdout:4922 writesame 0xb2b24e5 thru 0xb2bac97 data_size 0x1(0x87b3 bytes) 2024-09-13T05:11:54.427 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:54.424+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:54.428 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:11:54.442 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:11:54.457 INFO:teuthology.orchestra.run.smithi120.stdout:4923 write 0xeb2a160 thru 0xeb2e01d (0x3ebe bytes) 2024-09-13T05:11:54.464 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:11:54.485 INFO:teuthology.orchestra.run.smithi120.stdout:4926 read 0x2384dac thru 0x2394d22 (0xff77 bytes) 2024-09-13T05:11:54.485 INFO:teuthology.orchestra.run.smithi120.stdout:4928 write 0xd5f2595 thru 0xd5feb19 (0xc585 bytes) 2024-09-13T05:11:54.487 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:11:54.510 INFO:teuthology.orchestra.run.smithi120.stdout:4930 write 0x93aa485 thru 0x93b4196 (0x9d12 bytes) 2024-09-13T05:11:54.511 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:11:54.527 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:54.521+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:54.534 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:11:54.534 INFO:teuthology.orchestra.run.smithi120.stdout:4931 punch from 0xa532cd3 to 0xa539d9f, (0x70cc bytes) 2024-09-13T05:11:54.535 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:54.535 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:54.535 INFO:teuthology.orchestra.run.smithi120.stdout:4936 writesame 0xf76bfa thru 0xf83f62 data_size 0x1(0xd369 bytes) 2024-09-13T05:11:54.548 INFO:teuthology.orchestra.run.smithi120.stdout:4937 write 0xc37e91e thru 0xc3868c9 (0x7fac bytes) 2024-09-13T05:11:54.550 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:54.550 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:54.560 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:11:54.561 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:11:54.575 INFO:teuthology.orchestra.run.smithi120.stdout:4938 punch from 0x632cd68 to 0x633ca64, (0xfcfc bytes) 2024-09-13T05:11:54.575 INFO:teuthology.orchestra.run.smithi120.stdout:4939 read 0xd45da26 thru 0xd45e0cf (0x6aa bytes) 2024-09-13T05:11:54.576 INFO:teuthology.orchestra.run.smithi120.stdout:4940 read 0x970a736 thru 0x9716334 (0xbbff bytes) 2024-09-13T05:11:54.576 INFO:teuthology.orchestra.run.smithi120.stdout:4941 punch from 0x90dc21b to 0x90e2732, (0x6517 bytes) 2024-09-13T05:11:54.576 INFO:teuthology.orchestra.run.smithi120.stdout:4942 read 0xd930b70 thru 0xd93239c (0x182d bytes) 2024-09-13T05:11:54.576 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:54.576 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:54.576 INFO:teuthology.orchestra.run.smithi120.stdout:4945 read 0x214f609 thru 0x2153a55 (0x444d bytes) 2024-09-13T05:11:54.576 INFO:teuthology.orchestra.run.smithi120.stdout:4947 writesame 0xda2d41d thru 0xda2fcf2 data_size 0x1(0x28d6 bytes) 2024-09-13T05:11:54.586 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:11:54.586 INFO:teuthology.orchestra.run.smithi120.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-13T05:11:54.586 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:11:54.586 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:11:54.587 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:11:54.587 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:11:54.587 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:11:54.587 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:11:54.587 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:11:54.590 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T05:11:54.590 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T05:11:54.596 INFO:teuthology.orchestra.run.smithi120.stdout:4949 read 0x45f15de thru 0x45f5d25 (0x4748 bytes) 2024-09-13T05:11:54.596 INFO:teuthology.orchestra.run.smithi120.stdout:4950 writesame 0x7725cde thru 0x7733bf3 data_size 0x5(0xdf16 bytes) 2024-09-13T05:11:54.628 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:54.621+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:54.645 INFO:teuthology.orchestra.run.smithi120.stdout:4951 trunc from 0xeb2e01e to 0x5587d2 2024-09-13T05:11:54.683 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:54.684 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:54.696 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:11:54.729 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:54.721+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:54.829 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:54.828+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:54.848 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is unset 2024-09-13T05:11:54.854 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:54.854 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:54.865 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:11:54.930 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:54.925+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:54.978 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:54.978 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:54.988 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:11:55.032 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:55.025+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:55.115 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:55.116 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:55.129 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:11:55.132 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:55.125+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:55.233 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:55.225+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:55.236 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:55.236 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:55.247 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:11:55.333 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:55.329+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:55.350 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T05:11:55.350 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.0 2024-09-13T05:11:55.350 INFO:tasks.thrashosds.thrasher:remote for osd 0 is ubuntu@smithi120.front.sepia.ceph.com 2024-09-13T05:11:55.350 DEBUG:teuthology.orchestra.run.smithi120:> type ceph-objectstore-tool 2024-09-13T05:11:55.354 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-13T05:11:55.354 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-0 --journal-path /var/lib/ceph/osd/ceph-0/journal --op list-pgs 2024-09-13T05:11:55.375 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:55.375 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:55.390 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:11:55.434 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:55.432+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:55.509 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:55.510 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:55.520 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:11:55.561 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:55.560+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:55.562 INFO:teuthology.orchestra.run.smithi120.stdout:4952 read 0x41d6d0 thru 0x423fd0 (0x6901 bytes) 2024-09-13T05:11:55.563 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:55.563 INFO:teuthology.orchestra.run.smithi120.stdout:4955 read 0x132063 thru 0x141118 (0xf0b6 bytes) 2024-09-13T05:11:55.583 INFO:teuthology.orchestra.run.smithi120.stdout:4957 writesame 0x421b61a thru 0x421cd66 data_size 0x1(0x174d bytes) 2024-09-13T05:11:55.584 INFO:teuthology.orchestra.run.smithi120.stdout:4958 write 0x1030a44 thru 0x103a58e (0x9b4b bytes) 2024-09-13T05:11:55.628 INFO:teuthology.orchestra.run.smithi120.stdout:4959 write 0x9573c03 thru 0x9581477 (0xd875 bytes) 2024-09-13T05:11:55.636 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:55.632+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:55.655 INFO:teuthology.orchestra.run.smithi120.stdout:4962 clone 37 order 18 su 65536 sc 3 2024-09-13T05:11:55.673 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:55.673 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:55.682 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:11:55.737 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:55.736+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:55.798 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:55.798 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:55.808 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:11:55.839 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:55.833+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:55.924 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:55.924 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:55.934 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:11:55.939 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:55.936+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:55.979 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone36 from 0x9581478 (overlap 0x5587d2) to 0x0 2024-09-13T05:11:56.040 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:56.036+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:56.046 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:56.047 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:56.057 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:11:56.135 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #35, image image_client.0-clone35 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent36 2024-09-13T05:11:56.141 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:56.136+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:56.155 INFO:teuthology.orchestra.run.smithi120.stdout:4965 read 0x1a509f4 thru 0x1a5e469 (0xda76 bytes) 2024-09-13T05:11:56.161 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:56.161 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:56.165 INFO:teuthology.orchestra.run.smithi120.stdout:4966 punch from 0x56f6a82 to 0x5702f6d, (0xc4eb bytes) 2024-09-13T05:11:56.165 INFO:teuthology.orchestra.run.smithi120.stdout:4967 write 0x59f234 thru 0x5af1de (0xffab bytes) 2024-09-13T05:11:56.172 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:11:56.178 INFO:teuthology.orchestra.run.smithi120.stdout:4968 write 0x1c0740d thru 0x1c146b2 (0xd2a6 bytes) 2024-09-13T05:11:56.201 INFO:teuthology.orchestra.run.smithi120.stdout:4969 writesame 0xd748738 thru 0xd751c9d data_size 0xd(0x9566 bytes) 2024-09-13T05:11:56.217 INFO:teuthology.orchestra.run.smithi120.stdout:4970 trunc from 0xd751c9e to 0x4614879 2024-09-13T05:11:56.245 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:56.237+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:56.252 INFO:teuthology.orchestra.run.smithi120.stdout:4972 write 0x75c2b9a thru 0x75c8dc5 (0x622c bytes) 2024-09-13T05:11:56.259 INFO:teuthology.orchestra.run.smithi120.stdout:4973 read 0x2f5362c thru 0x2f600ec (0xcac1 bytes) 2024-09-13T05:11:56.259 INFO:teuthology.orchestra.run.smithi120.stdout:4975 write 0x4946a21 thru 0x49481d8 (0x17b8 bytes) 2024-09-13T05:11:56.272 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:56.272 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:56.283 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:11:56.285 INFO:teuthology.orchestra.run.smithi120.stdout:4977 writesame 0xc367550 thru 0xc374f1d data_size 0x3(0xd9ce bytes) 2024-09-13T05:11:56.285 INFO:teuthology.orchestra.run.smithi120.stdout:4978 read 0x27c971b thru 0x27ca654 (0xf3a bytes) 2024-09-13T05:11:56.285 INFO:teuthology.orchestra.run.smithi120.stdout:4979 read 0x7805cb8 thru 0x7814f88 (0xf2d1 bytes) 2024-09-13T05:11:56.297 INFO:teuthology.orchestra.run.smithi120.stdout:4980 trunc from 0xc374f1e to 0x6930629 2024-09-13T05:11:56.326 INFO:teuthology.orchestra.run.smithi120.stdout:4981 writesame 0x6d3e09e thru 0x6d4a251 data_size 0x31(0xc1b4 bytes) 2024-09-13T05:11:56.326 INFO:teuthology.orchestra.run.smithi120.stdout:4982 punch from 0x5a198f2 to 0x5a1edba, (0x54c8 bytes) 2024-09-13T05:11:56.343 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:56.337+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:56.345 INFO:teuthology.orchestra.run.smithi120.stdout:4983 writesame 0xa2f7c83 thru 0xa2fe4ba data_size 0x17(0x6838 bytes) 2024-09-13T05:11:56.364 INFO:teuthology.orchestra.run.smithi120.stdout:4984 write 0xe4b6c74 thru 0xe4b872e (0x1abb bytes) 2024-09-13T05:11:56.372 INFO:teuthology.orchestra.run.smithi120.stdout:4985 punch from 0x92d78e3 to 0x92d7a27, (0x144 bytes) 2024-09-13T05:11:56.372 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:56.372 INFO:teuthology.orchestra.run.smithi120.stdout:4987 read 0xd33b098 thru 0xd344eff (0x9e68 bytes) 2024-09-13T05:11:56.372 INFO:teuthology.orchestra.run.smithi120.stdout:4989 punch from 0x1be23d5 to 0x1be366a, (0x1295 bytes) 2024-09-13T05:11:56.372 INFO:teuthology.orchestra.run.smithi120.stdout:4990 write 0xaf917cf thru 0xaf9ec8d (0xd4bf bytes) 2024-09-13T05:11:56.378 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:56.378 INFO:teuthology.orchestra.run.smithi120.stdout:4992 writesame 0xf960ea thru 0xf9d5f9 data_size 0x8(0x7510 bytes) 2024-09-13T05:11:56.396 INFO:teuthology.orchestra.run.smithi120.stdout:4994 write 0xd67a1d8 thru 0xd685ca7 (0xbad0 bytes) 2024-09-13T05:11:56.400 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:56.400 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:56.404 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:56.404 INFO:teuthology.orchestra.run.smithi120.stdout:4997 write 0x6440f12 thru 0x644156f (0x65e bytes) 2024-09-13T05:11:56.410 INFO:teuthology.orchestra.run.smithi120.stdout:4998 punch from 0x28b9190 to 0x28c7e6f, (0xecdf bytes) 2024-09-13T05:11:56.410 INFO:teuthology.orchestra.run.smithi120.stdout:4999 write 0x8d51a5d thru 0x8d5f6a2 (0xdc46 bytes) 2024-09-13T05:11:56.411 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:11:56.416 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:56.416 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:56.416 INFO:teuthology.orchestra.run.smithi120.stdout:5004 writesame 0xb1194d5 thru 0xb11e210 data_size 0x2(0x4d3c bytes) 2024-09-13T05:11:56.431 INFO:teuthology.orchestra.run.smithi120.stdout:5005 read 0xd31b9dd thru 0xd325b18 (0xa13c bytes) 2024-09-13T05:11:56.431 INFO:teuthology.orchestra.run.smithi120.stdout:5008 writesame 0x5cd0d65 thru 0x5cd0fd5 data_size 0x5(0x271 bytes) 2024-09-13T05:11:56.437 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:56.437 INFO:teuthology.orchestra.run.smithi120.stdout:5010 read 0x5059aae thru 0x505b1ff (0x1752 bytes) 2024-09-13T05:11:56.437 INFO:teuthology.orchestra.run.smithi120.stdout:5012 write 0xaf4e2c0 thru 0xaf5ca55 (0xe796 bytes) 2024-09-13T05:11:56.443 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:56.437+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:56.446 INFO:teuthology.orchestra.run.smithi120.stdout:5013 read 0x3eb9727 thru 0x3ec8a46 (0xf320 bytes) 2024-09-13T05:11:56.447 INFO:teuthology.orchestra.run.smithi120.stdout:5017 read 0x2b5706b thru 0x2b65480 (0xe416 bytes) 2024-09-13T05:11:56.447 INFO:teuthology.orchestra.run.smithi120.stdout:5019 write 0x599e8cd thru 0x59aa43e (0xbb72 bytes) 2024-09-13T05:11:56.462 INFO:teuthology.orchestra.run.smithi120.stdout:5020 writesame 0xe0c310a thru 0xe0cdaf6 data_size 0x1(0xa9ed bytes) 2024-09-13T05:11:56.500 INFO:teuthology.orchestra.run.smithi120.stdout:5021 read 0xde2cccf thru 0xde38497 (0xb7c9 bytes) 2024-09-13T05:11:56.500 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:56.500 INFO:teuthology.orchestra.run.smithi120.stdout:5025 writesame 0x1e1a8b9 thru 0x1e259d4 data_size 0xa(0xb11c bytes) 2024-09-13T05:11:56.511 INFO:teuthology.orchestra.run.smithi120.stdout:5026 write 0x83efab1 thru 0x83fdd2c (0xe27c bytes) 2024-09-13T05:11:56.531 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:56.531 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:56.536 INFO:teuthology.orchestra.run.smithi120.stdout:5027 trunc from 0xe4b872f to 0x5d261f7 2024-09-13T05:11:56.544 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:11:56.545 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:56.540+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:56.554 INFO:teuthology.orchestra.run.smithi120.stdout:5028 read 0x1992908 thru 0x199c69f (0x9d98 bytes) 2024-09-13T05:11:56.554 INFO:teuthology.orchestra.run.smithi120.stdout:5029 read 0x1ca7cd6 thru 0x1cb2e87 (0xb1b2 bytes) 2024-09-13T05:11:56.575 INFO:teuthology.orchestra.run.smithi120.stdout:5030 write 0x7cb2968 thru 0x7cb4fca (0x2663 bytes) 2024-09-13T05:11:56.581 INFO:teuthology.orchestra.run.smithi120.stdout:5031 write 0x3175964 thru 0x317a885 (0x4f22 bytes) 2024-09-13T05:11:56.587 INFO:teuthology.orchestra.run.smithi120.stdout:5034 read 0x2106036 thru 0x210ec80 (0x8c4b bytes) 2024-09-13T05:11:56.587 INFO:teuthology.orchestra.run.smithi120.stdout:5035 write 0x447f5c8 thru 0x448823c (0x8c75 bytes) 2024-09-13T05:11:56.592 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:11:56.605 INFO:teuthology.orchestra.run.smithi120.stdout:5036 trunc from 0x7cb4fcb to 0x185f12e 2024-09-13T05:11:56.635 INFO:teuthology.orchestra.run.smithi120.stdout:5039 read 0x15d0972 thru 0x15db89b (0xaf2a bytes) 2024-09-13T05:11:56.635 INFO:teuthology.orchestra.run.smithi120.stdout:5042 punch from 0x853548 to 0x859c06, (0x66be bytes) 2024-09-13T05:11:56.643 INFO:teuthology.orchestra.run.smithi120.stdout:5043 trunc from 0x185f12e to 0x6ad886e 2024-09-13T05:11:56.645 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:56.644+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:56.652 INFO:teuthology.orchestra.run.smithi120.stdout:5044 read 0x2b2df59 thru 0x2b32d52 (0x4dfa bytes) 2024-09-13T05:11:56.656 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:56.656 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:56.665 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:11:56.671 INFO:teuthology.orchestra.run.smithi120.stdout:5045 writesame 0xb6fd969 thru 0xb7079b3 data_size 0x1d(0xa04b bytes) 2024-09-13T05:11:56.671 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:56.671 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:56.671 INFO:teuthology.orchestra.run.smithi120.stdout:5048 write 0x329c22f thru 0x32a6dfe (0xabd0 bytes) 2024-09-13T05:11:56.679 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:56.693 INFO:teuthology.orchestra.run.smithi120.stdout:5052 writesame 0xdf8d65b thru 0xdf96261 data_size 0x15(0x8c07 bytes) 2024-09-13T05:11:56.693 INFO:teuthology.orchestra.run.smithi120.stdout:5053 punch from 0x8c2f5ba to 0x8c36739, (0x717f bytes) 2024-09-13T05:11:56.693 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:56.693 INFO:teuthology.orchestra.run.smithi120.stdout:5056 punch from 0xbe8caaa to 0xbe8dc61, (0x11b7 bytes) 2024-09-13T05:11:56.693 INFO:teuthology.orchestra.run.smithi120.stdout:5057 write 0x8394a3d thru 0x83a1f02 (0xd4c6 bytes) 2024-09-13T05:11:56.700 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:56.700 INFO:teuthology.orchestra.run.smithi120.stdout:5059 punch from 0xc65aa30 to 0xc65dcb8, (0x3288 bytes) 2024-09-13T05:11:56.700 INFO:teuthology.orchestra.run.smithi120.stdout:5060 read 0x5246d77 thru 0x524c573 (0x57fd bytes) 2024-09-13T05:11:56.700 INFO:teuthology.orchestra.run.smithi120.stdout:5062 read 0x779d5d thru 0x784430 (0xa6d4 bytes) 2024-09-13T05:11:56.719 INFO:teuthology.orchestra.run.smithi120.stdout:5063 trunc from 0xdf96262 to 0x31ffdf4 2024-09-13T05:11:56.743 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:11:56.745 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:56.744+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:56.751 INFO:teuthology.orchestra.run.smithi120.stdout:5064 write 0x49830e5 thru 0x498a5a4 (0x74c0 bytes) 2024-09-13T05:11:56.758 INFO:teuthology.orchestra.run.smithi120.stdout:5065 write 0x3bab850 thru 0x3bba3e5 (0xeb96 bytes) 2024-09-13T05:11:56.766 INFO:teuthology.orchestra.run.smithi120.stdout:5066 punch from 0xb9e03c to 0xbad46f, (0xf433 bytes) 2024-09-13T05:11:56.766 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:56.766 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:56.766 INFO:teuthology.orchestra.run.smithi120.stdout:5070 punch from 0x2111f5f to 0x2113fb6, (0x2057 bytes) 2024-09-13T05:11:56.766 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:11:56.771 INFO:teuthology.orchestra.run.smithi120.stdout:5074 trunc from 0x498a5a5 to 0x21c30f4 2024-09-13T05:11:56.773 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:56.774 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:56.785 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:11:56.787 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:11:56.813 INFO:teuthology.orchestra.run.smithi120.stdout:5076 writesame 0x965af85 thru 0x96681d2 data_size 0x1b(0xd24e bytes) 2024-09-13T05:11:56.813 INFO:teuthology.orchestra.run.smithi120.stdout:5078 write 0x3868721 thru 0x387811c (0xf9fc bytes) 2024-09-13T05:11:56.819 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:11:56.819 INFO:teuthology.orchestra.run.smithi120.stdout:5079 punch from 0x91e4a6c to 0x91f050d, (0xbaa1 bytes) 2024-09-13T05:11:56.826 INFO:teuthology.orchestra.run.smithi120.stdout:5080 trunc from 0x96681d3 to 0x5c52cfc 2024-09-13T05:11:56.842 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:11:56.847 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:56.844+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:56.850 INFO:teuthology.orchestra.run.smithi120.stdout:5081 writesame 0x6a3661d thru 0x6a40286 data_size 0x1(0x9c6a bytes) 2024-09-13T05:11:56.861 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T05:11:56.862 INFO:teuthology.orchestra.run.smithi120.stdout:5082 write 0x7c9dd2c thru 0x7ca4cfd (0x6fd2 bytes) 2024-09-13T05:11:56.864 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:11:56.881 INFO:teuthology.orchestra.run.smithi120.stdout:5083 trunc from 0x7ca4cfe to 0xe48a223 2024-09-13T05:11:56.886 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:11:56.886 INFO:teuthology.orchestra.run.smithi120.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-13T05:11:56.887 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:11:56.887 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:11:56.887 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:11:56.887 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:11:56.887 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:11:56.887 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:11:56.887 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:11:56.889 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T05:11:56.890 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T05:11:56.891 INFO:teuthology.orchestra.run.smithi120.stdout:5084 write 0x30d0067 thru 0x30dbdf8 (0xbd92 bytes) 2024-09-13T05:11:56.897 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:145428 3.b e109/46 3:d03badb7:::rbd_data.112d7c1bedf7.00000000000000c4:head v 109'471, mlcod=109'469)", 2024-09-13T05:11:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:56.895301+0000", 2024-09-13T05:11:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.0010062770000000001, 2024-09-13T05:11:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001038459, 2024-09-13T05:11:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:56.895301+0000", 2024-09-13T05:11:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:56.895301+0000", 2024-09-13T05:11:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:56.895299+0000", 2024-09-13T05:11:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:56.895512+0000", 2024-09-13T05:11:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021258099999999999 2024-09-13T05:11:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:56.895538+0000", 2024-09-13T05:11:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6003000000000002e-05 2024-09-13T05:11:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:56.895549+0000", 2024-09-13T05:11:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1516e-05 2024-09-13T05:11:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:56.895629+0000", 2024-09-13T05:11:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9258999999999994e-05 2024-09-13T05:11:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:56.895662+0000", 2024-09-13T05:11:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3238999999999998e-05 2024-09-13T05:11:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-09-13T05:11:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 1 2024-09-13T05:11:56.902 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:56.902 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:56.902 INFO:teuthology.orchestra.run.smithi120.stdout:5086 writesame 0xbb24942 thru 0xbb30d58 data_size 0x1d(0xc417 bytes) 2024-09-13T05:11:56.905 INFO:teuthology.orchestra.run.smithi120.stdout:5087 write 0x1ea9f64 thru 0x1eb1261 (0x72fe bytes) 2024-09-13T05:11:56.907 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:11:56.912 INFO:teuthology.orchestra.run.smithi120.stdout:5088 writesame 0x73e5e87 thru 0x73f250f data_size 0x19(0xc689 bytes) 2024-09-13T05:11:56.921 INFO:teuthology.orchestra.run.smithi120.stdout:5089 trunc from 0xe48a223 to 0xd3f389a 2024-09-13T05:11:56.933 INFO:teuthology.orchestra.run.smithi120.stdout:5091 read 0x9f1a8fa thru 0x9f1b914 (0x101b bytes) 2024-09-13T05:11:56.933 INFO:teuthology.orchestra.run.smithi120.stdout:5093 read 0x2e3c0a4 thru 0x2e494bf (0xd41c bytes) 2024-09-13T05:11:56.933 INFO:teuthology.orchestra.run.smithi120.stdout:5096 read 0xd2a6ea6 thru 0xd2b1036 (0xa191 bytes) 2024-09-13T05:11:56.933 INFO:teuthology.orchestra.run.smithi120.stdout:5099 read 0x4db48fd thru 0x4dc3a4d (0xf151 bytes) 2024-09-13T05:11:56.948 INFO:teuthology.orchestra.run.smithi120.stdout:5100 write 0xe8eca3c thru 0xe8f3e35 (0x73fa bytes) 2024-09-13T05:11:56.953 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:56.949+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:56.956 INFO:teuthology.orchestra.run.smithi120.stdout:5101 read 0x7e06a24 thru 0x7e16049 (0xf626 bytes) 2024-09-13T05:11:56.956 INFO:teuthology.orchestra.run.smithi120.stdout:5102 read 0x538b5a1 thru 0x539909e (0xdafe bytes) 2024-09-13T05:11:56.969 INFO:teuthology.orchestra.run.smithi120.stdout:5104 write 0xeaa482c thru 0xeab44c2 (0xfc97 bytes) 2024-09-13T05:11:56.977 INFO:teuthology.orchestra.run.smithi120.stdout:5105 punch from 0x422da00 to 0x42367ef, (0x8def bytes) 2024-09-13T05:11:56.978 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:56.978 INFO:teuthology.orchestra.run.smithi120.stdout:5107 punch from 0x6756fd2 to 0x6760480, (0x94ae bytes) 2024-09-13T05:11:56.978 INFO:teuthology.orchestra.run.smithi120.stdout:5108 read 0xc79b5d5 thru 0xc7a15a0 (0x5fcc bytes) 2024-09-13T05:11:56.978 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:56.978 INFO:teuthology.orchestra.run.smithi120.stdout:5110 read 0x3a21bac thru 0x3a2aba0 (0x8ff5 bytes) 2024-09-13T05:11:56.979 INFO:teuthology.orchestra.run.smithi120.stdout:5112 write 0xdfb8fbd thru 0xdfc409e (0xb0e2 bytes) 2024-09-13T05:11:56.985 INFO:teuthology.orchestra.run.smithi120.stdout:5114 read 0x83944bd thru 0x839d0e8 (0x8c2c bytes) 2024-09-13T05:11:56.985 INFO:teuthology.orchestra.run.smithi120.stdout:5115 read 0xbb1d215 thru 0xbb1f746 (0x2532 bytes) 2024-09-13T05:11:56.985 INFO:teuthology.orchestra.run.smithi120.stdout:5116 write 0x6c40c2d thru 0x6c46fc0 (0x6394 bytes) 2024-09-13T05:11:56.990 INFO:teuthology.orchestra.run.smithi120.stdout:5117 write 0xb34677e thru 0xb34995f (0x31e2 bytes) 2024-09-13T05:11:56.994 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:11:56.995 INFO:teuthology.orchestra.run.smithi120.stdout:5120 punch from 0xd0a124f to 0xd0b0923, (0xf6d4 bytes) 2024-09-13T05:11:56.996 INFO:teuthology.orchestra.run.smithi120.stdout:5122 trunc from 0xeab44c3 to 0xdab6cef 2024-09-13T05:11:57.014 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:57.014 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:57.015 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:57.015 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:57.015 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:57.016 INFO:teuthology.orchestra.run.smithi120.stdout:5123 clone 38 order 18 su 1024 sc 7 2024-09-13T05:11:57.024 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:11:57.049 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:57.044+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:57.127 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:57.128 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:11:57.128 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:11:57.128 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:11:57.128 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.128 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:57.128 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:57.128 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 80.260433273000004, 2024-09-13T05:11:57.128 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:11:57.128 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:11:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:11:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:11:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:11:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:11:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:11:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:11:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:11:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:11:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:11:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:11:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:11:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:11:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:11:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:11:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:11:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:11:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:11:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 80.260408837, 2024-09-13T05:11:57.135 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:11:57.135 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:57.135 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:11:57.135 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:57.135 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:57.135 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.135 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:11:57.135 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.135 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.137 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:57.137 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:11:57.137 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:57.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.137 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.137 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:57.137 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:11:57.137 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:11:57.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.137 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.137 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:57.137 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:11:57.138 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:11:57.138 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.138 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.138 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.138 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:11:57.138 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:11:57.138 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.138 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.138 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.138 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:11:57.138 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:11:57.138 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:11:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:11:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:11:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:11:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:11:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:11:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:11:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:11:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:11:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 80.260399011000004, 2024-09-13T05:11:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:11:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:11:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:11:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:57.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.143 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.143 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:57.143 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:11:57.143 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:11:57.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.143 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.143 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:57.143 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:11:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:11:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:11:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:11:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:11:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:11:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:11:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:11:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:11:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:11:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:11:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:11:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 80.260390775000005, 2024-09-13T05:11:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:11:57.147 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:57.147 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:57.147 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:57.147 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:57.147 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.147 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:11:57.147 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.147 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:57.147 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.147 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:57.148 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:57.148 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.148 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.148 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:57.148 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:57.148 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.148 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.148 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:57.149 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:11:57.149 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:57.150 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.150 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.150 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:57.150 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:11:57.150 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:11:57.150 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.150 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:11:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:11:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:11:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:11:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:11:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:11:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:11:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:11:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:11:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:11:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:11:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:11:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 80.260368862999997, 2024-09-13T05:11:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:11:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:11:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:11:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:11:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:11:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.156 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:57.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:11:57.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:11:57.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.156 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.156 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:11:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:11:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:11:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:11:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:11:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:11:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.158 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:11:57.158 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:11:57.158 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.158 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.158 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:57.158 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:11:57.158 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:11:57.158 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.158 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 80.260360258999995, 2024-09-13T05:11:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:11:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:11:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:11:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:11:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:11:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:11:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:11:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:11:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:11:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:11:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:11:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:11:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:11:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:11:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:11:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:11:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:11:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 80.260350564999996, 2024-09-13T05:11:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:11:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:11:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:11:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:11:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:11:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:11:57.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:11:57.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.168 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.168 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.168 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:11:57.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:11:57.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.168 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:11:57.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:11:57.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:57.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:11:57.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:11:57.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:11:57.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:11:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:11:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:11:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 80.260341449999999, 2024-09-13T05:11:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:11:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:11:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:11:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:11:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:11:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:11:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:11:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:11:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:11:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:11:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:11:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:11:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:11:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:11:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:11:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:11:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:11:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:11:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 80.260332970999997, 2024-09-13T05:11:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:11:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:11:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:11:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:11:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:11:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:11:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:11:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:11:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:11:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.179 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:11:57.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:11:57.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.179 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:11:57.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:11:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:11:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:11:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:11:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:11:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:11:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:11:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:11:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 80.260321046000001, 2024-09-13T05:11:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:11:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:11:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:11:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:11:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:11:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:11:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:11:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:11:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:11:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:11:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:11:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:11:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:11:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:11:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:11:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:11:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:11:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:11:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:11:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:11:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.186 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:57.186 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:57.186 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 80.260299457000002, 2024-09-13T05:11:57.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:11:57.186 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:11:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:11:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:57.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:11:57.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:11:57.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:11:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:11:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:11:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:11:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:11:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:11:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:11:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:11:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:11:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:11:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:11:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:11:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 80.260276329000007, 2024-09-13T05:11:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:11:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:11:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:57.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:11:57.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:57.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:11:57.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:11:57.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:11:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:11:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:11:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:11:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:11:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:11:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:11:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:11:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:11:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:11:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:11:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:11:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:11:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 80.260260955999996, 2024-09-13T05:11:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:11:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:11:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:11:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:11:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:11:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:11:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:11:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:11:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:11:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:11:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:11:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:11:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:11:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:11:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:11:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:11:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:11:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:11:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:11:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 80.260240487999994, 2024-09-13T05:11:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:11:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:11:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:11:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:11:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:11:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:11:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:11:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:11:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:11:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:11:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:11:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:11:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:11:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:11:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:11:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:11:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:11:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 80.260223827000004, 2024-09-13T05:11:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:11:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:11:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:11:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:11:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:11:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:11:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:11:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:11:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:11:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:11:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:11:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:11:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:11:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:11:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:11:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:11:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:11:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:11:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 80.260197113999993, 2024-09-13T05:11:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:11:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:11:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:11:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:11:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:11:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:11:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:11:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:11:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:11:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:11:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:11:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:11:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:11:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:11:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:11:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:11:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:11:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:11:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:11:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 80.260178261999997, 2024-09-13T05:11:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:11:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:11:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:11:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:11:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:11:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:11:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:11:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:11:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:11:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:11:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:11:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:11:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:11:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:11:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:11:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:11:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:11:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 80.260160475999996, 2024-09-13T05:11:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:11:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:11:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:11:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:11:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:11:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:11:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:11:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:11:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:11:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:11:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:11:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:11:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:11:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:11:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:11:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:11:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:11:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 80.260125415999994, 2024-09-13T05:11:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:11:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:11:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:11:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:11:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:11:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:11:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:11:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:11:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:11:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:11:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:11:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:11:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:11:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:11:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:11:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:11:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:11:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:11:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 80.260108600999999, 2024-09-13T05:11:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:11:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:11:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:11:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:11:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:11:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:11:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:11:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:11:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:11:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:11:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:11:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:11:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:11:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:11:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:11:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:11:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:11:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:11:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:11:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:11:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:11:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:11:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:11:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:11:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:11:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:11:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:11:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:11:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:11:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:11:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:11:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:11:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:11:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.237 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:11:57.237 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:11:57.237 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:57.238 INFO:tasks.thrashosds.thrasher:No PGs found for osd.0 2024-09-13T05:11:57.239 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:57.236+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:57.239 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:11:57.339 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:57.337+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:57.394 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:57.394 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:57.394 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:57.394 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:57.404 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:11:57.440 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:57.436+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:57.509 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:57.510 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:57.510 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:57.510 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:57.510 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:57.519 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:11:57.541 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:57.537+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:57.642 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:57.637+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:57.673 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:57.673 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:57.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:57.673 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:57.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.673 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10634 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 731136~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:57.673 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.267794382999995, 2024-09-13T05:11:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028136992999999999, 2024-09-13T05:11:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10634 2024-09-13T05:11:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:11:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401987+0000", 2024-09-13T05:11:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5090000000000001e-06 2024-09-13T05:11:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401997+0000", 2024-09-13T05:11:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8009999999999998e-06 2024-09-13T05:11:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402000+0000", 2024-09-13T05:11:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.756e-06 2024-09-13T05:11:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430035+0000", 2024-09-13T05:11:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028034967000000001 2024-09-13T05:11:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430081+0000", 2024-09-13T05:11:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6448e-05 2024-09-13T05:11:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430123+0000", 2024-09-13T05:11:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1758000000000002e-05 2024-09-13T05:11:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10635 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 740352~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:11:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.267777769000006, 2024-09-13T05:11:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028229890000000001, 2024-09-13T05:11:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10635 2024-09-13T05:11:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:11:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:11:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402002+0000", 2024-09-13T05:11:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402004+0000", 2024-09-13T05:11:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.575e-06 2024-09-13T05:11:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402007+0000", 2024-09-13T05:11:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1240000000000001e-06 2024-09-13T05:11:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402010+0000", 2024-09-13T05:11:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5859999999999999e-06 2024-09-13T05:11:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430146+0000", 2024-09-13T05:11:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028136746000000001 2024-09-13T05:11:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430195+0000", 2024-09-13T05:11:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8948e-05 2024-09-13T05:11:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430232+0000", 2024-09-13T05:11:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7159000000000001e-05 2024-09-13T05:11:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10636 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 749568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:11:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.267768662999998, 2024-09-13T05:11:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328440999999999, 2024-09-13T05:11:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10636 2024-09-13T05:11:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:11:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:11:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402011+0000", 2024-09-13T05:11:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402017+0000", 2024-09-13T05:11:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5620000000000003e-06 2024-09-13T05:11:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402020+0000", 2024-09-13T05:11:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1410000000000001e-06 2024-09-13T05:11:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402024+0000", 2024-09-13T05:11:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4489999999999999e-06 2024-09-13T05:11:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430256+0000", 2024-09-13T05:11:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028232363 2024-09-13T05:11:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430299+0000", 2024-09-13T05:11:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2830999999999997e-05 2024-09-13T05:11:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430340+0000", 2024-09-13T05:11:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1301000000000003e-05 2024-09-13T05:11:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10637 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 758784~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.267753549999995, 2024-09-13T05:11:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028441793, 2024-09-13T05:11:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10637 2024-09-13T05:11:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:11:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402031+0000", 2024-09-13T05:11:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6770000000000003e-06 2024-09-13T05:11:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402034+0000", 2024-09-13T05:11:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1540000000000002e-06 2024-09-13T05:11:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402038+0000", 2024-09-13T05:11:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4970000000000001e-06 2024-09-13T05:11:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430367+0000", 2024-09-13T05:11:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328906000000001 2024-09-13T05:11:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430416+0000", 2024-09-13T05:11:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:11:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430469+0000", 2024-09-13T05:11:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2284999999999998e-05 2024-09-13T05:11:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10638 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 768000~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.267740066000002, 2024-09-13T05:11:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028548740999999999, 2024-09-13T05:11:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10638 2024-09-13T05:11:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:11:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402041+0000", 2024-09-13T05:11:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4789999999999999e-06 2024-09-13T05:11:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402044+0000", 2024-09-13T05:11:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.694e-06 2024-09-13T05:11:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402047+0000", 2024-09-13T05:11:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.537e-06 2024-09-13T05:11:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430494+0000", 2024-09-13T05:11:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028447665 2024-09-13T05:11:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430544+0000", 2024-09-13T05:11:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9539000000000001e-05 2024-09-13T05:11:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430589+0000", 2024-09-13T05:11:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5071999999999998e-05 2024-09-13T05:11:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10639 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 777216~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:11:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.267729685000006, 2024-09-13T05:11:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028651769000000001, 2024-09-13T05:11:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10639 2024-09-13T05:11:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:11:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:11:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402050+0000", 2024-09-13T05:11:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402052+0000", 2024-09-13T05:11:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2249999999999999e-06 2024-09-13T05:11:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402054+0000", 2024-09-13T05:11:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8140000000000001e-06 2024-09-13T05:11:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402057+0000", 2024-09-13T05:11:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4889999999999998e-06 2024-09-13T05:11:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430607+0000", 2024-09-13T05:11:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028549896000000002 2024-09-13T05:11:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430651+0000", 2024-09-13T05:11:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4622000000000001e-05 2024-09-13T05:11:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430702+0000", 2024-09-13T05:11:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0980999999999999e-05 2024-09-13T05:11:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11151 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 779264~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.237958403999997, 2024-09-13T05:11:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028283188000000001, 2024-09-13T05:11:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11151 2024-09-13T05:11:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:11:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431827+0000", 2024-09-13T05:11:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0989999999999998e-06 2024-09-13T05:11:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431832+0000", 2024-09-13T05:11:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8829999999999997e-06 2024-09-13T05:11:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431835+0000", 2024-09-13T05:11:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.439e-06 2024-09-13T05:11:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.459955+0000", 2024-09-13T05:11:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028119858000000001 2024-09-13T05:11:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.460029+0000", 2024-09-13T05:11:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4264000000000006e-05 2024-09-13T05:11:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.460105+0000", 2024-09-13T05:11:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5906000000000001e-05 2024-09-13T05:11:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11897 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 579584~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.188809230000004, 2024-09-13T05:11:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028193354, 2024-09-13T05:11:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11897 2024-09-13T05:11:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:11:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480973+0000", 2024-09-13T05:11:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.934e-06 2024-09-13T05:11:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480976+0000", 2024-09-13T05:11:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.614e-06 2024-09-13T05:11:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480980+0000", 2024-09-13T05:11:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.377e-06 2024-09-13T05:11:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.508967+0000", 2024-09-13T05:11:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027987455000000001 2024-09-13T05:11:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509074+0000", 2024-09-13T05:11:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107379 2024-09-13T05:11:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509164+0000", 2024-09-13T05:11:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9979e-05 2024-09-13T05:11:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11898 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 588800~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.188797166000001, 2024-09-13T05:11:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028308628999999998, 2024-09-13T05:11:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11898 2024-09-13T05:11:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:11:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480984+0000", 2024-09-13T05:11:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:11:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480988+0000", 2024-09-13T05:11:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4640000000000002e-06 2024-09-13T05:11:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480991+0000", 2024-09-13T05:11:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3469999999999999e-06 2024-09-13T05:11:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509199+0000", 2024-09-13T05:11:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028207449999999998 2024-09-13T05:11:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509250+0000", 2024-09-13T05:11:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1375000000000002e-05 2024-09-13T05:11:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509292+0000", 2024-09-13T05:11:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1730000000000002e-05 2024-09-13T05:11:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11899 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 598016~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.188786324999995, 2024-09-13T05:11:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516703000000001, 2024-09-13T05:11:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11899 2024-09-13T05:11:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:11:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480995+0000", 2024-09-13T05:11:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7349999999999999e-06 2024-09-13T05:11:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481000+0000", 2024-09-13T05:11:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0289999999999996e-06 2024-09-13T05:11:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481004+0000", 2024-09-13T05:11:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3699999999999999e-06 2024-09-13T05:11:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509332+0000", 2024-09-13T05:11:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328320000000001 2024-09-13T05:11:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509428+0000", 2024-09-13T05:11:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6150999999999995e-05 2024-09-13T05:11:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509511+0000", 2024-09-13T05:11:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2396000000000002e-05 2024-09-13T05:11:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11900 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 607232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:11:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.188773736000002, 2024-09-13T05:11:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028621273999999999, 2024-09-13T05:11:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11900 2024-09-13T05:11:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:11:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:11:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481006+0000", 2024-09-13T05:11:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481008+0000", 2024-09-13T05:11:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.73e-06 2024-09-13T05:11:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481011+0000", 2024-09-13T05:11:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4000000000000001e-06 2024-09-13T05:11:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481015+0000", 2024-09-13T05:11:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2760000000000001e-06 2024-09-13T05:11:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509531+0000", 2024-09-13T05:11:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516102000000002 2024-09-13T05:11:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509588+0000", 2024-09-13T05:11:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7423999999999998e-05 2024-09-13T05:11:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509628+0000", 2024-09-13T05:11:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9644000000000002e-05 2024-09-13T05:11:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11901 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 616448~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.188763115, 2024-09-13T05:11:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028820500999999998, 2024-09-13T05:11:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11901 2024-09-13T05:11:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:11:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481022+0000", 2024-09-13T05:11:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0209999999999999e-06 2024-09-13T05:11:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481026+0000", 2024-09-13T05:11:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:11:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481029+0000", 2024-09-13T05:11:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.636e-06 2024-09-13T05:11:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509661+0000", 2024-09-13T05:11:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028631496999999999 2024-09-13T05:11:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509757+0000", 2024-09-13T05:11:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5780999999999997e-05 2024-09-13T05:11:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509838+0000", 2024-09-13T05:11:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1102999999999999e-05 2024-09-13T05:11:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11902 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 625664~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.188741253000003, 2024-09-13T05:11:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028894265999999998, 2024-09-13T05:11:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11902 2024-09-13T05:11:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:11:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481041+0000", 2024-09-13T05:11:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8020000000000001e-06 2024-09-13T05:11:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481044+0000", 2024-09-13T05:11:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7110000000000001e-06 2024-09-13T05:11:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481048+0000", 2024-09-13T05:11:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.411e-06 2024-09-13T05:11:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509851+0000", 2024-09-13T05:11:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028803295 2024-09-13T05:11:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509896+0000", 2024-09-13T05:11:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4963000000000003e-05 2024-09-13T05:11:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509933+0000", 2024-09-13T05:11:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7384e-05 2024-09-13T05:11:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11903 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 634880~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.188730016999997, 2024-09-13T05:11:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029118033000000001, 2024-09-13T05:11:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11903 2024-09-13T05:11:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:11:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481052+0000", 2024-09-13T05:11:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.581e-06 2024-09-13T05:11:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481055+0000", 2024-09-13T05:11:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4520000000000002e-06 2024-09-13T05:11:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481058+0000", 2024-09-13T05:11:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4599999999999999e-06 2024-09-13T05:11:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509967+0000", 2024-09-13T05:11:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028908257999999999 2024-09-13T05:11:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510062+0000", 2024-09-13T05:11:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5613999999999996e-05 2024-09-13T05:11:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510168+0000", 2024-09-13T05:11:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105951 2024-09-13T05:11:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11904 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 644096~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.188719121999995, 2024-09-13T05:11:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029301971, 2024-09-13T05:11:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11904 2024-09-13T05:11:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:11:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481063+0000", 2024-09-13T05:11:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6700000000000001e-06 2024-09-13T05:11:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481068+0000", 2024-09-13T05:11:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4519999999999996e-06 2024-09-13T05:11:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481074+0000", 2024-09-13T05:11:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8370000000000002e-06 2024-09-13T05:11:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510197+0000", 2024-09-13T05:11:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029123237999999999 2024-09-13T05:11:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510285+0000", 2024-09-13T05:11:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7676000000000006e-05 2024-09-13T05:11:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510363+0000", 2024-09-13T05:11:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8418999999999996e-05 2024-09-13T05:11:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11905 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 653312~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:11:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.188703382, 2024-09-13T05:11:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029480164, 2024-09-13T05:11:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11905 2024-09-13T05:11:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:11:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:11:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481076+0000", 2024-09-13T05:11:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481079+0000", 2024-09-13T05:11:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9629999999999998e-06 2024-09-13T05:11:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481087+0000", 2024-09-13T05:11:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6369999999999999e-06 2024-09-13T05:11:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481093+0000", 2024-09-13T05:11:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.857e-06 2024-09-13T05:11:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510408+0000", 2024-09-13T05:11:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029315213 2024-09-13T05:11:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510501+0000", 2024-09-13T05:11:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2916000000000003e-05 2024-09-13T05:11:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510557+0000", 2024-09-13T05:11:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6063999999999997e-05 2024-09-13T05:11:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11906 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 662528~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:11:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.188661369000002, 2024-09-13T05:11:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029575054999999999, 2024-09-13T05:11:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11906 2024-09-13T05:11:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:11:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:11:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481118+0000", 2024-09-13T05:11:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481122+0000", 2024-09-13T05:11:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2610000000000002e-06 2024-09-13T05:11:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481129+0000", 2024-09-13T05:11:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0079999999999996e-06 2024-09-13T05:11:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481135+0000", 2024-09-13T05:11:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0599999999999996e-06 2024-09-13T05:11:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510575+0000", 2024-09-13T05:11:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029440470999999999 2024-09-13T05:11:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510635+0000", 2024-09-13T05:11:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0177000000000003e-05 2024-09-13T05:11:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510694+0000", 2024-09-13T05:11:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8675999999999999e-05 2024-09-13T05:11:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11907 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 671744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:11:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.188400573999999, 2024-09-13T05:11:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029479490000000001, 2024-09-13T05:11:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11907 2024-09-13T05:11:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:11:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:11:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481140+0000", 2024-09-13T05:11:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997597 2024-09-13T05:11:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481383+0000", 2024-09-13T05:11:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024355399999999999 2024-09-13T05:11:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481390+0000", 2024-09-13T05:11:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3599999999999998e-06 2024-09-13T05:11:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481395+0000", 2024-09-13T05:11:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8940000000000001e-06 2024-09-13T05:11:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510722+0000", 2024-09-13T05:11:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029327143999999999 2024-09-13T05:11:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510802+0000", 2024-09-13T05:11:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9770000000000004e-05 2024-09-13T05:11:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510859+0000", 2024-09-13T05:11:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6957999999999999e-05 2024-09-13T05:11:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11908 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 680960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:11:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.188380660999997, 2024-09-13T05:11:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029617622, 2024-09-13T05:11:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11908 2024-09-13T05:11:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:11:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:11:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481399+0000", 2024-09-13T05:11:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481401+0000", 2024-09-13T05:11:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8729999999999999e-06 2024-09-13T05:11:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481413+0000", 2024-09-13T05:11:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1748e-05 2024-09-13T05:11:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481417+0000", 2024-09-13T05:11:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:11:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510908+0000", 2024-09-13T05:11:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029491129000000001 2024-09-13T05:11:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510955+0000", 2024-09-13T05:11:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7188000000000003e-05 2024-09-13T05:11:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511017+0000", 2024-09-13T05:11:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2288999999999999e-05 2024-09-13T05:11:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11909 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 690176~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:11:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:11:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.188360333999995, 2024-09-13T05:11:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029780699000000001, 2024-09-13T05:11:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11909 2024-09-13T05:11:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:11:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:11:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481419+0000", 2024-09-13T05:11:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481421+0000", 2024-09-13T05:11:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.035e-06 2024-09-13T05:11:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481427+0000", 2024-09-13T05:11:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2449999999999998e-06 2024-09-13T05:11:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481430+0000", 2024-09-13T05:11:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.366e-06 2024-09-13T05:11:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511064+0000", 2024-09-13T05:11:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029633711 2024-09-13T05:11:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511160+0000", 2024-09-13T05:11:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6399999999999999e-05 2024-09-13T05:11:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511201+0000", 2024-09-13T05:11:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0448000000000003e-05 2024-09-13T05:11:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:57.767 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:57.768 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:11:57.769 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:57.765+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:57.869 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:11:57.864+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:11:57.870 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is set 2024-09-13T05:11:57.885 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:57.885 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:57.885 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:57.885 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:57.897 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:11:57.970 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:57.965+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:58.015 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone37 from 0xdab6cef (overlap 0x185f12e) to 0x15ef2a9 2024-09-13T05:11:58.057 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:58.057 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:58.057 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:58.058 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:58.058 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:58.068 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:11:58.070 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:58.065+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:58.171 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:58.168+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:58.177 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:58.178 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:58.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:58.178 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:58.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.178 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136560 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3908608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.178 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:11:58.178 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0795203940000002, 2024-09-13T05:11:58.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056148103999999997, 2024-09-13T05:11:58.178 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.178 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.179 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.179 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136560 2024-09-13T05:11:58.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.179 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:11:58.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:11:58.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095289+0000", 2024-09-13T05:11:58.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:58.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095292+0000", 2024-09-13T05:11:58.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.802e-06 2024-09-13T05:11:58.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095318+0000", 2024-09-13T05:11:58.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5987999999999999e-05 2024-09-13T05:11:58.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095323+0000", 2024-09-13T05:11:58.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.006e-06 2024-09-13T05:11:58.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151316+0000", 2024-09-13T05:11:58.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055992593 2024-09-13T05:11:58.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151371+0000", 2024-09-13T05:11:58.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5532999999999998e-05 2024-09-13T05:11:58.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151438+0000", 2024-09-13T05:11:58.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6557999999999995e-05 2024-09-13T05:11:58.184 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.184 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.184 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.184 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136562 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3922944~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.184 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:11:58.184 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0794832760000004, 2024-09-13T05:11:58.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056259690000000001, 2024-09-13T05:11:58.185 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.185 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.185 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.185 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.185 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.185 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136562 2024-09-13T05:11:58.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.185 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:11:58.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:11:58.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:11:58.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:58.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095329+0000", 2024-09-13T05:11:58.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3089999999999998e-06 2024-09-13T05:11:58.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095333+0000", 2024-09-13T05:11:58.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6239999999999999e-06 2024-09-13T05:11:58.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095335+0000", 2024-09-13T05:11:58.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5660000000000001e-06 2024-09-13T05:11:58.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151468+0000", 2024-09-13T05:11:58.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056132608000000001 2024-09-13T05:11:58.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151519+0000", 2024-09-13T05:11:58.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1681000000000002e-05 2024-09-13T05:11:58.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151587+0000", 2024-09-13T05:11:58.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7200999999999996e-05 2024-09-13T05:11:58.189 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.189 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.189 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.189 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136563 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3937280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.189 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:11:58.189 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0794718540000003, 2024-09-13T05:11:58.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056393051999999999, 2024-09-13T05:11:58.189 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.190 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.190 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.190 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.190 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.190 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136563 2024-09-13T05:11:58.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.190 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:11:58.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:11:58.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:11:58.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:58.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095340+0000", 2024-09-13T05:11:58.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.561e-06 2024-09-13T05:11:58.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095342+0000", 2024-09-13T05:11:58.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8059999999999999e-06 2024-09-13T05:11:58.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095345+0000", 2024-09-13T05:11:58.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:11:58.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151621+0000", 2024-09-13T05:11:58.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056275602000000001 2024-09-13T05:11:58.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151670+0000", 2024-09-13T05:11:58.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9478000000000003e-05 2024-09-13T05:11:58.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151731+0000", 2024-09-13T05:11:58.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1054000000000002e-05 2024-09-13T05:11:58.194 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.195 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.195 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.195 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136565 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3951616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.195 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:11:58.195 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0794615399999996, 2024-09-13T05:11:58.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056524090999999999, 2024-09-13T05:11:58.195 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.195 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.196 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136565 2024-09-13T05:11:58.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.196 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:11:58.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:11:58.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095348+0000", 2024-09-13T05:11:58.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:11:58.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095350+0000", 2024-09-13T05:11:58.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4479999999999999e-06 2024-09-13T05:11:58.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095353+0000", 2024-09-13T05:11:58.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.909e-06 2024-09-13T05:11:58.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095356+0000", 2024-09-13T05:11:58.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:11:58.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151763+0000", 2024-09-13T05:11:58.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056407813000000001 2024-09-13T05:11:58.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151812+0000", 2024-09-13T05:11:58.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8306999999999997e-05 2024-09-13T05:11:58.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151873+0000", 2024-09-13T05:11:58.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1064999999999999e-05 2024-09-13T05:11:58.200 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.200 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.200 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.200 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136567 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3965952~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.201 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:11:58.201 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0794525149999998, 2024-09-13T05:11:58.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056653907000000003, 2024-09-13T05:11:58.201 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.201 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.201 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.201 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.201 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.201 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136567 2024-09-13T05:11:58.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.201 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:11:58.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:11:58.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095357+0000", 2024-09-13T05:11:58.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:58.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095359+0000", 2024-09-13T05:11:58.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:11:58.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095362+0000", 2024-09-13T05:11:58.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7939999999999998e-06 2024-09-13T05:11:58.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095365+0000", 2024-09-13T05:11:58.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9979999999999999e-06 2024-09-13T05:11:58.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151904+0000", 2024-09-13T05:11:58.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056539308000000003 2024-09-13T05:11:58.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151953+0000", 2024-09-13T05:11:58.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8760000000000001e-05 2024-09-13T05:11:58.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152012+0000", 2024-09-13T05:11:58.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8761999999999997e-05 2024-09-13T05:11:58.205 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.205 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.205 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.205 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136569 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3980288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.205 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:11:58.205 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0794167610000001, 2024-09-13T05:11:58.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056771237000000002, 2024-09-13T05:11:58.205 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.205 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.205 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.205 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.205 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.206 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136569 2024-09-13T05:11:58.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.206 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:11:58.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:11:58.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:11:58.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:58.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095395+0000", 2024-09-13T05:11:58.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8870000000000001e-06 2024-09-13T05:11:58.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095402+0000", 2024-09-13T05:11:58.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6290000000000001e-06 2024-09-13T05:11:58.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095412+0000", 2024-09-13T05:11:58.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1730000000000001e-06 2024-09-13T05:11:58.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152044+0000", 2024-09-13T05:11:58.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056632016 2024-09-13T05:11:58.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152093+0000", 2024-09-13T05:11:58.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9570000000000001e-05 2024-09-13T05:11:58.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152165+0000", 2024-09-13T05:11:58.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1443e-05 2024-09-13T05:11:58.209 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.209 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.209 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.209 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136571 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3994624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.209 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:11:58.209 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0793957460000003, 2024-09-13T05:11:58.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056894741999999998, 2024-09-13T05:11:58.209 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.210 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.210 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.210 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.210 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.210 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136571 2024-09-13T05:11:58.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.210 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:11:58.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:11:58.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:11:58.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:58.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095418+0000", 2024-09-13T05:11:58.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0210000000000001e-06 2024-09-13T05:11:58.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095422+0000", 2024-09-13T05:11:58.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5310000000000002e-06 2024-09-13T05:11:58.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095425+0000", 2024-09-13T05:11:58.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8880000000000001e-06 2024-09-13T05:11:58.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152198+0000", 2024-09-13T05:11:58.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056773563999999999 2024-09-13T05:11:58.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152249+0000", 2024-09-13T05:11:58.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1168999999999997e-05 2024-09-13T05:11:58.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152309+0000", 2024-09-13T05:11:58.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9821999999999997e-05 2024-09-13T05:11:58.213 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.213 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.213 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.214 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136573 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4008960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.214 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:11:58.214 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0793835190000003, 2024-09-13T05:11:58.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057045810000000002, 2024-09-13T05:11:58.214 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.214 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.214 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.214 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.214 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.214 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136573 2024-09-13T05:11:58.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.214 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:11:58.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:11:58.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095426+0000", 2024-09-13T05:11:58.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:58.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095428+0000", 2024-09-13T05:11:58.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.593e-06 2024-09-13T05:11:58.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095431+0000", 2024-09-13T05:11:58.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9610000000000001e-06 2024-09-13T05:11:58.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095434+0000", 2024-09-13T05:11:58.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:11:58.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152352+0000", 2024-09-13T05:11:58.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05691881 2024-09-13T05:11:58.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152401+0000", 2024-09-13T05:11:58.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8995000000000001e-05 2024-09-13T05:11:58.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152472+0000", 2024-09-13T05:11:58.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1060000000000001e-05 2024-09-13T05:11:58.218 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.218 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.218 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.218 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136575 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4023296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.218 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:11:58.218 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0789535260000003, 2024-09-13T05:11:58.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056760069000000003, 2024-09-13T05:11:58.218 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.218 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.218 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.219 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.219 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.219 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136575 2024-09-13T05:11:58.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.219 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:11:58.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:11:58.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095437+0000", 2024-09-13T05:11:58.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9995799 2024-09-13T05:11:58.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095861+0000", 2024-09-13T05:11:58.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000424299 2024-09-13T05:11:58.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095869+0000", 2024-09-13T05:11:58.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5020000000000003e-06 2024-09-13T05:11:58.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095875+0000", 2024-09-13T05:11:58.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:11:58.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152502+0000", 2024-09-13T05:11:58.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056626528000000002 2024-09-13T05:11:58.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152556+0000", 2024-09-13T05:11:58.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4271000000000003e-05 2024-09-13T05:11:58.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152617+0000", 2024-09-13T05:11:58.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0896000000000001e-05 2024-09-13T05:11:58.222 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.222 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.222 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.222 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136577 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4037632~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.222 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:11:58.222 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.078852071, 2024-09-13T05:11:58.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056798242999999998, 2024-09-13T05:11:58.223 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.223 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.223 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.223 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.223 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.223 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136577 2024-09-13T05:11:58.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.223 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:11:58.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:11:58.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095882+0000", 2024-09-13T05:11:58.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999242 2024-09-13T05:11:58.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095961+0000", 2024-09-13T05:11:58.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8864999999999998e-05 2024-09-13T05:11:58.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095973+0000", 2024-09-13T05:11:58.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2206e-05 2024-09-13T05:11:58.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095978+0000", 2024-09-13T05:11:58.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0629999999999996e-06 2024-09-13T05:11:58.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152646+0000", 2024-09-13T05:11:58.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056668035999999998 2024-09-13T05:11:58.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152695+0000", 2024-09-13T05:11:58.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8634000000000002e-05 2024-09-13T05:11:58.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152756+0000", 2024-09-13T05:11:58.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1315000000000005e-05 2024-09-13T05:11:58.227 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.227 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.227 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.227 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136579 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4051968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.227 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:11:58.227 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0785239759999996, 2024-09-13T05:11:58.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056610869000000001, 2024-09-13T05:11:58.227 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.227 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.227 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.227 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.227 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.227 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136579 2024-09-13T05:11:58.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.228 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:11:58.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:11:58.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095989+0000", 2024-09-13T05:11:58.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997029 2024-09-13T05:11:58.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096291+0000", 2024-09-13T05:11:58.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030221499999999999 2024-09-13T05:11:58.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096300+0000", 2024-09-13T05:11:58.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4819999999999994e-06 2024-09-13T05:11:58.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096306+0000", 2024-09-13T05:11:58.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:11:58.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152788+0000", 2024-09-13T05:11:58.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056481625000000001 2024-09-13T05:11:58.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152837+0000", 2024-09-13T05:11:58.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9345000000000003e-05 2024-09-13T05:11:58.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152897+0000", 2024-09-13T05:11:58.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9892999999999997e-05 2024-09-13T05:11:58.231 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.231 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.231 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.231 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136581 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4066304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.231 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:11:58.231 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0783451490000004, 2024-09-13T05:11:58.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056597091000000002, 2024-09-13T05:11:58.231 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.231 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.232 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.232 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.232 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.232 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136581 2024-09-13T05:11:58.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.232 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:11:58.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:11:58.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096312+0000", 2024-09-13T05:11:58.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998465 2024-09-13T05:11:58.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096469+0000", 2024-09-13T05:11:58.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157109 2024-09-13T05:11:58.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096478+0000", 2024-09-13T05:11:58.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3260000000000002e-06 2024-09-13T05:11:58.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096482+0000", 2024-09-13T05:11:58.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9720000000000003e-06 2024-09-13T05:11:58.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152933+0000", 2024-09-13T05:11:58.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056451128000000003 2024-09-13T05:11:58.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152993+0000", 2024-09-13T05:11:58.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9947000000000001e-05 2024-09-13T05:11:58.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153062+0000", 2024-09-13T05:11:58.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9105999999999999e-05 2024-09-13T05:11:58.235 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.235 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.235 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.235 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136583 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4080640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.236 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:11:58.236 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0780792359999998, 2024-09-13T05:11:58.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056496609000000003, 2024-09-13T05:11:58.236 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.236 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.236 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.236 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.236 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.236 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136583 2024-09-13T05:11:58.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.236 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:11:58.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:11:58.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096485+0000", 2024-09-13T05:11:58.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997544 2024-09-13T05:11:58.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096735+0000", 2024-09-13T05:11:58.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024979899999999998 2024-09-13T05:11:58.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096742+0000", 2024-09-13T05:11:58.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7139999999999996e-06 2024-09-13T05:11:58.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096747+0000", 2024-09-13T05:11:58.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8709999999999996e-06 2024-09-13T05:11:58.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153099+0000", 2024-09-13T05:11:58.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056352639000000003 2024-09-13T05:11:58.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153168+0000", 2024-09-13T05:11:58.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9029000000000006e-05 2024-09-13T05:11:58.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153228+0000", 2024-09-13T05:11:58.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9339999999999998e-05 2024-09-13T05:11:58.239 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.240 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.240 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.240 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136585 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4094976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.240 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:11:58.240 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0778277689999998, 2024-09-13T05:11:58.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056396420000000003, 2024-09-13T05:11:58.240 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.240 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.240 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.240 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.240 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.241 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136585 2024-09-13T05:11:58.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.241 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:11:58.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:11:58.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096750+0000", 2024-09-13T05:11:58.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997673 2024-09-13T05:11:58.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096986+0000", 2024-09-13T05:11:58.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000236297 2024-09-13T05:11:58.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096993+0000", 2024-09-13T05:11:58.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9600000000000003e-06 2024-09-13T05:11:58.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096999+0000", 2024-09-13T05:11:58.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:11:58.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153264+0000", 2024-09-13T05:11:58.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056264728999999999 2024-09-13T05:11:58.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153318+0000", 2024-09-13T05:11:58.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3934000000000002e-05 2024-09-13T05:11:58.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153379+0000", 2024-09-13T05:11:58.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1206999999999999e-05 2024-09-13T05:11:58.244 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.244 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.244 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.244 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136586 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4109312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.244 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:11:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0776269669999996, 2024-09-13T05:11:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056374703999999998, 2024-09-13T05:11:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136586 2024-09-13T05:11:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:11:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:11:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097004+0000", 2024-09-13T05:11:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998207 2024-09-13T05:11:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097187+0000", 2024-09-13T05:11:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018337900000000001 2024-09-13T05:11:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097198+0000", 2024-09-13T05:11:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348e-05 2024-09-13T05:11:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097202+0000", 2024-09-13T05:11:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.121e-06 2024-09-13T05:11:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153411+0000", 2024-09-13T05:11:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056209510999999997 2024-09-13T05:11:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153464+0000", 2024-09-13T05:11:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2605000000000002e-05 2024-09-13T05:11:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153558+0000", 2024-09-13T05:11:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4017999999999993e-05 2024-09-13T05:11:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136588 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:11:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0773427839999998, 2024-09-13T05:11:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056274980000000002, 2024-09-13T05:11:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136588 2024-09-13T05:11:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:11:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:11:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097205+0000", 2024-09-13T05:11:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997377 2024-09-13T05:11:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097471+0000", 2024-09-13T05:11:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026628200000000001 2024-09-13T05:11:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097484+0000", 2024-09-13T05:11:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2493e-05 2024-09-13T05:11:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097488+0000", 2024-09-13T05:11:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9330000000000003e-06 2024-09-13T05:11:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153600+0000", 2024-09-13T05:11:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056112097 2024-09-13T05:11:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153654+0000", 2024-09-13T05:11:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4126000000000003e-05 2024-09-13T05:11:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153742+0000", 2024-09-13T05:11:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.831e-05 2024-09-13T05:11:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136589 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4137984~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:11:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0772034770000003, 2024-09-13T05:11:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056293867999999997, 2024-09-13T05:11:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136589 2024-09-13T05:11:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:11:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:11:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097491+0000", 2024-09-13T05:11:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998841 2024-09-13T05:11:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097610+0000", 2024-09-13T05:11:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119263 2024-09-13T05:11:58.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097617+0000", 2024-09-13T05:11:58.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6490000000000002e-06 2024-09-13T05:11:58.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097624+0000", 2024-09-13T05:11:58.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6309999999999997e-06 2024-09-13T05:11:58.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153779+0000", 2024-09-13T05:11:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056155153999999999 2024-09-13T05:11:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153831+0000", 2024-09-13T05:11:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2080000000000003e-05 2024-09-13T05:11:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153901+0000", 2024-09-13T05:11:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9765999999999996e-05 2024-09-13T05:11:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136591 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4152320~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097930+0000", 2024-09-13T05:11:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0768799250000001, 2024-09-13T05:11:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056118910000000001, 2024-09-13T05:11:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136591 2024-09-13T05:11:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097930+0000", 2024-09-13T05:11:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097930+0000", 2024-09-13T05:11:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097627+0000", 2024-09-13T05:11:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9996967 2024-09-13T05:11:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097934+0000", 2024-09-13T05:11:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030723700000000003 2024-09-13T05:11:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097941+0000", 2024-09-13T05:11:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.776e-06 2024-09-13T05:11:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097945+0000", 2024-09-13T05:11:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7809999999999999e-06 2024-09-13T05:11:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153937+0000", 2024-09-13T05:11:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055992078000000001 2024-09-13T05:11:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153987+0000", 2024-09-13T05:11:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0204000000000002e-05 2024-09-13T05:11:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.154049+0000", 2024-09-13T05:11:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2012000000000002e-05 2024-09-13T05:11:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136965 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3366912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:11:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0572346560000003, 2024-09-13T05:11:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056225403, 2024-09-13T05:11:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136965 2024-09-13T05:11:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:11:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:11:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117575+0000", 2024-09-13T05:11:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117578+0000", 2024-09-13T05:11:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4899999999999999e-06 2024-09-13T05:11:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117583+0000", 2024-09-13T05:11:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.074e-06 2024-09-13T05:11:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117587+0000", 2024-09-13T05:11:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5360000000000003e-06 2024-09-13T05:11:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173622+0000", 2024-09-13T05:11:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056034527000000001 2024-09-13T05:11:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173704+0000", 2024-09-13T05:11:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2137000000000003e-05 2024-09-13T05:11:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173801+0000", 2024-09-13T05:11:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7048999999999999e-05 2024-09-13T05:11:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136991 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3553280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:11:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0533088790000003, 2024-09-13T05:11:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056330199999999997, 2024-09-13T05:11:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136991 2024-09-13T05:11:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:11:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:11:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:11:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121504+0000", 2024-09-13T05:11:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7199999999999998e-06 2024-09-13T05:11:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121510+0000", 2024-09-13T05:11:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3459999999999999e-06 2024-09-13T05:11:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121515+0000", 2024-09-13T05:11:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.656e-06 2024-09-13T05:11:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177608+0000", 2024-09-13T05:11:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056093267000000002 2024-09-13T05:11:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177717+0000", 2024-09-13T05:11:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010901299999999999 2024-09-13T05:11:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177832+0000", 2024-09-13T05:11:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114604 2024-09-13T05:11:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.271 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.271 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.271 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.271 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:58.272 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #36, image image_client.0-clone36 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent37 2024-09-13T05:11:58.273 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:11:58.273 INFO:teuthology.orchestra.run.smithi120.stdout:5124 write 0x3291994 thru 0x329b363 (0x99d0 bytes) 2024-09-13T05:11:58.273 INFO:teuthology.orchestra.run.smithi120.stdout:5125 write 0xc68aea3 thru 0xc69556c (0xa6ca bytes) 2024-09-13T05:11:58.274 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:58.265+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:58.285 INFO:teuthology.orchestra.run.smithi120.stdout:5127 writesame 0x5499388 thru 0x549d67c data_size 0x1(0x42f5 bytes) 2024-09-13T05:11:58.298 INFO:teuthology.orchestra.run.smithi120.stdout:5128 punch from 0xcd2f75e to 0xcd37135, (0x79d7 bytes) 2024-09-13T05:11:58.298 INFO:teuthology.orchestra.run.smithi120.stdout:5130 write 0x7d3919c thru 0x7d4567d (0xc4e2 bytes) 2024-09-13T05:11:58.360 INFO:teuthology.orchestra.run.smithi120.stdout:5131 clone 39 order 25 su 131072 sc 14 2024-09-13T05:11:58.373 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:58.369+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:58.395 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:58.395 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:58.395 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:11:58.395 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:58.405 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:11:58.474 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:58.472+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:58.561 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:58.561 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:11:58.561 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:11:58.561 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:11:58.561 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:58.570 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:11:58.574 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-13T05:11:58.575 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:58.569+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:58.676 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:11:58.669+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:11:58.681 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:11:58.682 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:11:58.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:11:58.682 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:11:58.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.682 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:70758 3.2 3:427d0469:::rbd_header.112d8d1317eb:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-13T05:11:58.682 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:11:58.682 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.249588177, 2024-09-13T05:11:58.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.190313603, 2024-09-13T05:11:58.682 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.682 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.683 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.683 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70758 2024-09-13T05:11:58.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.683 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:11:58.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:11:58.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428654+0000", 2024-09-13T05:11:58.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:11:58.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428664+0000", 2024-09-13T05:11:58.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0664e-05 2024-09-13T05:11:58.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428683+0000", 2024-09-13T05:11:58.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8377e-05 2024-09-13T05:11:58.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428691+0000", 2024-09-13T05:11:58.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9400000000000008e-06 2024-09-13T05:11:58.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428789+0000", 2024-09-13T05:11:58.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7165999999999998e-05 2024-09-13T05:11:58.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:11:58.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428811+0000", 2024-09-13T05:11:58.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1925000000000001e-05 2024-09-13T05:11:58.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.617921+0000", 2024-09-13T05:11:58.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.189110536 2024-09-13T05:11:58.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618344+0000", 2024-09-13T05:11:58.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042245800000000001 2024-09-13T05:11:58.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618969+0000", 2024-09-13T05:11:58.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062529299999999996 2024-09-13T05:11:58.687 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.687 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.687 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.688 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135319 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 1397760~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.688 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.694864+0000", 2024-09-13T05:11:58.688 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9833791029999999, 2024-09-13T05:11:58.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061707414000000002, 2024-09-13T05:11:58.688 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.688 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.688 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.688 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.688 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.688 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135319 2024-09-13T05:11:58.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.688 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694864+0000", 2024-09-13T05:11:58.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694864+0000", 2024-09-13T05:11:58.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694864+0000", 2024-09-13T05:11:58.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:58.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694867+0000", 2024-09-13T05:11:58.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.01e-06 2024-09-13T05:11:58.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694874+0000", 2024-09-13T05:11:58.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5220000000000001e-06 2024-09-13T05:11:58.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694881+0000", 2024-09-13T05:11:58.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2260000000000002e-06 2024-09-13T05:11:58.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.756298+0000", 2024-09-13T05:11:58.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061417241999999997 2024-09-13T05:11:58.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.756424+0000", 2024-09-13T05:11:58.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012636 2024-09-13T05:11:58.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.756572+0000", 2024-09-13T05:11:58.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014749399999999999 2024-09-13T05:11:58.692 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.692 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.692 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.692 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135320 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 1412096~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.692 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.694887+0000", 2024-09-13T05:11:58.692 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9833560850000005, 2024-09-13T05:11:58.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061814784999999997, 2024-09-13T05:11:58.692 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.692 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.693 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.693 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.693 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.693 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135320 2024-09-13T05:11:58.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.693 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694887+0000", 2024-09-13T05:11:58.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694887+0000", 2024-09-13T05:11:58.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694886+0000", 2024-09-13T05:11:58.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:11:58.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694890+0000", 2024-09-13T05:11:58.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2400000000000001e-06 2024-09-13T05:11:58.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694897+0000", 2024-09-13T05:11:58.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2869999999999999e-06 2024-09-13T05:11:58.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694904+0000", 2024-09-13T05:11:58.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.063e-06 2024-09-13T05:11:58.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.756591+0000", 2024-09-13T05:11:58.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061686356999999997 2024-09-13T05:11:58.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.756639+0000", 2024-09-13T05:11:58.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8724999999999999e-05 2024-09-13T05:11:58.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.756702+0000", 2024-09-13T05:11:58.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2693000000000004e-05 2024-09-13T05:11:58.697 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.697 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.698 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.698 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135321 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 1426432~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.698 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.694919+0000", 2024-09-13T05:11:58.698 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9833246730000003, 2024-09-13T05:11:58.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062137276999999998, 2024-09-13T05:11:58.698 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.698 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.698 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135321 2024-09-13T05:11:58.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.699 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694919+0000", 2024-09-13T05:11:58.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694919+0000", 2024-09-13T05:11:58.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694918+0000", 2024-09-13T05:11:58.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:58.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694925+0000", 2024-09-13T05:11:58.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4930000000000003e-06 2024-09-13T05:11:58.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694932+0000", 2024-09-13T05:11:58.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6120000000000001e-06 2024-09-13T05:11:58.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694939+0000", 2024-09-13T05:11:58.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6719999999999998e-06 2024-09-13T05:11:58.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.756772+0000", 2024-09-13T05:11:58.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061833291999999998 2024-09-13T05:11:58.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.756898+0000", 2024-09-13T05:11:58.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012527799999999999 2024-09-13T05:11:58.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.757056+0000", 2024-09-13T05:11:58.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015851400000000001 2024-09-13T05:11:58.702 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.702 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.702 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.702 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135322 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 1440768~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.702 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.694945+0000", 2024-09-13T05:11:58.702 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9832982189999999, 2024-09-13T05:11:58.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062247731000000001, 2024-09-13T05:11:58.703 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.703 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.703 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.703 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.703 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.703 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135322 2024-09-13T05:11:58.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.703 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694945+0000", 2024-09-13T05:11:58.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694945+0000", 2024-09-13T05:11:58.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694945+0000", 2024-09-13T05:11:58.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:58.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694948+0000", 2024-09-13T05:11:58.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.315e-06 2024-09-13T05:11:58.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694965+0000", 2024-09-13T05:11:58.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7110000000000001e-05 2024-09-13T05:11:58.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694972+0000", 2024-09-13T05:11:58.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8739999999999997e-06 2024-09-13T05:11:58.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.757079+0000", 2024-09-13T05:11:58.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062106806000000001 2024-09-13T05:11:58.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.757128+0000", 2024-09-13T05:11:58.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9586000000000003e-05 2024-09-13T05:11:58.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.757193+0000", 2024-09-13T05:11:58.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4636999999999998e-05 2024-09-13T05:11:58.707 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.707 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.707 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.707 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135328 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 1526784~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.707 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.697227+0000", 2024-09-13T05:11:58.707 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9810162719999997, 2024-09-13T05:11:58.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061448902999999999, 2024-09-13T05:11:58.707 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.707 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.708 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135328 2024-09-13T05:11:58.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.708 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697227+0000", 2024-09-13T05:11:58.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697227+0000", 2024-09-13T05:11:58.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697227+0000", 2024-09-13T05:11:58.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:58.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697230+0000", 2024-09-13T05:11:58.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0479999999999999e-06 2024-09-13T05:11:58.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697237+0000", 2024-09-13T05:11:58.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5399999999999998e-06 2024-09-13T05:11:58.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697243+0000", 2024-09-13T05:11:58.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9859999999999999e-06 2024-09-13T05:11:58.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.758561+0000", 2024-09-13T05:11:58.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061317852999999999 2024-09-13T05:11:58.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.758611+0000", 2024-09-13T05:11:58.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9477000000000001e-05 2024-09-13T05:11:58.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.758676+0000", 2024-09-13T05:11:58.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5450000000000005e-05 2024-09-13T05:11:58.711 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.711 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.711 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.711 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135329 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 1541120~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.712 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.697250+0000", 2024-09-13T05:11:58.712 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9809935090000002, 2024-09-13T05:11:58.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061747999999999997, 2024-09-13T05:11:58.712 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.712 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.712 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.712 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.712 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.712 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135329 2024-09-13T05:11:58.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.712 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697250+0000", 2024-09-13T05:11:58.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697250+0000", 2024-09-13T05:11:58.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697249+0000", 2024-09-13T05:11:58.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:58.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697253+0000", 2024-09-13T05:11:58.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2780000000000002e-06 2024-09-13T05:11:58.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697260+0000", 2024-09-13T05:11:58.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9469999999999997e-06 2024-09-13T05:11:58.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697266+0000", 2024-09-13T05:11:58.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0159999999999997e-06 2024-09-13T05:11:58.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.758745+0000", 2024-09-13T05:11:58.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061479383999999998 2024-09-13T05:11:58.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.758863+0000", 2024-09-13T05:11:58.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011804 2024-09-13T05:11:58.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.758998+0000", 2024-09-13T05:11:58.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013477500000000001 2024-09-13T05:11:58.716 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.716 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.716 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.716 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135330 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 1555456~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.716 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.697273+0000", 2024-09-13T05:11:58.717 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9809705529999997, 2024-09-13T05:11:58.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061888229000000003, 2024-09-13T05:11:58.717 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.717 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.717 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.717 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.717 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.717 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135330 2024-09-13T05:11:58.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.717 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697273+0000", 2024-09-13T05:11:58.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697273+0000", 2024-09-13T05:11:58.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697272+0000", 2024-09-13T05:11:58.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:58.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697276+0000", 2024-09-13T05:11:58.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2260000000000001e-06 2024-09-13T05:11:58.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697283+0000", 2024-09-13T05:11:58.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9269999999999999e-06 2024-09-13T05:11:58.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697289+0000", 2024-09-13T05:11:58.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.229e-06 2024-09-13T05:11:58.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759040+0000", 2024-09-13T05:11:58.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061751440999999997 2024-09-13T05:11:58.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759094+0000", 2024-09-13T05:11:58.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3440999999999999e-05 2024-09-13T05:11:58.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759161+0000", 2024-09-13T05:11:58.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7447999999999995e-05 2024-09-13T05:11:58.721 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.721 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.721 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.721 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135331 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 1569792~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.721 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.697296+0000", 2024-09-13T05:11:58.721 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.980947155, 2024-09-13T05:11:58.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062128121000000001, 2024-09-13T05:11:58.721 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.721 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.721 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.722 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.722 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.722 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135331 2024-09-13T05:11:58.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.722 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697296+0000", 2024-09-13T05:11:58.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697296+0000", 2024-09-13T05:11:58.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697296+0000", 2024-09-13T05:11:58.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:58.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697299+0000", 2024-09-13T05:11:58.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.315e-06 2024-09-13T05:11:58.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697306+0000", 2024-09-13T05:11:58.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1600000000000001e-06 2024-09-13T05:11:58.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697313+0000", 2024-09-13T05:11:58.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4300000000000003e-06 2024-09-13T05:11:58.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759234+0000", 2024-09-13T05:11:58.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061921797000000001 2024-09-13T05:11:58.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759350+0000", 2024-09-13T05:11:58.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115986 2024-09-13T05:11:58.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759424+0000", 2024-09-13T05:11:58.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3930999999999994e-05 2024-09-13T05:11:58.725 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.725 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.725 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.725 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135332 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 8192~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.726 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.697328+0000", 2024-09-13T05:11:58.726 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9809152240000003, 2024-09-13T05:11:58.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062249958000000001, 2024-09-13T05:11:58.726 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.726 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.726 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.726 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.726 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.726 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135332 2024-09-13T05:11:58.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.726 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697328+0000", 2024-09-13T05:11:58.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697328+0000", 2024-09-13T05:11:58.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697327+0000", 2024-09-13T05:11:58.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:11:58.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697331+0000", 2024-09-13T05:11:58.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.568e-06 2024-09-13T05:11:58.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697340+0000", 2024-09-13T05:11:58.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7260000000000008e-06 2024-09-13T05:11:58.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697361+0000", 2024-09-13T05:11:58.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0959e-05 2024-09-13T05:11:58.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759460+0000", 2024-09-13T05:11:58.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062099092000000002 2024-09-13T05:11:58.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759510+0000", 2024-09-13T05:11:58.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0457999999999997e-05 2024-09-13T05:11:58.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759578+0000", 2024-09-13T05:11:58.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7881999999999998e-05 2024-09-13T05:11:58.730 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.730 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.730 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.730 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135333 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 22528~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.730 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.697365+0000", 2024-09-13T05:11:58.730 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9808783099999996, 2024-09-13T05:11:58.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062345834000000003, 2024-09-13T05:11:58.730 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.730 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.730 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.730 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.731 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.731 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135333 2024-09-13T05:11:58.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.731 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697365+0000", 2024-09-13T05:11:58.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697365+0000", 2024-09-13T05:11:58.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697365+0000", 2024-09-13T05:11:58.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:58.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697388+0000", 2024-09-13T05:11:58.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2745e-05 2024-09-13T05:11:58.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697396+0000", 2024-09-13T05:11:58.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4700000000000002e-06 2024-09-13T05:11:58.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697402+0000", 2024-09-13T05:11:58.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6239999999999999e-06 2024-09-13T05:11:58.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759605+0000", 2024-09-13T05:11:58.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062203062000000003 2024-09-13T05:11:58.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759652+0000", 2024-09-13T05:11:58.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7561000000000001e-05 2024-09-13T05:11:58.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759711+0000", 2024-09-13T05:11:58.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8743999999999999e-05 2024-09-13T05:11:58.734 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.734 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.734 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.734 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135334 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 36864~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.735 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.697455+0000", 2024-09-13T05:11:58.735 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9807880180000002, 2024-09-13T05:11:58.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062617093999999998, 2024-09-13T05:11:58.735 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.735 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.735 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.735 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.735 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.735 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135334 2024-09-13T05:11:58.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.735 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697455+0000", 2024-09-13T05:11:58.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697455+0000", 2024-09-13T05:11:58.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697406+0000", 2024-09-13T05:11:58.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999509 2024-09-13T05:11:58.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697460+0000", 2024-09-13T05:11:58.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3224999999999999e-05 2024-09-13T05:11:58.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697467+0000", 2024-09-13T05:11:58.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3950000000000003e-06 2024-09-13T05:11:58.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697473+0000", 2024-09-13T05:11:58.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4269999999999996e-06 2024-09-13T05:11:58.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759769+0000", 2024-09-13T05:11:58.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062295467 2024-09-13T05:11:58.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759904+0000", 2024-09-13T05:11:58.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134831 2024-09-13T05:11:58.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.760073+0000", 2024-09-13T05:11:58.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016886200000000001 2024-09-13T05:11:58.739 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.739 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.739 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.739 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135348 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 237568~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.739 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.701225+0000", 2024-09-13T05:11:58.739 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9770179930000005, 2024-09-13T05:11:58.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061582350000000001, 2024-09-13T05:11:58.739 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.739 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.740 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135348 2024-09-13T05:11:58.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.740 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701225+0000", 2024-09-13T05:11:58.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701225+0000", 2024-09-13T05:11:58.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701225+0000", 2024-09-13T05:11:58.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:58.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701228+0000", 2024-09-13T05:11:58.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8219999999999998e-06 2024-09-13T05:11:58.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701233+0000", 2024-09-13T05:11:58.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4140000000000002e-06 2024-09-13T05:11:58.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701239+0000", 2024-09-13T05:11:58.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7520000000000002e-06 2024-09-13T05:11:58.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.762690+0000", 2024-09-13T05:11:58.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061451257000000002 2024-09-13T05:11:58.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.762744+0000", 2024-09-13T05:11:58.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3884000000000001e-05 2024-09-13T05:11:58.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.762808+0000", 2024-09-13T05:11:58.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3830000000000004e-05 2024-09-13T05:11:58.743 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.743 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.743 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.744 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135349 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 251904~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.744 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.701244+0000", 2024-09-13T05:11:58.744 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9769995859999998, 2024-09-13T05:11:58.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061703169000000002, 2024-09-13T05:11:58.744 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.744 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.744 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.744 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.744 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.744 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135349 2024-09-13T05:11:58.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.744 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701244+0000", 2024-09-13T05:11:58.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701244+0000", 2024-09-13T05:11:58.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701243+0000", 2024-09-13T05:11:58.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:58.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701246+0000", 2024-09-13T05:11:58.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0240000000000002e-06 2024-09-13T05:11:58.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701253+0000", 2024-09-13T05:11:58.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4409999999999998e-06 2024-09-13T05:11:58.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701258+0000", 2024-09-13T05:11:58.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0880000000000002e-06 2024-09-13T05:11:58.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.762838+0000", 2024-09-13T05:11:58.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061580324999999998 2024-09-13T05:11:58.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.762885+0000", 2024-09-13T05:11:58.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6526000000000001e-05 2024-09-13T05:11:58.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.762947+0000", 2024-09-13T05:11:58.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2212999999999995e-05 2024-09-13T05:11:58.748 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.748 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.748 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.749 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135350 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 266240~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.749 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.701263+0000", 2024-09-13T05:11:58.749 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9769808160000002, 2024-09-13T05:11:58.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061884512000000003, 2024-09-13T05:11:58.749 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.749 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.749 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.749 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.749 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.749 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135350 2024-09-13T05:11:58.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.749 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701263+0000", 2024-09-13T05:11:58.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701263+0000", 2024-09-13T05:11:58.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701262+0000", 2024-09-13T05:11:58.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:58.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701265+0000", 2024-09-13T05:11:58.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5500000000000001e-06 2024-09-13T05:11:58.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701271+0000", 2024-09-13T05:11:58.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0120000000000002e-06 2024-09-13T05:11:58.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701276+0000", 2024-09-13T05:11:58.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1309999999999997e-06 2024-09-13T05:11:58.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.762996+0000", 2024-09-13T05:11:58.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061719860000000001 2024-09-13T05:11:58.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.763059+0000", 2024-09-13T05:11:58.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2983000000000003e-05 2024-09-13T05:11:58.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.763147+0000", 2024-09-13T05:11:58.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8300000000000005e-05 2024-09-13T05:11:58.753 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.753 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.753 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.753 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135351 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 280576~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.753 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.701280+0000", 2024-09-13T05:11:58.753 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9769630310000004, 2024-09-13T05:11:58.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062054665000000002, 2024-09-13T05:11:58.753 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.753 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.754 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.754 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.754 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.754 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135351 2024-09-13T05:11:58.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.754 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701280+0000", 2024-09-13T05:11:58.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701280+0000", 2024-09-13T05:11:58.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701280+0000", 2024-09-13T05:11:58.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:58.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701283+0000", 2024-09-13T05:11:58.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6010000000000002e-06 2024-09-13T05:11:58.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701290+0000", 2024-09-13T05:11:58.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8839999999999997e-06 2024-09-13T05:11:58.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701294+0000", 2024-09-13T05:11:58.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.826e-06 2024-09-13T05:11:58.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.763191+0000", 2024-09-13T05:11:58.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061896944000000002 2024-09-13T05:11:58.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.763271+0000", 2024-09-13T05:11:58.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0006999999999995e-05 2024-09-13T05:11:58.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.763335+0000", 2024-09-13T05:11:58.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3740999999999998e-05 2024-09-13T05:11:58.757 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.757 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.757 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.758 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135377 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 638976~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.758 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.705635+0000", 2024-09-13T05:11:58.758 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9726082700000003, 2024-09-13T05:11:58.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061486266999999997, 2024-09-13T05:11:58.758 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.758 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.758 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.758 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.758 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.758 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135377 2024-09-13T05:11:58.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.758 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705635+0000", 2024-09-13T05:11:58.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705635+0000", 2024-09-13T05:11:58.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705635+0000", 2024-09-13T05:11:58.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:58.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705639+0000", 2024-09-13T05:11:58.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9820000000000002e-06 2024-09-13T05:11:58.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705645+0000", 2024-09-13T05:11:58.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7399999999999998e-06 2024-09-13T05:11:58.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705650+0000", 2024-09-13T05:11:58.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.335e-06 2024-09-13T05:11:58.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.766994+0000", 2024-09-13T05:11:58.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061344309999999999 2024-09-13T05:11:58.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767055+0000", 2024-09-13T05:11:58.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1464000000000006e-05 2024-09-13T05:11:58.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767121+0000", 2024-09-13T05:11:58.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.601e-05 2024-09-13T05:11:58.762 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.762 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.762 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.762 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135378 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 653312~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.762 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.705653+0000", 2024-09-13T05:11:58.762 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9725901940000004, 2024-09-13T05:11:58.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061633412999999998, 2024-09-13T05:11:58.762 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.763 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.763 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.763 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.763 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.763 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135378 2024-09-13T05:11:58.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.763 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705653+0000", 2024-09-13T05:11:58.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705653+0000", 2024-09-13T05:11:58.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705653+0000", 2024-09-13T05:11:58.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:58.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705655+0000", 2024-09-13T05:11:58.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3889999999999999e-06 2024-09-13T05:11:58.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705660+0000", 2024-09-13T05:11:58.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3420000000000001e-06 2024-09-13T05:11:58.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705663+0000", 2024-09-13T05:11:58.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9809999999999997e-06 2024-09-13T05:11:58.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767152+0000", 2024-09-13T05:11:58.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061488084999999998 2024-09-13T05:11:58.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767217+0000", 2024-09-13T05:11:58.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5747000000000006e-05 2024-09-13T05:11:58.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767287+0000", 2024-09-13T05:11:58.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9330000000000002e-05 2024-09-13T05:11:58.766 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.766 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.766 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.767 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135379 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 667648~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.767 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.705667+0000", 2024-09-13T05:11:58.767 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9725764029999997, 2024-09-13T05:11:58.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061770584000000003, 2024-09-13T05:11:58.767 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.767 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.767 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.767 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.767 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.767 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135379 2024-09-13T05:11:58.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.767 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705667+0000", 2024-09-13T05:11:58.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705667+0000", 2024-09-13T05:11:58.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705667+0000", 2024-09-13T05:11:58.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:58.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705669+0000", 2024-09-13T05:11:58.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1040000000000001e-06 2024-09-13T05:11:58.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705673+0000", 2024-09-13T05:11:58.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3059999999999999e-06 2024-09-13T05:11:58.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705677+0000", 2024-09-13T05:11:58.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0459999999999999e-06 2024-09-13T05:11:58.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767316+0000", 2024-09-13T05:11:58.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061639237999999999 2024-09-13T05:11:58.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767370+0000", 2024-09-13T05:11:58.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3270000000000003e-05 2024-09-13T05:11:58.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767438+0000", 2024-09-13T05:11:58.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7951e-05 2024-09-13T05:11:58.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.771 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.771 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135380 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 681984~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:11:58.771 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.705681+0000", 2024-09-13T05:11:58.771 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.9725629300000005, 2024-09-13T05:11:58.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061931205000000003, 2024-09-13T05:11:58.771 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:11:58.771 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:11:58.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:11:58.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:11:58.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:11:58.772 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135380 2024-09-13T05:11:58.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.772 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:11:58.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:11:58.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705681+0000", 2024-09-13T05:11:58.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:11:58.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705681+0000", 2024-09-13T05:11:58.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:11:58.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:11:58.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705680+0000", 2024-09-13T05:11:58.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:11:58.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:11:58.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705682+0000", 2024-09-13T05:11:58.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.204e-06 2024-09-13T05:11:58.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:11:58.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705688+0000", 2024-09-13T05:11:58.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3820000000000003e-06 2024-09-13T05:11:58.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:11:58.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705692+0000", 2024-09-13T05:11:58.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8139999999999998e-06 2024-09-13T05:11:58.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:11:58.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767468+0000", 2024-09-13T05:11:58.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061776223999999998 2024-09-13T05:11:58.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:11:58.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767532+0000", 2024-09-13T05:11:58.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4066000000000006e-05 2024-09-13T05:11:58.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:11:58.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:11:58.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:11:58.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767612+0000", 2024-09-13T05:11:58.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9843000000000001e-05 2024-09-13T05:11:58.775 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.775 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.775 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.775 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:11:58.775 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:11:58.776 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:11:58.777 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:11:58.777 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:58.773+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:58.878 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:58.873+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:58.890 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:11:58.894 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:58.894 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:58.894 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:11:58.894 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:58.905 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:11:58.978 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:58.976+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:59.016 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:11:59.016 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:11:59.016 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:11:59.016 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:11:59.017 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:11:59.022 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone38 from 0xdab6cef (overlap 0xdab6cef) to 0x15df14b 2024-09-13T05:11:59.026 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:11:59.040 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:11:59.066 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:11:59.079 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:59.073+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:59.090 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:11:59.121 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:11:59.148 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:11:59.165 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:59.165 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:59.179 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:11:59.179 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:11:59.205 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:11:59.205 INFO:teuthology.orchestra.run.smithi120.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-13T05:11:59.205 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:11:59.205 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:11:59.205 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:11:59.206 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:11:59.206 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:11:59.206 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:11:59.206 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:11:59.208 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T05:11:59.208 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T05:11:59.221 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:59.217+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:59.281 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:59.280+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:59.326 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:59.326 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:59.336 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:11:59.382 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:11:59.377+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:11:59.453 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:59.454 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:59.466 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:11:59.483 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:59.480+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:59.584 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:11:59.577+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:11:59.638 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:59.638 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:59.649 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:11:59.685 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:59.684+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:11:59.786 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:11:59.781+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:11:59.788 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:59.788 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:59.801 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:11:59.885 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T05:11:59.886 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:11:59.884+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:11:59.930 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:11:59.930 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:11:59.943 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:11:59.987 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:11:59.984+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:00.055 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:00.055 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:00.066 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:12:00.113 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:00.109+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:00.170 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:00.170 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:00.180 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:12:00.188 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:00.181+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:00.293 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:00.292+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:00.312 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:00.312 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:00.325 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:12:00.391 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:00.388+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:00.427 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:00.428 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:00.437 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:12:00.492 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:00.485+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:00.547 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:00.547 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:00.557 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:12:00.578 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #37, image image_client.0-clone37 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent38 2024-09-13T05:12:00.593 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:00.589+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:00.694 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:00.692+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:00.696 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:00.697 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:00.712 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:12:00.795 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:00.789+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:00.840 INFO:teuthology.orchestra.run.smithi120.stdout:5132 writesame 0x568f62b thru 0x569a4a0 data_size 0x2(0xae76 bytes) 2024-09-13T05:12:00.847 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:00.847 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:00.860 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:12:00.896 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:00.889+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:00.898 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is set 2024-09-13T05:12:00.967 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:00.967 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:00.976 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:12:00.997 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:00.993+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:01.077 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:01.078 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:01.087 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:12:01.098 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:01.093+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:01.191 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:01.191 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:01.202 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:12:01.202 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:01.197+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:01.209 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:12:01.303 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:01.297+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:01.306 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:01.307 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:01.316 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:12:01.400 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:01.403 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:01.400+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:01.427 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:01.428 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:01.432 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:01.437 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:12:01.455 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:01.481 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:01.504 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:01.500+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:01.505 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:01.529 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:01.557 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:01.557 INFO:teuthology.orchestra.run.smithi120.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-13T05:12:01.558 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:01.558 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:01.558 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:01.558 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:01.558 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:01.558 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:01.559 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:01.564 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T05:12:01.565 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T05:12:01.576 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:01.576 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:01.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:01.576 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:70758 3.2 3:427d0469:::rbd_header.112d8d1317eb:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-13T05:12:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.144687277999999, 2024-09-13T05:12:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.190313603, 2024-09-13T05:12:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70758 2024-09-13T05:12:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428654+0000", 2024-09-13T05:12:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428664+0000", 2024-09-13T05:12:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0664e-05 2024-09-13T05:12:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428683+0000", 2024-09-13T05:12:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8377e-05 2024-09-13T05:12:01.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:01.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428691+0000", 2024-09-13T05:12:01.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9400000000000008e-06 2024-09-13T05:12:01.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:01.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428789+0000", 2024-09-13T05:12:01.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7165999999999998e-05 2024-09-13T05:12:01.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:01.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428811+0000", 2024-09-13T05:12:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1925000000000001e-05 2024-09-13T05:12:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.617921+0000", 2024-09-13T05:12:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.189110536 2024-09-13T05:12:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618344+0000", 2024-09-13T05:12:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042245800000000001 2024-09-13T05:12:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618969+0000", 2024-09-13T05:12:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062529299999999996 2024-09-13T05:12:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135319 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 1397760~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.694864+0000", 2024-09-13T05:12:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8784782040000003, 2024-09-13T05:12:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061707414000000002, 2024-09-13T05:12:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:01.584 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:01.584 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:01.584 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:01.584 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135319 2024-09-13T05:12:01.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.585 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:01.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:01.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694864+0000", 2024-09-13T05:12:01.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:01.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694864+0000", 2024-09-13T05:12:01.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:01.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694864+0000", 2024-09-13T05:12:01.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:01.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694867+0000", 2024-09-13T05:12:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.01e-06 2024-09-13T05:12:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694874+0000", 2024-09-13T05:12:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5220000000000001e-06 2024-09-13T05:12:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694881+0000", 2024-09-13T05:12:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2260000000000002e-06 2024-09-13T05:12:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.756298+0000", 2024-09-13T05:12:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061417241999999997 2024-09-13T05:12:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.756424+0000", 2024-09-13T05:12:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012636 2024-09-13T05:12:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.756572+0000", 2024-09-13T05:12:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014749399999999999 2024-09-13T05:12:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135320 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 1412096~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.694887+0000", 2024-09-13T05:12:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8784551860000001, 2024-09-13T05:12:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061814784999999997, 2024-09-13T05:12:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135320 2024-09-13T05:12:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694887+0000", 2024-09-13T05:12:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694887+0000", 2024-09-13T05:12:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694886+0000", 2024-09-13T05:12:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694890+0000", 2024-09-13T05:12:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2400000000000001e-06 2024-09-13T05:12:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694897+0000", 2024-09-13T05:12:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2869999999999999e-06 2024-09-13T05:12:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694904+0000", 2024-09-13T05:12:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.063e-06 2024-09-13T05:12:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.756591+0000", 2024-09-13T05:12:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061686356999999997 2024-09-13T05:12:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.756639+0000", 2024-09-13T05:12:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8724999999999999e-05 2024-09-13T05:12:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.756702+0000", 2024-09-13T05:12:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2693000000000004e-05 2024-09-13T05:12:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135321 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 1426432~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.694919+0000", 2024-09-13T05:12:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8784237739999998, 2024-09-13T05:12:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062137276999999998, 2024-09-13T05:12:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135321 2024-09-13T05:12:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694919+0000", 2024-09-13T05:12:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694919+0000", 2024-09-13T05:12:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694918+0000", 2024-09-13T05:12:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694925+0000", 2024-09-13T05:12:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4930000000000003e-06 2024-09-13T05:12:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694932+0000", 2024-09-13T05:12:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6120000000000001e-06 2024-09-13T05:12:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694939+0000", 2024-09-13T05:12:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6719999999999998e-06 2024-09-13T05:12:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.756772+0000", 2024-09-13T05:12:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061833291999999998 2024-09-13T05:12:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.756898+0000", 2024-09-13T05:12:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012527799999999999 2024-09-13T05:12:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.757056+0000", 2024-09-13T05:12:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015851400000000001 2024-09-13T05:12:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135322 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 1440768~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.694945+0000", 2024-09-13T05:12:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8783973199999995, 2024-09-13T05:12:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062247731000000001, 2024-09-13T05:12:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135322 2024-09-13T05:12:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694945+0000", 2024-09-13T05:12:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694945+0000", 2024-09-13T05:12:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694945+0000", 2024-09-13T05:12:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694948+0000", 2024-09-13T05:12:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.315e-06 2024-09-13T05:12:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694965+0000", 2024-09-13T05:12:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7110000000000001e-05 2024-09-13T05:12:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694972+0000", 2024-09-13T05:12:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8739999999999997e-06 2024-09-13T05:12:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.757079+0000", 2024-09-13T05:12:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062106806000000001 2024-09-13T05:12:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.757128+0000", 2024-09-13T05:12:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9586000000000003e-05 2024-09-13T05:12:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.757193+0000", 2024-09-13T05:12:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4636999999999998e-05 2024-09-13T05:12:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135328 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 1526784~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.697227+0000", 2024-09-13T05:12:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8761153729999993, 2024-09-13T05:12:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061448902999999999, 2024-09-13T05:12:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135328 2024-09-13T05:12:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697227+0000", 2024-09-13T05:12:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697227+0000", 2024-09-13T05:12:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697227+0000", 2024-09-13T05:12:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697230+0000", 2024-09-13T05:12:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0479999999999999e-06 2024-09-13T05:12:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697237+0000", 2024-09-13T05:12:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5399999999999998e-06 2024-09-13T05:12:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697243+0000", 2024-09-13T05:12:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9859999999999999e-06 2024-09-13T05:12:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.758561+0000", 2024-09-13T05:12:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061317852999999999 2024-09-13T05:12:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.758611+0000", 2024-09-13T05:12:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9477000000000001e-05 2024-09-13T05:12:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.758676+0000", 2024-09-13T05:12:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5450000000000005e-05 2024-09-13T05:12:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135329 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 1541120~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.697250+0000", 2024-09-13T05:12:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8760926100000006, 2024-09-13T05:12:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061747999999999997, 2024-09-13T05:12:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135329 2024-09-13T05:12:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697250+0000", 2024-09-13T05:12:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697250+0000", 2024-09-13T05:12:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697249+0000", 2024-09-13T05:12:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697253+0000", 2024-09-13T05:12:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2780000000000002e-06 2024-09-13T05:12:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697260+0000", 2024-09-13T05:12:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9469999999999997e-06 2024-09-13T05:12:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697266+0000", 2024-09-13T05:12:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0159999999999997e-06 2024-09-13T05:12:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.758745+0000", 2024-09-13T05:12:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061479383999999998 2024-09-13T05:12:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.758863+0000", 2024-09-13T05:12:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011804 2024-09-13T05:12:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.758998+0000", 2024-09-13T05:12:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013477500000000001 2024-09-13T05:12:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135330 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 1555456~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.697273+0000", 2024-09-13T05:12:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8760696540000001, 2024-09-13T05:12:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061888229000000003, 2024-09-13T05:12:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135330 2024-09-13T05:12:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697273+0000", 2024-09-13T05:12:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697273+0000", 2024-09-13T05:12:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697272+0000", 2024-09-13T05:12:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697276+0000", 2024-09-13T05:12:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2260000000000001e-06 2024-09-13T05:12:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697283+0000", 2024-09-13T05:12:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9269999999999999e-06 2024-09-13T05:12:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697289+0000", 2024-09-13T05:12:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.229e-06 2024-09-13T05:12:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759040+0000", 2024-09-13T05:12:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061751440999999997 2024-09-13T05:12:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759094+0000", 2024-09-13T05:12:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3440999999999999e-05 2024-09-13T05:12:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759161+0000", 2024-09-13T05:12:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7447999999999995e-05 2024-09-13T05:12:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135331 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 1569792~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.697296+0000", 2024-09-13T05:12:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8760462560000004, 2024-09-13T05:12:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062128121000000001, 2024-09-13T05:12:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135331 2024-09-13T05:12:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697296+0000", 2024-09-13T05:12:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:01.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697296+0000", 2024-09-13T05:12:01.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:01.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697296+0000", 2024-09-13T05:12:01.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:01.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697299+0000", 2024-09-13T05:12:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.315e-06 2024-09-13T05:12:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697306+0000", 2024-09-13T05:12:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1600000000000001e-06 2024-09-13T05:12:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697313+0000", 2024-09-13T05:12:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4300000000000003e-06 2024-09-13T05:12:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759234+0000", 2024-09-13T05:12:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061921797000000001 2024-09-13T05:12:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759350+0000", 2024-09-13T05:12:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115986 2024-09-13T05:12:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759424+0000", 2024-09-13T05:12:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3930999999999994e-05 2024-09-13T05:12:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135332 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 8192~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.697328+0000", 2024-09-13T05:12:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8760143249999999, 2024-09-13T05:12:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062249958000000001, 2024-09-13T05:12:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135332 2024-09-13T05:12:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697328+0000", 2024-09-13T05:12:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697328+0000", 2024-09-13T05:12:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697327+0000", 2024-09-13T05:12:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697331+0000", 2024-09-13T05:12:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.568e-06 2024-09-13T05:12:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697340+0000", 2024-09-13T05:12:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7260000000000008e-06 2024-09-13T05:12:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697361+0000", 2024-09-13T05:12:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0959e-05 2024-09-13T05:12:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759460+0000", 2024-09-13T05:12:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062099092000000002 2024-09-13T05:12:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759510+0000", 2024-09-13T05:12:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0457999999999997e-05 2024-09-13T05:12:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759578+0000", 2024-09-13T05:12:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7881999999999998e-05 2024-09-13T05:12:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135333 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 22528~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.697365+0000", 2024-09-13T05:12:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8759774110000009, 2024-09-13T05:12:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062345834000000003, 2024-09-13T05:12:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135333 2024-09-13T05:12:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697365+0000", 2024-09-13T05:12:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697365+0000", 2024-09-13T05:12:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697365+0000", 2024-09-13T05:12:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697388+0000", 2024-09-13T05:12:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2745e-05 2024-09-13T05:12:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697396+0000", 2024-09-13T05:12:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4700000000000002e-06 2024-09-13T05:12:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697402+0000", 2024-09-13T05:12:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6239999999999999e-06 2024-09-13T05:12:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759605+0000", 2024-09-13T05:12:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062203062000000003 2024-09-13T05:12:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759652+0000", 2024-09-13T05:12:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7561000000000001e-05 2024-09-13T05:12:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759711+0000", 2024-09-13T05:12:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8743999999999999e-05 2024-09-13T05:12:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135334 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 36864~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.697455+0000", 2024-09-13T05:12:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8758871189999997, 2024-09-13T05:12:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062617093999999998, 2024-09-13T05:12:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135334 2024-09-13T05:12:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697455+0000", 2024-09-13T05:12:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697455+0000", 2024-09-13T05:12:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697406+0000", 2024-09-13T05:12:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999509 2024-09-13T05:12:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697460+0000", 2024-09-13T05:12:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3224999999999999e-05 2024-09-13T05:12:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697467+0000", 2024-09-13T05:12:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3950000000000003e-06 2024-09-13T05:12:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697473+0000", 2024-09-13T05:12:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4269999999999996e-06 2024-09-13T05:12:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759769+0000", 2024-09-13T05:12:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062295467 2024-09-13T05:12:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759904+0000", 2024-09-13T05:12:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134831 2024-09-13T05:12:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.760073+0000", 2024-09-13T05:12:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016886200000000001 2024-09-13T05:12:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.636 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:01.636 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.636 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135348 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 237568~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:01.636 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.701225+0000", 2024-09-13T05:12:01.636 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.872117094, 2024-09-13T05:12:01.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061582350000000001, 2024-09-13T05:12:01.636 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:01.636 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:01.636 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:01.636 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:01.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:01.637 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135348 2024-09-13T05:12:01.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.637 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:01.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:01.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701225+0000", 2024-09-13T05:12:01.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:01.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701225+0000", 2024-09-13T05:12:01.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:01.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701225+0000", 2024-09-13T05:12:01.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:01.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:01.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701228+0000", 2024-09-13T05:12:01.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8219999999999998e-06 2024-09-13T05:12:01.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:01.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701233+0000", 2024-09-13T05:12:01.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4140000000000002e-06 2024-09-13T05:12:01.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:01.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701239+0000", 2024-09-13T05:12:01.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7520000000000002e-06 2024-09-13T05:12:01.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:01.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.762690+0000", 2024-09-13T05:12:01.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061451257000000002 2024-09-13T05:12:01.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:01.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.762744+0000", 2024-09-13T05:12:01.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3884000000000001e-05 2024-09-13T05:12:01.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:01.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.762808+0000", 2024-09-13T05:12:01.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3830000000000004e-05 2024-09-13T05:12:01.641 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.641 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:01.641 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.641 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135349 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 251904~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:01.641 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.701244+0000", 2024-09-13T05:12:01.641 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8720986869999994, 2024-09-13T05:12:01.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061703169000000002, 2024-09-13T05:12:01.641 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:01.642 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:01.642 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:01.642 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:01.642 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:01.642 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135349 2024-09-13T05:12:01.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.642 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:01.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:01.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701244+0000", 2024-09-13T05:12:01.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:01.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701244+0000", 2024-09-13T05:12:01.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:01.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701243+0000", 2024-09-13T05:12:01.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:01.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:01.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701246+0000", 2024-09-13T05:12:01.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0240000000000002e-06 2024-09-13T05:12:01.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:01.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701253+0000", 2024-09-13T05:12:01.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4409999999999998e-06 2024-09-13T05:12:01.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:01.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701258+0000", 2024-09-13T05:12:01.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0880000000000002e-06 2024-09-13T05:12:01.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:01.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.762838+0000", 2024-09-13T05:12:01.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061580324999999998 2024-09-13T05:12:01.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:01.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.762885+0000", 2024-09-13T05:12:01.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6526000000000001e-05 2024-09-13T05:12:01.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:01.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.762947+0000", 2024-09-13T05:12:01.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2212999999999995e-05 2024-09-13T05:12:01.646 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.646 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:01.646 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.647 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135350 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 266240~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:01.647 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.701263+0000", 2024-09-13T05:12:01.647 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8720799170000006, 2024-09-13T05:12:01.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061884512000000003, 2024-09-13T05:12:01.647 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:01.647 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:01.647 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:01.647 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:01.647 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:01.647 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135350 2024-09-13T05:12:01.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.648 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:01.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:01.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701263+0000", 2024-09-13T05:12:01.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:01.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701263+0000", 2024-09-13T05:12:01.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:01.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701262+0000", 2024-09-13T05:12:01.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:01.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:01.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701265+0000", 2024-09-13T05:12:01.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5500000000000001e-06 2024-09-13T05:12:01.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:01.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701271+0000", 2024-09-13T05:12:01.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0120000000000002e-06 2024-09-13T05:12:01.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:01.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701276+0000", 2024-09-13T05:12:01.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1309999999999997e-06 2024-09-13T05:12:01.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:01.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.762996+0000", 2024-09-13T05:12:01.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061719860000000001 2024-09-13T05:12:01.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:01.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.763059+0000", 2024-09-13T05:12:01.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2983000000000003e-05 2024-09-13T05:12:01.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:01.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.763147+0000", 2024-09-13T05:12:01.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8300000000000005e-05 2024-09-13T05:12:01.652 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.652 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:01.652 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.652 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135351 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 280576~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:01.653 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.701280+0000", 2024-09-13T05:12:01.653 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8720621319999999, 2024-09-13T05:12:01.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062054665000000002, 2024-09-13T05:12:01.653 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:01.653 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:01.653 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:01.653 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:01.653 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:01.653 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135351 2024-09-13T05:12:01.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.654 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:01.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:01.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701280+0000", 2024-09-13T05:12:01.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701280+0000", 2024-09-13T05:12:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701280+0000", 2024-09-13T05:12:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701283+0000", 2024-09-13T05:12:01.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6010000000000002e-06 2024-09-13T05:12:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701290+0000", 2024-09-13T05:12:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8839999999999997e-06 2024-09-13T05:12:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701294+0000", 2024-09-13T05:12:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.826e-06 2024-09-13T05:12:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.763191+0000", 2024-09-13T05:12:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061896944000000002 2024-09-13T05:12:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.763271+0000", 2024-09-13T05:12:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0006999999999995e-05 2024-09-13T05:12:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.763335+0000", 2024-09-13T05:12:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3740999999999998e-05 2024-09-13T05:12:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.657 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135377 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 638976~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.705635+0000", 2024-09-13T05:12:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8677073709999998, 2024-09-13T05:12:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061486266999999997, 2024-09-13T05:12:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:01.658 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135377 2024-09-13T05:12:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705635+0000", 2024-09-13T05:12:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705635+0000", 2024-09-13T05:12:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705635+0000", 2024-09-13T05:12:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705639+0000", 2024-09-13T05:12:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9820000000000002e-06 2024-09-13T05:12:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705645+0000", 2024-09-13T05:12:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7399999999999998e-06 2024-09-13T05:12:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705650+0000", 2024-09-13T05:12:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.335e-06 2024-09-13T05:12:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.766994+0000", 2024-09-13T05:12:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061344309999999999 2024-09-13T05:12:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767055+0000", 2024-09-13T05:12:01.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1464000000000006e-05 2024-09-13T05:12:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767121+0000", 2024-09-13T05:12:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.601e-05 2024-09-13T05:12:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135378 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 653312~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.705653+0000", 2024-09-13T05:12:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8676892949999999, 2024-09-13T05:12:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061633412999999998, 2024-09-13T05:12:01.662 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135378 2024-09-13T05:12:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705653+0000", 2024-09-13T05:12:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:01.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705653+0000", 2024-09-13T05:12:01.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:01.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705653+0000", 2024-09-13T05:12:01.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:01.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:01.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705655+0000", 2024-09-13T05:12:01.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3889999999999999e-06 2024-09-13T05:12:01.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:01.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705660+0000", 2024-09-13T05:12:01.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3420000000000001e-06 2024-09-13T05:12:01.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:01.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705663+0000", 2024-09-13T05:12:01.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9809999999999997e-06 2024-09-13T05:12:01.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:01.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767152+0000", 2024-09-13T05:12:01.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061488084999999998 2024-09-13T05:12:01.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:01.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767217+0000", 2024-09-13T05:12:01.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5747000000000006e-05 2024-09-13T05:12:01.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:01.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767287+0000", 2024-09-13T05:12:01.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9330000000000002e-05 2024-09-13T05:12:01.666 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.666 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:01.667 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.667 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135379 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 667648~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:01.667 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.705667+0000", 2024-09-13T05:12:01.667 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8676755039999993, 2024-09-13T05:12:01.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061770584000000003, 2024-09-13T05:12:01.667 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:01.667 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:01.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:01.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:01.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:01.667 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135379 2024-09-13T05:12:01.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.668 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:01.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:01.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705667+0000", 2024-09-13T05:12:01.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:01.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705667+0000", 2024-09-13T05:12:01.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:01.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705667+0000", 2024-09-13T05:12:01.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:01.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:01.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705669+0000", 2024-09-13T05:12:01.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1040000000000001e-06 2024-09-13T05:12:01.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:01.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705673+0000", 2024-09-13T05:12:01.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3059999999999999e-06 2024-09-13T05:12:01.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:01.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705677+0000", 2024-09-13T05:12:01.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0459999999999999e-06 2024-09-13T05:12:01.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:01.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767316+0000", 2024-09-13T05:12:01.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061639237999999999 2024-09-13T05:12:01.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:01.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767370+0000", 2024-09-13T05:12:01.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3270000000000003e-05 2024-09-13T05:12:01.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:01.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767438+0000", 2024-09-13T05:12:01.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7951e-05 2024-09-13T05:12:01.671 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.671 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:01.671 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.671 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135380 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 681984~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:01.671 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.705681+0000", 2024-09-13T05:12:01.671 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8676620310000001, 2024-09-13T05:12:01.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061931205000000003, 2024-09-13T05:12:01.672 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:01.672 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:01.672 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:01.672 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:01.672 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:01.672 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135380 2024-09-13T05:12:01.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.672 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:01.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:01.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705681+0000", 2024-09-13T05:12:01.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:01.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705681+0000", 2024-09-13T05:12:01.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:01.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:01.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705680+0000", 2024-09-13T05:12:01.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:01.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:01.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705682+0000", 2024-09-13T05:12:01.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.204e-06 2024-09-13T05:12:01.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:01.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705688+0000", 2024-09-13T05:12:01.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3820000000000003e-06 2024-09-13T05:12:01.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:01.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705692+0000", 2024-09-13T05:12:01.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8139999999999998e-06 2024-09-13T05:12:01.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:01.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767468+0000", 2024-09-13T05:12:01.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061776223999999998 2024-09-13T05:12:01.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:01.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767532+0000", 2024-09-13T05:12:01.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4066000000000006e-05 2024-09-13T05:12:01.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:01.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:01.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:01.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767612+0000", 2024-09-13T05:12:01.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9843000000000001e-05 2024-09-13T05:12:01.676 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.676 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:01.676 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.676 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:01.676 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:01.676 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:01.678 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:12:01.678 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:01.676+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:01.778 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:01.776+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:01.793 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:01.793 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:01.794 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:01.794 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:01.803 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:12:01.879 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:01.876+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:01.906 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:01.907 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:01.907 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:01.907 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:01.907 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:01.916 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:12:01.980 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:01.976+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:02.020 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:02.021 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:02.021 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:02.021 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [] 2024-09-13T05:12:02.021 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:02.030 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:12:02.081 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:02.080+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:02.138 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:02.138 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:02.138 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:02.138 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:02.148 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:12:02.182 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:02.180+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:02.239 INFO:tasks.thrashosds.thrasher:in_osds: [2, 3, 5, 6, 7] out_osds: [4, 1, 0] dead_osds: [0] live_osds: [1, 2, 3, 4, 5, 6, 7] 2024-09-13T05:12:02.239 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:12:02.239 INFO:tasks.thrashosds.thrasher:Adding osd 1 2024-09-13T05:12:02.240 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 1 2024-09-13T05:12:02.253 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:02.254 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:02.254 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:02.254 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:02.254 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:02.263 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:12:02.285 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:02.284+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:02.382 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:02.382 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:02.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:02.382 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:02.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.382 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3.bb1d1096 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:02.382 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:02.383 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 38.435569278999999, 2024-09-13T05:12:02.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68834410099999999, 2024-09-13T05:12:02.383 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.383 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:02.383 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.383 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.383 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.383 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:12:02.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.383 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:02.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.384 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.384 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:02.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.384 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.384 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943719+0000", 2024-09-13T05:12:02.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:12:02.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943734+0000", 2024-09-13T05:12:02.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4793e-05 2024-09-13T05:12:02.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943765+0000", 2024-09-13T05:12:02.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0648999999999997e-05 2024-09-13T05:12:02.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943779+0000", 2024-09-13T05:12:02.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.447e-05 2024-09-13T05:12:02.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943872+0000", 2024-09-13T05:12:02.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3304e-05 2024-09-13T05:12:02.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:02.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943884+0000", 2024-09-13T05:12:02.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.167e-05 2024-09-13T05:12:02.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632042+0000", 2024-09-13T05:12:02.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68815832600000004 2024-09-13T05:12:02.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632066+0000", 2024-09-13T05:12:02.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3765999999999999e-05 2024-09-13T05:12:02.388 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.388 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.388 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.388 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3.b6bd6256 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:02.388 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:02.388 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 38.435444779000001, 2024-09-13T05:12:02.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68852592499999998, 2024-09-13T05:12:02.388 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.388 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:02.389 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.389 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.389 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.389 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:12:02.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.389 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:02.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:02.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943846+0000", 2024-09-13T05:12:02.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:02.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943852+0000", 2024-09-13T05:12:02.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3820000000000001e-06 2024-09-13T05:12:02.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.391 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.391 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943876+0000", 2024-09-13T05:12:02.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3995e-05 2024-09-13T05:12:02.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.391 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.391 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943898+0000", 2024-09-13T05:12:02.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1838999999999999e-05 2024-09-13T05:12:02.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.391 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.391 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946457+0000", 2024-09-13T05:12:02.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025588910000000002 2024-09-13T05:12:02.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.392 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.392 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:02.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946499+0000", 2024-09-13T05:12:02.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2814e-05 2024-09-13T05:12:02.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.392 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.392 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632364+0000", 2024-09-13T05:12:02.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68586484999999997 2024-09-13T05:12:02.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.393 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.393 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.393 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632372+0000", 2024-09-13T05:12:02.393 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1659999999999994e-06 2024-09-13T05:12:02.393 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.393 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.393 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.393 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.393 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.393 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3:6908b8dd:::rbd_data.112d8d1317eb.000000000000000f:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:02.393 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:02.393 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 38.398300700999997, 2024-09-13T05:12:02.393 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65181049499999999, 2024-09-13T05:12:02.393 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.394 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.394 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.394 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.394 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.394 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:12:02.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.394 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.394 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:02.394 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:02.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980989+0000", 2024-09-13T05:12:02.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:02.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980996+0000", 2024-09-13T05:12:02.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2200000000000003e-06 2024-09-13T05:12:02.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981011+0000", 2024-09-13T05:12:02.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4997000000000001e-05 2024-09-13T05:12:02.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981025+0000", 2024-09-13T05:12:02.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3604000000000001e-05 2024-09-13T05:12:02.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.397 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981110+0000", 2024-09-13T05:12:02.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4948000000000001e-05 2024-09-13T05:12:02.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.397 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:02.397 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981120+0000", 2024-09-13T05:12:02.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9399999999999997e-06 2024-09-13T05:12:02.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.397 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.398 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632425+0000", 2024-09-13T05:12:02.398 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65130460499999998 2024-09-13T05:12:02.398 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.398 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.398 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.398 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632587+0000", 2024-09-13T05:12:02.398 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016199500000000001 2024-09-13T05:12:02.398 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.398 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.398 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.398 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632801+0000", 2024-09-13T05:12:02.398 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021459499999999999 2024-09-13T05:12:02.398 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.399 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.399 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.399 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3:6a46bd6d:::rbd_data.112d8d1317eb.0000000000000010:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:02.399 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:02.399 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 38.398243045000001, 2024-09-13T05:12:02.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65213695699999996, 2024-09-13T05:12:02.399 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.399 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.399 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.399 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.399 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.400 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:12:02.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.400 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.400 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:02.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.400 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:02.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:02.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981052+0000", 2024-09-13T05:12:02.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4469999999999999e-06 2024-09-13T05:12:02.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981066+0000", 2024-09-13T05:12:02.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3658e-05 2024-09-13T05:12:02.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.402 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.402 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981073+0000", 2024-09-13T05:12:02.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:12:02.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.402 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.402 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981150+0000", 2024-09-13T05:12:02.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7783999999999999e-05 2024-09-13T05:12:02.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.402 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:02.403 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981161+0000", 2024-09-13T05:12:02.403 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0197000000000001e-05 2024-09-13T05:12:02.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.403 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.403 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632926+0000", 2024-09-13T05:12:02.403 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65176517300000003 2024-09-13T05:12:02.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.403 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.403 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633081+0000", 2024-09-13T05:12:02.403 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000155172 2024-09-13T05:12:02.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.404 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.404 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633185+0000", 2024-09-13T05:12:02.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000104329 2024-09-13T05:12:02.404 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.404 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.404 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.404 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118368 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 2806784~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:12:02.404 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.389513+0000", 2024-09-13T05:12:02.404 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.989777947, 2024-09-13T05:12:02.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059680972999999998, 2024-09-13T05:12:02.404 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.405 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.405 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.405 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.405 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.405 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118368 2024-09-13T05:12:02.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.405 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.405 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389513+0000", 2024-09-13T05:12:02.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389513+0000", 2024-09-13T05:12:02.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389513+0000", 2024-09-13T05:12:02.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.407 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.407 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389515+0000", 2024-09-13T05:12:02.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3949999999999999e-06 2024-09-13T05:12:02.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.407 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.407 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.407 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389523+0000", 2024-09-13T05:12:02.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2139999999999999e-06 2024-09-13T05:12:02.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.407 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.407 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.407 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389528+0000", 2024-09-13T05:12:02.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0209999999999999e-06 2024-09-13T05:12:02.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.408 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.408 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.408 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449026+0000", 2024-09-13T05:12:02.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059498589999999997 2024-09-13T05:12:02.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.408 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.408 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.408 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449108+0000", 2024-09-13T05:12:02.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1488000000000003e-05 2024-09-13T05:12:02.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.408 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.408 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449194+0000", 2024-09-13T05:12:02.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6645999999999997e-05 2024-09-13T05:12:02.409 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.409 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.409 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.409 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.409 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118369 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 2821120~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:12:02.409 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.389532+0000", 2024-09-13T05:12:02.409 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.989759477, 2024-09-13T05:12:02.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059952904000000001, 2024-09-13T05:12:02.409 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.410 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.410 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.410 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.410 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.410 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118369 2024-09-13T05:12:02.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.410 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.410 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.410 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389532+0000", 2024-09-13T05:12:02.410 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389532+0000", 2024-09-13T05:12:02.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389532+0000", 2024-09-13T05:12:02.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.412 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389534+0000", 2024-09-13T05:12:02.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.615e-06 2024-09-13T05:12:02.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.412 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389540+0000", 2024-09-13T05:12:02.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5969999999999999e-06 2024-09-13T05:12:02.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.412 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389544+0000", 2024-09-13T05:12:02.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5580000000000002e-06 2024-09-13T05:12:02.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449254+0000", 2024-09-13T05:12:02.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059709275999999999 2024-09-13T05:12:02.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449348+0000", 2024-09-13T05:12:02.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4812e-05 2024-09-13T05:12:02.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449485+0000", 2024-09-13T05:12:02.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000136382 2024-09-13T05:12:02.414 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.414 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.414 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.414 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118370 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 2835456~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:12:02.414 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.389549+0000", 2024-09-13T05:12:02.414 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.989742502, 2024-09-13T05:12:02.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060184400999999998, 2024-09-13T05:12:02.414 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.414 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.414 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.414 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.414 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.415 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118370 2024-09-13T05:12:02.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.415 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.415 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.415 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389549+0000", 2024-09-13T05:12:02.415 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.415 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.415 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389549+0000", 2024-09-13T05:12:02.415 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.416 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.416 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389548+0000", 2024-09-13T05:12:02.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.416 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.416 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389551+0000", 2024-09-13T05:12:02.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2479999999999999e-06 2024-09-13T05:12:02.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.416 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.416 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389557+0000", 2024-09-13T05:12:02.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6080000000000001e-06 2024-09-13T05:12:02.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.417 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.389562+0000", 2024-09-13T05:12:02.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8670000000000002e-06 2024-09-13T05:12:02.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.417 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449531+0000", 2024-09-13T05:12:02.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059968606000000001 2024-09-13T05:12:02.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449623+0000", 2024-09-13T05:12:02.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2464000000000001e-05 2024-09-13T05:12:02.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.449733+0000", 2024-09-13T05:12:02.419 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010996 2024-09-13T05:12:02.419 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.419 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.419 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.419 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118393 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 3107840~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:12:02.419 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393407+0000", 2024-09-13T05:12:02.419 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.985884220999999, 2024-09-13T05:12:02.419 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059784062999999998, 2024-09-13T05:12:02.419 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.419 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.419 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.420 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.420 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.420 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118393 2024-09-13T05:12:02.420 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.420 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.420 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.420 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.420 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393407+0000", 2024-09-13T05:12:02.420 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.420 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.420 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.420 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.420 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393407+0000", 2024-09-13T05:12:02.421 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.421 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.421 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.421 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393406+0000", 2024-09-13T05:12:02.421 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.421 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.421 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.421 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393409+0000", 2024-09-13T05:12:02.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6369999999999999e-06 2024-09-13T05:12:02.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.422 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.422 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393414+0000", 2024-09-13T05:12:02.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2129999999999999e-06 2024-09-13T05:12:02.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.422 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.422 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393419+0000", 2024-09-13T05:12:02.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7160000000000002e-06 2024-09-13T05:12:02.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.422 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453054+0000", 2024-09-13T05:12:02.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059634468000000003 2024-09-13T05:12:02.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453118+0000", 2024-09-13T05:12:02.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4271999999999997e-05 2024-09-13T05:12:02.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453191+0000", 2024-09-13T05:12:02.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3406999999999997e-05 2024-09-13T05:12:02.423 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.424 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.424 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.424 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.424 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.424 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118394 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 3122176~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:12:02.424 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393434+0000", 2024-09-13T05:12:02.424 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.985857438, 2024-09-13T05:12:02.424 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059854255000000002, 2024-09-13T05:12:02.424 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.424 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.424 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.424 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.424 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.425 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118394 2024-09-13T05:12:02.425 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.425 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.425 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.425 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.425 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393434+0000", 2024-09-13T05:12:02.425 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.425 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.425 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.425 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.425 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393434+0000", 2024-09-13T05:12:02.425 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.425 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393433+0000", 2024-09-13T05:12:02.426 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.426 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393436+0000", 2024-09-13T05:12:02.426 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5639999999999999e-06 2024-09-13T05:12:02.426 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393442+0000", 2024-09-13T05:12:02.426 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1920000000000002e-06 2024-09-13T05:12:02.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.427 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393448+0000", 2024-09-13T05:12:02.427 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2219999999999999e-06 2024-09-13T05:12:02.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.427 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453202+0000", 2024-09-13T05:12:02.427 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059753891000000003 2024-09-13T05:12:02.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.428 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453242+0000", 2024-09-13T05:12:02.428 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9410999999999999e-05 2024-09-13T05:12:02.428 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.428 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.428 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.428 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453288+0000", 2024-09-13T05:12:02.428 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6519e-05 2024-09-13T05:12:02.428 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.428 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.428 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.428 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.428 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.428 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118395 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 3136512~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:12:02.429 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393453+0000", 2024-09-13T05:12:02.429 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.98583867, 2024-09-13T05:12:02.429 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059998586, 2024-09-13T05:12:02.429 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.429 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.429 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.429 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.429 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.429 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118395 2024-09-13T05:12:02.429 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.429 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.429 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.429 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.430 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393453+0000", 2024-09-13T05:12:02.430 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.430 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.430 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.430 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.430 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393453+0000", 2024-09-13T05:12:02.430 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.430 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.430 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.430 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.430 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393452+0000", 2024-09-13T05:12:02.430 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.430 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.430 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.431 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.431 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393455+0000", 2024-09-13T05:12:02.431 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6740000000000001e-06 2024-09-13T05:12:02.431 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.431 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.431 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.431 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393460+0000", 2024-09-13T05:12:02.431 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5860000000000004e-06 2024-09-13T05:12:02.431 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.431 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.431 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.431 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393465+0000", 2024-09-13T05:12:02.431 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7140000000000001e-06 2024-09-13T05:12:02.432 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.432 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.432 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.432 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453320+0000", 2024-09-13T05:12:02.432 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059854737999999998 2024-09-13T05:12:02.432 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.432 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.432 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.432 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453382+0000", 2024-09-13T05:12:02.432 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2147e-05 2024-09-13T05:12:02.432 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.432 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.432 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.433 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453451+0000", 2024-09-13T05:12:02.433 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9226000000000004e-05 2024-09-13T05:12:02.433 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.433 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.433 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.433 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.433 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.433 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118433 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 12288~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:12:02.433 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393469+0000", 2024-09-13T05:12:02.433 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.985822057, 2024-09-13T05:12:02.433 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060123661000000002, 2024-09-13T05:12:02.433 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.433 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.434 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.434 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.434 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.434 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118433 2024-09-13T05:12:02.434 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.434 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.434 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.434 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.434 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393469+0000", 2024-09-13T05:12:02.434 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.434 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.434 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.434 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.435 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393469+0000", 2024-09-13T05:12:02.435 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.435 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.435 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.435 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.435 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393469+0000", 2024-09-13T05:12:02.435 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.435 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.435 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.435 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.435 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393471+0000", 2024-09-13T05:12:02.435 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3350000000000001e-06 2024-09-13T05:12:02.435 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.435 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.436 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.436 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393477+0000", 2024-09-13T05:12:02.436 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3639999999999998e-06 2024-09-13T05:12:02.436 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.436 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.436 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.436 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393481+0000", 2024-09-13T05:12:02.436 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6020000000000002e-06 2024-09-13T05:12:02.436 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.436 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.436 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.436 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453477+0000", 2024-09-13T05:12:02.436 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059995615000000002 2024-09-13T05:12:02.437 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.437 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.437 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.437 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453522+0000", 2024-09-13T05:12:02.437 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5139999999999998e-05 2024-09-13T05:12:02.437 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.437 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.437 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.437 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453593+0000", 2024-09-13T05:12:02.437 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0963000000000005e-05 2024-09-13T05:12:02.437 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.437 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.437 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.438 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.438 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.438 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118434 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 26624~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:12:02.438 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393485+0000", 2024-09-13T05:12:02.438 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.985805914, 2024-09-13T05:12:02.438 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060351620000000002, 2024-09-13T05:12:02.438 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.438 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.438 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.438 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.438 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.438 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118434 2024-09-13T05:12:02.438 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.438 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.439 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.439 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.439 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393485+0000", 2024-09-13T05:12:02.439 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.439 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.439 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.439 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.439 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393485+0000", 2024-09-13T05:12:02.439 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.439 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.439 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.439 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.439 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393485+0000", 2024-09-13T05:12:02.440 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.440 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.440 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.440 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.440 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393488+0000", 2024-09-13T05:12:02.440 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8090000000000001e-06 2024-09-13T05:12:02.440 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.440 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.440 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.440 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393494+0000", 2024-09-13T05:12:02.440 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7780000000000004e-06 2024-09-13T05:12:02.440 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.440 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.441 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.441 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393498+0000", 2024-09-13T05:12:02.441 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.668e-06 2024-09-13T05:12:02.441 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.441 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.441 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.441 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453628+0000", 2024-09-13T05:12:02.441 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060129969999999998 2024-09-13T05:12:02.441 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.441 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.441 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.441 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453733+0000", 2024-09-13T05:12:02.441 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000105157 2024-09-13T05:12:02.442 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.442 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.442 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.442 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453837+0000", 2024-09-13T05:12:02.442 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000103596 2024-09-13T05:12:02.442 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.442 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.442 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.442 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.442 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.442 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118435 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 40960~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:12:02.442 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393503+0000", 2024-09-13T05:12:02.442 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.985788527, 2024-09-13T05:12:02.442 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060548137000000002, 2024-09-13T05:12:02.443 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.443 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.443 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.443 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.443 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.443 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118435 2024-09-13T05:12:02.443 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.443 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.443 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.443 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.443 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393503+0000", 2024-09-13T05:12:02.443 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.443 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.443 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.444 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393503+0000", 2024-09-13T05:12:02.444 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.444 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.444 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393502+0000", 2024-09-13T05:12:02.444 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.444 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.444 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393505+0000", 2024-09-13T05:12:02.444 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4279999999999999e-06 2024-09-13T05:12:02.445 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.445 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.445 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.445 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393510+0000", 2024-09-13T05:12:02.445 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.04e-06 2024-09-13T05:12:02.445 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.445 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.445 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.445 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393515+0000", 2024-09-13T05:12:02.445 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6809999999999997e-06 2024-09-13T05:12:02.445 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.445 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.445 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.445 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453862+0000", 2024-09-13T05:12:02.446 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060347849000000002 2024-09-13T05:12:02.446 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.446 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.446 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.446 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.453951+0000", 2024-09-13T05:12:02.446 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8121999999999994e-05 2024-09-13T05:12:02.446 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.446 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.446 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.446 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.454051+0000", 2024-09-13T05:12:02.446 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010035399999999999 2024-09-13T05:12:02.446 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.446 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.447 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.447 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.447 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.447 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118436 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 55296~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:12:02.447 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393520+0000", 2024-09-13T05:12:02.447 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.985771082999999, 2024-09-13T05:12:02.447 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060673151000000002, 2024-09-13T05:12:02.447 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.447 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.447 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.447 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.447 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.447 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118436 2024-09-13T05:12:02.447 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.448 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.448 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.448 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.448 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393520+0000", 2024-09-13T05:12:02.448 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.448 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.448 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.448 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.448 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393520+0000", 2024-09-13T05:12:02.448 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.448 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.448 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.448 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.449 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393520+0000", 2024-09-13T05:12:02.449 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.449 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.449 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.449 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.449 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393523+0000", 2024-09-13T05:12:02.449 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6220000000000001e-06 2024-09-13T05:12:02.449 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.449 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.449 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.449 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393528+0000", 2024-09-13T05:12:02.449 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5339999999999999e-06 2024-09-13T05:12:02.449 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.450 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.450 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.450 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393533+0000", 2024-09-13T05:12:02.450 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8060000000000002e-06 2024-09-13T05:12:02.450 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.450 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.450 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.450 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.454087+0000", 2024-09-13T05:12:02.450 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060554502000000003 2024-09-13T05:12:02.450 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.450 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.450 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.450 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.454138+0000", 2024-09-13T05:12:02.451 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0398000000000001e-05 2024-09-13T05:12:02.451 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.451 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.451 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.451 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.454193+0000", 2024-09-13T05:12:02.451 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5661000000000001e-05 2024-09-13T05:12:02.451 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.451 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.451 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.451 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.451 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.451 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118437 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 69632~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:12:02.451 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.393561+0000", 2024-09-13T05:12:02.451 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.985730638, 2024-09-13T05:12:02.452 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060852235999999997, 2024-09-13T05:12:02.452 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.452 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.452 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.452 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.452 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.452 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118437 2024-09-13T05:12:02.452 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.452 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.452 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.452 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.453 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393561+0000", 2024-09-13T05:12:02.453 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.453 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.453 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.453 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.453 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393561+0000", 2024-09-13T05:12:02.453 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.453 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.453 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.453 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.453 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393560+0000", 2024-09-13T05:12:02.453 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.453 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.454 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.454 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.454 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393573+0000", 2024-09-13T05:12:02.454 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2893e-05 2024-09-13T05:12:02.454 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.454 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.454 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.454 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393588+0000", 2024-09-13T05:12:02.454 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4810000000000001e-05 2024-09-13T05:12:02.454 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.454 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.454 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.454 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.393593+0000", 2024-09-13T05:12:02.454 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4829999999999999e-06 2024-09-13T05:12:02.454 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.455 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.455 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.455 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.454229+0000", 2024-09-13T05:12:02.455 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060635823999999998 2024-09-13T05:12:02.455 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.455 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.455 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.455 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.454316+0000", 2024-09-13T05:12:02.455 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6328000000000004e-05 2024-09-13T05:12:02.455 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.455 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.455 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.455 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.454413+0000", 2024-09-13T05:12:02.456 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7428000000000003e-05 2024-09-13T05:12:02.456 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.456 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.456 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.456 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.456 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.456 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118457 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 356352~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:12:02.456 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.397421+0000", 2024-09-13T05:12:02.456 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.981870362, 2024-09-13T05:12:02.456 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059721492000000001, 2024-09-13T05:12:02.456 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.456 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.456 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.457 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.457 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.457 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118457 2024-09-13T05:12:02.457 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.457 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.457 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.457 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.457 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397421+0000", 2024-09-13T05:12:02.457 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.457 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.457 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.457 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.457 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397421+0000", 2024-09-13T05:12:02.458 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.458 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.458 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.458 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.458 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397421+0000", 2024-09-13T05:12:02.458 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.458 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.458 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.458 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.458 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397423+0000", 2024-09-13T05:12:02.458 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3360000000000002e-06 2024-09-13T05:12:02.458 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.458 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.459 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.459 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397428+0000", 2024-09-13T05:12:02.459 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1019999999999996e-06 2024-09-13T05:12:02.459 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.459 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.459 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.459 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397433+0000", 2024-09-13T05:12:02.459 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5369999999999999e-06 2024-09-13T05:12:02.459 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.459 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.459 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.459 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457050+0000", 2024-09-13T05:12:02.459 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059617268000000001 2024-09-13T05:12:02.459 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.460 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.460 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.460 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457088+0000", 2024-09-13T05:12:02.460 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8586e-05 2024-09-13T05:12:02.460 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.460 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.460 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.460 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457142+0000", 2024-09-13T05:12:02.460 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4101000000000003e-05 2024-09-13T05:12:02.460 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.460 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.460 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.460 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.461 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.461 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118458 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 370688~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:12:02.461 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.397453+0000", 2024-09-13T05:12:02.461 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.981838367, 2024-09-13T05:12:02.461 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059799484, 2024-09-13T05:12:02.461 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.461 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.461 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.461 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.461 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.461 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118458 2024-09-13T05:12:02.461 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.461 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.461 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.462 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.462 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397453+0000", 2024-09-13T05:12:02.462 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.462 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.462 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.462 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.462 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397453+0000", 2024-09-13T05:12:02.462 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.462 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.462 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.462 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.462 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397452+0000", 2024-09-13T05:12:02.462 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.463 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.463 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.463 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.463 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397456+0000", 2024-09-13T05:12:02.463 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:12:02.463 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.463 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.463 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.463 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397461+0000", 2024-09-13T05:12:02.463 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9000000000000003e-06 2024-09-13T05:12:02.463 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.463 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.463 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.463 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397466+0000", 2024-09-13T05:12:02.464 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6659999999999999e-06 2024-09-13T05:12:02.464 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.464 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.464 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.464 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457167+0000", 2024-09-13T05:12:02.464 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059700955 2024-09-13T05:12:02.464 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.464 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.464 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.464 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457209+0000", 2024-09-13T05:12:02.464 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1758000000000002e-05 2024-09-13T05:12:02.464 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.464 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.464 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.465 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457252+0000", 2024-09-13T05:12:02.465 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3661000000000001e-05 2024-09-13T05:12:02.465 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.465 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.465 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.465 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.465 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.465 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118459 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 385024~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:12:02.465 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.397470+0000", 2024-09-13T05:12:02.465 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.981821197, 2024-09-13T05:12:02.465 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059892342000000001, 2024-09-13T05:12:02.465 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.465 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.466 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.466 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.466 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.466 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118459 2024-09-13T05:12:02.466 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.466 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.466 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.466 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.466 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397470+0000", 2024-09-13T05:12:02.466 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.466 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.466 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.466 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.466 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397470+0000", 2024-09-13T05:12:02.467 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.467 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.467 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.467 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.467 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397470+0000", 2024-09-13T05:12:02.467 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.467 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.467 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.467 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.467 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397472+0000", 2024-09-13T05:12:02.467 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4839999999999998e-06 2024-09-13T05:12:02.467 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.467 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.467 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.468 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397477+0000", 2024-09-13T05:12:02.468 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0819999999999998e-06 2024-09-13T05:12:02.468 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.468 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.468 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.468 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397482+0000", 2024-09-13T05:12:02.468 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5090000000000004e-06 2024-09-13T05:12:02.468 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.468 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.468 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.468 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457277+0000", 2024-09-13T05:12:02.468 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059795607000000001 2024-09-13T05:12:02.468 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.469 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.469 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.469 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457316+0000", 2024-09-13T05:12:02.469 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9004999999999997e-05 2024-09-13T05:12:02.469 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.469 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.469 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.469 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457362+0000", 2024-09-13T05:12:02.469 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6149000000000001e-05 2024-09-13T05:12:02.469 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.469 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.469 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.470 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.470 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.470 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118460 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 399360~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:12:02.470 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.397486+0000", 2024-09-13T05:12:02.470 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.981805789999999, 2024-09-13T05:12:02.470 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059990031999999999, 2024-09-13T05:12:02.470 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.470 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.470 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.470 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.470 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.470 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118460 2024-09-13T05:12:02.470 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.471 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.471 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.471 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.471 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397486+0000", 2024-09-13T05:12:02.471 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.471 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.471 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.471 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.471 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397486+0000", 2024-09-13T05:12:02.471 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.471 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.471 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.471 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.471 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397485+0000", 2024-09-13T05:12:02.472 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.472 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.472 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.472 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.472 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397488+0000", 2024-09-13T05:12:02.472 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:12:02.472 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.472 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.472 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.472 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397493+0000", 2024-09-13T05:12:02.472 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0919999999999997e-06 2024-09-13T05:12:02.472 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.472 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.473 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.473 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397497+0000", 2024-09-13T05:12:02.473 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4100000000000001e-06 2024-09-13T05:12:02.473 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.473 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.473 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.473 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457390+0000", 2024-09-13T05:12:02.473 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059892327000000002 2024-09-13T05:12:02.473 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.473 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.473 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.473 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457430+0000", 2024-09-13T05:12:02.473 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0590999999999998e-05 2024-09-13T05:12:02.474 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.474 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.474 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.474 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457476+0000", 2024-09-13T05:12:02.474 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5342000000000001e-05 2024-09-13T05:12:02.474 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.474 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.474 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.474 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.474 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.474 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:118461 3.16 3:6d488356:::rbd_data.112d52e08ead.0000000000000008:27 [read 413696~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e104)", 2024-09-13T05:12:02.474 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:48.397501+0000", 2024-09-13T05:12:02.474 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.981790159999999, 2024-09-13T05:12:02.475 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060091361000000003, 2024-09-13T05:12:02.475 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.475 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.475 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.475 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.475 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.475 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 118461 2024-09-13T05:12:02.475 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.475 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.475 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.475 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.475 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397501+0000", 2024-09-13T05:12:02.475 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.475 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.476 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.476 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.476 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397501+0000", 2024-09-13T05:12:02.476 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.476 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.476 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.476 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.476 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397501+0000", 2024-09-13T05:12:02.476 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.476 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.476 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.476 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.476 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397507+0000", 2024-09-13T05:12:02.477 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3940000000000001e-06 2024-09-13T05:12:02.477 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.477 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.477 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.477 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397512+0000", 2024-09-13T05:12:02.477 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2780000000000001e-06 2024-09-13T05:12:02.477 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.477 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.477 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.477 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.397517+0000", 2024-09-13T05:12:02.477 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7219999999999999e-06 2024-09-13T05:12:02.477 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.477 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.477 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.478 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457502+0000", 2024-09-13T05:12:02.478 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.059985199000000003 2024-09-13T05:12:02.478 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.478 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.478 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.478 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457545+0000", 2024-09-13T05:12:02.478 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2398000000000003e-05 2024-09-13T05:12:02.478 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.478 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.478 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.478 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:48.457593+0000", 2024-09-13T05:12:02.478 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7768000000000001e-05 2024-09-13T05:12:02.478 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.478 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.479 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.479 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.479 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.479 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:02.480 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:12:02.481 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:02.477+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:02.539 INFO:tasks.ceph.mon.a.smithi120.stderr:2024-09-13T05:12:02.536+0000 7fa8b7b30700 -1 mon.a@0(leader).osd e112 definitely_dead 0 2024-09-13T05:12:02.581 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:02.573+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:02.598 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:02.598 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:02.598 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:02.598 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:02.609 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:12:02.651 INFO:teuthology.orchestra.run.smithi120.stdout:5133 read 0x5dce9d4 thru 0x5dd055c (0x1b89 bytes) 2024-09-13T05:12:02.659 INFO:teuthology.orchestra.run.smithi120.stdout:5134 punch from 0x2d9dad1 to 0x2da0d99, (0x32c8 bytes) 2024-09-13T05:12:02.682 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:02.677+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:02.760 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:02.760 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:02.760 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:02.760 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:02.760 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:02.769 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:12:02.785 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:02.780+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:02.876 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:02.876 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:02.876 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:02.876 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:02.876 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.876 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29020 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2855936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:02.877 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:12:02.877 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 85.830795445999996, 2024-09-13T05:12:02.877 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060733743, 2024-09-13T05:12:02.877 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.877 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.877 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.877 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.877 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.877 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29020 2024-09-13T05:12:02.877 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.877 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.877 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.877 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.878 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:12:02.878 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.878 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.878 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.878 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:12:02.878 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.878 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.878 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.878 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041741+0000", 2024-09-13T05:12:02.878 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.878 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.879 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041749+0000", 2024-09-13T05:12:02.879 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6059999999999997e-06 2024-09-13T05:12:02.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.879 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041754+0000", 2024-09-13T05:12:02.879 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6740000000000002e-06 2024-09-13T05:12:02.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.879 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041760+0000", 2024-09-13T05:12:02.879 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0459999999999996e-06 2024-09-13T05:12:02.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.880 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.880 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.880 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102289+0000", 2024-09-13T05:12:02.880 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060529145999999999 2024-09-13T05:12:02.880 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.880 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.880 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.880 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102378+0000", 2024-09-13T05:12:02.880 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8901999999999997e-05 2024-09-13T05:12:02.880 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.880 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.881 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.881 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102476+0000", 2024-09-13T05:12:02.881 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7991000000000004e-05 2024-09-13T05:12:02.881 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.881 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.881 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.881 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.881 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.881 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29021 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2865152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:02.881 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:12:02.881 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 85.830773450999999, 2024-09-13T05:12:02.881 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060927993999999999, 2024-09-13T05:12:02.881 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.882 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.882 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.882 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.882 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.882 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29021 2024-09-13T05:12:02.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.882 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.882 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.882 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:12:02.882 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.882 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.883 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:12:02.883 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.883 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.883 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.883 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.883 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041763+0000", 2024-09-13T05:12:02.883 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.883 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.883 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.883 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.883 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041766+0000", 2024-09-13T05:12:02.883 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6800000000000002e-06 2024-09-13T05:12:02.883 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.884 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.884 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.884 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041771+0000", 2024-09-13T05:12:02.884 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:12:02.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.884 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.884 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.884 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041776+0000", 2024-09-13T05:12:02.884 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8489999999999997e-06 2024-09-13T05:12:02.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.884 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.884 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.884 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102513+0000", 2024-09-13T05:12:02.884 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060737102000000001 2024-09-13T05:12:02.885 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.885 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102597+0000", 2024-09-13T05:12:02.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4374000000000002e-05 2024-09-13T05:12:02.885 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.885 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102692+0000", 2024-09-13T05:12:02.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4436000000000002e-05 2024-09-13T05:12:02.885 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.885 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.885 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.886 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.886 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.886 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29022 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2874368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:02.886 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:02.886 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 85.830757151, 2024-09-13T05:12:02.886 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061135083999999999, 2024-09-13T05:12:02.886 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.886 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.886 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.886 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.886 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.886 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29022 2024-09-13T05:12:02.886 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.886 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.887 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.887 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.887 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:02.887 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.887 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.887 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.887 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.887 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:02.887 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.887 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.887 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.887 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.887 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:02.887 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.888 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.888 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.888 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.888 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041782+0000", 2024-09-13T05:12:02.888 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4959999999999999e-06 2024-09-13T05:12:02.888 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.888 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.888 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.888 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041787+0000", 2024-09-13T05:12:02.888 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1240000000000004e-06 2024-09-13T05:12:02.888 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.888 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.888 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.889 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041792+0000", 2024-09-13T05:12:02.889 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9200000000000003e-06 2024-09-13T05:12:02.889 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.889 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.889 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.889 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102738+0000", 2024-09-13T05:12:02.889 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060945581999999998 2024-09-13T05:12:02.889 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.889 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.889 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.889 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102821+0000", 2024-09-13T05:12:02.889 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2898999999999994e-05 2024-09-13T05:12:02.889 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.889 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.890 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.890 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102915+0000", 2024-09-13T05:12:02.890 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4523000000000003e-05 2024-09-13T05:12:02.890 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.890 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.890 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.890 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.890 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.890 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29067 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2764800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:02.890 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:02.890 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 85.826982934, 2024-09-13T05:12:02.890 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060816621000000001, 2024-09-13T05:12:02.890 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.891 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.891 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.891 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.891 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.891 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29067 2024-09-13T05:12:02.891 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.891 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.891 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.891 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.891 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:02.891 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.891 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.891 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.891 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.892 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:02.892 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.892 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.892 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:02.892 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.892 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.892 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045557+0000", 2024-09-13T05:12:02.892 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.898e-06 2024-09-13T05:12:02.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.893 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.893 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.893 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045575+0000", 2024-09-13T05:12:02.893 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8252000000000001e-05 2024-09-13T05:12:02.893 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.893 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.893 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.893 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045581+0000", 2024-09-13T05:12:02.893 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:12:02.893 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.893 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.893 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.893 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106183+0000", 2024-09-13T05:12:02.893 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060602630999999997 2024-09-13T05:12:02.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.894 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.894 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.894 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106271+0000", 2024-09-13T05:12:02.894 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7329000000000004e-05 2024-09-13T05:12:02.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.894 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.894 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.894 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106371+0000", 2024-09-13T05:12:02.894 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000100164 2024-09-13T05:12:02.894 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.894 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.894 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.895 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29068 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2774016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:02.895 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:12:02.895 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 85.826951699999995, 2024-09-13T05:12:02.895 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060994509000000002, 2024-09-13T05:12:02.895 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.895 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.895 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.895 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.895 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.895 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29068 2024-09-13T05:12:02.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.895 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.896 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.896 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:12:02.896 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.896 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.896 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.896 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.896 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:12:02.896 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.896 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.896 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.896 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.896 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045585+0000", 2024-09-13T05:12:02.896 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.897 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.897 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.897 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.897 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045588+0000", 2024-09-13T05:12:02.897 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:12:02.897 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.897 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.897 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.897 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045594+0000", 2024-09-13T05:12:02.897 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9329999999999998e-06 2024-09-13T05:12:02.897 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.897 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.897 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.897 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045599+0000", 2024-09-13T05:12:02.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3190000000000002e-06 2024-09-13T05:12:02.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.898 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.898 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106399+0000", 2024-09-13T05:12:02.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060800361999999997 2024-09-13T05:12:02.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.898 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.898 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106489+0000", 2024-09-13T05:12:02.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9301000000000004e-05 2024-09-13T05:12:02.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.898 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.899 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106580+0000", 2024-09-13T05:12:02.899 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1314e-05 2024-09-13T05:12:02.899 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.899 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.899 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.899 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.899 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29069 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2792448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:02.899 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:12:02.899 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 85.826933283000002, 2024-09-13T05:12:02.899 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061207599000000001, 2024-09-13T05:12:02.899 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.899 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.899 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.900 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.900 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.900 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29069 2024-09-13T05:12:02.900 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.900 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.900 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.900 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.900 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:12:02.900 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.900 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.900 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.900 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.900 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:12:02.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045603+0000", 2024-09-13T05:12:02.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045606+0000", 2024-09-13T05:12:02.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7300000000000001e-06 2024-09-13T05:12:02.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045612+0000", 2024-09-13T05:12:02.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9599999999999997e-06 2024-09-13T05:12:02.902 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045619+0000", 2024-09-13T05:12:02.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6019999999999996e-06 2024-09-13T05:12:02.902 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106619+0000", 2024-09-13T05:12:02.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061000029999999997 2024-09-13T05:12:02.902 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.903 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106713+0000", 2024-09-13T05:12:02.903 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4505000000000004e-05 2024-09-13T05:12:02.903 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.903 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.903 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.903 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106812+0000", 2024-09-13T05:12:02.903 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8264000000000007e-05 2024-09-13T05:12:02.903 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.903 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.903 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.903 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.903 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.903 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29070 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2783232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:02.903 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:02.904 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 85.826912824000004, 2024-09-13T05:12:02.904 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061389805999999998, 2024-09-13T05:12:02.904 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.904 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.904 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.904 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.904 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.904 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29070 2024-09-13T05:12:02.904 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.904 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.904 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.904 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.904 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:02.905 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.905 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.905 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.905 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.905 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:02.905 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.905 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.905 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.905 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.905 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:02.905 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.905 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.905 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.906 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.906 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045627+0000", 2024-09-13T05:12:02.906 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6579999999999998e-06 2024-09-13T05:12:02.906 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.906 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.906 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.906 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045632+0000", 2024-09-13T05:12:02.906 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8449999999999999e-06 2024-09-13T05:12:02.906 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.906 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.906 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.906 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045639+0000", 2024-09-13T05:12:02.906 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:12:02.906 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.907 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.907 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.907 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106837+0000", 2024-09-13T05:12:02.907 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061198529000000002 2024-09-13T05:12:02.907 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.907 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.907 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.907 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106922+0000", 2024-09-13T05:12:02.907 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4771999999999994e-05 2024-09-13T05:12:02.907 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.907 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.907 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.907 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107014+0000", 2024-09-13T05:12:02.907 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2009000000000006e-05 2024-09-13T05:12:02.908 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.908 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.908 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.908 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.908 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.908 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29071 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2801664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:02.908 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:12:02.908 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 85.826893748000003, 2024-09-13T05:12:02.908 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061582804999999997, 2024-09-13T05:12:02.908 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.908 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.908 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.908 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.908 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.909 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29071 2024-09-13T05:12:02.909 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.909 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.909 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.909 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.909 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:12:02.909 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.909 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.909 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.909 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.909 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:12:02.909 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.909 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.910 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.910 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.910 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045643+0000", 2024-09-13T05:12:02.910 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.910 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.910 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.910 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.910 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045646+0000", 2024-09-13T05:12:02.910 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:12:02.910 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.910 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.910 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.910 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045664+0000", 2024-09-13T05:12:02.910 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8408000000000001e-05 2024-09-13T05:12:02.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.911 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.911 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045670+0000", 2024-09-13T05:12:02.911 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7710000000000003e-06 2024-09-13T05:12:02.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.911 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.911 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107048+0000", 2024-09-13T05:12:02.911 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061378438 2024-09-13T05:12:02.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.911 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.912 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107134+0000", 2024-09-13T05:12:02.912 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5574000000000004e-05 2024-09-13T05:12:02.912 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.912 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.912 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.912 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107226+0000", 2024-09-13T05:12:02.912 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2262000000000005e-05 2024-09-13T05:12:02.912 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.912 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.912 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.912 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.912 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.912 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29072 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2810880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:02.913 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:12:02.913 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 85.826862363999993, 2024-09-13T05:12:02.913 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061762233999999999, 2024-09-13T05:12:02.913 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.913 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.913 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.913 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.913 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.913 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29072 2024-09-13T05:12:02.913 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.913 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.913 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.913 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.913 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:12:02.914 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.914 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.914 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.914 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.914 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:12:02.914 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.914 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.914 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.914 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.914 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045674+0000", 2024-09-13T05:12:02.914 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.914 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.914 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.914 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.915 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045677+0000", 2024-09-13T05:12:02.915 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9679999999999998e-06 2024-09-13T05:12:02.915 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.915 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.915 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.915 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045694+0000", 2024-09-13T05:12:02.915 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6801999999999999e-05 2024-09-13T05:12:02.915 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.915 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.915 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.915 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045700+0000", 2024-09-13T05:12:02.915 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8270000000000003e-06 2024-09-13T05:12:02.915 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.916 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.916 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.916 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107249+0000", 2024-09-13T05:12:02.916 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061549114000000002 2024-09-13T05:12:02.916 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.916 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.916 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.916 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107341+0000", 2024-09-13T05:12:02.916 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2390000000000001e-05 2024-09-13T05:12:02.916 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.916 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.916 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.916 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107437+0000", 2024-09-13T05:12:02.916 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5648000000000003e-05 2024-09-13T05:12:02.917 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.917 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.917 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.917 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.917 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.917 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29073 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2820096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:02.917 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:12:02.917 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 85.826820385999994, 2024-09-13T05:12:02.917 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061873910999999997, 2024-09-13T05:12:02.917 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.917 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.917 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.917 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.918 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.918 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29073 2024-09-13T05:12:02.918 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.918 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.918 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.918 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.918 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:12:02.918 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.918 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.918 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.918 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.918 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:12:02.918 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.918 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.919 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.919 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.919 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045716+0000", 2024-09-13T05:12:02.919 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.919 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.919 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.919 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045726+0000", 2024-09-13T05:12:02.919 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6350000000000001e-06 2024-09-13T05:12:02.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.919 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.919 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.919 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045739+0000", 2024-09-13T05:12:02.920 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3325e-05 2024-09-13T05:12:02.920 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.920 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.920 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.920 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045746+0000", 2024-09-13T05:12:02.920 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7399999999999998e-06 2024-09-13T05:12:02.920 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.920 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.920 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.920 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107457+0000", 2024-09-13T05:12:02.920 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061711038000000003 2024-09-13T05:12:02.920 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.920 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.920 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.921 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107522+0000", 2024-09-13T05:12:02.921 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4850000000000004e-05 2024-09-13T05:12:02.921 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.921 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.921 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.921 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107591+0000", 2024-09-13T05:12:02.921 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9029999999999995e-05 2024-09-13T05:12:02.921 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.921 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.921 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.921 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.921 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.921 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29074 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2829312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:02.922 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:12:02.922 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 85.826786478000002, 2024-09-13T05:12:02.922 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062055459, 2024-09-13T05:12:02.922 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.922 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.922 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.922 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.922 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.922 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29074 2024-09-13T05:12:02.922 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.922 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.922 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.922 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.922 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:12:02.923 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.923 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.923 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.923 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.923 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:12:02.923 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.923 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.923 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.923 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.923 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045750+0000", 2024-09-13T05:12:02.923 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.923 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.923 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.923 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.924 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045753+0000", 2024-09-13T05:12:02.924 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8399999999999999e-06 2024-09-13T05:12:02.924 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.924 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.924 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.924 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045759+0000", 2024-09-13T05:12:02.924 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8900000000000004e-06 2024-09-13T05:12:02.924 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.924 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.924 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.924 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045764+0000", 2024-09-13T05:12:02.924 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3850000000000001e-06 2024-09-13T05:12:02.924 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.925 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.925 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.925 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107623+0000", 2024-09-13T05:12:02.925 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061858817000000003 2024-09-13T05:12:02.925 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.925 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.925 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.925 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107710+0000", 2024-09-13T05:12:02.925 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7127999999999997e-05 2024-09-13T05:12:02.925 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.925 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.925 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.925 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107806+0000", 2024-09-13T05:12:02.926 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5886999999999999e-05 2024-09-13T05:12:02.926 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.926 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.926 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.926 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.926 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.926 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29075 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2838528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:02.926 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:02.926 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 85.826768024000003, 2024-09-13T05:12:02.926 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062188516999999999, 2024-09-13T05:12:02.926 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.926 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.926 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.926 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.927 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.927 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29075 2024-09-13T05:12:02.927 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.927 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.927 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.927 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.927 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:02.927 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.927 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.927 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.927 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.927 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:02.927 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.927 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.928 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.928 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.928 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:02.928 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.928 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.928 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.928 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.928 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045772+0000", 2024-09-13T05:12:02.928 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:12:02.928 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.928 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.928 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.928 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045778+0000", 2024-09-13T05:12:02.928 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9229999999999996e-06 2024-09-13T05:12:02.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.929 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.929 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.929 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045784+0000", 2024-09-13T05:12:02.929 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3800000000000002e-06 2024-09-13T05:12:02.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.929 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.929 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.929 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107823+0000", 2024-09-13T05:12:02.929 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062039331000000003 2024-09-13T05:12:02.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.929 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.929 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.930 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107886+0000", 2024-09-13T05:12:02.930 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2476000000000003e-05 2024-09-13T05:12:02.930 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.930 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.930 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.930 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107958+0000", 2024-09-13T05:12:02.930 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2089999999999996e-05 2024-09-13T05:12:02.930 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.930 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.930 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.930 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.930 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.930 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29115 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2682880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:02.930 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:12:02.931 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 85.823302497, 2024-09-13T05:12:02.931 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060847898999999997, 2024-09-13T05:12:02.931 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.931 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.931 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.931 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.931 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.931 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29115 2024-09-13T05:12:02.931 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.931 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.931 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.931 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.931 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:12:02.932 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.932 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.932 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.932 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.932 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:12:02.932 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.932 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.932 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.932 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.932 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049234+0000", 2024-09-13T05:12:02.932 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.932 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.932 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.932 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.933 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049237+0000", 2024-09-13T05:12:02.933 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9069999999999999e-06 2024-09-13T05:12:02.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.933 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.933 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.933 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049243+0000", 2024-09-13T05:12:02.933 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7459999999999997e-06 2024-09-13T05:12:02.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.933 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.933 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.933 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049248+0000", 2024-09-13T05:12:02.933 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1490000000000002e-06 2024-09-13T05:12:02.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.934 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.934 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.109945+0000", 2024-09-13T05:12:02.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060697299000000003 2024-09-13T05:12:02.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.934 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.934 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110013+0000", 2024-09-13T05:12:02.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8023999999999998e-05 2024-09-13T05:12:02.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.934 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.934 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110083+0000", 2024-09-13T05:12:02.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9296999999999997e-05 2024-09-13T05:12:02.935 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.935 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.935 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.935 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.935 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.935 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29116 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2692096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:02.935 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:12:02.935 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 85.823284653000002, 2024-09-13T05:12:02.935 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061040167999999999, 2024-09-13T05:12:02.935 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.935 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.935 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.935 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.936 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.936 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29116 2024-09-13T05:12:02.936 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.936 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.936 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.936 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.936 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:12:02.936 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.936 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.936 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.936 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.936 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:12:02.936 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.936 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.937 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.937 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.937 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049252+0000", 2024-09-13T05:12:02.937 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.937 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.937 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.937 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.937 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049255+0000", 2024-09-13T05:12:02.937 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7250000000000002e-06 2024-09-13T05:12:02.937 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.937 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.937 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.937 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049261+0000", 2024-09-13T05:12:02.938 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.755e-06 2024-09-13T05:12:02.938 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.938 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.938 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.938 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049266+0000", 2024-09-13T05:12:02.938 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2100000000000001e-06 2024-09-13T05:12:02.938 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.938 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.939 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.939 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110115+0000", 2024-09-13T05:12:02.939 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060849225999999999 2024-09-13T05:12:02.939 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.939 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.939 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.939 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110199+0000", 2024-09-13T05:12:02.940 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4339999999999995e-05 2024-09-13T05:12:02.940 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.940 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.940 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.940 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110293+0000", 2024-09-13T05:12:02.940 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3397e-05 2024-09-13T05:12:02.940 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.940 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.940 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.940 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.940 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.940 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29117 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2701312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:02.940 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:02.941 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 85.823267016000003, 2024-09-13T05:12:02.941 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.06118527, 2024-09-13T05:12:02.941 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.941 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.941 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.941 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.941 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.941 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29117 2024-09-13T05:12:02.941 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.942 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.942 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.942 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.942 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:02.942 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.942 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.942 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.942 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.942 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:02.942 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.942 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.942 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.942 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.942 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:02.943 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.943 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.943 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049273+0000", 2024-09-13T05:12:02.943 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.757e-06 2024-09-13T05:12:02.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.943 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.943 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049278+0000", 2024-09-13T05:12:02.943 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7830000000000004e-06 2024-09-13T05:12:02.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.943 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049284+0000", 2024-09-13T05:12:02.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3820000000000003e-06 2024-09-13T05:12:02.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.944 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110313+0000", 2024-09-13T05:12:02.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061029682000000002 2024-09-13T05:12:02.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.944 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110383+0000", 2024-09-13T05:12:02.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9406000000000006e-05 2024-09-13T05:12:02.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.945 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.945 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.945 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110456+0000", 2024-09-13T05:12:02.945 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2750000000000007e-05 2024-09-13T05:12:02.945 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.945 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.945 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.945 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.945 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.945 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29118 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2710528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:02.945 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:02.945 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 85.823249101000002, 2024-09-13T05:12:02.945 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061380698999999997, 2024-09-13T05:12:02.945 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.946 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.946 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.946 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.946 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.946 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29118 2024-09-13T05:12:02.946 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.946 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.946 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.946 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.946 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:02.946 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.946 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.946 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.946 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.947 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:02.947 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.947 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.947 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.947 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:02.947 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.947 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.947 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.947 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049291+0000", 2024-09-13T05:12:02.947 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8770000000000002e-06 2024-09-13T05:12:02.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.947 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.947 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.948 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049296+0000", 2024-09-13T05:12:02.948 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6799999999999998e-06 2024-09-13T05:12:02.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.948 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.948 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049302+0000", 2024-09-13T05:12:02.948 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2769999999999996e-06 2024-09-13T05:12:02.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.948 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.948 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110488+0000", 2024-09-13T05:12:02.948 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061186184999999997 2024-09-13T05:12:02.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.949 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.949 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.949 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110577+0000", 2024-09-13T05:12:02.949 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9246000000000006e-05 2024-09-13T05:12:02.949 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.949 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.949 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.949 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110669+0000", 2024-09-13T05:12:02.949 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1923999999999996e-05 2024-09-13T05:12:02.949 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.949 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.949 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.949 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.950 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29119 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2719744~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:02.950 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:12:02.950 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 85.823231356999997, 2024-09-13T05:12:02.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061521165000000003, 2024-09-13T05:12:02.950 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.950 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.950 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.950 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.950 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.950 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29119 2024-09-13T05:12:02.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.950 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.951 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.951 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:12:02.951 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.951 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.951 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.951 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:12:02.951 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.951 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.951 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.951 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049305+0000", 2024-09-13T05:12:02.951 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.952 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.952 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049308+0000", 2024-09-13T05:12:02.952 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7070000000000001e-06 2024-09-13T05:12:02.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.952 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.952 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049316+0000", 2024-09-13T05:12:02.952 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:12:02.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.952 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.952 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049322+0000", 2024-09-13T05:12:02.953 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3199999999999999e-06 2024-09-13T05:12:02.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.953 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.953 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110690+0000", 2024-09-13T05:12:02.953 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061368428000000003 2024-09-13T05:12:02.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.953 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.953 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110755+0000", 2024-09-13T05:12:02.953 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4893000000000004e-05 2024-09-13T05:12:02.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110827+0000", 2024-09-13T05:12:02.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2039000000000006e-05 2024-09-13T05:12:02.954 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.954 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.954 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.954 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29120 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2728960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:02.954 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:02.954 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 85.823211087000004, 2024-09-13T05:12:02.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061718420000000003, 2024-09-13T05:12:02.955 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.955 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.955 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.955 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.955 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.955 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29120 2024-09-13T05:12:02.955 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.955 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.955 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.955 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.955 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:02.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.955 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.956 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.956 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.956 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:02.956 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.956 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.956 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.956 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.956 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:02.956 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.956 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.956 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.956 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.956 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049329+0000", 2024-09-13T05:12:02.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.022e-06 2024-09-13T05:12:02.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.957 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049336+0000", 2024-09-13T05:12:02.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0720000000000002e-06 2024-09-13T05:12:02.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.957 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049341+0000", 2024-09-13T05:12:02.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:12:02.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110864+0000", 2024-09-13T05:12:02.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061523126999999997 2024-09-13T05:12:02.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110951+0000", 2024-09-13T05:12:02.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6557000000000005e-05 2024-09-13T05:12:02.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.111045+0000", 2024-09-13T05:12:02.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4043999999999996e-05 2024-09-13T05:12:02.958 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.959 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.959 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.959 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.959 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29136 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2876416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:02.959 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:12:02.959 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 85.819195661999998, 2024-09-13T05:12:02.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060742995000000001, 2024-09-13T05:12:02.959 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.959 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.959 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.959 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.959 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.959 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29136 2024-09-13T05:12:02.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.960 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:12:02.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:12:02.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053341+0000", 2024-09-13T05:12:02.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053344+0000", 2024-09-13T05:12:02.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:12:02.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053350+0000", 2024-09-13T05:12:02.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7200000000000003e-06 2024-09-13T05:12:02.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053355+0000", 2024-09-13T05:12:02.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0150000000000003e-06 2024-09-13T05:12:02.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113909+0000", 2024-09-13T05:12:02.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060554368999999997 2024-09-13T05:12:02.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113994+0000", 2024-09-13T05:12:02.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4658000000000002e-05 2024-09-13T05:12:02.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114085+0000", 2024-09-13T05:12:02.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0939000000000005e-05 2024-09-13T05:12:02.963 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.963 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.964 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.964 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29166 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2628608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:02.964 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:02.964 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 85.819178227999998, 2024-09-13T05:12:02.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060883127000000002, 2024-09-13T05:12:02.964 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:02.964 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:02.964 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:02.965 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:02.965 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:02.965 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29166 2024-09-13T05:12:02.965 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.965 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:02.965 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.965 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:02.965 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:02.965 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.965 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.965 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.965 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:02.965 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:02.966 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:02.966 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.966 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.966 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:02.966 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:02.966 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:02.966 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.966 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.966 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:02.967 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053361+0000", 2024-09-13T05:12:02.967 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:12:02.967 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:02.967 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053367+0000", 2024-09-13T05:12:02.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7350000000000001e-06 2024-09-13T05:12:02.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.968 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:02.968 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053372+0000", 2024-09-13T05:12:02.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7840000000000003e-06 2024-09-13T05:12:02.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.969 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:02.969 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114103+0000", 2024-09-13T05:12:02.969 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060730924999999998 2024-09-13T05:12:02.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.969 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:02.970 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114171+0000", 2024-09-13T05:12:02.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8021999999999993e-05 2024-09-13T05:12:02.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:02.970 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:02.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:02.970 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114242+0000", 2024-09-13T05:12:02.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1390999999999995e-05 2024-09-13T05:12:02.970 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.970 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.971 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.971 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:02.971 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:02.971 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:02.972 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T05:12:02.975 INFO:teuthology.orchestra.run.smithi120.stderr:marked in osd.1. 2024-09-13T05:12:02.975 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:12:02.975 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:02.965+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:02.976 INFO:tasks.thrashosds.thrasher:Added osd 1 2024-09-13T05:12:03.074 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:03.072+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:03.089 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:03.089 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:03.089 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:03.089 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:03.098 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:12:03.175 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:03.172+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:03.207 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:03.207 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:03.207 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:03.207 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:03.207 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:03.216 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:12:03.275 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:03.272+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:03.328 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:03.328 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:03.328 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:03.328 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:03.328 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.328 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:03.328 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:03.329 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 86.461174650999993, 2024-09-13T05:12:03.329 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:12:03.329 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:03.329 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:03.329 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:03.329 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:03.329 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:03.329 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:12:03.329 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.329 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:03.329 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.329 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:03.329 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:03.330 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.330 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.330 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:03.330 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:03.330 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.330 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.330 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:03.330 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:03.330 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:03.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.330 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.330 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:03.331 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:12:03.331 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:12:03.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.331 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.331 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:03.331 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:12:03.331 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:12:03.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.331 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.331 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:03.331 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:12:03.331 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:12:03.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.331 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.332 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.332 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:12:03.332 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:12:03.332 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.332 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.332 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:03.332 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:12:03.332 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:12:03.332 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.332 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.332 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.332 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:12:03.332 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:12:03.333 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.333 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.333 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:03.333 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:12:03.333 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:12:03.333 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.333 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.333 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:03.333 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:12:03.333 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:12:03.333 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.333 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:03.334 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.334 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.334 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.334 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:03.334 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:03.334 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 86.461150215000004, 2024-09-13T05:12:03.334 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:12:03.334 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:03.334 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:03.334 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:03.334 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:03.334 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:03.334 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:12:03.334 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.335 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:03.335 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.335 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:03.335 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:03.335 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.335 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.335 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.335 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:03.335 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:03.335 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.335 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.335 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.335 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:03.335 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:03.336 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:03.336 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.336 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.336 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:03.336 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:12:03.336 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:12:03.336 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.336 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.336 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:03.336 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:12:03.336 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:12:03.336 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.336 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.337 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:03.337 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:12:03.337 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:12:03.337 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.337 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.337 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.337 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:12:03.337 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:12:03.337 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.337 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.337 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:03.337 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:12:03.337 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:12:03.337 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.338 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.338 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.338 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:12:03.338 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:12:03.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.338 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.338 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:03.338 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:12:03.338 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:12:03.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.338 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.338 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:03.338 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:12:03.338 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:12:03.339 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.339 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:03.339 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.339 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.339 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.339 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:03.339 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:03.339 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 86.461140388999993, 2024-09-13T05:12:03.339 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:12:03.339 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:03.339 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:03.339 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:03.339 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:03.339 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:03.340 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:12:03.340 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.340 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:03.340 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.340 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:03.340 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:03.340 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.340 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.340 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.340 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:03.340 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:03.340 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.340 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.341 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.341 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:03.341 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:03.341 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:03.341 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.341 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.341 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:03.341 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:12:03.341 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:12:03.341 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.341 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.341 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:03.341 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:12:03.341 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:12:03.342 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.342 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.342 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:03.342 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:12:03.342 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:12:03.342 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.342 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.342 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.342 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:12:03.342 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:12:03.342 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.342 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.342 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:03.342 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:12:03.343 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:12:03.343 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.343 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.343 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.343 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:12:03.343 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:12:03.343 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.343 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.343 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:03.343 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:12:03.343 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:12:03.343 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.343 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:03.344 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.344 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.344 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.344 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:03.344 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:03.344 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 86.461132152999994, 2024-09-13T05:12:03.344 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:12:03.344 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:03.344 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:03.344 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:03.344 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:03.344 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:03.344 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:12:03.345 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.345 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:03.345 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.345 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:03.345 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:03.345 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.345 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.345 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.345 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:03.345 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:03.345 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.345 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.345 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.345 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:03.346 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:03.346 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:03.346 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.346 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.346 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:03.346 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:12:03.346 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:12:03.346 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.346 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.346 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:03.346 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:12:03.346 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:12:03.346 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.346 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.347 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:03.347 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:12:03.347 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:12:03.347 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.347 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.347 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.347 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:12:03.347 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:12:03.347 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.347 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.347 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:03.347 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:12:03.347 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:12:03.347 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.348 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.348 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.348 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:12:03.348 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:12:03.348 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.348 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.348 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:03.348 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:12:03.348 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:12:03.348 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.348 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:03.348 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.348 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.348 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.349 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:03.349 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:03.349 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 86.461110241, 2024-09-13T05:12:03.349 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:12:03.349 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:03.349 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:03.349 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:03.349 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:03.349 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:03.349 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:12:03.349 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.349 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:03.349 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.350 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:03.350 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:03.350 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.350 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.350 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.350 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:03.350 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:03.350 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.350 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.350 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.350 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:03.350 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:03.350 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:03.350 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.350 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.351 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:03.351 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:12:03.351 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:12:03.351 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.351 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.351 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:03.351 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:12:03.351 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:12:03.351 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.351 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.351 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:03.351 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:12:03.351 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:12:03.351 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.352 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.352 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.352 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:12:03.352 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:12:03.352 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.352 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.352 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:03.352 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:12:03.352 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:12:03.352 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.352 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.352 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.352 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:12:03.353 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:12:03.353 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.353 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.353 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:03.353 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:12:03.353 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:12:03.353 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.353 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:03.353 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.353 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.353 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.353 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:03.353 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:03.354 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 86.461101636999999, 2024-09-13T05:12:03.354 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:12:03.354 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:03.354 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:03.354 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:03.354 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:03.354 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:03.354 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:12:03.354 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.354 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:03.354 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.354 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:03.354 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:03.354 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.355 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.355 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.355 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:03.355 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:03.355 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.355 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.355 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.355 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:03.355 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:03.355 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:03.355 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.355 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.355 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:03.355 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:12:03.356 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:12:03.356 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.356 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.356 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:03.356 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:12:03.356 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:12:03.356 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.356 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.356 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:03.356 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:12:03.356 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:12:03.356 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.356 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.357 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.357 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:12:03.357 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:12:03.357 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.357 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.357 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:03.357 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:12:03.357 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:12:03.357 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.357 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.357 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.357 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:12:03.357 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:12:03.357 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.358 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.358 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:03.358 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:12:03.358 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:12:03.358 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.358 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:03.358 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.358 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.358 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.358 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:03.358 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:03.358 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 86.461091943, 2024-09-13T05:12:03.358 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:12:03.359 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:03.359 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:03.359 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:03.359 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:03.359 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:03.359 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:12:03.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.359 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:03.359 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.359 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:03.359 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:03.359 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.359 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.359 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:03.360 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:03.360 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.360 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.360 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.360 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:03.360 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:03.360 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:03.360 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.360 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.360 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:03.360 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:12:03.360 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:12:03.360 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.361 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.361 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:03.361 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:12:03.361 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:12:03.361 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.361 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.361 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:03.361 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:12:03.361 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:12:03.361 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.361 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.361 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.361 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:12:03.361 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:12:03.362 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.362 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.362 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:03.362 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:12:03.362 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:12:03.362 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.362 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.362 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.362 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:12:03.362 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:12:03.362 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.362 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.362 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:03.362 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:12:03.363 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:12:03.363 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.363 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:03.363 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.363 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.363 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.363 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:03.363 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:03.363 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 86.461082828000002, 2024-09-13T05:12:03.363 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:12:03.363 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:03.363 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:03.363 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:03.363 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:03.364 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:03.364 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:12:03.364 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.364 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:03.364 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.364 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:03.364 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:03.364 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.364 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.364 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.364 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:03.364 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:03.364 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.365 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.365 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.365 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:03.365 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:03.365 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:03.365 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.365 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.365 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:03.365 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:12:03.365 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:12:03.365 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.365 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.365 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:03.365 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:12:03.366 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:12:03.366 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.366 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.366 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:03.366 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:12:03.366 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:12:03.366 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.366 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.366 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.366 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:12:03.366 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:12:03.366 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.366 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.366 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:03.367 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:12:03.367 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:12:03.367 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.367 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.367 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.367 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:12:03.367 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:12:03.367 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.367 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.367 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:03.367 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:12:03.367 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:12:03.367 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.367 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:03.368 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.368 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.368 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:03.368 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:12:03.368 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 86.461074349, 2024-09-13T05:12:03.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:12:03.368 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:03.368 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:03.368 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:03.368 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:03.368 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:03.368 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:12:03.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.369 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:03.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:03.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:12:03.369 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:03.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:12:03.369 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:03.370 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:12:03.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:03.370 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.370 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.370 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:03.370 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:12:03.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:12:03.370 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.370 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.370 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:03.370 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:12:03.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:12:03.370 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.370 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.371 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:03.371 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:12:03.371 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:12:03.371 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.371 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.371 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.371 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:12:03.371 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:12:03.371 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.371 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.371 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:03.371 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:12:03.371 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:12:03.371 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.372 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.372 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.372 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:12:03.372 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:12:03.372 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.372 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.372 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:03.372 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:12:03.372 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:12:03.372 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.372 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:03.372 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.372 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.372 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.373 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:03.373 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:12:03.373 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 86.461062424000005, 2024-09-13T05:12:03.373 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:12:03.373 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:03.373 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:03.373 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:03.373 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:03.373 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:03.373 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:12:03.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.373 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:03.373 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.374 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:03.374 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:12:03.374 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.374 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.374 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:03.374 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:12:03.374 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.374 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.374 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:03.374 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:12:03.374 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:03.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.375 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.375 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:03.375 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:12:03.375 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:12:03.375 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.375 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.375 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:03.375 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:12:03.375 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:12:03.375 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.375 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.375 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:03.375 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:12:03.375 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:12:03.376 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.376 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.376 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.376 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:12:03.376 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:12:03.376 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.376 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.376 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:03.376 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:12:03.376 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:12:03.376 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.376 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.376 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.377 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:12:03.377 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:12:03.377 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.377 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.377 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:03.377 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:12:03.377 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:12:03.377 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.377 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:03.377 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.377 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.377 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.377 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:03.377 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:03.378 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 86.461040835000006, 2024-09-13T05:12:03.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:12:03.378 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:03.378 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:03.378 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:03.378 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:03.378 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:03.378 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:12:03.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.378 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:03.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:03.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:03.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:03.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:03.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:03.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:03.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:03.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:03.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:12:03.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:12:03.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.380 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:03.380 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:12:03.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:12:03.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.380 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:03.380 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:12:03.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:12:03.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.381 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.381 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:12:03.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:12:03.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.381 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:03.381 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:12:03.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:12:03.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.381 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.381 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:12:03.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:12:03.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:03.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:12:03.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:12:03.382 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.382 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:03.382 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.382 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:03.383 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:03.383 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 86.461017706999996, 2024-09-13T05:12:03.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:12:03.383 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:03.383 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:03.383 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:03.383 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:03.383 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:03.383 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:12:03.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.383 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:03.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:03.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:03.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.384 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:03.384 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:03.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.384 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:03.384 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:03.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:03.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:03.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:12:03.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:12:03.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:03.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:12:03.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:12:03.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:03.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:12:03.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:12:03.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:12:03.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:12:03.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:03.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:12:03.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:12:03.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:12:03.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:12:03.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:03.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:12:03.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:12:03.387 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.387 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:03.387 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.387 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:03.387 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:12:03.387 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 86.461002334, 2024-09-13T05:12:03.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:12:03.388 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:03.388 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:03.388 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:03.388 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:03.388 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:03.388 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:12:03.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.388 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:03.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.388 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:03.388 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:12:03.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:03.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:12:03.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:03.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:12:03.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:03.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:03.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:12:03.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:12:03.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:03.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:12:03.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:12:03.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:03.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:12:03.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:12:03.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:12:03.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:12:03.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.391 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:03.391 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:12:03.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:12:03.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.391 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.391 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:12:03.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:12:03.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.391 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:03.391 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:12:03.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:12:03.392 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.392 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:03.392 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.392 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.392 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:03.392 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:03.392 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 86.460981865999997, 2024-09-13T05:12:03.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:12:03.392 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:03.392 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:03.392 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:03.393 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:03.393 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:03.393 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:12:03.393 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.393 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:03.393 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.393 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:03.393 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:03.393 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.393 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:03.394 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:03.394 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:03.394 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:03.394 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:03.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:03.394 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:12:03.394 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:12:03.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:03.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:12:03.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:12:03.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:03.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:12:03.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:12:03.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:12:03.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:12:03.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:03.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:12:03.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:12:03.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:12:03.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:12:03.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.397 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:03.397 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:12:03.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:12:03.397 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.397 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:03.397 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.397 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:03.397 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:03.397 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 86.460965204999994, 2024-09-13T05:12:03.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:12:03.397 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:03.397 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:03.398 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:03.398 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:03.398 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:03.398 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:12:03.398 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.398 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:03.398 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.398 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:03.398 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:03.398 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.398 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.398 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.398 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:03.398 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:03.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:03.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:03.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:03.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:03.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:12:03.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:12:03.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:03.400 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:12:03.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:12:03.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:03.400 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:12:03.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:12:03.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.400 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:12:03.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:12:03.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:03.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:12:03.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:12:03.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:12:03.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:12:03.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:03.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:12:03.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:12:03.402 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.402 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:03.402 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.402 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:03.402 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:12:03.402 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 86.460938491999997, 2024-09-13T05:12:03.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:12:03.402 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:03.403 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:03.403 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:03.403 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:03.403 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:03.403 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:12:03.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.403 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:03.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.403 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:03.403 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:12:03.403 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.404 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:03.404 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:12:03.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.404 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:03.404 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:12:03.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:03.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.404 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:03.404 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:12:03.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:12:03.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.405 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:03.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:12:03.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:12:03.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.405 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:03.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:12:03.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:12:03.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.405 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:12:03.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:12:03.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:03.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:12:03.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:12:03.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:12:03.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:12:03.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:03.407 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:12:03.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:12:03.407 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.407 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:03.407 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.407 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.407 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:03.407 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:03.407 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 86.46091964, 2024-09-13T05:12:03.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:12:03.407 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:03.407 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:03.407 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:03.408 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:03.408 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:03.408 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:12:03.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.408 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:03.408 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.408 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:03.408 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:03.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.408 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:03.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:03.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.409 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:03.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:03.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:03.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.409 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:03.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:12:03.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:12:03.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.410 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:03.410 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:12:03.410 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:12:03.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.410 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:03.410 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:12:03.410 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:12:03.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.410 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.410 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:12:03.410 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:12:03.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:03.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:12:03.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:12:03.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:12:03.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:12:03.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:03.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:12:03.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:12:03.412 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.412 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:03.412 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.412 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:03.412 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:03.412 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 86.460901853999999, 2024-09-13T05:12:03.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:12:03.412 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:03.412 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:03.412 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:03.412 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:03.413 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:03.413 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:12:03.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.413 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:03.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:03.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:03.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:03.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:03.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:03.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:03.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:03.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:03.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:12:03.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:12:03.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:03.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:12:03.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:12:03.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.415 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:03.415 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:12:03.415 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:12:03.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.415 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.415 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:12:03.415 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:12:03.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.415 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:03.416 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:12:03.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:12:03.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.416 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.416 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:12:03.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:12:03.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.416 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:03.416 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:12:03.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:12:03.416 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.416 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:03.417 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.417 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.417 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:03.417 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:03.417 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 86.460866793999998, 2024-09-13T05:12:03.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:12:03.417 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:03.417 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:03.417 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:03.417 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:03.417 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:03.417 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:12:03.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.418 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:03.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:03.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:03.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:03.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:03.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:03.419 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:03.419 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:03.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.419 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:03.419 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:12:03.419 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:12:03.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.419 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:03.419 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:12:03.419 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:12:03.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.420 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:03.420 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:12:03.420 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:12:03.420 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.420 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.420 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.420 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:12:03.420 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:12:03.420 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.420 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.420 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:03.420 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:12:03.420 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:12:03.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.421 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.421 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.421 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:12:03.421 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:12:03.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.421 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.421 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:03.421 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:12:03.421 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:12:03.421 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.421 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:03.421 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.422 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:03.422 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:03.422 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 86.460849979000002, 2024-09-13T05:12:03.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:12:03.422 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:03.422 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:03.422 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:03.422 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:03.422 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:03.422 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:12:03.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.423 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:03.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:03.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:03.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:03.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:03.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:03.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:03.424 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:03.424 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:03.424 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.424 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.424 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:03.424 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:12:03.424 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:12:03.424 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.424 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.424 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:03.424 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:12:03.424 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:12:03.424 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.425 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.425 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:03.425 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:12:03.425 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:12:03.425 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.425 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.425 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.425 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:12:03.425 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:12:03.425 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.425 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.425 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:03.425 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:12:03.425 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:12:03.426 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:03.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:12:03.426 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:12:03.426 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:03.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:03.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:03.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:12:03.426 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:12:03.426 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.426 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:03.426 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.426 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:03.427 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:03.427 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:03.428 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:03.425+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:03.428 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:12:03.529 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:03.521+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:03.535 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:03.535 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:03.544 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:12:03.565 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:12:03.631 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:03.625+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:03.636 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is unset 2024-09-13T05:12:03.677 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:03.677 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:03.677 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:03.687 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:12:03.723 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:03.731 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:03.725+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:03.740 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:03.759 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:03.780 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:03.781 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:03.781 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:03.789 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:12:03.802 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:03.824 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:03.831 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:03.825+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:03.853 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:03.854 INFO:teuthology.orchestra.run.smithi120.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-13T05:12:03.854 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:03.854 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:03.854 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:03.854 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:03.854 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:03.854 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:03.854 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:03.857 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T05:12:03.858 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T05:12:03.912 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:03.913 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:03.922 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:12:03.932 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:03.928+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:04.022 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:04.022 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:04.032 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:12:04.033 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:04.029+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:04.128 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:04.129 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:04.134 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:04.132+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:04.137 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:12:04.235 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:04.229+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:04.288 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:04.288 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:04.298 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:12:04.336 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:04.332+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:04.393 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:04.393 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:04.402 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:12:04.436 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:04.432+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:04.510 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:04.510 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:04.520 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:12:04.566 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:04.561+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:04.639 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:04.633+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:04.650 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:04.651 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:04.660 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:12:04.739 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:04.736+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:04.785 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:04.785 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:04.796 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:12:04.800 INFO:teuthology.orchestra.run.smithi120.stdout:5135 write 0xe063ca4 thru 0xe071c84 (0xdfe1 bytes) 2024-09-13T05:12:04.841 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:04.836+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:04.909 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:04.909 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:04.919 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:12:04.942 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:04.940+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:05.029 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:05.029 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:05.039 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:12:05.042 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:05.037+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:05.142 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:05.142 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:05.144 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:05.140+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:05.152 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:12:05.245 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:05.237+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:05.261 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:05.261 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:05.271 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:12:05.345 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:05.341+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:05.424 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:05.424 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:05.434 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:12:05.446 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:05.444+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:05.537 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:05.537 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:05.547 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:12:05.548 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:05.544+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:05.650 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:05.645+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:05.651 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T05:12:05.654 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:05.654 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:05.663 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:12:05.750 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:05.745+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:05.823 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:05.823 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:05.833 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:12:05.858 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:12:05.878 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:05.873+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:05.944 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:05.945 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:05.952 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:05.948+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:05.954 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:12:06.011 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:06.030 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:06.049 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:06.053 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:06.052+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:06.063 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:06.063 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:06.071 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:06.074 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:12:06.093 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:06.115 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:06.139 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:06.139 INFO:teuthology.orchestra.run.smithi120.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-13T05:12:06.139 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:06.139 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:06.139 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:06.140 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:06.140 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:06.140 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:06.140 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:06.141 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T05:12:06.141 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T05:12:06.154 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:06.149+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:06.186 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:06.186 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:06.187 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:06.187 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:06.196 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:12:06.254 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:06.252+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:06.301 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:06.301 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:06.301 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:06.301 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:06.301 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:06.310 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:12:06.355 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:06.352+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:06.413 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:06.414 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:06.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:06.414 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:06.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.414 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10634 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 731136~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:06.414 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:12:06.414 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 96.009612516000004, 2024-09-13T05:12:06.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028136992999999999, 2024-09-13T05:12:06.414 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.414 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.414 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.414 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.415 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.415 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10634 2024-09-13T05:12:06.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.415 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:12:06.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:12:06.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401986+0000", 2024-09-13T05:12:06.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:06.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401987+0000", 2024-09-13T05:12:06.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5090000000000001e-06 2024-09-13T05:12:06.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.401997+0000", 2024-09-13T05:12:06.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8009999999999998e-06 2024-09-13T05:12:06.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402000+0000", 2024-09-13T05:12:06.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.756e-06 2024-09-13T05:12:06.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430035+0000", 2024-09-13T05:12:06.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028034967000000001 2024-09-13T05:12:06.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430081+0000", 2024-09-13T05:12:06.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6448e-05 2024-09-13T05:12:06.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430123+0000", 2024-09-13T05:12:06.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1758000000000002e-05 2024-09-13T05:12:06.418 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.418 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.418 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.418 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10635 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 740352~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:06.419 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:12:06.419 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 96.009595902000001, 2024-09-13T05:12:06.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028229890000000001, 2024-09-13T05:12:06.419 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.419 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.419 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10635 2024-09-13T05:12:06.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.419 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:12:06.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402003+0000", 2024-09-13T05:12:06.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402002+0000", 2024-09-13T05:12:06.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:06.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402004+0000", 2024-09-13T05:12:06.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.575e-06 2024-09-13T05:12:06.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402007+0000", 2024-09-13T05:12:06.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1240000000000001e-06 2024-09-13T05:12:06.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402010+0000", 2024-09-13T05:12:06.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5859999999999999e-06 2024-09-13T05:12:06.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430146+0000", 2024-09-13T05:12:06.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028136746000000001 2024-09-13T05:12:06.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430195+0000", 2024-09-13T05:12:06.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8948e-05 2024-09-13T05:12:06.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430232+0000", 2024-09-13T05:12:06.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7159000000000001e-05 2024-09-13T05:12:06.423 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.423 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.423 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.423 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10636 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 749568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:06.423 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:12:06.423 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 96.009586795999994, 2024-09-13T05:12:06.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328440999999999, 2024-09-13T05:12:06.424 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.424 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.424 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.424 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.424 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.424 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10636 2024-09-13T05:12:06.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.424 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:12:06.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:12:06.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402011+0000", 2024-09-13T05:12:06.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:12:06.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402017+0000", 2024-09-13T05:12:06.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5620000000000003e-06 2024-09-13T05:12:06.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402020+0000", 2024-09-13T05:12:06.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1410000000000001e-06 2024-09-13T05:12:06.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402024+0000", 2024-09-13T05:12:06.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4489999999999999e-06 2024-09-13T05:12:06.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430256+0000", 2024-09-13T05:12:06.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028232363 2024-09-13T05:12:06.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430299+0000", 2024-09-13T05:12:06.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2830999999999997e-05 2024-09-13T05:12:06.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430340+0000", 2024-09-13T05:12:06.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1301000000000003e-05 2024-09-13T05:12:06.428 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.428 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.428 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.428 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10637 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 758784~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:06.428 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:12:06.428 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 96.009571683000004, 2024-09-13T05:12:06.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028441793, 2024-09-13T05:12:06.429 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.429 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.429 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.429 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.429 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.429 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10637 2024-09-13T05:12:06.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.429 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:12:06.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:12:06.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:12:06.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:12:06.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402031+0000", 2024-09-13T05:12:06.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6770000000000003e-06 2024-09-13T05:12:06.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402034+0000", 2024-09-13T05:12:06.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1540000000000002e-06 2024-09-13T05:12:06.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402038+0000", 2024-09-13T05:12:06.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4970000000000001e-06 2024-09-13T05:12:06.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430367+0000", 2024-09-13T05:12:06.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328906000000001 2024-09-13T05:12:06.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430416+0000", 2024-09-13T05:12:06.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:12:06.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430469+0000", 2024-09-13T05:12:06.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2284999999999998e-05 2024-09-13T05:12:06.432 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.433 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.433 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.433 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10638 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 768000~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:06.433 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:12:06.433 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 96.009558198999997, 2024-09-13T05:12:06.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028548740999999999, 2024-09-13T05:12:06.433 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.433 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.433 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.433 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.433 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.434 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10638 2024-09-13T05:12:06.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.434 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:12:06.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:12:06.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:12:06.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:06.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402041+0000", 2024-09-13T05:12:06.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4789999999999999e-06 2024-09-13T05:12:06.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402044+0000", 2024-09-13T05:12:06.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.694e-06 2024-09-13T05:12:06.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402047+0000", 2024-09-13T05:12:06.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.537e-06 2024-09-13T05:12:06.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430494+0000", 2024-09-13T05:12:06.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028447665 2024-09-13T05:12:06.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430544+0000", 2024-09-13T05:12:06.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9539000000000001e-05 2024-09-13T05:12:06.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430589+0000", 2024-09-13T05:12:06.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5071999999999998e-05 2024-09-13T05:12:06.437 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.437 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.437 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.437 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10639 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 777216~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:06.437 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:12:06.437 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 96.009547818000001, 2024-09-13T05:12:06.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028651769000000001, 2024-09-13T05:12:06.438 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.438 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.438 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.438 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.438 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.438 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10639 2024-09-13T05:12:06.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.438 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:12:06.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:12:06.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402050+0000", 2024-09-13T05:12:06.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:06.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402052+0000", 2024-09-13T05:12:06.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2249999999999999e-06 2024-09-13T05:12:06.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402054+0000", 2024-09-13T05:12:06.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8140000000000001e-06 2024-09-13T05:12:06.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402057+0000", 2024-09-13T05:12:06.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4889999999999998e-06 2024-09-13T05:12:06.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430607+0000", 2024-09-13T05:12:06.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028549896000000002 2024-09-13T05:12:06.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430651+0000", 2024-09-13T05:12:06.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4622000000000001e-05 2024-09-13T05:12:06.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430702+0000", 2024-09-13T05:12:06.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0980999999999999e-05 2024-09-13T05:12:06.442 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.442 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.442 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.442 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11151 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 779264~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:06.442 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:12:06.442 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 95.979776537000006, 2024-09-13T05:12:06.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028283188000000001, 2024-09-13T05:12:06.442 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.443 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.443 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.443 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.443 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.443 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11151 2024-09-13T05:12:06.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.443 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:12:06.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:12:06.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431822+0000", 2024-09-13T05:12:06.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:06.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431827+0000", 2024-09-13T05:12:06.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0989999999999998e-06 2024-09-13T05:12:06.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431832+0000", 2024-09-13T05:12:06.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8829999999999997e-06 2024-09-13T05:12:06.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.431835+0000", 2024-09-13T05:12:06.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.439e-06 2024-09-13T05:12:06.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.459955+0000", 2024-09-13T05:12:06.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028119858000000001 2024-09-13T05:12:06.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.460029+0000", 2024-09-13T05:12:06.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4264000000000006e-05 2024-09-13T05:12:06.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.460105+0000", 2024-09-13T05:12:06.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5906000000000001e-05 2024-09-13T05:12:06.447 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.447 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.447 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.447 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11897 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 579584~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:06.447 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:12:06.447 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 95.930627362999999, 2024-09-13T05:12:06.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028193354, 2024-09-13T05:12:06.448 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.448 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.448 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11897 2024-09-13T05:12:06.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.448 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:12:06.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:12:06.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480971+0000", 2024-09-13T05:12:06.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:06.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480973+0000", 2024-09-13T05:12:06.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.934e-06 2024-09-13T05:12:06.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480976+0000", 2024-09-13T05:12:06.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.614e-06 2024-09-13T05:12:06.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480980+0000", 2024-09-13T05:12:06.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.377e-06 2024-09-13T05:12:06.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.508967+0000", 2024-09-13T05:12:06.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027987455000000001 2024-09-13T05:12:06.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509074+0000", 2024-09-13T05:12:06.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107379 2024-09-13T05:12:06.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509164+0000", 2024-09-13T05:12:06.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9979e-05 2024-09-13T05:12:06.452 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.452 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.452 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.452 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11898 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 588800~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:06.452 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:12:06.452 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 95.930615298999996, 2024-09-13T05:12:06.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028308628999999998, 2024-09-13T05:12:06.452 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.452 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.452 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.452 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.453 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.453 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11898 2024-09-13T05:12:06.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.453 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:12:06.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:12:06.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:12:06.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:06.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480984+0000", 2024-09-13T05:12:06.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:12:06.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480988+0000", 2024-09-13T05:12:06.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4640000000000002e-06 2024-09-13T05:12:06.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480991+0000", 2024-09-13T05:12:06.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3469999999999999e-06 2024-09-13T05:12:06.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509199+0000", 2024-09-13T05:12:06.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028207449999999998 2024-09-13T05:12:06.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509250+0000", 2024-09-13T05:12:06.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1375000000000002e-05 2024-09-13T05:12:06.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509292+0000", 2024-09-13T05:12:06.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1730000000000002e-05 2024-09-13T05:12:06.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.456 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.456 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11899 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 598016~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:06.456 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:12:06.456 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 95.930604458000005, 2024-09-13T05:12:06.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516703000000001, 2024-09-13T05:12:06.456 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.456 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.457 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11899 2024-09-13T05:12:06.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.457 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:12:06.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:12:06.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:12:06.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:06.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480995+0000", 2024-09-13T05:12:06.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7349999999999999e-06 2024-09-13T05:12:06.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481000+0000", 2024-09-13T05:12:06.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0289999999999996e-06 2024-09-13T05:12:06.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481004+0000", 2024-09-13T05:12:06.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3699999999999999e-06 2024-09-13T05:12:06.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509332+0000", 2024-09-13T05:12:06.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328320000000001 2024-09-13T05:12:06.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509428+0000", 2024-09-13T05:12:06.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6150999999999995e-05 2024-09-13T05:12:06.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509511+0000", 2024-09-13T05:12:06.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2396000000000002e-05 2024-09-13T05:12:06.460 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.460 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.460 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.460 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11900 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 607232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:06.460 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:12:06.460 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 95.930591868999997, 2024-09-13T05:12:06.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028621273999999999, 2024-09-13T05:12:06.460 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.461 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.461 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.461 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.461 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.461 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11900 2024-09-13T05:12:06.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.461 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:12:06.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:12:06.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481006+0000", 2024-09-13T05:12:06.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:06.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481008+0000", 2024-09-13T05:12:06.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.73e-06 2024-09-13T05:12:06.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481011+0000", 2024-09-13T05:12:06.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4000000000000001e-06 2024-09-13T05:12:06.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481015+0000", 2024-09-13T05:12:06.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2760000000000001e-06 2024-09-13T05:12:06.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509531+0000", 2024-09-13T05:12:06.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516102000000002 2024-09-13T05:12:06.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509588+0000", 2024-09-13T05:12:06.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7423999999999998e-05 2024-09-13T05:12:06.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509628+0000", 2024-09-13T05:12:06.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9644000000000002e-05 2024-09-13T05:12:06.464 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.464 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.464 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.464 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11901 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 616448~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:06.464 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:12:06.464 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 95.930581247999996, 2024-09-13T05:12:06.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028820500999999998, 2024-09-13T05:12:06.465 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.465 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.465 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.465 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.465 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.465 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11901 2024-09-13T05:12:06.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.465 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:12:06.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:12:06.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:12:06.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:06.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481022+0000", 2024-09-13T05:12:06.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0209999999999999e-06 2024-09-13T05:12:06.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481026+0000", 2024-09-13T05:12:06.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:12:06.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481029+0000", 2024-09-13T05:12:06.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.636e-06 2024-09-13T05:12:06.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509661+0000", 2024-09-13T05:12:06.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028631496999999999 2024-09-13T05:12:06.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509757+0000", 2024-09-13T05:12:06.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5780999999999997e-05 2024-09-13T05:12:06.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509838+0000", 2024-09-13T05:12:06.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1102999999999999e-05 2024-09-13T05:12:06.473 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.473 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.473 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.474 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11902 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 625664~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:06.474 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:12:06.474 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 95.930559385999999, 2024-09-13T05:12:06.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028894265999999998, 2024-09-13T05:12:06.474 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.474 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.474 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.474 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.474 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.474 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11902 2024-09-13T05:12:06.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.474 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:12:06.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:12:06.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:12:06.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:06.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481041+0000", 2024-09-13T05:12:06.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8020000000000001e-06 2024-09-13T05:12:06.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481044+0000", 2024-09-13T05:12:06.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7110000000000001e-06 2024-09-13T05:12:06.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481048+0000", 2024-09-13T05:12:06.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.411e-06 2024-09-13T05:12:06.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509851+0000", 2024-09-13T05:12:06.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028803295 2024-09-13T05:12:06.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509896+0000", 2024-09-13T05:12:06.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4963000000000003e-05 2024-09-13T05:12:06.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509933+0000", 2024-09-13T05:12:06.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7384e-05 2024-09-13T05:12:06.478 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.478 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.478 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.478 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11903 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 634880~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:06.478 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:12:06.478 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 95.930548150000007, 2024-09-13T05:12:06.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029118033000000001, 2024-09-13T05:12:06.478 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.478 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.479 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.479 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.479 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.479 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11903 2024-09-13T05:12:06.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.479 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:12:06.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:12:06.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:12:06.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:06.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481052+0000", 2024-09-13T05:12:06.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.581e-06 2024-09-13T05:12:06.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481055+0000", 2024-09-13T05:12:06.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4520000000000002e-06 2024-09-13T05:12:06.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481058+0000", 2024-09-13T05:12:06.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4599999999999999e-06 2024-09-13T05:12:06.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509967+0000", 2024-09-13T05:12:06.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028908257999999999 2024-09-13T05:12:06.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510062+0000", 2024-09-13T05:12:06.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5613999999999996e-05 2024-09-13T05:12:06.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510168+0000", 2024-09-13T05:12:06.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105951 2024-09-13T05:12:06.482 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.482 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.482 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.483 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11904 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 644096~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:06.483 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:12:06.483 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 95.930537255000004, 2024-09-13T05:12:06.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029301971, 2024-09-13T05:12:06.483 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.483 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.483 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.483 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.483 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.483 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11904 2024-09-13T05:12:06.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.483 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:12:06.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:12:06.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:12:06.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:06.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481063+0000", 2024-09-13T05:12:06.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6700000000000001e-06 2024-09-13T05:12:06.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481068+0000", 2024-09-13T05:12:06.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4519999999999996e-06 2024-09-13T05:12:06.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481074+0000", 2024-09-13T05:12:06.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8370000000000002e-06 2024-09-13T05:12:06.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510197+0000", 2024-09-13T05:12:06.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029123237999999999 2024-09-13T05:12:06.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510285+0000", 2024-09-13T05:12:06.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7676000000000006e-05 2024-09-13T05:12:06.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510363+0000", 2024-09-13T05:12:06.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8418999999999996e-05 2024-09-13T05:12:06.487 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.487 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.487 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.487 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11905 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 653312~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:06.487 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:12:06.487 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 95.930521514999995, 2024-09-13T05:12:06.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029480164, 2024-09-13T05:12:06.487 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.487 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.487 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.487 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.487 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.488 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11905 2024-09-13T05:12:06.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.488 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:12:06.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:12:06.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481076+0000", 2024-09-13T05:12:06.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:06.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481079+0000", 2024-09-13T05:12:06.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9629999999999998e-06 2024-09-13T05:12:06.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481087+0000", 2024-09-13T05:12:06.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6369999999999999e-06 2024-09-13T05:12:06.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481093+0000", 2024-09-13T05:12:06.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.857e-06 2024-09-13T05:12:06.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510408+0000", 2024-09-13T05:12:06.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029315213 2024-09-13T05:12:06.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510501+0000", 2024-09-13T05:12:06.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2916000000000003e-05 2024-09-13T05:12:06.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510557+0000", 2024-09-13T05:12:06.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6063999999999997e-05 2024-09-13T05:12:06.491 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.491 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.491 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.491 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11906 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 662528~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:06.491 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:12:06.491 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 95.930479501999997, 2024-09-13T05:12:06.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029575054999999999, 2024-09-13T05:12:06.492 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.492 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.492 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.492 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.492 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.492 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11906 2024-09-13T05:12:06.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.492 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:12:06.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:12:06.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481118+0000", 2024-09-13T05:12:06.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:06.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481122+0000", 2024-09-13T05:12:06.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2610000000000002e-06 2024-09-13T05:12:06.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481129+0000", 2024-09-13T05:12:06.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0079999999999996e-06 2024-09-13T05:12:06.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481135+0000", 2024-09-13T05:12:06.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0599999999999996e-06 2024-09-13T05:12:06.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510575+0000", 2024-09-13T05:12:06.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029440470999999999 2024-09-13T05:12:06.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510635+0000", 2024-09-13T05:12:06.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0177000000000003e-05 2024-09-13T05:12:06.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510694+0000", 2024-09-13T05:12:06.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8675999999999999e-05 2024-09-13T05:12:06.495 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.495 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.495 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.496 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11907 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 671744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:06.496 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:12:06.496 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 95.930218706999995, 2024-09-13T05:12:06.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029479490000000001, 2024-09-13T05:12:06.496 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.496 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.496 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.496 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.496 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.496 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11907 2024-09-13T05:12:06.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.496 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:12:06.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:12:06.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481140+0000", 2024-09-13T05:12:06.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997597 2024-09-13T05:12:06.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481383+0000", 2024-09-13T05:12:06.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024355399999999999 2024-09-13T05:12:06.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481390+0000", 2024-09-13T05:12:06.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3599999999999998e-06 2024-09-13T05:12:06.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481395+0000", 2024-09-13T05:12:06.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8940000000000001e-06 2024-09-13T05:12:06.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510722+0000", 2024-09-13T05:12:06.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029327143999999999 2024-09-13T05:12:06.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510802+0000", 2024-09-13T05:12:06.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9770000000000004e-05 2024-09-13T05:12:06.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510859+0000", 2024-09-13T05:12:06.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6957999999999999e-05 2024-09-13T05:12:06.500 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.500 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.500 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.500 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11908 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 680960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:06.500 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:12:06.500 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 95.930198794000006, 2024-09-13T05:12:06.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029617622, 2024-09-13T05:12:06.500 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.500 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.500 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.500 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.500 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.500 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11908 2024-09-13T05:12:06.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.501 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:12:06.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:12:06.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481399+0000", 2024-09-13T05:12:06.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:06.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481401+0000", 2024-09-13T05:12:06.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8729999999999999e-06 2024-09-13T05:12:06.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481413+0000", 2024-09-13T05:12:06.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1748e-05 2024-09-13T05:12:06.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481417+0000", 2024-09-13T05:12:06.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:12:06.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510908+0000", 2024-09-13T05:12:06.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029491129000000001 2024-09-13T05:12:06.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510955+0000", 2024-09-13T05:12:06.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7188000000000003e-05 2024-09-13T05:12:06.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511017+0000", 2024-09-13T05:12:06.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2288999999999999e-05 2024-09-13T05:12:06.504 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.504 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.504 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.504 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11909 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 690176~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:06.504 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:12:06.504 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 95.930178467000005, 2024-09-13T05:12:06.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029780699000000001, 2024-09-13T05:12:06.504 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.505 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.505 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.505 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.505 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.505 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11909 2024-09-13T05:12:06.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.505 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:12:06.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:12:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481419+0000", 2024-09-13T05:12:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481421+0000", 2024-09-13T05:12:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.035e-06 2024-09-13T05:12:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481427+0000", 2024-09-13T05:12:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2449999999999998e-06 2024-09-13T05:12:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481430+0000", 2024-09-13T05:12:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.366e-06 2024-09-13T05:12:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511064+0000", 2024-09-13T05:12:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029633711 2024-09-13T05:12:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511160+0000", 2024-09-13T05:12:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6399999999999999e-05 2024-09-13T05:12:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511201+0000", 2024-09-13T05:12:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0448000000000003e-05 2024-09-13T05:12:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.509 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:06.510 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:12:06.511 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:06.505+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:06.612 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:06.608+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:06.657 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:06.657 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:06.657 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:06.657 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:06.666 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:12:06.711 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:06.708+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:06.768 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:06.805 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:06.806 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:06.806 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:06.806 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:06.807 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:12:06.849 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:06.848+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:06.914 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:06.909+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:06.928 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is unset 2024-09-13T05:12:06.968 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:06.968 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:06.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:06.969 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:06.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.969 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136560 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3908608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:06.969 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:12:06.970 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.869692044000001, 2024-09-13T05:12:06.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056148103999999997, 2024-09-13T05:12:06.970 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.970 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.970 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.970 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.970 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.970 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136560 2024-09-13T05:12:06.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.970 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:12:06.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:12:06.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095289+0000", 2024-09-13T05:12:06.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:06.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095292+0000", 2024-09-13T05:12:06.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.802e-06 2024-09-13T05:12:06.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095318+0000", 2024-09-13T05:12:06.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5987999999999999e-05 2024-09-13T05:12:06.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095323+0000", 2024-09-13T05:12:06.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.006e-06 2024-09-13T05:12:06.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151316+0000", 2024-09-13T05:12:06.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055992593 2024-09-13T05:12:06.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151371+0000", 2024-09-13T05:12:06.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5532999999999998e-05 2024-09-13T05:12:06.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151438+0000", 2024-09-13T05:12:06.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6557999999999995e-05 2024-09-13T05:12:06.974 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.974 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.974 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.974 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136562 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3922944~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:06.974 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:06.974 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.869654926000001, 2024-09-13T05:12:06.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056259690000000001, 2024-09-13T05:12:06.974 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.975 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.975 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.975 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.975 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.975 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136562 2024-09-13T05:12:06.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.975 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:06.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:06.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:06.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:06.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095329+0000", 2024-09-13T05:12:06.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3089999999999998e-06 2024-09-13T05:12:06.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095333+0000", 2024-09-13T05:12:06.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6239999999999999e-06 2024-09-13T05:12:06.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095335+0000", 2024-09-13T05:12:06.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5660000000000001e-06 2024-09-13T05:12:06.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151468+0000", 2024-09-13T05:12:06.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056132608000000001 2024-09-13T05:12:06.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151519+0000", 2024-09-13T05:12:06.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1681000000000002e-05 2024-09-13T05:12:06.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151587+0000", 2024-09-13T05:12:06.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7200999999999996e-05 2024-09-13T05:12:06.980 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.980 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.980 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.980 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136563 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3937280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:06.980 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:06.981 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.869643504000001, 2024-09-13T05:12:06.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056393051999999999, 2024-09-13T05:12:06.981 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.981 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.981 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136563 2024-09-13T05:12:06.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.982 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:06.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:06.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:06.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:12:06.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095340+0000", 2024-09-13T05:12:06.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.561e-06 2024-09-13T05:12:06.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095342+0000", 2024-09-13T05:12:06.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8059999999999999e-06 2024-09-13T05:12:06.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095345+0000", 2024-09-13T05:12:06.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:12:06.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151621+0000", 2024-09-13T05:12:06.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056275602000000001 2024-09-13T05:12:06.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151670+0000", 2024-09-13T05:12:06.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9478000000000003e-05 2024-09-13T05:12:06.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151731+0000", 2024-09-13T05:12:06.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1054000000000002e-05 2024-09-13T05:12:06.987 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.987 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.987 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.987 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136565 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3951616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:06.987 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:12:06.988 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.86963319, 2024-09-13T05:12:06.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056524090999999999, 2024-09-13T05:12:06.988 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.988 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.988 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.988 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.988 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.988 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136565 2024-09-13T05:12:06.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.989 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:12:06.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:12:06.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095348+0000", 2024-09-13T05:12:06.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:12:06.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095350+0000", 2024-09-13T05:12:06.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4479999999999999e-06 2024-09-13T05:12:06.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095353+0000", 2024-09-13T05:12:06.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.909e-06 2024-09-13T05:12:06.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095356+0000", 2024-09-13T05:12:06.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:12:06.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151763+0000", 2024-09-13T05:12:06.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056407813000000001 2024-09-13T05:12:06.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151812+0000", 2024-09-13T05:12:06.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8306999999999997e-05 2024-09-13T05:12:06.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151873+0000", 2024-09-13T05:12:06.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1064999999999999e-05 2024-09-13T05:12:06.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.992 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.992 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136567 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3965952~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:06.992 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:12:06.992 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.869624164999999, 2024-09-13T05:12:06.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056653907000000003, 2024-09-13T05:12:06.993 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.993 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.993 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136567 2024-09-13T05:12:06.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.993 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:12:06.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:12:06.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095357+0000", 2024-09-13T05:12:06.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:06.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095359+0000", 2024-09-13T05:12:06.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:12:06.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095362+0000", 2024-09-13T05:12:06.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7939999999999998e-06 2024-09-13T05:12:06.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095365+0000", 2024-09-13T05:12:06.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9979999999999999e-06 2024-09-13T05:12:06.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:06.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151904+0000", 2024-09-13T05:12:06.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056539308000000003 2024-09-13T05:12:06.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:06.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151953+0000", 2024-09-13T05:12:06.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8760000000000001e-05 2024-09-13T05:12:06.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:06.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152012+0000", 2024-09-13T05:12:06.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8761999999999997e-05 2024-09-13T05:12:06.996 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.996 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:06.996 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:06.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.997 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136569 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3980288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:06.997 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:06.997 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.869588411000001, 2024-09-13T05:12:06.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056771237000000002, 2024-09-13T05:12:06.997 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:06.997 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:06.997 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:06.997 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:06.997 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:06.997 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136569 2024-09-13T05:12:06.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.997 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:06.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:06.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:06.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:06.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:06.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:06.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:06.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:06.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:06.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:06.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095395+0000", 2024-09-13T05:12:06.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8870000000000001e-06 2024-09-13T05:12:06.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:06.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095402+0000", 2024-09-13T05:12:06.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6290000000000001e-06 2024-09-13T05:12:06.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:06.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:06.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:06.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095412+0000", 2024-09-13T05:12:07.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1730000000000001e-06 2024-09-13T05:12:07.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152044+0000", 2024-09-13T05:12:07.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056632016 2024-09-13T05:12:07.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152093+0000", 2024-09-13T05:12:07.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9570000000000001e-05 2024-09-13T05:12:07.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152165+0000", 2024-09-13T05:12:07.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1443e-05 2024-09-13T05:12:07.001 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.001 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.001 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.001 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136571 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3994624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.001 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:07.001 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.869567396000001, 2024-09-13T05:12:07.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056894741999999998, 2024-09-13T05:12:07.001 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.001 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.001 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.002 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136571 2024-09-13T05:12:07.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.002 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:07.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:07.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:07.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:07.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095418+0000", 2024-09-13T05:12:07.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0210000000000001e-06 2024-09-13T05:12:07.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095422+0000", 2024-09-13T05:12:07.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5310000000000002e-06 2024-09-13T05:12:07.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095425+0000", 2024-09-13T05:12:07.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8880000000000001e-06 2024-09-13T05:12:07.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152198+0000", 2024-09-13T05:12:07.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056773563999999999 2024-09-13T05:12:07.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152249+0000", 2024-09-13T05:12:07.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1168999999999997e-05 2024-09-13T05:12:07.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152309+0000", 2024-09-13T05:12:07.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9821999999999997e-05 2024-09-13T05:12:07.006 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.006 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.006 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.006 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136573 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4008960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.006 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:12:07.006 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.869555169, 2024-09-13T05:12:07.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057045810000000002, 2024-09-13T05:12:07.006 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.006 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.006 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.006 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.006 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.007 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136573 2024-09-13T05:12:07.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.007 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:12:07.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:12:07.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095426+0000", 2024-09-13T05:12:07.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:07.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095428+0000", 2024-09-13T05:12:07.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.593e-06 2024-09-13T05:12:07.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095431+0000", 2024-09-13T05:12:07.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9610000000000001e-06 2024-09-13T05:12:07.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095434+0000", 2024-09-13T05:12:07.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:12:07.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152352+0000", 2024-09-13T05:12:07.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05691881 2024-09-13T05:12:07.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152401+0000", 2024-09-13T05:12:07.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8995000000000001e-05 2024-09-13T05:12:07.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152472+0000", 2024-09-13T05:12:07.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1060000000000001e-05 2024-09-13T05:12:07.010 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.010 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.010 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.010 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136575 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4023296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.010 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:12:07.010 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.869125176000001, 2024-09-13T05:12:07.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056760069000000003, 2024-09-13T05:12:07.011 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.011 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.011 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.011 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.011 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.011 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136575 2024-09-13T05:12:07.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.011 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:12:07.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:12:07.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095437+0000", 2024-09-13T05:12:07.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9995799 2024-09-13T05:12:07.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095861+0000", 2024-09-13T05:12:07.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000424299 2024-09-13T05:12:07.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095869+0000", 2024-09-13T05:12:07.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5020000000000003e-06 2024-09-13T05:12:07.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095875+0000", 2024-09-13T05:12:07.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:12:07.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152502+0000", 2024-09-13T05:12:07.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056626528000000002 2024-09-13T05:12:07.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152556+0000", 2024-09-13T05:12:07.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4271000000000003e-05 2024-09-13T05:12:07.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152617+0000", 2024-09-13T05:12:07.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0896000000000001e-05 2024-09-13T05:12:07.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.014 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.015 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136577 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4037632~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.015 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:12:07.015 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.869023721, 2024-09-13T05:12:07.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056798242999999998, 2024-09-13T05:12:07.015 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.015 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.015 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136577 2024-09-13T05:12:07.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.015 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:12:07.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:12:07.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095882+0000", 2024-09-13T05:12:07.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999242 2024-09-13T05:12:07.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095961+0000", 2024-09-13T05:12:07.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8864999999999998e-05 2024-09-13T05:12:07.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095973+0000", 2024-09-13T05:12:07.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2206e-05 2024-09-13T05:12:07.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095978+0000", 2024-09-13T05:12:07.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0629999999999996e-06 2024-09-13T05:12:07.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152646+0000", 2024-09-13T05:12:07.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056668035999999998 2024-09-13T05:12:07.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152695+0000", 2024-09-13T05:12:07.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8634000000000002e-05 2024-09-13T05:12:07.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152756+0000", 2024-09-13T05:12:07.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1315000000000005e-05 2024-09-13T05:12:07.019 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.019 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.019 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.019 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136579 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4051968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.019 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:12:07.020 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.868695626000001, 2024-09-13T05:12:07.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056610869000000001, 2024-09-13T05:12:07.020 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.020 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.020 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136579 2024-09-13T05:12:07.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.020 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:12:07.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:12:07.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095989+0000", 2024-09-13T05:12:07.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997029 2024-09-13T05:12:07.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096291+0000", 2024-09-13T05:12:07.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030221499999999999 2024-09-13T05:12:07.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096300+0000", 2024-09-13T05:12:07.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4819999999999994e-06 2024-09-13T05:12:07.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096306+0000", 2024-09-13T05:12:07.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:12:07.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152788+0000", 2024-09-13T05:12:07.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056481625000000001 2024-09-13T05:12:07.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152837+0000", 2024-09-13T05:12:07.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9345000000000003e-05 2024-09-13T05:12:07.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152897+0000", 2024-09-13T05:12:07.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9892999999999997e-05 2024-09-13T05:12:07.023 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.023 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.024 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.024 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136581 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4066304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.024 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:12:07.024 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.868516799, 2024-09-13T05:12:07.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056597091000000002, 2024-09-13T05:12:07.024 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.024 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.024 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.024 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.024 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.024 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136581 2024-09-13T05:12:07.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.025 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:12:07.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:12:07.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096312+0000", 2024-09-13T05:12:07.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998465 2024-09-13T05:12:07.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096469+0000", 2024-09-13T05:12:07.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157109 2024-09-13T05:12:07.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096478+0000", 2024-09-13T05:12:07.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3260000000000002e-06 2024-09-13T05:12:07.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096482+0000", 2024-09-13T05:12:07.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9720000000000003e-06 2024-09-13T05:12:07.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152933+0000", 2024-09-13T05:12:07.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056451128000000003 2024-09-13T05:12:07.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152993+0000", 2024-09-13T05:12:07.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9947000000000001e-05 2024-09-13T05:12:07.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153062+0000", 2024-09-13T05:12:07.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9105999999999999e-05 2024-09-13T05:12:07.028 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.028 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.029 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.029 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136583 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4080640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.029 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:12:07.029 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.868250886, 2024-09-13T05:12:07.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056496609000000003, 2024-09-13T05:12:07.029 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.029 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.029 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.029 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.029 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.029 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136583 2024-09-13T05:12:07.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.030 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:12:07.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:12:07.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096485+0000", 2024-09-13T05:12:07.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997544 2024-09-13T05:12:07.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096735+0000", 2024-09-13T05:12:07.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024979899999999998 2024-09-13T05:12:07.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096742+0000", 2024-09-13T05:12:07.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7139999999999996e-06 2024-09-13T05:12:07.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096747+0000", 2024-09-13T05:12:07.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8709999999999996e-06 2024-09-13T05:12:07.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153099+0000", 2024-09-13T05:12:07.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056352639000000003 2024-09-13T05:12:07.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153168+0000", 2024-09-13T05:12:07.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9029000000000006e-05 2024-09-13T05:12:07.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153228+0000", 2024-09-13T05:12:07.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9339999999999998e-05 2024-09-13T05:12:07.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.033 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.033 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136585 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4094976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.033 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:12:07.033 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.867999419, 2024-09-13T05:12:07.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056396420000000003, 2024-09-13T05:12:07.034 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.034 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.034 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136585 2024-09-13T05:12:07.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.034 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:12:07.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:12:07.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096750+0000", 2024-09-13T05:12:07.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997673 2024-09-13T05:12:07.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096986+0000", 2024-09-13T05:12:07.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000236297 2024-09-13T05:12:07.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096993+0000", 2024-09-13T05:12:07.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9600000000000003e-06 2024-09-13T05:12:07.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096999+0000", 2024-09-13T05:12:07.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:12:07.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153264+0000", 2024-09-13T05:12:07.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056264728999999999 2024-09-13T05:12:07.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153318+0000", 2024-09-13T05:12:07.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3934000000000002e-05 2024-09-13T05:12:07.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153379+0000", 2024-09-13T05:12:07.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1206999999999999e-05 2024-09-13T05:12:07.038 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.038 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.038 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.038 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136586 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4109312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.038 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:12:07.038 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.867798617, 2024-09-13T05:12:07.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056374703999999998, 2024-09-13T05:12:07.038 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.038 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.038 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.038 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.038 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.039 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136586 2024-09-13T05:12:07.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.039 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:12:07.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:12:07.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097004+0000", 2024-09-13T05:12:07.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998207 2024-09-13T05:12:07.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097187+0000", 2024-09-13T05:12:07.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018337900000000001 2024-09-13T05:12:07.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097198+0000", 2024-09-13T05:12:07.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348e-05 2024-09-13T05:12:07.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097202+0000", 2024-09-13T05:12:07.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.121e-06 2024-09-13T05:12:07.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153411+0000", 2024-09-13T05:12:07.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056209510999999997 2024-09-13T05:12:07.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153464+0000", 2024-09-13T05:12:07.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2605000000000002e-05 2024-09-13T05:12:07.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153558+0000", 2024-09-13T05:12:07.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4017999999999993e-05 2024-09-13T05:12:07.042 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.042 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.042 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.042 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136588 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.042 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:12:07.042 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.867514434, 2024-09-13T05:12:07.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056274980000000002, 2024-09-13T05:12:07.043 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.043 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.043 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136588 2024-09-13T05:12:07.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.043 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:12:07.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:12:07.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097205+0000", 2024-09-13T05:12:07.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997377 2024-09-13T05:12:07.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097471+0000", 2024-09-13T05:12:07.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026628200000000001 2024-09-13T05:12:07.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097484+0000", 2024-09-13T05:12:07.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2493e-05 2024-09-13T05:12:07.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097488+0000", 2024-09-13T05:12:07.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9330000000000003e-06 2024-09-13T05:12:07.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153600+0000", 2024-09-13T05:12:07.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056112097 2024-09-13T05:12:07.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153654+0000", 2024-09-13T05:12:07.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4126000000000003e-05 2024-09-13T05:12:07.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153742+0000", 2024-09-13T05:12:07.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.831e-05 2024-09-13T05:12:07.046 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.046 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.046 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.047 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136589 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4137984~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.047 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:12:07.047 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.867375127000001, 2024-09-13T05:12:07.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056293867999999997, 2024-09-13T05:12:07.047 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.047 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.047 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.047 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.047 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.047 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136589 2024-09-13T05:12:07.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.047 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:12:07.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:12:07.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097491+0000", 2024-09-13T05:12:07.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998841 2024-09-13T05:12:07.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097610+0000", 2024-09-13T05:12:07.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119263 2024-09-13T05:12:07.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097617+0000", 2024-09-13T05:12:07.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6490000000000002e-06 2024-09-13T05:12:07.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097624+0000", 2024-09-13T05:12:07.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6309999999999997e-06 2024-09-13T05:12:07.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153779+0000", 2024-09-13T05:12:07.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056155153999999999 2024-09-13T05:12:07.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153831+0000", 2024-09-13T05:12:07.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2080000000000003e-05 2024-09-13T05:12:07.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153901+0000", 2024-09-13T05:12:07.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9765999999999996e-05 2024-09-13T05:12:07.051 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.051 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.051 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.051 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136591 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4152320~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.051 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097930+0000", 2024-09-13T05:12:07.051 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.867051575, 2024-09-13T05:12:07.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056118910000000001, 2024-09-13T05:12:07.051 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.051 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.052 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136591 2024-09-13T05:12:07.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.052 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097930+0000", 2024-09-13T05:12:07.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097930+0000", 2024-09-13T05:12:07.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097627+0000", 2024-09-13T05:12:07.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9996967 2024-09-13T05:12:07.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097934+0000", 2024-09-13T05:12:07.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030723700000000003 2024-09-13T05:12:07.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097941+0000", 2024-09-13T05:12:07.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.776e-06 2024-09-13T05:12:07.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097945+0000", 2024-09-13T05:12:07.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7809999999999999e-06 2024-09-13T05:12:07.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153937+0000", 2024-09-13T05:12:07.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055992078000000001 2024-09-13T05:12:07.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153987+0000", 2024-09-13T05:12:07.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0204000000000002e-05 2024-09-13T05:12:07.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.154049+0000", 2024-09-13T05:12:07.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2012000000000002e-05 2024-09-13T05:12:07.056 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.056 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.056 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.056 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136965 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3366912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.056 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:12:07.056 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.847406306, 2024-09-13T05:12:07.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056225403, 2024-09-13T05:12:07.056 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.056 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.056 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.056 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.057 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.057 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136965 2024-09-13T05:12:07.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.057 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:12:07.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:12:07.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117575+0000", 2024-09-13T05:12:07.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:07.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117578+0000", 2024-09-13T05:12:07.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4899999999999999e-06 2024-09-13T05:12:07.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117583+0000", 2024-09-13T05:12:07.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.074e-06 2024-09-13T05:12:07.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117587+0000", 2024-09-13T05:12:07.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5360000000000003e-06 2024-09-13T05:12:07.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173622+0000", 2024-09-13T05:12:07.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056034527000000001 2024-09-13T05:12:07.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173704+0000", 2024-09-13T05:12:07.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2137000000000003e-05 2024-09-13T05:12:07.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173801+0000", 2024-09-13T05:12:07.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7048999999999999e-05 2024-09-13T05:12:07.060 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.060 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.060 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.060 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136991 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3553280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.061 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:07.061 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.843480529000001, 2024-09-13T05:12:07.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056330199999999997, 2024-09-13T05:12:07.061 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.061 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.061 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136991 2024-09-13T05:12:07.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.061 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:07.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:07.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:07.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:07.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121504+0000", 2024-09-13T05:12:07.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7199999999999998e-06 2024-09-13T05:12:07.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121510+0000", 2024-09-13T05:12:07.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3459999999999999e-06 2024-09-13T05:12:07.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121515+0000", 2024-09-13T05:12:07.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.656e-06 2024-09-13T05:12:07.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177608+0000", 2024-09-13T05:12:07.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056093267000000002 2024-09-13T05:12:07.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177717+0000", 2024-09-13T05:12:07.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010901299999999999 2024-09-13T05:12:07.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177832+0000", 2024-09-13T05:12:07.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114604 2024-09-13T05:12:07.065 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.065 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.065 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.065 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.065 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.065 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:07.066 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:12:07.067 INFO:teuthology.orchestra.run.smithi120.stdout:5136 write 0x9977854 thru 0x9979434 (0x1be1 bytes) 2024-09-13T05:12:07.067 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:07.064+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:07.167 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:07.164+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:07.171 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:07.171 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:07.171 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:07.171 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:07.181 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:12:07.268 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:07.264+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:07.341 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:07.341 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:07.341 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:07.341 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:07.341 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:07.351 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:12:07.369 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:07.361+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:07.454 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:07.454 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:07.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:07.454 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:07.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.454 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:70758 3.2 3:427d0469:::rbd_header.112d8d1317eb:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-13T05:12:07.454 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:07.454 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.023558430999998, 2024-09-13T05:12:07.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.190313603, 2024-09-13T05:12:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70758 2024-09-13T05:12:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428654+0000", 2024-09-13T05:12:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428664+0000", 2024-09-13T05:12:07.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0664e-05 2024-09-13T05:12:07.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428683+0000", 2024-09-13T05:12:07.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8377e-05 2024-09-13T05:12:07.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428691+0000", 2024-09-13T05:12:07.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9400000000000008e-06 2024-09-13T05:12:07.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428789+0000", 2024-09-13T05:12:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7165999999999998e-05 2024-09-13T05:12:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428811+0000", 2024-09-13T05:12:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1925000000000001e-05 2024-09-13T05:12:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.617921+0000", 2024-09-13T05:12:07.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.189110536 2024-09-13T05:12:07.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618344+0000", 2024-09-13T05:12:07.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042245800000000001 2024-09-13T05:12:07.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618969+0000", 2024-09-13T05:12:07.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062529299999999996 2024-09-13T05:12:07.459 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.459 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135319 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 1397760~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.694864+0000", 2024-09-13T05:12:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.757349357000001, 2024-09-13T05:12:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061707414000000002, 2024-09-13T05:12:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135319 2024-09-13T05:12:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694864+0000", 2024-09-13T05:12:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694864+0000", 2024-09-13T05:12:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694864+0000", 2024-09-13T05:12:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694867+0000", 2024-09-13T05:12:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.01e-06 2024-09-13T05:12:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694874+0000", 2024-09-13T05:12:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5220000000000001e-06 2024-09-13T05:12:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694881+0000", 2024-09-13T05:12:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2260000000000002e-06 2024-09-13T05:12:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.756298+0000", 2024-09-13T05:12:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061417241999999997 2024-09-13T05:12:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.756424+0000", 2024-09-13T05:12:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012636 2024-09-13T05:12:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.756572+0000", 2024-09-13T05:12:07.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014749399999999999 2024-09-13T05:12:07.464 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.464 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.464 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.465 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135320 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 1412096~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.465 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.694887+0000", 2024-09-13T05:12:07.465 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.757326339, 2024-09-13T05:12:07.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061814784999999997, 2024-09-13T05:12:07.465 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.465 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.465 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.465 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.465 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.465 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135320 2024-09-13T05:12:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694887+0000", 2024-09-13T05:12:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694887+0000", 2024-09-13T05:12:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694886+0000", 2024-09-13T05:12:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694890+0000", 2024-09-13T05:12:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2400000000000001e-06 2024-09-13T05:12:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694897+0000", 2024-09-13T05:12:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2869999999999999e-06 2024-09-13T05:12:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694904+0000", 2024-09-13T05:12:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.063e-06 2024-09-13T05:12:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.756591+0000", 2024-09-13T05:12:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061686356999999997 2024-09-13T05:12:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.756639+0000", 2024-09-13T05:12:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8724999999999999e-05 2024-09-13T05:12:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.756702+0000", 2024-09-13T05:12:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2693000000000004e-05 2024-09-13T05:12:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135321 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 1426432~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.694919+0000", 2024-09-13T05:12:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.757294927, 2024-09-13T05:12:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062137276999999998, 2024-09-13T05:12:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135321 2024-09-13T05:12:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694919+0000", 2024-09-13T05:12:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694919+0000", 2024-09-13T05:12:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694918+0000", 2024-09-13T05:12:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:07.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694925+0000", 2024-09-13T05:12:07.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4930000000000003e-06 2024-09-13T05:12:07.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694932+0000", 2024-09-13T05:12:07.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6120000000000001e-06 2024-09-13T05:12:07.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694939+0000", 2024-09-13T05:12:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6719999999999998e-06 2024-09-13T05:12:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.756772+0000", 2024-09-13T05:12:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061833291999999998 2024-09-13T05:12:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.756898+0000", 2024-09-13T05:12:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012527799999999999 2024-09-13T05:12:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.757056+0000", 2024-09-13T05:12:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015851400000000001 2024-09-13T05:12:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135322 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 1440768~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.694945+0000", 2024-09-13T05:12:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.757268473, 2024-09-13T05:12:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062247731000000001, 2024-09-13T05:12:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135322 2024-09-13T05:12:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694945+0000", 2024-09-13T05:12:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694945+0000", 2024-09-13T05:12:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694945+0000", 2024-09-13T05:12:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694948+0000", 2024-09-13T05:12:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.315e-06 2024-09-13T05:12:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694965+0000", 2024-09-13T05:12:07.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7110000000000001e-05 2024-09-13T05:12:07.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.694972+0000", 2024-09-13T05:12:07.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8739999999999997e-06 2024-09-13T05:12:07.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.757079+0000", 2024-09-13T05:12:07.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062106806000000001 2024-09-13T05:12:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.757128+0000", 2024-09-13T05:12:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9586000000000003e-05 2024-09-13T05:12:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.757193+0000", 2024-09-13T05:12:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4636999999999998e-05 2024-09-13T05:12:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135329 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 1541120~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.697250+0000", 2024-09-13T05:12:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.754963762999999, 2024-09-13T05:12:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061747999999999997, 2024-09-13T05:12:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135329 2024-09-13T05:12:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697250+0000", 2024-09-13T05:12:07.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697250+0000", 2024-09-13T05:12:07.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697249+0000", 2024-09-13T05:12:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697253+0000", 2024-09-13T05:12:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2780000000000002e-06 2024-09-13T05:12:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697260+0000", 2024-09-13T05:12:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9469999999999997e-06 2024-09-13T05:12:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697266+0000", 2024-09-13T05:12:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0159999999999997e-06 2024-09-13T05:12:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.758745+0000", 2024-09-13T05:12:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061479383999999998 2024-09-13T05:12:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.758863+0000", 2024-09-13T05:12:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011804 2024-09-13T05:12:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.758998+0000", 2024-09-13T05:12:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013477500000000001 2024-09-13T05:12:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135330 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 1555456~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.697273+0000", 2024-09-13T05:12:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.754940807000001, 2024-09-13T05:12:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061888229000000003, 2024-09-13T05:12:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135330 2024-09-13T05:12:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697273+0000", 2024-09-13T05:12:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697273+0000", 2024-09-13T05:12:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697272+0000", 2024-09-13T05:12:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697276+0000", 2024-09-13T05:12:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2260000000000001e-06 2024-09-13T05:12:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697283+0000", 2024-09-13T05:12:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9269999999999999e-06 2024-09-13T05:12:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697289+0000", 2024-09-13T05:12:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.229e-06 2024-09-13T05:12:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759040+0000", 2024-09-13T05:12:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061751440999999997 2024-09-13T05:12:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759094+0000", 2024-09-13T05:12:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3440999999999999e-05 2024-09-13T05:12:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759161+0000", 2024-09-13T05:12:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7447999999999995e-05 2024-09-13T05:12:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135331 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 1569792~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.697296+0000", 2024-09-13T05:12:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.754917409000001, 2024-09-13T05:12:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062128121000000001, 2024-09-13T05:12:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135331 2024-09-13T05:12:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697296+0000", 2024-09-13T05:12:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697296+0000", 2024-09-13T05:12:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697296+0000", 2024-09-13T05:12:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697299+0000", 2024-09-13T05:12:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.315e-06 2024-09-13T05:12:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697306+0000", 2024-09-13T05:12:07.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1600000000000001e-06 2024-09-13T05:12:07.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697313+0000", 2024-09-13T05:12:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4300000000000003e-06 2024-09-13T05:12:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759234+0000", 2024-09-13T05:12:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061921797000000001 2024-09-13T05:12:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759350+0000", 2024-09-13T05:12:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115986 2024-09-13T05:12:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759424+0000", 2024-09-13T05:12:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3930999999999994e-05 2024-09-13T05:12:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135332 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 8192~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.697328+0000", 2024-09-13T05:12:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.754885478, 2024-09-13T05:12:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062249958000000001, 2024-09-13T05:12:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135332 2024-09-13T05:12:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697328+0000", 2024-09-13T05:12:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697328+0000", 2024-09-13T05:12:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697327+0000", 2024-09-13T05:12:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697331+0000", 2024-09-13T05:12:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.568e-06 2024-09-13T05:12:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697340+0000", 2024-09-13T05:12:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7260000000000008e-06 2024-09-13T05:12:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697361+0000", 2024-09-13T05:12:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0959e-05 2024-09-13T05:12:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759460+0000", 2024-09-13T05:12:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062099092000000002 2024-09-13T05:12:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759510+0000", 2024-09-13T05:12:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0457999999999997e-05 2024-09-13T05:12:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759578+0000", 2024-09-13T05:12:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7881999999999998e-05 2024-09-13T05:12:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135333 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 22528~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.697365+0000", 2024-09-13T05:12:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.754848564, 2024-09-13T05:12:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062345834000000003, 2024-09-13T05:12:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135333 2024-09-13T05:12:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697365+0000", 2024-09-13T05:12:07.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697365+0000", 2024-09-13T05:12:07.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697365+0000", 2024-09-13T05:12:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697388+0000", 2024-09-13T05:12:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2745e-05 2024-09-13T05:12:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697396+0000", 2024-09-13T05:12:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4700000000000002e-06 2024-09-13T05:12:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697402+0000", 2024-09-13T05:12:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6239999999999999e-06 2024-09-13T05:12:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759605+0000", 2024-09-13T05:12:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062203062000000003 2024-09-13T05:12:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759652+0000", 2024-09-13T05:12:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7561000000000001e-05 2024-09-13T05:12:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759711+0000", 2024-09-13T05:12:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8743999999999999e-05 2024-09-13T05:12:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.504 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135334 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 36864~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.504 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.697455+0000", 2024-09-13T05:12:07.504 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.754758272, 2024-09-13T05:12:07.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062617093999999998, 2024-09-13T05:12:07.504 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.504 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.504 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.504 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.505 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.505 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135334 2024-09-13T05:12:07.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.505 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697455+0000", 2024-09-13T05:12:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697455+0000", 2024-09-13T05:12:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697406+0000", 2024-09-13T05:12:07.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999509 2024-09-13T05:12:07.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697460+0000", 2024-09-13T05:12:07.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3224999999999999e-05 2024-09-13T05:12:07.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697467+0000", 2024-09-13T05:12:07.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3950000000000003e-06 2024-09-13T05:12:07.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.697473+0000", 2024-09-13T05:12:07.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4269999999999996e-06 2024-09-13T05:12:07.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759769+0000", 2024-09-13T05:12:07.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062295467 2024-09-13T05:12:07.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.759904+0000", 2024-09-13T05:12:07.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134831 2024-09-13T05:12:07.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.760073+0000", 2024-09-13T05:12:07.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016886200000000001 2024-09-13T05:12:07.509 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.509 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.509 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.509 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135348 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 237568~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.509 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.701225+0000", 2024-09-13T05:12:07.509 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.750988247, 2024-09-13T05:12:07.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061582350000000001, 2024-09-13T05:12:07.509 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.510 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.510 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.510 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.510 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.510 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135348 2024-09-13T05:12:07.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.510 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701225+0000", 2024-09-13T05:12:07.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701225+0000", 2024-09-13T05:12:07.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701225+0000", 2024-09-13T05:12:07.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:07.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701228+0000", 2024-09-13T05:12:07.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8219999999999998e-06 2024-09-13T05:12:07.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701233+0000", 2024-09-13T05:12:07.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4140000000000002e-06 2024-09-13T05:12:07.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701239+0000", 2024-09-13T05:12:07.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7520000000000002e-06 2024-09-13T05:12:07.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.762690+0000", 2024-09-13T05:12:07.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061451257000000002 2024-09-13T05:12:07.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.762744+0000", 2024-09-13T05:12:07.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3884000000000001e-05 2024-09-13T05:12:07.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.762808+0000", 2024-09-13T05:12:07.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3830000000000004e-05 2024-09-13T05:12:07.514 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.514 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.514 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.515 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135349 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 251904~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.515 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.701244+0000", 2024-09-13T05:12:07.515 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.75096984, 2024-09-13T05:12:07.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061703169000000002, 2024-09-13T05:12:07.515 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.515 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.515 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.515 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.515 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.515 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135349 2024-09-13T05:12:07.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.515 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701244+0000", 2024-09-13T05:12:07.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701244+0000", 2024-09-13T05:12:07.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701243+0000", 2024-09-13T05:12:07.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:07.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701246+0000", 2024-09-13T05:12:07.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0240000000000002e-06 2024-09-13T05:12:07.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701253+0000", 2024-09-13T05:12:07.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4409999999999998e-06 2024-09-13T05:12:07.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701258+0000", 2024-09-13T05:12:07.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0880000000000002e-06 2024-09-13T05:12:07.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.762838+0000", 2024-09-13T05:12:07.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061580324999999998 2024-09-13T05:12:07.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.762885+0000", 2024-09-13T05:12:07.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6526000000000001e-05 2024-09-13T05:12:07.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.762947+0000", 2024-09-13T05:12:07.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2212999999999995e-05 2024-09-13T05:12:07.520 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.520 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.520 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.520 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135350 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 266240~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.520 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.701263+0000", 2024-09-13T05:12:07.520 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.750951069999999, 2024-09-13T05:12:07.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061884512000000003, 2024-09-13T05:12:07.521 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.521 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.521 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.521 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.521 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.521 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135350 2024-09-13T05:12:07.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.521 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701263+0000", 2024-09-13T05:12:07.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701263+0000", 2024-09-13T05:12:07.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701262+0000", 2024-09-13T05:12:07.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:07.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701265+0000", 2024-09-13T05:12:07.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5500000000000001e-06 2024-09-13T05:12:07.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701271+0000", 2024-09-13T05:12:07.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0120000000000002e-06 2024-09-13T05:12:07.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701276+0000", 2024-09-13T05:12:07.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1309999999999997e-06 2024-09-13T05:12:07.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.762996+0000", 2024-09-13T05:12:07.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061719860000000001 2024-09-13T05:12:07.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.763059+0000", 2024-09-13T05:12:07.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2983000000000003e-05 2024-09-13T05:12:07.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.763147+0000", 2024-09-13T05:12:07.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8300000000000005e-05 2024-09-13T05:12:07.526 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.526 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.526 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.527 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135351 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 280576~1024] snapc 0=[] RETRY=5 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.527 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.701280+0000", 2024-09-13T05:12:07.527 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.750933285, 2024-09-13T05:12:07.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.062054665000000002, 2024-09-13T05:12:07.527 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.527 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.527 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.527 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.527 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.527 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135351 2024-09-13T05:12:07.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.527 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701280+0000", 2024-09-13T05:12:07.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701280+0000", 2024-09-13T05:12:07.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701280+0000", 2024-09-13T05:12:07.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:07.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701283+0000", 2024-09-13T05:12:07.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6010000000000002e-06 2024-09-13T05:12:07.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701290+0000", 2024-09-13T05:12:07.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8839999999999997e-06 2024-09-13T05:12:07.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.701294+0000", 2024-09-13T05:12:07.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.826e-06 2024-09-13T05:12:07.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.763191+0000", 2024-09-13T05:12:07.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061896944000000002 2024-09-13T05:12:07.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.763271+0000", 2024-09-13T05:12:07.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0006999999999995e-05 2024-09-13T05:12:07.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.763335+0000", 2024-09-13T05:12:07.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3740999999999998e-05 2024-09-13T05:12:07.532 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.532 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.532 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.533 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135377 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 638976~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.533 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.705635+0000", 2024-09-13T05:12:07.533 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.746578524, 2024-09-13T05:12:07.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061486266999999997, 2024-09-13T05:12:07.533 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.533 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.533 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.533 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.533 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.533 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135377 2024-09-13T05:12:07.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.533 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705635+0000", 2024-09-13T05:12:07.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705635+0000", 2024-09-13T05:12:07.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705635+0000", 2024-09-13T05:12:07.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:07.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705639+0000", 2024-09-13T05:12:07.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9820000000000002e-06 2024-09-13T05:12:07.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705645+0000", 2024-09-13T05:12:07.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7399999999999998e-06 2024-09-13T05:12:07.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705650+0000", 2024-09-13T05:12:07.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.335e-06 2024-09-13T05:12:07.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.766994+0000", 2024-09-13T05:12:07.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061344309999999999 2024-09-13T05:12:07.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767055+0000", 2024-09-13T05:12:07.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1464000000000006e-05 2024-09-13T05:12:07.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767121+0000", 2024-09-13T05:12:07.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.601e-05 2024-09-13T05:12:07.537 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.537 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.538 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.538 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135378 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 653312~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.538 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.705653+0000", 2024-09-13T05:12:07.538 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.746560448, 2024-09-13T05:12:07.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061633412999999998, 2024-09-13T05:12:07.538 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.538 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.538 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.538 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.538 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.538 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135378 2024-09-13T05:12:07.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.539 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705653+0000", 2024-09-13T05:12:07.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705653+0000", 2024-09-13T05:12:07.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705653+0000", 2024-09-13T05:12:07.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:07.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705655+0000", 2024-09-13T05:12:07.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3889999999999999e-06 2024-09-13T05:12:07.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705660+0000", 2024-09-13T05:12:07.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3420000000000001e-06 2024-09-13T05:12:07.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705663+0000", 2024-09-13T05:12:07.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9809999999999997e-06 2024-09-13T05:12:07.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767152+0000", 2024-09-13T05:12:07.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061488084999999998 2024-09-13T05:12:07.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767217+0000", 2024-09-13T05:12:07.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5747000000000006e-05 2024-09-13T05:12:07.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767287+0000", 2024-09-13T05:12:07.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9330000000000002e-05 2024-09-13T05:12:07.542 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.542 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.542 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.542 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135379 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 667648~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.542 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.705667+0000", 2024-09-13T05:12:07.542 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.746546657, 2024-09-13T05:12:07.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061770584000000003, 2024-09-13T05:12:07.543 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.543 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.543 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.543 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.543 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.543 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135379 2024-09-13T05:12:07.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.543 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705667+0000", 2024-09-13T05:12:07.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705667+0000", 2024-09-13T05:12:07.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705667+0000", 2024-09-13T05:12:07.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:07.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705669+0000", 2024-09-13T05:12:07.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1040000000000001e-06 2024-09-13T05:12:07.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705673+0000", 2024-09-13T05:12:07.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3059999999999999e-06 2024-09-13T05:12:07.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705677+0000", 2024-09-13T05:12:07.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0459999999999999e-06 2024-09-13T05:12:07.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767316+0000", 2024-09-13T05:12:07.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061639237999999999 2024-09-13T05:12:07.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767370+0000", 2024-09-13T05:12:07.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3270000000000003e-05 2024-09-13T05:12:07.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767438+0000", 2024-09-13T05:12:07.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7951e-05 2024-09-13T05:12:07.550 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.550 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.550 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.551 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:135380 3.8 3:168cf5c3:::rbd_data.112d52e08ead.0000000000000004:27 [read 681984~1024] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:07.551 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:52.705681+0000", 2024-09-13T05:12:07.551 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.746533184, 2024-09-13T05:12:07.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061931205000000003, 2024-09-13T05:12:07.551 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.551 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:07.551 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:07.551 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:07.551 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:07.551 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 135380 2024-09-13T05:12:07.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.551 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705681+0000", 2024-09-13T05:12:07.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705681+0000", 2024-09-13T05:12:07.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705680+0000", 2024-09-13T05:12:07.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:07.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705682+0000", 2024-09-13T05:12:07.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.204e-06 2024-09-13T05:12:07.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705688+0000", 2024-09-13T05:12:07.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3820000000000003e-06 2024-09-13T05:12:07.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.705692+0000", 2024-09-13T05:12:07.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8139999999999998e-06 2024-09-13T05:12:07.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767468+0000", 2024-09-13T05:12:07.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.061776223999999998 2024-09-13T05:12:07.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767532+0000", 2024-09-13T05:12:07.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4066000000000006e-05 2024-09-13T05:12:07.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:52.767612+0000", 2024-09-13T05:12:07.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9843000000000001e-05 2024-09-13T05:12:07.555 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.555 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.555 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.555 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:157552 3.5 e112/22 3:a072521b:::rbd_data.112dc3abcba6.0000000000000006:head v 112'504, mlcod=111'502)", 2024-09-13T05:12:07.555 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:02.566884+0000", 2024-09-13T05:12:07.555 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.8853300810000002, 2024-09-13T05:12:07.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.082750025000000005, 2024-09-13T05:12:07.555 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:07.555 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:07.556 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:07.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:07.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:02.566884+0000", 2024-09-13T05:12:07.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:07.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:02.566884+0000", 2024-09-13T05:12:07.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:07.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:07.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:02.566883+0000", 2024-09-13T05:12:07.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:07.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:07.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:02.618760+0000", 2024-09-13T05:12:07.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.051877336000000003 2024-09-13T05:12:07.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:07.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:02.618792+0000", 2024-09-13T05:12:07.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1888999999999999e-05 2024-09-13T05:12:07.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:07.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:02.618805+0000", 2024-09-13T05:12:07.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2564e-05 2024-09-13T05:12:07.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:07.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:02.618900+0000", 2024-09-13T05:12:07.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5445000000000005e-05 2024-09-13T05:12:07.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:07.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:02.618918+0000", 2024-09-13T05:12:07.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7320999999999999e-05 2024-09-13T05:12:07.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:12:07.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:02.649549+0000", 2024-09-13T05:12:07.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.030631702 2024-09-13T05:12:07.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:07.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:07.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:07.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:02.649634+0000", 2024-09-13T05:12:07.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4260999999999998e-05 2024-09-13T05:12:07.559 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.559 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.559 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.559 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:07.559 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:07.559 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:07.561 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:12:07.562 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:07.553+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:07.662 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:07.657+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:07.678 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:07.678 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:07.678 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:07.678 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:07.688 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:12:07.763 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:07.757+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:07.792 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:07.793 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:07.793 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:07.793 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:07.793 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:07.802 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:12:07.863 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:07.860+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:07.959 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:07.959 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:07.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:07.959 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [] 2024-09-13T05:12:07.959 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:07.964 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:07.957+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:07.969 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:12:07.976 INFO:tasks.thrashosds.thrasher:in_osds: [2, 3, 5, 6, 7, 1] out_osds: [4, 0] dead_osds: [0] live_osds: [1, 2, 3, 4, 5, 6, 7] 2024-09-13T05:12:07.976 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:12:07.976 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-09-13T05:12:07.976 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T05:12:07.976 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T05:12:07.978 INFO:tasks.ceph.osd.0:Started 2024-09-13T05:12:07.979 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:12:08.065 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:08.064+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:08.066 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:08.066 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:08.066 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:08.067 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:08.075 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:12:08.136 INFO:teuthology.orchestra.run.smithi120.stderr:no valid command found; 10 closest matches: 2024-09-13T05:12:08.136 INFO:teuthology.orchestra.run.smithi120.stderr:0 2024-09-13T05:12:08.136 INFO:teuthology.orchestra.run.smithi120.stderr:1 2024-09-13T05:12:08.136 INFO:teuthology.orchestra.run.smithi120.stderr:2 2024-09-13T05:12:08.136 INFO:teuthology.orchestra.run.smithi120.stderr:abort 2024-09-13T05:12:08.137 INFO:teuthology.orchestra.run.smithi120.stderr:assert 2024-09-13T05:12:08.137 INFO:teuthology.orchestra.run.smithi120.stderr:config diff 2024-09-13T05:12:08.137 INFO:teuthology.orchestra.run.smithi120.stderr:config diff get 2024-09-13T05:12:08.137 INFO:teuthology.orchestra.run.smithi120.stderr:config get 2024-09-13T05:12:08.137 INFO:teuthology.orchestra.run.smithi120.stderr:config help [] 2024-09-13T05:12:08.137 INFO:teuthology.orchestra.run.smithi120.stderr:config set ... 2024-09-13T05:12:08.138 INFO:teuthology.orchestra.run.smithi120.stderr:admin_socket: invalid command 2024-09-13T05:12:08.139 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-13T05:12:08.139 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-13T05:12:08.142 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:12:08.166 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:08.164+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:08.183 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:08.183 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:08.183 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:08.183 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:08.183 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:08.193 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:12:08.267 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:08.260+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:08.296 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:08.302 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:08.303 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:08.303 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:08.303 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:08.303 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.303 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3.bb1d1096 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:08.303 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:08.303 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 44.356596905000004, 2024-09-13T05:12:08.303 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68834410099999999, 2024-09-13T05:12:08.303 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:08.303 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:08.303 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:08.303 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:08.303 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:08.304 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:12:08.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.304 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:08.304 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.304 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:08.304 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:08.304 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.304 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.304 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:08.304 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:08.304 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.305 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.305 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.305 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:08.305 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943719+0000", 2024-09-13T05:12:08.305 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:12:08.305 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.305 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.305 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:08.305 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943734+0000", 2024-09-13T05:12:08.305 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4793e-05 2024-09-13T05:12:08.305 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.306 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.306 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:08.306 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943765+0000", 2024-09-13T05:12:08.306 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0648999999999997e-05 2024-09-13T05:12:08.306 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.306 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.306 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:08.306 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943779+0000", 2024-09-13T05:12:08.306 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.447e-05 2024-09-13T05:12:08.306 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.306 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.306 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.307 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943872+0000", 2024-09-13T05:12:08.307 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3304e-05 2024-09-13T05:12:08.307 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.307 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.307 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:08.307 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943884+0000", 2024-09-13T05:12:08.307 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.167e-05 2024-09-13T05:12:08.307 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.308 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.308 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.308 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632042+0000", 2024-09-13T05:12:08.309 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68815832600000004 2024-09-13T05:12:08.309 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.309 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.309 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:08.309 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632066+0000", 2024-09-13T05:12:08.309 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3765999999999999e-05 2024-09-13T05:12:08.309 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.309 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:08.309 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.309 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.309 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.309 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3.b6bd6256 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:08.309 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:08.309 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 44.356472404999998, 2024-09-13T05:12:08.310 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68852592499999998, 2024-09-13T05:12:08.310 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:08.310 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:08.310 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:08.310 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:08.310 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:08.310 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:12:08.310 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.310 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:08.310 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.310 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:08.310 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:08.310 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.310 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.311 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.311 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:08.311 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:08.311 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.311 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.311 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.311 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:08.311 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943846+0000", 2024-09-13T05:12:08.311 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:08.311 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.311 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.311 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:08.311 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943852+0000", 2024-09-13T05:12:08.311 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3820000000000001e-06 2024-09-13T05:12:08.312 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.312 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.312 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:08.312 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943876+0000", 2024-09-13T05:12:08.312 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3995e-05 2024-09-13T05:12:08.312 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.312 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.312 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:08.312 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943898+0000", 2024-09-13T05:12:08.312 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1838999999999999e-05 2024-09-13T05:12:08.312 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.312 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.312 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.312 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946457+0000", 2024-09-13T05:12:08.313 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025588910000000002 2024-09-13T05:12:08.313 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.313 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.313 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:08.313 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946499+0000", 2024-09-13T05:12:08.313 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2814e-05 2024-09-13T05:12:08.313 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.313 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.313 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.313 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632364+0000", 2024-09-13T05:12:08.313 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68586484999999997 2024-09-13T05:12:08.313 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.313 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.314 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:08.314 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632372+0000", 2024-09-13T05:12:08.314 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1659999999999994e-06 2024-09-13T05:12:08.314 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.314 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:08.314 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.314 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.314 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.314 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3:6908b8dd:::rbd_data.112d8d1317eb.000000000000000f:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:08.314 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:08.314 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 44.319328327000001, 2024-09-13T05:12:08.314 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65181049499999999, 2024-09-13T05:12:08.315 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:08.315 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:08.315 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:08.315 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:08.315 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:08.315 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:12:08.315 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.315 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:08.315 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.315 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:08.315 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:08.315 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.315 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.315 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.315 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:08.316 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:08.316 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.316 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.316 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.316 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:08.316 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980989+0000", 2024-09-13T05:12:08.316 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:08.316 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.316 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.316 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:08.317 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980996+0000", 2024-09-13T05:12:08.317 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2200000000000003e-06 2024-09-13T05:12:08.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.317 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.317 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:08.317 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981011+0000", 2024-09-13T05:12:08.317 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4997000000000001e-05 2024-09-13T05:12:08.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.317 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.317 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:08.317 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981025+0000", 2024-09-13T05:12:08.317 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3604000000000001e-05 2024-09-13T05:12:08.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.317 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.318 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.318 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981110+0000", 2024-09-13T05:12:08.318 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4948000000000001e-05 2024-09-13T05:12:08.318 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.318 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.318 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:08.318 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981120+0000", 2024-09-13T05:12:08.318 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9399999999999997e-06 2024-09-13T05:12:08.318 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.318 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.318 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.318 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632425+0000", 2024-09-13T05:12:08.318 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65130460499999998 2024-09-13T05:12:08.318 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.319 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.319 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:08.319 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632587+0000", 2024-09-13T05:12:08.319 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016199500000000001 2024-09-13T05:12:08.319 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.319 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.319 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:08.319 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632801+0000", 2024-09-13T05:12:08.319 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021459499999999999 2024-09-13T05:12:08.319 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.319 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:08.319 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.319 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.319 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.319 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3:6a46bd6d:::rbd_data.112d8d1317eb.0000000000000010:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:08.320 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:08.320 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 44.319270670999998, 2024-09-13T05:12:08.320 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65213695699999996, 2024-09-13T05:12:08.320 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:08.320 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:08.320 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:08.320 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:08.320 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:08.320 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:12:08.320 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.320 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:08.320 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.320 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:08.321 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:08.321 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.321 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.321 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.321 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:08.321 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:08.321 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.321 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.321 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.321 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:08.321 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:08.321 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:08.321 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.322 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.322 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:08.322 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981052+0000", 2024-09-13T05:12:08.322 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4469999999999999e-06 2024-09-13T05:12:08.322 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.322 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.322 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:08.322 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981066+0000", 2024-09-13T05:12:08.322 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3658e-05 2024-09-13T05:12:08.322 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.322 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.323 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:08.323 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981073+0000", 2024-09-13T05:12:08.323 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:12:08.323 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.323 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.323 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.323 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981150+0000", 2024-09-13T05:12:08.323 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7783999999999999e-05 2024-09-13T05:12:08.324 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.324 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.324 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:08.324 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981161+0000", 2024-09-13T05:12:08.324 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0197000000000001e-05 2024-09-13T05:12:08.324 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.324 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.325 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.325 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632926+0000", 2024-09-13T05:12:08.325 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65176517300000003 2024-09-13T05:12:08.325 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.325 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.325 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:08.325 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633081+0000", 2024-09-13T05:12:08.325 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000155172 2024-09-13T05:12:08.326 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.326 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.326 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:08.326 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633185+0000", 2024-09-13T05:12:08.326 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000104329 2024-09-13T05:12:08.326 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.327 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:08.327 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.327 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.327 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:157552 3.5 3:a072521b:::rbd_data.112dc3abcba6.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-09-13T05:12:08.327 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:02.531636+0000", 2024-09-13T05:12:08.327 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.7686828339999998, 2024-09-13T05:12:08.328 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.118346166, 2024-09-13T05:12:08.328 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:08.328 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:08.328 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:08.328 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:08.328 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:08.328 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 157552 2024-09-13T05:12:08.328 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.328 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:08.328 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.328 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:08.329 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.531636+0000", 2024-09-13T05:12:08.329 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.329 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.329 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.329 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:08.329 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.531636+0000", 2024-09-13T05:12:08.329 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.329 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.329 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.329 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:08.329 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.531634+0000", 2024-09-13T05:12:08.330 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:12:08.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.330 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.330 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:08.330 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552355+0000", 2024-09-13T05:12:08.330 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020721112 2024-09-13T05:12:08.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.330 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.330 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:08.330 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552389+0000", 2024-09-13T05:12:08.330 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4425999999999999e-05 2024-09-13T05:12:08.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.330 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.330 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:08.331 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552399+0000", 2024-09-13T05:12:08.331 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0062e-05 2024-09-13T05:12:08.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.331 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.331 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.331 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552496+0000", 2024-09-13T05:12:08.331 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6914000000000001e-05 2024-09-13T05:12:08.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.331 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.331 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:08.331 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552765+0000", 2024-09-13T05:12:08.331 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00026873499999999998 2024-09-13T05:12:08.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.331 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.332 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 3", 2024-09-13T05:12:08.332 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.562896+0000", 2024-09-13T05:12:08.332 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010131186 2024-09-13T05:12:08.332 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.332 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.332 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:12:08.332 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.611492+0000", 2024-09-13T05:12:08.332 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048596448 2024-09-13T05:12:08.332 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.332 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.332 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:08.333 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.649797+0000", 2024-09-13T05:12:08.333 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038304202000000002 2024-09-13T05:12:08.333 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.333 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.333 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:08.333 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.649905+0000", 2024-09-13T05:12:08.333 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010853600000000001 2024-09-13T05:12:08.333 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.333 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.333 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:08.333 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.649982+0000", 2024-09-13T05:12:08.333 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7080000000000001e-05 2024-09-13T05:12:08.333 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.334 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:08.334 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.334 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.334 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.334 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:159585 3.1c 3:3afcc414:::rbd_data.112dfd94ee88.00000000000002ca:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:08.334 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:08.334 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.2859523580000001, 2024-09-13T05:12:08.334 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91717655399999998, 2024-09-13T05:12:08.334 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:08.334 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:08.335 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:08.335 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:08.335 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:08.335 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 159585 2024-09-13T05:12:08.335 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.335 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:08.335 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.335 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:08.335 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:08.335 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.335 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.335 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.335 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:08.336 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:08.336 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.336 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.336 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.336 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:08.336 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014366+0000", 2024-09-13T05:12:08.336 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:08.336 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.336 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.336 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:08.336 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014370+0000", 2024-09-13T05:12:08.336 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9960000000000004e-06 2024-09-13T05:12:08.336 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.337 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.337 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:08.337 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014379+0000", 2024-09-13T05:12:08.337 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8550000000000008e-06 2024-09-13T05:12:08.337 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.337 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.337 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:08.337 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014386+0000", 2024-09-13T05:12:08.337 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0140000000000001e-06 2024-09-13T05:12:08.337 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.337 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.337 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.337 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014533+0000", 2024-09-13T05:12:08.338 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000147458 2024-09-13T05:12:08.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.338 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.338 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:08.338 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014545+0000", 2024-09-13T05:12:08.338 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1318000000000001e-05 2024-09-13T05:12:08.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.338 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.338 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.338 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931378+0000", 2024-09-13T05:12:08.338 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91683292400000005 2024-09-13T05:12:08.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.338 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.338 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:08.338 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931495+0000", 2024-09-13T05:12:08.339 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011726399999999999 2024-09-13T05:12:08.339 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.339 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.339 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:08.339 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931543+0000", 2024-09-13T05:12:08.339 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8183000000000003e-05 2024-09-13T05:12:08.339 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.339 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:08.339 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.339 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.339 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.339 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160206 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 83968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:08.339 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:08.339 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.2625499609999999, 2024-09-13T05:12:08.340 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89412730799999995, 2024-09-13T05:12:08.340 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:08.340 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:08.340 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:08.340 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:08.340 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:08.340 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160206 2024-09-13T05:12:08.340 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.340 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:08.340 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.340 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:08.340 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:08.340 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.341 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.341 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.341 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:08.341 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:08.341 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.341 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.341 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.341 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:08.341 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037768+0000", 2024-09-13T05:12:08.341 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:08.341 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.341 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.341 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:08.341 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037774+0000", 2024-09-13T05:12:08.342 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3600000000000001e-06 2024-09-13T05:12:08.342 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.342 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.342 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:08.342 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037786+0000", 2024-09-13T05:12:08.342 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.188e-05 2024-09-13T05:12:08.342 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.342 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.342 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:08.342 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037793+0000", 2024-09-13T05:12:08.342 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2749999999999998e-06 2024-09-13T05:12:08.342 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.342 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.343 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.343 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:08.343 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0353000000000003e-05 2024-09-13T05:12:08.343 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.343 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.343 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:08.343 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037862+0000", 2024-09-13T05:12:08.343 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9710000000000004e-06 2024-09-13T05:12:08.343 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.343 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.343 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.343 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931610+0000", 2024-09-13T05:12:08.343 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89374846299999999 2024-09-13T05:12:08.343 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.344 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.344 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:08.344 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931815+0000", 2024-09-13T05:12:08.344 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020516499999999999 2024-09-13T05:12:08.344 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.344 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.344 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:08.344 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931896+0000", 2024-09-13T05:12:08.344 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1157999999999998e-05 2024-09-13T05:12:08.344 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.344 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:08.344 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.344 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.344 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.345 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160208 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 84992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:08.345 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:08.345 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.2624652219999999, 2024-09-13T05:12:08.345 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440702299999997, 2024-09-13T05:12:08.345 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:08.345 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:08.345 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:08.345 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:08.345 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:08.345 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160208 2024-09-13T05:12:08.346 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.346 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:08.346 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.346 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:08.346 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:08.346 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.346 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.346 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.346 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:08.346 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:08.347 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.347 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.347 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.347 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:08.347 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037853+0000", 2024-09-13T05:12:08.347 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:08.347 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.347 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.347 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:08.347 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037858+0000", 2024-09-13T05:12:08.347 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2179999999999998e-06 2024-09-13T05:12:08.347 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.347 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.347 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:08.348 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037867+0000", 2024-09-13T05:12:08.348 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5699999999999993e-06 2024-09-13T05:12:08.348 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.348 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.348 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:08.348 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037874+0000", 2024-09-13T05:12:08.348 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2810000000000003e-06 2024-09-13T05:12:08.348 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.348 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.348 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.348 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037935+0000", 2024-09-13T05:12:08.348 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1231999999999999e-05 2024-09-13T05:12:08.349 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.349 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.349 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:08.349 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037944+0000", 2024-09-13T05:12:08.349 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8580000000000006e-06 2024-09-13T05:12:08.349 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.349 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.349 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.349 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931956+0000", 2024-09-13T05:12:08.349 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89401158800000002 2024-09-13T05:12:08.349 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.349 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.349 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:08.349 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932015+0000", 2024-09-13T05:12:08.350 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8906999999999997e-05 2024-09-13T05:12:08.350 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.350 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.350 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:08.350 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932261+0000", 2024-09-13T05:12:08.350 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024622799999999997 2024-09-13T05:12:08.350 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.350 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:08.350 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.350 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.350 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.350 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160210 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 86016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:08.350 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:08.350 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.2623963680000001, 2024-09-13T05:12:08.351 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89428998299999996, 2024-09-13T05:12:08.351 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:08.351 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:08.351 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:08.351 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:08.351 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:08.351 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160210 2024-09-13T05:12:08.351 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.351 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:08.351 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.351 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:08.351 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:08.351 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.352 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.352 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.352 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:08.352 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:08.352 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.352 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.352 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.352 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:08.352 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037922+0000", 2024-09-13T05:12:08.352 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:08.352 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.352 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.352 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:08.352 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037926+0000", 2024-09-13T05:12:08.353 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6550000000000003e-06 2024-09-13T05:12:08.353 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.353 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.353 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:08.353 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037933+0000", 2024-09-13T05:12:08.353 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5409999999999997e-06 2024-09-13T05:12:08.353 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.353 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.353 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:08.353 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037939+0000", 2024-09-13T05:12:08.353 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1940000000000003e-06 2024-09-13T05:12:08.353 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.353 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.354 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.354 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037976+0000", 2024-09-13T05:12:08.354 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6671000000000002e-05 2024-09-13T05:12:08.354 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.354 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.354 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:08.354 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037982+0000", 2024-09-13T05:12:08.354 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9669999999999998e-06 2024-09-13T05:12:08.354 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.354 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.354 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.354 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932096+0000", 2024-09-13T05:12:08.354 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89411465599999995 2024-09-13T05:12:08.354 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.354 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.355 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:08.355 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932149+0000", 2024-09-13T05:12:08.355 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3032999999999999e-05 2024-09-13T05:12:08.355 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.355 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.355 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:08.355 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932213+0000", 2024-09-13T05:12:08.355 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3165999999999998e-05 2024-09-13T05:12:08.355 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.355 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:08.356 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.356 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.356 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.356 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160212 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 87040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:08.356 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:08.356 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.2623092470000001, 2024-09-13T05:12:08.356 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440379699999994, 2024-09-13T05:12:08.356 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:08.356 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:08.356 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:08.357 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:08.357 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:08.357 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160212 2024-09-13T05:12:08.357 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.357 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:08.357 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.357 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:08.357 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:08.357 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.357 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.357 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.357 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:08.357 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:08.357 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.358 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.358 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.358 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:08.358 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038009+0000", 2024-09-13T05:12:08.358 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:08.358 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.358 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.358 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:08.358 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038013+0000", 2024-09-13T05:12:08.358 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3950000000000003e-06 2024-09-13T05:12:08.358 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.358 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.358 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:08.358 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038032+0000", 2024-09-13T05:12:08.359 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8513999999999999e-05 2024-09-13T05:12:08.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.359 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.359 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:08.359 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038039+0000", 2024-09-13T05:12:08.359 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.985e-06 2024-09-13T05:12:08.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.359 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.359 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.359 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038086+0000", 2024-09-13T05:12:08.359 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7302999999999998e-05 2024-09-13T05:12:08.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.360 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.360 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:08.360 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038090+0000", 2024-09-13T05:12:08.360 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9029999999999997e-06 2024-09-13T05:12:08.360 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.360 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.360 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.360 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932291+0000", 2024-09-13T05:12:08.360 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89420100199999997 2024-09-13T05:12:08.360 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.360 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.361 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:08.361 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932352+0000", 2024-09-13T05:12:08.361 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1354999999999998e-05 2024-09-13T05:12:08.361 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.361 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.361 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:08.361 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932414+0000", 2024-09-13T05:12:08.361 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1037999999999994e-05 2024-09-13T05:12:08.361 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.361 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:08.361 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.361 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.361 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.361 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160214 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 88064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:08.362 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:08.362 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.2621781809999999, 2024-09-13T05:12:08.362 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89438890900000001, 2024-09-13T05:12:08.362 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:08.362 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:08.362 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:08.362 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:08.362 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:08.362 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160214 2024-09-13T05:12:08.362 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.362 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:08.362 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.362 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:08.362 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:08.363 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.363 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.363 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.363 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:08.363 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:08.363 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.364 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.364 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.364 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:08.364 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038140+0000", 2024-09-13T05:12:08.364 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:08.364 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.365 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.365 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:08.365 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038145+0000", 2024-09-13T05:12:08.365 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9749999999999998e-06 2024-09-13T05:12:08.365 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.366 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.366 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:08.366 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038153+0000", 2024-09-13T05:12:08.366 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1280000000000008e-06 2024-09-13T05:12:08.366 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.366 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.367 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:08.367 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038161+0000", 2024-09-13T05:12:08.367 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0339999999999997e-06 2024-09-13T05:12:08.367 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.367 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.367 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.368 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038199+0000", 2024-09-13T05:12:08.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8269999999999998e-05 2024-09-13T05:12:08.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.368 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.368 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:08.368 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038204+0000", 2024-09-13T05:12:08.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5399999999999997e-06 2024-09-13T05:12:08.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.368 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.368 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.368 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932438+0000", 2024-09-13T05:12:08.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89423397999999998 2024-09-13T05:12:08.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:08.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932480+0000", 2024-09-13T05:12:08.369 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2392999999999999e-05 2024-09-13T05:12:08.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:08.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932530+0000", 2024-09-13T05:12:08.369 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:12:08.369 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.369 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:08.369 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.370 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.370 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160305 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 215040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:08.370 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:08.370 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.257974959, 2024-09-13T05:12:08.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89028175300000001, 2024-09-13T05:12:08.370 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:08.370 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:08.370 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:08.370 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:08.370 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:08.370 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160305 2024-09-13T05:12:08.370 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.370 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:08.370 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.371 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:08.371 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:08.371 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.371 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.371 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.371 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:08.371 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:08.371 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.371 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.371 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.371 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:08.371 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042343+0000", 2024-09-13T05:12:08.371 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:08.371 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.372 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.372 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:08.372 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042350+0000", 2024-09-13T05:12:08.372 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3769999999999998e-06 2024-09-13T05:12:08.372 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.372 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.372 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:08.372 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042367+0000", 2024-09-13T05:12:08.372 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.734e-05 2024-09-13T05:12:08.372 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.372 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.372 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:08.372 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042375+0000", 2024-09-13T05:12:08.373 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8469999999999996e-06 2024-09-13T05:12:08.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.373 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.373 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.373 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042428+0000", 2024-09-13T05:12:08.373 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3074e-05 2024-09-13T05:12:08.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.373 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.373 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:08.373 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042437+0000", 2024-09-13T05:12:08.373 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:12:08.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.374 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.374 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.374 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932550+0000", 2024-09-13T05:12:08.374 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89011304300000005 2024-09-13T05:12:08.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.374 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.374 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:08.374 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932589+0000", 2024-09-13T05:12:08.374 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9236000000000002e-05 2024-09-13T05:12:08.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.374 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.374 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:08.374 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932626+0000", 2024-09-13T05:12:08.374 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6832999999999998e-05 2024-09-13T05:12:08.375 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.375 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:08.375 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.375 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.375 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.375 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160307 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 216064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:08.375 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:08.375 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.2579285200000001, 2024-09-13T05:12:08.375 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89032630800000001, 2024-09-13T05:12:08.375 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:08.375 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:08.375 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:08.375 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:08.376 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:08.376 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160307 2024-09-13T05:12:08.376 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.376 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:08.376 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.376 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:08.376 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:08.376 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.376 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.376 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.376 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:08.376 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:08.376 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.376 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.377 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.377 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:08.377 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:08.377 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:08.377 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.377 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.377 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:08.377 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042394+0000", 2024-09-13T05:12:08.377 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7900000000000001e-06 2024-09-13T05:12:08.377 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.377 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.377 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:08.377 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042401+0000", 2024-09-13T05:12:08.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.267e-06 2024-09-13T05:12:08.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:08.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042406+0000", 2024-09-13T05:12:08.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0860000000000001e-06 2024-09-13T05:12:08.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042465+0000", 2024-09-13T05:12:08.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9441000000000002e-05 2024-09-13T05:12:08.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:08.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042471+0000", 2024-09-13T05:12:08.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6640000000000003e-06 2024-09-13T05:12:08.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932645+0000", 2024-09-13T05:12:08.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89017372900000002 2024-09-13T05:12:08.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:08.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932681+0000", 2024-09-13T05:12:08.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5918999999999999e-05 2024-09-13T05:12:08.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.380 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:08.380 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932717+0000", 2024-09-13T05:12:08.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6007999999999998e-05 2024-09-13T05:12:08.380 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.380 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:08.380 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.380 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160309 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 217088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:08.381 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:08.381 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.2578782610000001, 2024-09-13T05:12:08.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89037315900000003, 2024-09-13T05:12:08.381 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:08.381 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:08.381 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:08.381 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:08.381 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:08.381 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160309 2024-09-13T05:12:08.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.382 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:08.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:08.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:08.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:08.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:08.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:08.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042440+0000", 2024-09-13T05:12:08.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:08.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:08.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042444+0000", 2024-09-13T05:12:08.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.104e-06 2024-09-13T05:12:08.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:08.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042451+0000", 2024-09-13T05:12:08.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.922e-06 2024-09-13T05:12:08.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.384 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:08.384 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042457+0000", 2024-09-13T05:12:08.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3979999999999998e-06 2024-09-13T05:12:08.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.384 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.384 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042497+0000", 2024-09-13T05:12:08.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0692999999999998e-05 2024-09-13T05:12:08.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:08.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042503+0000", 2024-09-13T05:12:08.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.553e-06 2024-09-13T05:12:08.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932735+0000", 2024-09-13T05:12:08.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89023238699999996 2024-09-13T05:12:08.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:08.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932771+0000", 2024-09-13T05:12:08.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5972000000000001e-05 2024-09-13T05:12:08.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:08.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932814+0000", 2024-09-13T05:12:08.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2657000000000002e-05 2024-09-13T05:12:08.386 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.386 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:08.386 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.386 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160311 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 218112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:08.386 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:08.387 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.257852771, 2024-09-13T05:12:08.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89045284400000002, 2024-09-13T05:12:08.387 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:08.387 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:08.387 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:08.387 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:08.387 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:08.387 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160311 2024-09-13T05:12:08.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.387 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:08.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:08.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:08.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.388 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:08.388 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:08.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.388 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:08.388 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:08.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:08.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.388 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:08.388 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042469+0000", 2024-09-13T05:12:08.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.456e-06 2024-09-13T05:12:08.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:08.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042475+0000", 2024-09-13T05:12:08.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0990000000000004e-06 2024-09-13T05:12:08.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:08.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042481+0000", 2024-09-13T05:12:08.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.237e-06 2024-09-13T05:12:08.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042527+0000", 2024-09-13T05:12:08.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6796999999999999e-05 2024-09-13T05:12:08.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:08.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042533+0000", 2024-09-13T05:12:08.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6489999999999996e-06 2024-09-13T05:12:08.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932832+0000", 2024-09-13T05:12:08.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89029919800000001 2024-09-13T05:12:08.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:08.391 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932867+0000", 2024-09-13T05:12:08.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5049000000000003e-05 2024-09-13T05:12:08.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.391 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:08.391 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932919+0000", 2024-09-13T05:12:08.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1780999999999998e-05 2024-09-13T05:12:08.391 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.391 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:08.391 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.391 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160313 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 219136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:08.391 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:08.392 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.25782368, 2024-09-13T05:12:08.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89064232600000004, 2024-09-13T05:12:08.392 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:08.392 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:08.392 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:08.392 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:08.392 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:08.392 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160313 2024-09-13T05:12:08.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.392 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:08.392 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.392 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:08.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:08.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.393 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.393 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.393 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:08.393 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:08.393 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.393 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.393 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.393 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:08.393 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:08.393 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:08.393 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.393 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.393 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:08.394 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042498+0000", 2024-09-13T05:12:08.394 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.281e-06 2024-09-13T05:12:08.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:08.394 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042505+0000", 2024-09-13T05:12:08.394 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2699999999999999e-06 2024-09-13T05:12:08.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:08.394 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042512+0000", 2024-09-13T05:12:08.394 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0330000000000003e-06 2024-09-13T05:12:08.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042557+0000", 2024-09-13T05:12:08.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4425999999999998e-05 2024-09-13T05:12:08.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:08.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042562+0000", 2024-09-13T05:12:08.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3639999999999998e-06 2024-09-13T05:12:08.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932987+0000", 2024-09-13T05:12:08.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89042472299999997 2024-09-13T05:12:08.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:08.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933062+0000", 2024-09-13T05:12:08.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5129999999999994e-05 2024-09-13T05:12:08.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:08.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933138+0000", 2024-09-13T05:12:08.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5536000000000003e-05 2024-09-13T05:12:08.396 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.396 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:08.396 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.397 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160315 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 220160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:08.397 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:08.397 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.2577925130000001, 2024-09-13T05:12:08.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89071820800000001, 2024-09-13T05:12:08.397 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:08.397 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:08.397 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:08.397 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:08.397 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:08.397 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160315 2024-09-13T05:12:08.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.398 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:08.398 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.398 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:08.398 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:08.398 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.398 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.398 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.398 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:08.398 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:08.398 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.398 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.398 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.398 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:08.398 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:08.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:08.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:08.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042529+0000", 2024-09-13T05:12:08.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3639999999999999e-06 2024-09-13T05:12:08.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:08.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042536+0000", 2024-09-13T05:12:08.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.866e-06 2024-09-13T05:12:08.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:08.400 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042541+0000", 2024-09-13T05:12:08.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:12:08.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.400 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042587+0000", 2024-09-13T05:12:08.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5735000000000002e-05 2024-09-13T05:12:08.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:08.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042593+0000", 2024-09-13T05:12:08.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0719999999999996e-06 2024-09-13T05:12:08.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933160+0000", 2024-09-13T05:12:08.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89056621000000002 2024-09-13T05:12:08.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:08.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933202+0000", 2024-09-13T05:12:08.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2376000000000002e-05 2024-09-13T05:12:08.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.402 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:08.402 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933245+0000", 2024-09-13T05:12:08.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2787999999999998e-05 2024-09-13T05:12:08.402 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.402 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:08.402 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.402 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160317 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:08.402 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:08.403 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.2577636839999999, 2024-09-13T05:12:08.403 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89082205800000003, 2024-09-13T05:12:08.403 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:08.403 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:08.403 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:08.403 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:08.403 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:08.403 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160317 2024-09-13T05:12:08.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.403 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:08.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.403 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:08.404 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:08.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.404 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:08.404 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:08.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.404 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:08.404 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:08.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:08.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.405 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:08.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042558+0000", 2024-09-13T05:12:08.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1810000000000001e-06 2024-09-13T05:12:08.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.405 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:08.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042565+0000", 2024-09-13T05:12:08.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9280000000000004e-06 2024-09-13T05:12:08.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.405 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:08.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042571+0000", 2024-09-13T05:12:08.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7420000000000003e-06 2024-09-13T05:12:08.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042616+0000", 2024-09-13T05:12:08.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5201999999999999e-05 2024-09-13T05:12:08.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:08.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042622+0000", 2024-09-13T05:12:08.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8289999999999996e-06 2024-09-13T05:12:08.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933259+0000", 2024-09-13T05:12:08.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89063730799999996 2024-09-13T05:12:08.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.407 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.407 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:08.407 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933311+0000", 2024-09-13T05:12:08.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1910000000000003e-05 2024-09-13T05:12:08.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.407 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.407 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:08.407 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933377+0000", 2024-09-13T05:12:08.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6396999999999995e-05 2024-09-13T05:12:08.407 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.407 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:08.407 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.407 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.408 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160319 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 222208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:08.408 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:08.408 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.2577334680000001, 2024-09-13T05:12:08.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89087477400000004, 2024-09-13T05:12:08.408 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:08.408 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:08.408 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:08.408 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:08.408 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:08.408 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160319 2024-09-13T05:12:08.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.408 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:08.408 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:08.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:08.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.409 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:08.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:08.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.410 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:08.410 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042585+0000", 2024-09-13T05:12:08.410 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:08.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.410 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:08.410 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042588+0000", 2024-09-13T05:12:08.410 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9450000000000002e-06 2024-09-13T05:12:08.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.410 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:08.410 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042594+0000", 2024-09-13T05:12:08.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0959999999999997e-06 2024-09-13T05:12:08.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:08.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042599+0000", 2024-09-13T05:12:08.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0069999999999997e-06 2024-09-13T05:12:08.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042642+0000", 2024-09-13T05:12:08.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2553999999999999e-05 2024-09-13T05:12:08.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:08.412 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042647+0000", 2024-09-13T05:12:08.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.31e-06 2024-09-13T05:12:08.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.412 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933387+0000", 2024-09-13T05:12:08.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89073982799999996 2024-09-13T05:12:08.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:08.412 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:12:08.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7101000000000003e-05 2024-09-13T05:12:08.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:08.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933460+0000", 2024-09-13T05:12:08.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6282999999999998e-05 2024-09-13T05:12:08.413 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.413 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:08.413 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.413 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160321 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 223232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:08.413 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:08.413 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.257704041, 2024-09-13T05:12:08.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89094616999999998, 2024-09-13T05:12:08.413 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:08.414 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:08.414 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:08.414 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:08.414 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:08.414 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160321 2024-09-13T05:12:08.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.414 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:08.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:08.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:08.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.415 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:08.415 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:08.415 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:08.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.415 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:08.415 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:08.415 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:08.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.415 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:08.415 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042617+0000", 2024-09-13T05:12:08.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8329999999999998e-06 2024-09-13T05:12:08.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.416 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:08.416 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042638+0000", 2024-09-13T05:12:08.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0908e-05 2024-09-13T05:12:08.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.416 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:08.416 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042644+0000", 2024-09-13T05:12:08.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0440000000000001e-06 2024-09-13T05:12:08.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.416 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042666+0000", 2024-09-13T05:12:08.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1256000000000001e-05 2024-09-13T05:12:08.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.417 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:08.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042671+0000", 2024-09-13T05:12:08.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6250000000000004e-06 2024-09-13T05:12:08.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.417 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:08.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933478+0000", 2024-09-13T05:12:08.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89080698800000002 2024-09-13T05:12:08.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:08.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933519+0000", 2024-09-13T05:12:08.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0717000000000003e-05 2024-09-13T05:12:08.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:08.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:08.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:08.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933561+0000", 2024-09-13T05:12:08.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2225999999999999e-05 2024-09-13T05:12:08.418 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.418 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:08.418 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.419 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:08.419 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:08.419 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:08.419 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:08.364+0000 7fada0141880 -1 Falling back to public interface 2024-09-13T05:12:08.420 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:12:08.421 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:08.416+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:08.521 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:08.520+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:08.522 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:08.545 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:08.564 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:08.581 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:08.582 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:08.582 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:08.582 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:08.585 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:08.592 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:12:08.609 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:08.622 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:08.616+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:08.639 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:08.639 INFO:teuthology.orchestra.run.smithi120.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-13T05:12:08.639 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:08.640 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:08.640 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:08.640 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:08.640 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:08.640 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:08.640 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:08.642 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T05:12:08.642 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T05:12:08.698 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:08.698 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:08.708 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:12:08.750 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:08.744+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:08.823 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:08.816+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:08.857 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:08.857 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:08.867 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:12:08.924 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:08.916+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:08.939 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T05:12:08.983 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:08.983 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:08.994 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:12:09.025 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:09.024+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:09.112 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:09.112 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:09.125 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:12:09.127 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:09.120+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:09.228 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:09.220+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:09.228 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:09.229 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:09.239 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:12:09.331 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:09.324+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:09.348 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:09.349 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:09.358 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:12:09.431 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:09.428+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:09.464 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:09.464 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:09.474 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:12:09.532 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:09.528+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:09.595 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:09.595 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:09.607 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:12:09.631 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is set 2024-09-13T05:12:09.632 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:09.628+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:09.712 INFO:teuthology.orchestra.run.smithi120.stdout:5137 punch from 0xdae07f7 to 0xdae2998, (0x21a1 bytes) 2024-09-13T05:12:09.713 INFO:teuthology.orchestra.run.smithi120.stdout:5138 read 0xc08b3c6 thru 0xc08cf53 (0x1b8e bytes) 2024-09-13T05:12:09.723 INFO:teuthology.orchestra.run.smithi120.stdout:5139 write 0xa53b5e0 thru 0xa54418a (0x8bab bytes) 2024-09-13T05:12:09.734 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:09.728+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:09.746 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:09.746 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:09.759 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:12:09.834 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:09.832+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:09.885 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:09.885 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:09.894 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:12:09.936 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:09.932+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:09.995 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:09.995 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:10.005 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:12:10.037 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:10.032+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:10.118 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:10.118 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:10.128 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:12:10.177 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:10.176+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:10.238 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:10.236+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:10.243 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:10.243 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:10.254 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:12:10.338 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:10.336+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:10.368 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:10.368 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:10.379 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:12:10.439 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:10.436+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:10.494 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:10.494 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:10.504 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:12:10.540 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:10.536+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:10.615 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:10.615 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:10.625 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:12:10.641 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:10.636+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:10.643 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:12:10.729 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:10.729 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:10.738 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:12:10.742 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:10.740+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:10.797 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:10.817 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:10.837 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:10.842 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:10.840+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:10.858 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:10.879 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:10.894 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:10.894 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:10.894 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:10.894 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:10.902 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:10.904 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:12:10.942 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:10.942 INFO:teuthology.orchestra.run.smithi120.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-13T05:12:10.943 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:10.943 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:10.943 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:10.943 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:10.943 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:10.943 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:10.943 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:10.943 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:10.940+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:10.946 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T05:12:10.946 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T05:12:11.007 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:11.007 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:11.007 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:11.007 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:11.007 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:11.016 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:12:11.058 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:11.056+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:11.145 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:11.140+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:11.174 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:11.174 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:11.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:11.174 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:11.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.174 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3.bb1d1096 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:11.174 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:11.174 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 47.221747462000003, 2024-09-13T05:12:11.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68834410099999999, 2024-09-13T05:12:11.175 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.175 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:11.175 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.175 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.175 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.175 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:12:11.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.175 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.175 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.175 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:11.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:11.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943719+0000", 2024-09-13T05:12:11.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:12:11.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943734+0000", 2024-09-13T05:12:11.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4793e-05 2024-09-13T05:12:11.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943765+0000", 2024-09-13T05:12:11.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0648999999999997e-05 2024-09-13T05:12:11.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943779+0000", 2024-09-13T05:12:11.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.447e-05 2024-09-13T05:12:11.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943872+0000", 2024-09-13T05:12:11.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3304e-05 2024-09-13T05:12:11.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:11.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943884+0000", 2024-09-13T05:12:11.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.167e-05 2024-09-13T05:12:11.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632042+0000", 2024-09-13T05:12:11.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68815832600000004 2024-09-13T05:12:11.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.179 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632066+0000", 2024-09-13T05:12:11.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3765999999999999e-05 2024-09-13T05:12:11.179 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.179 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.179 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.179 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3.b6bd6256 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:11.179 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:11.179 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 47.221622961999998, 2024-09-13T05:12:11.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68852592499999998, 2024-09-13T05:12:11.180 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.180 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:11.180 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.180 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.180 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.180 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:12:11.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.180 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:11.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:11.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943846+0000", 2024-09-13T05:12:11.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:11.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943852+0000", 2024-09-13T05:12:11.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3820000000000001e-06 2024-09-13T05:12:11.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943876+0000", 2024-09-13T05:12:11.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3995e-05 2024-09-13T05:12:11.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943898+0000", 2024-09-13T05:12:11.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1838999999999999e-05 2024-09-13T05:12:11.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946457+0000", 2024-09-13T05:12:11.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025588910000000002 2024-09-13T05:12:11.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:11.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946499+0000", 2024-09-13T05:12:11.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2814e-05 2024-09-13T05:12:11.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632364+0000", 2024-09-13T05:12:11.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68586484999999997 2024-09-13T05:12:11.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632372+0000", 2024-09-13T05:12:11.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1659999999999994e-06 2024-09-13T05:12:11.184 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.184 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.184 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.184 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3:6908b8dd:::rbd_data.112d8d1317eb.000000000000000f:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:11.184 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:11.184 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 47.184478884000001, 2024-09-13T05:12:11.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65181049499999999, 2024-09-13T05:12:11.184 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.184 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.184 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.185 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.185 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.185 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:12:11.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.185 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:11.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:11.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980989+0000", 2024-09-13T05:12:11.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:11.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.187 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980996+0000", 2024-09-13T05:12:11.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2200000000000003e-06 2024-09-13T05:12:11.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.187 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981011+0000", 2024-09-13T05:12:11.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4997000000000001e-05 2024-09-13T05:12:11.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981025+0000", 2024-09-13T05:12:11.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3604000000000001e-05 2024-09-13T05:12:11.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981110+0000", 2024-09-13T05:12:11.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4948000000000001e-05 2024-09-13T05:12:11.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:11.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981120+0000", 2024-09-13T05:12:11.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9399999999999997e-06 2024-09-13T05:12:11.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632425+0000", 2024-09-13T05:12:11.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65130460499999998 2024-09-13T05:12:11.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632587+0000", 2024-09-13T05:12:11.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016199500000000001 2024-09-13T05:12:11.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632801+0000", 2024-09-13T05:12:11.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021459499999999999 2024-09-13T05:12:11.190 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.191 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.191 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.191 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3:6a46bd6d:::rbd_data.112d8d1317eb.0000000000000010:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:11.191 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:11.191 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 47.184421227999998, 2024-09-13T05:12:11.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65213695699999996, 2024-09-13T05:12:11.191 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.192 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.192 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.192 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.192 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.192 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:12:11.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.192 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:11.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:11.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:11.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981052+0000", 2024-09-13T05:12:11.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4469999999999999e-06 2024-09-13T05:12:11.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.195 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.195 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981066+0000", 2024-09-13T05:12:11.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3658e-05 2024-09-13T05:12:11.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.195 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.195 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981073+0000", 2024-09-13T05:12:11.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:12:11.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.196 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981150+0000", 2024-09-13T05:12:11.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7783999999999999e-05 2024-09-13T05:12:11.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:11.197 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981161+0000", 2024-09-13T05:12:11.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0197000000000001e-05 2024-09-13T05:12:11.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.197 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632926+0000", 2024-09-13T05:12:11.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65176517300000003 2024-09-13T05:12:11.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.198 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.198 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633081+0000", 2024-09-13T05:12:11.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000155172 2024-09-13T05:12:11.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.198 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.199 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633185+0000", 2024-09-13T05:12:11.199 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000104329 2024-09-13T05:12:11.199 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.199 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.199 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.199 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.199 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.199 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:157552 3.5 3:a072521b:::rbd_data.112dc3abcba6.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-09-13T05:12:11.200 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:02.531636+0000", 2024-09-13T05:12:11.200 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.6338333909999996, 2024-09-13T05:12:11.200 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.118346166, 2024-09-13T05:12:11.200 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.200 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:11.200 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.200 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.200 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.200 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 157552 2024-09-13T05:12:11.200 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.200 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.200 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.200 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.200 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.531636+0000", 2024-09-13T05:12:11.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.531636+0000", 2024-09-13T05:12:11.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.531634+0000", 2024-09-13T05:12:11.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:12:11.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.202 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552355+0000", 2024-09-13T05:12:11.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020721112 2024-09-13T05:12:11.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.202 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.202 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552389+0000", 2024-09-13T05:12:11.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4425999999999999e-05 2024-09-13T05:12:11.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.202 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.202 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552399+0000", 2024-09-13T05:12:11.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0062e-05 2024-09-13T05:12:11.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.203 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.203 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552496+0000", 2024-09-13T05:12:11.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6914000000000001e-05 2024-09-13T05:12:11.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.203 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.203 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552765+0000", 2024-09-13T05:12:11.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00026873499999999998 2024-09-13T05:12:11.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.203 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 3", 2024-09-13T05:12:11.203 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.562896+0000", 2024-09-13T05:12:11.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010131186 2024-09-13T05:12:11.204 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.204 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:12:11.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.611492+0000", 2024-09-13T05:12:11.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048596448 2024-09-13T05:12:11.204 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.204 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:11.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.649797+0000", 2024-09-13T05:12:11.205 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038304202000000002 2024-09-13T05:12:11.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.205 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:11.205 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.649905+0000", 2024-09-13T05:12:11.205 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010853600000000001 2024-09-13T05:12:11.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.205 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.205 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.649982+0000", 2024-09-13T05:12:11.205 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7080000000000001e-05 2024-09-13T05:12:11.205 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.205 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.205 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.206 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:159585 3.1c 3:3afcc414:::rbd_data.112dfd94ee88.00000000000002ca:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:11.206 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:11.206 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.1511029150000001, 2024-09-13T05:12:11.206 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91717655399999998, 2024-09-13T05:12:11.206 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.206 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.206 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.206 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.206 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.206 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 159585 2024-09-13T05:12:11.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.206 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.207 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.207 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:11.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.207 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.207 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:11.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.207 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014366+0000", 2024-09-13T05:12:11.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.208 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014370+0000", 2024-09-13T05:12:11.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9960000000000004e-06 2024-09-13T05:12:11.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.208 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014379+0000", 2024-09-13T05:12:11.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8550000000000008e-06 2024-09-13T05:12:11.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.209 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.209 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014386+0000", 2024-09-13T05:12:11.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0140000000000001e-06 2024-09-13T05:12:11.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.209 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.209 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014533+0000", 2024-09-13T05:12:11.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000147458 2024-09-13T05:12:11.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.209 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:11.209 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014545+0000", 2024-09-13T05:12:11.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1318000000000001e-05 2024-09-13T05:12:11.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.210 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.210 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.210 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931378+0000", 2024-09-13T05:12:11.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91683292400000005 2024-09-13T05:12:11.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.211 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931495+0000", 2024-09-13T05:12:11.211 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011726399999999999 2024-09-13T05:12:11.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.212 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931543+0000", 2024-09-13T05:12:11.212 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8183000000000003e-05 2024-09-13T05:12:11.212 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.212 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.212 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.212 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.213 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.213 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160206 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 83968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:11.213 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:11.213 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.1277005180000002, 2024-09-13T05:12:11.213 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89412730799999995, 2024-09-13T05:12:11.213 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.213 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.213 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.213 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.213 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.213 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160206 2024-09-13T05:12:11.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.214 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.214 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.214 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.214 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:11.214 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.214 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.214 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.214 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:11.214 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.215 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.215 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037768+0000", 2024-09-13T05:12:11.215 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:11.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.215 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.215 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037774+0000", 2024-09-13T05:12:11.215 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3600000000000001e-06 2024-09-13T05:12:11.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.215 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.216 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037786+0000", 2024-09-13T05:12:11.216 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.188e-05 2024-09-13T05:12:11.216 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.216 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.216 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.216 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037793+0000", 2024-09-13T05:12:11.216 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2749999999999998e-06 2024-09-13T05:12:11.216 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.216 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.216 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.216 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:11.216 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0353000000000003e-05 2024-09-13T05:12:11.216 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.217 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.217 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:11.217 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037862+0000", 2024-09-13T05:12:11.217 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9710000000000004e-06 2024-09-13T05:12:11.217 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.217 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.217 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.217 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931610+0000", 2024-09-13T05:12:11.217 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89374846299999999 2024-09-13T05:12:11.217 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.217 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.217 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931815+0000", 2024-09-13T05:12:11.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020516499999999999 2024-09-13T05:12:11.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.218 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.218 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931896+0000", 2024-09-13T05:12:11.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1157999999999998e-05 2024-09-13T05:12:11.218 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.218 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.219 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.219 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.219 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.219 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160208 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 84992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:11.219 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:11.219 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.1276157790000001, 2024-09-13T05:12:11.219 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440702299999997, 2024-09-13T05:12:11.219 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.219 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.219 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.219 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.219 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.220 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160208 2024-09-13T05:12:11.220 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.220 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.220 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.220 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.220 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:11.220 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.220 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.220 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.220 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.220 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:11.220 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.220 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.220 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.221 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037853+0000", 2024-09-13T05:12:11.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:11.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.221 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.221 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037858+0000", 2024-09-13T05:12:11.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2179999999999998e-06 2024-09-13T05:12:11.222 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.222 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.222 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.222 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037867+0000", 2024-09-13T05:12:11.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5699999999999993e-06 2024-09-13T05:12:11.222 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.222 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.222 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.222 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037874+0000", 2024-09-13T05:12:11.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2810000000000003e-06 2024-09-13T05:12:11.222 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.222 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.222 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037935+0000", 2024-09-13T05:12:11.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1231999999999999e-05 2024-09-13T05:12:11.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:11.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037944+0000", 2024-09-13T05:12:11.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8580000000000006e-06 2024-09-13T05:12:11.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.224 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.224 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931956+0000", 2024-09-13T05:12:11.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89401158800000002 2024-09-13T05:12:11.224 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.224 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.224 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932015+0000", 2024-09-13T05:12:11.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8906999999999997e-05 2024-09-13T05:12:11.224 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.225 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.225 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.225 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932261+0000", 2024-09-13T05:12:11.225 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024622799999999997 2024-09-13T05:12:11.225 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.225 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.225 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.225 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.226 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160210 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 86016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:11.226 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:11.226 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.1275469249999999, 2024-09-13T05:12:11.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89428998299999996, 2024-09-13T05:12:11.226 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.226 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.226 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.226 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.226 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.226 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160210 2024-09-13T05:12:11.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.227 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:11.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:11.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.228 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.228 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037922+0000", 2024-09-13T05:12:11.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:11.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.228 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.228 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037926+0000", 2024-09-13T05:12:11.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6550000000000003e-06 2024-09-13T05:12:11.229 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.229 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.229 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.229 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037933+0000", 2024-09-13T05:12:11.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5409999999999997e-06 2024-09-13T05:12:11.229 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.229 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.229 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.229 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037939+0000", 2024-09-13T05:12:11.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1940000000000003e-06 2024-09-13T05:12:11.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037976+0000", 2024-09-13T05:12:11.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6671000000000002e-05 2024-09-13T05:12:11.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:11.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037982+0000", 2024-09-13T05:12:11.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9669999999999998e-06 2024-09-13T05:12:11.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.232 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.232 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.232 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932096+0000", 2024-09-13T05:12:11.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89411465599999995 2024-09-13T05:12:11.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932149+0000", 2024-09-13T05:12:11.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3032999999999999e-05 2024-09-13T05:12:11.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932213+0000", 2024-09-13T05:12:11.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3165999999999998e-05 2024-09-13T05:12:11.234 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.234 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.234 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.234 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.234 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.234 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160212 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 87040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:11.234 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:11.234 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.1274598039999999, 2024-09-13T05:12:11.234 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440379699999994, 2024-09-13T05:12:11.234 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.234 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.234 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.234 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.234 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.235 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160212 2024-09-13T05:12:11.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.235 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.235 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:11.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.235 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:11.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038009+0000", 2024-09-13T05:12:11.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038013+0000", 2024-09-13T05:12:11.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3950000000000003e-06 2024-09-13T05:12:11.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038032+0000", 2024-09-13T05:12:11.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8513999999999999e-05 2024-09-13T05:12:11.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038039+0000", 2024-09-13T05:12:11.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.985e-06 2024-09-13T05:12:11.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038086+0000", 2024-09-13T05:12:11.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7302999999999998e-05 2024-09-13T05:12:11.238 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.238 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.238 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:11.238 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038090+0000", 2024-09-13T05:12:11.238 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9029999999999997e-06 2024-09-13T05:12:11.238 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.238 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.238 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.238 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932291+0000", 2024-09-13T05:12:11.238 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89420100199999997 2024-09-13T05:12:11.238 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.238 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.238 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.238 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932352+0000", 2024-09-13T05:12:11.238 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1354999999999998e-05 2024-09-13T05:12:11.239 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.239 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.239 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.239 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932414+0000", 2024-09-13T05:12:11.239 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1037999999999994e-05 2024-09-13T05:12:11.239 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.239 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.239 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.239 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.239 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.239 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160214 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 88064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:11.239 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:11.239 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.1273287380000001, 2024-09-13T05:12:11.239 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89438890900000001, 2024-09-13T05:12:11.240 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.240 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.240 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.240 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.240 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.240 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160214 2024-09-13T05:12:11.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.240 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.240 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.240 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.240 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:11.240 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:11.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038140+0000", 2024-09-13T05:12:11.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:11.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038145+0000", 2024-09-13T05:12:11.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9749999999999998e-06 2024-09-13T05:12:11.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038153+0000", 2024-09-13T05:12:11.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1280000000000008e-06 2024-09-13T05:12:11.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038161+0000", 2024-09-13T05:12:11.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0339999999999997e-06 2024-09-13T05:12:11.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.243 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038199+0000", 2024-09-13T05:12:11.243 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8269999999999998e-05 2024-09-13T05:12:11.243 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.243 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.243 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:11.243 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038204+0000", 2024-09-13T05:12:11.243 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5399999999999997e-06 2024-09-13T05:12:11.243 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.243 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.243 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.243 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932438+0000", 2024-09-13T05:12:11.243 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89423397999999998 2024-09-13T05:12:11.243 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.243 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.244 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.244 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932480+0000", 2024-09-13T05:12:11.244 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2392999999999999e-05 2024-09-13T05:12:11.244 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.244 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.244 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.244 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932530+0000", 2024-09-13T05:12:11.244 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:12:11.244 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.244 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.244 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.244 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.244 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.245 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160305 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 215040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:11.245 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:11.245 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.123125516, 2024-09-13T05:12:11.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89028175300000001, 2024-09-13T05:12:11.245 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.245 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.245 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.245 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.245 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.245 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160305 2024-09-13T05:12:11.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.245 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:11.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:11.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042343+0000", 2024-09-13T05:12:11.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:11.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042350+0000", 2024-09-13T05:12:11.248 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3769999999999998e-06 2024-09-13T05:12:11.248 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.248 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.248 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042367+0000", 2024-09-13T05:12:11.248 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.734e-05 2024-09-13T05:12:11.248 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.248 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.248 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042375+0000", 2024-09-13T05:12:11.248 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8469999999999996e-06 2024-09-13T05:12:11.248 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.249 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.249 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042428+0000", 2024-09-13T05:12:11.249 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3074e-05 2024-09-13T05:12:11.249 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.249 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.249 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:11.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042437+0000", 2024-09-13T05:12:11.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:12:11.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932550+0000", 2024-09-13T05:12:11.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89011304300000005 2024-09-13T05:12:11.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932589+0000", 2024-09-13T05:12:11.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9236000000000002e-05 2024-09-13T05:12:11.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932626+0000", 2024-09-13T05:12:11.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6832999999999998e-05 2024-09-13T05:12:11.251 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.251 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.251 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.251 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160307 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 216064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:11.251 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:11.251 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.1230790769999999, 2024-09-13T05:12:11.252 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89032630800000001, 2024-09-13T05:12:11.252 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.252 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.252 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.252 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.252 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.252 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160307 2024-09-13T05:12:11.252 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.252 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.252 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.252 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.252 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:11.252 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.253 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.253 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.253 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.253 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:11.253 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.253 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.253 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.253 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.253 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:11.253 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.253 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.253 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.253 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.254 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042394+0000", 2024-09-13T05:12:11.254 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7900000000000001e-06 2024-09-13T05:12:11.254 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.254 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.254 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.254 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042401+0000", 2024-09-13T05:12:11.254 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.267e-06 2024-09-13T05:12:11.254 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.254 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.254 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.254 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042406+0000", 2024-09-13T05:12:11.254 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0860000000000001e-06 2024-09-13T05:12:11.254 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.255 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.255 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.255 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042465+0000", 2024-09-13T05:12:11.255 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9441000000000002e-05 2024-09-13T05:12:11.255 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.255 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.255 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:11.255 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042471+0000", 2024-09-13T05:12:11.255 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6640000000000003e-06 2024-09-13T05:12:11.255 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.255 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.255 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.255 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932645+0000", 2024-09-13T05:12:11.255 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89017372900000002 2024-09-13T05:12:11.256 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.256 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.256 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.256 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932681+0000", 2024-09-13T05:12:11.256 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5918999999999999e-05 2024-09-13T05:12:11.256 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.256 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.256 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.256 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932717+0000", 2024-09-13T05:12:11.256 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6007999999999998e-05 2024-09-13T05:12:11.256 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.256 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.256 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.256 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.257 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.257 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160309 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 217088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:11.257 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:11.257 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.1230288179999999, 2024-09-13T05:12:11.257 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89037315900000003, 2024-09-13T05:12:11.257 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.257 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.257 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.257 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.257 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.257 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160309 2024-09-13T05:12:11.257 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.257 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.258 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.258 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.258 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:11.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.258 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.258 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.258 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.258 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:11.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.258 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.258 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.258 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.258 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042440+0000", 2024-09-13T05:12:11.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.259 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.259 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042444+0000", 2024-09-13T05:12:11.259 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.104e-06 2024-09-13T05:12:11.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.259 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.259 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042451+0000", 2024-09-13T05:12:11.259 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.922e-06 2024-09-13T05:12:11.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.259 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.260 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042457+0000", 2024-09-13T05:12:11.260 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3979999999999998e-06 2024-09-13T05:12:11.260 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.260 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.260 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.260 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042497+0000", 2024-09-13T05:12:11.260 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0692999999999998e-05 2024-09-13T05:12:11.260 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.260 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.260 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:11.260 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042503+0000", 2024-09-13T05:12:11.260 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.553e-06 2024-09-13T05:12:11.260 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.261 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.261 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.261 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932735+0000", 2024-09-13T05:12:11.261 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89023238699999996 2024-09-13T05:12:11.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.261 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.261 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.261 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932771+0000", 2024-09-13T05:12:11.261 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5972000000000001e-05 2024-09-13T05:12:11.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.261 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.261 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.261 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932814+0000", 2024-09-13T05:12:11.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2657000000000002e-05 2024-09-13T05:12:11.262 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.262 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.262 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.262 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.262 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.262 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160311 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 218112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:11.262 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:11.262 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.1230033280000002, 2024-09-13T05:12:11.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89045284400000002, 2024-09-13T05:12:11.262 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.262 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.262 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.263 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.263 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.263 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160311 2024-09-13T05:12:11.263 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.263 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.263 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.263 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.263 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:11.263 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.263 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.263 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.263 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.263 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:11.263 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.264 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:11.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.264 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042469+0000", 2024-09-13T05:12:11.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.456e-06 2024-09-13T05:12:11.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.265 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042475+0000", 2024-09-13T05:12:11.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0990000000000004e-06 2024-09-13T05:12:11.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.265 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.265 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042481+0000", 2024-09-13T05:12:11.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.237e-06 2024-09-13T05:12:11.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.265 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.265 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042527+0000", 2024-09-13T05:12:11.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6796999999999999e-05 2024-09-13T05:12:11.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.266 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:11.266 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042533+0000", 2024-09-13T05:12:11.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6489999999999996e-06 2024-09-13T05:12:11.266 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.266 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.266 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932832+0000", 2024-09-13T05:12:11.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89029919800000001 2024-09-13T05:12:11.266 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.266 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.266 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932867+0000", 2024-09-13T05:12:11.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5049000000000003e-05 2024-09-13T05:12:11.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.267 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.267 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.267 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932919+0000", 2024-09-13T05:12:11.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1780999999999998e-05 2024-09-13T05:12:11.267 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.267 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.267 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.267 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.267 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160313 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 219136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:11.267 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:11.267 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.1229742370000002, 2024-09-13T05:12:11.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89064232600000004, 2024-09-13T05:12:11.268 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.268 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.268 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.268 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.268 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.268 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160313 2024-09-13T05:12:11.268 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.268 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.268 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.268 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.268 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:11.268 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.268 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.269 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.269 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.269 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:11.269 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.269 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.269 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.269 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.269 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:11.269 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.269 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.269 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.269 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.269 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042498+0000", 2024-09-13T05:12:11.269 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.281e-06 2024-09-13T05:12:11.270 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.270 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.270 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.270 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042505+0000", 2024-09-13T05:12:11.270 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2699999999999999e-06 2024-09-13T05:12:11.270 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.270 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.270 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.270 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042512+0000", 2024-09-13T05:12:11.270 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0330000000000003e-06 2024-09-13T05:12:11.270 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.270 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.270 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.270 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042557+0000", 2024-09-13T05:12:11.271 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4425999999999998e-05 2024-09-13T05:12:11.271 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.271 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.271 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:11.271 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042562+0000", 2024-09-13T05:12:11.271 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3639999999999998e-06 2024-09-13T05:12:11.271 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.271 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.271 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.271 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932987+0000", 2024-09-13T05:12:11.271 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89042472299999997 2024-09-13T05:12:11.271 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.271 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.271 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.272 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933062+0000", 2024-09-13T05:12:11.272 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5129999999999994e-05 2024-09-13T05:12:11.272 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.272 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.272 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.272 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933138+0000", 2024-09-13T05:12:11.272 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5536000000000003e-05 2024-09-13T05:12:11.272 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.272 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.272 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.272 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.272 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.272 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160315 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 220160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:11.273 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:11.273 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.1229430699999998, 2024-09-13T05:12:11.273 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89071820800000001, 2024-09-13T05:12:11.273 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.273 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.273 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.273 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.273 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.273 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160315 2024-09-13T05:12:11.273 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.273 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.274 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.274 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.274 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:11.274 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.274 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.274 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.274 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.274 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:11.274 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.274 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.274 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.274 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.274 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:11.275 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.275 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.275 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.275 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.275 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042529+0000", 2024-09-13T05:12:11.275 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3639999999999999e-06 2024-09-13T05:12:11.275 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.275 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.275 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.275 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042536+0000", 2024-09-13T05:12:11.275 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.866e-06 2024-09-13T05:12:11.275 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.275 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.275 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.276 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042541+0000", 2024-09-13T05:12:11.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:12:11.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.276 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.276 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.276 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042587+0000", 2024-09-13T05:12:11.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5735000000000002e-05 2024-09-13T05:12:11.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.276 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.276 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:11.276 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042593+0000", 2024-09-13T05:12:11.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0719999999999996e-06 2024-09-13T05:12:11.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.277 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.277 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.277 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933160+0000", 2024-09-13T05:12:11.277 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89056621000000002 2024-09-13T05:12:11.277 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.277 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.277 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.277 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933202+0000", 2024-09-13T05:12:11.277 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2376000000000002e-05 2024-09-13T05:12:11.277 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.277 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.277 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.277 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933245+0000", 2024-09-13T05:12:11.278 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2787999999999998e-05 2024-09-13T05:12:11.278 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.278 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.278 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.278 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.278 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160317 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:11.278 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:11.278 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.1229142410000001, 2024-09-13T05:12:11.278 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89082205800000003, 2024-09-13T05:12:11.278 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.278 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.278 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.279 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.279 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.279 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160317 2024-09-13T05:12:11.279 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.279 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.279 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.279 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.279 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:11.279 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.279 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.279 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.279 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.279 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:11.279 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.280 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.280 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.280 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.280 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:11.280 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.280 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.280 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.280 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.280 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042558+0000", 2024-09-13T05:12:11.280 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1810000000000001e-06 2024-09-13T05:12:11.280 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.280 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.280 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.281 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042565+0000", 2024-09-13T05:12:11.281 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9280000000000004e-06 2024-09-13T05:12:11.281 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.281 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.281 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.281 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042571+0000", 2024-09-13T05:12:11.281 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7420000000000003e-06 2024-09-13T05:12:11.281 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.281 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.281 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.281 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042616+0000", 2024-09-13T05:12:11.281 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5201999999999999e-05 2024-09-13T05:12:11.281 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.282 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.282 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:11.282 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042622+0000", 2024-09-13T05:12:11.282 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8289999999999996e-06 2024-09-13T05:12:11.282 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.282 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.282 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.282 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933259+0000", 2024-09-13T05:12:11.282 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89063730799999996 2024-09-13T05:12:11.282 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.282 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.282 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.282 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933311+0000", 2024-09-13T05:12:11.283 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1910000000000003e-05 2024-09-13T05:12:11.283 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.283 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.283 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.283 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933377+0000", 2024-09-13T05:12:11.283 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6396999999999995e-05 2024-09-13T05:12:11.283 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.283 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.283 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.283 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.283 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.283 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160319 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 222208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:11.283 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:11.284 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.1228840250000003, 2024-09-13T05:12:11.284 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89087477400000004, 2024-09-13T05:12:11.284 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.284 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.284 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.284 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.284 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.284 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160319 2024-09-13T05:12:11.284 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.284 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.284 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.284 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.284 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:11.284 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.285 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.285 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:11.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.285 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.285 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042585+0000", 2024-09-13T05:12:11.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.286 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.286 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042588+0000", 2024-09-13T05:12:11.286 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9450000000000002e-06 2024-09-13T05:12:11.286 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.286 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.286 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.286 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042594+0000", 2024-09-13T05:12:11.286 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0959999999999997e-06 2024-09-13T05:12:11.286 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.286 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.286 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.286 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042599+0000", 2024-09-13T05:12:11.286 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0069999999999997e-06 2024-09-13T05:12:11.286 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.287 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.287 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.287 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042642+0000", 2024-09-13T05:12:11.287 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2553999999999999e-05 2024-09-13T05:12:11.287 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.287 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.287 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:11.287 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042647+0000", 2024-09-13T05:12:11.287 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.31e-06 2024-09-13T05:12:11.287 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.287 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.287 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.287 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933387+0000", 2024-09-13T05:12:11.288 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89073982799999996 2024-09-13T05:12:11.288 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.288 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.288 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.288 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:12:11.288 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7101000000000003e-05 2024-09-13T05:12:11.288 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.288 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.288 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.288 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933460+0000", 2024-09-13T05:12:11.288 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6282999999999998e-05 2024-09-13T05:12:11.288 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.289 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.289 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.289 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.289 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.289 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160321 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 223232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:11.289 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:11.289 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.122854598, 2024-09-13T05:12:11.289 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89094616999999998, 2024-09-13T05:12:11.289 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.289 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.289 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.289 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.289 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.290 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160321 2024-09-13T05:12:11.290 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.290 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.290 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.290 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.290 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:11.290 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.290 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.290 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.290 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.290 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:11.290 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.290 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.290 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.291 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.291 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:11.291 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.291 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.291 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.291 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.291 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042617+0000", 2024-09-13T05:12:11.291 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8329999999999998e-06 2024-09-13T05:12:11.291 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.291 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.291 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.291 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042638+0000", 2024-09-13T05:12:11.291 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0908e-05 2024-09-13T05:12:11.291 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.292 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.292 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.292 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042644+0000", 2024-09-13T05:12:11.292 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0440000000000001e-06 2024-09-13T05:12:11.292 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.292 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.292 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.292 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042666+0000", 2024-09-13T05:12:11.292 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1256000000000001e-05 2024-09-13T05:12:11.293 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.293 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.293 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:11.293 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042671+0000", 2024-09-13T05:12:11.293 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6250000000000004e-06 2024-09-13T05:12:11.293 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.293 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.293 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.293 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933478+0000", 2024-09-13T05:12:11.293 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89080698800000002 2024-09-13T05:12:11.293 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.293 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.293 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.294 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933519+0000", 2024-09-13T05:12:11.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0717000000000003e-05 2024-09-13T05:12:11.294 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.294 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.294 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.294 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933561+0000", 2024-09-13T05:12:11.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2225999999999999e-05 2024-09-13T05:12:11.294 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.294 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.294 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.294 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.294 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.294 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:11.296 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:12:11.296 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:11.292+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:11.396 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:11.392+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:11.451 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:11.451 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:11.451 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:11.451 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:11.461 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:12:11.497 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:11.496+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:11.564 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:11.565 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:11.565 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:11.565 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:11.565 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:11.574 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:12:11.598 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:11.596+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:11.646 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T05:12:11.689 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:11.689 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:11.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:11.690 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:11.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.690 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29020 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2855936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:11.690 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:12:11.690 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 94.643867357999994, 2024-09-13T05:12:11.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060733743, 2024-09-13T05:12:11.690 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.690 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.690 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.690 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.690 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.690 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29020 2024-09-13T05:12:11.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.691 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:12:11.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041742+0000", 2024-09-13T05:12:11.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.692 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041741+0000", 2024-09-13T05:12:11.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.692 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.692 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041749+0000", 2024-09-13T05:12:11.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6059999999999997e-06 2024-09-13T05:12:11.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.692 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.692 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041754+0000", 2024-09-13T05:12:11.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6740000000000002e-06 2024-09-13T05:12:11.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041760+0000", 2024-09-13T05:12:11.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0459999999999996e-06 2024-09-13T05:12:11.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102289+0000", 2024-09-13T05:12:11.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060529145999999999 2024-09-13T05:12:11.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102378+0000", 2024-09-13T05:12:11.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8901999999999997e-05 2024-09-13T05:12:11.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102476+0000", 2024-09-13T05:12:11.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7991000000000004e-05 2024-09-13T05:12:11.694 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.694 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.694 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.695 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29021 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2865152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:11.695 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:12:11.695 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 94.643845362999997, 2024-09-13T05:12:11.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060927993999999999, 2024-09-13T05:12:11.695 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.695 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.695 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.695 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.695 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.695 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29021 2024-09-13T05:12:11.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.695 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.696 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.696 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:12:11.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.696 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.696 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.696 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:12:11.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.696 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.696 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.696 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041763+0000", 2024-09-13T05:12:11.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041766+0000", 2024-09-13T05:12:11.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6800000000000002e-06 2024-09-13T05:12:11.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041771+0000", 2024-09-13T05:12:11.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:12:11.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041776+0000", 2024-09-13T05:12:11.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8489999999999997e-06 2024-09-13T05:12:11.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102513+0000", 2024-09-13T05:12:11.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060737102000000001 2024-09-13T05:12:11.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102597+0000", 2024-09-13T05:12:11.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4374000000000002e-05 2024-09-13T05:12:11.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.699 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102692+0000", 2024-09-13T05:12:11.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4436000000000002e-05 2024-09-13T05:12:11.699 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.699 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.699 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.699 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29022 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2874368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:11.699 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:11.699 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 94.643829062999998, 2024-09-13T05:12:11.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061135083999999999, 2024-09-13T05:12:11.700 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.700 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.700 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.700 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.700 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.700 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29022 2024-09-13T05:12:11.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.700 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.700 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.700 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:11.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:11.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:11.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041782+0000", 2024-09-13T05:12:11.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4959999999999999e-06 2024-09-13T05:12:11.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.702 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.702 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041787+0000", 2024-09-13T05:12:11.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1240000000000004e-06 2024-09-13T05:12:11.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.702 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.702 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041792+0000", 2024-09-13T05:12:11.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9200000000000003e-06 2024-09-13T05:12:11.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.702 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102738+0000", 2024-09-13T05:12:11.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060945581999999998 2024-09-13T05:12:11.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102821+0000", 2024-09-13T05:12:11.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2898999999999994e-05 2024-09-13T05:12:11.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102915+0000", 2024-09-13T05:12:11.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4523000000000003e-05 2024-09-13T05:12:11.703 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.703 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.704 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.704 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29067 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2764800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:11.704 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:11.704 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 94.640054845999998, 2024-09-13T05:12:11.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060816621000000001, 2024-09-13T05:12:11.705 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.705 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.705 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.705 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.705 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.705 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29067 2024-09-13T05:12:11.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.705 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.705 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:11.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.706 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:11.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.706 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:11.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.706 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045557+0000", 2024-09-13T05:12:11.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.898e-06 2024-09-13T05:12:11.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045575+0000", 2024-09-13T05:12:11.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8252000000000001e-05 2024-09-13T05:12:11.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045581+0000", 2024-09-13T05:12:11.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:12:11.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106183+0000", 2024-09-13T05:12:11.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060602630999999997 2024-09-13T05:12:11.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106271+0000", 2024-09-13T05:12:11.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7329000000000004e-05 2024-09-13T05:12:11.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.709 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.709 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106371+0000", 2024-09-13T05:12:11.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000100164 2024-09-13T05:12:11.709 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.709 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.709 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.709 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29068 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2774016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:11.709 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:12:11.709 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 94.640023611999993, 2024-09-13T05:12:11.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060994509000000002, 2024-09-13T05:12:11.709 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.710 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.710 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.710 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.710 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.710 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29068 2024-09-13T05:12:11.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.710 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.711 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:12:11.711 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.711 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.711 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:12:11.711 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.711 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.711 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045585+0000", 2024-09-13T05:12:11.711 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.712 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.712 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045588+0000", 2024-09-13T05:12:11.712 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:12:11.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.712 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.712 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.712 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045594+0000", 2024-09-13T05:12:11.712 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9329999999999998e-06 2024-09-13T05:12:11.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.712 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.712 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.712 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045599+0000", 2024-09-13T05:12:11.712 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3190000000000002e-06 2024-09-13T05:12:11.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106399+0000", 2024-09-13T05:12:11.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060800361999999997 2024-09-13T05:12:11.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106489+0000", 2024-09-13T05:12:11.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9301000000000004e-05 2024-09-13T05:12:11.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.714 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106580+0000", 2024-09-13T05:12:11.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1314e-05 2024-09-13T05:12:11.714 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.714 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.714 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.714 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29069 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2792448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:11.714 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:12:11.714 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 94.640005195000001, 2024-09-13T05:12:11.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061207599000000001, 2024-09-13T05:12:11.714 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.714 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.715 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.715 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.715 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.715 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29069 2024-09-13T05:12:11.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.715 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.715 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:12:11.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.715 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:12:11.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.716 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.716 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.716 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045603+0000", 2024-09-13T05:12:11.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.716 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.716 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.716 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045606+0000", 2024-09-13T05:12:11.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7300000000000001e-06 2024-09-13T05:12:11.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.716 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.716 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.717 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045612+0000", 2024-09-13T05:12:11.717 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9599999999999997e-06 2024-09-13T05:12:11.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.717 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.717 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045619+0000", 2024-09-13T05:12:11.717 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6019999999999996e-06 2024-09-13T05:12:11.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.717 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.717 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106619+0000", 2024-09-13T05:12:11.717 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061000029999999997 2024-09-13T05:12:11.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.718 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.718 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106713+0000", 2024-09-13T05:12:11.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4505000000000004e-05 2024-09-13T05:12:11.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.718 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.718 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106812+0000", 2024-09-13T05:12:11.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8264000000000007e-05 2024-09-13T05:12:11.718 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.718 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.718 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.718 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29070 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2783232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:11.719 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:11.719 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 94.639984736000002, 2024-09-13T05:12:11.719 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061389805999999998, 2024-09-13T05:12:11.719 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.719 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.719 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.719 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.719 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.719 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29070 2024-09-13T05:12:11.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.719 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.719 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.719 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.719 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:11.720 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.720 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.720 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.720 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:11.720 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.720 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.720 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.720 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:11.720 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.720 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.721 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.721 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045627+0000", 2024-09-13T05:12:11.721 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6579999999999998e-06 2024-09-13T05:12:11.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.721 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.721 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.721 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045632+0000", 2024-09-13T05:12:11.721 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8449999999999999e-06 2024-09-13T05:12:11.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.721 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.721 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.721 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045639+0000", 2024-09-13T05:12:11.721 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:12:11.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.721 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106837+0000", 2024-09-13T05:12:11.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061198529000000002 2024-09-13T05:12:11.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106922+0000", 2024-09-13T05:12:11.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4771999999999994e-05 2024-09-13T05:12:11.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107014+0000", 2024-09-13T05:12:11.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2009000000000006e-05 2024-09-13T05:12:11.723 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.723 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.723 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.723 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29071 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2801664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:11.723 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:12:11.723 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 94.639965660000001, 2024-09-13T05:12:11.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061582804999999997, 2024-09-13T05:12:11.723 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.723 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.723 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.723 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.723 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.724 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29071 2024-09-13T05:12:11.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.724 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:12:11.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.725 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.725 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:12:11.725 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.725 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.725 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045643+0000", 2024-09-13T05:12:11.725 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.725 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.725 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045646+0000", 2024-09-13T05:12:11.726 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:12:11.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.726 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.726 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.726 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045664+0000", 2024-09-13T05:12:11.726 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8408000000000001e-05 2024-09-13T05:12:11.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.726 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.726 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.726 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045670+0000", 2024-09-13T05:12:11.726 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7710000000000003e-06 2024-09-13T05:12:11.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.727 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.727 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107048+0000", 2024-09-13T05:12:11.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061378438 2024-09-13T05:12:11.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.727 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.727 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107134+0000", 2024-09-13T05:12:11.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5574000000000004e-05 2024-09-13T05:12:11.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107226+0000", 2024-09-13T05:12:11.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2262000000000005e-05 2024-09-13T05:12:11.728 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.728 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.728 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.728 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29072 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2810880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:11.728 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:12:11.728 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 94.639934276000005, 2024-09-13T05:12:11.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061762233999999999, 2024-09-13T05:12:11.728 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.729 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.729 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.729 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.729 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.729 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29072 2024-09-13T05:12:11.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.729 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:12:11.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.730 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.730 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:12:11.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.730 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.730 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.730 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.730 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045674+0000", 2024-09-13T05:12:11.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045677+0000", 2024-09-13T05:12:11.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9679999999999998e-06 2024-09-13T05:12:11.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045694+0000", 2024-09-13T05:12:11.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6801999999999999e-05 2024-09-13T05:12:11.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045700+0000", 2024-09-13T05:12:11.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8270000000000003e-06 2024-09-13T05:12:11.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.732 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107249+0000", 2024-09-13T05:12:11.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061549114000000002 2024-09-13T05:12:11.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.732 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107341+0000", 2024-09-13T05:12:11.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2390000000000001e-05 2024-09-13T05:12:11.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.732 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107437+0000", 2024-09-13T05:12:11.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5648000000000003e-05 2024-09-13T05:12:11.733 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.733 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.733 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.733 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29073 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2820096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:11.733 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:12:11.733 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 94.639892298000007, 2024-09-13T05:12:11.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061873910999999997, 2024-09-13T05:12:11.733 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.733 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.733 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.733 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.734 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.734 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29073 2024-09-13T05:12:11.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.734 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:12:11.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:12:11.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045716+0000", 2024-09-13T05:12:11.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045726+0000", 2024-09-13T05:12:11.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6350000000000001e-06 2024-09-13T05:12:11.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045739+0000", 2024-09-13T05:12:11.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3325e-05 2024-09-13T05:12:11.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.736 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.736 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045746+0000", 2024-09-13T05:12:11.736 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7399999999999998e-06 2024-09-13T05:12:11.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.736 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.736 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107457+0000", 2024-09-13T05:12:11.736 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061711038000000003 2024-09-13T05:12:11.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.736 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.736 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107522+0000", 2024-09-13T05:12:11.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4850000000000004e-05 2024-09-13T05:12:11.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107591+0000", 2024-09-13T05:12:11.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9029999999999995e-05 2024-09-13T05:12:11.737 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.737 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.737 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.737 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29074 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2829312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:11.737 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:12:11.737 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 94.639858390000001, 2024-09-13T05:12:11.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062055459, 2024-09-13T05:12:11.738 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.738 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.738 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.738 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.738 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.738 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29074 2024-09-13T05:12:11.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.738 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:12:11.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:12:11.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045750+0000", 2024-09-13T05:12:11.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045753+0000", 2024-09-13T05:12:11.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8399999999999999e-06 2024-09-13T05:12:11.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.740 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.740 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045759+0000", 2024-09-13T05:12:11.740 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8900000000000004e-06 2024-09-13T05:12:11.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.740 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.740 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045764+0000", 2024-09-13T05:12:11.740 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3850000000000001e-06 2024-09-13T05:12:11.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.740 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.740 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107623+0000", 2024-09-13T05:12:11.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061858817000000003 2024-09-13T05:12:11.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.741 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107710+0000", 2024-09-13T05:12:11.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7127999999999997e-05 2024-09-13T05:12:11.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.741 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107806+0000", 2024-09-13T05:12:11.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5886999999999999e-05 2024-09-13T05:12:11.741 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.741 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.741 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.742 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29075 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2838528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:11.742 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:11.742 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 94.639839936000001, 2024-09-13T05:12:11.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062188516999999999, 2024-09-13T05:12:11.742 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.742 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.742 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.742 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.742 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.742 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29075 2024-09-13T05:12:11.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.742 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:11.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:11.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:11.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.744 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045772+0000", 2024-09-13T05:12:11.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:12:11.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.744 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045778+0000", 2024-09-13T05:12:11.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9229999999999996e-06 2024-09-13T05:12:11.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.744 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045784+0000", 2024-09-13T05:12:11.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3800000000000002e-06 2024-09-13T05:12:11.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.745 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.745 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.745 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107823+0000", 2024-09-13T05:12:11.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062039331000000003 2024-09-13T05:12:11.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.745 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.745 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.745 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107886+0000", 2024-09-13T05:12:11.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2476000000000003e-05 2024-09-13T05:12:11.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.745 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.746 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107958+0000", 2024-09-13T05:12:11.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2089999999999996e-05 2024-09-13T05:12:11.746 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.746 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.746 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.746 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29115 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2682880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:11.746 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:12:11.746 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 94.636374408999998, 2024-09-13T05:12:11.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060847898999999997, 2024-09-13T05:12:11.746 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.746 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.747 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.747 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.747 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.747 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29115 2024-09-13T05:12:11.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.747 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:12:11.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:12:11.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049234+0000", 2024-09-13T05:12:11.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049237+0000", 2024-09-13T05:12:11.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9069999999999999e-06 2024-09-13T05:12:11.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049243+0000", 2024-09-13T05:12:11.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7459999999999997e-06 2024-09-13T05:12:11.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049248+0000", 2024-09-13T05:12:11.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1490000000000002e-06 2024-09-13T05:12:11.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.109945+0000", 2024-09-13T05:12:11.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060697299000000003 2024-09-13T05:12:11.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110013+0000", 2024-09-13T05:12:11.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8023999999999998e-05 2024-09-13T05:12:11.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110083+0000", 2024-09-13T05:12:11.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9296999999999997e-05 2024-09-13T05:12:11.750 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.750 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.750 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.750 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29116 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2692096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:11.751 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:12:11.751 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 94.636356565, 2024-09-13T05:12:11.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061040167999999999, 2024-09-13T05:12:11.751 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.751 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.751 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.751 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.751 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.751 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29116 2024-09-13T05:12:11.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.751 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:12:11.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:12:11.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049252+0000", 2024-09-13T05:12:11.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049255+0000", 2024-09-13T05:12:11.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7250000000000002e-06 2024-09-13T05:12:11.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049261+0000", 2024-09-13T05:12:11.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.755e-06 2024-09-13T05:12:11.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049266+0000", 2024-09-13T05:12:11.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2100000000000001e-06 2024-09-13T05:12:11.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110115+0000", 2024-09-13T05:12:11.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060849225999999999 2024-09-13T05:12:11.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110199+0000", 2024-09-13T05:12:11.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4339999999999995e-05 2024-09-13T05:12:11.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110293+0000", 2024-09-13T05:12:11.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3397e-05 2024-09-13T05:12:11.755 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.755 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.755 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.755 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29117 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2701312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:11.755 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:11.755 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 94.636338928000001, 2024-09-13T05:12:11.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.06118527, 2024-09-13T05:12:11.755 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.755 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.755 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.756 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.756 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.756 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29117 2024-09-13T05:12:11.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.756 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:11.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:11.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:11.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049273+0000", 2024-09-13T05:12:11.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.757e-06 2024-09-13T05:12:11.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049278+0000", 2024-09-13T05:12:11.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7830000000000004e-06 2024-09-13T05:12:11.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049284+0000", 2024-09-13T05:12:11.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3820000000000003e-06 2024-09-13T05:12:11.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110313+0000", 2024-09-13T05:12:11.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061029682000000002 2024-09-13T05:12:11.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110383+0000", 2024-09-13T05:12:11.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9406000000000006e-05 2024-09-13T05:12:11.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110456+0000", 2024-09-13T05:12:11.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2750000000000007e-05 2024-09-13T05:12:11.759 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.759 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.759 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.760 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29118 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2710528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:11.760 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:11.760 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 94.636321013, 2024-09-13T05:12:11.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061380698999999997, 2024-09-13T05:12:11.760 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.760 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.760 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.760 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.760 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.760 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29118 2024-09-13T05:12:11.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.760 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:11.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:11.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:11.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049291+0000", 2024-09-13T05:12:11.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8770000000000002e-06 2024-09-13T05:12:11.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049296+0000", 2024-09-13T05:12:11.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6799999999999998e-06 2024-09-13T05:12:11.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.763 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.763 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049302+0000", 2024-09-13T05:12:11.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2769999999999996e-06 2024-09-13T05:12:11.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.763 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.763 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110488+0000", 2024-09-13T05:12:11.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061186184999999997 2024-09-13T05:12:11.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110577+0000", 2024-09-13T05:12:11.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9246000000000006e-05 2024-09-13T05:12:11.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110669+0000", 2024-09-13T05:12:11.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1923999999999996e-05 2024-09-13T05:12:11.764 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.764 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.765 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.765 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29119 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2719744~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:11.765 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:12:11.765 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 94.636303268999995, 2024-09-13T05:12:11.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061521165000000003, 2024-09-13T05:12:11.765 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.765 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.765 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.765 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.765 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.766 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29119 2024-09-13T05:12:11.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.766 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:12:11.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:12:11.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049305+0000", 2024-09-13T05:12:11.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049308+0000", 2024-09-13T05:12:11.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7070000000000001e-06 2024-09-13T05:12:11.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049316+0000", 2024-09-13T05:12:11.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:12:11.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049322+0000", 2024-09-13T05:12:11.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3199999999999999e-06 2024-09-13T05:12:11.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110690+0000", 2024-09-13T05:12:11.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061368428000000003 2024-09-13T05:12:11.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110755+0000", 2024-09-13T05:12:11.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4893000000000004e-05 2024-09-13T05:12:11.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.769 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.769 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110827+0000", 2024-09-13T05:12:11.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2039000000000006e-05 2024-09-13T05:12:11.769 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.769 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.769 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.769 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29120 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2728960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:11.769 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:11.769 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 94.636282999000002, 2024-09-13T05:12:11.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061718420000000003, 2024-09-13T05:12:11.770 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.770 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.770 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.770 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.770 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.770 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29120 2024-09-13T05:12:11.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.770 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:11.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:11.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:11.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049329+0000", 2024-09-13T05:12:11.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.022e-06 2024-09-13T05:12:11.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049336+0000", 2024-09-13T05:12:11.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0720000000000002e-06 2024-09-13T05:12:11.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049341+0000", 2024-09-13T05:12:11.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:12:11.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110864+0000", 2024-09-13T05:12:11.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061523126999999997 2024-09-13T05:12:11.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110951+0000", 2024-09-13T05:12:11.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6557000000000005e-05 2024-09-13T05:12:11.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.111045+0000", 2024-09-13T05:12:11.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4043999999999996e-05 2024-09-13T05:12:11.773 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.774 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.774 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.774 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29136 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2876416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:11.774 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:12:11.774 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 94.632267573999997, 2024-09-13T05:12:11.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060742995000000001, 2024-09-13T05:12:11.774 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.774 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.774 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.775 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.775 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.775 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29136 2024-09-13T05:12:11.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.775 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:12:11.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:12:11.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053341+0000", 2024-09-13T05:12:11.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053344+0000", 2024-09-13T05:12:11.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:12:11.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053350+0000", 2024-09-13T05:12:11.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7200000000000003e-06 2024-09-13T05:12:11.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053355+0000", 2024-09-13T05:12:11.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0150000000000003e-06 2024-09-13T05:12:11.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113909+0000", 2024-09-13T05:12:11.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060554368999999997 2024-09-13T05:12:11.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113994+0000", 2024-09-13T05:12:11.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4658000000000002e-05 2024-09-13T05:12:11.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114085+0000", 2024-09-13T05:12:11.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0939000000000005e-05 2024-09-13T05:12:11.779 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.779 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.779 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.779 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29166 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2628608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:11.779 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:11.779 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 94.632250139999996, 2024-09-13T05:12:11.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060883127000000002, 2024-09-13T05:12:11.779 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:11.780 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:11.780 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:11.780 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:11.780 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:11.780 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29166 2024-09-13T05:12:11.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.780 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:11.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:11.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:11.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:11.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:11.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:11.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:11.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:11.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:11.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:11.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053361+0000", 2024-09-13T05:12:11.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:12:11.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:11.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053367+0000", 2024-09-13T05:12:11.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7350000000000001e-06 2024-09-13T05:12:11.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:11.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053372+0000", 2024-09-13T05:12:11.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7840000000000003e-06 2024-09-13T05:12:11.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:11.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114103+0000", 2024-09-13T05:12:11.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060730924999999998 2024-09-13T05:12:11.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:11.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114171+0000", 2024-09-13T05:12:11.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8021999999999993e-05 2024-09-13T05:12:11.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:11.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:11.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:11.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114242+0000", 2024-09-13T05:12:11.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1390999999999995e-05 2024-09-13T05:12:11.783 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.783 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.783 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.784 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:11.784 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:11.784 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:11.785 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:11.724+0000 7fada0141880 -1 osd.0 105 log_to_monitors true 2024-09-13T05:12:11.785 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:12:11.789 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:11.780+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:11.890 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:11.888+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:11.948 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:11.949 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:11.949 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:11.949 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:11.959 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:12:11.987 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:11.984+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:12.068 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:12.068 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:12.068 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:12.069 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:12.069 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:12.079 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:12:12.126 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:12.120+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:12.191 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:12.188+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:12.236 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:12.237 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:12.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:12.237 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:12.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.237 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:12.237 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:12.237 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 95.369437931999997, 2024-09-13T05:12:12.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:12:12.237 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:12.237 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:12.237 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:12.237 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:12.238 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.238 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:12:12.238 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.238 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:12.238 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.238 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:12.238 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:12.238 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.238 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.239 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.239 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:12.239 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:12.239 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.239 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.239 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.239 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:12.239 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:12.239 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:12.239 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.239 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.240 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:12.240 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:12:12.240 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:12:12.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.240 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.240 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:12.240 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:12:12.240 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:12:12.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.240 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:12:12.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:12:12.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:12:12.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:12:12.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:12.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:12:12.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:12:12.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:12:12.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:12:12.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.243 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.243 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:12.243 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:12:12.243 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:12:12.243 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.243 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.243 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:12.243 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:12:12.243 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:12:12.243 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.244 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:12.244 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.244 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.244 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.244 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:12.244 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:12.244 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 95.369413496000007, 2024-09-13T05:12:12.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:12:12.245 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:12.245 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:12.245 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:12.245 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:12.245 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.245 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:12:12.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.245 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:12.245 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:12.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:12.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:12.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:12.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:12.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:12.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:12.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:12.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:12:12.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:12:12.248 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.248 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:12.248 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:12:12.248 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:12:12.248 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.248 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.248 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:12:12.249 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:12:12.249 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.249 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.249 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.249 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:12:12.249 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:12:12.249 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.249 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.249 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:12.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:12:12.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:12:12.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:12:12.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:12:12.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:12.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:12:12.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:12:12.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:12.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:12:12.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:12:12.251 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.252 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:12.252 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.252 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.252 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.252 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:12.252 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:12.252 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 95.369403669999997, 2024-09-13T05:12:12.253 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:12:12.253 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:12.253 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:12.253 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:12.253 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:12.253 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.253 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:12:12.253 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.253 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:12.254 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.254 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:12.254 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:12.254 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.254 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.254 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.254 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:12.254 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:12.254 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.254 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.254 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.255 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:12.255 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:12.255 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:12.255 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.255 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.255 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:12.255 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:12:12.255 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:12:12.255 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.255 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.255 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:12.256 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:12:12.256 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:12:12.256 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.256 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.256 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.256 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:12:12.256 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:12:12.256 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.257 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.257 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.257 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:12:12.257 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:12:12.257 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.257 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.257 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:12.257 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:12:12.257 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:12:12.257 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.258 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.258 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.258 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:12:12.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:12:12.258 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.258 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.258 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:12.258 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:12:12.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:12:12.258 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.259 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:12.259 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.259 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:12.259 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:12.259 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 95.369395433999998, 2024-09-13T05:12:12.260 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:12:12.260 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:12.260 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:12.260 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:12.260 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:12.260 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.261 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:12:12.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.261 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:12.261 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.261 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:12.261 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:12.261 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.262 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.262 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.262 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:12.262 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:12.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.262 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.262 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.262 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:12.263 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:12.263 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:12.263 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.263 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.263 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:12.263 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:12:12.263 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:12:12.263 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.263 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:12.264 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:12:12.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:12:12.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.264 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:12:12.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:12:12.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.265 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.265 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:12:12.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:12:12.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.266 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:12.266 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:12:12.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:12:12.266 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.266 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.266 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:12:12.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:12:12.266 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.267 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:12.267 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:12:12.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:12:12.267 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.267 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:12.267 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.267 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.267 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:12.268 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:12.268 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 95.369373522000004, 2024-09-13T05:12:12.268 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:12:12.268 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:12.268 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:12.268 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:12.268 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:12.268 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.268 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:12:12.268 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.269 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:12.269 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.269 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:12.269 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:12.269 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.269 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.269 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.269 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:12.269 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:12.269 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.269 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.270 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.270 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:12.270 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:12.270 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:12.270 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.270 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.270 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:12.270 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:12:12.270 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:12:12.270 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.270 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.271 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:12.271 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:12:12.271 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:12:12.271 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.271 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.271 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.271 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:12:12.271 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:12:12.271 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.271 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.271 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.272 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:12:12.272 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:12:12.272 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.272 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.272 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:12.272 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:12:12.272 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:12:12.273 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.273 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.273 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.273 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:12:12.273 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:12:12.273 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.273 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.274 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:12.274 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:12:12.274 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:12:12.274 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.274 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:12.274 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.274 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.274 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.274 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:12.274 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:12.274 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 95.369364918000002, 2024-09-13T05:12:12.275 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:12:12.275 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:12.275 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:12.275 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:12.275 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:12.275 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.275 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:12:12.275 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.275 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:12.275 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.275 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:12.275 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:12.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.276 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.276 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:12.276 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:12.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.276 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.276 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:12.276 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:12.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:12.277 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.277 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.277 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:12.277 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:12:12.277 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:12:12.277 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.277 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.278 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:12.278 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:12:12.278 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:12:12.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.278 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.278 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.278 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:12:12.278 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:12:12.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.278 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.279 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.279 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:12:12.279 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:12:12.279 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.279 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.279 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:12.279 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:12:12.279 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:12:12.279 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.279 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.280 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.280 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:12:12.280 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:12:12.280 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.280 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.280 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:12.280 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:12:12.280 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:12:12.281 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.281 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:12.281 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.281 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.281 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.281 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:12.281 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:12.282 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 95.369355224000003, 2024-09-13T05:12:12.282 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:12:12.282 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:12.282 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:12.282 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:12.282 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:12.282 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.283 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:12:12.283 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.283 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:12.283 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.283 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:12.283 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:12.283 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.283 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.284 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.284 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:12.284 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:12.284 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.284 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.284 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.284 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:12.284 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:12.284 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:12.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.285 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:12.285 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:12:12.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:12:12.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.286 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:12.286 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:12:12.286 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:12:12.286 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.286 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.286 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.286 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:12:12.286 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:12:12.286 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.287 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.287 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.287 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:12:12.287 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:12:12.287 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.287 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.287 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:12.288 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:12:12.288 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:12:12.288 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.288 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.288 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.288 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:12:12.288 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:12:12.288 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.288 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.289 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:12.289 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:12:12.289 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:12:12.289 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.289 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:12.289 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.289 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.289 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.289 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:12.290 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:12.290 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 95.369346109000006, 2024-09-13T05:12:12.290 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:12:12.290 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:12.290 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:12.290 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:12.290 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:12.290 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.290 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:12:12.291 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.291 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:12.291 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.291 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:12.291 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:12.291 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.291 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.291 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.292 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:12.292 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:12.292 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.292 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.292 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.292 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:12.293 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:12.293 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:12.293 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.293 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.293 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:12.293 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:12:12.293 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:12:12.293 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.293 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.294 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:12.294 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:12:12.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:12:12.294 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.294 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.294 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.294 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:12:12.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:12:12.295 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.295 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.295 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.295 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:12:12.295 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:12:12.295 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.296 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.296 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:12.296 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:12:12.296 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:12:12.296 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.296 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.296 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.297 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:12:12.297 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:12:12.297 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.297 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.297 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:12.297 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:12:12.297 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:12:12.297 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.298 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:12.298 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.298 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.298 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.298 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:12.298 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:12:12.298 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 95.369337630000004, 2024-09-13T05:12:12.298 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:12:12.299 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:12.299 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:12.299 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:12.299 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:12.299 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.299 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:12:12.300 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.300 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:12.300 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.300 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:12.300 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:12:12.300 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.301 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.301 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.301 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:12.301 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:12:12.301 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.301 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.301 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.301 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:12.302 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:12:12.302 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:12.302 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.302 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.302 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:12.302 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:12:12.302 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:12:12.303 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.303 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.303 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:12.303 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:12:12.303 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:12:12.303 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.303 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.304 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.304 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:12:12.304 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:12:12.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.304 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.304 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.304 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:12:12.304 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:12:12.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.305 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.305 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:12.305 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:12:12.305 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:12:12.305 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.305 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.305 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.305 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:12:12.305 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:12:12.306 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.306 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.306 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:12.306 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:12:12.306 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:12:12.306 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.306 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:12.306 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.306 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.306 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.306 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:12.307 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:12:12.307 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 95.369325704999994, 2024-09-13T05:12:12.307 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:12:12.307 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:12.307 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:12.307 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:12.307 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:12.307 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.307 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:12:12.307 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.308 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:12.308 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.308 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:12.308 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:12:12.308 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.308 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.308 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.308 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:12.308 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:12:12.308 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.308 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.309 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.309 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:12.309 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:12:12.309 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:12.309 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.309 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.309 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:12.309 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:12:12.309 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:12:12.309 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.309 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.309 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:12.310 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:12:12.310 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:12:12.310 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.310 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.310 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.310 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:12:12.310 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:12:12.310 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.311 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.311 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.311 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:12:12.311 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:12:12.311 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.311 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.311 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:12.311 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:12:12.311 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:12:12.312 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.312 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.312 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.312 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:12:12.312 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:12:12.312 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.312 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.312 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:12.312 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:12:12.312 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:12:12.313 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.313 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:12.313 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.313 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.313 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.313 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:12.313 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:12.313 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 95.369304115999995, 2024-09-13T05:12:12.313 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:12:12.313 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:12.313 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:12.314 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:12.314 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:12.314 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.314 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:12:12.314 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.314 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:12.314 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.314 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:12.314 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:12.315 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.315 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.315 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.315 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:12.315 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:12.315 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.315 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.315 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.315 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:12.315 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:12.316 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:12.316 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.316 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.316 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:12.316 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:12:12.316 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:12:12.316 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.316 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.316 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:12.316 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:12:12.316 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:12:12.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.317 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.317 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.317 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:12:12.317 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:12:12.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.317 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.317 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.317 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:12:12.317 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:12:12.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.318 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.318 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:12.318 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:12:12.318 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:12:12.318 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.318 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.318 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.318 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:12:12.318 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:12:12.318 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.319 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.319 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:12.319 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:12:12.319 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:12:12.319 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.319 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:12.319 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.319 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.319 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.319 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:12.319 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:12.319 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 95.369280988, 2024-09-13T05:12:12.320 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:12:12.320 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:12.320 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:12.320 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:12.320 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:12.320 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.320 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:12:12.320 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.320 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:12.320 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.321 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:12.321 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:12.321 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.321 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.321 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.321 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:12.321 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:12.322 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.322 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.322 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.322 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:12.322 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:12.322 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:12.322 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.322 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.322 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:12.322 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:12:12.323 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:12:12.323 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.323 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.323 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:12.323 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:12:12.323 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:12:12.323 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.323 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.323 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.323 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:12:12.323 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:12:12.323 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.324 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.324 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.324 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:12:12.324 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:12:12.324 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.324 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.324 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:12.324 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:12:12.324 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:12:12.324 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.324 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.325 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.325 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:12:12.325 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:12:12.325 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.325 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.325 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:12.325 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:12:12.325 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:12:12.325 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.325 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:12.325 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.326 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.326 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.326 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:12.326 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:12:12.326 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 95.369265615000003, 2024-09-13T05:12:12.326 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:12:12.326 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:12.326 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:12.326 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:12.326 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:12.326 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.326 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:12:12.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.327 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:12.327 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.327 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:12.327 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:12:12.327 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.327 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.327 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:12.327 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:12:12.327 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.328 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.328 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:12.328 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:12:12.328 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:12.328 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.328 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.328 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:12.328 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:12:12.328 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:12:12.328 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.328 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.328 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:12.329 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:12:12.329 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:12:12.329 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.329 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.329 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.329 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:12:12.329 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:12:12.329 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.329 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.329 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.329 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:12:12.329 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:12:12.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.330 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.330 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:12.330 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:12:12.330 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:12:12.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.330 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.330 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.330 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:12:12.330 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:12:12.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.330 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.331 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:12.331 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:12:12.331 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:12:12.331 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.331 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:12.331 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.331 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.331 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:12.331 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:12.331 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 95.369245147000001, 2024-09-13T05:12:12.331 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:12:12.332 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:12.332 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:12.332 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:12.332 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:12.332 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.332 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:12:12.332 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.332 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:12.332 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.332 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:12.332 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:12.332 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.333 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.333 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.333 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:12.333 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:12.333 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.333 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.333 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.333 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:12.333 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:12.333 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:12.333 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.333 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.334 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:12.334 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:12:12.334 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:12:12.334 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.334 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.334 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:12.334 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:12:12.334 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:12:12.334 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.334 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.334 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.334 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:12:12.335 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:12:12.335 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.335 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.335 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.335 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:12:12.335 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:12:12.335 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.335 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.335 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:12.335 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:12:12.335 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:12:12.335 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.336 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.336 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.336 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:12:12.336 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:12:12.336 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.336 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.336 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:12.336 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:12:12.336 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:12:12.336 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.336 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:12.337 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.337 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.337 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.337 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:12.337 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:12.337 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 95.369228485999997, 2024-09-13T05:12:12.337 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:12:12.337 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:12.337 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:12.337 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:12.337 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:12.337 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.338 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:12:12.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.338 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:12.338 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.338 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:12.338 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:12.338 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.338 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.338 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:12.338 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:12.338 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.339 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.339 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:12.339 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:12.339 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:12.339 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.339 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.339 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:12.339 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:12:12.339 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:12:12.339 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.339 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.339 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:12.340 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:12:12.340 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:12:12.340 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.340 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.340 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.340 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:12:12.340 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:12:12.340 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.340 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.340 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.340 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:12:12.341 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:12:12.341 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.341 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.341 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:12.341 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:12:12.341 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:12:12.341 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.341 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.341 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.341 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:12:12.341 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:12:12.341 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.342 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.342 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:12.342 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:12:12.342 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:12:12.342 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.342 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:12.342 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.342 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.342 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.342 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:12.342 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:12:12.342 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 95.369201773, 2024-09-13T05:12:12.343 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:12:12.343 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:12.343 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:12.343 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:12.343 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:12.343 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.343 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:12:12.343 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.343 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:12.343 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.344 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:12.344 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:12:12.344 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.344 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.344 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.344 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:12.344 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:12:12.344 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.345 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.345 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.345 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:12.345 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:12:12.345 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:12.345 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.345 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.345 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:12.345 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:12:12.345 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:12:12.346 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.346 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.346 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:12.346 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:12:12.346 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:12:12.346 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.346 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.346 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.346 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:12:12.346 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:12:12.346 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.347 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.347 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.347 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:12:12.347 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:12:12.347 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.347 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.347 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:12.347 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:12:12.347 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:12:12.347 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.347 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.347 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.348 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:12:12.348 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:12:12.348 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.348 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.348 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:12.348 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:12:12.348 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:12:12.348 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.348 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:12.348 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.348 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.349 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.349 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:12.349 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:12.349 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 95.369182921000004, 2024-09-13T05:12:12.349 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:12:12.349 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:12.349 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:12.349 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:12.349 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:12.349 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.349 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:12:12.349 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.349 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:12.350 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.350 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:12.350 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:12.350 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.350 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.350 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.350 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:12.350 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:12.350 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.350 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.350 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.350 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:12.351 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:12.351 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:12.351 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.351 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.351 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:12.351 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:12:12.351 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:12:12.351 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.351 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.351 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:12.351 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:12:12.351 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:12:12.352 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.352 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.352 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.352 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:12:12.352 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:12:12.352 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.352 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.352 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.352 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:12:12.352 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:12:12.352 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.352 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.353 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:12.353 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:12:12.353 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:12:12.353 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.353 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.353 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.353 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:12:12.353 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:12:12.353 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.353 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.353 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:12.353 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:12:12.354 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:12:12.354 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.354 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:12.354 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.354 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.354 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.354 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:12.354 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:12.354 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 95.369165135000003, 2024-09-13T05:12:12.354 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:12:12.354 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:12.354 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:12.355 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:12.355 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:12.355 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.355 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:12:12.355 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.355 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:12.355 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.355 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:12.355 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:12.355 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.355 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.355 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.356 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:12.356 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:12.356 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.356 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.356 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.356 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:12.356 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:12.356 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:12.356 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.356 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.356 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:12.356 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:12:12.357 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:12:12.357 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.357 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.357 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:12.357 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:12:12.357 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:12:12.357 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.357 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.357 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.357 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:12:12.357 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:12:12.357 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.358 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.358 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.358 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:12:12.358 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:12:12.358 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.358 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.358 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:12.358 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:12:12.358 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:12:12.358 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.358 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.358 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.359 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:12:12.359 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:12:12.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.359 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.359 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:12.359 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:12:12.359 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:12:12.359 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.359 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:12.359 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.359 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.360 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:12.360 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:12.360 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 95.369130075000001, 2024-09-13T05:12:12.360 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:12:12.360 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:12.360 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:12.360 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:12.360 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:12.360 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.360 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:12:12.360 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.361 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:12.361 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.361 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:12.361 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:12.361 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.361 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.361 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.361 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:12.361 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:12.361 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.362 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.362 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.362 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:12.362 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:12.362 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:12.362 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.362 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.362 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:12.362 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:12:12.362 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:12:12.362 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.362 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.363 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:12.363 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:12:12.363 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:12:12.363 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.363 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.363 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.363 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:12:12.363 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:12:12.363 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.363 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.363 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.363 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:12:12.364 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:12:12.364 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.364 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.364 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:12.364 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:12:12.364 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:12:12.364 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.364 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.364 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.364 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:12:12.364 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:12:12.365 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.365 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.365 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:12.365 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:12:12.365 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:12:12.365 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.365 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:12.365 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.366 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.366 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.366 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:12.366 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:12.366 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 95.369113260000006, 2024-09-13T05:12:12.366 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:12:12.366 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:12.366 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:12.366 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:12.366 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:12.366 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.367 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:12:12.367 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.367 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:12.367 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.367 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:12.367 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:12.367 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.367 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.367 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.367 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:12.367 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:12.367 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:12.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.368 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.368 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:12.368 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:12.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:12.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.368 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.368 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:12.368 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:12:12.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:12:12.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.368 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:12.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:12:12.369 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:12:12.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:12:12.369 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:12:12.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:12:12.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:12:12.370 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.370 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.370 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:12.370 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:12:12.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:12:12.370 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.370 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.370 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:12.370 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:12:12.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:12:12.370 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:12.371 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:12.371 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:12.371 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:12:12.371 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:12:12.371 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.371 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:12.371 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.371 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:12.371 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:12.371 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:12.373 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:12.368+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:12.373 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:12:12.474 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:12.472+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:12.491 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:12.491 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:12.491 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:12.491 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:12.499 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:12:12.518 INFO:teuthology.orchestra.run.smithi120.stdout:5140 write 0xdf3408d thru 0xdf35e7b (0x1def bytes) 2024-09-13T05:12:12.575 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:12.572+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:12.611 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:12.611 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:12.611 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:12.611 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:12.612 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:12.620 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:12:12.655 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is set 2024-09-13T05:12:12.673 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:12.671+0000 7fad93a2f700 -1 osd.0 105 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T05:12:12.676 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:12.671+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:12.731 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:12.731 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:12.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:12.731 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:12.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.731 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10636 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 749568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:12.731 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:12:12.731 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 102.325417681, 2024-09-13T05:12:12.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328440999999999, 2024-09-13T05:12:12.731 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:12.731 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:12.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:12.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:12.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.732 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10636 2024-09-13T05:12:12.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.732 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:12.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:12.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:12:12.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:12.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:12:12.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:12.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402011+0000", 2024-09-13T05:12:12.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:12:12.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:12.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402017+0000", 2024-09-13T05:12:12.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5620000000000003e-06 2024-09-13T05:12:12.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:12.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402020+0000", 2024-09-13T05:12:12.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1410000000000001e-06 2024-09-13T05:12:12.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402024+0000", 2024-09-13T05:12:12.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4489999999999999e-06 2024-09-13T05:12:12.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:12.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430256+0000", 2024-09-13T05:12:12.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028232363 2024-09-13T05:12:12.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:12.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430299+0000", 2024-09-13T05:12:12.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2830999999999997e-05 2024-09-13T05:12:12.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:12.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430340+0000", 2024-09-13T05:12:12.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1301000000000003e-05 2024-09-13T05:12:12.735 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.735 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:12.736 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.736 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10637 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 758784~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:12.736 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:12:12.736 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 102.325402568, 2024-09-13T05:12:12.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028441793, 2024-09-13T05:12:12.736 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:12.736 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:12.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:12.737 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:12.737 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.737 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10637 2024-09-13T05:12:12.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.737 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:12.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:12.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:12:12.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:12.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:12:12.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:12.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:12:12.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:12:12.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:12.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402031+0000", 2024-09-13T05:12:12.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6770000000000003e-06 2024-09-13T05:12:12.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:12.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402034+0000", 2024-09-13T05:12:12.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1540000000000002e-06 2024-09-13T05:12:12.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402038+0000", 2024-09-13T05:12:12.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4970000000000001e-06 2024-09-13T05:12:12.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:12.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430367+0000", 2024-09-13T05:12:12.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328906000000001 2024-09-13T05:12:12.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:12.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430416+0000", 2024-09-13T05:12:12.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:12:12.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:12.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430469+0000", 2024-09-13T05:12:12.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2284999999999998e-05 2024-09-13T05:12:12.741 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.741 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:12.741 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.741 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10638 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 768000~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:12.742 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:12:12.742 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 102.32538908399999, 2024-09-13T05:12:12.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028548740999999999, 2024-09-13T05:12:12.742 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:12.742 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:12.742 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:12.742 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:12.742 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.742 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10638 2024-09-13T05:12:12.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.742 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:12.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:12.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:12:12.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:12.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:12:12.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:12.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:12:12.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:12.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:12.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402041+0000", 2024-09-13T05:12:12.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4789999999999999e-06 2024-09-13T05:12:12.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:12.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402044+0000", 2024-09-13T05:12:12.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.694e-06 2024-09-13T05:12:12.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402047+0000", 2024-09-13T05:12:12.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.537e-06 2024-09-13T05:12:12.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:12.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430494+0000", 2024-09-13T05:12:12.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028447665 2024-09-13T05:12:12.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:12.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430544+0000", 2024-09-13T05:12:12.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9539000000000001e-05 2024-09-13T05:12:12.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:12.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430589+0000", 2024-09-13T05:12:12.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5071999999999998e-05 2024-09-13T05:12:12.745 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.746 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:12.746 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.746 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10639 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 777216~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:12.746 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:12:12.746 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 102.325378703, 2024-09-13T05:12:12.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028651769000000001, 2024-09-13T05:12:12.746 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:12.746 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:12.746 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:12.746 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:12.746 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.747 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10639 2024-09-13T05:12:12.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.747 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:12.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:12.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:12:12.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:12.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:12:12.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:12.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402050+0000", 2024-09-13T05:12:12.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:12.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:12.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402052+0000", 2024-09-13T05:12:12.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2249999999999999e-06 2024-09-13T05:12:12.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:12.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402054+0000", 2024-09-13T05:12:12.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8140000000000001e-06 2024-09-13T05:12:12.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402057+0000", 2024-09-13T05:12:12.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4889999999999998e-06 2024-09-13T05:12:12.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:12.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430607+0000", 2024-09-13T05:12:12.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028549896000000002 2024-09-13T05:12:12.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:12.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430651+0000", 2024-09-13T05:12:12.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4622000000000001e-05 2024-09-13T05:12:12.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:12.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430702+0000", 2024-09-13T05:12:12.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0980999999999999e-05 2024-09-13T05:12:12.751 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.751 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:12.751 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.752 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11898 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 588800~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:12.752 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:12:12.752 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 102.24644618400001, 2024-09-13T05:12:12.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028308628999999998, 2024-09-13T05:12:12.752 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:12.752 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:12.752 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:12.753 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:12.753 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.753 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11898 2024-09-13T05:12:12.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.753 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:12.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:12.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:12:12.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:12.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:12:12.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:12.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:12:12.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:12.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:12.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480984+0000", 2024-09-13T05:12:12.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:12:12.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:12.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480988+0000", 2024-09-13T05:12:12.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4640000000000002e-06 2024-09-13T05:12:12.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480991+0000", 2024-09-13T05:12:12.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3469999999999999e-06 2024-09-13T05:12:12.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:12.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509199+0000", 2024-09-13T05:12:12.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028207449999999998 2024-09-13T05:12:12.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:12.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509250+0000", 2024-09-13T05:12:12.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1375000000000002e-05 2024-09-13T05:12:12.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:12.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509292+0000", 2024-09-13T05:12:12.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1730000000000002e-05 2024-09-13T05:12:12.758 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.758 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:12.758 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.758 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11899 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 598016~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:12.758 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:12:12.758 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 102.246435343, 2024-09-13T05:12:12.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516703000000001, 2024-09-13T05:12:12.758 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:12.759 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:12.759 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:12.759 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:12.759 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.759 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11899 2024-09-13T05:12:12.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.759 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:12.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:12.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:12:12.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:12.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:12:12.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:12.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:12:12.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:12.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:12.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480995+0000", 2024-09-13T05:12:12.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7349999999999999e-06 2024-09-13T05:12:12.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:12.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481000+0000", 2024-09-13T05:12:12.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0289999999999996e-06 2024-09-13T05:12:12.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481004+0000", 2024-09-13T05:12:12.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3699999999999999e-06 2024-09-13T05:12:12.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:12.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509332+0000", 2024-09-13T05:12:12.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328320000000001 2024-09-13T05:12:12.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:12.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509428+0000", 2024-09-13T05:12:12.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6150999999999995e-05 2024-09-13T05:12:12.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:12.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509511+0000", 2024-09-13T05:12:12.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2396000000000002e-05 2024-09-13T05:12:12.763 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.763 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:12.763 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.764 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11900 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 607232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:12.764 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:12:12.764 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 102.24642275399999, 2024-09-13T05:12:12.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028621273999999999, 2024-09-13T05:12:12.764 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:12.764 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:12.764 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:12.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:12.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.765 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11900 2024-09-13T05:12:12.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.765 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:12.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:12.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:12:12.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:12.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:12:12.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:12.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481006+0000", 2024-09-13T05:12:12.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:12.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:12.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481008+0000", 2024-09-13T05:12:12.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.73e-06 2024-09-13T05:12:12.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:12.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481011+0000", 2024-09-13T05:12:12.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4000000000000001e-06 2024-09-13T05:12:12.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481015+0000", 2024-09-13T05:12:12.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2760000000000001e-06 2024-09-13T05:12:12.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:12.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509531+0000", 2024-09-13T05:12:12.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516102000000002 2024-09-13T05:12:12.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:12.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509588+0000", 2024-09-13T05:12:12.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7423999999999998e-05 2024-09-13T05:12:12.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:12.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509628+0000", 2024-09-13T05:12:12.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9644000000000002e-05 2024-09-13T05:12:12.769 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.769 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:12.769 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.769 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11901 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 616448~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:12.770 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:12:12.770 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 102.24641213300001, 2024-09-13T05:12:12.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028820500999999998, 2024-09-13T05:12:12.770 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:12.770 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:12.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:12.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:12.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.770 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11901 2024-09-13T05:12:12.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.770 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:12.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:12.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:12:12.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:12.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:12:12.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:12.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:12:12.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:12.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:12.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481022+0000", 2024-09-13T05:12:12.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0209999999999999e-06 2024-09-13T05:12:12.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:12.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481026+0000", 2024-09-13T05:12:12.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:12:12.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481029+0000", 2024-09-13T05:12:12.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.636e-06 2024-09-13T05:12:12.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:12.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509661+0000", 2024-09-13T05:12:12.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028631496999999999 2024-09-13T05:12:12.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:12.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509757+0000", 2024-09-13T05:12:12.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5780999999999997e-05 2024-09-13T05:12:12.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:12.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509838+0000", 2024-09-13T05:12:12.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1102999999999999e-05 2024-09-13T05:12:12.773 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.773 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:12.774 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.774 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11902 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 625664~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:12.774 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:12:12.774 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 102.246390271, 2024-09-13T05:12:12.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028894265999999998, 2024-09-13T05:12:12.774 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:12.774 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:12.774 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:12.774 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:12.774 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.774 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11902 2024-09-13T05:12:12.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.775 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:12.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:12.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:12:12.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:12.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:12:12.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:12.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:12:12.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:12.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:12.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481041+0000", 2024-09-13T05:12:12.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8020000000000001e-06 2024-09-13T05:12:12.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:12.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481044+0000", 2024-09-13T05:12:12.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7110000000000001e-06 2024-09-13T05:12:12.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481048+0000", 2024-09-13T05:12:12.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.411e-06 2024-09-13T05:12:12.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:12.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509851+0000", 2024-09-13T05:12:12.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028803295 2024-09-13T05:12:12.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:12.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509896+0000", 2024-09-13T05:12:12.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4963000000000003e-05 2024-09-13T05:12:12.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:12.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509933+0000", 2024-09-13T05:12:12.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7384e-05 2024-09-13T05:12:12.778 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.778 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:12.778 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.778 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11903 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 634880~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:12.778 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:12:12.778 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 102.246379035, 2024-09-13T05:12:12.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029118033000000001, 2024-09-13T05:12:12.778 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:12.778 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:12.778 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:12.778 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:12.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.779 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11903 2024-09-13T05:12:12.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.779 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:12.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:12.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:12:12.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:12.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:12:12.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:12.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:12:12.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:12.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:12.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481052+0000", 2024-09-13T05:12:12.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.581e-06 2024-09-13T05:12:12.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:12.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481055+0000", 2024-09-13T05:12:12.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4520000000000002e-06 2024-09-13T05:12:12.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481058+0000", 2024-09-13T05:12:12.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4599999999999999e-06 2024-09-13T05:12:12.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:12.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509967+0000", 2024-09-13T05:12:12.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028908257999999999 2024-09-13T05:12:12.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:12.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510062+0000", 2024-09-13T05:12:12.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5613999999999996e-05 2024-09-13T05:12:12.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:12.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510168+0000", 2024-09-13T05:12:12.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105951 2024-09-13T05:12:12.782 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.782 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:12.782 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.782 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11904 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 644096~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:12.782 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:12:12.782 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 102.24636814, 2024-09-13T05:12:12.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029301971, 2024-09-13T05:12:12.783 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:12.783 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:12.783 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:12.783 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:12.783 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.783 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11904 2024-09-13T05:12:12.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.783 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:12.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:12.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:12:12.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:12.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:12:12.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:12.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:12:12.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:12.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:12.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481063+0000", 2024-09-13T05:12:12.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6700000000000001e-06 2024-09-13T05:12:12.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:12.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481068+0000", 2024-09-13T05:12:12.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4519999999999996e-06 2024-09-13T05:12:12.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481074+0000", 2024-09-13T05:12:12.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8370000000000002e-06 2024-09-13T05:12:12.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:12.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510197+0000", 2024-09-13T05:12:12.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029123237999999999 2024-09-13T05:12:12.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:12.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510285+0000", 2024-09-13T05:12:12.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7676000000000006e-05 2024-09-13T05:12:12.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:12.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510363+0000", 2024-09-13T05:12:12.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8418999999999996e-05 2024-09-13T05:12:12.786 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.786 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:12.786 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.787 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11905 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 653312~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:12.787 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:12:12.787 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 102.24635240000001, 2024-09-13T05:12:12.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029480164, 2024-09-13T05:12:12.787 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:12.787 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:12.787 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:12.787 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:12.787 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.787 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11905 2024-09-13T05:12:12.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.787 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:12.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:12.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:12:12.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:12.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:12:12.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:12.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481076+0000", 2024-09-13T05:12:12.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:12.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:12.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481079+0000", 2024-09-13T05:12:12.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9629999999999998e-06 2024-09-13T05:12:12.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:12.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481087+0000", 2024-09-13T05:12:12.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6369999999999999e-06 2024-09-13T05:12:12.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481093+0000", 2024-09-13T05:12:12.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.857e-06 2024-09-13T05:12:12.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:12.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510408+0000", 2024-09-13T05:12:12.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029315213 2024-09-13T05:12:12.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:12.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510501+0000", 2024-09-13T05:12:12.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2916000000000003e-05 2024-09-13T05:12:12.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:12.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510557+0000", 2024-09-13T05:12:12.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6063999999999997e-05 2024-09-13T05:12:12.790 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.790 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:12.791 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.791 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11906 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 662528~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:12.791 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:12:12.791 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 102.24631038699999, 2024-09-13T05:12:12.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029575054999999999, 2024-09-13T05:12:12.791 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:12.791 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:12.791 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:12.791 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:12.791 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.791 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11906 2024-09-13T05:12:12.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.791 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:12.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:12.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:12:12.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:12.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:12:12.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:12.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481118+0000", 2024-09-13T05:12:12.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:12.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:12.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481122+0000", 2024-09-13T05:12:12.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2610000000000002e-06 2024-09-13T05:12:12.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:12.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481129+0000", 2024-09-13T05:12:12.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0079999999999996e-06 2024-09-13T05:12:12.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481135+0000", 2024-09-13T05:12:12.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0599999999999996e-06 2024-09-13T05:12:12.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:12.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510575+0000", 2024-09-13T05:12:12.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029440470999999999 2024-09-13T05:12:12.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:12.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510635+0000", 2024-09-13T05:12:12.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0177000000000003e-05 2024-09-13T05:12:12.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:12.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510694+0000", 2024-09-13T05:12:12.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8675999999999999e-05 2024-09-13T05:12:12.795 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.795 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:12.795 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.795 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11907 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 671744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:12.795 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:12:12.795 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 102.24604959200001, 2024-09-13T05:12:12.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029479490000000001, 2024-09-13T05:12:12.795 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:12.795 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:12.795 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:12.795 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:12.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.796 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11907 2024-09-13T05:12:12.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.796 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:12.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:12.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:12:12.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:12.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:12:12.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:12.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481140+0000", 2024-09-13T05:12:12.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997597 2024-09-13T05:12:12.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:12.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481383+0000", 2024-09-13T05:12:12.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024355399999999999 2024-09-13T05:12:12.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:12.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481390+0000", 2024-09-13T05:12:12.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3599999999999998e-06 2024-09-13T05:12:12.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481395+0000", 2024-09-13T05:12:12.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8940000000000001e-06 2024-09-13T05:12:12.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:12.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510722+0000", 2024-09-13T05:12:12.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029327143999999999 2024-09-13T05:12:12.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:12.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510802+0000", 2024-09-13T05:12:12.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9770000000000004e-05 2024-09-13T05:12:12.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:12.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510859+0000", 2024-09-13T05:12:12.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6957999999999999e-05 2024-09-13T05:12:12.799 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.799 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:12.799 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.799 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11908 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 680960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:12.799 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:12:12.799 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 102.246029679, 2024-09-13T05:12:12.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029617622, 2024-09-13T05:12:12.800 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:12.800 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:12.800 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:12.800 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:12.800 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.800 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11908 2024-09-13T05:12:12.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.800 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:12.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:12.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:12:12.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:12.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:12:12.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:12.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481399+0000", 2024-09-13T05:12:12.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:12.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:12.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481401+0000", 2024-09-13T05:12:12.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8729999999999999e-06 2024-09-13T05:12:12.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:12.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481413+0000", 2024-09-13T05:12:12.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1748e-05 2024-09-13T05:12:12.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481417+0000", 2024-09-13T05:12:12.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:12:12.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:12.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510908+0000", 2024-09-13T05:12:12.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029491129000000001 2024-09-13T05:12:12.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:12.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510955+0000", 2024-09-13T05:12:12.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7188000000000003e-05 2024-09-13T05:12:12.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:12.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511017+0000", 2024-09-13T05:12:12.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2288999999999999e-05 2024-09-13T05:12:12.803 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.803 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:12.803 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.804 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11909 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 690176~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:12.804 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:12:12.804 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 102.246009352, 2024-09-13T05:12:12.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029780699000000001, 2024-09-13T05:12:12.804 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:12.804 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:12.804 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:12.804 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:12.804 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.804 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11909 2024-09-13T05:12:12.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.804 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:12.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:12.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:12:12.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:12.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:12:12.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:12.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481419+0000", 2024-09-13T05:12:12.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:12.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:12.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481421+0000", 2024-09-13T05:12:12.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.035e-06 2024-09-13T05:12:12.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:12.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481427+0000", 2024-09-13T05:12:12.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2449999999999998e-06 2024-09-13T05:12:12.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481430+0000", 2024-09-13T05:12:12.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.366e-06 2024-09-13T05:12:12.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:12.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511064+0000", 2024-09-13T05:12:12.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029633711 2024-09-13T05:12:12.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:12.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511160+0000", 2024-09-13T05:12:12.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6399999999999999e-05 2024-09-13T05:12:12.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:12.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511201+0000", 2024-09-13T05:12:12.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0448000000000003e-05 2024-09-13T05:12:12.811 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.811 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:12.811 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.811 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:159451 3.1b e117/116 3:d9c87acb:::rbd_data.112dc3abcba6.0000000000000003:head v 117'567, mlcod=0'0)", 2024-09-13T05:12:12.811 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:12:12.811 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.789221285, 2024-09-13T05:12:12.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064897325000000006, 2024-09-13T05:12:12.811 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:12.811 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:12.811 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:12.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:12.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:12:12.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:12.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:12:12.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:12.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938207+0000", 2024-09-13T05:12:12.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:12.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:12.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972794+0000", 2024-09-13T05:12:12.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.034587013 2024-09-13T05:12:12.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:12.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972821+0000", 2024-09-13T05:12:12.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6764e-05 2024-09-13T05:12:12.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972841+0000", 2024-09-13T05:12:12.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0191999999999999e-05 2024-09-13T05:12:12.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:12.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972905+0000", 2024-09-13T05:12:12.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4319000000000005e-05 2024-09-13T05:12:12.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:12.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972927+0000", 2024-09-13T05:12:12.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1135999999999999e-05 2024-09-13T05:12:12.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:12:12.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.002964+0000", 2024-09-13T05:12:12.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.030037123999999998 2024-09-13T05:12:12.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:12.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.003105+0000", 2024-09-13T05:12:12.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141614 2024-09-13T05:12:12.815 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.815 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:12.815 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.815 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159495 3.0 3:022f4da1:::rbd_data.112dfd94ee88.00000000000000e4:2a [read 167936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:12.815 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:12:12.816 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.7140818639999997, 2024-09-13T05:12:12.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91926946899999995, 2024-09-13T05:12:12.816 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:12.816 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:12.816 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:12.816 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:12.816 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.816 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159495 2024-09-13T05:12:12.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.816 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:12.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:12.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:12:12.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:12.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:12:12.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:12.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013345+0000", 2024-09-13T05:12:12.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999971 2024-09-13T05:12:12.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:12.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013359+0000", 2024-09-13T05:12:12.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4752999999999999e-05 2024-09-13T05:12:12.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:12.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013418+0000", 2024-09-13T05:12:12.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8959000000000003e-05 2024-09-13T05:12:12.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013439+0000", 2024-09-13T05:12:12.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0749000000000001e-05 2024-09-13T05:12:12.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:12.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013563+0000", 2024-09-13T05:12:12.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012349400000000001 2024-09-13T05:12:12.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:12.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013583+0000", 2024-09-13T05:12:12.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0007e-05 2024-09-13T05:12:12.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:12.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932400+0000", 2024-09-13T05:12:12.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91881732400000005 2024-09-13T05:12:12.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:12.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932533+0000", 2024-09-13T05:12:12.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013263700000000001 2024-09-13T05:12:12.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:12.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932617+0000", 2024-09-13T05:12:12.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4313000000000004e-05 2024-09-13T05:12:12.820 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.820 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:12.820 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.820 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159517 3.0 3:03975f1c:::rbd_data.112dfd94ee88.0000000000000156:2a [read 167936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:12.821 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:12:12.821 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.7138181499999998, 2024-09-13T05:12:12.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91962025700000005, 2024-09-13T05:12:12.821 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:12.821 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:12.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:12.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:12.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.821 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159517 2024-09-13T05:12:12.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.821 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:12.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:12.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:12:12.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:12.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:12:12.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:12.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013609+0000", 2024-09-13T05:12:12.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:12.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:12.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013619+0000", 2024-09-13T05:12:12.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0077e-05 2024-09-13T05:12:12.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:12.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013638+0000", 2024-09-13T05:12:12.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8739000000000001e-05 2024-09-13T05:12:12.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013653+0000", 2024-09-13T05:12:12.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5446000000000001e-05 2024-09-13T05:12:12.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:12.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016506+0000", 2024-09-13T05:12:12.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028525619999999999 2024-09-13T05:12:12.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:12.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016521+0000", 2024-09-13T05:12:12.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5310000000000001e-05 2024-09-13T05:12:12.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:12.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932964+0000", 2024-09-13T05:12:12.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91644284099999995 2024-09-13T05:12:12.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:12.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933097+0000", 2024-09-13T05:12:12.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013337599999999999 2024-09-13T05:12:12.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:12.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933231+0000", 2024-09-13T05:12:12.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133996 2024-09-13T05:12:12.825 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.825 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:12.826 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.826 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159622 3.0 3:03f7a45a:::rbd_data.112dfd94ee88.0000000000000318:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:12.826 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:12:12.826 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.7121563389999999, 2024-09-13T05:12:12.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.918245003, 2024-09-13T05:12:12.826 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:12.826 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:12.826 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:12.826 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:12.826 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:12.826 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159622 2024-09-13T05:12:12.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.827 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:12.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:12.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:12:12.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:12.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:12:12.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:12.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:12.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015266+0000", 2024-09-13T05:12:12.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999928 2024-09-13T05:12:12.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:12.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015283+0000", 2024-09-13T05:12:12.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7309999999999999e-05 2024-09-13T05:12:12.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:12.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015318+0000", 2024-09-13T05:12:12.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5119e-05 2024-09-13T05:12:12.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:12.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015338+0000", 2024-09-13T05:12:12.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9259e-05 2024-09-13T05:12:12.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:12.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016558+0000", 2024-09-13T05:12:12.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012199909999999999 2024-09-13T05:12:12.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:12.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016567+0000", 2024-09-13T05:12:12.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2459999999999992e-06 2024-09-13T05:12:12.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:12.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933266+0000", 2024-09-13T05:12:12.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91669950300000003 2024-09-13T05:12:12.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:12.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:12:12.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015788099999999999 2024-09-13T05:12:12.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:12.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:12.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:12.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933518+0000", 2024-09-13T05:12:12.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3721000000000006e-05 2024-09-13T05:12:12.830 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.830 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:12.830 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.831 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:12.831 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:12.831 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:12.832 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:12:12.833 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:12.827+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:12.933 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:12.927+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:12.948 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:12:12.997 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:12.997 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:12.997 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:12.997 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:13.011 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:12:13.034 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:13.032+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:13.118 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:13.135 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:13.131+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:13.141 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:12:13.147 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:13.147 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:13.147 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:13.147 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:13.147 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:13.151 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:13.158 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:12:13.175 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:13.210 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:13.236 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:13.231+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:13.244 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:13.265 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:13.266 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:13.266 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:13.266 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:13.278 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:13.282 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:13.282 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:13.293 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:12:13.305 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:13.305 INFO:teuthology.orchestra.run.smithi120.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-13T05:12:13.305 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:13.305 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:13.305 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:13.305 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:13.306 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:13.306 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:13.306 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:13.309 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T05:12:13.309 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T05:12:13.353 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:13.351+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:13.399 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:13.399 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:13.408 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:12:13.438 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:13.435+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:13.506 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:13.506 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:13.516 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:12:13.539 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:13.536+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:13.641 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:13.636+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:13.662 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:13.662 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:13.671 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:12:13.742 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:13.740+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:13.787 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:13.787 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:13.797 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:12:13.842 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:13.840+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:13.903 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:13.903 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:13.912 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:12:13.954 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:13.952+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:14.044 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:14.040+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:14.062 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:14.063 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:14.073 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:12:14.145 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:14.143+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:14.177 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:14.177 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:14.186 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:12:14.246 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:14.243+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:14.313 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:14.313 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:14.323 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:12:14.337 INFO:teuthology.orchestra.run.smithi120.stdout:5141 writesame 0x65ba5c9 thru 0x65c49e9 data_size 0x1(0xa421 bytes) 2024-09-13T05:12:14.348 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:14.343+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:14.450 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:14.443+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:14.453 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:14.453 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:14.462 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:12:14.550 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:14.548+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:14.562 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:14.562 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:14.572 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:12:14.653 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:14.648+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:14.666 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T05:12:14.678 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:14.678 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:14.688 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:12:14.754 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:14.751+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:14.789 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:14.790 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:14.799 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:12:14.855 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:14.852+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:14.906 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:14.906 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:14.916 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:12:14.956 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:14.951+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:15.056 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:15.051+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:15.068 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:15.068 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:15.078 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:12:15.157 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:15.155+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:15.186 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:15.187 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:15.196 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:12:15.258 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:15.255+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:15.302 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:15.302 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:15.302 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:15.303 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:15.310 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:12:15.311 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:12:15.359 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:15.356+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:15.415 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:15.415 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:15.415 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:15.415 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:15.416 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:15.429 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:12:15.437 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:12:15.455 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:15.459 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:15.456+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:15.473 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:15.489 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:15.509 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:15.519 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:15.519 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:15.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:15.519 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [] 2024-09-13T05:12:15.519 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:15.528 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:12:15.529 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:15.553 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:15.560 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:15.556+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:15.575 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:15.578 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-09-13T05:12:15.578 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:15.578 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:15.578 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:15.578 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:15.578 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:15.578 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:15.578 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:15.660 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:15.661 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:15.661 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:15.661 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:15.661 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:15.656+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:15.662 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is unset 2024-09-13T05:12:15.674 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:12:15.762 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:15.759+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:15.774 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:15.774 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:15.775 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:15.775 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:15.775 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:15.783 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:12:15.863 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:15.860+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:15.893 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:15.893 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:15.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:15.893 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:15.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.894 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10636 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 749568~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:15.894 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:12:15.894 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 105.48792079899999, 2024-09-13T05:12:15.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328440999999999, 2024-09-13T05:12:15.894 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:15.894 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:15.894 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:15.894 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:15.894 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:15.894 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10636 2024-09-13T05:12:15.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.894 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:15.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:15.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:12:15.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:15.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402012+0000", 2024-09-13T05:12:15.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:15.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402011+0000", 2024-09-13T05:12:15.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:12:15.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:15.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402017+0000", 2024-09-13T05:12:15.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5620000000000003e-06 2024-09-13T05:12:15.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:15.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402020+0000", 2024-09-13T05:12:15.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1410000000000001e-06 2024-09-13T05:12:15.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:15.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402024+0000", 2024-09-13T05:12:15.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4489999999999999e-06 2024-09-13T05:12:15.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:15.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430256+0000", 2024-09-13T05:12:15.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028232363 2024-09-13T05:12:15.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:15.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430299+0000", 2024-09-13T05:12:15.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2830999999999997e-05 2024-09-13T05:12:15.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:15.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430340+0000", 2024-09-13T05:12:15.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1301000000000003e-05 2024-09-13T05:12:15.898 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.898 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:15.898 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.898 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10637 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 758784~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:15.898 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:12:15.898 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 105.487905686, 2024-09-13T05:12:15.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028441793, 2024-09-13T05:12:15.898 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:15.899 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:15.899 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:15.899 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:15.899 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:15.899 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10637 2024-09-13T05:12:15.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.899 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:15.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:15.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:12:15.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:15.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:12:15.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:15.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402027+0000", 2024-09-13T05:12:15.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:12:15.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:15.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402031+0000", 2024-09-13T05:12:15.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6770000000000003e-06 2024-09-13T05:12:15.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:15.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402034+0000", 2024-09-13T05:12:15.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1540000000000002e-06 2024-09-13T05:12:15.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:15.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402038+0000", 2024-09-13T05:12:15.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4970000000000001e-06 2024-09-13T05:12:15.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:15.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430367+0000", 2024-09-13T05:12:15.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328906000000001 2024-09-13T05:12:15.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:15.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430416+0000", 2024-09-13T05:12:15.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:12:15.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:15.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430469+0000", 2024-09-13T05:12:15.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2284999999999998e-05 2024-09-13T05:12:15.902 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.902 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:15.902 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.903 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10638 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 768000~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:15.903 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:12:15.903 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 105.487892202, 2024-09-13T05:12:15.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028548740999999999, 2024-09-13T05:12:15.903 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:15.903 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:15.903 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:15.903 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:15.903 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:15.903 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10638 2024-09-13T05:12:15.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.903 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:15.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:15.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:12:15.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:15.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:12:15.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:15.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402040+0000", 2024-09-13T05:12:15.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:15.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:15.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402041+0000", 2024-09-13T05:12:15.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4789999999999999e-06 2024-09-13T05:12:15.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:15.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402044+0000", 2024-09-13T05:12:15.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.694e-06 2024-09-13T05:12:15.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:15.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402047+0000", 2024-09-13T05:12:15.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.537e-06 2024-09-13T05:12:15.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:15.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430494+0000", 2024-09-13T05:12:15.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028447665 2024-09-13T05:12:15.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:15.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430544+0000", 2024-09-13T05:12:15.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9539000000000001e-05 2024-09-13T05:12:15.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:15.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430589+0000", 2024-09-13T05:12:15.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5071999999999998e-05 2024-09-13T05:12:15.906 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.907 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:15.907 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.907 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:10639 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 777216~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:15.907 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:12:15.907 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 105.487881821, 2024-09-13T05:12:15.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028651769000000001, 2024-09-13T05:12:15.907 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:15.907 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:15.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:15.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:15.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:15.907 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 10639 2024-09-13T05:12:15.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.908 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:15.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:15.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:12:15.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:15.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402051+0000", 2024-09-13T05:12:15.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:15.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402050+0000", 2024-09-13T05:12:15.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:15.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:15.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402052+0000", 2024-09-13T05:12:15.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2249999999999999e-06 2024-09-13T05:12:15.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:15.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402054+0000", 2024-09-13T05:12:15.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8140000000000001e-06 2024-09-13T05:12:15.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:15.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.402057+0000", 2024-09-13T05:12:15.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4889999999999998e-06 2024-09-13T05:12:15.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:15.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430607+0000", 2024-09-13T05:12:15.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028549896000000002 2024-09-13T05:12:15.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:15.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430651+0000", 2024-09-13T05:12:15.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4622000000000001e-05 2024-09-13T05:12:15.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:15.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.430702+0000", 2024-09-13T05:12:15.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0980999999999999e-05 2024-09-13T05:12:15.911 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.911 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:15.911 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.911 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11898 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 588800~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:15.911 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:12:15.912 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 105.408949302, 2024-09-13T05:12:15.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028308628999999998, 2024-09-13T05:12:15.912 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:15.912 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:15.912 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:15.912 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:15.912 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:15.912 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11898 2024-09-13T05:12:15.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.912 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:15.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:15.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:12:15.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:15.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:12:15.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:15.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480983+0000", 2024-09-13T05:12:15.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:15.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:15.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480984+0000", 2024-09-13T05:12:15.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:12:15.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:15.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480988+0000", 2024-09-13T05:12:15.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4640000000000002e-06 2024-09-13T05:12:15.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:15.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480991+0000", 2024-09-13T05:12:15.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3469999999999999e-06 2024-09-13T05:12:15.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:15.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509199+0000", 2024-09-13T05:12:15.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028207449999999998 2024-09-13T05:12:15.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:15.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509250+0000", 2024-09-13T05:12:15.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1375000000000002e-05 2024-09-13T05:12:15.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:15.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509292+0000", 2024-09-13T05:12:15.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1730000000000002e-05 2024-09-13T05:12:15.917 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.917 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:15.917 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.917 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11899 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 598016~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:15.917 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:12:15.917 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 105.40893846100001, 2024-09-13T05:12:15.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516703000000001, 2024-09-13T05:12:15.917 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:15.917 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:15.917 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:15.918 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:15.918 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:15.918 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11899 2024-09-13T05:12:15.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.918 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:15.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:15.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:12:15.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:15.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:12:15.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:15.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480994+0000", 2024-09-13T05:12:15.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:15.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:15.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.480995+0000", 2024-09-13T05:12:15.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7349999999999999e-06 2024-09-13T05:12:15.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:15.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481000+0000", 2024-09-13T05:12:15.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0289999999999996e-06 2024-09-13T05:12:15.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:15.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481004+0000", 2024-09-13T05:12:15.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3699999999999999e-06 2024-09-13T05:12:15.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:15.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509332+0000", 2024-09-13T05:12:15.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028328320000000001 2024-09-13T05:12:15.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:15.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509428+0000", 2024-09-13T05:12:15.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6150999999999995e-05 2024-09-13T05:12:15.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:15.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509511+0000", 2024-09-13T05:12:15.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2396000000000002e-05 2024-09-13T05:12:15.921 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.921 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:15.921 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.921 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11900 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 607232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:15.921 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:12:15.921 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 105.408925872, 2024-09-13T05:12:15.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028621273999999999, 2024-09-13T05:12:15.922 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:15.922 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:15.922 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:15.922 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:15.922 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:15.922 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11900 2024-09-13T05:12:15.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.922 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:15.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:15.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:12:15.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:15.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481007+0000", 2024-09-13T05:12:15.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:15.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481006+0000", 2024-09-13T05:12:15.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:15.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:15.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481008+0000", 2024-09-13T05:12:15.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.73e-06 2024-09-13T05:12:15.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:15.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481011+0000", 2024-09-13T05:12:15.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4000000000000001e-06 2024-09-13T05:12:15.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:15.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481015+0000", 2024-09-13T05:12:15.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2760000000000001e-06 2024-09-13T05:12:15.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:15.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509531+0000", 2024-09-13T05:12:15.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028516102000000002 2024-09-13T05:12:15.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:15.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509588+0000", 2024-09-13T05:12:15.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7423999999999998e-05 2024-09-13T05:12:15.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:15.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509628+0000", 2024-09-13T05:12:15.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9644000000000002e-05 2024-09-13T05:12:15.925 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.926 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:15.926 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.926 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11901 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 616448~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:15.926 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:12:15.926 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 105.408915251, 2024-09-13T05:12:15.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028820500999999998, 2024-09-13T05:12:15.926 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:15.926 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:15.926 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:15.926 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:15.926 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:15.926 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11901 2024-09-13T05:12:15.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.927 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:15.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:15.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:12:15.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:15.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:12:15.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:15.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481017+0000", 2024-09-13T05:12:15.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:15.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:15.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481022+0000", 2024-09-13T05:12:15.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0209999999999999e-06 2024-09-13T05:12:15.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:15.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481026+0000", 2024-09-13T05:12:15.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:12:15.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:15.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481029+0000", 2024-09-13T05:12:15.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.636e-06 2024-09-13T05:12:15.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:15.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509661+0000", 2024-09-13T05:12:15.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028631496999999999 2024-09-13T05:12:15.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:15.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509757+0000", 2024-09-13T05:12:15.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5780999999999997e-05 2024-09-13T05:12:15.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:15.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509838+0000", 2024-09-13T05:12:15.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1102999999999999e-05 2024-09-13T05:12:15.930 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.930 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:15.930 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.930 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11902 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 625664~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:15.930 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:12:15.930 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 105.408893389, 2024-09-13T05:12:15.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028894265999999998, 2024-09-13T05:12:15.930 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:15.931 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:15.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:15.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:15.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:15.931 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11902 2024-09-13T05:12:15.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.931 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:15.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:15.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:12:15.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:15.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:12:15.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:15.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481039+0000", 2024-09-13T05:12:15.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:15.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:15.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481041+0000", 2024-09-13T05:12:15.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8020000000000001e-06 2024-09-13T05:12:15.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:15.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481044+0000", 2024-09-13T05:12:15.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7110000000000001e-06 2024-09-13T05:12:15.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:15.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481048+0000", 2024-09-13T05:12:15.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.411e-06 2024-09-13T05:12:15.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:15.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509851+0000", 2024-09-13T05:12:15.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028803295 2024-09-13T05:12:15.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:15.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509896+0000", 2024-09-13T05:12:15.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4963000000000003e-05 2024-09-13T05:12:15.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:15.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509933+0000", 2024-09-13T05:12:15.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7384e-05 2024-09-13T05:12:15.934 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.934 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:15.934 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.934 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11903 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 634880~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:15.934 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:12:15.935 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 105.40888215299999, 2024-09-13T05:12:15.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029118033000000001, 2024-09-13T05:12:15.935 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:15.935 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:15.935 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:15.935 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:15.935 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:15.935 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11903 2024-09-13T05:12:15.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.935 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:15.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:15.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:12:15.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:15.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:12:15.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:15.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481050+0000", 2024-09-13T05:12:15.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:15.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:15.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481052+0000", 2024-09-13T05:12:15.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.581e-06 2024-09-13T05:12:15.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:15.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481055+0000", 2024-09-13T05:12:15.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4520000000000002e-06 2024-09-13T05:12:15.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:15.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481058+0000", 2024-09-13T05:12:15.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4599999999999999e-06 2024-09-13T05:12:15.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:15.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.509967+0000", 2024-09-13T05:12:15.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028908257999999999 2024-09-13T05:12:15.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:15.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510062+0000", 2024-09-13T05:12:15.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5613999999999996e-05 2024-09-13T05:12:15.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:15.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510168+0000", 2024-09-13T05:12:15.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105951 2024-09-13T05:12:15.939 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.939 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:15.939 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.939 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11904 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 644096~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:15.939 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:12:15.939 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 105.408871258, 2024-09-13T05:12:15.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029301971, 2024-09-13T05:12:15.939 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:15.939 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:15.939 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:15.940 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:15.940 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:15.940 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11904 2024-09-13T05:12:15.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.940 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:15.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:15.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:12:15.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:15.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:12:15.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:15.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481061+0000", 2024-09-13T05:12:15.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:15.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:15.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481063+0000", 2024-09-13T05:12:15.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6700000000000001e-06 2024-09-13T05:12:15.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:15.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481068+0000", 2024-09-13T05:12:15.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4519999999999996e-06 2024-09-13T05:12:15.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:15.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481074+0000", 2024-09-13T05:12:15.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8370000000000002e-06 2024-09-13T05:12:15.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:15.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510197+0000", 2024-09-13T05:12:15.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029123237999999999 2024-09-13T05:12:15.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:15.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510285+0000", 2024-09-13T05:12:15.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7676000000000006e-05 2024-09-13T05:12:15.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:15.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510363+0000", 2024-09-13T05:12:15.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8418999999999996e-05 2024-09-13T05:12:15.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.944 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:15.944 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.944 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11905 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 653312~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:15.944 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:12:15.944 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 105.408855518, 2024-09-13T05:12:15.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029480164, 2024-09-13T05:12:15.944 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:15.944 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:15.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:15.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:15.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:15.945 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11905 2024-09-13T05:12:15.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.945 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:15.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:15.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:12:15.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:15.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481077+0000", 2024-09-13T05:12:15.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:15.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481076+0000", 2024-09-13T05:12:15.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:15.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:15.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481079+0000", 2024-09-13T05:12:15.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9629999999999998e-06 2024-09-13T05:12:15.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:15.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481087+0000", 2024-09-13T05:12:15.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6369999999999999e-06 2024-09-13T05:12:15.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:15.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481093+0000", 2024-09-13T05:12:15.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.857e-06 2024-09-13T05:12:15.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:15.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510408+0000", 2024-09-13T05:12:15.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029315213 2024-09-13T05:12:15.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:15.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510501+0000", 2024-09-13T05:12:15.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2916000000000003e-05 2024-09-13T05:12:15.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:15.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510557+0000", 2024-09-13T05:12:15.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6063999999999997e-05 2024-09-13T05:12:15.948 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.948 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:15.948 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.948 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11906 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 662528~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:15.948 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:12:15.948 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 105.408813505, 2024-09-13T05:12:15.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029575054999999999, 2024-09-13T05:12:15.949 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:15.949 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:15.949 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:15.949 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:15.949 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:15.949 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11906 2024-09-13T05:12:15.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.950 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:15.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:15.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:12:15.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:15.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481119+0000", 2024-09-13T05:12:15.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:15.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481118+0000", 2024-09-13T05:12:15.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:15.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:15.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481122+0000", 2024-09-13T05:12:15.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2610000000000002e-06 2024-09-13T05:12:15.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:15.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481129+0000", 2024-09-13T05:12:15.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0079999999999996e-06 2024-09-13T05:12:15.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:15.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481135+0000", 2024-09-13T05:12:15.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0599999999999996e-06 2024-09-13T05:12:15.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:15.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510575+0000", 2024-09-13T05:12:15.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029440470999999999 2024-09-13T05:12:15.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:15.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510635+0000", 2024-09-13T05:12:15.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0177000000000003e-05 2024-09-13T05:12:15.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:15.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510694+0000", 2024-09-13T05:12:15.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8675999999999999e-05 2024-09-13T05:12:15.953 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.953 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:15.953 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.953 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11907 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 671744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:15.954 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:12:15.954 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 105.40855271, 2024-09-13T05:12:15.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029479490000000001, 2024-09-13T05:12:15.954 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:15.954 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:15.954 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:15.954 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:15.954 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:15.954 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11907 2024-09-13T05:12:15.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.954 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:15.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:15.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:12:15.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:15.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481380+0000", 2024-09-13T05:12:15.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:15.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481140+0000", 2024-09-13T05:12:15.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997597 2024-09-13T05:12:15.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:15.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481383+0000", 2024-09-13T05:12:15.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024355399999999999 2024-09-13T05:12:15.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:15.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481390+0000", 2024-09-13T05:12:15.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3599999999999998e-06 2024-09-13T05:12:15.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:15.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481395+0000", 2024-09-13T05:12:15.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8940000000000001e-06 2024-09-13T05:12:15.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:15.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510722+0000", 2024-09-13T05:12:15.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029327143999999999 2024-09-13T05:12:15.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:15.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510802+0000", 2024-09-13T05:12:15.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9770000000000004e-05 2024-09-13T05:12:15.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:15.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510859+0000", 2024-09-13T05:12:15.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6957999999999999e-05 2024-09-13T05:12:15.957 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.958 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:15.958 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.958 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11908 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 680960~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:15.958 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:12:15.958 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 105.40853279700001, 2024-09-13T05:12:15.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029617622, 2024-09-13T05:12:15.958 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:15.958 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:15.958 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:15.958 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:15.958 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:15.958 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11908 2024-09-13T05:12:15.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.959 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:15.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:15.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:12:15.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:15.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481400+0000", 2024-09-13T05:12:15.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:15.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481399+0000", 2024-09-13T05:12:15.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:15.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:15.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481401+0000", 2024-09-13T05:12:15.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8729999999999999e-06 2024-09-13T05:12:15.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:15.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481413+0000", 2024-09-13T05:12:15.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1748e-05 2024-09-13T05:12:15.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:15.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481417+0000", 2024-09-13T05:12:15.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7390000000000001e-06 2024-09-13T05:12:15.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:15.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510908+0000", 2024-09-13T05:12:15.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029491129000000001 2024-09-13T05:12:15.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:15.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.510955+0000", 2024-09-13T05:12:15.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7188000000000003e-05 2024-09-13T05:12:15.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:15.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511017+0000", 2024-09-13T05:12:15.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2288999999999999e-05 2024-09-13T05:12:15.962 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.962 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:15.962 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.962 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:11909 3.0 3:00cd087b:::rbd_data.112de12546cf.0000000000000012:b [read 690176~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-13T05:12:15.962 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:12:15.962 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 105.40851247000001, 2024-09-13T05:12:15.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029780699000000001, 2024-09-13T05:12:15.962 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:15.962 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:15.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:15.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:15.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:15.963 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 11909 2024-09-13T05:12:15.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.963 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:15.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:15.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:12:15.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:15.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481420+0000", 2024-09-13T05:12:15.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:15.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481419+0000", 2024-09-13T05:12:15.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:15.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:15.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481421+0000", 2024-09-13T05:12:15.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.035e-06 2024-09-13T05:12:15.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:15.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481427+0000", 2024-09-13T05:12:15.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2449999999999998e-06 2024-09-13T05:12:15.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:15.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.481430+0000", 2024-09-13T05:12:15.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.366e-06 2024-09-13T05:12:15.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:15.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511064+0000", 2024-09-13T05:12:15.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029633711 2024-09-13T05:12:15.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:15.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511160+0000", 2024-09-13T05:12:15.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6399999999999999e-05 2024-09-13T05:12:15.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:15.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:10:30.511201+0000", 2024-09-13T05:12:15.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0448000000000003e-05 2024-09-13T05:12:15.966 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.966 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:15.966 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.966 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:159451 3.1b e117/116 3:d9c87acb:::rbd_data.112dc3abcba6.0000000000000003:head v 117'567, mlcod=0'0)", 2024-09-13T05:12:15.966 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:12:15.967 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.9517244030000001, 2024-09-13T05:12:15.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064897325000000006, 2024-09-13T05:12:15.967 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:15.967 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:15.967 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:15.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:15.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:12:15.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:15.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:12:15.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:15.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938207+0000", 2024-09-13T05:12:15.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:15.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:15.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972794+0000", 2024-09-13T05:12:15.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.034587013 2024-09-13T05:12:15.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:15.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972821+0000", 2024-09-13T05:12:15.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6764e-05 2024-09-13T05:12:15.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:15.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972841+0000", 2024-09-13T05:12:15.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0191999999999999e-05 2024-09-13T05:12:15.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:15.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972905+0000", 2024-09-13T05:12:15.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4319000000000005e-05 2024-09-13T05:12:15.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:15.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972927+0000", 2024-09-13T05:12:15.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1135999999999999e-05 2024-09-13T05:12:15.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:12:15.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.002964+0000", 2024-09-13T05:12:15.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.030037123999999998 2024-09-13T05:12:15.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:15.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.003105+0000", 2024-09-13T05:12:15.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141614 2024-09-13T05:12:15.970 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.970 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:15.970 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.971 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159495 3.0 3:022f4da1:::rbd_data.112dfd94ee88.00000000000000e4:2a [read 167936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:15.971 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:12:15.971 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8765849820000007, 2024-09-13T05:12:15.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91926946899999995, 2024-09-13T05:12:15.971 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:15.971 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:15.971 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:15.971 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:15.971 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:15.971 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159495 2024-09-13T05:12:15.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.971 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:15.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:15.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:12:15.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:15.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:12:15.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:15.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013345+0000", 2024-09-13T05:12:15.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999971 2024-09-13T05:12:15.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:15.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013359+0000", 2024-09-13T05:12:15.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4752999999999999e-05 2024-09-13T05:12:15.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:15.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013418+0000", 2024-09-13T05:12:15.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8959000000000003e-05 2024-09-13T05:12:15.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:15.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013439+0000", 2024-09-13T05:12:15.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0749000000000001e-05 2024-09-13T05:12:15.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:15.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013563+0000", 2024-09-13T05:12:15.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012349400000000001 2024-09-13T05:12:15.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:15.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013583+0000", 2024-09-13T05:12:15.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0007e-05 2024-09-13T05:12:15.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:15.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932400+0000", 2024-09-13T05:12:15.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91881732400000005 2024-09-13T05:12:15.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:15.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932533+0000", 2024-09-13T05:12:15.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013263700000000001 2024-09-13T05:12:15.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:15.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932617+0000", 2024-09-13T05:12:15.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4313000000000004e-05 2024-09-13T05:12:15.975 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.975 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:15.976 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.976 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159517 3.0 3:03975f1c:::rbd_data.112dfd94ee88.0000000000000156:2a [read 167936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:15.976 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:12:15.976 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8763212679999999, 2024-09-13T05:12:15.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91962025700000005, 2024-09-13T05:12:15.976 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:15.976 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:15.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:15.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:15.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:15.976 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159517 2024-09-13T05:12:15.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.977 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:15.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:15.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:12:15.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:15.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:12:15.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:15.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013609+0000", 2024-09-13T05:12:15.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:15.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:15.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013619+0000", 2024-09-13T05:12:15.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0077e-05 2024-09-13T05:12:15.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:15.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013638+0000", 2024-09-13T05:12:15.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8739000000000001e-05 2024-09-13T05:12:15.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:15.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013653+0000", 2024-09-13T05:12:15.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5446000000000001e-05 2024-09-13T05:12:15.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:15.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016506+0000", 2024-09-13T05:12:15.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028525619999999999 2024-09-13T05:12:15.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:15.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016521+0000", 2024-09-13T05:12:15.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5310000000000001e-05 2024-09-13T05:12:15.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:15.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932964+0000", 2024-09-13T05:12:15.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91644284099999995 2024-09-13T05:12:15.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:15.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933097+0000", 2024-09-13T05:12:15.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013337599999999999 2024-09-13T05:12:15.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:15.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933231+0000", 2024-09-13T05:12:15.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133996 2024-09-13T05:12:15.980 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.981 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:15.981 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.981 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159622 3.0 3:03f7a45a:::rbd_data.112dfd94ee88.0000000000000318:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:15.981 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:12:15.981 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8746594569999999, 2024-09-13T05:12:15.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.918245003, 2024-09-13T05:12:15.981 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:15.981 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:15.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:15.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:15.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:15.981 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159622 2024-09-13T05:12:15.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.982 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:15.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:15.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:12:15.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:15.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:12:15.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:15.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:15.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015266+0000", 2024-09-13T05:12:15.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999928 2024-09-13T05:12:15.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:15.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015283+0000", 2024-09-13T05:12:15.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7309999999999999e-05 2024-09-13T05:12:15.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:15.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015318+0000", 2024-09-13T05:12:15.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5119e-05 2024-09-13T05:12:15.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:15.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015338+0000", 2024-09-13T05:12:15.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9259e-05 2024-09-13T05:12:15.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:15.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016558+0000", 2024-09-13T05:12:15.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012199909999999999 2024-09-13T05:12:15.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:15.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016567+0000", 2024-09-13T05:12:15.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2459999999999992e-06 2024-09-13T05:12:15.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:15.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933266+0000", 2024-09-13T05:12:15.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91669950300000003 2024-09-13T05:12:15.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:15.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:12:15.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015788099999999999 2024-09-13T05:12:15.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:15.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:15.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:15.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933518+0000", 2024-09-13T05:12:15.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3721000000000006e-05 2024-09-13T05:12:15.985 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.986 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:15.986 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.986 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:15.986 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:15.986 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:15.987 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:12:15.988 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:15.984+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:16.088 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:16.084+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:16.091 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:16.092 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:16.092 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:16.092 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:16.100 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:12:16.189 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:16.188+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:16.213 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:16.213 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:16.213 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:16.213 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:16.213 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:16.222 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:12:16.291 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:16.288+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:16.326 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:16.326 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:16.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:16.326 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:16.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.326 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136560 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3908608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:16.326 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:12:16.326 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.227081088999999, 2024-09-13T05:12:16.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056148103999999997, 2024-09-13T05:12:16.326 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.327 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.327 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136560 2024-09-13T05:12:16.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.327 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:12:16.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:12:16.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095289+0000", 2024-09-13T05:12:16.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095292+0000", 2024-09-13T05:12:16.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.802e-06 2024-09-13T05:12:16.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095318+0000", 2024-09-13T05:12:16.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5987999999999999e-05 2024-09-13T05:12:16.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095323+0000", 2024-09-13T05:12:16.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.006e-06 2024-09-13T05:12:16.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151316+0000", 2024-09-13T05:12:16.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055992593 2024-09-13T05:12:16.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151371+0000", 2024-09-13T05:12:16.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5532999999999998e-05 2024-09-13T05:12:16.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151438+0000", 2024-09-13T05:12:16.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6557999999999995e-05 2024-09-13T05:12:16.331 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.331 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.332 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.332 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136562 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3922944~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:16.332 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:16.332 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.227043971000001, 2024-09-13T05:12:16.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056259690000000001, 2024-09-13T05:12:16.332 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.332 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.332 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.332 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.332 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.332 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136562 2024-09-13T05:12:16.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.333 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:16.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:16.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:16.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095329+0000", 2024-09-13T05:12:16.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3089999999999998e-06 2024-09-13T05:12:16.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095333+0000", 2024-09-13T05:12:16.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6239999999999999e-06 2024-09-13T05:12:16.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095335+0000", 2024-09-13T05:12:16.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5660000000000001e-06 2024-09-13T05:12:16.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151468+0000", 2024-09-13T05:12:16.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056132608000000001 2024-09-13T05:12:16.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151519+0000", 2024-09-13T05:12:16.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1681000000000002e-05 2024-09-13T05:12:16.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151587+0000", 2024-09-13T05:12:16.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7200999999999996e-05 2024-09-13T05:12:16.336 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.336 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.336 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.337 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136563 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3937280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:16.337 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:16.337 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.227032549, 2024-09-13T05:12:16.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056393051999999999, 2024-09-13T05:12:16.337 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.337 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.337 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.337 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.337 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.337 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136563 2024-09-13T05:12:16.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.337 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:16.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:16.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:16.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:12:16.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095340+0000", 2024-09-13T05:12:16.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.561e-06 2024-09-13T05:12:16.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095342+0000", 2024-09-13T05:12:16.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8059999999999999e-06 2024-09-13T05:12:16.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095345+0000", 2024-09-13T05:12:16.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:12:16.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151621+0000", 2024-09-13T05:12:16.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056275602000000001 2024-09-13T05:12:16.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151670+0000", 2024-09-13T05:12:16.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9478000000000003e-05 2024-09-13T05:12:16.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151731+0000", 2024-09-13T05:12:16.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1054000000000002e-05 2024-09-13T05:12:16.341 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.341 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.341 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.341 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136565 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3951616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:16.341 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:12:16.341 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.227022235, 2024-09-13T05:12:16.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056524090999999999, 2024-09-13T05:12:16.341 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.342 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.342 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.342 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.342 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.342 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136565 2024-09-13T05:12:16.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.342 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:12:16.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:12:16.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095348+0000", 2024-09-13T05:12:16.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:12:16.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095350+0000", 2024-09-13T05:12:16.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4479999999999999e-06 2024-09-13T05:12:16.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095353+0000", 2024-09-13T05:12:16.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.909e-06 2024-09-13T05:12:16.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095356+0000", 2024-09-13T05:12:16.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:12:16.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151763+0000", 2024-09-13T05:12:16.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056407813000000001 2024-09-13T05:12:16.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151812+0000", 2024-09-13T05:12:16.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8306999999999997e-05 2024-09-13T05:12:16.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151873+0000", 2024-09-13T05:12:16.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1064999999999999e-05 2024-09-13T05:12:16.345 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.346 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.346 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.346 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136567 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3965952~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:16.346 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:12:16.346 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.227013209999999, 2024-09-13T05:12:16.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056653907000000003, 2024-09-13T05:12:16.346 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.346 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.347 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136567 2024-09-13T05:12:16.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.347 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:12:16.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:12:16.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095357+0000", 2024-09-13T05:12:16.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095359+0000", 2024-09-13T05:12:16.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:12:16.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095362+0000", 2024-09-13T05:12:16.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7939999999999998e-06 2024-09-13T05:12:16.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095365+0000", 2024-09-13T05:12:16.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9979999999999999e-06 2024-09-13T05:12:16.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151904+0000", 2024-09-13T05:12:16.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056539308000000003 2024-09-13T05:12:16.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151953+0000", 2024-09-13T05:12:16.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8760000000000001e-05 2024-09-13T05:12:16.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152012+0000", 2024-09-13T05:12:16.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8761999999999997e-05 2024-09-13T05:12:16.350 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.350 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.350 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.350 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136569 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3980288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:16.350 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:16.351 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.226977456, 2024-09-13T05:12:16.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056771237000000002, 2024-09-13T05:12:16.351 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.351 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.351 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.351 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.351 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.351 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136569 2024-09-13T05:12:16.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.351 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:16.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:16.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:16.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095395+0000", 2024-09-13T05:12:16.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8870000000000001e-06 2024-09-13T05:12:16.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095402+0000", 2024-09-13T05:12:16.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6290000000000001e-06 2024-09-13T05:12:16.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095412+0000", 2024-09-13T05:12:16.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1730000000000001e-06 2024-09-13T05:12:16.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152044+0000", 2024-09-13T05:12:16.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056632016 2024-09-13T05:12:16.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152093+0000", 2024-09-13T05:12:16.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9570000000000001e-05 2024-09-13T05:12:16.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152165+0000", 2024-09-13T05:12:16.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1443e-05 2024-09-13T05:12:16.355 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.355 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.355 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.355 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136571 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3994624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:16.355 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:16.355 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.226956440999999, 2024-09-13T05:12:16.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056894741999999998, 2024-09-13T05:12:16.355 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.355 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.355 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.356 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.356 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.356 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136571 2024-09-13T05:12:16.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.356 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:16.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:16.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:16.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095418+0000", 2024-09-13T05:12:16.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0210000000000001e-06 2024-09-13T05:12:16.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095422+0000", 2024-09-13T05:12:16.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5310000000000002e-06 2024-09-13T05:12:16.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095425+0000", 2024-09-13T05:12:16.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8880000000000001e-06 2024-09-13T05:12:16.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152198+0000", 2024-09-13T05:12:16.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056773563999999999 2024-09-13T05:12:16.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152249+0000", 2024-09-13T05:12:16.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1168999999999997e-05 2024-09-13T05:12:16.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152309+0000", 2024-09-13T05:12:16.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9821999999999997e-05 2024-09-13T05:12:16.359 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.359 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.359 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.359 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136573 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4008960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:16.360 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:12:16.360 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.226944214, 2024-09-13T05:12:16.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057045810000000002, 2024-09-13T05:12:16.360 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.360 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.360 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.360 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.360 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.360 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136573 2024-09-13T05:12:16.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.360 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:12:16.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:12:16.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095426+0000", 2024-09-13T05:12:16.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095428+0000", 2024-09-13T05:12:16.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.593e-06 2024-09-13T05:12:16.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095431+0000", 2024-09-13T05:12:16.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9610000000000001e-06 2024-09-13T05:12:16.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095434+0000", 2024-09-13T05:12:16.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:12:16.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152352+0000", 2024-09-13T05:12:16.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05691881 2024-09-13T05:12:16.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152401+0000", 2024-09-13T05:12:16.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8995000000000001e-05 2024-09-13T05:12:16.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152472+0000", 2024-09-13T05:12:16.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1060000000000001e-05 2024-09-13T05:12:16.364 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.364 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.364 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.364 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136575 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4023296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:16.364 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:12:16.364 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.226514220999999, 2024-09-13T05:12:16.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056760069000000003, 2024-09-13T05:12:16.364 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.364 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.365 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.365 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.365 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.365 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136575 2024-09-13T05:12:16.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.365 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:12:16.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:12:16.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095437+0000", 2024-09-13T05:12:16.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9995799 2024-09-13T05:12:16.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095861+0000", 2024-09-13T05:12:16.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000424299 2024-09-13T05:12:16.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095869+0000", 2024-09-13T05:12:16.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5020000000000003e-06 2024-09-13T05:12:16.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095875+0000", 2024-09-13T05:12:16.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:12:16.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152502+0000", 2024-09-13T05:12:16.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056626528000000002 2024-09-13T05:12:16.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152556+0000", 2024-09-13T05:12:16.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4271000000000003e-05 2024-09-13T05:12:16.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152617+0000", 2024-09-13T05:12:16.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0896000000000001e-05 2024-09-13T05:12:16.368 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.368 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.368 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.369 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136577 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4037632~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:16.369 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:12:16.369 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.226412765999999, 2024-09-13T05:12:16.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056798242999999998, 2024-09-13T05:12:16.369 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.369 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.369 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.369 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.369 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.369 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136577 2024-09-13T05:12:16.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.369 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:12:16.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:12:16.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095882+0000", 2024-09-13T05:12:16.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999242 2024-09-13T05:12:16.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095961+0000", 2024-09-13T05:12:16.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8864999999999998e-05 2024-09-13T05:12:16.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095973+0000", 2024-09-13T05:12:16.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2206e-05 2024-09-13T05:12:16.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095978+0000", 2024-09-13T05:12:16.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0629999999999996e-06 2024-09-13T05:12:16.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152646+0000", 2024-09-13T05:12:16.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056668035999999998 2024-09-13T05:12:16.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152695+0000", 2024-09-13T05:12:16.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8634000000000002e-05 2024-09-13T05:12:16.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152756+0000", 2024-09-13T05:12:16.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1315000000000005e-05 2024-09-13T05:12:16.373 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.373 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.373 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.373 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136579 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4051968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:16.373 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:12:16.373 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.226084670999999, 2024-09-13T05:12:16.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056610869000000001, 2024-09-13T05:12:16.373 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.373 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.373 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.373 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.374 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.374 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136579 2024-09-13T05:12:16.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.374 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:12:16.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:12:16.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095989+0000", 2024-09-13T05:12:16.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997029 2024-09-13T05:12:16.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096291+0000", 2024-09-13T05:12:16.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030221499999999999 2024-09-13T05:12:16.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096300+0000", 2024-09-13T05:12:16.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4819999999999994e-06 2024-09-13T05:12:16.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096306+0000", 2024-09-13T05:12:16.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:12:16.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152788+0000", 2024-09-13T05:12:16.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056481625000000001 2024-09-13T05:12:16.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152837+0000", 2024-09-13T05:12:16.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9345000000000003e-05 2024-09-13T05:12:16.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152897+0000", 2024-09-13T05:12:16.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9892999999999997e-05 2024-09-13T05:12:16.377 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.377 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.377 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.377 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136581 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4066304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:16.378 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:12:16.378 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.225905844, 2024-09-13T05:12:16.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056597091000000002, 2024-09-13T05:12:16.378 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.378 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.378 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.378 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.378 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.378 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136581 2024-09-13T05:12:16.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.378 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:12:16.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:12:16.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096312+0000", 2024-09-13T05:12:16.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998465 2024-09-13T05:12:16.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096469+0000", 2024-09-13T05:12:16.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157109 2024-09-13T05:12:16.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096478+0000", 2024-09-13T05:12:16.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3260000000000002e-06 2024-09-13T05:12:16.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096482+0000", 2024-09-13T05:12:16.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9720000000000003e-06 2024-09-13T05:12:16.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152933+0000", 2024-09-13T05:12:16.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056451128000000003 2024-09-13T05:12:16.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152993+0000", 2024-09-13T05:12:16.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9947000000000001e-05 2024-09-13T05:12:16.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153062+0000", 2024-09-13T05:12:16.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9105999999999999e-05 2024-09-13T05:12:16.382 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.382 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.382 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.382 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136583 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4080640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:16.382 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:12:16.382 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.225639931, 2024-09-13T05:12:16.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056496609000000003, 2024-09-13T05:12:16.382 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.382 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.383 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.383 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.383 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.383 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136583 2024-09-13T05:12:16.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.383 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:12:16.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:12:16.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096485+0000", 2024-09-13T05:12:16.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997544 2024-09-13T05:12:16.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096735+0000", 2024-09-13T05:12:16.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024979899999999998 2024-09-13T05:12:16.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096742+0000", 2024-09-13T05:12:16.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7139999999999996e-06 2024-09-13T05:12:16.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096747+0000", 2024-09-13T05:12:16.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8709999999999996e-06 2024-09-13T05:12:16.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153099+0000", 2024-09-13T05:12:16.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056352639000000003 2024-09-13T05:12:16.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153168+0000", 2024-09-13T05:12:16.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9029000000000006e-05 2024-09-13T05:12:16.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153228+0000", 2024-09-13T05:12:16.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9339999999999998e-05 2024-09-13T05:12:16.387 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.387 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.387 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.387 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136585 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4094976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:16.387 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:12:16.387 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.225388464000002, 2024-09-13T05:12:16.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056396420000000003, 2024-09-13T05:12:16.387 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.388 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.388 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.388 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.388 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.388 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136585 2024-09-13T05:12:16.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.388 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:12:16.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:12:16.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096750+0000", 2024-09-13T05:12:16.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997673 2024-09-13T05:12:16.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096986+0000", 2024-09-13T05:12:16.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000236297 2024-09-13T05:12:16.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096993+0000", 2024-09-13T05:12:16.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9600000000000003e-06 2024-09-13T05:12:16.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096999+0000", 2024-09-13T05:12:16.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:12:16.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153264+0000", 2024-09-13T05:12:16.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056264728999999999 2024-09-13T05:12:16.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153318+0000", 2024-09-13T05:12:16.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3934000000000002e-05 2024-09-13T05:12:16.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153379+0000", 2024-09-13T05:12:16.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1206999999999999e-05 2024-09-13T05:12:16.391 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.391 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.392 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.392 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136586 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4109312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:16.392 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:12:16.392 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.225187662, 2024-09-13T05:12:16.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056374703999999998, 2024-09-13T05:12:16.392 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.392 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.392 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.392 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.392 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.392 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136586 2024-09-13T05:12:16.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.393 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:12:16.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:12:16.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097004+0000", 2024-09-13T05:12:16.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998207 2024-09-13T05:12:16.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097187+0000", 2024-09-13T05:12:16.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018337900000000001 2024-09-13T05:12:16.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097198+0000", 2024-09-13T05:12:16.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348e-05 2024-09-13T05:12:16.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097202+0000", 2024-09-13T05:12:16.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.121e-06 2024-09-13T05:12:16.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153411+0000", 2024-09-13T05:12:16.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056209510999999997 2024-09-13T05:12:16.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153464+0000", 2024-09-13T05:12:16.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2605000000000002e-05 2024-09-13T05:12:16.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153558+0000", 2024-09-13T05:12:16.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4017999999999993e-05 2024-09-13T05:12:16.396 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.396 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.396 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.396 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136588 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:16.396 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:12:16.396 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.224903479000002, 2024-09-13T05:12:16.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056274980000000002, 2024-09-13T05:12:16.397 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.397 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.397 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.397 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.397 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.397 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136588 2024-09-13T05:12:16.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.397 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:12:16.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:12:16.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097205+0000", 2024-09-13T05:12:16.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997377 2024-09-13T05:12:16.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097471+0000", 2024-09-13T05:12:16.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026628200000000001 2024-09-13T05:12:16.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097484+0000", 2024-09-13T05:12:16.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2493e-05 2024-09-13T05:12:16.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097488+0000", 2024-09-13T05:12:16.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9330000000000003e-06 2024-09-13T05:12:16.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153600+0000", 2024-09-13T05:12:16.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056112097 2024-09-13T05:12:16.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153654+0000", 2024-09-13T05:12:16.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4126000000000003e-05 2024-09-13T05:12:16.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153742+0000", 2024-09-13T05:12:16.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.831e-05 2024-09-13T05:12:16.400 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.401 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.401 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.401 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136589 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4137984~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:16.401 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:12:16.401 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.224764172, 2024-09-13T05:12:16.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056293867999999997, 2024-09-13T05:12:16.401 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.401 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.401 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.401 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.401 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.402 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136589 2024-09-13T05:12:16.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.402 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:12:16.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:12:16.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097491+0000", 2024-09-13T05:12:16.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998841 2024-09-13T05:12:16.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097610+0000", 2024-09-13T05:12:16.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119263 2024-09-13T05:12:16.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097617+0000", 2024-09-13T05:12:16.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6490000000000002e-06 2024-09-13T05:12:16.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097624+0000", 2024-09-13T05:12:16.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6309999999999997e-06 2024-09-13T05:12:16.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153779+0000", 2024-09-13T05:12:16.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056155153999999999 2024-09-13T05:12:16.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153831+0000", 2024-09-13T05:12:16.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2080000000000003e-05 2024-09-13T05:12:16.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153901+0000", 2024-09-13T05:12:16.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9765999999999996e-05 2024-09-13T05:12:16.405 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.405 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.405 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.405 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136591 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4152320~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:16.405 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097930+0000", 2024-09-13T05:12:16.405 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.224440619999999, 2024-09-13T05:12:16.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056118910000000001, 2024-09-13T05:12:16.406 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.406 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.406 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.406 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.406 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.406 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136591 2024-09-13T05:12:16.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.406 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097930+0000", 2024-09-13T05:12:16.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097930+0000", 2024-09-13T05:12:16.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097627+0000", 2024-09-13T05:12:16.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9996967 2024-09-13T05:12:16.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097934+0000", 2024-09-13T05:12:16.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030723700000000003 2024-09-13T05:12:16.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097941+0000", 2024-09-13T05:12:16.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.776e-06 2024-09-13T05:12:16.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097945+0000", 2024-09-13T05:12:16.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7809999999999999e-06 2024-09-13T05:12:16.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153937+0000", 2024-09-13T05:12:16.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055992078000000001 2024-09-13T05:12:16.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153987+0000", 2024-09-13T05:12:16.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0204000000000002e-05 2024-09-13T05:12:16.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.154049+0000", 2024-09-13T05:12:16.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2012000000000002e-05 2024-09-13T05:12:16.409 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.410 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.410 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.410 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136965 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3366912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:16.410 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:12:16.410 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.204795351000001, 2024-09-13T05:12:16.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056225403, 2024-09-13T05:12:16.410 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.410 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.410 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.410 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.410 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.410 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136965 2024-09-13T05:12:16.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.411 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:12:16.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:12:16.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117575+0000", 2024-09-13T05:12:16.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117578+0000", 2024-09-13T05:12:16.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4899999999999999e-06 2024-09-13T05:12:16.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117583+0000", 2024-09-13T05:12:16.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.074e-06 2024-09-13T05:12:16.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117587+0000", 2024-09-13T05:12:16.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5360000000000003e-06 2024-09-13T05:12:16.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173622+0000", 2024-09-13T05:12:16.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056034527000000001 2024-09-13T05:12:16.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173704+0000", 2024-09-13T05:12:16.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2137000000000003e-05 2024-09-13T05:12:16.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173801+0000", 2024-09-13T05:12:16.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7048999999999999e-05 2024-09-13T05:12:16.414 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.414 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.414 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.414 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136991 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3553280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:16.414 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:16.414 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.200869573999999, 2024-09-13T05:12:16.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056330199999999997, 2024-09-13T05:12:16.415 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.415 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.415 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.415 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.415 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.415 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136991 2024-09-13T05:12:16.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.415 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:16.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:16.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:16.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121504+0000", 2024-09-13T05:12:16.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7199999999999998e-06 2024-09-13T05:12:16.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121510+0000", 2024-09-13T05:12:16.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3459999999999999e-06 2024-09-13T05:12:16.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121515+0000", 2024-09-13T05:12:16.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.656e-06 2024-09-13T05:12:16.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177608+0000", 2024-09-13T05:12:16.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056093267000000002 2024-09-13T05:12:16.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177717+0000", 2024-09-13T05:12:16.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010901299999999999 2024-09-13T05:12:16.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177832+0000", 2024-09-13T05:12:16.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114604 2024-09-13T05:12:16.418 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.418 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.418 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.419 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.419 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.419 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:16.420 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:12:16.421 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:16.416+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:16.432 INFO:teuthology.orchestra.run.smithi120.stdout:5142 trunc from 0xe071c85 to 0xb20df9e 2024-09-13T05:12:16.521 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:16.520+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:16.565 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:16.565 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:16.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.565 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:167647 3.a 3.d729692a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e125)", 2024-09-13T05:12:16.565 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:16.562349+0000", 2024-09-13T05:12:16.565 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001085195, 2024-09-13T05:12:16.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011087110000000001, 2024-09-13T05:12:16.565 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.565 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:16.566 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.566 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.566 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.566 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 167647 2024-09-13T05:12:16.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.566 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562349+0000", 2024-09-13T05:12:16.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562349+0000", 2024-09-13T05:12:16.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562348+0000", 2024-09-13T05:12:16.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562670+0000", 2024-09-13T05:12:16.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032162400000000001 2024-09-13T05:12:16.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562685+0000", 2024-09-13T05:12:16.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5573000000000002e-05 2024-09-13T05:12:16.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562693+0000", 2024-09-13T05:12:16.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1790000000000002e-06 2024-09-13T05:12:16.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.563445+0000", 2024-09-13T05:12:16.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075273699999999996 2024-09-13T05:12:16.569 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.569 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.569 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.569 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:167650 3.a 3.d729692a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e125)", 2024-09-13T05:12:16.569 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:16.562723+0000", 2024-09-13T05:12:16.569 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00071073200000000005, 2024-09-13T05:12:16.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00079728000000000004, 2024-09-13T05:12:16.569 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.569 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:16.570 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.570 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.570 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.570 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 167650 2024-09-13T05:12:16.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.570 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562723+0000", 2024-09-13T05:12:16.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562723+0000", 2024-09-13T05:12:16.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562723+0000", 2024-09-13T05:12:16.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562725+0000", 2024-09-13T05:12:16.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5050000000000002e-06 2024-09-13T05:12:16.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562732+0000", 2024-09-13T05:12:16.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5359999999999998e-06 2024-09-13T05:12:16.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562736+0000", 2024-09-13T05:12:16.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3329999999999998e-06 2024-09-13T05:12:16.573 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.574 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.574 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.574 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:167655 3.a 3.d729692a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e125)", 2024-09-13T05:12:16.574 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:16.562757+0000", 2024-09-13T05:12:16.574 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.000676843, 2024-09-13T05:12:16.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00081413000000000004, 2024-09-13T05:12:16.574 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.574 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:16.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.574 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 167655 2024-09-13T05:12:16.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.575 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562757+0000", 2024-09-13T05:12:16.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562757+0000", 2024-09-13T05:12:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562757+0000", 2024-09-13T05:12:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562759+0000", 2024-09-13T05:12:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3120000000000001e-06 2024-09-13T05:12:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562764+0000", 2024-09-13T05:12:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6709999999999998e-06 2024-09-13T05:12:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562769+0000", 2024-09-13T05:12:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3059999999999997e-06 2024-09-13T05:12:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:167660 3.a 3.d729692a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e125)", 2024-09-13T05:12:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:16.562803+0000", 2024-09-13T05:12:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00063035399999999996, 2024-09-13T05:12:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00081552700000000003, 2024-09-13T05:12:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 167660 2024-09-13T05:12:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562803+0000", 2024-09-13T05:12:16.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562803+0000", 2024-09-13T05:12:16.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562803+0000", 2024-09-13T05:12:16.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562805+0000", 2024-09-13T05:12:16.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.176e-06 2024-09-13T05:12:16.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562812+0000", 2024-09-13T05:12:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7089999999999996e-06 2024-09-13T05:12:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562818+0000", 2024-09-13T05:12:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6799999999999998e-06 2024-09-13T05:12:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.582 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.582 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:167663 3.8 3:1747e509:::rbd_data.112dbd21872d.000000000000001a:28 [read 97280~1024 out=1024b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125)", 2024-09-13T05:12:16.582 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:16.562822+0000", 2024-09-13T05:12:16.582 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00061194500000000002, 2024-09-13T05:12:16.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00084883799999999998, 2024-09-13T05:12:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 167663 2024-09-13T05:12:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562822+0000", 2024-09-13T05:12:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562822+0000", 2024-09-13T05:12:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562822+0000", 2024-09-13T05:12:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562824+0000", 2024-09-13T05:12:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3910000000000001e-06 2024-09-13T05:12:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562829+0000", 2024-09-13T05:12:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0300000000000001e-06 2024-09-13T05:12:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562833+0000", 2024-09-13T05:12:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7589999999999999e-06 2024-09-13T05:12:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.563463+0000", 2024-09-13T05:12:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000629978 2024-09-13T05:12:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.563532+0000", 2024-09-13T05:12:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8823000000000002e-05 2024-09-13T05:12:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:167664 3.a 3.d729692a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e125)", 2024-09-13T05:12:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:16.562836+0000", 2024-09-13T05:12:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00059746500000000004, 2024-09-13T05:12:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00088838899999999995, 2024-09-13T05:12:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 167664 2024-09-13T05:12:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562836+0000", 2024-09-13T05:12:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562836+0000", 2024-09-13T05:12:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562836+0000", 2024-09-13T05:12:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562838+0000", 2024-09-13T05:12:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.306e-06 2024-09-13T05:12:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562844+0000", 2024-09-13T05:12:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9730000000000002e-06 2024-09-13T05:12:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562850+0000", 2024-09-13T05:12:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8980000000000001e-06 2024-09-13T05:12:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:167667 3.8 3.90a7e2e8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e125)", 2024-09-13T05:12:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:16.562854+0000", 2024-09-13T05:12:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00057960800000000001, 2024-09-13T05:12:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00091832700000000003, 2024-09-13T05:12:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:16.591 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.591 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.591 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.591 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 167667 2024-09-13T05:12:16.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.591 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562854+0000", 2024-09-13T05:12:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562854+0000", 2024-09-13T05:12:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562854+0000", 2024-09-13T05:12:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562856+0000", 2024-09-13T05:12:16.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1519999999999999e-06 2024-09-13T05:12:16.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562862+0000", 2024-09-13T05:12:16.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-09-13T05:12:16.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562867+0000", 2024-09-13T05:12:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4789999999999998e-06 2024-09-13T05:12:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:167669 3.8 3.90a7e2e8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e125)", 2024-09-13T05:12:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:16.562871+0000", 2024-09-13T05:12:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00056327799999999996, 2024-09-13T05:12:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00095118600000000002, 2024-09-13T05:12:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "no flag points reached", 2024-09-13T05:12:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 167669 2024-09-13T05:12:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562871+0000", 2024-09-13T05:12:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562871+0000", 2024-09-13T05:12:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562870+0000", 2024-09-13T05:12:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562872+0000", 2024-09-13T05:12:16.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.266e-06 2024-09-13T05:12:16.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:16.562877+0000", 2024-09-13T05:12:16.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0340000000000004e-06 2024-09-13T05:12:16.598 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.598 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.598 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.599 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.599 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:12:16.599 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 8 2024-09-13T05:12:16.599 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:16.600 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:12:16.622 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:16.620+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:16.709 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:16.710 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:16.710 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:16.710 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:16.711 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:16.719 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:12:16.723 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:16.719+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:16.824 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:16.820+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:16.867 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:16.867 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:16.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:16.867 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:16.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.868 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:70758 3.2 3:427d0469:::rbd_header.112d8d1317eb:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-13T05:12:16.868 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:16.868 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.436048818000003, 2024-09-13T05:12:16.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.190313603, 2024-09-13T05:12:16.868 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.869 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.869 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.869 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.869 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.869 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70758 2024-09-13T05:12:16.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.869 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:16.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:16.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428654+0000", 2024-09-13T05:12:16.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:16.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428664+0000", 2024-09-13T05:12:16.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0664e-05 2024-09-13T05:12:16.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428683+0000", 2024-09-13T05:12:16.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8377e-05 2024-09-13T05:12:16.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428691+0000", 2024-09-13T05:12:16.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9400000000000008e-06 2024-09-13T05:12:16.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428789+0000", 2024-09-13T05:12:16.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7165999999999998e-05 2024-09-13T05:12:16.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:16.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428811+0000", 2024-09-13T05:12:16.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1925000000000001e-05 2024-09-13T05:12:16.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.617921+0000", 2024-09-13T05:12:16.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.189110536 2024-09-13T05:12:16.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618344+0000", 2024-09-13T05:12:16.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042245800000000001 2024-09-13T05:12:16.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618969+0000", 2024-09-13T05:12:16.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062529299999999996 2024-09-13T05:12:16.875 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.875 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.875 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.875 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162381 3.8 3.4e1a3768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:16.875 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:12:16.875 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3560425709999997, 2024-09-13T05:12:16.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.14690313199999999, 2024-09-13T05:12:16.876 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.876 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:16.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.876 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162381 2024-09-13T05:12:16.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.876 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:12:16.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:12:16.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508659+0000", 2024-09-13T05:12:16.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:12:16.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508673+0000", 2024-09-13T05:12:16.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4154999999999999e-05 2024-09-13T05:12:16.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508703+0000", 2024-09-13T05:12:16.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9427000000000001e-05 2024-09-13T05:12:16.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508719+0000", 2024-09-13T05:12:16.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6381000000000001e-05 2024-09-13T05:12:16.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508789+0000", 2024-09-13T05:12:16.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9898000000000001e-05 2024-09-13T05:12:16.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:16.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508799+0000", 2024-09-13T05:12:16.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0066e-05 2024-09-13T05:12:16.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655550+0000", 2024-09-13T05:12:16.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.146750506 2024-09-13T05:12:16.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655565+0000", 2024-09-13T05:12:16.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4915e-05 2024-09-13T05:12:16.881 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.881 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.881 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.881 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162393 3.8 3.fd966c88 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:16.881 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:12:16.881 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3445264970000004, 2024-09-13T05:12:16.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.135657895, 2024-09-13T05:12:16.881 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.881 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:16.881 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.881 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.881 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.882 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162393 2024-09-13T05:12:16.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.882 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:12:16.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:12:16.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520176+0000", 2024-09-13T05:12:16.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:16.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520184+0000", 2024-09-13T05:12:16.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5800000000000003e-06 2024-09-13T05:12:16.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520199+0000", 2024-09-13T05:12:16.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4481000000000001e-05 2024-09-13T05:12:16.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520209+0000", 2024-09-13T05:12:16.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0327e-05 2024-09-13T05:12:16.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520351+0000", 2024-09-13T05:12:16.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141827 2024-09-13T05:12:16.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:16.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520363+0000", 2024-09-13T05:12:16.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2018000000000001e-05 2024-09-13T05:12:16.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655819+0000", 2024-09-13T05:12:16.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13545665600000001 2024-09-13T05:12:16.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655835+0000", 2024-09-13T05:12:16.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6135000000000001e-05 2024-09-13T05:12:16.885 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.885 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.886 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.886 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162429 3.8 3.6e098f28 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:16.886 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:16.886 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3436758879999999, 2024-09-13T05:12:16.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13484765400000001, 2024-09-13T05:12:16.886 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.886 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:16.886 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.886 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.886 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.886 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162429 2024-09-13T05:12:16.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.887 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:16.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:16.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:16.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521032+0000", 2024-09-13T05:12:16.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3039999999999998e-06 2024-09-13T05:12:16.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521041+0000", 2024-09-13T05:12:16.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6880000000000005e-06 2024-09-13T05:12:16.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521047+0000", 2024-09-13T05:12:16.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0100000000000001e-06 2024-09-13T05:12:16.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521601+0000", 2024-09-13T05:12:16.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00055398600000000002 2024-09-13T05:12:16.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:16.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521613+0000", 2024-09-13T05:12:16.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2347000000000001e-05 2024-09-13T05:12:16.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655869+0000", 2024-09-13T05:12:16.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.134255597 2024-09-13T05:12:16.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655876+0000", 2024-09-13T05:12:16.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2790000000000001e-06 2024-09-13T05:12:16.890 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.890 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.890 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.891 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162521 3.8 3.f06bf7c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:16.891 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:16.891 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3412737579999998, 2024-09-13T05:12:16.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13247452600000001, 2024-09-13T05:12:16.891 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.891 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:16.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.891 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162521 2024-09-13T05:12:16.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.892 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:16.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:16.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:16.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523433+0000", 2024-09-13T05:12:16.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.128e-06 2024-09-13T05:12:16.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523440+0000", 2024-09-13T05:12:16.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9990000000000002e-06 2024-09-13T05:12:16.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523446+0000", 2024-09-13T05:12:16.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7869999999999998e-06 2024-09-13T05:12:16.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.528221+0000", 2024-09-13T05:12:16.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047747040000000003 2024-09-13T05:12:16.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:16.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.528237+0000", 2024-09-13T05:12:16.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6042e-05 2024-09-13T05:12:16.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655898+0000", 2024-09-13T05:12:16.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.127661521 2024-09-13T05:12:16.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655905+0000", 2024-09-13T05:12:16.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7780000000000002e-06 2024-09-13T05:12:16.896 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.896 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.896 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.896 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162381 3.8 3:16ec5872:::rbd_data.112dc3abcba6.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:16.896 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:12:16.897 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3317465930000001, 2024-09-13T05:12:16.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12546553899999999, 2024-09-13T05:12:16.897 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.897 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:16.897 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.897 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.897 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.897 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162381 2024-09-13T05:12:16.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.897 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:12:16.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:12:16.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532956+0000", 2024-09-13T05:12:16.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:16.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532964+0000", 2024-09-13T05:12:16.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.072e-06 2024-09-13T05:12:16.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532976+0000", 2024-09-13T05:12:16.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1355000000000001e-05 2024-09-13T05:12:16.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532984+0000", 2024-09-13T05:12:16.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3440000000000001e-06 2024-09-13T05:12:16.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533432+0000", 2024-09-13T05:12:16.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044773000000000002 2024-09-13T05:12:16.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:16.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533439+0000", 2024-09-13T05:12:16.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9890000000000003e-06 2024-09-13T05:12:16.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655985+0000", 2024-09-13T05:12:16.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122546527 2024-09-13T05:12:16.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656234+0000", 2024-09-13T05:12:16.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024911300000000003 2024-09-13T05:12:16.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:12:16.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656378+0000", 2024-09-13T05:12:16.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014417100000000001 2024-09-13T05:12:16.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:16.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657916+0000", 2024-09-13T05:12:16.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001537907 2024-09-13T05:12:16.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:12:16.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658308+0000", 2024-09-13T05:12:16.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039183700000000002 2024-09-13T05:12:16.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:12:16.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658364+0000", 2024-09-13T05:12:16.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5451000000000002e-05 2024-09-13T05:12:16.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658423+0000", 2024-09-13T05:12:16.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9449e-05 2024-09-13T05:12:16.906 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.906 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.906 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.906 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162393 3.8 3:113669bf:::rbd_data.112dfd94ee88.00000000000000bf:2a [read 131072~18432] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:16.906 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:16.906 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3317068140000003, 2024-09-13T05:12:16.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124231431, 2024-09-13T05:12:16.907 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.907 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.907 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162393 2024-09-13T05:12:16.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.907 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:16.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:16.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:16.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533001+0000", 2024-09-13T05:12:16.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8099999999999999e-06 2024-09-13T05:12:16.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533007+0000", 2024-09-13T05:12:16.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5849999999999996e-06 2024-09-13T05:12:16.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533012+0000", 2024-09-13T05:12:16.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0320000000000003e-06 2024-09-13T05:12:16.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533459+0000", 2024-09-13T05:12:16.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044646399999999999 2024-09-13T05:12:16.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:16.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533464+0000", 2024-09-13T05:12:16.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9180000000000002e-06 2024-09-13T05:12:16.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656870+0000", 2024-09-13T05:12:16.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123406847 2024-09-13T05:12:16.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657067+0000", 2024-09-13T05:12:16.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019655599999999999 2024-09-13T05:12:16.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657229+0000", 2024-09-13T05:12:16.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016175599999999999 2024-09-13T05:12:16.912 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.912 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.913 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.913 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162429 3.8 3:14f19076:::rbd_data.112dfd94ee88.0000000000000150:2a [read 131072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:16.913 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:12:16.913 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3316872640000001, 2024-09-13T05:12:16.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124549956, 2024-09-13T05:12:16.913 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.913 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.913 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.913 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.913 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.913 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162429 2024-09-13T05:12:16.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.914 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:12:16.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:12:16.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533016+0000", 2024-09-13T05:12:16.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533020+0000", 2024-09-13T05:12:16.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1049999999999999e-06 2024-09-13T05:12:16.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533025+0000", 2024-09-13T05:12:16.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-09-13T05:12:16.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533030+0000", 2024-09-13T05:12:16.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8999999999999997e-06 2024-09-13T05:12:16.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533481+0000", 2024-09-13T05:12:16.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045080400000000002 2024-09-13T05:12:16.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:16.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533486+0000", 2024-09-13T05:12:16.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3369999999999999e-06 2024-09-13T05:12:16.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657311+0000", 2024-09-13T05:12:16.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123824408 2024-09-13T05:12:16.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657464+0000", 2024-09-13T05:12:16.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015343900000000001 2024-09-13T05:12:16.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657567+0000", 2024-09-13T05:12:16.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102568 2024-09-13T05:12:16.918 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.918 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.918 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.918 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162521 3.8 3:13efd60f:::rbd_data.112dfd94ee88.000000000000031a:2a [read 131072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:16.918 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:16.918 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3315360309999997, 2024-09-13T05:12:16.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124709257, 2024-09-13T05:12:16.918 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.918 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.918 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.919 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.919 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.919 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162521 2024-09-13T05:12:16.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.919 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:16.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:16.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:16.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533170+0000", 2024-09-13T05:12:16.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3910000000000001e-06 2024-09-13T05:12:16.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533176+0000", 2024-09-13T05:12:16.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4029999999999998e-06 2024-09-13T05:12:16.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533180+0000", 2024-09-13T05:12:16.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6999999999999999e-06 2024-09-13T05:12:16.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533659+0000", 2024-09-13T05:12:16.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047839699999999998 2024-09-13T05:12:16.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:16.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533664+0000", 2024-09-13T05:12:16.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7239999999999997e-06 2024-09-13T05:12:16.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657619+0000", 2024-09-13T05:12:16.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123954412 2024-09-13T05:12:16.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657784+0000", 2024-09-13T05:12:16.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016527499999999999 2024-09-13T05:12:16.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657877+0000", 2024-09-13T05:12:16.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3280000000000001e-05 2024-09-13T05:12:16.923 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.923 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.923 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.923 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162618 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 70656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:16.923 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:12:16.923 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3302313210000003, 2024-09-13T05:12:16.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123752711, 2024-09-13T05:12:16.924 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.924 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.924 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.924 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.924 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.924 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162618 2024-09-13T05:12:16.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.924 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:12:16.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:12:16.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534472+0000", 2024-09-13T05:12:16.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534475+0000", 2024-09-13T05:12:16.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2010000000000002e-06 2024-09-13T05:12:16.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534482+0000", 2024-09-13T05:12:16.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:12:16.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534486+0000", 2024-09-13T05:12:16.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7520000000000004e-06 2024-09-13T05:12:16.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536456+0000", 2024-09-13T05:12:16.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001969527 2024-09-13T05:12:16.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:16.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536462+0000", 2024-09-13T05:12:16.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2750000000000001e-06 2024-09-13T05:12:16.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657939+0000", 2024-09-13T05:12:16.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121476769 2024-09-13T05:12:16.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658087+0000", 2024-09-13T05:12:16.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014862400000000001 2024-09-13T05:12:16.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658225+0000", 2024-09-13T05:12:16.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013800999999999999 2024-09-13T05:12:16.929 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.929 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.929 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.929 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162620 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 71680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:16.929 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:16.929 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3301971960000003, 2024-09-13T05:12:16.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124087688, 2024-09-13T05:12:16.929 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.929 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.930 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.930 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.930 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162620 2024-09-13T05:12:16.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.930 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:16.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:16.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:16.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534509+0000", 2024-09-13T05:12:16.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1270000000000001e-06 2024-09-13T05:12:16.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534514+0000", 2024-09-13T05:12:16.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8720000000000001e-06 2024-09-13T05:12:16.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534518+0000", 2024-09-13T05:12:16.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5090000000000004e-06 2024-09-13T05:12:16.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536485+0000", 2024-09-13T05:12:16.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019671530000000001 2024-09-13T05:12:16.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:16.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536491+0000", 2024-09-13T05:12:16.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3759999999999999e-06 2024-09-13T05:12:16.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658466+0000", 2024-09-13T05:12:16.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121975466 2024-09-13T05:12:16.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658522+0000", 2024-09-13T05:12:16.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5668999999999998e-05 2024-09-13T05:12:16.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658595+0000", 2024-09-13T05:12:16.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2800999999999996e-05 2024-09-13T05:12:16.936 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.936 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.936 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.936 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162622 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 72704~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:16.936 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:12:16.936 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3301662289999996, 2024-09-13T05:12:16.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124215569, 2024-09-13T05:12:16.936 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.937 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.937 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162622 2024-09-13T05:12:16.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.937 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:12:16.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:12:16.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534537+0000", 2024-09-13T05:12:16.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534540+0000", 2024-09-13T05:12:16.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3740000000000001e-06 2024-09-13T05:12:16.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534545+0000", 2024-09-13T05:12:16.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4210000000000003e-06 2024-09-13T05:12:16.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534550+0000", 2024-09-13T05:12:16.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3090000000000003e-06 2024-09-13T05:12:16.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536510+0000", 2024-09-13T05:12:16.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019597130000000001 2024-09-13T05:12:16.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:16.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536517+0000", 2024-09-13T05:12:16.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0620000000000003e-06 2024-09-13T05:12:16.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658632+0000", 2024-09-13T05:12:16.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122114373 2024-09-13T05:12:16.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658686+0000", 2024-09-13T05:12:16.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3882999999999999e-05 2024-09-13T05:12:16.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658753+0000", 2024-09-13T05:12:16.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7921000000000002e-05 2024-09-13T05:12:16.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.943 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.943 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162623 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 73728~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:16.943 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:12:16.943 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.330149424, 2024-09-13T05:12:16.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124350214, 2024-09-13T05:12:16.943 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.944 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.944 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162623 2024-09-13T05:12:16.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.945 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:12:16.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:12:16.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534554+0000", 2024-09-13T05:12:16.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534556+0000", 2024-09-13T05:12:16.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-13T05:12:16.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534563+0000", 2024-09-13T05:12:16.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2890000000000003e-06 2024-09-13T05:12:16.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534567+0000", 2024-09-13T05:12:16.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4880000000000001e-06 2024-09-13T05:12:16.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536538+0000", 2024-09-13T05:12:16.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019703989999999998 2024-09-13T05:12:16.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:16.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536543+0000", 2024-09-13T05:12:16.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3920000000000002e-06 2024-09-13T05:12:16.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658773+0000", 2024-09-13T05:12:16.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122229607 2024-09-13T05:12:16.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658835+0000", 2024-09-13T05:12:16.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1954999999999999e-05 2024-09-13T05:12:16.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658905+0000", 2024-09-13T05:12:16.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-09-13T05:12:16.949 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.949 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.949 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.950 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162626 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 65536~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:16.950 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:16.950 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3300981399999996, 2024-09-13T05:12:16.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124425881, 2024-09-13T05:12:16.950 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.950 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.950 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162626 2024-09-13T05:12:16.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.950 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:16.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:16.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:16.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534611+0000", 2024-09-13T05:12:16.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5419999999999996e-06 2024-09-13T05:12:16.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534617+0000", 2024-09-13T05:12:16.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5169999999999999e-06 2024-09-13T05:12:16.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534622+0000", 2024-09-13T05:12:16.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9810000000000003e-06 2024-09-13T05:12:16.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536563+0000", 2024-09-13T05:12:16.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019410549999999999 2024-09-13T05:12:16.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:16.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536568+0000", 2024-09-13T05:12:16.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4310000000000002e-06 2024-09-13T05:12:16.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658922+0000", 2024-09-13T05:12:16.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122354221 2024-09-13T05:12:16.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658968+0000", 2024-09-13T05:12:16.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5221e-05 2024-09-13T05:12:16.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659032+0000", 2024-09-13T05:12:16.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4256000000000003e-05 2024-09-13T05:12:16.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.955 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.955 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162628 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 66560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:16.955 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:16.955 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3300631889999996, 2024-09-13T05:12:16.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124532254, 2024-09-13T05:12:16.956 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.956 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.956 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162628 2024-09-13T05:12:16.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.956 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:16.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:16.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:16.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534643+0000", 2024-09-13T05:12:16.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1890000000000001e-06 2024-09-13T05:12:16.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534648+0000", 2024-09-13T05:12:16.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:12:16.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534652+0000", 2024-09-13T05:12:16.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4549999999999997e-06 2024-09-13T05:12:16.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536586+0000", 2024-09-13T05:12:16.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019336049999999999 2024-09-13T05:12:16.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:16.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536591+0000", 2024-09-13T05:12:16.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3770000000000004e-06 2024-09-13T05:12:16.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659062+0000", 2024-09-13T05:12:16.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122470685 2024-09-13T05:12:16.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659106+0000", 2024-09-13T05:12:16.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3856000000000002e-05 2024-09-13T05:12:16.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659173+0000", 2024-09-13T05:12:16.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7168000000000005e-05 2024-09-13T05:12:16.961 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.961 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.961 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.961 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162630 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 67584~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:16.961 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:16.961 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3300299830000002, 2024-09-13T05:12:16.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12468555100000001, 2024-09-13T05:12:16.961 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.962 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.962 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162630 2024-09-13T05:12:16.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.962 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:16.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:16.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:16.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534676+0000", 2024-09-13T05:12:16.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4399999999999999e-06 2024-09-13T05:12:16.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534681+0000", 2024-09-13T05:12:16.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2349999999999999e-06 2024-09-13T05:12:16.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534686+0000", 2024-09-13T05:12:16.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5499999999999996e-06 2024-09-13T05:12:16.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536609+0000", 2024-09-13T05:12:16.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001923407 2024-09-13T05:12:16.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:16.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536615+0000", 2024-09-13T05:12:16.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1499999999999998e-06 2024-09-13T05:12:16.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659233+0000", 2024-09-13T05:12:16.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122618957 2024-09-13T05:12:16.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659294+0000", 2024-09-13T05:12:16.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0251000000000003e-05 2024-09-13T05:12:16.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659360+0000", 2024-09-13T05:12:16.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5906000000000002e-05 2024-09-13T05:12:16.966 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.966 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.966 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.966 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162633 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 69632~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:16.967 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:16.967 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3299220780000001, 2024-09-13T05:12:16.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124702147, 2024-09-13T05:12:16.967 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.967 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.968 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162633 2024-09-13T05:12:16.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.968 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:16.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:16.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:16.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534784+0000", 2024-09-13T05:12:16.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3300000000000001e-06 2024-09-13T05:12:16.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534789+0000", 2024-09-13T05:12:16.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4149999999999998e-06 2024-09-13T05:12:16.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534794+0000", 2024-09-13T05:12:16.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5669999999999996e-06 2024-09-13T05:12:16.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536634+0000", 2024-09-13T05:12:16.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001840401 2024-09-13T05:12:16.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:16.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536642+0000", 2024-09-13T05:12:16.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9729999999999997e-06 2024-09-13T05:12:16.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659383+0000", 2024-09-13T05:12:16.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12274112099999999 2024-09-13T05:12:16.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659424+0000", 2024-09-13T05:12:16.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0936000000000002e-05 2024-09-13T05:12:16.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659484+0000", 2024-09-13T05:12:16.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9775000000000003e-05 2024-09-13T05:12:16.973 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.973 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.973 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.974 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162675 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 68608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:16.974 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:16.974 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3298730340000002, 2024-09-13T05:12:16.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124823974, 2024-09-13T05:12:16.974 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.974 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.974 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162675 2024-09-13T05:12:16.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.975 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:16.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:16.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:16.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534833+0000", 2024-09-13T05:12:16.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.204e-06 2024-09-13T05:12:16.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534838+0000", 2024-09-13T05:12:16.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0130000000000001e-06 2024-09-13T05:12:16.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534842+0000", 2024-09-13T05:12:16.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.51e-06 2024-09-13T05:12:16.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536661+0000", 2024-09-13T05:12:16.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018186039999999999 2024-09-13T05:12:16.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:16.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536667+0000", 2024-09-13T05:12:16.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5260000000000001e-06 2024-09-13T05:12:16.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659531+0000", 2024-09-13T05:12:16.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122864403 2024-09-13T05:12:16.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659583+0000", 2024-09-13T05:12:16.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1564000000000003e-05 2024-09-13T05:12:16.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659655+0000", 2024-09-13T05:12:16.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2504999999999998e-05 2024-09-13T05:12:16.981 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.981 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.981 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.981 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:163255 3.8 3:1136e8de:::rbd_data.112dbd21872d.000000000000003c:28 [read 199680~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:16.981 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.549831+0000", 2024-09-13T05:12:16.981 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3148733269999999, 2024-09-13T05:12:16.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121493219, 2024-09-13T05:12:16.981 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.981 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.982 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.982 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.982 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 163255 2024-09-13T05:12:16.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.982 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549831+0000", 2024-09-13T05:12:16.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549831+0000", 2024-09-13T05:12:16.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549830+0000", 2024-09-13T05:12:16.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549833+0000", 2024-09-13T05:12:16.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.277e-06 2024-09-13T05:12:16.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549838+0000", 2024-09-13T05:12:16.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2650000000000004e-06 2024-09-13T05:12:16.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549842+0000", 2024-09-13T05:12:16.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2740000000000001e-06 2024-09-13T05:12:16.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.550588+0000", 2024-09-13T05:12:16.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00074583500000000003 2024-09-13T05:12:16.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:16.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.550593+0000", 2024-09-13T05:12:16.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3650000000000003e-06 2024-09-13T05:12:16.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671232+0000", 2024-09-13T05:12:16.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.120638256 2024-09-13T05:12:16.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671284+0000", 2024-09-13T05:12:16.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2340999999999999e-05 2024-09-13T05:12:16.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671324+0000", 2024-09-13T05:12:16.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9892999999999999e-05 2024-09-13T05:12:16.986 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.986 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.986 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.986 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:163257 3.8 3:1136e8de:::rbd_data.112dbd21872d.000000000000003c:28 [read 200704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:16.987 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:16.987 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3148578280000001, 2024-09-13T05:12:16.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12163807, 2024-09-13T05:12:16.987 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:16.987 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:16.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:16.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:16.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:16.987 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 163257 2024-09-13T05:12:16.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.987 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:16.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:16.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:16.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:16.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:16.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:16.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:16.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:16.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:16.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:16.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549848+0000", 2024-09-13T05:12:16.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1789999999999998e-06 2024-09-13T05:12:16.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:16.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549854+0000", 2024-09-13T05:12:16.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9050000000000002e-06 2024-09-13T05:12:16.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:16.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549858+0000", 2024-09-13T05:12:16.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3529999999999997e-06 2024-09-13T05:12:16.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.551228+0000", 2024-09-13T05:12:16.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001369227 2024-09-13T05:12:16.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:16.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.551233+0000", 2024-09-13T05:12:16.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5860000000000004e-06 2024-09-13T05:12:16.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:16.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671337+0000", 2024-09-13T05:12:16.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.120104265 2024-09-13T05:12:16.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:16.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671425+0000", 2024-09-13T05:12:16.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7810000000000001e-05 2024-09-13T05:12:16.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:16.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:16.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:16.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671484+0000", 2024-09-13T05:12:16.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9079000000000001e-05 2024-09-13T05:12:16.991 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.991 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:16.992 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:16.992 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:16.993 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:12:16.994 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:16.992+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:17.094 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:17.091+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:17.114 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:17.114 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:17.114 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:17.114 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:17.124 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:12:17.195 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:17.191+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:17.233 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:17.233 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:17.234 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:17.234 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:17.234 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:17.243 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:12:17.296 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:17.292+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:17.349 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:17.350 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:17.350 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:17.350 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [] 2024-09-13T05:12:17.350 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:17.359 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:12:17.397 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:17.396+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:17.462 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:17.462 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:17.462 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:17.463 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:17.473 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:12:17.518 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:17.516+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:17.579 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:17.580 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:17.580 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:17.580 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:17.580 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:17.589 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:12:17.593 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:12:17.599 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:17.596+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:17.676 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T05:12:17.700 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:17.696+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:17.702 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:17.702 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:17.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:17.702 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:17.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.703 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3.bb1d1096 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:17.703 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:17.703 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 53.754672780999996, 2024-09-13T05:12:17.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68834410099999999, 2024-09-13T05:12:17.703 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:17.703 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:17.703 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:17.703 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:17.703 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:17.703 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:12:17.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.703 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:17.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:17.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:17.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:17.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:17.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:17.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943719+0000", 2024-09-13T05:12:17.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:12:17.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:17.705 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943734+0000", 2024-09-13T05:12:17.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4793e-05 2024-09-13T05:12:17.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:17.705 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943765+0000", 2024-09-13T05:12:17.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0648999999999997e-05 2024-09-13T05:12:17.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.706 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:17.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943779+0000", 2024-09-13T05:12:17.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.447e-05 2024-09-13T05:12:17.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.706 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943872+0000", 2024-09-13T05:12:17.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3304e-05 2024-09-13T05:12:17.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:17.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943884+0000", 2024-09-13T05:12:17.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.167e-05 2024-09-13T05:12:17.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632042+0000", 2024-09-13T05:12:17.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68815832600000004 2024-09-13T05:12:17.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:17.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632066+0000", 2024-09-13T05:12:17.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3765999999999999e-05 2024-09-13T05:12:17.708 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.708 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:17.708 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.709 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3.b6bd6256 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:17.709 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:17.709 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 53.754548280999998, 2024-09-13T05:12:17.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68852592499999998, 2024-09-13T05:12:17.709 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:17.712 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:17.713 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:17.713 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:17.713 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:17.713 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:12:17.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.713 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:17.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:17.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:17.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:17.714 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:17.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:17.714 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943846+0000", 2024-09-13T05:12:17.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:17.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.715 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:17.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943852+0000", 2024-09-13T05:12:17.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3820000000000001e-06 2024-09-13T05:12:17.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.715 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:17.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943876+0000", 2024-09-13T05:12:17.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3995e-05 2024-09-13T05:12:17.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.715 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:17.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943898+0000", 2024-09-13T05:12:17.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1838999999999999e-05 2024-09-13T05:12:17.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.716 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.716 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.716 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946457+0000", 2024-09-13T05:12:17.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025588910000000002 2024-09-13T05:12:17.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.716 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.716 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:17.716 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946499+0000", 2024-09-13T05:12:17.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2814e-05 2024-09-13T05:12:17.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.717 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.717 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632364+0000", 2024-09-13T05:12:17.717 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68586484999999997 2024-09-13T05:12:17.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.717 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:17.717 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632372+0000", 2024-09-13T05:12:17.717 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1659999999999994e-06 2024-09-13T05:12:17.717 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.717 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:17.717 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.718 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3:6908b8dd:::rbd_data.112d8d1317eb.000000000000000f:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:17.718 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:17.718 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 53.717404203000001, 2024-09-13T05:12:17.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65181049499999999, 2024-09-13T05:12:17.718 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:17.718 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:17.718 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:17.718 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:17.718 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:17.718 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:12:17.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.718 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:17.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.719 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:17.719 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:17.719 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.719 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.719 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:17.719 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:17.719 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.719 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.719 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:17.720 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980989+0000", 2024-09-13T05:12:17.720 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:17.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.720 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.720 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:17.720 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980996+0000", 2024-09-13T05:12:17.720 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2200000000000003e-06 2024-09-13T05:12:17.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.720 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.720 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:17.720 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981011+0000", 2024-09-13T05:12:17.721 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4997000000000001e-05 2024-09-13T05:12:17.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.721 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.721 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:17.721 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981025+0000", 2024-09-13T05:12:17.721 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3604000000000001e-05 2024-09-13T05:12:17.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.721 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.721 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.721 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981110+0000", 2024-09-13T05:12:17.721 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4948000000000001e-05 2024-09-13T05:12:17.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:17.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981120+0000", 2024-09-13T05:12:17.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9399999999999997e-06 2024-09-13T05:12:17.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632425+0000", 2024-09-13T05:12:17.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65130460499999998 2024-09-13T05:12:17.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.723 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:17.723 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632587+0000", 2024-09-13T05:12:17.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016199500000000001 2024-09-13T05:12:17.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.723 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:17.723 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632801+0000", 2024-09-13T05:12:17.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021459499999999999 2024-09-13T05:12:17.723 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.723 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:17.723 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.724 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3:6a46bd6d:::rbd_data.112d8d1317eb.0000000000000010:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:17.724 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:17.724 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 53.717346546999998, 2024-09-13T05:12:17.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65213695699999996, 2024-09-13T05:12:17.724 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:17.724 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:17.724 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:17.724 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:17.724 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:17.725 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:12:17.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.725 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:17.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.725 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:17.725 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:17.725 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.725 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:17.725 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:17.726 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.726 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.726 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:17.726 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:17.726 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:17.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.726 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.726 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:17.726 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981052+0000", 2024-09-13T05:12:17.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4469999999999999e-06 2024-09-13T05:12:17.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.727 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:17.727 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981066+0000", 2024-09-13T05:12:17.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3658e-05 2024-09-13T05:12:17.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.727 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:17.727 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981073+0000", 2024-09-13T05:12:17.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:12:17.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981150+0000", 2024-09-13T05:12:17.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7783999999999999e-05 2024-09-13T05:12:17.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:17.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981161+0000", 2024-09-13T05:12:17.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0197000000000001e-05 2024-09-13T05:12:17.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632926+0000", 2024-09-13T05:12:17.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65176517300000003 2024-09-13T05:12:17.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:17.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633081+0000", 2024-09-13T05:12:17.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000155172 2024-09-13T05:12:17.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:17.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633185+0000", 2024-09-13T05:12:17.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000104329 2024-09-13T05:12:17.729 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.729 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:17.730 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.730 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.730 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.730 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:157552 3.5 3:a072521b:::rbd_data.112dc3abcba6.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-09-13T05:12:17.730 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:02.531636+0000", 2024-09-13T05:12:17.730 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 15.16675871, 2024-09-13T05:12:17.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.118346166, 2024-09-13T05:12:17.730 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:17.730 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:17.730 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:17.731 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:17.731 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:17.731 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 157552 2024-09-13T05:12:17.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.731 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:17.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:17.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.531636+0000", 2024-09-13T05:12:17.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:17.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.531636+0000", 2024-09-13T05:12:17.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:17.732 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.531634+0000", 2024-09-13T05:12:17.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:12:17.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:17.732 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552355+0000", 2024-09-13T05:12:17.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020721112 2024-09-13T05:12:17.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:17.733 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552389+0000", 2024-09-13T05:12:17.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4425999999999999e-05 2024-09-13T05:12:17.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.733 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:17.733 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552399+0000", 2024-09-13T05:12:17.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0062e-05 2024-09-13T05:12:17.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.733 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.733 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552496+0000", 2024-09-13T05:12:17.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6914000000000001e-05 2024-09-13T05:12:17.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:17.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552765+0000", 2024-09-13T05:12:17.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00026873499999999998 2024-09-13T05:12:17.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 3", 2024-09-13T05:12:17.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.562896+0000", 2024-09-13T05:12:17.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010131186 2024-09-13T05:12:17.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:12:17.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.611492+0000", 2024-09-13T05:12:17.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048596448 2024-09-13T05:12:17.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:17.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.649797+0000", 2024-09-13T05:12:17.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038304202000000002 2024-09-13T05:12:17.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:17.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.649905+0000", 2024-09-13T05:12:17.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010853600000000001 2024-09-13T05:12:17.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:17.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.649982+0000", 2024-09-13T05:12:17.736 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7080000000000001e-05 2024-09-13T05:12:17.736 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.736 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:17.736 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.736 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:159585 3.1c 3:3afcc414:::rbd_data.112dfd94ee88.00000000000002ca:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:17.736 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:17.736 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 10.684028233999999, 2024-09-13T05:12:17.736 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91717655399999998, 2024-09-13T05:12:17.736 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:17.736 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:17.736 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:17.736 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:17.737 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:17.737 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 159585 2024-09-13T05:12:17.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.737 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:17.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:17.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:17.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:17.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:17.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:17.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014366+0000", 2024-09-13T05:12:17.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:17.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:17.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014370+0000", 2024-09-13T05:12:17.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9960000000000004e-06 2024-09-13T05:12:17.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:17.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014379+0000", 2024-09-13T05:12:17.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8550000000000008e-06 2024-09-13T05:12:17.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:17.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014386+0000", 2024-09-13T05:12:17.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0140000000000001e-06 2024-09-13T05:12:17.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014533+0000", 2024-09-13T05:12:17.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000147458 2024-09-13T05:12:17.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.740 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:17.740 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014545+0000", 2024-09-13T05:12:17.740 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1318000000000001e-05 2024-09-13T05:12:17.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.740 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.740 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931378+0000", 2024-09-13T05:12:17.740 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91683292400000005 2024-09-13T05:12:17.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.740 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:17.740 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931495+0000", 2024-09-13T05:12:17.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011726399999999999 2024-09-13T05:12:17.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.741 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:17.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931543+0000", 2024-09-13T05:12:17.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8183000000000003e-05 2024-09-13T05:12:17.741 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.741 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:17.741 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.741 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160206 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 83968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:17.741 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:17.741 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 10.660625837, 2024-09-13T05:12:17.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89412730799999995, 2024-09-13T05:12:17.742 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:17.742 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:17.742 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:17.742 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:17.742 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:17.742 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160206 2024-09-13T05:12:17.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.742 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:17.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:17.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:17.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:17.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:17.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:17.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037768+0000", 2024-09-13T05:12:17.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:17.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:17.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037774+0000", 2024-09-13T05:12:17.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3600000000000001e-06 2024-09-13T05:12:17.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.744 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:17.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037786+0000", 2024-09-13T05:12:17.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.188e-05 2024-09-13T05:12:17.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.744 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:17.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037793+0000", 2024-09-13T05:12:17.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2749999999999998e-06 2024-09-13T05:12:17.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.745 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.745 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:17.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0353000000000003e-05 2024-09-13T05:12:17.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.745 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.745 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:17.745 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037862+0000", 2024-09-13T05:12:17.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9710000000000004e-06 2024-09-13T05:12:17.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.745 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.745 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.745 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931610+0000", 2024-09-13T05:12:17.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89374846299999999 2024-09-13T05:12:17.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:17.746 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931815+0000", 2024-09-13T05:12:17.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020516499999999999 2024-09-13T05:12:17.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:17.746 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931896+0000", 2024-09-13T05:12:17.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1157999999999998e-05 2024-09-13T05:12:17.746 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.746 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:17.746 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.747 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160208 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 84992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:17.747 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:17.747 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 10.660541097999999, 2024-09-13T05:12:17.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440702299999997, 2024-09-13T05:12:17.747 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:17.747 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:17.747 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:17.747 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:17.748 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:17.748 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160208 2024-09-13T05:12:17.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.748 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:17.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:17.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:17.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:17.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:17.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:17.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037853+0000", 2024-09-13T05:12:17.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:17.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:17.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037858+0000", 2024-09-13T05:12:17.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2179999999999998e-06 2024-09-13T05:12:17.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:17.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037867+0000", 2024-09-13T05:12:17.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5699999999999993e-06 2024-09-13T05:12:17.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:17.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037874+0000", 2024-09-13T05:12:17.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2810000000000003e-06 2024-09-13T05:12:17.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037935+0000", 2024-09-13T05:12:17.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1231999999999999e-05 2024-09-13T05:12:17.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:17.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037944+0000", 2024-09-13T05:12:17.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8580000000000006e-06 2024-09-13T05:12:17.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931956+0000", 2024-09-13T05:12:17.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89401158800000002 2024-09-13T05:12:17.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:17.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932015+0000", 2024-09-13T05:12:17.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8906999999999997e-05 2024-09-13T05:12:17.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:17.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932261+0000", 2024-09-13T05:12:17.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024622799999999997 2024-09-13T05:12:17.752 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.752 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:17.752 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.752 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160210 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 86016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:17.752 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:17.752 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 10.660472243999999, 2024-09-13T05:12:17.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89428998299999996, 2024-09-13T05:12:17.752 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:17.753 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:17.753 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:17.753 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:17.753 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:17.753 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160210 2024-09-13T05:12:17.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.753 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:17.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:17.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:17.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:17.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:17.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:17.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037922+0000", 2024-09-13T05:12:17.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:17.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:17.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037926+0000", 2024-09-13T05:12:17.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6550000000000003e-06 2024-09-13T05:12:17.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:17.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037933+0000", 2024-09-13T05:12:17.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5409999999999997e-06 2024-09-13T05:12:17.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:17.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037939+0000", 2024-09-13T05:12:17.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1940000000000003e-06 2024-09-13T05:12:17.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037976+0000", 2024-09-13T05:12:17.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6671000000000002e-05 2024-09-13T05:12:17.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:17.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037982+0000", 2024-09-13T05:12:17.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9669999999999998e-06 2024-09-13T05:12:17.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932096+0000", 2024-09-13T05:12:17.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89411465599999995 2024-09-13T05:12:17.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:17.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932149+0000", 2024-09-13T05:12:17.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3032999999999999e-05 2024-09-13T05:12:17.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:17.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932213+0000", 2024-09-13T05:12:17.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3165999999999998e-05 2024-09-13T05:12:17.757 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.757 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:17.757 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.758 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160212 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 87040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:17.758 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:17.758 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 10.660385122999999, 2024-09-13T05:12:17.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440379699999994, 2024-09-13T05:12:17.758 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:17.758 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:17.758 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:17.758 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:17.758 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:17.758 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160212 2024-09-13T05:12:17.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.758 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:17.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:17.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:17.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:17.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:17.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:17.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038009+0000", 2024-09-13T05:12:17.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:17.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:17.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038013+0000", 2024-09-13T05:12:17.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3950000000000003e-06 2024-09-13T05:12:17.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:17.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038032+0000", 2024-09-13T05:12:17.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8513999999999999e-05 2024-09-13T05:12:17.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:17.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038039+0000", 2024-09-13T05:12:17.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.985e-06 2024-09-13T05:12:17.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038086+0000", 2024-09-13T05:12:17.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7302999999999998e-05 2024-09-13T05:12:17.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:17.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038090+0000", 2024-09-13T05:12:17.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9029999999999997e-06 2024-09-13T05:12:17.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932291+0000", 2024-09-13T05:12:17.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89420100199999997 2024-09-13T05:12:17.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:17.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932352+0000", 2024-09-13T05:12:17.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1354999999999998e-05 2024-09-13T05:12:17.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:17.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932414+0000", 2024-09-13T05:12:17.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1037999999999994e-05 2024-09-13T05:12:17.762 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.762 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:17.763 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.763 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160214 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 88064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:17.763 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:17.763 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 10.660254057, 2024-09-13T05:12:17.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89438890900000001, 2024-09-13T05:12:17.763 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:17.763 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:17.763 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:17.763 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:17.763 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:17.763 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160214 2024-09-13T05:12:17.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.764 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:17.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:17.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:17.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:17.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:17.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:17.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038140+0000", 2024-09-13T05:12:17.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:17.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:17.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038145+0000", 2024-09-13T05:12:17.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9749999999999998e-06 2024-09-13T05:12:17.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:17.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038153+0000", 2024-09-13T05:12:17.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1280000000000008e-06 2024-09-13T05:12:17.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:17.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038161+0000", 2024-09-13T05:12:17.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0339999999999997e-06 2024-09-13T05:12:17.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038199+0000", 2024-09-13T05:12:17.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8269999999999998e-05 2024-09-13T05:12:17.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:17.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038204+0000", 2024-09-13T05:12:17.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5399999999999997e-06 2024-09-13T05:12:17.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932438+0000", 2024-09-13T05:12:17.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89423397999999998 2024-09-13T05:12:17.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:17.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932480+0000", 2024-09-13T05:12:17.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2392999999999999e-05 2024-09-13T05:12:17.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:17.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932530+0000", 2024-09-13T05:12:17.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:12:17.768 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.768 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:17.768 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.768 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160305 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 215040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:17.769 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:17.769 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 10.656050835, 2024-09-13T05:12:17.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89028175300000001, 2024-09-13T05:12:17.769 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:17.769 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:17.769 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:17.769 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:17.769 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:17.769 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160305 2024-09-13T05:12:17.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.769 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:17.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:17.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:17.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:17.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:17.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:17.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042343+0000", 2024-09-13T05:12:17.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:17.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:17.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042350+0000", 2024-09-13T05:12:17.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3769999999999998e-06 2024-09-13T05:12:17.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:17.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042367+0000", 2024-09-13T05:12:17.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.734e-05 2024-09-13T05:12:17.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:17.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042375+0000", 2024-09-13T05:12:17.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8469999999999996e-06 2024-09-13T05:12:17.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042428+0000", 2024-09-13T05:12:17.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3074e-05 2024-09-13T05:12:17.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:17.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042437+0000", 2024-09-13T05:12:17.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:12:17.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932550+0000", 2024-09-13T05:12:17.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89011304300000005 2024-09-13T05:12:17.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:17.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932589+0000", 2024-09-13T05:12:17.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9236000000000002e-05 2024-09-13T05:12:17.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:17.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932626+0000", 2024-09-13T05:12:17.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6832999999999998e-05 2024-09-13T05:12:17.774 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.774 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:17.774 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.775 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160307 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 216064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:17.775 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:17.775 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 10.656004396, 2024-09-13T05:12:17.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89032630800000001, 2024-09-13T05:12:17.775 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:17.775 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:17.775 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:17.775 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:17.776 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:17.776 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160307 2024-09-13T05:12:17.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.776 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:17.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:17.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:17.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:17.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:17.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:17.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:17.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:17.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:17.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042394+0000", 2024-09-13T05:12:17.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7900000000000001e-06 2024-09-13T05:12:17.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:17.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042401+0000", 2024-09-13T05:12:17.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.267e-06 2024-09-13T05:12:17.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:17.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042406+0000", 2024-09-13T05:12:17.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0860000000000001e-06 2024-09-13T05:12:17.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042465+0000", 2024-09-13T05:12:17.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9441000000000002e-05 2024-09-13T05:12:17.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:17.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042471+0000", 2024-09-13T05:12:17.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6640000000000003e-06 2024-09-13T05:12:17.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932645+0000", 2024-09-13T05:12:17.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89017372900000002 2024-09-13T05:12:17.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:17.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932681+0000", 2024-09-13T05:12:17.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5918999999999999e-05 2024-09-13T05:12:17.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:17.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932717+0000", 2024-09-13T05:12:17.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6007999999999998e-05 2024-09-13T05:12:17.780 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.780 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:17.780 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.780 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160309 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 217088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:17.780 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:17.781 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 10.655954137, 2024-09-13T05:12:17.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89037315900000003, 2024-09-13T05:12:17.781 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:17.781 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:17.781 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:17.781 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:17.781 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:17.781 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160309 2024-09-13T05:12:17.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.781 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:17.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:17.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:17.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:17.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:17.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:17.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042440+0000", 2024-09-13T05:12:17.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:17.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:17.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042444+0000", 2024-09-13T05:12:17.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.104e-06 2024-09-13T05:12:17.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:17.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042451+0000", 2024-09-13T05:12:17.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.922e-06 2024-09-13T05:12:17.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:17.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042457+0000", 2024-09-13T05:12:17.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3979999999999998e-06 2024-09-13T05:12:17.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042497+0000", 2024-09-13T05:12:17.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0692999999999998e-05 2024-09-13T05:12:17.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:17.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042503+0000", 2024-09-13T05:12:17.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.553e-06 2024-09-13T05:12:17.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932735+0000", 2024-09-13T05:12:17.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89023238699999996 2024-09-13T05:12:17.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.786 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:17.786 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932771+0000", 2024-09-13T05:12:17.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5972000000000001e-05 2024-09-13T05:12:17.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.786 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:17.786 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932814+0000", 2024-09-13T05:12:17.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2657000000000002e-05 2024-09-13T05:12:17.786 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.786 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:17.786 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.786 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160311 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 218112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:17.787 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:17.787 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 10.655928647, 2024-09-13T05:12:17.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89045284400000002, 2024-09-13T05:12:17.787 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:17.787 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:17.787 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:17.787 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:17.787 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:17.787 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160311 2024-09-13T05:12:17.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.787 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:17.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:17.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:17.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:17.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:17.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:17.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:17.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:17.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:17.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042469+0000", 2024-09-13T05:12:17.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.456e-06 2024-09-13T05:12:17.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:17.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042475+0000", 2024-09-13T05:12:17.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0990000000000004e-06 2024-09-13T05:12:17.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:17.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042481+0000", 2024-09-13T05:12:17.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.237e-06 2024-09-13T05:12:17.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042527+0000", 2024-09-13T05:12:17.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6796999999999999e-05 2024-09-13T05:12:17.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:17.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042533+0000", 2024-09-13T05:12:17.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6489999999999996e-06 2024-09-13T05:12:17.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932832+0000", 2024-09-13T05:12:17.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89029919800000001 2024-09-13T05:12:17.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:17.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932867+0000", 2024-09-13T05:12:17.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5049000000000003e-05 2024-09-13T05:12:17.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.792 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:17.792 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932919+0000", 2024-09-13T05:12:17.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1780999999999998e-05 2024-09-13T05:12:17.792 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.792 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:17.792 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.792 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160313 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 219136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:17.792 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:17.792 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 10.655899556, 2024-09-13T05:12:17.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89064232600000004, 2024-09-13T05:12:17.793 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:17.793 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:17.793 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:17.793 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:17.793 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:17.793 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160313 2024-09-13T05:12:17.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.793 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:17.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:17.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:17.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:17.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:17.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:17.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:17.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:17.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:17.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042498+0000", 2024-09-13T05:12:17.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.281e-06 2024-09-13T05:12:17.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:17.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042505+0000", 2024-09-13T05:12:17.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2699999999999999e-06 2024-09-13T05:12:17.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:17.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042512+0000", 2024-09-13T05:12:17.796 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0330000000000003e-06 2024-09-13T05:12:17.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.796 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042557+0000", 2024-09-13T05:12:17.796 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4425999999999998e-05 2024-09-13T05:12:17.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:17.796 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042562+0000", 2024-09-13T05:12:17.796 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3639999999999998e-06 2024-09-13T05:12:17.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932987+0000", 2024-09-13T05:12:17.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89042472299999997 2024-09-13T05:12:17.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:17.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933062+0000", 2024-09-13T05:12:17.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5129999999999994e-05 2024-09-13T05:12:17.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:17.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933138+0000", 2024-09-13T05:12:17.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5536000000000003e-05 2024-09-13T05:12:17.798 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.798 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:17.798 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.798 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160315 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 220160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:17.798 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:17.798 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 10.655868389, 2024-09-13T05:12:17.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89071820800000001, 2024-09-13T05:12:17.798 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:17.798 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:17.798 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:17.798 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:17.799 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:17.799 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160315 2024-09-13T05:12:17.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.799 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:17.799 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.799 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:17.799 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:17.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.799 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.799 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:17.799 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:17.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:17.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:17.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:17.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:17.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042529+0000", 2024-09-13T05:12:17.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3639999999999999e-06 2024-09-13T05:12:17.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:17.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042536+0000", 2024-09-13T05:12:17.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.866e-06 2024-09-13T05:12:17.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:17.801 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042541+0000", 2024-09-13T05:12:17.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:12:17.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.801 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042587+0000", 2024-09-13T05:12:17.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5735000000000002e-05 2024-09-13T05:12:17.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:17.802 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042593+0000", 2024-09-13T05:12:17.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0719999999999996e-06 2024-09-13T05:12:17.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.802 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.802 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.802 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933160+0000", 2024-09-13T05:12:17.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89056621000000002 2024-09-13T05:12:17.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.802 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.802 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:17.802 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933202+0000", 2024-09-13T05:12:17.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2376000000000002e-05 2024-09-13T05:12:17.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.802 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.803 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:17.803 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933245+0000", 2024-09-13T05:12:17.803 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2787999999999998e-05 2024-09-13T05:12:17.803 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.803 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:17.803 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.803 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.803 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160317 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:17.803 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:17.803 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 10.65583956, 2024-09-13T05:12:17.803 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89082205800000003, 2024-09-13T05:12:17.803 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:17.804 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:17.804 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:17.804 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:17.804 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:17.804 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160317 2024-09-13T05:12:17.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.804 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:17.804 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.804 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:17.804 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:17.804 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.805 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:17.805 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:17.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.805 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.805 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:17.805 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:17.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:17.805 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.805 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:17.805 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042558+0000", 2024-09-13T05:12:17.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1810000000000001e-06 2024-09-13T05:12:17.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.806 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:17.806 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042565+0000", 2024-09-13T05:12:17.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9280000000000004e-06 2024-09-13T05:12:17.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.806 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:17.806 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042571+0000", 2024-09-13T05:12:17.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7420000000000003e-06 2024-09-13T05:12:17.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.806 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042616+0000", 2024-09-13T05:12:17.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5201999999999999e-05 2024-09-13T05:12:17.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:17.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042622+0000", 2024-09-13T05:12:17.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8289999999999996e-06 2024-09-13T05:12:17.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933259+0000", 2024-09-13T05:12:17.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89063730799999996 2024-09-13T05:12:17.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.808 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:17.808 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933311+0000", 2024-09-13T05:12:17.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1910000000000003e-05 2024-09-13T05:12:17.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.808 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:17.808 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933377+0000", 2024-09-13T05:12:17.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6396999999999995e-05 2024-09-13T05:12:17.808 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.808 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:17.808 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.809 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160319 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 222208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:17.809 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:17.809 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 10.655809344, 2024-09-13T05:12:17.809 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89087477400000004, 2024-09-13T05:12:17.809 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:17.809 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:17.809 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:17.809 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:17.809 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:17.809 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160319 2024-09-13T05:12:17.809 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.809 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:17.809 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.809 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:17.810 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:17.810 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.810 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.810 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:17.810 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:17.810 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.810 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.810 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:17.810 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042585+0000", 2024-09-13T05:12:17.810 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:17.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.810 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.810 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:17.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042588+0000", 2024-09-13T05:12:17.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9450000000000002e-06 2024-09-13T05:12:17.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:17.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042594+0000", 2024-09-13T05:12:17.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0959999999999997e-06 2024-09-13T05:12:17.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:17.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042599+0000", 2024-09-13T05:12:17.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0069999999999997e-06 2024-09-13T05:12:17.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.812 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.812 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042642+0000", 2024-09-13T05:12:17.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2553999999999999e-05 2024-09-13T05:12:17.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.812 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:17.812 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042647+0000", 2024-09-13T05:12:17.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.31e-06 2024-09-13T05:12:17.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.812 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.812 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933387+0000", 2024-09-13T05:12:17.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89073982799999996 2024-09-13T05:12:17.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:17.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:12:17.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7101000000000003e-05 2024-09-13T05:12:17.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:17.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933460+0000", 2024-09-13T05:12:17.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6282999999999998e-05 2024-09-13T05:12:17.813 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.813 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:17.813 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.814 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160321 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 223232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:17.814 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:17.814 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 10.655779917, 2024-09-13T05:12:17.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89094616999999998, 2024-09-13T05:12:17.814 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:17.814 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:17.814 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:17.814 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:17.814 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:17.814 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160321 2024-09-13T05:12:17.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.814 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:17.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.815 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:17.815 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:17.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.815 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.815 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:17.815 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:17.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:17.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.815 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.815 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:17.815 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:17.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:17.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:17.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042617+0000", 2024-09-13T05:12:17.816 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8329999999999998e-06 2024-09-13T05:12:17.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:17.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042638+0000", 2024-09-13T05:12:17.816 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0908e-05 2024-09-13T05:12:17.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:17.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042644+0000", 2024-09-13T05:12:17.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0440000000000001e-06 2024-09-13T05:12:17.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042666+0000", 2024-09-13T05:12:17.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1256000000000001e-05 2024-09-13T05:12:17.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:17.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042671+0000", 2024-09-13T05:12:17.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6250000000000004e-06 2024-09-13T05:12:17.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:17.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933478+0000", 2024-09-13T05:12:17.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89080698800000002 2024-09-13T05:12:17.818 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:17.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933519+0000", 2024-09-13T05:12:17.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0717000000000003e-05 2024-09-13T05:12:17.818 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:17.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:17.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:17.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933561+0000", 2024-09-13T05:12:17.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2225999999999999e-05 2024-09-13T05:12:17.818 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.819 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:17.819 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.819 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:17.819 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:17.819 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:17.820 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:12:17.820 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:17.821 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:17.815+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:17.821 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:12:17.830 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:17.859 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:17.897 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:17.921 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:17.919+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:17.936 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:17.959 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:17.980 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:17.981 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:12:17.982 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:17.982 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:17.982 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:17.982 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:17.982 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:17.982 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:17.982 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:17.983 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:17.983 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:17.995 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:12:18.023 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:18.020+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:18.106 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:18.106 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:18.115 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:12:18.123 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:18.119+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:18.223 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:18.223 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:18.224 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:18.220+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:18.233 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:12:18.275 INFO:tasks.thrashosds.thrasher:in_osds: [2, 3, 5, 6, 7, 1] out_osds: [4, 0] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-13T05:12:18.275 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:12:18.275 INFO:tasks.thrashosds.thrasher:Removing osd 6, in_osds are: [2, 3, 5, 6, 7, 1] 2024-09-13T05:12:18.275 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 6 2024-09-13T05:12:18.326 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:18.323+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:18.342 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:18.342 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:18.352 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:12:18.427 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:18.424+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:18.457 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:18.457 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:18.466 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:12:18.527 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:18.524+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:18.575 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:18.575 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:18.575 INFO:tasks.ceph.mon.a.smithi120.stderr:2024-09-13T05:12:18.571+0000 7fa8b7b30700 -1 mon.a@0(leader).osd e125 definitely_dead 0 2024-09-13T05:12:18.584 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:12:18.628 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:18.623+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:18.693 INFO:teuthology.orchestra.run.smithi120.stderr:marked out osd.6. 2024-09-13T05:12:18.693 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:18.694 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:18.700 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is unset 2024-09-13T05:12:18.704 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:12:18.729 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:18.728+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:18.830 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:18.827+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:18.859 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:18.859 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:18.869 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:12:18.931 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:18.928+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:18.964 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:18.964 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:18.973 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:12:19.031 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:19.027+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:19.073 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:19.073 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:19.082 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:12:19.133 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:19.128+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:19.180 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:19.181 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:19.190 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:12:19.233 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:19.232+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:19.290 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:19.290 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:19.299 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:12:19.334 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:19.331+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:19.397 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:19.397 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:19.405 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:12:19.435 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:19.432+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:19.536 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:19.531+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:19.548 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:19.548 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:19.562 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:12:19.637 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:19.632+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:19.669 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:19.669 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:19.679 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:12:19.738 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:19.736+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:19.769 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:19.769 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:19.778 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:12:19.839 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:19.835+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:19.873 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:19.874 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:19.882 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:12:19.940 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:19.936+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:19.984 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:19.984 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:19.991 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:12:19.994 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:12:20.042 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:20.040+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:20.110 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:20.111 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:20.120 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:12:20.135 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:12:20.141 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:20.139+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:20.154 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:20.173 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:20.194 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:20.216 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:20.223 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:20.223 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:20.223 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:20.223 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:20.224 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:20.233 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:12:20.238 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:20.260 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:20.277 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:20.276+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:20.283 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:20.285 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:12:20.286 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:20.286 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:20.286 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:20.286 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:20.286 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:20.286 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:20.286 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:20.340 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:20.340 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:20.340 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:20.340 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [] 2024-09-13T05:12:20.340 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:20.343 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:20.339+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:20.349 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:12:20.443 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:20.440+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:20.458 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:20.458 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:20.458 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:20.459 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:20.468 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:12:20.544 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:20.540+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:20.619 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:20.620 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:20.620 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:20.620 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:20.620 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:20.629 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:12:20.646 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:20.643+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:20.712 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T05:12:20.747 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:20.747 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:20.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:20.747 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3.bb1d1096 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.800353917000002, 2024-09-13T05:12:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68834410099999999, 2024-09-13T05:12:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:12:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.748 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943719+0000", 2024-09-13T05:12:20.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:12:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943734+0000", 2024-09-13T05:12:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4793e-05 2024-09-13T05:12:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943765+0000", 2024-09-13T05:12:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0648999999999997e-05 2024-09-13T05:12:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943779+0000", 2024-09-13T05:12:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.447e-05 2024-09-13T05:12:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943872+0000", 2024-09-13T05:12:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3304e-05 2024-09-13T05:12:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943884+0000", 2024-09-13T05:12:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.167e-05 2024-09-13T05:12:20.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632042+0000", 2024-09-13T05:12:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68815832600000004 2024-09-13T05:12:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632066+0000", 2024-09-13T05:12:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3765999999999999e-05 2024-09-13T05:12:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3.b6bd6256 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.800229416999997, 2024-09-13T05:12:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68852592499999998, 2024-09-13T05:12:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:12:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.753 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:20.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:20.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:20.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943846+0000", 2024-09-13T05:12:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943852+0000", 2024-09-13T05:12:20.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3820000000000001e-06 2024-09-13T05:12:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943876+0000", 2024-09-13T05:12:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3995e-05 2024-09-13T05:12:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943898+0000", 2024-09-13T05:12:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1838999999999999e-05 2024-09-13T05:12:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946457+0000", 2024-09-13T05:12:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025588910000000002 2024-09-13T05:12:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946499+0000", 2024-09-13T05:12:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2814e-05 2024-09-13T05:12:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632364+0000", 2024-09-13T05:12:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68586484999999997 2024-09-13T05:12:20.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632372+0000", 2024-09-13T05:12:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1659999999999994e-06 2024-09-13T05:12:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3:6908b8dd:::rbd_data.112d8d1317eb.000000000000000f:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.763085339, 2024-09-13T05:12:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65181049499999999, 2024-09-13T05:12:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:20.758 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:12:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:20.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980989+0000", 2024-09-13T05:12:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980996+0000", 2024-09-13T05:12:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2200000000000003e-06 2024-09-13T05:12:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981011+0000", 2024-09-13T05:12:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4997000000000001e-05 2024-09-13T05:12:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981025+0000", 2024-09-13T05:12:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3604000000000001e-05 2024-09-13T05:12:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981110+0000", 2024-09-13T05:12:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4948000000000001e-05 2024-09-13T05:12:20.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:20.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981120+0000", 2024-09-13T05:12:20.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9399999999999997e-06 2024-09-13T05:12:20.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632425+0000", 2024-09-13T05:12:20.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65130460499999998 2024-09-13T05:12:20.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:20.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632587+0000", 2024-09-13T05:12:20.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016199500000000001 2024-09-13T05:12:20.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.763 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:20.763 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632801+0000", 2024-09-13T05:12:20.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021459499999999999 2024-09-13T05:12:20.763 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.763 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:20.763 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.763 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3:6a46bd6d:::rbd_data.112d8d1317eb.0000000000000010:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:20.763 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:20.763 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.763027682999997, 2024-09-13T05:12:20.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65213695699999996, 2024-09-13T05:12:20.764 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:20.764 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:20.764 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:20.764 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:20.764 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:20.764 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:12:20.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.764 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:20.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:20.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:20.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:20.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:20.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:20.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:20.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:20.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:20.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981052+0000", 2024-09-13T05:12:20.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4469999999999999e-06 2024-09-13T05:12:20.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:20.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981066+0000", 2024-09-13T05:12:20.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3658e-05 2024-09-13T05:12:20.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:20.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981073+0000", 2024-09-13T05:12:20.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:12:20.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981150+0000", 2024-09-13T05:12:20.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7783999999999999e-05 2024-09-13T05:12:20.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:20.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981161+0000", 2024-09-13T05:12:20.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0197000000000001e-05 2024-09-13T05:12:20.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632926+0000", 2024-09-13T05:12:20.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65176517300000003 2024-09-13T05:12:20.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:20.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633081+0000", 2024-09-13T05:12:20.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000155172 2024-09-13T05:12:20.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:20.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633185+0000", 2024-09-13T05:12:20.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000104329 2024-09-13T05:12:20.768 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.768 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:20.768 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.768 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:157552 3.5 3:a072521b:::rbd_data.112dc3abcba6.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-09-13T05:12:20.769 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:02.531636+0000", 2024-09-13T05:12:20.769 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.212439845999999, 2024-09-13T05:12:20.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.118346166, 2024-09-13T05:12:20.769 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:20.769 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:20.769 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:20.769 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:20.769 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:20.769 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 157552 2024-09-13T05:12:20.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.769 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.531636+0000", 2024-09-13T05:12:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.531636+0000", 2024-09-13T05:12:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:20.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.531634+0000", 2024-09-13T05:12:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:12:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552355+0000", 2024-09-13T05:12:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020721112 2024-09-13T05:12:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552389+0000", 2024-09-13T05:12:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4425999999999999e-05 2024-09-13T05:12:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552399+0000", 2024-09-13T05:12:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0062e-05 2024-09-13T05:12:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552496+0000", 2024-09-13T05:12:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6914000000000001e-05 2024-09-13T05:12:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552765+0000", 2024-09-13T05:12:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00026873499999999998 2024-09-13T05:12:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 3", 2024-09-13T05:12:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.562896+0000", 2024-09-13T05:12:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010131186 2024-09-13T05:12:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:12:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.611492+0000", 2024-09-13T05:12:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048596448 2024-09-13T05:12:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.649797+0000", 2024-09-13T05:12:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038304202000000002 2024-09-13T05:12:20.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.649905+0000", 2024-09-13T05:12:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010853600000000001 2024-09-13T05:12:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.649982+0000", 2024-09-13T05:12:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7080000000000001e-05 2024-09-13T05:12:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:159585 3.1c 3:3afcc414:::rbd_data.112dfd94ee88.00000000000002ca:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.72970937, 2024-09-13T05:12:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91717655399999998, 2024-09-13T05:12:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 159585 2024-09-13T05:12:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:20.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014366+0000", 2024-09-13T05:12:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:20.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014370+0000", 2024-09-13T05:12:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9960000000000004e-06 2024-09-13T05:12:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014379+0000", 2024-09-13T05:12:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8550000000000008e-06 2024-09-13T05:12:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:20.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014386+0000", 2024-09-13T05:12:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0140000000000001e-06 2024-09-13T05:12:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014533+0000", 2024-09-13T05:12:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000147458 2024-09-13T05:12:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014545+0000", 2024-09-13T05:12:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1318000000000001e-05 2024-09-13T05:12:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931378+0000", 2024-09-13T05:12:20.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91683292400000005 2024-09-13T05:12:20.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:20.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931495+0000", 2024-09-13T05:12:20.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011726399999999999 2024-09-13T05:12:20.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931543+0000", 2024-09-13T05:12:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8183000000000003e-05 2024-09-13T05:12:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160206 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 83968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.706306973, 2024-09-13T05:12:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89412730799999995, 2024-09-13T05:12:20.780 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:20.781 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:20.781 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:20.781 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:20.781 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:20.781 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160206 2024-09-13T05:12:20.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.781 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:20.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:20.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:20.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037768+0000", 2024-09-13T05:12:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037774+0000", 2024-09-13T05:12:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3600000000000001e-06 2024-09-13T05:12:20.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037786+0000", 2024-09-13T05:12:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.188e-05 2024-09-13T05:12:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037793+0000", 2024-09-13T05:12:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2749999999999998e-06 2024-09-13T05:12:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:20.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0353000000000003e-05 2024-09-13T05:12:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037862+0000", 2024-09-13T05:12:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9710000000000004e-06 2024-09-13T05:12:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931610+0000", 2024-09-13T05:12:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89374846299999999 2024-09-13T05:12:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931815+0000", 2024-09-13T05:12:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020516499999999999 2024-09-13T05:12:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931896+0000", 2024-09-13T05:12:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1157999999999998e-05 2024-09-13T05:12:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160208 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 84992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:20.785 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.706222234, 2024-09-13T05:12:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440702299999997, 2024-09-13T05:12:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160208 2024-09-13T05:12:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:20.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037853+0000", 2024-09-13T05:12:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:20.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037858+0000", 2024-09-13T05:12:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2179999999999998e-06 2024-09-13T05:12:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037867+0000", 2024-09-13T05:12:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5699999999999993e-06 2024-09-13T05:12:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037874+0000", 2024-09-13T05:12:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2810000000000003e-06 2024-09-13T05:12:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037935+0000", 2024-09-13T05:12:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1231999999999999e-05 2024-09-13T05:12:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037944+0000", 2024-09-13T05:12:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8580000000000006e-06 2024-09-13T05:12:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931956+0000", 2024-09-13T05:12:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89401158800000002 2024-09-13T05:12:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932015+0000", 2024-09-13T05:12:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8906999999999997e-05 2024-09-13T05:12:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932261+0000", 2024-09-13T05:12:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024622799999999997 2024-09-13T05:12:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.790 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160210 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 86016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.70615338, 2024-09-13T05:12:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89428998299999996, 2024-09-13T05:12:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160210 2024-09-13T05:12:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037922+0000", 2024-09-13T05:12:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:20.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037926+0000", 2024-09-13T05:12:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6550000000000003e-06 2024-09-13T05:12:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037933+0000", 2024-09-13T05:12:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5409999999999997e-06 2024-09-13T05:12:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037939+0000", 2024-09-13T05:12:20.793 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1940000000000003e-06 2024-09-13T05:12:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037976+0000", 2024-09-13T05:12:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6671000000000002e-05 2024-09-13T05:12:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037982+0000", 2024-09-13T05:12:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9669999999999998e-06 2024-09-13T05:12:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932096+0000", 2024-09-13T05:12:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89411465599999995 2024-09-13T05:12:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932149+0000", 2024-09-13T05:12:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3032999999999999e-05 2024-09-13T05:12:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932213+0000", 2024-09-13T05:12:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3165999999999998e-05 2024-09-13T05:12:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160212 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 87040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.706066259, 2024-09-13T05:12:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440379699999994, 2024-09-13T05:12:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160212 2024-09-13T05:12:20.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:20.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038009+0000", 2024-09-13T05:12:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038013+0000", 2024-09-13T05:12:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3950000000000003e-06 2024-09-13T05:12:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038032+0000", 2024-09-13T05:12:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8513999999999999e-05 2024-09-13T05:12:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038039+0000", 2024-09-13T05:12:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.985e-06 2024-09-13T05:12:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038086+0000", 2024-09-13T05:12:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7302999999999998e-05 2024-09-13T05:12:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038090+0000", 2024-09-13T05:12:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9029999999999997e-06 2024-09-13T05:12:20.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932291+0000", 2024-09-13T05:12:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89420100199999997 2024-09-13T05:12:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932352+0000", 2024-09-13T05:12:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1354999999999998e-05 2024-09-13T05:12:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:20.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932414+0000", 2024-09-13T05:12:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1037999999999994e-05 2024-09-13T05:12:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160214 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 88064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.705935193, 2024-09-13T05:12:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89438890900000001, 2024-09-13T05:12:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:20.801 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160214 2024-09-13T05:12:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038140+0000", 2024-09-13T05:12:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038145+0000", 2024-09-13T05:12:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9749999999999998e-06 2024-09-13T05:12:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038153+0000", 2024-09-13T05:12:20.803 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1280000000000008e-06 2024-09-13T05:12:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038161+0000", 2024-09-13T05:12:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0339999999999997e-06 2024-09-13T05:12:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038199+0000", 2024-09-13T05:12:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8269999999999998e-05 2024-09-13T05:12:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:20.804 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038204+0000", 2024-09-13T05:12:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5399999999999997e-06 2024-09-13T05:12:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932438+0000", 2024-09-13T05:12:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89423397999999998 2024-09-13T05:12:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932480+0000", 2024-09-13T05:12:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2392999999999999e-05 2024-09-13T05:12:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.805 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932530+0000", 2024-09-13T05:12:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:12:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160305 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 215040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.701731970999999, 2024-09-13T05:12:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89028175300000001, 2024-09-13T05:12:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160305 2024-09-13T05:12:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:20.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042343+0000", 2024-09-13T05:12:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042350+0000", 2024-09-13T05:12:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3769999999999998e-06 2024-09-13T05:12:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042367+0000", 2024-09-13T05:12:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.734e-05 2024-09-13T05:12:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042375+0000", 2024-09-13T05:12:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8469999999999996e-06 2024-09-13T05:12:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042428+0000", 2024-09-13T05:12:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3074e-05 2024-09-13T05:12:20.809 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042437+0000", 2024-09-13T05:12:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:12:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932550+0000", 2024-09-13T05:12:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89011304300000005 2024-09-13T05:12:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:20.810 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932589+0000", 2024-09-13T05:12:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9236000000000002e-05 2024-09-13T05:12:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932626+0000", 2024-09-13T05:12:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6832999999999998e-05 2024-09-13T05:12:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160307 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 216064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:20.811 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.701685531999999, 2024-09-13T05:12:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89032630800000001, 2024-09-13T05:12:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160307 2024-09-13T05:12:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:20.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:20.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042394+0000", 2024-09-13T05:12:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7900000000000001e-06 2024-09-13T05:12:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042401+0000", 2024-09-13T05:12:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.267e-06 2024-09-13T05:12:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042406+0000", 2024-09-13T05:12:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0860000000000001e-06 2024-09-13T05:12:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042465+0000", 2024-09-13T05:12:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9441000000000002e-05 2024-09-13T05:12:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042471+0000", 2024-09-13T05:12:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6640000000000003e-06 2024-09-13T05:12:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932645+0000", 2024-09-13T05:12:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89017372900000002 2024-09-13T05:12:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.815 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932681+0000", 2024-09-13T05:12:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5918999999999999e-05 2024-09-13T05:12:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932717+0000", 2024-09-13T05:12:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6007999999999998e-05 2024-09-13T05:12:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.816 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160309 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 217088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.701635273000001, 2024-09-13T05:12:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89037315900000003, 2024-09-13T05:12:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160309 2024-09-13T05:12:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:20.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042440+0000", 2024-09-13T05:12:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042444+0000", 2024-09-13T05:12:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.104e-06 2024-09-13T05:12:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042451+0000", 2024-09-13T05:12:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.922e-06 2024-09-13T05:12:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042457+0000", 2024-09-13T05:12:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3979999999999998e-06 2024-09-13T05:12:20.819 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042497+0000", 2024-09-13T05:12:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0692999999999998e-05 2024-09-13T05:12:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042503+0000", 2024-09-13T05:12:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.553e-06 2024-09-13T05:12:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.820 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932735+0000", 2024-09-13T05:12:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89023238699999996 2024-09-13T05:12:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932771+0000", 2024-09-13T05:12:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5972000000000001e-05 2024-09-13T05:12:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932814+0000", 2024-09-13T05:12:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2657000000000002e-05 2024-09-13T05:12:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:20.821 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160311 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 218112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.701609783, 2024-09-13T05:12:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89045284400000002, 2024-09-13T05:12:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160311 2024-09-13T05:12:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:20.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042469+0000", 2024-09-13T05:12:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.456e-06 2024-09-13T05:12:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042475+0000", 2024-09-13T05:12:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0990000000000004e-06 2024-09-13T05:12:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.824 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042481+0000", 2024-09-13T05:12:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.237e-06 2024-09-13T05:12:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042527+0000", 2024-09-13T05:12:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6796999999999999e-05 2024-09-13T05:12:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042533+0000", 2024-09-13T05:12:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6489999999999996e-06 2024-09-13T05:12:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932832+0000", 2024-09-13T05:12:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89029919800000001 2024-09-13T05:12:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932867+0000", 2024-09-13T05:12:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5049000000000003e-05 2024-09-13T05:12:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932919+0000", 2024-09-13T05:12:20.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1780999999999998e-05 2024-09-13T05:12:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160313 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 219136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.701580692, 2024-09-13T05:12:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89064232600000004, 2024-09-13T05:12:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:20.827 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160313 2024-09-13T05:12:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.828 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042498+0000", 2024-09-13T05:12:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.281e-06 2024-09-13T05:12:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042505+0000", 2024-09-13T05:12:20.829 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2699999999999999e-06 2024-09-13T05:12:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042512+0000", 2024-09-13T05:12:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0330000000000003e-06 2024-09-13T05:12:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042557+0000", 2024-09-13T05:12:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4425999999999998e-05 2024-09-13T05:12:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:20.830 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042562+0000", 2024-09-13T05:12:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3639999999999998e-06 2024-09-13T05:12:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932987+0000", 2024-09-13T05:12:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89042472299999997 2024-09-13T05:12:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933062+0000", 2024-09-13T05:12:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5129999999999994e-05 2024-09-13T05:12:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.831 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933138+0000", 2024-09-13T05:12:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5536000000000003e-05 2024-09-13T05:12:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160315 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 220160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.701549525000001, 2024-09-13T05:12:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89071820800000001, 2024-09-13T05:12:20.832 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160315 2024-09-13T05:12:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.833 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042529+0000", 2024-09-13T05:12:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3639999999999999e-06 2024-09-13T05:12:20.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042536+0000", 2024-09-13T05:12:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.866e-06 2024-09-13T05:12:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042541+0000", 2024-09-13T05:12:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:12:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042587+0000", 2024-09-13T05:12:20.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5735000000000002e-05 2024-09-13T05:12:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042593+0000", 2024-09-13T05:12:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0719999999999996e-06 2024-09-13T05:12:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933160+0000", 2024-09-13T05:12:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89056621000000002 2024-09-13T05:12:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:20.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933202+0000", 2024-09-13T05:12:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2376000000000002e-05 2024-09-13T05:12:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933245+0000", 2024-09-13T05:12:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2787999999999998e-05 2024-09-13T05:12:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160317 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:20.837 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.701520695999999, 2024-09-13T05:12:20.838 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89082205800000003, 2024-09-13T05:12:20.838 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:20.838 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:20.838 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:20.838 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:20.838 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:20.838 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160317 2024-09-13T05:12:20.838 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.838 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:20.838 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.838 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:20.838 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:20.838 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.838 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.839 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.839 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:20.839 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:20.839 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.839 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.839 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:20.839 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:20.839 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:20.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.839 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.839 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:20.839 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042558+0000", 2024-09-13T05:12:20.839 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1810000000000001e-06 2024-09-13T05:12:20.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.840 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:20.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042565+0000", 2024-09-13T05:12:20.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9280000000000004e-06 2024-09-13T05:12:20.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.840 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:20.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042571+0000", 2024-09-13T05:12:20.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7420000000000003e-06 2024-09-13T05:12:20.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.840 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042616+0000", 2024-09-13T05:12:20.841 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5201999999999999e-05 2024-09-13T05:12:20.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.841 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.841 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:20.841 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042622+0000", 2024-09-13T05:12:20.841 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8289999999999996e-06 2024-09-13T05:12:20.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.841 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.841 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.841 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933259+0000", 2024-09-13T05:12:20.841 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89063730799999996 2024-09-13T05:12:20.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.841 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.841 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:20.842 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933311+0000", 2024-09-13T05:12:20.842 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1910000000000003e-05 2024-09-13T05:12:20.842 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.842 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.842 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:20.842 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933377+0000", 2024-09-13T05:12:20.842 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6396999999999995e-05 2024-09-13T05:12:20.842 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.842 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:20.842 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.842 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.842 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.842 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160319 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 222208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:20.842 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:20.842 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.70149048, 2024-09-13T05:12:20.843 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89087477400000004, 2024-09-13T05:12:20.843 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:20.843 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:20.843 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:20.843 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:20.843 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:20.843 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160319 2024-09-13T05:12:20.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.843 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:20.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.843 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:20.843 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:20.843 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.844 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.844 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:20.844 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:20.844 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.844 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.844 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.844 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:20.844 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042585+0000", 2024-09-13T05:12:20.844 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:20.844 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.844 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.844 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:20.844 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042588+0000", 2024-09-13T05:12:20.844 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9450000000000002e-06 2024-09-13T05:12:20.845 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.845 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.845 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:20.845 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042594+0000", 2024-09-13T05:12:20.845 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0959999999999997e-06 2024-09-13T05:12:20.845 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.845 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.845 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:20.845 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042599+0000", 2024-09-13T05:12:20.845 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0069999999999997e-06 2024-09-13T05:12:20.845 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.845 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.845 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.845 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042642+0000", 2024-09-13T05:12:20.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2553999999999999e-05 2024-09-13T05:12:20.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:20.846 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042647+0000", 2024-09-13T05:12:20.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.31e-06 2024-09-13T05:12:20.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.846 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933387+0000", 2024-09-13T05:12:20.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89073982799999996 2024-09-13T05:12:20.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:20.847 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:12:20.847 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7101000000000003e-05 2024-09-13T05:12:20.847 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.847 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.847 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:20.847 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933460+0000", 2024-09-13T05:12:20.847 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6282999999999998e-05 2024-09-13T05:12:20.847 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.847 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:20.847 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.847 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.847 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.847 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160321 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 223232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:20.847 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:20.848 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.701461052999999, 2024-09-13T05:12:20.848 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89094616999999998, 2024-09-13T05:12:20.848 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:20.848 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:20.848 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:20.848 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:20.848 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:20.848 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160321 2024-09-13T05:12:20.848 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.848 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:20.848 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.848 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:20.848 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:20.848 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.849 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.849 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.849 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:20.849 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:20.849 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:20.849 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.849 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.849 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:20.850 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:20.850 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:20.850 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.850 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.850 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:20.850 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042617+0000", 2024-09-13T05:12:20.850 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8329999999999998e-06 2024-09-13T05:12:20.850 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.850 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.850 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:20.850 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042638+0000", 2024-09-13T05:12:20.850 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0908e-05 2024-09-13T05:12:20.850 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.850 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.851 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:20.851 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042644+0000", 2024-09-13T05:12:20.851 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0440000000000001e-06 2024-09-13T05:12:20.851 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.851 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.851 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.851 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042666+0000", 2024-09-13T05:12:20.851 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1256000000000001e-05 2024-09-13T05:12:20.851 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.851 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.851 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:20.851 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042671+0000", 2024-09-13T05:12:20.851 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6250000000000004e-06 2024-09-13T05:12:20.852 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.852 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.852 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:20.852 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933478+0000", 2024-09-13T05:12:20.852 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89080698800000002 2024-09-13T05:12:20.852 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.852 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.852 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:20.852 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933519+0000", 2024-09-13T05:12:20.852 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0717000000000003e-05 2024-09-13T05:12:20.852 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:20.852 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:20.852 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:20.852 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933561+0000", 2024-09-13T05:12:20.853 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2225999999999999e-05 2024-09-13T05:12:20.853 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.853 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:20.853 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.853 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:20.853 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:20.853 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:20.854 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:20.759+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:20.855 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:12:20.855 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:20.851+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:20.955 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:20.952+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:20.976 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:20.976 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:20.977 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:20.977 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:20.987 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:12:21.057 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:21.052+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:21.104 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:21.104 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:21.104 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:21.104 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:21.104 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:21.115 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:12:21.158 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:21.156+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:21.224 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:21.225 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:21.225 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:21.225 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:21.225 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.225 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29021 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2865152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.225 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:12:21.225 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.180575108, 2024-09-13T05:12:21.225 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060927993999999999, 2024-09-13T05:12:21.225 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.225 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:21.225 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.225 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.225 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.226 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29021 2024-09-13T05:12:21.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.226 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:12:21.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:12:21.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041763+0000", 2024-09-13T05:12:21.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041766+0000", 2024-09-13T05:12:21.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6800000000000002e-06 2024-09-13T05:12:21.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.228 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.228 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041771+0000", 2024-09-13T05:12:21.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:12:21.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.228 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.228 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041776+0000", 2024-09-13T05:12:21.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8489999999999997e-06 2024-09-13T05:12:21.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.229 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.229 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102513+0000", 2024-09-13T05:12:21.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060737102000000001 2024-09-13T05:12:21.229 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.229 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.229 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:21.229 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102597+0000", 2024-09-13T05:12:21.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4374000000000002e-05 2024-09-13T05:12:21.229 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.229 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.229 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.229 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102692+0000", 2024-09-13T05:12:21.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4436000000000002e-05 2024-09-13T05:12:21.230 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.230 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.230 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.230 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29022 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2874368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.230 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:21.230 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.180558808, 2024-09-13T05:12:21.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061135083999999999, 2024-09-13T05:12:21.230 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.230 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:21.230 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.230 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.230 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.231 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29022 2024-09-13T05:12:21.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.231 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:21.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:21.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.232 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.232 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:21.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.232 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.232 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.232 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041782+0000", 2024-09-13T05:12:21.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4959999999999999e-06 2024-09-13T05:12:21.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.232 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.232 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.232 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041787+0000", 2024-09-13T05:12:21.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1240000000000004e-06 2024-09-13T05:12:21.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041792+0000", 2024-09-13T05:12:21.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9200000000000003e-06 2024-09-13T05:12:21.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102738+0000", 2024-09-13T05:12:21.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060945581999999998 2024-09-13T05:12:21.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:21.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102821+0000", 2024-09-13T05:12:21.234 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2898999999999994e-05 2024-09-13T05:12:21.234 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.234 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.234 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.234 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102915+0000", 2024-09-13T05:12:21.234 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4523000000000003e-05 2024-09-13T05:12:21.234 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.234 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.234 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.234 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.234 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.234 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29067 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2764800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.234 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:21.234 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.176784591, 2024-09-13T05:12:21.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060816621000000001, 2024-09-13T05:12:21.235 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.235 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:21.235 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.235 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.235 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.235 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29067 2024-09-13T05:12:21.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.235 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:21.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:21.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:21.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045557+0000", 2024-09-13T05:12:21.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.898e-06 2024-09-13T05:12:21.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045575+0000", 2024-09-13T05:12:21.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8252000000000001e-05 2024-09-13T05:12:21.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045581+0000", 2024-09-13T05:12:21.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:12:21.238 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.238 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.238 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.238 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106183+0000", 2024-09-13T05:12:21.238 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060602630999999997 2024-09-13T05:12:21.238 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.238 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.238 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:21.238 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106271+0000", 2024-09-13T05:12:21.238 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7329000000000004e-05 2024-09-13T05:12:21.238 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.238 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.238 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.238 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106371+0000", 2024-09-13T05:12:21.239 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000100164 2024-09-13T05:12:21.239 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.239 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.239 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.239 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.239 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.239 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29068 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2774016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.239 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:12:21.239 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.176753357, 2024-09-13T05:12:21.239 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060994509000000002, 2024-09-13T05:12:21.239 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.239 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:21.239 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.239 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.240 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.240 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29068 2024-09-13T05:12:21.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.240 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.240 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.240 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.240 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:12:21.240 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.240 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.240 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.240 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:12:21.240 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045585+0000", 2024-09-13T05:12:21.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045588+0000", 2024-09-13T05:12:21.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:12:21.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045594+0000", 2024-09-13T05:12:21.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9329999999999998e-06 2024-09-13T05:12:21.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045599+0000", 2024-09-13T05:12:21.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3190000000000002e-06 2024-09-13T05:12:21.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106399+0000", 2024-09-13T05:12:21.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060800361999999997 2024-09-13T05:12:21.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:21.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106489+0000", 2024-09-13T05:12:21.243 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9301000000000004e-05 2024-09-13T05:12:21.243 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.243 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.243 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.243 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106580+0000", 2024-09-13T05:12:21.243 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1314e-05 2024-09-13T05:12:21.243 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.243 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.243 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.243 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.243 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.243 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29069 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2792448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.243 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:12:21.243 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.17673494, 2024-09-13T05:12:21.244 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061207599000000001, 2024-09-13T05:12:21.244 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.244 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:21.244 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.244 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.244 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.244 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29069 2024-09-13T05:12:21.244 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.244 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.244 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.244 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.244 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:12:21.244 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.244 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.245 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.245 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.245 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:12:21.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.245 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.245 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.245 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045603+0000", 2024-09-13T05:12:21.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.245 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.245 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.245 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045606+0000", 2024-09-13T05:12:21.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7300000000000001e-06 2024-09-13T05:12:21.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045612+0000", 2024-09-13T05:12:21.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9599999999999997e-06 2024-09-13T05:12:21.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045619+0000", 2024-09-13T05:12:21.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6019999999999996e-06 2024-09-13T05:12:21.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106619+0000", 2024-09-13T05:12:21.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061000029999999997 2024-09-13T05:12:21.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:21.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106713+0000", 2024-09-13T05:12:21.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4505000000000004e-05 2024-09-13T05:12:21.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106812+0000", 2024-09-13T05:12:21.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8264000000000007e-05 2024-09-13T05:12:21.247 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.247 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.247 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.248 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29070 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2783232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.248 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:21.248 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.176714481, 2024-09-13T05:12:21.248 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061389805999999998, 2024-09-13T05:12:21.248 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.248 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:21.248 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.248 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.248 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.248 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29070 2024-09-13T05:12:21.248 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.248 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.249 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.249 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:21.249 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.249 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.249 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.249 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.249 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:21.249 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.249 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.249 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.249 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.249 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:21.249 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.249 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045627+0000", 2024-09-13T05:12:21.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6579999999999998e-06 2024-09-13T05:12:21.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045632+0000", 2024-09-13T05:12:21.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8449999999999999e-06 2024-09-13T05:12:21.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045639+0000", 2024-09-13T05:12:21.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:12:21.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106837+0000", 2024-09-13T05:12:21.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061198529000000002 2024-09-13T05:12:21.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:21.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106922+0000", 2024-09-13T05:12:21.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4771999999999994e-05 2024-09-13T05:12:21.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107014+0000", 2024-09-13T05:12:21.252 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2009000000000006e-05 2024-09-13T05:12:21.252 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.252 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.252 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.252 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.252 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.252 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29071 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2801664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.252 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:12:21.252 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.176695405, 2024-09-13T05:12:21.252 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061582804999999997, 2024-09-13T05:12:21.252 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.252 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:21.252 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.252 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.253 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.253 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29071 2024-09-13T05:12:21.253 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.253 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.253 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.253 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.253 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:12:21.253 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.253 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.253 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.253 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.253 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:12:21.253 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.254 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.254 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.254 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.254 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045643+0000", 2024-09-13T05:12:21.254 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.254 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.254 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.254 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.254 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045646+0000", 2024-09-13T05:12:21.254 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:12:21.254 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.254 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.254 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.254 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045664+0000", 2024-09-13T05:12:21.255 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8408000000000001e-05 2024-09-13T05:12:21.255 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.255 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.255 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.255 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045670+0000", 2024-09-13T05:12:21.255 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7710000000000003e-06 2024-09-13T05:12:21.255 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.255 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.255 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.255 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107048+0000", 2024-09-13T05:12:21.255 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061378438 2024-09-13T05:12:21.255 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.255 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.255 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:21.256 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107134+0000", 2024-09-13T05:12:21.256 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5574000000000004e-05 2024-09-13T05:12:21.256 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.256 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.256 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.256 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107226+0000", 2024-09-13T05:12:21.256 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2262000000000005e-05 2024-09-13T05:12:21.256 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.256 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.256 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.256 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.256 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.256 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29072 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2810880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.257 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:12:21.257 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.17666402099999, 2024-09-13T05:12:21.257 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061762233999999999, 2024-09-13T05:12:21.257 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.257 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:21.257 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.257 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.257 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.257 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29072 2024-09-13T05:12:21.257 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.257 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.257 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.257 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.258 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:12:21.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.258 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.258 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.258 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.258 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:12:21.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.258 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.258 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.258 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.258 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045674+0000", 2024-09-13T05:12:21.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.258 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.258 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.259 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.259 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045677+0000", 2024-09-13T05:12:21.259 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9679999999999998e-06 2024-09-13T05:12:21.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.259 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.259 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045694+0000", 2024-09-13T05:12:21.259 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6801999999999999e-05 2024-09-13T05:12:21.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.259 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.259 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045700+0000", 2024-09-13T05:12:21.260 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8270000000000003e-06 2024-09-13T05:12:21.260 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.260 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.260 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.260 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107249+0000", 2024-09-13T05:12:21.260 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061549114000000002 2024-09-13T05:12:21.260 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.260 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.260 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:21.260 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107341+0000", 2024-09-13T05:12:21.260 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2390000000000001e-05 2024-09-13T05:12:21.260 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.260 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.260 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.261 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107437+0000", 2024-09-13T05:12:21.261 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5648000000000003e-05 2024-09-13T05:12:21.261 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.261 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.261 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.261 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.261 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29073 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2820096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.261 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:12:21.261 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.17662204299999, 2024-09-13T05:12:21.261 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061873910999999997, 2024-09-13T05:12:21.261 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.261 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:21.261 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.262 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.262 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.262 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29073 2024-09-13T05:12:21.262 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.262 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.262 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.262 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.262 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:12:21.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.262 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.262 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.262 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.262 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:12:21.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.263 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.263 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.263 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.263 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045716+0000", 2024-09-13T05:12:21.263 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.263 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.263 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.263 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.263 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045726+0000", 2024-09-13T05:12:21.263 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6350000000000001e-06 2024-09-13T05:12:21.263 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.263 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.263 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.264 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045739+0000", 2024-09-13T05:12:21.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3325e-05 2024-09-13T05:12:21.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.264 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045746+0000", 2024-09-13T05:12:21.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7399999999999998e-06 2024-09-13T05:12:21.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.264 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107457+0000", 2024-09-13T05:12:21.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061711038000000003 2024-09-13T05:12:21.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.265 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:21.265 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107522+0000", 2024-09-13T05:12:21.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4850000000000004e-05 2024-09-13T05:12:21.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.265 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.265 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107591+0000", 2024-09-13T05:12:21.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9029999999999995e-05 2024-09-13T05:12:21.265 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.265 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.265 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.266 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29074 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2829312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.266 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:12:21.266 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.176588135, 2024-09-13T05:12:21.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062055459, 2024-09-13T05:12:21.266 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.266 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:21.266 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.266 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.266 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.266 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29074 2024-09-13T05:12:21.266 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.266 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.267 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.267 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:12:21.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.267 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.267 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.267 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:12:21.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.267 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.267 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.268 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045750+0000", 2024-09-13T05:12:21.268 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.268 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.268 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.268 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.268 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045753+0000", 2024-09-13T05:12:21.268 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8399999999999999e-06 2024-09-13T05:12:21.268 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.268 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.268 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.268 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045759+0000", 2024-09-13T05:12:21.268 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8900000000000004e-06 2024-09-13T05:12:21.268 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.268 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.269 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.269 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045764+0000", 2024-09-13T05:12:21.269 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3850000000000001e-06 2024-09-13T05:12:21.269 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.269 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.269 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.269 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107623+0000", 2024-09-13T05:12:21.269 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061858817000000003 2024-09-13T05:12:21.269 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.269 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.269 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:21.269 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107710+0000", 2024-09-13T05:12:21.269 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7127999999999997e-05 2024-09-13T05:12:21.269 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.270 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.270 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.270 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107806+0000", 2024-09-13T05:12:21.270 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5886999999999999e-05 2024-09-13T05:12:21.270 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.270 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.270 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.270 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.270 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.271 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29075 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2838528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.271 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:21.271 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.176569681, 2024-09-13T05:12:21.271 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062188516999999999, 2024-09-13T05:12:21.271 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.271 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:21.271 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.271 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.271 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.271 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29075 2024-09-13T05:12:21.271 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.271 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.271 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.271 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.272 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:21.272 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.272 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.272 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.272 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.272 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:21.272 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.272 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.272 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.272 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.272 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:21.272 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.272 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.273 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.273 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.273 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045772+0000", 2024-09-13T05:12:21.273 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:12:21.273 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.273 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.273 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.273 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045778+0000", 2024-09-13T05:12:21.273 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9229999999999996e-06 2024-09-13T05:12:21.273 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.273 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.273 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.273 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045784+0000", 2024-09-13T05:12:21.273 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3800000000000002e-06 2024-09-13T05:12:21.274 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.274 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.274 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.274 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107823+0000", 2024-09-13T05:12:21.274 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062039331000000003 2024-09-13T05:12:21.274 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.274 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.274 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:21.274 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107886+0000", 2024-09-13T05:12:21.274 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2476000000000003e-05 2024-09-13T05:12:21.274 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.274 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.274 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.275 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107958+0000", 2024-09-13T05:12:21.275 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2089999999999996e-05 2024-09-13T05:12:21.275 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.275 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.275 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.275 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.275 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.275 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29115 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2682880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.275 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:12:21.275 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.173104154, 2024-09-13T05:12:21.275 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060847898999999997, 2024-09-13T05:12:21.275 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.275 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:21.275 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.276 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.276 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.276 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29115 2024-09-13T05:12:21.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.276 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.276 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.276 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.276 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:12:21.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.276 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.276 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.276 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:12:21.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.277 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.277 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.277 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.277 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049234+0000", 2024-09-13T05:12:21.277 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.277 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.277 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.277 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.277 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049237+0000", 2024-09-13T05:12:21.277 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9069999999999999e-06 2024-09-13T05:12:21.277 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.277 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.277 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.277 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049243+0000", 2024-09-13T05:12:21.278 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7459999999999997e-06 2024-09-13T05:12:21.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.278 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.278 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.278 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049248+0000", 2024-09-13T05:12:21.278 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1490000000000002e-06 2024-09-13T05:12:21.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.278 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.278 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.278 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.109945+0000", 2024-09-13T05:12:21.278 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060697299000000003 2024-09-13T05:12:21.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.278 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.278 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:21.279 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110013+0000", 2024-09-13T05:12:21.279 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8023999999999998e-05 2024-09-13T05:12:21.279 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.279 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.279 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.279 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110083+0000", 2024-09-13T05:12:21.279 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9296999999999997e-05 2024-09-13T05:12:21.279 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.279 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.279 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.279 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.279 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.279 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29116 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2692096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.279 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:12:21.279 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.17308631, 2024-09-13T05:12:21.280 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061040167999999999, 2024-09-13T05:12:21.280 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.280 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:21.280 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.280 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.280 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.280 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29116 2024-09-13T05:12:21.280 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.280 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.280 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.280 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.280 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:12:21.280 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.281 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.281 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.281 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.281 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:12:21.281 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.281 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.281 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.281 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.281 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049252+0000", 2024-09-13T05:12:21.281 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.281 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.281 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.281 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.281 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049255+0000", 2024-09-13T05:12:21.281 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7250000000000002e-06 2024-09-13T05:12:21.282 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.282 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.282 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.282 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049261+0000", 2024-09-13T05:12:21.282 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.755e-06 2024-09-13T05:12:21.282 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.282 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.282 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.282 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049266+0000", 2024-09-13T05:12:21.282 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2100000000000001e-06 2024-09-13T05:12:21.282 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.282 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.282 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.283 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110115+0000", 2024-09-13T05:12:21.283 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060849225999999999 2024-09-13T05:12:21.283 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.283 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.283 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:21.283 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110199+0000", 2024-09-13T05:12:21.283 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4339999999999995e-05 2024-09-13T05:12:21.283 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.283 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.283 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.283 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110293+0000", 2024-09-13T05:12:21.283 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3397e-05 2024-09-13T05:12:21.283 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.283 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.283 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.284 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.284 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.284 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29117 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2701312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.284 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:21.284 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.173068673, 2024-09-13T05:12:21.284 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.06118527, 2024-09-13T05:12:21.284 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.284 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:21.284 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.284 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.284 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.284 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29117 2024-09-13T05:12:21.284 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.284 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.285 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.285 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:21.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.285 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.285 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:21.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.285 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.285 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:21.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.286 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.286 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.286 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.286 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049273+0000", 2024-09-13T05:12:21.286 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.757e-06 2024-09-13T05:12:21.286 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.286 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.286 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.286 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049278+0000", 2024-09-13T05:12:21.286 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7830000000000004e-06 2024-09-13T05:12:21.286 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.286 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.286 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.286 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049284+0000", 2024-09-13T05:12:21.287 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3820000000000003e-06 2024-09-13T05:12:21.287 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.287 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.287 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.287 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110313+0000", 2024-09-13T05:12:21.287 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061029682000000002 2024-09-13T05:12:21.287 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.287 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.287 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:21.287 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110383+0000", 2024-09-13T05:12:21.287 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9406000000000006e-05 2024-09-13T05:12:21.287 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.287 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.287 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.288 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110456+0000", 2024-09-13T05:12:21.288 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2750000000000007e-05 2024-09-13T05:12:21.288 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.288 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.288 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.288 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.288 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.288 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29118 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2710528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.288 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:21.288 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.173050758, 2024-09-13T05:12:21.288 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061380698999999997, 2024-09-13T05:12:21.288 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.288 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:21.288 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.289 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.289 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.289 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29118 2024-09-13T05:12:21.289 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.289 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.289 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.289 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.289 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:21.289 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.289 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.289 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.289 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.289 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:21.289 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.290 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.290 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.290 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.290 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:21.290 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.290 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.290 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.290 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.290 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049291+0000", 2024-09-13T05:12:21.290 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8770000000000002e-06 2024-09-13T05:12:21.290 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.290 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.290 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.290 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049296+0000", 2024-09-13T05:12:21.291 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6799999999999998e-06 2024-09-13T05:12:21.291 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.291 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.291 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.291 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049302+0000", 2024-09-13T05:12:21.291 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2769999999999996e-06 2024-09-13T05:12:21.291 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.291 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.291 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.291 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110488+0000", 2024-09-13T05:12:21.291 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061186184999999997 2024-09-13T05:12:21.291 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.291 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.291 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:21.292 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110577+0000", 2024-09-13T05:12:21.292 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9246000000000006e-05 2024-09-13T05:12:21.292 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.292 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.292 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.292 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110669+0000", 2024-09-13T05:12:21.292 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1923999999999996e-05 2024-09-13T05:12:21.292 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.292 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.292 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.292 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.292 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.292 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29119 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2719744~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.293 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:12:21.293 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.173033014, 2024-09-13T05:12:21.293 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061521165000000003, 2024-09-13T05:12:21.293 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.293 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:21.293 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.293 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.293 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.293 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29119 2024-09-13T05:12:21.293 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.293 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.293 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.293 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.293 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:12:21.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.294 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.294 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.294 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.294 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:12:21.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.294 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.294 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.294 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.294 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049305+0000", 2024-09-13T05:12:21.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.294 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.294 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.295 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.295 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049308+0000", 2024-09-13T05:12:21.295 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7070000000000001e-06 2024-09-13T05:12:21.295 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.295 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.295 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.295 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049316+0000", 2024-09-13T05:12:21.295 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:12:21.295 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.295 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.295 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.295 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049322+0000", 2024-09-13T05:12:21.295 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3199999999999999e-06 2024-09-13T05:12:21.295 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.296 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.296 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.296 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110690+0000", 2024-09-13T05:12:21.296 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061368428000000003 2024-09-13T05:12:21.296 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.296 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.296 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:21.296 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110755+0000", 2024-09-13T05:12:21.296 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4893000000000004e-05 2024-09-13T05:12:21.296 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.296 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.296 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.296 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110827+0000", 2024-09-13T05:12:21.297 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2039000000000006e-05 2024-09-13T05:12:21.297 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.297 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.297 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.297 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.297 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.297 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29120 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2728960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.297 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:21.297 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.173012744, 2024-09-13T05:12:21.297 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061718420000000003, 2024-09-13T05:12:21.297 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.297 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:21.297 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.298 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.298 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.298 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29120 2024-09-13T05:12:21.298 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.298 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.298 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.298 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.298 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:21.298 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.298 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.298 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.298 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.298 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:21.299 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.299 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.299 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.299 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.299 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:21.299 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.299 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.299 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.299 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.299 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049329+0000", 2024-09-13T05:12:21.299 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.022e-06 2024-09-13T05:12:21.299 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.299 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.299 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.300 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049336+0000", 2024-09-13T05:12:21.300 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0720000000000002e-06 2024-09-13T05:12:21.300 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.300 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.300 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.300 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049341+0000", 2024-09-13T05:12:21.300 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:12:21.300 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.300 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.300 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.300 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110864+0000", 2024-09-13T05:12:21.300 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061523126999999997 2024-09-13T05:12:21.300 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.300 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.301 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:21.301 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110951+0000", 2024-09-13T05:12:21.301 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6557000000000005e-05 2024-09-13T05:12:21.301 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.301 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.301 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.301 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.111045+0000", 2024-09-13T05:12:21.301 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4043999999999996e-05 2024-09-13T05:12:21.301 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.301 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.301 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.301 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.301 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.302 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29136 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2876416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.302 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:12:21.302 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.168997319, 2024-09-13T05:12:21.302 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060742995000000001, 2024-09-13T05:12:21.302 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.302 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:21.302 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.302 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.302 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.302 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29136 2024-09-13T05:12:21.302 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.302 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.302 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.302 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.303 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:12:21.303 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.303 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.303 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.303 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.303 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:12:21.303 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.303 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.303 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.303 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.303 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053341+0000", 2024-09-13T05:12:21.303 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.303 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.303 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.303 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.304 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053344+0000", 2024-09-13T05:12:21.304 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:12:21.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.304 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.304 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.304 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053350+0000", 2024-09-13T05:12:21.304 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7200000000000003e-06 2024-09-13T05:12:21.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.304 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.304 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.304 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053355+0000", 2024-09-13T05:12:21.304 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0150000000000003e-06 2024-09-13T05:12:21.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.304 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.305 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.305 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113909+0000", 2024-09-13T05:12:21.305 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060554368999999997 2024-09-13T05:12:21.305 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.305 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.305 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:21.305 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113994+0000", 2024-09-13T05:12:21.305 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4658000000000002e-05 2024-09-13T05:12:21.305 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.305 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.305 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.305 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114085+0000", 2024-09-13T05:12:21.305 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0939000000000005e-05 2024-09-13T05:12:21.305 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.306 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.306 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.306 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.306 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.306 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29166 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2628608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.306 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:21.306 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.168979885, 2024-09-13T05:12:21.306 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060883127000000002, 2024-09-13T05:12:21.306 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.306 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:21.306 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.306 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.306 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.306 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29166 2024-09-13T05:12:21.307 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.307 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.307 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.307 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.307 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:21.307 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.307 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.307 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.307 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.307 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:21.307 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.307 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.307 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.307 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.308 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:21.308 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.308 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.308 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.308 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.308 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053361+0000", 2024-09-13T05:12:21.308 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:12:21.308 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.308 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.308 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.308 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053367+0000", 2024-09-13T05:12:21.308 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7350000000000001e-06 2024-09-13T05:12:21.308 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.308 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.309 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.309 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053372+0000", 2024-09-13T05:12:21.309 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7840000000000003e-06 2024-09-13T05:12:21.309 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.309 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.309 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.309 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114103+0000", 2024-09-13T05:12:21.309 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060730924999999998 2024-09-13T05:12:21.309 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.309 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.309 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:21.309 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114171+0000", 2024-09-13T05:12:21.309 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8021999999999993e-05 2024-09-13T05:12:21.309 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.310 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.310 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.310 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114242+0000", 2024-09-13T05:12:21.310 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1390999999999995e-05 2024-09-13T05:12:21.310 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.310 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.310 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.310 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.310 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.310 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:165308 3.3 3:c04a6a9a:::rbd_data.112dc3abcba6.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-13T05:12:21.310 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:12:21.310 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.0905225989999998, 2024-09-13T05:12:21.310 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.085530595000000001, 2024-09-13T05:12:21.310 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.311 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:21.311 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.311 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.311 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.311 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 165308 2024-09-13T05:12:21.311 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.311 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.311 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.311 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.311 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:12:21.311 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.311 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.311 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.311 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.312 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:12:21.312 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.312 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.312 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.312 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.312 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131814+0000", 2024-09-13T05:12:21.312 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:21.312 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.312 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.312 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.312 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152479+0000", 2024-09-13T05:12:21.312 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020664281 2024-09-13T05:12:21.312 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.312 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.313 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.313 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152521+0000", 2024-09-13T05:12:21.313 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2567000000000001e-05 2024-09-13T05:12:21.313 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.313 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.313 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.313 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152536+0000", 2024-09-13T05:12:21.313 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4447000000000001e-05 2024-09-13T05:12:21.313 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.313 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.313 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.313 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152607+0000", 2024-09-13T05:12:21.313 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1687000000000007e-05 2024-09-13T05:12:21.313 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.314 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.314 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:21.314 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152753+0000", 2024-09-13T05:12:21.314 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000145861 2024-09-13T05:12:21.314 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.314 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.314 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:12:21.314 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.159991+0000", 2024-09-13T05:12:21.314 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0072373100000000003 2024-09-13T05:12:21.314 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.314 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.314 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:12:21.314 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.208492+0000", 2024-09-13T05:12:21.314 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048501003000000001 2024-09-13T05:12:21.315 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.315 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.315 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:21.315 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217224+0000", 2024-09-13T05:12:21.315 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0087320369999999998 2024-09-13T05:12:21.315 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.315 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.315 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:21.315 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217277+0000", 2024-09-13T05:12:21.315 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3841000000000002e-05 2024-09-13T05:12:21.315 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.315 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.315 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.315 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217347+0000", 2024-09-13T05:12:21.315 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9529999999999993e-05 2024-09-13T05:12:21.316 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.316 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.316 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.316 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.316 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.316 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:21.317 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:12:21.318 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:21.315+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:21.418 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:21.416+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:21.442 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:21.442 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:21.442 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:21.442 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:21.453 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:12:21.520 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:21.515+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:21.569 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:21.569 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:21.569 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:21.569 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:21.569 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:21.579 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:12:21.621 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:21.616+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:21.621 INFO:teuthology.orchestra.run.smithi120.stdout:5143 write 0x3230c19 thru 0x323a7f4 (0x9bdc bytes) 2024-09-13T05:12:21.632 INFO:teuthology.orchestra.run.smithi120.stdout:5146 trunc from 0xb20df9e to 0xe4cad30 2024-09-13T05:12:21.655 INFO:teuthology.orchestra.run.smithi120.stdout:5147 trunc from 0xe4cad30 to 0x859a983 2024-09-13T05:12:21.690 INFO:teuthology.orchestra.run.smithi120.stdout:5148 write 0xa63a422 thru 0xa63a61a (0x1f9 bytes) 2024-09-13T05:12:21.692 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:21.693 INFO:teuthology.orchestra.run.smithi120.stdout:5154 write 0x8f72786 thru 0x8f7fd1b (0xd596 bytes) 2024-09-13T05:12:21.695 INFO:teuthology.orchestra.run.smithi120.stdout:5155 write 0x3a1c5f1 thru 0x3a28d92 (0xc7a2 bytes) 2024-09-13T05:12:21.699 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:21.699 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:21.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:21.699 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:21.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.699 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.699 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:21.700 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.83242562700001, 2024-09-13T05:12:21.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:12:21.700 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.700 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:21.700 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.700 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.700 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.700 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:12:21.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.700 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:21.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:21.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:21.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:21.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.702 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.702 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:12:21.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:12:21.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.702 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.702 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:12:21.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:12:21.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:12:21.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:12:21.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:12:21.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:12:21.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:21.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:12:21.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:12:21.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:12:21.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:12:21.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:21.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:12:21.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:12:21.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:12:21.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:12:21.705 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.705 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.705 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.705 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.705 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:21.705 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.832401191, 2024-09-13T05:12:21.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:12:21.705 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.705 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:21.705 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.706 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.706 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.706 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:12:21.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.706 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.706 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:21.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.706 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:21.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:21.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:21.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:12:21.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:12:21.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:12:21.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:12:21.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:12:21.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:12:21.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:12:21.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:12:21.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.709 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:21.709 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:12:21.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:12:21.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.709 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.709 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:12:21.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:12:21.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.709 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:21.709 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:12:21.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:12:21.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:12:21.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:12:21.710 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.710 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.710 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.710 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.710 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:21.710 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.83239136500001, 2024-09-13T05:12:21.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:12:21.711 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.711 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:21.711 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.711 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.711 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.711 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:12:21.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.711 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.711 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.711 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:21.711 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.712 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.712 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.712 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:21.712 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.712 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.712 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.712 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:21.712 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:21.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.712 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.712 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:12:21.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:12:21.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:12:21.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:12:21.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:12:21.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:12:21.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.714 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:12:21.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:12:21.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:21.714 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:12:21.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:12:21.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.714 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:12:21.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:12:21.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.715 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:12:21.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:12:21.715 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.715 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.715 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.715 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.715 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:21.715 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.83238312899999, 2024-09-13T05:12:21.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:12:21.716 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.716 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:21.716 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.716 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.716 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.716 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:12:21.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.716 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.716 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.716 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.716 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:21.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.717 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.717 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:21.717 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.717 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.717 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:21.717 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:21.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.718 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.718 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:12:21.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:12:21.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.718 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.718 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:12:21.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:12:21.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.718 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.718 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:12:21.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:12:21.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.719 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.719 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.719 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:12:21.719 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:12:21.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.719 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.719 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:21.719 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:12:21.719 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:12:21.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.719 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.719 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.720 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:12:21.720 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:12:21.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.720 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.720 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.720 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:12:21.720 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:12:21.720 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.720 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.720 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.720 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.720 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.721 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:21.721 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.832361217, 2024-09-13T05:12:21.721 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:12:21.721 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.721 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:21.721 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.721 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.721 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.721 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:12:21.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.721 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.721 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.721 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:21.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:21.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:21.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:21.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.723 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.723 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:12:21.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:12:21.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.723 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.723 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:12:21.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:12:21.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.723 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.723 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:12:21.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:12:21.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:12:21.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:12:21.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:21.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:12:21.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:12:21.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:12:21.725 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:12:21.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.725 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.725 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:12:21.725 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:12:21.725 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.725 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.725 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.725 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.725 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:21.726 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.832352613, 2024-09-13T05:12:21.726 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:12:21.726 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.726 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:21.726 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.726 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.726 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.726 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:12:21.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.726 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.726 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.726 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.726 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:21.726 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.727 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.727 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:21.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.727 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.727 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:21.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:21.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.727 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.727 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:12:21.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:12:21.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:12:21.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:12:21.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:12:21.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:12:21.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:12:21.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:12:21.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:21.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:12:21.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:12:21.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:12:21.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:12:21.730 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.730 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.730 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.730 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:12:21.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:12:21.730 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.730 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.730 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.730 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.730 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.730 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.730 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:21.731 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.832342919, 2024-09-13T05:12:21.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:12:21.731 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.731 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:21.731 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.731 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.731 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.731 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:12:21.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.731 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:21.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.732 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:21.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.733 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:21.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:21.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.733 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.733 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:12:21.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:12:21.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.733 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.733 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:12:21.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:12:21.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:12:21.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:12:21.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:12:21.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:12:21.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:21.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:12:21.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:12:21.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:12:21.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:12:21.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:12:21.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:12:21.735 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.735 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.736 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.736 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.736 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:21.736 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.832333804, 2024-09-13T05:12:21.736 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:12:21.736 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.736 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:21.736 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.736 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.736 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.736 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:12:21.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.737 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:21.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:21.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:21.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:21.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:12:21.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:12:21.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:12:21.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:12:21.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:12:21.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:12:21.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:12:21.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:12:21.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:21.740 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:12:21.740 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:12:21.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.740 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.740 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:12:21.740 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:12:21.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.740 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.740 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:12:21.740 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:12:21.740 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.741 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.741 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.741 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.741 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:12:21.741 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.832325325, 2024-09-13T05:12:21.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:12:21.741 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.741 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:21.741 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.741 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.741 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.742 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:12:21.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.742 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:12:21.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:12:21.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:12:21.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:12:21.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:12:21.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:12:21.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:12:21.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.744 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:12:21.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:12:21.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.744 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:12:21.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:12:21.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.744 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:21.745 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:12:21.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:12:21.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.745 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.745 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.745 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:12:21.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:12:21.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.745 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.745 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.745 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:12:21.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:12:21.745 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.746 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.746 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.746 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.746 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:12:21.746 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.8323134, 2024-09-13T05:12:21.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:12:21.746 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.746 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:21.746 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.746 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.746 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.747 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:12:21.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.747 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:12:21.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:12:21.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:12:21.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:21.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:12:21.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:12:21.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:12:21.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:12:21.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:12:21.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:12:21.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:12:21.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:12:21.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:21.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:12:21.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:12:21.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:12:21.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:12:21.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:12:21.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:12:21.750 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.751 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.751 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.751 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.751 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:21.751 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.832291811, 2024-09-13T05:12:21.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:12:21.751 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.751 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:21.751 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.751 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.751 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.752 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:12:21.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.752 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:21.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:21.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:21.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:12:21.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:12:21.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:12:21.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:12:21.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:12:21.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:12:21.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:12:21.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:12:21.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:21.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:12:21.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:12:21.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:12:21.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:12:21.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:12:21.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:12:21.755 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.755 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.756 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.756 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.756 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:21.756 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.832268683, 2024-09-13T05:12:21.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:12:21.756 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.756 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:21.756 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.756 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.756 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.757 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:12:21.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.757 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:21.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:21.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:21.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:12:21.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:12:21.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:12:21.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:12:21.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:12:21.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:12:21.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:12:21.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:12:21.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:21.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:12:21.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:12:21.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:12:21.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:12:21.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:12:21.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:12:21.761 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.761 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.761 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.761 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.761 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:12:21.761 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.83225331, 2024-09-13T05:12:21.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:12:21.761 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.761 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:21.761 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.761 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.762 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.762 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:12:21.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.762 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:12:21.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:12:21.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.763 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.763 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:12:21.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.763 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.763 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:12:21.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:12:21.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.763 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.763 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:12:21.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:12:21.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:12:21.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:12:21.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:12:21.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:12:21.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:21.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:12:21.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:12:21.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:12:21.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:12:21.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:12:21.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:12:21.765 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.766 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.766 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.766 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.766 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:21.766 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.832232842, 2024-09-13T05:12:21.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:12:21.766 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.766 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:21.766 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.766 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.766 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.767 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:12:21.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.767 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:21.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:21.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:21.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:12:21.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:12:21.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:12:21.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:12:21.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.769 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.769 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:12:21.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:12:21.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.769 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.769 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:12:21.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:12:21.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:21.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:12:21.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:12:21.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:12:21.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:12:21.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:12:21.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:12:21.770 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.771 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.771 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.771 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.771 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:21.771 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.83221618100001, 2024-09-13T05:12:21.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:12:21.771 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.771 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:21.771 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.771 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.771 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.771 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:12:21.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.772 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:21.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:21.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:21.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:12:21.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:12:21.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:12:21.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:12:21.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:12:21.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:12:21.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:12:21.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:12:21.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:21.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:12:21.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:12:21.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:12:21.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:12:21.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:12:21.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:12:21.776 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.776 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.776 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.777 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.777 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:12:21.777 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.832189468, 2024-09-13T05:12:21.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:12:21.777 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.777 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:21.777 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.777 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.777 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.777 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:12:21.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.777 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:12:21.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:12:21.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:12:21.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:12:21.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:12:21.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:12:21.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:12:21.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:12:21.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:12:21.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:12:21.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:12:21.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:21.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:12:21.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:12:21.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:12:21.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:12:21.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:12:21.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:12:21.781 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.781 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.781 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.782 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.782 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:21.782 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.832170616, 2024-09-13T05:12:21.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:12:21.782 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.782 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:21.782 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.782 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.782 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.782 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:12:21.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.782 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:21.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:21.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:21.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:12:21.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:12:21.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:12:21.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:12:21.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:12:21.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:12:21.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:12:21.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:12:21.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:21.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:12:21.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:12:21.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.786 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.786 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:12:21.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:12:21.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.786 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.786 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:12:21.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:12:21.786 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.787 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.787 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.787 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.787 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:21.787 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.83215283, 2024-09-13T05:12:21.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:12:21.787 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.787 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:21.787 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.787 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.787 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.788 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:12:21.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.788 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:21.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:21.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:21.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:12:21.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:12:21.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:12:21.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:12:21.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:12:21.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:12:21.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:12:21.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:12:21.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:21.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:12:21.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:12:21.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:12:21.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:12:21.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:12:21.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:12:21.792 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.792 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.792 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.792 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.792 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:21.792 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.83211777, 2024-09-13T05:12:21.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:12:21.792 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.792 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:21.792 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.792 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.793 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.793 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:12:21.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.793 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.793 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:21.793 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.793 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:21.793 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:21.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:12:21.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:12:21.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:12:21.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:12:21.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:12:21.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:12:21.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:12:21.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:12:21.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:21.796 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:12:21.796 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:12:21.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.796 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:12:21.796 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:12:21.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.796 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:12:21.796 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:12:21.797 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.797 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.797 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.797 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:21.797 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:21.797 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 104.832100955, 2024-09-13T05:12:21.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:12:21.797 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:21.797 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:21.797 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:21.797 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:21.797 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:21.798 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:12:21.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.798 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:21.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.798 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:21.798 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:21.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.799 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:21.799 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:21.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:21.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.799 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.799 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:21.799 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:21.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:21.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.799 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.799 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:21.799 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:12:21.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:12:21.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:21.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:12:21.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:12:21.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:21.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:12:21.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:12:21.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.801 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:12:21.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:12:21.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:21.801 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:12:21.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:12:21.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:21.801 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:12:21.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:12:21.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:21.802 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:21.802 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:21.802 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:12:21.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:12:21.802 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.802 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.802 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.802 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:21.802 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:21.802 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:21.804 INFO:teuthology.orchestra.run.smithi120.stdout:5156 writesame 0x8601785 thru 0x86041ef data_size 0x1(0x2a6b bytes) 2024-09-13T05:12:21.804 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:21.804 INFO:teuthology.orchestra.run.smithi120.stdout:5158 read 0x6373222 thru 0x637a80b (0x75ea bytes) 2024-09-13T05:12:21.804 INFO:teuthology.orchestra.run.smithi120.stdout:5159 punch from 0x2452f4f to 0x24600af, (0xd160 bytes) 2024-09-13T05:12:21.804 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:21.804 INFO:teuthology.orchestra.run.smithi120.stdout:5161 write 0x9e6b100 thru 0x9e77c6b (0xcb6c bytes) 2024-09-13T05:12:21.805 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:12:21.806 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is set 2024-09-13T05:12:21.806 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:21.799+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:21.904 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:21.899+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:21.966 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:21.966 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:21.966 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:21.966 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:21.977 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:12:22.026 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:22.023+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:22.091 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:22.091 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:22.091 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:22.091 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:22.091 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:22.102 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:12:22.106 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:22.103+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:22.208 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:22.203+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:22.221 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:22.221 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:22.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:22.221 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [] 2024-09-13T05:12:22.221 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:22.235 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:12:22.298 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:12:22.308 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:22.304+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:22.406 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:170261 3.3 3.57a4a123 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e129)", 2024-09-13T05:12:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:21.726936+0000", 2024-09-13T05:12:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.67888702199999995, 2024-09-13T05:12:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.67892077399999995, 2024-09-13T05:12:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-09-13T05:12:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 170261 2024-09-13T05:12:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.726936+0000", 2024-09-13T05:12:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.726936+0000", 2024-09-13T05:12:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.726934+0000", 2024-09-13T05:12:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.726944+0000", 2024-09-13T05:12:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0305e-05 2024-09-13T05:12:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.726960+0000", 2024-09-13T05:12:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5790999999999998e-05 2024-09-13T05:12:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.726968+0000", 2024-09-13T05:12:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5439999999999999e-06 2024-09-13T05:12:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.727019+0000", 2024-09-13T05:12:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0569999999999999e-05 2024-09-13T05:12:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.727027+0000", 2024-09-13T05:12:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4810000000000006e-06 2024-09-13T05:12:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:12:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 1 2024-09-13T05:12:22.414 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:22.416 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:22.412+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:22.417 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:12:22.447 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:12:22.467 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:22.489 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:22.508 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:22.521 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:22.522 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:22.529 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:22.524+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:22.532 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:22.535 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:12:22.556 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:22.582 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:22.611 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:22.613 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:12:22.613 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:22.613 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:22.613 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:22.613 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:22.613 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:22.613 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:22.613 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:22.623 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:22.615+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:22.679 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:22.679 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:22.686 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:12:22.741 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:22.715+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:22.817 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:22.817 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:22.818 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:22.816+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:22.823 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:12:22.919 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:22.916+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:22.929 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:22.929 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:22.939 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:12:23.020 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:23.015+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:23.045 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:23.045 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:23.054 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:12:23.121 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:23.116+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:23.164 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:23.164 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:23.174 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:12:23.222 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:23.219+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:23.279 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:23.279 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:23.288 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:12:23.322 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:23.320+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:23.423 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:23.420+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:23.442 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:23.442 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:23.454 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:12:23.524 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:23.520+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:23.569 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:23.569 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:23.579 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:12:23.625 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:23.623+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:23.688 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:23.688 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:23.697 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:12:23.702 INFO:tasks.thrashosds.thrasher:in_osds: [2, 3, 5, 7, 1] out_osds: [4, 0, 6] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-13T05:12:23.702 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:12:23.702 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-13T05:12:23.702 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-13T05:12:23.726 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:23.724+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:23.739 INFO:teuthology.orchestra.run.smithi120.stdout:5162 write 0xd91a036 thru 0xd91dfc7 (0x3f92 bytes) 2024-09-13T05:12:23.741 INFO:teuthology.orchestra.run.smithi120.stdout:5163 write 0x2c9a510 thru 0x2c9de4c (0x393d bytes) 2024-09-13T05:12:23.757 INFO:teuthology.orchestra.run.smithi120.stdout:5165 trunc from 0xd91dfc8 to 0x674cb4c 2024-09-13T05:12:23.771 INFO:teuthology.orchestra.run.smithi120.stdout:5166 write 0x12e6bcd thru 0x12eb847 (0x4c7b bytes) 2024-09-13T05:12:23.773 INFO:teuthology.orchestra.run.smithi120.stdout:5167 write 0x6510499 thru 0x651b4f3 (0xb05b bytes) 2024-09-13T05:12:23.775 INFO:teuthology.orchestra.run.smithi120.stdout:5168 punch from 0x2a29340 to 0x2a336f1, (0xa3b1 bytes) 2024-09-13T05:12:23.786 INFO:teuthology.orchestra.run.smithi120.stdout:5169 write 0x85b668a thru 0x85bfb81 (0x94f8 bytes) 2024-09-13T05:12:23.789 INFO:teuthology.orchestra.run.smithi120.stdout:5170 read 0x33fcbc1 thru 0x340b27b (0xe6bb bytes) 2024-09-13T05:12:23.790 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:23.790 INFO:teuthology.orchestra.run.smithi120.stdout:5172 punch from 0x7dfd9c4 to 0x7e09211, (0xb84d bytes) 2024-09-13T05:12:23.790 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:23.790 INFO:teuthology.orchestra.run.smithi120.stdout:5174 writesame 0x71f62e2 thru 0x71ff547 data_size 0x7(0x9266 bytes) 2024-09-13T05:12:23.794 INFO:teuthology.orchestra.run.smithi120.stdout:5175 read 0x6e1effc thru 0x6e239a0 (0x49a5 bytes) 2024-09-13T05:12:23.806 INFO:teuthology.orchestra.run.smithi120.stdout:5176 write 0x8b22337 thru 0x8b26617 (0x42e1 bytes) 2024-09-13T05:12:23.807 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T05:12:23.811 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:23.811 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:23.818 INFO:teuthology.orchestra.run.smithi120.stdout:5177 trunc from 0x8b26618 to 0x38e00e6 2024-09-13T05:12:23.820 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:12:23.826 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:23.823+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:23.836 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:23.837 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:23.837 INFO:teuthology.orchestra.run.smithi120.stdout:5181 read 0x333fd50 thru 0x334e23d (0xe4ee bytes) 2024-09-13T05:12:23.837 INFO:teuthology.orchestra.run.smithi120.stdout:5185 read 0x9317e4 thru 0x93ae36 (0x9653 bytes) 2024-09-13T05:12:23.838 INFO:teuthology.orchestra.run.smithi120.stdout:5187 read 0x2a0e8b8 thru 0x2a1242c (0x3b75 bytes) 2024-09-13T05:12:23.839 INFO:teuthology.orchestra.run.smithi120.stdout:5188 read 0x4f0c64 thru 0x4f0e1a (0x1b7 bytes) 2024-09-13T05:12:23.839 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:23.845 INFO:teuthology.orchestra.run.smithi120.stdout:5190 trunc from 0x38e00e6 to 0x18df0a 2024-09-13T05:12:23.863 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:23.863 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:23.863 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:23.863 INFO:teuthology.orchestra.run.smithi120.stdout:5194 read 0x12ce12 thru 0x12fff7 (0x31e6 bytes) 2024-09-13T05:12:23.877 INFO:teuthology.orchestra.run.smithi120.stdout:5197 writesame 0x432cf87 thru 0x4332572 data_size 0x4e(0x55ec bytes) 2024-09-13T05:12:23.891 INFO:teuthology.orchestra.run.smithi120.stdout:5198 write 0x68b2410 thru 0x68b41a9 (0x1d9a bytes) 2024-09-13T05:12:23.900 INFO:teuthology.orchestra.run.smithi120.stdout:5199 trunc from 0x68b41aa to 0x9f2d96d 2024-09-13T05:12:23.918 INFO:teuthology.orchestra.run.smithi120.stdout:5200 trunc from 0x9f2d96d to 0x3d98282 2024-09-13T05:12:23.927 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:23.924+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:23.957 INFO:teuthology.orchestra.run.smithi120.stdout:5201 writesame 0xe2d5b1e thru 0xe2e52ed data_size 0xd0(0xf7d0 bytes) 2024-09-13T05:12:23.964 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:23.965 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:23.975 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:12:23.979 INFO:teuthology.orchestra.run.smithi120.stdout:5202 trunc from 0xe2e52ee to 0x61c398 2024-09-13T05:12:23.994 INFO:teuthology.orchestra.run.smithi120.stdout:5204 read 0x3fe417 thru 0x4085d5 (0xa1bf bytes) 2024-09-13T05:12:24.011 INFO:teuthology.orchestra.run.smithi120.stdout:5205 trunc from 0x61c398 to 0xb63ecf5 2024-09-13T05:12:24.018 INFO:teuthology.orchestra.run.smithi120.stdout:5206 read 0x991035f thru 0x991e859 (0xe4fb bytes) 2024-09-13T05:12:24.018 INFO:teuthology.orchestra.run.smithi120.stdout:5209 write 0x64f14e2 thru 0x64f7ac5 (0x65e4 bytes) 2024-09-13T05:12:24.021 INFO:teuthology.orchestra.run.smithi120.stdout:5210 read 0x1a252a8 thru 0x1a31f00 (0xcc59 bytes) 2024-09-13T05:12:24.021 INFO:teuthology.orchestra.run.smithi120.stdout:5213 writesame 0x595f2d9 thru 0x59658d4 data_size 0x3d(0x65fc bytes) 2024-09-13T05:12:24.025 INFO:teuthology.orchestra.run.smithi120.stdout:5214 read 0x4b57855 thru 0x4b584b6 (0xc62 bytes) 2024-09-13T05:12:24.026 INFO:teuthology.orchestra.run.smithi120.stdout:5215 punch from 0x1515f83 to 0x151a4f6, (0x4573 bytes) 2024-09-13T05:12:24.026 INFO:teuthology.orchestra.run.smithi120.stdout:5216 read 0x86f2660 thru 0x86fc77d (0xa11e bytes) 2024-09-13T05:12:24.026 INFO:teuthology.orchestra.run.smithi120.stdout:5217 read 0xa0df697 thru 0xa0e697c (0x72e6 bytes) 2024-09-13T05:12:24.027 INFO:teuthology.orchestra.run.smithi120.stdout:5218 write 0xa190dd4 thru 0xa191b72 (0xd9f bytes) 2024-09-13T05:12:24.027 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:24.023+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:24.029 INFO:teuthology.orchestra.run.smithi120.stdout:5222 read 0x37555cc thru 0x375c278 (0x6cad bytes) 2024-09-13T05:12:24.030 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:24.030 INFO:teuthology.orchestra.run.smithi120.stdout:5225 punch from 0x94b28bd to 0x94b9a0a, (0x714d bytes) 2024-09-13T05:12:24.030 INFO:teuthology.orchestra.run.smithi120.stdout:5226 punch from 0x21c8e97 to 0x21d6c00, (0xdd69 bytes) 2024-09-13T05:12:24.034 INFO:teuthology.orchestra.run.smithi120.stdout:5227 trunc from 0xb63ecf5 to 0xd92b260 2024-09-13T05:12:24.050 INFO:teuthology.orchestra.run.smithi120.stdout:5228 trunc from 0xd92b260 to 0x99ce15d 2024-09-13T05:12:24.063 INFO:teuthology.orchestra.run.smithi120.stdout:5229 write 0x71d23c3 thru 0x71dbf5d (0x9b9b bytes) 2024-09-13T05:12:24.065 INFO:teuthology.orchestra.run.smithi120.stdout:5230 punch from 0x2a81fc2 to 0x2a89045, (0x7083 bytes) 2024-09-13T05:12:24.065 INFO:teuthology.orchestra.run.smithi120.stdout:5231 read 0x45f36c0 thru 0x45f5098 (0x19d9 bytes) 2024-09-13T05:12:24.066 INFO:teuthology.orchestra.run.smithi120.stdout:5234 trunc from 0x99ce15d to 0x8e6bc11 2024-09-13T05:12:24.078 INFO:teuthology.orchestra.run.smithi120.stdout:5235 punch from 0x69ed5e5 to 0x69f4592, (0x6fad bytes) 2024-09-13T05:12:24.078 INFO:teuthology.orchestra.run.smithi120.stdout:5236 writesame 0x28860e2 thru 0x288c96d data_size 0x2(0x688c bytes) 2024-09-13T05:12:24.082 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:24.082 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:24.090 INFO:teuthology.orchestra.run.smithi120.stdout:5237 punch from 0x38658e9 to 0x386a630, (0x4d47 bytes) 2024-09-13T05:12:24.091 INFO:teuthology.orchestra.run.smithi120.stdout:5238 read 0x493f65d thru 0x494a30c (0xacb0 bytes) 2024-09-13T05:12:24.091 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:24.091 INFO:teuthology.orchestra.run.smithi120.stdout:5240 punch from 0x15134e to 0x1527d7, (0x1489 bytes) 2024-09-13T05:12:24.091 INFO:teuthology.orchestra.run.smithi120.stdout:5242 read 0x86b8ec5 thru 0x86b8f67 (0xa3 bytes) 2024-09-13T05:12:24.091 INFO:teuthology.orchestra.run.smithi120.stdout:5244 writesame 0x6591511 thru 0x659c846 data_size 0x71(0xb336 bytes) 2024-09-13T05:12:24.093 INFO:teuthology.orchestra.run.smithi120.stdout:5245 read 0x290ba96 thru 0x2918e44 (0xd3af bytes) 2024-09-13T05:12:24.094 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:12:24.095 INFO:teuthology.orchestra.run.smithi120.stdout:5246 read 0x39ba539 thru 0x39c890e (0xe3d6 bytes) 2024-09-13T05:12:24.095 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:12:24.096 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: "epoch": 131, 2024-09-13T05:12:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: "fsid": "0a3759da-62bd-4704-8a4a-7c20eb3fc816", 2024-09-13T05:12:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: "created": "2024-09-13T05:09:38.849186+0000", 2024-09-13T05:12:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: "modified": "2024-09-13T05:12:23.718792+0000", 2024-09-13T05:12:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: "last_up_change": "2024-09-13T05:12:13.640614+0000", 2024-09-13T05:12:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: "last_in_change": "2024-09-13T05:12:18.671581+0000", 2024-09-13T05:12:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T05:12:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_num": 5801984, 2024-09-13T05:12:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_set": [ 2024-09-13T05:12:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: "noscrub", 2024-09-13T05:12:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: "pglog_hardlimit", 2024-09-13T05:12:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: "purged_snapdirs", 2024-09-13T05:12:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: "recovery_deletes", 2024-09-13T05:12:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: "sortbitwise" 2024-09-13T05:12:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:12:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_version": 5, 2024-09-13T05:12:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: "full_ratio": 0.94999998807907104, 2024-09-13T05:12:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-13T05:12:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-13T05:12:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_snapshot": "", 2024-09-13T05:12:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_max": 3, 2024-09-13T05:12:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: "max_osd": 8, 2024-09-13T05:12:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: "require_min_compat_client": "luminous", 2024-09-13T05:12:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: "min_compat_client": "luminous", 2024-09-13T05:12:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: "require_osd_release": "reef", 2024-09-13T05:12:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: "allow_crimson": false, 2024-09-13T05:12:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: "pools": [ 2024-09-13T05:12:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: "pool": 1, 2024-09-13T05:12:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": ".mgr", 2024-09-13T05:12:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: "create_time": "2024-09-13T05:09:52.225455+0000", 2024-09-13T05:12:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-13T05:12:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_names": "hashpspool", 2024-09-13T05:12:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: "type": 1, 2024-09-13T05:12:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 2, 2024-09-13T05:12:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": 1, 2024-09-13T05:12:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_rule": 0, 2024-09-13T05:12:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_count": 0, 2024-09-13T05:12:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_target": 0, 2024-09-13T05:12:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T05:12:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T05:12:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: "object_hash": 2, 2024-09-13T05:12:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscale_mode": "off", 2024-09-13T05:12:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": 1, 2024-09-13T05:12:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num": 1, 2024-09-13T05:12:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num_target": 1, 2024-09-13T05:12:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_target": 1, 2024-09-13T05:12:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_pending": 1, 2024-09-13T05:12:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: "last_pg_merge_meta": { 2024-09-13T05:12:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: "source_pgid": "0.0", 2024-09-13T05:12:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: "ready_epoch": 0, 2024-09-13T05:12:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_started": 0, 2024-09-13T05:12:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_clean": 0, 2024-09-13T05:12:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: "source_version": "0'0", 2024-09-13T05:12:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: "target_version": "0'0" 2024-09-13T05:12:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: "last_change": "16", 2024-09-13T05:12:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend": "0", 2024-09-13T05:12:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T05:12:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T05:12:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: "auid": 0, 2024-09-13T05:12:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_mode": "selfmanaged", 2024-09-13T05:12:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_seq": 0, 2024-09-13T05:12:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_epoch": 0, 2024-09-13T05:12:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_snaps": [], 2024-09-13T05:12:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: "removed_snaps": "[]", 2024-09-13T05:12:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_bytes": 0, 2024-09-13T05:12:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_objects": 0, 2024-09-13T05:12:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: "tiers": [], 2024-09-13T05:12:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: "tier_of": -1, 2024-09-13T05:12:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: "read_tier": -1, 2024-09-13T05:12:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: "write_tier": -1, 2024-09-13T05:12:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_mode": "none", 2024-09-13T05:12:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_bytes": 0, 2024-09-13T05:12:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_objects": 0, 2024-09-13T05:12:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T05:12:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T05:12:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T05:12:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_flush_age": 0, 2024-09-13T05:12:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_evict_age": 0, 2024-09-13T05:12:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_profile": "", 2024-09-13T05:12:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_params": { 2024-09-13T05:12:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "none" 2024-09-13T05:12:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_period": 0, 2024-09-13T05:12:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_count": 0, 2024-09-13T05:12:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: "use_gmt_hitset": true, 2024-09-13T05:12:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: "min_read_recency_for_promote": 0, 2024-09-13T05:12:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: "min_write_recency_for_promote": 0, 2024-09-13T05:12:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T05:12:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_search_last_n": 0, 2024-09-13T05:12:24.103 INFO:teuthology.orchestra.run.smithi120.stdout: "grade_table": [], 2024-09-13T05:12:24.103 INFO:teuthology.orchestra.run.smithi120.stdout: "stripe_width": 0, 2024-09-13T05:12:24.103 INFO:teuthology.orchestra.run.smithi120.stdout: "expected_num_objects": 0, 2024-09-13T05:12:24.103 INFO:teuthology.orchestra.run.smithi120.stdout: "fast_read": false, 2024-09-13T05:12:24.104 INFO:teuthology.orchestra.run.smithi120.stdout: "options": { 2024-09-13T05:12:24.104 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_max": 32, 2024-09-13T05:12:24.104 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_min": 1 2024-09-13T05:12:24.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.104 INFO:teuthology.orchestra.run.smithi120.stdout: "application_metadata": { 2024-09-13T05:12:24.105 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": {} 2024-09-13T05:12:24.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.105 INFO:teuthology.orchestra.run.smithi120.stdout: "read_balance": { 2024-09-13T05:12:24.105 INFO:teuthology.orchestra.run.smithi120.stdout: "score_acting": 8, 2024-09-13T05:12:24.105 INFO:teuthology.orchestra.run.smithi120.stdout: "score_stable": 8, 2024-09-13T05:12:24.106 INFO:teuthology.orchestra.run.smithi120.stdout: "optimal_score": 0.25, 2024-09-13T05:12:24.106 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_acting": 2, 2024-09-13T05:12:24.106 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_stable": 2, 2024-09-13T05:12:24.106 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity_weighted": 0.97846031188964844, 2024-09-13T05:12:24.106 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-13T05:12:24.106 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-13T05:12:24.106 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: "pool": 2, 2024-09-13T05:12:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": "rbd", 2024-09-13T05:12:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: "create_time": "2024-09-13T05:09:57.858552+0000", 2024-09-13T05:12:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 8193, 2024-09-13T05:12:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T05:12:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: "type": 1, 2024-09-13T05:12:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 2, 2024-09-13T05:12:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": 1, 2024-09-13T05:12:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_rule": 0, 2024-09-13T05:12:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_count": 0, 2024-09-13T05:12:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_target": 0, 2024-09-13T05:12:24.108 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T05:12:24.108 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T05:12:24.108 INFO:teuthology.orchestra.run.smithi120.stdout: "object_hash": 2, 2024-09-13T05:12:24.108 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscale_mode": "off", 2024-09-13T05:12:24.108 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": 8, 2024-09-13T05:12:24.108 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num": 8, 2024-09-13T05:12:24.108 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num_target": 8, 2024-09-13T05:12:24.108 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_target": 8, 2024-09-13T05:12:24.108 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_pending": 8, 2024-09-13T05:12:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: "last_pg_merge_meta": { 2024-09-13T05:12:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: "source_pgid": "0.0", 2024-09-13T05:12:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: "ready_epoch": 0, 2024-09-13T05:12:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_started": 0, 2024-09-13T05:12:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_clean": 0, 2024-09-13T05:12:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: "source_version": "0'0", 2024-09-13T05:12:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: "target_version": "0'0" 2024-09-13T05:12:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: "last_change": "20", 2024-09-13T05:12:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend": "0", 2024-09-13T05:12:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T05:12:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T05:12:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: "auid": 0, 2024-09-13T05:12:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_mode": "selfmanaged", 2024-09-13T05:12:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_seq": 3, 2024-09-13T05:12:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_epoch": 20, 2024-09-13T05:12:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_snaps": [], 2024-09-13T05:12:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: "removed_snaps": "[]", 2024-09-13T05:12:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_bytes": 0, 2024-09-13T05:12:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_objects": 0, 2024-09-13T05:12:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: "tiers": [], 2024-09-13T05:12:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: "tier_of": -1, 2024-09-13T05:12:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: "read_tier": -1, 2024-09-13T05:12:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: "write_tier": -1, 2024-09-13T05:12:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_mode": "none", 2024-09-13T05:12:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_bytes": 0, 2024-09-13T05:12:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_objects": 0, 2024-09-13T05:12:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T05:12:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T05:12:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T05:12:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_flush_age": 0, 2024-09-13T05:12:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_evict_age": 0, 2024-09-13T05:12:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_profile": "", 2024-09-13T05:12:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_params": { 2024-09-13T05:12:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "none" 2024-09-13T05:12:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_period": 0, 2024-09-13T05:12:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_count": 0, 2024-09-13T05:12:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: "use_gmt_hitset": true, 2024-09-13T05:12:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: "min_read_recency_for_promote": 0, 2024-09-13T05:12:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: "min_write_recency_for_promote": 0, 2024-09-13T05:12:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T05:12:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_search_last_n": 0, 2024-09-13T05:12:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: "grade_table": [], 2024-09-13T05:12:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: "stripe_width": 0, 2024-09-13T05:12:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: "expected_num_objects": 0, 2024-09-13T05:12:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: "fast_read": false, 2024-09-13T05:12:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: "options": {}, 2024-09-13T05:12:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: "application_metadata": { 2024-09-13T05:12:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd": {} 2024-09-13T05:12:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: "read_balance": { 2024-09-13T05:12:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: "score_acting": 2.9800000190734863, 2024-09-13T05:12:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: "score_stable": 2.9800000190734863, 2024-09-13T05:12:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: "optimal_score": 0.62999999523162842, 2024-09-13T05:12:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_acting": 1.8799999952316284, 2024-09-13T05:12:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_stable": 1.8799999952316284, 2024-09-13T05:12:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity_weighted": 0.97846031188964844, 2024-09-13T05:12:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-13T05:12:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-13T05:12:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "pool": 3, 2024-09-13T05:12:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": "pool_client.0", 2024-09-13T05:12:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "create_time": "2024-09-13T05:10:07.742110+0000", 2024-09-13T05:12:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 8193, 2024-09-13T05:12:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T05:12:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "type": 1, 2024-09-13T05:12:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 2, 2024-09-13T05:12:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": 1, 2024-09-13T05:12:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_rule": 0, 2024-09-13T05:12:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_count": 0, 2024-09-13T05:12:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_target": 0, 2024-09-13T05:12:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T05:12:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T05:12:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "object_hash": 2, 2024-09-13T05:12:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscale_mode": "off", 2024-09-13T05:12:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": 32, 2024-09-13T05:12:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num": 32, 2024-09-13T05:12:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num_target": 32, 2024-09-13T05:12:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_target": 32, 2024-09-13T05:12:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_pending": 32, 2024-09-13T05:12:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "last_pg_merge_meta": { 2024-09-13T05:12:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "source_pgid": "0.0", 2024-09-13T05:12:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "ready_epoch": 0, 2024-09-13T05:12:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_started": 0, 2024-09-13T05:12:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_clean": 0, 2024-09-13T05:12:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "source_version": "0'0", 2024-09-13T05:12:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "target_version": "0'0" 2024-09-13T05:12:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "last_change": "111", 2024-09-13T05:12:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend": "0", 2024-09-13T05:12:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T05:12:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T05:12:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "auid": 0, 2024-09-13T05:12:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_mode": "selfmanaged", 2024-09-13T05:12:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_seq": 42, 2024-09-13T05:12:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_epoch": 111, 2024-09-13T05:12:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_snaps": [], 2024-09-13T05:12:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "removed_snaps": "[]", 2024-09-13T05:12:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_bytes": 0, 2024-09-13T05:12:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_objects": 0, 2024-09-13T05:12:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "tiers": [], 2024-09-13T05:12:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "tier_of": -1, 2024-09-13T05:12:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: "read_tier": -1, 2024-09-13T05:12:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: "write_tier": -1, 2024-09-13T05:12:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_mode": "none", 2024-09-13T05:12:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_bytes": 0, 2024-09-13T05:12:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_objects": 0, 2024-09-13T05:12:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T05:12:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T05:12:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T05:12:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_flush_age": 0, 2024-09-13T05:12:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_evict_age": 0, 2024-09-13T05:12:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_profile": "", 2024-09-13T05:12:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_params": { 2024-09-13T05:12:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "none" 2024-09-13T05:12:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_period": 0, 2024-09-13T05:12:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_count": 0, 2024-09-13T05:12:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "use_gmt_hitset": true, 2024-09-13T05:12:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "min_read_recency_for_promote": 0, 2024-09-13T05:12:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "min_write_recency_for_promote": 0, 2024-09-13T05:12:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T05:12:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_search_last_n": 0, 2024-09-13T05:12:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "grade_table": [], 2024-09-13T05:12:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "stripe_width": 0, 2024-09-13T05:12:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "expected_num_objects": 0, 2024-09-13T05:12:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "fast_read": false, 2024-09-13T05:12:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "options": {}, 2024-09-13T05:12:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "application_metadata": { 2024-09-13T05:12:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd": {} 2024-09-13T05:12:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "read_balance": { 2024-09-13T05:12:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "score_acting": 2.2400000095367432, 2024-09-13T05:12:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "score_stable": 2.2400000095367432, 2024-09-13T05:12:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "optimal_score": 0.62999999523162842, 2024-09-13T05:12:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_acting": 1.4099999666213989, 2024-09-13T05:12:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_stable": 1.4099999666213989, 2024-09-13T05:12:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity_weighted": 0.97846031188964844, 2024-09-13T05:12:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity": 0.98000001907348633, 2024-09-13T05:12:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity_weighted": 0.98000001907348633 2024-09-13T05:12:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:12:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "osds": [ 2024-09-13T05:12:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 0, 2024-09-13T05:12:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "b304ec03-bb00-4b13-bf2d-71017b8a70a3", 2024-09-13T05:12:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:12:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 0, 2024-09-13T05:12:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 0, 2024-09-13T05:12:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:12:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 13, 2024-09-13T05:12:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 105, 2024-09-13T05:12:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 124, 2024-09-13T05:12:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 40, 2024-09-13T05:12:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 106, 2024-09-13T05:12:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:12:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:12:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6800", 2024-09-13T05:12:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 367697828 2024-09-13T05:12:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6801", 2024-09-13T05:12:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 367697828 2024-09-13T05:12:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:12:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6802", 2024-09-13T05:12:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 367697828 2024-09-13T05:12:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6803", 2024-09-13T05:12:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 367697828 2024-09-13T05:12:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:12:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6806", 2024-09-13T05:12:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 367697828 2024-09-13T05:12:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6807", 2024-09-13T05:12:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 367697828 2024-09-13T05:12:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:12:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6804", 2024-09-13T05:12:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 367697828 2024-09-13T05:12:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6805", 2024-09-13T05:12:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 367697828 2024-09-13T05:12:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.120:6801/367697828", 2024-09-13T05:12:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.120:6803/367697828", 2024-09-13T05:12:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.120:6807/367697828", 2024-09-13T05:12:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.120:6805/367697828", 2024-09-13T05:12:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:12:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:12:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:12:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 1, 2024-09-13T05:12:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "c09e84f3-3a70-46a4-b67b-c9bb52c887b7", 2024-09-13T05:12:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:12:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:12:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:12:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:12:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:12:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:12:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:12:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 129, 2024-09-13T05:12:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:12:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:12:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:12:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6808", 2024-09-13T05:12:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:12:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6809", 2024-09-13T05:12:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:12:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:12:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6810", 2024-09-13T05:12:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:12:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6811", 2024-09-13T05:12:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:12:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:12:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6814", 2024-09-13T05:12:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:12:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6815", 2024-09-13T05:12:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:12:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:12:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6812", 2024-09-13T05:12:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:12:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6813", 2024-09-13T05:12:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:12:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.120:6809/1023532100", 2024-09-13T05:12:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.120:6811/1023532100", 2024-09-13T05:12:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.120:6815/1023532100", 2024-09-13T05:12:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.120:6813/1023532100", 2024-09-13T05:12:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:12:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:12:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:12:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 2, 2024-09-13T05:12:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "3c2a0458-369c-4dac-90a3-fb20cb70d53f", 2024-09-13T05:12:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:12:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:12:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:12:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:12:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:12:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:12:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:12:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 120, 2024-09-13T05:12:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:12:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:12:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:12:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6816", 2024-09-13T05:12:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:12:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6817", 2024-09-13T05:12:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:12:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:12:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6818", 2024-09-13T05:12:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:12:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6819", 2024-09-13T05:12:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:12:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:12:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6822", 2024-09-13T05:12:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:12:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6823", 2024-09-13T05:12:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:12:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:12:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6820", 2024-09-13T05:12:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:12:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6821", 2024-09-13T05:12:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:12:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.120:6817/592498012", 2024-09-13T05:12:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.120:6819/592498012", 2024-09-13T05:12:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.120:6823/592498012", 2024-09-13T05:12:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.120:6821/592498012", 2024-09-13T05:12:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:12:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:12:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:12:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 3, 2024-09-13T05:12:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "edce3757-5e9d-4221-a1f1-3f356bb5218b", 2024-09-13T05:12:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:12:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:12:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:12:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:12:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:12:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:12:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:12:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 130, 2024-09-13T05:12:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:12:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:12:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:12:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6824", 2024-09-13T05:12:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:12:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6825", 2024-09-13T05:12:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:12:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:12:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6826", 2024-09-13T05:12:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:12:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6827", 2024-09-13T05:12:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:12:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:12:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6830", 2024-09-13T05:12:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:12:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6831", 2024-09-13T05:12:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:12:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:12:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6828", 2024-09-13T05:12:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:12:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6829", 2024-09-13T05:12:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:12:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.120:6825/1939753938", 2024-09-13T05:12:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.120:6827/1939753938", 2024-09-13T05:12:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.120:6831/1939753938", 2024-09-13T05:12:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.120:6829/1939753938", 2024-09-13T05:12:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:12:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:12:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:12:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 4, 2024-09-13T05:12:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "5fe378d2-578f-41ea-980a-4673a8b376df", 2024-09-13T05:12:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:12:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 0, 2024-09-13T05:12:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 0, 2024-09-13T05:12:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:12:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:12:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:12:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:12:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 0, 2024-09-13T05:12:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:12:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:12:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:12:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6824", 2024-09-13T05:12:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:12:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6825", 2024-09-13T05:12:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:12:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:12:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6826", 2024-09-13T05:12:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:12:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6827", 2024-09-13T05:12:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:12:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:12:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6830", 2024-09-13T05:12:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:12:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6831", 2024-09-13T05:12:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:12:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:12:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6828", 2024-09-13T05:12:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:12:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6829", 2024-09-13T05:12:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:12:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.137:6825/3005075615", 2024-09-13T05:12:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.137:6827/3005075615", 2024-09-13T05:12:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.137:6831/3005075615", 2024-09-13T05:12:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.137:6829/3005075615", 2024-09-13T05:12:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:12:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:12:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:12:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 5, 2024-09-13T05:12:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "6e6f7499-ae9e-4cb1-9db7-4d9f8fd9b257", 2024-09-13T05:12:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:12:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:12:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:12:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:12:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:12:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:12:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:12:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 130, 2024-09-13T05:12:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:12:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:12:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:12:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6800", 2024-09-13T05:12:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:12:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6801", 2024-09-13T05:12:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:12:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:12:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6802", 2024-09-13T05:12:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:12:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6803", 2024-09-13T05:12:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:12:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:12:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6806", 2024-09-13T05:12:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:12:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6807", 2024-09-13T05:12:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:12:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:12:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6804", 2024-09-13T05:12:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:12:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6805", 2024-09-13T05:12:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:12:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.137:6801/1108177522", 2024-09-13T05:12:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.137:6803/1108177522", 2024-09-13T05:12:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.137:6807/1108177522", 2024-09-13T05:12:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.137:6805/1108177522", 2024-09-13T05:12:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:12:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:12:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:12:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 6, 2024-09-13T05:12:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "e4c519e5-5df4-4d55-b12e-fbcfb1b0555c", 2024-09-13T05:12:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:12:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 0, 2024-09-13T05:12:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 0, 2024-09-13T05:12:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 0.8276824951171875, 2024-09-13T05:12:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:12:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:12:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:12:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 118, 2024-09-13T05:12:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:12:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:12:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:12:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6816", 2024-09-13T05:12:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:12:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6817", 2024-09-13T05:12:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:12:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:12:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6818", 2024-09-13T05:12:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:12:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6819", 2024-09-13T05:12:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:12:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:12:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6822", 2024-09-13T05:12:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:12:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6823", 2024-09-13T05:12:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:12:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:12:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6820", 2024-09-13T05:12:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:12:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6821", 2024-09-13T05:12:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:12:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.137:6817/2667039053", 2024-09-13T05:12:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.137:6819/2667039053", 2024-09-13T05:12:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.137:6823/2667039053", 2024-09-13T05:12:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.137:6821/2667039053", 2024-09-13T05:12:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:12:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:12:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:12:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 7, 2024-09-13T05:12:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "914648c2-7a6c-4e66-811d-936e250638db", 2024-09-13T05:12:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:12:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:12:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:12:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:12:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:12:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:12:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:12:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 130, 2024-09-13T05:12:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:12:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:12:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:12:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6808", 2024-09-13T05:12:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:12:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6809", 2024-09-13T05:12:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:12:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:12:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6810", 2024-09-13T05:12:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:12:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6811", 2024-09-13T05:12:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:12:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:12:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6814", 2024-09-13T05:12:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:12:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6815", 2024-09-13T05:12:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:12:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:12:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6812", 2024-09-13T05:12:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:12:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6813", 2024-09-13T05:12:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:12:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.137:6809/993764921", 2024-09-13T05:12:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.137:6811/993764921", 2024-09-13T05:12:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.137:6815/993764921", 2024-09-13T05:12:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.137:6813/993764921", 2024-09-13T05:12:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:12:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:12:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:12:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:12:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_xinfo": [ 2024-09-13T05:12:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 0, 2024-09-13T05:12:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:12:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:12:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:12:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:12:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 65536, 2024-09-13T05:12:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:46.914820+0000", 2024-09-13T05:12:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 106 2024-09-13T05:12:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 1, 2024-09-13T05:12:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:12:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:12:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:12:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:12:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:12:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.326286+0000", 2024-09-13T05:12:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:12:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 2, 2024-09-13T05:12:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:12:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:12:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:12:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:12:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:12:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.147193+0000", 2024-09-13T05:12:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:12:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 3, 2024-09-13T05:12:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:12:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:12:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:12:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:12:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:12:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.478655+0000", 2024-09-13T05:12:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:12:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 4, 2024-09-13T05:12:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:12:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:12:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:12:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:12:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 65536, 2024-09-13T05:12:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.388938+0000", 2024-09-13T05:12:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:12:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 5, 2024-09-13T05:12:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:12:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:12:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:12:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:12:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:12:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.127175+0000", 2024-09-13T05:12:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:12:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 6, 2024-09-13T05:12:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:12:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:12:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:12:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:12:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 65536, 2024-09-13T05:12:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.187286+0000", 2024-09-13T05:12:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:12:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 7, 2024-09-13T05:12:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:12:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:12:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:12:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:12:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:12:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:46.962119+0000", 2024-09-13T05:12:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:12:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:12:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_upmap": [ 2024-09-13T05:12:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: "pgid": "3.a", 2024-09-13T05:12:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: "osds": [ 2024-09-13T05:12:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: 3, 2024-09-13T05:12:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: 2 2024-09-13T05:12:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:12:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_upmap_items": [], 2024-09-13T05:12:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_upmap_primaries": [], 2024-09-13T05:12:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_temp": [], 2024-09-13T05:12:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_temp": [], 2024-09-13T05:12:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "blocklist": {}, 2024-09-13T05:12:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "range_blocklist": {}, 2024-09-13T05:12:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_profiles": { 2024-09-13T05:12:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "default": { 2024-09-13T05:12:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "crush-failure-domain": "osd", 2024-09-13T05:12:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "k": "2", 2024-09-13T05:12:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "m": "1", 2024-09-13T05:12:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "plugin": "jerasure", 2024-09-13T05:12:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "technique": "reed_sol_van" 2024-09-13T05:12:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "removed_snaps_queue": [], 2024-09-13T05:12:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "new_removed_snaps": [], 2024-09-13T05:12:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "new_purged_snaps": [], 2024-09-13T05:12:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_node_flags": {}, 2024-09-13T05:12:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "device_class_flags": {}, 2024-09-13T05:12:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "stretch_mode": { 2024-09-13T05:12:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "stretch_mode_enabled": false, 2024-09-13T05:12:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "stretch_bucket_count": 0, 2024-09-13T05:12:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "degraded_stretch_mode": 0, 2024-09-13T05:12:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "recovering_stretch_mode": 0, 2024-09-13T05:12:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "stretch_mode_bucket": 0 2024-09-13T05:12:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:24.202 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:24.204 INFO:teuthology.orchestra.run.smithi120.stdout:5247 write 0x7828fce thru 0x7835b8d (0xcbc0 bytes) 2024-09-13T05:12:24.204 INFO:teuthology.orchestra.run.smithi120.stdout:5248 read 0x8bfdbb3 thru 0x8c0bacd (0xdf1b bytes) 2024-09-13T05:12:24.204 INFO:teuthology.orchestra.run.smithi120.stdout:5250 write 0x7153dd1 thru 0x7159941 (0x5b71 bytes) 2024-09-13T05:12:24.204 INFO:teuthology.orchestra.run.smithi120.stdout:5251 clone 40 order 22 su 2097152 sc 13 2024-09-13T05:12:24.205 INFO:tasks.thrashosds.thrasher:j is {'epoch': 131, 'fsid': '0a3759da-62bd-4704-8a4a-7c20eb3fc816', 'created': '2024-09-13T05:09:38.849186+0000', 'modified': '2024-09-13T05:12:23.718792+0000', 'last_up_change': '2024-09-13T05:12:13.640614+0000', 'last_in_change': '2024-09-13T05:12:18.671581+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T05:09:52.225455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9784603118896484, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T05:09:57.858552+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.9800000190734863, 'score_stable': 2.9800000190734863, 'optimal_score': 0.6299999952316284, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9784603118896484, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-13T05:10:07.742110+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 42, 'snap_epoch': 111, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.240000009536743, 'score_stable': 2.240000009536743, 'optimal_score': 0.6299999952316284, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 0.9784603118896484, 'average_primary_affinity': 0.9800000190734863, 'average_primary_affinity_weighted': 0.9800000190734863}}], 'osds': [{'osd': 0, 'uuid': 'b304ec03-bb00-4b13-bf2d-71017b8a70a3', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 105, 'up_from': 124, 'up_thru': 40, 'down_at': 106, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6800', 'nonce': 367697828}, {'type': 'v1', 'addr': '172.21.15.120:6801', 'nonce': 367697828}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6802', 'nonce': 367697828}, {'type': 'v1', 'addr': '172.21.15.120:6803', 'nonce': 367697828}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6806', 'nonce': 367697828}, {'type': 'v1', 'addr': '172.21.15.120:6807', 'nonce': 367697828}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6804', 'nonce': 367697828}, {'type': 'v1', 'addr': '172.21.15.120:6805', 'nonce': 367697828}]}, 'public_addr': '172.21.15.120:6801/367697828', 'cluster_addr': '172.21.15.120:6803/367697828', 'heartbeat_back_addr': '172.21.15.120:6807/367697828', 'heartbeat_front_addr': '172.21.15.120:6805/367697828', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'c09e84f3-3a70-46a4-b67b-c9bb52c887b7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 129, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6808', 'nonce': 1023532100}, {'type': 'v1', 'addr': '172.21.15.120:6809', 'nonce': 1023532100}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6810', 'nonce': 1023532100}, {'type': 'v1', 'addr': '172.21.15.120:6811', 'nonce': 1023532100}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6814', 'nonce': 1023532100}, {'type': 'v1', 'addr': '172.21.15.120:6815', 'nonce': 1023532100}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6812', 'nonce': 1023532100}, {'type': 'v1', 'addr': '172.21.15.120:6813', 'nonce': 1023532100}]}, 'public_addr': '172.21.15.120:6809/1023532100', 'cluster_addr': '172.21.15.120:6811/1023532100', 'heartbeat_back_addr': '172.21.15.120:6815/1023532100', 'heartbeat_front_addr': '172.21.15.120:6813/1023532100', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '3c2a0458-369c-4dac-90a3-fb20cb70d53f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 120, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6816', 'nonce': 592498012}, {'type': 'v1', 'addr': '172.21.15.120:6817', 'nonce': 592498012}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6818', 'nonce': 592498012}, {'type': 'v1', 'addr': '172.21.15.120:6819', 'nonce': 592498012}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6822', 'nonce': 592498012}, {'type': 'v1', 'addr': '172.21.15.120:6823', 'nonce': 592498012}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6820', 'nonce': 592498012}, {'type': 'v1', 'addr': '172.21.15.120:6821', 'nonce': 592498012}]}, 'public_addr': '172.21.15.120:6817/592498012', 'cluster_addr': '172.21.15.120:6819/592498012', 'heartbeat_back_addr': '172.21.15.120:6823/592498012', 'heartbeat_front_addr': '172.21.15.120:6821/592498012', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'edce3757-5e9d-4221-a1f1-3f356bb5218b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 130, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6824', 'nonce': 1939753938}, {'type': 'v1', 'addr': '172.21.15.120:6825', 'nonce': 1939753938}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6826', 'nonce': 1939753938}, {'type': 'v1', 'addr': '172.21.15.120:6827', 'nonce': 1939753938}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6830', 'nonce': 1939753938}, {'type': 'v1', 'addr': '172.21.15.120:6831', 'nonce': 1939753938}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6828', 'nonce': 1939753938}, {'type': 'v1', 'addr': '172.21.15.120:6829', 'nonce': 1939753938}]}, 'public_addr': '172.21.15.120:6825/1939753938', 'cluster_addr': '172.21.15.120:6827/1939753938', 'heartbeat_back_addr': '172.21.15.120:6831/1939753938', 'heartbeat_front_addr': '172.21.15.120:6829/1939753938', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '5fe378d2-578f-41ea-980a-4673a8b376df', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6824', 'nonce': 3005075615}, {'type': 'v1', 'addr': '172.21.15.137:6825', 'nonce': 3005075615}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6826', 'nonce': 3005075615}, {'type': 'v1', 'addr': '172.21.15.137:6827', 'nonce': 3005075615}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6830', 'nonce': 3005075615}, {'type': 'v1', 'addr': '172.21.15.137:6831', 'nonce': 3005075615}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6828', 'nonce': 3005075615}, {'type': 'v1', 'addr': '172.21.15.137:6829', 'nonce': 3005075615}]}, 'public_addr': '172.21.15.137:6825/3005075615', 'cluster_addr': '172.21.15.137:6827/3005075615', 'heartbeat_back_addr': '172.21.15.137:6831/3005075615', 'heartbeat_front_addr': '172.21.15.137:6829/3005075615', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '6e6f7499-ae9e-4cb1-9db7-4d9f8fd9b257', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 130, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6800', 'nonce': 1108177522}, {'type': 'v1', 'addr': '172.21.15.137:6801', 'nonce': 1108177522}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6802', 'nonce': 1108177522}, {'type': 'v1', 'addr': '172.21.15.137:6803', 'nonce': 1108177522}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6806', 'nonce': 1108177522}, {'type': 'v1', 'addr': '172.21.15.137:6807', 'nonce': 1108177522}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6804', 'nonce': 1108177522}, {'type': 'v1', 'addr': '172.21.15.137:6805', 'nonce': 1108177522}]}, 'public_addr': '172.21.15.137:6801/1108177522', 'cluster_addr': '172.21.15.137:6803/1108177522', 'heartbeat_back_addr': '172.21.15.137:6807/1108177522', 'heartbeat_front_addr': '172.21.15.137:6805/1108177522', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e4c519e5-5df4-4d55-b12e-fbcfb1b0555c', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 0.8276824951171875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 118, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6816', 'nonce': 2667039053}, {'type': 'v1', 'addr': '172.21.15.137:6817', 'nonce': 2667039053}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6818', 'nonce': 2667039053}, {'type': 'v1', 'addr': '172.21.15.137:6819', 'nonce': 2667039053}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6822', 'nonce': 2667039053}, {'type': 'v1', 'addr': '172.21.15.137:6823', 'nonce': 2667039053}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6820', 'nonce': 2667039053}, {'type': 'v1', 'addr': '172.21.15.137:6821', 'nonce': 2667039053}]}, 'public_addr': '172.21.15.137:6817/2667039053', 'cluster_addr': '172.21.15.137:6819/2667039053', 'heartbeat_back_addr': '172.21.15.137:6823/2667039053', 'heartbeat_front_addr': '172.21.15.137:6821/2667039053', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '914648c2-7a6c-4e66-811d-936e250638db', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 130, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6808', 'nonce': 993764921}, {'type': 'v1', 'addr': '172.21.15.137:6809', 'nonce': 993764921}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6810', 'nonce': 993764921}, {'type': 'v1', 'addr': '172.21.15.137:6811', 'nonce': 993764921}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6814', 'nonce': 993764921}, {'type': 'v1', 'addr': '172.21.15.137:6815', 'nonce': 993764921}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6812', 'nonce': 993764921}, {'type': 'v1', 'addr': '172.21.15.137:6813', 'nonce': 993764921}]}, 'public_addr': '172.21.15.137:6809/993764921', 'cluster_addr': '172.21.15.137:6811/993764921', 'heartbeat_back_addr': '172.21.15.137:6815/993764921', 'heartbeat_front_addr': '172.21.15.137:6813/993764921', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T05:09:46.914820+0000', 'dead_epoch': 106}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.326286+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.147193+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.478655+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.388938+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.127175+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.187286+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:46.962119+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.a', 'osds': [3, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-13T05:12:24.205 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:12:24.249 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:24.247+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:24.308 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:24.304+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:24.318 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:24.318 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:24.328 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:12:24.409 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:24.408+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:24.438 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:24.438 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:24.448 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:12:24.510 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:24.508+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:24.560 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:12:24.563 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:12:24.575 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2024-09-13T05:12:24.203267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1397607732,"num_objects":3586,"num_object_clones":513,"num_object_copies":7172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":120,"num_objects_unfound":0,"num_objects_dirty":3586,"num_whiteouts":2044,"num_read":207126,"num_read_kb":572230,"num_write":22318,"num_write_kb":505909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4978,"num_bytes_recovered":181564328,"num_keys_recovered":517,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20147,"ondisk_log_size":20147,"up":82,"acting":78,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":813328,"kb_used_data":542016,"kb_used_omap":7,"kb_used_meta":267896,"kb_avail":471045872,"statfs":{"total":483183820800,"available":482350972928,"internally_reserved":0,"allocated":555024384,"data_stored":592074751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7963,"internal_metadata":274325733},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8457722,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":120,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":129,"num_read_kb":-6,"num_write":59,"num_write_kb":37074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":698,"num_bytes_recovered":56056400,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001568"},"pg_stats":[{"pgid":"3.1f","version":"111'508","reported_seq":1847,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:20.687562+0000","last_change":"2024-09-13T05:10:37.993400+0000","last_active":"2024-09-13T05:12:20.687562+0000","last_peered":"2024-09-13T05:12:20.687562+0000","last_clean":"2024-09-13T05:12:20.687562+0000","last_became_active":"2024-09-13T05:10:37.864778+0000","last_became_peered":"2024-09-13T05:10:37.864778+0000","last_unstale":"2024-09-13T05:12:20.687562+0000","last_undegraded":"2024-09-13T05:12:20.687562+0000","last_fullsized":"2024-09-13T05:12:20.687562+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:56:24.801492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011835439999999999,"stat_sum":{"num_bytes":7966562,"num_objects":100,"num_object_clones":11,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":50,"num_read":2411,"num_read_kb":6544,"num_write":555,"num_write_kb":4897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":297202,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"128'458","reported_seq":8718,"reported_epoch":128,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-13T05:12:21.689642+0000","last_change":"2024-09-13T05:12:21.610533+0000","last_active":"2024-09-13T05:12:21.689642+0000","last_peered":"2024-09-13T05:12:21.689642+0000","last_clean":"2024-09-13T05:12:17.801629+0000","last_became_active":"2024-09-13T05:12:21.608595+0000","last_became_peered":"2024-09-13T05:12:21.608595+0000","last_unstale":"2024-09-13T05:12:21.689642+0000","last_undegraded":"2024-09-13T05:12:20.694718+0000","last_fullsized":"2024-09-13T05:12:20.691543+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:46:50.510707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225439,"stat_sum":{"num_bytes":30006627,"num_objects":102,"num_object_clones":13,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":62,"num_read":8998,"num_read_kb":6935,"num_write":383,"num_write_kb":4350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3],"avail_no_missing":["3","6"],"object_location_counts":[{"shards":"3","objects":1},{"shards":"3,6","objects":101}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"128'646","reported_seq":3136,"reported_epoch":129,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-13T05:12:21.942652+0000","last_change":"2024-09-13T05:12:21.858877+0000","last_active":"2024-09-13T05:12:21.942652+0000","last_peered":"2024-09-13T05:12:21.942652+0000","last_clean":"2024-09-13T05:12:16.469917+0000","last_became_active":"2024-09-13T05:12:20.716742+0000","last_became_peered":"2024-09-13T05:12:20.716742+0000","last_unstale":"2024-09-13T05:12:21.942652+0000","last_undegraded":"2024-09-13T05:12:21.942652+0000","last_fullsized":"2024-09-13T05:12:20.687450+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:52:50.733305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072691800000000001,"stat_sum":{"num_bytes":47249684,"num_objects":117,"num_object_clones":15,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":97,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":63,"num_read":4054,"num_read_kb":13909,"num_write":678,"num_write_kb":17506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":491136,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5],"avail_no_missing":["5","6"],"object_location_counts":[{"shards":"5","objects":20},{"shards":"5,6","objects":97}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"128'749","reported_seq":4674,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T05:12:21.709545+0000","last_change":"2024-09-13T05:12:07.931145+0000","last_active":"2024-09-13T05:12:21.709545+0000","last_peered":"2024-09-13T05:12:21.709545+0000","last_clean":"2024-09-13T05:12:21.709545+0000","last_became_active":"2024-09-13T05:12:07.928725+0000","last_became_peered":"2024-09-13T05:12:07.928725+0000","last_unstale":"2024-09-13T05:12:21.709545+0000","last_undegraded":"2024-09-13T05:12:21.709545+0000","last_fullsized":"2024-09-13T05:12:21.709545+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":749,"log_dups_size":0,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:12.555958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078437299999999999,"stat_sum":{"num_bytes":48281131,"num_objects":101,"num_object_clones":15,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":54,"num_read":5833,"num_read_kb":21339,"num_write":874,"num_write_kb":14723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":4747628,"num_keys_recovered":109,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"129'574","reported_seq":2957,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T05:12:21.711312+0000","last_change":"2024-09-13T05:12:06.959890+0000","last_active":"2024-09-13T05:12:21.711312+0000","last_peered":"2024-09-13T05:12:21.711312+0000","last_clean":"2024-09-13T05:12:21.711312+0000","last_became_active":"2024-09-13T05:12:06.927660+0000","last_became_peered":"2024-09-13T05:12:06.927660+0000","last_unstale":"2024-09-13T05:12:21.711312+0000","last_undegraded":"2024-09-13T05:12:21.711312+0000","last_fullsized":"2024-09-13T05:12:21.711312+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:07:02.040205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065808499999999999,"stat_sum":{"num_bytes":73983909,"num_objects":116,"num_object_clones":12,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":116,"num_whiteouts":67,"num_read":3729,"num_read_kb":14905,"num_write":592,"num_write_kb":41085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":212,"num_bytes_recovered":6422807,"num_keys_recovered":23,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"111'1811","reported_seq":18409,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:21.689071+0000","last_change":"2024-09-13T05:12:11.642732+0000","last_active":"2024-09-13T05:12:21.689071+0000","last_peered":"2024-09-13T05:12:21.689071+0000","last_clean":"2024-09-13T05:12:21.689071+0000","last_became_active":"2024-09-13T05:12:11.640620+0000","last_became_peered":"2024-09-13T05:12:11.640620+0000","last_unstale":"2024-09-13T05:12:21.689071+0000","last_undegraded":"2024-09-13T05:12:21.689071+0000","last_fullsized":"2024-09-13T05:12:21.689071+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1811,"log_dups_size":0,"ondisk_log_size":1811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:18:04.517687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027226559999999999,"stat_sum":{"num_bytes":57614215,"num_objects":129,"num_object_clones":18,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":64,"num_read":24712,"num_read_kb":27726,"num_write":2929,"num_write_kb":12666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":273,"num_bytes_recovered":5186066,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"111'775","reported_seq":10943,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:20.697014+0000","last_change":"2024-09-13T05:12:09.629044+0000","last_active":"2024-09-13T05:12:20.697014+0000","last_peered":"2024-09-13T05:12:20.697014+0000","last_clean":"2024-09-13T05:12:20.697014+0000","last_became_active":"2024-09-13T05:12:09.626312+0000","last_became_peered":"2024-09-13T05:12:09.626312+0000","last_unstale":"2024-09-13T05:12:20.697014+0000","last_undegraded":"2024-09-13T05:12:20.697014+0000","last_fullsized":"2024-09-13T05:12:20.697014+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:47.900796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067403999999999999,"stat_sum":{"num_bytes":70409891,"num_objects":123,"num_object_clones":19,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123,"num_whiteouts":68,"num_read":12643,"num_read_kb":21164,"num_write":903,"num_write_kb":6669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":3365202,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"111'569","reported_seq":3668,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:20.691015+0000","last_change":"2024-09-13T05:12:11.643510+0000","last_active":"2024-09-13T05:12:20.691015+0000","last_peered":"2024-09-13T05:12:20.691015+0000","last_clean":"2024-09-13T05:12:20.691015+0000","last_became_active":"2024-09-13T05:12:11.641696+0000","last_became_peered":"2024-09-13T05:12:11.641696+0000","last_unstale":"2024-09-13T05:12:20.691015+0000","last_undegraded":"2024-09-13T05:12:20.691015+0000","last_fullsized":"2024-09-13T05:12:20.691015+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:05:41.070434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087399999999998,"stat_sum":{"num_bytes":55268375,"num_objects":126,"num_object_clones":22,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":73,"num_read":3365,"num_read_kb":25803,"num_write":583,"num_write_kb":24121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":11847558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"111'477","reported_seq":2720,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:20.687718+0000","last_change":"2024-09-13T05:10:37.920810+0000","last_active":"2024-09-13T05:12:20.687718+0000","last_peered":"2024-09-13T05:12:20.687718+0000","last_clean":"2024-09-13T05:12:20.687718+0000","last_became_active":"2024-09-13T05:10:37.864816+0000","last_became_peered":"2024-09-13T05:10:37.864816+0000","last_unstale":"2024-09-13T05:12:20.687718+0000","last_undegraded":"2024-09-13T05:12:20.687718+0000","last_fullsized":"2024-09-13T05:12:20.687718+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:06.315864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096598599999999995,"stat_sum":{"num_bytes":11247004,"num_objects":103,"num_object_clones":11,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":65,"num_read":4463,"num_read_kb":7507,"num_write":390,"num_write_kb":3046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":37802,"num_keys_recovered":23,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"111'450","reported_seq":8727,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:20.687491+0000","last_change":"2024-09-13T05:11:24.632224+0000","last_active":"2024-09-13T05:12:20.687491+0000","last_peered":"2024-09-13T05:12:20.687491+0000","last_clean":"2024-09-13T05:12:20.687491+0000","last_became_active":"2024-09-13T05:11:24.631079+0000","last_became_peered":"2024-09-13T05:11:24.631079+0000","last_unstale":"2024-09-13T05:12:20.687491+0000","last_undegraded":"2024-09-13T05:12:20.687491+0000","last_fullsized":"2024-09-13T05:12:20.687491+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:29.182802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072236499999999999,"stat_sum":{"num_bytes":58493021,"num_objects":100,"num_object_clones":22,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":59,"num_read":8609,"num_read_kb":15045,"num_write":370,"num_write_kb":3975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":4743569,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"128'427","reported_seq":11683,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:21.698153+0000","last_change":"2024-09-13T05:10:11.681217+0000","last_active":"2024-09-13T05:12:21.698153+0000","last_peered":"2024-09-13T05:12:21.698153+0000","last_clean":"2024-09-13T05:12:21.698153+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:12:21.698153+0000","last_undegraded":"2024-09-13T05:12:21.698153+0000","last_fullsized":"2024-09-13T05:12:21.698153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:40.457636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095533399999999996,"stat_sum":{"num_bytes":26854307,"num_objects":106,"num_object_clones":16,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":65,"num_read":11816,"num_read_kb":13085,"num_write":438,"num_write_kb":22757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"111'410","reported_seq":7101,"reported_epoch":129,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-13T05:12:21.962467+0000","last_change":"2024-09-13T05:12:21.612740+0000","last_active":"2024-09-13T05:12:21.962467+0000","last_peered":"2024-09-13T05:12:21.962467+0000","last_clean":"2024-09-13T05:12:16.547436+0000","last_became_active":"2024-09-13T05:12:21.606718+0000","last_became_peered":"2024-09-13T05:12:21.606718+0000","last_unstale":"2024-09-13T05:12:21.962467+0000","last_undegraded":"2024-09-13T05:12:21.962467+0000","last_fullsized":"2024-09-13T05:12:20.693325+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:43:11.532584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011047369999999999,"stat_sum":{"num_bytes":48824458,"num_objects":103,"num_object_clones":17,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":23,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":61,"num_read":6474,"num_read_kb":28347,"num_write":335,"num_write_kb":6597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":130,"num_bytes_recovered":3862046,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7],"avail_no_missing":["7","6"],"object_location_counts":[{"shards":"6,7","objects":23},{"shards":"7","objects":80}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T05:12:21.711386+0000","last_change":"2024-09-13T05:12:19.694070+0000","last_active":"2024-09-13T05:12:21.711386+0000","last_peered":"2024-09-13T05:12:21.711386+0000","last_clean":"2024-09-13T05:12:21.711386+0000","last_became_active":"2024-09-13T05:12:19.693769+0000","last_became_peered":"2024-09-13T05:12:19.693769+0000","last_unstale":"2024-09-13T05:12:21.711386+0000","last_undegraded":"2024-09-13T05:12:21.711386+0000","last_fullsized":"2024-09-13T05:12:21.711386+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:47:36.726484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"111'413","reported_seq":6170,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:20.699014+0000","last_change":"2024-09-13T05:12:10.636874+0000","last_active":"2024-09-13T05:12:20.699014+0000","last_peered":"2024-09-13T05:12:20.699014+0000","last_clean":"2024-09-13T05:12:20.699014+0000","last_became_active":"2024-09-13T05:12:10.632435+0000","last_became_peered":"2024-09-13T05:12:10.632435+0000","last_unstale":"2024-09-13T05:12:20.699014+0000","last_undegraded":"2024-09-13T05:12:20.699014+0000","last_fullsized":"2024-09-13T05:12:20.699014+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:29:30.868588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099899699999999995,"stat_sum":{"num_bytes":34400793,"num_objects":110,"num_object_clones":17,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":60,"num_read":5434,"num_read_kb":15299,"num_write":330,"num_write_kb":8059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":358,"num_bytes_recovered":18571154,"num_keys_recovered":56,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:20.698919+0000","last_change":"2024-09-13T05:12:19.691066+0000","last_active":"2024-09-13T05:12:20.698919+0000","last_peered":"2024-09-13T05:12:20.698919+0000","last_clean":"2024-09-13T05:12:20.698919+0000","last_became_active":"2024-09-13T05:12:19.690800+0000","last_became_peered":"2024-09-13T05:12:19.690800+0000","last_unstale":"2024-09-13T05:12:20.698919+0000","last_undegraded":"2024-09-13T05:12:20.698919+0000","last_fullsized":"2024-09-13T05:12:20.698919+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:44:47.683946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"128'439","reported_seq":4587,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T05:12:21.717518+0000","last_change":"2024-09-13T05:10:12.077111+0000","last_active":"2024-09-13T05:12:21.717518+0000","last_peered":"2024-09-13T05:12:21.717518+0000","last_clean":"2024-09-13T05:12:21.717518+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:12:21.717518+0000","last_undegraded":"2024-09-13T05:12:21.717518+0000","last_fullsized":"2024-09-13T05:12:21.717518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:37.976147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001460444,"stat_sum":{"num_bytes":67236141,"num_objects":114,"num_object_clones":15,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":67,"num_read":4309,"num_read_kb":12079,"num_write":356,"num_write_kb":3903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":142,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:20.693536+0000","last_change":"2024-09-13T05:12:03.635721+0000","last_active":"2024-09-13T05:12:20.693536+0000","last_peered":"2024-09-13T05:12:20.693536+0000","last_clean":"2024-09-13T05:12:20.693536+0000","last_became_active":"2024-09-13T05:12:03.635398+0000","last_became_peered":"2024-09-13T05:12:03.635398+0000","last_unstale":"2024-09-13T05:12:20.693536+0000","last_undegraded":"2024-09-13T05:12:20.693536+0000","last_fullsized":"2024-09-13T05:12:20.693536+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:11:36.677719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"111'572","reported_seq":1337,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:20.700159+0000","last_change":"2024-09-13T05:12:09.630053+0000","last_active":"2024-09-13T05:12:20.700159+0000","last_peered":"2024-09-13T05:12:20.700159+0000","last_clean":"2024-09-13T05:12:20.700159+0000","last_became_active":"2024-09-13T05:12:09.627485+0000","last_became_peered":"2024-09-13T05:12:09.627485+0000","last_unstale":"2024-09-13T05:12:20.700159+0000","last_undegraded":"2024-09-13T05:12:20.700159+0000","last_fullsized":"2024-09-13T05:12:20.700159+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:54.694847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076234800000000004,"stat_sum":{"num_bytes":18146076,"num_objects":99,"num_object_clones":10,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":55,"num_read":1540,"num_read_kb":4459,"num_write":681,"num_write_kb":9754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":352,"num_bytes_recovered":5263836,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:20.700052+0000","last_change":"2024-09-13T05:12:03.637346+0000","last_active":"2024-09-13T05:12:20.700052+0000","last_peered":"2024-09-13T05:12:20.700052+0000","last_clean":"2024-09-13T05:12:20.700052+0000","last_became_active":"2024-09-13T05:12:03.636811+0000","last_became_peered":"2024-09-13T05:12:03.636811+0000","last_unstale":"2024-09-13T05:12:20.700052+0000","last_undegraded":"2024-09-13T05:12:20.700052+0000","last_fullsized":"2024-09-13T05:12:20.700052+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:20:34.682745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"128'507","reported_seq":4259,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:21.666088+0000","last_change":"2024-09-13T05:10:11.645960+0000","last_active":"2024-09-13T05:12:21.666088+0000","last_peered":"2024-09-13T05:12:21.666088+0000","last_clean":"2024-09-13T05:12:21.666088+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:12:21.666088+0000","last_undegraded":"2024-09-13T05:12:21.666088+0000","last_fullsized":"2024-09-13T05:12:21.666088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:40.372741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001054028,"stat_sum":{"num_bytes":107071044,"num_objects":117,"num_object_clones":16,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":52,"num_read":5385,"num_read_kb":57388,"num_write":453,"num_write_kb":54762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"128'651","reported_seq":3757,"reported_epoch":129,"state":"peering","last_fresh":"2024-09-13T05:12:21.713196+0000","last_change":"2024-09-13T05:12:21.713196+0000","last_active":"2024-09-13T05:12:21.712968+0000","last_peered":"2024-09-13T05:12:21.683799+0000","last_clean":"2024-09-13T05:12:17.771733+0000","last_became_active":"2024-09-13T05:12:20.714917+0000","last_became_peered":"2024-09-13T05:12:20.714917+0000","last_unstale":"2024-09-13T05:12:21.713196+0000","last_undegraded":"2024-09-13T05:12:21.713196+0000","last_fullsized":"2024-09-13T05:12:21.713196+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:33:04.533115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099335200000000008,"stat_sum":{"num_bytes":77524591,"num_objects":113,"num_object_clones":15,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":68,"num_read":3760,"num_read_kb":29060,"num_write":721,"num_write_kb":49346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":387,"num_bytes_recovered":24694331,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":152,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:20.687130+0000","last_change":"2024-09-13T05:12:03.638698+0000","last_active":"2024-09-13T05:12:20.687130+0000","last_peered":"2024-09-13T05:12:20.687130+0000","last_clean":"2024-09-13T05:12:20.687130+0000","last_became_active":"2024-09-13T05:12:03.635365+0000","last_became_peered":"2024-09-13T05:12:03.635365+0000","last_unstale":"2024-09-13T05:12:20.687130+0000","last_undegraded":"2024-09-13T05:12:20.687130+0000","last_fullsized":"2024-09-13T05:12:20.687130+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:44:53.312870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"111'613","reported_seq":1091,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:20.702191+0000","last_change":"2024-09-13T05:12:07.932806+0000","last_active":"2024-09-13T05:12:20.702191+0000","last_peered":"2024-09-13T05:12:20.702191+0000","last_clean":"2024-09-13T05:12:20.702191+0000","last_became_active":"2024-09-13T05:12:07.930334+0000","last_became_peered":"2024-09-13T05:12:07.930334+0000","last_unstale":"2024-09-13T05:12:20.702191+0000","last_undegraded":"2024-09-13T05:12:20.702191+0000","last_fullsized":"2024-09-13T05:12:20.702191+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:23:46.175271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045163499999999998,"stat_sum":{"num_bytes":24520179,"num_objects":120,"num_object_clones":18,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":72,"num_read":1356,"num_read_kb":3031,"num_write":601,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":1243867,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":126,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:21.597137+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:12:21.597137+0000","last_peered":"2024-09-13T05:12:21.597137+0000","last_clean":"2024-09-13T05:12:21.597137+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:12:21.597137+0000","last_undegraded":"2024-09-13T05:12:21.597137+0000","last_fullsized":"2024-09-13T05:12:21.597137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"111'483","reported_seq":2310,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:20.691157+0000","last_change":"2024-09-13T05:10:38.111510+0000","last_active":"2024-09-13T05:12:20.691157+0000","last_peered":"2024-09-13T05:12:20.691157+0000","last_clean":"2024-09-13T05:12:20.691157+0000","last_became_active":"2024-09-13T05:10:37.869040+0000","last_became_peered":"2024-09-13T05:10:37.869040+0000","last_unstale":"2024-09-13T05:12:20.691157+0000","last_undegraded":"2024-09-13T05:12:20.691157+0000","last_fullsized":"2024-09-13T05:12:20.691157+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:48:18.385423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048152600000000002,"stat_sum":{"num_bytes":29490159,"num_objects":100,"num_object_clones":18,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":58,"num_read":2394,"num_read_kb":14549,"num_write":501,"num_write_kb":9668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":383717,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":150,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:20.691396+0000","last_change":"2024-09-13T05:12:03.636279+0000","last_active":"2024-09-13T05:12:20.691396+0000","last_peered":"2024-09-13T05:12:20.691396+0000","last_clean":"2024-09-13T05:12:20.691396+0000","last_became_active":"2024-09-13T05:12:03.635929+0000","last_became_peered":"2024-09-13T05:12:03.635929+0000","last_unstale":"2024-09-13T05:12:20.691396+0000","last_undegraded":"2024-09-13T05:12:20.691396+0000","last_fullsized":"2024-09-13T05:12:20.691396+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:58:02.386056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"111'535","reported_seq":2745,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:20.691494+0000","last_change":"2024-09-13T05:11:23.619138+0000","last_active":"2024-09-13T05:12:20.691494+0000","last_peered":"2024-09-13T05:12:20.691494+0000","last_clean":"2024-09-13T05:12:20.691494+0000","last_became_active":"2024-09-13T05:11:23.617149+0000","last_became_peered":"2024-09-13T05:11:23.617149+0000","last_unstale":"2024-09-13T05:12:20.691494+0000","last_undegraded":"2024-09-13T05:12:20.691494+0000","last_fullsized":"2024-09-13T05:12:20.691494+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:55:46.203366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059320200000000003,"stat_sum":{"num_bytes":25978778,"num_objects":104,"num_object_clones":11,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":61,"num_read":4411,"num_read_kb":10978,"num_write":443,"num_write_kb":5375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":2822984,"num_keys_recovered":34,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":127,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:20.686849+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:12:20.686849+0000","last_peered":"2024-09-13T05:12:20.686849+0000","last_clean":"2024-09-13T05:12:20.686849+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:12:20.686849+0000","last_undegraded":"2024-09-13T05:12:20.686849+0000","last_fullsized":"2024-09-13T05:12:20.686849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":309,"reported_epoch":129,"state":"peering","last_fresh":"2024-09-13T05:12:21.711248+0000","last_change":"2024-09-13T05:12:21.711373+0000","last_active":"2024-09-13T05:12:21.711248+0000","last_peered":"2024-09-13T05:12:20.710394+0000","last_clean":"2024-09-13T05:12:16.293415+0000","last_became_active":"2024-09-13T05:12:20.703188+0000","last_became_peered":"2024-09-13T05:12:20.703188+0000","last_unstale":"2024-09-13T05:12:21.711248+0000","last_undegraded":"2024-09-13T05:12:21.711248+0000","last_fullsized":"2024-09-13T05:12:21.711248+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:01:05.998410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"128'432","reported_seq":13525,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T05:12:21.717276+0000","last_change":"2024-09-13T05:12:12.655698+0000","last_active":"2024-09-13T05:12:21.717276+0000","last_peered":"2024-09-13T05:12:21.717276+0000","last_clean":"2024-09-13T05:12:21.717276+0000","last_became_active":"2024-09-13T05:12:12.653214+0000","last_became_peered":"2024-09-13T05:12:12.653214+0000","last_unstale":"2024-09-13T05:12:21.717276+0000","last_undegraded":"2024-09-13T05:12:21.717276+0000","last_fullsized":"2024-09-13T05:12:21.717276+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:11.574280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000500144,"stat_sum":{"num_bytes":15757891,"num_objects":127,"num_object_clones":21,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":76,"num_read":12606,"num_read_kb":12657,"num_write":335,"num_write_kb":27186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":2876772,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"128'595","reported_seq":7176,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T05:12:21.720090+0000","last_change":"2024-09-13T05:10:11.648218+0000","last_active":"2024-09-13T05:12:21.720090+0000","last_peered":"2024-09-13T05:12:21.720090+0000","last_clean":"2024-09-13T05:12:21.720090+0000","last_became_active":"2024-09-13T05:10:09.645408+0000","last_became_peered":"2024-09-13T05:10:09.645408+0000","last_unstale":"2024-09-13T05:12:21.720090+0000","last_undegraded":"2024-09-13T05:12:21.720090+0000","last_fullsized":"2024-09-13T05:12:21.720090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:59.846981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097828900000000002,"stat_sum":{"num_bytes":54863593,"num_objects":100,"num_object_clones":12,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":52,"num_read":9234,"num_read_kb":23049,"num_write":607,"num_write_kb":19096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"111'628","reported_seq":9484,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:20.691370+0000","last_change":"2024-09-13T05:10:47.940550+0000","last_active":"2024-09-13T05:12:20.691370+0000","last_peered":"2024-09-13T05:12:20.691370+0000","last_clean":"2024-09-13T05:12:20.691370+0000","last_became_active":"2024-09-13T05:10:47.939220+0000","last_became_peered":"2024-09-13T05:10:47.939220+0000","last_unstale":"2024-09-13T05:12:20.691370+0000","last_undegraded":"2024-09-13T05:12:20.691370+0000","last_fullsized":"2024-09-13T05:12:20.691370+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:59.693041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013204619999999999,"stat_sum":{"num_bytes":23003361,"num_objects":111,"num_object_clones":16,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":65,"num_read":9610,"num_read_kb":17397,"num_write":624,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":59,"num_bytes_recovered":6203954,"num_keys_recovered":18,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"111'547","reported_seq":5263,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:20.691335+0000","last_change":"2024-09-13T05:12:06.927050+0000","last_active":"2024-09-13T05:12:20.691335+0000","last_peered":"2024-09-13T05:12:20.691335+0000","last_clean":"2024-09-13T05:12:20.691335+0000","last_became_active":"2024-09-13T05:12:06.925294+0000","last_became_peered":"2024-09-13T05:12:06.925294+0000","last_unstale":"2024-09-13T05:12:20.691335+0000","last_undegraded":"2024-09-13T05:12:20.691335+0000","last_fullsized":"2024-09-13T05:12:20.691335+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:30:53.233405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055343700000000005,"stat_sum":{"num_bytes":7803536,"num_objects":116,"num_object_clones":21,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":116,"num_whiteouts":72,"num_read":5531,"num_read_kb":11303,"num_write":462,"num_write_kb":7796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":228,"num_bytes_recovered":3266237,"num_keys_recovered":23,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"128'567","reported_seq":1811,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:21.667482+0000","last_change":"2024-09-13T05:10:11.647302+0000","last_active":"2024-09-13T05:12:21.667482+0000","last_peered":"2024-09-13T05:12:21.667482+0000","last_clean":"2024-09-13T05:12:21.667482+0000","last_became_active":"2024-09-13T05:10:09.647037+0000","last_became_peered":"2024-09-13T05:10:09.647037+0000","last_unstale":"2024-09-13T05:12:21.667482+0000","last_undegraded":"2024-09-13T05:12:21.667482+0000","last_fullsized":"2024-09-13T05:12:21.667482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:54:17.061326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069994199999999995,"stat_sum":{"num_bytes":64191372,"num_objects":104,"num_object_clones":15,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":58,"num_read":2451,"num_read_kb":13969,"num_write":696,"num_write_kb":18996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"111'697","reported_seq":4217,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:20.693401+0000","last_change":"2024-09-13T05:11:23.617596+0000","last_active":"2024-09-13T05:12:20.693401+0000","last_peered":"2024-09-13T05:12:20.693401+0000","last_clean":"2024-09-13T05:12:20.693401+0000","last_became_active":"2024-09-13T05:11:23.616962+0000","last_became_peered":"2024-09-13T05:11:23.616962+0000","last_unstale":"2024-09-13T05:12:20.693401+0000","last_undegraded":"2024-09-13T05:12:20.693401+0000","last_fullsized":"2024-09-13T05:12:20.693401+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:19.035337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019283150000000001,"stat_sum":{"num_bytes":70964405,"num_objects":110,"num_object_clones":16,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":60,"num_read":5000,"num_read_kb":15407,"num_write":812,"num_write_kb":8729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":12781016,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"111'997","reported_seq":7305,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:20.697231+0000","last_change":"2024-09-13T05:12:10.638495+0000","last_active":"2024-09-13T05:12:20.697231+0000","last_peered":"2024-09-13T05:12:20.697231+0000","last_clean":"2024-09-13T05:12:20.697231+0000","last_became_active":"2024-09-13T05:12:10.636822+0000","last_became_peered":"2024-09-13T05:12:10.636822+0000","last_unstale":"2024-09-13T05:12:20.697231+0000","last_undegraded":"2024-09-13T05:12:20.697231+0000","last_fullsized":"2024-09-13T05:12:20.697231+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":997,"log_dups_size":0,"ondisk_log_size":997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:51:55.639540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018982339999999999,"stat_sum":{"num_bytes":35729453,"num_objects":110,"num_object_clones":12,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":69,"num_read":8264,"num_read_kb":9703,"num_write":1377,"num_write_kb":6429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":424,"num_bytes_recovered":12485464,"num_keys_recovered":57,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"128'780","reported_seq":4817,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:21.662408+0000","last_change":"2024-09-13T05:12:08.628794+0000","last_active":"2024-09-13T05:12:21.662408+0000","last_peered":"2024-09-13T05:12:21.662408+0000","last_clean":"2024-09-13T05:12:21.662408+0000","last_became_active":"2024-09-13T05:12:08.627423+0000","last_became_peered":"2024-09-13T05:12:08.627423+0000","last_unstale":"2024-09-13T05:12:21.662408+0000","last_undegraded":"2024-09-13T05:12:21.662408+0000","last_fullsized":"2024-09-13T05:12:21.662408+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:20:20.740244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001164273,"stat_sum":{"num_bytes":19975461,"num_objects":123,"num_object_clones":19,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123,"num_whiteouts":76,"num_read":5915,"num_read_kb":13050,"num_write":978,"num_write_kb":7461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":4044295,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"128'526","reported_seq":3069,"reported_epoch":129,"state":"active+undersized+remapped","last_fresh":"2024-09-13T05:12:21.855199+0000","last_change":"2024-09-13T05:12:21.855199+0000","last_active":"2024-09-13T05:12:21.855199+0000","last_peered":"2024-09-13T05:12:21.855199+0000","last_clean":"2024-09-13T05:12:16.441033+0000","last_became_active":"2024-09-13T05:12:20.709802+0000","last_became_peered":"2024-09-13T05:12:20.709802+0000","last_unstale":"2024-09-13T05:12:21.855199+0000","last_undegraded":"2024-09-13T05:12:21.855199+0000","last_fullsized":"2024-09-13T05:12:20.686901+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:07:06.792845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009951719999999999,"stat_sum":{"num_bytes":46946744,"num_objects":125,"num_object_clones":10,"num_object_copies":250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":68,"num_read":3104,"num_read_kb":15621,"num_write":517,"num_write_kb":23166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":406,"num_bytes_recovered":27581720,"num_keys_recovered":44,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5],"avail_no_missing":["5","3","6"],"object_location_counts":[{"shards":"5","objects":125}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"128'404","reported_seq":8328,"reported_epoch":129,"state":"peering","last_fresh":"2024-09-13T05:12:21.711825+0000","last_change":"2024-09-13T05:12:21.712239+0000","last_active":"2024-09-13T05:12:21.711825+0000","last_peered":"2024-09-13T05:12:21.708701+0000","last_clean":"2024-09-13T05:12:16.674952+0000","last_became_active":"2024-09-13T05:12:20.711445+0000","last_became_peered":"2024-09-13T05:12:20.711445+0000","last_unstale":"2024-09-13T05:12:21.711825+0000","last_undegraded":"2024-09-13T05:12:21.711825+0000","last_fullsized":"2024-09-13T05:12:21.711825+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:42:07.055560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000625977,"stat_sum":{"num_bytes":24198881,"num_objects":123,"num_object_clones":19,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123,"num_whiteouts":77,"num_read":7613,"num_read_kb":13018,"num_write":318,"num_write_kb":20644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":16529867,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"111'883","reported_seq":4036,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:20.693141+0000","last_change":"2024-09-13T05:10:40.884306+0000","last_active":"2024-09-13T05:12:20.693141+0000","last_peered":"2024-09-13T05:12:20.693141+0000","last_clean":"2024-09-13T05:12:20.693141+0000","last_became_active":"2024-09-13T05:10:40.883543+0000","last_became_peered":"2024-09-13T05:10:40.883543+0000","last_unstale":"2024-09-13T05:12:20.693141+0000","last_undegraded":"2024-09-13T05:12:20.693141+0000","last_fullsized":"2024-09-13T05:12:20.693141+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":883,"log_dups_size":0,"ondisk_log_size":883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:14:23.460182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048307200000000003,"stat_sum":{"num_bytes":63127284,"num_objects":102,"num_object_clones":17,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":56,"num_read":6628,"num_read_kb":24823,"num_write":1116,"num_write_kb":8176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":633324,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"111'904","reported_seq":3415,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T05:12:20.692766+0000","last_change":"2024-09-13T05:10:11.680877+0000","last_active":"2024-09-13T05:12:20.692766+0000","last_peered":"2024-09-13T05:12:20.692766+0000","last_clean":"2024-09-13T05:12:20.692766+0000","last_became_active":"2024-09-13T05:10:09.649053+0000","last_became_peered":"2024-09-13T05:10:09.649053+0000","last_unstale":"2024-09-13T05:12:20.692766+0000","last_undegraded":"2024-09-13T05:12:20.692766+0000","last_fullsized":"2024-09-13T05:12:20.692766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:14.770260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062821800000000005,"stat_sum":{"num_bytes":49888419,"num_objects":128,"num_object_clones":24,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":128,"num_whiteouts":71,"num_read":5358,"num_read_kb":52981,"num_write":1199,"num_write_kb":39218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1397017345,"num_objects":3582,"num_object_clones":513,"num_object_copies":7164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":120,"num_objects_unfound":0,"num_objects_dirty":3582,"num_whiteouts":2044,"num_read":207010,"num_read_kb":572130,"num_write":22157,"num_write_kb":503491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4972,"num_bytes_recovered":180383554,"num_keys_recovered":517,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598220800,"data_stored":645619874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20027,"ondisk_log_size":20027,"up":64,"acting":60,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":208812,"kb_used_data":137500,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94163028,"statfs":{"total":96636764160,"available":96422940672,"internally_reserved":0,"allocated":140800000,"data_stored":147898468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":73005515},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.753}]},{"osd":1,"last update":"Fri Sep 13 05:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.80900000000000005,"15min":0.81899999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.871,"5min":0.80700000000000005,"15min":0.79700000000000004},"min":{"1min":0.60899999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.2090000000000001,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.0309999999999999}]},{"osd":2,"last update":"Fri Sep 13 05:11:53 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.84799999999999998,"15min":0.85399999999999998},"min":{"1min":0.52400000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.81000000000000005,"15min":0.78400000000000003},"min":{"1min":0.59299999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.337,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.155}]},{"osd":3,"last update":"Fri Sep 13 05:11:53 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.84999999999999998,"15min":0.86099999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.232,"5min":1.296,"15min":1.296},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.90200000000000002,"15min":0.90500000000000003},"min":{"1min":0.54600000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2529999999999999,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.0669999999999999}]},{"osd":4,"last update":"Fri Sep 13 05:11:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76700000000000002,"15min":0.76500000000000001},"min":{"1min":0.46600000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1899999999999999,"5min":1.204,"15min":1.204},"last":1.101},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.92400000000000004,"15min":0.93000000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.131}]},{"osd":5,"last update":"Fri Sep 13 05:11:53 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.94999999999999996,"15min":0.94899999999999995},"min":{"1min":0.47599999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.395,"5min":1.655,"15min":1.655},"last":1.202},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.93999999999999995,"15min":0.94299999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.177,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.179}]},{"osd":6,"last update":"Fri Sep 13 05:11:53 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.91000000000000003,"15min":0.91200000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.03,"15min":1.034},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2789999999999999,"5min":1.377,"15min":1.377},"last":1.246}]}]},{"osd":6,"up_from":0,"seq":55834574881,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166672,"kb_used_data":117504,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94205168,"statfs":{"total":96636764160,"available":96466092032,"internally_reserved":0,"allocated":120324096,"data_stored":126674584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.65300000000000002}]},{"osd":1,"last update":"Fri Sep 13 05:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.86299999999999999,"15min":0.88100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.161,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.89800000000000002,"15min":0.92000000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.2709999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.81899999999999995}]},{"osd":2,"last update":"Fri Sep 13 05:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.83099999999999996,"15min":0.84999999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.262,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.88300000000000001,"15min":0.89200000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.97799999999999998}]},{"osd":3,"last update":"Fri Sep 13 05:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.90100000000000002,"15min":0.92600000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.175,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.98899999999999999,"15min":1.02},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.236,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.755}]},{"osd":4,"last update":"Fri Sep 13 05:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.93400000000000005,"15min":0.96399999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1950000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.86399999999999999,"5min":1.077,"15min":1.113},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.3520000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.093}]},{"osd":6,"last update":"Fri Sep 13 05:12:00 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.93100000000000005,"15min":0.95099999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.84299999999999997,"5min":1.0129999999999999,"15min":1.0409999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.2789999999999999,"5min":1.528,"15min":1.528},"last":1.05}]},{"osd":7,"last update":"Fri Sep 13 05:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":1.151,"15min":1.194},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3080000000000001,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.002},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.1379999999999999,"15min":1.1679999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.619,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.073}]}]},{"osd":4,"up_from":0,"seq":55834574883,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":171552,"kb_used_data":123144,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94200288,"statfs":{"total":96636764160,"available":96461094912,"internally_reserved":0,"allocated":126099456,"data_stored":140010701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.51000000000000001}]},{"osd":1,"last update":"Fri Sep 13 05:12:00 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92600000000000005,"5min":1.089,"15min":1.089},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.71199999999999997,"15min":0.72799999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0720000000000001,"5min":1.125,"15min":1.125},"last":0.45300000000000001}]},{"osd":2,"last update":"Fri Sep 13 05:12:00 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73899999999999999,"15min":0.74399999999999999},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":1.089,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.82899999999999996,"15min":0.85099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1339999999999999,"5min":1.573,"15min":1.573},"last":0.49299999999999999}]},{"osd":4,"last update":"Fri Sep 13 05:12:00 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.87,"15min":0.90000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.98899999999999999,"5min":1.48,"15min":1.48},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.91600000000000004,"15min":0.93500000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.236,"5min":1.764,"15min":1.764},"last":0.66200000000000003}]},{"osd":5,"last update":"Fri Sep 13 05:12:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.995,"15min":1.0209999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.6890000000000001,"5min":2.157,"15min":2.157},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.95399999999999996,"15min":0.99199999999999999},"min":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0780000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.68400000000000005}]},{"osd":6,"last update":"Fri Sep 13 05:12:00 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.96899999999999997,"15min":0.98899999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3899999999999999,"5min":1.976,"15min":1.976},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.85999999999999999,"5min":1.071,"15min":1.1060000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2,"5min":2.012,"15min":2.012},"last":0.57099999999999995}]},{"osd":7,"last update":"Fri Sep 13 05:12:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":1.0600000000000001,"15min":1.0880000000000001},"min":{"1min":0.67700000000000005,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1599999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":1.0840000000000001,"15min":1.1080000000000001},"min":{"1min":0.68200000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.2,"5min":1.875,"15min":1.875},"last":0.58599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127172,"kb_used_data":55864,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94244668,"statfs":{"total":96636764160,"available":96506540032,"internally_reserved":0,"allocated":57204736,"data_stored":60377775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73005510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.77500000000000002}]},{"osd":1,"last update":"Fri Sep 13 05:11:52 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.65200000000000002,"15min":0.67000000000000004},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.89000000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65100000000000002,"15min":0.65700000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.032,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.66400000000000003}]},{"osd":3,"last update":"Fri Sep 13 05:11:52 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.66600000000000004,"15min":0.622},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":6.6070000000000002,"5min":6.6070000000000002,"15min":6.6070000000000002},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.66300000000000003,"15min":0.65600000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.90500000000000003}]},{"osd":4,"last update":"Fri Sep 13 05:11:52 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76100000000000001,"15min":0.76200000000000001},"min":{"1min":0.45900000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.88,"15min":0.88900000000000001},"min":{"1min":0.56699999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.232,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.878}]},{"osd":5,"last update":"Fri Sep 13 05:11:52 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.88400000000000001,"15min":0.89600000000000002},"min":{"1min":0.51000000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.278,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.84999999999999998,"15min":0.85599999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.262}]},{"osd":6,"last update":"Fri Sep 13 05:11:52 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.876,"15min":0.87},"min":{"1min":0.51400000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.282,"5min":1.306,"15min":1.306},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.93899999999999995,"15min":0.94499999999999995},"min":{"1min":0.60999999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.353,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.0880000000000001}]},{"osd":7,"last update":"Fri Sep 13 05:11:52 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.0189999999999999,"15min":1.032},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.153,"5min":1.867,"15min":1.867},"last":0.998},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.96399999999999997,"15min":0.97199999999999998},"min":{"1min":0.61399999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3500000000000001,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.284}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139120,"kb_used_data":108004,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94232720,"statfs":{"total":96636764160,"available":96494305280,"internally_reserved":0,"allocated":110596096,"data_stored":117113223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.73099999999999998}]},{"osd":2,"last update":"Fri Sep 13 05:11:57 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.64600000000000002,"15min":0.60999999999999999},"min":{"1min":0.27500000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":5.952,"5min":5.952,"15min":5.952},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69599999999999995,"15min":0.70099999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.64500000000000002}]},{"osd":3,"last update":"Fri Sep 13 05:11:57 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.76200000000000001,"15min":0.77800000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.083,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.74299999999999999,"15min":0.75700000000000001},"min":{"1min":0.35099999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":0.82699999999999996}]},{"osd":4,"last update":"Fri Sep 13 05:11:57 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.91300000000000003,"15min":0.92900000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.92300000000000004,"15min":0.94499999999999995},"min":{"1min":0.502,"5min":0.439,"15min":0.439},"max":{"1min":1.1259999999999999,"5min":1.724,"15min":1.724},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Sep 13 05:11:57 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.90700000000000003,"15min":0.92700000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.27,"5min":1.484,"15min":1.484},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.87,"5min":0.92400000000000004,"15min":0.93300000000000005},"min":{"1min":0.58399999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.93999999999999995}]},{"osd":6,"last update":"Fri Sep 13 05:11:57 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.98499999999999999,"15min":1.0109999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1970000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.357},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.99399999999999999,"15min":1.012},"min":{"1min":0.55100000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.4339999999999999,"5min":1.873,"15min":1.873},"last":0.86499999999999999}]},{"osd":7,"last update":"Fri Sep 13 05:11:57 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":1.0129999999999999,"15min":1.0229999999999999},"min":{"1min":0.64600000000000002,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.298,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0249999999999999,"15min":1.034},"min":{"1min":0.61199999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.2689999999999999}]}]},{"osd":0,"up_from":0,"seq":532575944708,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10035200,"data_stored":11939429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":95600640,"data_stored":102920630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":56176640,"data_stored":60948340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":133931008,"data_stored":148642359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":115671040,"data_stored":122804719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":64749568,"data_stored":68401288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":122056704,"data_stored":129963109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:12:24.579 INFO:tasks.thrashosds.thrasher:Setting 3.1b to [0, 5, 1, 6] 2024-09-13T05:12:24.579 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.1b', '0', '5', '1', '6'] 2024-09-13T05:12:24.579 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.1b 0 5 1 6 2024-09-13T05:12:24.600 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:24.600 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:24.609 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:12:24.610 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:24.607+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:24.618 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:12:24.712 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:24.707+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:24.718 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:24.718 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:24.728 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:12:24.749 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is set 2024-09-13T05:12:24.760 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:12:24.781 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:24.800 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:24.813 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:24.808+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:24.820 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:24.837 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:24.838 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:24.848 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:12:24.849 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:24.873 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:24.881 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone39 from 0x8e6bc11 (overlap 0x18df0a) to 0x0 2024-09-13T05:12:24.899 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:24.914 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:24.912+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:24.920 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:24.922 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:12:24.922 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:24.922 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:24.923 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:24.923 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:24.923 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:24.923 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:24.923 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:24.952 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:24.952 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:24.952 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:24.952 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:24.952 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:24.962 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:12:25.015 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:25.012+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:25.073 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:25.073 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:25.074 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:25.074 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:25.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.074 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:25.074 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:25.074 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 108.20575108, 2024-09-13T05:12:25.074 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:12:25.075 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:25.075 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:25.075 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:25.075 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:25.075 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:25.075 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:12:25.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.075 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:25.076 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.076 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:25.076 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:25.076 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.076 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.076 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.076 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:25.076 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:25.076 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.076 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.077 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.077 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:25.077 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:25.077 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:25.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.077 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.077 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:25.077 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:12:25.077 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:12:25.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.077 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.077 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:25.078 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:12:25.078 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:12:25.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.078 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:25.078 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:12:25.078 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:12:25.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.078 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.078 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:12:25.078 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:12:25.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.079 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.079 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:25.079 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:12:25.079 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:12:25.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.079 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.079 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.079 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:12:25.079 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:12:25.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.079 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.079 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:25.079 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:12:25.080 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:12:25.080 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.080 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.080 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:25.080 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:12:25.080 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:12:25.080 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.080 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:25.080 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.080 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.080 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.080 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:25.080 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:25.080 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 108.20572664399999, 2024-09-13T05:12:25.081 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:12:25.081 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:25.081 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:25.081 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:25.081 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:25.081 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:25.081 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:12:25.081 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.081 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:25.081 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.081 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:25.081 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:25.081 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.082 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.082 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.082 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:25.082 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:25.082 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.082 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.082 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.082 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:25.082 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:25.082 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:25.082 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.082 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.082 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:25.082 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:12:25.082 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:12:25.083 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.083 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.083 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:25.083 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:12:25.083 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:12:25.083 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.083 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.083 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:25.083 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:12:25.083 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:12:25.083 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.083 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.083 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.083 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:12:25.084 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:12:25.084 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.084 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.084 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:25.084 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:12:25.084 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:12:25.084 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.084 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.085 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.085 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:12:25.085 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:12:25.085 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.085 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.085 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:25.089 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:12:25.089 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:12:25.089 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.089 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.089 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:25.089 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:12:25.089 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:12:25.089 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.089 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:25.090 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.090 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.090 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.090 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:25.090 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:25.090 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 108.205716818, 2024-09-13T05:12:25.090 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:12:25.090 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:25.090 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:25.090 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:25.090 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:25.090 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:25.090 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:12:25.090 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.091 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:25.091 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.091 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:25.091 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:25.091 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.091 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.091 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.091 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:25.091 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:25.091 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.091 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.091 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.091 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:25.091 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:25.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:25.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.092 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.092 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:25.092 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:12:25.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:12:25.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.092 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.092 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:25.092 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:12:25.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:12:25.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.092 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:25.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:12:25.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:12:25.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:12:25.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:12:25.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:25.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:12:25.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:12:25.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.094 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:12:25.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:12:25.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.094 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:25.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:12:25.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:12:25.094 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.094 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:25.095 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.095 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.095 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.095 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:25.095 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:25.095 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 108.205708582, 2024-09-13T05:12:25.095 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:12:25.095 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:25.095 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:25.095 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:25.095 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:25.095 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:25.095 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:12:25.096 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.096 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:25.096 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.096 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:25.096 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:25.096 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.097 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.097 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.097 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:25.097 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:25.097 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.097 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.097 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.098 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:25.098 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:25.098 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:25.098 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.098 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.098 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:25.098 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:12:25.098 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:12:25.098 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.098 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.098 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:25.098 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:12:25.098 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:12:25.098 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.098 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.099 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:25.099 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:12:25.099 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:12:25.099 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.099 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.099 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.099 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:12:25.099 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:12:25.099 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.100 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.100 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:25.100 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:12:25.100 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:12:25.100 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.100 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.100 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.100 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:12:25.100 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:12:25.100 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.100 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.100 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:25.100 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:12:25.101 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:12:25.101 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.101 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:25.101 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.101 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.101 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.101 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:25.101 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:25.101 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 108.20568667000001, 2024-09-13T05:12:25.101 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:12:25.101 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:25.101 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:25.101 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:25.102 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:25.102 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:25.102 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:12:25.102 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.102 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:25.102 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.102 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:25.102 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:25.102 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.102 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.102 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.102 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:25.102 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:25.103 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.103 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.103 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.103 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:25.103 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:25.103 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:25.103 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.103 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.103 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:25.103 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:12:25.103 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:12:25.103 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.103 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.103 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:25.104 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:12:25.104 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:12:25.104 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.104 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.104 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:25.104 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:12:25.104 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:12:25.104 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.104 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.104 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.105 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:12:25.105 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:12:25.105 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.105 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.105 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:25.105 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:12:25.105 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:12:25.105 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.105 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.105 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.105 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:12:25.105 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:12:25.106 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.106 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.106 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:25.107 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:12:25.107 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:12:25.107 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.107 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:25.107 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.107 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.107 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.107 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:25.108 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:25.108 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 108.205678066, 2024-09-13T05:12:25.108 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:12:25.108 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:25.108 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:25.108 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:25.108 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:25.108 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:25.108 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:12:25.108 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.108 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:25.108 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.108 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:25.109 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:25.109 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.109 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.109 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.109 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:25.109 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:25.109 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.109 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.109 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.109 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:25.109 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:25.110 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:25.110 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.110 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.110 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:25.110 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:12:25.110 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:12:25.110 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.110 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.110 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:25.111 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:12:25.111 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:12:25.111 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.111 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.111 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:25.111 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:12:25.111 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:12:25.111 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.111 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.111 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.111 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:12:25.111 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:12:25.111 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.112 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.112 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:25.112 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:12:25.112 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:12:25.112 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.112 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.112 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.113 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:12:25.113 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:12:25.113 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.113 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.113 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:25.113 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:12:25.113 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:12:25.113 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.113 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:25.113 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.113 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.113 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.114 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:25.114 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:25.114 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 108.20566837200001, 2024-09-13T05:12:25.114 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:12:25.114 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:25.114 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:25.114 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:25.114 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:25.114 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:25.114 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:12:25.114 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.114 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:25.114 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.114 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:25.115 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:25.115 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.115 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.115 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.115 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:25.115 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:25.115 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.115 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.115 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.115 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:25.115 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:25.116 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:25.116 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.116 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.116 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:25.116 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:12:25.116 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:12:25.116 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.116 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.116 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:25.116 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:12:25.117 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:12:25.117 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.117 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.117 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:25.117 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:12:25.117 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:12:25.117 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.117 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.117 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.117 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:12:25.117 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:12:25.117 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.118 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.118 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:25.118 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:12:25.118 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:12:25.118 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.118 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.118 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.118 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:12:25.118 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:12:25.118 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.118 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.118 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:25.118 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:12:25.119 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:12:25.119 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.119 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:25.119 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.119 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.119 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.119 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:25.119 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:25.119 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 108.20565925699999, 2024-09-13T05:12:25.119 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:12:25.119 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:25.119 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:25.119 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:25.119 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:25.120 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:25.120 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:12:25.120 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.120 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:25.120 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.120 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:25.120 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:25.120 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.120 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.120 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.121 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:25.121 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:25.121 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.121 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.121 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.121 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:25.121 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:25.121 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:25.121 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.121 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.121 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:25.121 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:12:25.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:12:25.122 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.122 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.122 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:25.122 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:12:25.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:12:25.122 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.122 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.122 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:25.122 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:12:25.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:12:25.123 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.123 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.123 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.123 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:12:25.123 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:12:25.123 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.123 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.123 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:25.123 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:12:25.123 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:12:25.123 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.123 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.123 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.124 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:12:25.124 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:12:25.124 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.124 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.124 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:25.124 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:12:25.124 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:12:25.124 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.124 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:25.124 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.124 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.124 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.124 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:25.125 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:12:25.125 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 108.20565077800001, 2024-09-13T05:12:25.125 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:12:25.125 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:25.125 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:25.125 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:25.125 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:25.125 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:25.125 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:12:25.125 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.125 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:25.125 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.125 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:25.125 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:12:25.126 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.126 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.126 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.126 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:25.126 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:12:25.126 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.126 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.126 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.126 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:25.126 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:12:25.126 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:25.126 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.126 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.126 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:25.127 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:12:25.127 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:12:25.127 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.127 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.127 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:25.127 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:12:25.127 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:12:25.127 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.127 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.127 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:25.127 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:12:25.127 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:12:25.127 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.127 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.127 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.128 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:12:25.128 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:12:25.128 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.128 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.128 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:25.128 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:12:25.128 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:12:25.128 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.128 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.128 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.128 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:12:25.128 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:12:25.128 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.129 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.129 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:25.129 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:12:25.129 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:12:25.129 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.129 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:25.129 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.129 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.129 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:25.129 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:12:25.129 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 108.205638853, 2024-09-13T05:12:25.129 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:12:25.130 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:25.130 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:25.130 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:25.130 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:25.130 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:25.130 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:12:25.130 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.130 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:25.130 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.130 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:25.130 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:12:25.130 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.130 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.130 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.131 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:25.131 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:12:25.131 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.131 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.131 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.131 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:25.131 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:12:25.131 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:25.131 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.132 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.132 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:25.132 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:12:25.132 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:12:25.132 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.132 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.132 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:25.132 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:12:25.132 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:12:25.132 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.133 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.133 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:25.133 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:12:25.133 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:12:25.133 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.133 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.133 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.133 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:12:25.133 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:12:25.133 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.133 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.133 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:25.133 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:12:25.133 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:12:25.134 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.134 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.134 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.134 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:12:25.134 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:12:25.134 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.134 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.134 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:25.134 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:12:25.134 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:12:25.135 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.135 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:25.135 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.135 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.135 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.135 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:25.135 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:25.135 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 108.205617264, 2024-09-13T05:12:25.135 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:12:25.136 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:25.136 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:25.136 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:25.136 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:25.136 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:25.136 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:12:25.136 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.136 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:25.136 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.136 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:25.136 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:25.136 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.137 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.137 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:25.137 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:25.137 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.137 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.137 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:25.137 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:25.137 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:25.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.137 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.138 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:25.138 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:12:25.138 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:12:25.138 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.138 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.138 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:25.138 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:12:25.138 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:12:25.138 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.138 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.138 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:25.138 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:12:25.138 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:12:25.139 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.139 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.139 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.139 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:12:25.139 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:12:25.139 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.139 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.139 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:25.139 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:12:25.139 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:12:25.139 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.139 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.139 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.139 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:12:25.140 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:12:25.140 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.140 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.140 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:25.140 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:12:25.140 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:12:25.140 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.140 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:25.140 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.140 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.140 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.140 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:25.141 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:25.141 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 108.205594136, 2024-09-13T05:12:25.141 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:12:25.141 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:25.141 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:25.141 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:25.141 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:25.141 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:25.141 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:12:25.141 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.141 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:25.142 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.142 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:25.142 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:25.142 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.142 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.142 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.142 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:25.142 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:25.142 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.142 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.143 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.143 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:25.143 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:25.143 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:25.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.143 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.143 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:25.143 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:12:25.143 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:12:25.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.143 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.143 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:25.143 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:12:25.143 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:12:25.144 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.144 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.144 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:25.144 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:12:25.144 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:12:25.144 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.144 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.144 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.144 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:12:25.144 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:12:25.144 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.144 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.144 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:25.145 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:12:25.145 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:12:25.145 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.145 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.145 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.145 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:12:25.145 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:12:25.145 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.145 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.145 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:25.145 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:12:25.146 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:12:25.146 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.146 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:25.146 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.146 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.146 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.146 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:25.146 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:12:25.146 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 108.20557876300001, 2024-09-13T05:12:25.146 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:12:25.146 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:25.146 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:25.146 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:25.147 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:25.147 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:25.147 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:12:25.147 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.147 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:25.147 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.147 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:25.147 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:12:25.147 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.147 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.147 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.147 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:25.147 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:12:25.148 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.148 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.148 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:25.148 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:12:25.148 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:25.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.148 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.148 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:25.148 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:12:25.148 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:12:25.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.149 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.149 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:25.149 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:12:25.149 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:12:25.149 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.149 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.149 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:25.149 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:12:25.149 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:12:25.149 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.149 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.149 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.149 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:12:25.150 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:12:25.150 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.150 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.150 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:25.150 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:12:25.150 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:12:25.150 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.150 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.150 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.150 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:12:25.150 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:12:25.150 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.150 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.151 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:25.151 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:12:25.151 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:12:25.151 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.151 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:25.151 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.151 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.151 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.151 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:25.151 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:25.151 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 108.205558295, 2024-09-13T05:12:25.151 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:12:25.151 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:25.151 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:25.152 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:25.152 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:25.152 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:25.152 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:12:25.152 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.152 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:25.152 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.152 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:25.153 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:25.153 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.153 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.153 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.153 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:25.153 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:25.153 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.153 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.153 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.153 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:25.153 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:25.153 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:25.153 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.153 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.154 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:25.154 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:12:25.154 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:12:25.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.154 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.154 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:25.154 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:12:25.154 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:12:25.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.154 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.154 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:25.154 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:12:25.154 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:12:25.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.154 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:12:25.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:12:25.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:25.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:12:25.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:12:25.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:12:25.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:12:25.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.156 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.156 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:25.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:12:25.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:12:25.156 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.156 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:25.157 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.157 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.157 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:25.157 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:25.157 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 108.205541634, 2024-09-13T05:12:25.157 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:12:25.157 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:25.157 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:25.158 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:25.158 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:25.158 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:25.158 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:12:25.158 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.158 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:25.158 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.158 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:25.158 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:25.158 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.158 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.158 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.159 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:25.159 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:25.159 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.159 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.159 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:25.159 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:25.159 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:25.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.159 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.159 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:25.159 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:12:25.159 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:12:25.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.159 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:25.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:12:25.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:12:25.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:25.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:12:25.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:12:25.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:12:25.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:12:25.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.161 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:25.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:12:25.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:12:25.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.161 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:12:25.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:12:25.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.161 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:25.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:12:25.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:12:25.162 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.162 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:25.162 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.162 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.162 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.162 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:25.162 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:12:25.162 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 108.205514921, 2024-09-13T05:12:25.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:12:25.162 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:25.162 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:25.162 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:25.163 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:25.163 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:25.163 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:12:25.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.163 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:25.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.163 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:25.163 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:12:25.163 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.164 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:25.164 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:12:25.164 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.164 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.164 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.164 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:25.164 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:12:25.164 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:25.164 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.164 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.164 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:25.164 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:12:25.164 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:12:25.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.165 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.165 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:25.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:12:25.165 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:12:25.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.165 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.165 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:25.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:12:25.165 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:12:25.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.166 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.166 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:12:25.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:12:25.166 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.166 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:25.166 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:12:25.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:12:25.166 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.166 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.166 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:12:25.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:12:25.167 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.167 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:25.167 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:12:25.167 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:12:25.167 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.167 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:25.167 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.167 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.167 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:25.167 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:25.167 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 108.20549606900001, 2024-09-13T05:12:25.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:12:25.168 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:25.168 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:25.168 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:25.168 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:25.168 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:25.168 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:12:25.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.168 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:25.168 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.168 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:25.168 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:25.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:25.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:25.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:25.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:25.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:25.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:25.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:12:25.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:12:25.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:25.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:12:25.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:12:25.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:25.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:12:25.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:12:25.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.171 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:12:25.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:12:25.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.171 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:25.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:12:25.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:12:25.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.171 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:12:25.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:12:25.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:25.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:12:25.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:12:25.172 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.172 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:25.172 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.173 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:25.173 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:25.173 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 108.20547828300001, 2024-09-13T05:12:25.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:12:25.173 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:25.173 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:25.173 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:25.173 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:25.173 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:25.174 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:12:25.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.174 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:25.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:25.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:25.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:25.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:25.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.175 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:25.175 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:25.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:25.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.175 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:25.175 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:12:25.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:12:25.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:25.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:12:25.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:12:25.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:25.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:12:25.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:12:25.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:12:25.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:12:25.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:25.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:12:25.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:12:25.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:12:25.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:12:25.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:25.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:12:25.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:12:25.179 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.179 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:25.179 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.179 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:25.180 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:25.180 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 108.205443223, 2024-09-13T05:12:25.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:12:25.180 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:25.180 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:25.180 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:25.180 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:25.180 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:25.180 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:12:25.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.181 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:25.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:25.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:25.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:25.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:25.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:25.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:25.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:25.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:25.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:12:25.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:12:25.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:25.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:12:25.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:12:25.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.184 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:25.184 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:12:25.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:12:25.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.184 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.185 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:12:25.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:12:25.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:25.185 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:12:25.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:12:25.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:12:25.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:12:25.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:25.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:12:25.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:12:25.187 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.187 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:25.187 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.187 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:25.187 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:25.187 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 108.20542640799999, 2024-09-13T05:12:25.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:12:25.188 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:25.188 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:25.188 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:25.188 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:25.188 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:25.188 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:12:25.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.188 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:25.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:25.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:25.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:25.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:25.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:25.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:25.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:25.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:25.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:25.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:12:25.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:12:25.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:25.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:12:25.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:12:25.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:25.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:12:25.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:12:25.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:12:25.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:12:25.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:25.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:12:25.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:12:25.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:25.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:12:25.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:12:25.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:25.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:25.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:25.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:12:25.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:12:25.192 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.193 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:25.193 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.193 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:25.193 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:25.193 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:25.194 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #38, image image_client.0-clone38 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent39 2024-09-13T05:12:25.195 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:12:25.195 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:25.192+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:25.295 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:25.292+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:25.390 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:25.390 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:25.390 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:25.390 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:25.397 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:25.396+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:25.404 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:12:25.497 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:25.492+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:25.564 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:25.564 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:25.564 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:25.565 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:25.565 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:25.579 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:12:25.598 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:25.595+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:25.698 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:25.696+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:25.735 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:25.736 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:25.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:25.736 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [] 2024-09-13T05:12:25.736 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:25.750 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:12:25.789 INFO:teuthology.orchestra.run.smithi120.stderr:set 3.1b pg_upmap_items mapping to [0->5,1->6] 2024-09-13T05:12:25.799 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:25.796+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:25.899 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:25.895+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:25.927 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:25.927 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:25.927 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:25.927 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:25.938 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:12:26.001 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:25.996+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:26.086 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:26.086 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:26.086 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:26.087 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:26.087 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:26.099 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:12:26.101 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:26.096+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:26.161 INFO:teuthology.orchestra.run.smithi120.stdout:5252 writesame 0xae22daa thru 0xae27ce1 data_size 0x34(0x4f38 bytes) 2024-09-13T05:12:26.161 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:26.161 INFO:teuthology.orchestra.run.smithi120.stdout:5254 read 0x2913dfa thru 0x291d143 (0x934a bytes) 2024-09-13T05:12:26.183 INFO:teuthology.orchestra.run.smithi120.stdout:5256 write 0xe48a765 thru 0xe492d07 (0x85a3 bytes) 2024-09-13T05:12:26.189 INFO:teuthology.orchestra.run.smithi120.stdout:5257 read 0x14419c4 thru 0x144b35a (0x9997 bytes) 2024-09-13T05:12:26.202 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:26.203 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:26.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:26.203 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:26.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.204 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:159451 3.1b e117/116 3:d9c87acb:::rbd_data.112dc3abcba6.0000000000000003:head v 117'567, mlcod=0'0)", 2024-09-13T05:12:26.204 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:12:26.204 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.261505329999999, 2024-09-13T05:12:26.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064897325000000006, 2024-09-13T05:12:26.204 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.204 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:26.204 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:12:26.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:12:26.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938207+0000", 2024-09-13T05:12:26.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:26.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972794+0000", 2024-09-13T05:12:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.034587013 2024-09-13T05:12:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972821+0000", 2024-09-13T05:12:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6764e-05 2024-09-13T05:12:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972841+0000", 2024-09-13T05:12:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0191999999999999e-05 2024-09-13T05:12:26.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972905+0000", 2024-09-13T05:12:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4319000000000005e-05 2024-09-13T05:12:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972927+0000", 2024-09-13T05:12:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1135999999999999e-05 2024-09-13T05:12:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:12:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.002964+0000", 2024-09-13T05:12:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.030037123999999998 2024-09-13T05:12:26.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.003105+0000", 2024-09-13T05:12:26.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141614 2024-09-13T05:12:26.208 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.208 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.208 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.208 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159495 3.0 3:022f4da1:::rbd_data.112dfd94ee88.00000000000000e4:2a [read 167936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:26.208 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:12:26.208 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.186365908999999, 2024-09-13T05:12:26.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91926946899999995, 2024-09-13T05:12:26.208 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.209 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.209 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.209 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.209 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.209 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159495 2024-09-13T05:12:26.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.209 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:12:26.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:12:26.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013345+0000", 2024-09-13T05:12:26.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999971 2024-09-13T05:12:26.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013359+0000", 2024-09-13T05:12:26.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4752999999999999e-05 2024-09-13T05:12:26.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013418+0000", 2024-09-13T05:12:26.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8959000000000003e-05 2024-09-13T05:12:26.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013439+0000", 2024-09-13T05:12:26.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0749000000000001e-05 2024-09-13T05:12:26.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013563+0000", 2024-09-13T05:12:26.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012349400000000001 2024-09-13T05:12:26.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:26.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013583+0000", 2024-09-13T05:12:26.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0007e-05 2024-09-13T05:12:26.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932400+0000", 2024-09-13T05:12:26.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91881732400000005 2024-09-13T05:12:26.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932533+0000", 2024-09-13T05:12:26.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013263700000000001 2024-09-13T05:12:26.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932617+0000", 2024-09-13T05:12:26.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4313000000000004e-05 2024-09-13T05:12:26.214 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.214 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.214 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.214 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159517 3.0 3:03975f1c:::rbd_data.112dfd94ee88.0000000000000156:2a [read 167936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:26.214 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:12:26.214 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.186102195, 2024-09-13T05:12:26.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91962025700000005, 2024-09-13T05:12:26.215 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.215 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.215 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.215 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.215 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.215 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159517 2024-09-13T05:12:26.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.215 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:12:26.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:12:26.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013609+0000", 2024-09-13T05:12:26.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:26.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013619+0000", 2024-09-13T05:12:26.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0077e-05 2024-09-13T05:12:26.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013638+0000", 2024-09-13T05:12:26.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8739000000000001e-05 2024-09-13T05:12:26.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013653+0000", 2024-09-13T05:12:26.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5446000000000001e-05 2024-09-13T05:12:26.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016506+0000", 2024-09-13T05:12:26.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028525619999999999 2024-09-13T05:12:26.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:26.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016521+0000", 2024-09-13T05:12:26.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5310000000000001e-05 2024-09-13T05:12:26.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932964+0000", 2024-09-13T05:12:26.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91644284099999995 2024-09-13T05:12:26.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933097+0000", 2024-09-13T05:12:26.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013337599999999999 2024-09-13T05:12:26.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933231+0000", 2024-09-13T05:12:26.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133996 2024-09-13T05:12:26.219 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.219 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.219 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.220 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159622 3.0 3:03f7a45a:::rbd_data.112dfd94ee88.0000000000000318:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:26.220 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:12:26.220 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.184440383999998, 2024-09-13T05:12:26.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.918245003, 2024-09-13T05:12:26.220 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.220 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.220 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159622 2024-09-13T05:12:26.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.220 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:12:26.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:12:26.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015266+0000", 2024-09-13T05:12:26.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999928 2024-09-13T05:12:26.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015283+0000", 2024-09-13T05:12:26.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7309999999999999e-05 2024-09-13T05:12:26.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015318+0000", 2024-09-13T05:12:26.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5119e-05 2024-09-13T05:12:26.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015338+0000", 2024-09-13T05:12:26.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9259e-05 2024-09-13T05:12:26.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016558+0000", 2024-09-13T05:12:26.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012199909999999999 2024-09-13T05:12:26.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:26.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016567+0000", 2024-09-13T05:12:26.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2459999999999992e-06 2024-09-13T05:12:26.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933266+0000", 2024-09-13T05:12:26.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91669950300000003 2024-09-13T05:12:26.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:12:26.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015788099999999999 2024-09-13T05:12:26.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933518+0000", 2024-09-13T05:12:26.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3721000000000006e-05 2024-09-13T05:12:26.224 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.225 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.225 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.225 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173445 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 150528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:26.225 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:12:26.225 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.019863599, 2024-09-13T05:12:26.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064560905000000002, 2024-09-13T05:12:26.225 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.225 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.225 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.225 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.225 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.225 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173445 2024-09-13T05:12:26.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.226 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:12:26.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:12:26.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179849+0000", 2024-09-13T05:12:26.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:26.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179860+0000", 2024-09-13T05:12:26.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0419e-05 2024-09-13T05:12:26.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179866+0000", 2024-09-13T05:12:26.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.567e-06 2024-09-13T05:12:26.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179872+0000", 2024-09-13T05:12:26.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1830000000000002e-06 2024-09-13T05:12:26.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244262+0000", 2024-09-13T05:12:26.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064390814000000005 2024-09-13T05:12:26.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244321+0000", 2024-09-13T05:12:26.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8341000000000003e-05 2024-09-13T05:12:26.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244411+0000", 2024-09-13T05:12:26.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9911e-05 2024-09-13T05:12:26.229 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.229 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.229 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.229 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173446 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 157696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:26.229 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:12:26.229 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.019836832, 2024-09-13T05:12:26.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064714007000000004, 2024-09-13T05:12:26.229 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.230 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.230 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.230 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.230 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.230 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173446 2024-09-13T05:12:26.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.230 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:12:26.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:12:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179876+0000", 2024-09-13T05:12:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179879+0000", 2024-09-13T05:12:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1489999999999998e-06 2024-09-13T05:12:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179884+0000", 2024-09-13T05:12:26.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2800000000000003e-06 2024-09-13T05:12:26.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179889+0000", 2024-09-13T05:12:26.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7620000000000003e-06 2024-09-13T05:12:26.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244452+0000", 2024-09-13T05:12:26.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064562943999999997 2024-09-13T05:12:26.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244512+0000", 2024-09-13T05:12:26.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9879e-05 2024-09-13T05:12:26.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244591+0000", 2024-09-13T05:12:26.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8701000000000004e-05 2024-09-13T05:12:26.233 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.233 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.233 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.233 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173447 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 164864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:26.234 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:12:26.234 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.019820084, 2024-09-13T05:12:26.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064866246000000002, 2024-09-13T05:12:26.234 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.234 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.234 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.234 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.234 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.234 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173447 2024-09-13T05:12:26.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.234 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:12:26.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:12:26.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:12:26.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:26.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179895+0000", 2024-09-13T05:12:26.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6910000000000002e-06 2024-09-13T05:12:26.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179901+0000", 2024-09-13T05:12:26.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5149999999999997e-06 2024-09-13T05:12:26.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179905+0000", 2024-09-13T05:12:26.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4170000000000002e-06 2024-09-13T05:12:26.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244615+0000", 2024-09-13T05:12:26.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064709533999999999 2024-09-13T05:12:26.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244665+0000", 2024-09-13T05:12:26.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0283e-05 2024-09-13T05:12:26.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244760+0000", 2024-09-13T05:12:26.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4310999999999999e-05 2024-09-13T05:12:26.237 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.237 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.238 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.238 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173448 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 172032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:26.238 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:12:26.238 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.0198042380000001, 2024-09-13T05:12:26.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065022046999999999, 2024-09-13T05:12:26.238 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.238 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.238 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.238 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.238 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.238 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173448 2024-09-13T05:12:26.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.239 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:12:26.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:12:26.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:12:26.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:26.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179914+0000", 2024-09-13T05:12:26.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6699999999999999e-06 2024-09-13T05:12:26.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179921+0000", 2024-09-13T05:12:26.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:12:26.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179926+0000", 2024-09-13T05:12:26.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8659999999999997e-06 2024-09-13T05:12:26.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244782+0000", 2024-09-13T05:12:26.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064856570000000002 2024-09-13T05:12:26.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244857+0000", 2024-09-13T05:12:26.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4326999999999995e-05 2024-09-13T05:12:26.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244931+0000", 2024-09-13T05:12:26.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4443999999999994e-05 2024-09-13T05:12:26.242 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.242 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.242 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.242 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173450 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 179200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:26.242 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:12:26.242 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.019783404, 2024-09-13T05:12:26.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065192589999999995, 2024-09-13T05:12:26.242 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.242 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.243 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.243 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.243 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.243 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173450 2024-09-13T05:12:26.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.243 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:12:26.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:12:26.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:12:26.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:26.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179932+0000", 2024-09-13T05:12:26.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2529999999999999e-06 2024-09-13T05:12:26.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179937+0000", 2024-09-13T05:12:26.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4219999999999999e-06 2024-09-13T05:12:26.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179942+0000", 2024-09-13T05:12:26.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3250000000000001e-06 2024-09-13T05:12:26.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244969+0000", 2024-09-13T05:12:26.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065027794999999999 2024-09-13T05:12:26.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245048+0000", 2024-09-13T05:12:26.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8812000000000004e-05 2024-09-13T05:12:26.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245123+0000", 2024-09-13T05:12:26.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4342000000000001e-05 2024-09-13T05:12:26.246 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.246 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.246 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.246 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173451 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:26.246 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:12:26.247 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.019767417, 2024-09-13T05:12:26.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359814000000002, 2024-09-13T05:12:26.247 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.247 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.247 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.247 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.247 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.247 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173451 2024-09-13T05:12:26.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.247 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:12:26.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:12:26.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:12:26.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:26.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179948+0000", 2024-09-13T05:12:26.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5119999999999998e-06 2024-09-13T05:12:26.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179954+0000", 2024-09-13T05:12:26.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5840000000000002e-06 2024-09-13T05:12:26.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179958+0000", 2024-09-13T05:12:26.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.566e-06 2024-09-13T05:12:26.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245160+0000", 2024-09-13T05:12:26.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065202057999999993 2024-09-13T05:12:26.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245228+0000", 2024-09-13T05:12:26.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7257999999999999e-05 2024-09-13T05:12:26.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245306+0000", 2024-09-13T05:12:26.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8227999999999997e-05 2024-09-13T05:12:26.250 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.250 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.251 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.251 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173452 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 193536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:26.251 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:12:26.251 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.0197509300000001, 2024-09-13T05:12:26.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065505701, 2024-09-13T05:12:26.251 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.251 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.251 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.251 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.251 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.251 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173452 2024-09-13T05:12:26.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.252 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:12:26.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:12:26.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:12:26.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:26.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179965+0000", 2024-09-13T05:12:26.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.402e-06 2024-09-13T05:12:26.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179970+0000", 2024-09-13T05:12:26.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2290000000000002e-06 2024-09-13T05:12:26.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179974+0000", 2024-09-13T05:12:26.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5070000000000002e-06 2024-09-13T05:12:26.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245329+0000", 2024-09-13T05:12:26.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065354906000000004 2024-09-13T05:12:26.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245390+0000", 2024-09-13T05:12:26.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0878999999999998e-05 2024-09-13T05:12:26.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245468+0000", 2024-09-13T05:12:26.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8073999999999998e-05 2024-09-13T05:12:26.255 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.255 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.255 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.255 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173453 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 198656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:26.255 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:12:26.255 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.019734664, 2024-09-13T05:12:26.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065664343, 2024-09-13T05:12:26.255 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.255 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.256 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.256 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.256 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.256 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173453 2024-09-13T05:12:26.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.256 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:12:26.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:12:26.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179978+0000", 2024-09-13T05:12:26.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:26.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179981+0000", 2024-09-13T05:12:26.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4140000000000001e-06 2024-09-13T05:12:26.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179986+0000", 2024-09-13T05:12:26.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3519999999999997e-06 2024-09-13T05:12:26.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179991+0000", 2024-09-13T05:12:26.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6739999999999996e-06 2024-09-13T05:12:26.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245495+0000", 2024-09-13T05:12:26.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065504229999999997 2024-09-13T05:12:26.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245563+0000", 2024-09-13T05:12:26.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8119000000000003e-05 2024-09-13T05:12:26.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245643+0000", 2024-09-13T05:12:26.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9861e-05 2024-09-13T05:12:26.259 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.259 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.259 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.259 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173454 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:26.259 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:12:26.260 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.0196862769999999, 2024-09-13T05:12:26.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065750457999999998, 2024-09-13T05:12:26.260 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.260 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.260 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.260 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.260 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.260 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173454 2024-09-13T05:12:26.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.260 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:12:26.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:12:26.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180026+0000", 2024-09-13T05:12:26.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:26.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180030+0000", 2024-09-13T05:12:26.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3790000000000002e-06 2024-09-13T05:12:26.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180036+0000", 2024-09-13T05:12:26.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5889999999999999e-06 2024-09-13T05:12:26.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180041+0000", 2024-09-13T05:12:26.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9980000000000003e-06 2024-09-13T05:12:26.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245667+0000", 2024-09-13T05:12:26.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065625124000000007 2024-09-13T05:12:26.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245705+0000", 2024-09-13T05:12:26.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7994000000000002e-05 2024-09-13T05:12:26.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245778+0000", 2024-09-13T05:12:26.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2999999999999999e-05 2024-09-13T05:12:26.263 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.263 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.264 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.264 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173455 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 212992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:26.264 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:12:26.264 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.0196675690000001, 2024-09-13T05:12:26.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065899773999999994, 2024-09-13T05:12:26.264 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.264 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.264 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.264 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.264 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.264 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173455 2024-09-13T05:12:26.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.265 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:12:26.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:12:26.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180045+0000", 2024-09-13T05:12:26.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:26.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180048+0000", 2024-09-13T05:12:26.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5830000000000001e-06 2024-09-13T05:12:26.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180054+0000", 2024-09-13T05:12:26.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.789e-06 2024-09-13T05:12:26.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180059+0000", 2024-09-13T05:12:26.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.933e-06 2024-09-13T05:12:26.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245801+0000", 2024-09-13T05:12:26.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065742520999999998 2024-09-13T05:12:26.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245865+0000", 2024-09-13T05:12:26.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3325999999999996e-05 2024-09-13T05:12:26.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245946+0000", 2024-09-13T05:12:26.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0964999999999995e-05 2024-09-13T05:12:26.268 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.268 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.268 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.268 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173456 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:26.268 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:12:26.268 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.0196503379999999, 2024-09-13T05:12:26.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066035128999999998, 2024-09-13T05:12:26.268 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.268 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.269 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.269 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.269 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.269 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173456 2024-09-13T05:12:26.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.269 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:12:26.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:12:26.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:12:26.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:26.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180065+0000", 2024-09-13T05:12:26.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4250000000000001e-06 2024-09-13T05:12:26.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180070+0000", 2024-09-13T05:12:26.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1749999999999996e-06 2024-09-13T05:12:26.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180075+0000", 2024-09-13T05:12:26.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4769999999999997e-06 2024-09-13T05:12:26.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245969+0000", 2024-09-13T05:12:26.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065894182999999995 2024-09-13T05:12:26.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246027+0000", 2024-09-13T05:12:26.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8165999999999998e-05 2024-09-13T05:12:26.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246098+0000", 2024-09-13T05:12:26.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1068999999999993e-05 2024-09-13T05:12:26.272 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.272 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.272 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.273 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173458 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:26.273 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:12:26.273 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.019634355, 2024-09-13T05:12:26.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066134732000000002, 2024-09-13T05:12:26.273 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.273 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.273 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.273 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.273 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.273 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173458 2024-09-13T05:12:26.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.274 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:12:26.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:12:26.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:12:26.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:26.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180081+0000", 2024-09-13T05:12:26.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4150000000000002e-06 2024-09-13T05:12:26.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180087+0000", 2024-09-13T05:12:26.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5389999999999998e-06 2024-09-13T05:12:26.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180101+0000", 2024-09-13T05:12:26.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4537e-05 2024-09-13T05:12:26.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246119+0000", 2024-09-13T05:12:26.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066017701999999998 2024-09-13T05:12:26.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246155+0000", 2024-09-13T05:12:26.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6094999999999999e-05 2024-09-13T05:12:26.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246214+0000", 2024-09-13T05:12:26.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8789000000000002e-05 2024-09-13T05:12:26.277 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.277 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.277 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.277 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173459 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 234496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:26.277 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:12:26.277 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.019606832, 2024-09-13T05:12:26.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066227460000000002, 2024-09-13T05:12:26.277 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.278 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.278 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173459 2024-09-13T05:12:26.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.278 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:12:26.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:12:26.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180106+0000", 2024-09-13T05:12:26.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:26.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180109+0000", 2024-09-13T05:12:26.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2219999999999998e-06 2024-09-13T05:12:26.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180115+0000", 2024-09-13T05:12:26.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9190000000000004e-06 2024-09-13T05:12:26.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180120+0000", 2024-09-13T05:12:26.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8930000000000004e-06 2024-09-13T05:12:26.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246236+0000", 2024-09-13T05:12:26.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066115638000000004 2024-09-13T05:12:26.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246273+0000", 2024-09-13T05:12:26.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7083999999999999e-05 2024-09-13T05:12:26.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246334+0000", 2024-09-13T05:12:26.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1183e-05 2024-09-13T05:12:26.281 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.281 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.281 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.282 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173460 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 241664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:26.282 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:12:26.282 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.019589026, 2024-09-13T05:12:26.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066360459999999996, 2024-09-13T05:12:26.282 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.282 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.282 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.282 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.282 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.282 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173460 2024-09-13T05:12:26.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.282 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:12:26.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:12:26.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:12:26.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:26.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180126+0000", 2024-09-13T05:12:26.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3120000000000001e-06 2024-09-13T05:12:26.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180132+0000", 2024-09-13T05:12:26.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.105e-06 2024-09-13T05:12:26.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180137+0000", 2024-09-13T05:12:26.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6829999999999999e-06 2024-09-13T05:12:26.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246365+0000", 2024-09-13T05:12:26.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066227584000000006 2024-09-13T05:12:26.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246413+0000", 2024-09-13T05:12:26.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8479000000000001e-05 2024-09-13T05:12:26.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246485+0000", 2024-09-13T05:12:26.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1600000000000006e-05 2024-09-13T05:12:26.286 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.286 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.286 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.286 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173461 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:26.286 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:12:26.286 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.019570257, 2024-09-13T05:12:26.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066492449999999995, 2024-09-13T05:12:26.286 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.286 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.287 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173461 2024-09-13T05:12:26.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.287 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:12:26.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:12:26.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:12:26.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:26.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180149+0000", 2024-09-13T05:12:26.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7239999999999997e-06 2024-09-13T05:12:26.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180153+0000", 2024-09-13T05:12:26.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7859999999999996e-06 2024-09-13T05:12:26.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180158+0000", 2024-09-13T05:12:26.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0300000000000001e-06 2024-09-13T05:12:26.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246508+0000", 2024-09-13T05:12:26.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066350100999999995 2024-09-13T05:12:26.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246568+0000", 2024-09-13T05:12:26.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9500000000000003e-05 2024-09-13T05:12:26.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246636+0000", 2024-09-13T05:12:26.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7633999999999997e-05 2024-09-13T05:12:26.290 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.290 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.290 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.290 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173462 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 256000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:26.290 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:12:26.290 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.018737429, 2024-09-13T05:12:26.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065773376999999994, 2024-09-13T05:12:26.291 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.291 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.291 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.291 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.291 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.291 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173462 2024-09-13T05:12:26.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.291 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:12:26.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:12:26.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180162+0000", 2024-09-13T05:12:26.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9991865 2024-09-13T05:12:26.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180984+0000", 2024-09-13T05:12:26.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00082184599999999999 2024-09-13T05:12:26.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180994+0000", 2024-09-13T05:12:26.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9000000000000001e-06 2024-09-13T05:12:26.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.181001+0000", 2024-09-13T05:12:26.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.917e-06 2024-09-13T05:12:26.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246653+0000", 2024-09-13T05:12:26.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065651820999999999 2024-09-13T05:12:26.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246698+0000", 2024-09-13T05:12:26.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.473e-05 2024-09-13T05:12:26.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246749+0000", 2024-09-13T05:12:26.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1758999999999997e-05 2024-09-13T05:12:26.294 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.295 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.295 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.295 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.295 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.295 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:26.295 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:26.199+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:26.295 INFO:teuthology.orchestra.run.smithi120.stdout:5258 trunc from 0xe492d08 to 0xcc1a5e 2024-09-13T05:12:26.296 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:12:26.297 INFO:teuthology.orchestra.run.smithi120.stdout:5259 trunc from 0xcc1a5e to 0x7d85249 2024-09-13T05:12:26.297 INFO:teuthology.orchestra.run.smithi120.stdout:5260 write 0xd38b100 thru 0xd39162d (0x652e bytes) 2024-09-13T05:12:26.297 INFO:teuthology.orchestra.run.smithi120.stdout:5261 clone 41 order 20 su 524288 sc 6 2024-09-13T05:12:26.303 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:26.299+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:26.399 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:26.399 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:26.399 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:26.399 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:26.404 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:26.400+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:26.408 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:12:26.505 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:26.500+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:26.550 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:26.550 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:26.550 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:26.551 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:26.551 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:26.559 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:12:26.606 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:26.604+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:26.658 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:26.658 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:26.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:26.658 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:26.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.659 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136560 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3908608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:26.659 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:12:26.659 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.559618896000003, 2024-09-13T05:12:26.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056148103999999997, 2024-09-13T05:12:26.659 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.659 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.659 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136560 2024-09-13T05:12:26.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.659 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:12:26.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:12:26.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095289+0000", 2024-09-13T05:12:26.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:26.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095292+0000", 2024-09-13T05:12:26.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.802e-06 2024-09-13T05:12:26.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095318+0000", 2024-09-13T05:12:26.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5987999999999999e-05 2024-09-13T05:12:26.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095323+0000", 2024-09-13T05:12:26.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.006e-06 2024-09-13T05:12:26.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151316+0000", 2024-09-13T05:12:26.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055992593 2024-09-13T05:12:26.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151371+0000", 2024-09-13T05:12:26.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5532999999999998e-05 2024-09-13T05:12:26.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151438+0000", 2024-09-13T05:12:26.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6557999999999995e-05 2024-09-13T05:12:26.663 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.663 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.663 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.663 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136562 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3922944~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:26.663 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:26.664 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.559581778000002, 2024-09-13T05:12:26.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056259690000000001, 2024-09-13T05:12:26.664 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.664 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.664 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136562 2024-09-13T05:12:26.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.664 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:26.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:26.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:26.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:26.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095329+0000", 2024-09-13T05:12:26.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3089999999999998e-06 2024-09-13T05:12:26.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095333+0000", 2024-09-13T05:12:26.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6239999999999999e-06 2024-09-13T05:12:26.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095335+0000", 2024-09-13T05:12:26.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5660000000000001e-06 2024-09-13T05:12:26.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151468+0000", 2024-09-13T05:12:26.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056132608000000001 2024-09-13T05:12:26.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151519+0000", 2024-09-13T05:12:26.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1681000000000002e-05 2024-09-13T05:12:26.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151587+0000", 2024-09-13T05:12:26.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7200999999999996e-05 2024-09-13T05:12:26.667 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.668 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.668 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.668 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136563 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3937280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:26.668 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:26.668 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.559570356000002, 2024-09-13T05:12:26.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056393051999999999, 2024-09-13T05:12:26.668 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.668 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.669 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.669 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.669 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136563 2024-09-13T05:12:26.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.669 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:26.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:26.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:26.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:12:26.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095340+0000", 2024-09-13T05:12:26.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.561e-06 2024-09-13T05:12:26.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095342+0000", 2024-09-13T05:12:26.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8059999999999999e-06 2024-09-13T05:12:26.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095345+0000", 2024-09-13T05:12:26.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:12:26.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151621+0000", 2024-09-13T05:12:26.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056275602000000001 2024-09-13T05:12:26.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151670+0000", 2024-09-13T05:12:26.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9478000000000003e-05 2024-09-13T05:12:26.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151731+0000", 2024-09-13T05:12:26.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1054000000000002e-05 2024-09-13T05:12:26.672 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.672 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.672 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.673 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136565 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3951616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:26.673 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:12:26.673 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.559560042000001, 2024-09-13T05:12:26.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056524090999999999, 2024-09-13T05:12:26.673 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.673 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.673 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.673 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.673 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.673 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136565 2024-09-13T05:12:26.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.674 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:12:26.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:12:26.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095348+0000", 2024-09-13T05:12:26.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:12:26.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095350+0000", 2024-09-13T05:12:26.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4479999999999999e-06 2024-09-13T05:12:26.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095353+0000", 2024-09-13T05:12:26.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.909e-06 2024-09-13T05:12:26.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095356+0000", 2024-09-13T05:12:26.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:12:26.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151763+0000", 2024-09-13T05:12:26.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056407813000000001 2024-09-13T05:12:26.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151812+0000", 2024-09-13T05:12:26.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8306999999999997e-05 2024-09-13T05:12:26.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151873+0000", 2024-09-13T05:12:26.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1064999999999999e-05 2024-09-13T05:12:26.677 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.677 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.677 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.678 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136567 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3965952~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:26.678 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:12:26.678 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.559551016999997, 2024-09-13T05:12:26.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056653907000000003, 2024-09-13T05:12:26.678 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.678 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.678 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.678 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.678 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.678 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136567 2024-09-13T05:12:26.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.678 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:12:26.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:12:26.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095357+0000", 2024-09-13T05:12:26.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:26.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095359+0000", 2024-09-13T05:12:26.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:12:26.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095362+0000", 2024-09-13T05:12:26.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7939999999999998e-06 2024-09-13T05:12:26.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095365+0000", 2024-09-13T05:12:26.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9979999999999999e-06 2024-09-13T05:12:26.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151904+0000", 2024-09-13T05:12:26.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056539308000000003 2024-09-13T05:12:26.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151953+0000", 2024-09-13T05:12:26.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8760000000000001e-05 2024-09-13T05:12:26.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152012+0000", 2024-09-13T05:12:26.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8761999999999997e-05 2024-09-13T05:12:26.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.682 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.682 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.682 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136569 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3980288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:26.682 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:26.682 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.559515263000002, 2024-09-13T05:12:26.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056771237000000002, 2024-09-13T05:12:26.682 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.682 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.683 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.683 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.683 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.683 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136569 2024-09-13T05:12:26.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.683 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:26.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:26.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:26.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:26.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095395+0000", 2024-09-13T05:12:26.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8870000000000001e-06 2024-09-13T05:12:26.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095402+0000", 2024-09-13T05:12:26.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6290000000000001e-06 2024-09-13T05:12:26.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095412+0000", 2024-09-13T05:12:26.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1730000000000001e-06 2024-09-13T05:12:26.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152044+0000", 2024-09-13T05:12:26.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056632016 2024-09-13T05:12:26.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152093+0000", 2024-09-13T05:12:26.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9570000000000001e-05 2024-09-13T05:12:26.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152165+0000", 2024-09-13T05:12:26.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1443e-05 2024-09-13T05:12:26.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.687 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.687 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.687 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136571 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3994624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:26.687 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:26.687 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.559494248, 2024-09-13T05:12:26.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056894741999999998, 2024-09-13T05:12:26.687 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.687 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.687 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136571 2024-09-13T05:12:26.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.688 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:26.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:26.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:26.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:26.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095418+0000", 2024-09-13T05:12:26.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0210000000000001e-06 2024-09-13T05:12:26.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095422+0000", 2024-09-13T05:12:26.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5310000000000002e-06 2024-09-13T05:12:26.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095425+0000", 2024-09-13T05:12:26.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8880000000000001e-06 2024-09-13T05:12:26.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152198+0000", 2024-09-13T05:12:26.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056773563999999999 2024-09-13T05:12:26.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152249+0000", 2024-09-13T05:12:26.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1168999999999997e-05 2024-09-13T05:12:26.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152309+0000", 2024-09-13T05:12:26.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9821999999999997e-05 2024-09-13T05:12:26.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.691 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.692 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136573 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4008960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:26.692 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:12:26.692 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.559482021000001, 2024-09-13T05:12:26.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057045810000000002, 2024-09-13T05:12:26.692 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.692 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.692 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.693 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.693 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.693 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136573 2024-09-13T05:12:26.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.693 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:12:26.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:12:26.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095426+0000", 2024-09-13T05:12:26.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:26.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095428+0000", 2024-09-13T05:12:26.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.593e-06 2024-09-13T05:12:26.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095431+0000", 2024-09-13T05:12:26.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9610000000000001e-06 2024-09-13T05:12:26.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095434+0000", 2024-09-13T05:12:26.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:12:26.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152352+0000", 2024-09-13T05:12:26.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05691881 2024-09-13T05:12:26.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152401+0000", 2024-09-13T05:12:26.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8995000000000001e-05 2024-09-13T05:12:26.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152472+0000", 2024-09-13T05:12:26.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1060000000000001e-05 2024-09-13T05:12:26.696 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.696 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.697 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.697 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136575 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4023296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:26.697 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:12:26.697 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.559052027999996, 2024-09-13T05:12:26.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056760069000000003, 2024-09-13T05:12:26.697 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.697 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.697 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.697 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.697 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.697 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136575 2024-09-13T05:12:26.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.698 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:12:26.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:12:26.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095437+0000", 2024-09-13T05:12:26.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9995799 2024-09-13T05:12:26.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095861+0000", 2024-09-13T05:12:26.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000424299 2024-09-13T05:12:26.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095869+0000", 2024-09-13T05:12:26.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5020000000000003e-06 2024-09-13T05:12:26.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095875+0000", 2024-09-13T05:12:26.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:12:26.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152502+0000", 2024-09-13T05:12:26.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056626528000000002 2024-09-13T05:12:26.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152556+0000", 2024-09-13T05:12:26.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4271000000000003e-05 2024-09-13T05:12:26.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152617+0000", 2024-09-13T05:12:26.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0896000000000001e-05 2024-09-13T05:12:26.701 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.701 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.701 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.701 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136577 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4037632~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:26.701 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:12:26.701 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.558950572999997, 2024-09-13T05:12:26.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056798242999999998, 2024-09-13T05:12:26.701 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.701 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.702 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136577 2024-09-13T05:12:26.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.702 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:12:26.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:12:26.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095882+0000", 2024-09-13T05:12:26.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999242 2024-09-13T05:12:26.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095961+0000", 2024-09-13T05:12:26.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8864999999999998e-05 2024-09-13T05:12:26.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095973+0000", 2024-09-13T05:12:26.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2206e-05 2024-09-13T05:12:26.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095978+0000", 2024-09-13T05:12:26.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0629999999999996e-06 2024-09-13T05:12:26.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152646+0000", 2024-09-13T05:12:26.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056668035999999998 2024-09-13T05:12:26.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152695+0000", 2024-09-13T05:12:26.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8634000000000002e-05 2024-09-13T05:12:26.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152756+0000", 2024-09-13T05:12:26.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1315000000000005e-05 2024-09-13T05:12:26.705 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.705 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.705 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.706 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136579 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4051968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:26.706 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:12:26.706 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.558622477999997, 2024-09-13T05:12:26.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056610869000000001, 2024-09-13T05:12:26.706 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.706 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.706 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.706 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.706 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.706 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136579 2024-09-13T05:12:26.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.706 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:12:26.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:12:26.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095989+0000", 2024-09-13T05:12:26.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997029 2024-09-13T05:12:26.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096291+0000", 2024-09-13T05:12:26.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030221499999999999 2024-09-13T05:12:26.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096300+0000", 2024-09-13T05:12:26.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4819999999999994e-06 2024-09-13T05:12:26.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096306+0000", 2024-09-13T05:12:26.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:12:26.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152788+0000", 2024-09-13T05:12:26.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056481625000000001 2024-09-13T05:12:26.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152837+0000", 2024-09-13T05:12:26.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9345000000000003e-05 2024-09-13T05:12:26.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152897+0000", 2024-09-13T05:12:26.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9892999999999997e-05 2024-09-13T05:12:26.710 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.710 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.710 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.710 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136581 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4066304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:26.710 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:12:26.710 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.558443650999997, 2024-09-13T05:12:26.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056597091000000002, 2024-09-13T05:12:26.711 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.711 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.711 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136581 2024-09-13T05:12:26.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.711 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:12:26.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:12:26.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096312+0000", 2024-09-13T05:12:26.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998465 2024-09-13T05:12:26.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096469+0000", 2024-09-13T05:12:26.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157109 2024-09-13T05:12:26.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096478+0000", 2024-09-13T05:12:26.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3260000000000002e-06 2024-09-13T05:12:26.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096482+0000", 2024-09-13T05:12:26.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9720000000000003e-06 2024-09-13T05:12:26.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152933+0000", 2024-09-13T05:12:26.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056451128000000003 2024-09-13T05:12:26.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152993+0000", 2024-09-13T05:12:26.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9947000000000001e-05 2024-09-13T05:12:26.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153062+0000", 2024-09-13T05:12:26.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9105999999999999e-05 2024-09-13T05:12:26.715 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.715 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.715 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.715 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136583 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4080640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:26.715 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:12:26.715 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.558177737999998, 2024-09-13T05:12:26.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056496609000000003, 2024-09-13T05:12:26.716 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.716 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.716 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.716 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.716 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.716 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136583 2024-09-13T05:12:26.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.716 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:12:26.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:12:26.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096485+0000", 2024-09-13T05:12:26.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997544 2024-09-13T05:12:26.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096735+0000", 2024-09-13T05:12:26.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024979899999999998 2024-09-13T05:12:26.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096742+0000", 2024-09-13T05:12:26.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7139999999999996e-06 2024-09-13T05:12:26.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096747+0000", 2024-09-13T05:12:26.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8709999999999996e-06 2024-09-13T05:12:26.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153099+0000", 2024-09-13T05:12:26.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056352639000000003 2024-09-13T05:12:26.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153168+0000", 2024-09-13T05:12:26.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9029000000000006e-05 2024-09-13T05:12:26.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153228+0000", 2024-09-13T05:12:26.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9339999999999998e-05 2024-09-13T05:12:26.720 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.720 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.720 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.720 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136585 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4094976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:26.720 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:12:26.720 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.557926270999999, 2024-09-13T05:12:26.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056396420000000003, 2024-09-13T05:12:26.720 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.720 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.720 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.721 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.721 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.721 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136585 2024-09-13T05:12:26.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.721 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:12:26.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:12:26.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096750+0000", 2024-09-13T05:12:26.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997673 2024-09-13T05:12:26.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096986+0000", 2024-09-13T05:12:26.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000236297 2024-09-13T05:12:26.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096993+0000", 2024-09-13T05:12:26.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9600000000000003e-06 2024-09-13T05:12:26.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096999+0000", 2024-09-13T05:12:26.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:12:26.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153264+0000", 2024-09-13T05:12:26.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056264728999999999 2024-09-13T05:12:26.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153318+0000", 2024-09-13T05:12:26.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3934000000000002e-05 2024-09-13T05:12:26.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153379+0000", 2024-09-13T05:12:26.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1206999999999999e-05 2024-09-13T05:12:26.724 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.724 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.724 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.724 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136586 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4109312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:26.724 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:12:26.725 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.557725468999998, 2024-09-13T05:12:26.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056374703999999998, 2024-09-13T05:12:26.725 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.725 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.725 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.725 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.725 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.725 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136586 2024-09-13T05:12:26.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.725 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:12:26.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:12:26.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097004+0000", 2024-09-13T05:12:26.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998207 2024-09-13T05:12:26.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097187+0000", 2024-09-13T05:12:26.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018337900000000001 2024-09-13T05:12:26.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097198+0000", 2024-09-13T05:12:26.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348e-05 2024-09-13T05:12:26.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097202+0000", 2024-09-13T05:12:26.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.121e-06 2024-09-13T05:12:26.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153411+0000", 2024-09-13T05:12:26.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056209510999999997 2024-09-13T05:12:26.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153464+0000", 2024-09-13T05:12:26.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2605000000000002e-05 2024-09-13T05:12:26.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153558+0000", 2024-09-13T05:12:26.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4017999999999993e-05 2024-09-13T05:12:26.729 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.729 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.729 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.729 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136588 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:26.729 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:12:26.729 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.557441286, 2024-09-13T05:12:26.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056274980000000002, 2024-09-13T05:12:26.729 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.729 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.730 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.730 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.730 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.730 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136588 2024-09-13T05:12:26.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.730 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:12:26.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:12:26.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097205+0000", 2024-09-13T05:12:26.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997377 2024-09-13T05:12:26.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097471+0000", 2024-09-13T05:12:26.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026628200000000001 2024-09-13T05:12:26.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097484+0000", 2024-09-13T05:12:26.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2493e-05 2024-09-13T05:12:26.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097488+0000", 2024-09-13T05:12:26.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9330000000000003e-06 2024-09-13T05:12:26.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153600+0000", 2024-09-13T05:12:26.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056112097 2024-09-13T05:12:26.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153654+0000", 2024-09-13T05:12:26.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4126000000000003e-05 2024-09-13T05:12:26.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153742+0000", 2024-09-13T05:12:26.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.831e-05 2024-09-13T05:12:26.733 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.733 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.734 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.734 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136589 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4137984~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:26.734 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:12:26.734 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.557301979000002, 2024-09-13T05:12:26.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056293867999999997, 2024-09-13T05:12:26.734 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.734 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.734 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.734 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.734 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.734 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136589 2024-09-13T05:12:26.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.735 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:12:26.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:12:26.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097491+0000", 2024-09-13T05:12:26.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998841 2024-09-13T05:12:26.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097610+0000", 2024-09-13T05:12:26.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119263 2024-09-13T05:12:26.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097617+0000", 2024-09-13T05:12:26.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6490000000000002e-06 2024-09-13T05:12:26.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097624+0000", 2024-09-13T05:12:26.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6309999999999997e-06 2024-09-13T05:12:26.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153779+0000", 2024-09-13T05:12:26.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056155153999999999 2024-09-13T05:12:26.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153831+0000", 2024-09-13T05:12:26.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2080000000000003e-05 2024-09-13T05:12:26.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153901+0000", 2024-09-13T05:12:26.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9765999999999996e-05 2024-09-13T05:12:26.738 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.738 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.738 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.738 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136965 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3366912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:26.738 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:12:26.738 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.537333158000003, 2024-09-13T05:12:26.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056225403, 2024-09-13T05:12:26.738 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.738 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.739 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.739 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.739 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.739 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136965 2024-09-13T05:12:26.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.739 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:12:26.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:12:26.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117575+0000", 2024-09-13T05:12:26.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:26.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117578+0000", 2024-09-13T05:12:26.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4899999999999999e-06 2024-09-13T05:12:26.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117583+0000", 2024-09-13T05:12:26.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.074e-06 2024-09-13T05:12:26.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117587+0000", 2024-09-13T05:12:26.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5360000000000003e-06 2024-09-13T05:12:26.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173622+0000", 2024-09-13T05:12:26.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056034527000000001 2024-09-13T05:12:26.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173704+0000", 2024-09-13T05:12:26.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2137000000000003e-05 2024-09-13T05:12:26.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173801+0000", 2024-09-13T05:12:26.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7048999999999999e-05 2024-09-13T05:12:26.742 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.742 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.742 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.742 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136991 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3553280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:26.743 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:26.743 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.533407381000004, 2024-09-13T05:12:26.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056330199999999997, 2024-09-13T05:12:26.743 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.743 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.743 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.743 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.743 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.743 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136991 2024-09-13T05:12:26.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.743 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:26.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:26.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:26.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:26.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121504+0000", 2024-09-13T05:12:26.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7199999999999998e-06 2024-09-13T05:12:26.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121510+0000", 2024-09-13T05:12:26.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3459999999999999e-06 2024-09-13T05:12:26.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121515+0000", 2024-09-13T05:12:26.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.656e-06 2024-09-13T05:12:26.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177608+0000", 2024-09-13T05:12:26.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056093267000000002 2024-09-13T05:12:26.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177717+0000", 2024-09-13T05:12:26.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010901299999999999 2024-09-13T05:12:26.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177832+0000", 2024-09-13T05:12:26.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114604 2024-09-13T05:12:26.748 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.748 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.748 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.748 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173672 3.9 3:9520c004:::rbd_data.112d7c1bedf7.0000000000000040:29 [read 186368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:26.748 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:12:26.748 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.4695127559999999, 2024-09-13T05:12:26.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05682475, 2024-09-13T05:12:26.749 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:26.749 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:26.749 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:26.749 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:26.749 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:26.749 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173672 2024-09-13T05:12:26.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.749 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:26.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:26.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:12:26.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:26.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:12:26.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:26.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:26.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185395+0000", 2024-09-13T05:12:26.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:26.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:26.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185398+0000", 2024-09-13T05:12:26.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8260000000000001e-06 2024-09-13T05:12:26.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:26.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185404+0000", 2024-09-13T05:12:26.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-09-13T05:12:26.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:26.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185408+0000", 2024-09-13T05:12:26.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5279999999999997e-06 2024-09-13T05:12:26.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:26.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.236213+0000", 2024-09-13T05:12:26.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050805207999999998 2024-09-13T05:12:26.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:26.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.236285+0000", 2024-09-13T05:12:26.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1236999999999996e-05 2024-09-13T05:12:26.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:26.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:26.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:26.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.242221+0000", 2024-09-13T05:12:26.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059360050000000003 2024-09-13T05:12:26.752 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.752 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.752 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.753 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:26.753 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:26.753 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:26.754 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:12:26.755 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:26.751+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:26.762 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T05:12:26.855 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:26.852+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:26.915 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:26.915 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:26.924 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:12:26.935 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:12:26.949 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone40 from 0xd39162e (overlap 0xcc1a5e) to 0x0 2024-09-13T05:12:26.955 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:26.952+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:27.021 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:27.022 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:27.022 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:27.022 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:27.022 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:27.031 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:12:27.056 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:27.052+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:27.101 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #39, image image_client.0-clone39 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent40 2024-09-13T05:12:27.102 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:12:27.113 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:27.114 INFO:teuthology.orchestra.run.smithi120.stdout:5264 writesame 0x63528f3 thru 0x63622e2 data_size 0x3e(0xf9f0 bytes) 2024-09-13T05:12:27.120 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:27.128 INFO:teuthology.orchestra.run.smithi120.stdout:5265 write 0x9c8afe2 thru 0x9c95468 (0xa487 bytes) 2024-09-13T05:12:27.134 INFO:teuthology.orchestra.run.smithi120.stdout:5266 read 0x21c3325 thru 0x21c90b9 (0x5d95 bytes) 2024-09-13T05:12:27.135 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:27.136 INFO:teuthology.orchestra.run.smithi120.stdout:5268 punch from 0x77c6aaa to 0x77cfae0, (0x9036 bytes) 2024-09-13T05:12:27.136 INFO:teuthology.orchestra.run.smithi120.stdout:5269 punch from 0xcf771fe to 0xcf7a7c9, (0x35cb bytes) 2024-09-13T05:12:27.136 INFO:teuthology.orchestra.run.smithi120.stdout:5271 read 0x67844a3 thru 0x6792d3e (0xe89c bytes) 2024-09-13T05:12:27.136 INFO:teuthology.orchestra.run.smithi120.stdout:5272 read 0xb3270de thru 0xb332ce2 (0xbc05 bytes) 2024-09-13T05:12:27.136 INFO:teuthology.orchestra.run.smithi120.stdout:5273 punch from 0x5e39157 to 0x5e3ef49, (0x5df2 bytes) 2024-09-13T05:12:27.136 INFO:teuthology.orchestra.run.smithi120.stdout:5274 write 0xa45b82b thru 0xa46a3a5 (0xeb7b bytes) 2024-09-13T05:12:27.142 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:27.146 INFO:teuthology.orchestra.run.smithi120.stdout:5276 punch from 0x718ac4e to 0x71934da, (0x888c bytes) 2024-09-13T05:12:27.146 INFO:teuthology.orchestra.run.smithi120.stdout:5277 read 0x49af235 thru 0x49bd10e (0xdeda bytes) 2024-09-13T05:12:27.146 INFO:teuthology.orchestra.run.smithi120.stdout:5279 read 0x94879f5 thru 0x9489b2f (0x213b bytes) 2024-09-13T05:12:27.151 INFO:teuthology.orchestra.run.smithi120.stdout:5281 trunc from 0xd39162e to 0x9b20e05 2024-09-13T05:12:27.157 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:27.155+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:27.165 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:27.177 INFO:teuthology.orchestra.run.smithi120.stdout:5282 write 0x628845 thru 0x631a36 (0x91f2 bytes) 2024-09-13T05:12:27.184 INFO:teuthology.orchestra.run.smithi120.stdout:5283 read 0x156718f thru 0x156cc42 (0x5ab4 bytes) 2024-09-13T05:12:27.184 INFO:teuthology.orchestra.run.smithi120.stdout:5284 write 0x4baea76 thru 0x4bb6063 (0x75ee bytes) 2024-09-13T05:12:27.186 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:27.186 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:27.188 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:27.191 INFO:teuthology.orchestra.run.smithi120.stdout:5286 write 0x5dcf2c2 thru 0x5ddeb11 (0xf850 bytes) 2024-09-13T05:12:27.196 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:12:27.197 INFO:teuthology.orchestra.run.smithi120.stdout:5287 write 0x6f2408f thru 0x6f25713 (0x1685 bytes) 2024-09-13T05:12:27.203 INFO:teuthology.orchestra.run.smithi120.stdout:5289 write 0x4ec0466 thru 0x4ecb0ed (0xac88 bytes) 2024-09-13T05:12:27.210 INFO:teuthology.orchestra.run.smithi120.stdout:5290 write 0x81827ff thru 0x8187dd5 (0x55d7 bytes) 2024-09-13T05:12:27.215 INFO:teuthology.orchestra.run.smithi120.stdout:5292 punch from 0x3e3e1b2 to 0x3e4272d, (0x457b bytes) 2024-09-13T05:12:27.215 INFO:teuthology.orchestra.run.smithi120.stdout:5294 write 0x48692b thru 0x48a529 (0x3bff bytes) 2024-09-13T05:12:27.215 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:27.221 INFO:teuthology.orchestra.run.smithi120.stdout:5295 writesame 0x646b70f thru 0x6471b58 data_size 0x21(0x644a bytes) 2024-09-13T05:12:27.237 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:27.241 INFO:teuthology.orchestra.run.smithi120.stdout:5300 writesame 0xc0e4b6d thru 0xc0e803e data_size 0x1(0x34d2 bytes) 2024-09-13T05:12:27.241 INFO:teuthology.orchestra.run.smithi120.stdout:5301 write 0x9beee9b thru 0x9bf94fa (0xa660 bytes) 2024-09-13T05:12:27.243 INFO:teuthology.orchestra.run.smithi120.stdout:5302 read 0x96f500 thru 0x97bb99 (0xc69a bytes) 2024-09-13T05:12:27.244 INFO:teuthology.orchestra.run.smithi120.stdout:5303 read 0x161fd28 thru 0x16272b9 (0x7592 bytes) 2024-09-13T05:12:27.252 INFO:teuthology.orchestra.run.smithi120.stdout:5305 trunc from 0xc0e803f to 0x710b9f7 2024-09-13T05:12:27.258 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:27.256+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:27.266 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:27.267 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:12:27.268 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:27.268 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:27.268 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:27.268 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:27.268 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:27.268 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:27.268 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:27.278 INFO:teuthology.orchestra.run.smithi120.stdout:5306 read 0x523822f thru 0x523ed26 (0x6af8 bytes) 2024-09-13T05:12:27.278 INFO:teuthology.orchestra.run.smithi120.stdout:5307 punch from 0x4fbb610 to 0x4fc1f6a, (0x695a bytes) 2024-09-13T05:12:27.278 INFO:teuthology.orchestra.run.smithi120.stdout:5309 punch from 0x15fdee2 to 0x160a974, (0xca92 bytes) 2024-09-13T05:12:27.278 INFO:teuthology.orchestra.run.smithi120.stdout:5310 punch from 0x3a1377f to 0x3a15b50, (0x23d1 bytes) 2024-09-13T05:12:27.279 INFO:teuthology.orchestra.run.smithi120.stdout:5311 writesame 0x217b008 thru 0x217ce16 data_size 0x9(0x1e0f bytes) 2024-09-13T05:12:27.285 INFO:teuthology.orchestra.run.smithi120.stdout:5313 trunc from 0x710b9f7 to 0x7d358be 2024-09-13T05:12:27.310 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:27.310 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:27.315 INFO:teuthology.orchestra.run.smithi120.stdout:5316 write 0xc83935e thru 0xc83ce1b (0x3abe bytes) 2024-09-13T05:12:27.319 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:12:27.321 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:27.321 INFO:teuthology.orchestra.run.smithi120.stdout:5319 write 0x2ace249 thru 0x2ace4cd (0x285 bytes) 2024-09-13T05:12:27.328 INFO:teuthology.orchestra.run.smithi120.stdout:5320 read 0x33bc2b6 thru 0x33caf07 (0xec52 bytes) 2024-09-13T05:12:27.328 INFO:teuthology.orchestra.run.smithi120.stdout:5321 write 0x861ab4e thru 0x861c83c (0x1cef bytes) 2024-09-13T05:12:27.336 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:27.336 INFO:teuthology.orchestra.run.smithi120.stdout:5323 write 0xb2cfcdc thru 0xb2d675d (0x6a82 bytes) 2024-09-13T05:12:27.342 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:27.354 INFO:teuthology.orchestra.run.smithi120.stdout:5325 trunc from 0xc83ce1c to 0x5bbbe8c 2024-09-13T05:12:27.360 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:27.356+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:27.392 INFO:teuthology.orchestra.run.smithi120.stdout:5326 trunc from 0x5bbbe8c to 0xc59b381 2024-09-13T05:12:27.405 INFO:teuthology.orchestra.run.smithi120.stdout:5327 write 0x650e549 thru 0x650f1b3 (0xc6b bytes) 2024-09-13T05:12:27.426 INFO:teuthology.orchestra.run.smithi120.stdout:5328 write 0xd870ae0 thru 0xd8751d4 (0x46f5 bytes) 2024-09-13T05:12:27.433 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:27.433 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:27.437 INFO:teuthology.orchestra.run.smithi120.stdout:5329 trunc from 0xd8751d5 to 0xb7fe670 2024-09-13T05:12:27.443 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:12:27.459 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:27.455+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:27.461 INFO:teuthology.orchestra.run.smithi120.stdout:5330 writesame 0xb07a71c thru 0xb07c0a9 data_size 0x1(0x198e bytes) 2024-09-13T05:12:27.475 INFO:teuthology.orchestra.run.smithi120.stdout:5331 punch from 0x86911b0 to 0x8696c7b, (0x5acb bytes) 2024-09-13T05:12:27.475 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:27.475 INFO:teuthology.orchestra.run.smithi120.stdout:5334 read 0x8c611c thru 0x8cff7a (0x9e5f bytes) 2024-09-13T05:12:27.476 INFO:teuthology.orchestra.run.smithi120.stdout:5335 write 0x378d8e5 thru 0x3790ed1 (0x35ed bytes) 2024-09-13T05:12:27.484 INFO:teuthology.orchestra.run.smithi120.stdout:5336 writesame 0x46bb8c4 thru 0x46bdddd data_size 0x3(0x251a bytes) 2024-09-13T05:12:27.492 INFO:teuthology.orchestra.run.smithi120.stdout:5339 punch from 0x834b15e to 0x834b2a6, (0x148 bytes) 2024-09-13T05:12:27.509 INFO:teuthology.orchestra.run.smithi120.stdout:5340 write 0xd3a31b9 thru 0xd3b1e2d (0xec75 bytes) 2024-09-13T05:12:27.516 INFO:teuthology.orchestra.run.smithi120.stdout:5341 read 0x5f0f221 thru 0x5f1bf8f (0xcd6f bytes) 2024-09-13T05:12:27.516 INFO:teuthology.orchestra.run.smithi120.stdout:5342 read 0xa9f6861 thru 0xaa03b03 (0xd2a3 bytes) 2024-09-13T05:12:27.516 INFO:teuthology.orchestra.run.smithi120.stdout:5343 punch from 0x359ff1e to 0x35a2035, (0x2117 bytes) 2024-09-13T05:12:27.516 INFO:teuthology.orchestra.run.smithi120.stdout:5344 read 0x8e6286b thru 0x8e65404 (0x2b9a bytes) 2024-09-13T05:12:27.516 INFO:teuthology.orchestra.run.smithi120.stdout:5345 writesame 0xb193ada thru 0xb19d31a data_size 0x1(0x9841 bytes) 2024-09-13T05:12:27.541 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:27.541 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:27.551 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:12:27.554 INFO:teuthology.orchestra.run.smithi120.stdout:5346 read 0x9a32ab4 thru 0x9a38575 (0x5ac2 bytes) 2024-09-13T05:12:27.554 INFO:teuthology.orchestra.run.smithi120.stdout:5347 write 0x57b4147 thru 0x57bf0f3 (0xafad bytes) 2024-09-13T05:12:27.560 INFO:teuthology.orchestra.run.smithi120.stdout:5348 punch from 0x57cd452 to 0x57d3d6e, (0x691c bytes) 2024-09-13T05:12:27.561 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:27.555+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:27.578 INFO:teuthology.orchestra.run.smithi120.stdout:5349 trunc from 0xd3b1e2e to 0x4553c7e 2024-09-13T05:12:27.607 INFO:teuthology.orchestra.run.smithi120.stdout:5351 read 0x2e18378 thru 0x2e21620 (0x92a9 bytes) 2024-09-13T05:12:27.639 INFO:teuthology.orchestra.run.smithi120.stdout:5352 writesame 0xea75de8 thru 0xea81ca8 data_size 0x1(0xbec1 bytes) 2024-09-13T05:12:27.639 INFO:teuthology.orchestra.run.smithi120.stdout:5354 read 0x39fb2b3 thru 0x3a00c5f (0x59ad bytes) 2024-09-13T05:12:27.639 INFO:teuthology.orchestra.run.smithi120.stdout:5355 punch from 0x675f3b0 to 0x676ac4a, (0xb89a bytes) 2024-09-13T05:12:27.641 INFO:teuthology.orchestra.run.smithi120.stdout:5357 flatten 2024-09-13T05:12:27.661 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:27.659+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:27.662 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:27.662 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:27.663 INFO:teuthology.orchestra.run.smithi120.stdout:5358 read 0x662bf08 thru 0x66329de (0x6ad7 bytes) 2024-09-13T05:12:27.663 INFO:teuthology.orchestra.run.smithi120.stdout:5359 write 0xd33120f thru 0xd336c9d (0x5a8f bytes) 2024-09-13T05:12:27.669 INFO:teuthology.orchestra.run.smithi120.stdout:5362 write 0xa31488d thru 0xa31f958 (0xb0cc bytes) 2024-09-13T05:12:27.672 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:12:27.674 INFO:teuthology.orchestra.run.smithi120.stdout:5364 write 0x4e72698 thru 0x4e755c0 (0x2f29 bytes) 2024-09-13T05:12:27.680 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:27.680 INFO:teuthology.orchestra.run.smithi120.stdout:5366 read 0x6470253 thru 0x6470be4 (0x992 bytes) 2024-09-13T05:12:27.681 INFO:teuthology.orchestra.run.smithi120.stdout:5367 read 0xbda6ceb thru 0xbdace44 (0x615a bytes) 2024-09-13T05:12:27.681 INFO:teuthology.orchestra.run.smithi120.stdout:5368 read 0x3d3bb61 thru 0x3d48e27 (0xd2c7 bytes) 2024-09-13T05:12:27.681 INFO:teuthology.orchestra.run.smithi120.stdout:5369 punch from 0x24b2dcc to 0x24b72fa, (0x452e bytes) 2024-09-13T05:12:27.694 INFO:teuthology.orchestra.run.smithi120.stdout:5372 trunc from 0xea81ca9 to 0x8456ca4 2024-09-13T05:12:27.719 INFO:teuthology.orchestra.run.smithi120.stdout:5373 punch from 0x2dbc86 to 0x2e8c22, (0xcf9c bytes) 2024-09-13T05:12:27.719 INFO:teuthology.orchestra.run.smithi120.stdout:5374 read 0x42e7f05 thru 0x42f202a (0xa126 bytes) 2024-09-13T05:12:27.746 INFO:teuthology.orchestra.run.smithi120.stdout:5378 write 0xd820ef8 thru 0xd83066e (0xf777 bytes) 2024-09-13T05:12:27.762 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:27.759+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:27.770 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:27.770 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:27.770 INFO:teuthology.orchestra.run.smithi120.stdout:5379 trunc from 0xd83066f to 0x526e5eb 2024-09-13T05:12:27.777 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is unset 2024-09-13T05:12:27.780 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:12:27.798 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:27.810 INFO:teuthology.orchestra.run.smithi120.stdout:5382 write 0x6378730 thru 0x637ea88 (0x6359 bytes) 2024-09-13T05:12:27.819 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:27.819 INFO:teuthology.orchestra.run.smithi120.stdout:5384 write 0x51509ae thru 0x51591e3 (0x8836 bytes) 2024-09-13T05:12:27.822 INFO:teuthology.orchestra.run.smithi120.stdout:5386 read 0x1153e9c thru 0x1161e1d (0xdf82 bytes) 2024-09-13T05:12:27.822 INFO:teuthology.orchestra.run.smithi120.stdout:5387 clone 42 order 22 su 2097152 sc 5 2024-09-13T05:12:27.863 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:27.859+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:27.883 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:27.884 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:27.893 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:12:27.964 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:27.959+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:28.001 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:28.002 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:28.011 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:12:28.065 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:28.064+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:28.118 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:28.119 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:28.128 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:12:28.170 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:28.168+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:28.267 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:28.263+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:28.278 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:28.279 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:28.288 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:12:28.368 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:28.364+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:28.396 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:28.396 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:28.406 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:12:28.468 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:28.464+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:28.560 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:28.560 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:28.571 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:12:28.571 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:28.568+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:28.671 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:28.667+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:28.719 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:28.720 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:28.729 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:12:28.777 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:28.775+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:28.850 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:28.851 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:28.864 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:12:28.873 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:28.868+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:28.977 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:28.972+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:28.977 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:28.977 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:28.984 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:12:29.011 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #40, image image_client.0-clone40 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent41 2024-09-13T05:12:29.028 INFO:teuthology.orchestra.run.smithi120.stdout:5388 punch from 0x55d2199 to 0x55d23e4, (0x24b bytes) 2024-09-13T05:12:29.052 INFO:teuthology.orchestra.run.smithi120.stdout:5389 write 0x75ca449 thru 0x75cc944 (0x24fc bytes) 2024-09-13T05:12:29.057 INFO:teuthology.orchestra.run.smithi120.stdout:5390 writesame 0x31110a1 thru 0x3120ee3 data_size 0xd(0xfe43 bytes) 2024-09-13T05:12:29.074 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:29.071+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:29.087 INFO:teuthology.orchestra.run.smithi120.stdout:5391 write 0xb943fa0 thru 0xb948ab3 (0x4b14 bytes) 2024-09-13T05:12:29.094 INFO:teuthology.orchestra.run.smithi120.stdout:5398 writesame 0x6e9ae6b thru 0x6eaa3c7 data_size 0x1(0xf55d bytes) 2024-09-13T05:12:29.104 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:29.104 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:29.115 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:12:29.140 INFO:teuthology.orchestra.run.smithi120.stdout:5399 writesame 0x43cd360 thru 0x43d0e81 data_size 0x6(0x3b22 bytes) 2024-09-13T05:12:29.148 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:29.148 INFO:teuthology.orchestra.run.smithi120.stdout:5401 write 0x8b66a0b thru 0x8b6de6c (0x7462 bytes) 2024-09-13T05:12:29.154 INFO:teuthology.orchestra.run.smithi120.stdout:5402 write 0x71ee6f0 thru 0x71f1a6a (0x337b bytes) 2024-09-13T05:12:29.162 INFO:teuthology.orchestra.run.smithi120.stdout:5403 read 0x59ff093 thru 0x5a0e297 (0xf205 bytes) 2024-09-13T05:12:29.162 INFO:teuthology.orchestra.run.smithi120.stdout:5404 read 0x3ce90e1 thru 0x3cf42ac (0xb1cc bytes) 2024-09-13T05:12:29.162 INFO:teuthology.orchestra.run.smithi120.stdout:5405 write 0x275edf0 thru 0x27689c6 (0x9bd7 bytes) 2024-09-13T05:12:29.172 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:29.172 INFO:teuthology.orchestra.run.smithi120.stdout:5408 write 0x2660bbf thru 0x266862b (0x7a6d bytes) 2024-09-13T05:12:29.175 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:29.172+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:29.176 INFO:teuthology.orchestra.run.smithi120.stdout:5409 trunc from 0xb948ab4 to 0xc1dc2ff 2024-09-13T05:12:29.184 INFO:teuthology.orchestra.run.smithi120.stdout:5412 punch from 0x7423f81 to 0x74331a9, (0xf228 bytes) 2024-09-13T05:12:29.184 INFO:teuthology.orchestra.run.smithi120.stdout:5413 writesame 0x6b2be39 thru 0x6b3387a data_size 0x1(0x7a42 bytes) 2024-09-13T05:12:29.212 INFO:teuthology.orchestra.run.smithi120.stdout:5414 read 0x50b6245 thru 0x50bf6e5 (0x94a1 bytes) 2024-09-13T05:12:29.213 INFO:teuthology.orchestra.run.smithi120.stdout:5415 write 0xaf23f2f thru 0xaf2bb71 (0x7c43 bytes) 2024-09-13T05:12:29.220 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:29.220 INFO:teuthology.orchestra.run.smithi120.stdout:5417 writesame 0x3738ded thru 0x3745b01 data_size 0x1(0xcd15 bytes) 2024-09-13T05:12:29.255 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:29.255 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:29.265 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:12:29.270 INFO:teuthology.orchestra.run.smithi120.stdout:5420 read 0xa3ce243 thru 0xa3d8cf6 (0xaab4 bytes) 2024-09-13T05:12:29.270 INFO:teuthology.orchestra.run.smithi120.stdout:5422 write 0x5c760d6 thru 0x5c812d0 (0xb1fb bytes) 2024-09-13T05:12:29.276 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:29.272+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:29.277 INFO:teuthology.orchestra.run.smithi120.stdout:5425 write 0xaf4509e thru 0xaf4ad30 (0x5c93 bytes) 2024-09-13T05:12:29.278 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:12:29.281 INFO:teuthology.orchestra.run.smithi120.stdout:5426 punch from 0x9dea26e to 0x9df1c00, (0x7992 bytes) 2024-09-13T05:12:29.281 INFO:teuthology.orchestra.run.smithi120.stdout:5428 read 0x89a22b thru 0x89cdef (0x2bc5 bytes) 2024-09-13T05:12:29.282 INFO:teuthology.orchestra.run.smithi120.stdout:5429 write 0x3430f52 thru 0x343234f (0x13fe bytes) 2024-09-13T05:12:29.302 INFO:teuthology.orchestra.run.smithi120.stdout:5430 write 0xd75bbd2 thru 0xd76b12f (0xf55e bytes) 2024-09-13T05:12:29.308 INFO:teuthology.orchestra.run.smithi120.stdout:5431 read 0x20f9f5c thru 0x2103a92 (0x9b37 bytes) 2024-09-13T05:12:29.309 INFO:teuthology.orchestra.run.smithi120.stdout:5432 read 0x96dba78 thru 0x96eb3e4 (0xf96d bytes) 2024-09-13T05:12:29.309 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:29.309 INFO:teuthology.orchestra.run.smithi120.stdout:5434 writesame 0x458ec40 thru 0x459734f data_size 0x8(0x8710 bytes) 2024-09-13T05:12:29.323 INFO:teuthology.orchestra.run.smithi120.stdout:5435 clone 43 order 18 su 8192 sc 13 2024-09-13T05:12:29.378 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:29.375+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:29.385 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:29.385 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:29.393 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:12:29.415 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:12:29.434 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:29.452 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:29.468 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:29.478 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:29.476+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:29.489 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:29.513 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:29.522 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:29.522 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:29.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:29.522 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:29.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.522 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:159451 3.1b e117/116 3:d9c87acb:::rbd_data.112dc3abcba6.0000000000000003:head v 117'567, mlcod=0'0)", 2024-09-13T05:12:29.522 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:12:29.522 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.581309369, 2024-09-13T05:12:29.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064897325000000006, 2024-09-13T05:12:29.523 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:29.523 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:29.523 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:29.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:29.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:12:29.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:29.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:12:29.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:29.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938207+0000", 2024-09-13T05:12:29.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:29.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:29.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972794+0000", 2024-09-13T05:12:29.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.034587013 2024-09-13T05:12:29.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:29.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972821+0000", 2024-09-13T05:12:29.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6764e-05 2024-09-13T05:12:29.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:29.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972841+0000", 2024-09-13T05:12:29.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0191999999999999e-05 2024-09-13T05:12:29.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:29.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972905+0000", 2024-09-13T05:12:29.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4319000000000005e-05 2024-09-13T05:12:29.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:29.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972927+0000", 2024-09-13T05:12:29.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1135999999999999e-05 2024-09-13T05:12:29.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:12:29.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.002964+0000", 2024-09-13T05:12:29.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.030037123999999998 2024-09-13T05:12:29.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:29.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.003105+0000", 2024-09-13T05:12:29.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141614 2024-09-13T05:12:29.526 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.526 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:29.527 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.527 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159495 3.0 3:022f4da1:::rbd_data.112dfd94ee88.00000000000000e4:2a [read 167936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:29.527 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:12:29.527 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.506169948, 2024-09-13T05:12:29.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91926946899999995, 2024-09-13T05:12:29.527 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:29.527 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:29.527 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:29.527 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:29.527 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:29.527 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159495 2024-09-13T05:12:29.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.528 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:29.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:29.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:12:29.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:29.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:12:29.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:29.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013345+0000", 2024-09-13T05:12:29.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999971 2024-09-13T05:12:29.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:29.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013359+0000", 2024-09-13T05:12:29.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4752999999999999e-05 2024-09-13T05:12:29.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:29.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013418+0000", 2024-09-13T05:12:29.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8959000000000003e-05 2024-09-13T05:12:29.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:29.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013439+0000", 2024-09-13T05:12:29.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0749000000000001e-05 2024-09-13T05:12:29.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:29.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013563+0000", 2024-09-13T05:12:29.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012349400000000001 2024-09-13T05:12:29.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:29.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013583+0000", 2024-09-13T05:12:29.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0007e-05 2024-09-13T05:12:29.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:29.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932400+0000", 2024-09-13T05:12:29.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91881732400000005 2024-09-13T05:12:29.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:29.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932533+0000", 2024-09-13T05:12:29.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013263700000000001 2024-09-13T05:12:29.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:29.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932617+0000", 2024-09-13T05:12:29.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4313000000000004e-05 2024-09-13T05:12:29.531 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.532 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:29.532 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.532 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159517 3.0 3:03975f1c:::rbd_data.112dfd94ee88.0000000000000156:2a [read 167936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:29.532 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:12:29.532 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.505906234000001, 2024-09-13T05:12:29.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91962025700000005, 2024-09-13T05:12:29.532 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:29.532 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:29.532 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:29.532 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:29.533 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:29.533 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159517 2024-09-13T05:12:29.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.533 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:29.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:29.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:12:29.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:29.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:12:29.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:29.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013609+0000", 2024-09-13T05:12:29.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:29.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:29.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013619+0000", 2024-09-13T05:12:29.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0077e-05 2024-09-13T05:12:29.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:29.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013638+0000", 2024-09-13T05:12:29.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8739000000000001e-05 2024-09-13T05:12:29.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:29.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013653+0000", 2024-09-13T05:12:29.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5446000000000001e-05 2024-09-13T05:12:29.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:29.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016506+0000", 2024-09-13T05:12:29.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028525619999999999 2024-09-13T05:12:29.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:29.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016521+0000", 2024-09-13T05:12:29.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5310000000000001e-05 2024-09-13T05:12:29.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:29.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932964+0000", 2024-09-13T05:12:29.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91644284099999995 2024-09-13T05:12:29.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:29.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933097+0000", 2024-09-13T05:12:29.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013337599999999999 2024-09-13T05:12:29.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:29.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933231+0000", 2024-09-13T05:12:29.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133996 2024-09-13T05:12:29.537 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.537 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:29.537 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.537 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159622 3.0 3:03f7a45a:::rbd_data.112dfd94ee88.0000000000000318:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:29.537 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:12:29.537 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.504244422999999, 2024-09-13T05:12:29.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.918245003, 2024-09-13T05:12:29.537 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:29.537 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:29.537 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:29.538 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:29.538 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:29.538 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159622 2024-09-13T05:12:29.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.538 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:29.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:29.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:12:29.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:29.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:12:29.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:29.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015266+0000", 2024-09-13T05:12:29.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999928 2024-09-13T05:12:29.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:29.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015283+0000", 2024-09-13T05:12:29.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7309999999999999e-05 2024-09-13T05:12:29.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:29.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015318+0000", 2024-09-13T05:12:29.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5119e-05 2024-09-13T05:12:29.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:29.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015338+0000", 2024-09-13T05:12:29.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9259e-05 2024-09-13T05:12:29.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:29.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016558+0000", 2024-09-13T05:12:29.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012199909999999999 2024-09-13T05:12:29.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:29.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016567+0000", 2024-09-13T05:12:29.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2459999999999992e-06 2024-09-13T05:12:29.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:29.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933266+0000", 2024-09-13T05:12:29.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91669950300000003 2024-09-13T05:12:29.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:29.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:12:29.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015788099999999999 2024-09-13T05:12:29.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:29.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933518+0000", 2024-09-13T05:12:29.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3721000000000006e-05 2024-09-13T05:12:29.542 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.542 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:29.542 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.542 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173445 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 150528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:29.542 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:12:29.542 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3396676379999999, 2024-09-13T05:12:29.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064560905000000002, 2024-09-13T05:12:29.542 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:29.543 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:29.543 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:29.543 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:29.543 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:29.543 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173445 2024-09-13T05:12:29.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.543 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:29.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:29.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:12:29.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:29.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:12:29.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:29.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179849+0000", 2024-09-13T05:12:29.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:29.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:29.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179860+0000", 2024-09-13T05:12:29.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0419e-05 2024-09-13T05:12:29.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:29.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179866+0000", 2024-09-13T05:12:29.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.567e-06 2024-09-13T05:12:29.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:29.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179872+0000", 2024-09-13T05:12:29.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1830000000000002e-06 2024-09-13T05:12:29.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:29.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244262+0000", 2024-09-13T05:12:29.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064390814000000005 2024-09-13T05:12:29.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:29.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244321+0000", 2024-09-13T05:12:29.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8341000000000003e-05 2024-09-13T05:12:29.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:29.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244411+0000", 2024-09-13T05:12:29.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9911e-05 2024-09-13T05:12:29.547 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.547 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:29.547 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.547 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173446 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 157696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:29.547 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:12:29.547 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3396408710000003, 2024-09-13T05:12:29.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064714007000000004, 2024-09-13T05:12:29.547 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:29.547 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:29.547 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:29.548 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:29.548 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:29.548 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173446 2024-09-13T05:12:29.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.548 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:29.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:29.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:12:29.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:29.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:12:29.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:29.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179876+0000", 2024-09-13T05:12:29.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:29.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:29.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179879+0000", 2024-09-13T05:12:29.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1489999999999998e-06 2024-09-13T05:12:29.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:29.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179884+0000", 2024-09-13T05:12:29.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2800000000000003e-06 2024-09-13T05:12:29.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:29.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179889+0000", 2024-09-13T05:12:29.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7620000000000003e-06 2024-09-13T05:12:29.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:29.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244452+0000", 2024-09-13T05:12:29.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064562943999999997 2024-09-13T05:12:29.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:29.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244512+0000", 2024-09-13T05:12:29.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9879e-05 2024-09-13T05:12:29.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:29.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244591+0000", 2024-09-13T05:12:29.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8701000000000004e-05 2024-09-13T05:12:29.551 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.551 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:29.551 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.551 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173447 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 164864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:29.552 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:12:29.552 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3396241230000001, 2024-09-13T05:12:29.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064866246000000002, 2024-09-13T05:12:29.552 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:29.552 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:29.552 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:29.552 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:29.552 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:29.552 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173447 2024-09-13T05:12:29.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.552 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:29.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:29.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:12:29.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:29.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:12:29.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:29.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:12:29.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:29.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:29.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179895+0000", 2024-09-13T05:12:29.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6910000000000002e-06 2024-09-13T05:12:29.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:29.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179901+0000", 2024-09-13T05:12:29.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5149999999999997e-06 2024-09-13T05:12:29.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:29.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179905+0000", 2024-09-13T05:12:29.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4170000000000002e-06 2024-09-13T05:12:29.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:29.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244615+0000", 2024-09-13T05:12:29.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064709533999999999 2024-09-13T05:12:29.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:29.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244665+0000", 2024-09-13T05:12:29.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0283e-05 2024-09-13T05:12:29.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:29.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244760+0000", 2024-09-13T05:12:29.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4310999999999999e-05 2024-09-13T05:12:29.556 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.556 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:29.557 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.557 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173448 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 172032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:29.557 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:12:29.557 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.339608277, 2024-09-13T05:12:29.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065022046999999999, 2024-09-13T05:12:29.558 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:29.558 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:29.558 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:29.558 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:29.558 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:29.558 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173448 2024-09-13T05:12:29.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.559 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:29.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:29.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:12:29.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:29.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:12:29.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:29.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:12:29.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:29.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:29.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179914+0000", 2024-09-13T05:12:29.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6699999999999999e-06 2024-09-13T05:12:29.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:29.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179921+0000", 2024-09-13T05:12:29.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:12:29.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:29.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179926+0000", 2024-09-13T05:12:29.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8659999999999997e-06 2024-09-13T05:12:29.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:29.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244782+0000", 2024-09-13T05:12:29.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064856570000000002 2024-09-13T05:12:29.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:29.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244857+0000", 2024-09-13T05:12:29.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4326999999999995e-05 2024-09-13T05:12:29.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:29.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244931+0000", 2024-09-13T05:12:29.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4443999999999994e-05 2024-09-13T05:12:29.563 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.563 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:29.563 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.563 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173450 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 179200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:29.563 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:12:29.563 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3395874430000001, 2024-09-13T05:12:29.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065192589999999995, 2024-09-13T05:12:29.563 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:29.563 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:29.563 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:29.563 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:29.563 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:29.563 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173450 2024-09-13T05:12:29.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.564 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:29.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:29.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:12:29.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:29.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:12:29.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:29.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:12:29.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:29.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:29.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179932+0000", 2024-09-13T05:12:29.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2529999999999999e-06 2024-09-13T05:12:29.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:29.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179937+0000", 2024-09-13T05:12:29.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4219999999999999e-06 2024-09-13T05:12:29.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:29.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179942+0000", 2024-09-13T05:12:29.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3250000000000001e-06 2024-09-13T05:12:29.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:29.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244969+0000", 2024-09-13T05:12:29.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065027794999999999 2024-09-13T05:12:29.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:29.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245048+0000", 2024-09-13T05:12:29.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8812000000000004e-05 2024-09-13T05:12:29.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:29.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245123+0000", 2024-09-13T05:12:29.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4342000000000001e-05 2024-09-13T05:12:29.567 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.567 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:29.567 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.567 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173451 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:29.568 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:12:29.568 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3395714559999998, 2024-09-13T05:12:29.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359814000000002, 2024-09-13T05:12:29.568 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:29.568 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:29.568 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:29.568 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:29.568 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:29.568 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173451 2024-09-13T05:12:29.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.568 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:29.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:29.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:12:29.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:29.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:12:29.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:29.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:12:29.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:29.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:29.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179948+0000", 2024-09-13T05:12:29.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5119999999999998e-06 2024-09-13T05:12:29.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:29.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179954+0000", 2024-09-13T05:12:29.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5840000000000002e-06 2024-09-13T05:12:29.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:29.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179958+0000", 2024-09-13T05:12:29.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.566e-06 2024-09-13T05:12:29.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:29.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245160+0000", 2024-09-13T05:12:29.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065202057999999993 2024-09-13T05:12:29.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:29.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245228+0000", 2024-09-13T05:12:29.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7257999999999999e-05 2024-09-13T05:12:29.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:29.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245306+0000", 2024-09-13T05:12:29.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8227999999999997e-05 2024-09-13T05:12:29.572 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.572 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:29.572 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.572 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173452 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 193536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:29.572 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:12:29.573 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3395549689999999, 2024-09-13T05:12:29.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065505701, 2024-09-13T05:12:29.573 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:29.573 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:29.573 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:29.573 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:29.573 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:29.573 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173452 2024-09-13T05:12:29.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.573 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:29.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:29.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:12:29.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:29.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:12:29.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:29.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:12:29.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:29.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:29.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179965+0000", 2024-09-13T05:12:29.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.402e-06 2024-09-13T05:12:29.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:29.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179970+0000", 2024-09-13T05:12:29.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2290000000000002e-06 2024-09-13T05:12:29.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:29.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179974+0000", 2024-09-13T05:12:29.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5070000000000002e-06 2024-09-13T05:12:29.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:29.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245329+0000", 2024-09-13T05:12:29.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065354906000000004 2024-09-13T05:12:29.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:29.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245390+0000", 2024-09-13T05:12:29.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0878999999999998e-05 2024-09-13T05:12:29.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:29.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245468+0000", 2024-09-13T05:12:29.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8073999999999998e-05 2024-09-13T05:12:29.576 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.577 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:29.577 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.577 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173453 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 198656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:29.577 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:12:29.577 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3395387029999997, 2024-09-13T05:12:29.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065664343, 2024-09-13T05:12:29.577 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:29.577 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:29.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:29.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:29.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:29.577 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173453 2024-09-13T05:12:29.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.578 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:29.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:29.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:12:29.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:29.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:12:29.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:29.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179978+0000", 2024-09-13T05:12:29.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:29.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:29.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179981+0000", 2024-09-13T05:12:29.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4140000000000001e-06 2024-09-13T05:12:29.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:29.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179986+0000", 2024-09-13T05:12:29.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3519999999999997e-06 2024-09-13T05:12:29.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:29.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179991+0000", 2024-09-13T05:12:29.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6739999999999996e-06 2024-09-13T05:12:29.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:29.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245495+0000", 2024-09-13T05:12:29.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065504229999999997 2024-09-13T05:12:29.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:29.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245563+0000", 2024-09-13T05:12:29.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8119000000000003e-05 2024-09-13T05:12:29.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:29.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245643+0000", 2024-09-13T05:12:29.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9861e-05 2024-09-13T05:12:29.581 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.582 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:29.582 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.582 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173454 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:29.582 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:12:29.582 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.339490316, 2024-09-13T05:12:29.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065750457999999998, 2024-09-13T05:12:29.582 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:29.582 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:29.582 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:29.582 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:29.582 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:29.582 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173454 2024-09-13T05:12:29.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.583 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:29.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:29.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:12:29.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:29.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:12:29.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:29.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180026+0000", 2024-09-13T05:12:29.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:29.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:29.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180030+0000", 2024-09-13T05:12:29.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3790000000000002e-06 2024-09-13T05:12:29.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:29.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180036+0000", 2024-09-13T05:12:29.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5889999999999999e-06 2024-09-13T05:12:29.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:29.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180041+0000", 2024-09-13T05:12:29.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9980000000000003e-06 2024-09-13T05:12:29.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:29.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245667+0000", 2024-09-13T05:12:29.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065625124000000007 2024-09-13T05:12:29.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:29.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245705+0000", 2024-09-13T05:12:29.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7994000000000002e-05 2024-09-13T05:12:29.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:29.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245778+0000", 2024-09-13T05:12:29.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2999999999999999e-05 2024-09-13T05:12:29.586 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.586 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:29.586 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.587 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173455 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 212992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:29.587 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:12:29.587 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3394716080000002, 2024-09-13T05:12:29.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065899773999999994, 2024-09-13T05:12:29.587 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:29.587 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:29.587 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:29.588 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:29.588 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:29.588 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173455 2024-09-13T05:12:29.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.588 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:29.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:29.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:12:29.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:29.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:12:29.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:29.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180045+0000", 2024-09-13T05:12:29.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:29.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:29.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180048+0000", 2024-09-13T05:12:29.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5830000000000001e-06 2024-09-13T05:12:29.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:29.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180054+0000", 2024-09-13T05:12:29.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.789e-06 2024-09-13T05:12:29.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:29.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180059+0000", 2024-09-13T05:12:29.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.933e-06 2024-09-13T05:12:29.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:29.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245801+0000", 2024-09-13T05:12:29.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065742520999999998 2024-09-13T05:12:29.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:29.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245865+0000", 2024-09-13T05:12:29.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3325999999999996e-05 2024-09-13T05:12:29.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:29.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245946+0000", 2024-09-13T05:12:29.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0964999999999995e-05 2024-09-13T05:12:29.591 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.591 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:29.591 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.592 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173456 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:29.592 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:12:29.592 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.339454377, 2024-09-13T05:12:29.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066035128999999998, 2024-09-13T05:12:29.592 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:29.592 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:29.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:29.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:29.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:29.592 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173456 2024-09-13T05:12:29.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.592 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:29.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:29.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:12:29.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:29.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:12:29.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:29.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:12:29.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:29.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:29.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180065+0000", 2024-09-13T05:12:29.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4250000000000001e-06 2024-09-13T05:12:29.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:29.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180070+0000", 2024-09-13T05:12:29.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1749999999999996e-06 2024-09-13T05:12:29.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:29.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180075+0000", 2024-09-13T05:12:29.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4769999999999997e-06 2024-09-13T05:12:29.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:29.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245969+0000", 2024-09-13T05:12:29.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065894182999999995 2024-09-13T05:12:29.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:29.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246027+0000", 2024-09-13T05:12:29.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8165999999999998e-05 2024-09-13T05:12:29.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:29.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246098+0000", 2024-09-13T05:12:29.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1068999999999993e-05 2024-09-13T05:12:29.595 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.595 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:29.595 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.596 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173458 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:29.596 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:12:29.596 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3394383940000001, 2024-09-13T05:12:29.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066134732000000002, 2024-09-13T05:12:29.596 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:29.596 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:29.596 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:29.596 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:29.596 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:29.596 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173458 2024-09-13T05:12:29.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.596 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:29.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:29.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:12:29.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:29.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:12:29.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:29.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:12:29.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:29.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:29.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180081+0000", 2024-09-13T05:12:29.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4150000000000002e-06 2024-09-13T05:12:29.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:29.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180087+0000", 2024-09-13T05:12:29.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5389999999999998e-06 2024-09-13T05:12:29.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:29.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180101+0000", 2024-09-13T05:12:29.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4537e-05 2024-09-13T05:12:29.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:29.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246119+0000", 2024-09-13T05:12:29.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066017701999999998 2024-09-13T05:12:29.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:29.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246155+0000", 2024-09-13T05:12:29.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6094999999999999e-05 2024-09-13T05:12:29.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:29.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246214+0000", 2024-09-13T05:12:29.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8789000000000002e-05 2024-09-13T05:12:29.600 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.600 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:29.600 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.600 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173459 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 234496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:29.600 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:12:29.600 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3394108710000001, 2024-09-13T05:12:29.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066227460000000002, 2024-09-13T05:12:29.600 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:29.600 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:29.600 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:29.601 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:29.601 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:29.601 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173459 2024-09-13T05:12:29.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.601 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:29.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:29.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:12:29.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:29.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:12:29.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:29.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180106+0000", 2024-09-13T05:12:29.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:29.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:29.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180109+0000", 2024-09-13T05:12:29.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2219999999999998e-06 2024-09-13T05:12:29.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:29.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180115+0000", 2024-09-13T05:12:29.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9190000000000004e-06 2024-09-13T05:12:29.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:29.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180120+0000", 2024-09-13T05:12:29.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8930000000000004e-06 2024-09-13T05:12:29.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:29.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246236+0000", 2024-09-13T05:12:29.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066115638000000004 2024-09-13T05:12:29.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:29.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246273+0000", 2024-09-13T05:12:29.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7083999999999999e-05 2024-09-13T05:12:29.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:29.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246334+0000", 2024-09-13T05:12:29.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1183e-05 2024-09-13T05:12:29.605 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.605 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:29.605 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.606 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173460 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 241664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:29.606 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:12:29.606 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3393930650000003, 2024-09-13T05:12:29.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066360459999999996, 2024-09-13T05:12:29.606 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:29.606 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:29.607 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:29.607 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:29.607 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:29.607 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173460 2024-09-13T05:12:29.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.607 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:29.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:29.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:12:29.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:29.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:12:29.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:29.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:12:29.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:29.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:29.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180126+0000", 2024-09-13T05:12:29.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3120000000000001e-06 2024-09-13T05:12:29.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:29.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180132+0000", 2024-09-13T05:12:29.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.105e-06 2024-09-13T05:12:29.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:29.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180137+0000", 2024-09-13T05:12:29.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6829999999999999e-06 2024-09-13T05:12:29.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:29.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246365+0000", 2024-09-13T05:12:29.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066227584000000006 2024-09-13T05:12:29.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:29.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246413+0000", 2024-09-13T05:12:29.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8479000000000001e-05 2024-09-13T05:12:29.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:29.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246485+0000", 2024-09-13T05:12:29.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1600000000000006e-05 2024-09-13T05:12:29.611 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.611 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:29.611 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.611 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173461 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:29.611 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:12:29.612 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3393742959999999, 2024-09-13T05:12:29.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066492449999999995, 2024-09-13T05:12:29.612 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:29.612 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:29.612 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:29.612 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:29.612 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:29.612 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173461 2024-09-13T05:12:29.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.612 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:29.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:29.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:12:29.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:29.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:12:29.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:29.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:12:29.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:29.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:29.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180149+0000", 2024-09-13T05:12:29.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7239999999999997e-06 2024-09-13T05:12:29.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:29.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180153+0000", 2024-09-13T05:12:29.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7859999999999996e-06 2024-09-13T05:12:29.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:29.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180158+0000", 2024-09-13T05:12:29.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0300000000000001e-06 2024-09-13T05:12:29.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:29.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246508+0000", 2024-09-13T05:12:29.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066350100999999995 2024-09-13T05:12:29.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:29.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246568+0000", 2024-09-13T05:12:29.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9500000000000003e-05 2024-09-13T05:12:29.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:29.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246636+0000", 2024-09-13T05:12:29.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7633999999999997e-05 2024-09-13T05:12:29.616 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.616 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:29.616 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.616 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173462 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 256000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:29.616 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:12:29.616 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3385414679999998, 2024-09-13T05:12:29.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065773376999999994, 2024-09-13T05:12:29.616 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:29.616 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:29.617 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:29.617 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:29.617 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:29.617 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173462 2024-09-13T05:12:29.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.617 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:29.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:29.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:12:29.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:29.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:12:29.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:29.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:29.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180162+0000", 2024-09-13T05:12:29.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9991865 2024-09-13T05:12:29.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:29.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180984+0000", 2024-09-13T05:12:29.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00082184599999999999 2024-09-13T05:12:29.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:29.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180994+0000", 2024-09-13T05:12:29.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9000000000000001e-06 2024-09-13T05:12:29.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:29.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.181001+0000", 2024-09-13T05:12:29.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.917e-06 2024-09-13T05:12:29.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:29.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246653+0000", 2024-09-13T05:12:29.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065651820999999999 2024-09-13T05:12:29.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:29.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246698+0000", 2024-09-13T05:12:29.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.473e-05 2024-09-13T05:12:29.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:29.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:29.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:29.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246749+0000", 2024-09-13T05:12:29.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1758999999999997e-05 2024-09-13T05:12:29.620 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.620 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:29.621 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.621 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:29.621 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:29.621 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:29.622 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:12:29.623 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:29.623 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:29.624 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:12:29.624 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:29.624 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:29.624 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:29.624 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:29.624 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:29.625 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:29.625 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:29.625 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:29.619+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:29.723 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:29.719+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:29.779 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:29.779 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:29.779 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:29.779 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:29.789 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:12:29.790 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T05:12:29.824 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:29.820+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:29.895 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:29.895 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:29.896 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:29.896 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:29.896 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:29.904 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone42 from 0xd76b130 (overlap 0x637ea89) to 0x9f310d 2024-09-13T05:12:29.908 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:12:29.924 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:29.920+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:30.021 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:30.021 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:30.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:30.021 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:30.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.022 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136560 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3908608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:30.022 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:12:30.022 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.923145226000003, 2024-09-13T05:12:30.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056148103999999997, 2024-09-13T05:12:30.022 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.022 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:30.022 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.022 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.022 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.022 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136560 2024-09-13T05:12:30.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.022 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:12:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:12:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095289+0000", 2024-09-13T05:12:30.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095292+0000", 2024-09-13T05:12:30.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.802e-06 2024-09-13T05:12:30.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095318+0000", 2024-09-13T05:12:30.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5987999999999999e-05 2024-09-13T05:12:30.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095323+0000", 2024-09-13T05:12:30.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.006e-06 2024-09-13T05:12:30.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151316+0000", 2024-09-13T05:12:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055992593 2024-09-13T05:12:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151371+0000", 2024-09-13T05:12:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5532999999999998e-05 2024-09-13T05:12:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151438+0000", 2024-09-13T05:12:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6557999999999995e-05 2024-09-13T05:12:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.027 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.027 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136562 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3922944~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:30.027 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:30.027 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.923108108000001, 2024-09-13T05:12:30.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056259690000000001, 2024-09-13T05:12:30.027 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.027 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136562 2024-09-13T05:12:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095329+0000", 2024-09-13T05:12:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3089999999999998e-06 2024-09-13T05:12:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095333+0000", 2024-09-13T05:12:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6239999999999999e-06 2024-09-13T05:12:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095335+0000", 2024-09-13T05:12:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5660000000000001e-06 2024-09-13T05:12:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151468+0000", 2024-09-13T05:12:30.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056132608000000001 2024-09-13T05:12:30.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:30.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151519+0000", 2024-09-13T05:12:30.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1681000000000002e-05 2024-09-13T05:12:30.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151587+0000", 2024-09-13T05:12:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7200999999999996e-05 2024-09-13T05:12:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136563 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3937280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.923096686000001, 2024-09-13T05:12:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056393051999999999, 2024-09-13T05:12:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136563 2024-09-13T05:12:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:30.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:30.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:12:30.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095340+0000", 2024-09-13T05:12:30.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.561e-06 2024-09-13T05:12:30.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095342+0000", 2024-09-13T05:12:30.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8059999999999999e-06 2024-09-13T05:12:30.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095345+0000", 2024-09-13T05:12:30.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:12:30.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151621+0000", 2024-09-13T05:12:30.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056275602000000001 2024-09-13T05:12:30.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:30.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151670+0000", 2024-09-13T05:12:30.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9478000000000003e-05 2024-09-13T05:12:30.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:30.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151731+0000", 2024-09-13T05:12:30.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1054000000000002e-05 2024-09-13T05:12:30.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.039 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.040 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136565 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3951616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:30.040 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:12:30.040 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.923086372, 2024-09-13T05:12:30.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056524090999999999, 2024-09-13T05:12:30.040 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.041 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:30.041 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.041 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.041 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.041 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136565 2024-09-13T05:12:30.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.042 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:12:30.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:12:30.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095348+0000", 2024-09-13T05:12:30.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:12:30.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095350+0000", 2024-09-13T05:12:30.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4479999999999999e-06 2024-09-13T05:12:30.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095353+0000", 2024-09-13T05:12:30.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.909e-06 2024-09-13T05:12:30.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095356+0000", 2024-09-13T05:12:30.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:12:30.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151763+0000", 2024-09-13T05:12:30.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056407813000000001 2024-09-13T05:12:30.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:30.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151812+0000", 2024-09-13T05:12:30.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8306999999999997e-05 2024-09-13T05:12:30.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:30.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151873+0000", 2024-09-13T05:12:30.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1064999999999999e-05 2024-09-13T05:12:30.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.050 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.051 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136567 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3965952~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:30.051 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:12:30.051 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.923077347000003, 2024-09-13T05:12:30.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056653907000000003, 2024-09-13T05:12:30.051 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.051 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:30.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.052 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136567 2024-09-13T05:12:30.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.052 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:12:30.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:12:30.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095357+0000", 2024-09-13T05:12:30.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095359+0000", 2024-09-13T05:12:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:12:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095362+0000", 2024-09-13T05:12:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7939999999999998e-06 2024-09-13T05:12:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095365+0000", 2024-09-13T05:12:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9979999999999999e-06 2024-09-13T05:12:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151904+0000", 2024-09-13T05:12:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056539308000000003 2024-09-13T05:12:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151953+0000", 2024-09-13T05:12:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8760000000000001e-05 2024-09-13T05:12:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152012+0000", 2024-09-13T05:12:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8761999999999997e-05 2024-09-13T05:12:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136569 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3980288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.923041593000001, 2024-09-13T05:12:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056771237000000002, 2024-09-13T05:12:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136569 2024-09-13T05:12:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095395+0000", 2024-09-13T05:12:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8870000000000001e-06 2024-09-13T05:12:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095402+0000", 2024-09-13T05:12:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6290000000000001e-06 2024-09-13T05:12:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095412+0000", 2024-09-13T05:12:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1730000000000001e-06 2024-09-13T05:12:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152044+0000", 2024-09-13T05:12:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056632016 2024-09-13T05:12:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152093+0000", 2024-09-13T05:12:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9570000000000001e-05 2024-09-13T05:12:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152165+0000", 2024-09-13T05:12:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1443e-05 2024-09-13T05:12:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136571 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3994624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.923020577999999, 2024-09-13T05:12:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056894741999999998, 2024-09-13T05:12:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136571 2024-09-13T05:12:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095418+0000", 2024-09-13T05:12:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0210000000000001e-06 2024-09-13T05:12:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095422+0000", 2024-09-13T05:12:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5310000000000002e-06 2024-09-13T05:12:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095425+0000", 2024-09-13T05:12:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8880000000000001e-06 2024-09-13T05:12:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152198+0000", 2024-09-13T05:12:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056773563999999999 2024-09-13T05:12:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152249+0000", 2024-09-13T05:12:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1168999999999997e-05 2024-09-13T05:12:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152309+0000", 2024-09-13T05:12:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9821999999999997e-05 2024-09-13T05:12:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136573 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4008960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:12:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.923008351, 2024-09-13T05:12:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057045810000000002, 2024-09-13T05:12:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136573 2024-09-13T05:12:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:12:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:12:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095426+0000", 2024-09-13T05:12:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095428+0000", 2024-09-13T05:12:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.593e-06 2024-09-13T05:12:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095431+0000", 2024-09-13T05:12:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9610000000000001e-06 2024-09-13T05:12:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095434+0000", 2024-09-13T05:12:30.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:12:30.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152352+0000", 2024-09-13T05:12:30.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05691881 2024-09-13T05:12:30.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152401+0000", 2024-09-13T05:12:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8995000000000001e-05 2024-09-13T05:12:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152472+0000", 2024-09-13T05:12:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1060000000000001e-05 2024-09-13T05:12:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136575 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4023296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:12:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.922578358000003, 2024-09-13T05:12:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056760069000000003, 2024-09-13T05:12:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136575 2024-09-13T05:12:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:12:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:12:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095437+0000", 2024-09-13T05:12:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9995799 2024-09-13T05:12:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095861+0000", 2024-09-13T05:12:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000424299 2024-09-13T05:12:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095869+0000", 2024-09-13T05:12:30.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5020000000000003e-06 2024-09-13T05:12:30.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095875+0000", 2024-09-13T05:12:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:12:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152502+0000", 2024-09-13T05:12:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056626528000000002 2024-09-13T05:12:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152556+0000", 2024-09-13T05:12:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4271000000000003e-05 2024-09-13T05:12:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152617+0000", 2024-09-13T05:12:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0896000000000001e-05 2024-09-13T05:12:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136577 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4037632~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:12:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.922476903000003, 2024-09-13T05:12:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056798242999999998, 2024-09-13T05:12:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136577 2024-09-13T05:12:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:12:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:12:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095882+0000", 2024-09-13T05:12:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999242 2024-09-13T05:12:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095961+0000", 2024-09-13T05:12:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8864999999999998e-05 2024-09-13T05:12:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095973+0000", 2024-09-13T05:12:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2206e-05 2024-09-13T05:12:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095978+0000", 2024-09-13T05:12:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0629999999999996e-06 2024-09-13T05:12:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152646+0000", 2024-09-13T05:12:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056668035999999998 2024-09-13T05:12:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152695+0000", 2024-09-13T05:12:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8634000000000002e-05 2024-09-13T05:12:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:30.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152756+0000", 2024-09-13T05:12:30.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1315000000000005e-05 2024-09-13T05:12:30.082 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.082 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.082 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.082 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136579 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4051968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:30.082 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:12:30.082 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.922148808000003, 2024-09-13T05:12:30.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056610869000000001, 2024-09-13T05:12:30.082 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.082 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:30.082 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136579 2024-09-13T05:12:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:12:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:12:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095989+0000", 2024-09-13T05:12:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997029 2024-09-13T05:12:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096291+0000", 2024-09-13T05:12:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030221499999999999 2024-09-13T05:12:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096300+0000", 2024-09-13T05:12:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4819999999999994e-06 2024-09-13T05:12:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096306+0000", 2024-09-13T05:12:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:12:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152788+0000", 2024-09-13T05:12:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056481625000000001 2024-09-13T05:12:30.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:30.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152837+0000", 2024-09-13T05:12:30.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9345000000000003e-05 2024-09-13T05:12:30.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152897+0000", 2024-09-13T05:12:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9892999999999997e-05 2024-09-13T05:12:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136581 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4066304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:12:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.921969980999997, 2024-09-13T05:12:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056597091000000002, 2024-09-13T05:12:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136581 2024-09-13T05:12:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:12:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:12:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096312+0000", 2024-09-13T05:12:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998465 2024-09-13T05:12:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096469+0000", 2024-09-13T05:12:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157109 2024-09-13T05:12:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096478+0000", 2024-09-13T05:12:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3260000000000002e-06 2024-09-13T05:12:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096482+0000", 2024-09-13T05:12:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9720000000000003e-06 2024-09-13T05:12:30.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152933+0000", 2024-09-13T05:12:30.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056451128000000003 2024-09-13T05:12:30.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:30.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152993+0000", 2024-09-13T05:12:30.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9947000000000001e-05 2024-09-13T05:12:30.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:30.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153062+0000", 2024-09-13T05:12:30.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9105999999999999e-05 2024-09-13T05:12:30.092 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.092 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.092 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.093 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136583 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4080640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:30.093 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:12:30.093 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.921704067999997, 2024-09-13T05:12:30.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056496609000000003, 2024-09-13T05:12:30.093 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.093 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:30.093 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.093 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.093 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.093 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136583 2024-09-13T05:12:30.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.093 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:12:30.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:12:30.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096485+0000", 2024-09-13T05:12:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997544 2024-09-13T05:12:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096735+0000", 2024-09-13T05:12:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024979899999999998 2024-09-13T05:12:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096742+0000", 2024-09-13T05:12:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7139999999999996e-06 2024-09-13T05:12:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096747+0000", 2024-09-13T05:12:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8709999999999996e-06 2024-09-13T05:12:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153099+0000", 2024-09-13T05:12:30.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056352639000000003 2024-09-13T05:12:30.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:30.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153168+0000", 2024-09-13T05:12:30.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9029000000000006e-05 2024-09-13T05:12:30.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153228+0000", 2024-09-13T05:12:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9339999999999998e-05 2024-09-13T05:12:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136585 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4094976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:12:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.921452600999999, 2024-09-13T05:12:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056396420000000003, 2024-09-13T05:12:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136585 2024-09-13T05:12:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:12:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:12:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096750+0000", 2024-09-13T05:12:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997673 2024-09-13T05:12:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096986+0000", 2024-09-13T05:12:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000236297 2024-09-13T05:12:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096993+0000", 2024-09-13T05:12:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9600000000000003e-06 2024-09-13T05:12:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096999+0000", 2024-09-13T05:12:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:12:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153264+0000", 2024-09-13T05:12:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056264728999999999 2024-09-13T05:12:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153318+0000", 2024-09-13T05:12:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3934000000000002e-05 2024-09-13T05:12:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153379+0000", 2024-09-13T05:12:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1206999999999999e-05 2024-09-13T05:12:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136586 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4109312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:12:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.921251798999997, 2024-09-13T05:12:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056374703999999998, 2024-09-13T05:12:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.105 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136586 2024-09-13T05:12:30.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.105 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:12:30.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:12:30.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097004+0000", 2024-09-13T05:12:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998207 2024-09-13T05:12:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097187+0000", 2024-09-13T05:12:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018337900000000001 2024-09-13T05:12:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097198+0000", 2024-09-13T05:12:30.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348e-05 2024-09-13T05:12:30.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097202+0000", 2024-09-13T05:12:30.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.121e-06 2024-09-13T05:12:30.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153411+0000", 2024-09-13T05:12:30.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056209510999999997 2024-09-13T05:12:30.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:30.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153464+0000", 2024-09-13T05:12:30.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2605000000000002e-05 2024-09-13T05:12:30.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:30.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153558+0000", 2024-09-13T05:12:30.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4017999999999993e-05 2024-09-13T05:12:30.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.109 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.109 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136588 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:30.109 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:12:30.109 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.920967615999999, 2024-09-13T05:12:30.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056274980000000002, 2024-09-13T05:12:30.110 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.110 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:30.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.110 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136588 2024-09-13T05:12:30.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.110 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:12:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:12:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097205+0000", 2024-09-13T05:12:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997377 2024-09-13T05:12:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097471+0000", 2024-09-13T05:12:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026628200000000001 2024-09-13T05:12:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097484+0000", 2024-09-13T05:12:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2493e-05 2024-09-13T05:12:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097488+0000", 2024-09-13T05:12:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9330000000000003e-06 2024-09-13T05:12:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153600+0000", 2024-09-13T05:12:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056112097 2024-09-13T05:12:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153654+0000", 2024-09-13T05:12:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4126000000000003e-05 2024-09-13T05:12:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153742+0000", 2024-09-13T05:12:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.831e-05 2024-09-13T05:12:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136589 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4137984~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:12:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.920828309000001, 2024-09-13T05:12:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056293867999999997, 2024-09-13T05:12:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136589 2024-09-13T05:12:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:12:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:12:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097491+0000", 2024-09-13T05:12:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998841 2024-09-13T05:12:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097610+0000", 2024-09-13T05:12:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119263 2024-09-13T05:12:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097617+0000", 2024-09-13T05:12:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6490000000000002e-06 2024-09-13T05:12:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097624+0000", 2024-09-13T05:12:30.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6309999999999997e-06 2024-09-13T05:12:30.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153779+0000", 2024-09-13T05:12:30.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056155153999999999 2024-09-13T05:12:30.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:30.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153831+0000", 2024-09-13T05:12:30.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2080000000000003e-05 2024-09-13T05:12:30.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:30.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153901+0000", 2024-09-13T05:12:30.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9765999999999996e-05 2024-09-13T05:12:30.119 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.119 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136965 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3366912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:12:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.900859488000002, 2024-09-13T05:12:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056225403, 2024-09-13T05:12:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136965 2024-09-13T05:12:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:12:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:12:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117575+0000", 2024-09-13T05:12:30.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117578+0000", 2024-09-13T05:12:30.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4899999999999999e-06 2024-09-13T05:12:30.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117583+0000", 2024-09-13T05:12:30.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.074e-06 2024-09-13T05:12:30.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117587+0000", 2024-09-13T05:12:30.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5360000000000003e-06 2024-09-13T05:12:30.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173622+0000", 2024-09-13T05:12:30.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056034527000000001 2024-09-13T05:12:30.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:30.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173704+0000", 2024-09-13T05:12:30.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2137000000000003e-05 2024-09-13T05:12:30.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:30.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173801+0000", 2024-09-13T05:12:30.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7048999999999999e-05 2024-09-13T05:12:30.126 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.126 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.126 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.126 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136991 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3553280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:30.126 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:30.126 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.896933711000003, 2024-09-13T05:12:30.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056330199999999997, 2024-09-13T05:12:30.127 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.127 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:30.127 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.127 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.127 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.127 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136991 2024-09-13T05:12:30.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.128 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:30.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:30.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:30.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121504+0000", 2024-09-13T05:12:30.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7199999999999998e-06 2024-09-13T05:12:30.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121510+0000", 2024-09-13T05:12:30.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3459999999999999e-06 2024-09-13T05:12:30.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121515+0000", 2024-09-13T05:12:30.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.656e-06 2024-09-13T05:12:30.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177608+0000", 2024-09-13T05:12:30.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056093267000000002 2024-09-13T05:12:30.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:30.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177717+0000", 2024-09-13T05:12:30.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010901299999999999 2024-09-13T05:12:30.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:30.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177832+0000", 2024-09-13T05:12:30.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114604 2024-09-13T05:12:30.133 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.133 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.133 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.134 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173672 3.9 3:9520c004:::rbd_data.112d7c1bedf7.0000000000000040:29 [read 186368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:30.134 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:12:30.134 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.8330390860000003, 2024-09-13T05:12:30.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05682475, 2024-09-13T05:12:30.134 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.134 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:30.134 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.135 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.135 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.135 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173672 2024-09-13T05:12:30.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.135 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:12:30.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:12:30.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185395+0000", 2024-09-13T05:12:30.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185398+0000", 2024-09-13T05:12:30.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8260000000000001e-06 2024-09-13T05:12:30.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185404+0000", 2024-09-13T05:12:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-09-13T05:12:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185408+0000", 2024-09-13T05:12:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5279999999999997e-06 2024-09-13T05:12:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.236213+0000", 2024-09-13T05:12:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050805207999999998 2024-09-13T05:12:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.236285+0000", 2024-09-13T05:12:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1236999999999996e-05 2024-09-13T05:12:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.242221+0000", 2024-09-13T05:12:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059360050000000003 2024-09-13T05:12:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.140 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.140 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.140 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.140 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:30.141 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #41, image image_client.0-clone41 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent42 2024-09-13T05:12:30.142 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:12:30.142 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:30.136+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:30.229 INFO:teuthology.orchestra.run.smithi120.stdout:5436 trunc from 0xd76b130 to 0x6828e1c 2024-09-13T05:12:30.242 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:30.240+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:30.264 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:30.264 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:30.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.264 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195089 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.264 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.241346+0000", 2024-09-13T05:12:30.264 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.012875368999999999, 2024-09-13T05:12:30.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012906169, 2024-09-13T05:12:30.264 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.264 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.264 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.264 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.265 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.265 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195089 2024-09-13T05:12:30.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.265 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241346+0000", 2024-09-13T05:12:30.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241346+0000", 2024-09-13T05:12:30.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241345+0000", 2024-09-13T05:12:30.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:30.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241351+0000", 2024-09-13T05:12:30.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9340000000000003e-06 2024-09-13T05:12:30.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241365+0000", 2024-09-13T05:12:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4463e-05 2024-09-13T05:12:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241386+0000", 2024-09-13T05:12:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0653999999999999e-05 2024-09-13T05:12:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195121 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.242942+0000", 2024-09-13T05:12:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011279443, 2024-09-13T05:12:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011345620000000001, 2024-09-13T05:12:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195121 2024-09-13T05:12:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242942+0000", 2024-09-13T05:12:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242942+0000", 2024-09-13T05:12:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242941+0000", 2024-09-13T05:12:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242945+0000", 2024-09-13T05:12:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3289999999999998e-06 2024-09-13T05:12:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242956+0000", 2024-09-13T05:12:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1333e-05 2024-09-13T05:12:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242963+0000", 2024-09-13T05:12:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6880000000000002e-06 2024-09-13T05:12:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195153 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243738+0000", 2024-09-13T05:12:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010483539, 2024-09-13T05:12:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010576685000000001, 2024-09-13T05:12:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195153 2024-09-13T05:12:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243738+0000", 2024-09-13T05:12:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243738+0000", 2024-09-13T05:12:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243737+0000", 2024-09-13T05:12:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243739+0000", 2024-09-13T05:12:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.012e-06 2024-09-13T05:12:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243747+0000", 2024-09-13T05:12:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3259999999999998e-06 2024-09-13T05:12:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243750+0000", 2024-09-13T05:12:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8010000000000001e-06 2024-09-13T05:12:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195185 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244534+0000", 2024-09-13T05:12:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0096867280000000004, 2024-09-13T05:12:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0098079919999999998, 2024-09-13T05:12:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195185 2024-09-13T05:12:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244534+0000", 2024-09-13T05:12:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244534+0000", 2024-09-13T05:12:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244534+0000", 2024-09-13T05:12:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244537+0000", 2024-09-13T05:12:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2729999999999998e-06 2024-09-13T05:12:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244551+0000", 2024-09-13T05:12:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3834e-05 2024-09-13T05:12:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244563+0000", 2024-09-13T05:12:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1948e-05 2024-09-13T05:12:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195090 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.241392+0000", 2024-09-13T05:12:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.012828684999999999, 2024-09-13T05:12:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012975876000000001, 2024-09-13T05:12:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195090 2024-09-13T05:12:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241392+0000", 2024-09-13T05:12:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241392+0000", 2024-09-13T05:12:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241392+0000", 2024-09-13T05:12:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241396+0000", 2024-09-13T05:12:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6289999999999999e-06 2024-09-13T05:12:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241403+0000", 2024-09-13T05:12:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.52e-06 2024-09-13T05:12:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241409+0000", 2024-09-13T05:12:30.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.297e-06 2024-09-13T05:12:30.281 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.281 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.281 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.281 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195122 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.281 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.242968+0000", 2024-09-13T05:12:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011252708, 2024-09-13T05:12:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011446632, 2024-09-13T05:12:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195122 2024-09-13T05:12:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242968+0000", 2024-09-13T05:12:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242968+0000", 2024-09-13T05:12:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242968+0000", 2024-09-13T05:12:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242971+0000", 2024-09-13T05:12:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3859999999999999e-06 2024-09-13T05:12:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242986+0000", 2024-09-13T05:12:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4557e-05 2024-09-13T05:12:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243000+0000", 2024-09-13T05:12:30.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4037e-05 2024-09-13T05:12:30.285 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.285 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.285 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.285 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195154 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.285 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243754+0000", 2024-09-13T05:12:30.285 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010467462, 2024-09-13T05:12:30.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010706780000000001, 2024-09-13T05:12:30.285 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.285 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195154 2024-09-13T05:12:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243754+0000", 2024-09-13T05:12:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243754+0000", 2024-09-13T05:12:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243753+0000", 2024-09-13T05:12:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243755+0000", 2024-09-13T05:12:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9300000000000002e-06 2024-09-13T05:12:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243764+0000", 2024-09-13T05:12:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7800000000000006e-06 2024-09-13T05:12:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243768+0000", 2024-09-13T05:12:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5710000000000002e-06 2024-09-13T05:12:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195186 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244569+0000", 2024-09-13T05:12:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0096517700000000005, 2024-09-13T05:12:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0099425220000000005, 2024-09-13T05:12:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195186 2024-09-13T05:12:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.290 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244569+0000", 2024-09-13T05:12:30.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244569+0000", 2024-09-13T05:12:30.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244569+0000", 2024-09-13T05:12:30.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244572+0000", 2024-09-13T05:12:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.393e-06 2024-09-13T05:12:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244580+0000", 2024-09-13T05:12:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9920000000000007e-06 2024-09-13T05:12:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244593+0000", 2024-09-13T05:12:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.239e-05 2024-09-13T05:12:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195091 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.241415+0000", 2024-09-13T05:12:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.012806095999999999, 2024-09-13T05:12:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013150391000000001, 2024-09-13T05:12:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.294 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195091 2024-09-13T05:12:30.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.294 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241415+0000", 2024-09-13T05:12:30.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241415+0000", 2024-09-13T05:12:30.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241414+0000", 2024-09-13T05:12:30.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241418+0000", 2024-09-13T05:12:30.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.343e-06 2024-09-13T05:12:30.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241440+0000", 2024-09-13T05:12:30.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1858999999999999e-05 2024-09-13T05:12:30.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241448+0000", 2024-09-13T05:12:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8290000000000008e-06 2024-09-13T05:12:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195123 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243008+0000", 2024-09-13T05:12:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011213626000000001, 2024-09-13T05:12:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011616789000000001, 2024-09-13T05:12:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.298 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.298 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195123 2024-09-13T05:12:30.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.298 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243008+0000", 2024-09-13T05:12:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243008+0000", 2024-09-13T05:12:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243007+0000", 2024-09-13T05:12:30.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243011+0000", 2024-09-13T05:12:30.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4960000000000001e-06 2024-09-13T05:12:30.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243019+0000", 2024-09-13T05:12:30.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.208e-06 2024-09-13T05:12:30.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243026+0000", 2024-09-13T05:12:30.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8190000000000003e-06 2024-09-13T05:12:30.301 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.301 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.301 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195155 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243772+0000", 2024-09-13T05:12:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010449458, 2024-09-13T05:12:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010905547, 2024-09-13T05:12:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195155 2024-09-13T05:12:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243772+0000", 2024-09-13T05:12:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243772+0000", 2024-09-13T05:12:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243771+0000", 2024-09-13T05:12:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243774+0000", 2024-09-13T05:12:30.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0959999999999999e-06 2024-09-13T05:12:30.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243781+0000", 2024-09-13T05:12:30.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7829999999999999e-06 2024-09-13T05:12:30.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243786+0000", 2024-09-13T05:12:30.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-09-13T05:12:30.305 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.305 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.306 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.306 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195187 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.306 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244599+0000", 2024-09-13T05:12:30.306 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0096219589999999994, 2024-09-13T05:12:30.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01013088, 2024-09-13T05:12:30.306 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.306 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.306 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.307 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.307 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.307 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195187 2024-09-13T05:12:30.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.307 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244599+0000", 2024-09-13T05:12:30.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244599+0000", 2024-09-13T05:12:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244599+0000", 2024-09-13T05:12:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244602+0000", 2024-09-13T05:12:30.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3500000000000001e-06 2024-09-13T05:12:30.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244610+0000", 2024-09-13T05:12:30.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8679999999999999e-06 2024-09-13T05:12:30.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244622+0000", 2024-09-13T05:12:30.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2394e-05 2024-09-13T05:12:30.310 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.310 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.310 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.311 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195092 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.311 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.241454+0000", 2024-09-13T05:12:30.311 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.012767674, 2024-09-13T05:12:30.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013328467, 2024-09-13T05:12:30.311 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.311 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.311 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.311 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.311 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.312 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195092 2024-09-13T05:12:30.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.312 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241454+0000", 2024-09-13T05:12:30.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241454+0000", 2024-09-13T05:12:30.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241453+0000", 2024-09-13T05:12:30.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241457+0000", 2024-09-13T05:12:30.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6739999999999999e-06 2024-09-13T05:12:30.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241464+0000", 2024-09-13T05:12:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3540000000000002e-06 2024-09-13T05:12:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241475+0000", 2024-09-13T05:12:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.11e-05 2024-09-13T05:12:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195124 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243031+0000", 2024-09-13T05:12:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011189833, 2024-09-13T05:12:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011804565, 2024-09-13T05:12:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195124 2024-09-13T05:12:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243031+0000", 2024-09-13T05:12:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243031+0000", 2024-09-13T05:12:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243031+0000", 2024-09-13T05:12:30.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243034+0000", 2024-09-13T05:12:30.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2559999999999998e-06 2024-09-13T05:12:30.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243043+0000", 2024-09-13T05:12:30.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.132e-06 2024-09-13T05:12:30.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243047+0000", 2024-09-13T05:12:30.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7759999999999999e-06 2024-09-13T05:12:30.318 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.318 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.318 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195156 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243789+0000", 2024-09-13T05:12:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010431879, 2024-09-13T05:12:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011100128000000001, 2024-09-13T05:12:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195156 2024-09-13T05:12:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.320 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243789+0000", 2024-09-13T05:12:30.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243789+0000", 2024-09-13T05:12:30.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243789+0000", 2024-09-13T05:12:30.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243796+0000", 2024-09-13T05:12:30.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6839999999999999e-06 2024-09-13T05:12:30.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243802+0000", 2024-09-13T05:12:30.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1140000000000002e-06 2024-09-13T05:12:30.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243805+0000", 2024-09-13T05:12:30.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.591e-06 2024-09-13T05:12:30.323 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.323 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.323 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.323 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195188 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.323 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244634+0000", 2024-09-13T05:12:30.323 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0095867000000000001, 2024-09-13T05:12:30.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010307406999999999, 2024-09-13T05:12:30.323 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.323 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.323 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.323 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.324 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.324 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195188 2024-09-13T05:12:30.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.324 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244634+0000", 2024-09-13T05:12:30.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244634+0000", 2024-09-13T05:12:30.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244634+0000", 2024-09-13T05:12:30.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244637+0000", 2024-09-13T05:12:30.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2949999999999998e-06 2024-09-13T05:12:30.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244649+0000", 2024-09-13T05:12:30.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2007e-05 2024-09-13T05:12:30.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244662+0000", 2024-09-13T05:12:30.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3030000000000001e-05 2024-09-13T05:12:30.326 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.326 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.326 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.327 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195093 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.327 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.241482+0000", 2024-09-13T05:12:30.327 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.012739612000000001, 2024-09-13T05:12:30.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013514065, 2024-09-13T05:12:30.327 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.327 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.327 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195093 2024-09-13T05:12:30.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.327 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241482+0000", 2024-09-13T05:12:30.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241482+0000", 2024-09-13T05:12:30.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241481+0000", 2024-09-13T05:12:30.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241484+0000", 2024-09-13T05:12:30.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3459999999999998e-06 2024-09-13T05:12:30.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241499+0000", 2024-09-13T05:12:30.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4182000000000001e-05 2024-09-13T05:12:30.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241506+0000", 2024-09-13T05:12:30.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7570000000000004e-06 2024-09-13T05:12:30.330 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.330 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.330 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.330 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195125 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.330 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243051+0000", 2024-09-13T05:12:30.330 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011170304000000001, 2024-09-13T05:12:30.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011997165000000001, 2024-09-13T05:12:30.330 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.330 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.330 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.331 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.331 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.331 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195125 2024-09-13T05:12:30.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.331 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243051+0000", 2024-09-13T05:12:30.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243051+0000", 2024-09-13T05:12:30.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243050+0000", 2024-09-13T05:12:30.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243053+0000", 2024-09-13T05:12:30.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5069999999999999e-06 2024-09-13T05:12:30.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243063+0000", 2024-09-13T05:12:30.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0141e-05 2024-09-13T05:12:30.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243074+0000", 2024-09-13T05:12:30.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0453e-05 2024-09-13T05:12:30.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.333 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.334 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.334 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195157 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.334 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243809+0000", 2024-09-13T05:12:30.334 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010412309999999999, 2024-09-13T05:12:30.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011298674999999999, 2024-09-13T05:12:30.335 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.335 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.335 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.335 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.335 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.336 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195157 2024-09-13T05:12:30.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.336 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243809+0000", 2024-09-13T05:12:30.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243809+0000", 2024-09-13T05:12:30.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243809+0000", 2024-09-13T05:12:30.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243811+0000", 2024-09-13T05:12:30.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3369999999999998e-06 2024-09-13T05:12:30.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243821+0000", 2024-09-13T05:12:30.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0318e-05 2024-09-13T05:12:30.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243825+0000", 2024-09-13T05:12:30.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.687e-06 2024-09-13T05:12:30.341 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.342 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.342 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.342 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195189 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.342 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244675+0000", 2024-09-13T05:12:30.343 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00954611, 2024-09-13T05:12:30.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010483803999999999, 2024-09-13T05:12:30.343 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.343 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.344 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195189 2024-09-13T05:12:30.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.344 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244675+0000", 2024-09-13T05:12:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244675+0000", 2024-09-13T05:12:30.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244675+0000", 2024-09-13T05:12:30.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244678+0000", 2024-09-13T05:12:30.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4520000000000002e-06 2024-09-13T05:12:30.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244686+0000", 2024-09-13T05:12:30.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1079999999999993e-06 2024-09-13T05:12:30.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244693+0000", 2024-09-13T05:12:30.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5599999999999999e-06 2024-09-13T05:12:30.350 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.350 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.350 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.351 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195094 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.351 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.241512+0000", 2024-09-13T05:12:30.351 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.012709155999999999, 2024-09-13T05:12:30.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013697412000000001, 2024-09-13T05:12:30.351 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.352 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.352 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.352 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.352 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.352 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195094 2024-09-13T05:12:30.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.353 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241512+0000", 2024-09-13T05:12:30.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241512+0000", 2024-09-13T05:12:30.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241511+0000", 2024-09-13T05:12:30.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241515+0000", 2024-09-13T05:12:30.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2370000000000001e-06 2024-09-13T05:12:30.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241530+0000", 2024-09-13T05:12:30.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5364999999999999e-05 2024-09-13T05:12:30.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241536+0000", 2024-09-13T05:12:30.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3430000000000001e-06 2024-09-13T05:12:30.358 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.358 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.358 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.359 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195126 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.359 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243077+0000", 2024-09-13T05:12:30.359 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011143993, 2024-09-13T05:12:30.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012185521, 2024-09-13T05:12:30.359 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.360 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.360 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.360 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.360 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.360 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195126 2024-09-13T05:12:30.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.361 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243077+0000", 2024-09-13T05:12:30.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243077+0000", 2024-09-13T05:12:30.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243077+0000", 2024-09-13T05:12:30.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243079+0000", 2024-09-13T05:12:30.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0480000000000001e-06 2024-09-13T05:12:30.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243083+0000", 2024-09-13T05:12:30.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1590000000000003e-06 2024-09-13T05:12:30.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243087+0000", 2024-09-13T05:12:30.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7960000000000002e-06 2024-09-13T05:12:30.364 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.364 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.364 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.365 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195158 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.365 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243828+0000", 2024-09-13T05:12:30.365 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010393131999999999, 2024-09-13T05:12:30.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011485033, 2024-09-13T05:12:30.365 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.365 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.365 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.365 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.365 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.365 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195158 2024-09-13T05:12:30.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.365 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243828+0000", 2024-09-13T05:12:30.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243828+0000", 2024-09-13T05:12:30.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243828+0000", 2024-09-13T05:12:30.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243830+0000", 2024-09-13T05:12:30.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.103e-06 2024-09-13T05:12:30.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243843+0000", 2024-09-13T05:12:30.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2794e-05 2024-09-13T05:12:30.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243846+0000", 2024-09-13T05:12:30.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8539999999999999e-06 2024-09-13T05:12:30.369 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.369 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.369 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.369 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195190 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.369 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244699+0000", 2024-09-13T05:12:30.369 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0095217159999999995, 2024-09-13T05:12:30.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010665312, 2024-09-13T05:12:30.370 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.370 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.370 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.370 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.370 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.370 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195190 2024-09-13T05:12:30.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.370 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244699+0000", 2024-09-13T05:12:30.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244699+0000", 2024-09-13T05:12:30.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244699+0000", 2024-09-13T05:12:30.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244702+0000", 2024-09-13T05:12:30.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1070000000000001e-06 2024-09-13T05:12:30.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244711+0000", 2024-09-13T05:12:30.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7809999999999994e-06 2024-09-13T05:12:30.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244717+0000", 2024-09-13T05:12:30.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.494e-06 2024-09-13T05:12:30.373 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.373 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.373 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.373 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195095 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.373 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.241542+0000", 2024-09-13T05:12:30.373 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.012679005, 2024-09-13T05:12:30.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013874772, 2024-09-13T05:12:30.373 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.373 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.373 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.373 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.373 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.374 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195095 2024-09-13T05:12:30.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.374 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241542+0000", 2024-09-13T05:12:30.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241542+0000", 2024-09-13T05:12:30.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241542+0000", 2024-09-13T05:12:30.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241550+0000", 2024-09-13T05:12:30.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8400000000000001e-06 2024-09-13T05:12:30.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241560+0000", 2024-09-13T05:12:30.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2769999999999994e-06 2024-09-13T05:12:30.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241566+0000", 2024-09-13T05:12:30.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-09-13T05:12:30.376 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.376 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.376 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.377 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195127 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.377 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243090+0000", 2024-09-13T05:12:30.377 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011130994999999999, 2024-09-13T05:12:30.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012379424, 2024-09-13T05:12:30.377 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.377 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.377 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195127 2024-09-13T05:12:30.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.377 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243090+0000", 2024-09-13T05:12:30.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243090+0000", 2024-09-13T05:12:30.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243090+0000", 2024-09-13T05:12:30.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243092+0000", 2024-09-13T05:12:30.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9850000000000001e-06 2024-09-13T05:12:30.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243103+0000", 2024-09-13T05:12:30.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0881e-05 2024-09-13T05:12:30.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243107+0000", 2024-09-13T05:12:30.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6410000000000001e-06 2024-09-13T05:12:30.379 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.379 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.379 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.380 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195159 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.380 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243850+0000", 2024-09-13T05:12:30.380 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010371267, 2024-09-13T05:12:30.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011671473, 2024-09-13T05:12:30.380 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.380 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.380 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.380 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.380 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.380 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195159 2024-09-13T05:12:30.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.380 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243850+0000", 2024-09-13T05:12:30.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243850+0000", 2024-09-13T05:12:30.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243850+0000", 2024-09-13T05:12:30.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243852+0000", 2024-09-13T05:12:30.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0779999999999998e-06 2024-09-13T05:12:30.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243856+0000", 2024-09-13T05:12:30.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2740000000000001e-06 2024-09-13T05:12:30.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243860+0000", 2024-09-13T05:12:30.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5599999999999998e-06 2024-09-13T05:12:30.383 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.383 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.384 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.384 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195191 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.384 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244723+0000", 2024-09-13T05:12:30.384 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0094984319999999994, 2024-09-13T05:12:30.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010850257, 2024-09-13T05:12:30.384 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.385 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.385 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.385 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.385 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.385 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195191 2024-09-13T05:12:30.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.385 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244723+0000", 2024-09-13T05:12:30.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244723+0000", 2024-09-13T05:12:30.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244722+0000", 2024-09-13T05:12:30.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244725+0000", 2024-09-13T05:12:30.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8789999999999999e-06 2024-09-13T05:12:30.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244736+0000", 2024-09-13T05:12:30.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1044e-05 2024-09-13T05:12:30.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244746+0000", 2024-09-13T05:12:30.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3740000000000004e-06 2024-09-13T05:12:30.388 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.388 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.388 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.388 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195096 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.388 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.241573+0000", 2024-09-13T05:12:30.388 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.012648082999999999, 2024-09-13T05:12:30.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014051414, 2024-09-13T05:12:30.388 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.388 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.388 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.389 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.389 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.389 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195096 2024-09-13T05:12:30.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.389 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241573+0000", 2024-09-13T05:12:30.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241573+0000", 2024-09-13T05:12:30.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241573+0000", 2024-09-13T05:12:30.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241576+0000", 2024-09-13T05:12:30.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.286e-06 2024-09-13T05:12:30.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241599+0000", 2024-09-13T05:12:30.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2824999999999999e-05 2024-09-13T05:12:30.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241616+0000", 2024-09-13T05:12:30.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7039999999999999e-05 2024-09-13T05:12:30.391 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.391 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.392 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.392 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195128 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.392 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243111+0000", 2024-09-13T05:12:30.392 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011110454000000001, 2024-09-13T05:12:30.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012565491999999999, 2024-09-13T05:12:30.392 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.392 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.392 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.392 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.392 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.393 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195128 2024-09-13T05:12:30.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.393 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243111+0000", 2024-09-13T05:12:30.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243111+0000", 2024-09-13T05:12:30.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243110+0000", 2024-09-13T05:12:30.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243112+0000", 2024-09-13T05:12:30.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0169999999999999e-06 2024-09-13T05:12:30.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243116+0000", 2024-09-13T05:12:30.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0600000000000001e-06 2024-09-13T05:12:30.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243120+0000", 2024-09-13T05:12:30.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7230000000000002e-06 2024-09-13T05:12:30.396 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.396 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.396 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.397 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195160 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.397 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243863+0000", 2024-09-13T05:12:30.397 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010358152000000001, 2024-09-13T05:12:30.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011864328, 2024-09-13T05:12:30.397 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.397 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.397 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.397 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.397 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.398 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195160 2024-09-13T05:12:30.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.398 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243863+0000", 2024-09-13T05:12:30.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243863+0000", 2024-09-13T05:12:30.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243863+0000", 2024-09-13T05:12:30.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243866+0000", 2024-09-13T05:12:30.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0960000000000001e-06 2024-09-13T05:12:30.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243879+0000", 2024-09-13T05:12:30.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3764000000000001e-05 2024-09-13T05:12:30.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243884+0000", 2024-09-13T05:12:30.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2760000000000002e-06 2024-09-13T05:12:30.402 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.403 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.403 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.403 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195192 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.403 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244751+0000", 2024-09-13T05:12:30.404 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0094699069999999996, 2024-09-13T05:12:30.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011006488, 2024-09-13T05:12:30.404 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.404 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.404 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195192 2024-09-13T05:12:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244751+0000", 2024-09-13T05:12:30.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244751+0000", 2024-09-13T05:12:30.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244751+0000", 2024-09-13T05:12:30.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244754+0000", 2024-09-13T05:12:30.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.14e-06 2024-09-13T05:12:30.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244762+0000", 2024-09-13T05:12:30.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6699999999999994e-06 2024-09-13T05:12:30.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244772+0000", 2024-09-13T05:12:30.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0494e-05 2024-09-13T05:12:30.414 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.414 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.414 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195097 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.241657+0000", 2024-09-13T05:12:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.012564119, 2024-09-13T05:12:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014125949, 2024-09-13T05:12:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.416 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.416 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195097 2024-09-13T05:12:30.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241657+0000", 2024-09-13T05:12:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241657+0000", 2024-09-13T05:12:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241656+0000", 2024-09-13T05:12:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241662+0000", 2024-09-13T05:12:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9109999999999998e-06 2024-09-13T05:12:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241677+0000", 2024-09-13T05:12:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5648e-05 2024-09-13T05:12:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241706+0000", 2024-09-13T05:12:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8337e-05 2024-09-13T05:12:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195129 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243124+0000", 2024-09-13T05:12:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011097427, 2024-09-13T05:12:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012684436, 2024-09-13T05:12:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195129 2024-09-13T05:12:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243124+0000", 2024-09-13T05:12:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243124+0000", 2024-09-13T05:12:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243123+0000", 2024-09-13T05:12:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243125+0000", 2024-09-13T05:12:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0020000000000001e-06 2024-09-13T05:12:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243131+0000", 2024-09-13T05:12:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:12:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243135+0000", 2024-09-13T05:12:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4520000000000002e-06 2024-09-13T05:12:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195161 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243914+0000", 2024-09-13T05:12:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0103068, 2024-09-13T05:12:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011919377, 2024-09-13T05:12:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195161 2024-09-13T05:12:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243914+0000", 2024-09-13T05:12:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243914+0000", 2024-09-13T05:12:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243914+0000", 2024-09-13T05:12:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243917+0000", 2024-09-13T05:12:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5049999999999999e-06 2024-09-13T05:12:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243926+0000", 2024-09-13T05:12:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3680000000000002e-06 2024-09-13T05:12:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243939+0000", 2024-09-13T05:12:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3611000000000001e-05 2024-09-13T05:12:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195193 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244797+0000", 2024-09-13T05:12:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0094245509999999998, 2024-09-13T05:12:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011099489000000001, 2024-09-13T05:12:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195193 2024-09-13T05:12:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244797+0000", 2024-09-13T05:12:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244797+0000", 2024-09-13T05:12:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244796+0000", 2024-09-13T05:12:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244800+0000", 2024-09-13T05:12:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:12:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244812+0000", 2024-09-13T05:12:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.258e-05 2024-09-13T05:12:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244823+0000", 2024-09-13T05:12:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0197000000000001e-05 2024-09-13T05:12:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195098 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.241721+0000", 2024-09-13T05:12:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.012500103, 2024-09-13T05:12:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014226496, 2024-09-13T05:12:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195098 2024-09-13T05:12:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241721+0000", 2024-09-13T05:12:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241721+0000", 2024-09-13T05:12:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241720+0000", 2024-09-13T05:12:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241726+0000", 2024-09-13T05:12:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5600000000000001e-06 2024-09-13T05:12:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241748+0000", 2024-09-13T05:12:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1759999999999998e-05 2024-09-13T05:12:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241768+0000", 2024-09-13T05:12:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0854000000000001e-05 2024-09-13T05:12:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195130 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243138+0000", 2024-09-13T05:12:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011083206999999999, 2024-09-13T05:12:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012861332, 2024-09-13T05:12:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195130 2024-09-13T05:12:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243138+0000", 2024-09-13T05:12:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243138+0000", 2024-09-13T05:12:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243138+0000", 2024-09-13T05:12:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243140+0000", 2024-09-13T05:12:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.928e-06 2024-09-13T05:12:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243144+0000", 2024-09-13T05:12:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.941e-06 2024-09-13T05:12:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243147+0000", 2024-09-13T05:12:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.619e-06 2024-09-13T05:12:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195162 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243945+0000", 2024-09-13T05:12:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010275764999999999, 2024-09-13T05:12:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012088308000000001, 2024-09-13T05:12:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195162 2024-09-13T05:12:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243945+0000", 2024-09-13T05:12:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243945+0000", 2024-09-13T05:12:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243945+0000", 2024-09-13T05:12:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243948+0000", 2024-09-13T05:12:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2499999999999998e-06 2024-09-13T05:12:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243956+0000", 2024-09-13T05:12:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7039999999999994e-06 2024-09-13T05:12:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243963+0000", 2024-09-13T05:12:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7240000000000003e-06 2024-09-13T05:12:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195199 3.8 3:12df2633:::rbd_data.112d840e2e7a.00000000000001a1:head [call rbd.sparse_copyup in=24b,set-alloc-hint object_size 262144 write_size 262144,truncate 16384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.255309+0000", 2024-09-13T05:12:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9989123, 2024-09-13T05:12:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00077571400000000005, 2024-09-13T05:12:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-13T05:12:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195199 2024-09-13T05:12:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.255309+0000", 2024-09-13T05:12:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.255309+0000", 2024-09-13T05:12:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.255308+0000", 2024-09-13T05:12:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.255314+0000", 2024-09-13T05:12:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6460000000000004e-06 2024-09-13T05:12:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.255325+0000", 2024-09-13T05:12:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0336999999999999e-05 2024-09-13T05:12:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.255331+0000", 2024-09-13T05:12:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1850000000000001e-06 2024-09-13T05:12:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.255378+0000", 2024-09-13T05:12:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7601e-05 2024-09-13T05:12:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.255497+0000", 2024-09-13T05:12:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118959 2024-09-13T05:12:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:12:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.255617+0000", 2024-09-13T05:12:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011913000000000001 2024-09-13T05:12:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195099 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.241795+0000", 2024-09-13T05:12:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.012426448, 2024-09-13T05:12:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014333591999999999, 2024-09-13T05:12:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195099 2024-09-13T05:12:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241795+0000", 2024-09-13T05:12:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241795+0000", 2024-09-13T05:12:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241794+0000", 2024-09-13T05:12:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241800+0000", 2024-09-13T05:12:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2859999999999996e-06 2024-09-13T05:12:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241819+0000", 2024-09-13T05:12:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9457e-05 2024-09-13T05:12:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241836+0000", 2024-09-13T05:12:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6985000000000001e-05 2024-09-13T05:12:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195131 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243150+0000", 2024-09-13T05:12:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011071045, 2024-09-13T05:12:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013018205999999999, 2024-09-13T05:12:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195131 2024-09-13T05:12:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243150+0000", 2024-09-13T05:12:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243150+0000", 2024-09-13T05:12:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243150+0000", 2024-09-13T05:12:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243152+0000", 2024-09-13T05:12:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1119999999999999e-06 2024-09-13T05:12:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243156+0000", 2024-09-13T05:12:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9489999999999998e-06 2024-09-13T05:12:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243159+0000", 2024-09-13T05:12:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4709999999999999e-06 2024-09-13T05:12:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195163 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243968+0000", 2024-09-13T05:12:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010252785, 2024-09-13T05:12:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012232237999999999, 2024-09-13T05:12:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195163 2024-09-13T05:12:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243968+0000", 2024-09-13T05:12:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243968+0000", 2024-09-13T05:12:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243968+0000", 2024-09-13T05:12:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243971+0000", 2024-09-13T05:12:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4979999999999998e-06 2024-09-13T05:12:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243986+0000", 2024-09-13T05:12:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4202999999999999e-05 2024-09-13T05:12:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243996+0000", 2024-09-13T05:12:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.009e-05 2024-09-13T05:12:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195100 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.241857+0000", 2024-09-13T05:12:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.012364491999999999, 2024-09-13T05:12:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014389971999999999, 2024-09-13T05:12:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195100 2024-09-13T05:12:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241857+0000", 2024-09-13T05:12:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241857+0000", 2024-09-13T05:12:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241856+0000", 2024-09-13T05:12:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241862+0000", 2024-09-13T05:12:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3260000000000001e-06 2024-09-13T05:12:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241893+0000", 2024-09-13T05:12:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0942000000000003e-05 2024-09-13T05:12:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241909+0000", 2024-09-13T05:12:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5373999999999999e-05 2024-09-13T05:12:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195132 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243163+0000", 2024-09-13T05:12:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011058619, 2024-09-13T05:12:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013134142999999999, 2024-09-13T05:12:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195132 2024-09-13T05:12:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243163+0000", 2024-09-13T05:12:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243163+0000", 2024-09-13T05:12:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243162+0000", 2024-09-13T05:12:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243168+0000", 2024-09-13T05:12:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3029999999999999e-06 2024-09-13T05:12:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243172+0000", 2024-09-13T05:12:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2849999999999996e-06 2024-09-13T05:12:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243175+0000", 2024-09-13T05:12:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.54e-06 2024-09-13T05:12:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195164 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244002+0000", 2024-09-13T05:12:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010219146, 2024-09-13T05:12:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012339568, 2024-09-13T05:12:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195164 2024-09-13T05:12:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244002+0000", 2024-09-13T05:12:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244002+0000", 2024-09-13T05:12:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244002+0000", 2024-09-13T05:12:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244005+0000", 2024-09-13T05:12:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4000000000000001e-06 2024-09-13T05:12:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244015+0000", 2024-09-13T05:12:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9310000000000003e-06 2024-09-13T05:12:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244028+0000", 2024-09-13T05:12:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3585e-05 2024-09-13T05:12:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195101 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.241923+0000", 2024-09-13T05:12:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.012297771000000001, 2024-09-13T05:12:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014465992, 2024-09-13T05:12:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195101 2024-09-13T05:12:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241923+0000", 2024-09-13T05:12:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241923+0000", 2024-09-13T05:12:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241923+0000", 2024-09-13T05:12:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241928+0000", 2024-09-13T05:12:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5690000000000004e-06 2024-09-13T05:12:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241958+0000", 2024-09-13T05:12:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9747000000000002e-05 2024-09-13T05:12:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241975+0000", 2024-09-13T05:12:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7025999999999999e-05 2024-09-13T05:12:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195133 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243179+0000", 2024-09-13T05:12:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011042445, 2024-09-13T05:12:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013237722, 2024-09-13T05:12:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195133 2024-09-13T05:12:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243179+0000", 2024-09-13T05:12:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243179+0000", 2024-09-13T05:12:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243178+0000", 2024-09-13T05:12:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243180+0000", 2024-09-13T05:12:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9599999999999999e-06 2024-09-13T05:12:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243185+0000", 2024-09-13T05:12:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1160000000000001e-06 2024-09-13T05:12:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243189+0000", 2024-09-13T05:12:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8250000000000004e-06 2024-09-13T05:12:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195165 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244041+0000", 2024-09-13T05:12:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010180341000000001, 2024-09-13T05:12:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012403134, 2024-09-13T05:12:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195165 2024-09-13T05:12:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244041+0000", 2024-09-13T05:12:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244041+0000", 2024-09-13T05:12:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244040+0000", 2024-09-13T05:12:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244044+0000", 2024-09-13T05:12:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.23e-06 2024-09-13T05:12:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244052+0000", 2024-09-13T05:12:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.96e-06 2024-09-13T05:12:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244061+0000", 2024-09-13T05:12:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7380000000000006e-06 2024-09-13T05:12:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195102 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.241986+0000", 2024-09-13T05:12:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.012235098, 2024-09-13T05:12:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014499498, 2024-09-13T05:12:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195102 2024-09-13T05:12:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241986+0000", 2024-09-13T05:12:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241986+0000", 2024-09-13T05:12:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241985+0000", 2024-09-13T05:12:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.241991+0000", 2024-09-13T05:12:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9030000000000001e-06 2024-09-13T05:12:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242022+0000", 2024-09-13T05:12:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0830999999999997e-05 2024-09-13T05:12:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242051+0000", 2024-09-13T05:12:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9352999999999998e-05 2024-09-13T05:12:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195134 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243193+0000", 2024-09-13T05:12:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011028596999999999, 2024-09-13T05:12:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013351398, 2024-09-13T05:12:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195134 2024-09-13T05:12:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243193+0000", 2024-09-13T05:12:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243193+0000", 2024-09-13T05:12:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243192+0000", 2024-09-13T05:12:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243195+0000", 2024-09-13T05:12:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2259999999999999e-06 2024-09-13T05:12:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243199+0000", 2024-09-13T05:12:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0890000000000002e-06 2024-09-13T05:12:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243202+0000", 2024-09-13T05:12:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.579e-06 2024-09-13T05:12:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195166 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244067+0000", 2024-09-13T05:12:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010153898999999999, 2024-09-13T05:12:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012528278, 2024-09-13T05:12:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195166 2024-09-13T05:12:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244067+0000", 2024-09-13T05:12:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244067+0000", 2024-09-13T05:12:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244067+0000", 2024-09-13T05:12:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244070+0000", 2024-09-13T05:12:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1650000000000002e-06 2024-09-13T05:12:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244084+0000", 2024-09-13T05:12:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4139e-05 2024-09-13T05:12:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244097+0000", 2024-09-13T05:12:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2977e-05 2024-09-13T05:12:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195103 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.242087+0000", 2024-09-13T05:12:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.01213418, 2024-09-13T05:12:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014564209999999999, 2024-09-13T05:12:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195103 2024-09-13T05:12:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242087+0000", 2024-09-13T05:12:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242087+0000", 2024-09-13T05:12:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242086+0000", 2024-09-13T05:12:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242092+0000", 2024-09-13T05:12:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.285e-06 2024-09-13T05:12:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242123+0000", 2024-09-13T05:12:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1111000000000001e-05 2024-09-13T05:12:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242136+0000", 2024-09-13T05:12:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2774e-05 2024-09-13T05:12:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195135 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243206+0000", 2024-09-13T05:12:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011015626000000001, 2024-09-13T05:12:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013498283999999999, 2024-09-13T05:12:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195135 2024-09-13T05:12:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243206+0000", 2024-09-13T05:12:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243206+0000", 2024-09-13T05:12:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243205+0000", 2024-09-13T05:12:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243207+0000", 2024-09-13T05:12:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.903e-06 2024-09-13T05:12:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243211+0000", 2024-09-13T05:12:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0609999999999997e-06 2024-09-13T05:12:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243216+0000", 2024-09-13T05:12:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3850000000000004e-06 2024-09-13T05:12:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195167 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244103+0000", 2024-09-13T05:12:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010117983000000001, 2024-09-13T05:12:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012654881999999999, 2024-09-13T05:12:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195167 2024-09-13T05:12:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244103+0000", 2024-09-13T05:12:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244103+0000", 2024-09-13T05:12:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244103+0000", 2024-09-13T05:12:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244106+0000", 2024-09-13T05:12:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5099999999999999e-06 2024-09-13T05:12:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244116+0000", 2024-09-13T05:12:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8439999999999993e-06 2024-09-13T05:12:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244128+0000", 2024-09-13T05:12:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1497e-05 2024-09-13T05:12:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195104 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.242155+0000", 2024-09-13T05:12:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.012066204000000001, 2024-09-13T05:12:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014653869999999999, 2024-09-13T05:12:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195104 2024-09-13T05:12:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242155+0000", 2024-09-13T05:12:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242155+0000", 2024-09-13T05:12:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242154+0000", 2024-09-13T05:12:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242161+0000", 2024-09-13T05:12:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3969999999999999e-06 2024-09-13T05:12:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242180+0000", 2024-09-13T05:12:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9062000000000001e-05 2024-09-13T05:12:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242200+0000", 2024-09-13T05:12:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0562999999999999e-05 2024-09-13T05:12:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195136 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243219+0000", 2024-09-13T05:12:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011001985000000001, 2024-09-13T05:12:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013639587, 2024-09-13T05:12:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195136 2024-09-13T05:12:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243219+0000", 2024-09-13T05:12:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243219+0000", 2024-09-13T05:12:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243219+0000", 2024-09-13T05:12:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243221+0000", 2024-09-13T05:12:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6129999999999998e-06 2024-09-13T05:12:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243234+0000", 2024-09-13T05:12:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2455e-05 2024-09-13T05:12:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243245+0000", 2024-09-13T05:12:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1314999999999999e-05 2024-09-13T05:12:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195168 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244140+0000", 2024-09-13T05:12:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010081305, 2024-09-13T05:12:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012771581000000001, 2024-09-13T05:12:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195168 2024-09-13T05:12:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244140+0000", 2024-09-13T05:12:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244140+0000", 2024-09-13T05:12:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244139+0000", 2024-09-13T05:12:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244148+0000", 2024-09-13T05:12:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4679999999999992e-06 2024-09-13T05:12:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244161+0000", 2024-09-13T05:12:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3210000000000001e-05 2024-09-13T05:12:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244174+0000", 2024-09-13T05:12:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2925000000000001e-05 2024-09-13T05:12:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195105 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.242215+0000", 2024-09-13T05:12:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.012005951000000001, 2024-09-13T05:12:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014757098, 2024-09-13T05:12:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195105 2024-09-13T05:12:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242215+0000", 2024-09-13T05:12:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242215+0000", 2024-09-13T05:12:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242214+0000", 2024-09-13T05:12:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242220+0000", 2024-09-13T05:12:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6999999999999996e-06 2024-09-13T05:12:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242239+0000", 2024-09-13T05:12:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8856999999999999e-05 2024-09-13T05:12:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242255+0000", 2024-09-13T05:12:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6385e-05 2024-09-13T05:12:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195137 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243250+0000", 2024-09-13T05:12:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010971224999999999, 2024-09-13T05:12:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013777622999999999, 2024-09-13T05:12:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195137 2024-09-13T05:12:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243250+0000", 2024-09-13T05:12:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243250+0000", 2024-09-13T05:12:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243249+0000", 2024-09-13T05:12:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243253+0000", 2024-09-13T05:12:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6370000000000001e-06 2024-09-13T05:12:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243267+0000", 2024-09-13T05:12:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3879e-05 2024-09-13T05:12:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243277+0000", 2024-09-13T05:12:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9529999999999994e-06 2024-09-13T05:12:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195169 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244180+0000", 2024-09-13T05:12:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010040779, 2024-09-13T05:12:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012893408, 2024-09-13T05:12:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195169 2024-09-13T05:12:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244180+0000", 2024-09-13T05:12:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244180+0000", 2024-09-13T05:12:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244180+0000", 2024-09-13T05:12:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244183+0000", 2024-09-13T05:12:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2969999999999999e-06 2024-09-13T05:12:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244192+0000", 2024-09-13T05:12:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6770000000000001e-06 2024-09-13T05:12:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244200+0000", 2024-09-13T05:12:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3410000000000003e-06 2024-09-13T05:12:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195106 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.242307+0000", 2024-09-13T05:12:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011914202, 2024-09-13T05:12:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014813218, 2024-09-13T05:12:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195106 2024-09-13T05:12:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242307+0000", 2024-09-13T05:12:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242307+0000", 2024-09-13T05:12:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242306+0000", 2024-09-13T05:12:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242312+0000", 2024-09-13T05:12:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1680000000000001e-06 2024-09-13T05:12:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242327+0000", 2024-09-13T05:12:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5099999999999999e-05 2024-09-13T05:12:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242343+0000", 2024-09-13T05:12:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5979999999999999e-05 2024-09-13T05:12:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195138 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243282+0000", 2024-09-13T05:12:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010938865000000001, 2024-09-13T05:12:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013890273, 2024-09-13T05:12:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195138 2024-09-13T05:12:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243282+0000", 2024-09-13T05:12:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243282+0000", 2024-09-13T05:12:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243282+0000", 2024-09-13T05:12:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243285+0000", 2024-09-13T05:12:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4039999999999999e-06 2024-09-13T05:12:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243293+0000", 2024-09-13T05:12:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5209999999999997e-06 2024-09-13T05:12:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243302+0000", 2024-09-13T05:12:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4199999999999996e-06 2024-09-13T05:12:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195170 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244207+0000", 2024-09-13T05:12:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010014346, 2024-09-13T05:12:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013020179999999999, 2024-09-13T05:12:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195170 2024-09-13T05:12:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244207+0000", 2024-09-13T05:12:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244207+0000", 2024-09-13T05:12:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244206+0000", 2024-09-13T05:12:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244210+0000", 2024-09-13T05:12:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1379999999999999e-06 2024-09-13T05:12:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244217+0000", 2024-09-13T05:12:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4490000000000002e-06 2024-09-13T05:12:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244229+0000", 2024-09-13T05:12:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1534e-05 2024-09-13T05:12:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195107 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.242349+0000", 2024-09-13T05:12:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011871797, 2024-09-13T05:12:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014929962, 2024-09-13T05:12:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195107 2024-09-13T05:12:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242349+0000", 2024-09-13T05:12:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242349+0000", 2024-09-13T05:12:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242349+0000", 2024-09-13T05:12:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242358+0000", 2024-09-13T05:12:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4339999999999998e-06 2024-09-13T05:12:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242366+0000", 2024-09-13T05:12:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5399999999999998e-06 2024-09-13T05:12:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242373+0000", 2024-09-13T05:12:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7830000000000001e-06 2024-09-13T05:12:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195139 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243308+0000", 2024-09-13T05:12:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010913261, 2024-09-13T05:12:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014026571, 2024-09-13T05:12:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195139 2024-09-13T05:12:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243308+0000", 2024-09-13T05:12:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243308+0000", 2024-09-13T05:12:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243307+0000", 2024-09-13T05:12:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243311+0000", 2024-09-13T05:12:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1640000000000001e-06 2024-09-13T05:12:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243318+0000", 2024-09-13T05:12:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7300000000000005e-06 2024-09-13T05:12:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243330+0000", 2024-09-13T05:12:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1827999999999999e-05 2024-09-13T05:12:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195171 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244235+0000", 2024-09-13T05:12:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0099860969999999993, 2024-09-13T05:12:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013152041, 2024-09-13T05:12:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195171 2024-09-13T05:12:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244235+0000", 2024-09-13T05:12:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244235+0000", 2024-09-13T05:12:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244235+0000", 2024-09-13T05:12:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244238+0000", 2024-09-13T05:12:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.157e-06 2024-09-13T05:12:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244252+0000", 2024-09-13T05:12:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4357e-05 2024-09-13T05:12:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244262+0000", 2024-09-13T05:12:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5710000000000004e-06 2024-09-13T05:12:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195108 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.242378+0000", 2024-09-13T05:12:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011842741, 2024-09-13T05:12:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015061286, 2024-09-13T05:12:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195108 2024-09-13T05:12:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242378+0000", 2024-09-13T05:12:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242378+0000", 2024-09-13T05:12:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242378+0000", 2024-09-13T05:12:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242381+0000", 2024-09-13T05:12:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4259999999999999e-06 2024-09-13T05:12:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242405+0000", 2024-09-13T05:12:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3215999999999999e-05 2024-09-13T05:12:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242412+0000", 2024-09-13T05:12:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6520000000000006e-06 2024-09-13T05:12:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195140 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243337+0000", 2024-09-13T05:12:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010883899000000001, 2024-09-13T05:12:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014153364999999999, 2024-09-13T05:12:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195140 2024-09-13T05:12:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243337+0000", 2024-09-13T05:12:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243337+0000", 2024-09-13T05:12:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243337+0000", 2024-09-13T05:12:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243340+0000", 2024-09-13T05:12:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4800000000000001e-06 2024-09-13T05:12:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243349+0000", 2024-09-13T05:12:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8089999999999999e-06 2024-09-13T05:12:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243357+0000", 2024-09-13T05:12:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4159999999999998e-06 2024-09-13T05:12:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195172 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244275+0000", 2024-09-13T05:12:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0099462219999999994, 2024-09-13T05:12:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013265612, 2024-09-13T05:12:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195172 2024-09-13T05:12:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244275+0000", 2024-09-13T05:12:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244275+0000", 2024-09-13T05:12:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244274+0000", 2024-09-13T05:12:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244278+0000", 2024-09-13T05:12:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.303e-06 2024-09-13T05:12:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244293+0000", 2024-09-13T05:12:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4803999999999999e-05 2024-09-13T05:12:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244303+0000", 2024-09-13T05:12:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9569999999999997e-06 2024-09-13T05:12:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195109 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.242421+0000", 2024-09-13T05:12:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011800141, 2024-09-13T05:12:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015250728999999999, 2024-09-13T05:12:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195109 2024-09-13T05:12:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242421+0000", 2024-09-13T05:12:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242421+0000", 2024-09-13T05:12:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242420+0000", 2024-09-13T05:12:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242424+0000", 2024-09-13T05:12:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5140000000000002e-06 2024-09-13T05:12:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242455+0000", 2024-09-13T05:12:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0893999999999999e-05 2024-09-13T05:12:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242462+0000", 2024-09-13T05:12:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2740000000000002e-06 2024-09-13T05:12:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195141 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243363+0000", 2024-09-13T05:12:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010858581000000001, 2024-09-13T05:12:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014361666, 2024-09-13T05:12:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195141 2024-09-13T05:12:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243363+0000", 2024-09-13T05:12:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243363+0000", 2024-09-13T05:12:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243362+0000", 2024-09-13T05:12:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243365+0000", 2024-09-13T05:12:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2600000000000001e-06 2024-09-13T05:12:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243373+0000", 2024-09-13T05:12:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:12:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243379+0000", 2024-09-13T05:12:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3729999999999998e-06 2024-09-13T05:12:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195173 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244306+0000", 2024-09-13T05:12:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0099148099999999996, 2024-09-13T05:12:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013472849, 2024-09-13T05:12:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195173 2024-09-13T05:12:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244306+0000", 2024-09-13T05:12:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244306+0000", 2024-09-13T05:12:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244306+0000", 2024-09-13T05:12:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244308+0000", 2024-09-13T05:12:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.232e-06 2024-09-13T05:12:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244319+0000", 2024-09-13T05:12:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0976e-05 2024-09-13T05:12:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244323+0000", 2024-09-13T05:12:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7479999999999999e-06 2024-09-13T05:12:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195110 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.242468+0000", 2024-09-13T05:12:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.01175322, 2024-09-13T05:12:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015363089, 2024-09-13T05:12:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195110 2024-09-13T05:12:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242468+0000", 2024-09-13T05:12:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242468+0000", 2024-09-13T05:12:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242467+0000", 2024-09-13T05:12:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242471+0000", 2024-09-13T05:12:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5710000000000002e-06 2024-09-13T05:12:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242485+0000", 2024-09-13T05:12:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4443e-05 2024-09-13T05:12:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242498+0000", 2024-09-13T05:12:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.308e-05 2024-09-13T05:12:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195142 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243391+0000", 2024-09-13T05:12:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010830299999999999, 2024-09-13T05:12:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014494939, 2024-09-13T05:12:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195142 2024-09-13T05:12:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243391+0000", 2024-09-13T05:12:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243391+0000", 2024-09-13T05:12:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243390+0000", 2024-09-13T05:12:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243394+0000", 2024-09-13T05:12:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3969999999999998e-06 2024-09-13T05:12:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243407+0000", 2024-09-13T05:12:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.341e-05 2024-09-13T05:12:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243413+0000", 2024-09-13T05:12:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4330000000000001e-06 2024-09-13T05:12:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195174 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244326+0000", 2024-09-13T05:12:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.009894992, 2024-09-13T05:12:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013613719, 2024-09-13T05:12:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195174 2024-09-13T05:12:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244326+0000", 2024-09-13T05:12:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244326+0000", 2024-09-13T05:12:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244326+0000", 2024-09-13T05:12:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244328+0000", 2024-09-13T05:12:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.058e-06 2024-09-13T05:12:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244334+0000", 2024-09-13T05:12:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8669999999999999e-06 2024-09-13T05:12:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244339+0000", 2024-09-13T05:12:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1209999999999998e-06 2024-09-13T05:12:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195111 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.242505+0000", 2024-09-13T05:12:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011716503, 2024-09-13T05:12:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015489208000000001, 2024-09-13T05:12:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195111 2024-09-13T05:12:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242505+0000", 2024-09-13T05:12:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242505+0000", 2024-09-13T05:12:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242504+0000", 2024-09-13T05:12:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242508+0000", 2024-09-13T05:12:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.569e-06 2024-09-13T05:12:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242518+0000", 2024-09-13T05:12:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0168e-05 2024-09-13T05:12:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242532+0000", 2024-09-13T05:12:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4486e-05 2024-09-13T05:12:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195143 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243419+0000", 2024-09-13T05:12:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010801761, 2024-09-13T05:12:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014626825, 2024-09-13T05:12:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195143 2024-09-13T05:12:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243419+0000", 2024-09-13T05:12:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243419+0000", 2024-09-13T05:12:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243419+0000", 2024-09-13T05:12:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243422+0000", 2024-09-13T05:12:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1760000000000002e-06 2024-09-13T05:12:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243431+0000", 2024-09-13T05:12:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9109999999999999e-06 2024-09-13T05:12:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243438+0000", 2024-09-13T05:12:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1860000000000003e-06 2024-09-13T05:12:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195175 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244342+0000", 2024-09-13T05:12:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0098789140000000008, 2024-09-13T05:12:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013758672, 2024-09-13T05:12:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195175 2024-09-13T05:12:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244342+0000", 2024-09-13T05:12:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244342+0000", 2024-09-13T05:12:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244342+0000", 2024-09-13T05:12:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244344+0000", 2024-09-13T05:12:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.012e-06 2024-09-13T05:12:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244352+0000", 2024-09-13T05:12:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0080000000000002e-06 2024-09-13T05:12:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244356+0000", 2024-09-13T05:12:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5669999999999999e-06 2024-09-13T05:12:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195112 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.242539+0000", 2024-09-13T05:12:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011681801, 2024-09-13T05:12:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015613170000000001, 2024-09-13T05:12:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195112 2024-09-13T05:12:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242539+0000", 2024-09-13T05:12:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242539+0000", 2024-09-13T05:12:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242538+0000", 2024-09-13T05:12:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242544+0000", 2024-09-13T05:12:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8690000000000001e-06 2024-09-13T05:12:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242557+0000", 2024-09-13T05:12:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3054000000000001e-05 2024-09-13T05:12:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242580+0000", 2024-09-13T05:12:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2796e-05 2024-09-13T05:12:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195144 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243444+0000", 2024-09-13T05:12:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010777254, 2024-09-13T05:12:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014764438, 2024-09-13T05:12:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195144 2024-09-13T05:12:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243444+0000", 2024-09-13T05:12:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243444+0000", 2024-09-13T05:12:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243443+0000", 2024-09-13T05:12:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243455+0000", 2024-09-13T05:12:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1092e-05 2024-09-13T05:12:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243474+0000", 2024-09-13T05:12:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9218000000000001e-05 2024-09-13T05:12:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243496+0000", 2024-09-13T05:12:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2260999999999999e-05 2024-09-13T05:12:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.626 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195176 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.626 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244359+0000", 2024-09-13T05:12:30.626 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0098623010000000004, 2024-09-13T05:12:30.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013901033, 2024-09-13T05:12:30.626 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.626 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.626 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.626 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.626 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.626 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195176 2024-09-13T05:12:30.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244359+0000", 2024-09-13T05:12:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244359+0000", 2024-09-13T05:12:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244359+0000", 2024-09-13T05:12:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244360+0000", 2024-09-13T05:12:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8959999999999999e-06 2024-09-13T05:12:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244365+0000", 2024-09-13T05:12:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9969999999999998e-06 2024-09-13T05:12:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244369+0000", 2024-09-13T05:12:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4580000000000002e-06 2024-09-13T05:12:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195113 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.242619+0000", 2024-09-13T05:12:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011602349, 2024-09-13T05:12:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015693163999999999, 2024-09-13T05:12:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195113 2024-09-13T05:12:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242619+0000", 2024-09-13T05:12:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242619+0000", 2024-09-13T05:12:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242618+0000", 2024-09-13T05:12:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242624+0000", 2024-09-13T05:12:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7599999999999999e-06 2024-09-13T05:12:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242638+0000", 2024-09-13T05:12:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4248e-05 2024-09-13T05:12:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242658+0000", 2024-09-13T05:12:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9686000000000001e-05 2024-09-13T05:12:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195145 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243503+0000", 2024-09-13T05:12:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010718392, 2024-09-13T05:12:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014844927000000001, 2024-09-13T05:12:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195145 2024-09-13T05:12:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243503+0000", 2024-09-13T05:12:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243503+0000", 2024-09-13T05:12:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243502+0000", 2024-09-13T05:12:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243506+0000", 2024-09-13T05:12:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.659e-06 2024-09-13T05:12:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243514+0000", 2024-09-13T05:12:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8089999999999993e-06 2024-09-13T05:12:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243520+0000", 2024-09-13T05:12:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7220000000000002e-06 2024-09-13T05:12:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195177 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244373+0000", 2024-09-13T05:12:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0098485540000000007, 2024-09-13T05:12:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014000215999999999, 2024-09-13T05:12:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195177 2024-09-13T05:12:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244373+0000", 2024-09-13T05:12:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244373+0000", 2024-09-13T05:12:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244372+0000", 2024-09-13T05:12:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244374+0000", 2024-09-13T05:12:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.906e-06 2024-09-13T05:12:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244378+0000", 2024-09-13T05:12:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.924e-06 2024-09-13T05:12:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244383+0000", 2024-09-13T05:12:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1329999999999998e-06 2024-09-13T05:12:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195114 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.640 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.242683+0000", 2024-09-13T05:12:30.640 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.01153825, 2024-09-13T05:12:30.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015716483999999999, 2024-09-13T05:12:30.640 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.640 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.640 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.640 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.640 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.640 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195114 2024-09-13T05:12:30.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.640 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242683+0000", 2024-09-13T05:12:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242683+0000", 2024-09-13T05:12:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242682+0000", 2024-09-13T05:12:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242688+0000", 2024-09-13T05:12:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9540000000000001e-06 2024-09-13T05:12:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242704+0000", 2024-09-13T05:12:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.628e-05 2024-09-13T05:12:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242734+0000", 2024-09-13T05:12:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9386e-05 2024-09-13T05:12:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195146 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243526+0000", 2024-09-13T05:12:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010695006, 2024-09-13T05:12:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014898451, 2024-09-13T05:12:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195146 2024-09-13T05:12:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243526+0000", 2024-09-13T05:12:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243526+0000", 2024-09-13T05:12:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243526+0000", 2024-09-13T05:12:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243529+0000", 2024-09-13T05:12:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1420000000000002e-06 2024-09-13T05:12:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243543+0000", 2024-09-13T05:12:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4058e-05 2024-09-13T05:12:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243556+0000", 2024-09-13T05:12:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2848e-05 2024-09-13T05:12:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195178 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244387+0000", 2024-09-13T05:12:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0098346649999999994, 2024-09-13T05:12:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014064844999999999, 2024-09-13T05:12:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195178 2024-09-13T05:12:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244387+0000", 2024-09-13T05:12:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244387+0000", 2024-09-13T05:12:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244386+0000", 2024-09-13T05:12:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244388+0000", 2024-09-13T05:12:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.903e-06 2024-09-13T05:12:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244392+0000", 2024-09-13T05:12:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9400000000000004e-06 2024-09-13T05:12:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244396+0000", 2024-09-13T05:12:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5700000000000001e-06 2024-09-13T05:12:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195115 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.242740+0000", 2024-09-13T05:12:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011481186000000001, 2024-09-13T05:12:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015737223000000002, 2024-09-13T05:12:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195115 2024-09-13T05:12:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242740+0000", 2024-09-13T05:12:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242740+0000", 2024-09-13T05:12:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242739+0000", 2024-09-13T05:12:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242743+0000", 2024-09-13T05:12:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4829999999999999e-06 2024-09-13T05:12:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242756+0000", 2024-09-13T05:12:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3004e-05 2024-09-13T05:12:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242766+0000", 2024-09-13T05:12:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0267e-05 2024-09-13T05:12:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195147 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243569+0000", 2024-09-13T05:12:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010652261, 2024-09-13T05:12:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014957059, 2024-09-13T05:12:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195147 2024-09-13T05:12:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243569+0000", 2024-09-13T05:12:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243569+0000", 2024-09-13T05:12:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243568+0000", 2024-09-13T05:12:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243572+0000", 2024-09-13T05:12:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5480000000000002e-06 2024-09-13T05:12:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243584+0000", 2024-09-13T05:12:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2413e-05 2024-09-13T05:12:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243594+0000", 2024-09-13T05:12:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0094e-05 2024-09-13T05:12:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195179 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244399+0000", 2024-09-13T05:12:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0098222159999999999, 2024-09-13T05:12:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014180643999999999, 2024-09-13T05:12:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195179 2024-09-13T05:12:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244399+0000", 2024-09-13T05:12:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244399+0000", 2024-09-13T05:12:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244399+0000", 2024-09-13T05:12:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244401+0000", 2024-09-13T05:12:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9290000000000001e-06 2024-09-13T05:12:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244405+0000", 2024-09-13T05:12:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9990000000000002e-06 2024-09-13T05:12:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244408+0000", 2024-09-13T05:12:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.76e-06 2024-09-13T05:12:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195116 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.242772+0000", 2024-09-13T05:12:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011448798, 2024-09-13T05:12:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015861475, 2024-09-13T05:12:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195116 2024-09-13T05:12:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242772+0000", 2024-09-13T05:12:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242772+0000", 2024-09-13T05:12:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242772+0000", 2024-09-13T05:12:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242775+0000", 2024-09-13T05:12:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2480000000000001e-06 2024-09-13T05:12:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242783+0000", 2024-09-13T05:12:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8129999999999996e-06 2024-09-13T05:12:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242794+0000", 2024-09-13T05:12:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1331e-05 2024-09-13T05:12:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195148 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243642+0000", 2024-09-13T05:12:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010579633999999999, 2024-09-13T05:12:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015044046, 2024-09-13T05:12:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195148 2024-09-13T05:12:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243642+0000", 2024-09-13T05:12:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243642+0000", 2024-09-13T05:12:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243641+0000", 2024-09-13T05:12:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243644+0000", 2024-09-13T05:12:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:12:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243648+0000", 2024-09-13T05:12:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7350000000000004e-06 2024-09-13T05:12:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243652+0000", 2024-09-13T05:12:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9670000000000003e-06 2024-09-13T05:12:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195180 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244413+0000", 2024-09-13T05:12:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0098077770000000002, 2024-09-13T05:12:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014329087000000001, 2024-09-13T05:12:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195180 2024-09-13T05:12:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244413+0000", 2024-09-13T05:12:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244413+0000", 2024-09-13T05:12:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244413+0000", 2024-09-13T05:12:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244419+0000", 2024-09-13T05:12:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0440000000000001e-06 2024-09-13T05:12:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244430+0000", 2024-09-13T05:12:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0380000000000001e-05 2024-09-13T05:12:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244434+0000", 2024-09-13T05:12:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1690000000000002e-06 2024-09-13T05:12:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195117 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.242801+0000", 2024-09-13T05:12:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011419963999999999, 2024-09-13T05:12:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01599395, 2024-09-13T05:12:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195117 2024-09-13T05:12:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242801+0000", 2024-09-13T05:12:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242801+0000", 2024-09-13T05:12:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242801+0000", 2024-09-13T05:12:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242804+0000", 2024-09-13T05:12:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1049999999999999e-06 2024-09-13T05:12:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242817+0000", 2024-09-13T05:12:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2840000000000001e-05 2024-09-13T05:12:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242826+0000", 2024-09-13T05:12:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5389999999999996e-06 2024-09-13T05:12:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195149 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243655+0000", 2024-09-13T05:12:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010565694, 2024-09-13T05:12:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015189233999999999, 2024-09-13T05:12:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195149 2024-09-13T05:12:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243655+0000", 2024-09-13T05:12:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243655+0000", 2024-09-13T05:12:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243655+0000", 2024-09-13T05:12:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243657+0000", 2024-09-13T05:12:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9360000000000002e-06 2024-09-13T05:12:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243669+0000", 2024-09-13T05:12:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1438e-05 2024-09-13T05:12:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243678+0000", 2024-09-13T05:12:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3959999999999995e-06 2024-09-13T05:12:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195181 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244437+0000", 2024-09-13T05:12:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0097839810000000006, 2024-09-13T05:12:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014463793000000001, 2024-09-13T05:12:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195181 2024-09-13T05:12:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244437+0000", 2024-09-13T05:12:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244437+0000", 2024-09-13T05:12:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244437+0000", 2024-09-13T05:12:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244439+0000", 2024-09-13T05:12:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9259999999999999e-06 2024-09-13T05:12:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244443+0000", 2024-09-13T05:12:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1269999999999996e-06 2024-09-13T05:12:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244447+0000", 2024-09-13T05:12:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5839999999999999e-06 2024-09-13T05:12:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195118 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.242832+0000", 2024-09-13T05:12:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.01138891, 2024-09-13T05:12:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016121328000000001, 2024-09-13T05:12:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195118 2024-09-13T05:12:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242832+0000", 2024-09-13T05:12:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242832+0000", 2024-09-13T05:12:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242832+0000", 2024-09-13T05:12:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242835+0000", 2024-09-13T05:12:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6399999999999999e-06 2024-09-13T05:12:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242843+0000", 2024-09-13T05:12:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7970000000000001e-06 2024-09-13T05:12:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242856+0000", 2024-09-13T05:12:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2943e-05 2024-09-13T05:12:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195150 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243686+0000", 2024-09-13T05:12:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010535185000000001, 2024-09-13T05:12:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015321520999999999, 2024-09-13T05:12:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195150 2024-09-13T05:12:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243686+0000", 2024-09-13T05:12:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243686+0000", 2024-09-13T05:12:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243686+0000", 2024-09-13T05:12:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243688+0000", 2024-09-13T05:12:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3300000000000001e-06 2024-09-13T05:12:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243692+0000", 2024-09-13T05:12:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2300000000000002e-06 2024-09-13T05:12:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243696+0000", 2024-09-13T05:12:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5619999999999999e-06 2024-09-13T05:12:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195182 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244450+0000", 2024-09-13T05:12:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0097714550000000001, 2024-09-13T05:12:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014611618, 2024-09-13T05:12:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195182 2024-09-13T05:12:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244450+0000", 2024-09-13T05:12:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244450+0000", 2024-09-13T05:12:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244449+0000", 2024-09-13T05:12:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244451+0000", 2024-09-13T05:12:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0590000000000001e-06 2024-09-13T05:12:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244455+0000", 2024-09-13T05:12:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0099999999999997e-06 2024-09-13T05:12:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244459+0000", 2024-09-13T05:12:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4910000000000001e-06 2024-09-13T05:12:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195119 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.242868+0000", 2024-09-13T05:12:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011353596000000001, 2024-09-13T05:12:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016248139000000002, 2024-09-13T05:12:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195119 2024-09-13T05:12:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242868+0000", 2024-09-13T05:12:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242868+0000", 2024-09-13T05:12:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242867+0000", 2024-09-13T05:12:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242871+0000", 2024-09-13T05:12:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.523e-06 2024-09-13T05:12:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242879+0000", 2024-09-13T05:12:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.32e-06 2024-09-13T05:12:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242885+0000", 2024-09-13T05:12:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3149999999999997e-06 2024-09-13T05:12:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195151 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243699+0000", 2024-09-13T05:12:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010522145, 2024-09-13T05:12:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015469350999999999, 2024-09-13T05:12:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195151 2024-09-13T05:12:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243699+0000", 2024-09-13T05:12:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243699+0000", 2024-09-13T05:12:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243699+0000", 2024-09-13T05:12:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243701+0000", 2024-09-13T05:12:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9309999999999998e-06 2024-09-13T05:12:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243705+0000", 2024-09-13T05:12:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9489999999999998e-06 2024-09-13T05:12:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243709+0000", 2024-09-13T05:12:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5900000000000001e-06 2024-09-13T05:12:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195183 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244464+0000", 2024-09-13T05:12:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0097573460000000001, 2024-09-13T05:12:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014762150999999999, 2024-09-13T05:12:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195183 2024-09-13T05:12:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244464+0000", 2024-09-13T05:12:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244464+0000", 2024-09-13T05:12:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244463+0000", 2024-09-13T05:12:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244466+0000", 2024-09-13T05:12:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5730000000000002e-06 2024-09-13T05:12:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244480+0000", 2024-09-13T05:12:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3728e-05 2024-09-13T05:12:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244485+0000", 2024-09-13T05:12:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0359999999999997e-06 2024-09-13T05:12:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195120 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.242895+0000", 2024-09-13T05:12:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011326248000000001, 2024-09-13T05:12:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016382799, 2024-09-13T05:12:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195120 2024-09-13T05:12:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242895+0000", 2024-09-13T05:12:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242895+0000", 2024-09-13T05:12:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242894+0000", 2024-09-13T05:12:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242898+0000", 2024-09-13T05:12:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5590000000000001e-06 2024-09-13T05:12:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242922+0000", 2024-09-13T05:12:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3660999999999999e-05 2024-09-13T05:12:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.242928+0000", 2024-09-13T05:12:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6340000000000003e-06 2024-09-13T05:12:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195152 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.243713+0000", 2024-09-13T05:12:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.01050866, 2024-09-13T05:12:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015621149000000001, 2024-09-13T05:12:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195152 2024-09-13T05:12:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243713+0000", 2024-09-13T05:12:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243713+0000", 2024-09-13T05:12:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243712+0000", 2024-09-13T05:12:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243714+0000", 2024-09-13T05:12:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8920000000000001e-06 2024-09-13T05:12:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243723+0000", 2024-09-13T05:12:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6570000000000003e-06 2024-09-13T05:12:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.243734+0000", 2024-09-13T05:12:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1177e-05 2024-09-13T05:12:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:195184 3.1e 3.8e9bea9e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T05:12:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:30.244506+0000", 2024-09-13T05:12:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0097149530000000001, 2024-09-13T05:12:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014879088, 2024-09-13T05:12:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-09-13T05:12:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 195184 2024-09-13T05:12:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244506+0000", 2024-09-13T05:12:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244506+0000", 2024-09-13T05:12:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244506+0000", 2024-09-13T05:12:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244509+0000", 2024-09-13T05:12:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3639999999999999e-06 2024-09-13T05:12:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244516+0000", 2024-09-13T05:12:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5739999999999998e-06 2024-09-13T05:12:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:30.244528+0000", 2024-09-13T05:12:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1464000000000001e-05 2024-09-13T05:12:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:12:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 106 2024-09-13T05:12:30.711 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:30.712 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:12:30.714 INFO:teuthology.orchestra.run.smithi120.stdout:5438 trunc from 0x6828e1c to 0x82b32ef 2024-09-13T05:12:30.714 INFO:teuthology.orchestra.run.smithi120.stdout:5439 writesame 0xb288e86 thru 0xb29602b data_size 0xf(0xd1a6 bytes) 2024-09-13T05:12:30.714 INFO:teuthology.orchestra.run.smithi120.stdout:5440 write 0x8969146 thru 0x89780a3 (0xef5e bytes) 2024-09-13T05:12:30.714 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:30.715 INFO:teuthology.orchestra.run.smithi120.stdout:5443 trunc from 0xb29602c to 0xb0776ae 2024-09-13T05:12:30.715 INFO:teuthology.orchestra.run.smithi120.stdout:5444 punch from 0x45c9dc8 to 0x45cac85, (0xebd bytes) 2024-09-13T05:12:30.715 INFO:teuthology.orchestra.run.smithi120.stdout:5445 write 0x11172c4 thru 0x111dca7 (0x69e4 bytes) 2024-09-13T05:12:30.715 INFO:teuthology.orchestra.run.smithi120.stdout:5447 write 0x397f840 thru 0x398ddc3 (0xe584 bytes) 2024-09-13T05:12:30.715 INFO:teuthology.orchestra.run.smithi120.stdout:5448 write 0xa57c29b thru 0xa58b9d0 (0xf736 bytes) 2024-09-13T05:12:30.715 INFO:teuthology.orchestra.run.smithi120.stdout:5450 trunc from 0xb0776ae to 0x5392b69 2024-09-13T05:12:30.715 INFO:teuthology.orchestra.run.smithi120.stdout:5451 writesame 0xab9e4e thru 0xac70f0 data_size 0x1(0xd2a3 bytes) 2024-09-13T05:12:30.715 INFO:teuthology.orchestra.run.smithi120.stdout:5452 read 0x2181637 thru 0x21914e0 (0xfeaa bytes) 2024-09-13T05:12:30.715 INFO:teuthology.orchestra.run.smithi120.stdout:5453 read 0x2e7acbb thru 0x2e7ba37 (0xd7d bytes) 2024-09-13T05:12:30.715 INFO:teuthology.orchestra.run.smithi120.stdout:5454 trunc from 0x5392b69 to 0xe6ca499 2024-09-13T05:12:30.715 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:30.715 INFO:teuthology.orchestra.run.smithi120.stdout:5456 read 0x5cb1a59 thru 0x5cb9ea3 (0x844b bytes) 2024-09-13T05:12:30.715 INFO:teuthology.orchestra.run.smithi120.stdout:5457 trunc from 0xe6ca499 to 0x10a1139 2024-09-13T05:12:30.716 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:30.708+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:30.718 INFO:teuthology.orchestra.run.smithi120.stdout:5458 punch from 0xf53182 to 0xf62000, (0xee7e bytes) 2024-09-13T05:12:30.718 INFO:teuthology.orchestra.run.smithi120.stdout:5461 punch from 0xf97fb9 to 0xfa1844, (0x988b bytes) 2024-09-13T05:12:30.747 INFO:teuthology.orchestra.run.smithi120.stdout:5462 write 0xb7d5796 thru 0xb7e0051 (0xa8bc bytes) 2024-09-13T05:12:30.766 INFO:teuthology.orchestra.run.smithi120.stdout:5465 read 0x7e7e00 thru 0x7f5e01 (0xe002 bytes) 2024-09-13T05:12:30.776 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:30.776 INFO:teuthology.orchestra.run.smithi120.stdout:5467 punch from 0xae54cf0 to 0xae62255, (0xd565 bytes) 2024-09-13T05:12:30.776 INFO:teuthology.orchestra.run.smithi120.stdout:5469 read 0x1464f71 thru 0x1469d82 (0x4e12 bytes) 2024-09-13T05:12:30.776 INFO:teuthology.orchestra.run.smithi120.stdout:5471 read 0x921368 thru 0x925940 (0x45d9 bytes) 2024-09-13T05:12:30.795 INFO:teuthology.orchestra.run.smithi120.stdout:5472 read 0x98c2df thru 0x9956b6 (0x93d8 bytes) 2024-09-13T05:12:30.798 INFO:tasks.thrashosds.thrasher:in_osds: [2, 3, 5, 7, 1] out_osds: [4, 0, 6] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-13T05:12:30.798 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:12:30.798 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-13T05:12:30.799 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-13T05:12:30.799 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-13T05:12:30.799 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-13T05:12:30.809 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is unset 2024-09-13T05:12:30.817 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:30.811+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:30.823 INFO:teuthology.orchestra.run.smithi120.stdout:5473 write 0xd51a6cf thru 0xd51e2c3 (0x3bf5 bytes) 2024-09-13T05:12:30.833 INFO:teuthology.orchestra.run.smithi120.stdout:5474 writesame 0xb4ef92d thru 0xb4f7a74 data_size 0x54(0x8148 bytes) 2024-09-13T05:12:30.840 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:30.840 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:30.840 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:30.840 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:30.840 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:30.847 INFO:teuthology.orchestra.run.smithi120.stdout:5476 read 0x628ba8c thru 0x6296b59 (0xb0ce bytes) 2024-09-13T05:12:30.847 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:30.847 INFO:teuthology.orchestra.run.smithi120.stdout:5478 write 0xa44d67c thru 0xa44fda8 (0x272d bytes) 2024-09-13T05:12:30.852 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:12:30.854 INFO:teuthology.orchestra.run.smithi120.stdout:5479 read 0xaecb35d thru 0xaecff8a (0x4c2e bytes) 2024-09-13T05:12:30.855 INFO:teuthology.orchestra.run.smithi120.stdout:5480 punch from 0xbd26b4e to 0xbd2ec68, (0x811a bytes) 2024-09-13T05:12:30.855 INFO:teuthology.orchestra.run.smithi120.stdout:5481 write 0x74fffa9 thru 0x7509507 (0x955f bytes) 2024-09-13T05:12:30.868 INFO:teuthology.orchestra.run.smithi120.stdout:5482 punch from 0x5af200e to 0x5afdd7c, (0xbd6e bytes) 2024-09-13T05:12:30.869 INFO:teuthology.orchestra.run.smithi120.stdout:5483 read 0x90df212 thru 0x90e41f6 (0x4fe5 bytes) 2024-09-13T05:12:30.869 INFO:teuthology.orchestra.run.smithi120.stdout:5484 punch from 0x6b10a36 to 0x6b12063, (0x162d bytes) 2024-09-13T05:12:30.869 INFO:teuthology.orchestra.run.smithi120.stdout:5485 punch from 0xbf1249f to 0xbf18be3, (0x6744 bytes) 2024-09-13T05:12:30.869 INFO:teuthology.orchestra.run.smithi120.stdout:5486 write 0x7416bfe thru 0x741b05e (0x4461 bytes) 2024-09-13T05:12:30.877 INFO:teuthology.orchestra.run.smithi120.stdout:5487 read 0xc159eb8 thru 0xc169217 (0xf360 bytes) 2024-09-13T05:12:30.877 INFO:teuthology.orchestra.run.smithi120.stdout:5489 read 0x1bc157e thru 0x1bc95c6 (0x8049 bytes) 2024-09-13T05:12:30.896 INFO:teuthology.orchestra.run.smithi120.stdout:5490 trunc from 0xd51e2c4 to 0x7c2d7a 2024-09-13T05:12:30.914 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:30.911+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:30.918 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-13T05:12:30.918 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:30.953 INFO:teuthology.orchestra.run.smithi120.stdout:5491 punch from 0x6edd80 to 0x6fa64f, (0xc8cf bytes) 2024-09-13T05:12:30.953 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:30.967 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:70758 3.2 3:427d0469:::rbd_header.112d8d1317eb:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-13T05:12:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.536277971999993, 2024-09-13T05:12:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.190313603, 2024-09-13T05:12:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70758 2024-09-13T05:12:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428654+0000", 2024-09-13T05:12:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428664+0000", 2024-09-13T05:12:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0664e-05 2024-09-13T05:12:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428683+0000", 2024-09-13T05:12:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8377e-05 2024-09-13T05:12:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428691+0000", 2024-09-13T05:12:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9400000000000008e-06 2024-09-13T05:12:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428789+0000", 2024-09-13T05:12:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7165999999999998e-05 2024-09-13T05:12:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428811+0000", 2024-09-13T05:12:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1925000000000001e-05 2024-09-13T05:12:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.617921+0000", 2024-09-13T05:12:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.189110536 2024-09-13T05:12:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618344+0000", 2024-09-13T05:12:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042245800000000001 2024-09-13T05:12:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618969+0000", 2024-09-13T05:12:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062529299999999996 2024-09-13T05:12:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162381 3.8 3.4e1a3768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:12:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.456271725000001, 2024-09-13T05:12:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.14690313199999999, 2024-09-13T05:12:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162381 2024-09-13T05:12:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:12:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:12:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508659+0000", 2024-09-13T05:12:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:12:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508673+0000", 2024-09-13T05:12:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4154999999999999e-05 2024-09-13T05:12:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508703+0000", 2024-09-13T05:12:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9427000000000001e-05 2024-09-13T05:12:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508719+0000", 2024-09-13T05:12:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6381000000000001e-05 2024-09-13T05:12:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508789+0000", 2024-09-13T05:12:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9898000000000001e-05 2024-09-13T05:12:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508799+0000", 2024-09-13T05:12:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0066e-05 2024-09-13T05:12:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655550+0000", 2024-09-13T05:12:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.146750506 2024-09-13T05:12:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655565+0000", 2024-09-13T05:12:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4915e-05 2024-09-13T05:12:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162393 3.8 3.fd966c88 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:12:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.444755651000001, 2024-09-13T05:12:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.135657895, 2024-09-13T05:12:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162393 2024-09-13T05:12:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:12:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:12:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520176+0000", 2024-09-13T05:12:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520184+0000", 2024-09-13T05:12:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5800000000000003e-06 2024-09-13T05:12:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520199+0000", 2024-09-13T05:12:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4481000000000001e-05 2024-09-13T05:12:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520209+0000", 2024-09-13T05:12:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0327e-05 2024-09-13T05:12:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520351+0000", 2024-09-13T05:12:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141827 2024-09-13T05:12:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520363+0000", 2024-09-13T05:12:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2018000000000001e-05 2024-09-13T05:12:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655819+0000", 2024-09-13T05:12:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13545665600000001 2024-09-13T05:12:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655835+0000", 2024-09-13T05:12:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6135000000000001e-05 2024-09-13T05:12:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162429 3.8 3.6e098f28 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.443905042000001, 2024-09-13T05:12:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13484765400000001, 2024-09-13T05:12:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162429 2024-09-13T05:12:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521032+0000", 2024-09-13T05:12:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3039999999999998e-06 2024-09-13T05:12:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521041+0000", 2024-09-13T05:12:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6880000000000005e-06 2024-09-13T05:12:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521047+0000", 2024-09-13T05:12:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0100000000000001e-06 2024-09-13T05:12:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521601+0000", 2024-09-13T05:12:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00055398600000000002 2024-09-13T05:12:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521613+0000", 2024-09-13T05:12:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2347000000000001e-05 2024-09-13T05:12:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655869+0000", 2024-09-13T05:12:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.134255597 2024-09-13T05:12:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655876+0000", 2024-09-13T05:12:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2790000000000001e-06 2024-09-13T05:12:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162521 3.8 3.f06bf7c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.441502912000001, 2024-09-13T05:12:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13247452600000001, 2024-09-13T05:12:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162521 2024-09-13T05:12:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523433+0000", 2024-09-13T05:12:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.128e-06 2024-09-13T05:12:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523440+0000", 2024-09-13T05:12:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9990000000000002e-06 2024-09-13T05:12:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523446+0000", 2024-09-13T05:12:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7869999999999998e-06 2024-09-13T05:12:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.528221+0000", 2024-09-13T05:12:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047747040000000003 2024-09-13T05:12:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.528237+0000", 2024-09-13T05:12:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6042e-05 2024-09-13T05:12:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655898+0000", 2024-09-13T05:12:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.127661521 2024-09-13T05:12:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655905+0000", 2024-09-13T05:12:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7780000000000002e-06 2024-09-13T05:12:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162381 3.8 3:16ec5872:::rbd_data.112dc3abcba6.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:12:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.431975746999999, 2024-09-13T05:12:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12546553899999999, 2024-09-13T05:12:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162381 2024-09-13T05:12:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:12:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:12:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532956+0000", 2024-09-13T05:12:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532964+0000", 2024-09-13T05:12:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.072e-06 2024-09-13T05:12:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532976+0000", 2024-09-13T05:12:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1355000000000001e-05 2024-09-13T05:12:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532984+0000", 2024-09-13T05:12:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3440000000000001e-06 2024-09-13T05:12:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533432+0000", 2024-09-13T05:12:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044773000000000002 2024-09-13T05:12:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533439+0000", 2024-09-13T05:12:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9890000000000003e-06 2024-09-13T05:12:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655985+0000", 2024-09-13T05:12:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122546527 2024-09-13T05:12:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656234+0000", 2024-09-13T05:12:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024911300000000003 2024-09-13T05:12:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:12:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656378+0000", 2024-09-13T05:12:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014417100000000001 2024-09-13T05:12:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657916+0000", 2024-09-13T05:12:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001537907 2024-09-13T05:12:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:12:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658308+0000", 2024-09-13T05:12:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039183700000000002 2024-09-13T05:12:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:12:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658364+0000", 2024-09-13T05:12:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5451000000000002e-05 2024-09-13T05:12:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658423+0000", 2024-09-13T05:12:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9449e-05 2024-09-13T05:12:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162393 3.8 3:113669bf:::rbd_data.112dfd94ee88.00000000000000bf:2a [read 131072~18432] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.431935968000001, 2024-09-13T05:12:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124231431, 2024-09-13T05:12:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162393 2024-09-13T05:12:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533001+0000", 2024-09-13T05:12:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8099999999999999e-06 2024-09-13T05:12:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533007+0000", 2024-09-13T05:12:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5849999999999996e-06 2024-09-13T05:12:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533012+0000", 2024-09-13T05:12:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0320000000000003e-06 2024-09-13T05:12:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533459+0000", 2024-09-13T05:12:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044646399999999999 2024-09-13T05:12:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533464+0000", 2024-09-13T05:12:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9180000000000002e-06 2024-09-13T05:12:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656870+0000", 2024-09-13T05:12:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123406847 2024-09-13T05:12:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657067+0000", 2024-09-13T05:12:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019655599999999999 2024-09-13T05:12:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657229+0000", 2024-09-13T05:12:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016175599999999999 2024-09-13T05:12:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162429 3.8 3:14f19076:::rbd_data.112dfd94ee88.0000000000000150:2a [read 131072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:12:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.431916418, 2024-09-13T05:12:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124549956, 2024-09-13T05:12:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162429 2024-09-13T05:12:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:12:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:12:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533016+0000", 2024-09-13T05:12:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533020+0000", 2024-09-13T05:12:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1049999999999999e-06 2024-09-13T05:12:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533025+0000", 2024-09-13T05:12:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-09-13T05:12:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533030+0000", 2024-09-13T05:12:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8999999999999997e-06 2024-09-13T05:12:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533481+0000", 2024-09-13T05:12:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045080400000000002 2024-09-13T05:12:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533486+0000", 2024-09-13T05:12:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3369999999999999e-06 2024-09-13T05:12:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657311+0000", 2024-09-13T05:12:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123824408 2024-09-13T05:12:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657464+0000", 2024-09-13T05:12:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015343900000000001 2024-09-13T05:12:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657567+0000", 2024-09-13T05:12:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102568 2024-09-13T05:12:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162521 3.8 3:13efd60f:::rbd_data.112dfd94ee88.000000000000031a:2a [read 131072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.431765185, 2024-09-13T05:12:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124709257, 2024-09-13T05:12:31.022 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162521 2024-09-13T05:12:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533170+0000", 2024-09-13T05:12:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3910000000000001e-06 2024-09-13T05:12:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533176+0000", 2024-09-13T05:12:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4029999999999998e-06 2024-09-13T05:12:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533180+0000", 2024-09-13T05:12:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6999999999999999e-06 2024-09-13T05:12:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533659+0000", 2024-09-13T05:12:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047839699999999998 2024-09-13T05:12:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533664+0000", 2024-09-13T05:12:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7239999999999997e-06 2024-09-13T05:12:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657619+0000", 2024-09-13T05:12:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123954412 2024-09-13T05:12:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657784+0000", 2024-09-13T05:12:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016527499999999999 2024-09-13T05:12:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657877+0000", 2024-09-13T05:12:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3280000000000001e-05 2024-09-13T05:12:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162618 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 70656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:12:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.430460475, 2024-09-13T05:12:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123752711, 2024-09-13T05:12:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162618 2024-09-13T05:12:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:12:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:12:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534472+0000", 2024-09-13T05:12:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534475+0000", 2024-09-13T05:12:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2010000000000002e-06 2024-09-13T05:12:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534482+0000", 2024-09-13T05:12:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:12:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534486+0000", 2024-09-13T05:12:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7520000000000004e-06 2024-09-13T05:12:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536456+0000", 2024-09-13T05:12:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001969527 2024-09-13T05:12:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536462+0000", 2024-09-13T05:12:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2750000000000001e-06 2024-09-13T05:12:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657939+0000", 2024-09-13T05:12:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121476769 2024-09-13T05:12:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658087+0000", 2024-09-13T05:12:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014862400000000001 2024-09-13T05:12:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658225+0000", 2024-09-13T05:12:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013800999999999999 2024-09-13T05:12:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162620 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 71680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.430426350000001, 2024-09-13T05:12:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124087688, 2024-09-13T05:12:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162620 2024-09-13T05:12:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534509+0000", 2024-09-13T05:12:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1270000000000001e-06 2024-09-13T05:12:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534514+0000", 2024-09-13T05:12:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8720000000000001e-06 2024-09-13T05:12:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534518+0000", 2024-09-13T05:12:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5090000000000004e-06 2024-09-13T05:12:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536485+0000", 2024-09-13T05:12:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019671530000000001 2024-09-13T05:12:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536491+0000", 2024-09-13T05:12:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3759999999999999e-06 2024-09-13T05:12:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658466+0000", 2024-09-13T05:12:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121975466 2024-09-13T05:12:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658522+0000", 2024-09-13T05:12:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5668999999999998e-05 2024-09-13T05:12:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658595+0000", 2024-09-13T05:12:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2800999999999996e-05 2024-09-13T05:12:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162622 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 72704~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:12:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.430395383, 2024-09-13T05:12:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124215569, 2024-09-13T05:12:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162622 2024-09-13T05:12:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:12:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:12:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534537+0000", 2024-09-13T05:12:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534540+0000", 2024-09-13T05:12:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3740000000000001e-06 2024-09-13T05:12:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534545+0000", 2024-09-13T05:12:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4210000000000003e-06 2024-09-13T05:12:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534550+0000", 2024-09-13T05:12:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3090000000000003e-06 2024-09-13T05:12:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536510+0000", 2024-09-13T05:12:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019597130000000001 2024-09-13T05:12:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536517+0000", 2024-09-13T05:12:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0620000000000003e-06 2024-09-13T05:12:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658632+0000", 2024-09-13T05:12:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122114373 2024-09-13T05:12:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658686+0000", 2024-09-13T05:12:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3882999999999999e-05 2024-09-13T05:12:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658753+0000", 2024-09-13T05:12:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7921000000000002e-05 2024-09-13T05:12:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162623 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 73728~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:12:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.430378577999999, 2024-09-13T05:12:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124350214, 2024-09-13T05:12:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162623 2024-09-13T05:12:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:12:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:12:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534554+0000", 2024-09-13T05:12:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534556+0000", 2024-09-13T05:12:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-13T05:12:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534563+0000", 2024-09-13T05:12:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2890000000000003e-06 2024-09-13T05:12:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534567+0000", 2024-09-13T05:12:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4880000000000001e-06 2024-09-13T05:12:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536538+0000", 2024-09-13T05:12:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019703989999999998 2024-09-13T05:12:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536543+0000", 2024-09-13T05:12:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3920000000000002e-06 2024-09-13T05:12:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658773+0000", 2024-09-13T05:12:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122229607 2024-09-13T05:12:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658835+0000", 2024-09-13T05:12:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1954999999999999e-05 2024-09-13T05:12:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658905+0000", 2024-09-13T05:12:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-09-13T05:12:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162626 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 65536~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.430327294000001, 2024-09-13T05:12:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124425881, 2024-09-13T05:12:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162626 2024-09-13T05:12:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534611+0000", 2024-09-13T05:12:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5419999999999996e-06 2024-09-13T05:12:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534617+0000", 2024-09-13T05:12:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5169999999999999e-06 2024-09-13T05:12:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534622+0000", 2024-09-13T05:12:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9810000000000003e-06 2024-09-13T05:12:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536563+0000", 2024-09-13T05:12:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019410549999999999 2024-09-13T05:12:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536568+0000", 2024-09-13T05:12:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4310000000000002e-06 2024-09-13T05:12:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658922+0000", 2024-09-13T05:12:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122354221 2024-09-13T05:12:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658968+0000", 2024-09-13T05:12:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5221e-05 2024-09-13T05:12:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659032+0000", 2024-09-13T05:12:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4256000000000003e-05 2024-09-13T05:12:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162628 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 66560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.430292343000001, 2024-09-13T05:12:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124532254, 2024-09-13T05:12:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162628 2024-09-13T05:12:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534643+0000", 2024-09-13T05:12:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1890000000000001e-06 2024-09-13T05:12:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534648+0000", 2024-09-13T05:12:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:12:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534652+0000", 2024-09-13T05:12:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4549999999999997e-06 2024-09-13T05:12:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536586+0000", 2024-09-13T05:12:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019336049999999999 2024-09-13T05:12:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536591+0000", 2024-09-13T05:12:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3770000000000004e-06 2024-09-13T05:12:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659062+0000", 2024-09-13T05:12:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122470685 2024-09-13T05:12:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659106+0000", 2024-09-13T05:12:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3856000000000002e-05 2024-09-13T05:12:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659173+0000", 2024-09-13T05:12:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7168000000000005e-05 2024-09-13T05:12:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162630 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 67584~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.430259137, 2024-09-13T05:12:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12468555100000001, 2024-09-13T05:12:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162630 2024-09-13T05:12:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534676+0000", 2024-09-13T05:12:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4399999999999999e-06 2024-09-13T05:12:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534681+0000", 2024-09-13T05:12:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2349999999999999e-06 2024-09-13T05:12:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534686+0000", 2024-09-13T05:12:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5499999999999996e-06 2024-09-13T05:12:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536609+0000", 2024-09-13T05:12:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001923407 2024-09-13T05:12:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536615+0000", 2024-09-13T05:12:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1499999999999998e-06 2024-09-13T05:12:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659233+0000", 2024-09-13T05:12:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122618957 2024-09-13T05:12:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659294+0000", 2024-09-13T05:12:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0251000000000003e-05 2024-09-13T05:12:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659360+0000", 2024-09-13T05:12:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5906000000000002e-05 2024-09-13T05:12:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162633 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 69632~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.430151232, 2024-09-13T05:12:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124702147, 2024-09-13T05:12:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162633 2024-09-13T05:12:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534784+0000", 2024-09-13T05:12:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3300000000000001e-06 2024-09-13T05:12:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534789+0000", 2024-09-13T05:12:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4149999999999998e-06 2024-09-13T05:12:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534794+0000", 2024-09-13T05:12:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5669999999999996e-06 2024-09-13T05:12:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536634+0000", 2024-09-13T05:12:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001840401 2024-09-13T05:12:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536642+0000", 2024-09-13T05:12:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9729999999999997e-06 2024-09-13T05:12:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659383+0000", 2024-09-13T05:12:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12274112099999999 2024-09-13T05:12:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659424+0000", 2024-09-13T05:12:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0936000000000002e-05 2024-09-13T05:12:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659484+0000", 2024-09-13T05:12:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9775000000000003e-05 2024-09-13T05:12:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162675 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 68608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.430102187999999, 2024-09-13T05:12:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124823974, 2024-09-13T05:12:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162675 2024-09-13T05:12:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534833+0000", 2024-09-13T05:12:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.204e-06 2024-09-13T05:12:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534838+0000", 2024-09-13T05:12:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0130000000000001e-06 2024-09-13T05:12:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534842+0000", 2024-09-13T05:12:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.51e-06 2024-09-13T05:12:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536661+0000", 2024-09-13T05:12:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018186039999999999 2024-09-13T05:12:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536667+0000", 2024-09-13T05:12:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5260000000000001e-06 2024-09-13T05:12:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659531+0000", 2024-09-13T05:12:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122864403 2024-09-13T05:12:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659583+0000", 2024-09-13T05:12:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1564000000000003e-05 2024-09-13T05:12:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659655+0000", 2024-09-13T05:12:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2504999999999998e-05 2024-09-13T05:12:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:163257 3.8 3:1136e8de:::rbd_data.112dbd21872d.000000000000003c:28 [read 200704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.415086981999998, 2024-09-13T05:12:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12163807, 2024-09-13T05:12:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 163257 2024-09-13T05:12:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549848+0000", 2024-09-13T05:12:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1789999999999998e-06 2024-09-13T05:12:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549854+0000", 2024-09-13T05:12:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9050000000000002e-06 2024-09-13T05:12:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549858+0000", 2024-09-13T05:12:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3529999999999997e-06 2024-09-13T05:12:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.551228+0000", 2024-09-13T05:12:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001369227 2024-09-13T05:12:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.551233+0000", 2024-09-13T05:12:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5860000000000004e-06 2024-09-13T05:12:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671337+0000", 2024-09-13T05:12:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.120104265 2024-09-13T05:12:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671425+0000", 2024-09-13T05:12:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7810000000000001e-05 2024-09-13T05:12:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671484+0000", 2024-09-13T05:12:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9079000000000001e-05 2024-09-13T05:12:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:170203 3.1e 3:7c9b1cf4:::rbd_header.112dc3abcba6:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128)", 2024-09-13T05:12:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:12:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.150123217000001, 2024-09-13T05:12:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.79948714899999995, 2024-09-13T05:12:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 170203 2024-09-13T05:12:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:12:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:12:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814808+0000", 2024-09-13T05:12:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814820+0000", 2024-09-13T05:12:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.206e-05 2024-09-13T05:12:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814841+0000", 2024-09-13T05:12:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1464999999999999e-05 2024-09-13T05:12:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814853+0000", 2024-09-13T05:12:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1824999999999999e-05 2024-09-13T05:12:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814911+0000", 2024-09-13T05:12:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8255999999999999e-05 2024-09-13T05:12:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814918+0000", 2024-09-13T05:12:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7120000000000003e-06 2024-09-13T05:12:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.611660+0000", 2024-09-13T05:12:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.79674180100000003 2024-09-13T05:12:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.611911+0000", 2024-09-13T05:12:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025108900000000002 2024-09-13T05:12:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-13T05:12:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.612726+0000", 2024-09-13T05:12:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00081512999999999996 2024-09-13T05:12:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614087+0000", 2024-09-13T05:12:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013607560000000001 2024-09-13T05:12:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:12:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614095+0000", 2024-09-13T05:12:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3240000000000003e-06 2024-09-13T05:12:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:12:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614138+0000", 2024-09-13T05:12:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3115000000000003e-05 2024-09-13T05:12:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:31.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:31.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:31.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614297+0000", 2024-09-13T05:12:31.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015875399999999999 2024-09-13T05:12:31.116 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.116 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:31.116 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.116 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:31.116 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:31.116 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:31.117 INFO:teuthology.orchestra.run.smithi120.stdout:5493 write 0x33f77d2 thru 0x33f7d28 (0x557 bytes) 2024-09-13T05:12:31.118 INFO:teuthology.orchestra.run.smithi120.stdout:5494 punch from 0x273ce07 to 0x274af8f, (0xe188 bytes) 2024-09-13T05:12:31.118 INFO:teuthology.orchestra.run.smithi120.stdout:5495 write 0x1773fbb thru 0x177dc2f (0x9c75 bytes) 2024-09-13T05:12:31.119 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:12:31.120 INFO:teuthology.orchestra.run.smithi120.stdout:5496 write 0x1b3b5aa thru 0x1b45adf (0xa536 bytes) 2024-09-13T05:12:31.121 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:31.121 INFO:teuthology.orchestra.run.smithi120.stdout:5498 read 0x2f3c064 thru 0x2f46a0e (0xa9ab bytes) 2024-09-13T05:12:31.121 INFO:teuthology.orchestra.run.smithi120.stdout:5499 write 0x2b26f0 thru 0x2b91f7 (0x6b08 bytes) 2024-09-13T05:12:31.121 INFO:teuthology.orchestra.run.smithi120.stdout:5500 writesame 0x492f870 thru 0x4933eb6 data_size 0x3(0x4647 bytes) 2024-09-13T05:12:31.121 INFO:teuthology.orchestra.run.smithi120.stdout:5501 read 0xdf4558 thru 0xdfa005 (0x5aae bytes) 2024-09-13T05:12:31.121 INFO:teuthology.orchestra.run.smithi120.stdout:5503 writesame 0x116c277 thru 0x116c670 data_size 0x1(0x3fa bytes) 2024-09-13T05:12:31.122 INFO:teuthology.orchestra.run.smithi120.stdout:5504 read 0x108a268 thru 0x1099ef5 (0xfc8e bytes) 2024-09-13T05:12:31.122 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:31.122 INFO:teuthology.orchestra.run.smithi120.stdout:5508 write 0x9230e3 thru 0x927566 (0x4484 bytes) 2024-09-13T05:12:31.122 INFO:teuthology.orchestra.run.smithi120.stdout:5509 write 0xb0d46f5 thru 0xb0dd056 (0x8962 bytes) 2024-09-13T05:12:31.122 INFO:teuthology.orchestra.run.smithi120.stdout:5510 trunc from 0xb0dd057 to 0x684fbb8 2024-09-13T05:12:31.122 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:31.115+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:31.134 INFO:teuthology.orchestra.run.smithi120.stdout:5511 read 0x684a9ad thru 0x684b131 (0x785 bytes) 2024-09-13T05:12:31.134 INFO:teuthology.orchestra.run.smithi120.stdout:5515 punch from 0x5fac826 to 0x5fb797f, (0xb159 bytes) 2024-09-13T05:12:31.134 INFO:teuthology.orchestra.run.smithi120.stdout:5517 read 0x65a2e34 thru 0x65a7623 (0x47f0 bytes) 2024-09-13T05:12:31.134 INFO:teuthology.orchestra.run.smithi120.stdout:5519 write 0x36932f1 thru 0x369aab4 (0x77c4 bytes) 2024-09-13T05:12:31.150 INFO:teuthology.orchestra.run.smithi120.stdout:5520 trunc from 0x684fbb8 to 0x7eb9f4d 2024-09-13T05:12:31.161 INFO:teuthology.orchestra.run.smithi120.stdout:5521 punch from 0x48ed4a1 to 0x48f5f23, (0x8a82 bytes) 2024-09-13T05:12:31.161 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:31.168 INFO:teuthology.orchestra.run.smithi120.stdout:5524 trunc from 0x7eb9f4d to 0x4d3ae5d 2024-09-13T05:12:31.181 INFO:teuthology.orchestra.run.smithi120.stdout:5525 punch from 0x7daa71 to 0x7e27e8, (0x7d77 bytes) 2024-09-13T05:12:31.182 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:31.182 INFO:teuthology.orchestra.run.smithi120.stdout:5527 punch from 0x44fcc52 to 0x450515d, (0x850b bytes) 2024-09-13T05:12:31.182 INFO:teuthology.orchestra.run.smithi120.stdout:5528 punch from 0x3a7a408 to 0x3a89616, (0xf20e bytes) 2024-09-13T05:12:31.211 INFO:teuthology.orchestra.run.smithi120.stdout:5530 writesame 0xd50116d thru 0xd50d4f6 data_size 0x67(0xc38a bytes) 2024-09-13T05:12:31.211 INFO:teuthology.orchestra.run.smithi120.stdout:5531 read 0x887a962 thru 0x8880350 (0x59ef bytes) 2024-09-13T05:12:31.212 INFO:teuthology.orchestra.run.smithi120.stdout:5532 trunc from 0xd50d4f7 to 0xe120ee0 2024-09-13T05:12:31.218 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:31.215+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:31.226 INFO:teuthology.orchestra.run.smithi120.stdout:5533 write 0x1616508 thru 0x162587a (0xf373 bytes) 2024-09-13T05:12:31.245 INFO:teuthology.orchestra.run.smithi120.stdout:5534 write 0x4b23bf3 thru 0x4b24e9f (0x12ad bytes) 2024-09-13T05:12:31.246 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:31.246 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:31.246 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:31.246 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:31.257 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:12:31.257 INFO:teuthology.orchestra.run.smithi120.stdout:5535 trunc from 0xe120ee0 to 0xbda35f7 2024-09-13T05:12:31.268 INFO:teuthology.orchestra.run.smithi120.stdout:5536 read 0xb67bf28 thru 0xb67cf46 (0x101f bytes) 2024-09-13T05:12:31.269 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:31.269 INFO:teuthology.orchestra.run.smithi120.stdout:5539 writesame 0xbc4819d thru 0xbc4b72c data_size 0x8(0x3590 bytes) 2024-09-13T05:12:31.277 INFO:teuthology.orchestra.run.smithi120.stdout:5540 writesame 0x9d66b10 thru 0x9d7167e data_size 0x1(0xab6f bytes) 2024-09-13T05:12:31.303 INFO:teuthology.orchestra.run.smithi120.stdout:5541 writesame 0x9c906c7 thru 0x9c98c7c data_size 0x69(0x85b6 bytes) 2024-09-13T05:12:31.311 INFO:teuthology.orchestra.run.smithi120.stdout:5542 writesame 0x7b39454 thru 0x7b46f39 data_size 0x1(0xdae6 bytes) 2024-09-13T05:12:31.319 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:31.316+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:31.341 INFO:teuthology.orchestra.run.smithi120.stdout:5543 read 0x625f75d thru 0x62664dc (0x6d80 bytes) 2024-09-13T05:12:31.341 INFO:teuthology.orchestra.run.smithi120.stdout:5544 writesame 0x73ff281 thru 0x740cc14 data_size 0x32(0xd994 bytes) 2024-09-13T05:12:31.371 INFO:teuthology.orchestra.run.smithi120.stdout:5545 write 0xcf3bbd1 thru 0xcf48d19 (0xd149 bytes) 2024-09-13T05:12:31.374 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:31.374 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:31.374 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:31.374 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:31.374 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:31.386 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:12:31.389 INFO:teuthology.orchestra.run.smithi120.stdout:5546 read 0x5cd25f5 thru 0x5cd2dc0 (0x7cc bytes) 2024-09-13T05:12:31.389 INFO:teuthology.orchestra.run.smithi120.stdout:5547 writesame 0x5643f55 thru 0x564e6f0 data_size 0x22(0xa79c bytes) 2024-09-13T05:12:31.407 INFO:teuthology.orchestra.run.smithi120.stdout:5549 read 0xcdc848d thru 0xcdd6018 (0xdb8c bytes) 2024-09-13T05:12:31.420 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:31.415+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:31.426 INFO:teuthology.orchestra.run.smithi120.stdout:5552 trunc from 0xcf48d1a to 0x247ff3b 2024-09-13T05:12:31.454 INFO:teuthology.orchestra.run.smithi120.stdout:5553 read 0x1172e03 thru 0x117f6ac (0xc8aa bytes) 2024-09-13T05:12:31.474 INFO:teuthology.orchestra.run.smithi120.stdout:5554 writesame 0x80d4dd2 thru 0x80e04a1 data_size 0xc8(0xb6d0 bytes) 2024-09-13T05:12:31.474 INFO:teuthology.orchestra.run.smithi120.stdout:5556 punch from 0x772114a to 0x772a492, (0x9348 bytes) 2024-09-13T05:12:31.474 INFO:teuthology.orchestra.run.smithi120.stdout:5557 clone 44 order 21 su 8192 sc 13 2024-09-13T05:12:31.492 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:31.492 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:31.492 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:31.492 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [] 2024-09-13T05:12:31.492 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:31.502 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:12:31.521 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:31.516+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:31.603 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:31.604 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:31.604 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:31.604 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:31.613 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:12:31.626 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:12:31.658 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:31.656+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:31.723 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:31.720+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:31.767 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:31.768 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:31.768 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:31.768 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:31.768 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:31.777 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:12:31.783 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:12:31.812 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:31.823 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:31.819+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:31.835 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:31.858 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:31.878 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:31.892 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:31.892 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:31.892 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:31.892 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:31.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.893 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3.bb1d1096 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:31.893 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:31.893 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 67.944276676000001, 2024-09-13T05:12:31.893 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68834410099999999, 2024-09-13T05:12:31.893 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:31.893 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:31.893 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:31.893 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:31.893 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.893 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:12:31.893 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.893 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:31.893 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.893 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:31.894 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:31.894 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.894 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.894 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:31.894 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:31.894 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.895 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:31.895 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943719+0000", 2024-09-13T05:12:31.895 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:12:31.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.895 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:31.895 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943734+0000", 2024-09-13T05:12:31.895 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4793e-05 2024-09-13T05:12:31.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.895 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:31.895 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943765+0000", 2024-09-13T05:12:31.895 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0648999999999997e-05 2024-09-13T05:12:31.896 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.896 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.896 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.896 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943779+0000", 2024-09-13T05:12:31.896 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.447e-05 2024-09-13T05:12:31.896 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.896 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.896 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.897 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943872+0000", 2024-09-13T05:12:31.897 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3304e-05 2024-09-13T05:12:31.897 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.897 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.897 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.897 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943884+0000", 2024-09-13T05:12:31.897 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.167e-05 2024-09-13T05:12:31.897 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.897 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.897 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.897 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632042+0000", 2024-09-13T05:12:31.897 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68815832600000004 2024-09-13T05:12:31.897 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.898 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:31.898 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632066+0000", 2024-09-13T05:12:31.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3765999999999999e-05 2024-09-13T05:12:31.898 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.898 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:31.898 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.898 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3.b6bd6256 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:31.898 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:31.898 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 67.944152176000003, 2024-09-13T05:12:31.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68852592499999998, 2024-09-13T05:12:31.899 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:31.899 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:31.899 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:31.899 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:31.899 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.899 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:12:31.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.899 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:31.899 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.899 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:31.899 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:31.899 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.900 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.900 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:31.900 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:31.900 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.900 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.900 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.900 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:31.900 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943846+0000", 2024-09-13T05:12:31.900 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:31.900 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.900 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.900 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:31.900 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943852+0000", 2024-09-13T05:12:31.900 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3820000000000001e-06 2024-09-13T05:12:31.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:31.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943876+0000", 2024-09-13T05:12:31.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3995e-05 2024-09-13T05:12:31.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943898+0000", 2024-09-13T05:12:31.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1838999999999999e-05 2024-09-13T05:12:31.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946457+0000", 2024-09-13T05:12:31.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025588910000000002 2024-09-13T05:12:31.902 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946499+0000", 2024-09-13T05:12:31.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2814e-05 2024-09-13T05:12:31.902 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632364+0000", 2024-09-13T05:12:31.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68586484999999997 2024-09-13T05:12:31.903 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.903 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.903 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:31.903 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632372+0000", 2024-09-13T05:12:31.903 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1659999999999994e-06 2024-09-13T05:12:31.903 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.903 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:31.903 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.903 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.903 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.903 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3:6908b8dd:::rbd_data.112d8d1317eb.000000000000000f:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:31.903 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:31.903 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 67.907008098000006, 2024-09-13T05:12:31.903 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65181049499999999, 2024-09-13T05:12:31.903 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:31.904 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:31.904 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:31.904 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:31.904 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.904 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:12:31.904 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.904 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:31.904 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.904 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:31.904 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:31.904 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.905 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.905 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.905 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:31.905 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:31.905 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.905 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.905 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.905 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:31.905 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980989+0000", 2024-09-13T05:12:31.905 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:31.905 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.906 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.906 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:31.906 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980996+0000", 2024-09-13T05:12:31.906 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2200000000000003e-06 2024-09-13T05:12:31.906 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.906 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.906 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:31.906 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981011+0000", 2024-09-13T05:12:31.906 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4997000000000001e-05 2024-09-13T05:12:31.906 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.906 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.906 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.906 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981025+0000", 2024-09-13T05:12:31.906 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3604000000000001e-05 2024-09-13T05:12:31.907 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.907 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.907 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.907 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981110+0000", 2024-09-13T05:12:31.907 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4948000000000001e-05 2024-09-13T05:12:31.907 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.907 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.907 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.907 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981120+0000", 2024-09-13T05:12:31.907 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9399999999999997e-06 2024-09-13T05:12:31.907 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.907 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.907 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.907 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632425+0000", 2024-09-13T05:12:31.908 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65130460499999998 2024-09-13T05:12:31.908 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.908 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.908 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:31.908 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632587+0000", 2024-09-13T05:12:31.908 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016199500000000001 2024-09-13T05:12:31.908 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.908 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.908 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:31.908 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632801+0000", 2024-09-13T05:12:31.908 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021459499999999999 2024-09-13T05:12:31.908 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.908 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:31.909 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.909 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.909 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.909 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3:6a46bd6d:::rbd_data.112d8d1317eb.0000000000000010:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:31.909 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:31.909 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 67.906950441999996, 2024-09-13T05:12:31.909 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65213695699999996, 2024-09-13T05:12:31.909 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:31.909 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:31.909 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:31.909 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:31.910 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.910 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:12:31.910 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.910 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:31.910 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.910 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:31.910 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:31.910 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.910 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.910 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.910 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:31.910 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:31.910 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.911 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:31.911 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:31.911 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:31.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.911 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:31.911 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981052+0000", 2024-09-13T05:12:31.911 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4469999999999999e-06 2024-09-13T05:12:31.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.911 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:31.911 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981066+0000", 2024-09-13T05:12:31.912 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3658e-05 2024-09-13T05:12:31.912 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.912 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.912 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.912 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981073+0000", 2024-09-13T05:12:31.912 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:12:31.912 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.912 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.912 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.912 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981150+0000", 2024-09-13T05:12:31.912 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7783999999999999e-05 2024-09-13T05:12:31.912 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.912 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.913 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.913 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981161+0000", 2024-09-13T05:12:31.913 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0197000000000001e-05 2024-09-13T05:12:31.913 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.913 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.913 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.913 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632926+0000", 2024-09-13T05:12:31.913 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65176517300000003 2024-09-13T05:12:31.913 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.913 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.913 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:31.913 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633081+0000", 2024-09-13T05:12:31.913 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000155172 2024-09-13T05:12:31.914 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.914 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.914 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:31.914 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633185+0000", 2024-09-13T05:12:31.914 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000104329 2024-09-13T05:12:31.914 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.914 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:31.914 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.914 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.914 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.914 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:157552 3.5 3:a072521b:::rbd_data.112dc3abcba6.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-09-13T05:12:31.914 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:02.531636+0000", 2024-09-13T05:12:31.914 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 29.356362605000001, 2024-09-13T05:12:31.914 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.118346166, 2024-09-13T05:12:31.915 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:31.915 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:31.915 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:31.915 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:31.915 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.915 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 157552 2024-09-13T05:12:31.915 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.915 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:31.915 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.915 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:31.915 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.531636+0000", 2024-09-13T05:12:31.915 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.915 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.915 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.915 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:31.916 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.531636+0000", 2024-09-13T05:12:31.916 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.916 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.916 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.916 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:31.916 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.531634+0000", 2024-09-13T05:12:31.916 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:12:31.916 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.916 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.916 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:31.916 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552355+0000", 2024-09-13T05:12:31.916 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020721112 2024-09-13T05:12:31.916 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.916 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.917 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:31.917 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552389+0000", 2024-09-13T05:12:31.917 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4425999999999999e-05 2024-09-13T05:12:31.917 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.917 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.917 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.917 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552399+0000", 2024-09-13T05:12:31.917 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0062e-05 2024-09-13T05:12:31.917 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.917 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.917 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.917 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552496+0000", 2024-09-13T05:12:31.917 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6914000000000001e-05 2024-09-13T05:12:31.917 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.918 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.918 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:31.918 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552765+0000", 2024-09-13T05:12:31.918 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00026873499999999998 2024-09-13T05:12:31.918 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.918 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.918 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 3", 2024-09-13T05:12:31.918 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.562896+0000", 2024-09-13T05:12:31.918 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010131186 2024-09-13T05:12:31.918 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.918 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.918 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:12:31.918 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.611492+0000", 2024-09-13T05:12:31.918 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048596448 2024-09-13T05:12:31.918 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.919 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.919 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:31.919 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.649797+0000", 2024-09-13T05:12:31.919 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038304202000000002 2024-09-13T05:12:31.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.919 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.919 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:31.919 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.649905+0000", 2024-09-13T05:12:31.919 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010853600000000001 2024-09-13T05:12:31.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.919 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.919 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:31.919 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.649982+0000", 2024-09-13T05:12:31.919 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7080000000000001e-05 2024-09-13T05:12:31.920 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.920 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:31.920 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.920 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.920 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.920 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:159585 3.1c 3:3afcc414:::rbd_data.112dfd94ee88.00000000000002ca:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:31.920 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:31.920 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 24.873632129000001, 2024-09-13T05:12:31.920 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91717655399999998, 2024-09-13T05:12:31.920 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:31.920 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:31.920 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:31.920 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:31.920 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.921 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 159585 2024-09-13T05:12:31.921 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.921 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:31.921 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.921 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:31.921 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:31.921 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.921 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.921 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.921 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:31.921 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:31.921 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.921 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.922 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.922 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:31.922 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014366+0000", 2024-09-13T05:12:31.922 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:31.922 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.922 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.922 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:31.922 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014370+0000", 2024-09-13T05:12:31.922 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9960000000000004e-06 2024-09-13T05:12:31.922 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.922 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.922 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:31.922 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014379+0000", 2024-09-13T05:12:31.922 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8550000000000008e-06 2024-09-13T05:12:31.923 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.923 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.923 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.923 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014386+0000", 2024-09-13T05:12:31.923 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0140000000000001e-06 2024-09-13T05:12:31.923 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.923 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.923 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.923 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014533+0000", 2024-09-13T05:12:31.923 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000147458 2024-09-13T05:12:31.923 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.923 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.923 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.923 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014545+0000", 2024-09-13T05:12:31.924 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1318000000000001e-05 2024-09-13T05:12:31.924 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.924 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.924 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.924 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931378+0000", 2024-09-13T05:12:31.924 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91683292400000005 2024-09-13T05:12:31.924 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.924 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.924 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:31.924 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931495+0000", 2024-09-13T05:12:31.924 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011726399999999999 2024-09-13T05:12:31.924 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.924 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.924 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:31.925 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931543+0000", 2024-09-13T05:12:31.925 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8183000000000003e-05 2024-09-13T05:12:31.925 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.925 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:31.925 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.925 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.925 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.925 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160206 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 83968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:31.925 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:31.925 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 24.850229731999999, 2024-09-13T05:12:31.925 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89412730799999995, 2024-09-13T05:12:31.925 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:31.925 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:31.926 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:31.926 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:31.926 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.926 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160206 2024-09-13T05:12:31.926 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.926 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:31.926 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.926 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:31.926 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:31.926 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.926 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.926 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.926 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:31.926 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:31.927 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.927 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.927 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.927 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:31.927 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037768+0000", 2024-09-13T05:12:31.927 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:31.927 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.927 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.927 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:31.927 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037774+0000", 2024-09-13T05:12:31.927 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3600000000000001e-06 2024-09-13T05:12:31.927 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.927 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.927 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:31.928 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037786+0000", 2024-09-13T05:12:31.928 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.188e-05 2024-09-13T05:12:31.928 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.928 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.928 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.928 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037793+0000", 2024-09-13T05:12:31.928 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2749999999999998e-06 2024-09-13T05:12:31.928 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.928 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.928 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.928 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:31.928 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0353000000000003e-05 2024-09-13T05:12:31.928 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.928 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.929 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.929 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037862+0000", 2024-09-13T05:12:31.929 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9710000000000004e-06 2024-09-13T05:12:31.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.929 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.929 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.929 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931610+0000", 2024-09-13T05:12:31.929 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89374846299999999 2024-09-13T05:12:31.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.929 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.929 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:31.929 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931815+0000", 2024-09-13T05:12:31.929 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020516499999999999 2024-09-13T05:12:31.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.930 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.930 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:31.930 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931896+0000", 2024-09-13T05:12:31.930 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1157999999999998e-05 2024-09-13T05:12:31.930 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.930 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:31.930 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.930 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.930 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.930 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160208 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 84992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:31.930 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:31.930 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 24.850144993000001, 2024-09-13T05:12:31.930 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440702299999997, 2024-09-13T05:12:31.930 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:31.931 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:31.931 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:31.931 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:31.931 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.931 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160208 2024-09-13T05:12:31.931 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.931 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:31.931 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.931 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:31.931 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:31.931 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.931 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.931 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.932 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:31.932 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:31.932 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.932 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.932 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.932 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:31.932 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037853+0000", 2024-09-13T05:12:31.932 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:31.932 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.932 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.932 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:31.932 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037858+0000", 2024-09-13T05:12:31.932 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2179999999999998e-06 2024-09-13T05:12:31.932 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.932 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.933 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:31.933 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037867+0000", 2024-09-13T05:12:31.933 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5699999999999993e-06 2024-09-13T05:12:31.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.933 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.933 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.933 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037874+0000", 2024-09-13T05:12:31.933 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2810000000000003e-06 2024-09-13T05:12:31.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.933 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.933 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.933 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037935+0000", 2024-09-13T05:12:31.933 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1231999999999999e-05 2024-09-13T05:12:31.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.934 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.934 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037944+0000", 2024-09-13T05:12:31.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8580000000000006e-06 2024-09-13T05:12:31.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.934 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.934 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931956+0000", 2024-09-13T05:12:31.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89401158800000002 2024-09-13T05:12:31.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.934 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.934 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:31.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932015+0000", 2024-09-13T05:12:31.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8906999999999997e-05 2024-09-13T05:12:31.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.935 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.935 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:31.935 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932261+0000", 2024-09-13T05:12:31.935 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024622799999999997 2024-09-13T05:12:31.935 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.935 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:31.935 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.935 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.935 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.935 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160210 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 86016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:31.935 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:31.935 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 24.850076138999999, 2024-09-13T05:12:31.935 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89428998299999996, 2024-09-13T05:12:31.935 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:31.936 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:31.936 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:31.936 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:31.936 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.936 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160210 2024-09-13T05:12:31.936 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.936 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:31.936 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.936 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:31.936 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:31.936 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.936 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.936 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.937 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:31.937 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:31.937 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.937 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.937 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.937 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:31.937 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037922+0000", 2024-09-13T05:12:31.937 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:31.937 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.937 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.937 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:31.937 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037926+0000", 2024-09-13T05:12:31.937 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6550000000000003e-06 2024-09-13T05:12:31.937 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.938 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.938 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:31.938 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037933+0000", 2024-09-13T05:12:31.938 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5409999999999997e-06 2024-09-13T05:12:31.938 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.938 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.938 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.938 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037939+0000", 2024-09-13T05:12:31.938 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1940000000000003e-06 2024-09-13T05:12:31.938 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.938 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.938 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.938 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037976+0000", 2024-09-13T05:12:31.938 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6671000000000002e-05 2024-09-13T05:12:31.939 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.939 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.939 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.939 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037982+0000", 2024-09-13T05:12:31.939 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9669999999999998e-06 2024-09-13T05:12:31.939 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.939 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.939 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.939 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932096+0000", 2024-09-13T05:12:31.939 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89411465599999995 2024-09-13T05:12:31.939 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.939 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.939 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:31.939 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932149+0000", 2024-09-13T05:12:31.939 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3032999999999999e-05 2024-09-13T05:12:31.940 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.940 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.940 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:31.940 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932213+0000", 2024-09-13T05:12:31.940 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3165999999999998e-05 2024-09-13T05:12:31.940 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.940 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:31.940 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.940 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.940 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.940 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160212 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 87040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:31.940 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:31.940 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 24.849989017999999, 2024-09-13T05:12:31.940 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440379699999994, 2024-09-13T05:12:31.941 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:31.941 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:31.941 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:31.941 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:31.941 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.941 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160212 2024-09-13T05:12:31.941 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.941 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:31.941 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.941 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:31.941 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:31.941 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.941 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.942 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.942 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:31.942 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:31.942 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.942 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.942 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.942 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:31.942 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038009+0000", 2024-09-13T05:12:31.942 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:31.942 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.942 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.942 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:31.942 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038013+0000", 2024-09-13T05:12:31.942 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3950000000000003e-06 2024-09-13T05:12:31.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.943 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:31.943 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038032+0000", 2024-09-13T05:12:31.943 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8513999999999999e-05 2024-09-13T05:12:31.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.943 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.943 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038039+0000", 2024-09-13T05:12:31.943 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.985e-06 2024-09-13T05:12:31.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.943 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038086+0000", 2024-09-13T05:12:31.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7302999999999998e-05 2024-09-13T05:12:31.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.944 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038090+0000", 2024-09-13T05:12:31.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9029999999999997e-06 2024-09-13T05:12:31.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.944 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932291+0000", 2024-09-13T05:12:31.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89420100199999997 2024-09-13T05:12:31.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.944 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:31.945 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932352+0000", 2024-09-13T05:12:31.945 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1354999999999998e-05 2024-09-13T05:12:31.945 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.945 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.945 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:31.945 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932414+0000", 2024-09-13T05:12:31.945 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1037999999999994e-05 2024-09-13T05:12:31.945 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.945 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:31.945 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.945 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.945 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.945 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160214 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 88064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:31.945 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:31.946 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 24.849857952000001, 2024-09-13T05:12:31.946 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89438890900000001, 2024-09-13T05:12:31.946 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:31.946 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:31.946 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:31.946 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:31.946 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.946 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160214 2024-09-13T05:12:31.946 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.946 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:31.946 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.946 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:31.946 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:31.946 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.947 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.947 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:31.947 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:31.947 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.947 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.947 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:31.947 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038140+0000", 2024-09-13T05:12:31.947 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:31.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.947 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.947 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:31.948 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038145+0000", 2024-09-13T05:12:31.948 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9749999999999998e-06 2024-09-13T05:12:31.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.948 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:31.948 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038153+0000", 2024-09-13T05:12:31.948 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1280000000000008e-06 2024-09-13T05:12:31.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.948 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.948 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038161+0000", 2024-09-13T05:12:31.948 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0339999999999997e-06 2024-09-13T05:12:31.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.949 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.949 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.949 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038199+0000", 2024-09-13T05:12:31.949 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8269999999999998e-05 2024-09-13T05:12:31.949 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.949 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.949 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.949 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038204+0000", 2024-09-13T05:12:31.949 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5399999999999997e-06 2024-09-13T05:12:31.949 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.949 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.949 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.949 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932438+0000", 2024-09-13T05:12:31.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89423397999999998 2024-09-13T05:12:31.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.950 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:31.950 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932480+0000", 2024-09-13T05:12:31.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2392999999999999e-05 2024-09-13T05:12:31.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.950 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:31.950 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932530+0000", 2024-09-13T05:12:31.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:12:31.950 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.950 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:31.950 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.951 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.951 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160305 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 215040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:31.951 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:31.951 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 24.84565473, 2024-09-13T05:12:31.951 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89028175300000001, 2024-09-13T05:12:31.951 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:31.951 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:31.951 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:31.951 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:31.951 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.951 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160305 2024-09-13T05:12:31.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.952 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:31.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.952 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:31.952 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:31.952 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.952 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:31.952 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:31.952 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.952 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:31.952 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042343+0000", 2024-09-13T05:12:31.952 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:31.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.953 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:31.953 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042350+0000", 2024-09-13T05:12:31.953 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3769999999999998e-06 2024-09-13T05:12:31.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.953 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:31.953 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042367+0000", 2024-09-13T05:12:31.953 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.734e-05 2024-09-13T05:12:31.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.953 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.953 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042375+0000", 2024-09-13T05:12:31.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8469999999999996e-06 2024-09-13T05:12:31.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042428+0000", 2024-09-13T05:12:31.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3074e-05 2024-09-13T05:12:31.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042437+0000", 2024-09-13T05:12:31.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:12:31.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932550+0000", 2024-09-13T05:12:31.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89011304300000005 2024-09-13T05:12:31.955 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.955 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.955 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:31.955 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932589+0000", 2024-09-13T05:12:31.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9236000000000002e-05 2024-09-13T05:12:31.955 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.955 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.955 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:31.955 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932626+0000", 2024-09-13T05:12:31.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6832999999999998e-05 2024-09-13T05:12:31.955 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.955 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:31.955 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.956 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.956 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.956 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160307 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 216064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:31.956 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:31.956 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 24.845608291000001, 2024-09-13T05:12:31.956 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89032630800000001, 2024-09-13T05:12:31.956 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:31.956 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:31.956 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:31.956 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:31.956 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.956 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160307 2024-09-13T05:12:31.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.957 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:31.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:31.957 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:31.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:31.957 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:31.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:31.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:31.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:31.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:31.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042394+0000", 2024-09-13T05:12:31.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7900000000000001e-06 2024-09-13T05:12:31.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:31.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042401+0000", 2024-09-13T05:12:31.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.267e-06 2024-09-13T05:12:31.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.959 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.959 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042406+0000", 2024-09-13T05:12:31.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0860000000000001e-06 2024-09-13T05:12:31.959 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.959 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.959 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042465+0000", 2024-09-13T05:12:31.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9441000000000002e-05 2024-09-13T05:12:31.959 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.959 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.959 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042471+0000", 2024-09-13T05:12:31.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6640000000000003e-06 2024-09-13T05:12:31.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932645+0000", 2024-09-13T05:12:31.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89017372900000002 2024-09-13T05:12:31.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:31.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932681+0000", 2024-09-13T05:12:31.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5918999999999999e-05 2024-09-13T05:12:31.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:31.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932717+0000", 2024-09-13T05:12:31.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6007999999999998e-05 2024-09-13T05:12:31.961 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.961 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:31.961 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.961 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160309 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 217088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:31.961 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:31.961 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 24.845558032, 2024-09-13T05:12:31.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89037315900000003, 2024-09-13T05:12:31.961 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:31.961 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:31.961 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:31.961 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:31.962 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.962 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160309 2024-09-13T05:12:31.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.962 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:31.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:31.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:31.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:31.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:31.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:31.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042440+0000", 2024-09-13T05:12:31.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:31.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:31.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042444+0000", 2024-09-13T05:12:31.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.104e-06 2024-09-13T05:12:31.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:31.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042451+0000", 2024-09-13T05:12:31.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.922e-06 2024-09-13T05:12:31.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042457+0000", 2024-09-13T05:12:31.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3979999999999998e-06 2024-09-13T05:12:31.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042497+0000", 2024-09-13T05:12:31.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0692999999999998e-05 2024-09-13T05:12:31.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.965 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042503+0000", 2024-09-13T05:12:31.965 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.553e-06 2024-09-13T05:12:31.965 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.965 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.965 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.965 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932735+0000", 2024-09-13T05:12:31.965 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89023238699999996 2024-09-13T05:12:31.965 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.965 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.965 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:31.965 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932771+0000", 2024-09-13T05:12:31.965 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5972000000000001e-05 2024-09-13T05:12:31.965 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.966 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.966 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:31.966 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932814+0000", 2024-09-13T05:12:31.966 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2657000000000002e-05 2024-09-13T05:12:31.966 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.966 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:31.966 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.966 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.966 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.966 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160311 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 218112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:31.966 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:31.966 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 24.845532542000001, 2024-09-13T05:12:31.967 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89045284400000002, 2024-09-13T05:12:31.967 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:31.967 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:31.967 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:31.967 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:31.967 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.967 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160311 2024-09-13T05:12:31.967 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.967 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:31.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:31.967 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:31.967 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.967 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.968 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:31.968 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:31.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.968 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:31.968 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:31.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:31.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.968 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:31.968 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042469+0000", 2024-09-13T05:12:31.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.456e-06 2024-09-13T05:12:31.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.969 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:31.969 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042475+0000", 2024-09-13T05:12:31.969 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0990000000000004e-06 2024-09-13T05:12:31.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.969 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.969 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042481+0000", 2024-09-13T05:12:31.969 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.237e-06 2024-09-13T05:12:31.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.969 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.969 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042527+0000", 2024-09-13T05:12:31.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6796999999999999e-05 2024-09-13T05:12:31.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.970 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.970 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042533+0000", 2024-09-13T05:12:31.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6489999999999996e-06 2024-09-13T05:12:31.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.970 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.970 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932832+0000", 2024-09-13T05:12:31.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89029919800000001 2024-09-13T05:12:31.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.970 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:31.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932867+0000", 2024-09-13T05:12:31.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5049000000000003e-05 2024-09-13T05:12:31.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.971 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.971 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:31.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932919+0000", 2024-09-13T05:12:31.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1780999999999998e-05 2024-09-13T05:12:31.971 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.971 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:31.971 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.971 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.971 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160313 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 219136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:31.972 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:31.972 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 24.845503450999999, 2024-09-13T05:12:31.972 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89064232600000004, 2024-09-13T05:12:31.972 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:31.972 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:31.972 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:31.972 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:31.972 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.972 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160313 2024-09-13T05:12:31.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.972 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:31.972 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.972 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:31.972 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:31.973 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.973 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:31.973 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:31.973 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.973 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:31.973 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:31.973 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:31.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.973 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:31.974 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042498+0000", 2024-09-13T05:12:31.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.281e-06 2024-09-13T05:12:31.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.974 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:31.974 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042505+0000", 2024-09-13T05:12:31.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2699999999999999e-06 2024-09-13T05:12:31.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.974 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.974 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042512+0000", 2024-09-13T05:12:31.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0330000000000003e-06 2024-09-13T05:12:31.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.975 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.975 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042557+0000", 2024-09-13T05:12:31.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4425999999999998e-05 2024-09-13T05:12:31.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.975 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.975 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.975 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042562+0000", 2024-09-13T05:12:31.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3639999999999998e-06 2024-09-13T05:12:31.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.975 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.975 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.975 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932987+0000", 2024-09-13T05:12:31.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89042472299999997 2024-09-13T05:12:31.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.976 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.976 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:31.976 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933062+0000", 2024-09-13T05:12:31.976 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5129999999999994e-05 2024-09-13T05:12:31.976 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.976 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.976 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:31.976 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933138+0000", 2024-09-13T05:12:31.976 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5536000000000003e-05 2024-09-13T05:12:31.976 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.976 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:31.976 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.976 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.976 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.976 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160315 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 220160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:31.977 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:31.977 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 24.845472284, 2024-09-13T05:12:31.977 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89071820800000001, 2024-09-13T05:12:31.977 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:31.977 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:31.977 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:31.977 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:31.977 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.977 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160315 2024-09-13T05:12:31.977 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.977 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:31.977 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.978 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:31.978 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:31.978 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.978 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.978 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:31.978 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:31.978 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.978 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.978 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:31.978 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:31.978 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:31.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:31.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042529+0000", 2024-09-13T05:12:31.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3639999999999999e-06 2024-09-13T05:12:31.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:31.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042536+0000", 2024-09-13T05:12:31.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.866e-06 2024-09-13T05:12:31.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042541+0000", 2024-09-13T05:12:31.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:12:31.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.980 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.980 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.980 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042587+0000", 2024-09-13T05:12:31.980 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5735000000000002e-05 2024-09-13T05:12:31.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.980 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.980 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.980 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042593+0000", 2024-09-13T05:12:31.980 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0719999999999996e-06 2024-09-13T05:12:31.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.980 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.980 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.980 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933160+0000", 2024-09-13T05:12:31.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89056621000000002 2024-09-13T05:12:31.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.981 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:31.981 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933202+0000", 2024-09-13T05:12:31.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2376000000000002e-05 2024-09-13T05:12:31.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.981 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:31.981 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933245+0000", 2024-09-13T05:12:31.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2787999999999998e-05 2024-09-13T05:12:31.981 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.981 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:31.981 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.982 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.982 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160317 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:31.982 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:31.982 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 24.845443455000002, 2024-09-13T05:12:31.982 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89082205800000003, 2024-09-13T05:12:31.982 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:31.982 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:31.982 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:31.982 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:31.982 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.982 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160317 2024-09-13T05:12:31.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.982 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:31.982 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:31.983 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:31.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.983 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:31.983 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:31.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.983 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:31.983 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:31.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:31.983 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:31.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042558+0000", 2024-09-13T05:12:31.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1810000000000001e-06 2024-09-13T05:12:31.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:31.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042565+0000", 2024-09-13T05:12:31.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9280000000000004e-06 2024-09-13T05:12:31.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042571+0000", 2024-09-13T05:12:31.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7420000000000003e-06 2024-09-13T05:12:31.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.985 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.985 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042616+0000", 2024-09-13T05:12:31.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5201999999999999e-05 2024-09-13T05:12:31.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.985 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.985 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042622+0000", 2024-09-13T05:12:31.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8289999999999996e-06 2024-09-13T05:12:31.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.985 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.986 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933259+0000", 2024-09-13T05:12:31.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89063730799999996 2024-09-13T05:12:31.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:31.986 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933311+0000", 2024-09-13T05:12:31.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1910000000000003e-05 2024-09-13T05:12:31.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:31.986 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933377+0000", 2024-09-13T05:12:31.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6396999999999995e-05 2024-09-13T05:12:31.986 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.986 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:31.987 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.987 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160319 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 222208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:31.987 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:31.987 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 24.845413238999999, 2024-09-13T05:12:31.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89087477400000004, 2024-09-13T05:12:31.987 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:31.987 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:31.987 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:31.987 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:31.987 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.987 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160319 2024-09-13T05:12:31.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.988 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:31.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.988 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:31.988 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:31.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.988 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:31.988 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:31.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.988 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:31.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042585+0000", 2024-09-13T05:12:31.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:31.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:31.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042588+0000", 2024-09-13T05:12:31.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9450000000000002e-06 2024-09-13T05:12:31.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:31.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042594+0000", 2024-09-13T05:12:31.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0959999999999997e-06 2024-09-13T05:12:31.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.990 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.990 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042599+0000", 2024-09-13T05:12:31.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0069999999999997e-06 2024-09-13T05:12:31.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.990 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.990 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042642+0000", 2024-09-13T05:12:31.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2553999999999999e-05 2024-09-13T05:12:31.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.990 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.990 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042647+0000", 2024-09-13T05:12:31.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.31e-06 2024-09-13T05:12:31.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.991 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.991 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933387+0000", 2024-09-13T05:12:31.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89073982799999996 2024-09-13T05:12:31.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.991 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:31.991 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:12:31.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7101000000000003e-05 2024-09-13T05:12:31.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.991 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:31.991 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933460+0000", 2024-09-13T05:12:31.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6282999999999998e-05 2024-09-13T05:12:31.992 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.992 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:31.992 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.992 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160321 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 223232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:31.992 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:31.992 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 24.845383812000001, 2024-09-13T05:12:31.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89094616999999998, 2024-09-13T05:12:31.992 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:31.992 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:31.992 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:31.992 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:31.992 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:31.993 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160321 2024-09-13T05:12:31.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.993 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:31.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:31.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:31.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:31.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:31.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:31.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.994 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:31.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:31.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:31.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.994 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:31.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042617+0000", 2024-09-13T05:12:31.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8329999999999998e-06 2024-09-13T05:12:31.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.994 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:31.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042638+0000", 2024-09-13T05:12:31.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0908e-05 2024-09-13T05:12:31.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.995 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.995 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:31.995 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042644+0000", 2024-09-13T05:12:31.995 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0440000000000001e-06 2024-09-13T05:12:31.995 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.995 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.995 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.995 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042666+0000", 2024-09-13T05:12:31.995 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1256000000000001e-05 2024-09-13T05:12:31.995 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.995 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.995 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:31.995 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042671+0000", 2024-09-13T05:12:31.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6250000000000004e-06 2024-09-13T05:12:31.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:31.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933478+0000", 2024-09-13T05:12:31.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89080698800000002 2024-09-13T05:12:31.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:31.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933519+0000", 2024-09-13T05:12:31.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0717000000000003e-05 2024-09-13T05:12:31.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:31.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:31.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:31.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933561+0000", 2024-09-13T05:12:31.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2225999999999999e-05 2024-09-13T05:12:31.997 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.997 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:31.997 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.997 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:31.997 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:31.997 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:31.998 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:31.998 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:31.999 INFO:teuthology.orchestra.run.smithi120.stdout:truncating image image_client.0-clone43 from 0x80e04a2 (overlap 0x7c2d7a) to 0x0 2024-09-13T05:12:31.999 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:32.000 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:12:32.000 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:12:32.001 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:32.001 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:32.001 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:32.004 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:32.004 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:32.004 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:32.004 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:32.005 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:31.995+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:32.099 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:32.096+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:32.114 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:32.114 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:32.124 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:12:32.174 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #42, image image_client.0-clone42 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent43 2024-09-13T05:12:32.200 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:32.196+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:32.209 INFO:teuthology.orchestra.run.smithi120.stdout:5559 write 0x70b4aa4 thru 0x70bac94 (0x61f1 bytes) 2024-09-13T05:12:32.240 INFO:teuthology.orchestra.run.smithi120.stdout:5560 trunc from 0x80e04a2 to 0x24116eb 2024-09-13T05:12:32.282 INFO:teuthology.orchestra.run.smithi120.stdout:5561 read 0x1a895b5 thru 0x1a90e8d (0x78d9 bytes) 2024-09-13T05:12:32.285 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:32.285 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:32.295 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:12:32.300 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:32.296+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:32.301 INFO:teuthology.orchestra.run.smithi120.stdout:5562 writesame 0x742356d thru 0x7425c1e data_size 0x6(0x26b2 bytes) 2024-09-13T05:12:32.302 INFO:teuthology.orchestra.run.smithi120.stdout:5564 read 0x35f6c13 thru 0x3605609 (0xe9f7 bytes) 2024-09-13T05:12:32.302 INFO:teuthology.orchestra.run.smithi120.stdout:5566 read 0x4d5be5b thru 0x4d5ec1b (0x2dc1 bytes) 2024-09-13T05:12:32.302 INFO:teuthology.orchestra.run.smithi120.stdout:5567 punch from 0x5737908 to 0x57454c6, (0xdbbe bytes) 2024-09-13T05:12:32.302 INFO:teuthology.orchestra.run.smithi120.stdout:5568 punch from 0x6533b07 to 0x653d610, (0x9b09 bytes) 2024-09-13T05:12:32.316 INFO:teuthology.orchestra.run.smithi120.stdout:5569 trunc from 0x7425c1f to 0x8489fd 2024-09-13T05:12:32.378 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:32.378 INFO:teuthology.orchestra.run.smithi120.stdout:5571 punch from 0x7c9cc2 to 0x7cf38b, (0x56c9 bytes) 2024-09-13T05:12:32.378 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:32.378 INFO:teuthology.orchestra.run.smithi120.stdout:5574 read 0x38d079 thru 0x391491 (0x4419 bytes) 2024-09-13T05:12:32.379 INFO:teuthology.orchestra.run.smithi120.stdout:5577 read 0x78fde4 thru 0x7922e2 (0x24ff bytes) 2024-09-13T05:12:32.379 INFO:teuthology.orchestra.run.smithi120.stdout:5578 punch from 0x599234 to 0x59e291, (0x505d bytes) 2024-09-13T05:12:32.397 INFO:teuthology.orchestra.run.smithi120.stdout:5579 write 0x4b2c607 thru 0x4b2dc96 (0x1690 bytes) 2024-09-13T05:12:32.401 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:32.395+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:32.404 INFO:teuthology.orchestra.run.smithi120.stdout:5580 read 0x2f14731 thru 0x2f19f39 (0x5809 bytes) 2024-09-13T05:12:32.404 INFO:teuthology.orchestra.run.smithi120.stdout:5582 write 0x3be1bb3 thru 0x3beb89e (0x9cec bytes) 2024-09-13T05:12:32.410 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:32.410 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:32.420 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:12:32.427 INFO:teuthology.orchestra.run.smithi120.stdout:5585 writesame 0x545c4fc thru 0x5467286 data_size 0x3b(0xad8b bytes) 2024-09-13T05:12:32.437 INFO:teuthology.orchestra.run.smithi120.stdout:5586 writesame 0x5daa859 thru 0x5dafdc8 data_size 0x8(0x5570 bytes) 2024-09-13T05:12:32.437 INFO:teuthology.orchestra.run.smithi120.stdout:5587 read 0x19bd063 thru 0x19c70de (0xa07c bytes) 2024-09-13T05:12:32.457 INFO:teuthology.orchestra.run.smithi120.stdout:5588 writesame 0x97099f0 thru 0x970a11b data_size 0x6(0x72c bytes) 2024-09-13T05:12:32.457 INFO:teuthology.orchestra.run.smithi120.stdout:5589 write 0x86fce8f thru 0x86fd727 (0x899 bytes) 2024-09-13T05:12:32.463 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:32.463 INFO:teuthology.orchestra.run.smithi120.stdout:5591 read 0x51f9f2e thru 0x5205273 (0xb346 bytes) 2024-09-13T05:12:32.463 INFO:teuthology.orchestra.run.smithi120.stdout:5592 read 0x94fa55b thru 0x9503867 (0x930d bytes) 2024-09-13T05:12:32.464 INFO:teuthology.orchestra.run.smithi120.stdout:5593 writesame 0x520eab1 thru 0x520f14c data_size 0x12(0x69c bytes) 2024-09-13T05:12:32.471 INFO:teuthology.orchestra.run.smithi120.stdout:5595 read 0x23b3df6 thru 0x23b54ba (0x16c5 bytes) 2024-09-13T05:12:32.478 INFO:teuthology.orchestra.run.smithi120.stdout:5597 trunc from 0x970a11c to 0x7026e36 2024-09-13T05:12:32.501 INFO:teuthology.orchestra.run.smithi120.stdout:5598 write 0x6d3e4a8 thru 0x6d444d7 (0x6030 bytes) 2024-09-13T05:12:32.501 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:32.499+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:32.513 INFO:teuthology.orchestra.run.smithi120.stdout:5599 read 0x5e3c546 thru 0x5e4a9cc (0xe487 bytes) 2024-09-13T05:12:32.514 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:32.514 INFO:teuthology.orchestra.run.smithi120.stdout:5601 read 0x2acde7d thru 0x2adde32 (0xffb6 bytes) 2024-09-13T05:12:32.514 INFO:teuthology.orchestra.run.smithi120.stdout:5602 read 0x42772be thru 0x42849de (0xd721 bytes) 2024-09-13T05:12:32.515 INFO:teuthology.orchestra.run.smithi120.stdout:5603 write 0x5586ff9 thru 0x558d947 (0x694f bytes) 2024-09-13T05:12:32.526 INFO:teuthology.orchestra.run.smithi120.stdout:5604 read 0x6c1bfbb thru 0x6c1e8f3 (0x2939 bytes) 2024-09-13T05:12:32.548 INFO:teuthology.orchestra.run.smithi120.stdout:5605 write 0xb34af3a thru 0xb356f85 (0xc04c bytes) 2024-09-13T05:12:32.563 INFO:teuthology.orchestra.run.smithi120.stdout:truncating to largest ever: 0xedd95f1 2024-09-13T05:12:32.570 INFO:teuthology.orchestra.run.smithi120.stdout:5606 trunc from 0xb356f86 to 0xedd95f1 2024-09-13T05:12:32.576 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:32.576 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:32.581 INFO:teuthology.orchestra.run.smithi120.stdout:5607 writesame 0xc4c4e03 thru 0xc4d31c7 data_size 0x1(0xe3c5 bytes) 2024-09-13T05:12:32.586 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:12:32.602 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:32.600+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:32.611 INFO:teuthology.orchestra.run.smithi120.stdout:5609 punch from 0x8f0baf to 0x8f52c4, (0x4715 bytes) 2024-09-13T05:12:32.612 INFO:teuthology.orchestra.run.smithi120.stdout:5610 write 0x78b8c58 thru 0x78c25da (0x9983 bytes) 2024-09-13T05:12:32.618 INFO:teuthology.orchestra.run.smithi120.stdout:5611 read 0xf381be thru 0xf3c591 (0x43d4 bytes) 2024-09-13T05:12:32.619 INFO:teuthology.orchestra.run.smithi120.stdout:5612 flatten 2024-09-13T05:12:32.626 INFO:teuthology.orchestra.run.smithi120.stdout:5613 writesame 0x16d4b8f thru 0x16dd154 data_size 0x1(0x85c6 bytes) 2024-09-13T05:12:32.640 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:32.640 INFO:teuthology.orchestra.run.smithi120.stdout:5615 read 0x4e0e493 thru 0x4e1bfb5 (0xdb23 bytes) 2024-09-13T05:12:32.641 INFO:teuthology.orchestra.run.smithi120.stdout:5618 read 0x5300af4 thru 0x5300e90 (0x39d bytes) 2024-09-13T05:12:32.641 INFO:teuthology.orchestra.run.smithi120.stdout:5619 write 0x272f2b8 thru 0x273cc16 (0xd95f bytes) 2024-09-13T05:12:32.658 INFO:teuthology.orchestra.run.smithi120.stdout:5621 write 0xc9d8662 thru 0xc9dd137 (0x4ad6 bytes) 2024-09-13T05:12:32.675 INFO:teuthology.orchestra.run.smithi120.stdout:5622 trunc from 0xedd95f1 to 0x810a6a5 2024-09-13T05:12:32.695 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:32.695 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:32.696 INFO:teuthology.orchestra.run.smithi120.stdout:5627 read 0x5f11f84 thru 0x5f1c261 (0xa2de bytes) 2024-09-13T05:12:32.697 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:32.697 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:32.702 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:32.700+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:32.703 INFO:teuthology.orchestra.run.smithi120.stdout:5628 trunc from 0x810a6a5 to 0xc2cca28 2024-09-13T05:12:32.706 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:12:32.711 INFO:teuthology.orchestra.run.smithi120.stdout:5629 read 0x35cb1c2 thru 0x35cc7b0 (0x15ef bytes) 2024-09-13T05:12:32.722 INFO:teuthology.orchestra.run.smithi120.stdout:5630 write 0xd14827e thru 0xd150d34 (0x8ab7 bytes) 2024-09-13T05:12:32.735 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:32.754 INFO:teuthology.orchestra.run.smithi120.stdout:5632 trunc from 0xd150d35 to 0x30809fc 2024-09-13T05:12:32.782 INFO:teuthology.orchestra.run.smithi120.stdout:5635 write 0x1cc5776 thru 0x1cc70cc (0x1957 bytes) 2024-09-13T05:12:32.784 INFO:teuthology.orchestra.run.smithi120.stdout:5636 punch from 0xafcc58 to 0xb0230b, (0x56b3 bytes) 2024-09-13T05:12:32.784 INFO:teuthology.orchestra.run.smithi120.stdout:5637 writesame 0x16de404 thru 0x16e0633 data_size 0x8(0x2230 bytes) 2024-09-13T05:12:32.786 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:32.787 INFO:teuthology.orchestra.run.smithi120.stdout:5640 read 0x27942fa thru 0x2797538 (0x323f bytes) 2024-09-13T05:12:32.788 INFO:teuthology.orchestra.run.smithi120.stdout:5641 read 0x2f00a5 thru 0x2f0c85 (0xbe1 bytes) 2024-09-13T05:12:32.788 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:32.788 INFO:teuthology.orchestra.run.smithi120.stdout:5643 writesame 0x18b9440 thru 0x18bc5c6 data_size 0x1(0x3187 bytes) 2024-09-13T05:12:32.797 INFO:teuthology.orchestra.run.smithi120.stdout:5644 punch from 0x9cde8c to 0x9db972, (0xdae6 bytes) 2024-09-13T05:12:32.797 INFO:teuthology.orchestra.run.smithi120.stdout:5646 punch from 0x2a0f545 to 0x2a19c6b, (0xa726 bytes) 2024-09-13T05:12:32.804 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:32.800+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:32.820 INFO:teuthology.orchestra.run.smithi120.stdout:5648 writesame 0x9137e12 thru 0x913f2ef data_size 0x2(0x74de bytes) 2024-09-13T05:12:32.820 INFO:teuthology.orchestra.run.smithi120.stdout:5651 write 0x36573c3 thru 0x365c882 (0x54c0 bytes) 2024-09-13T05:12:32.826 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T05:12:32.828 INFO:teuthology.orchestra.run.smithi120.stdout:5653 read 0x6f3535 thru 0x6f4fa0 (0x1a6c bytes) 2024-09-13T05:12:32.829 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:32.829 INFO:teuthology.orchestra.run.smithi120.stdout:5656 punch from 0x5e4cda6 to 0x5e5c0df, (0xf339 bytes) 2024-09-13T05:12:32.829 INFO:teuthology.orchestra.run.smithi120.stdout:5658 punch from 0x808d45d to 0x8091350, (0x3ef3 bytes) 2024-09-13T05:12:32.840 INFO:teuthology.orchestra.run.smithi120.stdout:5659 trunc from 0x913f2f0 to 0x359df89 2024-09-13T05:12:32.853 INFO:teuthology.orchestra.run.smithi120.stdout:5660 read 0xffebc3 thru 0x1008f8d (0xa3cb bytes) 2024-09-13T05:12:32.863 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:32.863 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:32.873 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:12:32.879 INFO:teuthology.orchestra.run.smithi120.stdout:5661 writesame 0xd9046a9 thru 0xd905d93 data_size 0x1(0x16eb bytes) 2024-09-13T05:12:32.879 INFO:teuthology.orchestra.run.smithi120.stdout:5662 write 0x5e17fc1 thru 0x5e1cc27 (0x4c67 bytes) 2024-09-13T05:12:32.890 INFO:teuthology.orchestra.run.smithi120.stdout:5665 punch from 0x915f0ec to 0x9161f34, (0x2e48 bytes) 2024-09-13T05:12:32.890 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:32.890 INFO:teuthology.orchestra.run.smithi120.stdout:5668 write 0xa6cd42c thru 0xa6dcc89 (0xf85e bytes) 2024-09-13T05:12:32.904 INFO:teuthology.orchestra.run.smithi120.stdout:5670 read 0x95fb75c thru 0x9604064 (0x8909 bytes) 2024-09-13T05:12:32.904 INFO:teuthology.orchestra.run.smithi120.stdout:5671 read 0x70e6f0a thru 0x70eeffe (0x80f5 bytes) 2024-09-13T05:12:32.905 INFO:teuthology.orchestra.run.smithi120.stdout:5672 punch from 0x37d8efd to 0x37e1d70, (0x8e73 bytes) 2024-09-13T05:12:32.905 INFO:teuthology.orchestra.run.smithi120.stdout:5673 writesame 0x91a8cbd thru 0x91b79b8 data_size 0x3a(0xecfc bytes) 2024-09-13T05:12:32.905 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:32.899+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:32.918 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:32.918 INFO:teuthology.orchestra.run.smithi120.stdout:5675 read 0x16e3612 thru 0x16f0582 (0xcf71 bytes) 2024-09-13T05:12:32.918 INFO:teuthology.orchestra.run.smithi120.stdout:5676 punch from 0x73fc8b7 to 0x73feae9, (0x2232 bytes) 2024-09-13T05:12:32.919 INFO:teuthology.orchestra.run.smithi120.stdout:5677 writesame 0xc252014 thru 0xc2535e8 data_size 0x1b(0x15d5 bytes) 2024-09-13T05:12:32.931 INFO:teuthology.orchestra.run.smithi120.stdout:5679 write 0xe83633e thru 0xe83b72c (0x53ef bytes) 2024-09-13T05:12:32.938 INFO:teuthology.orchestra.run.smithi120.stdout:5680 read 0x416ddc3 thru 0x417beca (0xe108 bytes) 2024-09-13T05:12:32.938 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:32.938 INFO:teuthology.orchestra.run.smithi120.stdout:5684 read 0x45cb547 thru 0x45d934e (0xde08 bytes) 2024-09-13T05:12:32.939 INFO:teuthology.orchestra.run.smithi120.stdout:5685 write 0x68764b9 thru 0x687a224 (0x3d6c bytes) 2024-09-13T05:12:32.954 INFO:teuthology.orchestra.run.smithi120.stdout:5686 trunc from 0xe83b72d to 0xa74ce52 2024-09-13T05:12:32.988 INFO:teuthology.orchestra.run.smithi120.stdout:5688 write 0xc444f92 thru 0xc44b78e (0x67fd bytes) 2024-09-13T05:12:32.995 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:32.995 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:32.998 INFO:teuthology.orchestra.run.smithi120.stdout:5689 punch from 0x31d1017 to 0x31d938d, (0x8376 bytes) 2024-09-13T05:12:33.005 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:33.000+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:33.006 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:12:33.015 INFO:teuthology.orchestra.run.smithi120.stdout:5690 trunc from 0xc44b78f to 0x20261ed 2024-09-13T05:12:33.059 INFO:teuthology.orchestra.run.smithi120.stdout:5691 write 0x7ea8760 thru 0x7eb734a (0xebeb bytes) 2024-09-13T05:12:33.093 INFO:teuthology.orchestra.run.smithi120.stdout:5692 write 0xd211df4 thru 0xd217ed1 (0x60de bytes) 2024-09-13T05:12:33.105 INFO:teuthology.orchestra.run.smithi120.stdout:5693 read 0xbd7132e thru 0xbd7d8e8 (0xc5bb bytes) 2024-09-13T05:12:33.105 INFO:teuthology.orchestra.run.smithi120.stdout:5695 write 0x72cf234 thru 0x72d8f3b (0x9d08 bytes) 2024-09-13T05:12:33.106 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:33.104+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:33.111 INFO:teuthology.orchestra.run.smithi120.stdout:5696 read 0x334a065 thru 0x335926a (0xf206 bytes) 2024-09-13T05:12:33.112 INFO:teuthology.orchestra.run.smithi120.stdout:5697 write 0x143d922 thru 0x144507e (0x775d bytes) 2024-09-13T05:12:33.121 INFO:teuthology.orchestra.run.smithi120.stdout:5699 trunc from 0xd217ed2 to 0x9a1c43d 2024-09-13T05:12:33.137 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:33.137 INFO:teuthology.orchestra.run.smithi120.stdout:5702 punch from 0x1468314 to 0x146a9ca, (0x26b6 bytes) 2024-09-13T05:12:33.137 INFO:teuthology.orchestra.run.smithi120.stdout:5703 write 0x9dd3d7 thru 0x9e14f2 (0x411c bytes) 2024-09-13T05:12:33.140 INFO:teuthology.orchestra.run.smithi120.stdout:5705 read 0x47d0445 thru 0x47db871 (0xb42d bytes) 2024-09-13T05:12:33.140 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:33.140 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:33.146 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:33.147 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:33.154 INFO:teuthology.orchestra.run.smithi120.stdout:5710 trunc from 0x9a1c43d to 0x741079 2024-09-13T05:12:33.164 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:12:33.198 INFO:teuthology.orchestra.run.smithi120.stdout:5711 trunc from 0x741079 to 0xd111d17 2024-09-13T05:12:33.206 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:33.204+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:33.207 INFO:teuthology.orchestra.run.smithi120.stdout:5713 write 0x2f668a2 thru 0x2f6ea14 (0x8173 bytes) 2024-09-13T05:12:33.219 INFO:teuthology.orchestra.run.smithi120.stdout:5715 writesame 0x7dae1c0 thru 0x7db9ccb data_size 0x2(0xbb0c bytes) 2024-09-13T05:12:33.233 INFO:teuthology.orchestra.run.smithi120.stdout:5716 writesame 0xa01dc72 thru 0xa0288ae data_size 0x1(0xac3d bytes) 2024-09-13T05:12:33.253 INFO:teuthology.orchestra.run.smithi120.stdout:5717 read 0x6e78f61 thru 0x6e7f596 (0x6636 bytes) 2024-09-13T05:12:33.253 INFO:teuthology.orchestra.run.smithi120.stdout:5719 write 0x4a60ff8 thru 0x4a6cce3 (0xbcec bytes) 2024-09-13T05:12:33.265 INFO:teuthology.orchestra.run.smithi120.stdout:5721 trunc from 0xd111d17 to 0xc8234b9 2024-09-13T05:12:33.272 INFO:teuthology.orchestra.run.smithi120.stdout:5723 punch from 0x5a9ed87 to 0x5aab67a, (0xc8f3 bytes) 2024-09-13T05:12:33.272 INFO:teuthology.orchestra.run.smithi120.stdout:5724 writesame 0x150ed4c thru 0x1510cd0 data_size 0x1(0x1f85 bytes) 2024-09-13T05:12:33.277 INFO:teuthology.orchestra.run.smithi120.stdout:5725 write 0x5e2f430 thru 0x5e3abae (0xb77f bytes) 2024-09-13T05:12:33.293 INFO:teuthology.orchestra.run.smithi120.stdout:5726 read 0xb166eb9 thru 0xb16f956 (0x8a9e bytes) 2024-09-13T05:12:33.293 INFO:teuthology.orchestra.run.smithi120.stdout:5730 punch from 0x482fa5d to 0x482feaa, (0x44d bytes) 2024-09-13T05:12:33.294 INFO:teuthology.orchestra.run.smithi120.stdout:5731 write 0xc3dc55a thru 0xc3de6d6 (0x217d bytes) 2024-09-13T05:12:33.300 INFO:teuthology.orchestra.run.smithi120.stdout:5732 writesame 0x63173aa thru 0x63173bf data_size 0x1(0x16 bytes) 2024-09-13T05:12:33.302 INFO:teuthology.orchestra.run.smithi120.stdout:5733 punch from 0xa3261a to 0xa34477, (0x1e5d bytes) 2024-09-13T05:12:33.306 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:33.304+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:33.310 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:33.310 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:33.315 INFO:teuthology.orchestra.run.smithi120.stdout:5734 writesame 0xe92f600 thru 0xe9304aa data_size 0x1(0xeab bytes) 2024-09-13T05:12:33.315 INFO:teuthology.orchestra.run.smithi120.stdout:5735 write 0x868079e thru 0x86894ce (0x8d31 bytes) 2024-09-13T05:12:33.320 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:12:33.327 INFO:teuthology.orchestra.run.smithi120.stdout:5737 read 0x2e0ba7d thru 0x2e1a2f1 (0xe875 bytes) 2024-09-13T05:12:33.352 INFO:teuthology.orchestra.run.smithi120.stdout:5738 trunc from 0xe9304ab to 0x68d478 2024-09-13T05:12:33.403 INFO:teuthology.orchestra.run.smithi120.stdout:5739 writesame 0x9012444 thru 0x9021fde data_size 0x1(0xfb9b bytes) 2024-09-13T05:12:33.403 INFO:teuthology.orchestra.run.smithi120.stdout:5740 write 0x76df917 thru 0x76e4e2f (0x5519 bytes) 2024-09-13T05:12:33.408 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:33.404+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:33.413 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:33.430 INFO:teuthology.orchestra.run.smithi120.stdout:5744 writesame 0xd9dad51 thru 0xd9e0d9a data_size 0x55(0x604a bytes) 2024-09-13T05:12:33.430 INFO:teuthology.orchestra.run.smithi120.stdout:5745 read 0x92d4b57 thru 0x92e0dcd (0xc277 bytes) 2024-09-13T05:12:33.430 INFO:teuthology.orchestra.run.smithi120.stdout:5746 write 0x90b1062 thru 0x90bec40 (0xdbdf bytes) 2024-09-13T05:12:33.441 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:33.441 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:33.448 INFO:teuthology.orchestra.run.smithi120.stdout:5748 punch from 0x479971e to 0x47a6d1a, (0xd5fc bytes) 2024-09-13T05:12:33.449 INFO:teuthology.orchestra.run.smithi120.stdout:5749 writesame 0x9ebd5cf thru 0x9ebdf60 data_size 0x23(0x992 bytes) 2024-09-13T05:12:33.452 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:12:33.467 INFO:teuthology.orchestra.run.smithi120.stdout:5750 trunc from 0xd9e0d9b to 0x426672b 2024-09-13T05:12:33.485 INFO:teuthology.orchestra.run.smithi120.stdout:5752 write 0x37182c8 thru 0x3727066 (0xed9f bytes) 2024-09-13T05:12:33.508 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:33.503+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:33.519 INFO:teuthology.orchestra.run.smithi120.stdout:5753 trunc from 0x426672b to 0xedc0397 2024-09-13T05:12:33.527 INFO:teuthology.orchestra.run.smithi120.stdout:5755 write 0x6ca52e2 thru 0x6caa15f (0x4e7e bytes) 2024-09-13T05:12:33.537 INFO:teuthology.orchestra.run.smithi120.stdout:5756 write 0xd039de4 thru 0xd048d53 (0xef70 bytes) 2024-09-13T05:12:33.555 INFO:teuthology.orchestra.run.smithi120.stdout:5757 read 0x4dfda42 thru 0x4e0996c (0xbf2b bytes) 2024-09-13T05:12:33.555 INFO:teuthology.orchestra.run.smithi120.stdout:5758 write 0x5c669f7 thru 0x5c6873e (0x1d48 bytes) 2024-09-13T05:12:33.562 INFO:teuthology.orchestra.run.smithi120.stdout:5759 trunc from 0xedc0397 to 0xe943044 2024-09-13T05:12:33.575 INFO:teuthology.orchestra.run.smithi120.stdout:5760 trunc from 0xe943044 to 0xc817e0b 2024-09-13T05:12:33.587 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:33.587 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:33.598 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:12:33.603 INFO:teuthology.orchestra.run.smithi120.stdout:5761 write 0xdcd84ba thru 0xdce28c5 (0xa40c bytes) 2024-09-13T05:12:33.617 INFO:teuthology.orchestra.run.smithi120.stdout:5762 write 0x43d1b9 thru 0x43f69d (0x24e5 bytes) 2024-09-13T05:12:33.618 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:33.615+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:33.620 INFO:teuthology.orchestra.run.smithi120.stdout:5763 read 0x2e2ebae thru 0x2e30a42 (0x1e95 bytes) 2024-09-13T05:12:33.620 INFO:teuthology.orchestra.run.smithi120.stdout:5764 read 0x7a8d368 thru 0x7a9908c (0xbd25 bytes) 2024-09-13T05:12:33.641 INFO:teuthology.orchestra.run.smithi120.stdout:5765 trunc from 0xdce28c6 to 0x110c7ae 2024-09-13T05:12:33.668 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:33.668 INFO:teuthology.orchestra.run.smithi120.stdout:5767 trunc from 0x110c7ae to 0x1512806 2024-09-13T05:12:33.675 INFO:teuthology.orchestra.run.smithi120.stdout:5768 read 0x9a6c70 thru 0x9a9085 (0x2416 bytes) 2024-09-13T05:12:33.703 INFO:teuthology.orchestra.run.smithi120.stdout:5769 writesame 0xcbba554 thru 0xcbc1c6d data_size 0x5(0x771a bytes) 2024-09-13T05:12:33.703 INFO:teuthology.orchestra.run.smithi120.stdout:5770 read 0xd7bb55 thru 0xd82223 (0x66cf bytes) 2024-09-13T05:12:33.703 INFO:teuthology.orchestra.run.smithi120.stdout:5771 write 0x760d238 thru 0x761c7b8 (0xf581 bytes) 2024-09-13T05:12:33.712 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:33.708+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:33.721 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:33.721 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:33.735 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:12:33.736 INFO:teuthology.orchestra.run.smithi120.stdout:5772 trunc from 0xcbc1c6e to 0x24faade 2024-09-13T05:12:33.777 INFO:teuthology.orchestra.run.smithi120.stdout:5773 write 0xbc60807 thru 0xbc64af2 (0x42ec bytes) 2024-09-13T05:12:33.786 INFO:teuthology.orchestra.run.smithi120.stdout:5774 write 0xadee8f7 thru 0xadf8c22 (0xa32c bytes) 2024-09-13T05:12:33.799 INFO:teuthology.orchestra.run.smithi120.stdout:5777 write 0x1985c91 thru 0x198e44b (0x87bb bytes) 2024-09-13T05:12:33.803 INFO:teuthology.orchestra.run.smithi120.stdout:5778 writesame 0xb944ff thru 0xb97c63 data_size 0x1d(0x3765 bytes) 2024-09-13T05:12:33.806 INFO:teuthology.orchestra.run.smithi120.stdout:5779 writesame 0x742d4aa thru 0x7435cc9 data_size 0x30(0x8820 bytes) 2024-09-13T05:12:33.813 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:33.808+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:33.815 INFO:teuthology.orchestra.run.smithi120.stdout:5782 punch from 0x77bb8b2 to 0x77c423d, (0x898b bytes) 2024-09-13T05:12:33.815 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:33.816 INFO:teuthology.orchestra.run.smithi120.stdout:5787 punch from 0x2759712 to 0x275a557, (0xe45 bytes) 2024-09-13T05:12:33.816 INFO:teuthology.orchestra.run.smithi120.stdout:5789 read 0xbbb7e2e thru 0xbbb9d21 (0x1ef4 bytes) 2024-09-13T05:12:33.816 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:33.816 INFO:teuthology.orchestra.run.smithi120.stdout:5793 read 0x59b911c thru 0x59c3e59 (0xad3e bytes) 2024-09-13T05:12:33.816 INFO:teuthology.orchestra.run.smithi120.stdout:5794 write 0x44bc3d3 thru 0x44bf945 (0x3573 bytes) 2024-09-13T05:12:33.827 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is set 2024-09-13T05:12:33.837 INFO:teuthology.orchestra.run.smithi120.stdout:5795 writesame 0xc75f92d thru 0xc76bf31 data_size 0x1(0xc605 bytes) 2024-09-13T05:12:33.837 INFO:teuthology.orchestra.run.smithi120.stdout:5796 write 0x2084448 thru 0x2089d35 (0x58ee bytes) 2024-09-13T05:12:33.846 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:33.846 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:33.846 INFO:teuthology.orchestra.run.smithi120.stdout:5800 write 0x7c03031 thru 0x7c0856d (0x553d bytes) 2024-09-13T05:12:33.851 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:33.851 INFO:teuthology.orchestra.run.smithi120.stdout:5802 punch from 0x458f0de to 0x459ae89, (0xbdab bytes) 2024-09-13T05:12:33.851 INFO:teuthology.orchestra.run.smithi120.stdout:5804 write 0xc351b thru 0xcbb30 (0x8616 bytes) 2024-09-13T05:12:33.855 INFO:teuthology.orchestra.run.smithi120.stdout:5805 punch from 0x5a3b3bd to 0x5a42a51, (0x7694 bytes) 2024-09-13T05:12:33.855 INFO:teuthology.orchestra.run.smithi120.stdout:5806 read 0x68ea64c thru 0x68f53d4 (0xad89 bytes) 2024-09-13T05:12:33.855 INFO:teuthology.orchestra.run.smithi120.stdout:5807 read 0x52790ef thru 0x5287f32 (0xee44 bytes) 2024-09-13T05:12:33.855 INFO:teuthology.orchestra.run.smithi120.stdout:5810 punch from 0xa006873 to 0xa014db1, (0xe53e bytes) 2024-09-13T05:12:33.861 INFO:teuthology.orchestra.run.smithi120.stdout:5811 trunc from 0xc76bf32 to 0x8d24f1b 2024-09-13T05:12:33.866 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:33.866 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:33.877 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:12:33.882 INFO:teuthology.orchestra.run.smithi120.stdout:5812 trunc from 0x8d24f1b to 0x6f990d8 2024-09-13T05:12:33.897 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:33.897 INFO:teuthology.orchestra.run.smithi120.stdout:5814 read 0x2252aea thru 0x225c4ee (0x9a05 bytes) 2024-09-13T05:12:33.897 INFO:teuthology.orchestra.run.smithi120.stdout:5815 read 0x3503a9b thru 0x35116cf (0xdc35 bytes) 2024-09-13T05:12:33.898 INFO:teuthology.orchestra.run.smithi120.stdout:5816 clone 45 order 22 su 1048576 sc 2 2024-09-13T05:12:33.914 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:33.911+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:33.978 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:33.978 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:33.988 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:12:34.005 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:12:34.018 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:34.016+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:34.119 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:34.116+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:34.137 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:34.138 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:34.148 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:12:34.173 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:12:34.202 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:34.218 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:34.219 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:34.215+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:34.241 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:34.247 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:34.247 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:34.247 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:34.247 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:34.257 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:12:34.268 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:34.290 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:34.312 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:34.320 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:34.316+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:34.336 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:34.338 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:12:34.338 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:34.338 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:34.339 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:34.339 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:34.339 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:34.339 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:34.339 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:34.355 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:34.356 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:34.356 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:34.356 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:34.356 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:34.366 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:12:34.421 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:34.419+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:34.522 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:34.519+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:34.524 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:34.524 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:34.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:34.525 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:34.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.525 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:70758 3.2 3:427d0469:::rbd_header.112d8d1317eb:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-13T05:12:34.525 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:34.525 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.092190187, 2024-09-13T05:12:34.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.190313603, 2024-09-13T05:12:34.526 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:34.526 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:34.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:34.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:34.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:34.526 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70758 2024-09-13T05:12:34.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.526 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:34.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:34.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:34.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:34.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:34.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:34.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428654+0000", 2024-09-13T05:12:34.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:34.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:34.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428664+0000", 2024-09-13T05:12:34.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0664e-05 2024-09-13T05:12:34.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:34.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428683+0000", 2024-09-13T05:12:34.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8377e-05 2024-09-13T05:12:34.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:34.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428691+0000", 2024-09-13T05:12:34.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9400000000000008e-06 2024-09-13T05:12:34.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428789+0000", 2024-09-13T05:12:34.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7165999999999998e-05 2024-09-13T05:12:34.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:34.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428811+0000", 2024-09-13T05:12:34.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1925000000000001e-05 2024-09-13T05:12:34.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.617921+0000", 2024-09-13T05:12:34.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.189110536 2024-09-13T05:12:34.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:34.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618344+0000", 2024-09-13T05:12:34.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042245800000000001 2024-09-13T05:12:34.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:34.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618969+0000", 2024-09-13T05:12:34.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062529299999999996 2024-09-13T05:12:34.531 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.531 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:34.531 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.531 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162381 3.8 3.4e1a3768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:34.532 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:12:34.532 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.01218394, 2024-09-13T05:12:34.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.14690313199999999, 2024-09-13T05:12:34.532 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:34.532 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:34.532 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:34.533 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:34.533 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:34.533 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162381 2024-09-13T05:12:34.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.533 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:34.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:34.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:12:34.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:34.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:12:34.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:34.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508659+0000", 2024-09-13T05:12:34.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:12:34.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:34.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508673+0000", 2024-09-13T05:12:34.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4154999999999999e-05 2024-09-13T05:12:34.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:34.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508703+0000", 2024-09-13T05:12:34.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9427000000000001e-05 2024-09-13T05:12:34.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:34.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508719+0000", 2024-09-13T05:12:34.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6381000000000001e-05 2024-09-13T05:12:34.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508789+0000", 2024-09-13T05:12:34.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9898000000000001e-05 2024-09-13T05:12:34.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:34.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508799+0000", 2024-09-13T05:12:34.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0066e-05 2024-09-13T05:12:34.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655550+0000", 2024-09-13T05:12:34.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.146750506 2024-09-13T05:12:34.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:34.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655565+0000", 2024-09-13T05:12:34.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4915e-05 2024-09-13T05:12:34.540 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.540 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:34.540 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.540 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162393 3.8 3.fd966c88 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:34.540 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:12:34.540 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.000667866000001, 2024-09-13T05:12:34.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.135657895, 2024-09-13T05:12:34.541 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:34.541 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:34.541 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:34.541 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:34.541 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:34.541 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162393 2024-09-13T05:12:34.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.541 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:34.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:34.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:12:34.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:34.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:12:34.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:34.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520176+0000", 2024-09-13T05:12:34.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:34.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:34.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520184+0000", 2024-09-13T05:12:34.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5800000000000003e-06 2024-09-13T05:12:34.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:34.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520199+0000", 2024-09-13T05:12:34.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4481000000000001e-05 2024-09-13T05:12:34.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:34.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520209+0000", 2024-09-13T05:12:34.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0327e-05 2024-09-13T05:12:34.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520351+0000", 2024-09-13T05:12:34.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141827 2024-09-13T05:12:34.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:34.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520363+0000", 2024-09-13T05:12:34.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2018000000000001e-05 2024-09-13T05:12:34.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655819+0000", 2024-09-13T05:12:34.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13545665600000001 2024-09-13T05:12:34.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:34.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655835+0000", 2024-09-13T05:12:34.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6135000000000001e-05 2024-09-13T05:12:34.545 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.545 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:34.545 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.546 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162429 3.8 3.6e098f28 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:34.546 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:34.546 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.999817257, 2024-09-13T05:12:34.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13484765400000001, 2024-09-13T05:12:34.546 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:34.546 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:34.546 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:34.546 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:34.546 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:34.546 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162429 2024-09-13T05:12:34.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.546 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:34.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:34.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:34.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:34.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:34.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:34.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:34.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:34.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:34.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521032+0000", 2024-09-13T05:12:34.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3039999999999998e-06 2024-09-13T05:12:34.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:34.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521041+0000", 2024-09-13T05:12:34.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6880000000000005e-06 2024-09-13T05:12:34.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:34.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521047+0000", 2024-09-13T05:12:34.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0100000000000001e-06 2024-09-13T05:12:34.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521601+0000", 2024-09-13T05:12:34.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00055398600000000002 2024-09-13T05:12:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521613+0000", 2024-09-13T05:12:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2347000000000001e-05 2024-09-13T05:12:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655869+0000", 2024-09-13T05:12:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.134255597 2024-09-13T05:12:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655876+0000", 2024-09-13T05:12:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2790000000000001e-06 2024-09-13T05:12:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162521 3.8 3.f06bf7c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.997415127, 2024-09-13T05:12:34.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13247452600000001, 2024-09-13T05:12:34.552 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:34.552 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:34.552 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:34.552 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:34.552 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:34.552 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162521 2024-09-13T05:12:34.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.552 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:34.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:34.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:34.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:34.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:34.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:34.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:34.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:34.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:34.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523433+0000", 2024-09-13T05:12:34.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.128e-06 2024-09-13T05:12:34.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:34.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523440+0000", 2024-09-13T05:12:34.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9990000000000002e-06 2024-09-13T05:12:34.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:34.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523446+0000", 2024-09-13T05:12:34.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7869999999999998e-06 2024-09-13T05:12:34.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.528221+0000", 2024-09-13T05:12:34.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047747040000000003 2024-09-13T05:12:34.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:34.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.528237+0000", 2024-09-13T05:12:34.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6042e-05 2024-09-13T05:12:34.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655898+0000", 2024-09-13T05:12:34.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.127661521 2024-09-13T05:12:34.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655905+0000", 2024-09-13T05:12:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7780000000000002e-06 2024-09-13T05:12:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162381 3.8 3:16ec5872:::rbd_data.112dc3abcba6.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:12:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.987887961999999, 2024-09-13T05:12:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12546553899999999, 2024-09-13T05:12:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162381 2024-09-13T05:12:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:12:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:12:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532956+0000", 2024-09-13T05:12:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:34.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532964+0000", 2024-09-13T05:12:34.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.072e-06 2024-09-13T05:12:34.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:34.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532976+0000", 2024-09-13T05:12:34.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1355000000000001e-05 2024-09-13T05:12:34.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532984+0000", 2024-09-13T05:12:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3440000000000001e-06 2024-09-13T05:12:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533432+0000", 2024-09-13T05:12:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044773000000000002 2024-09-13T05:12:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533439+0000", 2024-09-13T05:12:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9890000000000003e-06 2024-09-13T05:12:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655985+0000", 2024-09-13T05:12:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122546527 2024-09-13T05:12:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656234+0000", 2024-09-13T05:12:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024911300000000003 2024-09-13T05:12:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:12:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656378+0000", 2024-09-13T05:12:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014417100000000001 2024-09-13T05:12:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657916+0000", 2024-09-13T05:12:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001537907 2024-09-13T05:12:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:12:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658308+0000", 2024-09-13T05:12:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039183700000000002 2024-09-13T05:12:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:12:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658364+0000", 2024-09-13T05:12:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5451000000000002e-05 2024-09-13T05:12:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658423+0000", 2024-09-13T05:12:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9449e-05 2024-09-13T05:12:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162393 3.8 3:113669bf:::rbd_data.112dfd94ee88.00000000000000bf:2a [read 131072~18432] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.987848183000001, 2024-09-13T05:12:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124231431, 2024-09-13T05:12:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162393 2024-09-13T05:12:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533001+0000", 2024-09-13T05:12:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8099999999999999e-06 2024-09-13T05:12:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533007+0000", 2024-09-13T05:12:34.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5849999999999996e-06 2024-09-13T05:12:34.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:34.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533012+0000", 2024-09-13T05:12:34.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0320000000000003e-06 2024-09-13T05:12:34.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533459+0000", 2024-09-13T05:12:34.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044646399999999999 2024-09-13T05:12:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533464+0000", 2024-09-13T05:12:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9180000000000002e-06 2024-09-13T05:12:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656870+0000", 2024-09-13T05:12:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123406847 2024-09-13T05:12:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657067+0000", 2024-09-13T05:12:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019655599999999999 2024-09-13T05:12:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657229+0000", 2024-09-13T05:12:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016175599999999999 2024-09-13T05:12:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162429 3.8 3:14f19076:::rbd_data.112dfd94ee88.0000000000000150:2a [read 131072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:12:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.987828632999999, 2024-09-13T05:12:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124549956, 2024-09-13T05:12:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162429 2024-09-13T05:12:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:12:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:12:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533016+0000", 2024-09-13T05:12:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533020+0000", 2024-09-13T05:12:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1049999999999999e-06 2024-09-13T05:12:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533025+0000", 2024-09-13T05:12:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-09-13T05:12:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533030+0000", 2024-09-13T05:12:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8999999999999997e-06 2024-09-13T05:12:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533481+0000", 2024-09-13T05:12:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045080400000000002 2024-09-13T05:12:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533486+0000", 2024-09-13T05:12:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3369999999999999e-06 2024-09-13T05:12:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657311+0000", 2024-09-13T05:12:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123824408 2024-09-13T05:12:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657464+0000", 2024-09-13T05:12:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015343900000000001 2024-09-13T05:12:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657567+0000", 2024-09-13T05:12:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102568 2024-09-13T05:12:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162521 3.8 3:13efd60f:::rbd_data.112dfd94ee88.000000000000031a:2a [read 131072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.987677399999999, 2024-09-13T05:12:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124709257, 2024-09-13T05:12:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162521 2024-09-13T05:12:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533170+0000", 2024-09-13T05:12:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3910000000000001e-06 2024-09-13T05:12:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533176+0000", 2024-09-13T05:12:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4029999999999998e-06 2024-09-13T05:12:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533180+0000", 2024-09-13T05:12:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6999999999999999e-06 2024-09-13T05:12:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533659+0000", 2024-09-13T05:12:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047839699999999998 2024-09-13T05:12:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533664+0000", 2024-09-13T05:12:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7239999999999997e-06 2024-09-13T05:12:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657619+0000", 2024-09-13T05:12:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123954412 2024-09-13T05:12:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657784+0000", 2024-09-13T05:12:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016527499999999999 2024-09-13T05:12:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:34.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657877+0000", 2024-09-13T05:12:34.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3280000000000001e-05 2024-09-13T05:12:34.582 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.582 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:34.582 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.582 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162618 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 70656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:34.582 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:12:34.582 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.98637269, 2024-09-13T05:12:34.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123752711, 2024-09-13T05:12:34.582 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162618 2024-09-13T05:12:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:12:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:12:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534472+0000", 2024-09-13T05:12:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534475+0000", 2024-09-13T05:12:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2010000000000002e-06 2024-09-13T05:12:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534482+0000", 2024-09-13T05:12:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:12:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534486+0000", 2024-09-13T05:12:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7520000000000004e-06 2024-09-13T05:12:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536456+0000", 2024-09-13T05:12:34.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001969527 2024-09-13T05:12:34.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:34.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536462+0000", 2024-09-13T05:12:34.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2750000000000001e-06 2024-09-13T05:12:34.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657939+0000", 2024-09-13T05:12:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121476769 2024-09-13T05:12:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658087+0000", 2024-09-13T05:12:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014862400000000001 2024-09-13T05:12:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:34.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658225+0000", 2024-09-13T05:12:34.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013800999999999999 2024-09-13T05:12:34.588 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.588 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:34.588 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.588 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162620 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 71680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:34.588 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:34.588 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.986338565000001, 2024-09-13T05:12:34.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124087688, 2024-09-13T05:12:34.589 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:34.589 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:34.589 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:34.589 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:34.589 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:34.589 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162620 2024-09-13T05:12:34.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.589 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534509+0000", 2024-09-13T05:12:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1270000000000001e-06 2024-09-13T05:12:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534514+0000", 2024-09-13T05:12:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8720000000000001e-06 2024-09-13T05:12:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534518+0000", 2024-09-13T05:12:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5090000000000004e-06 2024-09-13T05:12:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536485+0000", 2024-09-13T05:12:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019671530000000001 2024-09-13T05:12:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536491+0000", 2024-09-13T05:12:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3759999999999999e-06 2024-09-13T05:12:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658466+0000", 2024-09-13T05:12:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121975466 2024-09-13T05:12:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658522+0000", 2024-09-13T05:12:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5668999999999998e-05 2024-09-13T05:12:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658595+0000", 2024-09-13T05:12:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2800999999999996e-05 2024-09-13T05:12:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162622 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 72704~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:12:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.986307598, 2024-09-13T05:12:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124215569, 2024-09-13T05:12:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162622 2024-09-13T05:12:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:12:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:12:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534537+0000", 2024-09-13T05:12:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534540+0000", 2024-09-13T05:12:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3740000000000001e-06 2024-09-13T05:12:34.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:34.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534545+0000", 2024-09-13T05:12:34.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4210000000000003e-06 2024-09-13T05:12:34.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:34.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534550+0000", 2024-09-13T05:12:34.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3090000000000003e-06 2024-09-13T05:12:34.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536510+0000", 2024-09-13T05:12:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019597130000000001 2024-09-13T05:12:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536517+0000", 2024-09-13T05:12:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0620000000000003e-06 2024-09-13T05:12:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658632+0000", 2024-09-13T05:12:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122114373 2024-09-13T05:12:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658686+0000", 2024-09-13T05:12:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3882999999999999e-05 2024-09-13T05:12:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658753+0000", 2024-09-13T05:12:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7921000000000002e-05 2024-09-13T05:12:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162623 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 73728~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:12:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.986290792999998, 2024-09-13T05:12:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124350214, 2024-09-13T05:12:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162623 2024-09-13T05:12:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:12:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:12:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534554+0000", 2024-09-13T05:12:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534556+0000", 2024-09-13T05:12:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-13T05:12:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534563+0000", 2024-09-13T05:12:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2890000000000003e-06 2024-09-13T05:12:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534567+0000", 2024-09-13T05:12:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4880000000000001e-06 2024-09-13T05:12:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536538+0000", 2024-09-13T05:12:34.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019703989999999998 2024-09-13T05:12:34.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536543+0000", 2024-09-13T05:12:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3920000000000002e-06 2024-09-13T05:12:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658773+0000", 2024-09-13T05:12:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122229607 2024-09-13T05:12:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658835+0000", 2024-09-13T05:12:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1954999999999999e-05 2024-09-13T05:12:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:34.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658905+0000", 2024-09-13T05:12:34.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-09-13T05:12:34.607 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.607 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:34.607 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.607 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162626 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 65536~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.986239509000001, 2024-09-13T05:12:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124425881, 2024-09-13T05:12:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162626 2024-09-13T05:12:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534611+0000", 2024-09-13T05:12:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5419999999999996e-06 2024-09-13T05:12:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534617+0000", 2024-09-13T05:12:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5169999999999999e-06 2024-09-13T05:12:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534622+0000", 2024-09-13T05:12:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9810000000000003e-06 2024-09-13T05:12:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536563+0000", 2024-09-13T05:12:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019410549999999999 2024-09-13T05:12:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536568+0000", 2024-09-13T05:12:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4310000000000002e-06 2024-09-13T05:12:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658922+0000", 2024-09-13T05:12:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122354221 2024-09-13T05:12:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658968+0000", 2024-09-13T05:12:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5221e-05 2024-09-13T05:12:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659032+0000", 2024-09-13T05:12:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4256000000000003e-05 2024-09-13T05:12:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162628 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 66560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.986204558000001, 2024-09-13T05:12:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124532254, 2024-09-13T05:12:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162628 2024-09-13T05:12:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534643+0000", 2024-09-13T05:12:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1890000000000001e-06 2024-09-13T05:12:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534648+0000", 2024-09-13T05:12:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:12:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534652+0000", 2024-09-13T05:12:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4549999999999997e-06 2024-09-13T05:12:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536586+0000", 2024-09-13T05:12:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019336049999999999 2024-09-13T05:12:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536591+0000", 2024-09-13T05:12:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3770000000000004e-06 2024-09-13T05:12:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659062+0000", 2024-09-13T05:12:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122470685 2024-09-13T05:12:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659106+0000", 2024-09-13T05:12:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3856000000000002e-05 2024-09-13T05:12:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659173+0000", 2024-09-13T05:12:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7168000000000005e-05 2024-09-13T05:12:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162630 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 67584~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.986171352, 2024-09-13T05:12:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12468555100000001, 2024-09-13T05:12:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162630 2024-09-13T05:12:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534676+0000", 2024-09-13T05:12:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4399999999999999e-06 2024-09-13T05:12:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534681+0000", 2024-09-13T05:12:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2349999999999999e-06 2024-09-13T05:12:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534686+0000", 2024-09-13T05:12:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5499999999999996e-06 2024-09-13T05:12:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536609+0000", 2024-09-13T05:12:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001923407 2024-09-13T05:12:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536615+0000", 2024-09-13T05:12:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1499999999999998e-06 2024-09-13T05:12:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659233+0000", 2024-09-13T05:12:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122618957 2024-09-13T05:12:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659294+0000", 2024-09-13T05:12:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0251000000000003e-05 2024-09-13T05:12:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659360+0000", 2024-09-13T05:12:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5906000000000002e-05 2024-09-13T05:12:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162633 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 69632~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.986063446999999, 2024-09-13T05:12:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124702147, 2024-09-13T05:12:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162633 2024-09-13T05:12:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:34.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:34.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:34.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:34.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:34.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534784+0000", 2024-09-13T05:12:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3300000000000001e-06 2024-09-13T05:12:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534789+0000", 2024-09-13T05:12:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4149999999999998e-06 2024-09-13T05:12:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534794+0000", 2024-09-13T05:12:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5669999999999996e-06 2024-09-13T05:12:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536634+0000", 2024-09-13T05:12:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001840401 2024-09-13T05:12:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536642+0000", 2024-09-13T05:12:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9729999999999997e-06 2024-09-13T05:12:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659383+0000", 2024-09-13T05:12:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12274112099999999 2024-09-13T05:12:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659424+0000", 2024-09-13T05:12:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0936000000000002e-05 2024-09-13T05:12:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659484+0000", 2024-09-13T05:12:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9775000000000003e-05 2024-09-13T05:12:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162675 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 68608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.986014402999999, 2024-09-13T05:12:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124823974, 2024-09-13T05:12:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162675 2024-09-13T05:12:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534833+0000", 2024-09-13T05:12:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.204e-06 2024-09-13T05:12:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534838+0000", 2024-09-13T05:12:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0130000000000001e-06 2024-09-13T05:12:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534842+0000", 2024-09-13T05:12:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.51e-06 2024-09-13T05:12:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536661+0000", 2024-09-13T05:12:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018186039999999999 2024-09-13T05:12:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536667+0000", 2024-09-13T05:12:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5260000000000001e-06 2024-09-13T05:12:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659531+0000", 2024-09-13T05:12:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122864403 2024-09-13T05:12:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659583+0000", 2024-09-13T05:12:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1564000000000003e-05 2024-09-13T05:12:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659655+0000", 2024-09-13T05:12:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2504999999999998e-05 2024-09-13T05:12:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:163257 3.8 3:1136e8de:::rbd_data.112dbd21872d.000000000000003c:28 [read 200704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.970999197000001, 2024-09-13T05:12:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12163807, 2024-09-13T05:12:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 163257 2024-09-13T05:12:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549848+0000", 2024-09-13T05:12:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1789999999999998e-06 2024-09-13T05:12:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549854+0000", 2024-09-13T05:12:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9050000000000002e-06 2024-09-13T05:12:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549858+0000", 2024-09-13T05:12:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3529999999999997e-06 2024-09-13T05:12:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.551228+0000", 2024-09-13T05:12:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001369227 2024-09-13T05:12:34.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:34.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.551233+0000", 2024-09-13T05:12:34.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5860000000000004e-06 2024-09-13T05:12:34.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671337+0000", 2024-09-13T05:12:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.120104265 2024-09-13T05:12:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671425+0000", 2024-09-13T05:12:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7810000000000001e-05 2024-09-13T05:12:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671484+0000", 2024-09-13T05:12:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9079000000000001e-05 2024-09-13T05:12:34.641 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.641 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:34.641 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.641 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:170203 3.1e 3:7c9b1cf4:::rbd_header.112dc3abcba6:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128)", 2024-09-13T05:12:34.641 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:12:34.641 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.706035432, 2024-09-13T05:12:34.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.79948714899999995, 2024-09-13T05:12:34.642 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:34.642 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:34.642 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:34.642 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:34.642 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:34.642 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 170203 2024-09-13T05:12:34.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.642 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:34.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:12:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:12:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814808+0000", 2024-09-13T05:12:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814820+0000", 2024-09-13T05:12:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.206e-05 2024-09-13T05:12:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814841+0000", 2024-09-13T05:12:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1464999999999999e-05 2024-09-13T05:12:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814853+0000", 2024-09-13T05:12:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1824999999999999e-05 2024-09-13T05:12:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814911+0000", 2024-09-13T05:12:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8255999999999999e-05 2024-09-13T05:12:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814918+0000", 2024-09-13T05:12:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7120000000000003e-06 2024-09-13T05:12:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.611660+0000", 2024-09-13T05:12:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.79674180100000003 2024-09-13T05:12:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.611911+0000", 2024-09-13T05:12:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025108900000000002 2024-09-13T05:12:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-13T05:12:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.612726+0000", 2024-09-13T05:12:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00081512999999999996 2024-09-13T05:12:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614087+0000", 2024-09-13T05:12:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013607560000000001 2024-09-13T05:12:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:12:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614095+0000", 2024-09-13T05:12:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3240000000000003e-06 2024-09-13T05:12:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:12:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614138+0000", 2024-09-13T05:12:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3115000000000003e-05 2024-09-13T05:12:34.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:34.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:34.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:34.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614297+0000", 2024-09-13T05:12:34.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015875399999999999 2024-09-13T05:12:34.648 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.648 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:34.648 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.648 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:34.648 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:34.648 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:34.650 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:12:34.650 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:34.648+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:34.751 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:34.748+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:34.765 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:34.765 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:34.765 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:34.765 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:34.775 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:12:34.851 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:34.848+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:34.894 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:34.895 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:34.895 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:34.895 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:34.895 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:34.905 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:12:34.953 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:34.948+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:35.009 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:35.009 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:35.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:35.009 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [] 2024-09-13T05:12:35.009 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:35.018 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:12:35.054 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:35.051+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:35.075 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #43, image image_client.0-clone43 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent44 2024-09-13T05:12:35.092 INFO:teuthology.orchestra.run.smithi120.stdout:5817 read 0x5464c8e thru 0x546e648 (0x99bb bytes) 2024-09-13T05:12:35.102 INFO:teuthology.orchestra.run.smithi120.stdout:5819 read 0x1017fb7 thru 0x1026642 (0xe68c bytes) 2024-09-13T05:12:35.105 INFO:teuthology.orchestra.run.smithi120.stdout:5820 read 0x601fbce thru 0x602e230 (0xe663 bytes) 2024-09-13T05:12:35.107 INFO:teuthology.orchestra.run.smithi120.stdout:5821 write 0x38e942 thru 0x396b19 (0x81d8 bytes) 2024-09-13T05:12:35.128 INFO:teuthology.orchestra.run.smithi120.stdout:5822 read 0x5c1f406 thru 0x5c1fcd9 (0x8d4 bytes) 2024-09-13T05:12:35.129 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:35.129 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:35.129 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:35.129 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:35.134 INFO:teuthology.orchestra.run.smithi120.stdout:5824 trunc from 0x6f990d8 to 0x42b68e0 2024-09-13T05:12:35.138 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:12:35.155 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:35.151+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:35.177 INFO:teuthology.orchestra.run.smithi120.stdout:5825 writesame 0x6c71801 thru 0x6c736d9 data_size 0x1(0x1ed9 bytes) 2024-09-13T05:12:35.182 INFO:teuthology.orchestra.run.smithi120.stdout:5826 trunc from 0x6c736da to 0x9bdb54f 2024-09-13T05:12:35.195 INFO:teuthology.orchestra.run.smithi120.stdout:5827 write 0x57b299 thru 0x57d873 (0x25db bytes) 2024-09-13T05:12:35.198 INFO:teuthology.orchestra.run.smithi120.stdout:5828 read 0x9839387 thru 0x9846eda (0xdb54 bytes) 2024-09-13T05:12:35.199 INFO:teuthology.orchestra.run.smithi120.stdout:5829 punch from 0x5389638 to 0x538f859, (0x6221 bytes) 2024-09-13T05:12:35.199 INFO:teuthology.orchestra.run.smithi120.stdout:5831 punch from 0x61a0578 to 0x61a63fd, (0x5e85 bytes) 2024-09-13T05:12:35.199 INFO:teuthology.orchestra.run.smithi120.stdout:5832 read 0x8f12422 thru 0x8f13cfc (0x18db bytes) 2024-09-13T05:12:35.199 INFO:teuthology.orchestra.run.smithi120.stdout:5833 writesame 0x54ff5d7 thru 0x550b31a data_size 0x2(0xbd44 bytes) 2024-09-13T05:12:35.239 INFO:teuthology.orchestra.run.smithi120.stdout:5834 write 0xc29c3b2 thru 0xc2ab014 (0xec63 bytes) 2024-09-13T05:12:35.240 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:35.240 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:35.240 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:35.240 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:35.240 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:35.247 INFO:teuthology.orchestra.run.smithi120.stdout:5836 punch from 0x938f7c9 to 0x9394604, (0x4e3b bytes) 2024-09-13T05:12:35.247 INFO:teuthology.orchestra.run.smithi120.stdout:5838 read 0x59b6964 thru 0x59c5080 (0xe71d bytes) 2024-09-13T05:12:35.247 INFO:teuthology.orchestra.run.smithi120.stdout:5839 read 0x9f24e3f thru 0x9f2a329 (0x54eb bytes) 2024-09-13T05:12:35.247 INFO:teuthology.orchestra.run.smithi120.stdout:5840 write 0x99f3401 thru 0x99fc4f1 (0x90f1 bytes) 2024-09-13T05:12:35.249 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:12:35.255 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:35.252+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:35.275 INFO:teuthology.orchestra.run.smithi120.stdout:5841 trunc from 0xc2ab015 to 0x27509bd 2024-09-13T05:12:35.315 INFO:teuthology.orchestra.run.smithi120.stdout:5843 trunc from 0x27509bd to 0x9bf4c5b 2024-09-13T05:12:35.328 INFO:teuthology.orchestra.run.smithi120.stdout:5845 trunc from 0x9bf4c5b to 0xb15f9b8 2024-09-13T05:12:35.339 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:35.356 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:35.356 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:35.356 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:35.356 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3.bb1d1096 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 71.407892958000005, 2024-09-13T05:12:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68834410099999999, 2024-09-13T05:12:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:12:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.357 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943719+0000", 2024-09-13T05:12:35.358 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:12:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943734+0000", 2024-09-13T05:12:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4793e-05 2024-09-13T05:12:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943765+0000", 2024-09-13T05:12:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0648999999999997e-05 2024-09-13T05:12:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943779+0000", 2024-09-13T05:12:35.359 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.447e-05 2024-09-13T05:12:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943872+0000", 2024-09-13T05:12:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3304e-05 2024-09-13T05:12:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943884+0000", 2024-09-13T05:12:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.167e-05 2024-09-13T05:12:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.360 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632042+0000", 2024-09-13T05:12:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68815832600000004 2024-09-13T05:12:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632066+0000", 2024-09-13T05:12:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3765999999999999e-05 2024-09-13T05:12:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3.b6bd6256 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:35.361 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 71.407768458000007, 2024-09-13T05:12:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68852592499999998, 2024-09-13T05:12:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:12:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:35.362 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943846+0000", 2024-09-13T05:12:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943852+0000", 2024-09-13T05:12:35.363 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3820000000000001e-06 2024-09-13T05:12:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943876+0000", 2024-09-13T05:12:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3995e-05 2024-09-13T05:12:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943898+0000", 2024-09-13T05:12:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1838999999999999e-05 2024-09-13T05:12:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946457+0000", 2024-09-13T05:12:35.364 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025588910000000002 2024-09-13T05:12:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946499+0000", 2024-09-13T05:12:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2814e-05 2024-09-13T05:12:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632364+0000", 2024-09-13T05:12:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68586484999999997 2024-09-13T05:12:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.365 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632372+0000", 2024-09-13T05:12:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1659999999999994e-06 2024-09-13T05:12:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3:6908b8dd:::rbd_data.112d8d1317eb.000000000000000f:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 71.370624379999995, 2024-09-13T05:12:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65181049499999999, 2024-09-13T05:12:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.366 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:12:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.367 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980989+0000", 2024-09-13T05:12:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980996+0000", 2024-09-13T05:12:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2200000000000003e-06 2024-09-13T05:12:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981011+0000", 2024-09-13T05:12:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4997000000000001e-05 2024-09-13T05:12:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.368 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981025+0000", 2024-09-13T05:12:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3604000000000001e-05 2024-09-13T05:12:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981110+0000", 2024-09-13T05:12:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4948000000000001e-05 2024-09-13T05:12:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981120+0000", 2024-09-13T05:12:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9399999999999997e-06 2024-09-13T05:12:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632425+0000", 2024-09-13T05:12:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65130460499999998 2024-09-13T05:12:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632587+0000", 2024-09-13T05:12:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016199500000000001 2024-09-13T05:12:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632801+0000", 2024-09-13T05:12:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021459499999999999 2024-09-13T05:12:35.370 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3:6a46bd6d:::rbd_data.112d8d1317eb.0000000000000010:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 71.370566724, 2024-09-13T05:12:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65213695699999996, 2024-09-13T05:12:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.371 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:12:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.372 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981052+0000", 2024-09-13T05:12:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4469999999999999e-06 2024-09-13T05:12:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981066+0000", 2024-09-13T05:12:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3658e-05 2024-09-13T05:12:35.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981073+0000", 2024-09-13T05:12:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:12:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981150+0000", 2024-09-13T05:12:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7783999999999999e-05 2024-09-13T05:12:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981161+0000", 2024-09-13T05:12:35.374 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0197000000000001e-05 2024-09-13T05:12:35.375 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.375 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.375 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.375 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632926+0000", 2024-09-13T05:12:35.375 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65176517300000003 2024-09-13T05:12:35.375 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.375 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.375 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633081+0000", 2024-09-13T05:12:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000155172 2024-09-13T05:12:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633185+0000", 2024-09-13T05:12:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000104329 2024-09-13T05:12:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.376 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:157552 3.5 3:a072521b:::rbd_data.112dc3abcba6.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-09-13T05:12:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:02.531636+0000", 2024-09-13T05:12:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 32.819978886999998, 2024-09-13T05:12:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.118346166, 2024-09-13T05:12:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 157552 2024-09-13T05:12:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.377 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.531636+0000", 2024-09-13T05:12:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.531636+0000", 2024-09-13T05:12:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.531634+0000", 2024-09-13T05:12:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:12:35.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552355+0000", 2024-09-13T05:12:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020721112 2024-09-13T05:12:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552389+0000", 2024-09-13T05:12:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4425999999999999e-05 2024-09-13T05:12:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552399+0000", 2024-09-13T05:12:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0062e-05 2024-09-13T05:12:35.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.380 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.380 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552496+0000", 2024-09-13T05:12:35.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6914000000000001e-05 2024-09-13T05:12:35.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.380 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.380 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.552765+0000", 2024-09-13T05:12:35.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00026873499999999998 2024-09-13T05:12:35.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.380 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 3", 2024-09-13T05:12:35.380 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.562896+0000", 2024-09-13T05:12:35.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010131186 2024-09-13T05:12:35.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.381 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:12:35.381 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.611492+0000", 2024-09-13T05:12:35.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048596448 2024-09-13T05:12:35.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.381 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:35.381 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.649797+0000", 2024-09-13T05:12:35.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.038304202000000002 2024-09-13T05:12:35.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:35.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.649905+0000", 2024-09-13T05:12:35.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010853600000000001 2024-09-13T05:12:35.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:02.649982+0000", 2024-09-13T05:12:35.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7080000000000001e-05 2024-09-13T05:12:35.382 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.382 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.382 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.382 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:159585 3.1c 3:3afcc414:::rbd_data.112dfd94ee88.00000000000002ca:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:35.383 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:35.383 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.337248411000001, 2024-09-13T05:12:35.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91717655399999998, 2024-09-13T05:12:35.383 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.383 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.383 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.383 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.383 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.383 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 159585 2024-09-13T05:12:35.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.383 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:35.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.384 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.384 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:35.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.384 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.384 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014366+0000", 2024-09-13T05:12:35.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014370+0000", 2024-09-13T05:12:35.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9960000000000004e-06 2024-09-13T05:12:35.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014379+0000", 2024-09-13T05:12:35.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8550000000000008e-06 2024-09-13T05:12:35.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014386+0000", 2024-09-13T05:12:35.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0140000000000001e-06 2024-09-13T05:12:35.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014533+0000", 2024-09-13T05:12:35.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000147458 2024-09-13T05:12:35.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:35.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014545+0000", 2024-09-13T05:12:35.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1318000000000001e-05 2024-09-13T05:12:35.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931378+0000", 2024-09-13T05:12:35.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91683292400000005 2024-09-13T05:12:35.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931495+0000", 2024-09-13T05:12:35.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011726399999999999 2024-09-13T05:12:35.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931543+0000", 2024-09-13T05:12:35.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8183000000000003e-05 2024-09-13T05:12:35.387 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.387 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.387 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.388 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160206 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 83968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:35.388 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:35.388 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.313846013999999, 2024-09-13T05:12:35.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89412730799999995, 2024-09-13T05:12:35.388 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.388 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.388 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.388 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.388 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.388 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160206 2024-09-13T05:12:35.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.388 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:35.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:35.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037768+0000", 2024-09-13T05:12:35.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:35.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037774+0000", 2024-09-13T05:12:35.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3600000000000001e-06 2024-09-13T05:12:35.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037786+0000", 2024-09-13T05:12:35.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.188e-05 2024-09-13T05:12:35.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.391 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.391 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037793+0000", 2024-09-13T05:12:35.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2749999999999998e-06 2024-09-13T05:12:35.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.391 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.391 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:35.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0353000000000003e-05 2024-09-13T05:12:35.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.392 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:35.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037862+0000", 2024-09-13T05:12:35.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9710000000000004e-06 2024-09-13T05:12:35.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.392 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.392 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931610+0000", 2024-09-13T05:12:35.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89374846299999999 2024-09-13T05:12:35.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.392 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.392 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931815+0000", 2024-09-13T05:12:35.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020516499999999999 2024-09-13T05:12:35.393 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.393 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.393 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.393 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931896+0000", 2024-09-13T05:12:35.393 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1157999999999998e-05 2024-09-13T05:12:35.393 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.393 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.393 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.393 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.393 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.393 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160208 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 84992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:35.393 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:35.393 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.313761275000001, 2024-09-13T05:12:35.393 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440702299999997, 2024-09-13T05:12:35.393 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.394 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.394 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.394 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.394 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.394 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160208 2024-09-13T05:12:35.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.394 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.394 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:35.394 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:35.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037853+0000", 2024-09-13T05:12:35.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:35.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037858+0000", 2024-09-13T05:12:35.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2179999999999998e-06 2024-09-13T05:12:35.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037867+0000", 2024-09-13T05:12:35.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5699999999999993e-06 2024-09-13T05:12:35.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037874+0000", 2024-09-13T05:12:35.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2810000000000003e-06 2024-09-13T05:12:35.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037935+0000", 2024-09-13T05:12:35.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1231999999999999e-05 2024-09-13T05:12:35.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.397 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:35.397 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037944+0000", 2024-09-13T05:12:35.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8580000000000006e-06 2024-09-13T05:12:35.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.397 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.397 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931956+0000", 2024-09-13T05:12:35.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89401158800000002 2024-09-13T05:12:35.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.397 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.397 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932015+0000", 2024-09-13T05:12:35.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8906999999999997e-05 2024-09-13T05:12:35.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.398 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.398 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.398 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932261+0000", 2024-09-13T05:12:35.398 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024622799999999997 2024-09-13T05:12:35.398 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.398 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.398 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.398 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.398 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.398 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160210 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 86016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:35.398 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:35.398 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.313692420999999, 2024-09-13T05:12:35.398 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89428998299999996, 2024-09-13T05:12:35.398 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.399 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.399 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.399 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.399 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.399 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160210 2024-09-13T05:12:35.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.399 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:35.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:35.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.400 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037922+0000", 2024-09-13T05:12:35.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:35.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.400 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037926+0000", 2024-09-13T05:12:35.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6550000000000003e-06 2024-09-13T05:12:35.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037933+0000", 2024-09-13T05:12:35.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5409999999999997e-06 2024-09-13T05:12:35.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037939+0000", 2024-09-13T05:12:35.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1940000000000003e-06 2024-09-13T05:12:35.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037976+0000", 2024-09-13T05:12:35.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6671000000000002e-05 2024-09-13T05:12:35.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.402 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:35.402 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037982+0000", 2024-09-13T05:12:35.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9669999999999998e-06 2024-09-13T05:12:35.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.402 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.402 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932096+0000", 2024-09-13T05:12:35.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89411465599999995 2024-09-13T05:12:35.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.402 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.402 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932149+0000", 2024-09-13T05:12:35.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3032999999999999e-05 2024-09-13T05:12:35.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.403 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.403 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932213+0000", 2024-09-13T05:12:35.403 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3165999999999998e-05 2024-09-13T05:12:35.403 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.403 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.403 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.403 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160212 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 87040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:35.403 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:35.403 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.313605299999999, 2024-09-13T05:12:35.403 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440379699999994, 2024-09-13T05:12:35.404 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.404 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.404 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.404 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.404 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.404 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160212 2024-09-13T05:12:35.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.404 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.404 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.404 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:35.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.405 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:35.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.405 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038009+0000", 2024-09-13T05:12:35.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.405 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038013+0000", 2024-09-13T05:12:35.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3950000000000003e-06 2024-09-13T05:12:35.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038032+0000", 2024-09-13T05:12:35.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8513999999999999e-05 2024-09-13T05:12:35.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038039+0000", 2024-09-13T05:12:35.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.985e-06 2024-09-13T05:12:35.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038086+0000", 2024-09-13T05:12:35.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7302999999999998e-05 2024-09-13T05:12:35.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.407 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.407 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:35.407 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038090+0000", 2024-09-13T05:12:35.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9029999999999997e-06 2024-09-13T05:12:35.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.407 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.407 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.407 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932291+0000", 2024-09-13T05:12:35.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89420100199999997 2024-09-13T05:12:35.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.407 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.407 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.408 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932352+0000", 2024-09-13T05:12:35.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1354999999999998e-05 2024-09-13T05:12:35.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.408 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.408 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.408 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932414+0000", 2024-09-13T05:12:35.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1037999999999994e-05 2024-09-13T05:12:35.408 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.408 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.408 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.408 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.408 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160214 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 88064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:35.409 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:35.409 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.313474234000001, 2024-09-13T05:12:35.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89438890900000001, 2024-09-13T05:12:35.409 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.409 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.409 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.409 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.409 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.409 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160214 2024-09-13T05:12:35.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.409 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.409 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.410 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:35.410 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.410 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.410 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:35.410 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038140+0000", 2024-09-13T05:12:35.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:35.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038145+0000", 2024-09-13T05:12:35.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9749999999999998e-06 2024-09-13T05:12:35.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038153+0000", 2024-09-13T05:12:35.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1280000000000008e-06 2024-09-13T05:12:35.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.412 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038161+0000", 2024-09-13T05:12:35.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0339999999999997e-06 2024-09-13T05:12:35.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.412 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038199+0000", 2024-09-13T05:12:35.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8269999999999998e-05 2024-09-13T05:12:35.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:35.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038204+0000", 2024-09-13T05:12:35.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5399999999999997e-06 2024-09-13T05:12:35.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932438+0000", 2024-09-13T05:12:35.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89423397999999998 2024-09-13T05:12:35.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932480+0000", 2024-09-13T05:12:35.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2392999999999999e-05 2024-09-13T05:12:35.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932530+0000", 2024-09-13T05:12:35.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:12:35.414 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.414 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.414 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.414 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160305 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 215040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:35.414 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:35.414 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.309271012, 2024-09-13T05:12:35.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89028175300000001, 2024-09-13T05:12:35.414 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.415 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.415 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.415 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.415 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.415 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160305 2024-09-13T05:12:35.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.415 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.415 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.415 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:35.415 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.415 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.416 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:35.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.416 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.416 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042343+0000", 2024-09-13T05:12:35.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:35.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.416 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.416 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042350+0000", 2024-09-13T05:12:35.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3769999999999998e-06 2024-09-13T05:12:35.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.417 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042367+0000", 2024-09-13T05:12:35.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.734e-05 2024-09-13T05:12:35.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.417 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042375+0000", 2024-09-13T05:12:35.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8469999999999996e-06 2024-09-13T05:12:35.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.417 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042428+0000", 2024-09-13T05:12:35.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3074e-05 2024-09-13T05:12:35.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:35.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042437+0000", 2024-09-13T05:12:35.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:12:35.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932550+0000", 2024-09-13T05:12:35.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89011304300000005 2024-09-13T05:12:35.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932589+0000", 2024-09-13T05:12:35.419 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9236000000000002e-05 2024-09-13T05:12:35.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.419 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.419 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932626+0000", 2024-09-13T05:12:35.419 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6832999999999998e-05 2024-09-13T05:12:35.419 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.419 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.419 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.419 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160307 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 216064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:35.419 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:35.419 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.309224573000002, 2024-09-13T05:12:35.420 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89032630800000001, 2024-09-13T05:12:35.420 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.420 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.420 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.420 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.420 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.420 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160307 2024-09-13T05:12:35.420 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.420 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.420 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.420 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.420 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:35.420 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.421 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.421 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.421 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:35.421 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.421 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.421 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.421 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:35.421 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.421 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.421 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.421 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042394+0000", 2024-09-13T05:12:35.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7900000000000001e-06 2024-09-13T05:12:35.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.422 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.422 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042401+0000", 2024-09-13T05:12:35.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.267e-06 2024-09-13T05:12:35.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.422 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.422 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042406+0000", 2024-09-13T05:12:35.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0860000000000001e-06 2024-09-13T05:12:35.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.422 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042465+0000", 2024-09-13T05:12:35.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9441000000000002e-05 2024-09-13T05:12:35.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:35.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042471+0000", 2024-09-13T05:12:35.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6640000000000003e-06 2024-09-13T05:12:35.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932645+0000", 2024-09-13T05:12:35.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89017372900000002 2024-09-13T05:12:35.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.424 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.424 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932681+0000", 2024-09-13T05:12:35.424 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5918999999999999e-05 2024-09-13T05:12:35.424 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.424 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.424 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.424 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932717+0000", 2024-09-13T05:12:35.424 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6007999999999998e-05 2024-09-13T05:12:35.424 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.424 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.424 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.424 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.424 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.424 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160309 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 217088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:35.425 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:35.425 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.309174314, 2024-09-13T05:12:35.425 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89037315900000003, 2024-09-13T05:12:35.425 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.425 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.425 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.425 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.425 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.425 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160309 2024-09-13T05:12:35.425 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.425 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.425 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.425 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.425 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:35.425 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.426 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:35.426 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.426 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042440+0000", 2024-09-13T05:12:35.426 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.426 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042444+0000", 2024-09-13T05:12:35.427 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.104e-06 2024-09-13T05:12:35.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.427 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042451+0000", 2024-09-13T05:12:35.427 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.922e-06 2024-09-13T05:12:35.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.427 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042457+0000", 2024-09-13T05:12:35.427 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3979999999999998e-06 2024-09-13T05:12:35.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.428 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042497+0000", 2024-09-13T05:12:35.428 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0692999999999998e-05 2024-09-13T05:12:35.428 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.428 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.428 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:35.428 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042503+0000", 2024-09-13T05:12:35.428 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.553e-06 2024-09-13T05:12:35.428 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.428 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.428 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.428 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932735+0000", 2024-09-13T05:12:35.428 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89023238699999996 2024-09-13T05:12:35.428 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.428 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.429 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.429 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932771+0000", 2024-09-13T05:12:35.429 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5972000000000001e-05 2024-09-13T05:12:35.429 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.429 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.429 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.429 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932814+0000", 2024-09-13T05:12:35.429 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2657000000000002e-05 2024-09-13T05:12:35.429 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.429 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.429 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.430 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.430 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.430 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160311 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 218112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:35.430 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:35.430 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.309148824000001, 2024-09-13T05:12:35.430 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89045284400000002, 2024-09-13T05:12:35.430 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.430 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.430 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.430 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.430 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.430 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160311 2024-09-13T05:12:35.430 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.430 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.431 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.431 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.431 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:35.431 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.431 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.431 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.431 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.431 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:35.431 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.431 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.431 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.431 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.431 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:35.432 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.432 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.432 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.432 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.432 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042469+0000", 2024-09-13T05:12:35.432 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.456e-06 2024-09-13T05:12:35.432 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.432 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.432 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.432 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042475+0000", 2024-09-13T05:12:35.432 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0990000000000004e-06 2024-09-13T05:12:35.432 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.432 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.432 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.433 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042481+0000", 2024-09-13T05:12:35.433 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.237e-06 2024-09-13T05:12:35.433 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.433 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.433 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.433 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042527+0000", 2024-09-13T05:12:35.433 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6796999999999999e-05 2024-09-13T05:12:35.433 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.433 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.433 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:35.433 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042533+0000", 2024-09-13T05:12:35.433 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6489999999999996e-06 2024-09-13T05:12:35.433 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.434 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.434 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.434 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932832+0000", 2024-09-13T05:12:35.434 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89029919800000001 2024-09-13T05:12:35.434 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.434 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.434 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.434 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932867+0000", 2024-09-13T05:12:35.434 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5049000000000003e-05 2024-09-13T05:12:35.434 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.434 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.434 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.434 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932919+0000", 2024-09-13T05:12:35.434 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1780999999999998e-05 2024-09-13T05:12:35.434 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.435 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.435 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.435 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.435 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.435 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160313 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 219136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:35.435 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:35.435 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.309119732999999, 2024-09-13T05:12:35.435 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89064232600000004, 2024-09-13T05:12:35.435 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.435 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.435 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.435 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.435 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.436 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160313 2024-09-13T05:12:35.436 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.436 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.436 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.436 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.436 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:35.436 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.436 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.436 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.436 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.436 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:35.436 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.437 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.437 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.437 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.437 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:35.437 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.437 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.437 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.437 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.437 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042498+0000", 2024-09-13T05:12:35.437 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.281e-06 2024-09-13T05:12:35.437 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.437 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.437 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.437 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042505+0000", 2024-09-13T05:12:35.438 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2699999999999999e-06 2024-09-13T05:12:35.438 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.438 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.438 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.438 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042512+0000", 2024-09-13T05:12:35.438 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0330000000000003e-06 2024-09-13T05:12:35.438 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.438 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.438 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.438 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042557+0000", 2024-09-13T05:12:35.438 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4425999999999998e-05 2024-09-13T05:12:35.438 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.438 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.438 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:35.439 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042562+0000", 2024-09-13T05:12:35.439 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3639999999999998e-06 2024-09-13T05:12:35.439 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.439 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.439 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.439 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932987+0000", 2024-09-13T05:12:35.439 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89042472299999997 2024-09-13T05:12:35.439 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.439 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.439 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.439 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933062+0000", 2024-09-13T05:12:35.439 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5129999999999994e-05 2024-09-13T05:12:35.439 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.439 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.440 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.440 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933138+0000", 2024-09-13T05:12:35.440 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5536000000000003e-05 2024-09-13T05:12:35.440 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.440 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.440 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.440 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.440 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.440 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160315 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 220160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:35.440 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:35.440 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.309088566, 2024-09-13T05:12:35.440 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89071820800000001, 2024-09-13T05:12:35.440 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.440 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.441 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.441 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.441 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.441 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160315 2024-09-13T05:12:35.441 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.441 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.441 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.441 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.441 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:35.441 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.441 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.441 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.441 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.442 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:35.442 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.442 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.442 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.442 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.442 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:35.442 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.442 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.442 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.442 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.442 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042529+0000", 2024-09-13T05:12:35.442 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3639999999999999e-06 2024-09-13T05:12:35.442 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.442 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.443 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.443 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042536+0000", 2024-09-13T05:12:35.443 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.866e-06 2024-09-13T05:12:35.443 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.443 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.443 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.443 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042541+0000", 2024-09-13T05:12:35.443 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:12:35.443 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.443 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.443 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.443 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042587+0000", 2024-09-13T05:12:35.443 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5735000000000002e-05 2024-09-13T05:12:35.443 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.444 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:35.444 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042593+0000", 2024-09-13T05:12:35.444 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0719999999999996e-06 2024-09-13T05:12:35.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.444 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.444 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933160+0000", 2024-09-13T05:12:35.444 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89056621000000002 2024-09-13T05:12:35.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.444 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.444 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933202+0000", 2024-09-13T05:12:35.445 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2376000000000002e-05 2024-09-13T05:12:35.445 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.445 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.445 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.445 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933245+0000", 2024-09-13T05:12:35.445 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2787999999999998e-05 2024-09-13T05:12:35.445 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.445 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.445 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.445 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.445 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.446 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160317 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:35.446 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:35.446 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.309059736999998, 2024-09-13T05:12:35.446 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89082205800000003, 2024-09-13T05:12:35.446 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.446 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.446 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.446 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.446 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.446 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160317 2024-09-13T05:12:35.446 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.446 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.446 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.447 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.447 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:35.447 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.447 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.447 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.447 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.447 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:35.447 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.447 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.447 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.447 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.447 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:35.447 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.448 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.448 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.448 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.448 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042558+0000", 2024-09-13T05:12:35.448 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1810000000000001e-06 2024-09-13T05:12:35.448 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.448 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.448 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.448 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042565+0000", 2024-09-13T05:12:35.448 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9280000000000004e-06 2024-09-13T05:12:35.449 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.449 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.449 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.449 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042571+0000", 2024-09-13T05:12:35.449 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7420000000000003e-06 2024-09-13T05:12:35.449 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.449 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.449 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.449 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042616+0000", 2024-09-13T05:12:35.449 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5201999999999999e-05 2024-09-13T05:12:35.449 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.449 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.449 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:35.449 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042622+0000", 2024-09-13T05:12:35.450 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8289999999999996e-06 2024-09-13T05:12:35.450 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.450 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.450 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.450 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933259+0000", 2024-09-13T05:12:35.450 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89063730799999996 2024-09-13T05:12:35.450 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.450 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.450 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.450 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933311+0000", 2024-09-13T05:12:35.450 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1910000000000003e-05 2024-09-13T05:12:35.451 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.451 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.451 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.451 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933377+0000", 2024-09-13T05:12:35.451 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6396999999999995e-05 2024-09-13T05:12:35.451 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.451 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.451 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.451 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.451 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.451 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160319 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 222208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:35.452 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:35.452 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.309029520999999, 2024-09-13T05:12:35.452 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89087477400000004, 2024-09-13T05:12:35.452 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.452 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.452 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.452 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.452 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.452 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160319 2024-09-13T05:12:35.452 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.452 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.452 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.452 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.452 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:35.453 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.453 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.453 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.453 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.453 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:35.453 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.453 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.453 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.453 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.453 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042585+0000", 2024-09-13T05:12:35.453 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.453 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.453 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.453 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.454 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042588+0000", 2024-09-13T05:12:35.454 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9450000000000002e-06 2024-09-13T05:12:35.454 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.454 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.454 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.454 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042594+0000", 2024-09-13T05:12:35.454 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0959999999999997e-06 2024-09-13T05:12:35.454 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.454 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.454 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.454 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042599+0000", 2024-09-13T05:12:35.454 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0069999999999997e-06 2024-09-13T05:12:35.454 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.454 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.455 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.455 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042642+0000", 2024-09-13T05:12:35.455 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2553999999999999e-05 2024-09-13T05:12:35.455 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.455 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.455 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:35.455 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042647+0000", 2024-09-13T05:12:35.455 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.31e-06 2024-09-13T05:12:35.455 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.455 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.455 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.455 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933387+0000", 2024-09-13T05:12:35.455 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89073982799999996 2024-09-13T05:12:35.455 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.455 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.456 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.456 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:12:35.456 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7101000000000003e-05 2024-09-13T05:12:35.456 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.456 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.456 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.456 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933460+0000", 2024-09-13T05:12:35.456 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6282999999999998e-05 2024-09-13T05:12:35.456 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.456 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.456 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.456 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.456 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.457 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160321 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 223232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:35.457 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:35.457 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.309000094000002, 2024-09-13T05:12:35.457 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89094616999999998, 2024-09-13T05:12:35.457 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.457 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.457 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.457 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.457 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.457 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160321 2024-09-13T05:12:35.457 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.457 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.457 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.457 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.457 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:35.458 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.458 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.458 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.458 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.458 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:35.458 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.458 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.458 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.458 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.458 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:35.458 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.458 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.458 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.458 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.459 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042617+0000", 2024-09-13T05:12:35.459 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8329999999999998e-06 2024-09-13T05:12:35.459 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.459 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.459 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.459 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042638+0000", 2024-09-13T05:12:35.459 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0908e-05 2024-09-13T05:12:35.459 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.459 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.459 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.459 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042644+0000", 2024-09-13T05:12:35.459 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0440000000000001e-06 2024-09-13T05:12:35.459 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.459 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.459 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.460 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042666+0000", 2024-09-13T05:12:35.460 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1256000000000001e-05 2024-09-13T05:12:35.460 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.460 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.460 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:35.460 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042671+0000", 2024-09-13T05:12:35.460 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6250000000000004e-06 2024-09-13T05:12:35.460 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.460 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.460 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.460 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933478+0000", 2024-09-13T05:12:35.460 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89080698800000002 2024-09-13T05:12:35.460 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.460 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.461 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.461 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933519+0000", 2024-09-13T05:12:35.461 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0717000000000003e-05 2024-09-13T05:12:35.461 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.461 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.461 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.461 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933561+0000", 2024-09-13T05:12:35.461 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2225999999999999e-05 2024-09-13T05:12:35.461 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.461 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.461 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.461 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.461 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.461 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:35.462 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:35.351+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:35.464 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:12:35.465 INFO:teuthology.orchestra.run.smithi120.stdout:5847 write 0xdd86010 thru 0xdd8dd96 (0x7d87 bytes) 2024-09-13T05:12:35.465 INFO:teuthology.orchestra.run.smithi120.stdout:5848 punch from 0x1e61eef to 0x1e71a4b, (0xfb5c bytes) 2024-09-13T05:12:35.465 INFO:teuthology.orchestra.run.smithi120.stdout:5849 write 0xdd410ba thru 0xdd4ba52 (0xa999 bytes) 2024-09-13T05:12:35.465 INFO:teuthology.orchestra.run.smithi120.stdout:5851 writesame 0x202453 thru 0x2120b8 data_size 0x79(0xfc66 bytes) 2024-09-13T05:12:35.465 INFO:teuthology.orchestra.run.smithi120.stdout:5852 read 0x6564e13 thru 0x656b2e1 (0x64cf bytes) 2024-09-13T05:12:35.465 INFO:teuthology.orchestra.run.smithi120.stdout:5853 write 0xa0c3273 thru 0xa0cbe1f (0x8bad bytes) 2024-09-13T05:12:35.465 INFO:teuthology.orchestra.run.smithi120.stdout:5854 writesame 0x23d73cb thru 0x23db520 data_size 0x1(0x4156 bytes) 2024-09-13T05:12:35.465 INFO:teuthology.orchestra.run.smithi120.stdout:5855 punch from 0xabc4fa6 to 0xabc7492, (0x24ec bytes) 2024-09-13T05:12:35.465 INFO:teuthology.orchestra.run.smithi120.stdout:5856 punch from 0xd6bd113 to 0xd6bf089, (0x1f76 bytes) 2024-09-13T05:12:35.466 INFO:teuthology.orchestra.run.smithi120.stdout:5857 writesame 0x349954a thru 0x34a418f data_size 0x1(0xac46 bytes) 2024-09-13T05:12:35.466 INFO:teuthology.orchestra.run.smithi120.stdout:5858 write 0x6e1ff6e thru 0x6e2814e (0x81e1 bytes) 2024-09-13T05:12:35.466 INFO:teuthology.orchestra.run.smithi120.stdout:5859 read 0x1b8116f thru 0x1b8a92d (0x97bf bytes) 2024-09-13T05:12:35.466 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:35.459+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:35.466 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:35.466 INFO:teuthology.orchestra.run.smithi120.stdout:5861 read 0xdd6afd thru 0xddc9db (0x5edf bytes) 2024-09-13T05:12:35.467 INFO:teuthology.orchestra.run.smithi120.stdout:5862 write 0x51d0387 thru 0x51d7661 (0x72db bytes) 2024-09-13T05:12:35.483 INFO:teuthology.orchestra.run.smithi120.stdout:5863 trunc from 0xdd8dd97 to 0x91545c6 2024-09-13T05:12:35.508 INFO:teuthology.orchestra.run.smithi120.stdout:5864 trunc from 0x91545c6 to 0xc48342e 2024-09-13T05:12:35.522 INFO:teuthology.orchestra.run.smithi120.stdout:5866 read 0xc14d4b3 thru 0xc15652b (0x9079 bytes) 2024-09-13T05:12:35.540 INFO:teuthology.orchestra.run.smithi120.stdout:5867 trunc from 0xc48342e to 0x24be483 2024-09-13T05:12:35.563 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:35.560+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:35.571 INFO:teuthology.orchestra.run.smithi120.stdout:5869 read 0x6cd486 thru 0x6d434f (0x6eca bytes) 2024-09-13T05:12:35.587 INFO:teuthology.orchestra.run.smithi120.stdout:5870 trunc from 0x24be483 to 0xa1a9407 2024-09-13T05:12:35.600 INFO:teuthology.orchestra.run.smithi120.stdout:5871 write 0x5d2602 thru 0x5d4ac6 (0x24c5 bytes) 2024-09-13T05:12:35.604 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:35.617 INFO:teuthology.orchestra.run.smithi120.stdout:5874 trunc from 0xa1a9407 to 0x2aa9058 2024-09-13T05:12:35.619 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:35.619 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:35.619 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:35.619 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:35.630 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:12:35.659 INFO:teuthology.orchestra.run.smithi120.stdout:5877 write 0xd0a23f4 thru 0xd0b0898 (0xe4a5 bytes) 2024-09-13T05:12:35.666 INFO:teuthology.orchestra.run.smithi120.stdout:5879 read 0x11115b2 thru 0x1120f30 (0xf97f bytes) 2024-09-13T05:12:35.671 INFO:teuthology.orchestra.run.smithi120.stdout:5881 read 0x385d54 thru 0x388783 (0x2a30 bytes) 2024-09-13T05:12:35.673 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:35.672+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:35.683 INFO:teuthology.orchestra.run.smithi120.stdout:5882 trunc from 0xd0b0899 to 0x8347fd3 2024-09-13T05:12:35.703 INFO:teuthology.orchestra.run.smithi120.stdout:5884 read 0x8a49bf thru 0x8a5b46 (0x1188 bytes) 2024-09-13T05:12:35.711 INFO:teuthology.orchestra.run.smithi120.stdout:5886 trunc from 0x8347fd3 to 0x9c3c392 2024-09-13T05:12:35.725 INFO:teuthology.orchestra.run.smithi120.stdout:5887 write 0x8dc1b1b thru 0x8dce5e8 (0xcace bytes) 2024-09-13T05:12:35.730 INFO:teuthology.orchestra.run.smithi120.stdout:5889 read 0x1dbe901 thru 0x1dcc060 (0xd760 bytes) 2024-09-13T05:12:35.731 INFO:teuthology.orchestra.run.smithi120.stdout:5891 write 0x7f8f38 thru 0x80517e (0xc247 bytes) 2024-09-13T05:12:35.735 INFO:teuthology.orchestra.run.smithi120.stdout:5893 read 0x52eaf43 thru 0x52ed57d (0x263b bytes) 2024-09-13T05:12:35.735 INFO:teuthology.orchestra.run.smithi120.stdout:5894 punch from 0x730e2b3 to 0x7317754, (0x94a1 bytes) 2024-09-13T05:12:35.735 INFO:teuthology.orchestra.run.smithi120.stdout:5895 read 0x105f538 thru 0x106dbfd (0xe6c6 bytes) 2024-09-13T05:12:35.735 INFO:teuthology.orchestra.run.smithi120.stdout:5896 writesame 0x2049044 thru 0x2057670 data_size 0x5(0xe62d bytes) 2024-09-13T05:12:35.742 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:35.742 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:35.742 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:35.743 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:35.743 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:35.752 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:12:35.762 INFO:teuthology.orchestra.run.smithi120.stdout:5897 trunc from 0x9c3c392 to 0x32d5788 2024-09-13T05:12:35.764 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:35.760+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:35.787 INFO:teuthology.orchestra.run.smithi120.stdout:5898 trunc from 0x32d5788 to 0x6935578 2024-09-13T05:12:35.797 INFO:teuthology.orchestra.run.smithi120.stdout:5899 read 0x34e468b thru 0x34e876d (0x40e3 bytes) 2024-09-13T05:12:35.820 INFO:teuthology.orchestra.run.smithi120.stdout:5901 write 0xbf5bb6c thru 0xbf67f40 (0xc3d5 bytes) 2024-09-13T05:12:35.833 INFO:teuthology.orchestra.run.smithi120.stdout:5902 trunc from 0xbf67f41 to 0x8ca8ad0 2024-09-13T05:12:35.846 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T05:12:35.866 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:35.864+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:35.869 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:35.869 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:35.869 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:35.869 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:35.869 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.869 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29021 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2865152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:35.869 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:12:35.869 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 118.824434853, 2024-09-13T05:12:35.869 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060927993999999999, 2024-09-13T05:12:35.869 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.869 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.869 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.870 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.870 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.870 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29021 2024-09-13T05:12:35.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.870 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.870 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.870 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.870 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:12:35.870 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.870 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.870 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.870 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:12:35.870 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.871 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.871 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.871 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.871 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041763+0000", 2024-09-13T05:12:35.871 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.871 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.871 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.871 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.871 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041766+0000", 2024-09-13T05:12:35.871 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6800000000000002e-06 2024-09-13T05:12:35.871 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.871 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.871 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.871 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041771+0000", 2024-09-13T05:12:35.872 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:12:35.872 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.872 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.872 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.872 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041776+0000", 2024-09-13T05:12:35.872 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8489999999999997e-06 2024-09-13T05:12:35.872 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.872 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.872 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.872 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102513+0000", 2024-09-13T05:12:35.872 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060737102000000001 2024-09-13T05:12:35.872 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.872 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.872 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.873 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102597+0000", 2024-09-13T05:12:35.873 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4374000000000002e-05 2024-09-13T05:12:35.873 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.873 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.873 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.873 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102692+0000", 2024-09-13T05:12:35.873 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4436000000000002e-05 2024-09-13T05:12:35.873 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.873 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.873 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.873 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.873 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.873 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29022 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2874368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:35.873 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:35.874 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 118.824418553, 2024-09-13T05:12:35.874 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061135083999999999, 2024-09-13T05:12:35.874 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.874 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.874 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.874 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.874 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.874 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29022 2024-09-13T05:12:35.874 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.874 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.874 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.874 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.874 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:35.874 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.875 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.875 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.875 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:35.875 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.875 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.875 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.875 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:35.875 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.875 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.875 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.875 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041782+0000", 2024-09-13T05:12:35.876 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4959999999999999e-06 2024-09-13T05:12:35.876 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.876 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.876 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.876 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041787+0000", 2024-09-13T05:12:35.876 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1240000000000004e-06 2024-09-13T05:12:35.876 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.876 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.876 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.876 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041792+0000", 2024-09-13T05:12:35.876 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9200000000000003e-06 2024-09-13T05:12:35.876 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.876 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.876 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.877 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102738+0000", 2024-09-13T05:12:35.877 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060945581999999998 2024-09-13T05:12:35.877 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.877 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.877 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.877 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102821+0000", 2024-09-13T05:12:35.877 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2898999999999994e-05 2024-09-13T05:12:35.877 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.877 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.877 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.877 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102915+0000", 2024-09-13T05:12:35.877 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4523000000000003e-05 2024-09-13T05:12:35.877 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.877 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.878 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.878 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.878 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29067 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2764800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:35.878 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:35.878 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 118.820644336, 2024-09-13T05:12:35.878 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060816621000000001, 2024-09-13T05:12:35.878 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.878 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.878 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.878 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.878 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.878 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29067 2024-09-13T05:12:35.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.879 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.879 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:35.879 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.879 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:35.879 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.880 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:35.880 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.880 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.880 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.880 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.880 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045557+0000", 2024-09-13T05:12:35.880 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.898e-06 2024-09-13T05:12:35.880 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.880 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.880 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.880 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045575+0000", 2024-09-13T05:12:35.880 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8252000000000001e-05 2024-09-13T05:12:35.880 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.880 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.881 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.881 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045581+0000", 2024-09-13T05:12:35.881 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:12:35.881 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.881 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.881 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.881 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106183+0000", 2024-09-13T05:12:35.881 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060602630999999997 2024-09-13T05:12:35.881 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.881 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.881 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.881 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106271+0000", 2024-09-13T05:12:35.881 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7329000000000004e-05 2024-09-13T05:12:35.881 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.882 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.882 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106371+0000", 2024-09-13T05:12:35.882 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000100164 2024-09-13T05:12:35.882 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.882 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.882 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.882 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29068 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2774016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:35.882 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:12:35.882 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 118.820613102, 2024-09-13T05:12:35.882 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060994509000000002, 2024-09-13T05:12:35.882 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.883 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.883 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.883 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.883 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.883 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29068 2024-09-13T05:12:35.883 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.883 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.883 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.883 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.883 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:12:35.883 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.883 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.883 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.883 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.884 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:12:35.884 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.884 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.884 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.884 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045585+0000", 2024-09-13T05:12:35.884 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.884 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.884 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.884 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045588+0000", 2024-09-13T05:12:35.884 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:12:35.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.884 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.885 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045594+0000", 2024-09-13T05:12:35.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9329999999999998e-06 2024-09-13T05:12:35.885 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.885 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045599+0000", 2024-09-13T05:12:35.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3190000000000002e-06 2024-09-13T05:12:35.885 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.885 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106399+0000", 2024-09-13T05:12:35.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060800361999999997 2024-09-13T05:12:35.885 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.886 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.886 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106489+0000", 2024-09-13T05:12:35.886 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9301000000000004e-05 2024-09-13T05:12:35.886 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.886 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.886 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.886 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106580+0000", 2024-09-13T05:12:35.886 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1314e-05 2024-09-13T05:12:35.886 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.886 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.886 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.886 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.886 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.886 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29069 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2792448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:35.887 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:12:35.887 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 118.820594685, 2024-09-13T05:12:35.887 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061207599000000001, 2024-09-13T05:12:35.887 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.887 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.887 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.887 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.887 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.887 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29069 2024-09-13T05:12:35.887 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.887 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.887 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.887 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.887 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:12:35.888 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.888 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.888 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.888 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.888 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:12:35.888 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.888 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.888 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.888 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.888 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045603+0000", 2024-09-13T05:12:35.888 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.888 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.888 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.888 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.889 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045606+0000", 2024-09-13T05:12:35.889 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7300000000000001e-06 2024-09-13T05:12:35.889 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.889 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.889 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.889 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045612+0000", 2024-09-13T05:12:35.889 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9599999999999997e-06 2024-09-13T05:12:35.889 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.889 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.889 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.889 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045619+0000", 2024-09-13T05:12:35.889 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6019999999999996e-06 2024-09-13T05:12:35.889 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.889 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.890 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.890 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106619+0000", 2024-09-13T05:12:35.890 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061000029999999997 2024-09-13T05:12:35.890 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.890 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.890 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.890 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106713+0000", 2024-09-13T05:12:35.890 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4505000000000004e-05 2024-09-13T05:12:35.890 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.890 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.890 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.890 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106812+0000", 2024-09-13T05:12:35.890 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8264000000000007e-05 2024-09-13T05:12:35.890 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.890 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.891 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.891 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.891 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.891 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29070 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2783232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:35.891 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:35.891 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 118.82057422600001, 2024-09-13T05:12:35.891 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061389805999999998, 2024-09-13T05:12:35.891 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.891 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.891 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.891 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.891 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.891 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29070 2024-09-13T05:12:35.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.892 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.892 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.892 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:35.892 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.892 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.892 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:35.892 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.892 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.893 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:35.893 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.893 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.893 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.893 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.893 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045627+0000", 2024-09-13T05:12:35.893 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6579999999999998e-06 2024-09-13T05:12:35.893 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.893 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.893 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.893 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045632+0000", 2024-09-13T05:12:35.893 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8449999999999999e-06 2024-09-13T05:12:35.893 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.893 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.893 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.894 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045639+0000", 2024-09-13T05:12:35.894 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:12:35.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.894 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.894 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.894 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106837+0000", 2024-09-13T05:12:35.894 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061198529000000002 2024-09-13T05:12:35.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.894 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.894 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.895 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106922+0000", 2024-09-13T05:12:35.895 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4771999999999994e-05 2024-09-13T05:12:35.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.895 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.895 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107014+0000", 2024-09-13T05:12:35.895 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2009000000000006e-05 2024-09-13T05:12:35.895 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.895 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.895 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.895 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29071 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2801664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:35.895 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:12:35.896 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 118.82055515, 2024-09-13T05:12:35.896 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061582804999999997, 2024-09-13T05:12:35.896 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.896 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.896 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.896 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.896 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.896 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29071 2024-09-13T05:12:35.896 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.896 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.896 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.896 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.896 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:12:35.896 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.897 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.897 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.897 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.897 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:12:35.897 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.897 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.897 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.897 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.897 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045643+0000", 2024-09-13T05:12:35.897 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.897 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.897 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.897 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.898 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045646+0000", 2024-09-13T05:12:35.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:12:35.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.898 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.898 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045664+0000", 2024-09-13T05:12:35.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8408000000000001e-05 2024-09-13T05:12:35.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.898 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.898 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045670+0000", 2024-09-13T05:12:35.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7710000000000003e-06 2024-09-13T05:12:35.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.899 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.899 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107048+0000", 2024-09-13T05:12:35.899 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061378438 2024-09-13T05:12:35.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.899 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.899 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.899 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107134+0000", 2024-09-13T05:12:35.899 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5574000000000004e-05 2024-09-13T05:12:35.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.899 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.899 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.899 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107226+0000", 2024-09-13T05:12:35.899 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2262000000000005e-05 2024-09-13T05:12:35.899 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.899 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.900 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.900 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.900 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.900 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29072 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2810880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:35.900 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:12:35.900 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 118.82052376599999, 2024-09-13T05:12:35.900 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061762233999999999, 2024-09-13T05:12:35.900 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.900 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.900 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.900 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.900 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.900 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29072 2024-09-13T05:12:35.900 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.901 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:12:35.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:12:35.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045674+0000", 2024-09-13T05:12:35.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.902 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045677+0000", 2024-09-13T05:12:35.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9679999999999998e-06 2024-09-13T05:12:35.902 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045694+0000", 2024-09-13T05:12:35.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6801999999999999e-05 2024-09-13T05:12:35.902 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.903 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.903 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045700+0000", 2024-09-13T05:12:35.903 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8270000000000003e-06 2024-09-13T05:12:35.903 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.903 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.903 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.903 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107249+0000", 2024-09-13T05:12:35.903 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061549114000000002 2024-09-13T05:12:35.903 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.903 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.903 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.903 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107341+0000", 2024-09-13T05:12:35.903 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2390000000000001e-05 2024-09-13T05:12:35.903 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.904 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.904 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.904 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107437+0000", 2024-09-13T05:12:35.904 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5648000000000003e-05 2024-09-13T05:12:35.904 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.904 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.904 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.904 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.904 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.904 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29073 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2820096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:35.904 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:12:35.904 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 118.820481788, 2024-09-13T05:12:35.904 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061873910999999997, 2024-09-13T05:12:35.904 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.905 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.905 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.905 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.905 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.905 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29073 2024-09-13T05:12:35.905 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.905 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.905 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.905 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.905 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:12:35.905 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.905 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.905 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.906 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.906 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:12:35.906 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.906 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.906 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.906 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.906 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045716+0000", 2024-09-13T05:12:35.906 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.906 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.906 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.906 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.906 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045726+0000", 2024-09-13T05:12:35.906 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6350000000000001e-06 2024-09-13T05:12:35.906 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.906 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.907 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.907 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045739+0000", 2024-09-13T05:12:35.907 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3325e-05 2024-09-13T05:12:35.907 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.907 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.907 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.907 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045746+0000", 2024-09-13T05:12:35.907 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7399999999999998e-06 2024-09-13T05:12:35.907 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.907 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.907 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.907 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107457+0000", 2024-09-13T05:12:35.907 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061711038000000003 2024-09-13T05:12:35.908 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.908 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.908 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.908 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107522+0000", 2024-09-13T05:12:35.908 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4850000000000004e-05 2024-09-13T05:12:35.908 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.908 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.908 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.908 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107591+0000", 2024-09-13T05:12:35.908 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9029999999999995e-05 2024-09-13T05:12:35.908 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.908 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.908 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.909 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.909 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.909 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29074 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2829312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:35.909 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:12:35.909 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 118.82044788, 2024-09-13T05:12:35.909 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062055459, 2024-09-13T05:12:35.909 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.909 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.909 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.909 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.909 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.909 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29074 2024-09-13T05:12:35.909 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.909 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.909 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.910 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.910 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:12:35.910 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.910 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.910 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.910 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.910 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:12:35.910 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.910 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.910 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.910 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.910 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045750+0000", 2024-09-13T05:12:35.910 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.910 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.911 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.911 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045753+0000", 2024-09-13T05:12:35.911 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8399999999999999e-06 2024-09-13T05:12:35.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.911 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.911 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045759+0000", 2024-09-13T05:12:35.911 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8900000000000004e-06 2024-09-13T05:12:35.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.911 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.911 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045764+0000", 2024-09-13T05:12:35.912 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3850000000000001e-06 2024-09-13T05:12:35.912 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.912 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.912 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.912 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107623+0000", 2024-09-13T05:12:35.912 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061858817000000003 2024-09-13T05:12:35.912 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.912 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.912 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.913 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107710+0000", 2024-09-13T05:12:35.913 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7127999999999997e-05 2024-09-13T05:12:35.913 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.913 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.913 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.913 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107806+0000", 2024-09-13T05:12:35.913 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5886999999999999e-05 2024-09-13T05:12:35.913 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.913 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.913 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.913 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.913 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.913 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29075 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2838528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:35.914 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:35.914 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 118.820429426, 2024-09-13T05:12:35.914 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062188516999999999, 2024-09-13T05:12:35.914 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.914 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.914 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.914 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.914 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.914 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29075 2024-09-13T05:12:35.914 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.914 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.914 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.914 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.914 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:35.915 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.915 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.915 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.915 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.915 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:35.915 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.915 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.915 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.915 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.915 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:35.915 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.915 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.915 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.915 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.916 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045772+0000", 2024-09-13T05:12:35.916 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:12:35.916 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.916 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.916 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.916 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045778+0000", 2024-09-13T05:12:35.916 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9229999999999996e-06 2024-09-13T05:12:35.916 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.916 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.916 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.916 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045784+0000", 2024-09-13T05:12:35.916 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3800000000000002e-06 2024-09-13T05:12:35.916 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.917 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.917 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.917 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107823+0000", 2024-09-13T05:12:35.917 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062039331000000003 2024-09-13T05:12:35.917 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.917 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.917 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.917 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107886+0000", 2024-09-13T05:12:35.917 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2476000000000003e-05 2024-09-13T05:12:35.917 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.917 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.917 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.917 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107958+0000", 2024-09-13T05:12:35.917 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2089999999999996e-05 2024-09-13T05:12:35.918 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.918 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.918 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.918 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.918 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.918 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29115 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2682880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:35.918 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:12:35.918 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 118.816963899, 2024-09-13T05:12:35.918 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060847898999999997, 2024-09-13T05:12:35.918 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.918 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.918 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.918 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.918 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.919 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29115 2024-09-13T05:12:35.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.919 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.919 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.919 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.919 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:12:35.919 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.919 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.919 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.919 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:12:35.919 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.919 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.920 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.920 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049234+0000", 2024-09-13T05:12:35.920 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.920 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.920 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.920 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.920 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049237+0000", 2024-09-13T05:12:35.920 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9069999999999999e-06 2024-09-13T05:12:35.920 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.920 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.920 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.920 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049243+0000", 2024-09-13T05:12:35.920 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7459999999999997e-06 2024-09-13T05:12:35.920 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.921 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.921 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.921 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049248+0000", 2024-09-13T05:12:35.921 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1490000000000002e-06 2024-09-13T05:12:35.921 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.921 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.921 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.921 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.109945+0000", 2024-09-13T05:12:35.921 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060697299000000003 2024-09-13T05:12:35.921 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.921 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.921 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.921 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110013+0000", 2024-09-13T05:12:35.921 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8023999999999998e-05 2024-09-13T05:12:35.922 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.922 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.922 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.922 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110083+0000", 2024-09-13T05:12:35.922 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9296999999999997e-05 2024-09-13T05:12:35.922 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.922 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.922 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.922 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.922 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.922 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29116 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2692096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:35.922 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:12:35.922 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 118.816946055, 2024-09-13T05:12:35.922 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061040167999999999, 2024-09-13T05:12:35.923 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.923 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.923 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.923 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.923 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.923 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29116 2024-09-13T05:12:35.923 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.923 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.923 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.923 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.923 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:12:35.923 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.923 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.923 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.923 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.924 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:12:35.924 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.924 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.924 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.924 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.924 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049252+0000", 2024-09-13T05:12:35.924 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.924 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.924 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.924 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.924 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049255+0000", 2024-09-13T05:12:35.924 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7250000000000002e-06 2024-09-13T05:12:35.924 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.924 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.925 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.925 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049261+0000", 2024-09-13T05:12:35.925 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.755e-06 2024-09-13T05:12:35.925 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.925 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.925 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.925 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049266+0000", 2024-09-13T05:12:35.925 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2100000000000001e-06 2024-09-13T05:12:35.925 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.925 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.925 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.925 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110115+0000", 2024-09-13T05:12:35.925 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060849225999999999 2024-09-13T05:12:35.926 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.926 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.926 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.926 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110199+0000", 2024-09-13T05:12:35.926 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4339999999999995e-05 2024-09-13T05:12:35.926 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.926 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.926 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.926 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110293+0000", 2024-09-13T05:12:35.926 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3397e-05 2024-09-13T05:12:35.926 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.926 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.926 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.927 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.927 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.927 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29117 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2701312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:35.927 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:35.927 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 118.816928418, 2024-09-13T05:12:35.927 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.06118527, 2024-09-13T05:12:35.927 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.927 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.927 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.927 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.927 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.927 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29117 2024-09-13T05:12:35.927 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.927 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.928 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.928 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.928 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:35.928 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.928 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.928 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.928 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.928 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:35.928 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.928 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.928 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.928 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.928 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:35.929 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.929 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.929 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.929 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049273+0000", 2024-09-13T05:12:35.929 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.757e-06 2024-09-13T05:12:35.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.929 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.929 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.929 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049278+0000", 2024-09-13T05:12:35.929 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7830000000000004e-06 2024-09-13T05:12:35.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.929 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.929 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.930 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049284+0000", 2024-09-13T05:12:35.930 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3820000000000003e-06 2024-09-13T05:12:35.930 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.930 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.930 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.930 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110313+0000", 2024-09-13T05:12:35.930 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061029682000000002 2024-09-13T05:12:35.930 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.930 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.930 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.930 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110383+0000", 2024-09-13T05:12:35.930 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9406000000000006e-05 2024-09-13T05:12:35.930 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.931 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.931 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.931 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110456+0000", 2024-09-13T05:12:35.931 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2750000000000007e-05 2024-09-13T05:12:35.931 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.931 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.931 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.931 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.931 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.931 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29118 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2710528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:35.931 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:35.931 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 118.816910503, 2024-09-13T05:12:35.931 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061380698999999997, 2024-09-13T05:12:35.931 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.932 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.932 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.932 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.932 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.932 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29118 2024-09-13T05:12:35.932 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.932 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.932 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.932 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.932 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:35.932 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.932 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.932 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.932 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.933 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:35.933 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.933 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.933 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.933 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:35.933 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.933 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.933 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.933 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049291+0000", 2024-09-13T05:12:35.933 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8770000000000002e-06 2024-09-13T05:12:35.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.933 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.933 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049296+0000", 2024-09-13T05:12:35.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6799999999999998e-06 2024-09-13T05:12:35.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.934 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.934 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049302+0000", 2024-09-13T05:12:35.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2769999999999996e-06 2024-09-13T05:12:35.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.934 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.934 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110488+0000", 2024-09-13T05:12:35.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061186184999999997 2024-09-13T05:12:35.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.935 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.935 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.935 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110577+0000", 2024-09-13T05:12:35.935 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9246000000000006e-05 2024-09-13T05:12:35.935 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.935 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.935 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.935 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110669+0000", 2024-09-13T05:12:35.935 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1923999999999996e-05 2024-09-13T05:12:35.935 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.935 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.935 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.935 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.935 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.935 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29119 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2719744~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:35.936 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:12:35.936 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 118.816892759, 2024-09-13T05:12:35.936 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061521165000000003, 2024-09-13T05:12:35.936 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.936 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.936 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.936 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.936 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.936 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29119 2024-09-13T05:12:35.936 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.936 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.936 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.936 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.936 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:12:35.937 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.937 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.937 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.937 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.937 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:12:35.937 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.937 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.937 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.937 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.937 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049305+0000", 2024-09-13T05:12:35.937 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.937 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.937 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.938 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.938 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049308+0000", 2024-09-13T05:12:35.938 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7070000000000001e-06 2024-09-13T05:12:35.938 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.938 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.938 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.938 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049316+0000", 2024-09-13T05:12:35.938 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:12:35.938 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.938 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.938 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.938 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049322+0000", 2024-09-13T05:12:35.938 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3199999999999999e-06 2024-09-13T05:12:35.938 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.938 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.939 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.939 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110690+0000", 2024-09-13T05:12:35.939 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061368428000000003 2024-09-13T05:12:35.939 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.939 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.939 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.939 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110755+0000", 2024-09-13T05:12:35.939 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4893000000000004e-05 2024-09-13T05:12:35.939 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.939 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.939 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.939 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110827+0000", 2024-09-13T05:12:35.939 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2039000000000006e-05 2024-09-13T05:12:35.939 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.940 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.940 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.940 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.940 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.940 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29120 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2728960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:35.940 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:35.940 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 118.816872489, 2024-09-13T05:12:35.940 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061718420000000003, 2024-09-13T05:12:35.940 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.940 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.940 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.940 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.940 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.940 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29120 2024-09-13T05:12:35.941 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.941 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.941 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.941 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.941 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:35.941 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.941 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.941 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.941 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.941 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:35.941 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.941 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.941 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.942 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.942 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:35.942 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.942 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.942 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.942 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.942 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049329+0000", 2024-09-13T05:12:35.942 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.022e-06 2024-09-13T05:12:35.942 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.942 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.942 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.942 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049336+0000", 2024-09-13T05:12:35.942 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0720000000000002e-06 2024-09-13T05:12:35.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.943 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.943 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049341+0000", 2024-09-13T05:12:35.943 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:12:35.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.943 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.943 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110864+0000", 2024-09-13T05:12:35.943 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061523126999999997 2024-09-13T05:12:35.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.943 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.943 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110951+0000", 2024-09-13T05:12:35.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6557000000000005e-05 2024-09-13T05:12:35.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.944 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.111045+0000", 2024-09-13T05:12:35.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4043999999999996e-05 2024-09-13T05:12:35.944 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.944 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.944 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.944 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29136 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2876416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:35.944 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:12:35.944 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 118.812857064, 2024-09-13T05:12:35.945 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060742995000000001, 2024-09-13T05:12:35.945 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.945 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.945 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.945 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.949 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.949 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29136 2024-09-13T05:12:35.949 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.949 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.949 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.949 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.950 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:12:35.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.950 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.950 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:12:35.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.950 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.950 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053341+0000", 2024-09-13T05:12:35.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.951 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.951 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053344+0000", 2024-09-13T05:12:35.951 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:12:35.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.951 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.951 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.951 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053350+0000", 2024-09-13T05:12:35.951 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7200000000000003e-06 2024-09-13T05:12:35.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.951 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.951 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.951 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053355+0000", 2024-09-13T05:12:35.951 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0150000000000003e-06 2024-09-13T05:12:35.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.952 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.952 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113909+0000", 2024-09-13T05:12:35.952 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060554368999999997 2024-09-13T05:12:35.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.952 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.952 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113994+0000", 2024-09-13T05:12:35.952 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4658000000000002e-05 2024-09-13T05:12:35.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.952 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.952 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114085+0000", 2024-09-13T05:12:35.952 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0939000000000005e-05 2024-09-13T05:12:35.953 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.953 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.953 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.953 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29166 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2628608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:35.953 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:35.953 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 118.81283963, 2024-09-13T05:12:35.953 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060883127000000002, 2024-09-13T05:12:35.953 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.953 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:35.953 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.953 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.953 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.954 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29166 2024-09-13T05:12:35.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.954 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:35.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:35.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.955 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.955 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:35.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:35.955 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.955 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.955 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.955 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053361+0000", 2024-09-13T05:12:35.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:12:35.955 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.955 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.955 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.955 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053367+0000", 2024-09-13T05:12:35.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7350000000000001e-06 2024-09-13T05:12:35.956 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.956 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.956 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.956 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053372+0000", 2024-09-13T05:12:35.956 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7840000000000003e-06 2024-09-13T05:12:35.956 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.956 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.956 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.956 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114103+0000", 2024-09-13T05:12:35.956 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060730924999999998 2024-09-13T05:12:35.956 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.956 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.956 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.956 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114171+0000", 2024-09-13T05:12:35.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8021999999999993e-05 2024-09-13T05:12:35.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.957 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114242+0000", 2024-09-13T05:12:35.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1390999999999995e-05 2024-09-13T05:12:35.957 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.957 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.957 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.957 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:165308 3.3 3:c04a6a9a:::rbd_data.112dc3abcba6.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-13T05:12:35.957 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:12:35.957 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.734382344, 2024-09-13T05:12:35.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.085530595000000001, 2024-09-13T05:12:35.958 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:35.958 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:35.958 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:35.958 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:35.958 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:35.958 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 165308 2024-09-13T05:12:35.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.958 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:35.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:35.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:12:35.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:12:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131814+0000", 2024-09-13T05:12:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152479+0000", 2024-09-13T05:12:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020664281 2024-09-13T05:12:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152521+0000", 2024-09-13T05:12:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2567000000000001e-05 2024-09-13T05:12:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152536+0000", 2024-09-13T05:12:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4447000000000001e-05 2024-09-13T05:12:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152607+0000", 2024-09-13T05:12:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1687000000000007e-05 2024-09-13T05:12:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152753+0000", 2024-09-13T05:12:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000145861 2024-09-13T05:12:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:12:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.159991+0000", 2024-09-13T05:12:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0072373100000000003 2024-09-13T05:12:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:12:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.208492+0000", 2024-09-13T05:12:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048501003000000001 2024-09-13T05:12:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217224+0000", 2024-09-13T05:12:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0087320369999999998 2024-09-13T05:12:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217277+0000", 2024-09-13T05:12:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3841000000000002e-05 2024-09-13T05:12:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:35.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217347+0000", 2024-09-13T05:12:35.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9529999999999993e-05 2024-09-13T05:12:35.963 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.963 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.963 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.963 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:35.963 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:35.963 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:35.963 INFO:tasks.thrashosds.thrasher:in_osds: [2, 3, 5, 7, 1] out_osds: [4, 0, 6] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-13T05:12:35.963 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:12:35.963 INFO:tasks.thrashosds.thrasher:Adding osd 4 2024-09-13T05:12:35.964 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 4 2024-09-13T05:12:35.966 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:12:35.966 INFO:teuthology.orchestra.run.smithi120.stdout:5904 write 0xc270776 thru 0xc27888f (0x811a bytes) 2024-09-13T05:12:35.966 INFO:teuthology.orchestra.run.smithi120.stdout:5905 write 0x7a5bf51 thru 0x7a5fda5 (0x3e55 bytes) 2024-09-13T05:12:35.967 INFO:teuthology.orchestra.run.smithi120.stdout:5906 trunc from 0xc278890 to 0x15223ab 2024-09-13T05:12:35.967 INFO:teuthology.orchestra.run.smithi120.stdout:5910 write 0xe7b5d4a thru 0xe7c0894 (0xab4b bytes) 2024-09-13T05:12:35.967 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:35.967 INFO:teuthology.orchestra.run.smithi120.stdout:5913 punch from 0x9728bdb to 0x972add5, (0x21fa bytes) 2024-09-13T05:12:35.967 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:35.967 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:35.967 INFO:teuthology.orchestra.run.smithi120.stdout:5918 punch from 0xdaad0fc to 0xdabc198, (0xf09c bytes) 2024-09-13T05:12:35.967 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:35.967 INFO:teuthology.orchestra.run.smithi120.stdout:5920 read 0x4382313 thru 0x438dadd (0xb7cb bytes) 2024-09-13T05:12:35.967 INFO:teuthology.orchestra.run.smithi120.stdout:5922 read 0x4c36655 thru 0x4c38931 (0x22dd bytes) 2024-09-13T05:12:35.967 INFO:teuthology.orchestra.run.smithi120.stdout:5925 punch from 0xcc6da03 to 0xcc74271, (0x686e bytes) 2024-09-13T05:12:35.967 INFO:teuthology.orchestra.run.smithi120.stdout:5926 writesame 0xaadcac7 thru 0xaae81c6 data_size 0x60(0xb700 bytes) 2024-09-13T05:12:35.969 INFO:teuthology.orchestra.run.smithi120.stdout:5927 read 0x65000a2 thru 0x650dbbe (0xdb1d bytes) 2024-09-13T05:12:35.969 INFO:teuthology.orchestra.run.smithi120.stdout:5929 punch from 0xcb43ab6 to 0xcb4b0fb, (0x7645 bytes) 2024-09-13T05:12:35.969 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:35.969 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:35.967+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:35.974 INFO:teuthology.orchestra.run.smithi120.stdout:5931 trunc from 0xe7c0895 to 0xafc6e90 2024-09-13T05:12:35.995 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:36.009 INFO:teuthology.orchestra.run.smithi120.stdout:5933 write 0xc386347 thru 0xc3925fb (0xc2b5 bytes) 2024-09-13T05:12:36.014 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:36.021 INFO:teuthology.orchestra.run.smithi120.stdout:5937 trunc from 0xc3925fc to 0x8a8d2d7 2024-09-13T05:12:36.041 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:36.041 INFO:teuthology.orchestra.run.smithi120.stdout:5939 write 0x1be606f thru 0x1beb40c (0x539e bytes) 2024-09-13T05:12:36.058 INFO:teuthology.orchestra.run.smithi120.stdout:5941 trunc from 0x8a8d2d7 to 0xec9fe70 2024-09-13T05:12:36.068 INFO:teuthology.orchestra.run.smithi120.stdout:5942 write 0xa19c6f thru 0xa1d06c (0x33fe bytes) 2024-09-13T05:12:36.069 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:36.068+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:36.071 INFO:teuthology.orchestra.run.smithi120.stdout:5943 write 0xc099d thru 0xc544e (0x4ab2 bytes) 2024-09-13T05:12:36.075 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:36.075 INFO:teuthology.orchestra.run.smithi120.stdout:5946 writesame 0x7bc1472 thru 0x7bc384a data_size 0x15(0x23d9 bytes) 2024-09-13T05:12:36.089 INFO:teuthology.orchestra.run.smithi120.stdout:5947 trunc from 0xec9fe70 to 0xa3cc8ff 2024-09-13T05:12:36.099 INFO:teuthology.orchestra.run.smithi120.stdout:5949 read 0x89513b4 thru 0x895421b (0x2e68 bytes) 2024-09-13T05:12:36.099 INFO:teuthology.orchestra.run.smithi120.stdout:5950 read 0x8cf281e thru 0x8cf86bb (0x5e9e bytes) 2024-09-13T05:12:36.100 INFO:teuthology.orchestra.run.smithi120.stdout:5952 read 0x27e7ba7 thru 0x27ee0db (0x6535 bytes) 2024-09-13T05:12:36.100 INFO:teuthology.orchestra.run.smithi120.stdout:5953 read 0x367ec53 thru 0x368c233 (0xd5e1 bytes) 2024-09-13T05:12:36.100 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:36.100 INFO:teuthology.orchestra.run.smithi120.stdout:5955 write 0x21b3b7 thru 0x21ca14 (0x165e bytes) 2024-09-13T05:12:36.102 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:36.102 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:36.102 INFO:teuthology.orchestra.run.smithi120.stdout:5960 read 0x52183a4 thru 0x521f13d (0x6d9a bytes) 2024-09-13T05:12:36.108 INFO:teuthology.orchestra.run.smithi120.stdout:5961 trunc from 0xa3cc8ff to 0xe4d724f 2024-09-13T05:12:36.119 INFO:teuthology.orchestra.run.smithi120.stdout:5962 punch from 0xce7c97a to 0xce852a2, (0x8928 bytes) 2024-09-13T05:12:36.120 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:36.120 INFO:teuthology.orchestra.run.smithi120.stdout:5964 write 0xd20acad thru 0xd20c993 (0x1ce7 bytes) 2024-09-13T05:12:36.125 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:36.125 INFO:teuthology.orchestra.run.smithi120.stdout:5966 read 0x9262433 thru 0x9264b8d (0x275b bytes) 2024-09-13T05:12:36.125 INFO:teuthology.orchestra.run.smithi120.stdout:5967 read 0xad4c0c0 thru 0xad55642 (0x9583 bytes) 2024-09-13T05:12:36.125 INFO:teuthology.orchestra.run.smithi120.stdout:5968 read 0x9f8563 thru 0xa04bf8 (0xc696 bytes) 2024-09-13T05:12:36.126 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:36.126 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:36.126 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:36.126 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:36.126 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:36.126 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:36.126 INFO:teuthology.orchestra.run.smithi120.stdout:5975 read 0x70a055 thru 0x718c57 (0xec03 bytes) 2024-09-13T05:12:36.127 INFO:teuthology.orchestra.run.smithi120.stdout:5976 punch from 0x6dfc174 to 0x6e0542d, (0x92b9 bytes) 2024-09-13T05:12:36.127 INFO:teuthology.orchestra.run.smithi120.stdout:5978 write 0x36390bb thru 0x3648071 (0xefb7 bytes) 2024-09-13T05:12:36.132 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:36.132 INFO:teuthology.orchestra.run.smithi120.stdout:5980 write 0xe3bc548 thru 0xe3c3c02 (0x76bb bytes) 2024-09-13T05:12:36.136 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:12:36.140 INFO:teuthology.orchestra.run.smithi120.stdout:5982 punch from 0x9670c1c to 0x967a324, (0x9708 bytes) 2024-09-13T05:12:36.140 INFO:teuthology.orchestra.run.smithi120.stdout:5983 writesame 0xe0465cb thru 0xe05475a data_size 0x48(0xe190 bytes) 2024-09-13T05:12:36.145 INFO:teuthology.orchestra.run.smithi120.stdout:5984 writesame 0x1a16690 thru 0x1a16ab7 data_size 0x13(0x428 bytes) 2024-09-13T05:12:36.154 INFO:teuthology.orchestra.run.smithi120.stdout:5986 read 0x1c39f05 thru 0x1c3fb50 (0x5c4c bytes) 2024-09-13T05:12:36.154 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:36.154 INFO:teuthology.orchestra.run.smithi120.stdout:5988 read 0x1de7a9 thru 0x1e795d (0x91b5 bytes) 2024-09-13T05:12:36.154 INFO:teuthology.orchestra.run.smithi120.stdout:5989 read 0xbacb00a thru 0xbaceeb1 (0x3ea8 bytes) 2024-09-13T05:12:36.154 INFO:teuthology.orchestra.run.smithi120.stdout:5991 punch from 0x8bba9cc to 0x8bc9bde, (0xf212 bytes) 2024-09-13T05:12:36.166 INFO:teuthology.orchestra.run.smithi120.stdout:5992 trunc from 0xe4d724f to 0x6891da3 2024-09-13T05:12:36.170 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:36.167+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:36.184 INFO:teuthology.orchestra.run.smithi120.stdout:5993 read 0x46d04a1 thru 0x46df585 (0xf0e5 bytes) 2024-09-13T05:12:36.185 INFO:teuthology.orchestra.run.smithi120.stdout:5995 writesame 0x6018b2a thru 0x60279ae data_size 0xd(0xee85 bytes) 2024-09-13T05:12:36.193 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:36.193 INFO:teuthology.orchestra.run.smithi120.stdout:5997 read 0x9b7b03 thru 0x9be4bf (0x69bd bytes) 2024-09-13T05:12:36.193 INFO:teuthology.orchestra.run.smithi120.stdout:5998 read 0x48afe77 thru 0x48b0103 (0x28d bytes) 2024-09-13T05:12:36.205 INFO:teuthology.orchestra.run.smithi120.stdout:5999 trunc from 0x6891da3 to 0xca172b3 2024-09-13T05:12:36.215 INFO:teuthology.orchestra.run.smithi120.stdout:compare and write disabled 2024-09-13T05:12:36.238 INFO:teuthology.orchestra.run.smithi120.stdout:checking clone #44, image image_client.0-clone44 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent45 2024-09-13T05:12:36.243 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:36.243 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:36.243 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:36.243 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:36.243 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:36.252 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:12:36.271 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:36.267+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:36.291 INFO:tasks.ceph.mon.a.smithi120.stderr:2024-09-13T05:12:36.287+0000 7fa8b7b30700 -1 mon.a@0(leader).osd e141 definitely_dead 0 2024-09-13T05:12:36.350 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:12:36.365 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:36.366 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:36.366 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:36.366 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:36.366 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.366 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:36.366 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:36.366 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 119.499864249, 2024-09-13T05:12:36.366 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:12:36.366 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:36.366 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:36.366 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:36.366 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:36.366 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:36.367 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:12:36.367 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.367 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:36.367 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.367 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:36.367 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:36.367 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.367 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.367 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.367 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:36.367 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:36.367 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.367 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.367 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.368 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:36.368 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:36.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:36.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.368 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.368 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:36.368 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:12:36.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:12:36.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.368 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.368 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:36.368 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:12:36.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:12:36.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:36.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:12:36.369 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:12:36.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:12:36.369 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:12:36.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:36.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:12:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:12:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:12:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:12:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:12:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:12:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.370 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:36.371 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:12:36.371 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:12:36.371 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.371 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:36.371 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.371 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.371 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.371 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:36.371 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:36.371 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 119.49983981299999, 2024-09-13T05:12:36.371 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:12:36.371 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:36.371 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:36.372 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:36.372 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:36.372 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:36.372 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:12:36.372 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.372 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:36.372 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.372 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:36.372 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:36.372 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.372 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.372 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.372 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:36.373 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:36.373 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.373 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.373 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:36.373 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:36.373 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:36.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.373 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.373 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:36.373 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:12:36.373 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:12:36.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.373 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.373 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:36.374 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:12:36.374 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:12:36.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.374 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.374 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:36.374 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:12:36.374 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:12:36.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.374 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.374 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.374 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:12:36.374 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:12:36.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.374 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.375 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:36.375 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:12:36.375 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:12:36.375 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.375 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.375 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.375 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:12:36.375 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:12:36.375 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.375 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.375 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:36.375 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:12:36.375 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:12:36.375 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.376 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.376 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:36.376 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:12:36.376 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:12:36.376 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.376 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:36.376 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.376 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.376 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.376 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:36.376 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:36.376 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 119.499829987, 2024-09-13T05:12:36.376 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:12:36.376 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:36.377 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:36.377 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:36.377 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:36.377 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:36.377 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:12:36.377 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.377 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:36.377 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.377 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:36.377 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:36.377 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.377 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.377 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.377 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:36.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:36.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:36.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:36.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:36.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:36.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:12:36.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:12:36.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:36.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:12:36.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:12:36.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:36.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:12:36.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:12:36.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:12:36.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:12:36.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:36.380 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:12:36.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:12:36.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.380 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.380 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:12:36.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:12:36.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.380 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:36.380 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:12:36.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:12:36.381 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.381 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:36.381 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.381 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:36.381 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:36.381 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 119.499821751, 2024-09-13T05:12:36.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:12:36.381 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:36.381 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:36.381 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:36.381 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:36.382 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:36.382 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:12:36.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.382 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:36.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:36.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:36.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:36.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:36.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:36.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:36.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:36.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:36.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:12:36.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:12:36.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:36.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:12:36.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:12:36.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.384 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:36.384 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:12:36.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:12:36.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.384 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.384 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:12:36.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:12:36.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:36.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:12:36.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:12:36.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:12:36.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:12:36.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:36.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:12:36.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:12:36.386 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.386 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:36.386 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.386 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:36.386 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:36.386 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 119.499799839, 2024-09-13T05:12:36.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:12:36.386 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:36.386 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:36.386 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:36.386 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:36.386 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:36.386 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:12:36.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.387 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:36.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:36.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:36.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:36.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:36.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:36.388 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:36.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:36.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.388 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:36.388 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:12:36.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:12:36.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.388 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:36.388 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:12:36.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:12:36.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:36.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:12:36.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:12:36.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:12:36.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:12:36.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:36.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:12:36.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:12:36.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:12:36.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:12:36.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:36.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:12:36.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:12:36.390 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.390 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:36.390 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.391 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:36.391 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:36.391 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 119.499791235, 2024-09-13T05:12:36.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:12:36.391 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:36.391 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:36.391 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:36.391 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:36.391 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:36.391 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:12:36.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.391 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:36.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.391 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:36.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:36.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.392 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.392 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:36.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:36.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.392 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.392 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:36.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:36.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:36.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.392 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.393 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:36.393 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:12:36.393 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:12:36.393 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.393 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.393 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:36.393 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:12:36.393 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:12:36.393 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.393 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.393 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:36.393 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:12:36.393 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:12:36.393 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.394 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:12:36.394 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:12:36.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:36.394 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:12:36.394 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:12:36.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.394 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:12:36.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:12:36.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:36.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:12:36.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:12:36.395 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.395 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:36.395 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.395 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:36.395 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:36.396 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 119.499781541, 2024-09-13T05:12:36.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:12:36.396 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:36.396 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:36.396 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:36.396 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:36.396 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:36.396 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:12:36.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.396 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:36.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:36.397 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:36.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.397 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:36.397 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:36.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.397 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:36.397 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:36.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:36.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.398 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:36.398 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:12:36.398 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:12:36.398 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.398 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.398 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:36.398 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:12:36.398 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:12:36.398 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.398 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.398 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:36.398 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:12:36.398 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:12:36.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:12:36.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:12:36.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:36.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:12:36.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:12:36.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.400 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:12:36.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:12:36.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:36.400 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:12:36.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:12:36.400 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.400 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:36.400 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.401 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:36.401 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:36.401 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 119.49977242600001, 2024-09-13T05:12:36.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:12:36.401 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:36.401 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:36.401 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:36.401 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:36.401 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:36.401 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:12:36.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.401 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:36.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:36.402 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:36.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.402 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:36.402 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:36.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.402 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:36.402 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:36.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:36.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.402 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:36.403 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:12:36.403 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:12:36.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.403 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:36.403 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:12:36.403 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:12:36.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.403 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:36.403 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:12:36.403 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:12:36.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.403 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.404 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:12:36.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:12:36.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.404 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:36.404 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:12:36.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:12:36.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.404 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.404 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:12:36.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:12:36.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.405 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:36.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:12:36.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:12:36.405 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.405 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:36.405 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.405 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:36.405 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:12:36.405 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 119.49976394700001, 2024-09-13T05:12:36.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:12:36.405 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:36.406 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:36.406 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:36.406 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:36.406 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:36.406 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:12:36.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.406 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:36.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:36.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:12:36.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.407 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:36.407 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:12:36.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.407 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.407 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:36.407 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:12:36.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:36.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.407 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.407 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:36.407 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:12:36.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:12:36.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.407 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.408 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:36.408 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:12:36.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:12:36.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.408 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.408 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:36.408 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:12:36.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:12:36.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.408 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.408 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.408 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:12:36.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:12:36.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.409 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:36.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:12:36.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:12:36.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.409 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:12:36.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:12:36.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.409 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:36.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:12:36.410 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:12:36.410 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.410 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:36.410 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.410 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:36.410 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:12:36.410 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 119.499752022, 2024-09-13T05:12:36.410 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:12:36.410 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:36.410 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:36.410 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:36.410 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:36.411 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:36.411 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:12:36.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.411 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:36.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:36.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:12:36.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:36.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:12:36.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:36.412 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:12:36.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:36.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:36.412 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:12:36.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:12:36.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:36.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:12:36.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:12:36.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:36.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:12:36.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:12:36.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:12:36.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:12:36.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:36.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:12:36.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:12:36.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:12:36.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:12:36.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:36.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:12:36.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:12:36.414 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.415 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:36.415 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.415 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:36.415 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:36.415 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 119.499730433, 2024-09-13T05:12:36.415 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:12:36.415 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:36.415 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:36.415 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:36.415 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:36.415 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:36.416 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:12:36.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.416 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:36.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.416 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:36.416 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:36.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.416 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:36.416 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:36.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.416 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:36.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:36.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:36.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.417 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:36.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:12:36.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:12:36.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.417 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:36.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:12:36.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:12:36.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:36.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:12:36.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:12:36.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:12:36.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:12:36.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:36.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:12:36.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:12:36.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.419 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.419 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:12:36.419 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:12:36.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.419 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:36.419 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:12:36.419 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:12:36.420 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.420 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:36.420 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.420 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.420 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.420 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:36.420 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:36.420 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 119.499707305, 2024-09-13T05:12:36.420 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:12:36.420 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:36.420 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:36.420 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:36.420 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:36.421 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:36.421 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:12:36.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.421 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:36.421 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.421 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:36.421 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:36.421 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.421 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.421 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:36.421 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:36.421 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.422 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:36.422 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:36.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:36.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.422 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:36.422 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:12:36.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:12:36.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.422 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:36.422 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:12:36.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:12:36.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:36.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:12:36.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:12:36.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:12:36.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:12:36.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:36.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:12:36.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:12:36.424 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.424 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.424 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.424 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:12:36.424 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:12:36.424 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.424 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.424 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:36.424 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:12:36.424 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:12:36.424 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.424 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:36.424 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.425 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.425 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.425 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:36.425 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:12:36.425 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 119.499691932, 2024-09-13T05:12:36.425 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:12:36.425 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:36.425 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:36.425 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:36.425 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:36.425 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:36.425 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:12:36.425 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.425 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:36.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:36.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:12:36.426 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.426 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:36.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:12:36.426 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.426 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:36.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:12:36.426 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:36.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:36.427 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:12:36.427 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:12:36.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:36.427 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:12:36.427 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:12:36.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:36.427 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:12:36.428 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:12:36.428 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.428 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.428 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.428 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:12:36.428 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:12:36.428 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.428 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.428 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:36.429 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:12:36.429 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:12:36.429 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.429 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.429 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.429 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:12:36.429 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:12:36.429 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.429 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.429 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:36.429 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:12:36.429 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:12:36.429 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.429 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:36.430 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.430 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.430 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.430 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:36.430 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:36.430 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 119.499671464, 2024-09-13T05:12:36.430 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:12:36.430 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:36.430 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:36.430 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:36.430 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:36.430 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:36.431 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:12:36.431 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.431 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:36.431 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.431 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:36.431 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:36.431 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.431 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.431 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.431 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:36.431 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:36.431 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.431 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.432 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.432 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:36.432 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:36.432 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:36.432 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.432 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.432 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:36.432 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:12:36.432 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:12:36.432 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.433 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.433 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:36.433 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:12:36.433 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:12:36.433 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.433 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.433 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:36.433 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:12:36.433 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:12:36.433 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.433 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.434 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.434 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:12:36.434 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:12:36.434 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.434 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.434 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:36.434 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:12:36.434 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:12:36.434 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.434 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.435 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.435 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:12:36.435 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:12:36.435 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.435 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.435 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:36.435 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:12:36.435 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:12:36.435 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.435 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:36.435 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.435 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.435 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.436 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:36.436 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:36.436 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 119.499654803, 2024-09-13T05:12:36.436 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:12:36.436 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:36.436 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:36.436 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:36.436 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:36.436 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:36.436 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:12:36.436 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.436 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:36.436 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.437 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:36.437 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:36.437 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.437 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.437 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.437 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:36.437 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:36.437 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.437 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.437 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.437 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:36.437 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:36.437 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:36.437 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.438 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.438 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:36.438 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:12:36.438 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:12:36.438 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.438 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.438 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:36.438 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:12:36.438 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:12:36.438 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.438 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.438 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:36.438 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:12:36.439 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:12:36.439 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.439 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.439 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.439 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:12:36.439 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:12:36.439 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.439 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.439 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:36.439 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:12:36.439 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:12:36.439 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.439 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.440 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.440 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:12:36.440 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:12:36.440 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.440 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.440 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:36.440 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:12:36.440 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:12:36.440 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.440 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:36.440 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.441 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.441 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.441 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:36.441 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:12:36.441 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 119.49962809, 2024-09-13T05:12:36.441 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:12:36.441 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:36.441 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:36.441 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:36.441 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:36.441 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:36.441 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:12:36.441 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.442 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:36.442 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.442 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:36.442 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:12:36.442 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.442 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.442 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.442 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:36.442 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:12:36.442 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.442 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.442 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.443 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:36.443 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:12:36.443 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:36.443 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.443 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.443 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:36.443 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:12:36.443 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:12:36.443 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.443 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.443 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:36.443 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:12:36.443 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:12:36.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.444 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:36.444 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:12:36.444 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:12:36.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.444 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.444 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:12:36.444 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:12:36.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.444 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:36.445 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:12:36.445 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:12:36.445 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.445 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.445 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.445 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:12:36.445 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:12:36.445 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.445 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.445 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:36.445 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:12:36.445 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:12:36.445 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.446 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:36.446 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.446 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.446 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.446 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:36.446 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:36.446 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 119.49960923800001, 2024-09-13T05:12:36.446 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:12:36.446 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:36.446 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:36.446 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:36.446 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:36.446 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:36.447 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:12:36.447 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.447 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:36.447 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.447 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:36.447 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:36.447 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.447 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.447 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.447 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:36.447 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:36.447 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.448 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.448 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.448 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:36.448 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:36.448 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:36.448 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.448 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.448 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:36.448 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:12:36.449 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:12:36.449 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.449 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.449 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:36.449 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:12:36.449 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:12:36.449 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.449 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.449 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:36.449 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:12:36.449 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:12:36.449 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.450 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.450 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.450 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:12:36.450 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:12:36.450 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.450 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.450 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:36.450 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:12:36.450 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:12:36.450 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.450 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.450 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.450 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:12:36.450 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:12:36.451 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.451 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.451 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:36.451 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:12:36.451 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:12:36.451 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.451 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:36.451 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.451 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.451 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.451 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:36.451 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:36.451 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 119.499591452, 2024-09-13T05:12:36.452 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:12:36.452 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:36.452 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:36.452 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:36.452 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:36.452 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:36.452 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:12:36.452 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.452 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:36.452 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.452 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:36.452 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:36.453 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.453 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.453 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.453 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:36.453 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:36.453 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.453 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.453 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.453 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:36.453 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:36.453 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:36.453 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.453 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.453 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:36.454 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:12:36.454 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:12:36.454 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.454 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.454 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:36.454 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:12:36.454 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:12:36.454 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.454 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.454 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:36.454 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:12:36.454 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:12:36.454 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.454 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.455 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.455 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:12:36.455 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:12:36.455 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.455 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.455 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:36.455 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:12:36.455 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:12:36.455 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.455 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.455 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.455 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:12:36.455 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:12:36.456 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.456 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.456 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:36.456 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:12:36.456 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:12:36.456 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.456 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:36.456 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.456 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.456 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.456 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:36.456 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:36.456 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 119.499556392, 2024-09-13T05:12:36.456 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:12:36.457 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:36.457 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:36.457 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:36.457 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:36.457 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:36.457 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:12:36.457 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.457 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:36.457 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.457 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:36.457 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:36.457 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.457 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.457 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.458 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:36.458 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:36.458 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.458 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.458 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.458 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:36.458 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:36.458 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:36.458 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.458 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.459 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:36.459 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:12:36.459 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:12:36.459 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.459 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.460 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:36.460 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:12:36.460 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:12:36.460 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.460 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.460 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:36.460 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:12:36.460 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:12:36.460 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.460 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.460 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.460 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:12:36.460 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:12:36.461 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.461 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.461 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:36.461 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:12:36.461 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:12:36.461 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.461 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.461 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.461 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:12:36.461 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:12:36.461 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.461 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.461 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:36.462 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:12:36.462 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:12:36.462 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.462 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:36.462 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.462 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.462 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.462 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:36.462 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:36.462 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 119.49953957699999, 2024-09-13T05:12:36.462 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:12:36.462 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:36.462 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:36.462 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:36.463 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:36.463 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:36.463 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:12:36.463 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.463 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:36.463 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.463 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:36.463 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:36.463 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.463 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.463 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.463 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:36.463 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:36.463 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:36.464 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.464 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.464 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:36.464 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:36.464 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:36.464 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.464 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.464 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:36.464 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:12:36.464 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:12:36.464 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.464 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.464 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:36.464 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:12:36.465 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:12:36.465 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.465 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.465 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:36.465 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:12:36.465 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:12:36.465 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.465 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.465 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.465 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:12:36.466 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:12:36.466 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.466 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.466 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:36.466 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:12:36.466 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:12:36.466 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.466 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.466 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:36.466 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:12:36.466 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:12:36.466 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:36.466 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:36.467 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:36.467 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:12:36.467 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:12:36.467 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.467 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:36.467 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.467 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:36.467 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:36.467 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:36.469 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:12:36.469 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:36.463+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:36.480 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:12:36.501 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:36.518 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:36.537 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:36.560 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:36.569 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:36.567+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:36.580 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:36.581 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:36.583 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:36.591 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:12:36.606 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:36.628 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:36.630 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:12:36.631 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:36.631 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:36.631 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:36.631 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:36.631 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:36.631 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:36.631 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:36.689 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:36.687+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:36.711 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:36.711 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:36.721 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:12:36.772 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:36.768+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:36.841 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:36.841 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:36.854 INFO:teuthology.orchestra.run.smithi120.stderr:marked in osd.4. 2024-09-13T05:12:36.855 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is set 2024-09-13T05:12:36.859 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:12:36.867 INFO:tasks.thrashosds.thrasher:Added osd 4 2024-09-13T05:12:36.873 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:36.868+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:36.958 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:36.958 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:36.968 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:12:36.974 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:36.971+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:37.075 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:37.072+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:37.082 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:37.082 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:37.092 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:12:37.178 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:37.175+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:37.196 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:37.196 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:37.206 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:12:37.279 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:37.276+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:37.314 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:37.314 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:37.324 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:12:37.384 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:37.380+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:37.433 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:37.433 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:37.442 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:12:37.485 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:37.483+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:37.547 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:37.548 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:37.557 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:12:37.586 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:37.584+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:37.668 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:37.669 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:37.679 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:12:37.687 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:37.684+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:37.782 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:37.783 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:37.790 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:37.788+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:37.792 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:12:37.892 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:37.888+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:37.902 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:37.903 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:37.913 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:12:37.996 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:37.991+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:38.027 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:38.027 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:38.037 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:12:38.097 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:38.092+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:38.148 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:38.149 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:38.158 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:12:38.199 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:38.195+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:38.268 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:38.268 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:38.278 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:12:38.300 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:38.299+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:38.382 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:38.382 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:38.392 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:12:38.401 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:38.399+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:38.501 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:38.501 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:38.502 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:38.499+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:38.511 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:12:38.603 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:38.600+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:38.612 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:38.613 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:38.622 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:12:38.646 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:12:38.703 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:38.699+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:38.726 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:38.726 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:38.736 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:12:38.802 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:12:38.804 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:38.799+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:38.823 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:38.841 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:38.841 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:38.843 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:38.853 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:12:38.866 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T05:12:38.877 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:38.905 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:38.903+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:38.905 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:38.927 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:38.956 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:38.975 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:38.977 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:12:38.977 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:38.977 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:38.978 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:38.978 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:38.978 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:38.978 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:38.978 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:38.981 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:38.981 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:38.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:38.981 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:38.982 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.982 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29021 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2865152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:38.982 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:12:38.982 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 121.93745662800001, 2024-09-13T05:12:38.982 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060927993999999999, 2024-09-13T05:12:38.982 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:38.982 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:38.982 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:38.982 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:38.982 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:38.982 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29021 2024-09-13T05:12:38.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.982 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:38.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:38.983 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:12:38.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:38.983 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:38.983 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:12:38.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:38.983 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:38.983 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041763+0000", 2024-09-13T05:12:38.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:38.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:38.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041766+0000", 2024-09-13T05:12:38.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6800000000000002e-06 2024-09-13T05:12:38.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:38.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041771+0000", 2024-09-13T05:12:38.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:12:38.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:38.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041776+0000", 2024-09-13T05:12:38.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8489999999999997e-06 2024-09-13T05:12:38.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.985 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:38.985 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102513+0000", 2024-09-13T05:12:38.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060737102000000001 2024-09-13T05:12:38.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.985 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:38.985 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102597+0000", 2024-09-13T05:12:38.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4374000000000002e-05 2024-09-13T05:12:38.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:38.986 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102692+0000", 2024-09-13T05:12:38.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4436000000000002e-05 2024-09-13T05:12:38.986 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:38.986 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:38.986 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:38.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.986 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29022 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2874368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:38.986 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:38.986 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 121.93744032799999, 2024-09-13T05:12:38.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061135083999999999, 2024-09-13T05:12:38.986 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:38.986 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:38.987 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:38.987 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:38.987 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:38.987 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29022 2024-09-13T05:12:38.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.987 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:38.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:38.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:38.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:38.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:38.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:38.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:38.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.988 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:38.988 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:38.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:38.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.988 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:38.988 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041782+0000", 2024-09-13T05:12:38.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4959999999999999e-06 2024-09-13T05:12:38.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.988 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:38.988 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041787+0000", 2024-09-13T05:12:38.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1240000000000004e-06 2024-09-13T05:12:38.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:38.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041792+0000", 2024-09-13T05:12:38.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9200000000000003e-06 2024-09-13T05:12:38.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:38.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102738+0000", 2024-09-13T05:12:38.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060945581999999998 2024-09-13T05:12:38.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102821+0000", 2024-09-13T05:12:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2898999999999994e-05 2024-09-13T05:12:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102915+0000", 2024-09-13T05:12:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4523000000000003e-05 2024-09-13T05:12:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29067 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2764800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:38.990 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:38.991 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 121.93366611099999, 2024-09-13T05:12:38.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060816621000000001, 2024-09-13T05:12:38.991 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:38.991 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:38.991 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:38.991 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:38.991 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:38.991 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29067 2024-09-13T05:12:38.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.991 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:38.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.991 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:38.991 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:38.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:38.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.992 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:38.992 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:38.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:38.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.992 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:38.992 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:38.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:38.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.992 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:38.992 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045557+0000", 2024-09-13T05:12:38.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.898e-06 2024-09-13T05:12:38.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:38.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045575+0000", 2024-09-13T05:12:38.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8252000000000001e-05 2024-09-13T05:12:38.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:38.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045581+0000", 2024-09-13T05:12:38.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:12:38.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:38.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106183+0000", 2024-09-13T05:12:38.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060602630999999997 2024-09-13T05:12:38.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.994 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:38.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106271+0000", 2024-09-13T05:12:38.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7329000000000004e-05 2024-09-13T05:12:38.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.994 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:38.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106371+0000", 2024-09-13T05:12:38.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000100164 2024-09-13T05:12:38.994 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:38.994 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:38.994 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:38.995 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.995 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.995 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29068 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2774016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:38.995 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:12:38.995 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 121.933634877, 2024-09-13T05:12:38.995 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060994509000000002, 2024-09-13T05:12:38.995 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:38.995 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:38.995 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:38.995 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:38.995 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:38.995 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29068 2024-09-13T05:12:38.995 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.995 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:38.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:38.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:12:38.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:38.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:38.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:12:38.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:38.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:38.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045585+0000", 2024-09-13T05:12:38.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:38.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:38.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045588+0000", 2024-09-13T05:12:38.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:12:38.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:38.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045594+0000", 2024-09-13T05:12:38.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9329999999999998e-06 2024-09-13T05:12:38.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:38.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045599+0000", 2024-09-13T05:12:38.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3190000000000002e-06 2024-09-13T05:12:38.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:38.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106399+0000", 2024-09-13T05:12:38.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060800361999999997 2024-09-13T05:12:38.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:38.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106489+0000", 2024-09-13T05:12:38.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9301000000000004e-05 2024-09-13T05:12:38.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:38.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106580+0000", 2024-09-13T05:12:38.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1314e-05 2024-09-13T05:12:38.999 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:38.999 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:38.999 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:38.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:38.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:38.999 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29069 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2792448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:38.999 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:12:38.999 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 121.93361646, 2024-09-13T05:12:38.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061207599000000001, 2024-09-13T05:12:38.999 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:38.999 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:38.999 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.000 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.000 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.000 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29069 2024-09-13T05:12:39.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.000 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.000 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:12:39.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.001 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:12:39.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.001 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.001 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045603+0000", 2024-09-13T05:12:39.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.001 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.001 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045606+0000", 2024-09-13T05:12:39.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7300000000000001e-06 2024-09-13T05:12:39.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045612+0000", 2024-09-13T05:12:39.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9599999999999997e-06 2024-09-13T05:12:39.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045619+0000", 2024-09-13T05:12:39.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6019999999999996e-06 2024-09-13T05:12:39.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106619+0000", 2024-09-13T05:12:39.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061000029999999997 2024-09-13T05:12:39.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:39.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106713+0000", 2024-09-13T05:12:39.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4505000000000004e-05 2024-09-13T05:12:39.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106812+0000", 2024-09-13T05:12:39.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8264000000000007e-05 2024-09-13T05:12:39.003 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.003 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.003 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.004 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29070 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2783232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.004 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:39.004 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 121.933596001, 2024-09-13T05:12:39.004 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061389805999999998, 2024-09-13T05:12:39.004 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.004 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:39.004 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.004 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.004 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.004 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29070 2024-09-13T05:12:39.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.004 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.004 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.005 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:39.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.005 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:39.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.005 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:39.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045627+0000", 2024-09-13T05:12:39.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6579999999999998e-06 2024-09-13T05:12:39.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045632+0000", 2024-09-13T05:12:39.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8449999999999999e-06 2024-09-13T05:12:39.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045639+0000", 2024-09-13T05:12:39.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:12:39.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106837+0000", 2024-09-13T05:12:39.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061198529000000002 2024-09-13T05:12:39.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:39.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106922+0000", 2024-09-13T05:12:39.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4771999999999994e-05 2024-09-13T05:12:39.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107014+0000", 2024-09-13T05:12:39.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2009000000000006e-05 2024-09-13T05:12:39.007 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.007 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.008 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.008 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29071 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2801664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.008 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:12:39.008 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 121.933576925, 2024-09-13T05:12:39.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061582804999999997, 2024-09-13T05:12:39.008 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.008 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:39.008 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.008 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.008 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.008 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29071 2024-09-13T05:12:39.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.009 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.009 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.009 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:12:39.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.009 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.009 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:12:39.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.009 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.009 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045643+0000", 2024-09-13T05:12:39.010 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.010 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045646+0000", 2024-09-13T05:12:39.010 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:12:39.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.010 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045664+0000", 2024-09-13T05:12:39.010 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8408000000000001e-05 2024-09-13T05:12:39.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.010 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045670+0000", 2024-09-13T05:12:39.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7710000000000003e-06 2024-09-13T05:12:39.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.011 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.011 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107048+0000", 2024-09-13T05:12:39.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061378438 2024-09-13T05:12:39.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.011 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:39.011 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107134+0000", 2024-09-13T05:12:39.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5574000000000004e-05 2024-09-13T05:12:39.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.011 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.012 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107226+0000", 2024-09-13T05:12:39.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2262000000000005e-05 2024-09-13T05:12:39.012 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.012 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.012 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.012 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.012 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29072 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2810880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.012 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:12:39.012 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 121.933545541, 2024-09-13T05:12:39.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061762233999999999, 2024-09-13T05:12:39.012 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.012 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:39.012 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.013 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.013 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.013 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29072 2024-09-13T05:12:39.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.013 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:12:39.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:12:39.017 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045674+0000", 2024-09-13T05:12:39.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045677+0000", 2024-09-13T05:12:39.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9679999999999998e-06 2024-09-13T05:12:39.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045694+0000", 2024-09-13T05:12:39.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6801999999999999e-05 2024-09-13T05:12:39.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045700+0000", 2024-09-13T05:12:39.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8270000000000003e-06 2024-09-13T05:12:39.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107249+0000", 2024-09-13T05:12:39.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061549114000000002 2024-09-13T05:12:39.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.020 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:39.020 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107341+0000", 2024-09-13T05:12:39.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2390000000000001e-05 2024-09-13T05:12:39.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.020 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.020 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107437+0000", 2024-09-13T05:12:39.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5648000000000003e-05 2024-09-13T05:12:39.020 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.020 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.020 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.021 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29073 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2820096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.021 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:12:39.021 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 121.933503563, 2024-09-13T05:12:39.021 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061873910999999997, 2024-09-13T05:12:39.021 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.021 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:39.021 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.021 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.021 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.021 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29073 2024-09-13T05:12:39.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.021 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:12:39.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:12:39.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045716+0000", 2024-09-13T05:12:39.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045726+0000", 2024-09-13T05:12:39.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6350000000000001e-06 2024-09-13T05:12:39.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045739+0000", 2024-09-13T05:12:39.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3325e-05 2024-09-13T05:12:39.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.024 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045746+0000", 2024-09-13T05:12:39.024 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7399999999999998e-06 2024-09-13T05:12:39.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.024 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107457+0000", 2024-09-13T05:12:39.024 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061711038000000003 2024-09-13T05:12:39.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:39.025 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107522+0000", 2024-09-13T05:12:39.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4850000000000004e-05 2024-09-13T05:12:39.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.025 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.025 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107591+0000", 2024-09-13T05:12:39.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9029999999999995e-05 2024-09-13T05:12:39.025 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.026 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.026 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.026 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29074 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2829312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.026 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:12:39.027 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 121.933469655, 2024-09-13T05:12:39.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062055459, 2024-09-13T05:12:39.027 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.027 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:39.027 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.027 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.028 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.028 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29074 2024-09-13T05:12:39.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.028 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:12:39.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:12:39.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.030 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045750+0000", 2024-09-13T05:12:39.031 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.031 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.031 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045753+0000", 2024-09-13T05:12:39.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8399999999999999e-06 2024-09-13T05:12:39.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045759+0000", 2024-09-13T05:12:39.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8900000000000004e-06 2024-09-13T05:12:39.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045764+0000", 2024-09-13T05:12:39.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3850000000000001e-06 2024-09-13T05:12:39.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107623+0000", 2024-09-13T05:12:39.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061858817000000003 2024-09-13T05:12:39.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:39.035 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107710+0000", 2024-09-13T05:12:39.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7127999999999997e-05 2024-09-13T05:12:39.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.036 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.036 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107806+0000", 2024-09-13T05:12:39.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5886999999999999e-05 2024-09-13T05:12:39.036 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.036 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.037 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.037 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29075 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2838528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.037 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:39.037 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 121.933451201, 2024-09-13T05:12:39.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062188516999999999, 2024-09-13T05:12:39.038 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.038 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:39.038 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.038 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.038 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.038 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29075 2024-09-13T05:12:39.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.039 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:39.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:39.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:39.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.041 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.041 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.041 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045772+0000", 2024-09-13T05:12:39.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:12:39.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.041 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.041 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045778+0000", 2024-09-13T05:12:39.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9229999999999996e-06 2024-09-13T05:12:39.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045784+0000", 2024-09-13T05:12:39.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3800000000000002e-06 2024-09-13T05:12:39.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107823+0000", 2024-09-13T05:12:39.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062039331000000003 2024-09-13T05:12:39.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:39.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107886+0000", 2024-09-13T05:12:39.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2476000000000003e-05 2024-09-13T05:12:39.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107958+0000", 2024-09-13T05:12:39.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2089999999999996e-05 2024-09-13T05:12:39.043 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.043 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.043 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.044 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29115 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2682880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.044 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:12:39.044 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 121.92998567399999, 2024-09-13T05:12:39.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060847898999999997, 2024-09-13T05:12:39.044 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.044 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:39.044 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.044 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.044 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.044 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29115 2024-09-13T05:12:39.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.044 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:12:39.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:12:39.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049234+0000", 2024-09-13T05:12:39.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.046 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.046 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049237+0000", 2024-09-13T05:12:39.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9069999999999999e-06 2024-09-13T05:12:39.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.046 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.046 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049243+0000", 2024-09-13T05:12:39.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7459999999999997e-06 2024-09-13T05:12:39.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049248+0000", 2024-09-13T05:12:39.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1490000000000002e-06 2024-09-13T05:12:39.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.109945+0000", 2024-09-13T05:12:39.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060697299000000003 2024-09-13T05:12:39.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:39.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110013+0000", 2024-09-13T05:12:39.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8023999999999998e-05 2024-09-13T05:12:39.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110083+0000", 2024-09-13T05:12:39.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9296999999999997e-05 2024-09-13T05:12:39.048 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.048 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.048 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.048 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29116 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2692096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.048 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:12:39.048 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 121.92996783, 2024-09-13T05:12:39.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061040167999999999, 2024-09-13T05:12:39.049 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.049 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:39.049 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.049 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.049 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.049 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29116 2024-09-13T05:12:39.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.049 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.049 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:12:39.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.050 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.050 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.050 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:12:39.050 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.050 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.050 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.050 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.050 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049252+0000", 2024-09-13T05:12:39.050 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.050 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.050 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.050 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.050 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049255+0000", 2024-09-13T05:12:39.050 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7250000000000002e-06 2024-09-13T05:12:39.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049261+0000", 2024-09-13T05:12:39.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.755e-06 2024-09-13T05:12:39.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049266+0000", 2024-09-13T05:12:39.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2100000000000001e-06 2024-09-13T05:12:39.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110115+0000", 2024-09-13T05:12:39.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060849225999999999 2024-09-13T05:12:39.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:39.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110199+0000", 2024-09-13T05:12:39.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4339999999999995e-05 2024-09-13T05:12:39.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110293+0000", 2024-09-13T05:12:39.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3397e-05 2024-09-13T05:12:39.052 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.052 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.052 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.053 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29117 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2701312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.053 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:39.053 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 121.929950193, 2024-09-13T05:12:39.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.06118527, 2024-09-13T05:12:39.053 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.053 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:39.053 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.054 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.054 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.054 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29117 2024-09-13T05:12:39.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.054 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:39.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:39.055 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.055 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.055 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:39.055 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.056 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.056 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049273+0000", 2024-09-13T05:12:39.056 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.757e-06 2024-09-13T05:12:39.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.056 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.056 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.056 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049278+0000", 2024-09-13T05:12:39.056 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7830000000000004e-06 2024-09-13T05:12:39.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.056 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.056 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049284+0000", 2024-09-13T05:12:39.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3820000000000003e-06 2024-09-13T05:12:39.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110313+0000", 2024-09-13T05:12:39.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061029682000000002 2024-09-13T05:12:39.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:39.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110383+0000", 2024-09-13T05:12:39.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9406000000000006e-05 2024-09-13T05:12:39.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110456+0000", 2024-09-13T05:12:39.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2750000000000007e-05 2024-09-13T05:12:39.058 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.058 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.058 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.058 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29118 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2710528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.058 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:39.058 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 121.929932278, 2024-09-13T05:12:39.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061380698999999997, 2024-09-13T05:12:39.059 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.059 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:39.059 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.059 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.059 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.059 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29118 2024-09-13T05:12:39.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.060 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.060 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.060 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.060 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:39.060 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:39.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:39.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.063 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.063 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049291+0000", 2024-09-13T05:12:39.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8770000000000002e-06 2024-09-13T05:12:39.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.063 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.063 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.064 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049296+0000", 2024-09-13T05:12:39.064 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6799999999999998e-06 2024-09-13T05:12:39.064 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.064 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.064 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.064 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049302+0000", 2024-09-13T05:12:39.065 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2769999999999996e-06 2024-09-13T05:12:39.065 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.065 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.065 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.065 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110488+0000", 2024-09-13T05:12:39.065 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061186184999999997 2024-09-13T05:12:39.066 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.066 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.066 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:39.066 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110577+0000", 2024-09-13T05:12:39.066 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9246000000000006e-05 2024-09-13T05:12:39.066 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.067 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.067 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.067 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110669+0000", 2024-09-13T05:12:39.067 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1923999999999996e-05 2024-09-13T05:12:39.067 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.068 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.068 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.068 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.068 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.069 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29119 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2719744~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.069 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:12:39.069 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 121.92991453400001, 2024-09-13T05:12:39.069 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061521165000000003, 2024-09-13T05:12:39.069 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.070 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:39.070 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.070 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.070 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.070 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29119 2024-09-13T05:12:39.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.070 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:12:39.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.071 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.072 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:12:39.072 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.072 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.072 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.072 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.072 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049305+0000", 2024-09-13T05:12:39.072 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.072 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.073 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.073 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.073 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049308+0000", 2024-09-13T05:12:39.073 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7070000000000001e-06 2024-09-13T05:12:39.073 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.073 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.073 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.073 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049316+0000", 2024-09-13T05:12:39.073 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:12:39.073 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.073 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.074 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.074 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049322+0000", 2024-09-13T05:12:39.074 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3199999999999999e-06 2024-09-13T05:12:39.074 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.074 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.074 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110690+0000", 2024-09-13T05:12:39.074 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061368428000000003 2024-09-13T05:12:39.074 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.074 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:39.074 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110755+0000", 2024-09-13T05:12:39.074 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4893000000000004e-05 2024-09-13T05:12:39.074 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.075 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.075 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110827+0000", 2024-09-13T05:12:39.075 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2039000000000006e-05 2024-09-13T05:12:39.075 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.075 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.075 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.075 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29120 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2728960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.075 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:39.075 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 121.929894264, 2024-09-13T05:12:39.075 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061718420000000003, 2024-09-13T05:12:39.076 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.076 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:39.076 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.076 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.076 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.076 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29120 2024-09-13T05:12:39.076 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.076 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.076 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.076 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.076 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:39.076 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.076 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.076 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.077 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.077 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:39.077 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.077 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.077 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.077 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:39.077 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.077 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.077 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.077 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049329+0000", 2024-09-13T05:12:39.077 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.022e-06 2024-09-13T05:12:39.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.078 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.078 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049336+0000", 2024-09-13T05:12:39.078 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0720000000000002e-06 2024-09-13T05:12:39.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.078 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.078 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049341+0000", 2024-09-13T05:12:39.078 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:12:39.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.078 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.078 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110864+0000", 2024-09-13T05:12:39.079 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061523126999999997 2024-09-13T05:12:39.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.079 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.079 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:39.079 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110951+0000", 2024-09-13T05:12:39.079 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6557000000000005e-05 2024-09-13T05:12:39.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.079 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.079 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.079 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.111045+0000", 2024-09-13T05:12:39.079 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4043999999999996e-05 2024-09-13T05:12:39.079 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.079 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.080 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.080 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.080 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.080 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29136 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2876416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.080 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:12:39.080 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 121.92587883900001, 2024-09-13T05:12:39.080 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060742995000000001, 2024-09-13T05:12:39.080 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.080 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:39.080 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.080 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.081 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.081 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29136 2024-09-13T05:12:39.081 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.081 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.081 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.081 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.081 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:12:39.081 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.081 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.081 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.081 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.081 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:12:39.081 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.081 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.082 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.082 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.082 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053341+0000", 2024-09-13T05:12:39.082 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.082 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.082 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.082 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.082 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053344+0000", 2024-09-13T05:12:39.082 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:12:39.082 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.082 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.082 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.082 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053350+0000", 2024-09-13T05:12:39.082 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7200000000000003e-06 2024-09-13T05:12:39.082 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.083 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.083 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.083 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053355+0000", 2024-09-13T05:12:39.083 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0150000000000003e-06 2024-09-13T05:12:39.083 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.083 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.083 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.083 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113909+0000", 2024-09-13T05:12:39.083 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060554368999999997 2024-09-13T05:12:39.083 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.083 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.083 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:39.083 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113994+0000", 2024-09-13T05:12:39.083 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4658000000000002e-05 2024-09-13T05:12:39.084 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.084 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.084 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.084 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114085+0000", 2024-09-13T05:12:39.084 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0939000000000005e-05 2024-09-13T05:12:39.084 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.084 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.084 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.084 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.084 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.084 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29166 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2628608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.084 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:39.084 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 121.92586140500001, 2024-09-13T05:12:39.085 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060883127000000002, 2024-09-13T05:12:39.085 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.085 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:39.085 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.085 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.085 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.085 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29166 2024-09-13T05:12:39.085 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.085 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.085 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.085 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.085 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:39.085 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.086 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.086 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.086 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.086 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:39.086 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.086 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.086 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.086 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.086 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:39.086 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.086 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.086 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.086 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.086 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053361+0000", 2024-09-13T05:12:39.086 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:12:39.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.087 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.087 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.087 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053367+0000", 2024-09-13T05:12:39.087 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7350000000000001e-06 2024-09-13T05:12:39.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.087 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.087 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.087 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053372+0000", 2024-09-13T05:12:39.087 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7840000000000003e-06 2024-09-13T05:12:39.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.087 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.087 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.087 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114103+0000", 2024-09-13T05:12:39.087 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060730924999999998 2024-09-13T05:12:39.088 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.088 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.088 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:39.088 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114171+0000", 2024-09-13T05:12:39.088 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8021999999999993e-05 2024-09-13T05:12:39.088 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.088 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.088 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.088 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114242+0000", 2024-09-13T05:12:39.088 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1390999999999995e-05 2024-09-13T05:12:39.088 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.088 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.088 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.088 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.089 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.089 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:165308 3.3 3:c04a6a9a:::rbd_data.112dc3abcba6.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-13T05:12:39.089 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:12:39.089 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 22.847404119, 2024-09-13T05:12:39.089 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.085530595000000001, 2024-09-13T05:12:39.089 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.089 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:39.089 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.089 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.089 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.090 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 165308 2024-09-13T05:12:39.090 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.090 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.090 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.090 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.090 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:12:39.090 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.090 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.090 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.090 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.090 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:12:39.090 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.090 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.090 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.091 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.091 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131814+0000", 2024-09-13T05:12:39.091 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:39.091 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.091 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.091 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.091 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152479+0000", 2024-09-13T05:12:39.091 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020664281 2024-09-13T05:12:39.091 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.091 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.091 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.091 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152521+0000", 2024-09-13T05:12:39.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2567000000000001e-05 2024-09-13T05:12:39.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.092 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.092 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.092 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152536+0000", 2024-09-13T05:12:39.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4447000000000001e-05 2024-09-13T05:12:39.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.092 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.092 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.092 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152607+0000", 2024-09-13T05:12:39.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1687000000000007e-05 2024-09-13T05:12:39.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:39.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152753+0000", 2024-09-13T05:12:39.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000145861 2024-09-13T05:12:39.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:12:39.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.159991+0000", 2024-09-13T05:12:39.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0072373100000000003 2024-09-13T05:12:39.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:12:39.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.208492+0000", 2024-09-13T05:12:39.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048501003000000001 2024-09-13T05:12:39.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.094 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:39.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217224+0000", 2024-09-13T05:12:39.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0087320369999999998 2024-09-13T05:12:39.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.094 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:39.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217277+0000", 2024-09-13T05:12:39.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3841000000000002e-05 2024-09-13T05:12:39.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.094 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.095 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217347+0000", 2024-09-13T05:12:39.095 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9529999999999993e-05 2024-09-13T05:12:39.095 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.095 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.095 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.095 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.095 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.095 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:39.097 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:39.091+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:39.097 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:12:39.198 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:39.195+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:39.226 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:39.226 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:39.227 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:39.227 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:39.232 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:12:39.299 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:39.295+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:39.349 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:39.349 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:39.349 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:39.349 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:39.349 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:39.359 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:12:39.400 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:39.395+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:39.474 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:39.474 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:39.474 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:39.474 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:39.474 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.474 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.474 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:39.474 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 122.606676546, 2024-09-13T05:12:39.474 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:12:39.475 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.475 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:39.475 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.475 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.475 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.475 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:12:39.475 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.475 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.475 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.475 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.475 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:39.476 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.476 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.476 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.476 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.476 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:39.476 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.476 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.476 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.476 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.476 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:39.476 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:39.476 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.476 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.476 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.477 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:12:39.477 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:12:39.477 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.477 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.477 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.477 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:12:39.477 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:12:39.477 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.477 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.478 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.478 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:12:39.478 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:12:39.478 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.478 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.478 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.478 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:12:39.478 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:12:39.478 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.478 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.478 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:39.478 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:12:39.478 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:12:39.478 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.479 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.479 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.479 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:12:39.479 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:12:39.479 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.479 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.479 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:39.479 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:12:39.479 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:12:39.479 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.479 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.479 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.479 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:12:39.480 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:12:39.480 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.480 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.480 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.480 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.480 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.480 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.480 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:39.480 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 122.60665211, 2024-09-13T05:12:39.480 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:12:39.480 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.480 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:39.481 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.481 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.481 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.481 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:12:39.481 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.481 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.481 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.481 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.481 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:39.481 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.481 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.481 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.481 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.481 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:39.482 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.482 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.482 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.482 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.482 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:39.482 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:39.482 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.482 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.482 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.482 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:12:39.482 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:12:39.482 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.482 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.483 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.483 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:12:39.483 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:12:39.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.483 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.483 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.483 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:12:39.483 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:12:39.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.483 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.483 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.483 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:12:39.483 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:12:39.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.484 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.484 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:39.484 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:12:39.484 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:12:39.484 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.484 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.484 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.484 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:12:39.484 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:12:39.484 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.484 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.484 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:39.484 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:12:39.484 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:12:39.485 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.485 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.485 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.485 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:12:39.485 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:12:39.485 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.485 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.485 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.485 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.485 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.485 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.485 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:39.485 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 122.606642284, 2024-09-13T05:12:39.486 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:12:39.486 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.486 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:39.486 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.486 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.486 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.486 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:12:39.486 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.486 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.486 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.486 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.486 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:39.486 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.486 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.486 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.487 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.487 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:39.487 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.487 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.487 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.487 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.487 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:39.487 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:39.487 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.487 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.487 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.487 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:12:39.487 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:12:39.487 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.488 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.488 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.488 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:12:39.488 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:12:39.488 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.488 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.488 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.488 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:12:39.488 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:12:39.488 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.488 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.488 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.488 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:12:39.488 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:12:39.489 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.489 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.489 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:39.489 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:12:39.489 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:12:39.489 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.489 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.489 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.489 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:12:39.489 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:12:39.489 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.489 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.489 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.489 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:12:39.490 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:12:39.490 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.490 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.490 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.490 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.490 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.490 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.490 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:39.490 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 122.606634048, 2024-09-13T05:12:39.490 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:12:39.490 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.490 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:39.490 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.491 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.491 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.491 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:12:39.491 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.491 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.491 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.491 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.491 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:39.491 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.491 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.491 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.491 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.491 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:39.492 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.492 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.492 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.492 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.492 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:39.492 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:39.492 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.492 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.492 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.492 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:12:39.492 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:12:39.492 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.492 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.492 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.493 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:12:39.493 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:12:39.493 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.493 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.493 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.493 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:12:39.493 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:12:39.493 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.493 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.493 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.493 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:12:39.493 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:12:39.493 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.493 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.494 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:39.494 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:12:39.494 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:12:39.494 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.494 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.494 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.494 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:12:39.494 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:12:39.494 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.494 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.494 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.494 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:12:39.494 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:12:39.494 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.495 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.495 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.495 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.495 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.495 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.495 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:39.495 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 122.606612136, 2024-09-13T05:12:39.495 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:12:39.495 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.495 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:39.495 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.495 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.495 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.495 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:12:39.496 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.496 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.496 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.496 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.496 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:39.496 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.496 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.496 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.496 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.496 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:39.496 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.496 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.496 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.497 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.497 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:39.497 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:39.497 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.497 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.497 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.497 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:12:39.497 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:12:39.497 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.497 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.497 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.497 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:12:39.497 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:12:39.497 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.498 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.498 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.498 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:12:39.498 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:12:39.498 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.498 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.498 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.498 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:12:39.498 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:12:39.498 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.498 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.498 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:39.498 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:12:39.498 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:12:39.499 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.499 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.499 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.499 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:12:39.499 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:12:39.499 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.499 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.499 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.499 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:12:39.499 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:12:39.499 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.499 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.499 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.499 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.500 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.500 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.500 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:39.500 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 122.60660353199999, 2024-09-13T05:12:39.500 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:12:39.500 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.500 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:39.500 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.500 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.500 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.500 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:12:39.500 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.500 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.500 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.501 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.501 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:39.501 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.501 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.501 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.501 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.501 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:39.501 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.501 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.501 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.501 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.501 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:39.501 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:39.501 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.502 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.502 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.502 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:12:39.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:12:39.502 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.502 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.502 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.502 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:12:39.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:12:39.502 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.502 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.502 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.502 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:12:39.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:12:39.502 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.503 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.503 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.503 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:12:39.503 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:12:39.503 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.503 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.503 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:39.503 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:12:39.503 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:12:39.503 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.503 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.503 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.504 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:12:39.504 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:12:39.504 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.504 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.504 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.504 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:12:39.504 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:12:39.504 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.504 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.504 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.504 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.504 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.504 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.504 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:39.505 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 122.60659383799999, 2024-09-13T05:12:39.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:12:39.505 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.505 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:39.505 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.505 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.505 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.505 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:12:39.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.505 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.505 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.505 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.505 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:39.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.506 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.506 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.506 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:39.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.506 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.506 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.506 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:39.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:39.506 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.506 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.507 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:12:39.507 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:12:39.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.507 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.507 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:12:39.507 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:12:39.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.507 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.507 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:12:39.507 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:12:39.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.508 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.508 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:12:39.508 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:12:39.508 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.508 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.508 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:39.508 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:12:39.508 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:12:39.508 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.508 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.509 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.509 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:12:39.509 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:12:39.509 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.509 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.509 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.509 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:12:39.509 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:12:39.509 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.509 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.509 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.509 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.509 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.509 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.510 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:39.510 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 122.606584723, 2024-09-13T05:12:39.510 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:12:39.510 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.510 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:39.510 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.510 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.510 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.510 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:12:39.510 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.510 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.510 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.510 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.510 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:39.511 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.511 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.511 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.511 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:39.511 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.511 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.511 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.511 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:39.511 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:39.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.511 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.511 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.512 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:12:39.512 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:12:39.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.512 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.512 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.512 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:12:39.512 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:12:39.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.512 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.512 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.512 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:12:39.512 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:12:39.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.513 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.513 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:12:39.513 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:12:39.513 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.513 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:39.513 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:12:39.513 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:12:39.513 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.514 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.514 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.514 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:12:39.514 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:12:39.514 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.514 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.514 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.514 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:12:39.514 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:12:39.514 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.514 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.515 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.515 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.515 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:12:39.515 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 122.606576244, 2024-09-13T05:12:39.515 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:12:39.515 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.515 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:39.515 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.515 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.515 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.515 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:12:39.516 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.516 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.516 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.516 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.516 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:12:39.516 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.516 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.516 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.516 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.516 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:12:39.516 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.516 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.516 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.516 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.517 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:12:39.517 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.517 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.517 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:12:39.517 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:12:39.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.517 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.517 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:12:39.517 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:12:39.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.517 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.518 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:12:39.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:12:39.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.518 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.518 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:12:39.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:12:39.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.518 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:39.518 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:12:39.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:12:39.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.519 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:12:39.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:12:39.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.519 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:12:39.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:12:39.519 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.519 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.519 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.519 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.520 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:12:39.520 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 122.606564319, 2024-09-13T05:12:39.520 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:12:39.520 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.520 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:39.520 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.520 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.520 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.520 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:12:39.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.520 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.520 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.520 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:12:39.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.521 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.521 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:12:39.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.521 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.521 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:12:39.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:39.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.521 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:12:39.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:12:39.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:12:39.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:12:39.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:12:39.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:12:39.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.523 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:12:39.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:12:39.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.523 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:39.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:12:39.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:12:39.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.523 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:12:39.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:12:39.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:12:39.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:12:39.524 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.524 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.524 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.524 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.524 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:39.524 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 122.60654273, 2024-09-13T05:12:39.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:12:39.524 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.525 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:39.525 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.525 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.525 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.525 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:12:39.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.525 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.525 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.525 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:39.525 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.526 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.526 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:39.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.526 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.526 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:39.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.526 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.526 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:12:39.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:12:39.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:12:39.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:12:39.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:12:39.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:12:39.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:12:39.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:12:39.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.528 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:39.528 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:12:39.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:12:39.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.528 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.528 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:12:39.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:12:39.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.528 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.528 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:12:39.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:12:39.529 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.529 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.529 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.529 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.529 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:39.529 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 122.60651960200001, 2024-09-13T05:12:39.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:12:39.529 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.529 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:39.529 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.529 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.529 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.530 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:12:39.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.530 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.530 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.530 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:39.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.530 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.530 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:39.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:39.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:12:39.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:12:39.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:12:39.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:12:39.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:12:39.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:12:39.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:12:39.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:12:39.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:39.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:12:39.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:12:39.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:12:39.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:12:39.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:12:39.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:12:39.533 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.533 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.533 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.534 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.534 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:12:39.534 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 122.606504229, 2024-09-13T05:12:39.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:12:39.534 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.534 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:39.534 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.534 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.534 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.534 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:12:39.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.534 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.535 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.535 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:12:39.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.535 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.535 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.535 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:12:39.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.535 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.535 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.535 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:12:39.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:12:39.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:12:39.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:12:39.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:12:39.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:12:39.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:12:39.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:12:39.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:12:39.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:39.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:12:39.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:12:39.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:12:39.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:12:39.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:12:39.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:12:39.538 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.538 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.538 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.539 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.539 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:39.539 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 122.60648376100001, 2024-09-13T05:12:39.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:12:39.539 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.539 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:39.539 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.539 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.539 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.539 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:12:39.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.539 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.539 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.540 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:39.540 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.540 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.540 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:39.540 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.540 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.540 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:39.540 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:12:39.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:12:39.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:12:39.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:12:39.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:12:39.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:12:39.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:12:39.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:12:39.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:39.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:12:39.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:12:39.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:12:39.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:12:39.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:12:39.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:12:39.543 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.543 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.543 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.543 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.543 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:39.543 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 122.6064671, 2024-09-13T05:12:39.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:12:39.544 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.544 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:39.544 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.544 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.544 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.544 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:12:39.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.544 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.544 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:39.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.545 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:39.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.545 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:39.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:12:39.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:12:39.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:12:39.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:12:39.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:12:39.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:12:39.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:12:39.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:12:39.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:39.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:12:39.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:12:39.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:12:39.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:12:39.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:12:39.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:12:39.548 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.548 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.548 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.548 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.548 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:12:39.548 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 122.60644038700001, 2024-09-13T05:12:39.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:12:39.549 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.549 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:39.549 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.549 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.549 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.549 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:12:39.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.549 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:12:39.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:12:39.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:12:39.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:12:39.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:12:39.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:12:39.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:12:39.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:12:39.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:12:39.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:12:39.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:12:39.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:39.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:12:39.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:12:39.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:12:39.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:12:39.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.553 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.553 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:12:39.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:12:39.553 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.553 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.553 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.553 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.553 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:39.553 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 122.606421535, 2024-09-13T05:12:39.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:12:39.554 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.554 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:39.554 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.554 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.554 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.554 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:12:39.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.554 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:39.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:39.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:39.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:12:39.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:12:39.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:12:39.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:12:39.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:12:39.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:12:39.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:12:39.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:12:39.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:39.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:12:39.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:12:39.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:12:39.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:12:39.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:12:39.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:12:39.558 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.558 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.558 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.558 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.558 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:39.558 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 122.60640374899999, 2024-09-13T05:12:39.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:12:39.558 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.558 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:39.558 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.559 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.559 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.559 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:12:39.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.559 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:39.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:39.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:39.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:12:39.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:12:39.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:12:39.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:12:39.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:12:39.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:12:39.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:12:39.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:12:39.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:39.562 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:12:39.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:12:39.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.562 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:12:39.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:12:39.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:12:39.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:12:39.563 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.563 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.563 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.563 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.563 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:39.563 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 122.60636868899999, 2024-09-13T05:12:39.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:12:39.563 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.563 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:39.563 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.564 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.564 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.564 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:12:39.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.564 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:39.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:39.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:39.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:12:39.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:12:39.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:12:39.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:12:39.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:12:39.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:12:39.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:12:39.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:12:39.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:39.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:12:39.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:12:39.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:12:39.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:12:39.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:12:39.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:12:39.567 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.567 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.568 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.568 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:39.568 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:39.568 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 122.606351874, 2024-09-13T05:12:39.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:12:39.568 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:39.568 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:39.568 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:39.568 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:39.568 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:39.568 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:12:39.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.569 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:39.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:39.569 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:39.569 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:39.569 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:39.569 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:39.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:39.570 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:39.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:39.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.570 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:39.570 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:12:39.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:12:39.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.570 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:39.570 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:12:39.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:12:39.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.571 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:39.571 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:12:39.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:12:39.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.571 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.571 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.571 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:12:39.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:12:39.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.571 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.571 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:39.571 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:12:39.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:12:39.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:39.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:12:39.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:12:39.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:39.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:39.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:39.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:12:39.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:12:39.572 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.572 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.572 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.572 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:39.572 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:39.573 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:39.574 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:12:39.574 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:39.571+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:39.675 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:39.672+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:39.699 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:39.699 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:39.699 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:39.700 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:39.710 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:12:39.775 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:39.771+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:39.821 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:39.821 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:39.821 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:39.821 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:39.821 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:39.831 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:12:39.877 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:39.872+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:39.901 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is unset 2024-09-13T05:12:39.964 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:39.964 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:39.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:39.965 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [] 2024-09-13T05:12:39.965 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:39.975 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:12:39.977 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:39.975+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:40.078 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:40.075+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:40.080 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:40.080 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:40.080 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:40.080 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:40.090 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:12:40.179 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:40.176+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:40.197 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:40.198 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:40.198 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:40.198 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:40.198 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:40.208 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:12:40.280 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:40.275+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:40.322 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:40.322 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:40.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:40.322 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:40.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.322 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:159451 3.1b e117/116 3:d9c87acb:::rbd_data.112dc3abcba6.0000000000000003:head v 117'567, mlcod=0'0)", 2024-09-13T05:12:40.322 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:12:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.380483488000003, 2024-09-13T05:12:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064897325000000006, 2024-09-13T05:12:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:12:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:12:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938207+0000", 2024-09-13T05:12:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972794+0000", 2024-09-13T05:12:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.034587013 2024-09-13T05:12:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972821+0000", 2024-09-13T05:12:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6764e-05 2024-09-13T05:12:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972841+0000", 2024-09-13T05:12:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0191999999999999e-05 2024-09-13T05:12:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972905+0000", 2024-09-13T05:12:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4319000000000005e-05 2024-09-13T05:12:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972927+0000", 2024-09-13T05:12:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1135999999999999e-05 2024-09-13T05:12:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:12:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.002964+0000", 2024-09-13T05:12:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.030037123999999998 2024-09-13T05:12:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.003105+0000", 2024-09-13T05:12:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141614 2024-09-13T05:12:40.326 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159495 3.0 3:022f4da1:::rbd_data.112dfd94ee88.00000000000000e4:2a [read 167936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:12:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.305344067, 2024-09-13T05:12:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91926946899999995, 2024-09-13T05:12:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.327 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159495 2024-09-13T05:12:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:12:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:12:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013345+0000", 2024-09-13T05:12:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999971 2024-09-13T05:12:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013359+0000", 2024-09-13T05:12:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4752999999999999e-05 2024-09-13T05:12:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013418+0000", 2024-09-13T05:12:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8959000000000003e-05 2024-09-13T05:12:40.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013439+0000", 2024-09-13T05:12:40.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0749000000000001e-05 2024-09-13T05:12:40.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013563+0000", 2024-09-13T05:12:40.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012349400000000001 2024-09-13T05:12:40.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:40.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013583+0000", 2024-09-13T05:12:40.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0007e-05 2024-09-13T05:12:40.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932400+0000", 2024-09-13T05:12:40.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91881732400000005 2024-09-13T05:12:40.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932533+0000", 2024-09-13T05:12:40.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013263700000000001 2024-09-13T05:12:40.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932617+0000", 2024-09-13T05:12:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4313000000000004e-05 2024-09-13T05:12:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159517 3.0 3:03975f1c:::rbd_data.112dfd94ee88.0000000000000156:2a [read 167936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:12:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.305080353000001, 2024-09-13T05:12:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91962025700000005, 2024-09-13T05:12:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.333 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.334 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159517 2024-09-13T05:12:40.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.334 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:12:40.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:12:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013609+0000", 2024-09-13T05:12:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013619+0000", 2024-09-13T05:12:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0077e-05 2024-09-13T05:12:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013638+0000", 2024-09-13T05:12:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8739000000000001e-05 2024-09-13T05:12:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013653+0000", 2024-09-13T05:12:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5446000000000001e-05 2024-09-13T05:12:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016506+0000", 2024-09-13T05:12:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028525619999999999 2024-09-13T05:12:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016521+0000", 2024-09-13T05:12:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5310000000000001e-05 2024-09-13T05:12:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932964+0000", 2024-09-13T05:12:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91644284099999995 2024-09-13T05:12:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933097+0000", 2024-09-13T05:12:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013337599999999999 2024-09-13T05:12:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933231+0000", 2024-09-13T05:12:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133996 2024-09-13T05:12:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.338 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159622 3.0 3:03f7a45a:::rbd_data.112dfd94ee88.0000000000000318:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:12:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.303418542000003, 2024-09-13T05:12:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.918245003, 2024-09-13T05:12:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159622 2024-09-13T05:12:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:12:40.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:12:40.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015266+0000", 2024-09-13T05:12:40.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999928 2024-09-13T05:12:40.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015283+0000", 2024-09-13T05:12:40.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7309999999999999e-05 2024-09-13T05:12:40.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015318+0000", 2024-09-13T05:12:40.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5119e-05 2024-09-13T05:12:40.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015338+0000", 2024-09-13T05:12:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9259e-05 2024-09-13T05:12:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016558+0000", 2024-09-13T05:12:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012199909999999999 2024-09-13T05:12:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016567+0000", 2024-09-13T05:12:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2459999999999992e-06 2024-09-13T05:12:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933266+0000", 2024-09-13T05:12:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91669950300000003 2024-09-13T05:12:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:12:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015788099999999999 2024-09-13T05:12:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933518+0000", 2024-09-13T05:12:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3721000000000006e-05 2024-09-13T05:12:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.344 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173445 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 150528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:12:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.138841757, 2024-09-13T05:12:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064560905000000002, 2024-09-13T05:12:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173445 2024-09-13T05:12:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:12:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:12:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179849+0000", 2024-09-13T05:12:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179860+0000", 2024-09-13T05:12:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0419e-05 2024-09-13T05:12:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179866+0000", 2024-09-13T05:12:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.567e-06 2024-09-13T05:12:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179872+0000", 2024-09-13T05:12:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1830000000000002e-06 2024-09-13T05:12:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244262+0000", 2024-09-13T05:12:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064390814000000005 2024-09-13T05:12:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244321+0000", 2024-09-13T05:12:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8341000000000003e-05 2024-09-13T05:12:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244411+0000", 2024-09-13T05:12:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9911e-05 2024-09-13T05:12:40.348 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173446 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 157696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:12:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.13881499, 2024-09-13T05:12:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064714007000000004, 2024-09-13T05:12:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.349 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173446 2024-09-13T05:12:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:12:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:12:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179876+0000", 2024-09-13T05:12:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179879+0000", 2024-09-13T05:12:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1489999999999998e-06 2024-09-13T05:12:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179884+0000", 2024-09-13T05:12:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2800000000000003e-06 2024-09-13T05:12:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179889+0000", 2024-09-13T05:12:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7620000000000003e-06 2024-09-13T05:12:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244452+0000", 2024-09-13T05:12:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064562943999999997 2024-09-13T05:12:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244512+0000", 2024-09-13T05:12:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9879e-05 2024-09-13T05:12:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244591+0000", 2024-09-13T05:12:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8701000000000004e-05 2024-09-13T05:12:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173447 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 164864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:12:40.353 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.138798242, 2024-09-13T05:12:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064866246000000002, 2024-09-13T05:12:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173447 2024-09-13T05:12:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:12:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:12:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:12:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179895+0000", 2024-09-13T05:12:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6910000000000002e-06 2024-09-13T05:12:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179901+0000", 2024-09-13T05:12:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5149999999999997e-06 2024-09-13T05:12:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179905+0000", 2024-09-13T05:12:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4170000000000002e-06 2024-09-13T05:12:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244615+0000", 2024-09-13T05:12:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064709533999999999 2024-09-13T05:12:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244665+0000", 2024-09-13T05:12:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0283e-05 2024-09-13T05:12:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244760+0000", 2024-09-13T05:12:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4310999999999999e-05 2024-09-13T05:12:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.357 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173448 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 172032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:12:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.138782396, 2024-09-13T05:12:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065022046999999999, 2024-09-13T05:12:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.358 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173448 2024-09-13T05:12:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:12:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:12:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:12:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179914+0000", 2024-09-13T05:12:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6699999999999999e-06 2024-09-13T05:12:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179921+0000", 2024-09-13T05:12:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:12:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179926+0000", 2024-09-13T05:12:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8659999999999997e-06 2024-09-13T05:12:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244782+0000", 2024-09-13T05:12:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064856570000000002 2024-09-13T05:12:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244857+0000", 2024-09-13T05:12:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4326999999999995e-05 2024-09-13T05:12:40.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244931+0000", 2024-09-13T05:12:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4443999999999994e-05 2024-09-13T05:12:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173450 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 179200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:12:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.138761561999999, 2024-09-13T05:12:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065192589999999995, 2024-09-13T05:12:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173450 2024-09-13T05:12:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:12:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:12:40.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:12:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179932+0000", 2024-09-13T05:12:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2529999999999999e-06 2024-09-13T05:12:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179937+0000", 2024-09-13T05:12:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4219999999999999e-06 2024-09-13T05:12:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179942+0000", 2024-09-13T05:12:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3250000000000001e-06 2024-09-13T05:12:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244969+0000", 2024-09-13T05:12:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065027794999999999 2024-09-13T05:12:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245048+0000", 2024-09-13T05:12:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8812000000000004e-05 2024-09-13T05:12:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245123+0000", 2024-09-13T05:12:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4342000000000001e-05 2024-09-13T05:12:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.366 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173451 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:12:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.138745575, 2024-09-13T05:12:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359814000000002, 2024-09-13T05:12:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173451 2024-09-13T05:12:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:12:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:12:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:12:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179948+0000", 2024-09-13T05:12:40.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5119999999999998e-06 2024-09-13T05:12:40.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179954+0000", 2024-09-13T05:12:40.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5840000000000002e-06 2024-09-13T05:12:40.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179958+0000", 2024-09-13T05:12:40.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.566e-06 2024-09-13T05:12:40.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245160+0000", 2024-09-13T05:12:40.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065202057999999993 2024-09-13T05:12:40.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245228+0000", 2024-09-13T05:12:40.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7257999999999999e-05 2024-09-13T05:12:40.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245306+0000", 2024-09-13T05:12:40.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8227999999999997e-05 2024-09-13T05:12:40.371 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.371 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.371 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.371 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173452 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 193536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:40.371 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:12:40.371 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.138729088, 2024-09-13T05:12:40.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065505701, 2024-09-13T05:12:40.371 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.371 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.371 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.371 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.371 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.372 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173452 2024-09-13T05:12:40.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.372 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:12:40.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:12:40.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:12:40.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:40.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179965+0000", 2024-09-13T05:12:40.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.402e-06 2024-09-13T05:12:40.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179970+0000", 2024-09-13T05:12:40.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2290000000000002e-06 2024-09-13T05:12:40.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179974+0000", 2024-09-13T05:12:40.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5070000000000002e-06 2024-09-13T05:12:40.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245329+0000", 2024-09-13T05:12:40.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065354906000000004 2024-09-13T05:12:40.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245390+0000", 2024-09-13T05:12:40.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0878999999999998e-05 2024-09-13T05:12:40.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245468+0000", 2024-09-13T05:12:40.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8073999999999998e-05 2024-09-13T05:12:40.375 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.375 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.375 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.375 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173453 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 198656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:40.375 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:12:40.375 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.138712822, 2024-09-13T05:12:40.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065664343, 2024-09-13T05:12:40.376 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.376 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.376 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.376 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.376 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.376 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173453 2024-09-13T05:12:40.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.376 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:12:40.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:12:40.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179978+0000", 2024-09-13T05:12:40.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:40.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179981+0000", 2024-09-13T05:12:40.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4140000000000001e-06 2024-09-13T05:12:40.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179986+0000", 2024-09-13T05:12:40.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3519999999999997e-06 2024-09-13T05:12:40.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179991+0000", 2024-09-13T05:12:40.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6739999999999996e-06 2024-09-13T05:12:40.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245495+0000", 2024-09-13T05:12:40.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065504229999999997 2024-09-13T05:12:40.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245563+0000", 2024-09-13T05:12:40.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8119000000000003e-05 2024-09-13T05:12:40.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245643+0000", 2024-09-13T05:12:40.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9861e-05 2024-09-13T05:12:40.379 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.379 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.379 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.380 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173454 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:40.380 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:12:40.380 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.138664435000001, 2024-09-13T05:12:40.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065750457999999998, 2024-09-13T05:12:40.380 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.380 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.380 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.380 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.380 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.380 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173454 2024-09-13T05:12:40.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.380 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:12:40.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:12:40.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180026+0000", 2024-09-13T05:12:40.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:40.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180030+0000", 2024-09-13T05:12:40.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3790000000000002e-06 2024-09-13T05:12:40.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180036+0000", 2024-09-13T05:12:40.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5889999999999999e-06 2024-09-13T05:12:40.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180041+0000", 2024-09-13T05:12:40.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9980000000000003e-06 2024-09-13T05:12:40.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245667+0000", 2024-09-13T05:12:40.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065625124000000007 2024-09-13T05:12:40.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245705+0000", 2024-09-13T05:12:40.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7994000000000002e-05 2024-09-13T05:12:40.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245778+0000", 2024-09-13T05:12:40.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2999999999999999e-05 2024-09-13T05:12:40.384 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.384 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.384 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.384 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173455 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 212992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:40.384 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:12:40.384 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.138645727, 2024-09-13T05:12:40.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065899773999999994, 2024-09-13T05:12:40.384 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.384 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.385 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.385 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.385 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.385 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173455 2024-09-13T05:12:40.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.385 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:12:40.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:12:40.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180045+0000", 2024-09-13T05:12:40.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:40.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180048+0000", 2024-09-13T05:12:40.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5830000000000001e-06 2024-09-13T05:12:40.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180054+0000", 2024-09-13T05:12:40.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.789e-06 2024-09-13T05:12:40.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180059+0000", 2024-09-13T05:12:40.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.933e-06 2024-09-13T05:12:40.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245801+0000", 2024-09-13T05:12:40.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065742520999999998 2024-09-13T05:12:40.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245865+0000", 2024-09-13T05:12:40.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3325999999999996e-05 2024-09-13T05:12:40.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245946+0000", 2024-09-13T05:12:40.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0964999999999995e-05 2024-09-13T05:12:40.388 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.388 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.388 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.389 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173456 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:40.389 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:12:40.389 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.138628496000001, 2024-09-13T05:12:40.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066035128999999998, 2024-09-13T05:12:40.389 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.389 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.389 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.389 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.389 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.390 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173456 2024-09-13T05:12:40.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.390 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:12:40.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:12:40.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:12:40.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:40.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180065+0000", 2024-09-13T05:12:40.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4250000000000001e-06 2024-09-13T05:12:40.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180070+0000", 2024-09-13T05:12:40.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1749999999999996e-06 2024-09-13T05:12:40.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180075+0000", 2024-09-13T05:12:40.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4769999999999997e-06 2024-09-13T05:12:40.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245969+0000", 2024-09-13T05:12:40.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065894182999999995 2024-09-13T05:12:40.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246027+0000", 2024-09-13T05:12:40.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8165999999999998e-05 2024-09-13T05:12:40.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246098+0000", 2024-09-13T05:12:40.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1068999999999993e-05 2024-09-13T05:12:40.393 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.393 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.393 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.393 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173458 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:40.393 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:12:40.393 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.138612513, 2024-09-13T05:12:40.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066134732000000002, 2024-09-13T05:12:40.394 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.394 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.394 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.394 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.394 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.394 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173458 2024-09-13T05:12:40.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.394 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:12:40.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:12:40.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:12:40.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:40.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180081+0000", 2024-09-13T05:12:40.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4150000000000002e-06 2024-09-13T05:12:40.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180087+0000", 2024-09-13T05:12:40.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5389999999999998e-06 2024-09-13T05:12:40.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180101+0000", 2024-09-13T05:12:40.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4537e-05 2024-09-13T05:12:40.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246119+0000", 2024-09-13T05:12:40.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066017701999999998 2024-09-13T05:12:40.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246155+0000", 2024-09-13T05:12:40.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6094999999999999e-05 2024-09-13T05:12:40.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246214+0000", 2024-09-13T05:12:40.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8789000000000002e-05 2024-09-13T05:12:40.397 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.397 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.398 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.398 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173459 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 234496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:40.398 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:12:40.398 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.13858499, 2024-09-13T05:12:40.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066227460000000002, 2024-09-13T05:12:40.398 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.398 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.398 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.398 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.398 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.398 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173459 2024-09-13T05:12:40.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.399 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:12:40.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:12:40.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180106+0000", 2024-09-13T05:12:40.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:40.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180109+0000", 2024-09-13T05:12:40.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2219999999999998e-06 2024-09-13T05:12:40.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180115+0000", 2024-09-13T05:12:40.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9190000000000004e-06 2024-09-13T05:12:40.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180120+0000", 2024-09-13T05:12:40.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8930000000000004e-06 2024-09-13T05:12:40.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246236+0000", 2024-09-13T05:12:40.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066115638000000004 2024-09-13T05:12:40.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246273+0000", 2024-09-13T05:12:40.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7083999999999999e-05 2024-09-13T05:12:40.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246334+0000", 2024-09-13T05:12:40.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1183e-05 2024-09-13T05:12:40.402 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.402 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.402 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.402 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173460 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 241664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:40.402 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:12:40.402 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.138567183999999, 2024-09-13T05:12:40.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066360459999999996, 2024-09-13T05:12:40.402 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.402 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.403 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173460 2024-09-13T05:12:40.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.403 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:12:40.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:12:40.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:12:40.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:40.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180126+0000", 2024-09-13T05:12:40.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3120000000000001e-06 2024-09-13T05:12:40.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180132+0000", 2024-09-13T05:12:40.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.105e-06 2024-09-13T05:12:40.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180137+0000", 2024-09-13T05:12:40.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6829999999999999e-06 2024-09-13T05:12:40.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246365+0000", 2024-09-13T05:12:40.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066227584000000006 2024-09-13T05:12:40.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246413+0000", 2024-09-13T05:12:40.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8479000000000001e-05 2024-09-13T05:12:40.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246485+0000", 2024-09-13T05:12:40.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1600000000000006e-05 2024-09-13T05:12:40.407 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.407 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.407 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.407 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173461 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:40.407 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:12:40.407 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.138548415000001, 2024-09-13T05:12:40.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066492449999999995, 2024-09-13T05:12:40.407 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.407 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.408 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.408 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.408 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173461 2024-09-13T05:12:40.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.408 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:12:40.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:12:40.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:12:40.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:40.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180149+0000", 2024-09-13T05:12:40.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7239999999999997e-06 2024-09-13T05:12:40.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180153+0000", 2024-09-13T05:12:40.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7859999999999996e-06 2024-09-13T05:12:40.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180158+0000", 2024-09-13T05:12:40.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0300000000000001e-06 2024-09-13T05:12:40.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246508+0000", 2024-09-13T05:12:40.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066350100999999995 2024-09-13T05:12:40.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246568+0000", 2024-09-13T05:12:40.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9500000000000003e-05 2024-09-13T05:12:40.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246636+0000", 2024-09-13T05:12:40.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7633999999999997e-05 2024-09-13T05:12:40.411 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.411 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.411 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.412 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173462 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 256000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:40.412 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:12:40.412 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.137715587000001, 2024-09-13T05:12:40.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065773376999999994, 2024-09-13T05:12:40.412 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.412 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.412 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.412 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.412 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.412 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173462 2024-09-13T05:12:40.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.412 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:12:40.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:12:40.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180162+0000", 2024-09-13T05:12:40.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9991865 2024-09-13T05:12:40.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180984+0000", 2024-09-13T05:12:40.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00082184599999999999 2024-09-13T05:12:40.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180994+0000", 2024-09-13T05:12:40.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9000000000000001e-06 2024-09-13T05:12:40.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.181001+0000", 2024-09-13T05:12:40.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.917e-06 2024-09-13T05:12:40.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246653+0000", 2024-09-13T05:12:40.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065651820999999999 2024-09-13T05:12:40.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246698+0000", 2024-09-13T05:12:40.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.473e-05 2024-09-13T05:12:40.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246749+0000", 2024-09-13T05:12:40.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1758999999999997e-05 2024-09-13T05:12:40.416 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.416 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.416 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.416 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.416 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.416 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:40.417 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:40.412+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:40.418 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:12:40.518 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:40.516+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:40.538 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:40.539 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:40.539 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:40.539 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:40.549 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:12:40.619 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:40.616+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:40.655 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:40.655 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:40.655 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:40.665 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:12:40.720 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:40.715+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:40.776 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:40.776 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:40.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:40.777 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:40.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.777 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136560 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3908608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:40.777 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:12:40.777 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.679299084, 2024-09-13T05:12:40.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056148103999999997, 2024-09-13T05:12:40.777 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.777 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.777 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.777 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.777 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.777 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136560 2024-09-13T05:12:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:12:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:12:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095289+0000", 2024-09-13T05:12:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095292+0000", 2024-09-13T05:12:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.802e-06 2024-09-13T05:12:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095318+0000", 2024-09-13T05:12:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5987999999999999e-05 2024-09-13T05:12:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095323+0000", 2024-09-13T05:12:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.006e-06 2024-09-13T05:12:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151316+0000", 2024-09-13T05:12:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055992593 2024-09-13T05:12:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151371+0000", 2024-09-13T05:12:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5532999999999998e-05 2024-09-13T05:12:40.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151438+0000", 2024-09-13T05:12:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6557999999999995e-05 2024-09-13T05:12:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136562 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3922944~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.679261965999999, 2024-09-13T05:12:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056259690000000001, 2024-09-13T05:12:40.781 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136562 2024-09-13T05:12:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095329+0000", 2024-09-13T05:12:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3089999999999998e-06 2024-09-13T05:12:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095333+0000", 2024-09-13T05:12:40.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6239999999999999e-06 2024-09-13T05:12:40.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095335+0000", 2024-09-13T05:12:40.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5660000000000001e-06 2024-09-13T05:12:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151468+0000", 2024-09-13T05:12:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056132608000000001 2024-09-13T05:12:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151519+0000", 2024-09-13T05:12:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1681000000000002e-05 2024-09-13T05:12:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151587+0000", 2024-09-13T05:12:40.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7200999999999996e-05 2024-09-13T05:12:40.786 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.786 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.786 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.786 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136563 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3937280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:40.786 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:40.786 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.679250543999999, 2024-09-13T05:12:40.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056393051999999999, 2024-09-13T05:12:40.786 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.786 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.787 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136563 2024-09-13T05:12:40.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.787 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:40.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:40.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:12:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095340+0000", 2024-09-13T05:12:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.561e-06 2024-09-13T05:12:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095342+0000", 2024-09-13T05:12:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8059999999999999e-06 2024-09-13T05:12:40.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095345+0000", 2024-09-13T05:12:40.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:12:40.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151621+0000", 2024-09-13T05:12:40.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056275602000000001 2024-09-13T05:12:40.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151670+0000", 2024-09-13T05:12:40.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9478000000000003e-05 2024-09-13T05:12:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151731+0000", 2024-09-13T05:12:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1054000000000002e-05 2024-09-13T05:12:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136565 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3951616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:12:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.679240229999998, 2024-09-13T05:12:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056524090999999999, 2024-09-13T05:12:40.790 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136565 2024-09-13T05:12:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:12:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:12:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095348+0000", 2024-09-13T05:12:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:12:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095350+0000", 2024-09-13T05:12:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4479999999999999e-06 2024-09-13T05:12:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095353+0000", 2024-09-13T05:12:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.909e-06 2024-09-13T05:12:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095356+0000", 2024-09-13T05:12:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:12:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151763+0000", 2024-09-13T05:12:40.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056407813000000001 2024-09-13T05:12:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151812+0000", 2024-09-13T05:12:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8306999999999997e-05 2024-09-13T05:12:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151873+0000", 2024-09-13T05:12:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1064999999999999e-05 2024-09-13T05:12:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.795 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136567 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3965952~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:40.795 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:12:40.795 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.679231205000001, 2024-09-13T05:12:40.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056653907000000003, 2024-09-13T05:12:40.795 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.795 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.795 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.795 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.795 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.795 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136567 2024-09-13T05:12:40.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.795 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:12:40.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:12:40.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095357+0000", 2024-09-13T05:12:40.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:40.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095359+0000", 2024-09-13T05:12:40.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:12:40.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095362+0000", 2024-09-13T05:12:40.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7939999999999998e-06 2024-09-13T05:12:40.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095365+0000", 2024-09-13T05:12:40.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9979999999999999e-06 2024-09-13T05:12:40.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151904+0000", 2024-09-13T05:12:40.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056539308000000003 2024-09-13T05:12:40.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151953+0000", 2024-09-13T05:12:40.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8760000000000001e-05 2024-09-13T05:12:40.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152012+0000", 2024-09-13T05:12:40.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8761999999999997e-05 2024-09-13T05:12:40.799 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.799 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.799 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.799 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136569 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3980288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:40.799 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:40.799 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.679195450999998, 2024-09-13T05:12:40.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056771237000000002, 2024-09-13T05:12:40.799 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.799 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.799 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.799 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136569 2024-09-13T05:12:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:40.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095395+0000", 2024-09-13T05:12:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8870000000000001e-06 2024-09-13T05:12:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095402+0000", 2024-09-13T05:12:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6290000000000001e-06 2024-09-13T05:12:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095412+0000", 2024-09-13T05:12:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1730000000000001e-06 2024-09-13T05:12:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152044+0000", 2024-09-13T05:12:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056632016 2024-09-13T05:12:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152093+0000", 2024-09-13T05:12:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9570000000000001e-05 2024-09-13T05:12:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152165+0000", 2024-09-13T05:12:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1443e-05 2024-09-13T05:12:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136571 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3994624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:40.803 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:40.804 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.679174435999997, 2024-09-13T05:12:40.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056894741999999998, 2024-09-13T05:12:40.804 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.804 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.804 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.804 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.804 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.804 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136571 2024-09-13T05:12:40.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.804 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:40.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:40.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:40.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:40.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095418+0000", 2024-09-13T05:12:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0210000000000001e-06 2024-09-13T05:12:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095422+0000", 2024-09-13T05:12:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5310000000000002e-06 2024-09-13T05:12:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095425+0000", 2024-09-13T05:12:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8880000000000001e-06 2024-09-13T05:12:40.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152198+0000", 2024-09-13T05:12:40.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056773563999999999 2024-09-13T05:12:40.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152249+0000", 2024-09-13T05:12:40.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1168999999999997e-05 2024-09-13T05:12:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152309+0000", 2024-09-13T05:12:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9821999999999997e-05 2024-09-13T05:12:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136573 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4008960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:12:40.808 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.679162208999998, 2024-09-13T05:12:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057045810000000002, 2024-09-13T05:12:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136573 2024-09-13T05:12:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:12:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:12:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095426+0000", 2024-09-13T05:12:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095428+0000", 2024-09-13T05:12:40.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.593e-06 2024-09-13T05:12:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095431+0000", 2024-09-13T05:12:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9610000000000001e-06 2024-09-13T05:12:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095434+0000", 2024-09-13T05:12:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:12:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152352+0000", 2024-09-13T05:12:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05691881 2024-09-13T05:12:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152401+0000", 2024-09-13T05:12:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8995000000000001e-05 2024-09-13T05:12:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152472+0000", 2024-09-13T05:12:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1060000000000001e-05 2024-09-13T05:12:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136575 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4023296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:12:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.678732216, 2024-09-13T05:12:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056760069000000003, 2024-09-13T05:12:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136575 2024-09-13T05:12:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:12:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:12:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095437+0000", 2024-09-13T05:12:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9995799 2024-09-13T05:12:40.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095861+0000", 2024-09-13T05:12:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000424299 2024-09-13T05:12:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095869+0000", 2024-09-13T05:12:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5020000000000003e-06 2024-09-13T05:12:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095875+0000", 2024-09-13T05:12:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:12:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152502+0000", 2024-09-13T05:12:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056626528000000002 2024-09-13T05:12:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152556+0000", 2024-09-13T05:12:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4271000000000003e-05 2024-09-13T05:12:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152617+0000", 2024-09-13T05:12:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0896000000000001e-05 2024-09-13T05:12:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136577 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4037632~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:12:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.678630761000001, 2024-09-13T05:12:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056798242999999998, 2024-09-13T05:12:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.817 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.818 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.818 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.818 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136577 2024-09-13T05:12:40.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.818 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:12:40.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:12:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095882+0000", 2024-09-13T05:12:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999242 2024-09-13T05:12:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095961+0000", 2024-09-13T05:12:40.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8864999999999998e-05 2024-09-13T05:12:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095973+0000", 2024-09-13T05:12:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2206e-05 2024-09-13T05:12:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095978+0000", 2024-09-13T05:12:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0629999999999996e-06 2024-09-13T05:12:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152646+0000", 2024-09-13T05:12:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056668035999999998 2024-09-13T05:12:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152695+0000", 2024-09-13T05:12:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8634000000000002e-05 2024-09-13T05:12:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152756+0000", 2024-09-13T05:12:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1315000000000005e-05 2024-09-13T05:12:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.821 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136579 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4051968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:12:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.678302666, 2024-09-13T05:12:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056610869000000001, 2024-09-13T05:12:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136579 2024-09-13T05:12:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.822 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:12:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:12:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095989+0000", 2024-09-13T05:12:40.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997029 2024-09-13T05:12:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096291+0000", 2024-09-13T05:12:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030221499999999999 2024-09-13T05:12:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096300+0000", 2024-09-13T05:12:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4819999999999994e-06 2024-09-13T05:12:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096306+0000", 2024-09-13T05:12:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:12:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152788+0000", 2024-09-13T05:12:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056481625000000001 2024-09-13T05:12:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152837+0000", 2024-09-13T05:12:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9345000000000003e-05 2024-09-13T05:12:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152897+0000", 2024-09-13T05:12:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9892999999999997e-05 2024-09-13T05:12:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136581 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4066304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:12:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.678123839000001, 2024-09-13T05:12:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056597091000000002, 2024-09-13T05:12:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.826 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136581 2024-09-13T05:12:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:12:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:12:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096312+0000", 2024-09-13T05:12:40.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998465 2024-09-13T05:12:40.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096469+0000", 2024-09-13T05:12:40.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157109 2024-09-13T05:12:40.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096478+0000", 2024-09-13T05:12:40.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3260000000000002e-06 2024-09-13T05:12:40.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096482+0000", 2024-09-13T05:12:40.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9720000000000003e-06 2024-09-13T05:12:40.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152933+0000", 2024-09-13T05:12:40.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056451128000000003 2024-09-13T05:12:40.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152993+0000", 2024-09-13T05:12:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9947000000000001e-05 2024-09-13T05:12:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153062+0000", 2024-09-13T05:12:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9105999999999999e-05 2024-09-13T05:12:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136583 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4080640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:40.830 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:12:40.831 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.677857926000001, 2024-09-13T05:12:40.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056496609000000003, 2024-09-13T05:12:40.831 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.831 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.831 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.831 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.831 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.831 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136583 2024-09-13T05:12:40.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.831 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:12:40.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:12:40.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096485+0000", 2024-09-13T05:12:40.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997544 2024-09-13T05:12:40.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096735+0000", 2024-09-13T05:12:40.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024979899999999998 2024-09-13T05:12:40.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096742+0000", 2024-09-13T05:12:40.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7139999999999996e-06 2024-09-13T05:12:40.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096747+0000", 2024-09-13T05:12:40.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8709999999999996e-06 2024-09-13T05:12:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153099+0000", 2024-09-13T05:12:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056352639000000003 2024-09-13T05:12:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153168+0000", 2024-09-13T05:12:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9029000000000006e-05 2024-09-13T05:12:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153228+0000", 2024-09-13T05:12:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9339999999999998e-05 2024-09-13T05:12:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136585 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4094976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:12:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.677606459000003, 2024-09-13T05:12:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056396420000000003, 2024-09-13T05:12:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.835 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136585 2024-09-13T05:12:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:12:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:12:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096750+0000", 2024-09-13T05:12:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997673 2024-09-13T05:12:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096986+0000", 2024-09-13T05:12:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000236297 2024-09-13T05:12:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096993+0000", 2024-09-13T05:12:40.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9600000000000003e-06 2024-09-13T05:12:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096999+0000", 2024-09-13T05:12:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:12:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153264+0000", 2024-09-13T05:12:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056264728999999999 2024-09-13T05:12:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153318+0000", 2024-09-13T05:12:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3934000000000002e-05 2024-09-13T05:12:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153379+0000", 2024-09-13T05:12:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1206999999999999e-05 2024-09-13T05:12:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136586 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4109312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:12:40.839 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.677405657000001, 2024-09-13T05:12:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056374703999999998, 2024-09-13T05:12:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136586 2024-09-13T05:12:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:12:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:12:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097004+0000", 2024-09-13T05:12:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998207 2024-09-13T05:12:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097187+0000", 2024-09-13T05:12:40.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018337900000000001 2024-09-13T05:12:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097198+0000", 2024-09-13T05:12:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348e-05 2024-09-13T05:12:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097202+0000", 2024-09-13T05:12:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.121e-06 2024-09-13T05:12:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153411+0000", 2024-09-13T05:12:40.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056209510999999997 2024-09-13T05:12:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153464+0000", 2024-09-13T05:12:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2605000000000002e-05 2024-09-13T05:12:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153558+0000", 2024-09-13T05:12:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4017999999999993e-05 2024-09-13T05:12:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136588 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:12:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.677121474000003, 2024-09-13T05:12:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056274980000000002, 2024-09-13T05:12:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136588 2024-09-13T05:12:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:12:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:12:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097205+0000", 2024-09-13T05:12:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997377 2024-09-13T05:12:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097471+0000", 2024-09-13T05:12:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026628200000000001 2024-09-13T05:12:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097484+0000", 2024-09-13T05:12:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2493e-05 2024-09-13T05:12:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097488+0000", 2024-09-13T05:12:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9330000000000003e-06 2024-09-13T05:12:40.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153600+0000", 2024-09-13T05:12:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056112097 2024-09-13T05:12:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153654+0000", 2024-09-13T05:12:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4126000000000003e-05 2024-09-13T05:12:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153742+0000", 2024-09-13T05:12:40.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.831e-05 2024-09-13T05:12:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136589 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4137984~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:12:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.676982166999998, 2024-09-13T05:12:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056293867999999997, 2024-09-13T05:12:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136589 2024-09-13T05:12:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:12:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:12:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097491+0000", 2024-09-13T05:12:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998841 2024-09-13T05:12:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097610+0000", 2024-09-13T05:12:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119263 2024-09-13T05:12:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097617+0000", 2024-09-13T05:12:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6490000000000002e-06 2024-09-13T05:12:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097624+0000", 2024-09-13T05:12:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6309999999999997e-06 2024-09-13T05:12:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153779+0000", 2024-09-13T05:12:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056155153999999999 2024-09-13T05:12:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153831+0000", 2024-09-13T05:12:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2080000000000003e-05 2024-09-13T05:12:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153901+0000", 2024-09-13T05:12:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9765999999999996e-05 2024-09-13T05:12:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136965 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3366912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:12:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.657013345999999, 2024-09-13T05:12:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056225403, 2024-09-13T05:12:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.852 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136965 2024-09-13T05:12:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:12:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:12:40.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117575+0000", 2024-09-13T05:12:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117578+0000", 2024-09-13T05:12:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4899999999999999e-06 2024-09-13T05:12:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117583+0000", 2024-09-13T05:12:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.074e-06 2024-09-13T05:12:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117587+0000", 2024-09-13T05:12:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5360000000000003e-06 2024-09-13T05:12:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173622+0000", 2024-09-13T05:12:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056034527000000001 2024-09-13T05:12:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173704+0000", 2024-09-13T05:12:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2137000000000003e-05 2024-09-13T05:12:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173801+0000", 2024-09-13T05:12:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7048999999999999e-05 2024-09-13T05:12:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136991 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3553280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:40.856 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.653087569, 2024-09-13T05:12:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056330199999999997, 2024-09-13T05:12:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136991 2024-09-13T05:12:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121504+0000", 2024-09-13T05:12:40.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7199999999999998e-06 2024-09-13T05:12:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121510+0000", 2024-09-13T05:12:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3459999999999999e-06 2024-09-13T05:12:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121515+0000", 2024-09-13T05:12:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.656e-06 2024-09-13T05:12:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177608+0000", 2024-09-13T05:12:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056093267000000002 2024-09-13T05:12:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177717+0000", 2024-09-13T05:12:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010901299999999999 2024-09-13T05:12:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177832+0000", 2024-09-13T05:12:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114604 2024-09-13T05:12:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.860 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173672 3.9 3:9520c004:::rbd_data.112d7c1bedf7.0000000000000040:29 [read 186368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:12:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.589192944000001, 2024-09-13T05:12:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05682475, 2024-09-13T05:12:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173672 2024-09-13T05:12:40.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:12:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:12:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185395+0000", 2024-09-13T05:12:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185398+0000", 2024-09-13T05:12:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8260000000000001e-06 2024-09-13T05:12:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185404+0000", 2024-09-13T05:12:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-09-13T05:12:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:40.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185408+0000", 2024-09-13T05:12:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5279999999999997e-06 2024-09-13T05:12:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.236213+0000", 2024-09-13T05:12:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050805207999999998 2024-09-13T05:12:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.236285+0000", 2024-09-13T05:12:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1236999999999996e-05 2024-09-13T05:12:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:40.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.242221+0000", 2024-09-13T05:12:40.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059360050000000003 2024-09-13T05:12:40.865 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.865 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.865 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.865 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:40.865 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:40.865 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:40.866 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:12:40.867 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:40.864+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:40.967 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:40.963+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:40.978 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:40.979 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:40.979 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:40.979 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:40.988 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:12:41.068 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:41.063+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:41.088 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:41.089 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:41.097 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:12:41.099 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:12:41.169 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:41.164+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:41.250 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:41.251 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:41.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:41.251 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:41.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.251 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:70758 3.2 3:427d0469:::rbd_header.112d8d1317eb:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-13T05:12:41.251 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:41.251 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 77.817700310000006, 2024-09-13T05:12:41.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.190313603, 2024-09-13T05:12:41.251 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:41.251 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:41.251 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:41.251 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:41.251 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:41.252 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70758 2024-09-13T05:12:41.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.252 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:41.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:41.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:41.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:41.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:41.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:41.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428654+0000", 2024-09-13T05:12:41.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:41.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:41.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428664+0000", 2024-09-13T05:12:41.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0664e-05 2024-09-13T05:12:41.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:41.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428683+0000", 2024-09-13T05:12:41.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8377e-05 2024-09-13T05:12:41.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:41.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428691+0000", 2024-09-13T05:12:41.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9400000000000008e-06 2024-09-13T05:12:41.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428789+0000", 2024-09-13T05:12:41.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7165999999999998e-05 2024-09-13T05:12:41.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:41.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428811+0000", 2024-09-13T05:12:41.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1925000000000001e-05 2024-09-13T05:12:41.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.617921+0000", 2024-09-13T05:12:41.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.189110536 2024-09-13T05:12:41.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:41.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618344+0000", 2024-09-13T05:12:41.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042245800000000001 2024-09-13T05:12:41.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:41.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618969+0000", 2024-09-13T05:12:41.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062529299999999996 2024-09-13T05:12:41.256 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.256 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:41.256 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.256 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162381 3.8 3.4e1a3768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:41.256 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:12:41.256 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.737694062999999, 2024-09-13T05:12:41.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.14690313199999999, 2024-09-13T05:12:41.256 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:41.256 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:41.256 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:41.257 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:41.257 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:41.257 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162381 2024-09-13T05:12:41.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.257 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:41.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:41.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:12:41.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:41.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:12:41.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:41.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508659+0000", 2024-09-13T05:12:41.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:12:41.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:41.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508673+0000", 2024-09-13T05:12:41.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4154999999999999e-05 2024-09-13T05:12:41.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:41.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508703+0000", 2024-09-13T05:12:41.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9427000000000001e-05 2024-09-13T05:12:41.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:41.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508719+0000", 2024-09-13T05:12:41.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6381000000000001e-05 2024-09-13T05:12:41.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508789+0000", 2024-09-13T05:12:41.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9898000000000001e-05 2024-09-13T05:12:41.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:41.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508799+0000", 2024-09-13T05:12:41.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0066e-05 2024-09-13T05:12:41.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655550+0000", 2024-09-13T05:12:41.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.146750506 2024-09-13T05:12:41.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:41.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655565+0000", 2024-09-13T05:12:41.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4915e-05 2024-09-13T05:12:41.261 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.261 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:41.261 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.261 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162393 3.8 3.fd966c88 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:41.261 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:12:41.261 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.726177989, 2024-09-13T05:12:41.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.135657895, 2024-09-13T05:12:41.261 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:41.261 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:41.261 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:41.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:41.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:41.262 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162393 2024-09-13T05:12:41.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.262 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:41.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:41.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:12:41.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:41.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:12:41.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:41.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520176+0000", 2024-09-13T05:12:41.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:41.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:41.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520184+0000", 2024-09-13T05:12:41.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5800000000000003e-06 2024-09-13T05:12:41.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:41.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520199+0000", 2024-09-13T05:12:41.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4481000000000001e-05 2024-09-13T05:12:41.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:41.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520209+0000", 2024-09-13T05:12:41.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0327e-05 2024-09-13T05:12:41.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520351+0000", 2024-09-13T05:12:41.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141827 2024-09-13T05:12:41.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:41.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520363+0000", 2024-09-13T05:12:41.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2018000000000001e-05 2024-09-13T05:12:41.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655819+0000", 2024-09-13T05:12:41.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13545665600000001 2024-09-13T05:12:41.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:41.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655835+0000", 2024-09-13T05:12:41.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6135000000000001e-05 2024-09-13T05:12:41.266 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.266 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:41.266 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.266 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162429 3.8 3.6e098f28 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:41.266 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:41.266 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.72532738, 2024-09-13T05:12:41.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13484765400000001, 2024-09-13T05:12:41.266 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:41.266 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:41.266 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:41.266 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:41.267 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:41.267 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162429 2024-09-13T05:12:41.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.267 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:41.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:41.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:41.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:41.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:41.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:41.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:41.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:41.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:41.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521032+0000", 2024-09-13T05:12:41.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3039999999999998e-06 2024-09-13T05:12:41.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:41.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521041+0000", 2024-09-13T05:12:41.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6880000000000005e-06 2024-09-13T05:12:41.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:41.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521047+0000", 2024-09-13T05:12:41.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0100000000000001e-06 2024-09-13T05:12:41.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521601+0000", 2024-09-13T05:12:41.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00055398600000000002 2024-09-13T05:12:41.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:41.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521613+0000", 2024-09-13T05:12:41.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2347000000000001e-05 2024-09-13T05:12:41.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655869+0000", 2024-09-13T05:12:41.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.134255597 2024-09-13T05:12:41.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:41.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655876+0000", 2024-09-13T05:12:41.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2790000000000001e-06 2024-09-13T05:12:41.270 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.270 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:41.270 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.271 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162521 3.8 3.f06bf7c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:41.271 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:41.271 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.722925249999999, 2024-09-13T05:12:41.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13247452600000001, 2024-09-13T05:12:41.271 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:41.271 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:41.271 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:41.271 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:41.271 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:41.271 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162521 2024-09-13T05:12:41.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.271 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:41.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:41.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:41.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:41.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:41.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:41.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:41.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:41.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:41.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523433+0000", 2024-09-13T05:12:41.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.128e-06 2024-09-13T05:12:41.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:41.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523440+0000", 2024-09-13T05:12:41.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9990000000000002e-06 2024-09-13T05:12:41.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:41.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523446+0000", 2024-09-13T05:12:41.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7869999999999998e-06 2024-09-13T05:12:41.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.528221+0000", 2024-09-13T05:12:41.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047747040000000003 2024-09-13T05:12:41.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:41.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.528237+0000", 2024-09-13T05:12:41.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6042e-05 2024-09-13T05:12:41.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655898+0000", 2024-09-13T05:12:41.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.127661521 2024-09-13T05:12:41.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:41.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655905+0000", 2024-09-13T05:12:41.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7780000000000002e-06 2024-09-13T05:12:41.275 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.275 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:41.275 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.275 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162381 3.8 3:16ec5872:::rbd_data.112dc3abcba6.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:41.275 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:12:41.275 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.713398085000001, 2024-09-13T05:12:41.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12546553899999999, 2024-09-13T05:12:41.275 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:41.276 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:41.276 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:41.276 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:41.276 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:41.276 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162381 2024-09-13T05:12:41.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.276 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:41.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:41.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:12:41.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:41.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:12:41.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:41.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532956+0000", 2024-09-13T05:12:41.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:41.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:41.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532964+0000", 2024-09-13T05:12:41.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.072e-06 2024-09-13T05:12:41.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:41.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532976+0000", 2024-09-13T05:12:41.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1355000000000001e-05 2024-09-13T05:12:41.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:41.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532984+0000", 2024-09-13T05:12:41.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3440000000000001e-06 2024-09-13T05:12:41.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533432+0000", 2024-09-13T05:12:41.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044773000000000002 2024-09-13T05:12:41.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:41.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533439+0000", 2024-09-13T05:12:41.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9890000000000003e-06 2024-09-13T05:12:41.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655985+0000", 2024-09-13T05:12:41.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122546527 2024-09-13T05:12:41.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:41.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656234+0000", 2024-09-13T05:12:41.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024911300000000003 2024-09-13T05:12:41.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:12:41.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656378+0000", 2024-09-13T05:12:41.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014417100000000001 2024-09-13T05:12:41.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:41.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657916+0000", 2024-09-13T05:12:41.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001537907 2024-09-13T05:12:41.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:12:41.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658308+0000", 2024-09-13T05:12:41.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039183700000000002 2024-09-13T05:12:41.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:12:41.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658364+0000", 2024-09-13T05:12:41.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5451000000000002e-05 2024-09-13T05:12:41.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:41.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658423+0000", 2024-09-13T05:12:41.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9449e-05 2024-09-13T05:12:41.281 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.281 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:41.282 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.282 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162393 3.8 3:113669bf:::rbd_data.112dfd94ee88.00000000000000bf:2a [read 131072~18432] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:41.282 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:41.282 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.713358306, 2024-09-13T05:12:41.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124231431, 2024-09-13T05:12:41.282 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:41.282 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:41.282 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:41.282 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:41.282 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:41.282 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162393 2024-09-13T05:12:41.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.283 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:41.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:41.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:41.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:41.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:41.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:41.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:41.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:41.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:41.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533001+0000", 2024-09-13T05:12:41.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8099999999999999e-06 2024-09-13T05:12:41.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:41.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533007+0000", 2024-09-13T05:12:41.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5849999999999996e-06 2024-09-13T05:12:41.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:41.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533012+0000", 2024-09-13T05:12:41.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0320000000000003e-06 2024-09-13T05:12:41.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533459+0000", 2024-09-13T05:12:41.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044646399999999999 2024-09-13T05:12:41.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:41.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533464+0000", 2024-09-13T05:12:41.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9180000000000002e-06 2024-09-13T05:12:41.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656870+0000", 2024-09-13T05:12:41.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123406847 2024-09-13T05:12:41.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:41.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657067+0000", 2024-09-13T05:12:41.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019655599999999999 2024-09-13T05:12:41.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:41.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657229+0000", 2024-09-13T05:12:41.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016175599999999999 2024-09-13T05:12:41.286 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.287 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:41.287 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.287 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162429 3.8 3:14f19076:::rbd_data.112dfd94ee88.0000000000000150:2a [read 131072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:41.287 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:12:41.287 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.713338755999999, 2024-09-13T05:12:41.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124549956, 2024-09-13T05:12:41.287 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:41.287 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:41.287 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:41.287 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:41.287 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:41.287 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162429 2024-09-13T05:12:41.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.288 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:41.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:41.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:12:41.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:41.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:12:41.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:41.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533016+0000", 2024-09-13T05:12:41.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:41.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:41.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533020+0000", 2024-09-13T05:12:41.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1049999999999999e-06 2024-09-13T05:12:41.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:41.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533025+0000", 2024-09-13T05:12:41.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-09-13T05:12:41.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:41.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533030+0000", 2024-09-13T05:12:41.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8999999999999997e-06 2024-09-13T05:12:41.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533481+0000", 2024-09-13T05:12:41.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045080400000000002 2024-09-13T05:12:41.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:41.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533486+0000", 2024-09-13T05:12:41.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3369999999999999e-06 2024-09-13T05:12:41.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657311+0000", 2024-09-13T05:12:41.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123824408 2024-09-13T05:12:41.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:41.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657464+0000", 2024-09-13T05:12:41.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015343900000000001 2024-09-13T05:12:41.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:41.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657567+0000", 2024-09-13T05:12:41.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102568 2024-09-13T05:12:41.291 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.292 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:41.292 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.292 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162521 3.8 3:13efd60f:::rbd_data.112dfd94ee88.000000000000031a:2a [read 131072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:41.292 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:41.292 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.713187522999998, 2024-09-13T05:12:41.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124709257, 2024-09-13T05:12:41.292 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:41.292 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:41.292 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:41.292 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:41.292 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:41.293 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162521 2024-09-13T05:12:41.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.293 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:41.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:41.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:41.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:41.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:41.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:41.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:41.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:41.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:41.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533170+0000", 2024-09-13T05:12:41.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3910000000000001e-06 2024-09-13T05:12:41.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:41.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533176+0000", 2024-09-13T05:12:41.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4029999999999998e-06 2024-09-13T05:12:41.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:41.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533180+0000", 2024-09-13T05:12:41.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6999999999999999e-06 2024-09-13T05:12:41.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533659+0000", 2024-09-13T05:12:41.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047839699999999998 2024-09-13T05:12:41.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:41.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533664+0000", 2024-09-13T05:12:41.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7239999999999997e-06 2024-09-13T05:12:41.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657619+0000", 2024-09-13T05:12:41.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123954412 2024-09-13T05:12:41.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:41.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657784+0000", 2024-09-13T05:12:41.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016527499999999999 2024-09-13T05:12:41.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:41.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657877+0000", 2024-09-13T05:12:41.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3280000000000001e-05 2024-09-13T05:12:41.297 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.297 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:41.297 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.297 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162618 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 70656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:41.297 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:12:41.297 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.711882812999999, 2024-09-13T05:12:41.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123752711, 2024-09-13T05:12:41.297 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:41.297 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:41.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:41.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:41.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:41.298 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162618 2024-09-13T05:12:41.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.298 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:41.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:41.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:12:41.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:41.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:12:41.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:41.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534472+0000", 2024-09-13T05:12:41.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:41.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:41.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534475+0000", 2024-09-13T05:12:41.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2010000000000002e-06 2024-09-13T05:12:41.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:41.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534482+0000", 2024-09-13T05:12:41.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:12:41.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:41.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534486+0000", 2024-09-13T05:12:41.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7520000000000004e-06 2024-09-13T05:12:41.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536456+0000", 2024-09-13T05:12:41.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001969527 2024-09-13T05:12:41.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:41.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536462+0000", 2024-09-13T05:12:41.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2750000000000001e-06 2024-09-13T05:12:41.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657939+0000", 2024-09-13T05:12:41.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121476769 2024-09-13T05:12:41.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:41.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658087+0000", 2024-09-13T05:12:41.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014862400000000001 2024-09-13T05:12:41.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:41.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658225+0000", 2024-09-13T05:12:41.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013800999999999999 2024-09-13T05:12:41.302 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.302 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:41.302 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.302 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162620 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 71680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:41.302 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:41.302 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.711848688, 2024-09-13T05:12:41.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124087688, 2024-09-13T05:12:41.302 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:41.302 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:41.302 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:41.303 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:41.303 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:41.303 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162620 2024-09-13T05:12:41.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.303 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:41.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:41.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:41.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:41.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:41.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:41.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:41.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:41.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:41.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534509+0000", 2024-09-13T05:12:41.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1270000000000001e-06 2024-09-13T05:12:41.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:41.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534514+0000", 2024-09-13T05:12:41.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8720000000000001e-06 2024-09-13T05:12:41.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:41.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534518+0000", 2024-09-13T05:12:41.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5090000000000004e-06 2024-09-13T05:12:41.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536485+0000", 2024-09-13T05:12:41.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019671530000000001 2024-09-13T05:12:41.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:41.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536491+0000", 2024-09-13T05:12:41.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3759999999999999e-06 2024-09-13T05:12:41.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658466+0000", 2024-09-13T05:12:41.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121975466 2024-09-13T05:12:41.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:41.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658522+0000", 2024-09-13T05:12:41.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5668999999999998e-05 2024-09-13T05:12:41.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:41.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658595+0000", 2024-09-13T05:12:41.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2800999999999996e-05 2024-09-13T05:12:41.307 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.307 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:41.307 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.307 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162622 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 72704~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:41.308 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:12:41.308 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.711817720999999, 2024-09-13T05:12:41.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124215569, 2024-09-13T05:12:41.308 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:41.308 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:41.308 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:41.308 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:41.308 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:41.308 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162622 2024-09-13T05:12:41.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.308 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:41.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:41.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:12:41.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:41.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:12:41.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:41.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534537+0000", 2024-09-13T05:12:41.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:41.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:41.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534540+0000", 2024-09-13T05:12:41.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3740000000000001e-06 2024-09-13T05:12:41.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:41.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534545+0000", 2024-09-13T05:12:41.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4210000000000003e-06 2024-09-13T05:12:41.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:41.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534550+0000", 2024-09-13T05:12:41.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3090000000000003e-06 2024-09-13T05:12:41.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536510+0000", 2024-09-13T05:12:41.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019597130000000001 2024-09-13T05:12:41.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:41.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536517+0000", 2024-09-13T05:12:41.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0620000000000003e-06 2024-09-13T05:12:41.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658632+0000", 2024-09-13T05:12:41.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122114373 2024-09-13T05:12:41.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:41.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658686+0000", 2024-09-13T05:12:41.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3882999999999999e-05 2024-09-13T05:12:41.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:41.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658753+0000", 2024-09-13T05:12:41.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7921000000000002e-05 2024-09-13T05:12:41.312 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.312 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:41.312 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.313 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162623 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 73728~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:41.313 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:12:41.313 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.711800916000001, 2024-09-13T05:12:41.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124350214, 2024-09-13T05:12:41.313 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:41.313 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:41.313 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:41.313 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:41.313 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:41.313 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162623 2024-09-13T05:12:41.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.313 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:41.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:41.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:12:41.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:41.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:12:41.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:41.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534554+0000", 2024-09-13T05:12:41.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:41.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:41.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534556+0000", 2024-09-13T05:12:41.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-13T05:12:41.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:41.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534563+0000", 2024-09-13T05:12:41.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2890000000000003e-06 2024-09-13T05:12:41.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:41.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534567+0000", 2024-09-13T05:12:41.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4880000000000001e-06 2024-09-13T05:12:41.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536538+0000", 2024-09-13T05:12:41.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019703989999999998 2024-09-13T05:12:41.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:41.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536543+0000", 2024-09-13T05:12:41.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3920000000000002e-06 2024-09-13T05:12:41.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658773+0000", 2024-09-13T05:12:41.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122229607 2024-09-13T05:12:41.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:41.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658835+0000", 2024-09-13T05:12:41.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1954999999999999e-05 2024-09-13T05:12:41.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:41.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658905+0000", 2024-09-13T05:12:41.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-09-13T05:12:41.317 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.318 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:41.318 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.318 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162626 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 65536~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:41.318 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:41.318 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.711749632, 2024-09-13T05:12:41.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124425881, 2024-09-13T05:12:41.318 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:41.318 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:41.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:41.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:41.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:41.319 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162626 2024-09-13T05:12:41.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.319 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:41.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:41.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:41.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:41.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:41.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:41.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:41.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:41.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:41.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534611+0000", 2024-09-13T05:12:41.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5419999999999996e-06 2024-09-13T05:12:41.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:41.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534617+0000", 2024-09-13T05:12:41.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5169999999999999e-06 2024-09-13T05:12:41.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:41.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534622+0000", 2024-09-13T05:12:41.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9810000000000003e-06 2024-09-13T05:12:41.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536563+0000", 2024-09-13T05:12:41.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019410549999999999 2024-09-13T05:12:41.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:41.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536568+0000", 2024-09-13T05:12:41.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4310000000000002e-06 2024-09-13T05:12:41.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658922+0000", 2024-09-13T05:12:41.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122354221 2024-09-13T05:12:41.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:41.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658968+0000", 2024-09-13T05:12:41.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5221e-05 2024-09-13T05:12:41.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:41.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659032+0000", 2024-09-13T05:12:41.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4256000000000003e-05 2024-09-13T05:12:41.323 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.323 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:41.323 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.323 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162628 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 66560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:41.323 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:41.323 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.711714681, 2024-09-13T05:12:41.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124532254, 2024-09-13T05:12:41.324 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:41.324 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:41.324 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:41.324 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:41.324 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:41.324 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162628 2024-09-13T05:12:41.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.324 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:41.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:41.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:41.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:41.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:41.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:41.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:41.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:41.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:41.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534643+0000", 2024-09-13T05:12:41.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1890000000000001e-06 2024-09-13T05:12:41.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:41.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534648+0000", 2024-09-13T05:12:41.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:12:41.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:41.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534652+0000", 2024-09-13T05:12:41.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4549999999999997e-06 2024-09-13T05:12:41.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536586+0000", 2024-09-13T05:12:41.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019336049999999999 2024-09-13T05:12:41.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:41.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536591+0000", 2024-09-13T05:12:41.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3770000000000004e-06 2024-09-13T05:12:41.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659062+0000", 2024-09-13T05:12:41.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122470685 2024-09-13T05:12:41.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:41.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659106+0000", 2024-09-13T05:12:41.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3856000000000002e-05 2024-09-13T05:12:41.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:41.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659173+0000", 2024-09-13T05:12:41.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7168000000000005e-05 2024-09-13T05:12:41.328 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.328 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:41.328 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.328 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162630 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 67584~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:41.329 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:41.329 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.711681474999999, 2024-09-13T05:12:41.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12468555100000001, 2024-09-13T05:12:41.329 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:41.329 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:41.329 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:41.329 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:41.329 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:41.329 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162630 2024-09-13T05:12:41.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.329 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:41.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:41.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:41.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:41.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:41.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:41.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:41.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:41.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:41.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534676+0000", 2024-09-13T05:12:41.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4399999999999999e-06 2024-09-13T05:12:41.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:41.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534681+0000", 2024-09-13T05:12:41.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2349999999999999e-06 2024-09-13T05:12:41.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:41.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534686+0000", 2024-09-13T05:12:41.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5499999999999996e-06 2024-09-13T05:12:41.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536609+0000", 2024-09-13T05:12:41.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001923407 2024-09-13T05:12:41.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:41.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536615+0000", 2024-09-13T05:12:41.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1499999999999998e-06 2024-09-13T05:12:41.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659233+0000", 2024-09-13T05:12:41.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122618957 2024-09-13T05:12:41.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:41.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659294+0000", 2024-09-13T05:12:41.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0251000000000003e-05 2024-09-13T05:12:41.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:41.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659360+0000", 2024-09-13T05:12:41.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5906000000000002e-05 2024-09-13T05:12:41.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.334 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:41.334 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.334 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162633 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 69632~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:41.334 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:41.334 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.711573569999999, 2024-09-13T05:12:41.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124702147, 2024-09-13T05:12:41.334 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:41.334 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:41.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:41.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:41.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:41.334 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162633 2024-09-13T05:12:41.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.335 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:41.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:41.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:41.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:41.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:41.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:41.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:41.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:41.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:41.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534784+0000", 2024-09-13T05:12:41.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3300000000000001e-06 2024-09-13T05:12:41.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:41.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534789+0000", 2024-09-13T05:12:41.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4149999999999998e-06 2024-09-13T05:12:41.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:41.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534794+0000", 2024-09-13T05:12:41.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5669999999999996e-06 2024-09-13T05:12:41.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536634+0000", 2024-09-13T05:12:41.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001840401 2024-09-13T05:12:41.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:41.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536642+0000", 2024-09-13T05:12:41.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9729999999999997e-06 2024-09-13T05:12:41.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659383+0000", 2024-09-13T05:12:41.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12274112099999999 2024-09-13T05:12:41.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:41.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659424+0000", 2024-09-13T05:12:41.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0936000000000002e-05 2024-09-13T05:12:41.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:41.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659484+0000", 2024-09-13T05:12:41.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9775000000000003e-05 2024-09-13T05:12:41.339 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.339 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:41.339 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.339 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162675 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 68608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:41.339 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:41.339 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.711524526000002, 2024-09-13T05:12:41.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124823974, 2024-09-13T05:12:41.339 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:41.339 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:41.340 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:41.340 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:41.340 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:41.340 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162675 2024-09-13T05:12:41.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.340 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:41.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:41.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:41.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:41.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:41.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:41.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:41.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:41.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:41.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534833+0000", 2024-09-13T05:12:41.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.204e-06 2024-09-13T05:12:41.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:41.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534838+0000", 2024-09-13T05:12:41.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0130000000000001e-06 2024-09-13T05:12:41.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:41.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534842+0000", 2024-09-13T05:12:41.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.51e-06 2024-09-13T05:12:41.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536661+0000", 2024-09-13T05:12:41.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018186039999999999 2024-09-13T05:12:41.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:41.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536667+0000", 2024-09-13T05:12:41.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5260000000000001e-06 2024-09-13T05:12:41.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659531+0000", 2024-09-13T05:12:41.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122864403 2024-09-13T05:12:41.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:41.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659583+0000", 2024-09-13T05:12:41.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1564000000000003e-05 2024-09-13T05:12:41.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:41.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659655+0000", 2024-09-13T05:12:41.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2504999999999998e-05 2024-09-13T05:12:41.344 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.344 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:41.344 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.344 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:163257 3.8 3:1136e8de:::rbd_data.112dbd21872d.000000000000003c:28 [read 200704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:41.344 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:41.344 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.696509320000001, 2024-09-13T05:12:41.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12163807, 2024-09-13T05:12:41.344 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:41.345 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:41.345 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:41.345 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:41.345 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:41.345 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 163257 2024-09-13T05:12:41.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.345 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:41.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:41.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:41.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:41.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:41.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:41.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:41.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:41.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:41.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549848+0000", 2024-09-13T05:12:41.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1789999999999998e-06 2024-09-13T05:12:41.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:41.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549854+0000", 2024-09-13T05:12:41.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9050000000000002e-06 2024-09-13T05:12:41.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:41.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549858+0000", 2024-09-13T05:12:41.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3529999999999997e-06 2024-09-13T05:12:41.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.551228+0000", 2024-09-13T05:12:41.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001369227 2024-09-13T05:12:41.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:41.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.551233+0000", 2024-09-13T05:12:41.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5860000000000004e-06 2024-09-13T05:12:41.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671337+0000", 2024-09-13T05:12:41.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.120104265 2024-09-13T05:12:41.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:41.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671425+0000", 2024-09-13T05:12:41.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7810000000000001e-05 2024-09-13T05:12:41.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:41.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671484+0000", 2024-09-13T05:12:41.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9079000000000001e-05 2024-09-13T05:12:41.349 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.349 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:41.349 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.349 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:170203 3.1e 3:7c9b1cf4:::rbd_header.112dc3abcba6:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128)", 2024-09-13T05:12:41.349 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:12:41.349 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.431545555, 2024-09-13T05:12:41.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.79948714899999995, 2024-09-13T05:12:41.350 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:41.350 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:41.350 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:41.350 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:41.350 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:41.350 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 170203 2024-09-13T05:12:41.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.350 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:41.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:41.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:12:41.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:41.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:12:41.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:41.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:41.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814808+0000", 2024-09-13T05:12:41.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:41.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:41.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814820+0000", 2024-09-13T05:12:41.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.206e-05 2024-09-13T05:12:41.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:41.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814841+0000", 2024-09-13T05:12:41.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1464999999999999e-05 2024-09-13T05:12:41.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:41.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814853+0000", 2024-09-13T05:12:41.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1824999999999999e-05 2024-09-13T05:12:41.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814911+0000", 2024-09-13T05:12:41.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8255999999999999e-05 2024-09-13T05:12:41.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:41.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814918+0000", 2024-09-13T05:12:41.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7120000000000003e-06 2024-09-13T05:12:41.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:41.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.611660+0000", 2024-09-13T05:12:41.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.79674180100000003 2024-09-13T05:12:41.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:41.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.611911+0000", 2024-09-13T05:12:41.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025108900000000002 2024-09-13T05:12:41.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-13T05:12:41.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.612726+0000", 2024-09-13T05:12:41.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00081512999999999996 2024-09-13T05:12:41.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:41.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614087+0000", 2024-09-13T05:12:41.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013607560000000001 2024-09-13T05:12:41.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:12:41.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614095+0000", 2024-09-13T05:12:41.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3240000000000003e-06 2024-09-13T05:12:41.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:12:41.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614138+0000", 2024-09-13T05:12:41.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3115000000000003e-05 2024-09-13T05:12:41.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:41.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:41.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:41.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614297+0000", 2024-09-13T05:12:41.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015875399999999999 2024-09-13T05:12:41.355 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.356 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:41.356 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.356 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:41.356 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:41.356 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:41.357 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:12:41.358 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:12:41.358 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:41.358 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:41.358 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:41.358 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:41.355+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:41.362 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:41.384 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:41.404 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:41.427 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:41.429 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:12:41.429 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:41.429 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:41.429 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:41.430 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:41.430 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:41.430 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:41.430 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:41.457 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:41.455+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:41.478 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:41.478 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:41.488 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:12:41.559 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:41.555+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:41.593 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:41.594 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:41.604 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:12:41.660 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:41.656+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:41.716 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:41.716 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:41.726 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:12:41.774 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:41.772+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:41.861 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:41.856+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:41.868 INFO:tasks.thrashosds.thrasher:in_osds: [2, 3, 5, 7, 1, 4] out_osds: [0, 6] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-13T05:12:41.868 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:12:41.868 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-13T05:12:41.868 INFO:tasks.thrashosds.thrasher:Setting osd 5 primary_affinity to 1.000000 2024-09-13T05:12:41.868 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-13T05:12:41.894 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:41.894 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:41.906 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:12:41.918 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T05:12:41.962 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:41.960+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:42.024 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:42.024 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:42.035 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:12:42.063 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:42.059+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:42.147 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:42.147 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:42.157 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:12:42.164 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:42.159+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:42.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:12:42.243+0000 7f4fdcaca700 0 --2- 172.21.15.120:0/3482574631 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4fd8139870 0x7f4fd80a8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-13T05:12:42.265 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:42.263+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:42.278 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:42.278 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:42.288 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:12:42.367 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:42.363+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:42.406 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:42.407 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:42.418 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:12:42.467 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:42.463+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:42.523 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:42.524 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:42.534 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:12:42.567 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:42.564+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:42.643 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:42.643 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:42.653 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:12:42.694 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:42.692+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:42.769 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:42.767+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:42.807 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:42.807 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:42.817 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:12:42.871 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:42.867+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:42.928 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:42.928 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:42.935 INFO:teuthology.orchestra.run.smithi120.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-13T05:12:42.936 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is unset 2024-09-13T05:12:42.944 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:12:42.993 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:42.991+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:43.046 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:43.046 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:43.056 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:12:43.073 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:43.068+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:43.173 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:43.173 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:43.174 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:43.172+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:43.184 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:12:43.274 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:43.271+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:43.294 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:43.294 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:43.304 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:12:43.376 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:43.372+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:43.442 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:12:43.461 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:43.461 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:43.472 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:12:43.476 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:43.472+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:43.577 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:43.575+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:43.579 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:43.579 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:43.589 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:12:43.592 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:12:43.611 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:43.633 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:43.656 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:43.678 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:43.679 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:43.676+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:43.706 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:43.719 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:43.719 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:43.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:43.720 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:43.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.720 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:159451 3.1b e117/116 3:d9c87acb:::rbd_data.112dc3abcba6.0000000000000003:head v 117'567, mlcod=0'0)", 2024-09-13T05:12:43.720 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:12:43.720 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.777755092, 2024-09-13T05:12:43.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064897325000000006, 2024-09-13T05:12:43.721 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:43.721 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:43.721 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:43.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:43.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:12:43.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:43.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:12:43.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:43.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938207+0000", 2024-09-13T05:12:43.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:43.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:43.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972794+0000", 2024-09-13T05:12:43.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.034587013 2024-09-13T05:12:43.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:43.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972821+0000", 2024-09-13T05:12:43.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6764e-05 2024-09-13T05:12:43.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:43.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972841+0000", 2024-09-13T05:12:43.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0191999999999999e-05 2024-09-13T05:12:43.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:43.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972905+0000", 2024-09-13T05:12:43.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4319000000000005e-05 2024-09-13T05:12:43.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:43.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972927+0000", 2024-09-13T05:12:43.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1135999999999999e-05 2024-09-13T05:12:43.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:12:43.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.002964+0000", 2024-09-13T05:12:43.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.030037123999999998 2024-09-13T05:12:43.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:43.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.003105+0000", 2024-09-13T05:12:43.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141614 2024-09-13T05:12:43.730 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.730 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:43.730 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.730 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159495 3.0 3:022f4da1:::rbd_data.112dfd94ee88.00000000000000e4:2a [read 167936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:43.731 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:12:43.731 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.702615670999997, 2024-09-13T05:12:43.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91926946899999995, 2024-09-13T05:12:43.731 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:43.731 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:43.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:43.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:43.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:43.732 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159495 2024-09-13T05:12:43.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.732 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:43.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:43.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:12:43.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:43.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:12:43.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:43.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013345+0000", 2024-09-13T05:12:43.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999971 2024-09-13T05:12:43.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:43.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013359+0000", 2024-09-13T05:12:43.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4752999999999999e-05 2024-09-13T05:12:43.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:43.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013418+0000", 2024-09-13T05:12:43.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8959000000000003e-05 2024-09-13T05:12:43.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:43.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013439+0000", 2024-09-13T05:12:43.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0749000000000001e-05 2024-09-13T05:12:43.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:43.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013563+0000", 2024-09-13T05:12:43.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012349400000000001 2024-09-13T05:12:43.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:43.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013583+0000", 2024-09-13T05:12:43.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0007e-05 2024-09-13T05:12:43.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:43.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932400+0000", 2024-09-13T05:12:43.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91881732400000005 2024-09-13T05:12:43.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:43.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932533+0000", 2024-09-13T05:12:43.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013263700000000001 2024-09-13T05:12:43.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:43.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932617+0000", 2024-09-13T05:12:43.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4313000000000004e-05 2024-09-13T05:12:43.742 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.742 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:43.742 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.743 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159517 3.0 3:03975f1c:::rbd_data.112dfd94ee88.0000000000000156:2a [read 167936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:43.743 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:12:43.743 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.702351956999998, 2024-09-13T05:12:43.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91962025700000005, 2024-09-13T05:12:43.743 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:43.744 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:43.744 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:43.744 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:43.744 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:43.744 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159517 2024-09-13T05:12:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:12:43.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:12:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013609+0000", 2024-09-13T05:12:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013619+0000", 2024-09-13T05:12:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0077e-05 2024-09-13T05:12:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013638+0000", 2024-09-13T05:12:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8739000000000001e-05 2024-09-13T05:12:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013653+0000", 2024-09-13T05:12:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5446000000000001e-05 2024-09-13T05:12:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016506+0000", 2024-09-13T05:12:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028525619999999999 2024-09-13T05:12:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016521+0000", 2024-09-13T05:12:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5310000000000001e-05 2024-09-13T05:12:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932964+0000", 2024-09-13T05:12:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91644284099999995 2024-09-13T05:12:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933097+0000", 2024-09-13T05:12:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013337599999999999 2024-09-13T05:12:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933231+0000", 2024-09-13T05:12:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133996 2024-09-13T05:12:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159622 3.0 3:03f7a45a:::rbd_data.112dfd94ee88.0000000000000318:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:12:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.700690145999999, 2024-09-13T05:12:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.918245003, 2024-09-13T05:12:43.751 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159622 2024-09-13T05:12:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:12:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:12:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015266+0000", 2024-09-13T05:12:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999928 2024-09-13T05:12:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015283+0000", 2024-09-13T05:12:43.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7309999999999999e-05 2024-09-13T05:12:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015318+0000", 2024-09-13T05:12:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5119e-05 2024-09-13T05:12:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015338+0000", 2024-09-13T05:12:43.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9259e-05 2024-09-13T05:12:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016558+0000", 2024-09-13T05:12:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012199909999999999 2024-09-13T05:12:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016567+0000", 2024-09-13T05:12:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2459999999999992e-06 2024-09-13T05:12:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933266+0000", 2024-09-13T05:12:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91669950300000003 2024-09-13T05:12:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:43.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:12:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015788099999999999 2024-09-13T05:12:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933518+0000", 2024-09-13T05:12:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3721000000000006e-05 2024-09-13T05:12:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:43.757 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.758 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173445 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 150528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:43.758 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:12:43.758 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.536113360999998, 2024-09-13T05:12:43.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064560905000000002, 2024-09-13T05:12:43.758 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:43.758 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:43.758 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:43.758 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:43.758 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:43.759 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173445 2024-09-13T05:12:43.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.759 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:43.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:43.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:12:43.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:43.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:12:43.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:43.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179849+0000", 2024-09-13T05:12:43.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:43.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179860+0000", 2024-09-13T05:12:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0419e-05 2024-09-13T05:12:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179866+0000", 2024-09-13T05:12:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.567e-06 2024-09-13T05:12:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:43.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179872+0000", 2024-09-13T05:12:43.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1830000000000002e-06 2024-09-13T05:12:43.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:43.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244262+0000", 2024-09-13T05:12:43.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064390814000000005 2024-09-13T05:12:43.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:43.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244321+0000", 2024-09-13T05:12:43.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8341000000000003e-05 2024-09-13T05:12:43.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:43.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244411+0000", 2024-09-13T05:12:43.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9911e-05 2024-09-13T05:12:43.763 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.763 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:43.763 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.763 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173446 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 157696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:43.764 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:12:43.764 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.536086594, 2024-09-13T05:12:43.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064714007000000004, 2024-09-13T05:12:43.764 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:43.764 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:43.764 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:43.764 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:43.764 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:43.764 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173446 2024-09-13T05:12:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:12:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:12:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179876+0000", 2024-09-13T05:12:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179879+0000", 2024-09-13T05:12:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1489999999999998e-06 2024-09-13T05:12:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179884+0000", 2024-09-13T05:12:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2800000000000003e-06 2024-09-13T05:12:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179889+0000", 2024-09-13T05:12:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7620000000000003e-06 2024-09-13T05:12:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244452+0000", 2024-09-13T05:12:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064562943999999997 2024-09-13T05:12:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:43.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244512+0000", 2024-09-13T05:12:43.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9879e-05 2024-09-13T05:12:43.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:43.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244591+0000", 2024-09-13T05:12:43.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8701000000000004e-05 2024-09-13T05:12:43.768 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.768 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:43.768 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173447 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 164864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:12:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.536069846, 2024-09-13T05:12:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064866246000000002, 2024-09-13T05:12:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173447 2024-09-13T05:12:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:43.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:43.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:12:43.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:43.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:12:43.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:12:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179895+0000", 2024-09-13T05:12:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6910000000000002e-06 2024-09-13T05:12:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179901+0000", 2024-09-13T05:12:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5149999999999997e-06 2024-09-13T05:12:43.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179905+0000", 2024-09-13T05:12:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4170000000000002e-06 2024-09-13T05:12:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244615+0000", 2024-09-13T05:12:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064709533999999999 2024-09-13T05:12:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:43.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244665+0000", 2024-09-13T05:12:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0283e-05 2024-09-13T05:12:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244760+0000", 2024-09-13T05:12:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4310999999999999e-05 2024-09-13T05:12:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.773 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173448 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 172032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:43.774 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:12:43.774 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.536054, 2024-09-13T05:12:43.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065022046999999999, 2024-09-13T05:12:43.774 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:43.774 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:43.774 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:43.774 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:43.774 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:43.774 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173448 2024-09-13T05:12:43.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.774 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:12:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:12:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:12:43.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179914+0000", 2024-09-13T05:12:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6699999999999999e-06 2024-09-13T05:12:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179921+0000", 2024-09-13T05:12:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:12:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179926+0000", 2024-09-13T05:12:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8659999999999997e-06 2024-09-13T05:12:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244782+0000", 2024-09-13T05:12:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064856570000000002 2024-09-13T05:12:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244857+0000", 2024-09-13T05:12:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4326999999999995e-05 2024-09-13T05:12:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:43.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244931+0000", 2024-09-13T05:12:43.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4443999999999994e-05 2024-09-13T05:12:43.778 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.778 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:43.778 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.778 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173450 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 179200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:43.778 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:12:43.779 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.536033165999999, 2024-09-13T05:12:43.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065192589999999995, 2024-09-13T05:12:43.779 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:43.779 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:43.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:43.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:43.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:43.779 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173450 2024-09-13T05:12:43.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.779 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:43.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:43.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:12:43.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:43.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:12:43.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:43.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:12:43.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:43.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179932+0000", 2024-09-13T05:12:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2529999999999999e-06 2024-09-13T05:12:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179937+0000", 2024-09-13T05:12:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4219999999999999e-06 2024-09-13T05:12:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179942+0000", 2024-09-13T05:12:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3250000000000001e-06 2024-09-13T05:12:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244969+0000", 2024-09-13T05:12:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065027794999999999 2024-09-13T05:12:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245048+0000", 2024-09-13T05:12:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8812000000000004e-05 2024-09-13T05:12:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245123+0000", 2024-09-13T05:12:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4342000000000001e-05 2024-09-13T05:12:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173451 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:12:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.536017179000002, 2024-09-13T05:12:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359814000000002, 2024-09-13T05:12:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:43.784 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173451 2024-09-13T05:12:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:12:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:12:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:12:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179948+0000", 2024-09-13T05:12:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5119999999999998e-06 2024-09-13T05:12:43.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:43.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179954+0000", 2024-09-13T05:12:43.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5840000000000002e-06 2024-09-13T05:12:43.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:43.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179958+0000", 2024-09-13T05:12:43.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.566e-06 2024-09-13T05:12:43.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245160+0000", 2024-09-13T05:12:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065202057999999993 2024-09-13T05:12:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245228+0000", 2024-09-13T05:12:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7257999999999999e-05 2024-09-13T05:12:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245306+0000", 2024-09-13T05:12:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8227999999999997e-05 2024-09-13T05:12:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173452 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 193536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:12:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.536000692000002, 2024-09-13T05:12:43.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065505701, 2024-09-13T05:12:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173452 2024-09-13T05:12:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:12:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:12:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:12:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179965+0000", 2024-09-13T05:12:43.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.402e-06 2024-09-13T05:12:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179970+0000", 2024-09-13T05:12:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2290000000000002e-06 2024-09-13T05:12:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179974+0000", 2024-09-13T05:12:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5070000000000002e-06 2024-09-13T05:12:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245329+0000", 2024-09-13T05:12:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065354906000000004 2024-09-13T05:12:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245390+0000", 2024-09-13T05:12:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0878999999999998e-05 2024-09-13T05:12:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245468+0000", 2024-09-13T05:12:43.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8073999999999998e-05 2024-09-13T05:12:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173453 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 198656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:12:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.535984425999999, 2024-09-13T05:12:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065664343, 2024-09-13T05:12:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173453 2024-09-13T05:12:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:12:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:12:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179978+0000", 2024-09-13T05:12:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179981+0000", 2024-09-13T05:12:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4140000000000001e-06 2024-09-13T05:12:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179986+0000", 2024-09-13T05:12:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3519999999999997e-06 2024-09-13T05:12:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179991+0000", 2024-09-13T05:12:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6739999999999996e-06 2024-09-13T05:12:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245495+0000", 2024-09-13T05:12:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065504229999999997 2024-09-13T05:12:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245563+0000", 2024-09-13T05:12:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8119000000000003e-05 2024-09-13T05:12:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245643+0000", 2024-09-13T05:12:43.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9861e-05 2024-09-13T05:12:43.799 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.799 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:43.799 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.799 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173454 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:43.799 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:12:43.799 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.535936038999999, 2024-09-13T05:12:43.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065750457999999998, 2024-09-13T05:12:43.799 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:43.800 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:43.800 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:43.800 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:43.800 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:43.800 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173454 2024-09-13T05:12:43.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.800 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:43.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:43.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:12:43.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:43.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:12:43.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:43.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180026+0000", 2024-09-13T05:12:43.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180030+0000", 2024-09-13T05:12:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3790000000000002e-06 2024-09-13T05:12:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180036+0000", 2024-09-13T05:12:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5889999999999999e-06 2024-09-13T05:12:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180041+0000", 2024-09-13T05:12:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9980000000000003e-06 2024-09-13T05:12:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245667+0000", 2024-09-13T05:12:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065625124000000007 2024-09-13T05:12:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:43.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245705+0000", 2024-09-13T05:12:43.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7994000000000002e-05 2024-09-13T05:12:43.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:43.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245778+0000", 2024-09-13T05:12:43.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2999999999999999e-05 2024-09-13T05:12:43.804 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.804 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:43.804 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173455 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 212992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:12:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.535917331, 2024-09-13T05:12:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065899773999999994, 2024-09-13T05:12:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:43.805 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173455 2024-09-13T05:12:43.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.806 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:43.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:43.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:12:43.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:43.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:12:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180045+0000", 2024-09-13T05:12:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180048+0000", 2024-09-13T05:12:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5830000000000001e-06 2024-09-13T05:12:43.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:43.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180054+0000", 2024-09-13T05:12:43.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.789e-06 2024-09-13T05:12:43.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:43.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180059+0000", 2024-09-13T05:12:43.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.933e-06 2024-09-13T05:12:43.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245801+0000", 2024-09-13T05:12:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065742520999999998 2024-09-13T05:12:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245865+0000", 2024-09-13T05:12:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3325999999999996e-05 2024-09-13T05:12:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245946+0000", 2024-09-13T05:12:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0964999999999995e-05 2024-09-13T05:12:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173456 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:12:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.535900099999999, 2024-09-13T05:12:43.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066035128999999998, 2024-09-13T05:12:43.811 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:43.811 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:43.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:43.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:43.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:43.811 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173456 2024-09-13T05:12:43.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.811 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:43.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:43.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:12:43.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:43.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:12:43.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:12:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180065+0000", 2024-09-13T05:12:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4250000000000001e-06 2024-09-13T05:12:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:43.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180070+0000", 2024-09-13T05:12:43.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1749999999999996e-06 2024-09-13T05:12:43.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:43.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180075+0000", 2024-09-13T05:12:43.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4769999999999997e-06 2024-09-13T05:12:43.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:43.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245969+0000", 2024-09-13T05:12:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065894182999999995 2024-09-13T05:12:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246027+0000", 2024-09-13T05:12:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8165999999999998e-05 2024-09-13T05:12:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246098+0000", 2024-09-13T05:12:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1068999999999993e-05 2024-09-13T05:12:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:43.815 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173458 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:12:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.535884116999998, 2024-09-13T05:12:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066134732000000002, 2024-09-13T05:12:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:43.816 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173458 2024-09-13T05:12:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:12:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:12:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:12:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180081+0000", 2024-09-13T05:12:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4150000000000002e-06 2024-09-13T05:12:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:43.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180087+0000", 2024-09-13T05:12:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5389999999999998e-06 2024-09-13T05:12:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180101+0000", 2024-09-13T05:12:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4537e-05 2024-09-13T05:12:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246119+0000", 2024-09-13T05:12:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066017701999999998 2024-09-13T05:12:43.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246155+0000", 2024-09-13T05:12:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6094999999999999e-05 2024-09-13T05:12:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246214+0000", 2024-09-13T05:12:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8789000000000002e-05 2024-09-13T05:12:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173459 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 234496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:12:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.535856593999998, 2024-09-13T05:12:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066227460000000002, 2024-09-13T05:12:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173459 2024-09-13T05:12:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:43.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:43.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:12:43.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:43.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:12:43.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180106+0000", 2024-09-13T05:12:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180109+0000", 2024-09-13T05:12:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2219999999999998e-06 2024-09-13T05:12:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180115+0000", 2024-09-13T05:12:43.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9190000000000004e-06 2024-09-13T05:12:43.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:43.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180120+0000", 2024-09-13T05:12:43.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8930000000000004e-06 2024-09-13T05:12:43.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:43.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246236+0000", 2024-09-13T05:12:43.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066115638000000004 2024-09-13T05:12:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246273+0000", 2024-09-13T05:12:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7083999999999999e-05 2024-09-13T05:12:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246334+0000", 2024-09-13T05:12:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1183e-05 2024-09-13T05:12:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:43.825 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173460 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 241664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:12:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.535838788, 2024-09-13T05:12:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066360459999999996, 2024-09-13T05:12:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:43.826 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:43.827 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:43.827 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173460 2024-09-13T05:12:43.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.827 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:43.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:43.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:12:43.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:12:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:12:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:43.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180126+0000", 2024-09-13T05:12:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3120000000000001e-06 2024-09-13T05:12:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180132+0000", 2024-09-13T05:12:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.105e-06 2024-09-13T05:12:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180137+0000", 2024-09-13T05:12:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6829999999999999e-06 2024-09-13T05:12:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246365+0000", 2024-09-13T05:12:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066227584000000006 2024-09-13T05:12:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246413+0000", 2024-09-13T05:12:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8479000000000001e-05 2024-09-13T05:12:43.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246485+0000", 2024-09-13T05:12:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1600000000000006e-05 2024-09-13T05:12:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173461 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:12:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.535820018999999, 2024-09-13T05:12:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066492449999999995, 2024-09-13T05:12:43.831 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173461 2024-09-13T05:12:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:12:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:12:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:12:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180149+0000", 2024-09-13T05:12:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7239999999999997e-06 2024-09-13T05:12:43.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:43.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180153+0000", 2024-09-13T05:12:43.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7859999999999996e-06 2024-09-13T05:12:43.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:43.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180158+0000", 2024-09-13T05:12:43.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0300000000000001e-06 2024-09-13T05:12:43.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246508+0000", 2024-09-13T05:12:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066350100999999995 2024-09-13T05:12:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246568+0000", 2024-09-13T05:12:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9500000000000003e-05 2024-09-13T05:12:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:43.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246636+0000", 2024-09-13T05:12:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7633999999999997e-05 2024-09-13T05:12:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173462 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 256000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:12:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.534987190999999, 2024-09-13T05:12:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065773376999999994, 2024-09-13T05:12:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:43.836 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173462 2024-09-13T05:12:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:12:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:12:43.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180162+0000", 2024-09-13T05:12:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9991865 2024-09-13T05:12:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180984+0000", 2024-09-13T05:12:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00082184599999999999 2024-09-13T05:12:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:43.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180994+0000", 2024-09-13T05:12:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9000000000000001e-06 2024-09-13T05:12:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.181001+0000", 2024-09-13T05:12:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.917e-06 2024-09-13T05:12:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246653+0000", 2024-09-13T05:12:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065651820999999999 2024-09-13T05:12:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246698+0000", 2024-09-13T05:12:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.473e-05 2024-09-13T05:12:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246749+0000", 2024-09-13T05:12:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1758999999999997e-05 2024-09-13T05:12:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:43.840 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:43.840 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:43.842 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:12:43.842 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:43.843 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:43.843 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:12:43.843 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:43.843 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:43.844 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:43.844 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:43.844 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:43.844 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:43.844 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:43.844 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:43.839+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:43.943 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:43.940+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:44.002 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:44.002 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:44.002 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:44.002 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:44.012 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:12:44.044 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:44.040+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:44.114 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:44.115 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:44.123 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:12:44.145 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:44.140+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:44.230 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136560 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3908608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:12:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.133579097000002, 2024-09-13T05:12:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056148103999999997, 2024-09-13T05:12:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.231 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136560 2024-09-13T05:12:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:12:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:12:44.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095289+0000", 2024-09-13T05:12:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095292+0000", 2024-09-13T05:12:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.802e-06 2024-09-13T05:12:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095318+0000", 2024-09-13T05:12:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5987999999999999e-05 2024-09-13T05:12:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095323+0000", 2024-09-13T05:12:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.006e-06 2024-09-13T05:12:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151316+0000", 2024-09-13T05:12:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055992593 2024-09-13T05:12:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151371+0000", 2024-09-13T05:12:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5532999999999998e-05 2024-09-13T05:12:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151438+0000", 2024-09-13T05:12:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6557999999999995e-05 2024-09-13T05:12:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136562 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3922944~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:44.235 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.133541979, 2024-09-13T05:12:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056259690000000001, 2024-09-13T05:12:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136562 2024-09-13T05:12:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:44.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095329+0000", 2024-09-13T05:12:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3089999999999998e-06 2024-09-13T05:12:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095333+0000", 2024-09-13T05:12:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6239999999999999e-06 2024-09-13T05:12:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095335+0000", 2024-09-13T05:12:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5660000000000001e-06 2024-09-13T05:12:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151468+0000", 2024-09-13T05:12:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056132608000000001 2024-09-13T05:12:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151519+0000", 2024-09-13T05:12:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1681000000000002e-05 2024-09-13T05:12:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151587+0000", 2024-09-13T05:12:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7200999999999996e-05 2024-09-13T05:12:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136563 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3937280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.133530557, 2024-09-13T05:12:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056393051999999999, 2024-09-13T05:12:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136563 2024-09-13T05:12:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.240 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:12:44.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095340+0000", 2024-09-13T05:12:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.561e-06 2024-09-13T05:12:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095342+0000", 2024-09-13T05:12:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8059999999999999e-06 2024-09-13T05:12:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095345+0000", 2024-09-13T05:12:44.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:12:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151621+0000", 2024-09-13T05:12:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056275602000000001 2024-09-13T05:12:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151670+0000", 2024-09-13T05:12:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9478000000000003e-05 2024-09-13T05:12:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151731+0000", 2024-09-13T05:12:44.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1054000000000002e-05 2024-09-13T05:12:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136565 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3951616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:12:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.133520243, 2024-09-13T05:12:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056524090999999999, 2024-09-13T05:12:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.244 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136565 2024-09-13T05:12:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:12:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:12:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095348+0000", 2024-09-13T05:12:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:12:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095350+0000", 2024-09-13T05:12:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4479999999999999e-06 2024-09-13T05:12:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095353+0000", 2024-09-13T05:12:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.909e-06 2024-09-13T05:12:44.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095356+0000", 2024-09-13T05:12:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:12:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151763+0000", 2024-09-13T05:12:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056407813000000001 2024-09-13T05:12:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151812+0000", 2024-09-13T05:12:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8306999999999997e-05 2024-09-13T05:12:44.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151873+0000", 2024-09-13T05:12:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1064999999999999e-05 2024-09-13T05:12:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136567 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3965952~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:12:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.133511218000002, 2024-09-13T05:12:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056653907000000003, 2024-09-13T05:12:44.248 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136567 2024-09-13T05:12:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:12:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:12:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095357+0000", 2024-09-13T05:12:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095359+0000", 2024-09-13T05:12:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:12:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095362+0000", 2024-09-13T05:12:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7939999999999998e-06 2024-09-13T05:12:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095365+0000", 2024-09-13T05:12:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9979999999999999e-06 2024-09-13T05:12:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151904+0000", 2024-09-13T05:12:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056539308000000003 2024-09-13T05:12:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151953+0000", 2024-09-13T05:12:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8760000000000001e-05 2024-09-13T05:12:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152012+0000", 2024-09-13T05:12:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8761999999999997e-05 2024-09-13T05:12:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.252 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136569 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3980288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.133475464, 2024-09-13T05:12:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056771237000000002, 2024-09-13T05:12:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136569 2024-09-13T05:12:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095395+0000", 2024-09-13T05:12:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8870000000000001e-06 2024-09-13T05:12:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095402+0000", 2024-09-13T05:12:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6290000000000001e-06 2024-09-13T05:12:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095412+0000", 2024-09-13T05:12:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1730000000000001e-06 2024-09-13T05:12:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152044+0000", 2024-09-13T05:12:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056632016 2024-09-13T05:12:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152093+0000", 2024-09-13T05:12:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9570000000000001e-05 2024-09-13T05:12:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152165+0000", 2024-09-13T05:12:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1443e-05 2024-09-13T05:12:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.256 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136571 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3994624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.133454448999998, 2024-09-13T05:12:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056894741999999998, 2024-09-13T05:12:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136571 2024-09-13T05:12:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.257 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:44.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095418+0000", 2024-09-13T05:12:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0210000000000001e-06 2024-09-13T05:12:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095422+0000", 2024-09-13T05:12:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5310000000000002e-06 2024-09-13T05:12:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095425+0000", 2024-09-13T05:12:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8880000000000001e-06 2024-09-13T05:12:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152198+0000", 2024-09-13T05:12:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056773563999999999 2024-09-13T05:12:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152249+0000", 2024-09-13T05:12:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1168999999999997e-05 2024-09-13T05:12:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152309+0000", 2024-09-13T05:12:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9821999999999997e-05 2024-09-13T05:12:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136573 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4008960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:12:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.133442221999999, 2024-09-13T05:12:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057045810000000002, 2024-09-13T05:12:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136573 2024-09-13T05:12:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:12:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:12:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095426+0000", 2024-09-13T05:12:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095428+0000", 2024-09-13T05:12:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.593e-06 2024-09-13T05:12:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095431+0000", 2024-09-13T05:12:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9610000000000001e-06 2024-09-13T05:12:44.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095434+0000", 2024-09-13T05:12:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:12:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152352+0000", 2024-09-13T05:12:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05691881 2024-09-13T05:12:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152401+0000", 2024-09-13T05:12:44.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8995000000000001e-05 2024-09-13T05:12:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152472+0000", 2024-09-13T05:12:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1060000000000001e-05 2024-09-13T05:12:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136575 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4023296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:12:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.133012229000002, 2024-09-13T05:12:44.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056760069000000003, 2024-09-13T05:12:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136575 2024-09-13T05:12:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:12:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:12:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095437+0000", 2024-09-13T05:12:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9995799 2024-09-13T05:12:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095861+0000", 2024-09-13T05:12:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000424299 2024-09-13T05:12:44.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095869+0000", 2024-09-13T05:12:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5020000000000003e-06 2024-09-13T05:12:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095875+0000", 2024-09-13T05:12:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:12:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152502+0000", 2024-09-13T05:12:44.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056626528000000002 2024-09-13T05:12:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152556+0000", 2024-09-13T05:12:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4271000000000003e-05 2024-09-13T05:12:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152617+0000", 2024-09-13T05:12:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0896000000000001e-05 2024-09-13T05:12:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136577 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4037632~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:12:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.132910774000003, 2024-09-13T05:12:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056798242999999998, 2024-09-13T05:12:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136577 2024-09-13T05:12:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:12:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:12:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095882+0000", 2024-09-13T05:12:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999242 2024-09-13T05:12:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095961+0000", 2024-09-13T05:12:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8864999999999998e-05 2024-09-13T05:12:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095973+0000", 2024-09-13T05:12:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2206e-05 2024-09-13T05:12:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095978+0000", 2024-09-13T05:12:44.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0629999999999996e-06 2024-09-13T05:12:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152646+0000", 2024-09-13T05:12:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056668035999999998 2024-09-13T05:12:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152695+0000", 2024-09-13T05:12:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8634000000000002e-05 2024-09-13T05:12:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152756+0000", 2024-09-13T05:12:44.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1315000000000005e-05 2024-09-13T05:12:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136579 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4051968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:12:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.132582679000002, 2024-09-13T05:12:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056610869000000001, 2024-09-13T05:12:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.274 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136579 2024-09-13T05:12:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:12:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:12:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095989+0000", 2024-09-13T05:12:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997029 2024-09-13T05:12:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096291+0000", 2024-09-13T05:12:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030221499999999999 2024-09-13T05:12:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096300+0000", 2024-09-13T05:12:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4819999999999994e-06 2024-09-13T05:12:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096306+0000", 2024-09-13T05:12:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:12:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152788+0000", 2024-09-13T05:12:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056481625000000001 2024-09-13T05:12:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152837+0000", 2024-09-13T05:12:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9345000000000003e-05 2024-09-13T05:12:44.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152897+0000", 2024-09-13T05:12:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9892999999999997e-05 2024-09-13T05:12:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136581 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4066304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:12:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.132403852000003, 2024-09-13T05:12:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056597091000000002, 2024-09-13T05:12:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.278 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136581 2024-09-13T05:12:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:12:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:12:44.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096312+0000", 2024-09-13T05:12:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998465 2024-09-13T05:12:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096469+0000", 2024-09-13T05:12:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157109 2024-09-13T05:12:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096478+0000", 2024-09-13T05:12:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3260000000000002e-06 2024-09-13T05:12:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096482+0000", 2024-09-13T05:12:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9720000000000003e-06 2024-09-13T05:12:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152933+0000", 2024-09-13T05:12:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056451128000000003 2024-09-13T05:12:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152993+0000", 2024-09-13T05:12:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9947000000000001e-05 2024-09-13T05:12:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153062+0000", 2024-09-13T05:12:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9105999999999999e-05 2024-09-13T05:12:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.282 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136583 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4080640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:12:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.132137939000003, 2024-09-13T05:12:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056496609000000003, 2024-09-13T05:12:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136583 2024-09-13T05:12:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:12:44.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:12:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096485+0000", 2024-09-13T05:12:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997544 2024-09-13T05:12:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096735+0000", 2024-09-13T05:12:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024979899999999998 2024-09-13T05:12:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096742+0000", 2024-09-13T05:12:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7139999999999996e-06 2024-09-13T05:12:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096747+0000", 2024-09-13T05:12:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8709999999999996e-06 2024-09-13T05:12:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153099+0000", 2024-09-13T05:12:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056352639000000003 2024-09-13T05:12:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153168+0000", 2024-09-13T05:12:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9029000000000006e-05 2024-09-13T05:12:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153228+0000", 2024-09-13T05:12:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9339999999999998e-05 2024-09-13T05:12:44.286 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136585 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4094976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:12:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.131886471999998, 2024-09-13T05:12:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056396420000000003, 2024-09-13T05:12:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.287 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136585 2024-09-13T05:12:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:12:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:12:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096750+0000", 2024-09-13T05:12:44.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997673 2024-09-13T05:12:44.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096986+0000", 2024-09-13T05:12:44.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000236297 2024-09-13T05:12:44.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096993+0000", 2024-09-13T05:12:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9600000000000003e-06 2024-09-13T05:12:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096999+0000", 2024-09-13T05:12:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:12:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153264+0000", 2024-09-13T05:12:44.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056264728999999999 2024-09-13T05:12:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153318+0000", 2024-09-13T05:12:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3934000000000002e-05 2024-09-13T05:12:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153379+0000", 2024-09-13T05:12:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1206999999999999e-05 2024-09-13T05:12:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136586 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4109312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:12:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.131685670000003, 2024-09-13T05:12:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056374703999999998, 2024-09-13T05:12:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136586 2024-09-13T05:12:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.292 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:12:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:12:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097004+0000", 2024-09-13T05:12:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998207 2024-09-13T05:12:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097187+0000", 2024-09-13T05:12:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018337900000000001 2024-09-13T05:12:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097198+0000", 2024-09-13T05:12:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348e-05 2024-09-13T05:12:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097202+0000", 2024-09-13T05:12:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.121e-06 2024-09-13T05:12:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153411+0000", 2024-09-13T05:12:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056209510999999997 2024-09-13T05:12:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153464+0000", 2024-09-13T05:12:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2605000000000002e-05 2024-09-13T05:12:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153558+0000", 2024-09-13T05:12:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4017999999999993e-05 2024-09-13T05:12:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136588 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:12:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.131401486999998, 2024-09-13T05:12:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056274980000000002, 2024-09-13T05:12:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.296 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136588 2024-09-13T05:12:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:12:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:12:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097205+0000", 2024-09-13T05:12:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997377 2024-09-13T05:12:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097471+0000", 2024-09-13T05:12:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026628200000000001 2024-09-13T05:12:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097484+0000", 2024-09-13T05:12:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2493e-05 2024-09-13T05:12:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097488+0000", 2024-09-13T05:12:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9330000000000003e-06 2024-09-13T05:12:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153600+0000", 2024-09-13T05:12:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056112097 2024-09-13T05:12:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153654+0000", 2024-09-13T05:12:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4126000000000003e-05 2024-09-13T05:12:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153742+0000", 2024-09-13T05:12:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.831e-05 2024-09-13T05:12:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136589 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4137984~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:44.300 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:12:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.13126218, 2024-09-13T05:12:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056293867999999997, 2024-09-13T05:12:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136589 2024-09-13T05:12:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:12:44.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:12:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097491+0000", 2024-09-13T05:12:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998841 2024-09-13T05:12:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097610+0000", 2024-09-13T05:12:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119263 2024-09-13T05:12:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097617+0000", 2024-09-13T05:12:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6490000000000002e-06 2024-09-13T05:12:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097624+0000", 2024-09-13T05:12:44.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6309999999999997e-06 2024-09-13T05:12:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153779+0000", 2024-09-13T05:12:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056155153999999999 2024-09-13T05:12:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153831+0000", 2024-09-13T05:12:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2080000000000003e-05 2024-09-13T05:12:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153901+0000", 2024-09-13T05:12:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9765999999999996e-05 2024-09-13T05:12:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136965 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3366912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:12:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.111293359000001, 2024-09-13T05:12:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056225403, 2024-09-13T05:12:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136965 2024-09-13T05:12:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:12:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:12:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117575+0000", 2024-09-13T05:12:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117578+0000", 2024-09-13T05:12:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4899999999999999e-06 2024-09-13T05:12:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117583+0000", 2024-09-13T05:12:44.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.074e-06 2024-09-13T05:12:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117587+0000", 2024-09-13T05:12:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5360000000000003e-06 2024-09-13T05:12:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173622+0000", 2024-09-13T05:12:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056034527000000001 2024-09-13T05:12:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173704+0000", 2024-09-13T05:12:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2137000000000003e-05 2024-09-13T05:12:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173801+0000", 2024-09-13T05:12:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7048999999999999e-05 2024-09-13T05:12:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136991 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3553280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.107367582000002, 2024-09-13T05:12:44.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056330199999999997, 2024-09-13T05:12:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136991 2024-09-13T05:12:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121504+0000", 2024-09-13T05:12:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7199999999999998e-06 2024-09-13T05:12:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121510+0000", 2024-09-13T05:12:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3459999999999999e-06 2024-09-13T05:12:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121515+0000", 2024-09-13T05:12:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.656e-06 2024-09-13T05:12:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177608+0000", 2024-09-13T05:12:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056093267000000002 2024-09-13T05:12:44.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177717+0000", 2024-09-13T05:12:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010901299999999999 2024-09-13T05:12:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177832+0000", 2024-09-13T05:12:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114604 2024-09-13T05:12:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173672 3.9 3:9520c004:::rbd_data.112d7c1bedf7.0000000000000040:29 [read 186368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:12:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.043472956999999, 2024-09-13T05:12:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05682475, 2024-09-13T05:12:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173672 2024-09-13T05:12:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:12:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:12:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185395+0000", 2024-09-13T05:12:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185398+0000", 2024-09-13T05:12:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8260000000000001e-06 2024-09-13T05:12:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185404+0000", 2024-09-13T05:12:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-09-13T05:12:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185408+0000", 2024-09-13T05:12:44.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5279999999999997e-06 2024-09-13T05:12:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.236213+0000", 2024-09-13T05:12:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050805207999999998 2024-09-13T05:12:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.236285+0000", 2024-09-13T05:12:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1236999999999996e-05 2024-09-13T05:12:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.242221+0000", 2024-09-13T05:12:44.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059360050000000003 2024-09-13T05:12:44.318 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.318 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.318 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.318 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.318 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.318 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:44.319 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:12:44.320 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:44.316+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:44.420 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:44.416+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:44.441 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:44.442 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:44.452 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:12:44.522 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:44.520+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:44.565 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:44.565 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:44.575 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:12:44.623 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:44.619+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:44.696 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:44.696 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:44.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:44.696 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:44.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.696 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:70758 3.2 3:427d0469:::rbd_header.112d8d1317eb:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-13T05:12:44.696 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:44.696 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 81.264763645000002, 2024-09-13T05:12:44.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.190313603, 2024-09-13T05:12:44.697 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.697 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.697 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.697 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.697 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.697 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70758 2024-09-13T05:12:44.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.697 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:44.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:44.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428654+0000", 2024-09-13T05:12:44.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:44.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428664+0000", 2024-09-13T05:12:44.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0664e-05 2024-09-13T05:12:44.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428683+0000", 2024-09-13T05:12:44.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8377e-05 2024-09-13T05:12:44.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428691+0000", 2024-09-13T05:12:44.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9400000000000008e-06 2024-09-13T05:12:44.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428789+0000", 2024-09-13T05:12:44.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7165999999999998e-05 2024-09-13T05:12:44.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:44.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428811+0000", 2024-09-13T05:12:44.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1925000000000001e-05 2024-09-13T05:12:44.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.617921+0000", 2024-09-13T05:12:44.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.189110536 2024-09-13T05:12:44.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618344+0000", 2024-09-13T05:12:44.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042245800000000001 2024-09-13T05:12:44.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618969+0000", 2024-09-13T05:12:44.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062529299999999996 2024-09-13T05:12:44.701 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.701 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.701 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.701 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162381 3.8 3.4e1a3768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:44.702 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:12:44.702 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.184757398000002, 2024-09-13T05:12:44.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.14690313199999999, 2024-09-13T05:12:44.702 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.702 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:44.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.702 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162381 2024-09-13T05:12:44.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.702 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:12:44.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:12:44.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508659+0000", 2024-09-13T05:12:44.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:12:44.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508673+0000", 2024-09-13T05:12:44.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4154999999999999e-05 2024-09-13T05:12:44.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508703+0000", 2024-09-13T05:12:44.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9427000000000001e-05 2024-09-13T05:12:44.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508719+0000", 2024-09-13T05:12:44.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6381000000000001e-05 2024-09-13T05:12:44.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508789+0000", 2024-09-13T05:12:44.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9898000000000001e-05 2024-09-13T05:12:44.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:44.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508799+0000", 2024-09-13T05:12:44.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0066e-05 2024-09-13T05:12:44.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655550+0000", 2024-09-13T05:12:44.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.146750506 2024-09-13T05:12:44.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655565+0000", 2024-09-13T05:12:44.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4915e-05 2024-09-13T05:12:44.706 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.706 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.706 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.706 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162393 3.8 3.fd966c88 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:44.706 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:12:44.706 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.173241324000003, 2024-09-13T05:12:44.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.135657895, 2024-09-13T05:12:44.707 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.707 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:44.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.707 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162393 2024-09-13T05:12:44.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.707 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:12:44.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:12:44.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520176+0000", 2024-09-13T05:12:44.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:44.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520184+0000", 2024-09-13T05:12:44.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5800000000000003e-06 2024-09-13T05:12:44.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520199+0000", 2024-09-13T05:12:44.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4481000000000001e-05 2024-09-13T05:12:44.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520209+0000", 2024-09-13T05:12:44.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0327e-05 2024-09-13T05:12:44.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520351+0000", 2024-09-13T05:12:44.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141827 2024-09-13T05:12:44.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:44.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520363+0000", 2024-09-13T05:12:44.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2018000000000001e-05 2024-09-13T05:12:44.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655819+0000", 2024-09-13T05:12:44.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13545665600000001 2024-09-13T05:12:44.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655835+0000", 2024-09-13T05:12:44.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6135000000000001e-05 2024-09-13T05:12:44.711 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.711 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.711 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.711 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162429 3.8 3.6e098f28 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:44.712 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:44.712 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.172390714999999, 2024-09-13T05:12:44.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13484765400000001, 2024-09-13T05:12:44.712 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.712 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:44.712 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.712 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.712 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.712 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162429 2024-09-13T05:12:44.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.712 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:44.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:44.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:44.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:44.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521032+0000", 2024-09-13T05:12:44.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3039999999999998e-06 2024-09-13T05:12:44.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521041+0000", 2024-09-13T05:12:44.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6880000000000005e-06 2024-09-13T05:12:44.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521047+0000", 2024-09-13T05:12:44.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0100000000000001e-06 2024-09-13T05:12:44.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521601+0000", 2024-09-13T05:12:44.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00055398600000000002 2024-09-13T05:12:44.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:44.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521613+0000", 2024-09-13T05:12:44.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2347000000000001e-05 2024-09-13T05:12:44.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655869+0000", 2024-09-13T05:12:44.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.134255597 2024-09-13T05:12:44.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655876+0000", 2024-09-13T05:12:44.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2790000000000001e-06 2024-09-13T05:12:44.716 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.716 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.716 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.716 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162521 3.8 3.f06bf7c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:44.716 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:44.717 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.169988584999999, 2024-09-13T05:12:44.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13247452600000001, 2024-09-13T05:12:44.717 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.717 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:44.717 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.717 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.717 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.717 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162521 2024-09-13T05:12:44.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.717 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:44.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:44.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:44.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:44.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523433+0000", 2024-09-13T05:12:44.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.128e-06 2024-09-13T05:12:44.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523440+0000", 2024-09-13T05:12:44.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9990000000000002e-06 2024-09-13T05:12:44.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523446+0000", 2024-09-13T05:12:44.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7869999999999998e-06 2024-09-13T05:12:44.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.528221+0000", 2024-09-13T05:12:44.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047747040000000003 2024-09-13T05:12:44.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:44.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.528237+0000", 2024-09-13T05:12:44.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6042e-05 2024-09-13T05:12:44.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655898+0000", 2024-09-13T05:12:44.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.127661521 2024-09-13T05:12:44.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655905+0000", 2024-09-13T05:12:44.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7780000000000002e-06 2024-09-13T05:12:44.721 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.721 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.721 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.721 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162381 3.8 3:16ec5872:::rbd_data.112dc3abcba6.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:44.721 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:12:44.721 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.160461419999997, 2024-09-13T05:12:44.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12546553899999999, 2024-09-13T05:12:44.721 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.722 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:44.722 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.722 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.722 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.722 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162381 2024-09-13T05:12:44.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.722 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:12:44.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:12:44.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532956+0000", 2024-09-13T05:12:44.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:44.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532964+0000", 2024-09-13T05:12:44.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.072e-06 2024-09-13T05:12:44.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532976+0000", 2024-09-13T05:12:44.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1355000000000001e-05 2024-09-13T05:12:44.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532984+0000", 2024-09-13T05:12:44.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3440000000000001e-06 2024-09-13T05:12:44.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533432+0000", 2024-09-13T05:12:44.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044773000000000002 2024-09-13T05:12:44.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:44.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533439+0000", 2024-09-13T05:12:44.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9890000000000003e-06 2024-09-13T05:12:44.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655985+0000", 2024-09-13T05:12:44.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122546527 2024-09-13T05:12:44.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656234+0000", 2024-09-13T05:12:44.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024911300000000003 2024-09-13T05:12:44.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:12:44.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656378+0000", 2024-09-13T05:12:44.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014417100000000001 2024-09-13T05:12:44.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:44.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657916+0000", 2024-09-13T05:12:44.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001537907 2024-09-13T05:12:44.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:12:44.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658308+0000", 2024-09-13T05:12:44.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039183700000000002 2024-09-13T05:12:44.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:12:44.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658364+0000", 2024-09-13T05:12:44.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5451000000000002e-05 2024-09-13T05:12:44.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658423+0000", 2024-09-13T05:12:44.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9449e-05 2024-09-13T05:12:44.728 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.728 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.728 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.728 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162393 3.8 3:113669bf:::rbd_data.112dfd94ee88.00000000000000bf:2a [read 131072~18432] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:44.728 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:44.728 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.160421640999999, 2024-09-13T05:12:44.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124231431, 2024-09-13T05:12:44.728 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.728 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.728 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.729 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162393 2024-09-13T05:12:44.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.729 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:44.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:44.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:44.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:44.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533001+0000", 2024-09-13T05:12:44.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8099999999999999e-06 2024-09-13T05:12:44.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533007+0000", 2024-09-13T05:12:44.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5849999999999996e-06 2024-09-13T05:12:44.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533012+0000", 2024-09-13T05:12:44.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0320000000000003e-06 2024-09-13T05:12:44.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533459+0000", 2024-09-13T05:12:44.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044646399999999999 2024-09-13T05:12:44.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:44.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533464+0000", 2024-09-13T05:12:44.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9180000000000002e-06 2024-09-13T05:12:44.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656870+0000", 2024-09-13T05:12:44.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123406847 2024-09-13T05:12:44.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657067+0000", 2024-09-13T05:12:44.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019655599999999999 2024-09-13T05:12:44.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657229+0000", 2024-09-13T05:12:44.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016175599999999999 2024-09-13T05:12:44.733 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.733 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.733 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.733 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162429 3.8 3:14f19076:::rbd_data.112dfd94ee88.0000000000000150:2a [read 131072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:44.733 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:12:44.733 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.160402091000002, 2024-09-13T05:12:44.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124549956, 2024-09-13T05:12:44.734 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.734 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.734 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.734 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.734 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.734 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162429 2024-09-13T05:12:44.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.734 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:12:44.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:12:44.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533016+0000", 2024-09-13T05:12:44.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:44.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533020+0000", 2024-09-13T05:12:44.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1049999999999999e-06 2024-09-13T05:12:44.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533025+0000", 2024-09-13T05:12:44.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-09-13T05:12:44.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533030+0000", 2024-09-13T05:12:44.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8999999999999997e-06 2024-09-13T05:12:44.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533481+0000", 2024-09-13T05:12:44.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045080400000000002 2024-09-13T05:12:44.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:44.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533486+0000", 2024-09-13T05:12:44.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3369999999999999e-06 2024-09-13T05:12:44.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657311+0000", 2024-09-13T05:12:44.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123824408 2024-09-13T05:12:44.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657464+0000", 2024-09-13T05:12:44.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015343900000000001 2024-09-13T05:12:44.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657567+0000", 2024-09-13T05:12:44.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102568 2024-09-13T05:12:44.738 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.738 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.738 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.739 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162521 3.8 3:13efd60f:::rbd_data.112dfd94ee88.000000000000031a:2a [read 131072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:44.739 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:44.739 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.160250857999998, 2024-09-13T05:12:44.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124709257, 2024-09-13T05:12:44.739 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.739 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.739 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.739 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.739 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.739 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162521 2024-09-13T05:12:44.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.739 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:44.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:44.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:44.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:44.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533170+0000", 2024-09-13T05:12:44.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3910000000000001e-06 2024-09-13T05:12:44.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533176+0000", 2024-09-13T05:12:44.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4029999999999998e-06 2024-09-13T05:12:44.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533180+0000", 2024-09-13T05:12:44.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6999999999999999e-06 2024-09-13T05:12:44.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533659+0000", 2024-09-13T05:12:44.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047839699999999998 2024-09-13T05:12:44.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:44.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533664+0000", 2024-09-13T05:12:44.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7239999999999997e-06 2024-09-13T05:12:44.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657619+0000", 2024-09-13T05:12:44.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123954412 2024-09-13T05:12:44.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657784+0000", 2024-09-13T05:12:44.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016527499999999999 2024-09-13T05:12:44.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657877+0000", 2024-09-13T05:12:44.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3280000000000001e-05 2024-09-13T05:12:44.743 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.744 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.744 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.744 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162618 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 70656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:44.744 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:12:44.744 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.158946147999998, 2024-09-13T05:12:44.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123752711, 2024-09-13T05:12:44.744 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.744 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.744 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.744 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.744 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.745 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162618 2024-09-13T05:12:44.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.745 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:12:44.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:12:44.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534472+0000", 2024-09-13T05:12:44.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:44.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534475+0000", 2024-09-13T05:12:44.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2010000000000002e-06 2024-09-13T05:12:44.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534482+0000", 2024-09-13T05:12:44.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:12:44.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534486+0000", 2024-09-13T05:12:44.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7520000000000004e-06 2024-09-13T05:12:44.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536456+0000", 2024-09-13T05:12:44.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001969527 2024-09-13T05:12:44.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:44.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536462+0000", 2024-09-13T05:12:44.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2750000000000001e-06 2024-09-13T05:12:44.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657939+0000", 2024-09-13T05:12:44.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121476769 2024-09-13T05:12:44.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658087+0000", 2024-09-13T05:12:44.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014862400000000001 2024-09-13T05:12:44.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658225+0000", 2024-09-13T05:12:44.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013800999999999999 2024-09-13T05:12:44.749 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.749 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.749 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.749 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162620 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 71680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:44.749 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:44.749 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.158912022999999, 2024-09-13T05:12:44.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124087688, 2024-09-13T05:12:44.749 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.749 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.749 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.750 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.750 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.750 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162620 2024-09-13T05:12:44.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.750 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:44.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:44.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:44.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:44.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534509+0000", 2024-09-13T05:12:44.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1270000000000001e-06 2024-09-13T05:12:44.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534514+0000", 2024-09-13T05:12:44.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8720000000000001e-06 2024-09-13T05:12:44.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534518+0000", 2024-09-13T05:12:44.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5090000000000004e-06 2024-09-13T05:12:44.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536485+0000", 2024-09-13T05:12:44.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019671530000000001 2024-09-13T05:12:44.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:44.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536491+0000", 2024-09-13T05:12:44.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3759999999999999e-06 2024-09-13T05:12:44.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658466+0000", 2024-09-13T05:12:44.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121975466 2024-09-13T05:12:44.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658522+0000", 2024-09-13T05:12:44.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5668999999999998e-05 2024-09-13T05:12:44.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658595+0000", 2024-09-13T05:12:44.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2800999999999996e-05 2024-09-13T05:12:44.754 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.754 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.754 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.754 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162622 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 72704~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:44.754 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:12:44.754 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.158881055999998, 2024-09-13T05:12:44.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124215569, 2024-09-13T05:12:44.754 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.754 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.755 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.755 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.755 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.755 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162622 2024-09-13T05:12:44.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.755 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:12:44.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:12:44.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534537+0000", 2024-09-13T05:12:44.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:44.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534540+0000", 2024-09-13T05:12:44.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3740000000000001e-06 2024-09-13T05:12:44.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534545+0000", 2024-09-13T05:12:44.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4210000000000003e-06 2024-09-13T05:12:44.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534550+0000", 2024-09-13T05:12:44.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3090000000000003e-06 2024-09-13T05:12:44.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536510+0000", 2024-09-13T05:12:44.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019597130000000001 2024-09-13T05:12:44.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:44.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536517+0000", 2024-09-13T05:12:44.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0620000000000003e-06 2024-09-13T05:12:44.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658632+0000", 2024-09-13T05:12:44.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122114373 2024-09-13T05:12:44.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658686+0000", 2024-09-13T05:12:44.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3882999999999999e-05 2024-09-13T05:12:44.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658753+0000", 2024-09-13T05:12:44.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7921000000000002e-05 2024-09-13T05:12:44.759 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.759 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.759 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.759 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162623 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 73728~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:44.759 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:12:44.759 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.158864250999997, 2024-09-13T05:12:44.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124350214, 2024-09-13T05:12:44.760 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.760 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.760 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162623 2024-09-13T05:12:44.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.760 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:12:44.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:12:44.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534554+0000", 2024-09-13T05:12:44.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:44.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534556+0000", 2024-09-13T05:12:44.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-13T05:12:44.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534563+0000", 2024-09-13T05:12:44.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2890000000000003e-06 2024-09-13T05:12:44.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534567+0000", 2024-09-13T05:12:44.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4880000000000001e-06 2024-09-13T05:12:44.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536538+0000", 2024-09-13T05:12:44.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019703989999999998 2024-09-13T05:12:44.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:44.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536543+0000", 2024-09-13T05:12:44.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3920000000000002e-06 2024-09-13T05:12:44.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658773+0000", 2024-09-13T05:12:44.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122229607 2024-09-13T05:12:44.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658835+0000", 2024-09-13T05:12:44.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1954999999999999e-05 2024-09-13T05:12:44.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658905+0000", 2024-09-13T05:12:44.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-09-13T05:12:44.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.764 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.765 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162626 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 65536~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:44.765 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:44.765 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.158812967000003, 2024-09-13T05:12:44.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124425881, 2024-09-13T05:12:44.765 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.765 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.765 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162626 2024-09-13T05:12:44.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.765 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:44.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:44.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:44.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:44.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534611+0000", 2024-09-13T05:12:44.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5419999999999996e-06 2024-09-13T05:12:44.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534617+0000", 2024-09-13T05:12:44.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5169999999999999e-06 2024-09-13T05:12:44.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534622+0000", 2024-09-13T05:12:44.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9810000000000003e-06 2024-09-13T05:12:44.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536563+0000", 2024-09-13T05:12:44.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019410549999999999 2024-09-13T05:12:44.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:44.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536568+0000", 2024-09-13T05:12:44.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4310000000000002e-06 2024-09-13T05:12:44.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658922+0000", 2024-09-13T05:12:44.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122354221 2024-09-13T05:12:44.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658968+0000", 2024-09-13T05:12:44.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5221e-05 2024-09-13T05:12:44.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659032+0000", 2024-09-13T05:12:44.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4256000000000003e-05 2024-09-13T05:12:44.769 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.769 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.770 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.770 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162628 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 66560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:44.770 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:44.770 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.158778015999999, 2024-09-13T05:12:44.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124532254, 2024-09-13T05:12:44.770 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.770 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.770 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162628 2024-09-13T05:12:44.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.771 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:44.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:44.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:44.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:44.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534643+0000", 2024-09-13T05:12:44.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1890000000000001e-06 2024-09-13T05:12:44.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534648+0000", 2024-09-13T05:12:44.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:12:44.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534652+0000", 2024-09-13T05:12:44.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4549999999999997e-06 2024-09-13T05:12:44.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536586+0000", 2024-09-13T05:12:44.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019336049999999999 2024-09-13T05:12:44.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:44.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536591+0000", 2024-09-13T05:12:44.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3770000000000004e-06 2024-09-13T05:12:44.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659062+0000", 2024-09-13T05:12:44.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122470685 2024-09-13T05:12:44.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659106+0000", 2024-09-13T05:12:44.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3856000000000002e-05 2024-09-13T05:12:44.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659173+0000", 2024-09-13T05:12:44.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7168000000000005e-05 2024-09-13T05:12:44.774 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.775 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.775 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.775 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162630 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 67584~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:44.775 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:44.775 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.158744810000002, 2024-09-13T05:12:44.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12468555100000001, 2024-09-13T05:12:44.775 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.775 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.775 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.775 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.775 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.775 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162630 2024-09-13T05:12:44.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.776 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:44.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:44.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:44.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:44.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534676+0000", 2024-09-13T05:12:44.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4399999999999999e-06 2024-09-13T05:12:44.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534681+0000", 2024-09-13T05:12:44.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2349999999999999e-06 2024-09-13T05:12:44.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534686+0000", 2024-09-13T05:12:44.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5499999999999996e-06 2024-09-13T05:12:44.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536609+0000", 2024-09-13T05:12:44.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001923407 2024-09-13T05:12:44.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:44.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536615+0000", 2024-09-13T05:12:44.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1499999999999998e-06 2024-09-13T05:12:44.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659233+0000", 2024-09-13T05:12:44.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122618957 2024-09-13T05:12:44.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659294+0000", 2024-09-13T05:12:44.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0251000000000003e-05 2024-09-13T05:12:44.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659360+0000", 2024-09-13T05:12:44.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5906000000000002e-05 2024-09-13T05:12:44.780 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.780 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.780 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.780 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162633 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 69632~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:44.780 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:44.780 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.158636905000002, 2024-09-13T05:12:44.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124702147, 2024-09-13T05:12:44.780 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.780 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.780 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.780 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.781 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.781 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162633 2024-09-13T05:12:44.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.781 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:44.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:44.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:44.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:44.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534784+0000", 2024-09-13T05:12:44.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3300000000000001e-06 2024-09-13T05:12:44.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534789+0000", 2024-09-13T05:12:44.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4149999999999998e-06 2024-09-13T05:12:44.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534794+0000", 2024-09-13T05:12:44.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5669999999999996e-06 2024-09-13T05:12:44.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536634+0000", 2024-09-13T05:12:44.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001840401 2024-09-13T05:12:44.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:44.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536642+0000", 2024-09-13T05:12:44.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9729999999999997e-06 2024-09-13T05:12:44.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659383+0000", 2024-09-13T05:12:44.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12274112099999999 2024-09-13T05:12:44.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659424+0000", 2024-09-13T05:12:44.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0936000000000002e-05 2024-09-13T05:12:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659484+0000", 2024-09-13T05:12:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9775000000000003e-05 2024-09-13T05:12:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162675 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 68608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.158587861000001, 2024-09-13T05:12:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124823974, 2024-09-13T05:12:44.786 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.786 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.786 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162675 2024-09-13T05:12:44.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.786 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:44.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:44.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:44.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:44.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534833+0000", 2024-09-13T05:12:44.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.204e-06 2024-09-13T05:12:44.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534838+0000", 2024-09-13T05:12:44.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0130000000000001e-06 2024-09-13T05:12:44.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534842+0000", 2024-09-13T05:12:44.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.51e-06 2024-09-13T05:12:44.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536661+0000", 2024-09-13T05:12:44.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018186039999999999 2024-09-13T05:12:44.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:44.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536667+0000", 2024-09-13T05:12:44.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5260000000000001e-06 2024-09-13T05:12:44.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659531+0000", 2024-09-13T05:12:44.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122864403 2024-09-13T05:12:44.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659583+0000", 2024-09-13T05:12:44.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1564000000000003e-05 2024-09-13T05:12:44.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659655+0000", 2024-09-13T05:12:44.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2504999999999998e-05 2024-09-13T05:12:44.790 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.790 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.790 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.790 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:163257 3.8 3:1136e8de:::rbd_data.112dbd21872d.000000000000003c:28 [read 200704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:44.790 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:44.790 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.143572655, 2024-09-13T05:12:44.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12163807, 2024-09-13T05:12:44.791 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.791 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:44.791 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.791 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.791 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.791 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 163257 2024-09-13T05:12:44.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.791 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:44.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:44.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:44.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:44.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549848+0000", 2024-09-13T05:12:44.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1789999999999998e-06 2024-09-13T05:12:44.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549854+0000", 2024-09-13T05:12:44.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9050000000000002e-06 2024-09-13T05:12:44.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549858+0000", 2024-09-13T05:12:44.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3529999999999997e-06 2024-09-13T05:12:44.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.551228+0000", 2024-09-13T05:12:44.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001369227 2024-09-13T05:12:44.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:44.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.551233+0000", 2024-09-13T05:12:44.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5860000000000004e-06 2024-09-13T05:12:44.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671337+0000", 2024-09-13T05:12:44.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.120104265 2024-09-13T05:12:44.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671425+0000", 2024-09-13T05:12:44.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7810000000000001e-05 2024-09-13T05:12:44.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671484+0000", 2024-09-13T05:12:44.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9079000000000001e-05 2024-09-13T05:12:44.795 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.795 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.795 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.795 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:170203 3.1e 3:7c9b1cf4:::rbd_header.112dc3abcba6:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128)", 2024-09-13T05:12:44.796 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:12:44.796 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.878608889999999, 2024-09-13T05:12:44.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.79948714899999995, 2024-09-13T05:12:44.796 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:44.796 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:44.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:44.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:44.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:44.796 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 170203 2024-09-13T05:12:44.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.796 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:44.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:44.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:12:44.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:44.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:12:44.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:44.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:44.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814808+0000", 2024-09-13T05:12:44.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:44.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:44.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814820+0000", 2024-09-13T05:12:44.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.206e-05 2024-09-13T05:12:44.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:44.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814841+0000", 2024-09-13T05:12:44.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1464999999999999e-05 2024-09-13T05:12:44.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:44.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814853+0000", 2024-09-13T05:12:44.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1824999999999999e-05 2024-09-13T05:12:44.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814911+0000", 2024-09-13T05:12:44.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8255999999999999e-05 2024-09-13T05:12:44.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:44.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814918+0000", 2024-09-13T05:12:44.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7120000000000003e-06 2024-09-13T05:12:44.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:44.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.611660+0000", 2024-09-13T05:12:44.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.79674180100000003 2024-09-13T05:12:44.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:44.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.611911+0000", 2024-09-13T05:12:44.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025108900000000002 2024-09-13T05:12:44.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-13T05:12:44.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.612726+0000", 2024-09-13T05:12:44.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00081512999999999996 2024-09-13T05:12:44.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:44.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614087+0000", 2024-09-13T05:12:44.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013607560000000001 2024-09-13T05:12:44.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:12:44.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614095+0000", 2024-09-13T05:12:44.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3240000000000003e-06 2024-09-13T05:12:44.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:12:44.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614138+0000", 2024-09-13T05:12:44.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3115000000000003e-05 2024-09-13T05:12:44.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:44.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:44.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:44.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614297+0000", 2024-09-13T05:12:44.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015875399999999999 2024-09-13T05:12:44.802 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.802 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.802 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.802 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:44.802 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:44.802 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:44.804 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:12:44.804 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:44.800+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:44.904 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:44.899+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:44.918 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:44.918 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:44.918 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:44.918 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:44.930 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:12:44.952 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T05:12:45.005 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:45.003+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:45.042 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:45.043 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:45.043 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:45.043 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:45.043 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:45.053 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:12:45.106 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:45.104+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:45.166 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:45.166 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:45.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:45.167 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:45.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.167 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.1 144/143 [PushOp(3:84db47f5:::rbd_data.112d9735e8af.0000000000000002:head, version: 47'61, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:84db47f5:::rbd_data.112d9735e8af.0000000000000002:head@47'61, size: 6291456, copy_subset: [0~6291456], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:45.167 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:39.672152+0000", 2024-09-13T05:12:45.167 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.4858653869999996, 2024-09-13T05:12:45.167 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0047065179999999998, 2024-09-13T05:12:45.167 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.167 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.167 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.167 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.167 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.672152+0000", 2024-09-13T05:12:45.167 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.168 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.168 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.168 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.672152+0000", 2024-09-13T05:12:45.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.168 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.168 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.168 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.672151+0000", 2024-09-13T05:12:45.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:45.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.168 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.168 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.168 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.674487+0000", 2024-09-13T05:12:45.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023360939999999999 2024-09-13T05:12:45.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.674523+0000", 2024-09-13T05:12:45.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6582000000000003e-05 2024-09-13T05:12:45.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.674556+0000", 2024-09-13T05:12:45.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2103000000000001e-05 2024-09-13T05:12:45.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.674687+0000", 2024-09-13T05:12:45.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013118099999999999 2024-09-13T05:12:45.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.674709+0000", 2024-09-13T05:12:45.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2509000000000001e-05 2024-09-13T05:12:45.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.676859+0000", 2024-09-13T05:12:45.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021497450000000002 2024-09-13T05:12:45.170 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.171 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.171 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.171 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.1 144/143 [PushOp(3:84db47f5:::rbd_data.112d9735e8af.0000000000000002:head, version: 47'61, data_included: [1048576~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:84db47f5:::rbd_data.112d9735e8af.0000000000000002:head@47'61, size: 6291456, copy_subset: [0~6291456], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:2097152, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", 2024-09-13T05:12:45.171 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:39.678212+0000", 2024-09-13T05:12:45.171 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.4798060350000002, 2024-09-13T05:12:45.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0044025239999999997, 2024-09-13T05:12:45.171 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.171 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.171 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.171 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.678212+0000", 2024-09-13T05:12:45.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.678212+0000", 2024-09-13T05:12:45.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.678210+0000", 2024-09-13T05:12:45.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:45.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.680365+0000", 2024-09-13T05:12:45.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021552479999999998 2024-09-13T05:12:45.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.680404+0000", 2024-09-13T05:12:45.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.858e-05 2024-09-13T05:12:45.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.680433+0000", 2024-09-13T05:12:45.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9145e-05 2024-09-13T05:12:45.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.680563+0000", 2024-09-13T05:12:45.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012996399999999999 2024-09-13T05:12:45.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.680586+0000", 2024-09-13T05:12:45.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3076999999999999e-05 2024-09-13T05:12:45.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.682614+0000", 2024-09-13T05:12:45.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020281600000000002 2024-09-13T05:12:45.175 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.175 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.175 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.175 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.1 144/143 [PushOp(3:8231b51f:::rbd_data.112d8ff9b77a.0000000000000005:1d, version: 81'189, data_included: [0~753664,786432~294912], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:8231b51f:::rbd_data.112d8ff9b77a.0000000000000005:1d@81'189, size: 1572864, copy_subset: [0~1572864], clone_subset: {}, snapset: 1d=[]:{1d=[1d]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1081344, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:45.175 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:39.880889+0000", 2024-09-13T05:12:45.175 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.2771292479999996, 2024-09-13T05:12:45.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0046534849999999997, 2024-09-13T05:12:45.175 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.175 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.175 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.175 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.880889+0000", 2024-09-13T05:12:45.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.880889+0000", 2024-09-13T05:12:45.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.880887+0000", 2024-09-13T05:12:45.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:45.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.883013+0000", 2024-09-13T05:12:45.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021263649999999999 2024-09-13T05:12:45.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.883043+0000", 2024-09-13T05:12:45.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0009e-05 2024-09-13T05:12:45.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.883075+0000", 2024-09-13T05:12:45.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1798999999999998e-05 2024-09-13T05:12:45.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.883245+0000", 2024-09-13T05:12:45.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000169915 2024-09-13T05:12:45.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.883265+0000", 2024-09-13T05:12:45.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9711000000000002e-05 2024-09-13T05:12:45.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.885542+0000", 2024-09-13T05:12:45.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772230000000001 2024-09-13T05:12:45.179 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.179 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.179 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.179 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.1 145/143 [PushOp(3:8468e10f:::rbd_data.112db56bb33d.0000000000000003:1f, version: 87'205, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:8468e10f:::rbd_data.112db56bb33d.0000000000000003:1f@87'205, size: 2621440, copy_subset: [0~2621440], clone_subset: {}, snapset: 1f=[]:{1f=[1f]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:2621440, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:45.179 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:39.907301+0000", 2024-09-13T05:12:45.179 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.2507166920000001, 2024-09-13T05:12:45.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0035218089999999999, 2024-09-13T05:12:45.179 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.179 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.179 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.907301+0000", 2024-09-13T05:12:45.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.907301+0000", 2024-09-13T05:12:45.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.907301+0000", 2024-09-13T05:12:45.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:45.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.908858+0000", 2024-09-13T05:12:45.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001557014 2024-09-13T05:12:45.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.908878+0000", 2024-09-13T05:12:45.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0811000000000001e-05 2024-09-13T05:12:45.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.908902+0000", 2024-09-13T05:12:45.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3930999999999998e-05 2024-09-13T05:12:45.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.908991+0000", 2024-09-13T05:12:45.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8354000000000001e-05 2024-09-13T05:12:45.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.908999+0000", 2024-09-13T05:12:45.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7309999999999999e-06 2024-09-13T05:12:45.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.910823+0000", 2024-09-13T05:12:45.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001823505 2024-09-13T05:12:45.183 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.183 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.183 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.183 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.1 145/143 [PushOp(3:8468e10f:::rbd_data.112db56bb33d.0000000000000003:head, version: 87'206, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:8468e10f:::rbd_data.112db56bb33d.0000000000000003:head@87'206, size: 1572864, copy_subset: [0~1572864], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1572864, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:45.183 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:39.909123+0000", 2024-09-13T05:12:45.183 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.2488945530000004, 2024-09-13T05:12:45.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0036698619999999999, 2024-09-13T05:12:45.183 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.183 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.183 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.184 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.184 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.909123+0000", 2024-09-13T05:12:45.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.184 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.184 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.909123+0000", 2024-09-13T05:12:45.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.184 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.184 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.909122+0000", 2024-09-13T05:12:45.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:45.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.185 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.911296+0000", 2024-09-13T05:12:45.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002174091 2024-09-13T05:12:45.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.185 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.911319+0000", 2024-09-13T05:12:45.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2976000000000002e-05 2024-09-13T05:12:45.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.185 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.911341+0000", 2024-09-13T05:12:45.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1678000000000001e-05 2024-09-13T05:12:45.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.911419+0000", 2024-09-13T05:12:45.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8212000000000003e-05 2024-09-13T05:12:45.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.911428+0000", 2024-09-13T05:12:45.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7299999999999994e-06 2024-09-13T05:12:45.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.187 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.912793+0000", 2024-09-13T05:12:45.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001365341 2024-09-13T05:12:45.187 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.187 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.187 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.187 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.1 145/143 [PushOp(3:87438965:::rbd_data.112dae408c93.0000000000000000:2c, version: 134'486, data_included: [131072~524288,786432~524288], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:87438965:::rbd_data.112dae408c93.0000000000000000:2c@134'486, size: 2097152, copy_subset: [0~2097152], clone_subset: {}, snapset: 2c=[]:{2c=[2c]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1310720, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:45.187 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:40.102826+0000", 2024-09-13T05:12:45.187 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.0551913930000003, 2024-09-13T05:12:45.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0034251609999999999, 2024-09-13T05:12:45.187 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.187 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.187 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.102826+0000", 2024-09-13T05:12:45.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.102826+0000", 2024-09-13T05:12:45.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.102825+0000", 2024-09-13T05:12:45.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:45.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.104404+0000", 2024-09-13T05:12:45.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0015791900000000001 2024-09-13T05:12:45.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.104446+0000", 2024-09-13T05:12:45.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2199e-05 2024-09-13T05:12:45.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.104477+0000", 2024-09-13T05:12:45.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1198999999999997e-05 2024-09-13T05:12:45.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.104597+0000", 2024-09-13T05:12:45.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011985300000000001 2024-09-13T05:12:45.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.104616+0000", 2024-09-13T05:12:45.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8777e-05 2024-09-13T05:12:45.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.106252+0000", 2024-09-13T05:12:45.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0016356599999999999 2024-09-13T05:12:45.191 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.191 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.191 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.191 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.9 145/143 [PushOp(3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a, version: 37'57, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a@37'57, size: 3145728, copy_subset: [0~3145728], clone_subset: {}, snapset: a=[]:{a=[a]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:45.191 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:40.247555+0000", 2024-09-13T05:12:45.191 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.9104631300000001, 2024-09-13T05:12:45.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0039205769999999997, 2024-09-13T05:12:45.191 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.192 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.192 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.247555+0000", 2024-09-13T05:12:45.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.247555+0000", 2024-09-13T05:12:45.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.247553+0000", 2024-09-13T05:12:45.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:45.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.249635+0000", 2024-09-13T05:12:45.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002082286 2024-09-13T05:12:45.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.249677+0000", 2024-09-13T05:12:45.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1122999999999999e-05 2024-09-13T05:12:45.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.249703+0000", 2024-09-13T05:12:45.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6982999999999999e-05 2024-09-13T05:12:45.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.249806+0000", 2024-09-13T05:12:45.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010210200000000001 2024-09-13T05:12:45.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.249824+0000", 2024-09-13T05:12:45.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8348000000000001e-05 2024-09-13T05:12:45.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.195 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.195 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.251475+0000", 2024-09-13T05:12:45.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0016513719999999999 2024-09-13T05:12:45.195 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.195 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.195 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.195 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.9 145/143 [PushOp(3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a, version: 37'57, data_included: [1048576~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a@37'57, size: 3145728, copy_subset: [0~3145728], clone_subset: {}, snapset: a=[]:{a=[a]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:3145728, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", 2024-09-13T05:12:45.195 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:40.253450+0000", 2024-09-13T05:12:45.195 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.9045676839999999, 2024-09-13T05:12:45.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0043607760000000002, 2024-09-13T05:12:45.196 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.196 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.196 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.196 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.253450+0000", 2024-09-13T05:12:45.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.196 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.253450+0000", 2024-09-13T05:12:45.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.197 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.253449+0000", 2024-09-13T05:12:45.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:45.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.197 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.255155+0000", 2024-09-13T05:12:45.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001706155 2024-09-13T05:12:45.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.197 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.255190+0000", 2024-09-13T05:12:45.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5373999999999997e-05 2024-09-13T05:12:45.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.198 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.198 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.255213+0000", 2024-09-13T05:12:45.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2878999999999999e-05 2024-09-13T05:12:45.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.198 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.198 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.255355+0000", 2024-09-13T05:12:45.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014184399999999999 2024-09-13T05:12:45.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.198 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.199 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.255378+0000", 2024-09-13T05:12:45.199 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2866000000000001e-05 2024-09-13T05:12:45.199 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.199 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.199 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.199 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.257811+0000", 2024-09-13T05:12:45.199 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024332210000000002 2024-09-13T05:12:45.199 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.199 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.199 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.199 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.199 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.199 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.9 145/143 [PushOp(3:9731cd35:::rbd_data.112db114688b.0000000000000000:head, version: 53'108, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:9731cd35:::rbd_data.112db114688b.0000000000000000:head@53'108, size: 3145728, copy_subset: [0~3145728], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:45.199 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:40.330580+0000", 2024-09-13T05:12:45.200 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.8274374980000001, 2024-09-13T05:12:45.200 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0046015459999999998, 2024-09-13T05:12:45.200 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.200 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.200 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.200 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.200 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.200 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.330580+0000", 2024-09-13T05:12:45.200 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.200 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.200 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.200 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.200 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.330580+0000", 2024-09-13T05:12:45.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.330579+0000", 2024-09-13T05:12:45.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:45.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.332494+0000", 2024-09-13T05:12:45.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0019150700000000001 2024-09-13T05:12:45.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.202 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.202 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.332536+0000", 2024-09-13T05:12:45.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1798999999999997e-05 2024-09-13T05:12:45.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.202 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.202 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.332565+0000", 2024-09-13T05:12:45.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9505999999999998e-05 2024-09-13T05:12:45.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.202 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.202 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.332747+0000", 2024-09-13T05:12:45.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018156300000000001 2024-09-13T05:12:45.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.203 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.203 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.332779+0000", 2024-09-13T05:12:45.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2546000000000003e-05 2024-09-13T05:12:45.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.203 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.203 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.335182+0000", 2024-09-13T05:12:45.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002402702 2024-09-13T05:12:45.203 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.203 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.203 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.204 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.9 145/143 [PushOp(3:9731cd35:::rbd_data.112db114688b.0000000000000000:head, version: 53'108, data_included: [1310720~786432], data_size: 786432, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:9731cd35:::rbd_data.112db114688b.0000000000000000:head@53'108, size: 3145728, copy_subset: [0~3145728], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:3145728, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", 2024-09-13T05:12:45.204 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:40.337078+0000", 2024-09-13T05:12:45.204 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.8209399150000003, 2024-09-13T05:12:45.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0032341200000000001, 2024-09-13T05:12:45.204 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.204 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.204 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.204 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.337078+0000", 2024-09-13T05:12:45.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.204 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.205 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.205 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.337078+0000", 2024-09-13T05:12:45.205 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.205 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.205 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.337077+0000", 2024-09-13T05:12:45.205 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:45.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.205 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.205 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.338341+0000", 2024-09-13T05:12:45.205 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0012648399999999999 2024-09-13T05:12:45.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.206 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.206 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.338380+0000", 2024-09-13T05:12:45.206 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8415999999999999e-05 2024-09-13T05:12:45.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.206 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.206 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.338420+0000", 2024-09-13T05:12:45.206 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0326e-05 2024-09-13T05:12:45.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.206 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.206 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.338538+0000", 2024-09-13T05:12:45.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011801700000000001 2024-09-13T05:12:45.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.207 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.207 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.338558+0000", 2024-09-13T05:12:45.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0088000000000001e-05 2024-09-13T05:12:45.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.207 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.207 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.340312+0000", 2024-09-13T05:12:45.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00175384 2024-09-13T05:12:45.207 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.207 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.207 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.208 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.208 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.11 146/143 [PushOp(3:8f0c99ef:::rbd_data.112d9735e8af.0000000000000003:head, version: 47'71, data_included: [1233058~864094], data_size: 864094, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:8f0c99ef:::rbd_data.112d9735e8af.0000000000000003:head@47'71, size: 2097152, copy_subset: [0~2097152], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:2097152, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:1233058, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", 2024-09-13T05:12:45.208 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:40.960394+0000", 2024-09-13T05:12:45.208 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.1976239880000001, 2024-09-13T05:12:45.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003063957, 2024-09-13T05:12:45.208 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.208 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.208 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.208 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.960394+0000", 2024-09-13T05:12:45.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.209 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.209 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.960394+0000", 2024-09-13T05:12:45.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.209 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.209 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.960393+0000", 2024-09-13T05:12:45.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:45.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.209 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.209 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.960948+0000", 2024-09-13T05:12:45.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000554832 2024-09-13T05:12:45.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.210 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.210 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.210 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.960985+0000", 2024-09-13T05:12:45.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7431000000000001e-05 2024-09-13T05:12:45.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.210 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.210 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.210 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.961001+0000", 2024-09-13T05:12:45.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5780000000000001e-05 2024-09-13T05:12:45.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.210 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.211 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.961108+0000", 2024-09-13T05:12:45.211 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107352 2024-09-13T05:12:45.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.211 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.961121+0000", 2024-09-13T05:12:45.211 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2588e-05 2024-09-13T05:12:45.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.211 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.963458+0000", 2024-09-13T05:12:45.211 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023371260000000001 2024-09-13T05:12:45.211 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.212 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.212 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.212 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.212 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.212 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.f 149/143 [PushOp(3:f4a50fbe:::rbd_data.112db114688b.0000000000000001:head, version: 53'359, data_included: [1048576~601950,1835008~262144], data_size: 864094, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:f4a50fbe:::rbd_data.112db114688b.0000000000000001:head@53'359, size: 2788113, copy_subset: [0~2788113], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:2788113, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", 2024-09-13T05:12:45.212 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:43.781167+0000", 2024-09-13T05:12:45.212 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.376851144, 2024-09-13T05:12:45.212 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0030868649999999998, 2024-09-13T05:12:45.212 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.212 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.212 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.212 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.212 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.213 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:43.781167+0000", 2024-09-13T05:12:45.213 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.213 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.213 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.213 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.213 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:43.781167+0000", 2024-09-13T05:12:45.213 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.213 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.213 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.213 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.213 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:43.781165+0000", 2024-09-13T05:12:45.213 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:45.213 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.213 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.214 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.214 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:43.781768+0000", 2024-09-13T05:12:45.214 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00060277900000000001 2024-09-13T05:12:45.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.214 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.214 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.214 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:43.781799+0000", 2024-09-13T05:12:45.214 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0605999999999998e-05 2024-09-13T05:12:45.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.214 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.214 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.214 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:43.781845+0000", 2024-09-13T05:12:45.214 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5924000000000003e-05 2024-09-13T05:12:45.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.215 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.215 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:43.781970+0000", 2024-09-13T05:12:45.215 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000125284 2024-09-13T05:12:45.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.215 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.215 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:43.782000+0000", 2024-09-13T05:12:45.215 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0457999999999999e-05 2024-09-13T05:12:45.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.215 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.216 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:43.784254+0000", 2024-09-13T05:12:45.216 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022531119999999998 2024-09-13T05:12:45.216 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.216 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.216 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.216 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.216 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.216 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.1a 149/143 [PushOp(3:5f416f2f:::rbd_data.112d265b2a09.0000000000000009:head, version: 31'15, data_included: [0~229376,245760~32768,294912~225256], data_size: 487400, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:5f416f2f:::rbd_data.112d265b2a09.0000000000000009:head@31'15, size: 520168, copy_subset: [0~520168], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:520168, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:45.216 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:44.321799+0000", 2024-09-13T05:12:45.216 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.83621862700000005, 2024-09-13T05:12:45.216 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0032178290000000002, 2024-09-13T05:12:45.216 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.216 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.217 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.217 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.217 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.217 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.321799+0000", 2024-09-13T05:12:45.217 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.217 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.217 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.217 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.217 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.321799+0000", 2024-09-13T05:12:45.217 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.217 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.217 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.217 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.321797+0000", 2024-09-13T05:12:45.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:12:45.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.218 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.218 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.322721+0000", 2024-09-13T05:12:45.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00092462999999999996 2024-09-13T05:12:45.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.218 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.218 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.322759+0000", 2024-09-13T05:12:45.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7750999999999998e-05 2024-09-13T05:12:45.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.218 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.218 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.219 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.322782+0000", 2024-09-13T05:12:45.219 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3159999999999998e-05 2024-09-13T05:12:45.219 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.219 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.219 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.219 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.322900+0000", 2024-09-13T05:12:45.219 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011783299999999999 2024-09-13T05:12:45.219 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.219 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.219 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.219 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.322914+0000", 2024-09-13T05:12:45.219 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4114000000000001e-05 2024-09-13T05:12:45.219 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.219 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.220 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.220 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.325017+0000", 2024-09-13T05:12:45.220 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021028010000000001 2024-09-13T05:12:45.220 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.220 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.220 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.220 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.220 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.220 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.1.0:1125 3.6 e150/148 3:64971f98:::rbd_data.112db1dfbf0e.0000000000000003:2e v 150'548, mlcod=149'545)", 2024-09-13T05:12:45.220 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:44.641341+0000", 2024-09-13T05:12:45.220 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.516676625, 2024-09-13T05:12:45.220 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033107639999999999, 2024-09-13T05:12:45.220 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.221 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:45.221 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.221 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.221 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.641341+0000", 2024-09-13T05:12:45.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.221 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.221 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.641341+0000", 2024-09-13T05:12:45.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.222 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.222 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.222 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.641340+0000", 2024-09-13T05:12:45.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:45.222 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.222 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.222 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.222 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.641349+0000", 2024-09-13T05:12:45.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.3510000000000002e-06 2024-09-13T05:12:45.222 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.222 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.222 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.222 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.641367+0000", 2024-09-13T05:12:45.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8510999999999999e-05 2024-09-13T05:12:45.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.641374+0000", 2024-09-13T05:12:45.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7150000000000001e-06 2024-09-13T05:12:45.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.641469+0000", 2024-09-13T05:12:45.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5545999999999996e-05 2024-09-13T05:12:45.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.641508+0000", 2024-09-13T05:12:45.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8223000000000003e-05 2024-09-13T05:12:45.224 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.224 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:45.224 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.644604+0000", 2024-09-13T05:12:45.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0030961560000000001 2024-09-13T05:12:45.224 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.224 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.224 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.644652+0000", 2024-09-13T05:12:45.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8151e-05 2024-09-13T05:12:45.224 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.224 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.225 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.225 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.225 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.225 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.1a 150/143 [PushOp(3:5ee2787d:::rbd_data.112d667fb7f9.0000000000000008:19, version: 71'204, data_included: [0~32768,65536~65536,163840~98304], data_size: 196608, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:5ee2787d:::rbd_data.112d667fb7f9.0000000000000008:19@71'204, size: 262144, copy_subset: [0~262144], clone_subset: {}, snapset: 19=[]:{19=[19]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:262144, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:45.225 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:44.641971+0000", 2024-09-13T05:12:45.225 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.51604644399999999, 2024-09-13T05:12:45.225 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0036569710000000002, 2024-09-13T05:12:45.225 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.225 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.225 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.225 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.225 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.225 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.641971+0000", 2024-09-13T05:12:45.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.641971+0000", 2024-09-13T05:12:45.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.641970+0000", 2024-09-13T05:12:45.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:45.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.642211+0000", 2024-09-13T05:12:45.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024046199999999999 2024-09-13T05:12:45.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.642229+0000", 2024-09-13T05:12:45.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8587e-05 2024-09-13T05:12:45.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.642312+0000", 2024-09-13T05:12:45.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2225000000000006e-05 2024-09-13T05:12:45.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.228 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.228 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.643077+0000", 2024-09-13T05:12:45.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00076504999999999997 2024-09-13T05:12:45.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.228 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.228 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.643090+0000", 2024-09-13T05:12:45.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2796000000000001e-05 2024-09-13T05:12:45.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.228 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.228 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.645628+0000", 2024-09-13T05:12:45.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025388989999999998 2024-09-13T05:12:45.229 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.229 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.229 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.229 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.229 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.229 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.1.0:1126 3.6 e150/148 3:66c34280:::rbd_data.112db1dfbf0e.0000000000000002:2e v 150'550, mlcod=149'545)", 2024-09-13T05:12:45.229 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:44.642337+0000", 2024-09-13T05:12:45.229 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.51568103499999995, 2024-09-13T05:12:45.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033021309999999998, 2024-09-13T05:12:45.229 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.229 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:45.230 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.230 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.642337+0000", 2024-09-13T05:12:45.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.230 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.642337+0000", 2024-09-13T05:12:45.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.230 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.642336+0000", 2024-09-13T05:12:45.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:45.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.642345+0000", 2024-09-13T05:12:45.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.3629999999999994e-06 2024-09-13T05:12:45.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.642354+0000", 2024-09-13T05:12:45.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7070000000000004e-06 2024-09-13T05:12:45.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.232 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.232 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.642361+0000", 2024-09-13T05:12:45.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3740000000000003e-06 2024-09-13T05:12:45.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.232 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.232 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.232 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.643695+0000", 2024-09-13T05:12:45.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0013343719999999999 2024-09-13T05:12:45.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.232 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.232 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.232 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.643713+0000", 2024-09-13T05:12:45.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7606999999999999e-05 2024-09-13T05:12:45.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:45.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.645610+0000", 2024-09-13T05:12:45.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0018970879999999999 2024-09-13T05:12:45.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.645639+0000", 2024-09-13T05:12:45.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9317000000000001e-05 2024-09-13T05:12:45.233 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.233 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.233 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.234 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.234 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.234 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.1a 150/143 [PushOp(3:5af372d9:::rbd_data.112d1f830c0e.0000000000000003:head, version: 92'308, data_included: [0~47106,339081~16689,524288~131072,786432~131072,1048576~722637], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:5af372d9:::rbd_data.112d1f830c0e.0000000000000003:head@92'308, size: 10305184, copy_subset: [0~10305184], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1771213, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:45.234 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:44.772454+0000", 2024-09-13T05:12:45.234 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.38556411299999999, 2024-09-13T05:12:45.234 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003486112, 2024-09-13T05:12:45.234 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.234 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.234 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.235 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.772454+0000", 2024-09-13T05:12:45.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.235 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.772454+0000", 2024-09-13T05:12:45.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.235 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.772453+0000", 2024-09-13T05:12:45.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:45.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.773969+0000", 2024-09-13T05:12:45.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0015167539999999999 2024-09-13T05:12:45.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.774006+0000", 2024-09-13T05:12:45.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6179e-05 2024-09-13T05:12:45.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.774033+0000", 2024-09-13T05:12:45.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7648e-05 2024-09-13T05:12:45.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.774139+0000", 2024-09-13T05:12:45.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000105697 2024-09-13T05:12:45.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.774151+0000", 2024-09-13T05:12:45.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1532000000000001e-05 2024-09-13T05:12:45.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.238 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.238 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.238 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.775940+0000", 2024-09-13T05:12:45.238 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0017893620000000001 2024-09-13T05:12:45.238 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.238 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.238 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.238 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.238 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.238 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.1a 150/143 [PushOp(3:5af372d9:::rbd_data.112d1f830c0e.0000000000000003:head, version: 92'308, data_included: [1771213~325939,10300732~4452], data_size: 330391, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:5af372d9:::rbd_data.112d1f830c0e.0000000000000003:head@92'308, size: 10305184, copy_subset: [0~10305184], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:10305184, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:1771213, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", 2024-09-13T05:12:45.238 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:44.778082+0000", 2024-09-13T05:12:45.238 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.37993584699999999, 2024-09-13T05:12:45.238 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0034322860000000001, 2024-09-13T05:12:45.238 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.239 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.239 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.239 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.239 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.239 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.778082+0000", 2024-09-13T05:12:45.239 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.239 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.239 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.239 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.239 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.778082+0000", 2024-09-13T05:12:45.239 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.239 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.239 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.239 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.240 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.778081+0000", 2024-09-13T05:12:45.240 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:45.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.240 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.240 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.240 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.778520+0000", 2024-09-13T05:12:45.240 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00043967700000000003 2024-09-13T05:12:45.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.240 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.240 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.240 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.778557+0000", 2024-09-13T05:12:45.240 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7067000000000003e-05 2024-09-13T05:12:45.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.778584+0000", 2024-09-13T05:12:45.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6451000000000001e-05 2024-09-13T05:12:45.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.778700+0000", 2024-09-13T05:12:45.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000116425 2024-09-13T05:12:45.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.778717+0000", 2024-09-13T05:12:45.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6413e-05 2024-09-13T05:12:45.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.781514+0000", 2024-09-13T05:12:45.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0027977190000000002 2024-09-13T05:12:45.242 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.242 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.242 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.242 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.e 150/143 [PushOp(3:70e8fe20:::rbd_data.112de12546cf.0000000000000002:head, version: 45'527, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:70e8fe20:::rbd_data.112de12546cf.0000000000000002:head@45'527, size: 1048576, copy_subset: [0~1048576], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:45.242 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:45.134724+0000", 2024-09-13T05:12:45.242 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.023293952999999999, 2024-09-13T05:12:45.243 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033495320000000001, 2024-09-13T05:12:45.243 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.243 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.243 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.243 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.243 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.243 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.134724+0000", 2024-09-13T05:12:45.243 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.243 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.243 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.243 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.243 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.134724+0000", 2024-09-13T05:12:45.243 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.243 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.244 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.244 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.244 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.134722+0000", 2024-09-13T05:12:45.244 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:45.244 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.244 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.244 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.244 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.135809+0000", 2024-09-13T05:12:45.244 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001086488 2024-09-13T05:12:45.244 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.244 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.244 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.244 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.135843+0000", 2024-09-13T05:12:45.244 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4548000000000002e-05 2024-09-13T05:12:45.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.245 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.245 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.245 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.135868+0000", 2024-09-13T05:12:45.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4671000000000001e-05 2024-09-13T05:12:45.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.245 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.245 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.245 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.135986+0000", 2024-09-13T05:12:45.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000118078 2024-09-13T05:12:45.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.245 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.245 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.245 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.136005+0000", 2024-09-13T05:12:45.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9332000000000001e-05 2024-09-13T05:12:45.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.138073+0000", 2024-09-13T05:12:45.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020683089999999999 2024-09-13T05:12:45.246 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.246 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.246 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.246 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.e 150/143 [PushOp(3:762a664f:::rbd_data.112de12546cf.0000000000000004:head, version: 45'528, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:762a664f:::rbd_data.112de12546cf.0000000000000004:head@45'528, size: 1048576, copy_subset: [0~1048576], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:45.247 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:45.140672+0000", 2024-09-13T05:12:45.247 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.017345418000000001, 2024-09-13T05:12:45.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0031859169999999999, 2024-09-13T05:12:45.247 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.247 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.247 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.140672+0000", 2024-09-13T05:12:45.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.140672+0000", 2024-09-13T05:12:45.248 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.248 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.248 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.248 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.140671+0000", 2024-09-13T05:12:45.248 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:45.248 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.248 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.248 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.141462+0000", 2024-09-13T05:12:45.248 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00079088499999999996 2024-09-13T05:12:45.248 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.248 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.249 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.141490+0000", 2024-09-13T05:12:45.249 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7769000000000001e-05 2024-09-13T05:12:45.249 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.249 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.249 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.249 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.141508+0000", 2024-09-13T05:12:45.249 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7810999999999999e-05 2024-09-13T05:12:45.249 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.249 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.249 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.249 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.141639+0000", 2024-09-13T05:12:45.249 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013135600000000001 2024-09-13T05:12:45.249 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.249 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.141664+0000", 2024-09-13T05:12:45.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4620000000000001e-05 2024-09-13T05:12:45.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.143858+0000", 2024-09-13T05:12:45.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021945649999999999 2024-09-13T05:12:45.250 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.250 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.250 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.250 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.250 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.250 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:45.252 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:12:45.252 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:45.248+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:45.352 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:45.348+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:45.412 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:45.412 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:45.412 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:45.412 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:45.422 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:12:45.454 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:45.451+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:45.538 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:45.538 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:45.539 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:45.539 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:45.539 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:45.549 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:12:45.554 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:45.551+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:45.652 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is set 2024-09-13T05:12:45.655 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:45.652+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:45.665 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:45.665 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:45.665 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:45.665 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:45.665 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.665 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3.bb1d1096 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:45.666 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:45.666 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 81.718481530000005, 2024-09-13T05:12:45.666 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68834410099999999, 2024-09-13T05:12:45.666 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.666 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:45.666 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:45.666 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:45.666 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:45.666 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:12:45.666 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.666 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.666 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.666 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.666 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:45.667 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.667 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.667 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.667 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.667 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:45.667 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.667 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.667 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.667 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.667 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943719+0000", 2024-09-13T05:12:45.667 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:12:45.667 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.667 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.668 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.668 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943734+0000", 2024-09-13T05:12:45.668 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4793e-05 2024-09-13T05:12:45.668 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.668 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.668 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.668 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943765+0000", 2024-09-13T05:12:45.668 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0648999999999997e-05 2024-09-13T05:12:45.668 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.668 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.668 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.668 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943779+0000", 2024-09-13T05:12:45.668 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.447e-05 2024-09-13T05:12:45.669 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.669 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.669 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.669 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943872+0000", 2024-09-13T05:12:45.669 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3304e-05 2024-09-13T05:12:45.669 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.669 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.669 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:45.669 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943884+0000", 2024-09-13T05:12:45.669 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.167e-05 2024-09-13T05:12:45.669 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.669 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.669 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.670 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632042+0000", 2024-09-13T05:12:45.670 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68815832600000004 2024-09-13T05:12:45.670 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.670 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.670 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.670 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632066+0000", 2024-09-13T05:12:45.670 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3765999999999999e-05 2024-09-13T05:12:45.670 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.670 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.670 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.670 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.670 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.670 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3.b6bd6256 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:45.670 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:45.671 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 81.718357029999993, 2024-09-13T05:12:45.671 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68852592499999998, 2024-09-13T05:12:45.671 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.671 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:45.671 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:45.671 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:45.671 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:45.671 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:12:45.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.671 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.671 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.671 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.671 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:45.671 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.672 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.672 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.672 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.672 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:45.672 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.672 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.672 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.672 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.672 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943846+0000", 2024-09-13T05:12:45.672 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:45.672 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.672 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.672 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.673 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943852+0000", 2024-09-13T05:12:45.673 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3820000000000001e-06 2024-09-13T05:12:45.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.673 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.673 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.673 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943876+0000", 2024-09-13T05:12:45.673 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3995e-05 2024-09-13T05:12:45.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.673 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.673 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.673 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943898+0000", 2024-09-13T05:12:45.673 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1838999999999999e-05 2024-09-13T05:12:45.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.673 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.674 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.674 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946457+0000", 2024-09-13T05:12:45.674 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025588910000000002 2024-09-13T05:12:45.674 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.674 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.674 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:45.674 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946499+0000", 2024-09-13T05:12:45.674 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2814e-05 2024-09-13T05:12:45.674 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.674 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.674 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.674 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632364+0000", 2024-09-13T05:12:45.674 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68586484999999997 2024-09-13T05:12:45.675 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.675 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.675 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.675 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632372+0000", 2024-09-13T05:12:45.675 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1659999999999994e-06 2024-09-13T05:12:45.675 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.675 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.675 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.675 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.675 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.675 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3:6908b8dd:::rbd_data.112d8d1317eb.000000000000000f:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:45.675 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:45.675 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 81.681212951999996, 2024-09-13T05:12:45.675 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65181049499999999, 2024-09-13T05:12:45.676 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.676 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.676 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:45.676 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:45.676 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:45.676 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:12:45.676 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.676 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.676 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.676 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.676 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:45.676 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.676 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.676 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.677 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.677 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:45.677 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.677 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.677 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.677 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.677 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980989+0000", 2024-09-13T05:12:45.677 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:45.677 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.677 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.677 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.677 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980996+0000", 2024-09-13T05:12:45.677 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2200000000000003e-06 2024-09-13T05:12:45.678 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.678 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.678 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981011+0000", 2024-09-13T05:12:45.678 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4997000000000001e-05 2024-09-13T05:12:45.678 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.678 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.678 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981025+0000", 2024-09-13T05:12:45.678 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3604000000000001e-05 2024-09-13T05:12:45.678 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.678 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.678 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981110+0000", 2024-09-13T05:12:45.679 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4948000000000001e-05 2024-09-13T05:12:45.679 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.679 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.679 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:45.679 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981120+0000", 2024-09-13T05:12:45.679 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9399999999999997e-06 2024-09-13T05:12:45.679 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.679 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.679 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.679 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632425+0000", 2024-09-13T05:12:45.679 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65130460499999998 2024-09-13T05:12:45.679 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.679 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.679 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.680 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632587+0000", 2024-09-13T05:12:45.680 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016199500000000001 2024-09-13T05:12:45.680 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.680 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.680 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.680 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632801+0000", 2024-09-13T05:12:45.680 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021459499999999999 2024-09-13T05:12:45.680 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.680 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.680 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.680 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.680 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.680 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3:6a46bd6d:::rbd_data.112d8d1317eb.0000000000000010:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:45.681 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:45.681 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 81.681155296, 2024-09-13T05:12:45.681 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65213695699999996, 2024-09-13T05:12:45.681 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.681 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.681 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:45.681 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:45.681 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:45.681 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:12:45.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.681 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.681 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.681 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:45.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.682 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.682 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:45.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.682 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.682 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:45.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:45.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.682 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.683 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981052+0000", 2024-09-13T05:12:45.683 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4469999999999999e-06 2024-09-13T05:12:45.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.683 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.683 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.683 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981066+0000", 2024-09-13T05:12:45.683 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3658e-05 2024-09-13T05:12:45.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.683 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.683 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.683 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981073+0000", 2024-09-13T05:12:45.683 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:12:45.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.683 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.684 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.684 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981150+0000", 2024-09-13T05:12:45.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7783999999999999e-05 2024-09-13T05:12:45.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.684 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:45.684 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981161+0000", 2024-09-13T05:12:45.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0197000000000001e-05 2024-09-13T05:12:45.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.684 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.684 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632926+0000", 2024-09-13T05:12:45.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65176517300000003 2024-09-13T05:12:45.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.685 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.685 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633081+0000", 2024-09-13T05:12:45.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000155172 2024-09-13T05:12:45.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.685 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.685 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633185+0000", 2024-09-13T05:12:45.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000104329 2024-09-13T05:12:45.685 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.685 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.685 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.686 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:159585 3.1c 3:3afcc414:::rbd_data.112dfd94ee88.00000000000002ca:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:45.686 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:45.686 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 38.647836982999998, 2024-09-13T05:12:45.686 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91717655399999998, 2024-09-13T05:12:45.686 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.686 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.686 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:45.686 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:45.686 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:45.686 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 159585 2024-09-13T05:12:45.686 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.686 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.686 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.686 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.686 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:45.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:45.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014366+0000", 2024-09-13T05:12:45.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:45.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.688 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014370+0000", 2024-09-13T05:12:45.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9960000000000004e-06 2024-09-13T05:12:45.688 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.688 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.688 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.688 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014379+0000", 2024-09-13T05:12:45.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8550000000000008e-06 2024-09-13T05:12:45.688 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.688 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.688 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.688 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014386+0000", 2024-09-13T05:12:45.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0140000000000001e-06 2024-09-13T05:12:45.688 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.689 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.689 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.689 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014533+0000", 2024-09-13T05:12:45.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000147458 2024-09-13T05:12:45.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.689 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.689 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:45.689 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014545+0000", 2024-09-13T05:12:45.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1318000000000001e-05 2024-09-13T05:12:45.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.689 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.689 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.689 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931378+0000", 2024-09-13T05:12:45.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91683292400000005 2024-09-13T05:12:45.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931495+0000", 2024-09-13T05:12:45.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011726399999999999 2024-09-13T05:12:45.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931543+0000", 2024-09-13T05:12:45.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8183000000000003e-05 2024-09-13T05:12:45.690 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.690 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.690 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.691 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160206 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 83968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:45.691 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:45.691 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 38.624434586, 2024-09-13T05:12:45.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89412730799999995, 2024-09-13T05:12:45.691 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.691 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.691 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:45.691 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:45.691 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:45.691 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160206 2024-09-13T05:12:45.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.691 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.692 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.692 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:45.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.692 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.692 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:45.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.692 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.692 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037768+0000", 2024-09-13T05:12:45.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:45.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037774+0000", 2024-09-13T05:12:45.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3600000000000001e-06 2024-09-13T05:12:45.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037786+0000", 2024-09-13T05:12:45.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.188e-05 2024-09-13T05:12:45.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037793+0000", 2024-09-13T05:12:45.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2749999999999998e-06 2024-09-13T05:12:45.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:45.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0353000000000003e-05 2024-09-13T05:12:45.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:45.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037862+0000", 2024-09-13T05:12:45.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9710000000000004e-06 2024-09-13T05:12:45.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.695 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.695 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931610+0000", 2024-09-13T05:12:45.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89374846299999999 2024-09-13T05:12:45.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.695 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.695 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931815+0000", 2024-09-13T05:12:45.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020516499999999999 2024-09-13T05:12:45.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.695 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.695 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931896+0000", 2024-09-13T05:12:45.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1157999999999998e-05 2024-09-13T05:12:45.696 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.696 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.696 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.696 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.696 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160208 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 84992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:45.696 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:45.696 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 38.624349846999998, 2024-09-13T05:12:45.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440702299999997, 2024-09-13T05:12:45.696 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.696 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.696 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:45.696 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:45.697 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:45.697 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160208 2024-09-13T05:12:45.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.697 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:45.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:45.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037853+0000", 2024-09-13T05:12:45.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:45.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037858+0000", 2024-09-13T05:12:45.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2179999999999998e-06 2024-09-13T05:12:45.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037867+0000", 2024-09-13T05:12:45.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5699999999999993e-06 2024-09-13T05:12:45.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.699 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037874+0000", 2024-09-13T05:12:45.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2810000000000003e-06 2024-09-13T05:12:45.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.699 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037935+0000", 2024-09-13T05:12:45.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1231999999999999e-05 2024-09-13T05:12:45.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.700 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:45.700 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037944+0000", 2024-09-13T05:12:45.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8580000000000006e-06 2024-09-13T05:12:45.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.700 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.700 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931956+0000", 2024-09-13T05:12:45.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89401158800000002 2024-09-13T05:12:45.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.700 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.700 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932015+0000", 2024-09-13T05:12:45.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8906999999999997e-05 2024-09-13T05:12:45.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932261+0000", 2024-09-13T05:12:45.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024622799999999997 2024-09-13T05:12:45.701 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.701 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.701 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.701 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160210 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 86016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:45.701 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:45.702 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 38.624280992999999, 2024-09-13T05:12:45.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89428998299999996, 2024-09-13T05:12:45.702 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.702 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.702 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:45.702 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:45.702 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:45.702 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160210 2024-09-13T05:12:45.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.702 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.702 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.702 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:45.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:45.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037922+0000", 2024-09-13T05:12:45.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:45.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037926+0000", 2024-09-13T05:12:45.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6550000000000003e-06 2024-09-13T05:12:45.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037933+0000", 2024-09-13T05:12:45.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5409999999999997e-06 2024-09-13T05:12:45.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037939+0000", 2024-09-13T05:12:45.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1940000000000003e-06 2024-09-13T05:12:45.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.705 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037976+0000", 2024-09-13T05:12:45.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6671000000000002e-05 2024-09-13T05:12:45.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:45.705 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037982+0000", 2024-09-13T05:12:45.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9669999999999998e-06 2024-09-13T05:12:45.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.705 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932096+0000", 2024-09-13T05:12:45.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89411465599999995 2024-09-13T05:12:45.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.706 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932149+0000", 2024-09-13T05:12:45.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3032999999999999e-05 2024-09-13T05:12:45.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.706 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932213+0000", 2024-09-13T05:12:45.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3165999999999998e-05 2024-09-13T05:12:45.706 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.706 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.706 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.706 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160212 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 87040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:45.707 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:45.707 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 38.624193871999999, 2024-09-13T05:12:45.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440379699999994, 2024-09-13T05:12:45.707 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.707 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.707 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:45.707 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:45.707 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:45.707 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160212 2024-09-13T05:12:45.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.707 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:45.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:45.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038009+0000", 2024-09-13T05:12:45.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:45.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.709 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.709 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038013+0000", 2024-09-13T05:12:45.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3950000000000003e-06 2024-09-13T05:12:45.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.709 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.709 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038032+0000", 2024-09-13T05:12:45.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8513999999999999e-05 2024-09-13T05:12:45.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.709 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.709 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038039+0000", 2024-09-13T05:12:45.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.985e-06 2024-09-13T05:12:45.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038086+0000", 2024-09-13T05:12:45.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7302999999999998e-05 2024-09-13T05:12:45.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:45.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038090+0000", 2024-09-13T05:12:45.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9029999999999997e-06 2024-09-13T05:12:45.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932291+0000", 2024-09-13T05:12:45.711 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89420100199999997 2024-09-13T05:12:45.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.711 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.711 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932352+0000", 2024-09-13T05:12:45.711 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1354999999999998e-05 2024-09-13T05:12:45.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.711 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.711 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932414+0000", 2024-09-13T05:12:45.711 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1037999999999994e-05 2024-09-13T05:12:45.711 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.711 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.711 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.712 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.712 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160214 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 88064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:45.712 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:45.712 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 38.624062805999998, 2024-09-13T05:12:45.712 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89438890900000001, 2024-09-13T05:12:45.712 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.712 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.712 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:45.712 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:45.712 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:45.712 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160214 2024-09-13T05:12:45.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.713 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:45.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:45.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038140+0000", 2024-09-13T05:12:45.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:45.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.714 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038145+0000", 2024-09-13T05:12:45.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9749999999999998e-06 2024-09-13T05:12:45.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.714 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038153+0000", 2024-09-13T05:12:45.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1280000000000008e-06 2024-09-13T05:12:45.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038161+0000", 2024-09-13T05:12:45.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0339999999999997e-06 2024-09-13T05:12:45.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.715 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038199+0000", 2024-09-13T05:12:45.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8269999999999998e-05 2024-09-13T05:12:45.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.715 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:45.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038204+0000", 2024-09-13T05:12:45.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5399999999999997e-06 2024-09-13T05:12:45.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.716 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.716 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932438+0000", 2024-09-13T05:12:45.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89423397999999998 2024-09-13T05:12:45.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.716 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.716 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.716 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932480+0000", 2024-09-13T05:12:45.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2392999999999999e-05 2024-09-13T05:12:45.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.716 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.716 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.716 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932530+0000", 2024-09-13T05:12:45.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:12:45.717 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.717 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.717 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.717 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160305 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 215040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:45.717 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:45.717 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 38.619859583999997, 2024-09-13T05:12:45.717 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89028175300000001, 2024-09-13T05:12:45.717 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.717 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.717 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:45.717 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:45.717 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:45.718 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160305 2024-09-13T05:12:45.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.718 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.718 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.718 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:45.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.718 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.718 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:45.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.719 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.719 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042343+0000", 2024-09-13T05:12:45.719 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:45.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.719 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.719 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.719 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042350+0000", 2024-09-13T05:12:45.719 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3769999999999998e-06 2024-09-13T05:12:45.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.719 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.719 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.719 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042367+0000", 2024-09-13T05:12:45.719 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.734e-05 2024-09-13T05:12:45.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.720 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.720 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.720 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042375+0000", 2024-09-13T05:12:45.720 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8469999999999996e-06 2024-09-13T05:12:45.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.720 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.720 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.720 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042428+0000", 2024-09-13T05:12:45.720 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3074e-05 2024-09-13T05:12:45.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.720 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.720 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:45.720 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042437+0000", 2024-09-13T05:12:45.720 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:12:45.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.721 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.721 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.721 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932550+0000", 2024-09-13T05:12:45.721 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89011304300000005 2024-09-13T05:12:45.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.721 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.721 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.721 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932589+0000", 2024-09-13T05:12:45.721 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9236000000000002e-05 2024-09-13T05:12:45.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.721 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.721 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.721 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932626+0000", 2024-09-13T05:12:45.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6832999999999998e-05 2024-09-13T05:12:45.722 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.722 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.722 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.722 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160307 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 216064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:45.722 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:45.722 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 38.619813145000002, 2024-09-13T05:12:45.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89032630800000001, 2024-09-13T05:12:45.722 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.722 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.722 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:45.722 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:45.723 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:45.723 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160307 2024-09-13T05:12:45.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.723 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.723 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.723 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:45.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.723 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.723 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:45.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:45.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:45.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042394+0000", 2024-09-13T05:12:45.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7900000000000001e-06 2024-09-13T05:12:45.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042401+0000", 2024-09-13T05:12:45.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.267e-06 2024-09-13T05:12:45.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.725 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.725 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042406+0000", 2024-09-13T05:12:45.725 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0860000000000001e-06 2024-09-13T05:12:45.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.725 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.725 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042465+0000", 2024-09-13T05:12:45.725 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9441000000000002e-05 2024-09-13T05:12:45.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.725 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:45.726 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042471+0000", 2024-09-13T05:12:45.726 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6640000000000003e-06 2024-09-13T05:12:45.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.726 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.726 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.726 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932645+0000", 2024-09-13T05:12:45.726 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89017372900000002 2024-09-13T05:12:45.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.726 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.726 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.726 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932681+0000", 2024-09-13T05:12:45.726 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5918999999999999e-05 2024-09-13T05:12:45.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.726 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.727 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.727 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932717+0000", 2024-09-13T05:12:45.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6007999999999998e-05 2024-09-13T05:12:45.727 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.727 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.727 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.727 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160309 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 217088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:45.727 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:45.727 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 38.619762885999997, 2024-09-13T05:12:45.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89037315900000003, 2024-09-13T05:12:45.727 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.728 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.728 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:45.728 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:45.728 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:45.728 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160309 2024-09-13T05:12:45.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.728 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:45.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:45.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042440+0000", 2024-09-13T05:12:45.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:45.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042444+0000", 2024-09-13T05:12:45.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.104e-06 2024-09-13T05:12:45.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.730 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.730 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.730 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042451+0000", 2024-09-13T05:12:45.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.922e-06 2024-09-13T05:12:45.730 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.730 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.730 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.730 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042457+0000", 2024-09-13T05:12:45.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3979999999999998e-06 2024-09-13T05:12:45.730 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.730 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.730 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.730 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042497+0000", 2024-09-13T05:12:45.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0692999999999998e-05 2024-09-13T05:12:45.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:45.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042503+0000", 2024-09-13T05:12:45.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.553e-06 2024-09-13T05:12:45.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932735+0000", 2024-09-13T05:12:45.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89023238699999996 2024-09-13T05:12:45.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932771+0000", 2024-09-13T05:12:45.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5972000000000001e-05 2024-09-13T05:12:45.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.732 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932814+0000", 2024-09-13T05:12:45.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2657000000000002e-05 2024-09-13T05:12:45.732 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.732 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.732 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.732 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160311 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 218112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:45.732 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:45.733 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 38.619737395999998, 2024-09-13T05:12:45.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89045284400000002, 2024-09-13T05:12:45.733 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.733 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.733 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:45.733 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:45.733 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:45.733 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160311 2024-09-13T05:12:45.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.733 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.733 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.733 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:45.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:45.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:45.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:45.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042469+0000", 2024-09-13T05:12:45.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.456e-06 2024-09-13T05:12:45.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042475+0000", 2024-09-13T05:12:45.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0990000000000004e-06 2024-09-13T05:12:45.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.735 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.735 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042481+0000", 2024-09-13T05:12:45.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.237e-06 2024-09-13T05:12:45.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.736 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.736 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042527+0000", 2024-09-13T05:12:45.736 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6796999999999999e-05 2024-09-13T05:12:45.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.736 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:45.736 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042533+0000", 2024-09-13T05:12:45.736 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6489999999999996e-06 2024-09-13T05:12:45.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.736 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.736 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932832+0000", 2024-09-13T05:12:45.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89029919800000001 2024-09-13T05:12:45.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932867+0000", 2024-09-13T05:12:45.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5049000000000003e-05 2024-09-13T05:12:45.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932919+0000", 2024-09-13T05:12:45.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1780999999999998e-05 2024-09-13T05:12:45.737 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.737 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.737 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.738 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160313 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 219136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:45.738 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:45.738 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 38.619708305000003, 2024-09-13T05:12:45.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89064232600000004, 2024-09-13T05:12:45.738 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.738 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.738 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:45.738 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:45.738 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:45.738 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160313 2024-09-13T05:12:45.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.739 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:45.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:45.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:45.740 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:45.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.740 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.740 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042498+0000", 2024-09-13T05:12:45.740 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.281e-06 2024-09-13T05:12:45.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.740 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.740 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042505+0000", 2024-09-13T05:12:45.740 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2699999999999999e-06 2024-09-13T05:12:45.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.740 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042512+0000", 2024-09-13T05:12:45.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0330000000000003e-06 2024-09-13T05:12:45.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.741 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042557+0000", 2024-09-13T05:12:45.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4425999999999998e-05 2024-09-13T05:12:45.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.741 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:45.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042562+0000", 2024-09-13T05:12:45.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3639999999999998e-06 2024-09-13T05:12:45.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932987+0000", 2024-09-13T05:12:45.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89042472299999997 2024-09-13T05:12:45.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933062+0000", 2024-09-13T05:12:45.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5129999999999994e-05 2024-09-13T05:12:45.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933138+0000", 2024-09-13T05:12:45.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5536000000000003e-05 2024-09-13T05:12:45.742 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.743 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.743 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.743 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160315 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 220160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:45.743 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:45.743 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 38.619677138, 2024-09-13T05:12:45.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89071820800000001, 2024-09-13T05:12:45.743 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.743 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.743 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:45.743 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:45.743 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:45.744 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160315 2024-09-13T05:12:45.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.744 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.744 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:45.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.744 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:45.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.745 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.745 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:45.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:45.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.745 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.745 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.745 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042529+0000", 2024-09-13T05:12:45.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3639999999999999e-06 2024-09-13T05:12:45.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.745 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.745 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.745 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042536+0000", 2024-09-13T05:12:45.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.866e-06 2024-09-13T05:12:45.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.746 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042541+0000", 2024-09-13T05:12:45.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:12:45.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.746 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042587+0000", 2024-09-13T05:12:45.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5735000000000002e-05 2024-09-13T05:12:45.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:45.746 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042593+0000", 2024-09-13T05:12:45.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0719999999999996e-06 2024-09-13T05:12:45.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933160+0000", 2024-09-13T05:12:45.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89056621000000002 2024-09-13T05:12:45.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933202+0000", 2024-09-13T05:12:45.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2376000000000002e-05 2024-09-13T05:12:45.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933245+0000", 2024-09-13T05:12:45.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2787999999999998e-05 2024-09-13T05:12:45.748 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.748 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.748 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.748 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160317 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:45.748 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:45.748 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 38.619648308999999, 2024-09-13T05:12:45.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89082205800000003, 2024-09-13T05:12:45.748 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.748 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.748 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:45.749 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:45.749 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:45.749 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160317 2024-09-13T05:12:45.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.749 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:45.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:45.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:45.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:45.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042558+0000", 2024-09-13T05:12:45.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1810000000000001e-06 2024-09-13T05:12:45.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042565+0000", 2024-09-13T05:12:45.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9280000000000004e-06 2024-09-13T05:12:45.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042571+0000", 2024-09-13T05:12:45.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7420000000000003e-06 2024-09-13T05:12:45.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042616+0000", 2024-09-13T05:12:45.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5201999999999999e-05 2024-09-13T05:12:45.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:45.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042622+0000", 2024-09-13T05:12:45.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8289999999999996e-06 2024-09-13T05:12:45.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933259+0000", 2024-09-13T05:12:45.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89063730799999996 2024-09-13T05:12:45.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933311+0000", 2024-09-13T05:12:45.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1910000000000003e-05 2024-09-13T05:12:45.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933377+0000", 2024-09-13T05:12:45.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6396999999999995e-05 2024-09-13T05:12:45.753 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.753 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.753 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.753 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160319 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 222208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:45.753 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:45.753 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 38.619618093, 2024-09-13T05:12:45.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89087477400000004, 2024-09-13T05:12:45.753 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.753 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.754 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:45.754 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:45.754 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:45.754 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160319 2024-09-13T05:12:45.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.754 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:45.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:45.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042585+0000", 2024-09-13T05:12:45.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:45.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042588+0000", 2024-09-13T05:12:45.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9450000000000002e-06 2024-09-13T05:12:45.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042594+0000", 2024-09-13T05:12:45.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0959999999999997e-06 2024-09-13T05:12:45.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042599+0000", 2024-09-13T05:12:45.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0069999999999997e-06 2024-09-13T05:12:45.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042642+0000", 2024-09-13T05:12:45.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2553999999999999e-05 2024-09-13T05:12:45.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:45.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042647+0000", 2024-09-13T05:12:45.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.31e-06 2024-09-13T05:12:45.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933387+0000", 2024-09-13T05:12:45.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89073982799999996 2024-09-13T05:12:45.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:12:45.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7101000000000003e-05 2024-09-13T05:12:45.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933460+0000", 2024-09-13T05:12:45.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6282999999999998e-05 2024-09-13T05:12:45.758 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.758 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.758 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.758 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160321 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 223232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:45.758 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:45.758 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 38.619588665999999, 2024-09-13T05:12:45.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89094616999999998, 2024-09-13T05:12:45.758 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.759 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:45.759 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:45.759 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:45.759 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:45.759 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160321 2024-09-13T05:12:45.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.759 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:45.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:45.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:45.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:45.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042617+0000", 2024-09-13T05:12:45.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8329999999999998e-06 2024-09-13T05:12:45.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042638+0000", 2024-09-13T05:12:45.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0908e-05 2024-09-13T05:12:45.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042644+0000", 2024-09-13T05:12:45.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0440000000000001e-06 2024-09-13T05:12:45.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042666+0000", 2024-09-13T05:12:45.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1256000000000001e-05 2024-09-13T05:12:45.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:45.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042671+0000", 2024-09-13T05:12:45.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6250000000000004e-06 2024-09-13T05:12:45.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933478+0000", 2024-09-13T05:12:45.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89080698800000002 2024-09-13T05:12:45.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.763 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.763 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933519+0000", 2024-09-13T05:12:45.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0717000000000003e-05 2024-09-13T05:12:45.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.763 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.763 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933561+0000", 2024-09-13T05:12:45.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2225999999999999e-05 2024-09-13T05:12:45.763 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.763 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.763 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.764 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:201615 3.1d 3:bb015654:::rbd_data.112d9dba7cdc.000000000000000a:head [delete] snapc 30=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2024-09-13T05:12:45.764 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:12:45.764 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.6573518849999997, 2024-09-13T05:12:45.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.90842926999999996, 2024-09-13T05:12:45.764 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:45.764 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:45.764 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:45.764 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:45.764 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:45.764 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 201615 2024-09-13T05:12:45.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.764 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:45.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:45.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:12:45.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:45.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:12:45.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:45.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:45.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004850+0000", 2024-09-13T05:12:45.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:45.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:45.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004860+0000", 2024-09-13T05:12:45.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.927e-06 2024-09-13T05:12:45.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:45.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004882+0000", 2024-09-13T05:12:45.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2079999999999999e-05 2024-09-13T05:12:45.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:45.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004897+0000", 2024-09-13T05:12:45.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4892000000000001e-05 2024-09-13T05:12:45.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.005068+0000", 2024-09-13T05:12:45.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017098999999999999 2024-09-13T05:12:45.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:45.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.005081+0000", 2024-09-13T05:12:45.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3063e-05 2024-09-13T05:12:45.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:45.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.910925+0000", 2024-09-13T05:12:45.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.90584383400000001 2024-09-13T05:12:45.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:45.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.911131+0000", 2024-09-13T05:12:45.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020629399999999999 2024-09-13T05:12:45.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 4", 2024-09-13T05:12:45.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.911313+0000", 2024-09-13T05:12:45.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000182175 2024-09-13T05:12:45.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.769 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:12:45.769 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913010+0000", 2024-09-13T05:12:45.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0016971550000000001 2024-09-13T05:12:45.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.769 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:45.769 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913212+0000", 2024-09-13T05:12:45.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000202237 2024-09-13T05:12:45.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.769 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:45.769 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913253+0000", 2024-09-13T05:12:45.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0250999999999998e-05 2024-09-13T05:12:45.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:45.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:45.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:45.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913281+0000", 2024-09-13T05:12:45.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8314e-05 2024-09-13T05:12:45.770 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.770 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.770 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.770 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:45.770 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:45.770 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:45.771 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:12:45.772 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:45.767+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:45.845 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:12:45.872 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:45.868+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:45.898 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:45.898 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:45.898 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:45.898 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:45.909 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:12:45.973 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:45.968+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:46.007 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:12:46.028 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:46.051 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:46.068 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:46.068 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:46.068 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:46.068 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:46.068 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:46.068 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:46.074 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:46.071+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:46.079 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:12:46.091 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:46.117 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:46.142 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:46.167 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:46.169 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:12:46.170 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:46.170 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:46.170 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:46.170 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:46.170 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:46.170 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:46.170 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:46.175 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:46.172+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:46.189 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:46.189 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:46.199 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:12:46.277 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:46.271+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:46.363 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:46.363 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:46.374 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:12:46.377 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:46.375+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:46.477 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:46.476+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:46.485 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:46.485 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:46.496 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:12:46.578 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:46.576+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:46.654 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:46.654 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:46.666 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:12:46.678 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:46.676+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:46.772 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:46.772 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:46.779 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:46.775+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:46.781 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:12:46.880 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:46.876+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:46.885 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:46.885 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:46.897 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:12:46.981 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:46.979+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:47.011 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:47.011 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:47.021 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:12:47.082 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:47.080+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:47.130 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:47.130 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:47.140 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:12:47.183 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:47.180+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:47.253 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:47.253 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:47.263 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:12:47.284 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:47.279+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:47.376 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:47.376 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:47.385 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:47.379+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:47.386 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:12:47.486 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:47.483+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:47.542 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:47.542 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:47.552 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:12:47.597 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:47.595+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:47.656 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:47.656 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:47.665 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T05:12:47.668 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:12:47.688 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:47.683+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:47.773 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:47.773 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:47.783 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:12:47.825 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:47.823+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:47.890 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:47.888+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:47.928 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:47.928 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:47.938 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:12:47.951 INFO:tasks.thrashosds.thrasher:in_osds: [2, 3, 5, 7, 1, 4] out_osds: [0, 6] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-13T05:12:47.951 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:12:47.951 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-13T05:12:47.951 INFO:tasks.thrashosds.thrasher:Setting osd 4 primary_affinity to 0.894749 2024-09-13T05:12:47.952 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 0.8947489008565708 2024-09-13T05:12:47.997 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:47.995+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:48.042 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:48.042 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:48.051 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:12:48.092 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:48.088+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:48.150 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:48.150 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:48.160 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:12:48.182 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:12:48.206 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:48.204+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:48.273 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:48.273 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:48.282 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:12:48.294 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:48.292+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:48.323 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:12:48.341 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:48.361 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:48.382 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:48.394 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:48.394 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:48.394 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:48.392+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:48.400 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:48.404 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:12:48.422 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:48.443 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:48.464 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:48.466 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:12:48.466 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:48.466 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:48.466 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:48.466 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:48.466 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:48.466 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:48.466 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:48.495 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:48.491+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:48.518 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:48.518 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:48.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.1 144/143 [PushOp(3:84db47f5:::rbd_data.112d9735e8af.0000000000000002:head, version: 47'61, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:84db47f5:::rbd_data.112d9735e8af.0000000000000002:head@47'61, size: 6291456, copy_subset: [0~6291456], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:39.672152+0000", 2024-09-13T05:12:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.8416238719999996, 2024-09-13T05:12:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0047065179999999998, 2024-09-13T05:12:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.672152+0000", 2024-09-13T05:12:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.672152+0000", 2024-09-13T05:12:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.672151+0000", 2024-09-13T05:12:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:48.520 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.674487+0000", 2024-09-13T05:12:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023360939999999999 2024-09-13T05:12:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.674523+0000", 2024-09-13T05:12:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6582000000000003e-05 2024-09-13T05:12:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.674556+0000", 2024-09-13T05:12:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2103000000000001e-05 2024-09-13T05:12:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.674687+0000", 2024-09-13T05:12:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013118099999999999 2024-09-13T05:12:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.674709+0000", 2024-09-13T05:12:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2509000000000001e-05 2024-09-13T05:12:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.676859+0000", 2024-09-13T05:12:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021497450000000002 2024-09-13T05:12:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.1 144/143 [PushOp(3:84db47f5:::rbd_data.112d9735e8af.0000000000000002:head, version: 47'61, data_included: [1048576~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:84db47f5:::rbd_data.112d9735e8af.0000000000000002:head@47'61, size: 6291456, copy_subset: [0~6291456], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:2097152, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", 2024-09-13T05:12:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:39.678212+0000", 2024-09-13T05:12:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.8355645200000001, 2024-09-13T05:12:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0044025239999999997, 2024-09-13T05:12:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.523 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.678212+0000", 2024-09-13T05:12:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.678212+0000", 2024-09-13T05:12:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:48.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.678210+0000", 2024-09-13T05:12:48.525 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:48.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.525 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.680365+0000", 2024-09-13T05:12:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021552479999999998 2024-09-13T05:12:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.680404+0000", 2024-09-13T05:12:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.858e-05 2024-09-13T05:12:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.680433+0000", 2024-09-13T05:12:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9145e-05 2024-09-13T05:12:48.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.680563+0000", 2024-09-13T05:12:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012996399999999999 2024-09-13T05:12:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.680586+0000", 2024-09-13T05:12:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3076999999999999e-05 2024-09-13T05:12:48.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.682614+0000", 2024-09-13T05:12:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020281600000000002 2024-09-13T05:12:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.1 144/143 [PushOp(3:8231b51f:::rbd_data.112d8ff9b77a.0000000000000005:1d, version: 81'189, data_included: [0~753664,786432~294912], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:8231b51f:::rbd_data.112d8ff9b77a.0000000000000005:1d@81'189, size: 1572864, copy_subset: [0~1572864], clone_subset: {}, snapset: 1d=[]:{1d=[1d]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1081344, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:39.880889+0000", 2024-09-13T05:12:48.529 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.6328877330000005, 2024-09-13T05:12:48.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0046534849999999997, 2024-09-13T05:12:48.530 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.530 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:48.530 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.530 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.530 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.880889+0000", 2024-09-13T05:12:48.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.530 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:48.530 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.880889+0000", 2024-09-13T05:12:48.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:48.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.880887+0000", 2024-09-13T05:12:48.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:48.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.883013+0000", 2024-09-13T05:12:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021263649999999999 2024-09-13T05:12:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.883043+0000", 2024-09-13T05:12:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0009e-05 2024-09-13T05:12:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.883075+0000", 2024-09-13T05:12:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1798999999999998e-05 2024-09-13T05:12:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.883245+0000", 2024-09-13T05:12:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000169915 2024-09-13T05:12:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.883265+0000", 2024-09-13T05:12:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9711000000000002e-05 2024-09-13T05:12:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.885542+0000", 2024-09-13T05:12:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772230000000001 2024-09-13T05:12:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.1 145/143 [PushOp(3:8468e10f:::rbd_data.112db56bb33d.0000000000000003:1f, version: 87'205, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:8468e10f:::rbd_data.112db56bb33d.0000000000000003:1f@87'205, size: 2621440, copy_subset: [0~2621440], clone_subset: {}, snapset: 1f=[]:{1f=[1f]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:2621440, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:39.907301+0000", 2024-09-13T05:12:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.6064751770000001, 2024-09-13T05:12:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0035218089999999999, 2024-09-13T05:12:48.534 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.535 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:48.535 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.535 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.535 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.907301+0000", 2024-09-13T05:12:48.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.535 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.535 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:48.535 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.907301+0000", 2024-09-13T05:12:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.907301+0000", 2024-09-13T05:12:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.908858+0000", 2024-09-13T05:12:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001557014 2024-09-13T05:12:48.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.908878+0000", 2024-09-13T05:12:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0811000000000001e-05 2024-09-13T05:12:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.908902+0000", 2024-09-13T05:12:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3930999999999998e-05 2024-09-13T05:12:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.908991+0000", 2024-09-13T05:12:48.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8354000000000001e-05 2024-09-13T05:12:48.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:48.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.908999+0000", 2024-09-13T05:12:48.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7309999999999999e-06 2024-09-13T05:12:48.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:48.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.910823+0000", 2024-09-13T05:12:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001823505 2024-09-13T05:12:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.1 145/143 [PushOp(3:8468e10f:::rbd_data.112db56bb33d.0000000000000003:head, version: 87'206, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:8468e10f:::rbd_data.112db56bb33d.0000000000000003:head@87'206, size: 1572864, copy_subset: [0~1572864], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1572864, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:39.909123+0000", 2024-09-13T05:12:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.6046530380000004, 2024-09-13T05:12:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0036698619999999999, 2024-09-13T05:12:48.539 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.909123+0000", 2024-09-13T05:12:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.909123+0000", 2024-09-13T05:12:48.540 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:48.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.909122+0000", 2024-09-13T05:12:48.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:48.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:48.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.911296+0000", 2024-09-13T05:12:48.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002174091 2024-09-13T05:12:48.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:48.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.911319+0000", 2024-09-13T05:12:48.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2976000000000002e-05 2024-09-13T05:12:48.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.911341+0000", 2024-09-13T05:12:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1678000000000001e-05 2024-09-13T05:12:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.911419+0000", 2024-09-13T05:12:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8212000000000003e-05 2024-09-13T05:12:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.911428+0000", 2024-09-13T05:12:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7299999999999994e-06 2024-09-13T05:12:48.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.544 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:48.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.912793+0000", 2024-09-13T05:12:48.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001365341 2024-09-13T05:12:48.544 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.544 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.544 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.545 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.1 145/143 [PushOp(3:87438965:::rbd_data.112dae408c93.0000000000000000:2c, version: 134'486, data_included: [131072~524288,786432~524288], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:87438965:::rbd_data.112dae408c93.0000000000000000:2c@134'486, size: 2097152, copy_subset: [0~2097152], clone_subset: {}, snapset: 2c=[]:{2c=[2c]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1310720, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:48.545 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:40.102826+0000", 2024-09-13T05:12:48.545 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.4109498780000003, 2024-09-13T05:12:48.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0034251609999999999, 2024-09-13T05:12:48.545 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.545 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:48.545 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.102826+0000", 2024-09-13T05:12:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.102826+0000", 2024-09-13T05:12:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.102825+0000", 2024-09-13T05:12:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:48.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.104404+0000", 2024-09-13T05:12:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0015791900000000001 2024-09-13T05:12:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.104446+0000", 2024-09-13T05:12:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2199e-05 2024-09-13T05:12:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.104477+0000", 2024-09-13T05:12:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1198999999999997e-05 2024-09-13T05:12:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.104597+0000", 2024-09-13T05:12:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011985300000000001 2024-09-13T05:12:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.104616+0000", 2024-09-13T05:12:48.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8777e-05 2024-09-13T05:12:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.106252+0000", 2024-09-13T05:12:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0016356599999999999 2024-09-13T05:12:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.9 145/143 [PushOp(3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a, version: 37'57, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a@37'57, size: 3145728, copy_subset: [0~3145728], clone_subset: {}, snapset: a=[]:{a=[a]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:40.247555+0000", 2024-09-13T05:12:48.549 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.2662216149999992, 2024-09-13T05:12:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0039205769999999997, 2024-09-13T05:12:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.247555+0000", 2024-09-13T05:12:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.247555+0000", 2024-09-13T05:12:48.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.247553+0000", 2024-09-13T05:12:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.249635+0000", 2024-09-13T05:12:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002082286 2024-09-13T05:12:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:48.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.249677+0000", 2024-09-13T05:12:48.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1122999999999999e-05 2024-09-13T05:12:48.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:48.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.249703+0000", 2024-09-13T05:12:48.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6982999999999999e-05 2024-09-13T05:12:48.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.249806+0000", 2024-09-13T05:12:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010210200000000001 2024-09-13T05:12:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.249824+0000", 2024-09-13T05:12:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8348000000000001e-05 2024-09-13T05:12:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.251475+0000", 2024-09-13T05:12:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0016513719999999999 2024-09-13T05:12:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.553 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.9 145/143 [PushOp(3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a, version: 37'57, data_included: [1048576~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:92fa226d:::rbd_data.112db57f3a18.0000000000000001:a@37'57, size: 3145728, copy_subset: [0~3145728], clone_subset: {}, snapset: a=[]:{a=[a]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:3145728, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", 2024-09-13T05:12:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:40.253450+0000", 2024-09-13T05:12:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.2603261690000007, 2024-09-13T05:12:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0043607760000000002, 2024-09-13T05:12:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.253450+0000", 2024-09-13T05:12:48.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.253450+0000", 2024-09-13T05:12:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.253449+0000", 2024-09-13T05:12:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.255155+0000", 2024-09-13T05:12:48.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001706155 2024-09-13T05:12:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.255190+0000", 2024-09-13T05:12:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5373999999999997e-05 2024-09-13T05:12:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.255213+0000", 2024-09-13T05:12:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2878999999999999e-05 2024-09-13T05:12:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.255355+0000", 2024-09-13T05:12:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014184399999999999 2024-09-13T05:12:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.255378+0000", 2024-09-13T05:12:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2866000000000001e-05 2024-09-13T05:12:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.257811+0000", 2024-09-13T05:12:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024332210000000002 2024-09-13T05:12:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.557 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.9 145/143 [PushOp(3:9731cd35:::rbd_data.112db114688b.0000000000000000:head, version: 53'108, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:9731cd35:::rbd_data.112db114688b.0000000000000000:head@53'108, size: 3145728, copy_subset: [0~3145728], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:40.330580+0000", 2024-09-13T05:12:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.1831959829999992, 2024-09-13T05:12:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0046015459999999998, 2024-09-13T05:12:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.330580+0000", 2024-09-13T05:12:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.330580+0000", 2024-09-13T05:12:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.330579+0000", 2024-09-13T05:12:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.332494+0000", 2024-09-13T05:12:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0019150700000000001 2024-09-13T05:12:48.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.332536+0000", 2024-09-13T05:12:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1798999999999997e-05 2024-09-13T05:12:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.332565+0000", 2024-09-13T05:12:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9505999999999998e-05 2024-09-13T05:12:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.332747+0000", 2024-09-13T05:12:48.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018156300000000001 2024-09-13T05:12:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.332779+0000", 2024-09-13T05:12:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2546000000000003e-05 2024-09-13T05:12:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.335182+0000", 2024-09-13T05:12:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002402702 2024-09-13T05:12:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.561 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.1.0:1125 3.6 e150/148 3:64971f98:::rbd_data.112db1dfbf0e.0000000000000003:2e v 150'548, mlcod=149'545)", 2024-09-13T05:12:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:44.641341+0000", 2024-09-13T05:12:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.8724351100000001, 2024-09-13T05:12:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033107639999999999, 2024-09-13T05:12:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.562 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.641341+0000", 2024-09-13T05:12:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.641341+0000", 2024-09-13T05:12:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.641340+0000", 2024-09-13T05:12:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:48.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.641349+0000", 2024-09-13T05:12:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.3510000000000002e-06 2024-09-13T05:12:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.641367+0000", 2024-09-13T05:12:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8510999999999999e-05 2024-09-13T05:12:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:48.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.641374+0000", 2024-09-13T05:12:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7150000000000001e-06 2024-09-13T05:12:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.641469+0000", 2024-09-13T05:12:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5545999999999996e-05 2024-09-13T05:12:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.641508+0000", 2024-09-13T05:12:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8223000000000003e-05 2024-09-13T05:12:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.644604+0000", 2024-09-13T05:12:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0030961560000000001 2024-09-13T05:12:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.644652+0000", 2024-09-13T05:12:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8151e-05 2024-09-13T05:12:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.567 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.1a 150/143 [PushOp(3:5ee2787d:::rbd_data.112d667fb7f9.0000000000000008:19, version: 71'204, data_included: [0~32768,65536~65536,163840~98304], data_size: 196608, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:5ee2787d:::rbd_data.112d667fb7f9.0000000000000008:19@71'204, size: 262144, copy_subset: [0~262144], clone_subset: {}, snapset: 19=[]:{19=[19]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:262144, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:48.567 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:44.641971+0000", 2024-09-13T05:12:48.567 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.8718049290000001, 2024-09-13T05:12:48.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0036569710000000002, 2024-09-13T05:12:48.567 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.567 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:48.567 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.641971+0000", 2024-09-13T05:12:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.641971+0000", 2024-09-13T05:12:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.641970+0000", 2024-09-13T05:12:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:48.569 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.642211+0000", 2024-09-13T05:12:48.569 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024046199999999999 2024-09-13T05:12:48.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:48.570 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.642229+0000", 2024-09-13T05:12:48.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8587e-05 2024-09-13T05:12:48.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.570 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:48.570 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.642312+0000", 2024-09-13T05:12:48.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2225000000000006e-05 2024-09-13T05:12:48.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.570 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.571 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.643077+0000", 2024-09-13T05:12:48.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00076504999999999997 2024-09-13T05:12:48.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.571 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.571 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:48.571 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.643090+0000", 2024-09-13T05:12:48.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2796000000000001e-05 2024-09-13T05:12:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.645628+0000", 2024-09-13T05:12:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025388989999999998 2024-09-13T05:12:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.1a 150/143 [PushOp(3:5af372d9:::rbd_data.112d1f830c0e.0000000000000003:head, version: 92'308, data_included: [0~47106,339081~16689,524288~131072,786432~131072,1048576~722637], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:5af372d9:::rbd_data.112d1f830c0e.0000000000000003:head@92'308, size: 10305184, copy_subset: [0~10305184], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1771213, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:44.772454+0000", 2024-09-13T05:12:48.572 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.741322598, 2024-09-13T05:12:48.573 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003486112, 2024-09-13T05:12:48.573 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.573 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:48.573 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.573 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.772454+0000", 2024-09-13T05:12:48.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.574 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.574 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:48.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.772454+0000", 2024-09-13T05:12:48.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.574 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.575 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:48.575 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.772453+0000", 2024-09-13T05:12:48.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:48.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.575 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:48.575 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.773969+0000", 2024-09-13T05:12:48.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0015167539999999999 2024-09-13T05:12:48.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.576 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.576 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:48.576 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.774006+0000", 2024-09-13T05:12:48.576 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6179e-05 2024-09-13T05:12:48.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.576 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:48.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.774033+0000", 2024-09-13T05:12:48.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7648e-05 2024-09-13T05:12:48.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.577 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.578 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.774139+0000", 2024-09-13T05:12:48.578 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000105697 2024-09-13T05:12:48.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:48.578 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.774151+0000", 2024-09-13T05:12:48.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1532000000000001e-05 2024-09-13T05:12:48.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:48.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.775940+0000", 2024-09-13T05:12:48.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0017893620000000001 2024-09-13T05:12:48.579 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.1a 150/143 [PushOp(3:5af372d9:::rbd_data.112d1f830c0e.0000000000000003:head, version: 92'308, data_included: [1771213~325939,10300732~4452], data_size: 330391, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:5af372d9:::rbd_data.112d1f830c0e.0000000000000003:head@92'308, size: 10305184, copy_subset: [0~10305184], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:10305184, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:1771213, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", 2024-09-13T05:12:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:44.778082+0000", 2024-09-13T05:12:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.735694332, 2024-09-13T05:12:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0034322860000000001, 2024-09-13T05:12:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.580 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.778082+0000", 2024-09-13T05:12:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.778082+0000", 2024-09-13T05:12:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.778081+0000", 2024-09-13T05:12:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.778520+0000", 2024-09-13T05:12:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00043967700000000003 2024-09-13T05:12:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.778557+0000", 2024-09-13T05:12:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7067000000000003e-05 2024-09-13T05:12:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.778584+0000", 2024-09-13T05:12:48.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6451000000000001e-05 2024-09-13T05:12:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.778700+0000", 2024-09-13T05:12:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000116425 2024-09-13T05:12:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.778717+0000", 2024-09-13T05:12:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6413e-05 2024-09-13T05:12:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.583 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:44.781514+0000", 2024-09-13T05:12:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0027977190000000002 2024-09-13T05:12:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.e 150/143 [PushOp(3:70e8fe20:::rbd_data.112de12546cf.0000000000000002:head, version: 45'527, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:70e8fe20:::rbd_data.112de12546cf.0000000000000002:head@45'527, size: 1048576, copy_subset: [0~1048576], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:45.134724+0000", 2024-09-13T05:12:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.379052438, 2024-09-13T05:12:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033495320000000001, 2024-09-13T05:12:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.584 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.134724+0000", 2024-09-13T05:12:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.134724+0000", 2024-09-13T05:12:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:48.585 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.134722+0000", 2024-09-13T05:12:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.135809+0000", 2024-09-13T05:12:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001086488 2024-09-13T05:12:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.135843+0000", 2024-09-13T05:12:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4548000000000002e-05 2024-09-13T05:12:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.135868+0000", 2024-09-13T05:12:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4671000000000001e-05 2024-09-13T05:12:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.135986+0000", 2024-09-13T05:12:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000118078 2024-09-13T05:12:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.136005+0000", 2024-09-13T05:12:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9332000000000001e-05 2024-09-13T05:12:48.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.138073+0000", 2024-09-13T05:12:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020683089999999999 2024-09-13T05:12:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:201991 3.3 e151/143 3:c56b8e2d:::rbd_object_map.112d69c7209a:head v 151'854, mlcod=25'1)", 2024-09-13T05:12:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:45.651210+0000", 2024-09-13T05:12:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 2.8625663110000001, 2024-09-13T05:12:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0048597409999999999, 2024-09-13T05:12:48.588 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.651210+0000", 2024-09-13T05:12:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.651210+0000", 2024-09-13T05:12:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.651209+0000", 2024-09-13T05:12:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.651217+0000", 2024-09-13T05:12:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5340000000000002e-06 2024-09-13T05:12:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.651225+0000", 2024-09-13T05:12:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.3340000000000002e-06 2024-09-13T05:12:48.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.651232+0000", 2024-09-13T05:12:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5880000000000003e-06 2024-09-13T05:12:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.653107+0000", 2024-09-13T05:12:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0018757240000000001 2024-09-13T05:12:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:48.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.653128+0000", 2024-09-13T05:12:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0801e-05 2024-09-13T05:12:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.656041+0000", 2024-09-13T05:12:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002912984 2024-09-13T05:12:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.656070+0000", 2024-09-13T05:12:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8710000000000001e-05 2024-09-13T05:12:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.592 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7214 3.f e151/150 3:f17197dc:::rbd_data.112d840e2e7a.0000000000000067:2f v 151'847, mlcod=0'0)", 2024-09-13T05:12:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:45.654561+0000", 2024-09-13T05:12:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 2.8592157010000001, 2024-09-13T05:12:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003462213, 2024-09-13T05:12:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.654561+0000", 2024-09-13T05:12:48.593 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.654561+0000", 2024-09-13T05:12:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.654560+0000", 2024-09-13T05:12:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.654566+0000", 2024-09-13T05:12:48.594 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.993e-06 2024-09-13T05:12:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.654576+0000", 2024-09-13T05:12:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0169e-05 2024-09-13T05:12:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.654581+0000", 2024-09-13T05:12:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2730000000000002e-06 2024-09-13T05:12:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.654620+0000", 2024-09-13T05:12:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8435e-05 2024-09-13T05:12:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.654641+0000", 2024-09-13T05:12:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1086000000000001e-05 2024-09-13T05:12:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.657986+0000", 2024-09-13T05:12:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003345532 2024-09-13T05:12:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.658023+0000", 2024-09-13T05:12:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6452999999999998e-05 2024-09-13T05:12:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.3 151/143 [PushOp(3:c4bca103:::rbd_data.112d42377185.0000000000000005:head, version: 65'147, data_included: [0~524288,1835832~60912,1942780~23167], data_size: 608367, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:c4bca103:::rbd_data.112d42377185.0000000000000005:head@65'147, size: 7340032, copy_subset: [0~7340032], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:7340032, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:45.778684+0000", 2024-09-13T05:12:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 2.7350926639999997, 2024-09-13T05:12:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0036707829999999999, 2024-09-13T05:12:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.597 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.778684+0000", 2024-09-13T05:12:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.778684+0000", 2024-09-13T05:12:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.778682+0000", 2024-09-13T05:12:48.598 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.779498+0000", 2024-09-13T05:12:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00081607900000000004 2024-09-13T05:12:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.779539+0000", 2024-09-13T05:12:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0908999999999997e-05 2024-09-13T05:12:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:48.599 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.779565+0000", 2024-09-13T05:12:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5262999999999999e-05 2024-09-13T05:12:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.779766+0000", 2024-09-13T05:12:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020176300000000001 2024-09-13T05:12:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.779803+0000", 2024-09-13T05:12:48.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6993999999999999e-05 2024-09-13T05:12:48.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.601 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.601 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:48.601 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.782354+0000", 2024-09-13T05:12:48.601 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025511209999999999 2024-09-13T05:12:48.601 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.601 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.601 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.3 151/143 [PushOp(3:c5ecde36:::rbd_data.112db56bb33d.0000000000000000:1f, version: 87'433, data_included: [0~983040,1114112~65536], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:c5ecde36:::rbd_data.112db56bb33d.0000000000000000:1f@87'433, size: 2621440, copy_subset: [0~2621440], clone_subset: {}, snapset: 1f=[]:{1f=[1f]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1179648, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:45.910434+0000", 2024-09-13T05:12:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 2.603342526, 2024-09-13T05:12:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003908094, 2024-09-13T05:12:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.910434+0000", 2024-09-13T05:12:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.603 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:48.603 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.910434+0000", 2024-09-13T05:12:48.603 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.603 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.603 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.603 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:48.603 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.910432+0000", 2024-09-13T05:12:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.912183+0000", 2024-09-13T05:12:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0017504599999999999 2024-09-13T05:12:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.912221+0000", 2024-09-13T05:12:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8546e-05 2024-09-13T05:12:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.605 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:48.605 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.912251+0000", 2024-09-13T05:12:48.605 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9675999999999998e-05 2024-09-13T05:12:48.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.605 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.605 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.912405+0000", 2024-09-13T05:12:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00015411999999999999 2024-09-13T05:12:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.912427+0000", 2024-09-13T05:12:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1696e-05 2024-09-13T05:12:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.914342+0000", 2024-09-13T05:12:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0019152329999999999 2024-09-13T05:12:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.606 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.607 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.607 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.3 151/143 [PushOp(3:c190344a:::rbd_data.112d1f830c0e.0000000000000000:head, version: 92'485, data_included: [0~131072,262144~917504], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:c190344a:::rbd_data.112d1f830c0e.0000000000000000:head@92'485, size: 7746784, copy_subset: [0~7746784], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1179648, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:48.607 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:45.958504+0000", 2024-09-13T05:12:48.607 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 2.5552719389999998, 2024-09-13T05:12:48.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0040577260000000002, 2024-09-13T05:12:48.607 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.607 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:48.607 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.608 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.608 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.958504+0000", 2024-09-13T05:12:48.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.608 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:48.608 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.958504+0000", 2024-09-13T05:12:48.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:48.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.958503+0000", 2024-09-13T05:12:48.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:48.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:48.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.959800+0000", 2024-09-13T05:12:48.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001296754 2024-09-13T05:12:48.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:48.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.959837+0000", 2024-09-13T05:12:48.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7351000000000002e-05 2024-09-13T05:12:48.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:48.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.959859+0000", 2024-09-13T05:12:48.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2333000000000001e-05 2024-09-13T05:12:48.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.960000+0000", 2024-09-13T05:12:48.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014032899999999999 2024-09-13T05:12:48.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:48.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.960022+0000", 2024-09-13T05:12:48.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2646e-05 2024-09-13T05:12:48.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.613 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:48.613 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.962562+0000", 2024-09-13T05:12:48.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025397589999999999 2024-09-13T05:12:48.613 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.613 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.613 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.3 151/143 [PushOp(3:c190344a:::rbd_data.112d1f830c0e.0000000000000000:head, version: 92'485, data_included: [1179648~917504,2516511~24814,6515280~28046,7690156~56628], data_size: 1026992, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:c190344a:::rbd_data.112d1f830c0e.0000000000000000:head@92'485, size: 7746784, copy_subset: [0~7746784], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:7746784, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:1179648, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", 2024-09-13T05:12:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:45.967329+0000", 2024-09-13T05:12:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 2.5464473000000001, 2024-09-13T05:12:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003868336, 2024-09-13T05:12:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.967329+0000", 2024-09-13T05:12:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.967329+0000", 2024-09-13T05:12:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.967327+0000", 2024-09-13T05:12:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.968604+0000", 2024-09-13T05:12:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0012765330000000001 2024-09-13T05:12:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.968643+0000", 2024-09-13T05:12:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9258999999999998e-05 2024-09-13T05:12:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.968672+0000", 2024-09-13T05:12:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8719000000000001e-05 2024-09-13T05:12:48.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.968823+0000", 2024-09-13T05:12:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00015149599999999999 2024-09-13T05:12:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.968841+0000", 2024-09-13T05:12:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7368999999999999e-05 2024-09-13T05:12:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:48.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.971197+0000", 2024-09-13T05:12:48.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023566300000000002 2024-09-13T05:12:48.618 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.618 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.618 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.618 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.618 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.618 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:48.619 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:12:48.620 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:48.615+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:48.641 INFO:teuthology.orchestra.run.smithi120.stderr:set osd.4 primary-affinity to 0.894749 (8586382) 2024-09-13T05:12:48.642 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is set 2024-09-13T05:12:48.721 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:48.715+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:48.739 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:48.739 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:48.739 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:48.739 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:48.748 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:12:48.822 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:48.819+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:48.857 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:48.857 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:48.857 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:48.857 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:48.857 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:48.867 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:12:48.923 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:48.920+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:48.977 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:48.977 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:48.977 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:48.977 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3.bb1d1096 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 85.029397755999995, 2024-09-13T05:12:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68834410099999999, 2024-09-13T05:12:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:12:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943719+0000", 2024-09-13T05:12:48.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:12:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943734+0000", 2024-09-13T05:12:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4793e-05 2024-09-13T05:12:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943765+0000", 2024-09-13T05:12:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0648999999999997e-05 2024-09-13T05:12:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:48.980 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943779+0000", 2024-09-13T05:12:48.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.447e-05 2024-09-13T05:12:48.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.981 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.981 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943872+0000", 2024-09-13T05:12:48.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3304e-05 2024-09-13T05:12:48.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.981 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:48.981 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943884+0000", 2024-09-13T05:12:48.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.167e-05 2024-09-13T05:12:48.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632042+0000", 2024-09-13T05:12:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68815832600000004 2024-09-13T05:12:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632066+0000", 2024-09-13T05:12:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3765999999999999e-05 2024-09-13T05:12:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.982 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.983 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3.b6bd6256 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:48.983 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:48.983 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 85.029273255999996, 2024-09-13T05:12:48.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68852592499999998, 2024-09-13T05:12:48.983 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.983 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:48.983 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:48.983 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:48.983 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:48.983 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:12:48.983 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.983 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943846+0000", 2024-09-13T05:12:48.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943852+0000", 2024-09-13T05:12:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3820000000000001e-06 2024-09-13T05:12:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943876+0000", 2024-09-13T05:12:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3995e-05 2024-09-13T05:12:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.985 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943898+0000", 2024-09-13T05:12:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1838999999999999e-05 2024-09-13T05:12:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946457+0000", 2024-09-13T05:12:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025588910000000002 2024-09-13T05:12:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946499+0000", 2024-09-13T05:12:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2814e-05 2024-09-13T05:12:48.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632364+0000", 2024-09-13T05:12:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68586484999999997 2024-09-13T05:12:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632372+0000", 2024-09-13T05:12:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1659999999999994e-06 2024-09-13T05:12:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3:6908b8dd:::rbd_data.112d8d1317eb.000000000000000f:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 84.992129177999999, 2024-09-13T05:12:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65181049499999999, 2024-09-13T05:12:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:12:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.988 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980989+0000", 2024-09-13T05:12:48.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980996+0000", 2024-09-13T05:12:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2200000000000003e-06 2024-09-13T05:12:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981011+0000", 2024-09-13T05:12:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4997000000000001e-05 2024-09-13T05:12:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:48.990 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981025+0000", 2024-09-13T05:12:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3604000000000001e-05 2024-09-13T05:12:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981110+0000", 2024-09-13T05:12:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4948000000000001e-05 2024-09-13T05:12:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981120+0000", 2024-09-13T05:12:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9399999999999997e-06 2024-09-13T05:12:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.991 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632425+0000", 2024-09-13T05:12:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65130460499999998 2024-09-13T05:12:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632587+0000", 2024-09-13T05:12:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016199500000000001 2024-09-13T05:12:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632801+0000", 2024-09-13T05:12:48.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021459499999999999 2024-09-13T05:12:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3:6a46bd6d:::rbd_data.112d8d1317eb.0000000000000010:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 84.992071522000003, 2024-09-13T05:12:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65213695699999996, 2024-09-13T05:12:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:12:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:48.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981052+0000", 2024-09-13T05:12:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4469999999999999e-06 2024-09-13T05:12:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:48.995 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981066+0000", 2024-09-13T05:12:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3658e-05 2024-09-13T05:12:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981073+0000", 2024-09-13T05:12:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:12:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981150+0000", 2024-09-13T05:12:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7783999999999999e-05 2024-09-13T05:12:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981161+0000", 2024-09-13T05:12:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0197000000000001e-05 2024-09-13T05:12:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632926+0000", 2024-09-13T05:12:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65176517300000003 2024-09-13T05:12:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633081+0000", 2024-09-13T05:12:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000155172 2024-09-13T05:12:48.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633185+0000", 2024-09-13T05:12:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000104329 2024-09-13T05:12:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:159585 3.1c 3:3afcc414:::rbd_data.112dfd94ee88.00000000000002ca:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 41.958753209000001, 2024-09-13T05:12:48.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91717655399999998, 2024-09-13T05:12:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 159585 2024-09-13T05:12:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:48.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014366+0000", 2024-09-13T05:12:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014370+0000", 2024-09-13T05:12:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9960000000000004e-06 2024-09-13T05:12:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014379+0000", 2024-09-13T05:12:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8550000000000008e-06 2024-09-13T05:12:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014386+0000", 2024-09-13T05:12:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0140000000000001e-06 2024-09-13T05:12:49.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014533+0000", 2024-09-13T05:12:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000147458 2024-09-13T05:12:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014545+0000", 2024-09-13T05:12:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1318000000000001e-05 2024-09-13T05:12:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931378+0000", 2024-09-13T05:12:49.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91683292400000005 2024-09-13T05:12:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931495+0000", 2024-09-13T05:12:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011726399999999999 2024-09-13T05:12:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931543+0000", 2024-09-13T05:12:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8183000000000003e-05 2024-09-13T05:12:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.003 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160206 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 83968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 41.935350812000003, 2024-09-13T05:12:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89412730799999995, 2024-09-13T05:12:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160206 2024-09-13T05:12:49.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.005 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.005 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:49.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.005 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:49.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037768+0000", 2024-09-13T05:12:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037774+0000", 2024-09-13T05:12:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3600000000000001e-06 2024-09-13T05:12:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037786+0000", 2024-09-13T05:12:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.188e-05 2024-09-13T05:12:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037793+0000", 2024-09-13T05:12:49.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2749999999999998e-06 2024-09-13T05:12:49.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:49.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0353000000000003e-05 2024-09-13T05:12:49.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037862+0000", 2024-09-13T05:12:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9710000000000004e-06 2024-09-13T05:12:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931610+0000", 2024-09-13T05:12:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89374846299999999 2024-09-13T05:12:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931815+0000", 2024-09-13T05:12:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020516499999999999 2024-09-13T05:12:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.009 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.009 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931896+0000", 2024-09-13T05:12:49.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1157999999999998e-05 2024-09-13T05:12:49.009 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.009 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.009 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.009 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160208 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 84992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:49.009 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:49.009 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 41.935266073000001, 2024-09-13T05:12:49.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440702299999997, 2024-09-13T05:12:49.009 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160208 2024-09-13T05:12:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.011 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:49.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.011 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.011 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037853+0000", 2024-09-13T05:12:49.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:49.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.011 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037858+0000", 2024-09-13T05:12:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2179999999999998e-06 2024-09-13T05:12:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037867+0000", 2024-09-13T05:12:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5699999999999993e-06 2024-09-13T05:12:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037874+0000", 2024-09-13T05:12:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2810000000000003e-06 2024-09-13T05:12:49.012 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037935+0000", 2024-09-13T05:12:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1231999999999999e-05 2024-09-13T05:12:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037944+0000", 2024-09-13T05:12:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8580000000000006e-06 2024-09-13T05:12:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931956+0000", 2024-09-13T05:12:49.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89401158800000002 2024-09-13T05:12:49.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.014 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.014 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932015+0000", 2024-09-13T05:12:49.014 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8906999999999997e-05 2024-09-13T05:12:49.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.014 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.014 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932261+0000", 2024-09-13T05:12:49.014 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024622799999999997 2024-09-13T05:12:49.014 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.014 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.015 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.015 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160210 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 86016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:49.015 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:49.015 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 41.935197219000003, 2024-09-13T05:12:49.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89428998299999996, 2024-09-13T05:12:49.015 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.015 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.015 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.016 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.016 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.016 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160210 2024-09-13T05:12:49.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.016 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.016 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.016 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:49.016 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.016 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.017 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:49.017 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.017 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.017 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.017 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037922+0000", 2024-09-13T05:12:49.017 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:49.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.017 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.017 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.017 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037926+0000", 2024-09-13T05:12:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6550000000000003e-06 2024-09-13T05:12:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037933+0000", 2024-09-13T05:12:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5409999999999997e-06 2024-09-13T05:12:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037939+0000", 2024-09-13T05:12:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1940000000000003e-06 2024-09-13T05:12:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037976+0000", 2024-09-13T05:12:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6671000000000002e-05 2024-09-13T05:12:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037982+0000", 2024-09-13T05:12:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9669999999999998e-06 2024-09-13T05:12:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932096+0000", 2024-09-13T05:12:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89411465599999995 2024-09-13T05:12:49.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.020 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.020 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932149+0000", 2024-09-13T05:12:49.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3032999999999999e-05 2024-09-13T05:12:49.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.020 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.020 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932213+0000", 2024-09-13T05:12:49.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3165999999999998e-05 2024-09-13T05:12:49.020 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.021 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.021 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.021 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160212 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 87040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:49.021 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:49.021 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 41.935110098000003, 2024-09-13T05:12:49.021 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440379699999994, 2024-09-13T05:12:49.021 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160212 2024-09-13T05:12:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:49.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038009+0000", 2024-09-13T05:12:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038013+0000", 2024-09-13T05:12:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3950000000000003e-06 2024-09-13T05:12:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038032+0000", 2024-09-13T05:12:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8513999999999999e-05 2024-09-13T05:12:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.024 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038039+0000", 2024-09-13T05:12:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.985e-06 2024-09-13T05:12:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038086+0000", 2024-09-13T05:12:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7302999999999998e-05 2024-09-13T05:12:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038090+0000", 2024-09-13T05:12:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9029999999999997e-06 2024-09-13T05:12:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.025 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932291+0000", 2024-09-13T05:12:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89420100199999997 2024-09-13T05:12:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932352+0000", 2024-09-13T05:12:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1354999999999998e-05 2024-09-13T05:12:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932414+0000", 2024-09-13T05:12:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1037999999999994e-05 2024-09-13T05:12:49.026 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160214 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 88064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 41.934979032000001, 2024-09-13T05:12:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89438890900000001, 2024-09-13T05:12:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.027 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160214 2024-09-13T05:12:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038140+0000", 2024-09-13T05:12:49.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:49.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038145+0000", 2024-09-13T05:12:49.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9749999999999998e-06 2024-09-13T05:12:49.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.030 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038153+0000", 2024-09-13T05:12:49.031 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1280000000000008e-06 2024-09-13T05:12:49.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.031 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.031 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038161+0000", 2024-09-13T05:12:49.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0339999999999997e-06 2024-09-13T05:12:49.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038199+0000", 2024-09-13T05:12:49.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8269999999999998e-05 2024-09-13T05:12:49.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038204+0000", 2024-09-13T05:12:49.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5399999999999997e-06 2024-09-13T05:12:49.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932438+0000", 2024-09-13T05:12:49.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89423397999999998 2024-09-13T05:12:49.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932480+0000", 2024-09-13T05:12:49.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2392999999999999e-05 2024-09-13T05:12:49.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.036 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932530+0000", 2024-09-13T05:12:49.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:12:49.036 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.036 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.036 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.037 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160305 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 215040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:49.037 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:49.038 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 41.93077581, 2024-09-13T05:12:49.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89028175300000001, 2024-09-13T05:12:49.038 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.038 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.038 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.038 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.038 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.038 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160305 2024-09-13T05:12:49.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.039 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:49.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:49.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042343+0000", 2024-09-13T05:12:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042350+0000", 2024-09-13T05:12:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3769999999999998e-06 2024-09-13T05:12:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042367+0000", 2024-09-13T05:12:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.734e-05 2024-09-13T05:12:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.041 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042375+0000", 2024-09-13T05:12:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8469999999999996e-06 2024-09-13T05:12:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042428+0000", 2024-09-13T05:12:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3074e-05 2024-09-13T05:12:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042437+0000", 2024-09-13T05:12:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:12:49.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932550+0000", 2024-09-13T05:12:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89011304300000005 2024-09-13T05:12:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932589+0000", 2024-09-13T05:12:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9236000000000002e-05 2024-09-13T05:12:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932626+0000", 2024-09-13T05:12:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6832999999999998e-05 2024-09-13T05:12:49.043 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.044 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.044 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.044 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160307 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 216064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:49.044 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:49.044 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 41.930729370999998, 2024-09-13T05:12:49.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89032630800000001, 2024-09-13T05:12:49.044 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.044 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.044 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.044 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160307 2024-09-13T05:12:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.046 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.046 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:49.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.046 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.046 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042394+0000", 2024-09-13T05:12:49.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7900000000000001e-06 2024-09-13T05:12:49.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.046 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042401+0000", 2024-09-13T05:12:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.267e-06 2024-09-13T05:12:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042406+0000", 2024-09-13T05:12:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0860000000000001e-06 2024-09-13T05:12:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042465+0000", 2024-09-13T05:12:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9441000000000002e-05 2024-09-13T05:12:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042471+0000", 2024-09-13T05:12:49.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6640000000000003e-06 2024-09-13T05:12:49.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932645+0000", 2024-09-13T05:12:49.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89017372900000002 2024-09-13T05:12:49.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.049 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932681+0000", 2024-09-13T05:12:49.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5918999999999999e-05 2024-09-13T05:12:49.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.049 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932717+0000", 2024-09-13T05:12:49.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6007999999999998e-05 2024-09-13T05:12:49.049 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.049 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.049 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160309 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 217088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 41.930679112, 2024-09-13T05:12:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89037315900000003, 2024-09-13T05:12:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160309 2024-09-13T05:12:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042440+0000", 2024-09-13T05:12:49.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042444+0000", 2024-09-13T05:12:49.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.104e-06 2024-09-13T05:12:49.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042451+0000", 2024-09-13T05:12:49.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.922e-06 2024-09-13T05:12:49.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.053 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042457+0000", 2024-09-13T05:12:49.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3979999999999998e-06 2024-09-13T05:12:49.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.053 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.053 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042497+0000", 2024-09-13T05:12:49.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0692999999999998e-05 2024-09-13T05:12:49.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.053 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042503+0000", 2024-09-13T05:12:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.553e-06 2024-09-13T05:12:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932735+0000", 2024-09-13T05:12:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89023238699999996 2024-09-13T05:12:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932771+0000", 2024-09-13T05:12:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5972000000000001e-05 2024-09-13T05:12:49.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932814+0000", 2024-09-13T05:12:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2657000000000002e-05 2024-09-13T05:12:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160311 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 218112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:49.055 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 41.930653622000001, 2024-09-13T05:12:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89045284400000002, 2024-09-13T05:12:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160311 2024-09-13T05:12:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.056 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042469+0000", 2024-09-13T05:12:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.456e-06 2024-09-13T05:12:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042475+0000", 2024-09-13T05:12:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0990000000000004e-06 2024-09-13T05:12:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042481+0000", 2024-09-13T05:12:49.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.237e-06 2024-09-13T05:12:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042527+0000", 2024-09-13T05:12:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6796999999999999e-05 2024-09-13T05:12:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042533+0000", 2024-09-13T05:12:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6489999999999996e-06 2024-09-13T05:12:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.059 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932832+0000", 2024-09-13T05:12:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89029919800000001 2024-09-13T05:12:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932867+0000", 2024-09-13T05:12:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5049000000000003e-05 2024-09-13T05:12:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932919+0000", 2024-09-13T05:12:49.060 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1780999999999998e-05 2024-09-13T05:12:49.061 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.061 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.061 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.061 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160313 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 219136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:49.061 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:49.061 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 41.930624530999999, 2024-09-13T05:12:49.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89064232600000004, 2024-09-13T05:12:49.061 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160313 2024-09-13T05:12:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042498+0000", 2024-09-13T05:12:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.281e-06 2024-09-13T05:12:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.063 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.064 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042505+0000", 2024-09-13T05:12:49.064 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2699999999999999e-06 2024-09-13T05:12:49.064 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.064 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.064 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.064 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042512+0000", 2024-09-13T05:12:49.064 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0330000000000003e-06 2024-09-13T05:12:49.064 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042557+0000", 2024-09-13T05:12:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4425999999999998e-05 2024-09-13T05:12:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042562+0000", 2024-09-13T05:12:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3639999999999998e-06 2024-09-13T05:12:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932987+0000", 2024-09-13T05:12:49.065 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89042472299999997 2024-09-13T05:12:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933062+0000", 2024-09-13T05:12:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5129999999999994e-05 2024-09-13T05:12:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933138+0000", 2024-09-13T05:12:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5536000000000003e-05 2024-09-13T05:12:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.066 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160315 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 220160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 41.930593364000003, 2024-09-13T05:12:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89071820800000001, 2024-09-13T05:12:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160315 2024-09-13T05:12:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.067 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.068 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042529+0000", 2024-09-13T05:12:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3639999999999999e-06 2024-09-13T05:12:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042536+0000", 2024-09-13T05:12:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.866e-06 2024-09-13T05:12:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.069 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042541+0000", 2024-09-13T05:12:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:12:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042587+0000", 2024-09-13T05:12:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5735000000000002e-05 2024-09-13T05:12:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.070 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042593+0000", 2024-09-13T05:12:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0719999999999996e-06 2024-09-13T05:12:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933160+0000", 2024-09-13T05:12:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89056621000000002 2024-09-13T05:12:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933202+0000", 2024-09-13T05:12:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2376000000000002e-05 2024-09-13T05:12:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933245+0000", 2024-09-13T05:12:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2787999999999998e-05 2024-09-13T05:12:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160317 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:49.072 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 41.930564535000002, 2024-09-13T05:12:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89082205800000003, 2024-09-13T05:12:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160317 2024-09-13T05:12:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.073 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.074 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.074 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:49.074 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.074 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.074 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.074 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:49.074 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.074 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.074 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.074 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042558+0000", 2024-09-13T05:12:49.074 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1810000000000001e-06 2024-09-13T05:12:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042565+0000", 2024-09-13T05:12:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9280000000000004e-06 2024-09-13T05:12:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042571+0000", 2024-09-13T05:12:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7420000000000003e-06 2024-09-13T05:12:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.075 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.076 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042616+0000", 2024-09-13T05:12:49.076 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5201999999999999e-05 2024-09-13T05:12:49.076 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.076 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.076 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.076 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042622+0000", 2024-09-13T05:12:49.076 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8289999999999996e-06 2024-09-13T05:12:49.076 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.076 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.076 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.076 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933259+0000", 2024-09-13T05:12:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89063730799999996 2024-09-13T05:12:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933311+0000", 2024-09-13T05:12:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1910000000000003e-05 2024-09-13T05:12:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933377+0000", 2024-09-13T05:12:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6396999999999995e-05 2024-09-13T05:12:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.077 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.078 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160319 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 222208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:49.078 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:49.078 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 41.930534319000003, 2024-09-13T05:12:49.078 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89087477400000004, 2024-09-13T05:12:49.078 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.078 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160319 2024-09-13T05:12:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.079 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:49.080 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.080 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.080 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.080 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.080 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042585+0000", 2024-09-13T05:12:49.080 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.080 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.081 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.081 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.081 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042588+0000", 2024-09-13T05:12:49.081 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9450000000000002e-06 2024-09-13T05:12:49.081 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.081 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.081 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.081 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042594+0000", 2024-09-13T05:12:49.081 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0959999999999997e-06 2024-09-13T05:12:49.081 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.081 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.081 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.081 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042599+0000", 2024-09-13T05:12:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0069999999999997e-06 2024-09-13T05:12:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042642+0000", 2024-09-13T05:12:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2553999999999999e-05 2024-09-13T05:12:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042647+0000", 2024-09-13T05:12:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.31e-06 2024-09-13T05:12:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.082 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933387+0000", 2024-09-13T05:12:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89073982799999996 2024-09-13T05:12:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:12:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7101000000000003e-05 2024-09-13T05:12:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933460+0000", 2024-09-13T05:12:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6282999999999998e-05 2024-09-13T05:12:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.083 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.084 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.084 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.084 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160321 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 223232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:49.084 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:49.084 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 41.930504892000002, 2024-09-13T05:12:49.084 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89094616999999998, 2024-09-13T05:12:49.084 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.084 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.084 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.084 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.085 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.085 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160321 2024-09-13T05:12:49.085 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.085 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.085 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.085 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.085 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:49.085 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.085 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.085 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.085 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.085 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:49.085 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.085 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042617+0000", 2024-09-13T05:12:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8329999999999998e-06 2024-09-13T05:12:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042638+0000", 2024-09-13T05:12:49.086 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0908e-05 2024-09-13T05:12:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042644+0000", 2024-09-13T05:12:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0440000000000001e-06 2024-09-13T05:12:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042666+0000", 2024-09-13T05:12:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1256000000000001e-05 2024-09-13T05:12:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.087 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042671+0000", 2024-09-13T05:12:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6250000000000004e-06 2024-09-13T05:12:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933478+0000", 2024-09-13T05:12:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89080698800000002 2024-09-13T05:12:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933519+0000", 2024-09-13T05:12:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0717000000000003e-05 2024-09-13T05:12:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.088 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933561+0000", 2024-09-13T05:12:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2225999999999999e-05 2024-09-13T05:12:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:201615 3.1d 3:bb015654:::rbd_data.112d9dba7cdc.000000000000000a:head [delete] snapc 30=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2024-09-13T05:12:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:12:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.9682681110000004, 2024-09-13T05:12:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.90842926999999996, 2024-09-13T05:12:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.089 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:49.090 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.090 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.090 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.090 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 201615 2024-09-13T05:12:49.090 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.090 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.090 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.090 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.090 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:12:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:12:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004850+0000", 2024-09-13T05:12:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.091 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004860+0000", 2024-09-13T05:12:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.927e-06 2024-09-13T05:12:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004882+0000", 2024-09-13T05:12:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2079999999999999e-05 2024-09-13T05:12:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004897+0000", 2024-09-13T05:12:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4892000000000001e-05 2024-09-13T05:12:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.092 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.005068+0000", 2024-09-13T05:12:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017098999999999999 2024-09-13T05:12:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.005081+0000", 2024-09-13T05:12:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3063e-05 2024-09-13T05:12:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.910925+0000", 2024-09-13T05:12:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.90584383400000001 2024-09-13T05:12:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.911131+0000", 2024-09-13T05:12:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020629399999999999 2024-09-13T05:12:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 4", 2024-09-13T05:12:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.911313+0000", 2024-09-13T05:12:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000182175 2024-09-13T05:12:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:12:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913010+0000", 2024-09-13T05:12:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0016971550000000001 2024-09-13T05:12:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913212+0000", 2024-09-13T05:12:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000202237 2024-09-13T05:12:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:49.095 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913253+0000", 2024-09-13T05:12:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0250999999999998e-05 2024-09-13T05:12:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913281+0000", 2024-09-13T05:12:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8314e-05 2024-09-13T05:12:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.096 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.097 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.097 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:49.098 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:12:49.099 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:49.096+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:49.200 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:49.199+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:49.260 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:49.260 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:49.260 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:49.261 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:49.270 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:12:49.300 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:49.296+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:49.379 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:49.379 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:49.380 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:49.380 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:49.380 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:49.389 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:12:49.401 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:49.395+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:49.498 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29021 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2865152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:12:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 132.453214575, 2024-09-13T05:12:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060927993999999999, 2024-09-13T05:12:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.499 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29021 2024-09-13T05:12:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:12:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:12:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.500 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041763+0000", 2024-09-13T05:12:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041766+0000", 2024-09-13T05:12:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6800000000000002e-06 2024-09-13T05:12:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041771+0000", 2024-09-13T05:12:49.501 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:12:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041776+0000", 2024-09-13T05:12:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8489999999999997e-06 2024-09-13T05:12:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102513+0000", 2024-09-13T05:12:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060737102000000001 2024-09-13T05:12:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.502 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102597+0000", 2024-09-13T05:12:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4374000000000002e-05 2024-09-13T05:12:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102692+0000", 2024-09-13T05:12:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4436000000000002e-05 2024-09-13T05:12:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29022 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2874368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 132.45319827500001, 2024-09-13T05:12:49.503 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061135083999999999, 2024-09-13T05:12:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29022 2024-09-13T05:12:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.504 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041782+0000", 2024-09-13T05:12:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4959999999999999e-06 2024-09-13T05:12:49.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041787+0000", 2024-09-13T05:12:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1240000000000004e-06 2024-09-13T05:12:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041792+0000", 2024-09-13T05:12:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9200000000000003e-06 2024-09-13T05:12:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102738+0000", 2024-09-13T05:12:49.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060945581999999998 2024-09-13T05:12:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102821+0000", 2024-09-13T05:12:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2898999999999994e-05 2024-09-13T05:12:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102915+0000", 2024-09-13T05:12:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4523000000000003e-05 2024-09-13T05:12:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29067 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2764800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 132.44942405800001, 2024-09-13T05:12:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060816621000000001, 2024-09-13T05:12:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29067 2024-09-13T05:12:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.508 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.509 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045557+0000", 2024-09-13T05:12:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.898e-06 2024-09-13T05:12:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045575+0000", 2024-09-13T05:12:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8252000000000001e-05 2024-09-13T05:12:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045581+0000", 2024-09-13T05:12:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:12:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.510 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106183+0000", 2024-09-13T05:12:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060602630999999997 2024-09-13T05:12:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106271+0000", 2024-09-13T05:12:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7329000000000004e-05 2024-09-13T05:12:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106371+0000", 2024-09-13T05:12:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000100164 2024-09-13T05:12:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.511 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29068 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2774016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:12:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 132.449392824, 2024-09-13T05:12:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060994509000000002, 2024-09-13T05:12:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.512 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29068 2024-09-13T05:12:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:12:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:12:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.513 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045585+0000", 2024-09-13T05:12:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045588+0000", 2024-09-13T05:12:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:12:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045594+0000", 2024-09-13T05:12:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9329999999999998e-06 2024-09-13T05:12:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.514 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045599+0000", 2024-09-13T05:12:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3190000000000002e-06 2024-09-13T05:12:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106399+0000", 2024-09-13T05:12:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060800361999999997 2024-09-13T05:12:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106489+0000", 2024-09-13T05:12:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9301000000000004e-05 2024-09-13T05:12:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106580+0000", 2024-09-13T05:12:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1314e-05 2024-09-13T05:12:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29069 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2792448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:12:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 132.44937440699999, 2024-09-13T05:12:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061207599000000001, 2024-09-13T05:12:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.516 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29069 2024-09-13T05:12:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:12:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.517 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:12:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045603+0000", 2024-09-13T05:12:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045606+0000", 2024-09-13T05:12:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7300000000000001e-06 2024-09-13T05:12:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.518 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045612+0000", 2024-09-13T05:12:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9599999999999997e-06 2024-09-13T05:12:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045619+0000", 2024-09-13T05:12:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6019999999999996e-06 2024-09-13T05:12:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106619+0000", 2024-09-13T05:12:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061000029999999997 2024-09-13T05:12:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106713+0000", 2024-09-13T05:12:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4505000000000004e-05 2024-09-13T05:12:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106812+0000", 2024-09-13T05:12:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8264000000000007e-05 2024-09-13T05:12:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29070 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2783232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 132.44935394800001, 2024-09-13T05:12:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061389805999999998, 2024-09-13T05:12:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29070 2024-09-13T05:12:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.521 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.523 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045627+0000", 2024-09-13T05:12:49.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6579999999999998e-06 2024-09-13T05:12:49.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.523 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045632+0000", 2024-09-13T05:12:49.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8449999999999999e-06 2024-09-13T05:12:49.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.523 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045639+0000", 2024-09-13T05:12:49.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:12:49.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106837+0000", 2024-09-13T05:12:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061198529000000002 2024-09-13T05:12:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106922+0000", 2024-09-13T05:12:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4771999999999994e-05 2024-09-13T05:12:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107014+0000", 2024-09-13T05:12:49.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2009000000000006e-05 2024-09-13T05:12:49.525 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.525 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.525 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.525 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29071 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2801664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.525 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:12:49.525 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 132.44933487200001, 2024-09-13T05:12:49.525 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061582804999999997, 2024-09-13T05:12:49.525 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.525 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.525 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29071 2024-09-13T05:12:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:12:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:12:49.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045643+0000", 2024-09-13T05:12:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045646+0000", 2024-09-13T05:12:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:12:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045664+0000", 2024-09-13T05:12:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8408000000000001e-05 2024-09-13T05:12:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045670+0000", 2024-09-13T05:12:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7710000000000003e-06 2024-09-13T05:12:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.528 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107048+0000", 2024-09-13T05:12:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061378438 2024-09-13T05:12:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107134+0000", 2024-09-13T05:12:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5574000000000004e-05 2024-09-13T05:12:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107226+0000", 2024-09-13T05:12:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2262000000000005e-05 2024-09-13T05:12:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.529 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.530 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29072 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2810880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.530 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:12:49.530 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 132.449303488, 2024-09-13T05:12:49.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061762233999999999, 2024-09-13T05:12:49.530 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.530 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.530 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.530 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.530 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.530 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29072 2024-09-13T05:12:49.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.530 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:12:49.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:12:49.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045674+0000", 2024-09-13T05:12:49.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045677+0000", 2024-09-13T05:12:49.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9679999999999998e-06 2024-09-13T05:12:49.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045694+0000", 2024-09-13T05:12:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6801999999999999e-05 2024-09-13T05:12:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045700+0000", 2024-09-13T05:12:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8270000000000003e-06 2024-09-13T05:12:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107249+0000", 2024-09-13T05:12:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061549114000000002 2024-09-13T05:12:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107341+0000", 2024-09-13T05:12:49.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2390000000000001e-05 2024-09-13T05:12:49.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107437+0000", 2024-09-13T05:12:49.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5648000000000003e-05 2024-09-13T05:12:49.534 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.534 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.534 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.534 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29073 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2820096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:12:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 132.44926151000001, 2024-09-13T05:12:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061873910999999997, 2024-09-13T05:12:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29073 2024-09-13T05:12:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:12:49.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:12:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045716+0000", 2024-09-13T05:12:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045726+0000", 2024-09-13T05:12:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6350000000000001e-06 2024-09-13T05:12:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045739+0000", 2024-09-13T05:12:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3325e-05 2024-09-13T05:12:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045746+0000", 2024-09-13T05:12:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7399999999999998e-06 2024-09-13T05:12:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107457+0000", 2024-09-13T05:12:49.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061711038000000003 2024-09-13T05:12:49.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107522+0000", 2024-09-13T05:12:49.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4850000000000004e-05 2024-09-13T05:12:49.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.539 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.539 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107591+0000", 2024-09-13T05:12:49.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9029999999999995e-05 2024-09-13T05:12:49.539 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.539 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.539 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.539 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29074 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2829312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.539 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:12:49.539 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 132.44922760200001, 2024-09-13T05:12:49.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062055459, 2024-09-13T05:12:49.539 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.539 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.540 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.540 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.540 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.540 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29074 2024-09-13T05:12:49.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.540 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.540 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.540 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:12:49.540 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.540 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:12:49.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045750+0000", 2024-09-13T05:12:49.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045753+0000", 2024-09-13T05:12:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8399999999999999e-06 2024-09-13T05:12:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045759+0000", 2024-09-13T05:12:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8900000000000004e-06 2024-09-13T05:12:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045764+0000", 2024-09-13T05:12:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3850000000000001e-06 2024-09-13T05:12:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107623+0000", 2024-09-13T05:12:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061858817000000003 2024-09-13T05:12:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107710+0000", 2024-09-13T05:12:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7127999999999997e-05 2024-09-13T05:12:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107806+0000", 2024-09-13T05:12:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5886999999999999e-05 2024-09-13T05:12:49.543 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29075 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2838528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 132.44920914799999, 2024-09-13T05:12:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062188516999999999, 2024-09-13T05:12:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.544 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29075 2024-09-13T05:12:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045772+0000", 2024-09-13T05:12:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:12:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045778+0000", 2024-09-13T05:12:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9229999999999996e-06 2024-09-13T05:12:49.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045784+0000", 2024-09-13T05:12:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3800000000000002e-06 2024-09-13T05:12:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107823+0000", 2024-09-13T05:12:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062039331000000003 2024-09-13T05:12:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107886+0000", 2024-09-13T05:12:49.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2476000000000003e-05 2024-09-13T05:12:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107958+0000", 2024-09-13T05:12:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2089999999999996e-05 2024-09-13T05:12:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29115 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2682880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:12:49.548 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 132.44574362099999, 2024-09-13T05:12:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060847898999999997, 2024-09-13T05:12:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29115 2024-09-13T05:12:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:12:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:12:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049234+0000", 2024-09-13T05:12:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049237+0000", 2024-09-13T05:12:49.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9069999999999999e-06 2024-09-13T05:12:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049243+0000", 2024-09-13T05:12:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7459999999999997e-06 2024-09-13T05:12:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049248+0000", 2024-09-13T05:12:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1490000000000002e-06 2024-09-13T05:12:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.109945+0000", 2024-09-13T05:12:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060697299000000003 2024-09-13T05:12:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110013+0000", 2024-09-13T05:12:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8023999999999998e-05 2024-09-13T05:12:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110083+0000", 2024-09-13T05:12:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9296999999999997e-05 2024-09-13T05:12:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.552 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29116 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2692096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:12:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 132.44572577700001, 2024-09-13T05:12:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061040167999999999, 2024-09-13T05:12:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29116 2024-09-13T05:12:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.553 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:12:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:12:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049252+0000", 2024-09-13T05:12:49.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049255+0000", 2024-09-13T05:12:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7250000000000002e-06 2024-09-13T05:12:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049261+0000", 2024-09-13T05:12:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.755e-06 2024-09-13T05:12:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049266+0000", 2024-09-13T05:12:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2100000000000001e-06 2024-09-13T05:12:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110115+0000", 2024-09-13T05:12:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060849225999999999 2024-09-13T05:12:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110199+0000", 2024-09-13T05:12:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4339999999999995e-05 2024-09-13T05:12:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110293+0000", 2024-09-13T05:12:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3397e-05 2024-09-13T05:12:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29117 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2701312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 132.44570813999999, 2024-09-13T05:12:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.06118527, 2024-09-13T05:12:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.557 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29117 2024-09-13T05:12:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049273+0000", 2024-09-13T05:12:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.757e-06 2024-09-13T05:12:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049278+0000", 2024-09-13T05:12:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7830000000000004e-06 2024-09-13T05:12:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049284+0000", 2024-09-13T05:12:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3820000000000003e-06 2024-09-13T05:12:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110313+0000", 2024-09-13T05:12:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061029682000000002 2024-09-13T05:12:49.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110383+0000", 2024-09-13T05:12:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9406000000000006e-05 2024-09-13T05:12:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110456+0000", 2024-09-13T05:12:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2750000000000007e-05 2024-09-13T05:12:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29118 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2710528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 132.44569022499999, 2024-09-13T05:12:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061380698999999997, 2024-09-13T05:12:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29118 2024-09-13T05:12:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:49.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:49.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:49.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049291+0000", 2024-09-13T05:12:49.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8770000000000002e-06 2024-09-13T05:12:49.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049296+0000", 2024-09-13T05:12:49.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6799999999999998e-06 2024-09-13T05:12:49.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049302+0000", 2024-09-13T05:12:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2769999999999996e-06 2024-09-13T05:12:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110488+0000", 2024-09-13T05:12:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061186184999999997 2024-09-13T05:12:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110577+0000", 2024-09-13T05:12:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9246000000000006e-05 2024-09-13T05:12:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110669+0000", 2024-09-13T05:12:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1923999999999996e-05 2024-09-13T05:12:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29119 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2719744~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:12:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 132.445672481, 2024-09-13T05:12:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061521165000000003, 2024-09-13T05:12:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.566 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29119 2024-09-13T05:12:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:12:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:12:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049305+0000", 2024-09-13T05:12:49.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049308+0000", 2024-09-13T05:12:49.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7070000000000001e-06 2024-09-13T05:12:49.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049316+0000", 2024-09-13T05:12:49.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:12:49.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.569 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049322+0000", 2024-09-13T05:12:49.569 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3199999999999999e-06 2024-09-13T05:12:49.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.569 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110690+0000", 2024-09-13T05:12:49.569 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061368428000000003 2024-09-13T05:12:49.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.569 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110755+0000", 2024-09-13T05:12:49.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4893000000000004e-05 2024-09-13T05:12:49.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.570 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.570 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110827+0000", 2024-09-13T05:12:49.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2039000000000006e-05 2024-09-13T05:12:49.570 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.570 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.570 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.570 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29120 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2728960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.570 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:49.571 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 132.44565221100001, 2024-09-13T05:12:49.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061718420000000003, 2024-09-13T05:12:49.571 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.571 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.571 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.571 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.571 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.571 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29120 2024-09-13T05:12:49.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.571 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.571 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.571 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.571 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:49.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:49.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:49.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049329+0000", 2024-09-13T05:12:49.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.022e-06 2024-09-13T05:12:49.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.573 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.573 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049336+0000", 2024-09-13T05:12:49.573 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0720000000000002e-06 2024-09-13T05:12:49.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.573 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.573 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049341+0000", 2024-09-13T05:12:49.573 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:12:49.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.573 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.573 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110864+0000", 2024-09-13T05:12:49.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061523126999999997 2024-09-13T05:12:49.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.574 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.574 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110951+0000", 2024-09-13T05:12:49.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6557000000000005e-05 2024-09-13T05:12:49.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.574 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.574 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.111045+0000", 2024-09-13T05:12:49.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4043999999999996e-05 2024-09-13T05:12:49.574 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.574 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.575 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.575 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29136 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2876416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.575 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:12:49.575 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 132.441636786, 2024-09-13T05:12:49.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060742995000000001, 2024-09-13T05:12:49.575 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.575 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.575 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29136 2024-09-13T05:12:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:12:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:12:49.576 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053341+0000", 2024-09-13T05:12:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053344+0000", 2024-09-13T05:12:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:12:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053350+0000", 2024-09-13T05:12:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7200000000000003e-06 2024-09-13T05:12:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053355+0000", 2024-09-13T05:12:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0150000000000003e-06 2024-09-13T05:12:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113909+0000", 2024-09-13T05:12:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060554368999999997 2024-09-13T05:12:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113994+0000", 2024-09-13T05:12:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4658000000000002e-05 2024-09-13T05:12:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114085+0000", 2024-09-13T05:12:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0939000000000005e-05 2024-09-13T05:12:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29166 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2628608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.579 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 132.441619352, 2024-09-13T05:12:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060883127000000002, 2024-09-13T05:12:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29166 2024-09-13T05:12:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.580 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053361+0000", 2024-09-13T05:12:49.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:12:49.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053367+0000", 2024-09-13T05:12:49.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7350000000000001e-06 2024-09-13T05:12:49.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053372+0000", 2024-09-13T05:12:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7840000000000003e-06 2024-09-13T05:12:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114103+0000", 2024-09-13T05:12:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060730924999999998 2024-09-13T05:12:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114171+0000", 2024-09-13T05:12:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8021999999999993e-05 2024-09-13T05:12:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114242+0000", 2024-09-13T05:12:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1390999999999995e-05 2024-09-13T05:12:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:165308 3.3 3:c04a6a9a:::rbd_data.112dc3abcba6.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-13T05:12:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:12:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 33.363162066000001, 2024-09-13T05:12:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.085530595000000001, 2024-09-13T05:12:49.584 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 165308 2024-09-13T05:12:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:12:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:12:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131814+0000", 2024-09-13T05:12:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152479+0000", 2024-09-13T05:12:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020664281 2024-09-13T05:12:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.587 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152521+0000", 2024-09-13T05:12:49.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2567000000000001e-05 2024-09-13T05:12:49.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.587 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152536+0000", 2024-09-13T05:12:49.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4447000000000001e-05 2024-09-13T05:12:49.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.587 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152607+0000", 2024-09-13T05:12:49.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1687000000000007e-05 2024-09-13T05:12:49.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152753+0000", 2024-09-13T05:12:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000145861 2024-09-13T05:12:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:12:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.159991+0000", 2024-09-13T05:12:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0072373100000000003 2024-09-13T05:12:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:12:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.208492+0000", 2024-09-13T05:12:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048501003000000001 2024-09-13T05:12:49.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217224+0000", 2024-09-13T05:12:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0087320369999999998 2024-09-13T05:12:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217277+0000", 2024-09-13T05:12:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3841000000000002e-05 2024-09-13T05:12:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217347+0000", 2024-09-13T05:12:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9529999999999993e-05 2024-09-13T05:12:49.589 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.590 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.590 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.590 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.590 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.590 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:49.591 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:12:49.592 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:49.587+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:49.692 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:49.688+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:49.714 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:49.714 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:49.714 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:49.714 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:49.725 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:12:49.793 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:49.787+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:49.830 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:49.830 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:49.830 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:49.830 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:49.831 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:49.841 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:12:49.893 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:49.892+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:49.946 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:49.946 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:49.946 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:49.946 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:49.946 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.946 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.946 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:49.946 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 133.078636074, 2024-09-13T05:12:49.946 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:12:49.946 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.946 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.947 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.947 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.947 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.947 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:12:49.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.947 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.947 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.947 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.947 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:49.947 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.947 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.947 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.947 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:49.948 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.948 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.948 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:49.948 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:49.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.948 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.948 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:12:49.948 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:12:49.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.948 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.949 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:12:49.949 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:12:49.949 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.949 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.949 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.949 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:12:49.949 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:12:49.949 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.949 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.950 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.950 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:12:49.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:12:49.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.950 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.950 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:12:49.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:12:49.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.950 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.950 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:12:49.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:12:49.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.951 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.951 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.951 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:12:49.951 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:12:49.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.951 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.951 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.951 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:12:49.951 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:12:49.951 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.951 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.951 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.951 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.952 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.952 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:49.952 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 133.07861163800001, 2024-09-13T05:12:49.952 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:12:49.952 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.952 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:49.952 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.952 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.952 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.952 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:12:49.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.952 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.952 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.953 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:49.953 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.953 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.953 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:49.953 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.953 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.953 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:49.953 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:49.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:12:49.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:12:49.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:12:49.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:12:49.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:12:49.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:12:49.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.955 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.955 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.955 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:12:49.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:12:49.955 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.955 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.955 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.955 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:12:49.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:12:49.955 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.955 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.955 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.955 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:12:49.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:12:49.955 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.956 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.956 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:49.956 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:12:49.956 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:12:49.956 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.956 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.956 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.956 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:12:49.956 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:12:49.956 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.956 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.957 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.957 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.957 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:49.957 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 133.07860181199999, 2024-09-13T05:12:49.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:12:49.957 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.957 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:49.957 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.957 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.957 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.957 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:12:49.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:12:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:12:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:12:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:12:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:12:49.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:12:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:12:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:12:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:12:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:12:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:12:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:12:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:12:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:12:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:49.961 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 133.078593576, 2024-09-13T05:12:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:12:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:12:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:12:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:12:49.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:12:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:12:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:12:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:12:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:12:49.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:12:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:12:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:12:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:12:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:12:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:12:49.965 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:12:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 133.07857166400001, 2024-09-13T05:12:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:12:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.966 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:12:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:12:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:12:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:12:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:12:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:12:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:12:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:12:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:12:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:12:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:12:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:12:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:12:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:12:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:12:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.970 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 133.07856305999999, 2024-09-13T05:12:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:12:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:12:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:12:49.972 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:12:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:12:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:12:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:12:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:12:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.973 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:12:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:12:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:12:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:12:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:12:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:12:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.974 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:12:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:12:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 133.07855336599999, 2024-09-13T05:12:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:12:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.976 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.976 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:12:49.976 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.976 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.976 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.976 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.976 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:49.976 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.976 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.976 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:12:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:12:49.977 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:12:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:12:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:12:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:12:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:12:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:12:49.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:12:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:12:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:12:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:12:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:12:49.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:12:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 133.07854425100001, 2024-09-13T05:12:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:12:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.980 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:12:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:12:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:12:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:12:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:12:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.982 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.983 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:12:49.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:12:49.983 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.983 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:12:49.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:12:49.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:12:49.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:12:49.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:12:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:12:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:12:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:12:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.986 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.986 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:12:49.986 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 133.07853577200001, 2024-09-13T05:12:49.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:12:49.986 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.986 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:49.986 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.986 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.986 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.986 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:12:49.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.986 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:12:49.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:12:49.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:12:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:12:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:12:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:12:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:12:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:12:49.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:12:49.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:12:49.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:12:49.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:12:49.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:12:49.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.990 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.990 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:12:49.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:12:49.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.990 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.990 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:12:49.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:12:49.990 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.990 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.990 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.990 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.991 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:12:49.991 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 133.07852384700001, 2024-09-13T05:12:49.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:12:49.991 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.991 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:49.991 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.991 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.991 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.991 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:12:49.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.991 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.991 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.991 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:12:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:12:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:12:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:12:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:12:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:12:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:12:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:12:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:12:49.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:12:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:12:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:12:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:12:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:12:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:12:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:12:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:12:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:49.995 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 133.07850225799999, 2024-09-13T05:12:49.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:12:49.996 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:49.996 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:49.996 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:49.996 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:49.996 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:49.996 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:12:49.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.996 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:49.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:12:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:12:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:12:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:12:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:12:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:12:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:12:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:12:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:12:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:12:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:49.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:12:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:12:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:12:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:12:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.000 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 133.07847913000001, 2024-09-13T05:12:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:12:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:12:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:50.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:50.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:12:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:12:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:12:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:12:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:12:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:12:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:12:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:12:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:12:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:12:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:12:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:12:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:12:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:12:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:12:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 133.07846375700001, 2024-09-13T05:12:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:12:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:12:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:12:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:12:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:12:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:12:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:12:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:12:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:12:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:12:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:12:50.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:12:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:12:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:12:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:12:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:12:50.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:12:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:12:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:12:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:50.010 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 133.07844328900001, 2024-09-13T05:12:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:12:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:12:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:50.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:12:50.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:12:50.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:50.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:12:50.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:12:50.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:50.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:12:50.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:12:50.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:50.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:12:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:12:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:12:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:12:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:12:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:12:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:12:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:12:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 133.07842662799999, 2024-09-13T05:12:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:12:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:50.015 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:12:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.016 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:12:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:12:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.017 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:12:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:12:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:12:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:12:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:12:50.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:12:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:12:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:12:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:12:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:12:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:50.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:12:50.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:12:50.020 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:50.020 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:50.020 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:50.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.020 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:50.020 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:12:50.020 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 133.07839991500001, 2024-09-13T05:12:50.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:12:50.020 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:50.020 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:50.020 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:50.021 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:50.021 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:50.021 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:12:50.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.021 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:50.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.021 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:50.021 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:12:50.021 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:50.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.021 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:50.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:12:50.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:50.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:50.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:12:50.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:50.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:50.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:12:50.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:12:50.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:50.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:12:50.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:12:50.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:50.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:12:50.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:12:50.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:50.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:12:50.024 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:12:50.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:50.024 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:12:50.024 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:12:50.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:50.024 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:12:50.024 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:12:50.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.025 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:50.025 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:12:50.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:12:50.025 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:50.025 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:50.025 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:50.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.025 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:50.025 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:50.025 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 133.07838106299999, 2024-09-13T05:12:50.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:12:50.026 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:50.026 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:50.026 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:50.026 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:50.026 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:50.026 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:12:50.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.026 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:50.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.026 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:50.026 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:50.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:50.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.027 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:50.027 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:50.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:50.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.027 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:50.027 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:50.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:50.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.027 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:50.027 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:12:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:12:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:12:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:12:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:12:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:12:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:12:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:12:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:12:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:12:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:12:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:12:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.030 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:50.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:12:50.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:12:50.030 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:50.030 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:50.030 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:50.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.030 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:50.030 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 133.07836327699999, 2024-09-13T05:12:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:12:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:12:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:50.031 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:12:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:12:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:12:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:12:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:12:50.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:12:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:12:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:12:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:12:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:12:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:12:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:12:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:12:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:12:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 133.07832821700001, 2024-09-13T05:12:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:12:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:12:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:50.036 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:50.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:12:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:12:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:12:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:12:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:12:50.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:12:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:12:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:12:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:12:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:12:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:12:50.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:12:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:12:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:12:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:50.040 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 133.078311402, 2024-09-13T05:12:50.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:12:50.041 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:50.041 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:50.041 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:50.041 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:50.041 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:50.041 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:12:50.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.041 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:50.041 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.041 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:50.041 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:50.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:50.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:50.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:12:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:12:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:12:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:12:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:12:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:12:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:12:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:12:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:12:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:12:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:12:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:12:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:50.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:50.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:50.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:12:50.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:12:50.045 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:50.045 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:50.045 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:50.045 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:50.045 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:50.045 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:50.047 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:12:50.047 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:50.044+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:50.147 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:50.144+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:50.161 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:50.162 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:50.162 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:50.162 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:50.172 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:12:50.248 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:50.243+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:50.282 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:50.282 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:50.282 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:50.282 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:50.282 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:50.292 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:12:50.349 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:50.343+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:50.395 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:50.395 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:50.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:50.396 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [] 2024-09-13T05:12:50.396 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:50.405 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:12:50.450 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:50.447+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:50.478 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:12:50.517 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:50.517 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:50.517 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:50.517 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:50.527 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:12:50.551 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:50.548+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:50.614 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:12:50.633 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:50.650 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:50.651 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:50.647+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:50.657 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T05:12:50.681 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:50.687 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:50.687 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:50.702 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:12:50.703 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:50.727 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:50.749 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:50.752 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:50.748+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:50.776 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:50.778 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:12:50.778 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:50.778 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:50.778 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:50.778 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:50.778 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:50.779 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:50.779 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:50.818 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:50.819 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:50.828 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:12:50.873 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:50.871+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:50.954 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:50.951+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:50.976 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:50.976 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:50.986 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:12:51.055 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:51.051+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:51.085 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:51.085 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:51.095 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:12:51.156 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:51.152+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:51.198 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:51.198 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:51.207 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:12:51.257 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:51.255+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:51.310 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:51.310 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:51.320 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:12:51.358 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:51.355+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:51.459 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:51.455+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:51.469 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:51.469 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:51.479 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:12:51.560 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:51.555+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:51.583 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:51.583 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:51.593 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:12:51.661 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:51.659+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:51.690 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is unset 2024-09-13T05:12:51.728 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:51.728 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:51.738 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:12:51.762 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:51.759+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:51.848 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:51.848 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:51.857 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:12:51.863 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:51.859+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:51.957 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:51.957 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:51.964 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:51.959+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:51.966 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:12:52.065 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:52.059+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:52.118 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:52.118 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:52.129 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:12:52.166 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:52.163+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:52.236 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:52.236 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:52.245 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:12:52.267 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:52.263+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:52.350 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:52.351 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:52.360 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:12:52.368 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:52.363+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:52.469 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:52.469 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:52.470 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:52.467+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:52.479 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:12:52.571 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:52.567+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:52.581 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:52.581 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:52.591 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:12:52.671 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:52.667+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:52.758 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:52.758 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:52.768 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:12:52.772 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:52.767+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:52.792 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:12:52.873 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:52.871+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:52.886 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:52.886 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:52.896 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:12:52.955 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:12:52.974 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:52.975 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:52.971+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:52.994 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:53.001 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:53.002 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:53.011 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:12:53.016 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:53.038 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:53.060 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:53.075 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:53.071+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:53.082 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:53.103 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:53.105 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:12:53.105 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:53.106 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:53.106 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:53.106 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:53.106 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:53.106 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:53.106 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:53.121 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:53.121 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:53.121 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:53.121 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:53.121 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.121 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:53.121 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:53.121 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 136.25470300000001, 2024-09-13T05:12:53.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:12:53.122 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:53.122 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:53.122 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:53.122 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:53.122 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:53.122 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:12:53.122 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.122 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:53.122 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.122 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:53.122 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:53.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:12:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.123 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:53.124 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:12:53.124 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:12:53.124 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.124 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.124 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:53.124 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:12:53.124 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:12:53.124 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.124 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.124 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:53.124 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:12:53.124 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:12:53.125 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.125 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.125 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.125 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:12:53.125 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:12:53.125 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.125 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.125 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:53.125 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:12:53.125 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:12:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:12:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:12:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:12:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:12:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:53.126 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:12:53.127 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:12:53.127 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.127 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:53.127 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.127 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.127 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.127 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:53.127 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:53.127 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 136.25467856399999, 2024-09-13T05:12:53.127 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:12:53.127 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:53.127 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:53.127 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:53.127 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:53.128 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:53.128 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:12:53.128 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.128 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:53.128 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.128 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:53.128 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:53.128 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.128 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.128 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.128 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:53.128 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:53.129 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.129 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.129 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:53.129 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:12:53.129 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:53.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.129 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.129 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:53.129 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:12:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:12:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:12:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:12:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:12:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:12:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.131 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.131 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:12:53.131 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:12:53.131 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.131 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.131 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:53.131 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:12:53.131 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:12:53.131 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.131 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.131 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.131 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:12:53.131 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:12:53.132 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.132 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.132 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:53.132 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:12:53.132 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:12:53.132 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.132 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.132 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:53.132 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:12:53.132 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:12:53.132 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.133 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:53.133 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.133 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.133 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.133 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:53.133 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:53.133 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 136.25466873799999, 2024-09-13T05:12:53.133 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:12:53.133 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:53.133 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:53.133 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:53.133 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:12:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.134 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.135 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.135 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:53.135 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:12:53.135 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:53.135 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.135 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.135 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:53.135 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:12:53.135 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:12:53.135 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.135 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.135 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:53.135 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:12:53.136 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:12:53.136 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.136 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.136 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:53.136 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:12:53.136 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:12:53.136 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.136 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.136 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.136 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:12:53.136 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:12:53.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.137 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.137 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:53.137 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:12:53.137 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:12:53.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.137 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.137 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.137 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:12:53.137 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:12:53.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.138 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.138 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:53.138 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:12:53.138 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:12:53.138 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.138 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:53.138 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.138 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.138 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.138 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:53.138 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:53.138 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 136.25466050200001, 2024-09-13T05:12:53.138 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:12:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:12:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.139 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.140 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:53.140 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:53.140 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.140 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.140 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.140 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:53.140 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:12:53.140 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:53.140 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.140 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.140 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:53.140 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:12:53.140 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:12:53.141 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.141 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.141 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:53.141 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:12:53.141 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:12:53.141 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.141 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.141 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:53.141 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:12:53.141 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:12:53.141 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.141 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.141 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.141 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:12:53.142 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:12:53.142 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.142 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.142 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:53.142 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:12:53.142 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:12:53.142 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.142 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.142 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.142 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:12:53.142 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:12:53.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.143 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.143 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:53.143 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:12:53.143 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:12:53.143 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.143 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:53.143 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.143 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.143 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:53.144 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:53.144 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 136.25463859000001, 2024-09-13T05:12:53.144 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:12:53.144 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:53.144 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:53.144 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:53.144 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:53.144 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:53.144 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:12:53.144 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.144 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:53.144 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.144 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:53.144 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:53.144 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:12:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:53.145 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:12:53.146 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:12:53.146 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.146 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.146 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:53.146 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:12:53.146 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:12:53.146 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.146 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.146 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:53.146 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:12:53.146 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:12:53.146 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:12:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:12:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:12:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:12:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:12:53.147 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:12:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:12:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:12:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 136.254629986, 2024-09-13T05:12:53.148 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:12:53.149 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:53.149 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:53.149 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:53.149 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:53.149 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:53.149 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:12:53.149 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.152 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:53.152 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.152 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:53.152 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:53.152 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.152 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.152 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.152 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:53.152 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:53.152 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.153 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.153 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.153 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:53.153 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:12:53.153 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:53.153 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.153 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.153 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:53.153 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:12:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:12:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:12:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:12:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:12:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:12:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.154 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:12:53.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:12:53.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:53.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:12:53.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:12:53.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.156 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:12:53.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:12:53.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.156 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.156 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:53.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:12:53.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:12:53.156 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.156 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:53.156 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.156 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.157 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:53.157 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:53.157 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 136.254620292, 2024-09-13T05:12:53.157 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:12:53.157 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:53.157 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:53.157 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:53.157 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:53.157 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:53.157 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:12:53.157 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.157 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:12:53.158 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:12:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:12:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:12:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:12:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.159 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:53.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:12:53.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:12:53.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:12:53.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:12:53.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:12:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:12:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:12:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:12:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:12:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:12:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.161 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 136.25461117699999, 2024-09-13T05:12:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:12:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:12:53.162 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:53.163 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:12:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:12:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:12:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:12:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:12:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.164 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:12:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:12:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:12:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:12:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:12:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:12:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.165 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:12:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:12:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:12:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:12:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.166 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:12:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 136.25460269800001, 2024-09-13T05:12:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:12:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:12:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:53.167 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:12:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:12:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:12:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.168 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:12:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:12:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:12:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:12:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:12:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:12:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:12:53.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:12:53.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:53.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:12:53.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:12:53.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:12:53.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:12:53.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.171 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:53.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:12:53.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:12:53.171 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.171 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:53.171 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.171 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:53.171 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:12:53.171 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 136.25459077299999, 2024-09-13T05:12:53.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:12:53.171 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:53.171 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:12:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:12:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:53.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:12:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:12:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:12:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:12:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:12:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:12:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:12:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:12:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:12:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:12:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:12:53.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:12:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:12:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:12:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:12:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:12:53.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:12:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 136.25456918399999, 2024-09-13T05:12:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:12:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:53.176 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:12:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:12:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:12:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:12:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:12:53.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:12:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:12:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:12:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:12:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:12:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:53.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:12:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:12:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:12:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:12:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:12:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:12:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:53.180 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 136.25454605600001, 2024-09-13T05:12:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:12:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:12:53.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:12:53.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:53.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:53.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:12:53.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:12:53.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:53.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:12:53.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:12:53.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.184 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:53.184 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:12:53.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:12:53.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.184 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.184 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:12:53.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:12:53.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:12:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:12:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:12:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:12:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:53.185 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:12:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:12:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:12:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 136.25453068300001, 2024-09-13T05:12:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:12:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:53.186 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:53.187 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:53.187 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:12:53.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.187 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:53.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:53.187 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:12:53.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:53.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:12:53.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:53.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:12:53.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:53.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:53.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:12:53.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:12:53.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:12:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:12:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:12:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:12:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:12:53.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:12:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:12:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:12:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:12:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:12:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:12:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:12:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 136.25451021500001, 2024-09-13T05:12:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:12:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:53.192 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:53.193 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:53.193 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:53.193 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:12:53.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.193 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:53.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:53.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:53.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:53.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:53.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:53.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:12:53.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:53.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:53.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:12:53.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:12:53.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:53.195 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:12:53.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:12:53.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.195 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:53.195 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:12:53.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:12:53.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.195 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:12:53.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:12:53.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.196 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:53.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:12:53.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:12:53.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.196 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:12:53.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:12:53.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:12:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:12:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 136.25449355399999, 2024-09-13T05:12:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:12:53.197 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:12:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.199 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:53.199 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:53.199 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.199 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.199 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.199 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:53.199 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:12:53.199 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:53.199 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.199 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:12:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:12:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:12:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:12:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:12:53.200 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:12:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:12:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:12:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:12:53.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:12:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:12:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:12:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:12:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:12:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.202 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:12:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 136.25446684100001, 2024-09-13T05:12:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:12:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:12:53.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.204 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:53.204 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:53.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:12:53.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.204 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.204 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:53.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:12:53.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.204 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.204 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:12:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:12:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:12:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:12:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:12:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:12:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:12:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:12:53.206 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:12:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:12:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:12:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:12:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:12:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:12:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:12:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:53.208 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 136.254447989, 2024-09-13T05:12:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:12:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:12:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:12:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:12:53.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:12:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:12:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:12:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:12:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:12:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.211 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:12:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:12:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:12:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:12:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:12:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:12:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.212 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:12:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:12:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 136.254430203, 2024-09-13T05:12:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:12:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:53.213 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:12:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:12:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.215 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:53.216 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:12:53.216 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:12:53.216 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.216 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.216 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:53.216 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:12:53.216 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:12:53.216 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.216 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.216 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:53.217 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:12:53.217 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:12:53.217 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.217 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.217 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.217 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:12:53.217 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:12:53.217 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.217 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.217 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:53.217 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:12:53.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:12:53.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.218 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.218 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:12:53.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:12:53.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.218 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.218 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:53.218 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:12:53.218 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:12:53.218 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.219 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:53.219 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.219 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.219 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.219 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:53.219 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:53.219 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 136.25439514300001, 2024-09-13T05:12:53.219 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:12:53.219 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:53.219 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:53.219 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:53.219 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:53.220 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:53.220 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:12:53.220 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.220 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:53.220 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.220 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:53.220 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:53.220 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.220 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.221 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:53.221 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:53.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.221 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:53.221 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:12:53.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:53.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.221 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.221 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:53.221 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:12:53.221 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:12:53.222 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.222 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.222 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:53.222 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:12:53.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:12:53.222 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.222 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.222 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:53.222 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:12:53.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:12:53.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:12:53.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:12:53.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.223 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:53.223 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:12:53.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:12:53.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.224 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.224 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:12:53.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:12:53.224 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.224 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:53.224 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:12:53.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:12:53.224 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.224 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:53.224 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.224 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.225 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:53.225 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:53.225 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 136.254378328, 2024-09-13T05:12:53.225 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:12:53.225 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:53.225 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:53.225 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:53.225 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:53.225 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:53.225 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:12:53.225 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.225 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:53.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:53.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:53.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:53.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:53.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:53.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:53.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:12:53.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:53.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:53.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:12:53.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:12:53.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:53.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:12:53.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:12:53.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.228 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:53.228 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:12:53.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:12:53.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.228 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.228 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:12:53.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:12:53.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.228 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:53.229 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:12:53.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:12:53.229 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.229 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.229 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:53.229 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:12:53.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:12:53.229 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:53.229 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:53.229 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:53.229 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:12:53.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:12:53.230 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.230 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:53.230 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.230 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:53.230 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:53.230 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:53.231 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:12:53.232 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:53.231+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:53.332 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:53.327+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:53.348 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:53.348 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:53.348 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:53.348 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:53.358 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:12:53.433 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:53.431+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:53.462 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:53.463 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:53.463 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:53.463 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:53.463 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:53.472 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:12:53.534 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:53.531+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:53.575 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:53.575 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:53.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:53.575 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [] 2024-09-13T05:12:53.575 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:53.585 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:12:53.642 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:53.639+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:53.658 INFO:tasks.thrashosds.thrasher:in_osds: [2, 3, 5, 7, 1, 4] out_osds: [0, 6] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-13T05:12:53.658 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:12:53.658 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-13T05:12:53.658 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-13T05:12:53.706 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T05:12:53.725 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:53.725 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:53.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:53.725 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:203056 3.1a e159/151 3:5a99807b:::rbd_object_map.112dbd21872d:head v 159'1876, mlcod=159'1874)", 2024-09-13T05:12:53.725 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:53.723184+0000", 2024-09-13T05:12:53.725 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00072984500000000002, 2024-09-13T05:12:53.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075233600000000004, 2024-09-13T05:12:53.725 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:53.725 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:53.725 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:53.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:53.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:53.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:53.723184+0000", 2024-09-13T05:12:53.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:53.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:53.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:53.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:53.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:53.723184+0000", 2024-09-13T05:12:53.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:53.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:53.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:53.723183+0000", 2024-09-13T05:12:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:53.723196+0000", 2024-09-13T05:12:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.38e-05 2024-09-13T05:12:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:53.723222+0000", 2024-09-13T05:12:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6101999999999998e-05 2024-09-13T05:12:53.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:53.723235+0000", 2024-09-13T05:12:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2177e-05 2024-09-13T05:12:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:53.723328+0000", 2024-09-13T05:12:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2961999999999995e-05 2024-09-13T05:12:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:53.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:53.723366+0000", 2024-09-13T05:12:53.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8457000000000001e-05 2024-09-13T05:12:53.729 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:53.729 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:53.729 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:53.729 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:53.729 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:12:53.729 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 1 2024-09-13T05:12:53.729 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:53.735 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:12:53.737 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:53.731+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:53.836 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:53.831+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:53.899 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:53.899 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:53.900 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:53.900 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:53.900 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:53.909 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:12:53.937 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:53.935+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:53.984 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:12:53.984 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:53.984 INFO:teuthology.orchestra.run.smithi120.stdout: "epoch": 159, 2024-09-13T05:12:53.984 INFO:teuthology.orchestra.run.smithi120.stdout: "fsid": "0a3759da-62bd-4704-8a4a-7c20eb3fc816", 2024-09-13T05:12:53.984 INFO:teuthology.orchestra.run.smithi120.stdout: "created": "2024-09-13T05:09:38.849186+0000", 2024-09-13T05:12:53.985 INFO:teuthology.orchestra.run.smithi120.stdout: "modified": "2024-09-13T05:12:53.627509+0000", 2024-09-13T05:12:53.985 INFO:teuthology.orchestra.run.smithi120.stdout: "last_up_change": "2024-09-13T05:12:13.640614+0000", 2024-09-13T05:12:53.985 INFO:teuthology.orchestra.run.smithi120.stdout: "last_in_change": "2024-09-13T05:12:36.834526+0000", 2024-09-13T05:12:53.985 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T05:12:53.985 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_num": 5804032, 2024-09-13T05:12:53.985 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_set": [ 2024-09-13T05:12:53.985 INFO:teuthology.orchestra.run.smithi120.stdout: "nodeep-scrub", 2024-09-13T05:12:53.985 INFO:teuthology.orchestra.run.smithi120.stdout: "pglog_hardlimit", 2024-09-13T05:12:53.985 INFO:teuthology.orchestra.run.smithi120.stdout: "purged_snapdirs", 2024-09-13T05:12:53.985 INFO:teuthology.orchestra.run.smithi120.stdout: "recovery_deletes", 2024-09-13T05:12:53.985 INFO:teuthology.orchestra.run.smithi120.stdout: "sortbitwise" 2024-09-13T05:12:53.985 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:12:53.985 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_version": 5, 2024-09-13T05:12:53.986 INFO:teuthology.orchestra.run.smithi120.stdout: "full_ratio": 0.94999998807907104, 2024-09-13T05:12:53.986 INFO:teuthology.orchestra.run.smithi120.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-13T05:12:53.986 INFO:teuthology.orchestra.run.smithi120.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-13T05:12:53.986 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_snapshot": "", 2024-09-13T05:12:53.986 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_max": 3, 2024-09-13T05:12:53.986 INFO:teuthology.orchestra.run.smithi120.stdout: "max_osd": 8, 2024-09-13T05:12:53.986 INFO:teuthology.orchestra.run.smithi120.stdout: "require_min_compat_client": "luminous", 2024-09-13T05:12:53.986 INFO:teuthology.orchestra.run.smithi120.stdout: "min_compat_client": "luminous", 2024-09-13T05:12:53.986 INFO:teuthology.orchestra.run.smithi120.stdout: "require_osd_release": "reef", 2024-09-13T05:12:53.986 INFO:teuthology.orchestra.run.smithi120.stdout: "allow_crimson": false, 2024-09-13T05:12:53.986 INFO:teuthology.orchestra.run.smithi120.stdout: "pools": [ 2024-09-13T05:12:53.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:53.986 INFO:teuthology.orchestra.run.smithi120.stdout: "pool": 1, 2024-09-13T05:12:53.986 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": ".mgr", 2024-09-13T05:12:53.987 INFO:teuthology.orchestra.run.smithi120.stdout: "create_time": "2024-09-13T05:09:52.225455+0000", 2024-09-13T05:12:53.987 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-13T05:12:53.987 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_names": "hashpspool", 2024-09-13T05:12:53.987 INFO:teuthology.orchestra.run.smithi120.stdout: "type": 1, 2024-09-13T05:12:53.987 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 2, 2024-09-13T05:12:53.987 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": 1, 2024-09-13T05:12:53.987 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_rule": 0, 2024-09-13T05:12:53.987 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_count": 0, 2024-09-13T05:12:53.987 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_target": 0, 2024-09-13T05:12:53.987 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T05:12:53.987 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T05:12:53.987 INFO:teuthology.orchestra.run.smithi120.stdout: "object_hash": 2, 2024-09-13T05:12:53.987 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscale_mode": "off", 2024-09-13T05:12:53.988 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": 1, 2024-09-13T05:12:53.988 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num": 1, 2024-09-13T05:12:53.988 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num_target": 1, 2024-09-13T05:12:53.988 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_target": 1, 2024-09-13T05:12:53.988 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_pending": 1, 2024-09-13T05:12:53.988 INFO:teuthology.orchestra.run.smithi120.stdout: "last_pg_merge_meta": { 2024-09-13T05:12:53.988 INFO:teuthology.orchestra.run.smithi120.stdout: "source_pgid": "0.0", 2024-09-13T05:12:53.988 INFO:teuthology.orchestra.run.smithi120.stdout: "ready_epoch": 0, 2024-09-13T05:12:53.988 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_started": 0, 2024-09-13T05:12:53.988 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_clean": 0, 2024-09-13T05:12:53.989 INFO:teuthology.orchestra.run.smithi120.stdout: "source_version": "0'0", 2024-09-13T05:12:53.989 INFO:teuthology.orchestra.run.smithi120.stdout: "target_version": "0'0" 2024-09-13T05:12:53.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:53.989 INFO:teuthology.orchestra.run.smithi120.stdout: "last_change": "16", 2024-09-13T05:12:53.990 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend": "0", 2024-09-13T05:12:53.990 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T05:12:53.990 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T05:12:53.990 INFO:teuthology.orchestra.run.smithi120.stdout: "auid": 0, 2024-09-13T05:12:53.990 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_mode": "selfmanaged", 2024-09-13T05:12:53.991 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_seq": 0, 2024-09-13T05:12:53.991 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_epoch": 0, 2024-09-13T05:12:53.991 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_snaps": [], 2024-09-13T05:12:53.991 INFO:teuthology.orchestra.run.smithi120.stdout: "removed_snaps": "[]", 2024-09-13T05:12:53.991 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_bytes": 0, 2024-09-13T05:12:53.991 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_objects": 0, 2024-09-13T05:12:53.991 INFO:teuthology.orchestra.run.smithi120.stdout: "tiers": [], 2024-09-13T05:12:53.992 INFO:teuthology.orchestra.run.smithi120.stdout: "tier_of": -1, 2024-09-13T05:12:53.992 INFO:teuthology.orchestra.run.smithi120.stdout: "read_tier": -1, 2024-09-13T05:12:53.992 INFO:teuthology.orchestra.run.smithi120.stdout: "write_tier": -1, 2024-09-13T05:12:53.992 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_mode": "none", 2024-09-13T05:12:53.992 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_bytes": 0, 2024-09-13T05:12:53.992 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_objects": 0, 2024-09-13T05:12:53.992 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T05:12:53.993 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T05:12:53.993 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T05:12:53.993 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_flush_age": 0, 2024-09-13T05:12:53.993 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_evict_age": 0, 2024-09-13T05:12:53.993 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_profile": "", 2024-09-13T05:12:53.993 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_params": { 2024-09-13T05:12:53.993 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "none" 2024-09-13T05:12:53.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:53.994 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_period": 0, 2024-09-13T05:12:53.994 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_count": 0, 2024-09-13T05:12:53.994 INFO:teuthology.orchestra.run.smithi120.stdout: "use_gmt_hitset": true, 2024-09-13T05:12:53.994 INFO:teuthology.orchestra.run.smithi120.stdout: "min_read_recency_for_promote": 0, 2024-09-13T05:12:53.994 INFO:teuthology.orchestra.run.smithi120.stdout: "min_write_recency_for_promote": 0, 2024-09-13T05:12:53.994 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T05:12:53.995 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_search_last_n": 0, 2024-09-13T05:12:53.995 INFO:teuthology.orchestra.run.smithi120.stdout: "grade_table": [], 2024-09-13T05:12:53.995 INFO:teuthology.orchestra.run.smithi120.stdout: "stripe_width": 0, 2024-09-13T05:12:53.995 INFO:teuthology.orchestra.run.smithi120.stdout: "expected_num_objects": 0, 2024-09-13T05:12:53.995 INFO:teuthology.orchestra.run.smithi120.stdout: "fast_read": false, 2024-09-13T05:12:53.995 INFO:teuthology.orchestra.run.smithi120.stdout: "options": { 2024-09-13T05:12:53.996 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_max": 32, 2024-09-13T05:12:53.996 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_min": 1 2024-09-13T05:12:53.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:53.996 INFO:teuthology.orchestra.run.smithi120.stdout: "application_metadata": { 2024-09-13T05:12:53.996 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": {} 2024-09-13T05:12:53.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:53.997 INFO:teuthology.orchestra.run.smithi120.stdout: "read_balance": { 2024-09-13T05:12:53.997 INFO:teuthology.orchestra.run.smithi120.stdout: "score_acting": 8, 2024-09-13T05:12:53.997 INFO:teuthology.orchestra.run.smithi120.stdout: "score_stable": 8, 2024-09-13T05:12:53.997 INFO:teuthology.orchestra.run.smithi120.stdout: "optimal_score": 0.25, 2024-09-13T05:12:53.997 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_acting": 2, 2024-09-13T05:12:53.997 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_stable": 2, 2024-09-13T05:12:53.998 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity_weighted": 0.96530342102050781, 2024-09-13T05:12:53.998 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity": 0.97000002861022949, 2024-09-13T05:12:53.998 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity_weighted": 0.97000002861022949 2024-09-13T05:12:53.998 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:53.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:53.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:53.998 INFO:teuthology.orchestra.run.smithi120.stdout: "pool": 2, 2024-09-13T05:12:53.998 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": "rbd", 2024-09-13T05:12:53.998 INFO:teuthology.orchestra.run.smithi120.stdout: "create_time": "2024-09-13T05:09:57.858552+0000", 2024-09-13T05:12:53.999 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 8193, 2024-09-13T05:12:53.999 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T05:12:53.999 INFO:teuthology.orchestra.run.smithi120.stdout: "type": 1, 2024-09-13T05:12:53.999 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 2, 2024-09-13T05:12:53.999 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": 1, 2024-09-13T05:12:53.999 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_rule": 0, 2024-09-13T05:12:53.999 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_count": 0, 2024-09-13T05:12:53.999 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_target": 0, 2024-09-13T05:12:53.999 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T05:12:53.999 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T05:12:53.999 INFO:teuthology.orchestra.run.smithi120.stdout: "object_hash": 2, 2024-09-13T05:12:53.999 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscale_mode": "off", 2024-09-13T05:12:53.999 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": 8, 2024-09-13T05:12:54.000 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num": 8, 2024-09-13T05:12:54.000 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num_target": 8, 2024-09-13T05:12:54.000 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_target": 8, 2024-09-13T05:12:54.000 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_pending": 8, 2024-09-13T05:12:54.000 INFO:teuthology.orchestra.run.smithi120.stdout: "last_pg_merge_meta": { 2024-09-13T05:12:54.000 INFO:teuthology.orchestra.run.smithi120.stdout: "source_pgid": "0.0", 2024-09-13T05:12:54.000 INFO:teuthology.orchestra.run.smithi120.stdout: "ready_epoch": 0, 2024-09-13T05:12:54.000 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_started": 0, 2024-09-13T05:12:54.000 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_clean": 0, 2024-09-13T05:12:54.000 INFO:teuthology.orchestra.run.smithi120.stdout: "source_version": "0'0", 2024-09-13T05:12:54.000 INFO:teuthology.orchestra.run.smithi120.stdout: "target_version": "0'0" 2024-09-13T05:12:54.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.000 INFO:teuthology.orchestra.run.smithi120.stdout: "last_change": "20", 2024-09-13T05:12:54.001 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend": "0", 2024-09-13T05:12:54.001 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T05:12:54.001 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T05:12:54.001 INFO:teuthology.orchestra.run.smithi120.stdout: "auid": 0, 2024-09-13T05:12:54.001 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_mode": "selfmanaged", 2024-09-13T05:12:54.001 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_seq": 3, 2024-09-13T05:12:54.001 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_epoch": 20, 2024-09-13T05:12:54.001 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_snaps": [], 2024-09-13T05:12:54.001 INFO:teuthology.orchestra.run.smithi120.stdout: "removed_snaps": "[]", 2024-09-13T05:12:54.001 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_bytes": 0, 2024-09-13T05:12:54.001 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_objects": 0, 2024-09-13T05:12:54.001 INFO:teuthology.orchestra.run.smithi120.stdout: "tiers": [], 2024-09-13T05:12:54.002 INFO:teuthology.orchestra.run.smithi120.stdout: "tier_of": -1, 2024-09-13T05:12:54.002 INFO:teuthology.orchestra.run.smithi120.stdout: "read_tier": -1, 2024-09-13T05:12:54.002 INFO:teuthology.orchestra.run.smithi120.stdout: "write_tier": -1, 2024-09-13T05:12:54.002 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_mode": "none", 2024-09-13T05:12:54.002 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_bytes": 0, 2024-09-13T05:12:54.002 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_objects": 0, 2024-09-13T05:12:54.002 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T05:12:54.002 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T05:12:54.002 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T05:12:54.002 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_flush_age": 0, 2024-09-13T05:12:54.002 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_evict_age": 0, 2024-09-13T05:12:54.002 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_profile": "", 2024-09-13T05:12:54.002 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_params": { 2024-09-13T05:12:54.003 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "none" 2024-09-13T05:12:54.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.003 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_period": 0, 2024-09-13T05:12:54.003 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_count": 0, 2024-09-13T05:12:54.003 INFO:teuthology.orchestra.run.smithi120.stdout: "use_gmt_hitset": true, 2024-09-13T05:12:54.003 INFO:teuthology.orchestra.run.smithi120.stdout: "min_read_recency_for_promote": 0, 2024-09-13T05:12:54.003 INFO:teuthology.orchestra.run.smithi120.stdout: "min_write_recency_for_promote": 0, 2024-09-13T05:12:54.003 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T05:12:54.003 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_search_last_n": 0, 2024-09-13T05:12:54.004 INFO:teuthology.orchestra.run.smithi120.stdout: "grade_table": [], 2024-09-13T05:12:54.004 INFO:teuthology.orchestra.run.smithi120.stdout: "stripe_width": 0, 2024-09-13T05:12:54.004 INFO:teuthology.orchestra.run.smithi120.stdout: "expected_num_objects": 0, 2024-09-13T05:12:54.004 INFO:teuthology.orchestra.run.smithi120.stdout: "fast_read": false, 2024-09-13T05:12:54.004 INFO:teuthology.orchestra.run.smithi120.stdout: "options": {}, 2024-09-13T05:12:54.004 INFO:teuthology.orchestra.run.smithi120.stdout: "application_metadata": { 2024-09-13T05:12:54.004 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd": {} 2024-09-13T05:12:54.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.004 INFO:teuthology.orchestra.run.smithi120.stdout: "read_balance": { 2024-09-13T05:12:54.004 INFO:teuthology.orchestra.run.smithi120.stdout: "score_acting": 3, 2024-09-13T05:12:54.004 INFO:teuthology.orchestra.run.smithi120.stdout: "score_stable": 3, 2024-09-13T05:12:54.004 INFO:teuthology.orchestra.run.smithi120.stdout: "optimal_score": 0.75, 2024-09-13T05:12:54.004 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_acting": 2.25, 2024-09-13T05:12:54.005 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_stable": 2.25, 2024-09-13T05:12:54.005 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity_weighted": 0.96530342102050781, 2024-09-13T05:12:54.005 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity": 0.97000002861022949, 2024-09-13T05:12:54.005 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity_weighted": 0.97000002861022949 2024-09-13T05:12:54.005 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.005 INFO:teuthology.orchestra.run.smithi120.stdout: "pool": 3, 2024-09-13T05:12:54.005 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": "pool_client.0", 2024-09-13T05:12:54.005 INFO:teuthology.orchestra.run.smithi120.stdout: "create_time": "2024-09-13T05:10:07.742110+0000", 2024-09-13T05:12:54.005 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 8193, 2024-09-13T05:12:54.005 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T05:12:54.005 INFO:teuthology.orchestra.run.smithi120.stdout: "type": 1, 2024-09-13T05:12:54.006 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 2, 2024-09-13T05:12:54.006 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": 1, 2024-09-13T05:12:54.006 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_rule": 0, 2024-09-13T05:12:54.006 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_count": 0, 2024-09-13T05:12:54.006 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_target": 0, 2024-09-13T05:12:54.006 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T05:12:54.006 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T05:12:54.006 INFO:teuthology.orchestra.run.smithi120.stdout: "object_hash": 2, 2024-09-13T05:12:54.006 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscale_mode": "off", 2024-09-13T05:12:54.006 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": 32, 2024-09-13T05:12:54.006 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num": 32, 2024-09-13T05:12:54.006 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num_target": 32, 2024-09-13T05:12:54.006 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_target": 32, 2024-09-13T05:12:54.007 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_pending": 32, 2024-09-13T05:12:54.007 INFO:teuthology.orchestra.run.smithi120.stdout: "last_pg_merge_meta": { 2024-09-13T05:12:54.007 INFO:teuthology.orchestra.run.smithi120.stdout: "source_pgid": "0.0", 2024-09-13T05:12:54.007 INFO:teuthology.orchestra.run.smithi120.stdout: "ready_epoch": 0, 2024-09-13T05:12:54.007 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_started": 0, 2024-09-13T05:12:54.007 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_clean": 0, 2024-09-13T05:12:54.007 INFO:teuthology.orchestra.run.smithi120.stdout: "source_version": "0'0", 2024-09-13T05:12:54.007 INFO:teuthology.orchestra.run.smithi120.stdout: "target_version": "0'0" 2024-09-13T05:12:54.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.007 INFO:teuthology.orchestra.run.smithi120.stdout: "last_change": "159", 2024-09-13T05:12:54.007 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend": "0", 2024-09-13T05:12:54.008 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T05:12:54.008 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T05:12:54.008 INFO:teuthology.orchestra.run.smithi120.stdout: "auid": 0, 2024-09-13T05:12:54.008 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_mode": "selfmanaged", 2024-09-13T05:12:54.008 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_seq": 57, 2024-09-13T05:12:54.008 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_epoch": 159, 2024-09-13T05:12:54.008 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_snaps": [], 2024-09-13T05:12:54.008 INFO:teuthology.orchestra.run.smithi120.stdout: "removed_snaps": "[]", 2024-09-13T05:12:54.008 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_bytes": 0, 2024-09-13T05:12:54.008 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_objects": 0, 2024-09-13T05:12:54.008 INFO:teuthology.orchestra.run.smithi120.stdout: "tiers": [], 2024-09-13T05:12:54.008 INFO:teuthology.orchestra.run.smithi120.stdout: "tier_of": -1, 2024-09-13T05:12:54.009 INFO:teuthology.orchestra.run.smithi120.stdout: "read_tier": -1, 2024-09-13T05:12:54.009 INFO:teuthology.orchestra.run.smithi120.stdout: "write_tier": -1, 2024-09-13T05:12:54.009 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_mode": "none", 2024-09-13T05:12:54.009 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_bytes": 0, 2024-09-13T05:12:54.009 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_objects": 0, 2024-09-13T05:12:54.009 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T05:12:54.009 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T05:12:54.009 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T05:12:54.009 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_flush_age": 0, 2024-09-13T05:12:54.009 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_evict_age": 0, 2024-09-13T05:12:54.010 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_profile": "", 2024-09-13T05:12:54.010 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_params": { 2024-09-13T05:12:54.010 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "none" 2024-09-13T05:12:54.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.010 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_period": 0, 2024-09-13T05:12:54.010 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_count": 0, 2024-09-13T05:12:54.010 INFO:teuthology.orchestra.run.smithi120.stdout: "use_gmt_hitset": true, 2024-09-13T05:12:54.010 INFO:teuthology.orchestra.run.smithi120.stdout: "min_read_recency_for_promote": 0, 2024-09-13T05:12:54.010 INFO:teuthology.orchestra.run.smithi120.stdout: "min_write_recency_for_promote": 0, 2024-09-13T05:12:54.010 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T05:12:54.010 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_search_last_n": 0, 2024-09-13T05:12:54.010 INFO:teuthology.orchestra.run.smithi120.stdout: "grade_table": [], 2024-09-13T05:12:54.010 INFO:teuthology.orchestra.run.smithi120.stdout: "stripe_width": 0, 2024-09-13T05:12:54.011 INFO:teuthology.orchestra.run.smithi120.stdout: "expected_num_objects": 0, 2024-09-13T05:12:54.011 INFO:teuthology.orchestra.run.smithi120.stdout: "fast_read": false, 2024-09-13T05:12:54.011 INFO:teuthology.orchestra.run.smithi120.stdout: "options": {}, 2024-09-13T05:12:54.011 INFO:teuthology.orchestra.run.smithi120.stdout: "application_metadata": { 2024-09-13T05:12:54.011 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd": {} 2024-09-13T05:12:54.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.011 INFO:teuthology.orchestra.run.smithi120.stdout: "read_balance": { 2024-09-13T05:12:54.011 INFO:teuthology.orchestra.run.smithi120.stdout: "score_acting": 2, 2024-09-13T05:12:54.011 INFO:teuthology.orchestra.run.smithi120.stdout: "score_stable": 2, 2024-09-13T05:12:54.011 INFO:teuthology.orchestra.run.smithi120.stdout: "optimal_score": 0.75, 2024-09-13T05:12:54.011 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_acting": 1.5, 2024-09-13T05:12:54.011 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_stable": 1.5, 2024-09-13T05:12:54.011 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity_weighted": 0.96530342102050781, 2024-09-13T05:12:54.012 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity": 0.97000002861022949, 2024-09-13T05:12:54.012 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity_weighted": 0.97000002861022949 2024-09-13T05:12:54.012 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.012 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.012 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:12:54.012 INFO:teuthology.orchestra.run.smithi120.stdout: "osds": [ 2024-09-13T05:12:54.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.012 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 0, 2024-09-13T05:12:54.012 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "b304ec03-bb00-4b13-bf2d-71017b8a70a3", 2024-09-13T05:12:54.012 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:12:54.012 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 0, 2024-09-13T05:12:54.013 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 0, 2024-09-13T05:12:54.013 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:12:54.013 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 13, 2024-09-13T05:12:54.013 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 105, 2024-09-13T05:12:54.013 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 124, 2024-09-13T05:12:54.013 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 40, 2024-09-13T05:12:54.013 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 106, 2024-09-13T05:12:54.013 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:12:54.013 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:12:54.013 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.013 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.013 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6800", 2024-09-13T05:12:54.014 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 367697828 2024-09-13T05:12:54.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.014 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.014 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6801", 2024-09-13T05:12:54.014 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 367697828 2024-09-13T05:12:54.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.014 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.014 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:12:54.014 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.015 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.015 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6802", 2024-09-13T05:12:54.015 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 367697828 2024-09-13T05:12:54.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.015 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.015 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6803", 2024-09-13T05:12:54.015 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 367697828 2024-09-13T05:12:54.015 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.015 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.016 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:12:54.016 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.016 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.016 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6806", 2024-09-13T05:12:54.016 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 367697828 2024-09-13T05:12:54.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.016 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.017 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6807", 2024-09-13T05:12:54.017 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 367697828 2024-09-13T05:12:54.017 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.017 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.017 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:12:54.017 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.017 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.017 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6804", 2024-09-13T05:12:54.017 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 367697828 2024-09-13T05:12:54.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.018 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.018 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6805", 2024-09-13T05:12:54.018 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 367697828 2024-09-13T05:12:54.018 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.018 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.018 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.120:6801/367697828", 2024-09-13T05:12:54.018 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.120:6803/367697828", 2024-09-13T05:12:54.018 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.120:6807/367697828", 2024-09-13T05:12:54.018 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.120:6805/367697828", 2024-09-13T05:12:54.018 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:12:54.019 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:12:54.019 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:12:54.019 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.019 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 1, 2024-09-13T05:12:54.019 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "c09e84f3-3a70-46a4-b67b-c9bb52c887b7", 2024-09-13T05:12:54.019 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:12:54.019 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:12:54.019 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:12:54.019 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:12:54.019 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:12:54.019 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:12:54.020 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:12:54.020 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 153, 2024-09-13T05:12:54.020 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:12:54.020 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:12:54.020 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:12:54.020 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.020 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.020 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6808", 2024-09-13T05:12:54.020 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:12:54.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.021 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.021 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6809", 2024-09-13T05:12:54.021 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:12:54.021 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.021 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.021 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:12:54.021 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.021 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.021 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6810", 2024-09-13T05:12:54.021 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:12:54.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.022 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.022 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6811", 2024-09-13T05:12:54.022 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:12:54.022 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.022 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.022 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:12:54.022 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.022 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.022 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6814", 2024-09-13T05:12:54.022 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:12:54.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.023 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.023 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6815", 2024-09-13T05:12:54.023 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:12:54.023 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.023 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.023 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:12:54.023 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.023 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.023 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6812", 2024-09-13T05:12:54.023 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:12:54.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.024 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.024 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6813", 2024-09-13T05:12:54.024 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:12:54.024 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.024 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.024 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.120:6809/1023532100", 2024-09-13T05:12:54.024 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.120:6811/1023532100", 2024-09-13T05:12:54.024 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.120:6815/1023532100", 2024-09-13T05:12:54.024 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.120:6813/1023532100", 2024-09-13T05:12:54.024 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:12:54.025 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:12:54.025 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:12:54.025 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.025 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 2, 2024-09-13T05:12:54.025 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "3c2a0458-369c-4dac-90a3-fb20cb70d53f", 2024-09-13T05:12:54.025 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:12:54.025 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:12:54.025 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:12:54.025 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:12:54.025 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:12:54.026 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:12:54.026 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:12:54.026 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 149, 2024-09-13T05:12:54.026 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:12:54.026 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:12:54.026 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:12:54.026 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.026 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.026 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6816", 2024-09-13T05:12:54.026 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:12:54.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.027 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.027 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6817", 2024-09-13T05:12:54.027 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:12:54.027 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.027 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.027 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:12:54.027 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.027 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.027 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6818", 2024-09-13T05:12:54.027 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:12:54.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.027 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.028 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6819", 2024-09-13T05:12:54.028 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:12:54.028 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.028 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.028 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:12:54.028 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.028 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.028 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6822", 2024-09-13T05:12:54.028 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:12:54.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.029 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.029 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6823", 2024-09-13T05:12:54.029 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:12:54.029 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.029 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.029 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:12:54.029 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.029 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.029 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6820", 2024-09-13T05:12:54.029 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:12:54.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.030 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.030 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6821", 2024-09-13T05:12:54.030 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:12:54.030 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.030 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.030 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.120:6817/592498012", 2024-09-13T05:12:54.030 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.120:6819/592498012", 2024-09-13T05:12:54.030 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.120:6823/592498012", 2024-09-13T05:12:54.030 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.120:6821/592498012", 2024-09-13T05:12:54.030 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:12:54.030 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:12:54.031 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:12:54.031 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.031 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 3, 2024-09-13T05:12:54.031 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "edce3757-5e9d-4221-a1f1-3f356bb5218b", 2024-09-13T05:12:54.031 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:12:54.031 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:12:54.031 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:12:54.031 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:12:54.031 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:12:54.031 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:12:54.031 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:12:54.031 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 149, 2024-09-13T05:12:54.032 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:12:54.032 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:12:54.032 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:12:54.032 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.032 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.032 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6824", 2024-09-13T05:12:54.032 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:12:54.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.032 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.032 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6825", 2024-09-13T05:12:54.032 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:12:54.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.033 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.033 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:12:54.033 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.033 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.033 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6826", 2024-09-13T05:12:54.033 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:12:54.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.033 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.034 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6827", 2024-09-13T05:12:54.034 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:12:54.034 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.034 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.034 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:12:54.034 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.034 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.034 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6830", 2024-09-13T05:12:54.034 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:12:54.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.034 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.035 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6831", 2024-09-13T05:12:54.035 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:12:54.035 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.035 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.035 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:12:54.035 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.035 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.035 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6828", 2024-09-13T05:12:54.035 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:12:54.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.035 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.036 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6829", 2024-09-13T05:12:54.036 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:12:54.036 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.036 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.036 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.120:6825/1939753938", 2024-09-13T05:12:54.036 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.120:6827/1939753938", 2024-09-13T05:12:54.036 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.120:6831/1939753938", 2024-09-13T05:12:54.036 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.120:6829/1939753938", 2024-09-13T05:12:54.036 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:12:54.036 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:12:54.036 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:12:54.036 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.037 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 4, 2024-09-13T05:12:54.037 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "5fe378d2-578f-41ea-980a-4673a8b376df", 2024-09-13T05:12:54.037 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:12:54.037 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:12:54.037 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:12:54.037 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 0.894744873046875, 2024-09-13T05:12:54.037 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:12:54.037 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:12:54.038 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:12:54.038 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 154, 2024-09-13T05:12:54.038 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:12:54.038 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:12:54.038 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:12:54.038 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.038 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.038 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6824", 2024-09-13T05:12:54.038 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:12:54.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.038 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.038 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6825", 2024-09-13T05:12:54.039 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:12:54.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.039 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.039 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:12:54.039 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.039 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.039 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6826", 2024-09-13T05:12:54.039 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:12:54.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.039 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.039 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6827", 2024-09-13T05:12:54.040 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:12:54.040 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.040 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.040 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:12:54.040 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.040 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.040 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6830", 2024-09-13T05:12:54.040 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:12:54.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.040 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.041 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6831", 2024-09-13T05:12:54.041 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:12:54.041 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.041 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.041 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:12:54.041 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.041 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.041 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6828", 2024-09-13T05:12:54.041 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:12:54.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.041 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.042 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6829", 2024-09-13T05:12:54.042 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:12:54.042 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.042 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.042 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.137:6825/3005075615", 2024-09-13T05:12:54.042 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.137:6827/3005075615", 2024-09-13T05:12:54.042 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.137:6831/3005075615", 2024-09-13T05:12:54.042 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.137:6829/3005075615", 2024-09-13T05:12:54.042 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:12:54.042 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:12:54.042 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:12:54.042 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.043 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 5, 2024-09-13T05:12:54.043 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "6e6f7499-ae9e-4cb1-9db7-4d9f8fd9b257", 2024-09-13T05:12:54.043 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:12:54.043 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:12:54.043 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:12:54.043 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:12:54.043 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:12:54.043 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:12:54.043 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:12:54.043 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 148, 2024-09-13T05:12:54.043 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:12:54.043 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:12:54.043 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:12:54.044 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.044 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.044 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6800", 2024-09-13T05:12:54.044 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:12:54.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.044 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.044 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6801", 2024-09-13T05:12:54.044 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:12:54.044 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.044 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.045 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:12:54.045 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.045 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.045 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6802", 2024-09-13T05:12:54.045 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:12:54.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.045 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.045 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6803", 2024-09-13T05:12:54.045 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:12:54.045 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.045 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.046 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:12:54.046 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.046 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.046 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6806", 2024-09-13T05:12:54.046 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:12:54.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.046 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.046 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6807", 2024-09-13T05:12:54.046 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:12:54.046 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.046 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:12:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6804", 2024-09-13T05:12:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:12:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6805", 2024-09-13T05:12:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:12:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.047 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.048 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.137:6801/1108177522", 2024-09-13T05:12:54.048 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.137:6803/1108177522", 2024-09-13T05:12:54.048 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.137:6807/1108177522", 2024-09-13T05:12:54.048 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.137:6805/1108177522", 2024-09-13T05:12:54.048 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:12:54.048 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:12:54.048 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:12:54.048 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.048 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 6, 2024-09-13T05:12:54.048 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "e4c519e5-5df4-4d55-b12e-fbcfb1b0555c", 2024-09-13T05:12:54.048 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:12:54.049 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 0, 2024-09-13T05:12:54.049 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 0, 2024-09-13T05:12:54.049 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 0.8276824951171875, 2024-09-13T05:12:54.049 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:12:54.049 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:12:54.049 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:12:54.049 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 118, 2024-09-13T05:12:54.049 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:12:54.049 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:12:54.049 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:12:54.049 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.049 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.050 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6816", 2024-09-13T05:12:54.050 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:12:54.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.050 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.050 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6817", 2024-09-13T05:12:54.050 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:12:54.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.050 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.050 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:12:54.050 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.051 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.051 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6818", 2024-09-13T05:12:54.051 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:12:54.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.051 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.051 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6819", 2024-09-13T05:12:54.051 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:12:54.051 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.051 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.051 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:12:54.052 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.052 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.052 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6822", 2024-09-13T05:12:54.052 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:12:54.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.052 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.052 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6823", 2024-09-13T05:12:54.052 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:12:54.052 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.052 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.052 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:12:54.053 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.053 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.053 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6820", 2024-09-13T05:12:54.053 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:12:54.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.053 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.053 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6821", 2024-09-13T05:12:54.053 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:12:54.053 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.053 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.053 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.137:6817/2667039053", 2024-09-13T05:12:54.054 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.137:6819/2667039053", 2024-09-13T05:12:54.054 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.137:6823/2667039053", 2024-09-13T05:12:54.054 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.137:6821/2667039053", 2024-09-13T05:12:54.054 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:12:54.054 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:12:54.054 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:12:54.054 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.054 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 7, 2024-09-13T05:12:54.054 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "914648c2-7a6c-4e66-811d-936e250638db", 2024-09-13T05:12:54.054 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:12:54.054 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:12:54.054 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:12:54.055 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:12:54.055 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:12:54.055 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:12:54.055 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:12:54.055 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 153, 2024-09-13T05:12:54.055 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:12:54.055 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:12:54.055 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:12:54.055 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.055 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.055 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6808", 2024-09-13T05:12:54.055 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:12:54.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.056 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.056 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6809", 2024-09-13T05:12:54.056 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:12:54.056 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.056 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.056 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:12:54.056 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.056 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.056 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6810", 2024-09-13T05:12:54.056 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:12:54.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.057 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.057 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6811", 2024-09-13T05:12:54.057 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:12:54.057 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.057 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.057 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:12:54.057 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.057 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.057 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6814", 2024-09-13T05:12:54.057 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:12:54.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.058 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.058 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6815", 2024-09-13T05:12:54.058 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:12:54.058 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.058 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.058 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:12:54.058 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:12:54.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.058 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:12:54.058 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6812", 2024-09-13T05:12:54.058 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:12:54.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.059 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:12:54.059 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6813", 2024-09-13T05:12:54.059 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:12:54.059 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.059 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.059 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.137:6809/993764921", 2024-09-13T05:12:54.059 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.137:6811/993764921", 2024-09-13T05:12:54.059 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.137:6815/993764921", 2024-09-13T05:12:54.059 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.137:6813/993764921", 2024-09-13T05:12:54.059 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:12:54.060 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:12:54.060 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:12:54.060 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.060 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.060 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:12:54.060 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_xinfo": [ 2024-09-13T05:12:54.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.060 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 0, 2024-09-13T05:12:54.060 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:12:54.060 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:12:54.060 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:12:54.061 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:12:54.061 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 65536, 2024-09-13T05:12:54.061 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:46.914820+0000", 2024-09-13T05:12:54.061 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 106 2024-09-13T05:12:54.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.061 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 1, 2024-09-13T05:12:54.061 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:12:54.061 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:12:54.061 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:12:54.061 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:12:54.061 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:12:54.061 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.326286+0000", 2024-09-13T05:12:54.061 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:12:54.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.062 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 2, 2024-09-13T05:12:54.062 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:12:54.062 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:12:54.062 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:12:54.062 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:12:54.062 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:12:54.062 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.147193+0000", 2024-09-13T05:12:54.062 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:12:54.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.062 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 3, 2024-09-13T05:12:54.063 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:12:54.063 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:12:54.063 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:12:54.063 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:12:54.063 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:12:54.063 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.478655+0000", 2024-09-13T05:12:54.063 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:12:54.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.063 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 4, 2024-09-13T05:12:54.063 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:12:54.063 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:12:54.063 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:12:54.064 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:12:54.064 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:12:54.064 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.388938+0000", 2024-09-13T05:12:54.064 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:12:54.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.064 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 5, 2024-09-13T05:12:54.064 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:12:54.064 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:12:54.064 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:12:54.064 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:12:54.064 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:12:54.064 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.127175+0000", 2024-09-13T05:12:54.064 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:12:54.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.065 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 6, 2024-09-13T05:12:54.065 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:12:54.065 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:12:54.065 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:12:54.065 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:12:54.065 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 65536, 2024-09-13T05:12:54.065 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.187286+0000", 2024-09-13T05:12:54.065 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:12:54.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.065 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 7, 2024-09-13T05:12:54.066 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:12:54.066 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:12:54.066 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:12:54.066 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:12:54.066 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:12:54.066 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:46.962119+0000", 2024-09-13T05:12:54.066 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:12:54.066 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.066 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:12:54.066 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_upmap": [ 2024-09-13T05:12:54.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.066 INFO:teuthology.orchestra.run.smithi120.stdout: "pgid": "3.a", 2024-09-13T05:12:54.067 INFO:teuthology.orchestra.run.smithi120.stdout: "osds": [ 2024-09-13T05:12:54.067 INFO:teuthology.orchestra.run.smithi120.stdout: 3, 2024-09-13T05:12:54.067 INFO:teuthology.orchestra.run.smithi120.stdout: 2 2024-09-13T05:12:54.067 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.067 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.067 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:12:54.067 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_upmap_items": [], 2024-09-13T05:12:54.067 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_upmap_primaries": [], 2024-09-13T05:12:54.067 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_temp": [], 2024-09-13T05:12:54.067 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_temp": [], 2024-09-13T05:12:54.067 INFO:teuthology.orchestra.run.smithi120.stdout: "blocklist": {}, 2024-09-13T05:12:54.067 INFO:teuthology.orchestra.run.smithi120.stdout: "range_blocklist": {}, 2024-09-13T05:12:54.068 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_profiles": { 2024-09-13T05:12:54.068 INFO:teuthology.orchestra.run.smithi120.stdout: "default": { 2024-09-13T05:12:54.068 INFO:teuthology.orchestra.run.smithi120.stdout: "crush-failure-domain": "osd", 2024-09-13T05:12:54.068 INFO:teuthology.orchestra.run.smithi120.stdout: "k": "2", 2024-09-13T05:12:54.068 INFO:teuthology.orchestra.run.smithi120.stdout: "m": "1", 2024-09-13T05:12:54.068 INFO:teuthology.orchestra.run.smithi120.stdout: "plugin": "jerasure", 2024-09-13T05:12:54.068 INFO:teuthology.orchestra.run.smithi120.stdout: "technique": "reed_sol_van" 2024-09-13T05:12:54.068 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.068 INFO:teuthology.orchestra.run.smithi120.stdout: "removed_snaps_queue": [ 2024-09-13T05:12:54.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.068 INFO:teuthology.orchestra.run.smithi120.stdout: "pool": 3, 2024-09-13T05:12:54.068 INFO:teuthology.orchestra.run.smithi120.stdout: "snaps": [ 2024-09-13T05:12:54.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.069 INFO:teuthology.orchestra.run.smithi120.stdout: "begin": 40, 2024-09-13T05:12:54.069 INFO:teuthology.orchestra.run.smithi120.stdout: "length": 2 2024-09-13T05:12:54.069 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.069 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.069 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.069 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:12:54.069 INFO:teuthology.orchestra.run.smithi120.stdout: "new_removed_snaps": [ 2024-09-13T05:12:54.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.069 INFO:teuthology.orchestra.run.smithi120.stdout: "pool": 3, 2024-09-13T05:12:54.069 INFO:teuthology.orchestra.run.smithi120.stdout: "snaps": [ 2024-09-13T05:12:54.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.069 INFO:teuthology.orchestra.run.smithi120.stdout: "begin": 40, 2024-09-13T05:12:54.070 INFO:teuthology.orchestra.run.smithi120.stdout: "length": 1 2024-09-13T05:12:54.070 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.070 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.070 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.070 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:12:54.070 INFO:teuthology.orchestra.run.smithi120.stdout: "new_purged_snaps": [ 2024-09-13T05:12:54.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.070 INFO:teuthology.orchestra.run.smithi120.stdout: "pool": 3, 2024-09-13T05:12:54.070 INFO:teuthology.orchestra.run.smithi120.stdout: "snaps": [ 2024-09-13T05:12:54.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.070 INFO:teuthology.orchestra.run.smithi120.stdout: "begin": 42, 2024-09-13T05:12:54.070 INFO:teuthology.orchestra.run.smithi120.stdout: "length": 7 2024-09-13T05:12:54.070 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.071 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.071 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.071 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:12:54.071 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_node_flags": {}, 2024-09-13T05:12:54.071 INFO:teuthology.orchestra.run.smithi120.stdout: "device_class_flags": {}, 2024-09-13T05:12:54.071 INFO:teuthology.orchestra.run.smithi120.stdout: "stretch_mode": { 2024-09-13T05:12:54.071 INFO:teuthology.orchestra.run.smithi120.stdout: "stretch_mode_enabled": false, 2024-09-13T05:12:54.071 INFO:teuthology.orchestra.run.smithi120.stdout: "stretch_bucket_count": 0, 2024-09-13T05:12:54.071 INFO:teuthology.orchestra.run.smithi120.stdout: "degraded_stretch_mode": 0, 2024-09-13T05:12:54.071 INFO:teuthology.orchestra.run.smithi120.stdout: "recovering_stretch_mode": 0, 2024-09-13T05:12:54.071 INFO:teuthology.orchestra.run.smithi120.stdout: "stretch_mode_bucket": 0 2024-09-13T05:12:54.071 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.071 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:54.074 INFO:tasks.thrashosds.thrasher:j is {'epoch': 159, 'fsid': '0a3759da-62bd-4704-8a4a-7c20eb3fc816', 'created': '2024-09-13T05:09:38.849186+0000', 'modified': '2024-09-13T05:12:53.627509+0000', 'last_up_change': '2024-09-13T05:12:13.640614+0000', 'last_in_change': '2024-09-13T05:12:36.834526+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T05:09:52.225455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9653034210205078, 'average_primary_affinity': 0.9700000286102295, 'average_primary_affinity_weighted': 0.9700000286102295}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T05:09:57.858552+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 3, 'score_stable': 3, 'optimal_score': 0.75, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9653034210205078, 'average_primary_affinity': 0.9700000286102295, 'average_primary_affinity_weighted': 0.9700000286102295}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-13T05:10:07.742110+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '159', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 57, 'snap_epoch': 159, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 0.75, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9653034210205078, 'average_primary_affinity': 0.9700000286102295, 'average_primary_affinity_weighted': 0.9700000286102295}}], 'osds': [{'osd': 0, 'uuid': 'b304ec03-bb00-4b13-bf2d-71017b8a70a3', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 105, 'up_from': 124, 'up_thru': 40, 'down_at': 106, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6800', 'nonce': 367697828}, {'type': 'v1', 'addr': '172.21.15.120:6801', 'nonce': 367697828}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6802', 'nonce': 367697828}, {'type': 'v1', 'addr': '172.21.15.120:6803', 'nonce': 367697828}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6806', 'nonce': 367697828}, {'type': 'v1', 'addr': '172.21.15.120:6807', 'nonce': 367697828}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6804', 'nonce': 367697828}, {'type': 'v1', 'addr': '172.21.15.120:6805', 'nonce': 367697828}]}, 'public_addr': '172.21.15.120:6801/367697828', 'cluster_addr': '172.21.15.120:6803/367697828', 'heartbeat_back_addr': '172.21.15.120:6807/367697828', 'heartbeat_front_addr': '172.21.15.120:6805/367697828', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'c09e84f3-3a70-46a4-b67b-c9bb52c887b7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 153, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6808', 'nonce': 1023532100}, {'type': 'v1', 'addr': '172.21.15.120:6809', 'nonce': 1023532100}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6810', 'nonce': 1023532100}, {'type': 'v1', 'addr': '172.21.15.120:6811', 'nonce': 1023532100}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6814', 'nonce': 1023532100}, {'type': 'v1', 'addr': '172.21.15.120:6815', 'nonce': 1023532100}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6812', 'nonce': 1023532100}, {'type': 'v1', 'addr': '172.21.15.120:6813', 'nonce': 1023532100}]}, 'public_addr': '172.21.15.120:6809/1023532100', 'cluster_addr': '172.21.15.120:6811/1023532100', 'heartbeat_back_addr': '172.21.15.120:6815/1023532100', 'heartbeat_front_addr': '172.21.15.120:6813/1023532100', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '3c2a0458-369c-4dac-90a3-fb20cb70d53f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 149, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6816', 'nonce': 592498012}, {'type': 'v1', 'addr': '172.21.15.120:6817', 'nonce': 592498012}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6818', 'nonce': 592498012}, {'type': 'v1', 'addr': '172.21.15.120:6819', 'nonce': 592498012}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6822', 'nonce': 592498012}, {'type': 'v1', 'addr': '172.21.15.120:6823', 'nonce': 592498012}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6820', 'nonce': 592498012}, {'type': 'v1', 'addr': '172.21.15.120:6821', 'nonce': 592498012}]}, 'public_addr': '172.21.15.120:6817/592498012', 'cluster_addr': '172.21.15.120:6819/592498012', 'heartbeat_back_addr': '172.21.15.120:6823/592498012', 'heartbeat_front_addr': '172.21.15.120:6821/592498012', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'edce3757-5e9d-4221-a1f1-3f356bb5218b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 149, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6824', 'nonce': 1939753938}, {'type': 'v1', 'addr': '172.21.15.120:6825', 'nonce': 1939753938}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6826', 'nonce': 1939753938}, {'type': 'v1', 'addr': '172.21.15.120:6827', 'nonce': 1939753938}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6830', 'nonce': 1939753938}, {'type': 'v1', 'addr': '172.21.15.120:6831', 'nonce': 1939753938}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6828', 'nonce': 1939753938}, {'type': 'v1', 'addr': '172.21.15.120:6829', 'nonce': 1939753938}]}, 'public_addr': '172.21.15.120:6825/1939753938', 'cluster_addr': '172.21.15.120:6827/1939753938', 'heartbeat_back_addr': '172.21.15.120:6831/1939753938', 'heartbeat_front_addr': '172.21.15.120:6829/1939753938', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '5fe378d2-578f-41ea-980a-4673a8b376df', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.894744873046875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 154, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6824', 'nonce': 3005075615}, {'type': 'v1', 'addr': '172.21.15.137:6825', 'nonce': 3005075615}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6826', 'nonce': 3005075615}, {'type': 'v1', 'addr': '172.21.15.137:6827', 'nonce': 3005075615}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6830', 'nonce': 3005075615}, {'type': 'v1', 'addr': '172.21.15.137:6831', 'nonce': 3005075615}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6828', 'nonce': 3005075615}, {'type': 'v1', 'addr': '172.21.15.137:6829', 'nonce': 3005075615}]}, 'public_addr': '172.21.15.137:6825/3005075615', 'cluster_addr': '172.21.15.137:6827/3005075615', 'heartbeat_back_addr': '172.21.15.137:6831/3005075615', 'heartbeat_front_addr': '172.21.15.137:6829/3005075615', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '6e6f7499-ae9e-4cb1-9db7-4d9f8fd9b257', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 148, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6800', 'nonce': 1108177522}, {'type': 'v1', 'addr': '172.21.15.137:6801', 'nonce': 1108177522}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6802', 'nonce': 1108177522}, {'type': 'v1', 'addr': '172.21.15.137:6803', 'nonce': 1108177522}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6806', 'nonce': 1108177522}, {'type': 'v1', 'addr': '172.21.15.137:6807', 'nonce': 1108177522}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6804', 'nonce': 1108177522}, {'type': 'v1', 'addr': '172.21.15.137:6805', 'nonce': 1108177522}]}, 'public_addr': '172.21.15.137:6801/1108177522', 'cluster_addr': '172.21.15.137:6803/1108177522', 'heartbeat_back_addr': '172.21.15.137:6807/1108177522', 'heartbeat_front_addr': '172.21.15.137:6805/1108177522', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e4c519e5-5df4-4d55-b12e-fbcfb1b0555c', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 0.8276824951171875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 118, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6816', 'nonce': 2667039053}, {'type': 'v1', 'addr': '172.21.15.137:6817', 'nonce': 2667039053}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6818', 'nonce': 2667039053}, {'type': 'v1', 'addr': '172.21.15.137:6819', 'nonce': 2667039053}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6822', 'nonce': 2667039053}, {'type': 'v1', 'addr': '172.21.15.137:6823', 'nonce': 2667039053}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6820', 'nonce': 2667039053}, {'type': 'v1', 'addr': '172.21.15.137:6821', 'nonce': 2667039053}]}, 'public_addr': '172.21.15.137:6817/2667039053', 'cluster_addr': '172.21.15.137:6819/2667039053', 'heartbeat_back_addr': '172.21.15.137:6823/2667039053', 'heartbeat_front_addr': '172.21.15.137:6821/2667039053', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '914648c2-7a6c-4e66-811d-936e250638db', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 153, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6808', 'nonce': 993764921}, {'type': 'v1', 'addr': '172.21.15.137:6809', 'nonce': 993764921}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6810', 'nonce': 993764921}, {'type': 'v1', 'addr': '172.21.15.137:6811', 'nonce': 993764921}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6814', 'nonce': 993764921}, {'type': 'v1', 'addr': '172.21.15.137:6815', 'nonce': 993764921}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6812', 'nonce': 993764921}, {'type': 'v1', 'addr': '172.21.15.137:6813', 'nonce': 993764921}]}, 'public_addr': '172.21.15.137:6809/993764921', 'cluster_addr': '172.21.15.137:6811/993764921', 'heartbeat_back_addr': '172.21.15.137:6815/993764921', 'heartbeat_front_addr': '172.21.15.137:6813/993764921', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T05:09:46.914820+0000', 'dead_epoch': 106}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.326286+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.147193+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.478655+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.388938+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.127175+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.187286+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:46.962119+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.a', 'osds': [3, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 40, 'length': 2}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 40, 'length': 1}]}], 'new_purged_snaps': [{'pool': 3, 'snaps': [{'begin': 42, 'length': 7}]}], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-13T05:12:54.074 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:12:54.075 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:54.075 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:54.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:54.076 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:54.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.076 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:159451 3.1b e117/116 3:d9c87acb:::rbd_data.112dc3abcba6.0000000000000003:head v 117'567, mlcod=0'0)", 2024-09-13T05:12:54.076 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:12:54.076 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.073213656, 2024-09-13T05:12:54.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064897325000000006, 2024-09-13T05:12:54.076 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.076 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:54.076 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:12:54.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:12:54.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938207+0000", 2024-09-13T05:12:54.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:54.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972794+0000", 2024-09-13T05:12:54.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.034587013 2024-09-13T05:12:54.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972821+0000", 2024-09-13T05:12:54.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6764e-05 2024-09-13T05:12:54.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972841+0000", 2024-09-13T05:12:54.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0191999999999999e-05 2024-09-13T05:12:54.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972905+0000", 2024-09-13T05:12:54.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4319000000000005e-05 2024-09-13T05:12:54.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972927+0000", 2024-09-13T05:12:54.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1135999999999999e-05 2024-09-13T05:12:54.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:12:54.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.002964+0000", 2024-09-13T05:12:54.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.030037123999999998 2024-09-13T05:12:54.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.003105+0000", 2024-09-13T05:12:54.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141614 2024-09-13T05:12:54.080 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.080 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.080 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.080 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159495 3.0 3:022f4da1:::rbd_data.112dfd94ee88.00000000000000e4:2a [read 167936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:54.080 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:12:54.080 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 46.998074234999997, 2024-09-13T05:12:54.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91926946899999995, 2024-09-13T05:12:54.081 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.081 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.081 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.081 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.081 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.081 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159495 2024-09-13T05:12:54.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.081 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:12:54.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:12:54.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013345+0000", 2024-09-13T05:12:54.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999971 2024-09-13T05:12:54.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013359+0000", 2024-09-13T05:12:54.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4752999999999999e-05 2024-09-13T05:12:54.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013418+0000", 2024-09-13T05:12:54.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8959000000000003e-05 2024-09-13T05:12:54.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013439+0000", 2024-09-13T05:12:54.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0749000000000001e-05 2024-09-13T05:12:54.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013563+0000", 2024-09-13T05:12:54.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012349400000000001 2024-09-13T05:12:54.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:54.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013583+0000", 2024-09-13T05:12:54.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0007e-05 2024-09-13T05:12:54.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932400+0000", 2024-09-13T05:12:54.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91881732400000005 2024-09-13T05:12:54.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932533+0000", 2024-09-13T05:12:54.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013263700000000001 2024-09-13T05:12:54.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932617+0000", 2024-09-13T05:12:54.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4313000000000004e-05 2024-09-13T05:12:54.085 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.085 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.085 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.086 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159517 3.0 3:03975f1c:::rbd_data.112dfd94ee88.0000000000000156:2a [read 167936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:54.086 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:12:54.086 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 46.997810520999998, 2024-09-13T05:12:54.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91962025700000005, 2024-09-13T05:12:54.086 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.086 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.086 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.086 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.086 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.086 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159517 2024-09-13T05:12:54.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.086 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:12:54.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:12:54.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013609+0000", 2024-09-13T05:12:54.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:54.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013619+0000", 2024-09-13T05:12:54.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0077e-05 2024-09-13T05:12:54.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013638+0000", 2024-09-13T05:12:54.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8739000000000001e-05 2024-09-13T05:12:54.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013653+0000", 2024-09-13T05:12:54.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5446000000000001e-05 2024-09-13T05:12:54.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016506+0000", 2024-09-13T05:12:54.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028525619999999999 2024-09-13T05:12:54.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:54.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016521+0000", 2024-09-13T05:12:54.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5310000000000001e-05 2024-09-13T05:12:54.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932964+0000", 2024-09-13T05:12:54.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91644284099999995 2024-09-13T05:12:54.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933097+0000", 2024-09-13T05:12:54.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013337599999999999 2024-09-13T05:12:54.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933231+0000", 2024-09-13T05:12:54.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133996 2024-09-13T05:12:54.091 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.091 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.091 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.091 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159622 3.0 3:03f7a45a:::rbd_data.112dfd94ee88.0000000000000318:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:54.091 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:12:54.091 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 46.99614871, 2024-09-13T05:12:54.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.918245003, 2024-09-13T05:12:54.091 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.091 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.091 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159622 2024-09-13T05:12:54.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.092 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:12:54.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:12:54.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015266+0000", 2024-09-13T05:12:54.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999928 2024-09-13T05:12:54.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015283+0000", 2024-09-13T05:12:54.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7309999999999999e-05 2024-09-13T05:12:54.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015318+0000", 2024-09-13T05:12:54.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5119e-05 2024-09-13T05:12:54.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015338+0000", 2024-09-13T05:12:54.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9259e-05 2024-09-13T05:12:54.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016558+0000", 2024-09-13T05:12:54.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012199909999999999 2024-09-13T05:12:54.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:54.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016567+0000", 2024-09-13T05:12:54.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2459999999999992e-06 2024-09-13T05:12:54.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933266+0000", 2024-09-13T05:12:54.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91669950300000003 2024-09-13T05:12:54.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:12:54.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015788099999999999 2024-09-13T05:12:54.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933518+0000", 2024-09-13T05:12:54.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3721000000000006e-05 2024-09-13T05:12:54.096 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.096 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.096 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.096 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173445 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 150528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:54.096 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:12:54.096 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.831571924999999, 2024-09-13T05:12:54.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064560905000000002, 2024-09-13T05:12:54.097 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.097 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.097 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173445 2024-09-13T05:12:54.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.097 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:12:54.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:12:54.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179849+0000", 2024-09-13T05:12:54.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:54.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179860+0000", 2024-09-13T05:12:54.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0419e-05 2024-09-13T05:12:54.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179866+0000", 2024-09-13T05:12:54.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.567e-06 2024-09-13T05:12:54.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179872+0000", 2024-09-13T05:12:54.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1830000000000002e-06 2024-09-13T05:12:54.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244262+0000", 2024-09-13T05:12:54.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064390814000000005 2024-09-13T05:12:54.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244321+0000", 2024-09-13T05:12:54.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8341000000000003e-05 2024-09-13T05:12:54.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244411+0000", 2024-09-13T05:12:54.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9911e-05 2024-09-13T05:12:54.100 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.100 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.100 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.101 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173446 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 157696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:54.101 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:12:54.101 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.831545158000001, 2024-09-13T05:12:54.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064714007000000004, 2024-09-13T05:12:54.101 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.101 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.101 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.101 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.101 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.101 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173446 2024-09-13T05:12:54.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.101 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:12:54.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:12:54.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179876+0000", 2024-09-13T05:12:54.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:54.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179879+0000", 2024-09-13T05:12:54.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1489999999999998e-06 2024-09-13T05:12:54.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179884+0000", 2024-09-13T05:12:54.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2800000000000003e-06 2024-09-13T05:12:54.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179889+0000", 2024-09-13T05:12:54.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7620000000000003e-06 2024-09-13T05:12:54.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244452+0000", 2024-09-13T05:12:54.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064562943999999997 2024-09-13T05:12:54.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244512+0000", 2024-09-13T05:12:54.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9879e-05 2024-09-13T05:12:54.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244591+0000", 2024-09-13T05:12:54.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8701000000000004e-05 2024-09-13T05:12:54.105 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.105 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.105 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.105 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173447 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 164864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:54.105 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:12:54.105 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.831528410000001, 2024-09-13T05:12:54.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064866246000000002, 2024-09-13T05:12:54.105 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.105 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.105 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.105 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.106 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.106 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173447 2024-09-13T05:12:54.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.106 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:12:54.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:12:54.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:12:54.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:54.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179895+0000", 2024-09-13T05:12:54.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6910000000000002e-06 2024-09-13T05:12:54.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179901+0000", 2024-09-13T05:12:54.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5149999999999997e-06 2024-09-13T05:12:54.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179905+0000", 2024-09-13T05:12:54.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4170000000000002e-06 2024-09-13T05:12:54.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244615+0000", 2024-09-13T05:12:54.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064709533999999999 2024-09-13T05:12:54.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244665+0000", 2024-09-13T05:12:54.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0283e-05 2024-09-13T05:12:54.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244760+0000", 2024-09-13T05:12:54.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4310999999999999e-05 2024-09-13T05:12:54.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.109 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.109 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173448 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 172032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:54.109 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:12:54.109 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.831512564000001, 2024-09-13T05:12:54.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065022046999999999, 2024-09-13T05:12:54.110 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.110 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.110 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173448 2024-09-13T05:12:54.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.110 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:12:54.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:12:54.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:12:54.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:54.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179914+0000", 2024-09-13T05:12:54.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6699999999999999e-06 2024-09-13T05:12:54.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179921+0000", 2024-09-13T05:12:54.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:12:54.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179926+0000", 2024-09-13T05:12:54.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8659999999999997e-06 2024-09-13T05:12:54.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244782+0000", 2024-09-13T05:12:54.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064856570000000002 2024-09-13T05:12:54.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244857+0000", 2024-09-13T05:12:54.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4326999999999995e-05 2024-09-13T05:12:54.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244931+0000", 2024-09-13T05:12:54.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4443999999999994e-05 2024-09-13T05:12:54.113 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.113 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.113 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.114 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173450 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 179200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:54.114 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:12:54.114 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.83149173, 2024-09-13T05:12:54.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065192589999999995, 2024-09-13T05:12:54.114 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.114 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.114 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173450 2024-09-13T05:12:54.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.114 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:12:54.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:12:54.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:12:54.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:54.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179932+0000", 2024-09-13T05:12:54.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2529999999999999e-06 2024-09-13T05:12:54.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179937+0000", 2024-09-13T05:12:54.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4219999999999999e-06 2024-09-13T05:12:54.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179942+0000", 2024-09-13T05:12:54.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3250000000000001e-06 2024-09-13T05:12:54.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244969+0000", 2024-09-13T05:12:54.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065027794999999999 2024-09-13T05:12:54.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245048+0000", 2024-09-13T05:12:54.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8812000000000004e-05 2024-09-13T05:12:54.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245123+0000", 2024-09-13T05:12:54.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4342000000000001e-05 2024-09-13T05:12:54.118 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.118 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.118 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.118 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173451 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:54.119 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:12:54.119 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.831475742999999, 2024-09-13T05:12:54.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359814000000002, 2024-09-13T05:12:54.119 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.119 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.119 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.119 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.119 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.119 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173451 2024-09-13T05:12:54.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.119 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:12:54.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:12:54.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:12:54.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:54.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179948+0000", 2024-09-13T05:12:54.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5119999999999998e-06 2024-09-13T05:12:54.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179954+0000", 2024-09-13T05:12:54.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5840000000000002e-06 2024-09-13T05:12:54.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179958+0000", 2024-09-13T05:12:54.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.566e-06 2024-09-13T05:12:54.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245160+0000", 2024-09-13T05:12:54.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065202057999999993 2024-09-13T05:12:54.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245228+0000", 2024-09-13T05:12:54.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7257999999999999e-05 2024-09-13T05:12:54.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245306+0000", 2024-09-13T05:12:54.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8227999999999997e-05 2024-09-13T05:12:54.122 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.122 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.123 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.123 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173452 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 193536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:54.123 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:12:54.123 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.831459255999999, 2024-09-13T05:12:54.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065505701, 2024-09-13T05:12:54.123 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.123 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.123 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.123 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.123 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.123 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173452 2024-09-13T05:12:54.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.124 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:12:54.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:12:54.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:12:54.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:54.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179965+0000", 2024-09-13T05:12:54.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.402e-06 2024-09-13T05:12:54.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179970+0000", 2024-09-13T05:12:54.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2290000000000002e-06 2024-09-13T05:12:54.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179974+0000", 2024-09-13T05:12:54.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5070000000000002e-06 2024-09-13T05:12:54.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245329+0000", 2024-09-13T05:12:54.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065354906000000004 2024-09-13T05:12:54.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245390+0000", 2024-09-13T05:12:54.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0878999999999998e-05 2024-09-13T05:12:54.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245468+0000", 2024-09-13T05:12:54.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8073999999999998e-05 2024-09-13T05:12:54.127 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.127 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.127 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.127 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173453 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 198656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:54.128 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:12:54.128 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.831442989999999, 2024-09-13T05:12:54.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065664343, 2024-09-13T05:12:54.128 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.128 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.128 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.128 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.128 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.128 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173453 2024-09-13T05:12:54.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.128 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:12:54.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:12:54.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179978+0000", 2024-09-13T05:12:54.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:54.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179981+0000", 2024-09-13T05:12:54.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4140000000000001e-06 2024-09-13T05:12:54.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179986+0000", 2024-09-13T05:12:54.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3519999999999997e-06 2024-09-13T05:12:54.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179991+0000", 2024-09-13T05:12:54.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6739999999999996e-06 2024-09-13T05:12:54.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245495+0000", 2024-09-13T05:12:54.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065504229999999997 2024-09-13T05:12:54.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245563+0000", 2024-09-13T05:12:54.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8119000000000003e-05 2024-09-13T05:12:54.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245643+0000", 2024-09-13T05:12:54.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9861e-05 2024-09-13T05:12:54.132 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.132 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.132 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.132 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173454 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:54.132 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:12:54.132 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.831394603, 2024-09-13T05:12:54.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065750457999999998, 2024-09-13T05:12:54.132 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.132 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.133 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.133 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.133 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.133 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173454 2024-09-13T05:12:54.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.133 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:12:54.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:12:54.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180026+0000", 2024-09-13T05:12:54.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:54.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180030+0000", 2024-09-13T05:12:54.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3790000000000002e-06 2024-09-13T05:12:54.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180036+0000", 2024-09-13T05:12:54.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5889999999999999e-06 2024-09-13T05:12:54.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180041+0000", 2024-09-13T05:12:54.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9980000000000003e-06 2024-09-13T05:12:54.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245667+0000", 2024-09-13T05:12:54.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065625124000000007 2024-09-13T05:12:54.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245705+0000", 2024-09-13T05:12:54.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7994000000000002e-05 2024-09-13T05:12:54.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245778+0000", 2024-09-13T05:12:54.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2999999999999999e-05 2024-09-13T05:12:54.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.137 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.137 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173455 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 212992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:54.137 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:12:54.137 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.831375895000001, 2024-09-13T05:12:54.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065899773999999994, 2024-09-13T05:12:54.137 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.137 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.137 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.137 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.137 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.138 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173455 2024-09-13T05:12:54.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.138 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:12:54.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:12:54.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180045+0000", 2024-09-13T05:12:54.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:54.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180048+0000", 2024-09-13T05:12:54.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5830000000000001e-06 2024-09-13T05:12:54.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180054+0000", 2024-09-13T05:12:54.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.789e-06 2024-09-13T05:12:54.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180059+0000", 2024-09-13T05:12:54.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.933e-06 2024-09-13T05:12:54.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245801+0000", 2024-09-13T05:12:54.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065742520999999998 2024-09-13T05:12:54.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245865+0000", 2024-09-13T05:12:54.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3325999999999996e-05 2024-09-13T05:12:54.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245946+0000", 2024-09-13T05:12:54.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0964999999999995e-05 2024-09-13T05:12:54.141 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.141 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.141 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.142 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173456 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:54.142 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:12:54.142 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.831358664, 2024-09-13T05:12:54.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066035128999999998, 2024-09-13T05:12:54.142 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.142 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.142 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.142 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.142 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.142 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173456 2024-09-13T05:12:54.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.142 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:12:54.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:12:54.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:12:54.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:54.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180065+0000", 2024-09-13T05:12:54.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4250000000000001e-06 2024-09-13T05:12:54.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180070+0000", 2024-09-13T05:12:54.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1749999999999996e-06 2024-09-13T05:12:54.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180075+0000", 2024-09-13T05:12:54.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4769999999999997e-06 2024-09-13T05:12:54.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245969+0000", 2024-09-13T05:12:54.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065894182999999995 2024-09-13T05:12:54.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246027+0000", 2024-09-13T05:12:54.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8165999999999998e-05 2024-09-13T05:12:54.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246098+0000", 2024-09-13T05:12:54.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1068999999999993e-05 2024-09-13T05:12:54.146 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.146 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.146 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.146 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173458 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:54.146 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:12:54.146 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.831342680999999, 2024-09-13T05:12:54.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066134732000000002, 2024-09-13T05:12:54.146 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.146 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.146 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.146 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.147 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.147 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173458 2024-09-13T05:12:54.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.147 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:12:54.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:12:54.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:12:54.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:54.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180081+0000", 2024-09-13T05:12:54.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4150000000000002e-06 2024-09-13T05:12:54.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180087+0000", 2024-09-13T05:12:54.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5389999999999998e-06 2024-09-13T05:12:54.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180101+0000", 2024-09-13T05:12:54.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4537e-05 2024-09-13T05:12:54.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246119+0000", 2024-09-13T05:12:54.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066017701999999998 2024-09-13T05:12:54.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246155+0000", 2024-09-13T05:12:54.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6094999999999999e-05 2024-09-13T05:12:54.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246214+0000", 2024-09-13T05:12:54.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8789000000000002e-05 2024-09-13T05:12:54.150 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.150 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.150 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.150 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173459 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 234496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:54.150 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:12:54.150 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.831315157999999, 2024-09-13T05:12:54.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066227460000000002, 2024-09-13T05:12:54.151 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.151 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.151 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.151 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.151 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.151 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173459 2024-09-13T05:12:54.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.151 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:12:54.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:12:54.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180106+0000", 2024-09-13T05:12:54.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:54.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180109+0000", 2024-09-13T05:12:54.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2219999999999998e-06 2024-09-13T05:12:54.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180115+0000", 2024-09-13T05:12:54.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9190000000000004e-06 2024-09-13T05:12:54.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180120+0000", 2024-09-13T05:12:54.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8930000000000004e-06 2024-09-13T05:12:54.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246236+0000", 2024-09-13T05:12:54.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066115638000000004 2024-09-13T05:12:54.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246273+0000", 2024-09-13T05:12:54.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7083999999999999e-05 2024-09-13T05:12:54.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246334+0000", 2024-09-13T05:12:54.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1183e-05 2024-09-13T05:12:54.155 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.155 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.155 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.155 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173460 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 241664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:54.155 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:12:54.155 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.831297352, 2024-09-13T05:12:54.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066360459999999996, 2024-09-13T05:12:54.155 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.155 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.155 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.155 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.155 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.156 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173460 2024-09-13T05:12:54.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.156 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:12:54.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:12:54.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:12:54.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:54.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180126+0000", 2024-09-13T05:12:54.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3120000000000001e-06 2024-09-13T05:12:54.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180132+0000", 2024-09-13T05:12:54.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.105e-06 2024-09-13T05:12:54.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180137+0000", 2024-09-13T05:12:54.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6829999999999999e-06 2024-09-13T05:12:54.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246365+0000", 2024-09-13T05:12:54.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066227584000000006 2024-09-13T05:12:54.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246413+0000", 2024-09-13T05:12:54.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8479000000000001e-05 2024-09-13T05:12:54.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246485+0000", 2024-09-13T05:12:54.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1600000000000006e-05 2024-09-13T05:12:54.159 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.159 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.159 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.159 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173461 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:54.159 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:12:54.159 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.831278583, 2024-09-13T05:12:54.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066492449999999995, 2024-09-13T05:12:54.159 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.160 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.160 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.160 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.160 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.160 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173461 2024-09-13T05:12:54.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.160 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:12:54.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:12:54.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:12:54.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:54.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180149+0000", 2024-09-13T05:12:54.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7239999999999997e-06 2024-09-13T05:12:54.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180153+0000", 2024-09-13T05:12:54.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7859999999999996e-06 2024-09-13T05:12:54.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180158+0000", 2024-09-13T05:12:54.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0300000000000001e-06 2024-09-13T05:12:54.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246508+0000", 2024-09-13T05:12:54.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066350100999999995 2024-09-13T05:12:54.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246568+0000", 2024-09-13T05:12:54.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9500000000000003e-05 2024-09-13T05:12:54.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246636+0000", 2024-09-13T05:12:54.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7633999999999997e-05 2024-09-13T05:12:54.163 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.163 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.164 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.164 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173462 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 256000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:54.164 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:12:54.164 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.830445755, 2024-09-13T05:12:54.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065773376999999994, 2024-09-13T05:12:54.164 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.164 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.164 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.164 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.164 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.164 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173462 2024-09-13T05:12:54.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.165 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:12:54.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:12:54.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180162+0000", 2024-09-13T05:12:54.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9991865 2024-09-13T05:12:54.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180984+0000", 2024-09-13T05:12:54.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00082184599999999999 2024-09-13T05:12:54.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180994+0000", 2024-09-13T05:12:54.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9000000000000001e-06 2024-09-13T05:12:54.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.181001+0000", 2024-09-13T05:12:54.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.917e-06 2024-09-13T05:12:54.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246653+0000", 2024-09-13T05:12:54.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065651820999999999 2024-09-13T05:12:54.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246698+0000", 2024-09-13T05:12:54.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.473e-05 2024-09-13T05:12:54.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246749+0000", 2024-09-13T05:12:54.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1758999999999997e-05 2024-09-13T05:12:54.168 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.168 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.168 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.168 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.168 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.168 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:54.169 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:12:54.173 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:54.067+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:54.174 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:54.171+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:54.274 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:54.271+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:54.283 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:54.283 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:54.283 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:54.283 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:54.293 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:12:54.375 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:54.371+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:54.392 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:54.393 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:54.393 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:54.393 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:54.393 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:54.401 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:12:54.476 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:54.471+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:54.483 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:12:54.486 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:12:54.499 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2024-09-13T05:12:54.212409+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1270090149,"num_objects":3425,"num_object_clones":436,"num_object_copies":6850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3425,"num_whiteouts":1987,"num_read":247767,"num_read_kb":622733,"num_write":26351,"num_write_kb":534599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8106,"num_bytes_recovered":272699257,"num_keys_recovered":882,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23871,"ondisk_log_size":23871,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":734448,"kb_used_data":356464,"kb_used_omap":9,"kb_used_meta":377718,"kb_avail":565496592,"statfs":{"total":579820584960,"available":579068510208,"internally_reserved":0,"allocated":365019136,"data_stored":400443423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9557,"internal_metadata":386783915},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-96536905,"num_objects":-331,"num_object_clones":-101,"num_object_copies":-662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-120,"num_objects_unfound":0,"num_objects_dirty":-331,"num_whiteouts":-101,"num_read":1091,"num_read_kb":929,"num_write":256,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":373,"num_bytes_recovered":12388264,"num_keys_recovered":34,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001318"},"pg_stats":[{"pgid":"3.1f","version":"157'597","reported_seq":3430,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.805921+0000","last_change":"2024-09-13T05:12:51.719297+0000","last_active":"2024-09-13T05:12:51.805921+0000","last_peered":"2024-09-13T05:12:51.805921+0000","last_clean":"2024-09-13T05:12:51.805921+0000","last_became_active":"2024-09-13T05:10:37.864778+0000","last_became_peered":"2024-09-13T05:10:37.864778+0000","last_unstale":"2024-09-13T05:12:51.805921+0000","last_undegraded":"2024-09-13T05:12:51.805921+0000","last_fullsized":"2024-09-13T05:12:51.805921+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:56:24.801492+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.015676912000000001,"stat_sum":{"num_bytes":7597312,"num_objects":97,"num_object_clones":9,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":49,"num_read":3887,"num_read_kb":8569,"num_write":636,"num_write_kb":5970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":297202,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"3.1e","version":"157'560","reported_seq":10046,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.828302+0000","last_change":"2024-09-13T05:12:51.713667+0000","last_active":"2024-09-13T05:12:51.828302+0000","last_peered":"2024-09-13T05:12:51.828302+0000","last_clean":"2024-09-13T05:12:51.828302+0000","last_became_active":"2024-09-13T05:12:23.730740+0000","last_became_peered":"2024-09-13T05:12:23.730740+0000","last_unstale":"2024-09-13T05:12:51.828302+0000","last_undegraded":"2024-09-13T05:12:51.828302+0000","last_fullsized":"2024-09-13T05:12:51.828302+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:05:34.025751+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.03030093,"stat_sum":{"num_bytes":29359459,"num_objects":96,"num_object_clones":10,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":60,"num_read":10286,"num_read_kb":9252,"num_write":464,"num_write_kb":4488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":2534879,"num_keys_recovered":23,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"3.1d","version":"157'711","reported_seq":4123,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.877917+0000","last_change":"2024-09-13T05:12:51.716072+0000","last_active":"2024-09-13T05:12:51.877917+0000","last_peered":"2024-09-13T05:12:51.877917+0000","last_clean":"2024-09-13T05:12:51.877917+0000","last_became_active":"2024-09-13T05:12:40.908241+0000","last_became_peered":"2024-09-13T05:12:40.908241+0000","last_unstale":"2024-09-13T05:12:51.877917+0000","last_undegraded":"2024-09-13T05:12:51.877917+0000","last_fullsized":"2024-09-13T05:12:51.877917+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:22:11.929867+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.012627584000000001,"stat_sum":{"num_bytes":34424238,"num_objects":111,"num_object_clones":13,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":61,"num_read":4334,"num_read_kb":14221,"num_write":740,"num_write_kb":18470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":387,"num_bytes_recovered":7610600,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"3.1c","version":"157'839","reported_seq":5935,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.883424+0000","last_change":"2024-09-13T05:12:51.709241+0000","last_active":"2024-09-13T05:12:51.883424+0000","last_peered":"2024-09-13T05:12:51.883424+0000","last_clean":"2024-09-13T05:12:51.883424+0000","last_became_active":"2024-09-13T05:12:43.633794+0000","last_became_peered":"2024-09-13T05:12:43.633794+0000","last_unstale":"2024-09-13T05:12:51.883424+0000","last_undegraded":"2024-09-13T05:12:51.883424+0000","last_fullsized":"2024-09-13T05:12:51.883424+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:26:39.019760+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0062246790000000003,"stat_sum":{"num_bytes":48031275,"num_objects":97,"num_object_clones":14,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":53,"num_read":6619,"num_read_kb":23473,"num_write":954,"num_write_kb":15856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":371,"num_bytes_recovered":9523896,"num_keys_recovered":208,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"3.1b","version":"157'767","reported_seq":4171,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.836915+0000","last_change":"2024-09-13T05:12:51.698201+0000","last_active":"2024-09-13T05:12:51.836915+0000","last_peered":"2024-09-13T05:12:51.836915+0000","last_clean":"2024-09-13T05:12:51.836915+0000","last_became_active":"2024-09-13T05:12:49.645215+0000","last_became_peered":"2024-09-13T05:12:49.645215+0000","last_unstale":"2024-09-13T05:12:51.836915+0000","last_undegraded":"2024-09-13T05:12:51.836915+0000","last_fullsized":"2024-09-13T05:12:51.836915+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:23:07.604094+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.020072684,"stat_sum":{"num_bytes":51872512,"num_objects":112,"num_object_clones":11,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":67,"num_read":4847,"num_read_kb":16096,"num_write":884,"num_write_kb":43420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":413,"num_bytes_recovered":12868860,"num_keys_recovered":46,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"3.1a","version":"157'1859","reported_seq":20335,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.909587+0000","last_change":"2024-09-13T05:12:51.691793+0000","last_active":"2024-09-13T05:12:51.909587+0000","last_peered":"2024-09-13T05:12:51.909587+0000","last_clean":"2024-09-13T05:12:51.909587+0000","last_became_active":"2024-09-13T05:12:46.652272+0000","last_became_peered":"2024-09-13T05:12:46.652272+0000","last_unstale":"2024-09-13T05:12:51.909587+0000","last_undegraded":"2024-09-13T05:12:51.909587+0000","last_fullsized":"2024-09-13T05:12:51.909587+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1859,"log_dups_size":0,"ondisk_log_size":1859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:54.915675+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.01466349,"stat_sum":{"num_bytes":57271175,"num_objects":124,"num_object_clones":16,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":62,"num_read":26567,"num_read_kb":29553,"num_write":2972,"num_write_kb":13180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":478,"num_bytes_recovered":9711059,"num_keys_recovered":48,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"3.19","version":"157'821","reported_seq":12234,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.762638+0000","last_change":"2024-09-13T05:12:51.690939+0000","last_active":"2024-09-13T05:12:51.762638+0000","last_peered":"2024-09-13T05:12:51.762638+0000","last_clean":"2024-09-13T05:12:51.762638+0000","last_became_active":"2024-09-13T05:12:09.626312+0000","last_became_peered":"2024-09-13T05:12:09.626312+0000","last_unstale":"2024-09-13T05:12:51.762638+0000","last_undegraded":"2024-09-13T05:12:51.762638+0000","last_fullsized":"2024-09-13T05:12:51.762638+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:47.900796+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0063952499999999999,"stat_sum":{"num_bytes":69928595,"num_objects":118,"num_object_clones":17,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":66,"num_read":13840,"num_read_kb":22821,"num_write":945,"num_write_kb":7451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":3365202,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"3.18","version":"157'624","reported_seq":5213,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.814654+0000","last_change":"2024-09-13T05:12:51.694292+0000","last_active":"2024-09-13T05:12:51.814654+0000","last_peered":"2024-09-13T05:12:51.814654+0000","last_clean":"2024-09-13T05:12:51.814654+0000","last_became_active":"2024-09-13T05:12:11.641696+0000","last_became_peered":"2024-09-13T05:12:11.641696+0000","last_unstale":"2024-09-13T05:12:51.814654+0000","last_undegraded":"2024-09-13T05:12:51.814654+0000","last_fullsized":"2024-09-13T05:12:51.814654+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:05:41.070434+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.012843111000000001,"stat_sum":{"num_bytes":54855431,"num_objects":118,"num_object_clones":18,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":69,"num_read":4816,"num_read_kb":27010,"num_write":630,"num_write_kb":24610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":11847558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"3.17","version":"157'614","reported_seq":3901,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.828277+0000","last_change":"2024-09-13T05:12:51.718913+0000","last_active":"2024-09-13T05:12:51.828277+0000","last_peered":"2024-09-13T05:12:51.828277+0000","last_clean":"2024-09-13T05:12:51.828277+0000","last_became_active":"2024-09-13T05:10:37.864816+0000","last_became_peered":"2024-09-13T05:10:37.864816+0000","last_unstale":"2024-09-13T05:12:51.828277+0000","last_undegraded":"2024-09-13T05:12:51.828277+0000","last_fullsized":"2024-09-13T05:12:51.828277+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":614,"log_dups_size":0,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:06.315864+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.015412835999999999,"stat_sum":{"num_bytes":10661432,"num_objects":100,"num_object_clones":8,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":65,"num_read":5810,"num_read_kb":10941,"num_write":494,"num_write_kb":4122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":37802,"num_keys_recovered":23,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"3.16","version":"157'482","reported_seq":9281,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.817917+0000","last_change":"2024-09-13T05:12:51.721148+0000","last_active":"2024-09-13T05:12:51.817917+0000","last_peered":"2024-09-13T05:12:51.817917+0000","last_clean":"2024-09-13T05:12:51.817917+0000","last_became_active":"2024-09-13T05:11:24.631079+0000","last_became_peered":"2024-09-13T05:11:24.631079+0000","last_unstale":"2024-09-13T05:12:51.817917+0000","last_undegraded":"2024-09-13T05:12:51.817917+0000","last_fullsized":"2024-09-13T05:12:51.817917+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:29.182802+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.017522249,"stat_sum":{"num_bytes":58282749,"num_objects":96,"num_object_clones":20,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":57,"num_read":9083,"num_read_kb":15558,"num_write":392,"num_write_kb":4473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":4743569,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"3.15","version":"157'581","reported_seq":13219,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.821764+0000","last_change":"2024-09-13T05:12:51.696261+0000","last_active":"2024-09-13T05:12:51.821764+0000","last_peered":"2024-09-13T05:12:51.821764+0000","last_clean":"2024-09-13T05:12:51.821764+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:12:51.821764+0000","last_undegraded":"2024-09-13T05:12:51.821764+0000","last_fullsized":"2024-09-13T05:12:51.821764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:40.457636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066590240000000004,"stat_sum":{"num_bytes":16761763,"num_objects":105,"num_object_clones":16,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":65,"num_read":13609,"num_read_kb":13872,"num_write":556,"num_write_kb":23548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"3.14","version":"157'537","reported_seq":8068,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.688892+0000","last_change":"2024-09-13T05:12:51.689251+0000","last_active":"2024-09-13T05:12:51.688892+0000","last_peered":"2024-09-13T05:12:51.688892+0000","last_clean":"2024-09-13T05:12:51.688892+0000","last_became_active":"2024-09-13T05:12:45.651071+0000","last_became_peered":"2024-09-13T05:12:45.651071+0000","last_unstale":"2024-09-13T05:12:51.688892+0000","last_undegraded":"2024-09-13T05:12:51.688892+0000","last_fullsized":"2024-09-13T05:12:51.688892+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:25.056987+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.011758930000000001,"stat_sum":{"num_bytes":48700189,"num_objects":102,"num_object_clones":16,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":61,"num_read":7282,"num_read_kb":29052,"num_write":445,"num_write_kb":7007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":364,"num_bytes_recovered":7851183,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-13T05:12:50.677073+0000","last_change":"2024-09-13T05:12:19.694070+0000","last_active":"2024-09-13T05:12:50.677073+0000","last_peered":"2024-09-13T05:12:50.677073+0000","last_clean":"2024-09-13T05:12:50.677073+0000","last_became_active":"2024-09-13T05:12:19.693769+0000","last_became_peered":"2024-09-13T05:12:19.693769+0000","last_unstale":"2024-09-13T05:12:50.677073+0000","last_undegraded":"2024-09-13T05:12:50.677073+0000","last_fullsized":"2024-09-13T05:12:50.677073+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:47:36.726484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"157'568","reported_seq":8445,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.905949+0000","last_change":"2024-09-13T05:12:51.698411+0000","last_active":"2024-09-13T05:12:51.905949+0000","last_peered":"2024-09-13T05:12:51.905949+0000","last_clean":"2024-09-13T05:12:51.905949+0000","last_became_active":"2024-09-13T05:12:43.636700+0000","last_became_peered":"2024-09-13T05:12:43.636700+0000","last_unstale":"2024-09-13T05:12:51.905949+0000","last_undegraded":"2024-09-13T05:12:51.905949+0000","last_fullsized":"2024-09-13T05:12:51.905949+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:42:50.465437+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.012138886999999999,"stat_sum":{"num_bytes":33731097,"num_objects":103,"num_object_clones":13,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":57,"num_read":7815,"num_read_kb":17828,"num_write":522,"num_write_kb":8585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":531,"num_bytes_recovered":23835437,"num_keys_recovered":90,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"2.6","version":"0'0","reported_seq":69,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-13T05:12:50.668051+0000","last_change":"2024-09-13T05:12:37.863607+0000","last_active":"2024-09-13T05:12:50.668051+0000","last_peered":"2024-09-13T05:12:50.668051+0000","last_clean":"2024-09-13T05:12:50.668051+0000","last_became_active":"2024-09-13T05:12:37.863309+0000","last_became_peered":"2024-09-13T05:12:37.863309+0000","last_unstale":"2024-09-13T05:12:50.668051+0000","last_undegraded":"2024-09-13T05:12:50.668051+0000","last_fullsized":"2024-09-13T05:12:50.668051+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:28:14.261640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"157'537","reported_seq":5730,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.824659+0000","last_change":"2024-09-13T05:12:51.713685+0000","last_active":"2024-09-13T05:12:51.824659+0000","last_peered":"2024-09-13T05:12:51.824659+0000","last_clean":"2024-09-13T05:12:51.824659+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:12:51.824659+0000","last_undegraded":"2024-09-13T05:12:51.824659+0000","last_fullsized":"2024-09-13T05:12:51.824659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:37.976147+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.030443891000000001,"stat_sum":{"num_bytes":56656559,"num_objects":103,"num_object_clones":10,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":62,"num_read":5344,"num_read_kb":14781,"num_write":421,"num_write_kb":5129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"2.5","version":"0'0","reported_seq":178,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-13T05:12:50.676753+0000","last_change":"2024-09-13T05:12:37.863288+0000","last_active":"2024-09-13T05:12:50.676753+0000","last_peered":"2024-09-13T05:12:50.676753+0000","last_clean":"2024-09-13T05:12:50.676753+0000","last_became_active":"2024-09-13T05:12:37.862910+0000","last_became_peered":"2024-09-13T05:12:37.862910+0000","last_unstale":"2024-09-13T05:12:50.676753+0000","last_undegraded":"2024-09-13T05:12:50.676753+0000","last_fullsized":"2024-09-13T05:12:50.676753+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:28:53.795278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"157'652","reported_seq":1588,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.827273+0000","last_change":"2024-09-13T05:12:51.688291+0000","last_active":"2024-09-13T05:12:51.827273+0000","last_peered":"2024-09-13T05:12:51.827273+0000","last_clean":"2024-09-13T05:12:51.827273+0000","last_became_active":"2024-09-13T05:12:09.627485+0000","last_became_peered":"2024-09-13T05:12:09.627485+0000","last_unstale":"2024-09-13T05:12:51.827273+0000","last_undegraded":"2024-09-13T05:12:51.827273+0000","last_fullsized":"2024-09-13T05:12:51.827273+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:54.694847+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0036619019999999999,"stat_sum":{"num_bytes":17763084,"num_objects":96,"num_object_clones":9,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":55,"num_read":1683,"num_read_kb":4624,"num_write":749,"num_write_kb":10312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":352,"num_bytes_recovered":5263836,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-13T05:12:50.668177+0000","last_change":"2024-09-13T05:12:03.637346+0000","last_active":"2024-09-13T05:12:50.668177+0000","last_peered":"2024-09-13T05:12:50.668177+0000","last_clean":"2024-09-13T05:12:50.668177+0000","last_became_active":"2024-09-13T05:12:03.636811+0000","last_became_peered":"2024-09-13T05:12:03.636811+0000","last_unstale":"2024-09-13T05:12:50.668177+0000","last_undegraded":"2024-09-13T05:12:50.668177+0000","last_fullsized":"2024-09-13T05:12:50.668177+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:20:34.682745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"157'614","reported_seq":5234,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.827731+0000","last_change":"2024-09-13T05:12:51.713126+0000","last_active":"2024-09-13T05:12:51.827731+0000","last_peered":"2024-09-13T05:12:51.827731+0000","last_clean":"2024-09-13T05:12:51.827731+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:12:51.827731+0000","last_undegraded":"2024-09-13T05:12:51.827731+0000","last_fullsized":"2024-09-13T05:12:51.827731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":614,"log_dups_size":0,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:40.372741+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0096393499999999997,"stat_sum":{"num_bytes":97017412,"num_objects":114,"num_object_clones":15,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":51,"num_read":6823,"num_read_kb":59230,"num_write":548,"num_write_kb":55659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"3.3","version":"157'900","reported_seq":4217,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.854299+0000","last_change":"2024-09-13T05:12:51.701794+0000","last_active":"2024-09-13T05:12:51.854299+0000","last_peered":"2024-09-13T05:12:51.854299+0000","last_clean":"2024-09-13T05:12:51.854299+0000","last_became_active":"2024-09-13T05:12:47.658611+0000","last_became_peered":"2024-09-13T05:12:47.658611+0000","last_unstale":"2024-09-13T05:12:51.854299+0000","last_undegraded":"2024-09-13T05:12:51.854299+0000","last_fullsized":"2024-09-13T05:12:51.854299+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:49.136782+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.023642795000000001,"stat_sum":{"num_bytes":66810441,"num_objects":106,"num_object_clones":12,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":65,"num_read":4486,"num_read_kb":30271,"num_write":1031,"num_write_kb":50251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":590,"num_bytes_recovered":30927923,"num_keys_recovered":33,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"2.2","version":"20'2","reported_seq":180,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-13T05:12:50.669130+0000","last_change":"2024-09-13T05:12:03.638698+0000","last_active":"2024-09-13T05:12:50.669130+0000","last_peered":"2024-09-13T05:12:50.669130+0000","last_clean":"2024-09-13T05:12:50.669130+0000","last_became_active":"2024-09-13T05:12:03.635365+0000","last_became_peered":"2024-09-13T05:12:03.635365+0000","last_unstale":"2024-09-13T05:12:50.669130+0000","last_undegraded":"2024-09-13T05:12:50.669130+0000","last_fullsized":"2024-09-13T05:12:50.669130+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:44:53.312870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"157'705","reported_seq":1451,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.822938+0000","last_change":"2024-09-13T05:12:51.698810+0000","last_active":"2024-09-13T05:12:51.822938+0000","last_peered":"2024-09-13T05:12:51.822938+0000","last_clean":"2024-09-13T05:12:51.822938+0000","last_became_active":"2024-09-13T05:12:07.930334+0000","last_became_peered":"2024-09-13T05:12:07.930334+0000","last_unstale":"2024-09-13T05:12:51.822938+0000","last_undegraded":"2024-09-13T05:12:51.822938+0000","last_fullsized":"2024-09-13T05:12:51.822938+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:23:46.175271+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.012113232,"stat_sum":{"num_bytes":24103513,"num_objects":114,"num_object_clones":15,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":70,"num_read":1950,"num_read_kb":3519,"num_write":667,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":1243867,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"2.1","version":"0'0","reported_seq":154,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-13T05:12:50.675034+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:12:50.675034+0000","last_peered":"2024-09-13T05:12:50.675034+0000","last_clean":"2024-09-13T05:12:50.675034+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:12:50.675034+0000","last_undegraded":"2024-09-13T05:12:50.675034+0000","last_fullsized":"2024-09-13T05:12:50.675034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"157'949","reported_seq":5024,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.907545+0000","last_change":"2024-09-13T05:12:51.684346+0000","last_active":"2024-09-13T05:12:51.907545+0000","last_peered":"2024-09-13T05:12:51.907545+0000","last_clean":"2024-09-13T05:12:51.907545+0000","last_became_active":"2024-09-13T05:12:41.915886+0000","last_became_peered":"2024-09-13T05:12:41.915886+0000","last_unstale":"2024-09-13T05:12:51.907545+0000","last_undegraded":"2024-09-13T05:12:51.907545+0000","last_fullsized":"2024-09-13T05:12:51.907545+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":949,"log_dups_size":0,"ondisk_log_size":949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:48.945004+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0073247670000000003,"stat_sum":{"num_bytes":29007855,"num_objects":96,"num_object_clones":16,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":56,"num_read":6392,"num_read_kb":19883,"num_write":1254,"num_write_kb":12446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":8416446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"2.0","version":"0'0","reported_seq":178,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-13T05:12:50.676334+0000","last_change":"2024-09-13T05:12:03.636279+0000","last_active":"2024-09-13T05:12:50.676334+0000","last_peered":"2024-09-13T05:12:50.676334+0000","last_clean":"2024-09-13T05:12:50.676334+0000","last_became_active":"2024-09-13T05:12:03.635929+0000","last_became_peered":"2024-09-13T05:12:03.635929+0000","last_unstale":"2024-09-13T05:12:50.676334+0000","last_undegraded":"2024-09-13T05:12:50.676334+0000","last_fullsized":"2024-09-13T05:12:50.676334+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:58:02.386056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"157'595","reported_seq":3007,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.815093+0000","last_change":"2024-09-13T05:12:51.717148+0000","last_active":"2024-09-13T05:12:51.815093+0000","last_peered":"2024-09-13T05:12:51.815093+0000","last_clean":"2024-09-13T05:12:51.815093+0000","last_became_active":"2024-09-13T05:11:23.617149+0000","last_became_peered":"2024-09-13T05:11:23.617149+0000","last_unstale":"2024-09-13T05:12:51.815093+0000","last_undegraded":"2024-09-13T05:12:51.815093+0000","last_fullsized":"2024-09-13T05:12:51.815093+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:55:46.203366+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.033081019000000003,"stat_sum":{"num_bytes":25738138,"num_objects":102,"num_object_clones":10,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":60,"num_read":4573,"num_read_kb":11695,"num_write":552,"num_write_kb":8352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":2822984,"num_keys_recovered":34,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"2.3","version":"18'1","reported_seq":155,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-13T05:12:50.669281+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:12:50.669281+0000","last_peered":"2024-09-13T05:12:50.669281+0000","last_clean":"2024-09-13T05:12:50.669281+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:12:50.669281+0000","last_undegraded":"2024-09-13T05:12:50.669281+0000","last_fullsized":"2024-09-13T05:12:50.669281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":344,"reported_epoch":156,"state":"active+clean","last_fresh":"2024-09-13T05:12:50.676423+0000","last_change":"2024-09-13T05:12:22.723305+0000","last_active":"2024-09-13T05:12:50.676423+0000","last_peered":"2024-09-13T05:12:50.676423+0000","last_clean":"2024-09-13T05:12:50.676423+0000","last_became_active":"2024-09-13T05:12:22.722658+0000","last_became_peered":"2024-09-13T05:12:22.722658+0000","last_unstale":"2024-09-13T05:12:50.676423+0000","last_undegraded":"2024-09-13T05:12:50.676423+0000","last_fullsized":"2024-09-13T05:12:50.676423+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:43:27.636898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"157'593","reported_seq":16930,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.820653+0000","last_change":"2024-09-13T05:12:51.698876+0000","last_active":"2024-09-13T05:12:51.820653+0000","last_peered":"2024-09-13T05:12:51.820653+0000","last_clean":"2024-09-13T05:12:51.820653+0000","last_became_active":"2024-09-13T05:12:12.653214+0000","last_became_peered":"2024-09-13T05:12:12.653214+0000","last_unstale":"2024-09-13T05:12:51.820653+0000","last_undegraded":"2024-09-13T05:12:51.820653+0000","last_fullsized":"2024-09-13T05:12:51.820653+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:11.574280+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.017037389999999999,"stat_sum":{"num_bytes":15299658,"num_objects":120,"num_object_clones":18,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":73,"num_read":16621,"num_read_kb":16706,"num_write":469,"num_write_kb":27916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":2876772,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"3.9","version":"157'756","reported_seq":8488,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.891921+0000","last_change":"2024-09-13T05:12:51.684772+0000","last_active":"2024-09-13T05:12:51.891921+0000","last_peered":"2024-09-13T05:12:51.891921+0000","last_clean":"2024-09-13T05:12:51.891921+0000","last_became_active":"2024-09-13T05:12:41.912780+0000","last_became_peered":"2024-09-13T05:12:41.912780+0000","last_unstale":"2024-09-13T05:12:51.891921+0000","last_undegraded":"2024-09-13T05:12:51.891921+0000","last_fullsized":"2024-09-13T05:12:51.891921+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:02:12.915400+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.0077321009999999999,"stat_sum":{"num_bytes":44253289,"num_objects":92,"num_object_clones":9,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":49,"num_read":10818,"num_read_kb":25051,"num_write":784,"num_write_kb":20337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":5657687,"num_keys_recovered":48,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"3.a","version":"157'723","reported_seq":10760,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.842298+0000","last_change":"2024-09-13T05:12:51.719115+0000","last_active":"2024-09-13T05:12:51.842298+0000","last_peered":"2024-09-13T05:12:51.842298+0000","last_clean":"2024-09-13T05:12:51.842298+0000","last_became_active":"2024-09-13T05:10:47.939220+0000","last_became_peered":"2024-09-13T05:10:47.939220+0000","last_unstale":"2024-09-13T05:12:51.842298+0000","last_undegraded":"2024-09-13T05:12:51.842298+0000","last_fullsized":"2024-09-13T05:12:51.842298+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:59.693041+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.035425535000000001,"stat_sum":{"num_bytes":22504328,"num_objects":105,"num_object_clones":13,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":63,"num_read":10975,"num_read_kb":19574,"num_write":690,"num_write_kb":9899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":59,"num_bytes_recovered":6203954,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"3.b","version":"157'605","reported_seq":7082,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.825179+0000","last_change":"2024-09-13T05:12:51.708589+0000","last_active":"2024-09-13T05:12:51.825179+0000","last_peered":"2024-09-13T05:12:51.825179+0000","last_clean":"2024-09-13T05:12:51.825179+0000","last_became_active":"2024-09-13T05:12:44.643571+0000","last_became_peered":"2024-09-13T05:12:44.643571+0000","last_unstale":"2024-09-13T05:12:51.825179+0000","last_undegraded":"2024-09-13T05:12:51.825179+0000","last_fullsized":"2024-09-13T05:12:51.825179+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:47:44.698936+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.025641245999999999,"stat_sum":{"num_bytes":7177935,"num_objects":107,"num_object_clones":16,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":68,"num_read":6816,"num_read_kb":12515,"num_write":494,"num_write_kb":8600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":440,"num_bytes_recovered":7231372,"num_keys_recovered":46,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"3.c","version":"157'638","reported_seq":2388,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.938061+0000","last_change":"2024-09-13T05:12:51.710128+0000","last_active":"2024-09-13T05:12:51.938061+0000","last_peered":"2024-09-13T05:12:51.938061+0000","last_clean":"2024-09-13T05:12:51.938061+0000","last_became_active":"2024-09-13T05:10:09.647037+0000","last_became_peered":"2024-09-13T05:10:09.647037+0000","last_unstale":"2024-09-13T05:12:51.938061+0000","last_undegraded":"2024-09-13T05:12:51.938061+0000","last_fullsized":"2024-09-13T05:12:51.938061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:54:17.061326+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.006950894,"stat_sum":{"num_bytes":54006668,"num_objects":99,"num_object_clones":13,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":56,"num_read":2932,"num_read_kb":14692,"num_write":745,"num_write_kb":19812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"3.d","version":"157'757","reported_seq":4340,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.708969+0000","last_change":"2024-09-13T05:12:51.708969+0000","last_active":"2024-09-13T05:12:51.708969+0000","last_peered":"2024-09-13T05:12:51.708969+0000","last_clean":"2024-09-13T05:12:51.708969+0000","last_became_active":"2024-09-13T05:11:23.616962+0000","last_became_peered":"2024-09-13T05:11:23.616962+0000","last_unstale":"2024-09-13T05:12:51.708969+0000","last_undegraded":"2024-09-13T05:12:51.708969+0000","last_fullsized":"2024-09-13T05:12:51.708969+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:19.035337+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.019041626999999998,"stat_sum":{"num_bytes":70352053,"num_objects":104,"num_object_clones":13,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":57,"num_read":5022,"num_read_kb":15414,"num_write":855,"num_write_kb":9162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":12781016,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"3.e","version":"157'1046","reported_seq":8991,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.817291+0000","last_change":"2024-09-13T05:12:51.716562+0000","last_active":"2024-09-13T05:12:51.817291+0000","last_peered":"2024-09-13T05:12:51.817291+0000","last_clean":"2024-09-13T05:12:51.817291+0000","last_became_active":"2024-09-13T05:12:46.655973+0000","last_became_peered":"2024-09-13T05:12:46.655973+0000","last_unstale":"2024-09-13T05:12:51.817291+0000","last_undegraded":"2024-09-13T05:12:51.817291+0000","last_fullsized":"2024-09-13T05:12:51.817291+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1046,"log_dups_size":0,"ondisk_log_size":1046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:05:32.995650+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.025292355999999998,"stat_sum":{"num_bytes":35531821,"num_objects":107,"num_object_clones":11,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":68,"num_read":9469,"num_read_kb":10891,"num_write":1414,"num_write_kb":6881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":612,"num_bytes_recovered":16479322,"num_keys_recovered":78,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"3.f","version":"157'858","reported_seq":6910,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.821118+0000","last_change":"2024-09-13T05:12:51.713771+0000","last_active":"2024-09-13T05:12:51.821118+0000","last_peered":"2024-09-13T05:12:51.821118+0000","last_clean":"2024-09-13T05:12:51.821118+0000","last_became_active":"2024-09-13T05:12:45.651313+0000","last_became_peered":"2024-09-13T05:12:45.651313+0000","last_unstale":"2024-09-13T05:12:51.821118+0000","last_undegraded":"2024-09-13T05:12:51.821118+0000","last_fullsized":"2024-09-13T05:12:51.821118+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:07:00.462818+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.022740614999999999,"stat_sum":{"num_bytes":19463461,"num_objects":117,"num_object_clones":17,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":74,"num_read":7472,"num_read_kb":14077,"num_write":1039,"num_write_kb":7811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":7824116,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"3.10","version":"157'589","reported_seq":3263,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.825167+0000","last_change":"2024-09-13T05:12:51.706336+0000","last_active":"2024-09-13T05:12:51.825167+0000","last_peered":"2024-09-13T05:12:51.825167+0000","last_clean":"2024-09-13T05:12:51.825167+0000","last_became_active":"2024-09-13T05:12:23.730157+0000","last_became_peered":"2024-09-13T05:12:23.730157+0000","last_unstale":"2024-09-13T05:12:51.825167+0000","last_undegraded":"2024-09-13T05:12:51.825167+0000","last_fullsized":"2024-09-13T05:12:51.825167+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:16:41.314885+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0033803330000000001,"stat_sum":{"num_bytes":36614584,"num_objects":120,"num_object_clones":8,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":66,"num_read":3200,"num_read_kb":16544,"num_write":567,"num_write_kb":24226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":406,"num_bytes_recovered":27581720,"num_keys_recovered":44,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"3.11","version":"157'481","reported_seq":9365,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.819801+0000","last_change":"2024-09-13T05:12:51.699624+0000","last_active":"2024-09-13T05:12:51.819801+0000","last_peered":"2024-09-13T05:12:51.819801+0000","last_clean":"2024-09-13T05:12:51.819801+0000","last_became_active":"2024-09-13T05:12:42.936456+0000","last_became_peered":"2024-09-13T05:12:42.936456+0000","last_unstale":"2024-09-13T05:12:51.819801+0000","last_undegraded":"2024-09-13T05:12:51.819801+0000","last_fullsized":"2024-09-13T05:12:51.819801+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:23.680853+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.010316113999999999,"stat_sum":{"num_bytes":13642993,"num_objects":115,"num_object_clones":15,"num_object_copies":230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":115,"num_whiteouts":74,"num_read":8113,"num_read_kb":13497,"num_write":377,"num_write_kb":21128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":380,"num_bytes_recovered":20462375,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"3.12","version":"157'981","reported_seq":5950,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.942563+0000","last_change":"2024-09-13T05:12:51.695883+0000","last_active":"2024-09-13T05:12:51.942563+0000","last_peered":"2024-09-13T05:12:51.942563+0000","last_clean":"2024-09-13T05:12:51.942563+0000","last_became_active":"2024-09-13T05:10:40.883543+0000","last_became_peered":"2024-09-13T05:10:40.883543+0000","last_unstale":"2024-09-13T05:12:51.942563+0000","last_undegraded":"2024-09-13T05:12:51.942563+0000","last_fullsized":"2024-09-13T05:12:51.942563+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":981,"log_dups_size":0,"ondisk_log_size":981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:14:23.460182+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0064397200000000003,"stat_sum":{"num_bytes":62886644,"num_objects":104,"num_object_clones":16,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":59,"num_read":8618,"num_read_kb":26572,"num_write":1198,"num_write_kb":8566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":633324,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2a","length":"7"}]},{"pgid":"3.13","version":"157'1212","reported_seq":5027,"reported_epoch":157,"state":"active+clean","last_fresh":"2024-09-13T05:12:51.716269+0000","last_change":"2024-09-13T05:12:51.716269+0000","last_active":"2024-09-13T05:12:51.716269+0000","last_peered":"2024-09-13T05:12:51.716269+0000","last_clean":"2024-09-13T05:12:51.716269+0000","last_became_active":"2024-09-13T05:12:48.638127+0000","last_became_peered":"2024-09-13T05:12:48.638127+0000","last_unstale":"2024-09-13T05:12:51.716269+0000","last_undegraded":"2024-09-13T05:12:51.716269+0000","last_fullsized":"2024-09-13T05:12:51.716269+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1212,"log_dups_size":0,"ondisk_log_size":1212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:33:48.012842+0000","scrub_duration":0,"objects_trimmed":10,"snaptrim_duration":0.026670207000000001,"stat_sum":{"num_bytes":49192099,"num_objects":121,"num_object_clones":19,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":69,"num_read":7549,"num_read_kb":54851,"num_write":1702,"num_write_kb":40142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":20884522,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2a","length":"7"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1269499762,"num_objects":3421,"num_object_clones":436,"num_object_copies":6842,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3421,"num_whiteouts":1987,"num_read":247651,"num_read_kb":622633,"num_write":26190,"num_write_kb":532181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8100,"num_bytes_recovered":271518483,"num_keys_recovered":882,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":409133056,"data_stored":457171353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23751,"ondisk_log_size":23751,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":159492,"kb_used_data":66036,"kb_used_omap":1,"kb_used_meta":93438,"kb_avail":94212348,"statfs":{"total":96636764160,"available":96473444352,"internally_reserved":0,"allocated":67620864,"data_stored":70673298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":95680971},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.59799999999999998}]},{"osd":1,"last update":"Fri Sep 13 05:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.80900000000000005,"15min":0.81899999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.871,"5min":0.80700000000000005,"15min":0.79700000000000004},"min":{"1min":0.60899999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.2090000000000001,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.036}]},{"osd":2,"last update":"Fri Sep 13 05:11:53 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.84799999999999998,"15min":0.85399999999999998},"min":{"1min":0.52400000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.81000000000000005,"15min":0.78400000000000003},"min":{"1min":0.59299999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.337,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.877}]},{"osd":3,"last update":"Fri Sep 13 05:11:53 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.84999999999999998,"15min":0.86099999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.232,"5min":1.296,"15min":1.296},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.90200000000000002,"15min":0.90500000000000003},"min":{"1min":0.54600000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2529999999999999,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.76000000000000001}]},{"osd":4,"last update":"Fri Sep 13 05:11:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76700000000000002,"15min":0.76500000000000001},"min":{"1min":0.46600000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1899999999999999,"5min":1.204,"15min":1.204},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.92400000000000004,"15min":0.93000000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.71899999999999997}]},{"osd":5,"last update":"Fri Sep 13 05:11:53 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.94999999999999996,"15min":0.94899999999999995},"min":{"1min":0.47599999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.395,"5min":1.655,"15min":1.655},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.93999999999999995,"15min":0.94299999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.177,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.80400000000000005}]},{"osd":6,"last update":"Fri Sep 13 05:11:53 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.91000000000000003,"15min":0.91200000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.03,"15min":1.034},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2789999999999999,"5min":1.377,"15min":1.377},"last":1.0780000000000001}]}]},{"osd":6,"up_from":0,"seq":55834574887,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132364,"kb_used_data":61056,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94239476,"statfs":{"total":96636764160,"available":96501223424,"internally_reserved":0,"allocated":62521344,"data_stored":66151555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73005510},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.499},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.65500000000000003}]},{"osd":1,"last update":"Fri Sep 13 05:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.86299999999999999,"15min":0.88100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.161,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.89800000000000002,"15min":0.92000000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.2709999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.54700000000000004}]},{"osd":2,"last update":"Fri Sep 13 05:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.83099999999999996,"15min":0.84999999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.262,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.88300000000000001,"15min":0.89200000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.86099999999999999}]},{"osd":3,"last update":"Fri Sep 13 05:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.90100000000000002,"15min":0.92600000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.175,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.98899999999999999,"15min":1.02},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.236,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.58299999999999996}]},{"osd":4,"last update":"Fri Sep 13 05:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.93400000000000005,"15min":0.96399999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1950000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":1.077,"15min":1.113},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.3520000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.81799999999999995}]},{"osd":6,"last update":"Fri Sep 13 05:12:00 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.93100000000000005,"15min":0.95099999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":1.0129999999999999,"15min":1.0409999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.2789999999999999,"5min":1.528,"15min":1.528},"last":0.83999999999999997}]},{"osd":7,"last update":"Fri Sep 13 05:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":1.151,"15min":1.194},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3080000000000001,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.1379999999999999,"15min":1.1679999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.619,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.79900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109652,"kb_used_data":82464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94262188,"statfs":{"total":96636764160,"available":96524480512,"internally_reserved":0,"allocated":84443136,"data_stored":89018284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:55 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":3.9929999999999999,"5min":3.9929999999999999,"15min":3.9929999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.622}]},{"osd":1,"last update":"Fri Sep 13 05:11:55 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.752,"15min":0.754},"min":{"1min":0.44800000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.90800000000000003,"15min":0.93200000000000005},"min":{"1min":0.496,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.107,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.40300000000000002}]},{"osd":2,"last update":"Fri Sep 13 05:11:55 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.995,"15min":0.999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":4.1779999999999999,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.026,"5min":1.089,"15min":1.099},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":4.1639999999999997,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.59899999999999998}]},{"osd":3,"last update":"Fri Sep 13 05:11:55 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.93999999999999995,"15min":0.92400000000000004},"min":{"1min":0.57699999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":4.0609999999999999,"5min":4.0609999999999999,"15min":4.0609999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.91500000000000004,"15min":0.92400000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.758,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.78400000000000003}]},{"osd":5,"last update":"Fri Sep 13 05:11:55 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.89400000000000002,"15min":0.89500000000000002},"min":{"1min":0.50600000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.143,"15min":1.175},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3080000000000001,"5min":3.871,"15min":3.871},"last":0.54200000000000004}]},{"osd":6,"last update":"Fri Sep 13 05:11:55 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.123,"15min":1.153},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3640000000000001,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.95799999999999996,"15min":0.96199999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.5629999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.99199999999999999}]},{"osd":7,"last update":"Fri Sep 13 05:11:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.1519999999999999,"15min":1.1699999999999999},"min":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4970000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.105,"15min":1.1080000000000001},"min":{"1min":0.65200000000000002,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.04}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139560,"kb_used_data":86292,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94232280,"statfs":{"total":96636764160,"available":96493854720,"internally_reserved":0,"allocated":88363008,"data_stored":102120342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":54524360},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.498},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.72499999999999998}]},{"osd":1,"last update":"Fri Sep 13 05:12:00 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92600000000000005,"5min":1.089,"15min":1.089},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.71199999999999997,"15min":0.72799999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0720000000000001,"5min":1.125,"15min":1.125},"last":1.0069999999999999}]},{"osd":2,"last update":"Fri Sep 13 05:12:00 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73899999999999999,"15min":0.74399999999999999},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":1.089,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.82899999999999996,"15min":0.85099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1339999999999999,"5min":1.573,"15min":1.573},"last":1.113}]},{"osd":4,"last update":"Fri Sep 13 05:12:00 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.87,"15min":0.90000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.98899999999999999,"5min":1.48,"15min":1.48},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.91600000000000004,"15min":0.93500000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.236,"5min":1.764,"15min":1.764},"last":0.87}]},{"osd":5,"last update":"Fri Sep 13 05:12:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.995,"15min":1.0209999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.6890000000000001,"5min":2.157,"15min":2.157},"last":1.069},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.95399999999999996,"15min":0.99199999999999999},"min":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0780000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Sep 13 05:12:00 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.96899999999999997,"15min":0.98899999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3899999999999999,"5min":1.976,"15min":1.976},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.85999999999999999,"5min":1.071,"15min":1.1060000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2,"5min":2.012,"15min":2.012},"last":1.4970000000000001}]},{"osd":7,"last update":"Fri Sep 13 05:12:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":1.0600000000000001,"15min":1.0880000000000001},"min":{"1min":0.67700000000000005,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1599999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.93999999999999995,"5min":1.0840000000000001,"15min":1.1080000000000001},"min":{"1min":0.68200000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.2,"5min":1.875,"15min":1.875},"last":0.90500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101760,"kb_used_data":22260,"kb_used_omap":1,"kb_used_meta":79486,"kb_avail":94270080,"statfs":{"total":96636764160,"available":96532561920,"internally_reserved":0,"allocated":22794240,"data_stored":26656112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":81394118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.44700000000000001}]},{"osd":1,"last update":"Fri Sep 13 05:11:52 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.65200000000000002,"15min":0.67000000000000004},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.89000000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65100000000000002,"15min":0.65700000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.032,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.504}]},{"osd":3,"last update":"Fri Sep 13 05:11:52 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.66600000000000004,"15min":0.622},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":6.6070000000000002,"5min":6.6070000000000002,"15min":6.6070000000000002},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.66300000000000003,"15min":0.65600000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":1.042}]},{"osd":4,"last update":"Fri Sep 13 05:11:52 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76100000000000001,"15min":0.76200000000000001},"min":{"1min":0.45900000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.88,"15min":0.88900000000000001},"min":{"1min":0.56699999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.232,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.87}]},{"osd":5,"last update":"Fri Sep 13 05:11:52 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.88400000000000001,"15min":0.89600000000000002},"min":{"1min":0.51000000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.278,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.84999999999999998,"15min":0.85599999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.72199999999999998}]},{"osd":6,"last update":"Fri Sep 13 05:11:52 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.876,"15min":0.87},"min":{"1min":0.51400000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.282,"5min":1.306,"15min":1.306},"last":0.628},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.93899999999999995,"15min":0.94499999999999995},"min":{"1min":0.60999999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.353,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.90400000000000003}]},{"osd":7,"last update":"Fri Sep 13 05:11:52 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.0189999999999999,"15min":1.032},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.153,"5min":1.867,"15min":1.867},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.96399999999999997,"15min":0.97199999999999998},"min":{"1min":0.61399999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3500000000000001,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.70299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91620,"kb_used_data":38356,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94280220,"statfs":{"total":96636764160,"available":96542945280,"internally_reserved":0,"allocated":39276544,"data_stored":45823832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Sep 13 05:11:57 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.64600000000000002,"15min":0.60999999999999999},"min":{"1min":0.27500000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":5.952,"5min":5.952,"15min":5.952},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69599999999999995,"15min":0.70099999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.88700000000000001}]},{"osd":3,"last update":"Fri Sep 13 05:11:57 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.76200000000000001,"15min":0.77800000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.083,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.74299999999999999,"15min":0.75700000000000001},"min":{"1min":0.35099999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":0.745}]},{"osd":4,"last update":"Fri Sep 13 05:11:57 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.91300000000000003,"15min":0.92900000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.92300000000000004,"15min":0.94499999999999995},"min":{"1min":0.502,"5min":0.439,"15min":0.439},"max":{"1min":1.1259999999999999,"5min":1.724,"15min":1.724},"last":1.3520000000000001}]},{"osd":5,"last update":"Fri Sep 13 05:11:57 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.90700000000000003,"15min":0.92700000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.27,"5min":1.484,"15min":1.484},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.87,"5min":0.92400000000000004,"15min":0.93300000000000005},"min":{"1min":0.58399999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.1579999999999999}]},{"osd":6,"last update":"Fri Sep 13 05:11:57 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.98499999999999999,"15min":1.0109999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1970000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.99399999999999999,"15min":1.012},"min":{"1min":0.55100000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.4339999999999999,"5min":1.873,"15min":1.873},"last":1.1120000000000001}]},{"osd":7,"last update":"Fri Sep 13 05:11:57 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":1.0129999999999999,"15min":1.0229999999999999},"min":{"1min":0.64600000000000002,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.298,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.083},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0249999999999999,"15min":1.034},"min":{"1min":0.61199999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.26}]}]},{"osd":0,"up_from":0,"seq":532575944714,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10035200,"data_stored":11939429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":34803712,"data_stored":42484967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19980288,"data_stored":24929020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81694720,"data_stored":96700926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":78868480,"data_stored":84718450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":56623104,"data_stored":61420620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":64749568,"data_stored":68401288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":62377984,"data_stored":66576653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:12:54.502 INFO:tasks.thrashosds.thrasher:Setting 3.1d to [0, 7] 2024-09-13T05:12:54.502 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.1d', '0', '7'] 2024-09-13T05:12:54.502 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.1d 0 7 2024-09-13T05:12:54.509 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:54.509 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:54.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:54.510 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:54.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.510 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136560 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3908608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:54.510 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:12:54.510 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.411283320999999, 2024-09-13T05:12:54.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056148103999999997, 2024-09-13T05:12:54.510 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.510 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.510 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.510 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.510 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.510 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136560 2024-09-13T05:12:54.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.510 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:12:54.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:12:54.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095289+0000", 2024-09-13T05:12:54.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:54.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095292+0000", 2024-09-13T05:12:54.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.802e-06 2024-09-13T05:12:54.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095318+0000", 2024-09-13T05:12:54.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5987999999999999e-05 2024-09-13T05:12:54.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095323+0000", 2024-09-13T05:12:54.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.006e-06 2024-09-13T05:12:54.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151316+0000", 2024-09-13T05:12:54.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055992593 2024-09-13T05:12:54.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151371+0000", 2024-09-13T05:12:54.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5532999999999998e-05 2024-09-13T05:12:54.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151438+0000", 2024-09-13T05:12:54.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6557999999999995e-05 2024-09-13T05:12:54.514 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.514 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.514 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.514 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136562 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3922944~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:54.515 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:54.515 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.411246202999997, 2024-09-13T05:12:54.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056259690000000001, 2024-09-13T05:12:54.515 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.515 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.515 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.515 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.515 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.515 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136562 2024-09-13T05:12:54.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.515 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:54.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:54.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:54.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:54.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095329+0000", 2024-09-13T05:12:54.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3089999999999998e-06 2024-09-13T05:12:54.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095333+0000", 2024-09-13T05:12:54.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6239999999999999e-06 2024-09-13T05:12:54.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095335+0000", 2024-09-13T05:12:54.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5660000000000001e-06 2024-09-13T05:12:54.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151468+0000", 2024-09-13T05:12:54.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056132608000000001 2024-09-13T05:12:54.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151519+0000", 2024-09-13T05:12:54.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1681000000000002e-05 2024-09-13T05:12:54.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151587+0000", 2024-09-13T05:12:54.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7200999999999996e-05 2024-09-13T05:12:54.519 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.519 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.519 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.520 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136563 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3937280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:54.520 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:54.520 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.411234780999997, 2024-09-13T05:12:54.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056393051999999999, 2024-09-13T05:12:54.520 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.521 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.521 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.521 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.521 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.521 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136563 2024-09-13T05:12:54.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.522 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:54.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:54.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:54.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:12:54.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095340+0000", 2024-09-13T05:12:54.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.561e-06 2024-09-13T05:12:54.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095342+0000", 2024-09-13T05:12:54.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8059999999999999e-06 2024-09-13T05:12:54.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095345+0000", 2024-09-13T05:12:54.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:12:54.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151621+0000", 2024-09-13T05:12:54.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056275602000000001 2024-09-13T05:12:54.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151670+0000", 2024-09-13T05:12:54.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9478000000000003e-05 2024-09-13T05:12:54.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151731+0000", 2024-09-13T05:12:54.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1054000000000002e-05 2024-09-13T05:12:54.525 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.525 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.525 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.526 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136565 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3951616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:54.526 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:12:54.526 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.411224466999997, 2024-09-13T05:12:54.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056524090999999999, 2024-09-13T05:12:54.526 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.526 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.526 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136565 2024-09-13T05:12:54.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.527 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:12:54.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:12:54.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095348+0000", 2024-09-13T05:12:54.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:12:54.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095350+0000", 2024-09-13T05:12:54.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4479999999999999e-06 2024-09-13T05:12:54.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095353+0000", 2024-09-13T05:12:54.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.909e-06 2024-09-13T05:12:54.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095356+0000", 2024-09-13T05:12:54.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:12:54.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151763+0000", 2024-09-13T05:12:54.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056407813000000001 2024-09-13T05:12:54.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151812+0000", 2024-09-13T05:12:54.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8306999999999997e-05 2024-09-13T05:12:54.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151873+0000", 2024-09-13T05:12:54.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1064999999999999e-05 2024-09-13T05:12:54.530 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.530 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.530 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.530 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136567 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3965952~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:54.530 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:12:54.530 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.411215442, 2024-09-13T05:12:54.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056653907000000003, 2024-09-13T05:12:54.531 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.531 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.531 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.531 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.531 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.531 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136567 2024-09-13T05:12:54.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.531 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:12:54.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:12:54.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095357+0000", 2024-09-13T05:12:54.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:54.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095359+0000", 2024-09-13T05:12:54.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:12:54.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095362+0000", 2024-09-13T05:12:54.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7939999999999998e-06 2024-09-13T05:12:54.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095365+0000", 2024-09-13T05:12:54.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9979999999999999e-06 2024-09-13T05:12:54.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151904+0000", 2024-09-13T05:12:54.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056539308000000003 2024-09-13T05:12:54.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151953+0000", 2024-09-13T05:12:54.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8760000000000001e-05 2024-09-13T05:12:54.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152012+0000", 2024-09-13T05:12:54.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8761999999999997e-05 2024-09-13T05:12:54.535 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.535 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.535 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.536 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136569 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3980288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:54.536 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:54.536 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.411179687999997, 2024-09-13T05:12:54.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056771237000000002, 2024-09-13T05:12:54.536 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.536 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.536 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.536 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.536 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.536 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136569 2024-09-13T05:12:54.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.536 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:54.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:54.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:54.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:54.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095395+0000", 2024-09-13T05:12:54.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8870000000000001e-06 2024-09-13T05:12:54.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095402+0000", 2024-09-13T05:12:54.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6290000000000001e-06 2024-09-13T05:12:54.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095412+0000", 2024-09-13T05:12:54.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1730000000000001e-06 2024-09-13T05:12:54.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152044+0000", 2024-09-13T05:12:54.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056632016 2024-09-13T05:12:54.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152093+0000", 2024-09-13T05:12:54.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9570000000000001e-05 2024-09-13T05:12:54.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152165+0000", 2024-09-13T05:12:54.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1443e-05 2024-09-13T05:12:54.540 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.540 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.540 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.540 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136571 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3994624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:54.540 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:54.540 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.411158673000003, 2024-09-13T05:12:54.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056894741999999998, 2024-09-13T05:12:54.541 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.541 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.541 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.541 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.541 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.541 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136571 2024-09-13T05:12:54.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.541 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:54.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:54.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:54.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:54.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095418+0000", 2024-09-13T05:12:54.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0210000000000001e-06 2024-09-13T05:12:54.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095422+0000", 2024-09-13T05:12:54.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5310000000000002e-06 2024-09-13T05:12:54.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095425+0000", 2024-09-13T05:12:54.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8880000000000001e-06 2024-09-13T05:12:54.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152198+0000", 2024-09-13T05:12:54.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056773563999999999 2024-09-13T05:12:54.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152249+0000", 2024-09-13T05:12:54.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1168999999999997e-05 2024-09-13T05:12:54.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152309+0000", 2024-09-13T05:12:54.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9821999999999997e-05 2024-09-13T05:12:54.545 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.545 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.545 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.545 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136573 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4008960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:54.545 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:12:54.545 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.411146445999997, 2024-09-13T05:12:54.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057045810000000002, 2024-09-13T05:12:54.546 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.546 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.546 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.546 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.546 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.546 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136573 2024-09-13T05:12:54.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.546 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:12:54.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:12:54.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095426+0000", 2024-09-13T05:12:54.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:54.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095428+0000", 2024-09-13T05:12:54.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.593e-06 2024-09-13T05:12:54.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095431+0000", 2024-09-13T05:12:54.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9610000000000001e-06 2024-09-13T05:12:54.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095434+0000", 2024-09-13T05:12:54.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:12:54.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152352+0000", 2024-09-13T05:12:54.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05691881 2024-09-13T05:12:54.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152401+0000", 2024-09-13T05:12:54.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8995000000000001e-05 2024-09-13T05:12:54.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152472+0000", 2024-09-13T05:12:54.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1060000000000001e-05 2024-09-13T05:12:54.549 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.549 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.550 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.550 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136575 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4023296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:54.550 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:12:54.550 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.410716452999999, 2024-09-13T05:12:54.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056760069000000003, 2024-09-13T05:12:54.550 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.550 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.550 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.550 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.550 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.550 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136575 2024-09-13T05:12:54.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.551 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:12:54.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:12:54.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095437+0000", 2024-09-13T05:12:54.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9995799 2024-09-13T05:12:54.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095861+0000", 2024-09-13T05:12:54.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000424299 2024-09-13T05:12:54.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095869+0000", 2024-09-13T05:12:54.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5020000000000003e-06 2024-09-13T05:12:54.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095875+0000", 2024-09-13T05:12:54.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:12:54.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152502+0000", 2024-09-13T05:12:54.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056626528000000002 2024-09-13T05:12:54.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152556+0000", 2024-09-13T05:12:54.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4271000000000003e-05 2024-09-13T05:12:54.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152617+0000", 2024-09-13T05:12:54.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0896000000000001e-05 2024-09-13T05:12:54.554 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.554 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.554 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.554 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136577 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4037632~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:54.554 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:12:54.554 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.410614998, 2024-09-13T05:12:54.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056798242999999998, 2024-09-13T05:12:54.555 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.555 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.555 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.555 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.555 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.555 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136577 2024-09-13T05:12:54.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.555 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:12:54.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:12:54.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095882+0000", 2024-09-13T05:12:54.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999242 2024-09-13T05:12:54.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095961+0000", 2024-09-13T05:12:54.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8864999999999998e-05 2024-09-13T05:12:54.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095973+0000", 2024-09-13T05:12:54.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2206e-05 2024-09-13T05:12:54.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095978+0000", 2024-09-13T05:12:54.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0629999999999996e-06 2024-09-13T05:12:54.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152646+0000", 2024-09-13T05:12:54.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056668035999999998 2024-09-13T05:12:54.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152695+0000", 2024-09-13T05:12:54.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8634000000000002e-05 2024-09-13T05:12:54.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152756+0000", 2024-09-13T05:12:54.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1315000000000005e-05 2024-09-13T05:12:54.559 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.559 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.559 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.559 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136579 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4051968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:54.559 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:12:54.559 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.410286902999999, 2024-09-13T05:12:54.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056610869000000001, 2024-09-13T05:12:54.559 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.559 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.560 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.560 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.560 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.560 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136579 2024-09-13T05:12:54.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.560 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:12:54.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:12:54.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095989+0000", 2024-09-13T05:12:54.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997029 2024-09-13T05:12:54.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096291+0000", 2024-09-13T05:12:54.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030221499999999999 2024-09-13T05:12:54.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096300+0000", 2024-09-13T05:12:54.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4819999999999994e-06 2024-09-13T05:12:54.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096306+0000", 2024-09-13T05:12:54.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:12:54.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152788+0000", 2024-09-13T05:12:54.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056481625000000001 2024-09-13T05:12:54.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152837+0000", 2024-09-13T05:12:54.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9345000000000003e-05 2024-09-13T05:12:54.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152897+0000", 2024-09-13T05:12:54.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9892999999999997e-05 2024-09-13T05:12:54.563 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.563 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.563 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.564 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136581 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4066304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:54.564 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:12:54.564 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.410108076, 2024-09-13T05:12:54.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056597091000000002, 2024-09-13T05:12:54.564 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.564 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.564 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.564 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.564 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.564 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136581 2024-09-13T05:12:54.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.564 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:12:54.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:12:54.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096312+0000", 2024-09-13T05:12:54.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998465 2024-09-13T05:12:54.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096469+0000", 2024-09-13T05:12:54.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157109 2024-09-13T05:12:54.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096478+0000", 2024-09-13T05:12:54.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3260000000000002e-06 2024-09-13T05:12:54.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096482+0000", 2024-09-13T05:12:54.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9720000000000003e-06 2024-09-13T05:12:54.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152933+0000", 2024-09-13T05:12:54.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056451128000000003 2024-09-13T05:12:54.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152993+0000", 2024-09-13T05:12:54.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9947000000000001e-05 2024-09-13T05:12:54.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153062+0000", 2024-09-13T05:12:54.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9105999999999999e-05 2024-09-13T05:12:54.572 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.572 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.572 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.573 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136583 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4080640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:54.573 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:12:54.573 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.409842163, 2024-09-13T05:12:54.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056496609000000003, 2024-09-13T05:12:54.573 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.574 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.574 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136583 2024-09-13T05:12:54.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.575 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:12:54.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:12:54.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096485+0000", 2024-09-13T05:12:54.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997544 2024-09-13T05:12:54.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096735+0000", 2024-09-13T05:12:54.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024979899999999998 2024-09-13T05:12:54.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096742+0000", 2024-09-13T05:12:54.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7139999999999996e-06 2024-09-13T05:12:54.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096747+0000", 2024-09-13T05:12:54.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8709999999999996e-06 2024-09-13T05:12:54.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153099+0000", 2024-09-13T05:12:54.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056352639000000003 2024-09-13T05:12:54.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153168+0000", 2024-09-13T05:12:54.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9029000000000006e-05 2024-09-13T05:12:54.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153228+0000", 2024-09-13T05:12:54.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9339999999999998e-05 2024-09-13T05:12:54.585 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.585 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.585 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.586 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136585 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4094976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:54.586 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:12:54.586 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.409590696000002, 2024-09-13T05:12:54.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056396420000000003, 2024-09-13T05:12:54.586 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.586 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.586 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.586 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.586 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.586 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136585 2024-09-13T05:12:54.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.586 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:12:54.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:12:54.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096750+0000", 2024-09-13T05:12:54.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997673 2024-09-13T05:12:54.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096986+0000", 2024-09-13T05:12:54.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000236297 2024-09-13T05:12:54.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096993+0000", 2024-09-13T05:12:54.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9600000000000003e-06 2024-09-13T05:12:54.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096999+0000", 2024-09-13T05:12:54.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:12:54.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153264+0000", 2024-09-13T05:12:54.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056264728999999999 2024-09-13T05:12:54.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153318+0000", 2024-09-13T05:12:54.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3934000000000002e-05 2024-09-13T05:12:54.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153379+0000", 2024-09-13T05:12:54.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1206999999999999e-05 2024-09-13T05:12:54.590 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.590 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.590 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.590 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136586 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4109312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:54.590 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:12:54.590 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.409389894, 2024-09-13T05:12:54.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056374703999999998, 2024-09-13T05:12:54.590 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.590 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.590 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.590 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.591 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.591 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136586 2024-09-13T05:12:54.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.591 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:12:54.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:12:54.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097004+0000", 2024-09-13T05:12:54.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998207 2024-09-13T05:12:54.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097187+0000", 2024-09-13T05:12:54.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018337900000000001 2024-09-13T05:12:54.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097198+0000", 2024-09-13T05:12:54.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348e-05 2024-09-13T05:12:54.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097202+0000", 2024-09-13T05:12:54.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.121e-06 2024-09-13T05:12:54.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153411+0000", 2024-09-13T05:12:54.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056209510999999997 2024-09-13T05:12:54.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153464+0000", 2024-09-13T05:12:54.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2605000000000002e-05 2024-09-13T05:12:54.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153558+0000", 2024-09-13T05:12:54.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4017999999999993e-05 2024-09-13T05:12:54.595 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.595 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.595 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.595 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136588 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:54.595 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:12:54.595 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.409105711000002, 2024-09-13T05:12:54.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056274980000000002, 2024-09-13T05:12:54.595 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.595 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.596 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136588 2024-09-13T05:12:54.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.596 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:12:54.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:12:54.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097205+0000", 2024-09-13T05:12:54.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997377 2024-09-13T05:12:54.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097471+0000", 2024-09-13T05:12:54.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026628200000000001 2024-09-13T05:12:54.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097484+0000", 2024-09-13T05:12:54.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2493e-05 2024-09-13T05:12:54.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097488+0000", 2024-09-13T05:12:54.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9330000000000003e-06 2024-09-13T05:12:54.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153600+0000", 2024-09-13T05:12:54.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056112097 2024-09-13T05:12:54.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153654+0000", 2024-09-13T05:12:54.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4126000000000003e-05 2024-09-13T05:12:54.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153742+0000", 2024-09-13T05:12:54.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.831e-05 2024-09-13T05:12:54.599 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.599 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.599 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.600 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136589 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4137984~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:54.600 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:12:54.600 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.408966403999997, 2024-09-13T05:12:54.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056293867999999997, 2024-09-13T05:12:54.600 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.600 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.600 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.601 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.601 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.601 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136589 2024-09-13T05:12:54.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.601 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:12:54.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:12:54.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097491+0000", 2024-09-13T05:12:54.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998841 2024-09-13T05:12:54.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097610+0000", 2024-09-13T05:12:54.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119263 2024-09-13T05:12:54.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097617+0000", 2024-09-13T05:12:54.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6490000000000002e-06 2024-09-13T05:12:54.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097624+0000", 2024-09-13T05:12:54.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6309999999999997e-06 2024-09-13T05:12:54.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153779+0000", 2024-09-13T05:12:54.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056155153999999999 2024-09-13T05:12:54.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153831+0000", 2024-09-13T05:12:54.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2080000000000003e-05 2024-09-13T05:12:54.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153901+0000", 2024-09-13T05:12:54.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9765999999999996e-05 2024-09-13T05:12:54.606 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.606 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.607 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.607 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136965 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3366912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:54.607 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:12:54.607 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.388997582999998, 2024-09-13T05:12:54.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056225403, 2024-09-13T05:12:54.607 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.607 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.608 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.608 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.608 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.608 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136965 2024-09-13T05:12:54.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.608 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:12:54.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:12:54.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117575+0000", 2024-09-13T05:12:54.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:54.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117578+0000", 2024-09-13T05:12:54.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4899999999999999e-06 2024-09-13T05:12:54.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117583+0000", 2024-09-13T05:12:54.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.074e-06 2024-09-13T05:12:54.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117587+0000", 2024-09-13T05:12:54.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5360000000000003e-06 2024-09-13T05:12:54.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173622+0000", 2024-09-13T05:12:54.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056034527000000001 2024-09-13T05:12:54.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173704+0000", 2024-09-13T05:12:54.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2137000000000003e-05 2024-09-13T05:12:54.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173801+0000", 2024-09-13T05:12:54.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7048999999999999e-05 2024-09-13T05:12:54.613 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.613 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.613 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.614 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136991 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3553280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:54.614 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:54.614 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.385071805999999, 2024-09-13T05:12:54.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056330199999999997, 2024-09-13T05:12:54.614 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.614 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.614 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.614 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.615 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.615 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136991 2024-09-13T05:12:54.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.615 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:54.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:54.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:54.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:54.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121504+0000", 2024-09-13T05:12:54.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7199999999999998e-06 2024-09-13T05:12:54.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121510+0000", 2024-09-13T05:12:54.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3459999999999999e-06 2024-09-13T05:12:54.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121515+0000", 2024-09-13T05:12:54.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.656e-06 2024-09-13T05:12:54.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177608+0000", 2024-09-13T05:12:54.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056093267000000002 2024-09-13T05:12:54.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177717+0000", 2024-09-13T05:12:54.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010901299999999999 2024-09-13T05:12:54.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177832+0000", 2024-09-13T05:12:54.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114604 2024-09-13T05:12:54.618 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.618 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.618 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.618 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173672 3.9 3:9520c004:::rbd_data.112d7c1bedf7.0000000000000040:29 [read 186368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:54.619 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:12:54.619 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.321177180999999, 2024-09-13T05:12:54.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05682475, 2024-09-13T05:12:54.619 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.619 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.619 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.619 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.619 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.619 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173672 2024-09-13T05:12:54.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.620 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:12:54.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:12:54.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185395+0000", 2024-09-13T05:12:54.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:54.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185398+0000", 2024-09-13T05:12:54.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8260000000000001e-06 2024-09-13T05:12:54.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185404+0000", 2024-09-13T05:12:54.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-09-13T05:12:54.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185408+0000", 2024-09-13T05:12:54.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5279999999999997e-06 2024-09-13T05:12:54.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.236213+0000", 2024-09-13T05:12:54.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050805207999999998 2024-09-13T05:12:54.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.236285+0000", 2024-09-13T05:12:54.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1236999999999996e-05 2024-09-13T05:12:54.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.242221+0000", 2024-09-13T05:12:54.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059360050000000003 2024-09-13T05:12:54.624 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.624 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.624 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.624 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.624 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.624 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:54.625 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:12:54.626 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:54.579+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:54.682 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:54.679+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:54.690 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is unset 2024-09-13T05:12:54.745 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:54.745 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:54.746 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:54.746 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:54.756 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:12:54.785 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:54.779+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:54.866 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:54.866 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:54.866 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:54.866 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:54.866 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:54.879 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:12:54.886 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:54.883+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:54.983 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:54.983 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:70758 3.2 3:427d0469:::rbd_header.112d8d1317eb:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-13T05:12:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 91.551245413000004, 2024-09-13T05:12:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.190313603, 2024-09-13T05:12:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.984 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70758 2024-09-13T05:12:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428654+0000", 2024-09-13T05:12:54.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:54.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428664+0000", 2024-09-13T05:12:54.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0664e-05 2024-09-13T05:12:54.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428683+0000", 2024-09-13T05:12:54.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8377e-05 2024-09-13T05:12:54.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428691+0000", 2024-09-13T05:12:54.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9400000000000008e-06 2024-09-13T05:12:54.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428789+0000", 2024-09-13T05:12:54.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7165999999999998e-05 2024-09-13T05:12:54.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:54.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428811+0000", 2024-09-13T05:12:54.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1925000000000001e-05 2024-09-13T05:12:54.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.617921+0000", 2024-09-13T05:12:54.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.189110536 2024-09-13T05:12:54.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:54.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618344+0000", 2024-09-13T05:12:54.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042245800000000001 2024-09-13T05:12:54.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618969+0000", 2024-09-13T05:12:54.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062529299999999996 2024-09-13T05:12:54.991 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.991 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.991 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.991 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162381 3.8 3.4e1a3768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:54.991 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:12:54.991 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.471239165999997, 2024-09-13T05:12:54.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.14690313199999999, 2024-09-13T05:12:54.991 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.991 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:54.992 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.992 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.992 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.992 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162381 2024-09-13T05:12:54.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.992 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:12:54.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:12:54.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508659+0000", 2024-09-13T05:12:54.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:12:54.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508673+0000", 2024-09-13T05:12:54.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4154999999999999e-05 2024-09-13T05:12:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508703+0000", 2024-09-13T05:12:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9427000000000001e-05 2024-09-13T05:12:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508719+0000", 2024-09-13T05:12:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6381000000000001e-05 2024-09-13T05:12:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508789+0000", 2024-09-13T05:12:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9898000000000001e-05 2024-09-13T05:12:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508799+0000", 2024-09-13T05:12:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0066e-05 2024-09-13T05:12:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655550+0000", 2024-09-13T05:12:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.146750506 2024-09-13T05:12:54.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655565+0000", 2024-09-13T05:12:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4915e-05 2024-09-13T05:12:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162393 3.8 3.fd966c88 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:12:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.459723091999997, 2024-09-13T05:12:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.135657895, 2024-09-13T05:12:54.996 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162393 2024-09-13T05:12:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:12:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:12:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520176+0000", 2024-09-13T05:12:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520184+0000", 2024-09-13T05:12:54.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5800000000000003e-06 2024-09-13T05:12:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520199+0000", 2024-09-13T05:12:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4481000000000001e-05 2024-09-13T05:12:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520209+0000", 2024-09-13T05:12:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0327e-05 2024-09-13T05:12:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:54.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520351+0000", 2024-09-13T05:12:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141827 2024-09-13T05:12:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520363+0000", 2024-09-13T05:12:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2018000000000001e-05 2024-09-13T05:12:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655819+0000", 2024-09-13T05:12:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13545665600000001 2024-09-13T05:12:55.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655835+0000", 2024-09-13T05:12:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6135000000000001e-05 2024-09-13T05:12:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162429 3.8 3.6e098f28 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.458872483, 2024-09-13T05:12:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13484765400000001, 2024-09-13T05:12:55.001 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162429 2024-09-13T05:12:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521032+0000", 2024-09-13T05:12:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3039999999999998e-06 2024-09-13T05:12:55.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521041+0000", 2024-09-13T05:12:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6880000000000005e-06 2024-09-13T05:12:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521047+0000", 2024-09-13T05:12:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0100000000000001e-06 2024-09-13T05:12:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521601+0000", 2024-09-13T05:12:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00055398600000000002 2024-09-13T05:12:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521613+0000", 2024-09-13T05:12:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2347000000000001e-05 2024-09-13T05:12:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655869+0000", 2024-09-13T05:12:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.134255597 2024-09-13T05:12:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655876+0000", 2024-09-13T05:12:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2790000000000001e-06 2024-09-13T05:12:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162521 3.8 3.f06bf7c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.456470353, 2024-09-13T05:12:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13247452600000001, 2024-09-13T05:12:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:55.006 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162521 2024-09-13T05:12:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:55.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523433+0000", 2024-09-13T05:12:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.128e-06 2024-09-13T05:12:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523440+0000", 2024-09-13T05:12:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9990000000000002e-06 2024-09-13T05:12:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523446+0000", 2024-09-13T05:12:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7869999999999998e-06 2024-09-13T05:12:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.528221+0000", 2024-09-13T05:12:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047747040000000003 2024-09-13T05:12:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.528237+0000", 2024-09-13T05:12:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6042e-05 2024-09-13T05:12:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655898+0000", 2024-09-13T05:12:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.127661521 2024-09-13T05:12:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655905+0000", 2024-09-13T05:12:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7780000000000002e-06 2024-09-13T05:12:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162381 3.8 3:16ec5872:::rbd_data.112dc3abcba6.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:12:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.446943187999999, 2024-09-13T05:12:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12546553899999999, 2024-09-13T05:12:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162381 2024-09-13T05:12:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:12:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:12:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532956+0000", 2024-09-13T05:12:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532964+0000", 2024-09-13T05:12:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.072e-06 2024-09-13T05:12:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532976+0000", 2024-09-13T05:12:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1355000000000001e-05 2024-09-13T05:12:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532984+0000", 2024-09-13T05:12:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3440000000000001e-06 2024-09-13T05:12:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533432+0000", 2024-09-13T05:12:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044773000000000002 2024-09-13T05:12:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533439+0000", 2024-09-13T05:12:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9890000000000003e-06 2024-09-13T05:12:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655985+0000", 2024-09-13T05:12:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122546527 2024-09-13T05:12:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656234+0000", 2024-09-13T05:12:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024911300000000003 2024-09-13T05:12:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:12:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656378+0000", 2024-09-13T05:12:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014417100000000001 2024-09-13T05:12:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657916+0000", 2024-09-13T05:12:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001537907 2024-09-13T05:12:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:12:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658308+0000", 2024-09-13T05:12:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039183700000000002 2024-09-13T05:12:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:12:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658364+0000", 2024-09-13T05:12:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5451000000000002e-05 2024-09-13T05:12:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658423+0000", 2024-09-13T05:12:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9449e-05 2024-09-13T05:12:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162393 3.8 3:113669bf:::rbd_data.112dfd94ee88.00000000000000bf:2a [read 131072~18432] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.446903409000001, 2024-09-13T05:12:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124231431, 2024-09-13T05:12:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162393 2024-09-13T05:12:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533001+0000", 2024-09-13T05:12:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8099999999999999e-06 2024-09-13T05:12:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533007+0000", 2024-09-13T05:12:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5849999999999996e-06 2024-09-13T05:12:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533012+0000", 2024-09-13T05:12:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0320000000000003e-06 2024-09-13T05:12:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533459+0000", 2024-09-13T05:12:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044646399999999999 2024-09-13T05:12:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533464+0000", 2024-09-13T05:12:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9180000000000002e-06 2024-09-13T05:12:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656870+0000", 2024-09-13T05:12:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123406847 2024-09-13T05:12:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657067+0000", 2024-09-13T05:12:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019655599999999999 2024-09-13T05:12:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657229+0000", 2024-09-13T05:12:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016175599999999999 2024-09-13T05:12:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162429 3.8 3:14f19076:::rbd_data.112dfd94ee88.0000000000000150:2a [read 131072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:12:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.446883859000003, 2024-09-13T05:12:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124549956, 2024-09-13T05:12:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162429 2024-09-13T05:12:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:12:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:12:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533016+0000", 2024-09-13T05:12:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533020+0000", 2024-09-13T05:12:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1049999999999999e-06 2024-09-13T05:12:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533025+0000", 2024-09-13T05:12:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-09-13T05:12:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533030+0000", 2024-09-13T05:12:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8999999999999997e-06 2024-09-13T05:12:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533481+0000", 2024-09-13T05:12:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045080400000000002 2024-09-13T05:12:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533486+0000", 2024-09-13T05:12:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3369999999999999e-06 2024-09-13T05:12:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657311+0000", 2024-09-13T05:12:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123824408 2024-09-13T05:12:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657464+0000", 2024-09-13T05:12:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015343900000000001 2024-09-13T05:12:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657567+0000", 2024-09-13T05:12:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102568 2024-09-13T05:12:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162521 3.8 3:13efd60f:::rbd_data.112dfd94ee88.000000000000031a:2a [read 131072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.446732625999999, 2024-09-13T05:12:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124709257, 2024-09-13T05:12:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162521 2024-09-13T05:12:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533170+0000", 2024-09-13T05:12:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3910000000000001e-06 2024-09-13T05:12:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533176+0000", 2024-09-13T05:12:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4029999999999998e-06 2024-09-13T05:12:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533180+0000", 2024-09-13T05:12:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6999999999999999e-06 2024-09-13T05:12:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533659+0000", 2024-09-13T05:12:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047839699999999998 2024-09-13T05:12:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533664+0000", 2024-09-13T05:12:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7239999999999997e-06 2024-09-13T05:12:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657619+0000", 2024-09-13T05:12:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123954412 2024-09-13T05:12:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657784+0000", 2024-09-13T05:12:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016527499999999999 2024-09-13T05:12:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657877+0000", 2024-09-13T05:12:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3280000000000001e-05 2024-09-13T05:12:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162618 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 70656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:12:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.445427916, 2024-09-13T05:12:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123752711, 2024-09-13T05:12:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162618 2024-09-13T05:12:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:12:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:12:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534472+0000", 2024-09-13T05:12:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534475+0000", 2024-09-13T05:12:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2010000000000002e-06 2024-09-13T05:12:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534482+0000", 2024-09-13T05:12:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:12:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534486+0000", 2024-09-13T05:12:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7520000000000004e-06 2024-09-13T05:12:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536456+0000", 2024-09-13T05:12:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001969527 2024-09-13T05:12:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536462+0000", 2024-09-13T05:12:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2750000000000001e-06 2024-09-13T05:12:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657939+0000", 2024-09-13T05:12:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121476769 2024-09-13T05:12:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658087+0000", 2024-09-13T05:12:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014862400000000001 2024-09-13T05:12:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658225+0000", 2024-09-13T05:12:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013800999999999999 2024-09-13T05:12:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162620 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 71680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.445393791000001, 2024-09-13T05:12:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124087688, 2024-09-13T05:12:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162620 2024-09-13T05:12:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534509+0000", 2024-09-13T05:12:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1270000000000001e-06 2024-09-13T05:12:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534514+0000", 2024-09-13T05:12:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8720000000000001e-06 2024-09-13T05:12:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534518+0000", 2024-09-13T05:12:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5090000000000004e-06 2024-09-13T05:12:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536485+0000", 2024-09-13T05:12:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019671530000000001 2024-09-13T05:12:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536491+0000", 2024-09-13T05:12:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3759999999999999e-06 2024-09-13T05:12:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658466+0000", 2024-09-13T05:12:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121975466 2024-09-13T05:12:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658522+0000", 2024-09-13T05:12:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5668999999999998e-05 2024-09-13T05:12:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658595+0000", 2024-09-13T05:12:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2800999999999996e-05 2024-09-13T05:12:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162622 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 72704~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:12:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.445362824, 2024-09-13T05:12:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124215569, 2024-09-13T05:12:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162622 2024-09-13T05:12:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:12:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:12:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534537+0000", 2024-09-13T05:12:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534540+0000", 2024-09-13T05:12:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3740000000000001e-06 2024-09-13T05:12:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534545+0000", 2024-09-13T05:12:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4210000000000003e-06 2024-09-13T05:12:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534550+0000", 2024-09-13T05:12:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3090000000000003e-06 2024-09-13T05:12:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536510+0000", 2024-09-13T05:12:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019597130000000001 2024-09-13T05:12:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536517+0000", 2024-09-13T05:12:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0620000000000003e-06 2024-09-13T05:12:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658632+0000", 2024-09-13T05:12:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122114373 2024-09-13T05:12:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658686+0000", 2024-09-13T05:12:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3882999999999999e-05 2024-09-13T05:12:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658753+0000", 2024-09-13T05:12:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7921000000000002e-05 2024-09-13T05:12:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162623 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 73728~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:12:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.445346018999999, 2024-09-13T05:12:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124350214, 2024-09-13T05:12:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162623 2024-09-13T05:12:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:12:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:12:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534554+0000", 2024-09-13T05:12:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534556+0000", 2024-09-13T05:12:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-13T05:12:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534563+0000", 2024-09-13T05:12:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2890000000000003e-06 2024-09-13T05:12:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534567+0000", 2024-09-13T05:12:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4880000000000001e-06 2024-09-13T05:12:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536538+0000", 2024-09-13T05:12:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019703989999999998 2024-09-13T05:12:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536543+0000", 2024-09-13T05:12:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3920000000000002e-06 2024-09-13T05:12:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658773+0000", 2024-09-13T05:12:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122229607 2024-09-13T05:12:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658835+0000", 2024-09-13T05:12:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1954999999999999e-05 2024-09-13T05:12:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658905+0000", 2024-09-13T05:12:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-09-13T05:12:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162626 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 65536~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.445294734999997, 2024-09-13T05:12:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124425881, 2024-09-13T05:12:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162626 2024-09-13T05:12:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534611+0000", 2024-09-13T05:12:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5419999999999996e-06 2024-09-13T05:12:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534617+0000", 2024-09-13T05:12:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5169999999999999e-06 2024-09-13T05:12:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534622+0000", 2024-09-13T05:12:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9810000000000003e-06 2024-09-13T05:12:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536563+0000", 2024-09-13T05:12:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019410549999999999 2024-09-13T05:12:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536568+0000", 2024-09-13T05:12:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4310000000000002e-06 2024-09-13T05:12:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658922+0000", 2024-09-13T05:12:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122354221 2024-09-13T05:12:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658968+0000", 2024-09-13T05:12:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5221e-05 2024-09-13T05:12:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659032+0000", 2024-09-13T05:12:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4256000000000003e-05 2024-09-13T05:12:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162628 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 66560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.445259784000001, 2024-09-13T05:12:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124532254, 2024-09-13T05:12:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162628 2024-09-13T05:12:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534643+0000", 2024-09-13T05:12:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1890000000000001e-06 2024-09-13T05:12:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534648+0000", 2024-09-13T05:12:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:12:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534652+0000", 2024-09-13T05:12:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4549999999999997e-06 2024-09-13T05:12:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536586+0000", 2024-09-13T05:12:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019336049999999999 2024-09-13T05:12:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536591+0000", 2024-09-13T05:12:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3770000000000004e-06 2024-09-13T05:12:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659062+0000", 2024-09-13T05:12:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122470685 2024-09-13T05:12:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659106+0000", 2024-09-13T05:12:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3856000000000002e-05 2024-09-13T05:12:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659173+0000", 2024-09-13T05:12:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7168000000000005e-05 2024-09-13T05:12:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162630 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 67584~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.445226578000003, 2024-09-13T05:12:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12468555100000001, 2024-09-13T05:12:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162630 2024-09-13T05:12:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534676+0000", 2024-09-13T05:12:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4399999999999999e-06 2024-09-13T05:12:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534681+0000", 2024-09-13T05:12:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2349999999999999e-06 2024-09-13T05:12:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534686+0000", 2024-09-13T05:12:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5499999999999996e-06 2024-09-13T05:12:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536609+0000", 2024-09-13T05:12:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001923407 2024-09-13T05:12:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536615+0000", 2024-09-13T05:12:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1499999999999998e-06 2024-09-13T05:12:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659233+0000", 2024-09-13T05:12:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122618957 2024-09-13T05:12:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659294+0000", 2024-09-13T05:12:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0251000000000003e-05 2024-09-13T05:12:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659360+0000", 2024-09-13T05:12:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5906000000000002e-05 2024-09-13T05:12:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162633 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 69632~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.445118673000003, 2024-09-13T05:12:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124702147, 2024-09-13T05:12:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162633 2024-09-13T05:12:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534784+0000", 2024-09-13T05:12:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3300000000000001e-06 2024-09-13T05:12:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534789+0000", 2024-09-13T05:12:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4149999999999998e-06 2024-09-13T05:12:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534794+0000", 2024-09-13T05:12:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5669999999999996e-06 2024-09-13T05:12:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536634+0000", 2024-09-13T05:12:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001840401 2024-09-13T05:12:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536642+0000", 2024-09-13T05:12:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9729999999999997e-06 2024-09-13T05:12:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659383+0000", 2024-09-13T05:12:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12274112099999999 2024-09-13T05:12:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659424+0000", 2024-09-13T05:12:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0936000000000002e-05 2024-09-13T05:12:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659484+0000", 2024-09-13T05:12:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9775000000000003e-05 2024-09-13T05:12:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162675 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 68608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.445069629000002, 2024-09-13T05:12:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124823974, 2024-09-13T05:12:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162675 2024-09-13T05:12:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534833+0000", 2024-09-13T05:12:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.204e-06 2024-09-13T05:12:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534838+0000", 2024-09-13T05:12:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0130000000000001e-06 2024-09-13T05:12:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534842+0000", 2024-09-13T05:12:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.51e-06 2024-09-13T05:12:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536661+0000", 2024-09-13T05:12:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018186039999999999 2024-09-13T05:12:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536667+0000", 2024-09-13T05:12:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5260000000000001e-06 2024-09-13T05:12:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659531+0000", 2024-09-13T05:12:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122864403 2024-09-13T05:12:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659583+0000", 2024-09-13T05:12:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1564000000000003e-05 2024-09-13T05:12:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659655+0000", 2024-09-13T05:12:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2504999999999998e-05 2024-09-13T05:12:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:163257 3.8 3:1136e8de:::rbd_data.112dbd21872d.000000000000003c:28 [read 200704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.430054423000001, 2024-09-13T05:12:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12163807, 2024-09-13T05:12:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 163257 2024-09-13T05:12:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549848+0000", 2024-09-13T05:12:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1789999999999998e-06 2024-09-13T05:12:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549854+0000", 2024-09-13T05:12:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9050000000000002e-06 2024-09-13T05:12:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549858+0000", 2024-09-13T05:12:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3529999999999997e-06 2024-09-13T05:12:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.551228+0000", 2024-09-13T05:12:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001369227 2024-09-13T05:12:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.551233+0000", 2024-09-13T05:12:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5860000000000004e-06 2024-09-13T05:12:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671337+0000", 2024-09-13T05:12:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.120104265 2024-09-13T05:12:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671425+0000", 2024-09-13T05:12:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7810000000000001e-05 2024-09-13T05:12:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671484+0000", 2024-09-13T05:12:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9079000000000001e-05 2024-09-13T05:12:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:170203 3.1e 3:7c9b1cf4:::rbd_header.112dc3abcba6:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128)", 2024-09-13T05:12:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:12:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.165090657999997, 2024-09-13T05:12:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.79948714899999995, 2024-09-13T05:12:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 170203 2024-09-13T05:12:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:12:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:12:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814808+0000", 2024-09-13T05:12:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814820+0000", 2024-09-13T05:12:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.206e-05 2024-09-13T05:12:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814841+0000", 2024-09-13T05:12:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1464999999999999e-05 2024-09-13T05:12:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814853+0000", 2024-09-13T05:12:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1824999999999999e-05 2024-09-13T05:12:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814911+0000", 2024-09-13T05:12:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8255999999999999e-05 2024-09-13T05:12:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814918+0000", 2024-09-13T05:12:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7120000000000003e-06 2024-09-13T05:12:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.611660+0000", 2024-09-13T05:12:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.79674180100000003 2024-09-13T05:12:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.611911+0000", 2024-09-13T05:12:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025108900000000002 2024-09-13T05:12:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-13T05:12:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.612726+0000", 2024-09-13T05:12:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00081512999999999996 2024-09-13T05:12:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614087+0000", 2024-09-13T05:12:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013607560000000001 2024-09-13T05:12:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:12:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614095+0000", 2024-09-13T05:12:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3240000000000003e-06 2024-09-13T05:12:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:12:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614138+0000", 2024-09-13T05:12:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3115000000000003e-05 2024-09-13T05:12:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614297+0000", 2024-09-13T05:12:55.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015875399999999999 2024-09-13T05:12:55.094 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.094 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:55.094 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.094 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:55.094 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:55.094 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:55.096 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:12:55.096 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:55.091+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:55.119 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:12:55.197 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:55.191+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:55.214 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:55.214 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:55.215 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:55.215 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:55.224 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:12:55.278 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:12:55.297 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:55.295+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:55.300 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:55.322 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:55.331 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:55.331 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:55.331 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:55.331 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:55.332 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:55.341 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:12:55.343 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:55.365 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:55.389 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:55.398 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:55.395+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:55.413 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:55.435 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:55.437 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:12:55.438 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:55.438 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:55.438 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:55.438 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:55.438 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:55.438 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:55.438 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:55.447 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:55.448 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:55.457 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:12:55.499 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:55.495+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:55.568 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:55.568 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:55.578 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:12:55.626 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:55.623+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:55.683 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:55.684 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:55.696 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:12:55.700 INFO:teuthology.orchestra.run.smithi120.stderr:set 3.1d pg_upmap mapping to [0,7] 2024-09-13T05:12:55.701 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:55.695+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:55.797 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:55.797 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:55.803 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:55.799+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:55.808 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:12:55.903 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:55.899+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:55.915 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:55.915 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:55.925 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:12:56.004 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:55.999+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:56.033 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:56.033 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:56.042 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:12:56.105 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:56.099+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:56.151 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:56.151 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:56.161 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:12:56.206 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:56.203+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:56.262 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:56.263 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:56.272 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:12:56.307 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:56.303+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:56.408 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:56.403+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:56.421 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:56.421 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:56.431 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:12:56.508 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:56.503+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:56.538 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:56.538 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:56.548 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:12:56.610 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:56.607+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:56.667 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:56.667 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:56.677 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:12:56.706 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T05:12:56.711 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:56.707+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:56.807 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:56.808 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:56.811 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:56.807+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:56.818 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:12:56.912 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:56.907+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:56.928 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:56.928 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:56.938 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:12:57.014 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:57.011+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:57.036 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:57.036 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:57.045 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:12:57.115 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:57.111+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:57.198 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:57.198 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:57.207 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:12:57.216 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:57.211+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:57.313 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:57.313 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:57.316 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:57.311+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:57.323 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:12:57.418 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:57.415+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:57.429 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:57.429 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:57.439 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:12:57.456 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:12:57.519 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:57.515+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:57.565 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:12:57.566 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:12:57.576 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:12:57.599 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:12:57.616 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:12:57.620 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:57.615+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:57.635 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:12:57.653 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:12:57.680 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136560 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3908608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:12:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.582823176000005, 2024-09-13T05:12:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056148103999999997, 2024-09-13T05:12:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136560 2024-09-13T05:12:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:12:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:12:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095289+0000", 2024-09-13T05:12:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095292+0000", 2024-09-13T05:12:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.802e-06 2024-09-13T05:12:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095318+0000", 2024-09-13T05:12:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5987999999999999e-05 2024-09-13T05:12:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095323+0000", 2024-09-13T05:12:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.006e-06 2024-09-13T05:12:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151316+0000", 2024-09-13T05:12:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055992593 2024-09-13T05:12:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151371+0000", 2024-09-13T05:12:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5532999999999998e-05 2024-09-13T05:12:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151438+0000", 2024-09-13T05:12:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6557999999999995e-05 2024-09-13T05:12:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136562 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3922944~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.582786057999996, 2024-09-13T05:12:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056259690000000001, 2024-09-13T05:12:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136562 2024-09-13T05:12:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:12:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095329+0000", 2024-09-13T05:12:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3089999999999998e-06 2024-09-13T05:12:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095333+0000", 2024-09-13T05:12:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6239999999999999e-06 2024-09-13T05:12:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095335+0000", 2024-09-13T05:12:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5660000000000001e-06 2024-09-13T05:12:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151468+0000", 2024-09-13T05:12:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056132608000000001 2024-09-13T05:12:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151519+0000", 2024-09-13T05:12:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1681000000000002e-05 2024-09-13T05:12:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151587+0000", 2024-09-13T05:12:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7200999999999996e-05 2024-09-13T05:12:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136563 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3937280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.582774635999996, 2024-09-13T05:12:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056393051999999999, 2024-09-13T05:12:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136563 2024-09-13T05:12:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:12:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:12:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095340+0000", 2024-09-13T05:12:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.561e-06 2024-09-13T05:12:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095342+0000", 2024-09-13T05:12:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8059999999999999e-06 2024-09-13T05:12:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095345+0000", 2024-09-13T05:12:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:12:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151621+0000", 2024-09-13T05:12:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056275602000000001 2024-09-13T05:12:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151670+0000", 2024-09-13T05:12:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9478000000000003e-05 2024-09-13T05:12:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151731+0000", 2024-09-13T05:12:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1054000000000002e-05 2024-09-13T05:12:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136565 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3951616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:12:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.582764322000003, 2024-09-13T05:12:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056524090999999999, 2024-09-13T05:12:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136565 2024-09-13T05:12:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:12:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:12:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095348+0000", 2024-09-13T05:12:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:12:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095350+0000", 2024-09-13T05:12:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4479999999999999e-06 2024-09-13T05:12:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095353+0000", 2024-09-13T05:12:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.909e-06 2024-09-13T05:12:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095356+0000", 2024-09-13T05:12:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:12:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151763+0000", 2024-09-13T05:12:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056407813000000001 2024-09-13T05:12:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151812+0000", 2024-09-13T05:12:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8306999999999997e-05 2024-09-13T05:12:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151873+0000", 2024-09-13T05:12:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1064999999999999e-05 2024-09-13T05:12:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136567 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3965952~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:12:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.582755297000006, 2024-09-13T05:12:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056653907000000003, 2024-09-13T05:12:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136567 2024-09-13T05:12:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:12:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:12:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095357+0000", 2024-09-13T05:12:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095359+0000", 2024-09-13T05:12:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:12:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095362+0000", 2024-09-13T05:12:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7939999999999998e-06 2024-09-13T05:12:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095365+0000", 2024-09-13T05:12:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9979999999999999e-06 2024-09-13T05:12:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151904+0000", 2024-09-13T05:12:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056539308000000003 2024-09-13T05:12:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151953+0000", 2024-09-13T05:12:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8760000000000001e-05 2024-09-13T05:12:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152012+0000", 2024-09-13T05:12:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8761999999999997e-05 2024-09-13T05:12:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136569 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3980288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.582719542999996, 2024-09-13T05:12:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056771237000000002, 2024-09-13T05:12:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136569 2024-09-13T05:12:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:12:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095395+0000", 2024-09-13T05:12:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8870000000000001e-06 2024-09-13T05:12:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095402+0000", 2024-09-13T05:12:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6290000000000001e-06 2024-09-13T05:12:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095412+0000", 2024-09-13T05:12:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1730000000000001e-06 2024-09-13T05:12:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152044+0000", 2024-09-13T05:12:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056632016 2024-09-13T05:12:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152093+0000", 2024-09-13T05:12:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9570000000000001e-05 2024-09-13T05:12:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152165+0000", 2024-09-13T05:12:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1443e-05 2024-09-13T05:12:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136571 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3994624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.582698527999995, 2024-09-13T05:12:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056894741999999998, 2024-09-13T05:12:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136571 2024-09-13T05:12:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:12:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095418+0000", 2024-09-13T05:12:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0210000000000001e-06 2024-09-13T05:12:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095422+0000", 2024-09-13T05:12:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5310000000000002e-06 2024-09-13T05:12:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095425+0000", 2024-09-13T05:12:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8880000000000001e-06 2024-09-13T05:12:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152198+0000", 2024-09-13T05:12:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056773563999999999 2024-09-13T05:12:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152249+0000", 2024-09-13T05:12:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1168999999999997e-05 2024-09-13T05:12:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152309+0000", 2024-09-13T05:12:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9821999999999997e-05 2024-09-13T05:12:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136573 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4008960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:12:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.582686300999995, 2024-09-13T05:12:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057045810000000002, 2024-09-13T05:12:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136573 2024-09-13T05:12:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:12:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:12:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095426+0000", 2024-09-13T05:12:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095428+0000", 2024-09-13T05:12:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.593e-06 2024-09-13T05:12:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095431+0000", 2024-09-13T05:12:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9610000000000001e-06 2024-09-13T05:12:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095434+0000", 2024-09-13T05:12:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:12:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152352+0000", 2024-09-13T05:12:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05691881 2024-09-13T05:12:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152401+0000", 2024-09-13T05:12:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8995000000000001e-05 2024-09-13T05:12:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152472+0000", 2024-09-13T05:12:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1060000000000001e-05 2024-09-13T05:12:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136575 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4023296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:12:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.582256307999998, 2024-09-13T05:12:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056760069000000003, 2024-09-13T05:12:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136575 2024-09-13T05:12:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:12:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:12:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095437+0000", 2024-09-13T05:12:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9995799 2024-09-13T05:12:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095861+0000", 2024-09-13T05:12:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000424299 2024-09-13T05:12:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095869+0000", 2024-09-13T05:12:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5020000000000003e-06 2024-09-13T05:12:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095875+0000", 2024-09-13T05:12:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:12:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152502+0000", 2024-09-13T05:12:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056626528000000002 2024-09-13T05:12:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152556+0000", 2024-09-13T05:12:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4271000000000003e-05 2024-09-13T05:12:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152617+0000", 2024-09-13T05:12:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0896000000000001e-05 2024-09-13T05:12:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136577 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4037632~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:12:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.582154853000006, 2024-09-13T05:12:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056798242999999998, 2024-09-13T05:12:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136577 2024-09-13T05:12:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:12:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:12:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095882+0000", 2024-09-13T05:12:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999242 2024-09-13T05:12:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095961+0000", 2024-09-13T05:12:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8864999999999998e-05 2024-09-13T05:12:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095973+0000", 2024-09-13T05:12:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2206e-05 2024-09-13T05:12:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095978+0000", 2024-09-13T05:12:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0629999999999996e-06 2024-09-13T05:12:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152646+0000", 2024-09-13T05:12:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056668035999999998 2024-09-13T05:12:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152695+0000", 2024-09-13T05:12:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8634000000000002e-05 2024-09-13T05:12:57.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:57.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152756+0000", 2024-09-13T05:12:57.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1315000000000005e-05 2024-09-13T05:12:57.778 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.778 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:57.779 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.779 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136579 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4051968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:57.780 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:12:57.780 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.581826758000005, 2024-09-13T05:12:57.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056610869000000001, 2024-09-13T05:12:57.780 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:57.781 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:57.781 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:57.781 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:57.781 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:57.781 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136579 2024-09-13T05:12:57.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.781 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:57.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:57.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:12:57.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:57.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:12:57.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:57.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095989+0000", 2024-09-13T05:12:57.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997029 2024-09-13T05:12:57.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:57.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096291+0000", 2024-09-13T05:12:57.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030221499999999999 2024-09-13T05:12:57.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:57.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096300+0000", 2024-09-13T05:12:57.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4819999999999994e-06 2024-09-13T05:12:57.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:57.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096306+0000", 2024-09-13T05:12:57.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:12:57.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:57.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152788+0000", 2024-09-13T05:12:57.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056481625000000001 2024-09-13T05:12:57.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:57.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152837+0000", 2024-09-13T05:12:57.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9345000000000003e-05 2024-09-13T05:12:57.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:57.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152897+0000", 2024-09-13T05:12:57.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9892999999999997e-05 2024-09-13T05:12:57.788 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.788 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:57.789 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.789 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136581 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4066304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:57.789 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:12:57.789 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.581647931000006, 2024-09-13T05:12:57.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056597091000000002, 2024-09-13T05:12:57.790 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:57.790 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:57.790 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:57.790 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:57.790 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:57.790 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136581 2024-09-13T05:12:57.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.790 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:57.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:57.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:12:57.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:57.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:12:57.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:57.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096312+0000", 2024-09-13T05:12:57.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998465 2024-09-13T05:12:57.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:57.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096469+0000", 2024-09-13T05:12:57.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157109 2024-09-13T05:12:57.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:57.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096478+0000", 2024-09-13T05:12:57.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3260000000000002e-06 2024-09-13T05:12:57.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:57.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096482+0000", 2024-09-13T05:12:57.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9720000000000003e-06 2024-09-13T05:12:57.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:57.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152933+0000", 2024-09-13T05:12:57.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056451128000000003 2024-09-13T05:12:57.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:57.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152993+0000", 2024-09-13T05:12:57.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9947000000000001e-05 2024-09-13T05:12:57.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:57.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153062+0000", 2024-09-13T05:12:57.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9105999999999999e-05 2024-09-13T05:12:57.797 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.797 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:57.797 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.797 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136583 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4080640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:57.798 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:12:57.798 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.581382017999999, 2024-09-13T05:12:57.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056496609000000003, 2024-09-13T05:12:57.798 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:57.798 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:57.798 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:57.798 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:57.798 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:57.799 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136583 2024-09-13T05:12:57.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.799 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:57.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:57.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:12:57.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:57.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:12:57.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:57.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096485+0000", 2024-09-13T05:12:57.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997544 2024-09-13T05:12:57.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:57.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096735+0000", 2024-09-13T05:12:57.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024979899999999998 2024-09-13T05:12:57.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:57.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096742+0000", 2024-09-13T05:12:57.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7139999999999996e-06 2024-09-13T05:12:57.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:57.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096747+0000", 2024-09-13T05:12:57.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8709999999999996e-06 2024-09-13T05:12:57.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:57.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153099+0000", 2024-09-13T05:12:57.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056352639000000003 2024-09-13T05:12:57.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:57.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153168+0000", 2024-09-13T05:12:57.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9029000000000006e-05 2024-09-13T05:12:57.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:57.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153228+0000", 2024-09-13T05:12:57.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9339999999999998e-05 2024-09-13T05:12:57.804 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.805 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:57.805 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.805 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136585 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4094976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:57.805 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:12:57.805 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.581130551000001, 2024-09-13T05:12:57.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056396420000000003, 2024-09-13T05:12:57.805 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:57.805 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:57.806 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:57.806 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:57.806 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:57.806 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136585 2024-09-13T05:12:57.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.806 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:57.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:57.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:12:57.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:57.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:12:57.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096750+0000", 2024-09-13T05:12:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997673 2024-09-13T05:12:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096986+0000", 2024-09-13T05:12:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000236297 2024-09-13T05:12:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096993+0000", 2024-09-13T05:12:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9600000000000003e-06 2024-09-13T05:12:57.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096999+0000", 2024-09-13T05:12:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:12:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153264+0000", 2024-09-13T05:12:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056264728999999999 2024-09-13T05:12:57.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153318+0000", 2024-09-13T05:12:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3934000000000002e-05 2024-09-13T05:12:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153379+0000", 2024-09-13T05:12:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1206999999999999e-05 2024-09-13T05:12:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:57.811 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.812 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136586 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4109312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:57.812 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:12:57.812 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.580929749000006, 2024-09-13T05:12:57.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056374703999999998, 2024-09-13T05:12:57.812 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:57.812 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:57.812 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:57.812 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:57.813 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:57.813 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136586 2024-09-13T05:12:57.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.813 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:57.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:57.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:12:57.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:57.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:12:57.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:57.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097004+0000", 2024-09-13T05:12:57.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998207 2024-09-13T05:12:57.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:57.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097187+0000", 2024-09-13T05:12:57.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018337900000000001 2024-09-13T05:12:57.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:57.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097198+0000", 2024-09-13T05:12:57.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348e-05 2024-09-13T05:12:57.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:57.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097202+0000", 2024-09-13T05:12:57.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.121e-06 2024-09-13T05:12:57.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:57.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153411+0000", 2024-09-13T05:12:57.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056209510999999997 2024-09-13T05:12:57.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:57.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153464+0000", 2024-09-13T05:12:57.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2605000000000002e-05 2024-09-13T05:12:57.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:57.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153558+0000", 2024-09-13T05:12:57.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4017999999999993e-05 2024-09-13T05:12:57.818 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.818 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:57.818 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.819 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136588 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:57.819 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:12:57.819 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.580645566000001, 2024-09-13T05:12:57.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056274980000000002, 2024-09-13T05:12:57.819 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:57.819 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:57.819 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136588 2024-09-13T05:12:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:12:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:57.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:12:57.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:57.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097205+0000", 2024-09-13T05:12:57.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997377 2024-09-13T05:12:57.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:57.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097471+0000", 2024-09-13T05:12:57.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026628200000000001 2024-09-13T05:12:57.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:57.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097484+0000", 2024-09-13T05:12:57.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2493e-05 2024-09-13T05:12:57.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:57.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097488+0000", 2024-09-13T05:12:57.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9330000000000003e-06 2024-09-13T05:12:57.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:57.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153600+0000", 2024-09-13T05:12:57.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056112097 2024-09-13T05:12:57.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:57.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153654+0000", 2024-09-13T05:12:57.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4126000000000003e-05 2024-09-13T05:12:57.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:57.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153742+0000", 2024-09-13T05:12:57.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.831e-05 2024-09-13T05:12:57.824 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.824 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:57.824 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.825 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136589 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4137984~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:57.825 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:12:57.825 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.580506259000003, 2024-09-13T05:12:57.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056293867999999997, 2024-09-13T05:12:57.825 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:57.825 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:57.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:57.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:57.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136589 2024-09-13T05:12:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:12:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:12:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:57.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097491+0000", 2024-09-13T05:12:57.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998841 2024-09-13T05:12:57.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:57.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097610+0000", 2024-09-13T05:12:57.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119263 2024-09-13T05:12:57.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:57.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097617+0000", 2024-09-13T05:12:57.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6490000000000002e-06 2024-09-13T05:12:57.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:57.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097624+0000", 2024-09-13T05:12:57.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6309999999999997e-06 2024-09-13T05:12:57.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:57.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153779+0000", 2024-09-13T05:12:57.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056155153999999999 2024-09-13T05:12:57.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:57.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153831+0000", 2024-09-13T05:12:57.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2080000000000003e-05 2024-09-13T05:12:57.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:57.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153901+0000", 2024-09-13T05:12:57.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9765999999999996e-05 2024-09-13T05:12:57.830 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.830 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:57.830 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.830 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136965 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3366912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:57.830 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:12:57.831 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.560537437999997, 2024-09-13T05:12:57.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056225403, 2024-09-13T05:12:57.831 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:57.831 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:57.831 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:57.831 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:57.831 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:57.831 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136965 2024-09-13T05:12:57.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.831 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:57.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:57.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:12:57.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:57.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:12:57.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:57.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117575+0000", 2024-09-13T05:12:57.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:57.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:57.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117578+0000", 2024-09-13T05:12:57.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4899999999999999e-06 2024-09-13T05:12:57.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:57.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117583+0000", 2024-09-13T05:12:57.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.074e-06 2024-09-13T05:12:57.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:57.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117587+0000", 2024-09-13T05:12:57.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5360000000000003e-06 2024-09-13T05:12:57.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:57.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173622+0000", 2024-09-13T05:12:57.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056034527000000001 2024-09-13T05:12:57.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:57.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173704+0000", 2024-09-13T05:12:57.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2137000000000003e-05 2024-09-13T05:12:57.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:57.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173801+0000", 2024-09-13T05:12:57.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7048999999999999e-05 2024-09-13T05:12:57.835 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.835 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:57.835 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.835 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136991 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3553280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:12:57.835 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:57.835 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.556611661000005, 2024-09-13T05:12:57.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056330199999999997, 2024-09-13T05:12:57.835 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:57.836 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:57.836 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:57.836 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:57.836 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:57.836 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136991 2024-09-13T05:12:57.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.836 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:57.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:57.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:57.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:57.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:57.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:57.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:12:57.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:57.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:57.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121504+0000", 2024-09-13T05:12:57.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7199999999999998e-06 2024-09-13T05:12:57.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:57.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121510+0000", 2024-09-13T05:12:57.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3459999999999999e-06 2024-09-13T05:12:57.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:57.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121515+0000", 2024-09-13T05:12:57.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.656e-06 2024-09-13T05:12:57.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:57.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177608+0000", 2024-09-13T05:12:57.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056093267000000002 2024-09-13T05:12:57.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:57.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177717+0000", 2024-09-13T05:12:57.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010901299999999999 2024-09-13T05:12:57.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:57.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177832+0000", 2024-09-13T05:12:57.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114604 2024-09-13T05:12:57.840 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.840 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:57.840 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.840 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173672 3.9 3:9520c004:::rbd_data.112d7c1bedf7.0000000000000040:29 [read 186368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:12:57.840 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:12:57.840 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.492717036000002, 2024-09-13T05:12:57.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05682475, 2024-09-13T05:12:57.840 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:57.841 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:57.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:57.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:57.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:57.841 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173672 2024-09-13T05:12:57.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.841 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:57.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:57.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:12:57.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:57.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:12:57.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:57.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:57.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185395+0000", 2024-09-13T05:12:57.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:57.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:57.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185398+0000", 2024-09-13T05:12:57.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8260000000000001e-06 2024-09-13T05:12:57.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:57.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185404+0000", 2024-09-13T05:12:57.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-09-13T05:12:57.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:57.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185408+0000", 2024-09-13T05:12:57.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5279999999999997e-06 2024-09-13T05:12:57.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:57.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.236213+0000", 2024-09-13T05:12:57.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050805207999999998 2024-09-13T05:12:57.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:57.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.236285+0000", 2024-09-13T05:12:57.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1236999999999996e-05 2024-09-13T05:12:57.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:57.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:57.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:57.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.242221+0000", 2024-09-13T05:12:57.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059360050000000003 2024-09-13T05:12:57.846 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.846 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:57.846 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.846 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:57.846 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:57.846 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:57.848 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:12:57.849 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:12:57.850 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:12:57.851 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is set 2024-09-13T05:12:57.851 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:12:57.851 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:12:57.852 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:12:57.852 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:12:57.853 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:12:57.853 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:12:57.853 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:12:57.853 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:12:57.853 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:12:57.853 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:12:57.853 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:57.842+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:57.949 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:57.946+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:58.003 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:58.003 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:58.004 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:12:58.004 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:58.013 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:12:58.057 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:12:58.054+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:12:58.123 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:58.124 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:12:58.124 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:12:58.124 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:12:58.124 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:58.133 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:12:58.151 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:58.146+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:58.244 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:12:58.244 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:12:58.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:12:58.244 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:12:58.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:70758 3.2 3:427d0469:::rbd_header.112d8d1317eb:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-13T05:12:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 94.811208442999998, 2024-09-13T05:12:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.190313603, 2024-09-13T05:12:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70758 2024-09-13T05:12:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.245 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:12:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428654+0000", 2024-09-13T05:12:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428664+0000", 2024-09-13T05:12:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0664e-05 2024-09-13T05:12:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428683+0000", 2024-09-13T05:12:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8377e-05 2024-09-13T05:12:58.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428691+0000", 2024-09-13T05:12:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9400000000000008e-06 2024-09-13T05:12:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428789+0000", 2024-09-13T05:12:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7165999999999998e-05 2024-09-13T05:12:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:58.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428811+0000", 2024-09-13T05:12:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1925000000000001e-05 2024-09-13T05:12:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.617921+0000", 2024-09-13T05:12:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.189110536 2024-09-13T05:12:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618344+0000", 2024-09-13T05:12:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042245800000000001 2024-09-13T05:12:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618969+0000", 2024-09-13T05:12:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062529299999999996 2024-09-13T05:12:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162381 3.8 3.4e1a3768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:12:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.731202195999998, 2024-09-13T05:12:58.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.14690313199999999, 2024-09-13T05:12:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162381 2024-09-13T05:12:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:12:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:12:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508659+0000", 2024-09-13T05:12:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:12:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:58.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508673+0000", 2024-09-13T05:12:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4154999999999999e-05 2024-09-13T05:12:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508703+0000", 2024-09-13T05:12:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9427000000000001e-05 2024-09-13T05:12:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508719+0000", 2024-09-13T05:12:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6381000000000001e-05 2024-09-13T05:12:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508789+0000", 2024-09-13T05:12:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9898000000000001e-05 2024-09-13T05:12:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508799+0000", 2024-09-13T05:12:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0066e-05 2024-09-13T05:12:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655550+0000", 2024-09-13T05:12:58.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.146750506 2024-09-13T05:12:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655565+0000", 2024-09-13T05:12:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4915e-05 2024-09-13T05:12:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162393 3.8 3.fd966c88 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:12:58.255 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.719686121999999, 2024-09-13T05:12:58.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.135657895, 2024-09-13T05:12:58.256 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:58.256 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:58.256 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:58.256 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:58.256 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:58.256 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162393 2024-09-13T05:12:58.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.256 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:58.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:12:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:12:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520176+0000", 2024-09-13T05:12:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:12:58.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520184+0000", 2024-09-13T05:12:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5800000000000003e-06 2024-09-13T05:12:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520199+0000", 2024-09-13T05:12:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4481000000000001e-05 2024-09-13T05:12:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520209+0000", 2024-09-13T05:12:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0327e-05 2024-09-13T05:12:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520351+0000", 2024-09-13T05:12:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141827 2024-09-13T05:12:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520363+0000", 2024-09-13T05:12:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2018000000000001e-05 2024-09-13T05:12:58.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655819+0000", 2024-09-13T05:12:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13545665600000001 2024-09-13T05:12:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655835+0000", 2024-09-13T05:12:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6135000000000001e-05 2024-09-13T05:12:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.260 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162429 3.8 3.6e098f28 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.718835513000002, 2024-09-13T05:12:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13484765400000001, 2024-09-13T05:12:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:58.261 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162429 2024-09-13T05:12:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:12:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521032+0000", 2024-09-13T05:12:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3039999999999998e-06 2024-09-13T05:12:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521041+0000", 2024-09-13T05:12:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6880000000000005e-06 2024-09-13T05:12:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521047+0000", 2024-09-13T05:12:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0100000000000001e-06 2024-09-13T05:12:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521601+0000", 2024-09-13T05:12:58.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00055398600000000002 2024-09-13T05:12:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521613+0000", 2024-09-13T05:12:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2347000000000001e-05 2024-09-13T05:12:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655869+0000", 2024-09-13T05:12:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.134255597 2024-09-13T05:12:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655876+0000", 2024-09-13T05:12:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2790000000000001e-06 2024-09-13T05:12:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162521 3.8 3.f06bf7c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.716433383000002, 2024-09-13T05:12:58.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13247452600000001, 2024-09-13T05:12:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:12:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162521 2024-09-13T05:12:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:12:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523433+0000", 2024-09-13T05:12:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.128e-06 2024-09-13T05:12:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523440+0000", 2024-09-13T05:12:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9990000000000002e-06 2024-09-13T05:12:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523446+0000", 2024-09-13T05:12:58.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7869999999999998e-06 2024-09-13T05:12:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.528221+0000", 2024-09-13T05:12:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047747040000000003 2024-09-13T05:12:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.528237+0000", 2024-09-13T05:12:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6042e-05 2024-09-13T05:12:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655898+0000", 2024-09-13T05:12:58.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.127661521 2024-09-13T05:12:58.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:58.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655905+0000", 2024-09-13T05:12:58.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7780000000000002e-06 2024-09-13T05:12:58.271 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.271 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:58.271 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.271 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162381 3.8 3:16ec5872:::rbd_data.112dc3abcba6.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:58.272 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:12:58.272 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.706906218, 2024-09-13T05:12:58.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12546553899999999, 2024-09-13T05:12:58.272 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:58.272 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:58.272 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:58.272 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:58.272 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:58.272 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162381 2024-09-13T05:12:58.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.272 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:58.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:58.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:12:58.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:58.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:12:58.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:58.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532956+0000", 2024-09-13T05:12:58.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:58.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:58.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532964+0000", 2024-09-13T05:12:58.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.072e-06 2024-09-13T05:12:58.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:58.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532976+0000", 2024-09-13T05:12:58.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1355000000000001e-05 2024-09-13T05:12:58.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532984+0000", 2024-09-13T05:12:58.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3440000000000001e-06 2024-09-13T05:12:58.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533432+0000", 2024-09-13T05:12:58.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044773000000000002 2024-09-13T05:12:58.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:58.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533439+0000", 2024-09-13T05:12:58.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9890000000000003e-06 2024-09-13T05:12:58.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655985+0000", 2024-09-13T05:12:58.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122546527 2024-09-13T05:12:58.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:58.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656234+0000", 2024-09-13T05:12:58.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024911300000000003 2024-09-13T05:12:58.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:12:58.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656378+0000", 2024-09-13T05:12:58.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014417100000000001 2024-09-13T05:12:58.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:58.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657916+0000", 2024-09-13T05:12:58.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001537907 2024-09-13T05:12:58.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:12:58.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658308+0000", 2024-09-13T05:12:58.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039183700000000002 2024-09-13T05:12:58.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:12:58.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658364+0000", 2024-09-13T05:12:58.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5451000000000002e-05 2024-09-13T05:12:58.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:58.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658423+0000", 2024-09-13T05:12:58.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9449e-05 2024-09-13T05:12:58.279 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.279 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:58.279 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.279 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162393 3.8 3:113669bf:::rbd_data.112dfd94ee88.00000000000000bf:2a [read 131072~18432] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:58.279 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:58.279 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.706866439000002, 2024-09-13T05:12:58.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124231431, 2024-09-13T05:12:58.279 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:58.279 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:58.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:58.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:58.280 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:58.280 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162393 2024-09-13T05:12:58.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.280 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:58.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:58.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:58.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:58.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:58.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:58.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:12:58.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:58.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:58.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533001+0000", 2024-09-13T05:12:58.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8099999999999999e-06 2024-09-13T05:12:58.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:58.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533007+0000", 2024-09-13T05:12:58.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5849999999999996e-06 2024-09-13T05:12:58.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533012+0000", 2024-09-13T05:12:58.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0320000000000003e-06 2024-09-13T05:12:58.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533459+0000", 2024-09-13T05:12:58.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044646399999999999 2024-09-13T05:12:58.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:58.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533464+0000", 2024-09-13T05:12:58.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9180000000000002e-06 2024-09-13T05:12:58.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656870+0000", 2024-09-13T05:12:58.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123406847 2024-09-13T05:12:58.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:58.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657067+0000", 2024-09-13T05:12:58.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019655599999999999 2024-09-13T05:12:58.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:58.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657229+0000", 2024-09-13T05:12:58.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016175599999999999 2024-09-13T05:12:58.285 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.285 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:58.285 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.285 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162429 3.8 3:14f19076:::rbd_data.112dfd94ee88.0000000000000150:2a [read 131072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:58.285 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:12:58.285 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.706846888999998, 2024-09-13T05:12:58.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124549956, 2024-09-13T05:12:58.285 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:58.285 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:58.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:58.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:58.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:58.286 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162429 2024-09-13T05:12:58.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.286 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:58.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:58.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:12:58.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:58.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:12:58.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:58.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533016+0000", 2024-09-13T05:12:58.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:58.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:58.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533020+0000", 2024-09-13T05:12:58.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1049999999999999e-06 2024-09-13T05:12:58.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:58.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533025+0000", 2024-09-13T05:12:58.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-09-13T05:12:58.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533030+0000", 2024-09-13T05:12:58.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8999999999999997e-06 2024-09-13T05:12:58.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533481+0000", 2024-09-13T05:12:58.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045080400000000002 2024-09-13T05:12:58.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:58.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533486+0000", 2024-09-13T05:12:58.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3369999999999999e-06 2024-09-13T05:12:58.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657311+0000", 2024-09-13T05:12:58.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123824408 2024-09-13T05:12:58.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:58.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657464+0000", 2024-09-13T05:12:58.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015343900000000001 2024-09-13T05:12:58.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:58.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657567+0000", 2024-09-13T05:12:58.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102568 2024-09-13T05:12:58.291 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.291 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:58.291 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.291 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162521 3.8 3:13efd60f:::rbd_data.112dfd94ee88.000000000000031a:2a [read 131072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:58.291 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:58.291 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.706695656000001, 2024-09-13T05:12:58.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124709257, 2024-09-13T05:12:58.292 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:58.292 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:58.292 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:58.292 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:58.292 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:58.292 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162521 2024-09-13T05:12:58.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.292 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:58.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:58.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:58.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:58.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:58.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:58.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:12:58.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:58.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:58.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533170+0000", 2024-09-13T05:12:58.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3910000000000001e-06 2024-09-13T05:12:58.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:58.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533176+0000", 2024-09-13T05:12:58.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4029999999999998e-06 2024-09-13T05:12:58.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533180+0000", 2024-09-13T05:12:58.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6999999999999999e-06 2024-09-13T05:12:58.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533659+0000", 2024-09-13T05:12:58.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047839699999999998 2024-09-13T05:12:58.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:58.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533664+0000", 2024-09-13T05:12:58.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7239999999999997e-06 2024-09-13T05:12:58.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657619+0000", 2024-09-13T05:12:58.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123954412 2024-09-13T05:12:58.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:58.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657784+0000", 2024-09-13T05:12:58.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016527499999999999 2024-09-13T05:12:58.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:58.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657877+0000", 2024-09-13T05:12:58.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3280000000000001e-05 2024-09-13T05:12:58.297 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.297 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:58.298 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.298 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162618 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 70656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:58.298 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:12:58.298 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.705390946000001, 2024-09-13T05:12:58.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123752711, 2024-09-13T05:12:58.298 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:58.298 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:58.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:58.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:58.299 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:58.299 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162618 2024-09-13T05:12:58.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.299 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:58.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:58.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:12:58.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:58.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:12:58.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:58.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534472+0000", 2024-09-13T05:12:58.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:58.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:58.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534475+0000", 2024-09-13T05:12:58.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2010000000000002e-06 2024-09-13T05:12:58.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:58.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534482+0000", 2024-09-13T05:12:58.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:12:58.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534486+0000", 2024-09-13T05:12:58.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7520000000000004e-06 2024-09-13T05:12:58.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536456+0000", 2024-09-13T05:12:58.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001969527 2024-09-13T05:12:58.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:58.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536462+0000", 2024-09-13T05:12:58.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2750000000000001e-06 2024-09-13T05:12:58.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657939+0000", 2024-09-13T05:12:58.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121476769 2024-09-13T05:12:58.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:58.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658087+0000", 2024-09-13T05:12:58.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014862400000000001 2024-09-13T05:12:58.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:58.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658225+0000", 2024-09-13T05:12:58.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013800999999999999 2024-09-13T05:12:58.304 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.304 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:58.304 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.304 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162620 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 71680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:58.304 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:58.304 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.705356821000002, 2024-09-13T05:12:58.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124087688, 2024-09-13T05:12:58.305 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:58.305 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:58.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:58.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:58.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:58.305 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162620 2024-09-13T05:12:58.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.305 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:58.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:58.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:58.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:58.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:58.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:58.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:12:58.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:58.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:58.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534509+0000", 2024-09-13T05:12:58.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1270000000000001e-06 2024-09-13T05:12:58.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:58.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534514+0000", 2024-09-13T05:12:58.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8720000000000001e-06 2024-09-13T05:12:58.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534518+0000", 2024-09-13T05:12:58.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5090000000000004e-06 2024-09-13T05:12:58.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536485+0000", 2024-09-13T05:12:58.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019671530000000001 2024-09-13T05:12:58.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:58.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536491+0000", 2024-09-13T05:12:58.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3759999999999999e-06 2024-09-13T05:12:58.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658466+0000", 2024-09-13T05:12:58.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121975466 2024-09-13T05:12:58.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:58.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658522+0000", 2024-09-13T05:12:58.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5668999999999998e-05 2024-09-13T05:12:58.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:58.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658595+0000", 2024-09-13T05:12:58.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2800999999999996e-05 2024-09-13T05:12:58.310 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.311 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:58.311 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.311 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162622 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 72704~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:58.311 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:12:58.311 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.705325854000002, 2024-09-13T05:12:58.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124215569, 2024-09-13T05:12:58.311 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:58.311 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:58.311 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:58.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:58.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:58.312 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162622 2024-09-13T05:12:58.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.312 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:58.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:58.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:12:58.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:58.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:12:58.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:58.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534537+0000", 2024-09-13T05:12:58.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:58.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:58.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534540+0000", 2024-09-13T05:12:58.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3740000000000001e-06 2024-09-13T05:12:58.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:58.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534545+0000", 2024-09-13T05:12:58.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4210000000000003e-06 2024-09-13T05:12:58.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534550+0000", 2024-09-13T05:12:58.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3090000000000003e-06 2024-09-13T05:12:58.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536510+0000", 2024-09-13T05:12:58.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019597130000000001 2024-09-13T05:12:58.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:58.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536517+0000", 2024-09-13T05:12:58.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0620000000000003e-06 2024-09-13T05:12:58.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658632+0000", 2024-09-13T05:12:58.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122114373 2024-09-13T05:12:58.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:58.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658686+0000", 2024-09-13T05:12:58.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3882999999999999e-05 2024-09-13T05:12:58.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:58.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658753+0000", 2024-09-13T05:12:58.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7921000000000002e-05 2024-09-13T05:12:58.317 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.317 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:58.317 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.317 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162623 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 73728~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:58.317 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:12:58.317 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.705309049, 2024-09-13T05:12:58.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124350214, 2024-09-13T05:12:58.318 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:58.318 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:58.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:58.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:58.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:58.318 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162623 2024-09-13T05:12:58.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.318 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:58.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:58.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:12:58.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:58.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:12:58.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:58.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534554+0000", 2024-09-13T05:12:58.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:58.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:58.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534556+0000", 2024-09-13T05:12:58.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-13T05:12:58.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:58.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534563+0000", 2024-09-13T05:12:58.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2890000000000003e-06 2024-09-13T05:12:58.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534567+0000", 2024-09-13T05:12:58.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4880000000000001e-06 2024-09-13T05:12:58.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536538+0000", 2024-09-13T05:12:58.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019703989999999998 2024-09-13T05:12:58.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:58.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536543+0000", 2024-09-13T05:12:58.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3920000000000002e-06 2024-09-13T05:12:58.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658773+0000", 2024-09-13T05:12:58.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122229607 2024-09-13T05:12:58.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:58.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658835+0000", 2024-09-13T05:12:58.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1954999999999999e-05 2024-09-13T05:12:58.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:58.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658905+0000", 2024-09-13T05:12:58.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-09-13T05:12:58.323 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.323 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:58.323 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.323 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162626 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 65536~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:58.324 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:58.324 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.705257764999999, 2024-09-13T05:12:58.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124425881, 2024-09-13T05:12:58.324 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:58.324 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:58.324 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:58.324 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:58.324 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:58.324 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162626 2024-09-13T05:12:58.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.325 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:58.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:58.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:58.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:58.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:58.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:58.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:12:58.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:58.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:58.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534611+0000", 2024-09-13T05:12:58.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5419999999999996e-06 2024-09-13T05:12:58.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:58.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534617+0000", 2024-09-13T05:12:58.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5169999999999999e-06 2024-09-13T05:12:58.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534622+0000", 2024-09-13T05:12:58.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9810000000000003e-06 2024-09-13T05:12:58.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536563+0000", 2024-09-13T05:12:58.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019410549999999999 2024-09-13T05:12:58.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:58.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536568+0000", 2024-09-13T05:12:58.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4310000000000002e-06 2024-09-13T05:12:58.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658922+0000", 2024-09-13T05:12:58.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122354221 2024-09-13T05:12:58.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:58.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658968+0000", 2024-09-13T05:12:58.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5221e-05 2024-09-13T05:12:58.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:58.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659032+0000", 2024-09-13T05:12:58.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4256000000000003e-05 2024-09-13T05:12:58.330 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.330 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:58.330 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.330 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162628 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 66560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:58.330 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:58.331 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.705222814000003, 2024-09-13T05:12:58.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124532254, 2024-09-13T05:12:58.331 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:58.331 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:58.331 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:58.331 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:58.331 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:58.331 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162628 2024-09-13T05:12:58.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.331 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:58.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:58.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:58.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:58.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:58.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:58.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:12:58.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:58.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:58.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534643+0000", 2024-09-13T05:12:58.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1890000000000001e-06 2024-09-13T05:12:58.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:58.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534648+0000", 2024-09-13T05:12:58.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:12:58.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534652+0000", 2024-09-13T05:12:58.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4549999999999997e-06 2024-09-13T05:12:58.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536586+0000", 2024-09-13T05:12:58.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019336049999999999 2024-09-13T05:12:58.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:58.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536591+0000", 2024-09-13T05:12:58.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3770000000000004e-06 2024-09-13T05:12:58.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659062+0000", 2024-09-13T05:12:58.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122470685 2024-09-13T05:12:58.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:58.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659106+0000", 2024-09-13T05:12:58.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3856000000000002e-05 2024-09-13T05:12:58.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:58.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659173+0000", 2024-09-13T05:12:58.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7168000000000005e-05 2024-09-13T05:12:58.337 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.337 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:58.337 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.337 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162630 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 67584~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:58.337 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:58.337 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.705189607999998, 2024-09-13T05:12:58.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12468555100000001, 2024-09-13T05:12:58.337 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:58.337 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:58.338 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:58.338 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:58.338 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:58.338 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162630 2024-09-13T05:12:58.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.338 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:58.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:58.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:58.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:58.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:58.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:58.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:12:58.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:58.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:58.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534676+0000", 2024-09-13T05:12:58.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4399999999999999e-06 2024-09-13T05:12:58.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:58.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534681+0000", 2024-09-13T05:12:58.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2349999999999999e-06 2024-09-13T05:12:58.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534686+0000", 2024-09-13T05:12:58.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5499999999999996e-06 2024-09-13T05:12:58.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536609+0000", 2024-09-13T05:12:58.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001923407 2024-09-13T05:12:58.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:58.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536615+0000", 2024-09-13T05:12:58.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1499999999999998e-06 2024-09-13T05:12:58.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659233+0000", 2024-09-13T05:12:58.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122618957 2024-09-13T05:12:58.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:58.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659294+0000", 2024-09-13T05:12:58.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0251000000000003e-05 2024-09-13T05:12:58.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:58.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659360+0000", 2024-09-13T05:12:58.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5906000000000002e-05 2024-09-13T05:12:58.344 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.344 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:58.344 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.344 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162633 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 69632~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:58.344 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:58.344 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.705081702999998, 2024-09-13T05:12:58.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124702147, 2024-09-13T05:12:58.345 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:58.345 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:58.345 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:58.345 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:58.345 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:58.345 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162633 2024-09-13T05:12:58.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.345 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:58.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:58.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:58.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:58.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:58.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:58.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:12:58.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:58.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:58.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534784+0000", 2024-09-13T05:12:58.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3300000000000001e-06 2024-09-13T05:12:58.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:58.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534789+0000", 2024-09-13T05:12:58.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4149999999999998e-06 2024-09-13T05:12:58.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534794+0000", 2024-09-13T05:12:58.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5669999999999996e-06 2024-09-13T05:12:58.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536634+0000", 2024-09-13T05:12:58.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001840401 2024-09-13T05:12:58.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:58.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536642+0000", 2024-09-13T05:12:58.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9729999999999997e-06 2024-09-13T05:12:58.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659383+0000", 2024-09-13T05:12:58.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12274112099999999 2024-09-13T05:12:58.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:58.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659424+0000", 2024-09-13T05:12:58.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0936000000000002e-05 2024-09-13T05:12:58.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:58.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659484+0000", 2024-09-13T05:12:58.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9775000000000003e-05 2024-09-13T05:12:58.350 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.350 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:58.351 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.351 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162675 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 68608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:58.351 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:58.351 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.705032658999997, 2024-09-13T05:12:58.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124823974, 2024-09-13T05:12:58.351 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:58.351 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:58.351 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:58.351 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:58.352 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:58.352 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162675 2024-09-13T05:12:58.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.352 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:58.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:58.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:58.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:58.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:58.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:58.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:12:58.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:58.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:58.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534833+0000", 2024-09-13T05:12:58.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.204e-06 2024-09-13T05:12:58.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:58.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534838+0000", 2024-09-13T05:12:58.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0130000000000001e-06 2024-09-13T05:12:58.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534842+0000", 2024-09-13T05:12:58.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.51e-06 2024-09-13T05:12:58.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536661+0000", 2024-09-13T05:12:58.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018186039999999999 2024-09-13T05:12:58.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:58.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536667+0000", 2024-09-13T05:12:58.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5260000000000001e-06 2024-09-13T05:12:58.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659531+0000", 2024-09-13T05:12:58.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122864403 2024-09-13T05:12:58.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:58.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659583+0000", 2024-09-13T05:12:58.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1564000000000003e-05 2024-09-13T05:12:58.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:58.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659655+0000", 2024-09-13T05:12:58.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2504999999999998e-05 2024-09-13T05:12:58.357 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.357 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:58.357 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.357 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:163257 3.8 3:1136e8de:::rbd_data.112dbd21872d.000000000000003c:28 [read 200704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:12:58.357 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:58.357 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.690017453000003, 2024-09-13T05:12:58.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12163807, 2024-09-13T05:12:58.357 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:58.358 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:12:58.358 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:58.358 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:58.358 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:58.358 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 163257 2024-09-13T05:12:58.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.358 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:58.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:58.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:58.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:58.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:58.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:58.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:12:58.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:58.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:58.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549848+0000", 2024-09-13T05:12:58.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1789999999999998e-06 2024-09-13T05:12:58.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:58.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549854+0000", 2024-09-13T05:12:58.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9050000000000002e-06 2024-09-13T05:12:58.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549858+0000", 2024-09-13T05:12:58.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3529999999999997e-06 2024-09-13T05:12:58.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.551228+0000", 2024-09-13T05:12:58.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001369227 2024-09-13T05:12:58.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:58.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.551233+0000", 2024-09-13T05:12:58.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5860000000000004e-06 2024-09-13T05:12:58.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671337+0000", 2024-09-13T05:12:58.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.120104265 2024-09-13T05:12:58.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:58.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671425+0000", 2024-09-13T05:12:58.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7810000000000001e-05 2024-09-13T05:12:58.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:58.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671484+0000", 2024-09-13T05:12:58.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9079000000000001e-05 2024-09-13T05:12:58.363 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.363 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:58.364 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.364 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:170203 3.1e 3:7c9b1cf4:::rbd_header.112dc3abcba6:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128)", 2024-09-13T05:12:58.364 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:12:58.364 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 37.425053687999998, 2024-09-13T05:12:58.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.79948714899999995, 2024-09-13T05:12:58.364 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:12:58.364 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:58.364 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:12:58.364 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:12:58.365 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:58.365 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 170203 2024-09-13T05:12:58.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.365 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:12:58.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:12:58.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:12:58.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:12:58.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:12:58.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:12:58.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:12:58.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814808+0000", 2024-09-13T05:12:58.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:58.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:12:58.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814820+0000", 2024-09-13T05:12:58.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.206e-05 2024-09-13T05:12:58.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:12:58.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814841+0000", 2024-09-13T05:12:58.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1464999999999999e-05 2024-09-13T05:12:58.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814853+0000", 2024-09-13T05:12:58.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1824999999999999e-05 2024-09-13T05:12:58.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814911+0000", 2024-09-13T05:12:58.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8255999999999999e-05 2024-09-13T05:12:58.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:12:58.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814918+0000", 2024-09-13T05:12:58.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7120000000000003e-06 2024-09-13T05:12:58.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:12:58.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.611660+0000", 2024-09-13T05:12:58.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.79674180100000003 2024-09-13T05:12:58.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:12:58.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.611911+0000", 2024-09-13T05:12:58.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025108900000000002 2024-09-13T05:12:58.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-13T05:12:58.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.612726+0000", 2024-09-13T05:12:58.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00081512999999999996 2024-09-13T05:12:58.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:58.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614087+0000", 2024-09-13T05:12:58.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013607560000000001 2024-09-13T05:12:58.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:12:58.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614095+0000", 2024-09-13T05:12:58.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3240000000000003e-06 2024-09-13T05:12:58.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:12:58.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614138+0000", 2024-09-13T05:12:58.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3115000000000003e-05 2024-09-13T05:12:58.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:12:58.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:12:58.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:12:58.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614297+0000", 2024-09-13T05:12:58.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015875399999999999 2024-09-13T05:12:58.372 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.372 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:58.372 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.372 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:12:58.372 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:12:58.372 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:12:58.374 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:12:58.375 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:58.370+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:58.475 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:58.471+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:58.490 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:58.490 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:58.490 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:58.490 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:58.499 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:12:58.575 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:12:58.571+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:12:58.609 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:58.609 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:58.609 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:58.609 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:58.609 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:58.618 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:12:58.676 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:58.671+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:58.746 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:58.746 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:58.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:58.746 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:58.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.746 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.1 144/143 [PushOp(3:84db47f5:::rbd_data.112d9735e8af.0000000000000002:head, version: 47'61, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:84db47f5:::rbd_data.112d9735e8af.0000000000000002:head@47'61, size: 6291456, copy_subset: [0~6291456], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:58.746 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:39.672152+0000", 2024-09-13T05:12:58.746 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.063754428999999, 2024-09-13T05:12:58.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0047065179999999998, 2024-09-13T05:12:58.746 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:58.746 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:58.747 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:58.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:58.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.672152+0000", 2024-09-13T05:12:58.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:58.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.672152+0000", 2024-09-13T05:12:58.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:58.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.672151+0000", 2024-09-13T05:12:58.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:58.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:58.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.674487+0000", 2024-09-13T05:12:58.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023360939999999999 2024-09-13T05:12:58.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:58.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.674523+0000", 2024-09-13T05:12:58.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6582000000000003e-05 2024-09-13T05:12:58.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.674556+0000", 2024-09-13T05:12:58.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2103000000000001e-05 2024-09-13T05:12:58.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.749 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:58.749 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.674687+0000", 2024-09-13T05:12:58.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013118099999999999 2024-09-13T05:12:58.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:58.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.674709+0000", 2024-09-13T05:12:58.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2509000000000001e-05 2024-09-13T05:12:58.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:58.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.676859+0000", 2024-09-13T05:12:58.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021497450000000002 2024-09-13T05:12:58.750 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.750 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:58.750 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.751 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.1 144/143 [PushOp(3:84db47f5:::rbd_data.112d9735e8af.0000000000000002:head, version: 47'61, data_included: [1048576~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:84db47f5:::rbd_data.112d9735e8af.0000000000000002:head@47'61, size: 6291456, copy_subset: [0~6291456], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:2097152, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", 2024-09-13T05:12:58.751 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:39.678212+0000", 2024-09-13T05:12:58.751 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.057695077000002, 2024-09-13T05:12:58.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0044025239999999997, 2024-09-13T05:12:58.751 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:58.751 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:58.751 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:58.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:58.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.678212+0000", 2024-09-13T05:12:58.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:58.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.678212+0000", 2024-09-13T05:12:58.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:58.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.678210+0000", 2024-09-13T05:12:58.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:58.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:58.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.680365+0000", 2024-09-13T05:12:58.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021552479999999998 2024-09-13T05:12:58.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:58.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.680404+0000", 2024-09-13T05:12:58.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.858e-05 2024-09-13T05:12:58.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.680433+0000", 2024-09-13T05:12:58.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9145e-05 2024-09-13T05:12:58.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:58.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.680563+0000", 2024-09-13T05:12:58.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012996399999999999 2024-09-13T05:12:58.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:58.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.680586+0000", 2024-09-13T05:12:58.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3076999999999999e-05 2024-09-13T05:12:58.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.754 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:58.754 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.682614+0000", 2024-09-13T05:12:58.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020281600000000002 2024-09-13T05:12:58.754 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.755 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:58.755 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.755 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.1 144/143 [PushOp(3:8231b51f:::rbd_data.112d8ff9b77a.0000000000000005:1d, version: 81'189, data_included: [0~753664,786432~294912], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:8231b51f:::rbd_data.112d8ff9b77a.0000000000000005:1d@81'189, size: 1572864, copy_subset: [0~1572864], clone_subset: {}, snapset: 1d=[]:{1d=[1d]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1081344, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:58.755 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:39.880889+0000", 2024-09-13T05:12:58.755 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.85501829, 2024-09-13T05:12:58.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0046534849999999997, 2024-09-13T05:12:58.755 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:58.755 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:58.755 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:58.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:58.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.880889+0000", 2024-09-13T05:12:58.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:58.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.880889+0000", 2024-09-13T05:12:58.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:58.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.880887+0000", 2024-09-13T05:12:58.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:58.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:58.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.883013+0000", 2024-09-13T05:12:58.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021263649999999999 2024-09-13T05:12:58.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:58.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.883043+0000", 2024-09-13T05:12:58.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0009e-05 2024-09-13T05:12:58.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.883075+0000", 2024-09-13T05:12:58.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1798999999999998e-05 2024-09-13T05:12:58.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:58.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.883245+0000", 2024-09-13T05:12:58.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000169915 2024-09-13T05:12:58.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:58.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.883265+0000", 2024-09-13T05:12:58.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9711000000000002e-05 2024-09-13T05:12:58.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:58.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:39.885542+0000", 2024-09-13T05:12:58.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772230000000001 2024-09-13T05:12:58.759 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.759 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:58.759 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.759 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "MOSDPGPush(3.9 145/143 [PushOp(3:9731cd35:::rbd_data.112db114688b.0000000000000000:head, version: 53'108, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:9731cd35:::rbd_data.112db114688b.0000000000000000:head@53'108, size: 3145728, copy_subset: [0~3145728], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:1048576, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-13T05:12:58.759 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:40.330580+0000", 2024-09-13T05:12:58.759 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.405326540000001, 2024-09-13T05:12:58.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0046015459999999998, 2024-09-13T05:12:58.759 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:58.759 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:58.759 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:58.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:58.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.330580+0000", 2024-09-13T05:12:58.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:58.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.330580+0000", 2024-09-13T05:12:58.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:58.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.330579+0000", 2024-09-13T05:12:58.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:58.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:58.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.332494+0000", 2024-09-13T05:12:58.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0019150700000000001 2024-09-13T05:12:58.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:58.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.332536+0000", 2024-09-13T05:12:58.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1798999999999997e-05 2024-09-13T05:12:58.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.332565+0000", 2024-09-13T05:12:58.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9505999999999998e-05 2024-09-13T05:12:58.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:58.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.332747+0000", 2024-09-13T05:12:58.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018156300000000001 2024-09-13T05:12:58.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:58.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.332779+0000", 2024-09-13T05:12:58.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2546000000000003e-05 2024-09-13T05:12:58.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.763 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:58.763 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.335182+0000", 2024-09-13T05:12:58.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002402702 2024-09-13T05:12:58.763 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.763 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:58.763 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.763 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:201991 3.3 e151/143 3:c56b8e2d:::rbd_object_map.112d69c7209a:head v 151'854, mlcod=25'1)", 2024-09-13T05:12:58.763 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:45.651210+0000", 2024-09-13T05:12:58.763 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.084696868, 2024-09-13T05:12:58.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0048597409999999999, 2024-09-13T05:12:58.763 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:58.763 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:58.764 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:58.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:58.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.651210+0000", 2024-09-13T05:12:58.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:58.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.651210+0000", 2024-09-13T05:12:58.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:58.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.651209+0000", 2024-09-13T05:12:58.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:58.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:58.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.651217+0000", 2024-09-13T05:12:58.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5340000000000002e-06 2024-09-13T05:12:58.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:58.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.651225+0000", 2024-09-13T05:12:58.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.3340000000000002e-06 2024-09-13T05:12:58.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.651232+0000", 2024-09-13T05:12:58.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5880000000000003e-06 2024-09-13T05:12:58.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:58.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.653107+0000", 2024-09-13T05:12:58.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0018757240000000001 2024-09-13T05:12:58.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:58.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.653128+0000", 2024-09-13T05:12:58.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0801e-05 2024-09-13T05:12:58.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:58.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.656041+0000", 2024-09-13T05:12:58.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002912984 2024-09-13T05:12:58.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:58.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:45.656070+0000", 2024-09-13T05:12:58.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8710000000000001e-05 2024-09-13T05:12:58.767 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.767 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:58.767 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.767 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7312 3.13 e159/153 3:ce615828:::rbd_data.112dbd21872d.000000000000000f:28 v 159'1216, mlcod=158'1213)", 2024-09-13T05:12:58.768 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.645274+0000", 2024-09-13T05:12:58.768 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.0906326919999998, 2024-09-13T05:12:58.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0050366250000000003, 2024-09-13T05:12:58.768 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:58.768 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:58.768 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:58.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:58.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.645274+0000", 2024-09-13T05:12:58.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.769 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:58.769 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.645274+0000", 2024-09-13T05:12:58.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.769 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:58.769 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.645274+0000", 2024-09-13T05:12:58.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:58.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.769 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:58.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.645280+0000", 2024-09-13T05:12:58.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9000000000000003e-06 2024-09-13T05:12:58.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:58.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.645286+0000", 2024-09-13T05:12:58.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3149999999999997e-06 2024-09-13T05:12:58.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.645291+0000", 2024-09-13T05:12:58.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.04e-06 2024-09-13T05:12:58.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:58.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.645370+0000", 2024-09-13T05:12:58.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8996000000000001e-05 2024-09-13T05:12:58.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:58.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.645392+0000", 2024-09-13T05:12:58.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2362999999999999e-05 2024-09-13T05:12:58.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:58.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.650153+0000", 2024-09-13T05:12:58.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0047611040000000004 2024-09-13T05:12:58.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:58.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.650311+0000", 2024-09-13T05:12:58.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000157362 2024-09-13T05:12:58.772 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.772 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:58.772 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.773 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7315 3.13 e159/153 3:cd8e2485:::rbd_data.112dbd21872d.0000000000000251:28 v 159'1218, mlcod=158'1213)", 2024-09-13T05:12:58.773 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.647328+0000", 2024-09-13T05:12:58.773 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.0885787069999999, 2024-09-13T05:12:58.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0051515930000000003, 2024-09-13T05:12:58.773 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:58.773 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:58.773 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:58.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:58.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.647328+0000", 2024-09-13T05:12:58.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:58.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.647328+0000", 2024-09-13T05:12:58.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:58.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.647327+0000", 2024-09-13T05:12:58.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:58.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:58.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.647336+0000", 2024-09-13T05:12:58.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8319999999999995e-06 2024-09-13T05:12:58.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:58.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.647351+0000", 2024-09-13T05:12:58.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5226e-05 2024-09-13T05:12:58.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.647360+0000", 2024-09-13T05:12:58.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2029999999999992e-06 2024-09-13T05:12:58.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:58.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.647538+0000", 2024-09-13T05:12:58.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017795500000000001 2024-09-13T05:12:58.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:58.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.647569+0000", 2024-09-13T05:12:58.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1636e-05 2024-09-13T05:12:58.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:58.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.652446+0000", 2024-09-13T05:12:58.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0048766629999999998 2024-09-13T05:12:58.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:58.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.652480+0000", 2024-09-13T05:12:58.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3927000000000002e-05 2024-09-13T05:12:58.778 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.778 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:58.778 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.778 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203004 3.1a 3:5a99807b:::rbd_object_map.112dbd21872d:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159)", 2024-09-13T05:12:58.778 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.649669+0000", 2024-09-13T05:12:58.778 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.0862374270000004, 2024-09-13T05:12:58.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0064520619999999997, 2024-09-13T05:12:58.779 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:58.779 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:58.779 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:58.779 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:58.779 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:58.779 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203004 2024-09-13T05:12:58.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.779 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:58.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:58.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649669+0000", 2024-09-13T05:12:58.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:58.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649669+0000", 2024-09-13T05:12:58.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:58.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649668+0000", 2024-09-13T05:12:58.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:58.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:58.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649676+0000", 2024-09-13T05:12:58.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0020000000000006e-06 2024-09-13T05:12:58.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.781 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:58.781 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649686+0000", 2024-09-13T05:12:58.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0702e-05 2024-09-13T05:12:58.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649694+0000", 2024-09-13T05:12:58.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9370000000000004e-06 2024-09-13T05:12:58.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:58.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.650848+0000", 2024-09-13T05:12:58.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0011532020000000001 2024-09-13T05:12:58.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:58.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.650973+0000", 2024-09-13T05:12:58.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012510099999999999 2024-09-13T05:12:58.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:12:58.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.651197+0000", 2024-09-13T05:12:58.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00022407899999999999 2024-09-13T05:12:58.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:58.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.653302+0000", 2024-09-13T05:12:58.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021053629999999999 2024-09-13T05:12:58.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:12:58.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655437+0000", 2024-09-13T05:12:58.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002135348 2024-09-13T05:12:58.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:58.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655500+0000", 2024-09-13T05:12:58.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2453999999999995e-05 2024-09-13T05:12:58.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:58.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656122+0000", 2024-09-13T05:12:58.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00062160299999999998 2024-09-13T05:12:58.785 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.785 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:58.785 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.785 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.3.0:5114 3.b e159/149 3:d13d0bb6:::rbd_data.112dbd21872d.000000000000000c:28 v 159'614, mlcod=158'611)", 2024-09-13T05:12:58.785 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.655063+0000", 2024-09-13T05:12:58.785 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.080844355, 2024-09-13T05:12:58.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0057558009999999996, 2024-09-13T05:12:58.786 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:58.786 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:58.786 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:58.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.786 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:58.786 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655063+0000", 2024-09-13T05:12:58.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.786 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:58.786 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655063+0000", 2024-09-13T05:12:58.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:58.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655062+0000", 2024-09-13T05:12:58.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:58.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:58.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655070+0000", 2024-09-13T05:12:58.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5059999999999995e-06 2024-09-13T05:12:58.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:58.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655092+0000", 2024-09-13T05:12:58.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2310000000000002e-05 2024-09-13T05:12:58.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655105+0000", 2024-09-13T05:12:58.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2432999999999999e-05 2024-09-13T05:12:58.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:58.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655154+0000", 2024-09-13T05:12:58.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8673e-05 2024-09-13T05:12:58.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:58.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655171+0000", 2024-09-13T05:12:58.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7487999999999999e-05 2024-09-13T05:12:58.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:58.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.660765+0000", 2024-09-13T05:12:58.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0055935209999999997 2024-09-13T05:12:58.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:58.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.660818+0000", 2024-09-13T05:12:58.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3769e-05 2024-09-13T05:12:58.790 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.790 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:58.790 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.790 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7318 3.13 e159/153 3:cf0a521c:::rbd_data.112dbd21872d.0000000000000004:28 v 159'1220, mlcod=159'1216)", 2024-09-13T05:12:58.790 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.655897+0000", 2024-09-13T05:12:58.790 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.0800096330000004, 2024-09-13T05:12:58.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0075974520000000002, 2024-09-13T05:12:58.790 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:58.790 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:58.790 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:58.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:58.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655897+0000", 2024-09-13T05:12:58.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:58.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655897+0000", 2024-09-13T05:12:58.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:58.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655897+0000", 2024-09-13T05:12:58.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:58.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655906+0000", 2024-09-13T05:12:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6290000000000005e-06 2024-09-13T05:12:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655916+0000", 2024-09-13T05:12:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0079e-05 2024-09-13T05:12:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655923+0000", 2024-09-13T05:12:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1319999999999996e-06 2024-09-13T05:12:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656023+0000", 2024-09-13T05:12:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9747000000000006e-05 2024-09-13T05:12:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656042+0000", 2024-09-13T05:12:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8491999999999998e-05 2024-09-13T05:12:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:58.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.663412+0000", 2024-09-13T05:12:58.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0073701959999999999 2024-09-13T05:12:58.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:58.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.663495+0000", 2024-09-13T05:12:58.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2923000000000005e-05 2024-09-13T05:12:58.794 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.794 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:58.794 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.794 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.3.0:5116 3.b e159/149 3:d32d7958:::rbd_data.112dbd21872d.0000000000000001:28 v 159'616, mlcod=158'611)", 2024-09-13T05:12:58.794 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.655899+0000", 2024-09-13T05:12:58.795 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.0800079499999997, 2024-09-13T05:12:58.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0075096859999999998, 2024-09-13T05:12:58.795 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:58.795 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:58.795 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:58.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:58.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655899+0000", 2024-09-13T05:12:58.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:58.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655899+0000", 2024-09-13T05:12:58.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:58.796 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655898+0000", 2024-09-13T05:12:58.796 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:58.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:58.796 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655907+0000", 2024-09-13T05:12:58.796 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5939999999999994e-06 2024-09-13T05:12:58.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:58.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655916+0000", 2024-09-13T05:12:58.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9840000000000007e-06 2024-09-13T05:12:58.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655923+0000", 2024-09-13T05:12:58.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1350000000000003e-06 2024-09-13T05:12:58.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:58.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656059+0000", 2024-09-13T05:12:58.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013669999999999999 2024-09-13T05:12:58.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.798 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:58.798 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656079+0000", 2024-09-13T05:12:58.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9293e-05 2024-09-13T05:12:58.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.798 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:58.798 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.663368+0000", 2024-09-13T05:12:58.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0072892570000000004 2024-09-13T05:12:58.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.798 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:58.798 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.663409+0000", 2024-09-13T05:12:58.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0614000000000001e-05 2024-09-13T05:12:58.798 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.799 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:58.799 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.799 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.799 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:203005 3.1d e159/145 3:bdc9ac73:::rbd_header.112dbd21872d:head v 159'721, mlcod=159'719)", 2024-09-13T05:12:58.799 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.656243+0000", 2024-09-13T05:12:58.799 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.0796635959999996, 2024-09-13T05:12:58.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0047734680000000003, 2024-09-13T05:12:58.799 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:58.799 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:58.799 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:58.799 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.799 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:58.799 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656243+0000", 2024-09-13T05:12:58.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:58.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656243+0000", 2024-09-13T05:12:58.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:58.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656243+0000", 2024-09-13T05:12:58.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:58.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:58.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656250+0000", 2024-09-13T05:12:58.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6769999999999995e-06 2024-09-13T05:12:58.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:58.801 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656264+0000", 2024-09-13T05:12:58.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4011e-05 2024-09-13T05:12:58.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.801 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656272+0000", 2024-09-13T05:12:58.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3679999999999996e-06 2024-09-13T05:12:58.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:58.802 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656335+0000", 2024-09-13T05:12:58.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3541999999999996e-05 2024-09-13T05:12:58.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.802 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.802 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:58.802 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656362+0000", 2024-09-13T05:12:58.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6792e-05 2024-09-13T05:12:58.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.804 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.804 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:58.804 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.660812+0000", 2024-09-13T05:12:58.804 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.004449784 2024-09-13T05:12:58.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.804 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.804 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:58.804 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.661017+0000", 2024-09-13T05:12:58.804 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000205081 2024-09-13T05:12:58.804 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.804 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:58.804 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.805 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:203007 3.1d e159/145 3:bdc9ac73:::rbd_header.112dbd21872d:head v 159'722, mlcod=159'720)", 2024-09-13T05:12:58.805 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.662037+0000", 2024-09-13T05:12:58.805 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.0738697930000001, 2024-09-13T05:12:58.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0043866310000000002, 2024-09-13T05:12:58.805 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:58.805 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:58.805 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:58.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.805 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:58.805 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.662037+0000", 2024-09-13T05:12:58.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.805 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.806 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:58.806 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.662037+0000", 2024-09-13T05:12:58.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.806 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:58.806 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.662036+0000", 2024-09-13T05:12:58.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:58.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:58.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.662044+0000", 2024-09-13T05:12:58.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9950000000000005e-06 2024-09-13T05:12:58.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:58.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.662059+0000", 2024-09-13T05:12:58.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4531e-05 2024-09-13T05:12:58.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.662065+0000", 2024-09-13T05:12:58.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6669999999999999e-06 2024-09-13T05:12:58.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.808 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:58.808 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.662111+0000", 2024-09-13T05:12:58.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6006e-05 2024-09-13T05:12:58.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.808 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:58.808 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.662137+0000", 2024-09-13T05:12:58.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5996999999999999e-05 2024-09-13T05:12:58.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.809 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:58.809 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.666383+0000", 2024-09-13T05:12:58.809 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0042459300000000002 2024-09-13T05:12:58.809 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.809 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.809 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:58.809 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.666424+0000", 2024-09-13T05:12:58.809 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0472000000000001e-05 2024-09-13T05:12:58.809 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.809 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:58.809 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.810 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.810 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.3.0:5119 3.b e159/149 3:d7928ff2:::rbd_data.112dbd21872d.000000000000003d:28 v 159'618, mlcod=159'614)", 2024-09-13T05:12:58.810 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.664054+0000", 2024-09-13T05:12:58.810 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.0718533490000004, 2024-09-13T05:12:58.810 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0051301250000000001, 2024-09-13T05:12:58.810 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:58.810 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:58.810 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:58.810 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.810 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:58.810 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.664054+0000", 2024-09-13T05:12:58.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:58.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.664054+0000", 2024-09-13T05:12:58.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:58.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.664053+0000", 2024-09-13T05:12:58.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:58.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.812 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:58.812 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.664062+0000", 2024-09-13T05:12:58.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8629999999999997e-06 2024-09-13T05:12:58.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.812 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:58.812 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.664075+0000", 2024-09-13T05:12:58.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3327e-05 2024-09-13T05:12:58.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.664081+0000", 2024-09-13T05:12:58.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9529999999999996e-06 2024-09-13T05:12:58.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:58.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.664121+0000", 2024-09-13T05:12:58.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9876999999999998e-05 2024-09-13T05:12:58.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.813 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:58.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.664141+0000", 2024-09-13T05:12:58.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0428000000000002e-05 2024-09-13T05:12:58.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:58.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.669132+0000", 2024-09-13T05:12:58.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0049911249999999999 2024-09-13T05:12:58.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.814 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:58.814 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.669184+0000", 2024-09-13T05:12:58.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1400000000000003e-05 2024-09-13T05:12:58.815 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.815 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:58.815 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.815 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.815 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7322 3.e e159/151 3:70c69f8c:::rbd_data.112dbd21872d.0000000000000252:28 v 159'1049, mlcod=157'1046)", 2024-09-13T05:12:58.815 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.667192+0000", 2024-09-13T05:12:58.815 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.0687153719999998, 2024-09-13T05:12:58.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0048663430000000004, 2024-09-13T05:12:58.816 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:58.816 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:58.816 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:58.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:58.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.667192+0000", 2024-09-13T05:12:58.816 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:58.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.667192+0000", 2024-09-13T05:12:58.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:58.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.667191+0000", 2024-09-13T05:12:58.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:58.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:58.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.667201+0000", 2024-09-13T05:12:58.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353999999999999e-05 2024-09-13T05:12:58.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:58.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.667214+0000", 2024-09-13T05:12:58.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2819e-05 2024-09-13T05:12:58.818 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.667227+0000", 2024-09-13T05:12:58.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3514e-05 2024-09-13T05:12:58.818 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:58.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.667291+0000", 2024-09-13T05:12:58.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3314999999999999e-05 2024-09-13T05:12:58.818 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.819 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:58.819 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.667306+0000", 2024-09-13T05:12:58.819 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5594999999999999e-05 2024-09-13T05:12:58.819 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.819 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.819 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:58.819 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.671971+0000", 2024-09-13T05:12:58.819 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0046650320000000004 2024-09-13T05:12:58.819 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.819 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.819 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:58.819 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672058+0000", 2024-09-13T05:12:58.819 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6705000000000004e-05 2024-09-13T05:12:58.819 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.820 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:58.820 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.820 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7323 3.e e159/151 3:742bfecb:::rbd_data.112dbd21872d.0000000000000018:28 v 159'1051, mlcod=157'1046)", 2024-09-13T05:12:58.820 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.668166+0000", 2024-09-13T05:12:58.820 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.0677407560000001, 2024-09-13T05:12:58.820 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0065306610000000001, 2024-09-13T05:12:58.820 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:58.820 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:58.820 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:58.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.821 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:58.821 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668166+0000", 2024-09-13T05:12:58.821 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.821 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.821 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:58.821 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668166+0000", 2024-09-13T05:12:58.821 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.821 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.821 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:58.821 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668165+0000", 2024-09-13T05:12:58.821 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:58.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.822 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.822 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:58.822 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668174+0000", 2024-09-13T05:12:58.822 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.3790000000000006e-06 2024-09-13T05:12:58.822 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.822 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.822 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:58.822 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668187+0000", 2024-09-13T05:12:58.822 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3172e-05 2024-09-13T05:12:58.822 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.822 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.822 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.822 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668208+0000", 2024-09-13T05:12:58.822 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0713999999999999e-05 2024-09-13T05:12:58.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:58.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668272+0000", 2024-09-13T05:12:58.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4453000000000001e-05 2024-09-13T05:12:58.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:58.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668289+0000", 2024-09-13T05:12:58.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7331000000000001e-05 2024-09-13T05:12:58.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.823 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:58.823 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.674630+0000", 2024-09-13T05:12:58.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0063409340000000003 2024-09-13T05:12:58.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.824 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:58.824 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.674697+0000", 2024-09-13T05:12:58.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6472999999999999e-05 2024-09-13T05:12:58.824 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.824 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:58.824 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.824 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7324 3.f e159/150 3:f534c371:::rbd_data.112dbd21872d.0000000000000017:28 v 159'871, mlcod=158'868)", 2024-09-13T05:12:58.824 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.672502+0000", 2024-09-13T05:12:58.824 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.0634046020000003, 2024-09-13T05:12:58.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.004881753, 2024-09-13T05:12:58.825 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:58.825 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:58.825 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:58.825 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.825 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:58.825 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672502+0000", 2024-09-13T05:12:58.825 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.825 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.825 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:58.825 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672502+0000", 2024-09-13T05:12:58.825 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.826 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.826 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:58.826 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672501+0000", 2024-09-13T05:12:58.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:58.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.826 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.826 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:58.826 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672509+0000", 2024-09-13T05:12:58.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8970000000000008e-06 2024-09-13T05:12:58.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.826 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.826 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:58.826 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672524+0000", 2024-09-13T05:12:58.827 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4558e-05 2024-09-13T05:12:58.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.827 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.827 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.827 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672533+0000", 2024-09-13T05:12:58.827 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3000000000000007e-06 2024-09-13T05:12:58.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.827 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.827 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:58.827 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672595+0000", 2024-09-13T05:12:58.827 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1750999999999999e-05 2024-09-13T05:12:58.828 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.828 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.828 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:58.828 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672619+0000", 2024-09-13T05:12:58.828 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.472e-05 2024-09-13T05:12:58.828 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.828 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:58.829 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.677335+0000", 2024-09-13T05:12:58.829 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0047155720000000003 2024-09-13T05:12:58.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:58.829 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.677384+0000", 2024-09-13T05:12:58.829 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9013e-05 2024-09-13T05:12:58.829 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.829 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:58.829 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.829 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203156 3.9 3:9079854c:::rbd_header.112d52e08ead:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e160)", 2024-09-13T05:12:58.830 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:54.685914+0000", 2024-09-13T05:12:58.830 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.0499928289999998, 2024-09-13T05:12:58.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0085711250000000006, 2024-09-13T05:12:58.830 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:58.830 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:58.830 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:58.830 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:58.830 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:58.830 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203156 2024-09-13T05:12:58.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.830 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:58.831 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.831 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:58.831 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685914+0000", 2024-09-13T05:12:58.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.831 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.831 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:58.831 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685914+0000", 2024-09-13T05:12:58.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.831 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.831 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:58.831 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685912+0000", 2024-09-13T05:12:58.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:58.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.832 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.832 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:58.832 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685924+0000", 2024-09-13T05:12:58.832 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1537e-05 2024-09-13T05:12:58.832 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.832 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.832 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:58.832 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685950+0000", 2024-09-13T05:12:58.832 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6781e-05 2024-09-13T05:12:58.832 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.832 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.832 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.832 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685962+0000", 2024-09-13T05:12:58.832 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1953999999999999e-05 2024-09-13T05:12:58.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.833 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.833 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:58.833 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.686102+0000", 2024-09-13T05:12:58.833 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013926300000000001 2024-09-13T05:12:58.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.833 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.833 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op must wait for map", 2024-09-13T05:12:58.833 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.686115+0000", 2024-09-13T05:12:58.833 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3506000000000001e-05 2024-09-13T05:12:58.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.833 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.833 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:58.833 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.689954+0000", 2024-09-13T05:12:58.833 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0038391810000000001 2024-09-13T05:12:58.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:58.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.690104+0000", 2024-09-13T05:12:58.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014980500000000001 2024-09-13T05:12:58.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 2", 2024-09-13T05:12:58.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.690674+0000", 2024-09-13T05:12:58.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00057014200000000004 2024-09-13T05:12:58.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:58.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.692426+0000", 2024-09-13T05:12:58.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0017518810000000001 2024-09-13T05:12:58.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.835 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:12:58.835 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.694360+0000", 2024-09-13T05:12:58.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0019340819999999999 2024-09-13T05:12:58.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.835 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:58.835 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.694443+0000", 2024-09-13T05:12:58.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2693000000000003e-05 2024-09-13T05:12:58.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.835 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:58.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.694485+0000", 2024-09-13T05:12:58.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2355999999999999e-05 2024-09-13T05:12:58.836 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.836 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:58.836 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.836 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203594 3.1 3:82a5a606:::rbd_object_map.112d841a7de:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163)", 2024-09-13T05:12:58.836 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:57.719919+0000", 2024-09-13T05:12:58.836 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 1.0159875709999999, 2024-09-13T05:12:58.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0058258199999999998, 2024-09-13T05:12:58.836 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:58.836 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:58.836 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:58.837 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:58.837 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:58.837 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203594 2024-09-13T05:12:58.837 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.837 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:58.837 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.837 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:58.837 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.719919+0000", 2024-09-13T05:12:58.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.837 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.837 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.837 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:58.837 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.719919+0000", 2024-09-13T05:12:58.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.838 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.838 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.838 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:58.838 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.719916+0000", 2024-09-13T05:12:58.838 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999967 2024-09-13T05:12:58.838 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.838 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.838 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:58.838 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.719935+0000", 2024-09-13T05:12:58.838 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8637000000000001e-05 2024-09-13T05:12:58.838 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.838 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.838 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:58.839 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.719965+0000", 2024-09-13T05:12:58.839 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0457e-05 2024-09-13T05:12:58.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.839 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.839 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.839 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.719981+0000", 2024-09-13T05:12:58.839 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6359e-05 2024-09-13T05:12:58.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.839 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.839 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:58.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.720066+0000", 2024-09-13T05:12:58.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4710999999999996e-05 2024-09-13T05:12:58.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.840 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op must wait for map", 2024-09-13T05:12:58.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.720072+0000", 2024-09-13T05:12:58.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5300000000000004e-06 2024-09-13T05:12:58.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.840 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:58.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.723400+0000", 2024-09-13T05:12:58.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033279809999999998 2024-09-13T05:12:58.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.841 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:58.841 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.723530+0000", 2024-09-13T05:12:58.841 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013047300000000001 2024-09-13T05:12:58.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.841 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.841 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 3", 2024-09-13T05:12:58.841 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.723708+0000", 2024-09-13T05:12:58.841 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017767400000000001 2024-09-13T05:12:58.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.841 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.841 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:58.841 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.725594+0000", 2024-09-13T05:12:58.841 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0018860960000000001 2024-09-13T05:12:58.842 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.842 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.842 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:12:58.842 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.725617+0000", 2024-09-13T05:12:58.842 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3210999999999999e-05 2024-09-13T05:12:58.842 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.842 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.842 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:58.842 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.725675+0000", 2024-09-13T05:12:58.842 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7899999999999998e-05 2024-09-13T05:12:58.842 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.842 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.842 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:58.842 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.725745+0000", 2024-09-13T05:12:58.843 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0097000000000003e-05 2024-09-13T05:12:58.843 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.843 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:58.843 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.843 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203689 3.1b 3:de67b3cb:::rbd_data.112d841a7de.000000000000000a:head [delete] snapc 24=[] ondisk+write+known_if_redirected+supports_pool_eio e163)", 2024-09-13T05:12:58.843 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:57.847775+0000", 2024-09-13T05:12:58.843 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.88813144799999999, 2024-09-13T05:12:58.843 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0046792559999999997, 2024-09-13T05:12:58.843 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:58.843 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:58.843 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:58.843 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:58.843 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:58.844 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203689 2024-09-13T05:12:58.844 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.844 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:58.844 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.844 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:58.844 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.847775+0000", 2024-09-13T05:12:58.844 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.844 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.844 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.844 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:58.844 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.847775+0000", 2024-09-13T05:12:58.844 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:58.844 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.844 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.845 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:58.845 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.847774+0000", 2024-09-13T05:12:58.845 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:58.845 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.845 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.845 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:58.845 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.847783+0000", 2024-09-13T05:12:58.845 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.482e-06 2024-09-13T05:12:58.845 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.845 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.845 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:58.845 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.847804+0000", 2024-09-13T05:12:58.845 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0845000000000001e-05 2024-09-13T05:12:58.845 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:58.846 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.847818+0000", 2024-09-13T05:12:58.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3824e-05 2024-09-13T05:12:58.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:58.846 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.849271+0000", 2024-09-13T05:12:58.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0014529689999999999 2024-09-13T05:12:58.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:58.846 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.849553+0000", 2024-09-13T05:12:58.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000282594 2024-09-13T05:12:58.847 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.847 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.847 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 7", 2024-09-13T05:12:58.847 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.849750+0000", 2024-09-13T05:12:58.847 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00019693900000000001 2024-09-13T05:12:58.847 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.847 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.847 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:12:58.847 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.852062+0000", 2024-09-13T05:12:58.847 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023120509999999999 2024-09-13T05:12:58.847 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.847 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.848 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:58.848 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.852313+0000", 2024-09-13T05:12:58.848 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000250437 2024-09-13T05:12:58.848 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.848 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.848 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:58.848 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.852394+0000", 2024-09-13T05:12:58.848 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1252000000000001e-05 2024-09-13T05:12:58.848 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:58.848 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:58.848 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:58.848 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.852455+0000", 2024-09-13T05:12:58.848 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0600000000000003e-05 2024-09-13T05:12:58.848 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.849 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:58.849 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.849 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:58.849 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:58.849 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:58.849 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:12:58.850 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:12:58.802+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:12:58.904 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:58.898+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:58.980 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:58.980 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:58.980 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:58.980 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:58.992 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:12:59.042 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:59.035+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:59.102 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:59.102 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:59.102 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:59.102 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:59.102 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:59.106 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:59.103+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:59.112 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:12:59.207 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:59.203+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:59.222 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:59.222 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:59.222 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:59.222 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:59.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.223 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3.bb1d1096 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:59.223 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:59.223 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 95.274299791000004, 2024-09-13T05:12:59.223 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68834410099999999, 2024-09-13T05:12:59.223 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.223 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:59.223 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.223 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.223 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.223 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:12:59.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.223 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.224 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.224 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:59.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.224 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.224 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.224 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:12:59.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.224 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.224 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.224 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943719+0000", 2024-09-13T05:12:59.224 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:12:59.225 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.225 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.225 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.225 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943734+0000", 2024-09-13T05:12:59.225 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4793e-05 2024-09-13T05:12:59.225 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.225 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.225 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.225 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943765+0000", 2024-09-13T05:12:59.225 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0648999999999997e-05 2024-09-13T05:12:59.225 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.225 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.225 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.225 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943779+0000", 2024-09-13T05:12:59.225 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.447e-05 2024-09-13T05:12:59.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943872+0000", 2024-09-13T05:12:59.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3304e-05 2024-09-13T05:12:59.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:59.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943884+0000", 2024-09-13T05:12:59.226 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.167e-05 2024-09-13T05:12:59.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.226 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.226 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.226 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632042+0000", 2024-09-13T05:12:59.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68815832600000004 2024-09-13T05:12:59.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.227 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.227 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632066+0000", 2024-09-13T05:12:59.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3765999999999999e-05 2024-09-13T05:12:59.227 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.227 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.227 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.227 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.227 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3.b6bd6256 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:59.227 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:59.227 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 95.274175291000006, 2024-09-13T05:12:59.227 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68852592499999998, 2024-09-13T05:12:59.228 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.228 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:12:59.228 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.228 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.228 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.228 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:12:59.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.228 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.228 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.228 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.228 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:59.228 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.228 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.229 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.229 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.229 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:12:59.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.229 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.229 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.229 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.229 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943846+0000", 2024-09-13T05:12:59.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:59.229 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.229 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.229 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.229 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943852+0000", 2024-09-13T05:12:59.229 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3820000000000001e-06 2024-09-13T05:12:59.229 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.230 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943876+0000", 2024-09-13T05:12:59.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3995e-05 2024-09-13T05:12:59.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.230 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943898+0000", 2024-09-13T05:12:59.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1838999999999999e-05 2024-09-13T05:12:59.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.230 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.230 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.230 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946457+0000", 2024-09-13T05:12:59.230 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025588910000000002 2024-09-13T05:12:59.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:59.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946499+0000", 2024-09-13T05:12:59.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2814e-05 2024-09-13T05:12:59.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632364+0000", 2024-09-13T05:12:59.231 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68586484999999997 2024-09-13T05:12:59.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.231 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.231 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632372+0000", 2024-09-13T05:12:59.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1659999999999994e-06 2024-09-13T05:12:59.232 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.232 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.232 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.232 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.232 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3:6908b8dd:::rbd_data.112d8d1317eb.000000000000000f:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:59.232 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:59.232 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 95.237031212999995, 2024-09-13T05:12:59.232 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65181049499999999, 2024-09-13T05:12:59.232 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.232 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.232 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.232 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.233 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.233 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:12:59.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.233 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:59.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.233 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.233 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:12:59.233 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.234 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.234 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980989+0000", 2024-09-13T05:12:59.234 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:59.234 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.234 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.234 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.234 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980996+0000", 2024-09-13T05:12:59.234 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2200000000000003e-06 2024-09-13T05:12:59.234 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.234 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.234 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.234 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981011+0000", 2024-09-13T05:12:59.234 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4997000000000001e-05 2024-09-13T05:12:59.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.235 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981025+0000", 2024-09-13T05:12:59.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3604000000000001e-05 2024-09-13T05:12:59.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.235 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.235 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981110+0000", 2024-09-13T05:12:59.235 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4948000000000001e-05 2024-09-13T05:12:59.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:59.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981120+0000", 2024-09-13T05:12:59.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9399999999999997e-06 2024-09-13T05:12:59.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.236 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632425+0000", 2024-09-13T05:12:59.236 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65130460499999998 2024-09-13T05:12:59.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.236 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632587+0000", 2024-09-13T05:12:59.237 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016199500000000001 2024-09-13T05:12:59.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.237 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.237 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632801+0000", 2024-09-13T05:12:59.238 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021459499999999999 2024-09-13T05:12:59.238 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.238 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.238 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.238 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.238 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.238 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3:6a46bd6d:::rbd_data.112d8d1317eb.0000000000000010:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:12:59.238 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:59.238 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 95.236973556999999, 2024-09-13T05:12:59.238 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65213695699999996, 2024-09-13T05:12:59.238 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.238 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.238 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.238 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.239 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.239 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:12:59.239 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.239 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.239 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.239 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.239 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:59.239 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.239 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.239 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.239 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.239 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:59.239 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.240 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.240 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.240 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:12:59.240 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.240 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.240 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.240 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981052+0000", 2024-09-13T05:12:59.240 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4469999999999999e-06 2024-09-13T05:12:59.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.240 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.240 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.240 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981066+0000", 2024-09-13T05:12:59.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3658e-05 2024-09-13T05:12:59.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981073+0000", 2024-09-13T05:12:59.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:12:59.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.241 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.241 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981150+0000", 2024-09-13T05:12:59.241 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7783999999999999e-05 2024-09-13T05:12:59.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:59.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981161+0000", 2024-09-13T05:12:59.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0197000000000001e-05 2024-09-13T05:12:59.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632926+0000", 2024-09-13T05:12:59.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65176517300000003 2024-09-13T05:12:59.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.242 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.242 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633081+0000", 2024-09-13T05:12:59.242 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000155172 2024-09-13T05:12:59.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.243 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.243 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.243 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633185+0000", 2024-09-13T05:12:59.243 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000104329 2024-09-13T05:12:59.243 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.243 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.243 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.243 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.243 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.243 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:159585 3.1c 3:3afcc414:::rbd_data.112dfd94ee88.00000000000002ca:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:59.243 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:59.243 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 52.203655243999997, 2024-09-13T05:12:59.243 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91717655399999998, 2024-09-13T05:12:59.243 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.244 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.244 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.244 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.244 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.244 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 159585 2024-09-13T05:12:59.244 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.244 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.244 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.244 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.244 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:59.244 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.244 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.244 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.244 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.245 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:12:59.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.245 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.245 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.245 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014366+0000", 2024-09-13T05:12:59.245 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.245 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.245 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014370+0000", 2024-09-13T05:12:59.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9960000000000004e-06 2024-09-13T05:12:59.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014379+0000", 2024-09-13T05:12:59.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8550000000000008e-06 2024-09-13T05:12:59.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.246 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.246 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014386+0000", 2024-09-13T05:12:59.246 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0140000000000001e-06 2024-09-13T05:12:59.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.246 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014533+0000", 2024-09-13T05:12:59.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000147458 2024-09-13T05:12:59.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:59.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014545+0000", 2024-09-13T05:12:59.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1318000000000001e-05 2024-09-13T05:12:59.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.247 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.247 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.247 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931378+0000", 2024-09-13T05:12:59.247 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91683292400000005 2024-09-13T05:12:59.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.248 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.248 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931495+0000", 2024-09-13T05:12:59.248 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011726399999999999 2024-09-13T05:12:59.248 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.248 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.248 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931543+0000", 2024-09-13T05:12:59.248 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8183000000000003e-05 2024-09-13T05:12:59.248 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.248 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.248 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.248 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.248 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.249 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160206 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 83968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:59.249 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:59.249 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 52.180252846999998, 2024-09-13T05:12:59.249 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89412730799999995, 2024-09-13T05:12:59.249 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.249 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.249 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.249 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.249 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.249 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160206 2024-09-13T05:12:59.249 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.249 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.249 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.249 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:59.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:12:59.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.250 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.250 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037768+0000", 2024-09-13T05:12:59.250 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:59.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.250 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037774+0000", 2024-09-13T05:12:59.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3600000000000001e-06 2024-09-13T05:12:59.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037786+0000", 2024-09-13T05:12:59.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.188e-05 2024-09-13T05:12:59.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.251 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.251 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.251 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037793+0000", 2024-09-13T05:12:59.251 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2749999999999998e-06 2024-09-13T05:12:59.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.252 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.252 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.252 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:59.252 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0353000000000003e-05 2024-09-13T05:12:59.252 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.252 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.252 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:59.252 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037862+0000", 2024-09-13T05:12:59.252 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9710000000000004e-06 2024-09-13T05:12:59.252 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.252 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.252 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.252 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931610+0000", 2024-09-13T05:12:59.252 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89374846299999999 2024-09-13T05:12:59.253 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.253 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.253 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.253 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931815+0000", 2024-09-13T05:12:59.253 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020516499999999999 2024-09-13T05:12:59.253 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.253 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.253 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.253 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931896+0000", 2024-09-13T05:12:59.253 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1157999999999998e-05 2024-09-13T05:12:59.253 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.253 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.253 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.253 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.254 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.254 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160208 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 84992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:59.254 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:59.254 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 52.180168107999997, 2024-09-13T05:12:59.254 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440702299999997, 2024-09-13T05:12:59.254 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.254 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.254 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.254 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.254 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.254 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160208 2024-09-13T05:12:59.255 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.255 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.255 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.255 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.255 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:59.255 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.255 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.255 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.255 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.256 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:12:59.256 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.256 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.256 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.256 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.256 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037853+0000", 2024-09-13T05:12:59.256 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:59.256 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.256 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.256 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.256 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037858+0000", 2024-09-13T05:12:59.256 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2179999999999998e-06 2024-09-13T05:12:59.257 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.257 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.257 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.257 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037867+0000", 2024-09-13T05:12:59.257 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5699999999999993e-06 2024-09-13T05:12:59.257 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.257 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.257 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.257 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037874+0000", 2024-09-13T05:12:59.257 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2810000000000003e-06 2024-09-13T05:12:59.257 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.257 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.257 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.258 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037935+0000", 2024-09-13T05:12:59.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1231999999999999e-05 2024-09-13T05:12:59.258 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.258 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.258 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:59.258 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037944+0000", 2024-09-13T05:12:59.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8580000000000006e-06 2024-09-13T05:12:59.258 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.258 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.258 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.258 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931956+0000", 2024-09-13T05:12:59.258 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89401158800000002 2024-09-13T05:12:59.258 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.258 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.258 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.259 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932015+0000", 2024-09-13T05:12:59.259 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8906999999999997e-05 2024-09-13T05:12:59.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.259 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.259 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932261+0000", 2024-09-13T05:12:59.259 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024622799999999997 2024-09-13T05:12:59.259 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.259 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.259 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.259 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160210 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 86016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:59.259 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:59.260 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 52.180099253999998, 2024-09-13T05:12:59.260 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89428998299999996, 2024-09-13T05:12:59.260 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.260 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.260 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.260 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.260 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.260 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160210 2024-09-13T05:12:59.260 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.260 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.260 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.260 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.260 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:59.260 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.261 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.261 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.261 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:12:59.261 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.261 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.261 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.261 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037922+0000", 2024-09-13T05:12:59.261 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:59.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.261 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.261 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.261 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037926+0000", 2024-09-13T05:12:59.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6550000000000003e-06 2024-09-13T05:12:59.262 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.262 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.262 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.262 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037933+0000", 2024-09-13T05:12:59.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5409999999999997e-06 2024-09-13T05:12:59.262 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.262 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.262 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.262 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037939+0000", 2024-09-13T05:12:59.262 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1940000000000003e-06 2024-09-13T05:12:59.262 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.262 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.262 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.263 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037976+0000", 2024-09-13T05:12:59.263 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6671000000000002e-05 2024-09-13T05:12:59.263 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.263 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.263 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:59.263 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037982+0000", 2024-09-13T05:12:59.263 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9669999999999998e-06 2024-09-13T05:12:59.263 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.263 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.263 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.263 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932096+0000", 2024-09-13T05:12:59.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89411465599999995 2024-09-13T05:12:59.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.264 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932149+0000", 2024-09-13T05:12:59.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3032999999999999e-05 2024-09-13T05:12:59.264 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.264 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.264 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.264 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932213+0000", 2024-09-13T05:12:59.264 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3165999999999998e-05 2024-09-13T05:12:59.265 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.265 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.265 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.265 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160212 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 87040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:59.265 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:59.265 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 52.180012132999998, 2024-09-13T05:12:59.265 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440379699999994, 2024-09-13T05:12:59.265 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.265 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.265 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.265 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.266 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.266 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160212 2024-09-13T05:12:59.266 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.266 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.266 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.266 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:59.266 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.266 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.266 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.266 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.266 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:12:59.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.267 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.267 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.267 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038009+0000", 2024-09-13T05:12:59.267 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.267 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.267 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.267 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038013+0000", 2024-09-13T05:12:59.268 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3950000000000003e-06 2024-09-13T05:12:59.268 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.268 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.268 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.268 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038032+0000", 2024-09-13T05:12:59.268 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8513999999999999e-05 2024-09-13T05:12:59.268 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.268 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.268 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.268 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038039+0000", 2024-09-13T05:12:59.268 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.985e-06 2024-09-13T05:12:59.269 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.269 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.269 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.269 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038086+0000", 2024-09-13T05:12:59.269 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7302999999999998e-05 2024-09-13T05:12:59.269 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.269 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.269 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:59.269 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038090+0000", 2024-09-13T05:12:59.269 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9029999999999997e-06 2024-09-13T05:12:59.269 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.269 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.269 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.270 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932291+0000", 2024-09-13T05:12:59.270 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89420100199999997 2024-09-13T05:12:59.270 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.270 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.270 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.270 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932352+0000", 2024-09-13T05:12:59.270 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1354999999999998e-05 2024-09-13T05:12:59.270 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.270 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.270 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.270 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932414+0000", 2024-09-13T05:12:59.270 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1037999999999994e-05 2024-09-13T05:12:59.270 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.271 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.271 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.271 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.271 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.271 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160214 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 88064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:59.271 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:59.271 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 52.179881066999997, 2024-09-13T05:12:59.271 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89438890900000001, 2024-09-13T05:12:59.271 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.271 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.271 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.271 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.271 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.271 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160214 2024-09-13T05:12:59.272 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.272 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.272 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.272 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.272 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:59.272 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.272 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.272 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.272 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.272 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:12:59.272 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.272 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.272 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.273 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.273 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038140+0000", 2024-09-13T05:12:59.273 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:12:59.273 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.273 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.273 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.273 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038145+0000", 2024-09-13T05:12:59.273 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9749999999999998e-06 2024-09-13T05:12:59.273 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.273 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.273 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.273 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038153+0000", 2024-09-13T05:12:59.273 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1280000000000008e-06 2024-09-13T05:12:59.274 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.274 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.274 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.274 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038161+0000", 2024-09-13T05:12:59.274 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0339999999999997e-06 2024-09-13T05:12:59.274 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.274 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.274 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.274 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038199+0000", 2024-09-13T05:12:59.274 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8269999999999998e-05 2024-09-13T05:12:59.274 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.274 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.274 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:59.274 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038204+0000", 2024-09-13T05:12:59.275 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5399999999999997e-06 2024-09-13T05:12:59.275 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.275 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.275 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.275 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932438+0000", 2024-09-13T05:12:59.275 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89423397999999998 2024-09-13T05:12:59.275 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.275 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.275 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.275 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932480+0000", 2024-09-13T05:12:59.275 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2392999999999999e-05 2024-09-13T05:12:59.275 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.275 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.276 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.276 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932530+0000", 2024-09-13T05:12:59.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:12:59.276 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.276 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.276 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.276 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.276 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160305 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 215040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:59.276 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:59.276 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 52.175677845000003, 2024-09-13T05:12:59.276 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89028175300000001, 2024-09-13T05:12:59.276 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.277 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.277 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.277 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.277 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.277 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160305 2024-09-13T05:12:59.277 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.277 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.277 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.277 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.277 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:59.277 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.277 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.277 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.278 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.278 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:12:59.278 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.278 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.278 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.278 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042343+0000", 2024-09-13T05:12:59.278 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:12:59.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.278 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.279 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.279 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042350+0000", 2024-09-13T05:12:59.279 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3769999999999998e-06 2024-09-13T05:12:59.279 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.279 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.279 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.279 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042367+0000", 2024-09-13T05:12:59.279 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.734e-05 2024-09-13T05:12:59.279 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.279 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.279 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.279 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042375+0000", 2024-09-13T05:12:59.279 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8469999999999996e-06 2024-09-13T05:12:59.280 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.280 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.280 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.280 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042428+0000", 2024-09-13T05:12:59.280 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3074e-05 2024-09-13T05:12:59.280 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.280 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.280 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:59.280 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042437+0000", 2024-09-13T05:12:59.280 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:12:59.280 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.280 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.280 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.280 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932550+0000", 2024-09-13T05:12:59.281 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89011304300000005 2024-09-13T05:12:59.281 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.281 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.281 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.281 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932589+0000", 2024-09-13T05:12:59.281 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9236000000000002e-05 2024-09-13T05:12:59.281 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.281 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.281 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.281 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932626+0000", 2024-09-13T05:12:59.281 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6832999999999998e-05 2024-09-13T05:12:59.281 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.281 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.282 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.282 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.282 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.282 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160307 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 216064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:59.282 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:59.282 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 52.175631406000001, 2024-09-13T05:12:59.282 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89032630800000001, 2024-09-13T05:12:59.282 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.282 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.282 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.282 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.282 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.282 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160307 2024-09-13T05:12:59.282 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.283 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.283 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.283 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.283 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:59.283 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.283 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.283 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.283 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.283 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:59.283 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.283 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.283 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.283 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.284 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:12:59.284 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.284 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.284 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.284 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.284 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042394+0000", 2024-09-13T05:12:59.284 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7900000000000001e-06 2024-09-13T05:12:59.284 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.284 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.284 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.284 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042401+0000", 2024-09-13T05:12:59.284 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.267e-06 2024-09-13T05:12:59.284 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.284 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.285 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.285 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042406+0000", 2024-09-13T05:12:59.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0860000000000001e-06 2024-09-13T05:12:59.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.285 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.285 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042465+0000", 2024-09-13T05:12:59.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9441000000000002e-05 2024-09-13T05:12:59.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.285 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.285 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:59.285 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042471+0000", 2024-09-13T05:12:59.285 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6640000000000003e-06 2024-09-13T05:12:59.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.286 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.286 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.286 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932645+0000", 2024-09-13T05:12:59.286 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89017372900000002 2024-09-13T05:12:59.286 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.286 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.286 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.286 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932681+0000", 2024-09-13T05:12:59.286 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5918999999999999e-05 2024-09-13T05:12:59.286 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.286 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.286 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.286 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932717+0000", 2024-09-13T05:12:59.286 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6007999999999998e-05 2024-09-13T05:12:59.287 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.287 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.287 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.287 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.287 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.287 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160309 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 217088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:59.287 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:59.287 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 52.175581147000003, 2024-09-13T05:12:59.287 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89037315900000003, 2024-09-13T05:12:59.287 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.287 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.287 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.287 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.288 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.288 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160309 2024-09-13T05:12:59.288 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.288 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.288 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.288 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.288 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:59.288 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.288 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.288 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.289 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.289 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:12:59.289 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.289 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.289 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.289 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.289 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042440+0000", 2024-09-13T05:12:59.289 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.289 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.289 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.289 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.289 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042444+0000", 2024-09-13T05:12:59.289 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.104e-06 2024-09-13T05:12:59.290 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.290 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.290 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.290 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042451+0000", 2024-09-13T05:12:59.290 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.922e-06 2024-09-13T05:12:59.290 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.290 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.290 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.290 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042457+0000", 2024-09-13T05:12:59.290 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3979999999999998e-06 2024-09-13T05:12:59.290 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.290 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.291 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.291 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042497+0000", 2024-09-13T05:12:59.291 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0692999999999998e-05 2024-09-13T05:12:59.291 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.291 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.291 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:59.291 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042503+0000", 2024-09-13T05:12:59.291 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.553e-06 2024-09-13T05:12:59.291 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.291 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.291 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.291 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932735+0000", 2024-09-13T05:12:59.291 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89023238699999996 2024-09-13T05:12:59.291 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.292 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.292 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.292 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932771+0000", 2024-09-13T05:12:59.292 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5972000000000001e-05 2024-09-13T05:12:59.292 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.292 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.292 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.292 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932814+0000", 2024-09-13T05:12:59.292 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2657000000000002e-05 2024-09-13T05:12:59.292 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.292 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.292 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.292 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.292 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.293 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160311 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 218112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:59.293 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:59.293 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 52.175555656999997, 2024-09-13T05:12:59.293 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89045284400000002, 2024-09-13T05:12:59.293 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.293 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.293 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.293 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.293 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.293 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160311 2024-09-13T05:12:59.293 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.293 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.293 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.294 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.294 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:59.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.294 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.294 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.294 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.294 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:59.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.294 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.294 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.294 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.294 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:12:59.294 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.295 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.295 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.295 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.295 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042469+0000", 2024-09-13T05:12:59.295 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.456e-06 2024-09-13T05:12:59.295 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.295 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.295 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.295 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042475+0000", 2024-09-13T05:12:59.295 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0990000000000004e-06 2024-09-13T05:12:59.295 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.295 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.295 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.295 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042481+0000", 2024-09-13T05:12:59.295 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.237e-06 2024-09-13T05:12:59.296 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.296 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.296 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.296 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042527+0000", 2024-09-13T05:12:59.296 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6796999999999999e-05 2024-09-13T05:12:59.296 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.296 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.296 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:59.296 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042533+0000", 2024-09-13T05:12:59.296 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6489999999999996e-06 2024-09-13T05:12:59.296 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.296 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.297 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.297 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932832+0000", 2024-09-13T05:12:59.297 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89029919800000001 2024-09-13T05:12:59.297 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.297 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.297 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.297 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932867+0000", 2024-09-13T05:12:59.297 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5049000000000003e-05 2024-09-13T05:12:59.297 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.297 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.297 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.297 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932919+0000", 2024-09-13T05:12:59.297 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1780999999999998e-05 2024-09-13T05:12:59.298 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.298 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.298 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.298 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.298 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.298 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160313 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 219136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:59.298 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:59.298 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 52.175526566000002, 2024-09-13T05:12:59.298 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89064232600000004, 2024-09-13T05:12:59.298 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.298 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.298 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.298 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.299 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.299 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160313 2024-09-13T05:12:59.299 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.299 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.299 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.299 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.299 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:59.299 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.299 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.299 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.299 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.299 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:59.299 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.299 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.300 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.300 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.300 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:12:59.300 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.300 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.300 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.300 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.300 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042498+0000", 2024-09-13T05:12:59.300 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.281e-06 2024-09-13T05:12:59.300 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.300 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.300 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.300 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042505+0000", 2024-09-13T05:12:59.300 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2699999999999999e-06 2024-09-13T05:12:59.301 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.301 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.301 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.301 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042512+0000", 2024-09-13T05:12:59.301 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0330000000000003e-06 2024-09-13T05:12:59.301 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.301 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.301 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.301 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042557+0000", 2024-09-13T05:12:59.301 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4425999999999998e-05 2024-09-13T05:12:59.301 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.301 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.301 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:59.302 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042562+0000", 2024-09-13T05:12:59.302 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3639999999999998e-06 2024-09-13T05:12:59.302 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.302 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.302 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.302 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932987+0000", 2024-09-13T05:12:59.302 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89042472299999997 2024-09-13T05:12:59.302 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.302 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.302 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.302 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933062+0000", 2024-09-13T05:12:59.302 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5129999999999994e-05 2024-09-13T05:12:59.302 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.302 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.303 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.303 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933138+0000", 2024-09-13T05:12:59.303 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5536000000000003e-05 2024-09-13T05:12:59.303 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.303 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.304 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.304 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.304 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.305 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160315 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 220160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:59.305 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:59.305 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 52.175495398999999, 2024-09-13T05:12:59.305 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89071820800000001, 2024-09-13T05:12:59.305 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.305 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.305 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.305 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.305 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.305 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160315 2024-09-13T05:12:59.305 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.305 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.305 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.305 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.306 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:59.306 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.306 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.306 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.306 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.306 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:59.306 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.306 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.306 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.306 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.306 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:12:59.306 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.306 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.306 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.307 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.307 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042529+0000", 2024-09-13T05:12:59.307 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3639999999999999e-06 2024-09-13T05:12:59.307 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.307 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.307 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.307 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042536+0000", 2024-09-13T05:12:59.307 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.866e-06 2024-09-13T05:12:59.307 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.307 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.307 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.307 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042541+0000", 2024-09-13T05:12:59.307 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:12:59.308 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.308 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.308 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.308 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042587+0000", 2024-09-13T05:12:59.308 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5735000000000002e-05 2024-09-13T05:12:59.308 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.308 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.308 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:59.308 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042593+0000", 2024-09-13T05:12:59.308 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0719999999999996e-06 2024-09-13T05:12:59.308 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.308 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.308 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.309 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933160+0000", 2024-09-13T05:12:59.309 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89056621000000002 2024-09-13T05:12:59.309 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.309 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.309 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.309 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933202+0000", 2024-09-13T05:12:59.309 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2376000000000002e-05 2024-09-13T05:12:59.309 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.309 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.309 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.309 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933245+0000", 2024-09-13T05:12:59.309 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2787999999999998e-05 2024-09-13T05:12:59.309 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.309 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.310 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.310 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.310 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.310 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160317 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:59.310 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:59.310 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 52.175466569999998, 2024-09-13T05:12:59.310 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89082205800000003, 2024-09-13T05:12:59.310 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.310 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.310 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.310 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.310 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.310 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160317 2024-09-13T05:12:59.311 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.311 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.311 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.311 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.311 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:59.311 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.311 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.311 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.311 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.311 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:59.311 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.311 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.311 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.311 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.311 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:12:59.312 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.312 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.312 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.312 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.312 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042558+0000", 2024-09-13T05:12:59.312 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1810000000000001e-06 2024-09-13T05:12:59.312 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.312 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.312 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.312 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042565+0000", 2024-09-13T05:12:59.312 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9280000000000004e-06 2024-09-13T05:12:59.312 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.312 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.313 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.313 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042571+0000", 2024-09-13T05:12:59.313 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7420000000000003e-06 2024-09-13T05:12:59.313 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.313 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.313 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.313 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042616+0000", 2024-09-13T05:12:59.313 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5201999999999999e-05 2024-09-13T05:12:59.313 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.313 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.313 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:59.313 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042622+0000", 2024-09-13T05:12:59.313 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8289999999999996e-06 2024-09-13T05:12:59.313 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.314 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.314 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.314 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933259+0000", 2024-09-13T05:12:59.314 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89063730799999996 2024-09-13T05:12:59.314 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.314 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.314 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.314 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933311+0000", 2024-09-13T05:12:59.314 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1910000000000003e-05 2024-09-13T05:12:59.314 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.314 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.314 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.314 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933377+0000", 2024-09-13T05:12:59.315 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6396999999999995e-05 2024-09-13T05:12:59.315 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.315 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.315 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.315 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.315 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.315 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160319 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 222208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:59.315 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:59.315 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 52.175436353999999, 2024-09-13T05:12:59.315 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89087477400000004, 2024-09-13T05:12:59.315 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.315 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.315 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.316 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.316 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.316 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160319 2024-09-13T05:12:59.316 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.316 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.316 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.316 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.316 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:59.316 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.316 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.316 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.316 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.316 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:12:59.317 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.317 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.317 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.317 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042585+0000", 2024-09-13T05:12:59.317 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.317 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.317 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.317 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042588+0000", 2024-09-13T05:12:59.317 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9450000000000002e-06 2024-09-13T05:12:59.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.317 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.317 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.318 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042594+0000", 2024-09-13T05:12:59.318 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0959999999999997e-06 2024-09-13T05:12:59.318 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.318 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.318 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.318 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042599+0000", 2024-09-13T05:12:59.318 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0069999999999997e-06 2024-09-13T05:12:59.318 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.318 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.318 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.318 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042642+0000", 2024-09-13T05:12:59.318 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2553999999999999e-05 2024-09-13T05:12:59.319 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.319 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.319 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:59.319 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042647+0000", 2024-09-13T05:12:59.319 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.31e-06 2024-09-13T05:12:59.319 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.319 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.319 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.319 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933387+0000", 2024-09-13T05:12:59.319 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89073982799999996 2024-09-13T05:12:59.319 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.319 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.319 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.319 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:12:59.320 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7101000000000003e-05 2024-09-13T05:12:59.320 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.320 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.320 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.320 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933460+0000", 2024-09-13T05:12:59.320 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6282999999999998e-05 2024-09-13T05:12:59.320 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.320 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.320 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.320 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.320 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.320 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160321 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 223232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:12:59.320 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:59.321 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 52.175406926999997, 2024-09-13T05:12:59.321 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89094616999999998, 2024-09-13T05:12:59.321 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.321 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.321 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.321 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.321 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.321 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160321 2024-09-13T05:12:59.321 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.321 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.321 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.321 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.322 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:59.322 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.322 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.322 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.322 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.322 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:59.322 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.322 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.322 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.322 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.322 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:12:59.322 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.322 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.322 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.323 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.323 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042617+0000", 2024-09-13T05:12:59.323 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8329999999999998e-06 2024-09-13T05:12:59.323 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.323 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.323 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.323 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042638+0000", 2024-09-13T05:12:59.323 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0908e-05 2024-09-13T05:12:59.323 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.323 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.323 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.323 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042644+0000", 2024-09-13T05:12:59.323 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0440000000000001e-06 2024-09-13T05:12:59.323 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.324 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.324 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.324 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042666+0000", 2024-09-13T05:12:59.324 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1256000000000001e-05 2024-09-13T05:12:59.324 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.324 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.324 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:59.324 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042671+0000", 2024-09-13T05:12:59.324 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6250000000000004e-06 2024-09-13T05:12:59.324 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.324 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.324 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.324 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933478+0000", 2024-09-13T05:12:59.325 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89080698800000002 2024-09-13T05:12:59.325 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.325 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.325 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.325 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933519+0000", 2024-09-13T05:12:59.325 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0717000000000003e-05 2024-09-13T05:12:59.325 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.325 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.325 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.325 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933561+0000", 2024-09-13T05:12:59.326 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2225999999999999e-05 2024-09-13T05:12:59.326 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.326 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.326 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.326 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.326 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.326 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:201615 3.1d 3:bb015654:::rbd_data.112d9dba7cdc.000000000000000a:head [delete] snapc 30=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2024-09-13T05:12:59.326 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:12:59.326 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.213170146, 2024-09-13T05:12:59.326 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.90842926999999996, 2024-09-13T05:12:59.326 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.326 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:59.326 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.326 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.327 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.327 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 201615 2024-09-13T05:12:59.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.327 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.327 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.327 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.327 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:12:59.327 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.328 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.328 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.328 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:12:59.328 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.328 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.328 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.328 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.328 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004850+0000", 2024-09-13T05:12:59.328 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:59.328 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.328 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.328 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.328 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004860+0000", 2024-09-13T05:12:59.329 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.927e-06 2024-09-13T05:12:59.329 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.329 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.329 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.329 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004882+0000", 2024-09-13T05:12:59.329 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2079999999999999e-05 2024-09-13T05:12:59.329 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.329 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.329 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.329 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004897+0000", 2024-09-13T05:12:59.329 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4892000000000001e-05 2024-09-13T05:12:59.329 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.329 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.330 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.330 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.005068+0000", 2024-09-13T05:12:59.330 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017098999999999999 2024-09-13T05:12:59.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.330 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.330 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:12:59.330 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.005081+0000", 2024-09-13T05:12:59.330 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3063e-05 2024-09-13T05:12:59.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.330 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.330 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.330 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.910925+0000", 2024-09-13T05:12:59.330 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.90584383400000001 2024-09-13T05:12:59.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.331 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.331 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.331 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.911131+0000", 2024-09-13T05:12:59.331 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020629399999999999 2024-09-13T05:12:59.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.331 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.331 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 4", 2024-09-13T05:12:59.331 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.911313+0000", 2024-09-13T05:12:59.331 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000182175 2024-09-13T05:12:59.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.331 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.331 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:12:59.331 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913010+0000", 2024-09-13T05:12:59.332 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0016971550000000001 2024-09-13T05:12:59.332 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.332 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.332 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:59.332 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913212+0000", 2024-09-13T05:12:59.332 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000202237 2024-09-13T05:12:59.332 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.332 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.332 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:59.332 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913253+0000", 2024-09-13T05:12:59.332 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0250999999999998e-05 2024-09-13T05:12:59.332 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.332 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.332 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.333 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913281+0000", 2024-09-13T05:12:59.333 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8314e-05 2024-09-13T05:12:59.333 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.333 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.333 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.333 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.333 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.333 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:59.335 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:12:59.335 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:12:59.330+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:12:59.436 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:59.431+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:59.449 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:59.449 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:59.449 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:12:59.449 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:59.459 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:12:59.536 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:59.530+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:59.614 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:59.615 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:12:59.615 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:12:59.615 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:12:59.615 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:59.624 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:12:59.637 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:12:59.635+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:12:59.738 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:12:59.735+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:12:59.753 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:12:59.753 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:12:59.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:12:59.753 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:12:59.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.754 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29021 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2865152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:59.754 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:12:59.754 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 142.70880649899999, 2024-09-13T05:12:59.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060927993999999999, 2024-09-13T05:12:59.754 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.754 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.754 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.754 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.754 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.754 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29021 2024-09-13T05:12:59.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.754 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:12:59.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:12:59.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041763+0000", 2024-09-13T05:12:59.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041766+0000", 2024-09-13T05:12:59.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6800000000000002e-06 2024-09-13T05:12:59.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041771+0000", 2024-09-13T05:12:59.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:12:59.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041776+0000", 2024-09-13T05:12:59.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8489999999999997e-06 2024-09-13T05:12:59.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102513+0000", 2024-09-13T05:12:59.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060737102000000001 2024-09-13T05:12:59.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102597+0000", 2024-09-13T05:12:59.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4374000000000002e-05 2024-09-13T05:12:59.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102692+0000", 2024-09-13T05:12:59.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4436000000000002e-05 2024-09-13T05:12:59.758 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.758 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.758 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.758 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29022 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2874368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:59.758 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:59.758 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 142.70879019899999, 2024-09-13T05:12:59.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061135083999999999, 2024-09-13T05:12:59.758 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.758 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.759 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.759 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.759 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.759 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29022 2024-09-13T05:12:59.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.759 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:59.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.759 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:59.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:12:59.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041782+0000", 2024-09-13T05:12:59.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4959999999999999e-06 2024-09-13T05:12:59.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041787+0000", 2024-09-13T05:12:59.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1240000000000004e-06 2024-09-13T05:12:59.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041792+0000", 2024-09-13T05:12:59.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9200000000000003e-06 2024-09-13T05:12:59.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102738+0000", 2024-09-13T05:12:59.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060945581999999998 2024-09-13T05:12:59.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102821+0000", 2024-09-13T05:12:59.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2898999999999994e-05 2024-09-13T05:12:59.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102915+0000", 2024-09-13T05:12:59.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4523000000000003e-05 2024-09-13T05:12:59.762 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.762 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.762 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.763 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29067 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2764800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:59.763 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:59.763 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 142.70501598199999, 2024-09-13T05:12:59.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060816621000000001, 2024-09-13T05:12:59.763 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.763 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.763 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.763 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.763 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.763 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29067 2024-09-13T05:12:59.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.763 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:59.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:59.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.764 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.764 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:12:59.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045557+0000", 2024-09-13T05:12:59.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.898e-06 2024-09-13T05:12:59.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045575+0000", 2024-09-13T05:12:59.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8252000000000001e-05 2024-09-13T05:12:59.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045581+0000", 2024-09-13T05:12:59.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:12:59.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106183+0000", 2024-09-13T05:12:59.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060602630999999997 2024-09-13T05:12:59.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106271+0000", 2024-09-13T05:12:59.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7329000000000004e-05 2024-09-13T05:12:59.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106371+0000", 2024-09-13T05:12:59.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000100164 2024-09-13T05:12:59.767 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.767 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.767 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.767 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29068 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2774016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:59.767 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:12:59.767 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 142.70498474799999, 2024-09-13T05:12:59.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060994509000000002, 2024-09-13T05:12:59.767 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.767 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.768 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.768 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.768 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.768 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29068 2024-09-13T05:12:59.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.768 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:12:59.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.769 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:12:59.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.769 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.769 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045585+0000", 2024-09-13T05:12:59.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.769 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.769 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045588+0000", 2024-09-13T05:12:59.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:12:59.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045594+0000", 2024-09-13T05:12:59.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9329999999999998e-06 2024-09-13T05:12:59.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045599+0000", 2024-09-13T05:12:59.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3190000000000002e-06 2024-09-13T05:12:59.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106399+0000", 2024-09-13T05:12:59.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060800361999999997 2024-09-13T05:12:59.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106489+0000", 2024-09-13T05:12:59.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9301000000000004e-05 2024-09-13T05:12:59.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106580+0000", 2024-09-13T05:12:59.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1314e-05 2024-09-13T05:12:59.771 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.771 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.771 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.772 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29069 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2792448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:59.772 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:12:59.772 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 142.70496633100001, 2024-09-13T05:12:59.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061207599000000001, 2024-09-13T05:12:59.772 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.772 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.772 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.772 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.772 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.772 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29069 2024-09-13T05:12:59.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:12:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:12:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045603+0000", 2024-09-13T05:12:59.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045606+0000", 2024-09-13T05:12:59.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7300000000000001e-06 2024-09-13T05:12:59.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.774 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045612+0000", 2024-09-13T05:12:59.774 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9599999999999997e-06 2024-09-13T05:12:59.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.774 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.774 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045619+0000", 2024-09-13T05:12:59.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6019999999999996e-06 2024-09-13T05:12:59.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106619+0000", 2024-09-13T05:12:59.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061000029999999997 2024-09-13T05:12:59.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.775 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.775 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.775 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106713+0000", 2024-09-13T05:12:59.775 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4505000000000004e-05 2024-09-13T05:12:59.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.776 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.776 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106812+0000", 2024-09-13T05:12:59.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8264000000000007e-05 2024-09-13T05:12:59.776 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.776 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.776 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.776 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.776 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29070 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2783232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:59.776 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:59.776 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 142.704945872, 2024-09-13T05:12:59.776 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061389805999999998, 2024-09-13T05:12:59.776 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.777 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.777 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.777 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.777 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.777 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29070 2024-09-13T05:12:59.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.777 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.777 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.777 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:59.777 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:59.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:12:59.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.778 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.778 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.778 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045627+0000", 2024-09-13T05:12:59.778 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6579999999999998e-06 2024-09-13T05:12:59.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045632+0000", 2024-09-13T05:12:59.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8449999999999999e-06 2024-09-13T05:12:59.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045639+0000", 2024-09-13T05:12:59.779 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:12:59.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.779 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.779 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.779 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106837+0000", 2024-09-13T05:12:59.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061198529000000002 2024-09-13T05:12:59.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106922+0000", 2024-09-13T05:12:59.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4771999999999994e-05 2024-09-13T05:12:59.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.780 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.780 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.780 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107014+0000", 2024-09-13T05:12:59.780 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2009000000000006e-05 2024-09-13T05:12:59.780 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.780 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.780 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.781 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.781 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29071 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2801664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:59.781 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:12:59.781 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 142.704926796, 2024-09-13T05:12:59.781 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061582804999999997, 2024-09-13T05:12:59.781 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.781 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.781 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.781 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.781 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.781 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29071 2024-09-13T05:12:59.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.781 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:12:59.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:12:59.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.782 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.782 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.782 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.782 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045643+0000", 2024-09-13T05:12:59.782 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045646+0000", 2024-09-13T05:12:59.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:12:59.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045664+0000", 2024-09-13T05:12:59.783 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8408000000000001e-05 2024-09-13T05:12:59.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.783 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.783 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.783 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045670+0000", 2024-09-13T05:12:59.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7710000000000003e-06 2024-09-13T05:12:59.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107048+0000", 2024-09-13T05:12:59.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061378438 2024-09-13T05:12:59.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.784 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.784 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107134+0000", 2024-09-13T05:12:59.784 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5574000000000004e-05 2024-09-13T05:12:59.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.784 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.785 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.785 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107226+0000", 2024-09-13T05:12:59.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2262000000000005e-05 2024-09-13T05:12:59.785 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.785 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.785 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.785 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.785 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29072 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2810880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:59.785 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:12:59.785 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 142.70489541200001, 2024-09-13T05:12:59.785 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061762233999999999, 2024-09-13T05:12:59.785 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.785 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.786 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.786 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.786 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.786 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29072 2024-09-13T05:12:59.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.786 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.786 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.786 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:12:59.786 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.786 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.786 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.786 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:12:59.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045674+0000", 2024-09-13T05:12:59.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045677+0000", 2024-09-13T05:12:59.787 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9679999999999998e-06 2024-09-13T05:12:59.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.787 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.787 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.787 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045694+0000", 2024-09-13T05:12:59.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6801999999999999e-05 2024-09-13T05:12:59.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045700+0000", 2024-09-13T05:12:59.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8270000000000003e-06 2024-09-13T05:12:59.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.788 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107249+0000", 2024-09-13T05:12:59.788 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061549114000000002 2024-09-13T05:12:59.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.788 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.788 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107341+0000", 2024-09-13T05:12:59.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2390000000000001e-05 2024-09-13T05:12:59.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.789 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.789 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107437+0000", 2024-09-13T05:12:59.789 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5648000000000003e-05 2024-09-13T05:12:59.789 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.789 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.789 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.789 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.789 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29073 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2820096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:59.790 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:12:59.790 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 142.704853434, 2024-09-13T05:12:59.790 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061873910999999997, 2024-09-13T05:12:59.790 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.790 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.790 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.790 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.790 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.790 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29073 2024-09-13T05:12:59.790 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.790 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.790 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.790 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.790 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:12:59.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:12:59.791 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.791 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.791 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.791 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045716+0000", 2024-09-13T05:12:59.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.792 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.792 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045726+0000", 2024-09-13T05:12:59.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6350000000000001e-06 2024-09-13T05:12:59.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.792 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.792 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045739+0000", 2024-09-13T05:12:59.792 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3325e-05 2024-09-13T05:12:59.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.792 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.793 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045746+0000", 2024-09-13T05:12:59.793 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7399999999999998e-06 2024-09-13T05:12:59.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.793 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107457+0000", 2024-09-13T05:12:59.793 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061711038000000003 2024-09-13T05:12:59.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.793 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.793 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107522+0000", 2024-09-13T05:12:59.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4850000000000004e-05 2024-09-13T05:12:59.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.794 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.794 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107591+0000", 2024-09-13T05:12:59.794 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9029999999999995e-05 2024-09-13T05:12:59.794 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.794 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.794 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.794 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.794 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29074 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2829312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:59.794 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:12:59.795 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 142.70481952599999, 2024-09-13T05:12:59.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062055459, 2024-09-13T05:12:59.795 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.795 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.795 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.795 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.795 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.795 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29074 2024-09-13T05:12:59.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.795 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.795 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.795 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.795 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:12:59.795 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.796 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:12:59.796 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.796 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045750+0000", 2024-09-13T05:12:59.796 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.796 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.796 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045753+0000", 2024-09-13T05:12:59.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8399999999999999e-06 2024-09-13T05:12:59.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045759+0000", 2024-09-13T05:12:59.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8900000000000004e-06 2024-09-13T05:12:59.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.797 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.797 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045764+0000", 2024-09-13T05:12:59.797 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3850000000000001e-06 2024-09-13T05:12:59.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.798 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.798 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107623+0000", 2024-09-13T05:12:59.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061858817000000003 2024-09-13T05:12:59.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.798 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.798 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107710+0000", 2024-09-13T05:12:59.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7127999999999997e-05 2024-09-13T05:12:59.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.798 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.798 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.798 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107806+0000", 2024-09-13T05:12:59.798 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5886999999999999e-05 2024-09-13T05:12:59.798 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.799 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.799 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.799 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.799 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29075 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2838528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:59.799 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:59.799 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 142.70480107200001, 2024-09-13T05:12:59.799 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062188516999999999, 2024-09-13T05:12:59.799 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.799 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.799 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.799 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.799 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.799 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29075 2024-09-13T05:12:59.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.800 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:59.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.800 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.800 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:59.800 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.801 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:12:59.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.801 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045772+0000", 2024-09-13T05:12:59.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:12:59.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.801 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.801 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.801 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045778+0000", 2024-09-13T05:12:59.801 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9229999999999996e-06 2024-09-13T05:12:59.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.802 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.802 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.802 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045784+0000", 2024-09-13T05:12:59.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3800000000000002e-06 2024-09-13T05:12:59.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.802 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.802 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.802 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107823+0000", 2024-09-13T05:12:59.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062039331000000003 2024-09-13T05:12:59.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.802 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.802 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.802 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107886+0000", 2024-09-13T05:12:59.802 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2476000000000003e-05 2024-09-13T05:12:59.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.803 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.803 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.803 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107958+0000", 2024-09-13T05:12:59.803 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2089999999999996e-05 2024-09-13T05:12:59.803 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.803 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.803 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.803 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.803 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29115 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2682880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:59.803 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:12:59.803 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 142.70133554500001, 2024-09-13T05:12:59.803 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060847898999999997, 2024-09-13T05:12:59.804 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.804 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.804 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.804 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.804 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.804 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29115 2024-09-13T05:12:59.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.804 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.804 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.804 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.804 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:12:59.804 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.805 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.805 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:12:59.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.805 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.805 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.805 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049234+0000", 2024-09-13T05:12:59.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.805 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.805 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.805 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.805 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049237+0000", 2024-09-13T05:12:59.805 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9069999999999999e-06 2024-09-13T05:12:59.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.806 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.806 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049243+0000", 2024-09-13T05:12:59.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7459999999999997e-06 2024-09-13T05:12:59.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.806 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.806 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049248+0000", 2024-09-13T05:12:59.806 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1490000000000002e-06 2024-09-13T05:12:59.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.806 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.806 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.806 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.109945+0000", 2024-09-13T05:12:59.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060697299000000003 2024-09-13T05:12:59.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110013+0000", 2024-09-13T05:12:59.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8023999999999998e-05 2024-09-13T05:12:59.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.807 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.807 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110083+0000", 2024-09-13T05:12:59.807 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9296999999999997e-05 2024-09-13T05:12:59.807 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.807 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.807 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.808 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.808 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29116 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2692096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:59.808 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:12:59.808 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 142.70131770099999, 2024-09-13T05:12:59.808 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061040167999999999, 2024-09-13T05:12:59.808 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.808 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.808 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.808 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.809 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.809 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29116 2024-09-13T05:12:59.809 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.809 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.809 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.809 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.809 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:12:59.809 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.809 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.809 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.809 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.810 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:12:59.810 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.810 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.810 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.810 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049252+0000", 2024-09-13T05:12:59.810 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.810 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.810 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.810 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049255+0000", 2024-09-13T05:12:59.810 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7250000000000002e-06 2024-09-13T05:12:59.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049261+0000", 2024-09-13T05:12:59.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.755e-06 2024-09-13T05:12:59.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049266+0000", 2024-09-13T05:12:59.811 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2100000000000001e-06 2024-09-13T05:12:59.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.811 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.811 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.811 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110115+0000", 2024-09-13T05:12:59.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060849225999999999 2024-09-13T05:12:59.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.812 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.812 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110199+0000", 2024-09-13T05:12:59.812 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4339999999999995e-05 2024-09-13T05:12:59.812 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.812 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.812 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.813 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110293+0000", 2024-09-13T05:12:59.813 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3397e-05 2024-09-13T05:12:59.813 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.813 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.813 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.813 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.813 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29117 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2701312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:59.814 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:59.814 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 142.70130006400001, 2024-09-13T05:12:59.814 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.06118527, 2024-09-13T05:12:59.814 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.814 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.814 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.814 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.814 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.814 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29117 2024-09-13T05:12:59.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.814 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.815 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.815 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.815 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:59.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.815 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.815 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.815 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:59.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.815 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.815 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.815 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.815 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:12:59.815 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049273+0000", 2024-09-13T05:12:59.816 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.757e-06 2024-09-13T05:12:59.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049278+0000", 2024-09-13T05:12:59.816 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7830000000000004e-06 2024-09-13T05:12:59.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.816 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.816 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.816 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049284+0000", 2024-09-13T05:12:59.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3820000000000003e-06 2024-09-13T05:12:59.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110313+0000", 2024-09-13T05:12:59.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061029682000000002 2024-09-13T05:12:59.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.817 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.817 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.817 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110383+0000", 2024-09-13T05:12:59.817 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9406000000000006e-05 2024-09-13T05:12:59.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.818 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.818 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110456+0000", 2024-09-13T05:12:59.818 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2750000000000007e-05 2024-09-13T05:12:59.818 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.818 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.818 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.818 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.818 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.818 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29118 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2710528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:59.818 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:59.818 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 142.70128214900001, 2024-09-13T05:12:59.819 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061380698999999997, 2024-09-13T05:12:59.819 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.819 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.819 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.819 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.819 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.819 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29118 2024-09-13T05:12:59.819 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.819 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.819 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.819 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.820 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:59.820 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.820 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.820 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:59.820 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.820 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.820 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:12:59.820 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.821 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.821 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049291+0000", 2024-09-13T05:12:59.821 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8770000000000002e-06 2024-09-13T05:12:59.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.821 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.821 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.821 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049296+0000", 2024-09-13T05:12:59.821 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6799999999999998e-06 2024-09-13T05:12:59.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.821 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.821 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.821 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049302+0000", 2024-09-13T05:12:59.821 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2769999999999996e-06 2024-09-13T05:12:59.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.822 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.822 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.822 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110488+0000", 2024-09-13T05:12:59.822 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061186184999999997 2024-09-13T05:12:59.822 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.822 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.822 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.822 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110577+0000", 2024-09-13T05:12:59.822 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9246000000000006e-05 2024-09-13T05:12:59.822 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.822 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.822 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.822 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110669+0000", 2024-09-13T05:12:59.822 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1923999999999996e-05 2024-09-13T05:12:59.823 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.823 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.823 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.823 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.823 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29119 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2719744~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:59.823 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:12:59.823 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 142.70126440499999, 2024-09-13T05:12:59.823 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061521165000000003, 2024-09-13T05:12:59.823 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.823 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.823 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.823 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.823 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.824 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29119 2024-09-13T05:12:59.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.824 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.824 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.824 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:12:59.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.824 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.824 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.824 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:12:59.824 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.825 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.825 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.825 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049305+0000", 2024-09-13T05:12:59.825 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.825 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.825 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.825 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049308+0000", 2024-09-13T05:12:59.825 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7070000000000001e-06 2024-09-13T05:12:59.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.826 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.826 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.826 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049316+0000", 2024-09-13T05:12:59.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:12:59.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.826 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.826 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.826 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049322+0000", 2024-09-13T05:12:59.826 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3199999999999999e-06 2024-09-13T05:12:59.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.827 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.827 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.827 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110690+0000", 2024-09-13T05:12:59.827 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061368428000000003 2024-09-13T05:12:59.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.827 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.827 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.827 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110755+0000", 2024-09-13T05:12:59.827 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4893000000000004e-05 2024-09-13T05:12:59.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.828 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.828 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.828 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110827+0000", 2024-09-13T05:12:59.828 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2039000000000006e-05 2024-09-13T05:12:59.828 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.828 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.828 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.828 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.828 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.828 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29120 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2728960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:59.828 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:59.828 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 142.701244135, 2024-09-13T05:12:59.828 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061718420000000003, 2024-09-13T05:12:59.829 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.829 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.829 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.829 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.829 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.829 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29120 2024-09-13T05:12:59.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.829 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.829 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.829 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:59.829 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.829 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.830 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.830 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:59.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.830 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.830 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.830 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:12:59.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.830 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.830 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.830 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049329+0000", 2024-09-13T05:12:59.830 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.022e-06 2024-09-13T05:12:59.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.830 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.831 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.831 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049336+0000", 2024-09-13T05:12:59.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0720000000000002e-06 2024-09-13T05:12:59.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.831 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.831 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.831 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049341+0000", 2024-09-13T05:12:59.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:12:59.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.831 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.831 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.831 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110864+0000", 2024-09-13T05:12:59.831 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061523126999999997 2024-09-13T05:12:59.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.832 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.832 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.832 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110951+0000", 2024-09-13T05:12:59.832 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6557000000000005e-05 2024-09-13T05:12:59.832 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.832 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.832 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.832 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.111045+0000", 2024-09-13T05:12:59.832 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4043999999999996e-05 2024-09-13T05:12:59.832 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.832 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.832 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.832 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.832 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.833 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29136 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2876416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:59.833 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:12:59.833 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 142.69722870999999, 2024-09-13T05:12:59.833 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060742995000000001, 2024-09-13T05:12:59.833 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.833 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.833 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.833 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.833 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.833 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29136 2024-09-13T05:12:59.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.833 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:12:59.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:12:59.834 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.834 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.834 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.834 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053341+0000", 2024-09-13T05:12:59.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.835 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.835 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053344+0000", 2024-09-13T05:12:59.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:12:59.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.835 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.835 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053350+0000", 2024-09-13T05:12:59.835 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7200000000000003e-06 2024-09-13T05:12:59.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.835 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.835 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.835 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053355+0000", 2024-09-13T05:12:59.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0150000000000003e-06 2024-09-13T05:12:59.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.836 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113909+0000", 2024-09-13T05:12:59.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060554368999999997 2024-09-13T05:12:59.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.836 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.836 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113994+0000", 2024-09-13T05:12:59.836 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4658000000000002e-05 2024-09-13T05:12:59.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.837 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.837 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114085+0000", 2024-09-13T05:12:59.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0939000000000005e-05 2024-09-13T05:12:59.837 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.837 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.837 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.837 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.837 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.837 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29166 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2628608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:12:59.837 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:59.837 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 142.69721127599999, 2024-09-13T05:12:59.837 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060883127000000002, 2024-09-13T05:12:59.837 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.837 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:12:59.838 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.838 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.838 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.838 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29166 2024-09-13T05:12:59.838 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.838 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.838 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.838 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.838 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:59.838 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.838 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.838 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.839 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.839 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:59.839 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.839 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.839 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.839 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:12:59.839 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:12:59.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.839 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.839 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.839 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053361+0000", 2024-09-13T05:12:59.839 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:12:59.839 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.840 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053367+0000", 2024-09-13T05:12:59.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7350000000000001e-06 2024-09-13T05:12:59.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.840 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053372+0000", 2024-09-13T05:12:59.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7840000000000003e-06 2024-09-13T05:12:59.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.840 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.840 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114103+0000", 2024-09-13T05:12:59.840 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060730924999999998 2024-09-13T05:12:59.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.841 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.841 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.841 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114171+0000", 2024-09-13T05:12:59.841 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8021999999999993e-05 2024-09-13T05:12:59.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.841 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.841 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.841 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114242+0000", 2024-09-13T05:12:59.841 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1390999999999995e-05 2024-09-13T05:12:59.841 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.841 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.841 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.841 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.842 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:165308 3.3 3:c04a6a9a:::rbd_data.112dc3abcba6.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-13T05:12:59.842 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:12:59.842 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 43.618753990000002, 2024-09-13T05:12:59.842 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.085530595000000001, 2024-09-13T05:12:59.842 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:12:59.842 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:12:59.842 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:12:59.842 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:12:59.842 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:12:59.842 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 165308 2024-09-13T05:12:59.842 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.842 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:12:59.842 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.843 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:12:59.843 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:12:59.843 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.843 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:12:59.843 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:12:59.843 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:12:59.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.843 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:12:59.843 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131814+0000", 2024-09-13T05:12:59.843 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:12:59.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.844 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:12:59.844 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152479+0000", 2024-09-13T05:12:59.844 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020664281 2024-09-13T05:12:59.844 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.844 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.844 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:12:59.844 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152521+0000", 2024-09-13T05:12:59.844 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2567000000000001e-05 2024-09-13T05:12:59.844 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.844 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.844 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:12:59.844 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152536+0000", 2024-09-13T05:12:59.844 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4447000000000001e-05 2024-09-13T05:12:59.845 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.845 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.845 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:12:59.845 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152607+0000", 2024-09-13T05:12:59.845 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1687000000000007e-05 2024-09-13T05:12:59.845 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.845 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.845 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:12:59.845 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152753+0000", 2024-09-13T05:12:59.845 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000145861 2024-09-13T05:12:59.845 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.845 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.845 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:12:59.845 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.159991+0000", 2024-09-13T05:12:59.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0072373100000000003 2024-09-13T05:12:59.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:12:59.846 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.208492+0000", 2024-09-13T05:12:59.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048501003000000001 2024-09-13T05:12:59.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.846 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:12:59.846 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217224+0000", 2024-09-13T05:12:59.846 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0087320369999999998 2024-09-13T05:12:59.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.847 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:12:59.847 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217277+0000", 2024-09-13T05:12:59.847 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3841000000000002e-05 2024-09-13T05:12:59.847 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:12:59.847 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:12:59.847 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:12:59.847 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217347+0000", 2024-09-13T05:12:59.847 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9529999999999993e-05 2024-09-13T05:12:59.847 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.847 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.847 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.848 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:12:59.848 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:12:59.848 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:12:59.850 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:12:59.850 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:12:59.846+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:12:59.851 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T05:12:59.854 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:12:59.950 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:12:59.947+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:12:59.994 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:13:00.011 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:00.011 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:00.011 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:13:00.011 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:00.021 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:13:00.027 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:13:00.051 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:00.046+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:00.063 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:13:00.090 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:13:00.118 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:13:00.125 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:00.125 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:00.126 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:13:00.126 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:13:00.126 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:00.135 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:13:00.138 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:13:00.151 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:00.146+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:00.159 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:13:00.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:13:00.170+0000 7ff7b9194700 0 --2- 172.21.15.120:0/2882316371 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff7b4146270 0x7ff7b4148660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-13T05:13:00.181 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:13:00.185 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:13:00.185 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:13:00.185 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:13:00.185 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:13:00.185 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:13:00.185 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:13:00.185 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:13:00.185 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:13:00.240 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:00.240 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:00.249 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:13:00.252 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:00.247+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:00.353 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:00.350+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:00.361 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:00.361 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:00.371 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:13:00.455 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:00.451+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:00.491 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:00.491 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:00.501 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:13:00.556 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:00.551+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:00.613 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:00.613 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:00.623 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:13:00.657 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:00.651+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:00.714 INFO:tasks.thrashosds.thrasher:in_osds: [2, 3, 5, 7, 1, 4] out_osds: [0, 6] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-13T05:13:00.714 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:13:00.714 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-13T05:13:00.715 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-13T05:13:00.726 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:00.726 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:00.740 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:13:00.742 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is set 2024-09-13T05:13:00.797 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:00.794+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:00.847 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:00.847 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:00.857 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:00.854+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:00.858 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:13:00.959 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:00.954+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:00.963 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:00.963 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:00.974 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:13:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:13:01.036 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: "epoch": 166, 2024-09-13T05:13:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: "fsid": "0a3759da-62bd-4704-8a4a-7c20eb3fc816", 2024-09-13T05:13:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: "created": "2024-09-13T05:09:38.849186+0000", 2024-09-13T05:13:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: "modified": "2024-09-13T05:13:00.722077+0000", 2024-09-13T05:13:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: "last_up_change": "2024-09-13T05:12:13.640614+0000", 2024-09-13T05:13:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: "last_in_change": "2024-09-13T05:12:36.834526+0000", 2024-09-13T05:13:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T05:13:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_num": 5806080, 2024-09-13T05:13:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_set": [ 2024-09-13T05:13:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "nodeep-scrub", 2024-09-13T05:13:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "noscrub", 2024-09-13T05:13:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "pglog_hardlimit", 2024-09-13T05:13:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "purged_snapdirs", 2024-09-13T05:13:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "recovery_deletes", 2024-09-13T05:13:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "sortbitwise" 2024-09-13T05:13:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:13:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_version": 5, 2024-09-13T05:13:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "full_ratio": 0.94999998807907104, 2024-09-13T05:13:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-13T05:13:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-13T05:13:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_snapshot": "", 2024-09-13T05:13:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_max": 3, 2024-09-13T05:13:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "max_osd": 8, 2024-09-13T05:13:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "require_min_compat_client": "luminous", 2024-09-13T05:13:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "min_compat_client": "luminous", 2024-09-13T05:13:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "require_osd_release": "reef", 2024-09-13T05:13:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "allow_crimson": false, 2024-09-13T05:13:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "pools": [ 2024-09-13T05:13:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "pool": 1, 2024-09-13T05:13:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": ".mgr", 2024-09-13T05:13:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "create_time": "2024-09-13T05:09:52.225455+0000", 2024-09-13T05:13:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-13T05:13:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_names": "hashpspool", 2024-09-13T05:13:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "type": 1, 2024-09-13T05:13:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 2, 2024-09-13T05:13:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": 1, 2024-09-13T05:13:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_rule": 0, 2024-09-13T05:13:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_count": 0, 2024-09-13T05:13:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_target": 0, 2024-09-13T05:13:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T05:13:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T05:13:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "object_hash": 2, 2024-09-13T05:13:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscale_mode": "off", 2024-09-13T05:13:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": 1, 2024-09-13T05:13:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num": 1, 2024-09-13T05:13:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num_target": 1, 2024-09-13T05:13:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_target": 1, 2024-09-13T05:13:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_pending": 1, 2024-09-13T05:13:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "last_pg_merge_meta": { 2024-09-13T05:13:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "source_pgid": "0.0", 2024-09-13T05:13:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "ready_epoch": 0, 2024-09-13T05:13:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_started": 0, 2024-09-13T05:13:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_clean": 0, 2024-09-13T05:13:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "source_version": "0'0", 2024-09-13T05:13:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "target_version": "0'0" 2024-09-13T05:13:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "last_change": "16", 2024-09-13T05:13:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend": "0", 2024-09-13T05:13:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T05:13:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T05:13:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "auid": 0, 2024-09-13T05:13:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_mode": "selfmanaged", 2024-09-13T05:13:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_seq": 0, 2024-09-13T05:13:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_epoch": 0, 2024-09-13T05:13:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_snaps": [], 2024-09-13T05:13:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: "removed_snaps": "[]", 2024-09-13T05:13:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_bytes": 0, 2024-09-13T05:13:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_objects": 0, 2024-09-13T05:13:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: "tiers": [], 2024-09-13T05:13:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: "tier_of": -1, 2024-09-13T05:13:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: "read_tier": -1, 2024-09-13T05:13:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: "write_tier": -1, 2024-09-13T05:13:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_mode": "none", 2024-09-13T05:13:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_bytes": 0, 2024-09-13T05:13:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_objects": 0, 2024-09-13T05:13:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T05:13:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T05:13:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T05:13:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_flush_age": 0, 2024-09-13T05:13:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_evict_age": 0, 2024-09-13T05:13:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_profile": "", 2024-09-13T05:13:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_params": { 2024-09-13T05:13:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "none" 2024-09-13T05:13:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_period": 0, 2024-09-13T05:13:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_count": 0, 2024-09-13T05:13:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "use_gmt_hitset": true, 2024-09-13T05:13:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "min_read_recency_for_promote": 0, 2024-09-13T05:13:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "min_write_recency_for_promote": 0, 2024-09-13T05:13:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T05:13:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_search_last_n": 0, 2024-09-13T05:13:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "grade_table": [], 2024-09-13T05:13:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "stripe_width": 0, 2024-09-13T05:13:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "expected_num_objects": 0, 2024-09-13T05:13:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "fast_read": false, 2024-09-13T05:13:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "options": { 2024-09-13T05:13:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_max": 32, 2024-09-13T05:13:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_min": 1 2024-09-13T05:13:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "application_metadata": { 2024-09-13T05:13:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": {} 2024-09-13T05:13:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "read_balance": { 2024-09-13T05:13:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "score_acting": 8, 2024-09-13T05:13:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "score_stable": 8, 2024-09-13T05:13:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "optimal_score": 0.25, 2024-09-13T05:13:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_acting": 2, 2024-09-13T05:13:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_stable": 2, 2024-09-13T05:13:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity_weighted": 0.96530342102050781, 2024-09-13T05:13:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity": 0.97000002861022949, 2024-09-13T05:13:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity_weighted": 0.97000002861022949 2024-09-13T05:13:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: "pool": 2, 2024-09-13T05:13:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": "rbd", 2024-09-13T05:13:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: "create_time": "2024-09-13T05:09:57.858552+0000", 2024-09-13T05:13:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 8193, 2024-09-13T05:13:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T05:13:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "type": 1, 2024-09-13T05:13:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 2, 2024-09-13T05:13:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": 1, 2024-09-13T05:13:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_rule": 0, 2024-09-13T05:13:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_count": 0, 2024-09-13T05:13:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_target": 0, 2024-09-13T05:13:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T05:13:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T05:13:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "object_hash": 2, 2024-09-13T05:13:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscale_mode": "off", 2024-09-13T05:13:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": 8, 2024-09-13T05:13:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num": 8, 2024-09-13T05:13:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num_target": 8, 2024-09-13T05:13:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_target": 8, 2024-09-13T05:13:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_pending": 8, 2024-09-13T05:13:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "last_pg_merge_meta": { 2024-09-13T05:13:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "source_pgid": "0.0", 2024-09-13T05:13:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "ready_epoch": 0, 2024-09-13T05:13:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_started": 0, 2024-09-13T05:13:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_clean": 0, 2024-09-13T05:13:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "source_version": "0'0", 2024-09-13T05:13:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "target_version": "0'0" 2024-09-13T05:13:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "last_change": "20", 2024-09-13T05:13:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend": "0", 2024-09-13T05:13:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T05:13:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T05:13:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "auid": 0, 2024-09-13T05:13:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_mode": "selfmanaged", 2024-09-13T05:13:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_seq": 3, 2024-09-13T05:13:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_epoch": 20, 2024-09-13T05:13:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_snaps": [], 2024-09-13T05:13:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "removed_snaps": "[]", 2024-09-13T05:13:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_bytes": 0, 2024-09-13T05:13:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_objects": 0, 2024-09-13T05:13:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "tiers": [], 2024-09-13T05:13:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "tier_of": -1, 2024-09-13T05:13:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "read_tier": -1, 2024-09-13T05:13:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "write_tier": -1, 2024-09-13T05:13:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_mode": "none", 2024-09-13T05:13:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_bytes": 0, 2024-09-13T05:13:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_objects": 0, 2024-09-13T05:13:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T05:13:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T05:13:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T05:13:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_flush_age": 0, 2024-09-13T05:13:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_evict_age": 0, 2024-09-13T05:13:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_profile": "", 2024-09-13T05:13:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_params": { 2024-09-13T05:13:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "none" 2024-09-13T05:13:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_period": 0, 2024-09-13T05:13:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_count": 0, 2024-09-13T05:13:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "use_gmt_hitset": true, 2024-09-13T05:13:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "min_read_recency_for_promote": 0, 2024-09-13T05:13:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "min_write_recency_for_promote": 0, 2024-09-13T05:13:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T05:13:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_search_last_n": 0, 2024-09-13T05:13:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "grade_table": [], 2024-09-13T05:13:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "stripe_width": 0, 2024-09-13T05:13:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "expected_num_objects": 0, 2024-09-13T05:13:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "fast_read": false, 2024-09-13T05:13:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "options": {}, 2024-09-13T05:13:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "application_metadata": { 2024-09-13T05:13:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd": {} 2024-09-13T05:13:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "read_balance": { 2024-09-13T05:13:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "score_acting": 3, 2024-09-13T05:13:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "score_stable": 3, 2024-09-13T05:13:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "optimal_score": 0.75, 2024-09-13T05:13:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_acting": 2.25, 2024-09-13T05:13:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_stable": 2.25, 2024-09-13T05:13:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity_weighted": 0.96530342102050781, 2024-09-13T05:13:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity": 0.97000002861022949, 2024-09-13T05:13:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity_weighted": 0.97000002861022949 2024-09-13T05:13:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "pool": 3, 2024-09-13T05:13:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": "pool_client.0", 2024-09-13T05:13:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "create_time": "2024-09-13T05:10:07.742110+0000", 2024-09-13T05:13:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 8193, 2024-09-13T05:13:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T05:13:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "type": 1, 2024-09-13T05:13:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 2, 2024-09-13T05:13:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": 1, 2024-09-13T05:13:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_rule": 0, 2024-09-13T05:13:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_count": 0, 2024-09-13T05:13:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_target": 0, 2024-09-13T05:13:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T05:13:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T05:13:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "object_hash": 2, 2024-09-13T05:13:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscale_mode": "off", 2024-09-13T05:13:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": 32, 2024-09-13T05:13:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num": 32, 2024-09-13T05:13:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_placement_num_target": 32, 2024-09-13T05:13:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_target": 32, 2024-09-13T05:13:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num_pending": 32, 2024-09-13T05:13:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "last_pg_merge_meta": { 2024-09-13T05:13:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "source_pgid": "0.0", 2024-09-13T05:13:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "ready_epoch": 0, 2024-09-13T05:13:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_started": 0, 2024-09-13T05:13:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "last_epoch_clean": 0, 2024-09-13T05:13:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "source_version": "0'0", 2024-09-13T05:13:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "target_version": "0'0" 2024-09-13T05:13:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "last_change": "166", 2024-09-13T05:13:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend": "0", 2024-09-13T05:13:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T05:13:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T05:13:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "auid": 0, 2024-09-13T05:13:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_mode": "selfmanaged", 2024-09-13T05:13:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_seq": 64, 2024-09-13T05:13:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_epoch": 166, 2024-09-13T05:13:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_snaps": [], 2024-09-13T05:13:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "removed_snaps": "[]", 2024-09-13T05:13:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_bytes": 0, 2024-09-13T05:13:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "quota_max_objects": 0, 2024-09-13T05:13:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "tiers": [], 2024-09-13T05:13:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "tier_of": -1, 2024-09-13T05:13:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "read_tier": -1, 2024-09-13T05:13:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "write_tier": -1, 2024-09-13T05:13:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_mode": "none", 2024-09-13T05:13:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_bytes": 0, 2024-09-13T05:13:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "target_max_objects": 0, 2024-09-13T05:13:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T05:13:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T05:13:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T05:13:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_flush_age": 0, 2024-09-13T05:13:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "cache_min_evict_age": 0, 2024-09-13T05:13:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_profile": "", 2024-09-13T05:13:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_params": { 2024-09-13T05:13:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "none" 2024-09-13T05:13:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_period": 0, 2024-09-13T05:13:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_count": 0, 2024-09-13T05:13:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "use_gmt_hitset": true, 2024-09-13T05:13:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "min_read_recency_for_promote": 0, 2024-09-13T05:13:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "min_write_recency_for_promote": 0, 2024-09-13T05:13:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T05:13:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "hit_set_search_last_n": 0, 2024-09-13T05:13:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "grade_table": [], 2024-09-13T05:13:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "stripe_width": 0, 2024-09-13T05:13:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "expected_num_objects": 0, 2024-09-13T05:13:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "fast_read": false, 2024-09-13T05:13:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "options": {}, 2024-09-13T05:13:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "application_metadata": { 2024-09-13T05:13:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd": {} 2024-09-13T05:13:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "read_balance": { 2024-09-13T05:13:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "score_acting": 2, 2024-09-13T05:13:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "score_stable": 2, 2024-09-13T05:13:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "optimal_score": 0.75, 2024-09-13T05:13:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_acting": 1.5, 2024-09-13T05:13:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "raw_score_stable": 1.5, 2024-09-13T05:13:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity_weighted": 0.96530342102050781, 2024-09-13T05:13:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity": 0.97000002861022949, 2024-09-13T05:13:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "average_primary_affinity_weighted": 0.97000002861022949 2024-09-13T05:13:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:13:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "osds": [ 2024-09-13T05:13:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 0, 2024-09-13T05:13:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "b304ec03-bb00-4b13-bf2d-71017b8a70a3", 2024-09-13T05:13:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:13:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 0, 2024-09-13T05:13:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 0, 2024-09-13T05:13:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:13:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 13, 2024-09-13T05:13:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 105, 2024-09-13T05:13:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 124, 2024-09-13T05:13:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 40, 2024-09-13T05:13:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 106, 2024-09-13T05:13:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:13:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:13:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6800", 2024-09-13T05:13:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 367697828 2024-09-13T05:13:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6801", 2024-09-13T05:13:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 367697828 2024-09-13T05:13:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:13:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6802", 2024-09-13T05:13:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 367697828 2024-09-13T05:13:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6803", 2024-09-13T05:13:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 367697828 2024-09-13T05:13:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:13:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6806", 2024-09-13T05:13:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 367697828 2024-09-13T05:13:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6807", 2024-09-13T05:13:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 367697828 2024-09-13T05:13:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:13:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6804", 2024-09-13T05:13:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 367697828 2024-09-13T05:13:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6805", 2024-09-13T05:13:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 367697828 2024-09-13T05:13:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.120:6801/367697828", 2024-09-13T05:13:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.120:6803/367697828", 2024-09-13T05:13:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.120:6807/367697828", 2024-09-13T05:13:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.120:6805/367697828", 2024-09-13T05:13:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:13:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:13:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:13:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 1, 2024-09-13T05:13:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "c09e84f3-3a70-46a4-b67b-c9bb52c887b7", 2024-09-13T05:13:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:13:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:13:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:13:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:13:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:13:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:13:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:13:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 153, 2024-09-13T05:13:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:13:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:13:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:13:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6808", 2024-09-13T05:13:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:13:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6809", 2024-09-13T05:13:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:13:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:13:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6810", 2024-09-13T05:13:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:13:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6811", 2024-09-13T05:13:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:13:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:13:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6814", 2024-09-13T05:13:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:13:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6815", 2024-09-13T05:13:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:13:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:13:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6812", 2024-09-13T05:13:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:13:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6813", 2024-09-13T05:13:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1023532100 2024-09-13T05:13:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.120:6809/1023532100", 2024-09-13T05:13:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.120:6811/1023532100", 2024-09-13T05:13:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.120:6815/1023532100", 2024-09-13T05:13:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.120:6813/1023532100", 2024-09-13T05:13:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:13:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:13:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:13:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 2, 2024-09-13T05:13:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "3c2a0458-369c-4dac-90a3-fb20cb70d53f", 2024-09-13T05:13:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:13:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:13:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:13:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:13:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:13:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:13:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:13:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 149, 2024-09-13T05:13:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:13:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:13:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:13:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6816", 2024-09-13T05:13:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:13:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6817", 2024-09-13T05:13:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:13:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:13:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6818", 2024-09-13T05:13:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:13:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6819", 2024-09-13T05:13:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:13:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:13:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6822", 2024-09-13T05:13:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:13:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6823", 2024-09-13T05:13:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:13:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:13:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6820", 2024-09-13T05:13:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:13:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6821", 2024-09-13T05:13:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 592498012 2024-09-13T05:13:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.120:6817/592498012", 2024-09-13T05:13:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.120:6819/592498012", 2024-09-13T05:13:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.120:6823/592498012", 2024-09-13T05:13:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.120:6821/592498012", 2024-09-13T05:13:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:13:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:13:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:13:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 3, 2024-09-13T05:13:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "edce3757-5e9d-4221-a1f1-3f356bb5218b", 2024-09-13T05:13:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:13:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:13:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:13:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:13:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:13:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:13:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:13:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 149, 2024-09-13T05:13:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:13:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:13:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:13:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6824", 2024-09-13T05:13:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:13:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6825", 2024-09-13T05:13:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:13:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:13:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6826", 2024-09-13T05:13:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:13:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6827", 2024-09-13T05:13:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:13:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:13:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6830", 2024-09-13T05:13:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:13:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6831", 2024-09-13T05:13:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:13:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:13:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6828", 2024-09-13T05:13:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:13:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6829", 2024-09-13T05:13:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1939753938 2024-09-13T05:13:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.120:6825/1939753938", 2024-09-13T05:13:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.120:6827/1939753938", 2024-09-13T05:13:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.120:6831/1939753938", 2024-09-13T05:13:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.120:6829/1939753938", 2024-09-13T05:13:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:13:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:13:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:13:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 4, 2024-09-13T05:13:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "5fe378d2-578f-41ea-980a-4673a8b376df", 2024-09-13T05:13:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:13:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:13:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:13:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 0.894744873046875, 2024-09-13T05:13:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:13:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:13:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:13:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 154, 2024-09-13T05:13:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:13:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:13:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:13:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6824", 2024-09-13T05:13:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:13:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6825", 2024-09-13T05:13:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:13:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:13:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6826", 2024-09-13T05:13:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:13:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6827", 2024-09-13T05:13:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:13:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:13:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6830", 2024-09-13T05:13:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:13:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6831", 2024-09-13T05:13:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:13:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:13:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6828", 2024-09-13T05:13:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:13:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6829", 2024-09-13T05:13:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3005075615 2024-09-13T05:13:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.137:6825/3005075615", 2024-09-13T05:13:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.137:6827/3005075615", 2024-09-13T05:13:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.137:6831/3005075615", 2024-09-13T05:13:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.137:6829/3005075615", 2024-09-13T05:13:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:13:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:13:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:13:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 5, 2024-09-13T05:13:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "6e6f7499-ae9e-4cb1-9db7-4d9f8fd9b257", 2024-09-13T05:13:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:13:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:13:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:13:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:13:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:13:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:13:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:13:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 148, 2024-09-13T05:13:01.094 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:13:01.094 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:13:01.094 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:13:01.094 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6800", 2024-09-13T05:13:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:13:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6801", 2024-09-13T05:13:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:13:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:13:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6802", 2024-09-13T05:13:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:13:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6803", 2024-09-13T05:13:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:13:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:13:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6806", 2024-09-13T05:13:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:13:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6807", 2024-09-13T05:13:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:13:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:13:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6804", 2024-09-13T05:13:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:13:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6805", 2024-09-13T05:13:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1108177522 2024-09-13T05:13:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.137:6801/1108177522", 2024-09-13T05:13:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.137:6803/1108177522", 2024-09-13T05:13:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.137:6807/1108177522", 2024-09-13T05:13:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.137:6805/1108177522", 2024-09-13T05:13:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:13:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:13:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:13:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 6, 2024-09-13T05:13:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "e4c519e5-5df4-4d55-b12e-fbcfb1b0555c", 2024-09-13T05:13:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:13:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 0, 2024-09-13T05:13:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 0, 2024-09-13T05:13:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 0.8276824951171875, 2024-09-13T05:13:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:13:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:13:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:13:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 118, 2024-09-13T05:13:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:13:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:13:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:13:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6816", 2024-09-13T05:13:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:13:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6817", 2024-09-13T05:13:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:13:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:13:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.105 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.105 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6818", 2024-09-13T05:13:01.105 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:13:01.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.105 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.105 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6819", 2024-09-13T05:13:01.105 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:13:01.105 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.106 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.106 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:13:01.106 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.106 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.106 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6822", 2024-09-13T05:13:01.106 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:13:01.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6823", 2024-09-13T05:13:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:13:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:13:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.107 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6820", 2024-09-13T05:13:01.108 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:13:01.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.108 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.108 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6821", 2024-09-13T05:13:01.108 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2667039053 2024-09-13T05:13:01.108 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.108 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.108 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.137:6817/2667039053", 2024-09-13T05:13:01.108 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.137:6819/2667039053", 2024-09-13T05:13:01.109 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.137:6823/2667039053", 2024-09-13T05:13:01.109 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.137:6821/2667039053", 2024-09-13T05:13:01.109 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:13:01.109 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:13:01.109 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:13:01.110 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.110 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 7, 2024-09-13T05:13:01.110 INFO:teuthology.orchestra.run.smithi120.stdout: "uuid": "914648c2-7a6c-4e66-811d-936e250638db", 2024-09-13T05:13:01.110 INFO:teuthology.orchestra.run.smithi120.stdout: "up": 1, 2024-09-13T05:13:01.110 INFO:teuthology.orchestra.run.smithi120.stdout: "in": 1, 2024-09-13T05:13:01.110 INFO:teuthology.orchestra.run.smithi120.stdout: "weight": 1, 2024-09-13T05:13:01.110 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_affinity": 1, 2024-09-13T05:13:01.110 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_begin": 0, 2024-09-13T05:13:01.111 INFO:teuthology.orchestra.run.smithi120.stdout: "last_clean_end": 0, 2024-09-13T05:13:01.111 INFO:teuthology.orchestra.run.smithi120.stdout: "up_from": 13, 2024-09-13T05:13:01.111 INFO:teuthology.orchestra.run.smithi120.stdout: "up_thru": 153, 2024-09-13T05:13:01.111 INFO:teuthology.orchestra.run.smithi120.stdout: "down_at": 0, 2024-09-13T05:13:01.111 INFO:teuthology.orchestra.run.smithi120.stdout: "lost_at": 0, 2024-09-13T05:13:01.111 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addrs": { 2024-09-13T05:13:01.111 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.111 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.111 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6808", 2024-09-13T05:13:01.112 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:13:01.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.112 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.112 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6809", 2024-09-13T05:13:01.112 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:13:01.112 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.112 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.113 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addrs": { 2024-09-13T05:13:01.113 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.113 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.113 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6810", 2024-09-13T05:13:01.113 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:13:01.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.113 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.113 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6811", 2024-09-13T05:13:01.114 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:13:01.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.114 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.114 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addrs": { 2024-09-13T05:13:01.114 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.114 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.114 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6814", 2024-09-13T05:13:01.114 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:13:01.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.115 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.115 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6815", 2024-09-13T05:13:01.115 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:13:01.115 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.115 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.115 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addrs": { 2024-09-13T05:13:01.115 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-13T05:13:01.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.115 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-13T05:13:01.115 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6812", 2024-09-13T05:13:01.116 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:13:01.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.116 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-13T05:13:01.116 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.137:6813", 2024-09-13T05:13:01.116 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 993764921 2024-09-13T05:13:01.116 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.116 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.116 INFO:teuthology.orchestra.run.smithi120.stdout: "public_addr": "172.21.15.137:6809/993764921", 2024-09-13T05:13:01.116 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_addr": "172.21.15.137:6811/993764921", 2024-09-13T05:13:01.117 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_back_addr": "172.21.15.137:6815/993764921", 2024-09-13T05:13:01.117 INFO:teuthology.orchestra.run.smithi120.stdout: "heartbeat_front_addr": "172.21.15.137:6813/993764921", 2024-09-13T05:13:01.117 INFO:teuthology.orchestra.run.smithi120.stdout: "state": [ 2024-09-13T05:13:01.117 INFO:teuthology.orchestra.run.smithi120.stdout: "exists", 2024-09-13T05:13:01.117 INFO:teuthology.orchestra.run.smithi120.stdout: "up" 2024-09-13T05:13:01.117 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.117 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.117 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:13:01.117 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_xinfo": [ 2024-09-13T05:13:01.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.117 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 0, 2024-09-13T05:13:01.118 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:13:01.118 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:13:01.118 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:13:01.118 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:13:01.118 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 65536, 2024-09-13T05:13:01.118 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:46.914820+0000", 2024-09-13T05:13:01.118 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 106 2024-09-13T05:13:01.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.118 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 1, 2024-09-13T05:13:01.119 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:13:01.119 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:13:01.119 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:13:01.119 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:13:01.119 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:13:01.119 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.326286+0000", 2024-09-13T05:13:01.119 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:13:01.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.120 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 2, 2024-09-13T05:13:01.120 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:13:01.120 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:13:01.120 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:13:01.120 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:13:01.120 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:13:01.120 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.147193+0000", 2024-09-13T05:13:01.120 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:13:01.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.120 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 3, 2024-09-13T05:13:01.120 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:13:01.121 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:13:01.121 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:13:01.121 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:13:01.121 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:13:01.121 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.478655+0000", 2024-09-13T05:13:01.121 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:13:01.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.121 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 4, 2024-09-13T05:13:01.122 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:13:01.122 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:13:01.122 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:13:01.122 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:13:01.122 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:13:01.122 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.388938+0000", 2024-09-13T05:13:01.122 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:13:01.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.122 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 5, 2024-09-13T05:13:01.122 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:13:01.122 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:13:01.122 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:13:01.123 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:13:01.123 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:13:01.123 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.127175+0000", 2024-09-13T05:13:01.123 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:13:01.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.123 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 6, 2024-09-13T05:13:01.123 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:13:01.123 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:13:01.123 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:13:01.124 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:13:01.124 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 65536, 2024-09-13T05:13:01.124 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:47.187286+0000", 2024-09-13T05:13:01.124 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:13:01.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.124 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": 7, 2024-09-13T05:13:01.124 INFO:teuthology.orchestra.run.smithi120.stdout: "down_stamp": "0.000000", 2024-09-13T05:13:01.124 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_probability": 0, 2024-09-13T05:13:01.124 INFO:teuthology.orchestra.run.smithi120.stdout: "laggy_interval": 0, 2024-09-13T05:13:01.124 INFO:teuthology.orchestra.run.smithi120.stdout: "features": 4540138322906710015, 2024-09-13T05:13:01.124 INFO:teuthology.orchestra.run.smithi120.stdout: "old_weight": 0, 2024-09-13T05:13:01.125 INFO:teuthology.orchestra.run.smithi120.stdout: "last_purged_snaps_scrub": "2024-09-13T05:09:46.962119+0000", 2024-09-13T05:13:01.125 INFO:teuthology.orchestra.run.smithi120.stdout: "dead_epoch": 0 2024-09-13T05:13:01.125 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.125 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:13:01.125 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_upmap": [ 2024-09-13T05:13:01.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.125 INFO:teuthology.orchestra.run.smithi120.stdout: "pgid": "3.a", 2024-09-13T05:13:01.125 INFO:teuthology.orchestra.run.smithi120.stdout: "osds": [ 2024-09-13T05:13:01.125 INFO:teuthology.orchestra.run.smithi120.stdout: 3, 2024-09-13T05:13:01.125 INFO:teuthology.orchestra.run.smithi120.stdout: 2 2024-09-13T05:13:01.126 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.126 INFO:teuthology.orchestra.run.smithi120.stdout: "pgid": "3.1d", 2024-09-13T05:13:01.126 INFO:teuthology.orchestra.run.smithi120.stdout: "osds": [ 2024-09-13T05:13:01.126 INFO:teuthology.orchestra.run.smithi120.stdout: 0, 2024-09-13T05:13:01.126 INFO:teuthology.orchestra.run.smithi120.stdout: 7 2024-09-13T05:13:01.126 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.126 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.126 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:13:01.126 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_upmap_items": [], 2024-09-13T05:13:01.126 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_upmap_primaries": [], 2024-09-13T05:13:01.127 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_temp": [], 2024-09-13T05:13:01.127 INFO:teuthology.orchestra.run.smithi120.stdout: "primary_temp": [], 2024-09-13T05:13:01.127 INFO:teuthology.orchestra.run.smithi120.stdout: "blocklist": {}, 2024-09-13T05:13:01.127 INFO:teuthology.orchestra.run.smithi120.stdout: "range_blocklist": {}, 2024-09-13T05:13:01.127 INFO:teuthology.orchestra.run.smithi120.stdout: "erasure_code_profiles": { 2024-09-13T05:13:01.127 INFO:teuthology.orchestra.run.smithi120.stdout: "default": { 2024-09-13T05:13:01.127 INFO:teuthology.orchestra.run.smithi120.stdout: "crush-failure-domain": "osd", 2024-09-13T05:13:01.127 INFO:teuthology.orchestra.run.smithi120.stdout: "k": "2", 2024-09-13T05:13:01.127 INFO:teuthology.orchestra.run.smithi120.stdout: "m": "1", 2024-09-13T05:13:01.128 INFO:teuthology.orchestra.run.smithi120.stdout: "plugin": "jerasure", 2024-09-13T05:13:01.128 INFO:teuthology.orchestra.run.smithi120.stdout: "technique": "reed_sol_van" 2024-09-13T05:13:01.128 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:01.128 INFO:teuthology.orchestra.run.smithi120.stdout: "removed_snaps_queue": [ 2024-09-13T05:13:01.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.128 INFO:teuthology.orchestra.run.smithi120.stdout: "pool": 3, 2024-09-13T05:13:01.128 INFO:teuthology.orchestra.run.smithi120.stdout: "snaps": [ 2024-09-13T05:13:01.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.128 INFO:teuthology.orchestra.run.smithi120.stdout: "begin": 33, 2024-09-13T05:13:01.128 INFO:teuthology.orchestra.run.smithi120.stdout: "length": 9 2024-09-13T05:13:01.129 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.129 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.129 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.129 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:13:01.129 INFO:teuthology.orchestra.run.smithi120.stdout: "new_removed_snaps": [ 2024-09-13T05:13:01.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.129 INFO:teuthology.orchestra.run.smithi120.stdout: "pool": 3, 2024-09-13T05:13:01.129 INFO:teuthology.orchestra.run.smithi120.stdout: "snaps": [ 2024-09-13T05:13:01.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:01.130 INFO:teuthology.orchestra.run.smithi120.stdout: "begin": 33, 2024-09-13T05:13:01.130 INFO:teuthology.orchestra.run.smithi120.stdout: "length": 1 2024-09-13T05:13:01.130 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.130 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:01.130 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.130 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-13T05:13:01.130 INFO:teuthology.orchestra.run.smithi120.stdout: "new_purged_snaps": [], 2024-09-13T05:13:01.130 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_node_flags": {}, 2024-09-13T05:13:01.130 INFO:teuthology.orchestra.run.smithi120.stdout: "device_class_flags": {}, 2024-09-13T05:13:01.130 INFO:teuthology.orchestra.run.smithi120.stdout: "stretch_mode": { 2024-09-13T05:13:01.130 INFO:teuthology.orchestra.run.smithi120.stdout: "stretch_mode_enabled": false, 2024-09-13T05:13:01.131 INFO:teuthology.orchestra.run.smithi120.stdout: "stretch_bucket_count": 0, 2024-09-13T05:13:01.131 INFO:teuthology.orchestra.run.smithi120.stdout: "degraded_stretch_mode": 0, 2024-09-13T05:13:01.131 INFO:teuthology.orchestra.run.smithi120.stdout: "recovering_stretch_mode": 0, 2024-09-13T05:13:01.131 INFO:teuthology.orchestra.run.smithi120.stdout: "stretch_mode_bucket": 0 2024-09-13T05:13:01.131 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:01.131 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:01.133 INFO:tasks.thrashosds.thrasher:j is {'epoch': 166, 'fsid': '0a3759da-62bd-4704-8a4a-7c20eb3fc816', 'created': '2024-09-13T05:09:38.849186+0000', 'modified': '2024-09-13T05:13:00.722077+0000', 'last_up_change': '2024-09-13T05:12:13.640614+0000', 'last_in_change': '2024-09-13T05:12:36.834526+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T05:09:52.225455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9653034210205078, 'average_primary_affinity': 0.9700000286102295, 'average_primary_affinity_weighted': 0.9700000286102295}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T05:09:57.858552+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 3, 'score_stable': 3, 'optimal_score': 0.75, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9653034210205078, 'average_primary_affinity': 0.9700000286102295, 'average_primary_affinity_weighted': 0.9700000286102295}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-13T05:10:07.742110+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '166', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 64, 'snap_epoch': 166, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 0.75, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9653034210205078, 'average_primary_affinity': 0.9700000286102295, 'average_primary_affinity_weighted': 0.9700000286102295}}], 'osds': [{'osd': 0, 'uuid': 'b304ec03-bb00-4b13-bf2d-71017b8a70a3', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 105, 'up_from': 124, 'up_thru': 40, 'down_at': 106, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6800', 'nonce': 367697828}, {'type': 'v1', 'addr': '172.21.15.120:6801', 'nonce': 367697828}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6802', 'nonce': 367697828}, {'type': 'v1', 'addr': '172.21.15.120:6803', 'nonce': 367697828}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6806', 'nonce': 367697828}, {'type': 'v1', 'addr': '172.21.15.120:6807', 'nonce': 367697828}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6804', 'nonce': 367697828}, {'type': 'v1', 'addr': '172.21.15.120:6805', 'nonce': 367697828}]}, 'public_addr': '172.21.15.120:6801/367697828', 'cluster_addr': '172.21.15.120:6803/367697828', 'heartbeat_back_addr': '172.21.15.120:6807/367697828', 'heartbeat_front_addr': '172.21.15.120:6805/367697828', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'c09e84f3-3a70-46a4-b67b-c9bb52c887b7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 153, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6808', 'nonce': 1023532100}, {'type': 'v1', 'addr': '172.21.15.120:6809', 'nonce': 1023532100}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6810', 'nonce': 1023532100}, {'type': 'v1', 'addr': '172.21.15.120:6811', 'nonce': 1023532100}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6814', 'nonce': 1023532100}, {'type': 'v1', 'addr': '172.21.15.120:6815', 'nonce': 1023532100}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6812', 'nonce': 1023532100}, {'type': 'v1', 'addr': '172.21.15.120:6813', 'nonce': 1023532100}]}, 'public_addr': '172.21.15.120:6809/1023532100', 'cluster_addr': '172.21.15.120:6811/1023532100', 'heartbeat_back_addr': '172.21.15.120:6815/1023532100', 'heartbeat_front_addr': '172.21.15.120:6813/1023532100', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '3c2a0458-369c-4dac-90a3-fb20cb70d53f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 149, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6816', 'nonce': 592498012}, {'type': 'v1', 'addr': '172.21.15.120:6817', 'nonce': 592498012}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6818', 'nonce': 592498012}, {'type': 'v1', 'addr': '172.21.15.120:6819', 'nonce': 592498012}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6822', 'nonce': 592498012}, {'type': 'v1', 'addr': '172.21.15.120:6823', 'nonce': 592498012}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6820', 'nonce': 592498012}, {'type': 'v1', 'addr': '172.21.15.120:6821', 'nonce': 592498012}]}, 'public_addr': '172.21.15.120:6817/592498012', 'cluster_addr': '172.21.15.120:6819/592498012', 'heartbeat_back_addr': '172.21.15.120:6823/592498012', 'heartbeat_front_addr': '172.21.15.120:6821/592498012', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'edce3757-5e9d-4221-a1f1-3f356bb5218b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 149, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6824', 'nonce': 1939753938}, {'type': 'v1', 'addr': '172.21.15.120:6825', 'nonce': 1939753938}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6826', 'nonce': 1939753938}, {'type': 'v1', 'addr': '172.21.15.120:6827', 'nonce': 1939753938}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6830', 'nonce': 1939753938}, {'type': 'v1', 'addr': '172.21.15.120:6831', 'nonce': 1939753938}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6828', 'nonce': 1939753938}, {'type': 'v1', 'addr': '172.21.15.120:6829', 'nonce': 1939753938}]}, 'public_addr': '172.21.15.120:6825/1939753938', 'cluster_addr': '172.21.15.120:6827/1939753938', 'heartbeat_back_addr': '172.21.15.120:6831/1939753938', 'heartbeat_front_addr': '172.21.15.120:6829/1939753938', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '5fe378d2-578f-41ea-980a-4673a8b376df', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.894744873046875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 154, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6824', 'nonce': 3005075615}, {'type': 'v1', 'addr': '172.21.15.137:6825', 'nonce': 3005075615}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6826', 'nonce': 3005075615}, {'type': 'v1', 'addr': '172.21.15.137:6827', 'nonce': 3005075615}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6830', 'nonce': 3005075615}, {'type': 'v1', 'addr': '172.21.15.137:6831', 'nonce': 3005075615}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6828', 'nonce': 3005075615}, {'type': 'v1', 'addr': '172.21.15.137:6829', 'nonce': 3005075615}]}, 'public_addr': '172.21.15.137:6825/3005075615', 'cluster_addr': '172.21.15.137:6827/3005075615', 'heartbeat_back_addr': '172.21.15.137:6831/3005075615', 'heartbeat_front_addr': '172.21.15.137:6829/3005075615', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '6e6f7499-ae9e-4cb1-9db7-4d9f8fd9b257', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 148, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6800', 'nonce': 1108177522}, {'type': 'v1', 'addr': '172.21.15.137:6801', 'nonce': 1108177522}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6802', 'nonce': 1108177522}, {'type': 'v1', 'addr': '172.21.15.137:6803', 'nonce': 1108177522}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6806', 'nonce': 1108177522}, {'type': 'v1', 'addr': '172.21.15.137:6807', 'nonce': 1108177522}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6804', 'nonce': 1108177522}, {'type': 'v1', 'addr': '172.21.15.137:6805', 'nonce': 1108177522}]}, 'public_addr': '172.21.15.137:6801/1108177522', 'cluster_addr': '172.21.15.137:6803/1108177522', 'heartbeat_back_addr': '172.21.15.137:6807/1108177522', 'heartbeat_front_addr': '172.21.15.137:6805/1108177522', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e4c519e5-5df4-4d55-b12e-fbcfb1b0555c', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 0.8276824951171875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 118, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6816', 'nonce': 2667039053}, {'type': 'v1', 'addr': '172.21.15.137:6817', 'nonce': 2667039053}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6818', 'nonce': 2667039053}, {'type': 'v1', 'addr': '172.21.15.137:6819', 'nonce': 2667039053}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6822', 'nonce': 2667039053}, {'type': 'v1', 'addr': '172.21.15.137:6823', 'nonce': 2667039053}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6820', 'nonce': 2667039053}, {'type': 'v1', 'addr': '172.21.15.137:6821', 'nonce': 2667039053}]}, 'public_addr': '172.21.15.137:6817/2667039053', 'cluster_addr': '172.21.15.137:6819/2667039053', 'heartbeat_back_addr': '172.21.15.137:6823/2667039053', 'heartbeat_front_addr': '172.21.15.137:6821/2667039053', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '914648c2-7a6c-4e66-811d-936e250638db', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 153, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6808', 'nonce': 993764921}, {'type': 'v1', 'addr': '172.21.15.137:6809', 'nonce': 993764921}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6810', 'nonce': 993764921}, {'type': 'v1', 'addr': '172.21.15.137:6811', 'nonce': 993764921}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6814', 'nonce': 993764921}, {'type': 'v1', 'addr': '172.21.15.137:6815', 'nonce': 993764921}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6812', 'nonce': 993764921}, {'type': 'v1', 'addr': '172.21.15.137:6813', 'nonce': 993764921}]}, 'public_addr': '172.21.15.137:6809/993764921', 'cluster_addr': '172.21.15.137:6811/993764921', 'heartbeat_back_addr': '172.21.15.137:6815/993764921', 'heartbeat_front_addr': '172.21.15.137:6813/993764921', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T05:09:46.914820+0000', 'dead_epoch': 106}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.326286+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.147193+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.478655+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.388938+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.127175+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T05:09:47.187286+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T05:09:46.962119+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.a', 'osds': [3, 2]}, {'pgid': '3.1d', 'osds': [0, 7]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 33, 'length': 9}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 33, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-13T05:13:01.133 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:13:01.135 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:01.136 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:01.136 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:13:01.137 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:01.127+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:01.233 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:01.230+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:01.244 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:01.245 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:01.255 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:13:01.334 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:01.331+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:01.358 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:01.358 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:01.368 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:13:01.435 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:01.430+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:01.469 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:13:01.472 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:13:01.476 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:01.476 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:01.485 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-09-13T05:13:00.729376+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1208848645,"num_objects":3128,"num_object_clones":345,"num_object_copies":6256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3128,"num_whiteouts":1898,"num_read":248900,"num_read_kb":623703,"num_write":26636,"num_write_kb":534658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8106,"num_bytes_recovered":272699257,"num_keys_recovered":882,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24361,"ondisk_log_size":24361,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":717216,"kb_used_data":327064,"kb_used_omap":9,"kb_used_meta":390006,"kb_avail":565513824,"statfs":{"total":579820584960,"available":579086155776,"internally_reserved":0,"allocated":334913536,"data_stored":371667322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9557,"internal_metadata":399366827},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-61241504,"num_objects":-297,"num_object_clones":-91,"num_object_copies":-594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-297,"num_whiteouts":-89,"num_read":1133,"num_read_kb":970,"num_write":285,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.033237"},"pg_stats":[{"pgid":"3.1f","version":"159'605","reported_seq":3463,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.702124+0000","last_change":"2024-09-13T05:12:56.702955+0000","last_active":"2024-09-13T05:12:56.702124+0000","last_peered":"2024-09-13T05:12:56.702124+0000","last_clean":"2024-09-13T05:12:56.702124+0000","last_became_active":"2024-09-13T05:10:37.864778+0000","last_became_peered":"2024-09-13T05:10:37.864778+0000","last_unstale":"2024-09-13T05:12:56.702124+0000","last_undegraded":"2024-09-13T05:12:56.702124+0000","last_fullsized":"2024-09-13T05:12:56.702124+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:56:24.801492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014491700000000001,"stat_sum":{"num_bytes":7030016,"num_objects":89,"num_object_clones":7,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":47,"num_read":3887,"num_read_kb":8569,"num_write":640,"num_write_kb":5970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":297202,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.1e","version":"161'582","reported_seq":10097,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.706168+0000","last_change":"2024-09-13T05:12:56.706581+0000","last_active":"2024-09-13T05:12:56.706168+0000","last_peered":"2024-09-13T05:12:56.706168+0000","last_clean":"2024-09-13T05:12:56.706168+0000","last_became_active":"2024-09-13T05:12:23.730740+0000","last_became_peered":"2024-09-13T05:12:23.730740+0000","last_unstale":"2024-09-13T05:12:56.706168+0000","last_undegraded":"2024-09-13T05:12:56.706168+0000","last_fullsized":"2024-09-13T05:12:56.706168+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":582,"log_dups_size":0,"ondisk_log_size":582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:05:34.025751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086092500000000001,"stat_sum":{"num_bytes":26552467,"num_objects":85,"num_object_clones":7,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":57,"num_read":10317,"num_read_kb":9276,"num_write":482,"num_write_kb":4493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":2534879,"num_keys_recovered":23,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.1d","version":"161'749","reported_seq":4262,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.706484+0000","last_change":"2024-09-13T05:12:56.706858+0000","last_active":"2024-09-13T05:12:56.706484+0000","last_peered":"2024-09-13T05:12:56.706484+0000","last_clean":"2024-09-13T05:12:56.706484+0000","last_became_active":"2024-09-13T05:12:40.908241+0000","last_became_peered":"2024-09-13T05:12:40.908241+0000","last_unstale":"2024-09-13T05:12:56.706484+0000","last_undegraded":"2024-09-13T05:12:56.706484+0000","last_fullsized":"2024-09-13T05:12:56.706484+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":749,"log_dups_size":0,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:22:11.929867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045132280000000002,"stat_sum":{"num_bytes":33906834,"num_objects":106,"num_object_clones":13,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":61,"num_read":4533,"num_read_kb":14391,"num_write":773,"num_write_kb":18480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":387,"num_bytes_recovered":7610600,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.1c","version":"162'851","reported_seq":5988,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.749349+0000","last_change":"2024-09-13T05:12:56.707284+0000","last_active":"2024-09-13T05:12:56.749349+0000","last_peered":"2024-09-13T05:12:56.749349+0000","last_clean":"2024-09-13T05:12:56.749349+0000","last_became_active":"2024-09-13T05:12:43.633794+0000","last_became_peered":"2024-09-13T05:12:43.633794+0000","last_unstale":"2024-09-13T05:12:56.749349+0000","last_undegraded":"2024-09-13T05:12:56.749349+0000","last_fullsized":"2024-09-13T05:12:56.749349+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:26:39.019760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042856910000000003,"stat_sum":{"num_bytes":47759563,"num_objects":90,"num_object_clones":11,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":50,"num_read":6645,"num_read_kb":23499,"num_write":965,"num_write_kb":15856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":371,"num_bytes_recovered":9523896,"num_keys_recovered":208,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.1b","version":"162'773","reported_seq":4206,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.710315+0000","last_change":"2024-09-13T05:12:56.710315+0000","last_active":"2024-09-13T05:12:56.710315+0000","last_peered":"2024-09-13T05:12:56.710315+0000","last_clean":"2024-09-13T05:12:56.710315+0000","last_became_active":"2024-09-13T05:12:49.645215+0000","last_became_peered":"2024-09-13T05:12:49.645215+0000","last_unstale":"2024-09-13T05:12:56.710315+0000","last_undegraded":"2024-09-13T05:12:56.710315+0000","last_fullsized":"2024-09-13T05:12:56.710315+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:23:07.604094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021375629999999999,"stat_sum":{"num_bytes":51734194,"num_objects":106,"num_object_clones":10,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":66,"num_read":4852,"num_read_kb":16098,"num_write":888,"num_write_kb":43420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":413,"num_bytes_recovered":12868860,"num_keys_recovered":46,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.1a","version":"161'1885","reported_seq":20421,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.853009+0000","last_change":"2024-09-13T05:12:56.709305+0000","last_active":"2024-09-13T05:12:56.853009+0000","last_peered":"2024-09-13T05:12:56.853009+0000","last_clean":"2024-09-13T05:12:56.853009+0000","last_became_active":"2024-09-13T05:12:46.652272+0000","last_became_peered":"2024-09-13T05:12:46.652272+0000","last_unstale":"2024-09-13T05:12:56.853009+0000","last_undegraded":"2024-09-13T05:12:56.853009+0000","last_fullsized":"2024-09-13T05:12:56.853009+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1885,"log_dups_size":0,"ondisk_log_size":1885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:54.915675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015796899999999999,"stat_sum":{"num_bytes":40342377,"num_objects":108,"num_object_clones":12,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":59,"num_read":26619,"num_read_kb":29599,"num_write":2989,"num_write_kb":13180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":478,"num_bytes_recovered":9711059,"num_keys_recovered":48,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.19","version":"160'835","reported_seq":12273,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.699886+0000","last_change":"2024-09-13T05:12:56.700253+0000","last_active":"2024-09-13T05:12:56.699886+0000","last_peered":"2024-09-13T05:12:56.699886+0000","last_clean":"2024-09-13T05:12:56.699886+0000","last_became_active":"2024-09-13T05:12:09.626312+0000","last_became_peered":"2024-09-13T05:12:09.626312+0000","last_unstale":"2024-09-13T05:12:56.699886+0000","last_undegraded":"2024-09-13T05:12:56.699886+0000","last_fullsized":"2024-09-13T05:12:56.699886+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:47.900796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047232799999999999,"stat_sum":{"num_bytes":64977555,"num_objects":104,"num_object_clones":12,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":61,"num_read":13840,"num_read_kb":22821,"num_write":949,"num_write_kb":7451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":3365202,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.18","version":"161'631","reported_seq":5245,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.704572+0000","last_change":"2024-09-13T05:12:56.704866+0000","last_active":"2024-09-13T05:12:56.704572+0000","last_peered":"2024-09-13T05:12:56.704572+0000","last_clean":"2024-09-13T05:12:56.704572+0000","last_became_active":"2024-09-13T05:12:11.641696+0000","last_became_peered":"2024-09-13T05:12:11.641696+0000","last_unstale":"2024-09-13T05:12:56.704572+0000","last_undegraded":"2024-09-13T05:12:56.704572+0000","last_fullsized":"2024-09-13T05:12:56.704572+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:05:41.070434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077583199999999995,"stat_sum":{"num_bytes":53709096,"num_objects":111,"num_object_clones":16,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":67,"num_read":4816,"num_read_kb":27010,"num_write":633,"num_write_kb":24610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":11847558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.17","version":"159'618","reported_seq":3931,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.703019+0000","last_change":"2024-09-13T05:12:56.703635+0000","last_active":"2024-09-13T05:12:56.703019+0000","last_peered":"2024-09-13T05:12:56.703019+0000","last_clean":"2024-09-13T05:12:56.703019+0000","last_became_active":"2024-09-13T05:10:37.864816+0000","last_became_peered":"2024-09-13T05:10:37.864816+0000","last_unstale":"2024-09-13T05:12:56.703019+0000","last_undegraded":"2024-09-13T05:12:56.703019+0000","last_fullsized":"2024-09-13T05:12:56.703019+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:06.315864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018717740000000001,"stat_sum":{"num_bytes":10494520,"num_objects":96,"num_object_clones":7,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":64,"num_read":5810,"num_read_kb":10941,"num_write":496,"num_write_kb":4122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":37802,"num_keys_recovered":23,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.16","version":"162'511","reported_seq":9407,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.832036+0000","last_change":"2024-09-13T05:12:56.702818+0000","last_active":"2024-09-13T05:12:56.832036+0000","last_peered":"2024-09-13T05:12:56.832036+0000","last_clean":"2024-09-13T05:12:56.832036+0000","last_became_active":"2024-09-13T05:11:24.631079+0000","last_became_peered":"2024-09-13T05:11:24.631079+0000","last_unstale":"2024-09-13T05:12:56.832036+0000","last_undegraded":"2024-09-13T05:12:56.832036+0000","last_fullsized":"2024-09-13T05:12:56.832036+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:29.182802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020248900000000001,"stat_sum":{"num_bytes":53688061,"num_objects":88,"num_object_clones":17,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":54,"num_read":9251,"num_read_kb":15704,"num_write":410,"num_write_kb":4479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":4743569,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.15","version":"160'590","reported_seq":13254,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.704925+0000","last_change":"2024-09-13T05:12:56.705412+0000","last_active":"2024-09-13T05:12:56.704925+0000","last_peered":"2024-09-13T05:12:56.704925+0000","last_clean":"2024-09-13T05:12:56.704925+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:12:56.704925+0000","last_undegraded":"2024-09-13T05:12:56.704925+0000","last_fullsized":"2024-09-13T05:12:56.704925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:40.457636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0057071179999999997,"stat_sum":{"num_bytes":16205440,"num_objects":96,"num_object_clones":14,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":63,"num_read":13609,"num_read_kb":13872,"num_write":561,"num_write_kb":23548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.14","version":"160'543","reported_seq":8100,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.710365+0000","last_change":"2024-09-13T05:12:56.710712+0000","last_active":"2024-09-13T05:12:56.710365+0000","last_peered":"2024-09-13T05:12:56.710365+0000","last_clean":"2024-09-13T05:12:56.710365+0000","last_became_active":"2024-09-13T05:12:45.651071+0000","last_became_peered":"2024-09-13T05:12:45.651071+0000","last_unstale":"2024-09-13T05:12:56.710365+0000","last_undegraded":"2024-09-13T05:12:56.710365+0000","last_fullsized":"2024-09-13T05:12:56.710365+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:25.056987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024260280000000002,"stat_sum":{"num_bytes":44187301,"num_objects":96,"num_object_clones":13,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":58,"num_read":7282,"num_read_kb":29052,"num_write":445,"num_write_kb":7007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":364,"num_bytes_recovered":7851183,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T05:12:55.773156+0000","last_change":"2024-09-13T05:12:19.694070+0000","last_active":"2024-09-13T05:12:55.773156+0000","last_peered":"2024-09-13T05:12:55.773156+0000","last_clean":"2024-09-13T05:12:55.773156+0000","last_became_active":"2024-09-13T05:12:19.693769+0000","last_became_peered":"2024-09-13T05:12:19.693769+0000","last_unstale":"2024-09-13T05:12:55.773156+0000","last_undegraded":"2024-09-13T05:12:55.773156+0000","last_fullsized":"2024-09-13T05:12:55.773156+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:47:36.726484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"162'605","reported_seq":8591,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.845906+0000","last_change":"2024-09-13T05:12:56.706244+0000","last_active":"2024-09-13T05:12:56.845906+0000","last_peered":"2024-09-13T05:12:56.845906+0000","last_clean":"2024-09-13T05:12:56.845906+0000","last_became_active":"2024-09-13T05:12:43.636700+0000","last_became_peered":"2024-09-13T05:12:43.636700+0000","last_unstale":"2024-09-13T05:12:56.845906+0000","last_undegraded":"2024-09-13T05:12:56.845906+0000","last_fullsized":"2024-09-13T05:12:56.845906+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:42:50.465437+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.006158958,"stat_sum":{"num_bytes":33141020,"num_objects":92,"num_object_clones":10,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":54,"num_read":8028,"num_read_kb":18011,"num_write":543,"num_write_kb":8591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":531,"num_bytes_recovered":23835437,"num_keys_recovered":90,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"2.6","version":"0'0","reported_seq":74,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T05:12:55.698227+0000","last_change":"2024-09-13T05:12:37.863607+0000","last_active":"2024-09-13T05:12:55.698227+0000","last_peered":"2024-09-13T05:12:55.698227+0000","last_clean":"2024-09-13T05:12:55.698227+0000","last_became_active":"2024-09-13T05:12:37.863309+0000","last_became_peered":"2024-09-13T05:12:37.863309+0000","last_unstale":"2024-09-13T05:12:55.698227+0000","last_undegraded":"2024-09-13T05:12:55.698227+0000","last_fullsized":"2024-09-13T05:12:55.698227+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:28:14.261640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"160'546","reported_seq":5765,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.706226+0000","last_change":"2024-09-13T05:12:56.706606+0000","last_active":"2024-09-13T05:12:56.706226+0000","last_peered":"2024-09-13T05:12:56.706226+0000","last_clean":"2024-09-13T05:12:56.706226+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:12:56.706226+0000","last_undegraded":"2024-09-13T05:12:56.706226+0000","last_fullsized":"2024-09-13T05:12:56.706226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:37.976147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066390000000000004,"stat_sum":{"num_bytes":52324015,"num_objects":94,"num_object_clones":8,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":60,"num_read":5344,"num_read_kb":14781,"num_write":426,"num_write_kb":5129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"2.5","version":"0'0","reported_seq":183,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T05:12:55.773006+0000","last_change":"2024-09-13T05:12:37.863288+0000","last_active":"2024-09-13T05:12:55.773006+0000","last_peered":"2024-09-13T05:12:55.773006+0000","last_clean":"2024-09-13T05:12:55.773006+0000","last_became_active":"2024-09-13T05:12:37.862910+0000","last_became_peered":"2024-09-13T05:12:37.862910+0000","last_unstale":"2024-09-13T05:12:55.773006+0000","last_undegraded":"2024-09-13T05:12:55.773006+0000","last_fullsized":"2024-09-13T05:12:55.773006+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:28:53.795278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"159'658","reported_seq":1620,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.700311+0000","last_change":"2024-09-13T05:12:56.700634+0000","last_active":"2024-09-13T05:12:56.700311+0000","last_peered":"2024-09-13T05:12:56.700311+0000","last_clean":"2024-09-13T05:12:56.700311+0000","last_became_active":"2024-09-13T05:12:09.627485+0000","last_became_peered":"2024-09-13T05:12:09.627485+0000","last_unstale":"2024-09-13T05:12:56.700311+0000","last_undegraded":"2024-09-13T05:12:56.700311+0000","last_fullsized":"2024-09-13T05:12:56.700311+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:54.694847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060286699999999999,"stat_sum":{"num_bytes":17574668,"num_objects":90,"num_object_clones":8,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":54,"num_read":1683,"num_read_kb":4624,"num_write":753,"num_write_kb":10312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":352,"num_bytes_recovered":5263836,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"2.4","version":"0'0","reported_seq":58,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T05:12:55.698517+0000","last_change":"2024-09-13T05:12:03.637346+0000","last_active":"2024-09-13T05:12:55.698517+0000","last_peered":"2024-09-13T05:12:55.698517+0000","last_clean":"2024-09-13T05:12:55.698517+0000","last_became_active":"2024-09-13T05:12:03.636811+0000","last_became_peered":"2024-09-13T05:12:03.636811+0000","last_unstale":"2024-09-13T05:12:55.698517+0000","last_undegraded":"2024-09-13T05:12:55.698517+0000","last_fullsized":"2024-09-13T05:12:55.698517+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:20:34.682745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"162'631","reported_seq":5275,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.711232+0000","last_change":"2024-09-13T05:12:56.711541+0000","last_active":"2024-09-13T05:12:56.711232+0000","last_peered":"2024-09-13T05:12:56.711232+0000","last_clean":"2024-09-13T05:12:56.711232+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:12:56.711232+0000","last_undegraded":"2024-09-13T05:12:56.711232+0000","last_fullsized":"2024-09-13T05:12:56.711232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:40.372741+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0089536359999999992,"stat_sum":{"num_bytes":96367512,"num_objects":98,"num_object_clones":10,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":47,"num_read":6823,"num_read_kb":59230,"num_write":555,"num_write_kb":55659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.3","version":"162'927","reported_seq":4290,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.841918+0000","last_change":"2024-09-13T05:12:56.709708+0000","last_active":"2024-09-13T05:12:56.841918+0000","last_peered":"2024-09-13T05:12:56.841918+0000","last_clean":"2024-09-13T05:12:56.841918+0000","last_became_active":"2024-09-13T05:12:47.658611+0000","last_became_peered":"2024-09-13T05:12:47.658611+0000","last_unstale":"2024-09-13T05:12:56.841918+0000","last_undegraded":"2024-09-13T05:12:56.841918+0000","last_fullsized":"2024-09-13T05:12:56.841918+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:39:49.136782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001528389,"stat_sum":{"num_bytes":66613817,"num_objects":99,"num_object_clones":11,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":64,"num_read":4516,"num_read_kb":30301,"num_write":1056,"num_write_kb":50266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":590,"num_bytes_recovered":30927923,"num_keys_recovered":33,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"2.2","version":"20'2","reported_seq":185,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T05:12:55.691527+0000","last_change":"2024-09-13T05:12:03.638698+0000","last_active":"2024-09-13T05:12:55.691527+0000","last_peered":"2024-09-13T05:12:55.691527+0000","last_clean":"2024-09-13T05:12:55.691527+0000","last_became_active":"2024-09-13T05:12:03.635365+0000","last_became_peered":"2024-09-13T05:12:03.635365+0000","last_unstale":"2024-09-13T05:12:55.691527+0000","last_undegraded":"2024-09-13T05:12:55.691527+0000","last_fullsized":"2024-09-13T05:12:55.691527+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:44:53.312870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"159'710","reported_seq":1481,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.700063+0000","last_change":"2024-09-13T05:12:56.700381+0000","last_active":"2024-09-13T05:12:56.700063+0000","last_peered":"2024-09-13T05:12:56.700063+0000","last_clean":"2024-09-13T05:12:56.700063+0000","last_became_active":"2024-09-13T05:12:07.930334+0000","last_became_peered":"2024-09-13T05:12:07.930334+0000","last_unstale":"2024-09-13T05:12:56.700063+0000","last_undegraded":"2024-09-13T05:12:56.700063+0000","last_fullsized":"2024-09-13T05:12:56.700063+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:23:46.175271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044018699999999998,"stat_sum":{"num_bytes":23728729,"num_objects":109,"num_object_clones":13,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":68,"num_read":1950,"num_read_kb":3519,"num_write":668,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":1243867,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"2.1","version":"0'0","reported_seq":159,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T05:12:55.704959+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:12:55.704959+0000","last_peered":"2024-09-13T05:12:55.704959+0000","last_clean":"2024-09-13T05:12:55.704959+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:12:55.704959+0000","last_undegraded":"2024-09-13T05:12:55.704959+0000","last_fullsized":"2024-09-13T05:12:55.704959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"162'965","reported_seq":5068,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.875086+0000","last_change":"2024-09-13T05:12:56.713597+0000","last_active":"2024-09-13T05:12:56.875086+0000","last_peered":"2024-09-13T05:12:56.875086+0000","last_clean":"2024-09-13T05:12:56.875086+0000","last_became_active":"2024-09-13T05:12:41.915886+0000","last_became_peered":"2024-09-13T05:12:41.915886+0000","last_unstale":"2024-09-13T05:12:56.875086+0000","last_undegraded":"2024-09-13T05:12:56.875086+0000","last_fullsized":"2024-09-13T05:12:56.875086+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:48.945004+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0057291319999999996,"stat_sum":{"num_bytes":26459318,"num_objects":82,"num_object_clones":11,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":51,"num_read":6404,"num_read_kb":19890,"num_write":1260,"num_write_kb":12447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":8416446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"2.0","version":"0'0","reported_seq":183,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T05:12:55.771739+0000","last_change":"2024-09-13T05:12:03.636279+0000","last_active":"2024-09-13T05:12:55.771739+0000","last_peered":"2024-09-13T05:12:55.771739+0000","last_clean":"2024-09-13T05:12:55.771739+0000","last_became_active":"2024-09-13T05:12:03.635929+0000","last_became_peered":"2024-09-13T05:12:03.635929+0000","last_unstale":"2024-09-13T05:12:55.771739+0000","last_undegraded":"2024-09-13T05:12:55.771739+0000","last_fullsized":"2024-09-13T05:12:55.771739+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:58:02.386056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"162'599","reported_seq":3038,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.880240+0000","last_change":"2024-09-13T05:12:56.705308+0000","last_active":"2024-09-13T05:12:56.880240+0000","last_peered":"2024-09-13T05:12:56.880240+0000","last_clean":"2024-09-13T05:12:56.880240+0000","last_became_active":"2024-09-13T05:11:23.617149+0000","last_became_peered":"2024-09-13T05:11:23.617149+0000","last_unstale":"2024-09-13T05:12:56.880240+0000","last_undegraded":"2024-09-13T05:12:56.880240+0000","last_fullsized":"2024-09-13T05:12:56.880240+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:55:46.203366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092626500000000001,"stat_sum":{"num_bytes":25536731,"num_objects":98,"num_object_clones":9,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":59,"num_read":4575,"num_read_kb":11696,"num_write":554,"num_write_kb":8352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":2822984,"num_keys_recovered":34,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"2.3","version":"18'1","reported_seq":160,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T05:12:55.691787+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:12:55.691787+0000","last_peered":"2024-09-13T05:12:55.691787+0000","last_clean":"2024-09-13T05:12:55.691787+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:12:55.691787+0000","last_undegraded":"2024-09-13T05:12:55.691787+0000","last_fullsized":"2024-09-13T05:12:55.691787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":349,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T05:12:55.772028+0000","last_change":"2024-09-13T05:12:22.723305+0000","last_active":"2024-09-13T05:12:55.772028+0000","last_peered":"2024-09-13T05:12:55.772028+0000","last_clean":"2024-09-13T05:12:55.772028+0000","last_became_active":"2024-09-13T05:12:22.722658+0000","last_became_peered":"2024-09-13T05:12:22.722658+0000","last_unstale":"2024-09-13T05:12:55.772028+0000","last_undegraded":"2024-09-13T05:12:55.772028+0000","last_fullsized":"2024-09-13T05:12:55.772028+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:43:27.636898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"160'611","reported_seq":16971,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.705162+0000","last_change":"2024-09-13T05:12:56.705406+0000","last_active":"2024-09-13T05:12:56.705162+0000","last_peered":"2024-09-13T05:12:56.705162+0000","last_clean":"2024-09-13T05:12:56.705162+0000","last_became_active":"2024-09-13T05:12:12.653214+0000","last_became_peered":"2024-09-13T05:12:12.653214+0000","last_unstale":"2024-09-13T05:12:56.705162+0000","last_undegraded":"2024-09-13T05:12:56.705162+0000","last_fullsized":"2024-09-13T05:12:56.705162+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:11.574280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098219600000000007,"stat_sum":{"num_bytes":9754698,"num_objects":102,"num_object_clones":11,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":66,"num_read":16621,"num_read_kb":16706,"num_write":473,"num_write_kb":27916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":2876772,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.9","version":"160'783","reported_seq":8614,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.710783+0000","last_change":"2024-09-13T05:12:56.711081+0000","last_active":"2024-09-13T05:12:56.710783+0000","last_peered":"2024-09-13T05:12:56.710783+0000","last_clean":"2024-09-13T05:12:56.710783+0000","last_became_active":"2024-09-13T05:12:41.912780+0000","last_became_peered":"2024-09-13T05:12:41.912780+0000","last_unstale":"2024-09-13T05:12:56.710783+0000","last_undegraded":"2024-09-13T05:12:56.710783+0000","last_fullsized":"2024-09-13T05:12:56.710783+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:02:12.915400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032190629999999999,"stat_sum":{"num_bytes":43941578,"num_objects":86,"num_object_clones":8,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":48,"num_read":10989,"num_read_kb":25198,"num_write":804,"num_write_kb":20343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":5657687,"num_keys_recovered":48,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.a","version":"162'734","reported_seq":10798,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.821823+0000","last_change":"2024-09-13T05:12:56.704555+0000","last_active":"2024-09-13T05:12:56.821823+0000","last_peered":"2024-09-13T05:12:56.821823+0000","last_clean":"2024-09-13T05:12:56.821823+0000","last_became_active":"2024-09-13T05:10:47.939220+0000","last_became_peered":"2024-09-13T05:10:47.939220+0000","last_unstale":"2024-09-13T05:12:56.821823+0000","last_undegraded":"2024-09-13T05:12:56.821823+0000","last_fullsized":"2024-09-13T05:12:56.821823+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":734,"log_dups_size":0,"ondisk_log_size":734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:59.693041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049545500000000001,"stat_sum":{"num_bytes":22041823,"num_objects":98,"num_object_clones":12,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":62,"num_read":10979,"num_read_kb":19578,"num_write":699,"num_write_kb":9899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":59,"num_bytes_recovered":6203954,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.b","version":"159'618","reported_seq":7119,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.704639+0000","last_change":"2024-09-13T05:12:56.705065+0000","last_active":"2024-09-13T05:12:56.704639+0000","last_peered":"2024-09-13T05:12:56.704639+0000","last_clean":"2024-09-13T05:12:56.704639+0000","last_became_active":"2024-09-13T05:12:44.643571+0000","last_became_peered":"2024-09-13T05:12:44.643571+0000","last_unstale":"2024-09-13T05:12:56.704639+0000","last_undegraded":"2024-09-13T05:12:56.704639+0000","last_fullsized":"2024-09-13T05:12:56.704639+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:47:44.698936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089931500000000003,"stat_sum":{"num_bytes":6303613,"num_objects":94,"num_object_clones":11,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":63,"num_read":6816,"num_read_kb":12515,"num_write":497,"num_write_kb":8600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":440,"num_bytes_recovered":7231372,"num_keys_recovered":46,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.c","version":"159'656","reported_seq":2434,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.708166+0000","last_change":"2024-09-13T05:12:56.709473+0000","last_active":"2024-09-13T05:12:56.708166+0000","last_peered":"2024-09-13T05:12:56.708166+0000","last_clean":"2024-09-13T05:12:56.708166+0000","last_became_active":"2024-09-13T05:10:09.647037+0000","last_became_peered":"2024-09-13T05:10:09.647037+0000","last_unstale":"2024-09-13T05:12:56.708166+0000","last_undegraded":"2024-09-13T05:12:56.708166+0000","last_fullsized":"2024-09-13T05:12:56.708166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:54:17.061326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006111511,"stat_sum":{"num_bytes":53680979,"num_objects":90,"num_object_clones":11,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":54,"num_read":2957,"num_read_kb":14712,"num_write":761,"num_write_kb":19816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.d","version":"162'763","reported_seq":4374,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.712330+0000","last_change":"2024-09-13T05:12:56.712602+0000","last_active":"2024-09-13T05:12:56.712330+0000","last_peered":"2024-09-13T05:12:56.712330+0000","last_clean":"2024-09-13T05:12:56.712330+0000","last_became_active":"2024-09-13T05:11:23.616962+0000","last_became_peered":"2024-09-13T05:11:23.616962+0000","last_unstale":"2024-09-13T05:12:56.712330+0000","last_undegraded":"2024-09-13T05:12:56.712330+0000","last_fullsized":"2024-09-13T05:12:56.712330+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:19.035337+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.012499079999999999,"stat_sum":{"num_bytes":68614016,"num_objects":98,"num_object_clones":11,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":55,"num_read":5025,"num_read_kb":15415,"num_write":857,"num_write_kb":9162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":12781016,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.e","version":"162'1065","reported_seq":9038,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.824346+0000","last_change":"2024-09-13T05:12:56.712140+0000","last_active":"2024-09-13T05:12:56.824346+0000","last_peered":"2024-09-13T05:12:56.824346+0000","last_clean":"2024-09-13T05:12:56.824346+0000","last_became_active":"2024-09-13T05:12:46.655973+0000","last_became_peered":"2024-09-13T05:12:46.655973+0000","last_unstale":"2024-09-13T05:12:56.824346+0000","last_undegraded":"2024-09-13T05:12:56.824346+0000","last_fullsized":"2024-09-13T05:12:56.824346+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1065,"log_dups_size":0,"ondisk_log_size":1065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:05:32.995650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011933908999999999,"stat_sum":{"num_bytes":34681871,"num_objects":97,"num_object_clones":7,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":64,"num_read":9488,"num_read_kb":10905,"num_write":1424,"num_write_kb":6881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":612,"num_bytes_recovered":16479322,"num_keys_recovered":78,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.f","version":"162'876","reported_seq":6953,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.711219+0000","last_change":"2024-09-13T05:12:56.711568+0000","last_active":"2024-09-13T05:12:56.711219+0000","last_peered":"2024-09-13T05:12:56.711219+0000","last_clean":"2024-09-13T05:12:56.711219+0000","last_became_active":"2024-09-13T05:12:45.651313+0000","last_became_peered":"2024-09-13T05:12:45.651313+0000","last_unstale":"2024-09-13T05:12:56.711219+0000","last_undegraded":"2024-09-13T05:12:56.711219+0000","last_fullsized":"2024-09-13T05:12:56.711219+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:07:00.462818+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.011398323,"stat_sum":{"num_bytes":18538959,"num_objects":99,"num_object_clones":10,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":67,"num_read":7475,"num_read_kb":14078,"num_write":1043,"num_write_kb":7811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":7824116,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.10","version":"162'600","reported_seq":3321,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.878558+0000","last_change":"2024-09-13T05:12:56.701490+0000","last_active":"2024-09-13T05:12:56.878558+0000","last_peered":"2024-09-13T05:12:56.878558+0000","last_clean":"2024-09-13T05:12:56.878558+0000","last_became_active":"2024-09-13T05:12:23.730157+0000","last_became_peered":"2024-09-13T05:12:23.730157+0000","last_unstale":"2024-09-13T05:12:56.878558+0000","last_undegraded":"2024-09-13T05:12:56.878558+0000","last_fullsized":"2024-09-13T05:12:56.878558+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:16:41.314885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00126056,"stat_sum":{"num_bytes":36417976,"num_objects":114,"num_object_clones":7,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":65,"num_read":3270,"num_read_kb":16603,"num_write":577,"num_write_kb":24231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":406,"num_bytes_recovered":27581720,"num_keys_recovered":44,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.11","version":"162'492","reported_seq":9401,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.705833+0000","last_change":"2024-09-13T05:12:56.706352+0000","last_active":"2024-09-13T05:12:56.705833+0000","last_peered":"2024-09-13T05:12:56.705833+0000","last_clean":"2024-09-13T05:12:56.705833+0000","last_became_active":"2024-09-13T05:12:42.936456+0000","last_became_peered":"2024-09-13T05:12:42.936456+0000","last_unstale":"2024-09-13T05:12:56.705833+0000","last_undegraded":"2024-09-13T05:12:56.705833+0000","last_fullsized":"2024-09-13T05:12:56.705833+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:23.680853+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0069189050000000004,"stat_sum":{"num_bytes":12220355,"num_objects":104,"num_object_clones":11,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":70,"num_read":8113,"num_read_kb":13497,"num_write":380,"num_write_kb":21128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":380,"num_bytes_recovered":20462375,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.12","version":"162'1009","reported_seq":6054,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.704816+0000","last_change":"2024-09-13T05:12:56.704816+0000","last_active":"2024-09-13T05:12:56.704816+0000","last_peered":"2024-09-13T05:12:56.704816+0000","last_clean":"2024-09-13T05:12:56.704816+0000","last_became_active":"2024-09-13T05:10:40.883543+0000","last_became_peered":"2024-09-13T05:10:40.883543+0000","last_unstale":"2024-09-13T05:12:56.704816+0000","last_undegraded":"2024-09-13T05:12:56.704816+0000","last_fullsized":"2024-09-13T05:12:56.704816+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1009,"log_dups_size":0,"ondisk_log_size":1009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:14:23.460182+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0053415240000000003,"stat_sum":{"num_bytes":61124833,"num_objects":92,"num_object_clones":11,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":54,"num_read":8718,"num_read_kb":26661,"num_write":1210,"num_write_kb":8567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":633324,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"25","length":"5"}]},{"pgid":"3.13","version":"159'1220","reported_seq":5060,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T05:12:56.705515+0000","last_change":"2024-09-13T05:12:56.706447+0000","last_active":"2024-09-13T05:12:56.705515+0000","last_peered":"2024-09-13T05:12:56.705515+0000","last_clean":"2024-09-13T05:12:56.705515+0000","last_became_active":"2024-09-13T05:12:48.638127+0000","last_became_peered":"2024-09-13T05:12:48.638127+0000","last_unstale":"2024-09-13T05:12:56.705515+0000","last_undegraded":"2024-09-13T05:12:56.705515+0000","last_fullsized":"2024-09-13T05:12:56.705515+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1220,"log_dups_size":0,"ondisk_log_size":1220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:33:48.012842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066726019999999997,"stat_sum":{"num_bytes":48604323,"num_objects":113,"num_object_clones":16,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":66,"num_read":7549,"num_read_kb":54851,"num_write":1704,"num_write_kb":40142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":20884522,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"25","length":"5"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1208258258,"num_objects":3124,"num_object_clones":345,"num_object_copies":6248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3124,"num_whiteouts":1898,"num_read":248784,"num_read_kb":623603,"num_write":26475,"num_write_kb":532240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8100,"num_bytes_recovered":271518483,"num_keys_recovered":882,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":396460032,"data_stored":444917633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24241,"ondisk_log_size":24241,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":155080,"kb_used_data":61628,"kb_used_omap":1,"kb_used_meta":93438,"kb_avail":94216760,"statfs":{"total":96636764160,"available":96477962240,"internally_reserved":0,"allocated":63107072,"data_stored":66341062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":95680971},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:52 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":1.3500000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.83799999999999997}]},{"osd":1,"last update":"Fri Sep 13 05:11:54 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.80900000000000005,"15min":0.81899999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.871,"5min":0.80700000000000005,"15min":0.79700000000000004},"min":{"1min":0.60899999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.2090000000000001,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.036}]},{"osd":2,"last update":"Fri Sep 13 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.83699999999999997,"15min":0.84999999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.84499999999999997,"15min":0.79600000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.3169999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.3169999999999999}]},{"osd":3,"last update":"Fri Sep 13 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":0.98499999999999999,"15min":0.90600000000000003},"min":{"1min":0.53200000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":12.663,"5min":12.663,"15min":12.663},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.89400000000000002,"15min":0.90200000000000002},"min":{"1min":0.50600000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4179999999999999,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Sep 13 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.79200000000000004,"15min":0.77300000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.93400000000000005,"15min":0.93300000000000005},"min":{"1min":0.49399999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":0.80400000000000005}]},{"osd":5,"last update":"Fri Sep 13 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":0.96699999999999997,"15min":0.95499999999999996},"min":{"1min":0.68700000000000006,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.5349999999999999,"5min":1.655,"15min":1.655},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.95599999999999996,"15min":0.94799999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.98399999999999999}]},{"osd":6,"last update":"Fri Sep 13 05:12:53 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.93000000000000005,"15min":0.91800000000000004},"min":{"1min":0.48399999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.097},{"interface":"front","average":{"1min":1.135,"5min":1.0489999999999999,"15min":1.0409999999999999},"min":{"1min":0.80500000000000005,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.167}]}]},{"osd":6,"up_from":0,"seq":55834574888,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132100,"kb_used_data":56700,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94239740,"statfs":{"total":96636764160,"available":96501493760,"internally_reserved":0,"allocated":58060800,"data_stored":61892828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77199814},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.628},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.83199999999999996}]},{"osd":1,"last update":"Fri Sep 13 05:12:56 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.84499999999999997,"15min":0.875},"min":{"1min":0.42799999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.0760000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.875,"15min":0.91300000000000003},"min":{"1min":0.54700000000000004,"5min":0.376,"15min":0.376},"max":{"1min":1.0349999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.91900000000000004}]},{"osd":2,"last update":"Fri Sep 13 05:12:56 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.81999999999999995,"15min":0.84599999999999997},"min":{"1min":0.61799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.226,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.88900000000000001,"15min":0.89400000000000002},"min":{"1min":0.53000000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.53000000000000003}]},{"osd":3,"last update":"Fri Sep 13 05:12:56 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.874,"15min":0.91700000000000004},"min":{"1min":0.56399999999999995,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.2609999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.95499999999999996,"15min":1.0089999999999999},"min":{"1min":0.48399999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.375,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.48399999999999999}]},{"osd":4,"last update":"Fri Sep 13 05:12:56 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.90600000000000003,"15min":0.95399999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.448,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.002},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.048,"15min":1.103},"min":{"1min":0.47299999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.3879999999999999,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.95799999999999996}]},{"osd":6,"last update":"Fri Sep 13 05:12:00 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.93100000000000005,"15min":0.95099999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":1.0129999999999999,"15min":1.0409999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.2789999999999999,"5min":1.528,"15min":1.528},"last":1.075}]},{"osd":7,"last update":"Fri Sep 13 05:12:56 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.111,"15min":1.181},"min":{"1min":0.54800000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5489999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.113,"15min":1.1599999999999999},"min":{"1min":0.50800000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.554,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.89800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107352,"kb_used_data":76184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94264488,"statfs":{"total":96636764160,"available":96526835712,"internally_reserved":0,"allocated":78012416,"data_stored":82947622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:55 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":3.9929999999999999,"5min":3.9929999999999999,"15min":3.9929999999999999},"last":1.101},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":1.224}]},{"osd":1,"last update":"Fri Sep 13 05:11:55 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.752,"15min":0.754},"min":{"1min":0.44800000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.753},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.90800000000000003,"15min":0.93200000000000005},"min":{"1min":0.496,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.107,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.78900000000000003}]},{"osd":2,"last update":"Fri Sep 13 05:11:55 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.995,"15min":0.999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":4.1779999999999999,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.026,"5min":1.089,"15min":1.099},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":4.1639999999999997,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.98099999999999998}]},{"osd":3,"last update":"Fri Sep 13 05:11:55 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.93999999999999995,"15min":0.92400000000000004},"min":{"1min":0.57699999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":4.0609999999999999,"5min":4.0609999999999999,"15min":4.0609999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.91500000000000004,"15min":0.92400000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.758,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.87}]},{"osd":5,"last update":"Fri Sep 13 05:11:55 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.89400000000000002,"15min":0.89500000000000002},"min":{"1min":0.50600000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.143,"15min":1.175},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3080000000000001,"5min":3.871,"15min":3.871},"last":0.89400000000000002}]},{"osd":6,"last update":"Fri Sep 13 05:11:55 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.123,"15min":1.153},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3640000000000001,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":1.071},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.95799999999999996,"15min":0.96199999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.5629999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.95399999999999996}]},{"osd":7,"last update":"Fri Sep 13 05:11:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.1519999999999999,"15min":1.1699999999999999},"min":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4970000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.105,"15min":1.1080000000000001},"min":{"1min":0.65200000000000002,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.0449999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131364,"kb_used_data":78096,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94240476,"statfs":{"total":96636764160,"available":96502247424,"internally_reserved":0,"allocated":79970304,"data_stored":94038024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":54524360},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.497}]},{"osd":1,"last update":"Fri Sep 13 05:12:00 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92600000000000005,"5min":1.089,"15min":1.089},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.71199999999999997,"15min":0.72799999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0720000000000001,"5min":1.125,"15min":1.125},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Sep 13 05:12:00 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73899999999999999,"15min":0.74399999999999999},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":1.089,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.82899999999999996,"15min":0.85099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1339999999999999,"5min":1.573,"15min":1.573},"last":0.438}]},{"osd":4,"last update":"Fri Sep 13 05:12:00 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.87,"15min":0.90000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.98899999999999999,"5min":1.48,"15min":1.48},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.91600000000000004,"15min":0.93500000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.236,"5min":1.764,"15min":1.764},"last":0.79900000000000004}]},{"osd":5,"last update":"Fri Sep 13 05:12:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.995,"15min":1.0209999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.6890000000000001,"5min":2.157,"15min":2.157},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.95399999999999996,"15min":0.99199999999999999},"min":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0780000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.71599999999999997}]},{"osd":6,"last update":"Fri Sep 13 05:12:00 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.96899999999999997,"15min":0.98899999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3899999999999999,"5min":1.976,"15min":1.976},"last":0.629},{"interface":"front","average":{"1min":0.85999999999999999,"5min":1.071,"15min":1.1060000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2,"5min":2.012,"15min":2.012},"last":0.90500000000000003}]},{"osd":7,"last update":"Fri Sep 13 05:12:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":1.0600000000000001,"15min":1.0880000000000001},"min":{"1min":0.67700000000000005,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1599999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":1.0840000000000001,"15min":1.1080000000000001},"min":{"1min":0.68200000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.2,"5min":1.875,"15min":1.875},"last":0.76000000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99904,"kb_used_data":20396,"kb_used_omap":1,"kb_used_meta":79486,"kb_avail":94271936,"statfs":{"total":96636764160,"available":96534462464,"internally_reserved":0,"allocated":20885504,"data_stored":24848789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":81394118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:51 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.96399999999999997}]},{"osd":1,"last update":"Fri Sep 13 05:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65400000000000003,"15min":0.67000000000000004},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65000000000000002,"15min":0.65600000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.0780000000000001}]},{"osd":3,"last update":"Fri Sep 13 05:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.65900000000000003,"15min":0.62},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.94499999999999995,"5min":6.6070000000000002,"15min":6.6070000000000002},"last":1.002},{"interface":"front","average":{"1min":0.746,"5min":0.68200000000000005,"15min":0.66200000000000003},"min":{"1min":0.41799999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.014}]},{"osd":4,"last update":"Fri Sep 13 05:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.78400000000000003,"15min":0.77000000000000002},"min":{"1min":0.57899999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.88900000000000001,"15min":0.89200000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3160000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.88}]},{"osd":5,"last update":"Fri Sep 13 05:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.86699999999999999,"15min":0.89100000000000001},"min":{"1min":0.60599999999999998,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0189999999999999,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.05},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.88100000000000001,"15min":0.86699999999999999},"min":{"1min":0.71399999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.0649999999999999}]},{"osd":6,"last update":"Fri Sep 13 05:12:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.88900000000000001,"15min":0.874},"min":{"1min":0.53800000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.622,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.3100000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.1910000000000001}]},{"osd":7,"last update":"Fri Sep 13 05:12:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.016,"15min":1.0309999999999999},"min":{"1min":0.59399999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.393,"5min":1.867,"15min":1.867},"last":1.2669999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.96299999999999997,"15min":0.97199999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.292,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.1359999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91416,"kb_used_data":34060,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94280424,"statfs":{"total":96636764160,"available":96543154176,"internally_reserved":0,"allocated":34877440,"data_stored":41598997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:10:54 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.54800000000000004}]},{"osd":2,"last update":"Fri Sep 13 05:11:57 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.64600000000000002,"15min":0.60999999999999999},"min":{"1min":0.27500000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":5.952,"5min":5.952,"15min":5.952},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69599999999999995,"15min":0.70099999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.64900000000000002}]},{"osd":3,"last update":"Fri Sep 13 05:11:57 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.76200000000000001,"15min":0.77800000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.083,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.74299999999999999,"15min":0.75700000000000001},"min":{"1min":0.35099999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":0.67700000000000005}]},{"osd":4,"last update":"Fri Sep 13 05:11:57 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.91300000000000003,"15min":0.92900000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.92300000000000004,"15min":0.94499999999999995},"min":{"1min":0.502,"5min":0.439,"15min":0.439},"max":{"1min":1.1259999999999999,"5min":1.724,"15min":1.724},"last":0.84199999999999997}]},{"osd":5,"last update":"Fri Sep 13 05:11:57 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.90700000000000003,"15min":0.92700000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.27,"5min":1.484,"15min":1.484},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.87,"5min":0.92400000000000004,"15min":0.93300000000000005},"min":{"1min":0.58399999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.93799999999999994}]},{"osd":6,"last update":"Fri Sep 13 05:11:57 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.98499999999999999,"15min":1.0109999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1970000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.99399999999999999,"15min":1.012},"min":{"1min":0.55100000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.4339999999999999,"5min":1.873,"15min":1.873},"last":1.2809999999999999}]},{"osd":7,"last update":"Fri Sep 13 05:11:57 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":1.0129999999999999,"15min":1.0229999999999999},"min":{"1min":0.64600000000000002,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.298,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.3149999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0249999999999999,"15min":1.034},"min":{"1min":0.61199999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.468}]}]},{"osd":0,"up_from":0,"seq":532575944715,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10035200,"data_stored":11939429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32342016,"data_stored":40084513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18948096,"data_stored":23924692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":78016512,"data_stored":93107549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":75927552,"data_stored":81890876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":56033280,"data_stored":60891150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":64749568,"data_stored":68401288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":60407808,"data_stored":64678136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:13:01.488 INFO:tasks.thrashosds.thrasher:Setting 3.2 to [6, 7] 2024-09-13T05:13:01.488 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.2', '6', '7'] 2024-09-13T05:13:01.488 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.2 6 7 2024-09-13T05:13:01.490 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:13:01.536 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:01.530+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:01.636 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:01.630+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:01.639 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:01.639 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:01.649 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:13:01.737 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:01.734+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:01.754 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:01.759 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:01.764 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:13:01.839 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:01.835+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:01.886 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:01.887 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:01.897 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:13:01.939 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:01.934+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:02.008 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:02.009 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:02.020 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:13:02.070 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:02.067+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:02.122 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:02.122 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:02.132 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:13:02.141 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:02.135+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:02.198 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:13:02.240 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:02.241 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:02.245 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:02.242+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:02.248 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:13:02.342 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:02.339+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:02.353 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:13:02.376 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:13:02.397 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:13:02.399 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:02.399 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:02.409 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:13:02.420 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:13:02.440 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:13:02.454 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:02.451+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:02.461 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:13:02.483 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:13:02.506 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:13:02.508 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:13:02.509 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:13:02.509 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:13:02.509 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:13:02.509 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:13:02.509 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:13:02.509 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:13:02.509 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:13:02.520 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:02.520 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:13:02.520 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:13:02.521 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:13:02.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.521 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3.bb1d1096 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:13:02.521 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:13:02.521 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 98.572182953999999, 2024-09-13T05:13:02.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68834410099999999, 2024-09-13T05:13:02.521 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:02.521 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:02.521 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:02.521 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:02.521 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:02.521 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:13:02.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.521 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:02.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:02.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:13:02.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:02.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:13:02.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:02.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943719+0000", 2024-09-13T05:13:02.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:13:02.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.523 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:02.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943734+0000", 2024-09-13T05:13:02.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4793e-05 2024-09-13T05:13:02.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.523 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:02.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943765+0000", 2024-09-13T05:13:02.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0648999999999997e-05 2024-09-13T05:13:02.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:02.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943779+0000", 2024-09-13T05:13:02.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.447e-05 2024-09-13T05:13:02.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943872+0000", 2024-09-13T05:13:02.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3304e-05 2024-09-13T05:13:02.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:02.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943884+0000", 2024-09-13T05:13:02.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.167e-05 2024-09-13T05:13:02.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.525 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.525 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632042+0000", 2024-09-13T05:13:02.525 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68815832600000004 2024-09-13T05:13:02.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.525 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:02.525 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632066+0000", 2024-09-13T05:13:02.525 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3765999999999999e-05 2024-09-13T05:13:02.525 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.525 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:02.526 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.526 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3.b6bd6256 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:13:02.526 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:13:02.526 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 98.572058454, 2024-09-13T05:13:02.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68852592499999998, 2024-09-13T05:13:02.526 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:02.526 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:02.526 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:02.526 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:02.526 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:02.526 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:13:02.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.527 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:02.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:02.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:13:02.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:02.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:13:02.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.528 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:02.528 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943846+0000", 2024-09-13T05:13:02.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:02.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.528 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:02.528 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943852+0000", 2024-09-13T05:13:02.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3820000000000001e-06 2024-09-13T05:13:02.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.528 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:02.528 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943876+0000", 2024-09-13T05:13:02.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3995e-05 2024-09-13T05:13:02.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.529 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:02.529 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943898+0000", 2024-09-13T05:13:02.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1838999999999999e-05 2024-09-13T05:13:02.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.529 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.529 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946457+0000", 2024-09-13T05:13:02.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025588910000000002 2024-09-13T05:13:02.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.529 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:02.530 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946499+0000", 2024-09-13T05:13:02.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2814e-05 2024-09-13T05:13:02.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.530 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.530 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632364+0000", 2024-09-13T05:13:02.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68586484999999997 2024-09-13T05:13:02.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.530 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:02.530 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632372+0000", 2024-09-13T05:13:02.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1659999999999994e-06 2024-09-13T05:13:02.530 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.530 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:02.531 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.531 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3:6908b8dd:::rbd_data.112d8d1317eb.000000000000000f:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:13:02.531 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:13:02.531 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 98.534914376000003, 2024-09-13T05:13:02.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65181049499999999, 2024-09-13T05:13:02.531 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:02.531 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:02.531 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:02.531 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:02.531 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:02.531 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:13:02.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.532 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:02.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:02.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:13:02.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:02.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:13:02.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:02.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980989+0000", 2024-09-13T05:13:02.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:02.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:02.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980996+0000", 2024-09-13T05:13:02.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2200000000000003e-06 2024-09-13T05:13:02.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:02.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981011+0000", 2024-09-13T05:13:02.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4997000000000001e-05 2024-09-13T05:13:02.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:02.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981025+0000", 2024-09-13T05:13:02.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3604000000000001e-05 2024-09-13T05:13:02.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981110+0000", 2024-09-13T05:13:02.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4948000000000001e-05 2024-09-13T05:13:02.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:02.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981120+0000", 2024-09-13T05:13:02.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9399999999999997e-06 2024-09-13T05:13:02.535 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.535 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.535 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632425+0000", 2024-09-13T05:13:02.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65130460499999998 2024-09-13T05:13:02.535 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.535 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:02.535 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632587+0000", 2024-09-13T05:13:02.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016199500000000001 2024-09-13T05:13:02.535 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:02.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632801+0000", 2024-09-13T05:13:02.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021459499999999999 2024-09-13T05:13:02.536 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.536 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:02.536 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.536 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3:6a46bd6d:::rbd_data.112d8d1317eb.0000000000000010:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:13:02.536 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:13:02.536 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 98.534856719999993, 2024-09-13T05:13:02.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65213695699999996, 2024-09-13T05:13:02.537 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:02.537 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:02.537 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:02.537 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:02.537 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:02.537 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:13:02.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.537 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:02.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:02.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:13:02.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:02.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:13:02.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:02.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:13:02.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:02.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:02.539 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981052+0000", 2024-09-13T05:13:02.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4469999999999999e-06 2024-09-13T05:13:02.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.539 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:02.539 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981066+0000", 2024-09-13T05:13:02.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3658e-05 2024-09-13T05:13:02.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.539 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:02.539 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981073+0000", 2024-09-13T05:13:02.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:13:02.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.540 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.540 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981150+0000", 2024-09-13T05:13:02.540 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7783999999999999e-05 2024-09-13T05:13:02.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.540 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:02.540 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981161+0000", 2024-09-13T05:13:02.540 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0197000000000001e-05 2024-09-13T05:13:02.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.540 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.540 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632926+0000", 2024-09-13T05:13:02.540 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65176517300000003 2024-09-13T05:13:02.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:02.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633081+0000", 2024-09-13T05:13:02.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000155172 2024-09-13T05:13:02.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:02.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633185+0000", 2024-09-13T05:13:02.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000104329 2024-09-13T05:13:02.541 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.541 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:02.541 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.542 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:159585 3.1c 3:3afcc414:::rbd_data.112dfd94ee88.00000000000002ca:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:02.542 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:13:02.542 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 55.501538406999998, 2024-09-13T05:13:02.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91717655399999998, 2024-09-13T05:13:02.542 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:02.542 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:02.542 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:02.542 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:02.542 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:02.542 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 159585 2024-09-13T05:13:02.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.543 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:02.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:02.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:13:02.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:02.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:13:02.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.544 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:02.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014366+0000", 2024-09-13T05:13:02.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:02.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.544 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:02.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014370+0000", 2024-09-13T05:13:02.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9960000000000004e-06 2024-09-13T05:13:02.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.544 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:02.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014379+0000", 2024-09-13T05:13:02.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8550000000000008e-06 2024-09-13T05:13:02.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:02.545 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014386+0000", 2024-09-13T05:13:02.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0140000000000001e-06 2024-09-13T05:13:02.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.545 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014533+0000", 2024-09-13T05:13:02.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000147458 2024-09-13T05:13:02.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:02.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014545+0000", 2024-09-13T05:13:02.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1318000000000001e-05 2024-09-13T05:13:02.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931378+0000", 2024-09-13T05:13:02.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91683292400000005 2024-09-13T05:13:02.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:02.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931495+0000", 2024-09-13T05:13:02.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011726399999999999 2024-09-13T05:13:02.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:02.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931543+0000", 2024-09-13T05:13:02.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8183000000000003e-05 2024-09-13T05:13:02.547 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.547 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:02.547 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.548 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160206 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 83968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:02.548 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:13:02.548 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 55.47813601, 2024-09-13T05:13:02.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89412730799999995, 2024-09-13T05:13:02.548 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:02.548 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:02.548 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:02.548 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:02.548 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:02.548 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160206 2024-09-13T05:13:02.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.548 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:02.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:02.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:13:02.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:02.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:13:02.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:02.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037768+0000", 2024-09-13T05:13:02.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:02.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:02.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037774+0000", 2024-09-13T05:13:02.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3600000000000001e-06 2024-09-13T05:13:02.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:02.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037786+0000", 2024-09-13T05:13:02.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.188e-05 2024-09-13T05:13:02.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:02.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037793+0000", 2024-09-13T05:13:02.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2749999999999998e-06 2024-09-13T05:13:02.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:13:02.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0353000000000003e-05 2024-09-13T05:13:02.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:02.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037862+0000", 2024-09-13T05:13:02.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9710000000000004e-06 2024-09-13T05:13:02.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931610+0000", 2024-09-13T05:13:02.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89374846299999999 2024-09-13T05:13:02.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:02.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931815+0000", 2024-09-13T05:13:02.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020516499999999999 2024-09-13T05:13:02.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:02.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931896+0000", 2024-09-13T05:13:02.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1157999999999998e-05 2024-09-13T05:13:02.553 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.553 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:02.553 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.553 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160208 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 84992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:02.553 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:13:02.553 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 55.478051270999998, 2024-09-13T05:13:02.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440702299999997, 2024-09-13T05:13:02.553 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:02.553 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:02.553 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:02.553 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:02.554 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:02.554 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160208 2024-09-13T05:13:02.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.554 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:02.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:02.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:13:02.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:02.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:13:02.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:02.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037853+0000", 2024-09-13T05:13:02.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:02.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:02.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037858+0000", 2024-09-13T05:13:02.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2179999999999998e-06 2024-09-13T05:13:02.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:02.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037867+0000", 2024-09-13T05:13:02.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5699999999999993e-06 2024-09-13T05:13:02.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:02.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037874+0000", 2024-09-13T05:13:02.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2810000000000003e-06 2024-09-13T05:13:02.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037935+0000", 2024-09-13T05:13:02.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1231999999999999e-05 2024-09-13T05:13:02.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:02.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037944+0000", 2024-09-13T05:13:02.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8580000000000006e-06 2024-09-13T05:13:02.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931956+0000", 2024-09-13T05:13:02.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89401158800000002 2024-09-13T05:13:02.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:02.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932015+0000", 2024-09-13T05:13:02.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8906999999999997e-05 2024-09-13T05:13:02.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:02.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932261+0000", 2024-09-13T05:13:02.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024622799999999997 2024-09-13T05:13:02.558 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.558 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:02.558 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.558 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160210 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 86016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:02.558 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:13:02.558 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 55.477982417, 2024-09-13T05:13:02.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89428998299999996, 2024-09-13T05:13:02.558 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:02.558 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:02.558 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:02.558 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:02.559 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:02.559 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160210 2024-09-13T05:13:02.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.559 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:02.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:02.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:13:02.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:02.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:13:02.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:02.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037922+0000", 2024-09-13T05:13:02.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:02.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:02.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037926+0000", 2024-09-13T05:13:02.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6550000000000003e-06 2024-09-13T05:13:02.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:02.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037933+0000", 2024-09-13T05:13:02.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5409999999999997e-06 2024-09-13T05:13:02.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:02.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037939+0000", 2024-09-13T05:13:02.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1940000000000003e-06 2024-09-13T05:13:02.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037976+0000", 2024-09-13T05:13:02.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6671000000000002e-05 2024-09-13T05:13:02.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:02.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037982+0000", 2024-09-13T05:13:02.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9669999999999998e-06 2024-09-13T05:13:02.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.562 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932096+0000", 2024-09-13T05:13:02.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89411465599999995 2024-09-13T05:13:02.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:02.562 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932149+0000", 2024-09-13T05:13:02.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3032999999999999e-05 2024-09-13T05:13:02.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:02.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932213+0000", 2024-09-13T05:13:02.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3165999999999998e-05 2024-09-13T05:13:02.563 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.563 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:02.563 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.563 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160212 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 87040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:02.563 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:13:02.563 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 55.477895296, 2024-09-13T05:13:02.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440379699999994, 2024-09-13T05:13:02.563 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:02.563 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:02.563 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:02.564 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:02.564 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:02.564 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160212 2024-09-13T05:13:02.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.564 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:02.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:02.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:13:02.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:02.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:13:02.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:02.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038009+0000", 2024-09-13T05:13:02.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:02.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:02.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038013+0000", 2024-09-13T05:13:02.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3950000000000003e-06 2024-09-13T05:13:02.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:02.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038032+0000", 2024-09-13T05:13:02.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8513999999999999e-05 2024-09-13T05:13:02.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:02.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038039+0000", 2024-09-13T05:13:02.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.985e-06 2024-09-13T05:13:02.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038086+0000", 2024-09-13T05:13:02.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7302999999999998e-05 2024-09-13T05:13:02.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:02.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038090+0000", 2024-09-13T05:13:02.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9029999999999997e-06 2024-09-13T05:13:02.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932291+0000", 2024-09-13T05:13:02.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89420100199999997 2024-09-13T05:13:02.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:02.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932352+0000", 2024-09-13T05:13:02.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1354999999999998e-05 2024-09-13T05:13:02.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:02.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932414+0000", 2024-09-13T05:13:02.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1037999999999994e-05 2024-09-13T05:13:02.568 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.568 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:02.568 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.568 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160214 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 88064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:02.568 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:13:02.568 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 55.477764229999998, 2024-09-13T05:13:02.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89438890900000001, 2024-09-13T05:13:02.568 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:02.568 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:02.568 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:02.568 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:02.568 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:02.569 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160214 2024-09-13T05:13:02.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.569 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:02.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:02.569 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:13:02.569 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:02.569 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:13:02.569 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:02.570 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038140+0000", 2024-09-13T05:13:02.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:02.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.570 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:02.570 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038145+0000", 2024-09-13T05:13:02.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9749999999999998e-06 2024-09-13T05:13:02.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.570 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:02.570 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038153+0000", 2024-09-13T05:13:02.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1280000000000008e-06 2024-09-13T05:13:02.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.570 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:02.571 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038161+0000", 2024-09-13T05:13:02.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0339999999999997e-06 2024-09-13T05:13:02.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.571 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.571 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.571 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038199+0000", 2024-09-13T05:13:02.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8269999999999998e-05 2024-09-13T05:13:02.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.571 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.571 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:02.571 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038204+0000", 2024-09-13T05:13:02.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5399999999999997e-06 2024-09-13T05:13:02.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.571 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.571 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932438+0000", 2024-09-13T05:13:02.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89423397999999998 2024-09-13T05:13:02.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:02.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932480+0000", 2024-09-13T05:13:02.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2392999999999999e-05 2024-09-13T05:13:02.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:02.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932530+0000", 2024-09-13T05:13:02.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:13:02.572 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.572 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:02.573 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.573 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160305 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 215040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:02.573 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:13:02.573 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 55.473561007999997, 2024-09-13T05:13:02.573 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89028175300000001, 2024-09-13T05:13:02.573 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:02.573 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:02.573 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:02.573 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:02.573 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:02.573 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160305 2024-09-13T05:13:02.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.574 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:02.574 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.574 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:02.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:13:02.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.574 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.574 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:02.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:13:02.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.574 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.574 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:02.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042343+0000", 2024-09-13T05:13:02.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:02.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.575 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:02.575 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042350+0000", 2024-09-13T05:13:02.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3769999999999998e-06 2024-09-13T05:13:02.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.575 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:02.575 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042367+0000", 2024-09-13T05:13:02.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.734e-05 2024-09-13T05:13:02.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.575 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:02.575 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042375+0000", 2024-09-13T05:13:02.576 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8469999999999996e-06 2024-09-13T05:13:02.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.576 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.576 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.576 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042428+0000", 2024-09-13T05:13:02.576 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3074e-05 2024-09-13T05:13:02.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.576 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.576 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:02.576 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042437+0000", 2024-09-13T05:13:02.576 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:13:02.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.576 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.576 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932550+0000", 2024-09-13T05:13:02.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89011304300000005 2024-09-13T05:13:02.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.577 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:02.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932589+0000", 2024-09-13T05:13:02.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9236000000000002e-05 2024-09-13T05:13:02.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.577 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:02.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932626+0000", 2024-09-13T05:13:02.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6832999999999998e-05 2024-09-13T05:13:02.577 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.577 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:02.577 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.578 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160307 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 216064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:02.578 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:13:02.578 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 55.473514569000002, 2024-09-13T05:13:02.578 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89032630800000001, 2024-09-13T05:13:02.578 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:02.578 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:02.578 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:02.578 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:02.578 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:02.578 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160307 2024-09-13T05:13:02.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.578 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:02.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:02.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:13:02.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:02.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:13:02.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:02.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:13:02.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:02.580 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.580 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.580 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:02.580 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042394+0000", 2024-09-13T05:13:02.580 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7900000000000001e-06 2024-09-13T05:13:02.580 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.580 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.580 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:02.580 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042401+0000", 2024-09-13T05:13:02.580 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.267e-06 2024-09-13T05:13:02.580 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.580 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.580 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:02.580 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042406+0000", 2024-09-13T05:13:02.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0860000000000001e-06 2024-09-13T05:13:02.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042465+0000", 2024-09-13T05:13:02.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9441000000000002e-05 2024-09-13T05:13:02.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:02.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042471+0000", 2024-09-13T05:13:02.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6640000000000003e-06 2024-09-13T05:13:02.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.581 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.581 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932645+0000", 2024-09-13T05:13:02.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89017372900000002 2024-09-13T05:13:02.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:02.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932681+0000", 2024-09-13T05:13:02.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5918999999999999e-05 2024-09-13T05:13:02.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:02.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932717+0000", 2024-09-13T05:13:02.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6007999999999998e-05 2024-09-13T05:13:02.582 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.582 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:02.582 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.583 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160309 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 217088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:02.583 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:13:02.583 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 55.473464309999997, 2024-09-13T05:13:02.583 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89037315900000003, 2024-09-13T05:13:02.583 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:02.583 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:02.583 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:02.583 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:02.583 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:02.583 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160309 2024-09-13T05:13:02.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.583 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:02.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.584 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:02.584 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:13:02.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.584 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.584 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:02.584 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:13:02.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.584 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.584 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:02.584 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042440+0000", 2024-09-13T05:13:02.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:02.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:02.585 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042444+0000", 2024-09-13T05:13:02.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.104e-06 2024-09-13T05:13:02.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:02.585 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042451+0000", 2024-09-13T05:13:02.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.922e-06 2024-09-13T05:13:02.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:02.585 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042457+0000", 2024-09-13T05:13:02.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3979999999999998e-06 2024-09-13T05:13:02.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042497+0000", 2024-09-13T05:13:02.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0692999999999998e-05 2024-09-13T05:13:02.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:02.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042503+0000", 2024-09-13T05:13:02.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.553e-06 2024-09-13T05:13:02.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932735+0000", 2024-09-13T05:13:02.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89023238699999996 2024-09-13T05:13:02.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.587 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:02.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932771+0000", 2024-09-13T05:13:02.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5972000000000001e-05 2024-09-13T05:13:02.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.587 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:02.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932814+0000", 2024-09-13T05:13:02.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2657000000000002e-05 2024-09-13T05:13:02.587 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.587 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:02.587 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.588 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.588 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160311 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 218112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:02.588 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:13:02.588 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 55.473438819999998, 2024-09-13T05:13:02.588 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89045284400000002, 2024-09-13T05:13:02.588 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:02.588 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:02.588 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:02.588 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:02.588 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:02.588 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160311 2024-09-13T05:13:02.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.588 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:02.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:02.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:13:02.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:02.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:13:02.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:02.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:13:02.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:02.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:02.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042469+0000", 2024-09-13T05:13:02.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.456e-06 2024-09-13T05:13:02.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:02.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042475+0000", 2024-09-13T05:13:02.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0990000000000004e-06 2024-09-13T05:13:02.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:02.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042481+0000", 2024-09-13T05:13:02.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.237e-06 2024-09-13T05:13:02.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042527+0000", 2024-09-13T05:13:02.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6796999999999999e-05 2024-09-13T05:13:02.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:02.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042533+0000", 2024-09-13T05:13:02.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6489999999999996e-06 2024-09-13T05:13:02.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.592 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932832+0000", 2024-09-13T05:13:02.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89029919800000001 2024-09-13T05:13:02.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.592 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:02.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932867+0000", 2024-09-13T05:13:02.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5049000000000003e-05 2024-09-13T05:13:02.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.592 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:02.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932919+0000", 2024-09-13T05:13:02.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1780999999999998e-05 2024-09-13T05:13:02.592 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.593 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:02.593 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.593 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.593 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.593 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160313 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 219136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:02.593 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:13:02.593 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 55.473409728999997, 2024-09-13T05:13:02.593 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89064232600000004, 2024-09-13T05:13:02.593 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:02.593 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:02.593 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:02.593 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:02.593 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:02.594 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160313 2024-09-13T05:13:02.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.594 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:02.594 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.594 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:02.594 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:13:02.594 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.594 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.594 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:02.594 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:13:02.594 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.594 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.594 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:02.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:13:02.595 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:02.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.595 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:02.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042498+0000", 2024-09-13T05:13:02.595 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.281e-06 2024-09-13T05:13:02.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.595 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:02.595 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042505+0000", 2024-09-13T05:13:02.595 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2699999999999999e-06 2024-09-13T05:13:02.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:02.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042512+0000", 2024-09-13T05:13:02.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0330000000000003e-06 2024-09-13T05:13:02.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042557+0000", 2024-09-13T05:13:02.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4425999999999998e-05 2024-09-13T05:13:02.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:02.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042562+0000", 2024-09-13T05:13:02.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3639999999999998e-06 2024-09-13T05:13:02.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.597 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.597 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932987+0000", 2024-09-13T05:13:02.597 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89042472299999997 2024-09-13T05:13:02.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.597 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.597 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:02.597 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933062+0000", 2024-09-13T05:13:02.597 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5129999999999994e-05 2024-09-13T05:13:02.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.597 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.597 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:02.597 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933138+0000", 2024-09-13T05:13:02.597 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5536000000000003e-05 2024-09-13T05:13:02.597 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.598 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:02.598 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.598 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.598 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160315 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 220160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:02.598 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:13:02.598 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 55.473378562000001, 2024-09-13T05:13:02.598 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89071820800000001, 2024-09-13T05:13:02.598 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:02.598 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:02.598 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:02.598 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:02.598 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:02.598 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160315 2024-09-13T05:13:02.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.599 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:02.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:02.599 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:13:02.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:02.599 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:13:02.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:02.599 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:13:02.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:02.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.600 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:02.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042529+0000", 2024-09-13T05:13:02.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3639999999999999e-06 2024-09-13T05:13:02.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.600 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:02.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042536+0000", 2024-09-13T05:13:02.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.866e-06 2024-09-13T05:13:02.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.600 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:02.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042541+0000", 2024-09-13T05:13:02.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:13:02.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.601 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.601 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.601 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042587+0000", 2024-09-13T05:13:02.601 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5735000000000002e-05 2024-09-13T05:13:02.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.601 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.601 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:02.601 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042593+0000", 2024-09-13T05:13:02.601 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0719999999999996e-06 2024-09-13T05:13:02.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.601 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.601 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.601 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933160+0000", 2024-09-13T05:13:02.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89056621000000002 2024-09-13T05:13:02.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:02.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933202+0000", 2024-09-13T05:13:02.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2376000000000002e-05 2024-09-13T05:13:02.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:02.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933245+0000", 2024-09-13T05:13:02.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2787999999999998e-05 2024-09-13T05:13:02.602 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.602 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:02.602 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.603 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.603 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.603 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160317 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:02.603 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:13:02.603 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 55.473349732999999, 2024-09-13T05:13:02.603 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89082205800000003, 2024-09-13T05:13:02.603 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:02.603 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:02.603 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:02.603 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:02.603 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:02.603 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160317 2024-09-13T05:13:02.603 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.603 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:02.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.604 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:02.604 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:13:02.604 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.604 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:02.604 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:13:02.604 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.604 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:02.604 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:13:02.604 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:02.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.605 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:02.605 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042558+0000", 2024-09-13T05:13:02.605 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1810000000000001e-06 2024-09-13T05:13:02.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.605 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:02.605 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042565+0000", 2024-09-13T05:13:02.605 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9280000000000004e-06 2024-09-13T05:13:02.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.605 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:02.605 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042571+0000", 2024-09-13T05:13:02.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7420000000000003e-06 2024-09-13T05:13:02.606 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042616+0000", 2024-09-13T05:13:02.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5201999999999999e-05 2024-09-13T05:13:02.606 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:02.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042622+0000", 2024-09-13T05:13:02.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8289999999999996e-06 2024-09-13T05:13:02.606 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933259+0000", 2024-09-13T05:13:02.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89063730799999996 2024-09-13T05:13:02.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.607 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:02.607 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933311+0000", 2024-09-13T05:13:02.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1910000000000003e-05 2024-09-13T05:13:02.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.607 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:02.607 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933377+0000", 2024-09-13T05:13:02.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6396999999999995e-05 2024-09-13T05:13:02.607 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.607 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:02.607 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.608 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160319 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 222208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:02.608 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:13:02.608 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 55.473319517, 2024-09-13T05:13:02.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89087477400000004, 2024-09-13T05:13:02.608 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:02.608 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:02.608 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:02.608 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:02.608 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:02.608 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160319 2024-09-13T05:13:02.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.608 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:02.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:02.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:13:02.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:02.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:13:02.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:02.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042585+0000", 2024-09-13T05:13:02.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:02.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:02.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042588+0000", 2024-09-13T05:13:02.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9450000000000002e-06 2024-09-13T05:13:02.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:02.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042594+0000", 2024-09-13T05:13:02.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0959999999999997e-06 2024-09-13T05:13:02.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:02.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042599+0000", 2024-09-13T05:13:02.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0069999999999997e-06 2024-09-13T05:13:02.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042642+0000", 2024-09-13T05:13:02.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2553999999999999e-05 2024-09-13T05:13:02.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:02.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042647+0000", 2024-09-13T05:13:02.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.31e-06 2024-09-13T05:13:02.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933387+0000", 2024-09-13T05:13:02.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89073982799999996 2024-09-13T05:13:02.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:02.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:13:02.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7101000000000003e-05 2024-09-13T05:13:02.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:02.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933460+0000", 2024-09-13T05:13:02.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6282999999999998e-05 2024-09-13T05:13:02.612 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.612 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:02.612 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.613 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160321 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 223232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:02.613 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:13:02.613 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 55.473290089999999, 2024-09-13T05:13:02.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89094616999999998, 2024-09-13T05:13:02.613 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:02.613 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:02.613 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:02.613 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:02.613 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:02.613 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160321 2024-09-13T05:13:02.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.613 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:02.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.613 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:02.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:13:02.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:02.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:13:02.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:02.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:13:02.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:02.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:02.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042617+0000", 2024-09-13T05:13:02.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8329999999999998e-06 2024-09-13T05:13:02.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:02.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042638+0000", 2024-09-13T05:13:02.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0908e-05 2024-09-13T05:13:02.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:02.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042644+0000", 2024-09-13T05:13:02.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0440000000000001e-06 2024-09-13T05:13:02.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042666+0000", 2024-09-13T05:13:02.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1256000000000001e-05 2024-09-13T05:13:02.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:02.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042671+0000", 2024-09-13T05:13:02.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6250000000000004e-06 2024-09-13T05:13:02.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933478+0000", 2024-09-13T05:13:02.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89080698800000002 2024-09-13T05:13:02.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:02.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933519+0000", 2024-09-13T05:13:02.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0717000000000003e-05 2024-09-13T05:13:02.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:02.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933561+0000", 2024-09-13T05:13:02.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2225999999999999e-05 2024-09-13T05:13:02.617 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.617 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:02.617 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.618 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:201615 3.1d 3:bb015654:::rbd_data.112d9dba7cdc.000000000000000a:head [delete] snapc 30=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2024-09-13T05:13:02.618 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:13:02.618 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 22.511053309000001, 2024-09-13T05:13:02.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.90842926999999996, 2024-09-13T05:13:02.618 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:02.618 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:02.618 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:02.618 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:02.618 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:02.618 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 201615 2024-09-13T05:13:02.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.619 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:02.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:02.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:13:02.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:02.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:13:02.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:02.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004850+0000", 2024-09-13T05:13:02.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:02.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:02.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004860+0000", 2024-09-13T05:13:02.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.927e-06 2024-09-13T05:13:02.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:02.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004882+0000", 2024-09-13T05:13:02.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2079999999999999e-05 2024-09-13T05:13:02.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:02.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004897+0000", 2024-09-13T05:13:02.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4892000000000001e-05 2024-09-13T05:13:02.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.005068+0000", 2024-09-13T05:13:02.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017098999999999999 2024-09-13T05:13:02.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:02.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.005081+0000", 2024-09-13T05:13:02.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3063e-05 2024-09-13T05:13:02.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.910925+0000", 2024-09-13T05:13:02.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.90584383400000001 2024-09-13T05:13:02.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:02.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.911131+0000", 2024-09-13T05:13:02.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020629399999999999 2024-09-13T05:13:02.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 4", 2024-09-13T05:13:02.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.911313+0000", 2024-09-13T05:13:02.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000182175 2024-09-13T05:13:02.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:02.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913010+0000", 2024-09-13T05:13:02.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0016971550000000001 2024-09-13T05:13:02.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:02.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913212+0000", 2024-09-13T05:13:02.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000202237 2024-09-13T05:13:02.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:02.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913253+0000", 2024-09-13T05:13:02.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0250999999999998e-05 2024-09-13T05:13:02.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:02.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913281+0000", 2024-09-13T05:13:02.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8314e-05 2024-09-13T05:13:02.624 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.624 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:02.624 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.624 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.624 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:02.624 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:02.626 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:02.622+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:02.626 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:13:02.726 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:02.722+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:02.743 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:02.743 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:02.743 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:13:02.743 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:02.754 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:13:02.756 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T05:13:02.758 INFO:teuthology.orchestra.run.smithi120.stderr:set 3.2 pg_upmap mapping to [6,7] 2024-09-13T05:13:02.828 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:02.822+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:02.860 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:02.861 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:02.861 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:13:02.861 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:13:02.861 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:02.871 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:13:02.929 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:02.923+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:02.983 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:02.983 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:13:02.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:13:02.983 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:13:02.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.983 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29021 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2865152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:02.983 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:13:02.983 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 145.93721839700001, 2024-09-13T05:13:02.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060927993999999999, 2024-09-13T05:13:02.984 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:02.984 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:02.984 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:02.984 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:02.984 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:02.984 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29021 2024-09-13T05:13:02.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.984 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:02.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:02.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:13:02.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.985 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:02.985 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:13:02.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.985 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:02.985 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041763+0000", 2024-09-13T05:13:02.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:02.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:02.986 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041766+0000", 2024-09-13T05:13:02.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6800000000000002e-06 2024-09-13T05:13:02.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:02.986 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041771+0000", 2024-09-13T05:13:02.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:13:02.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:02.986 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041776+0000", 2024-09-13T05:13:02.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8489999999999997e-06 2024-09-13T05:13:02.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102513+0000", 2024-09-13T05:13:02.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060737102000000001 2024-09-13T05:13:02.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:02.988 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102597+0000", 2024-09-13T05:13:02.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4374000000000002e-05 2024-09-13T05:13:02.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.988 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:02.988 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102692+0000", 2024-09-13T05:13:02.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4436000000000002e-05 2024-09-13T05:13:02.989 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.989 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:02.989 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.989 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29022 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2874368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:02.989 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:13:02.989 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 145.93720209700001, 2024-09-13T05:13:02.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061135083999999999, 2024-09-13T05:13:02.989 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:02.989 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:02.989 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:02.990 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:02.990 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:02.990 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29022 2024-09-13T05:13:02.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.990 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:02.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.990 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:02.990 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:13:02.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.990 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:02.990 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:13:02.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.991 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:02.991 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:13:02.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:02.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.991 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:02.991 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041782+0000", 2024-09-13T05:13:02.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4959999999999999e-06 2024-09-13T05:13:02.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.992 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:02.992 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041787+0000", 2024-09-13T05:13:02.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1240000000000004e-06 2024-09-13T05:13:02.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.992 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:02.992 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041792+0000", 2024-09-13T05:13:02.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9200000000000003e-06 2024-09-13T05:13:02.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.992 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.992 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102738+0000", 2024-09-13T05:13:02.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060945581999999998 2024-09-13T05:13:02.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:02.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102821+0000", 2024-09-13T05:13:02.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2898999999999994e-05 2024-09-13T05:13:02.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:02.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102915+0000", 2024-09-13T05:13:02.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4523000000000003e-05 2024-09-13T05:13:02.993 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.993 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:02.993 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.994 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29067 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2764800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:02.994 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:13:02.994 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 145.93342788000001, 2024-09-13T05:13:02.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060816621000000001, 2024-09-13T05:13:02.994 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:02.994 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:02.994 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:02.994 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:02.994 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:02.994 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29067 2024-09-13T05:13:02.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.994 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:02.995 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.995 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:02.995 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:13:02.995 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.995 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.995 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.995 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:02.995 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:13:02.995 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.995 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.995 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.995 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:02.995 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:13:02.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:02.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:02.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045557+0000", 2024-09-13T05:13:02.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.898e-06 2024-09-13T05:13:02.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:02.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045575+0000", 2024-09-13T05:13:02.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8252000000000001e-05 2024-09-13T05:13:02.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:02.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045581+0000", 2024-09-13T05:13:02.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:13:02.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:02.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106183+0000", 2024-09-13T05:13:02.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060602630999999997 2024-09-13T05:13:02.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:02.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106271+0000", 2024-09-13T05:13:02.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7329000000000004e-05 2024-09-13T05:13:02.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:02.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106371+0000", 2024-09-13T05:13:02.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000100164 2024-09-13T05:13:02.998 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.998 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:02.998 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:02.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.998 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29068 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2774016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:02.998 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:13:02.998 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 145.93339664600001, 2024-09-13T05:13:02.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060994509000000002, 2024-09-13T05:13:02.998 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:02.999 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:02.999 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:02.999 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:02.999 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:02.999 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29068 2024-09-13T05:13:02.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.999 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:02.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:02.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:02.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:13:02.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:02.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:02.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.000 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:13:03.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.000 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045585+0000", 2024-09-13T05:13:03.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.000 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045588+0000", 2024-09-13T05:13:03.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:13:03.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.001 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.001 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045594+0000", 2024-09-13T05:13:03.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9329999999999998e-06 2024-09-13T05:13:03.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.001 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.001 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045599+0000", 2024-09-13T05:13:03.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3190000000000002e-06 2024-09-13T05:13:03.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.001 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.001 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106399+0000", 2024-09-13T05:13:03.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060800361999999997 2024-09-13T05:13:03.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:03.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106489+0000", 2024-09-13T05:13:03.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9301000000000004e-05 2024-09-13T05:13:03.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106580+0000", 2024-09-13T05:13:03.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1314e-05 2024-09-13T05:13:03.002 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.002 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.002 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.003 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29069 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2792448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.003 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:13:03.003 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 145.933378229, 2024-09-13T05:13:03.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061207599000000001, 2024-09-13T05:13:03.003 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.003 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:03.003 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.003 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.003 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.003 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29069 2024-09-13T05:13:03.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.004 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.004 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.004 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:13:03.004 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.005 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:13:03.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.005 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045603+0000", 2024-09-13T05:13:03.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.005 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045606+0000", 2024-09-13T05:13:03.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7300000000000001e-06 2024-09-13T05:13:03.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045612+0000", 2024-09-13T05:13:03.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9599999999999997e-06 2024-09-13T05:13:03.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045619+0000", 2024-09-13T05:13:03.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6019999999999996e-06 2024-09-13T05:13:03.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106619+0000", 2024-09-13T05:13:03.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061000029999999997 2024-09-13T05:13:03.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:03.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106713+0000", 2024-09-13T05:13:03.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4505000000000004e-05 2024-09-13T05:13:03.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.008 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106812+0000", 2024-09-13T05:13:03.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8264000000000007e-05 2024-09-13T05:13:03.008 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.008 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.008 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.008 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29070 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2783232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.008 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:13:03.008 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 145.93335776999999, 2024-09-13T05:13:03.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061389805999999998, 2024-09-13T05:13:03.009 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.009 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:03.009 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.009 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.009 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.009 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29070 2024-09-13T05:13:03.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.009 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.009 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.009 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:13:03.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.010 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:13:03.010 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.010 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:13:03.010 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.010 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045627+0000", 2024-09-13T05:13:03.010 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6579999999999998e-06 2024-09-13T05:13:03.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.011 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.011 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045632+0000", 2024-09-13T05:13:03.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8449999999999999e-06 2024-09-13T05:13:03.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.011 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.011 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045639+0000", 2024-09-13T05:13:03.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:13:03.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.012 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.012 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106837+0000", 2024-09-13T05:13:03.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061198529000000002 2024-09-13T05:13:03.012 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.012 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:03.012 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106922+0000", 2024-09-13T05:13:03.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4771999999999994e-05 2024-09-13T05:13:03.012 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.012 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.012 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107014+0000", 2024-09-13T05:13:03.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2009000000000006e-05 2024-09-13T05:13:03.013 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.013 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.013 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.013 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29071 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2801664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.013 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:13:03.013 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 145.93333869400001, 2024-09-13T05:13:03.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061582804999999997, 2024-09-13T05:13:03.013 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.013 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:03.013 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.013 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.013 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.014 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29071 2024-09-13T05:13:03.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.014 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.014 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.014 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:13:03.014 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.014 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.014 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:13:03.014 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045643+0000", 2024-09-13T05:13:03.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.016 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.016 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045646+0000", 2024-09-13T05:13:03.016 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:13:03.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.016 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.016 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045664+0000", 2024-09-13T05:13:03.016 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8408000000000001e-05 2024-09-13T05:13:03.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.017 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.017 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.017 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045670+0000", 2024-09-13T05:13:03.017 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7710000000000003e-06 2024-09-13T05:13:03.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.017 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.017 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.017 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107048+0000", 2024-09-13T05:13:03.017 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061378438 2024-09-13T05:13:03.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.017 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.017 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:03.017 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107134+0000", 2024-09-13T05:13:03.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5574000000000004e-05 2024-09-13T05:13:03.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107226+0000", 2024-09-13T05:13:03.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2262000000000005e-05 2024-09-13T05:13:03.018 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.018 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.018 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.019 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29072 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2810880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.019 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:13:03.019 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 145.93330731, 2024-09-13T05:13:03.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061762233999999999, 2024-09-13T05:13:03.019 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.019 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:03.019 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.019 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.019 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.019 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29072 2024-09-13T05:13:03.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.019 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.020 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.020 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:13:03.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.020 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.020 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:13:03.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.020 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.020 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045674+0000", 2024-09-13T05:13:03.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.021 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.021 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045677+0000", 2024-09-13T05:13:03.021 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9679999999999998e-06 2024-09-13T05:13:03.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.021 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.021 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045694+0000", 2024-09-13T05:13:03.021 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6801999999999999e-05 2024-09-13T05:13:03.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.021 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.021 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045700+0000", 2024-09-13T05:13:03.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8270000000000003e-06 2024-09-13T05:13:03.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107249+0000", 2024-09-13T05:13:03.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061549114000000002 2024-09-13T05:13:03.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:03.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107341+0000", 2024-09-13T05:13:03.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2390000000000001e-05 2024-09-13T05:13:03.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107437+0000", 2024-09-13T05:13:03.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5648000000000003e-05 2024-09-13T05:13:03.023 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.023 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.023 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.023 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29073 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2820096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.023 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:13:03.023 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 145.93326533199999, 2024-09-13T05:13:03.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061873910999999997, 2024-09-13T05:13:03.023 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.023 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:03.023 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.024 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.024 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.024 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29073 2024-09-13T05:13:03.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.024 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.024 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:13:03.024 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.024 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:13:03.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.025 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.025 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045716+0000", 2024-09-13T05:13:03.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.025 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.025 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045726+0000", 2024-09-13T05:13:03.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6350000000000001e-06 2024-09-13T05:13:03.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.025 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.026 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045739+0000", 2024-09-13T05:13:03.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3325e-05 2024-09-13T05:13:03.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.026 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.026 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045746+0000", 2024-09-13T05:13:03.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7399999999999998e-06 2024-09-13T05:13:03.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.026 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.026 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107457+0000", 2024-09-13T05:13:03.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061711038000000003 2024-09-13T05:13:03.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.027 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:03.027 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107522+0000", 2024-09-13T05:13:03.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4850000000000004e-05 2024-09-13T05:13:03.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.027 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.027 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107591+0000", 2024-09-13T05:13:03.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9029999999999995e-05 2024-09-13T05:13:03.027 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.027 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.027 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.028 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29074 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2829312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.028 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:13:03.028 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 145.93323142400001, 2024-09-13T05:13:03.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062055459, 2024-09-13T05:13:03.028 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.028 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:03.028 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.028 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.028 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.028 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29074 2024-09-13T05:13:03.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.028 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:13:03.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:13:03.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045750+0000", 2024-09-13T05:13:03.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.030 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045753+0000", 2024-09-13T05:13:03.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8399999999999999e-06 2024-09-13T05:13:03.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.030 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045759+0000", 2024-09-13T05:13:03.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8900000000000004e-06 2024-09-13T05:13:03.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.030 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045764+0000", 2024-09-13T05:13:03.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3850000000000001e-06 2024-09-13T05:13:03.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.031 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.031 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107623+0000", 2024-09-13T05:13:03.031 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061858817000000003 2024-09-13T05:13:03.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.031 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:03.031 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107710+0000", 2024-09-13T05:13:03.031 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7127999999999997e-05 2024-09-13T05:13:03.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.031 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.031 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107806+0000", 2024-09-13T05:13:03.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5886999999999999e-05 2024-09-13T05:13:03.032 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.032 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.032 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.032 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29075 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2838528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.032 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:13:03.032 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 145.93321297, 2024-09-13T05:13:03.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062188516999999999, 2024-09-13T05:13:03.032 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.032 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:03.032 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.032 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.033 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.033 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29075 2024-09-13T05:13:03.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.033 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:13:03.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:13:03.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:13:03.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045772+0000", 2024-09-13T05:13:03.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:13:03.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.035 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045778+0000", 2024-09-13T05:13:03.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9229999999999996e-06 2024-09-13T05:13:03.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.035 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045784+0000", 2024-09-13T05:13:03.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3800000000000002e-06 2024-09-13T05:13:03.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.035 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107823+0000", 2024-09-13T05:13:03.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062039331000000003 2024-09-13T05:13:03.036 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.036 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.036 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:03.036 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107886+0000", 2024-09-13T05:13:03.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2476000000000003e-05 2024-09-13T05:13:03.036 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.036 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.036 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.036 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107958+0000", 2024-09-13T05:13:03.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2089999999999996e-05 2024-09-13T05:13:03.036 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.036 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.036 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.037 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29115 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2682880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.037 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:13:03.037 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 145.929747443, 2024-09-13T05:13:03.037 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060847898999999997, 2024-09-13T05:13:03.037 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.037 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:03.037 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.037 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.037 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.037 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29115 2024-09-13T05:13:03.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.037 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:13:03.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:13:03.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049234+0000", 2024-09-13T05:13:03.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049237+0000", 2024-09-13T05:13:03.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9069999999999999e-06 2024-09-13T05:13:03.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049243+0000", 2024-09-13T05:13:03.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7459999999999997e-06 2024-09-13T05:13:03.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049248+0000", 2024-09-13T05:13:03.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1490000000000002e-06 2024-09-13T05:13:03.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.109945+0000", 2024-09-13T05:13:03.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060697299000000003 2024-09-13T05:13:03.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:03.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110013+0000", 2024-09-13T05:13:03.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8023999999999998e-05 2024-09-13T05:13:03.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110083+0000", 2024-09-13T05:13:03.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9296999999999997e-05 2024-09-13T05:13:03.041 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.041 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.041 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.041 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.041 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29116 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2692096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.041 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:13:03.041 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 145.92972959900001, 2024-09-13T05:13:03.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061040167999999999, 2024-09-13T05:13:03.041 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.041 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:03.041 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.041 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.042 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.042 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29116 2024-09-13T05:13:03.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.042 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:13:03.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:13:03.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049252+0000", 2024-09-13T05:13:03.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.043 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.043 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049255+0000", 2024-09-13T05:13:03.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7250000000000002e-06 2024-09-13T05:13:03.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049261+0000", 2024-09-13T05:13:03.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.755e-06 2024-09-13T05:13:03.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049266+0000", 2024-09-13T05:13:03.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2100000000000001e-06 2024-09-13T05:13:03.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110115+0000", 2024-09-13T05:13:03.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060849225999999999 2024-09-13T05:13:03.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:03.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110199+0000", 2024-09-13T05:13:03.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4339999999999995e-05 2024-09-13T05:13:03.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110293+0000", 2024-09-13T05:13:03.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3397e-05 2024-09-13T05:13:03.045 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.046 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.046 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.046 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29117 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2701312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.046 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:13:03.046 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 145.929711962, 2024-09-13T05:13:03.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.06118527, 2024-09-13T05:13:03.046 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.046 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:03.046 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.046 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.046 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.046 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29117 2024-09-13T05:13:03.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.047 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:13:03.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:13:03.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:13:03.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049273+0000", 2024-09-13T05:13:03.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.757e-06 2024-09-13T05:13:03.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049278+0000", 2024-09-13T05:13:03.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7830000000000004e-06 2024-09-13T05:13:03.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049284+0000", 2024-09-13T05:13:03.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3820000000000003e-06 2024-09-13T05:13:03.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.049 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110313+0000", 2024-09-13T05:13:03.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061029682000000002 2024-09-13T05:13:03.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.049 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:03.049 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110383+0000", 2024-09-13T05:13:03.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9406000000000006e-05 2024-09-13T05:13:03.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.050 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.050 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110456+0000", 2024-09-13T05:13:03.050 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2750000000000007e-05 2024-09-13T05:13:03.050 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.050 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.050 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.050 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.050 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.050 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29118 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2710528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.050 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:13:03.050 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 145.929694047, 2024-09-13T05:13:03.050 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061380698999999997, 2024-09-13T05:13:03.051 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.051 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:03.051 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.051 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.051 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.051 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29118 2024-09-13T05:13:03.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.051 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:13:03.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:13:03.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:13:03.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.053 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.053 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049291+0000", 2024-09-13T05:13:03.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8770000000000002e-06 2024-09-13T05:13:03.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.053 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.053 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049296+0000", 2024-09-13T05:13:03.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6799999999999998e-06 2024-09-13T05:13:03.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049302+0000", 2024-09-13T05:13:03.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2769999999999996e-06 2024-09-13T05:13:03.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110488+0000", 2024-09-13T05:13:03.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061186184999999997 2024-09-13T05:13:03.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:03.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110577+0000", 2024-09-13T05:13:03.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9246000000000006e-05 2024-09-13T05:13:03.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.055 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.055 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110669+0000", 2024-09-13T05:13:03.055 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1923999999999996e-05 2024-09-13T05:13:03.055 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.055 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.055 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.055 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29119 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2719744~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.055 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:13:03.055 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 145.92967630300001, 2024-09-13T05:13:03.056 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061521165000000003, 2024-09-13T05:13:03.056 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.056 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:03.056 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.056 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.056 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.056 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29119 2024-09-13T05:13:03.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.056 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.056 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.056 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.056 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:13:03.056 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:13:03.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049305+0000", 2024-09-13T05:13:03.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049308+0000", 2024-09-13T05:13:03.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7070000000000001e-06 2024-09-13T05:13:03.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049316+0000", 2024-09-13T05:13:03.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:13:03.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049322+0000", 2024-09-13T05:13:03.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3199999999999999e-06 2024-09-13T05:13:03.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110690+0000", 2024-09-13T05:13:03.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061368428000000003 2024-09-13T05:13:03.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.059 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.059 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:03.059 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110755+0000", 2024-09-13T05:13:03.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4893000000000004e-05 2024-09-13T05:13:03.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.059 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.059 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.059 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110827+0000", 2024-09-13T05:13:03.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2039000000000006e-05 2024-09-13T05:13:03.059 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.059 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.060 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.060 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.060 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29120 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2728960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.060 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:13:03.060 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 145.92965603299999, 2024-09-13T05:13:03.060 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061718420000000003, 2024-09-13T05:13:03.060 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.060 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:03.060 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.060 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.060 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.061 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29120 2024-09-13T05:13:03.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.061 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:13:03.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:13:03.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:13:03.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049329+0000", 2024-09-13T05:13:03.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.022e-06 2024-09-13T05:13:03.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.062 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.062 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049336+0000", 2024-09-13T05:13:03.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0720000000000002e-06 2024-09-13T05:13:03.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.063 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.063 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049341+0000", 2024-09-13T05:13:03.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:13:03.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.063 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.063 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.063 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110864+0000", 2024-09-13T05:13:03.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061523126999999997 2024-09-13T05:13:03.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.063 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.063 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:03.063 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110951+0000", 2024-09-13T05:13:03.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6557000000000005e-05 2024-09-13T05:13:03.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.064 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.064 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.064 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.111045+0000", 2024-09-13T05:13:03.064 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4043999999999996e-05 2024-09-13T05:13:03.064 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.064 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.064 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.064 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.064 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.064 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29136 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2876416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.064 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:13:03.064 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 145.92564060800001, 2024-09-13T05:13:03.064 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060742995000000001, 2024-09-13T05:13:03.064 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.064 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:03.065 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.065 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.065 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.065 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29136 2024-09-13T05:13:03.065 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.065 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.065 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.065 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.065 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:13:03.065 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.065 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.066 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.066 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.066 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:13:03.066 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.066 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.066 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.066 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.066 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053341+0000", 2024-09-13T05:13:03.066 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.066 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.066 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.066 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.066 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053344+0000", 2024-09-13T05:13:03.066 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:13:03.066 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.066 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.067 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.067 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053350+0000", 2024-09-13T05:13:03.067 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7200000000000003e-06 2024-09-13T05:13:03.067 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.067 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.067 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.067 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053355+0000", 2024-09-13T05:13:03.067 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0150000000000003e-06 2024-09-13T05:13:03.067 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.067 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.067 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.067 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113909+0000", 2024-09-13T05:13:03.067 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060554368999999997 2024-09-13T05:13:03.067 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.067 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.068 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:03.068 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113994+0000", 2024-09-13T05:13:03.068 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4658000000000002e-05 2024-09-13T05:13:03.068 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.068 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.068 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.068 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114085+0000", 2024-09-13T05:13:03.068 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0939000000000005e-05 2024-09-13T05:13:03.068 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.068 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.068 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.068 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.068 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.068 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29166 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2628608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.069 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:13:03.069 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 145.92562317400001, 2024-09-13T05:13:03.069 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060883127000000002, 2024-09-13T05:13:03.069 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.069 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:03.069 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.069 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.069 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.069 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29166 2024-09-13T05:13:03.069 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.069 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.069 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.069 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.069 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:13:03.069 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.069 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.070 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.070 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.070 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:13:03.070 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.070 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.070 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.070 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:13:03.070 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.070 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.070 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.070 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053361+0000", 2024-09-13T05:13:03.070 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:13:03.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.070 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053367+0000", 2024-09-13T05:13:03.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7350000000000001e-06 2024-09-13T05:13:03.071 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053372+0000", 2024-09-13T05:13:03.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7840000000000003e-06 2024-09-13T05:13:03.071 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114103+0000", 2024-09-13T05:13:03.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060730924999999998 2024-09-13T05:13:03.071 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.072 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:03.072 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114171+0000", 2024-09-13T05:13:03.072 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8021999999999993e-05 2024-09-13T05:13:03.072 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.072 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.072 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.072 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114242+0000", 2024-09-13T05:13:03.072 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1390999999999995e-05 2024-09-13T05:13:03.072 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.072 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.072 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.072 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.072 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.072 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:165308 3.3 3:c04a6a9a:::rbd_data.112dc3abcba6.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-13T05:13:03.073 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:13:03.073 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 46.847165887999999, 2024-09-13T05:13:03.073 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.085530595000000001, 2024-09-13T05:13:03.073 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.073 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:03.073 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.073 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.073 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.073 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 165308 2024-09-13T05:13:03.073 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.073 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.073 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.073 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.073 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:13:03.074 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.074 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.074 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.074 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:13:03.074 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.074 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.074 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.074 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131814+0000", 2024-09-13T05:13:03.074 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:03.074 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.074 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.075 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152479+0000", 2024-09-13T05:13:03.075 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020664281 2024-09-13T05:13:03.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.075 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.075 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152521+0000", 2024-09-13T05:13:03.075 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2567000000000001e-05 2024-09-13T05:13:03.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.075 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.075 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152536+0000", 2024-09-13T05:13:03.075 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4447000000000001e-05 2024-09-13T05:13:03.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.075 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.076 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152607+0000", 2024-09-13T05:13:03.076 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1687000000000007e-05 2024-09-13T05:13:03.076 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.076 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.076 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:03.076 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152753+0000", 2024-09-13T05:13:03.076 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000145861 2024-09-13T05:13:03.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.077 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.077 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:03.077 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.159991+0000", 2024-09-13T05:13:03.077 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0072373100000000003 2024-09-13T05:13:03.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.077 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.077 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:03.077 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.208492+0000", 2024-09-13T05:13:03.077 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048501003000000001 2024-09-13T05:13:03.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.078 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:03.078 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217224+0000", 2024-09-13T05:13:03.078 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0087320369999999998 2024-09-13T05:13:03.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.078 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:03.078 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217277+0000", 2024-09-13T05:13:03.078 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3841000000000002e-05 2024-09-13T05:13:03.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.079 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.079 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217347+0000", 2024-09-13T05:13:03.079 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9529999999999993e-05 2024-09-13T05:13:03.079 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.079 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.079 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.079 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.079 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.079 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:03.081 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:13:03.082 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:03.078+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:03.182 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:03.179+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:03.198 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:03.198 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:03.198 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:13:03.198 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:03.208 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:13:03.282 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:03.278+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:03.357 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:03.357 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:03.358 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:13:03.358 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:13:03.358 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:03.367 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:13:03.383 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:03.379+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:03.473 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:03.473 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:13:03.473 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:13:03.473 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:13:03.473 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.473 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.473 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:13:03.474 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 146.607317008, 2024-09-13T05:13:03.474 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:13:03.474 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.474 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:03.474 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.474 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.474 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.474 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:13:03.474 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.474 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.474 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.474 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.474 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:13:03.474 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.475 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.475 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.475 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.475 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:13:03.475 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.475 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.475 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.475 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.475 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:13:03.475 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:03.475 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.475 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.475 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.475 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:13:03.475 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:13:03.476 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.476 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.476 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.476 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:13:03.476 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:13:03.476 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.476 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.476 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.476 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:13:03.476 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:13:03.476 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.476 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.476 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.477 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:13:03.477 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:13:03.477 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.477 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.477 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:03.477 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:13:03.477 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:13:03.477 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.477 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.477 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.477 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:13:03.477 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:13:03.477 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.477 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.477 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:03.478 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:13:03.478 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:13:03.478 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.478 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.478 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.478 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:13:03.478 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:13:03.478 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.478 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.478 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.478 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.478 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.478 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.478 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:13:03.479 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 146.60729257200001, 2024-09-13T05:13:03.479 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:13:03.479 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.479 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:03.479 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.479 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.479 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.479 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:13:03.479 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.479 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.479 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.479 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.479 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:13:03.479 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.480 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.480 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.480 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.480 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:13:03.480 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.480 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.480 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.480 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.480 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:13:03.480 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:03.480 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.480 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.480 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.481 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:13:03.481 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:13:03.481 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.481 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.481 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.481 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:13:03.481 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:13:03.481 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.481 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.481 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.481 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:13:03.481 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:13:03.481 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.481 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.482 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.482 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:13:03.482 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:13:03.482 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.482 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.482 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:03.482 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:13:03.482 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:13:03.482 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.482 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.482 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.482 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:13:03.482 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:13:03.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.483 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.483 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:03.483 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:13:03.483 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:13:03.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.483 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.483 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.483 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:13:03.483 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:13:03.483 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.483 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.483 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.484 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.484 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.484 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.484 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:13:03.484 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 146.60728274600001, 2024-09-13T05:13:03.484 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:13:03.484 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.484 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:03.484 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.484 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.484 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.484 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:13:03.484 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.485 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.485 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.485 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.485 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:13:03.485 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.485 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.485 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.485 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.485 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:13:03.485 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.485 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.485 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.485 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.485 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:13:03.486 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:03.486 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.486 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.486 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.486 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:13:03.486 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:13:03.486 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.486 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.486 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.486 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:13:03.486 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:13:03.486 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.486 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.487 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.487 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:13:03.487 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:13:03.487 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.487 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.487 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.487 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:13:03.487 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:13:03.487 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.487 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.487 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:03.487 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:13:03.487 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:13:03.487 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.488 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.488 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.488 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:13:03.488 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:13:03.488 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.488 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.488 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.488 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:13:03.488 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:13:03.488 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.488 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.488 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.488 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.489 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.489 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.489 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:13:03.489 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 146.60727451, 2024-09-13T05:13:03.489 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:13:03.489 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.489 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:03.489 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.489 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.489 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.489 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:13:03.489 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.489 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.489 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.489 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.490 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:13:03.490 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.490 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.490 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.490 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.490 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:13:03.490 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.490 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.490 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.490 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.490 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:13:03.490 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:03.490 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.490 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.490 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.491 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:13:03.491 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:13:03.491 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.491 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.491 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.491 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:13:03.491 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:13:03.491 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.491 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.491 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.491 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:13:03.491 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:13:03.491 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.491 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.491 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.492 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:13:03.492 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:13:03.492 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.492 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.492 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:03.492 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:13:03.492 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:13:03.492 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.492 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.492 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.492 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:13:03.492 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:13:03.492 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.492 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.492 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.493 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:13:03.493 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:13:03.493 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.493 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.493 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.493 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.493 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.493 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.493 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:13:03.493 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 146.607252598, 2024-09-13T05:13:03.493 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:13:03.493 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.493 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:03.493 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.494 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.494 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.494 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:13:03.494 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.494 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.494 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.494 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.494 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:13:03.494 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.494 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.494 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.494 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.494 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:13:03.494 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.495 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.495 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.495 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.495 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:13:03.495 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:03.495 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.495 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.495 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.495 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:13:03.495 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:13:03.495 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.495 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.495 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.495 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:13:03.495 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:13:03.496 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.496 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.496 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.496 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:13:03.496 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:13:03.496 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.496 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.496 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.496 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:13:03.496 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:13:03.496 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.496 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.496 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:03.496 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:13:03.497 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:13:03.497 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.497 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.497 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.497 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:13:03.497 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:13:03.497 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.497 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.497 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.497 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:13:03.497 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:13:03.497 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.497 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.497 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.498 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.498 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.498 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.498 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:13:03.498 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 146.60724399399999, 2024-09-13T05:13:03.498 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:13:03.498 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.498 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:03.498 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.498 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.498 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.498 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:13:03.498 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.498 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.498 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.499 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.499 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:13:03.499 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.499 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.499 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.499 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.499 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:13:03.499 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.499 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.499 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.499 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.499 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:13:03.499 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:03.499 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.500 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.500 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.500 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:13:03.500 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:13:03.500 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.500 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.500 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.500 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:13:03.500 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:13:03.500 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.500 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.500 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.500 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:13:03.500 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:13:03.501 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.501 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.501 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.501 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:13:03.501 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:13:03.501 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.501 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.501 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:03.501 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:13:03.501 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:13:03.501 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.501 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.501 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.501 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:13:03.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:13:03.502 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.502 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.502 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.502 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:13:03.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:13:03.502 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.502 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.502 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.502 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.502 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.502 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.502 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:13:03.502 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 146.60723429999999, 2024-09-13T05:13:03.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:13:03.503 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.503 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:03.503 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.503 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.503 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.503 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:13:03.503 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.503 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.503 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.503 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.504 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:13:03.504 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.504 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.504 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.504 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.504 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:13:03.504 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.504 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.504 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.504 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.504 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:13:03.504 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:03.504 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.504 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.505 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.505 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:13:03.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:13:03.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.505 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.505 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.505 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:13:03.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:13:03.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.505 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.505 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.505 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:13:03.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:13:03.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.506 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.506 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:13:03.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:13:03.506 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.506 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:03.506 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:13:03.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:13:03.506 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.506 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.506 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:13:03.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:13:03.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.507 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.507 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:13:03.507 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:13:03.507 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.507 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.507 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.507 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.507 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:13:03.507 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 146.607225185, 2024-09-13T05:13:03.507 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:13:03.508 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.508 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:03.508 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.508 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.508 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.508 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:13:03.508 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.508 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.508 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.508 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.508 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:13:03.508 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.508 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.508 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.508 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.509 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:13:03.509 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.509 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.509 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.509 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.509 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:13:03.509 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:03.509 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.509 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.509 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.509 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:13:03.509 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:13:03.509 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.509 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.510 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.510 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:13:03.510 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:13:03.510 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.510 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.510 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.510 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:13:03.510 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:13:03.510 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.510 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.510 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.510 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:13:03.510 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:13:03.510 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.510 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.511 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:03.511 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:13:03.511 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:13:03.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.511 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.511 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.511 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:13:03.511 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:13:03.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.511 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.511 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.511 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:13:03.511 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:13:03.511 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.511 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.512 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.512 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.512 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.512 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:13:03.512 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 146.607216706, 2024-09-13T05:13:03.512 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:13:03.512 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.512 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:03.512 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.512 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.512 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.512 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:13:03.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.513 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.513 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.513 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:13:03.513 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.513 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.513 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.513 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:13:03.513 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.513 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.513 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.513 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:13:03.513 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.514 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.514 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.514 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.514 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:13:03.514 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:13:03.514 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.514 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.514 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.514 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:13:03.514 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:13:03.514 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.514 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.514 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.514 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:13:03.514 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:13:03.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.515 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.515 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:13:03.515 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:13:03.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.515 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:03.515 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:13:03.515 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:13:03.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.515 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.515 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:13:03.516 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:13:03.516 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.516 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.516 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.516 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:13:03.516 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:13:03.516 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.516 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.516 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.516 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.516 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.516 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.516 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:13:03.516 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 146.60720478100001, 2024-09-13T05:13:03.517 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:13:03.517 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.517 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:03.517 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.517 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.517 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.517 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:13:03.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.517 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.517 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.517 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:13:03.517 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.518 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.518 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:13:03.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.518 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.518 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:13:03.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:03.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.518 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.518 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:13:03.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:13:03.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.519 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:13:03.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:13:03.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.519 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:13:03.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:13:03.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.519 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:13:03.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:13:03.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.520 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:03.520 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:13:03.520 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:13:03.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.520 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.520 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:13:03.520 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:13:03.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.520 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.520 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:13:03.520 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:13:03.521 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.521 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.521 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.521 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.521 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:13:03.521 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 146.60718319200001, 2024-09-13T05:13:03.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:13:03.521 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.521 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:03.521 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.521 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.521 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.522 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:13:03.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.522 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:13:03.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:13:03.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:13:03.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.523 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:13:03.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:13:03.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.523 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:13:03.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:13:03.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:13:03.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:13:03.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:13:03.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:13:03.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:03.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:13:03.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:13:03.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.525 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.525 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:13:03.525 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:13:03.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.525 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.525 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:13:03.525 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:13:03.525 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.525 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.525 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.525 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.526 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:13:03.526 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 146.607160064, 2024-09-13T05:13:03.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:13:03.526 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.526 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:03.526 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.526 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.526 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.526 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:13:03.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.526 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.526 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.526 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:13:03.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:13:03.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:13:03.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:13:03.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:13:03.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.528 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.528 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:13:03.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:13:03.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.528 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.528 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:13:03.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:13:03.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.528 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.529 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:13:03.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:13:03.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.529 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:03.529 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:13:03.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:13:03.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.529 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.529 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:13:03.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:13:03.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.529 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.530 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:13:03.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:13:03.530 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.530 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.530 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.530 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.530 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:13:03.530 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 146.607144691, 2024-09-13T05:13:03.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:13:03.530 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.530 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:03.530 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.531 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.531 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.531 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:13:03.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.531 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:13:03.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:13:03.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:13:03.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:13:03.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:13:03.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:13:03.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:13:03.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:13:03.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:13:03.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:13:03.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:13:03.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:03.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:13:03.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:13:03.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:13:03.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:13:03.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:13:03.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:13:03.534 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.534 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.534 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.535 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.535 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:13:03.535 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 146.607124223, 2024-09-13T05:13:03.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:13:03.535 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.535 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:03.535 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.535 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.535 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.535 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:13:03.535 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.535 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.535 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:13:03.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:13:03.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:13:03.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:13:03.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:13:03.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:13:03.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:13:03.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:13:03.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:13:03.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:13:03.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:13:03.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:03.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:13:03.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:13:03.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:13:03.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:13:03.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.539 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.539 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:13:03.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:13:03.539 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.539 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.539 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.539 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.539 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:13:03.539 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 146.60710756200001, 2024-09-13T05:13:03.540 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:13:03.540 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.540 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:03.540 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.540 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.540 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.540 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:13:03.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.540 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.540 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.540 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:13:03.540 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:13:03.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:13:03.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:13:03.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:13:03.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:13:03.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:13:03.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:13:03.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:13:03.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:13:03.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:13:03.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:03.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:13:03.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:13:03.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:13:03.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:13:03.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:13:03.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:13:03.544 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.544 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.544 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.544 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.544 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:13:03.544 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 146.607080849, 2024-09-13T05:13:03.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:13:03.544 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.544 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:03.544 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.545 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.545 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.545 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:13:03.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.545 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.545 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:13:03.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.545 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.545 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:13:03.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:13:03.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:13:03.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:13:03.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:13:03.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:13:03.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:13:03.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:13:03.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:13:03.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:13:03.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:03.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:13:03.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:13:03.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:13:03.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:13:03.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:13:03.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:13:03.548 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.548 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.548 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.549 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.549 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:13:03.549 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 146.60706199699999, 2024-09-13T05:13:03.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:13:03.549 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.549 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:03.549 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.549 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.549 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.549 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:13:03.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.550 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:13:03.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:13:03.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.550 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.550 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:13:03.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:13:03.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:13:03.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:13:03.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:13:03.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:13:03.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:13:03.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:13:03.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:13:03.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:03.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:13:03.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:13:03.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.553 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.553 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:13:03.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:13:03.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.553 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.553 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:13:03.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:13:03.553 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.553 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.553 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.553 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.554 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:13:03.554 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 146.60704421099999, 2024-09-13T05:13:03.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:13:03.554 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.554 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:03.554 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.554 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.554 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.554 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:13:03.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.554 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:13:03.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:13:03.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:13:03.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:13:03.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:13:03.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:13:03.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:13:03.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:13:03.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:13:03.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:13:03.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:13:03.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:03.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:13:03.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:13:03.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:13:03.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:13:03.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:13:03.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:13:03.558 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.558 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.558 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.558 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.558 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:13:03.558 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 146.607009151, 2024-09-13T05:13:03.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:13:03.558 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.559 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:03.559 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.559 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.559 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.559 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:13:03.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.559 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:13:03.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:13:03.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:13:03.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:13:03.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:13:03.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:13:03.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:13:03.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:13:03.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:13:03.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.562 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:13:03.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:13:03.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:03.562 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:13:03.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:13:03.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:13:03.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:13:03.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:13:03.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:13:03.563 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.563 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.563 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.563 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:03.564 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:13:03.564 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 146.60699233599999, 2024-09-13T05:13:03.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:13:03.564 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:03.564 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:03.564 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:03.564 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:03.564 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:03.564 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:13:03.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.564 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:03.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:03.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:13:03.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:03.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:13:03.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:03.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:03.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:13:03.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:03.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:03.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:13:03.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:13:03.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:03.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:13:03.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:13:03.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:03.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:13:03.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:13:03.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:13:03.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:13:03.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:03.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:13:03.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:13:03.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:03.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:13:03.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:13:03.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:03.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:03.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:03.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:13:03.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:13:03.568 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.568 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.568 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.568 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:03.568 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:03.568 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:03.570 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:13:03.570 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:03.567+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:03.648 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is unset 2024-09-13T05:13:03.670 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:03.667+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:03.702 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:03.702 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:13:03.702 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:03.713 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:13:03.773 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:03.766+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:03.823 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:03.823 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:03.823 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:13:03.823 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:13:03.823 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:03.833 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:13:03.881 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:03.878+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:03.937 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:03.937 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:13:03.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:13:03.938 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [] 2024-09-13T05:13:03.938 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:03.947 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:13:03.973 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:03.966+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:04.049 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:04.050 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:04.050 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:13:04.050 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:04.059 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:13:04.073 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:04.070+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:04.167 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:04.168 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:04.168 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:13:04.168 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:13:04.168 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:04.174 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:04.170+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:04.177 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:13:04.275 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:04.271+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:04.332 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:13:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:13:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:13:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:159451 3.1b e117/116 3:d9c87acb:::rbd_data.112dc3abcba6.0000000000000003:head v 117'567, mlcod=0'0)", 2024-09-13T05:13:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:13:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.390192921000001, 2024-09-13T05:13:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064897325000000006, 2024-09-13T05:13:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:13:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:13:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938207+0000", 2024-09-13T05:13:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:13:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972794+0000", 2024-09-13T05:13:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.034587013 2024-09-13T05:13:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972821+0000", 2024-09-13T05:13:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6764e-05 2024-09-13T05:13:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972841+0000", 2024-09-13T05:13:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0191999999999999e-05 2024-09-13T05:13:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972905+0000", 2024-09-13T05:13:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4319000000000005e-05 2024-09-13T05:13:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972927+0000", 2024-09-13T05:13:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1135999999999999e-05 2024-09-13T05:13:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:13:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.002964+0000", 2024-09-13T05:13:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.030037123999999998 2024-09-13T05:13:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.003105+0000", 2024-09-13T05:13:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141614 2024-09-13T05:13:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159495 3.0 3:022f4da1:::rbd_data.112dfd94ee88.00000000000000e4:2a [read 167936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:13:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.315053499999998, 2024-09-13T05:13:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91926946899999995, 2024-09-13T05:13:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159495 2024-09-13T05:13:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:13:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:13:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013345+0000", 2024-09-13T05:13:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999971 2024-09-13T05:13:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013359+0000", 2024-09-13T05:13:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4752999999999999e-05 2024-09-13T05:13:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013418+0000", 2024-09-13T05:13:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8959000000000003e-05 2024-09-13T05:13:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013439+0000", 2024-09-13T05:13:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0749000000000001e-05 2024-09-13T05:13:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013563+0000", 2024-09-13T05:13:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012349400000000001 2024-09-13T05:13:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013583+0000", 2024-09-13T05:13:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0007e-05 2024-09-13T05:13:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932400+0000", 2024-09-13T05:13:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91881732400000005 2024-09-13T05:13:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932533+0000", 2024-09-13T05:13:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013263700000000001 2024-09-13T05:13:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932617+0000", 2024-09-13T05:13:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4313000000000004e-05 2024-09-13T05:13:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159517 3.0 3:03975f1c:::rbd_data.112dfd94ee88.0000000000000156:2a [read 167936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:13:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.314789785999999, 2024-09-13T05:13:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91962025700000005, 2024-09-13T05:13:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159517 2024-09-13T05:13:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:13:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:13:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013609+0000", 2024-09-13T05:13:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013619+0000", 2024-09-13T05:13:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0077e-05 2024-09-13T05:13:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013638+0000", 2024-09-13T05:13:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8739000000000001e-05 2024-09-13T05:13:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013653+0000", 2024-09-13T05:13:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5446000000000001e-05 2024-09-13T05:13:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016506+0000", 2024-09-13T05:13:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028525619999999999 2024-09-13T05:13:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016521+0000", 2024-09-13T05:13:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5310000000000001e-05 2024-09-13T05:13:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932964+0000", 2024-09-13T05:13:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91644284099999995 2024-09-13T05:13:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933097+0000", 2024-09-13T05:13:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013337599999999999 2024-09-13T05:13:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933231+0000", 2024-09-13T05:13:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133996 2024-09-13T05:13:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159622 3.0 3:03f7a45a:::rbd_data.112dfd94ee88.0000000000000318:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:13:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.313127975, 2024-09-13T05:13:04.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.918245003, 2024-09-13T05:13:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159622 2024-09-13T05:13:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:13:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:13:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015266+0000", 2024-09-13T05:13:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999928 2024-09-13T05:13:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015283+0000", 2024-09-13T05:13:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7309999999999999e-05 2024-09-13T05:13:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015318+0000", 2024-09-13T05:13:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5119e-05 2024-09-13T05:13:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015338+0000", 2024-09-13T05:13:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9259e-05 2024-09-13T05:13:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016558+0000", 2024-09-13T05:13:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012199909999999999 2024-09-13T05:13:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016567+0000", 2024-09-13T05:13:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2459999999999992e-06 2024-09-13T05:13:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933266+0000", 2024-09-13T05:13:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91669950300000003 2024-09-13T05:13:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:13:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015788099999999999 2024-09-13T05:13:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933518+0000", 2024-09-13T05:13:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3721000000000006e-05 2024-09-13T05:13:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173445 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 150528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:13:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.148551189999999, 2024-09-13T05:13:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064560905000000002, 2024-09-13T05:13:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173445 2024-09-13T05:13:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:13:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:13:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179849+0000", 2024-09-13T05:13:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179860+0000", 2024-09-13T05:13:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0419e-05 2024-09-13T05:13:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179866+0000", 2024-09-13T05:13:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.567e-06 2024-09-13T05:13:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179872+0000", 2024-09-13T05:13:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1830000000000002e-06 2024-09-13T05:13:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244262+0000", 2024-09-13T05:13:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064390814000000005 2024-09-13T05:13:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244321+0000", 2024-09-13T05:13:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8341000000000003e-05 2024-09-13T05:13:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244411+0000", 2024-09-13T05:13:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9911e-05 2024-09-13T05:13:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173446 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 157696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:13:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.148524422999998, 2024-09-13T05:13:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064714007000000004, 2024-09-13T05:13:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.358 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173446 2024-09-13T05:13:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:13:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:13:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179876+0000", 2024-09-13T05:13:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179879+0000", 2024-09-13T05:13:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1489999999999998e-06 2024-09-13T05:13:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179884+0000", 2024-09-13T05:13:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2800000000000003e-06 2024-09-13T05:13:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179889+0000", 2024-09-13T05:13:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7620000000000003e-06 2024-09-13T05:13:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244452+0000", 2024-09-13T05:13:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064562943999999997 2024-09-13T05:13:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244512+0000", 2024-09-13T05:13:04.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9879e-05 2024-09-13T05:13:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244591+0000", 2024-09-13T05:13:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8701000000000004e-05 2024-09-13T05:13:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173447 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 164864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:13:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.148507674999998, 2024-09-13T05:13:04.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064866246000000002, 2024-09-13T05:13:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173447 2024-09-13T05:13:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:13:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:13:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:13:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179895+0000", 2024-09-13T05:13:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6910000000000002e-06 2024-09-13T05:13:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179901+0000", 2024-09-13T05:13:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5149999999999997e-06 2024-09-13T05:13:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179905+0000", 2024-09-13T05:13:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4170000000000002e-06 2024-09-13T05:13:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244615+0000", 2024-09-13T05:13:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064709533999999999 2024-09-13T05:13:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244665+0000", 2024-09-13T05:13:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0283e-05 2024-09-13T05:13:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244760+0000", 2024-09-13T05:13:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4310999999999999e-05 2024-09-13T05:13:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.366 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173448 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 172032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:13:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.148491829000001, 2024-09-13T05:13:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065022046999999999, 2024-09-13T05:13:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.367 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173448 2024-09-13T05:13:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:13:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:13:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:13:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179914+0000", 2024-09-13T05:13:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6699999999999999e-06 2024-09-13T05:13:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179921+0000", 2024-09-13T05:13:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:13:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179926+0000", 2024-09-13T05:13:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8659999999999997e-06 2024-09-13T05:13:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244782+0000", 2024-09-13T05:13:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064856570000000002 2024-09-13T05:13:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244857+0000", 2024-09-13T05:13:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4326999999999995e-05 2024-09-13T05:13:04.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244931+0000", 2024-09-13T05:13:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4443999999999994e-05 2024-09-13T05:13:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173450 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 179200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:13:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.148470994999997, 2024-09-13T05:13:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065192589999999995, 2024-09-13T05:13:04.371 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173450 2024-09-13T05:13:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:13:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:13:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:13:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179932+0000", 2024-09-13T05:13:04.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2529999999999999e-06 2024-09-13T05:13:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179937+0000", 2024-09-13T05:13:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4219999999999999e-06 2024-09-13T05:13:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179942+0000", 2024-09-13T05:13:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3250000000000001e-06 2024-09-13T05:13:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244969+0000", 2024-09-13T05:13:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065027794999999999 2024-09-13T05:13:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245048+0000", 2024-09-13T05:13:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8812000000000004e-05 2024-09-13T05:13:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245123+0000", 2024-09-13T05:13:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4342000000000001e-05 2024-09-13T05:13:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173451 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:13:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.148455007999999, 2024-09-13T05:13:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359814000000002, 2024-09-13T05:13:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.376 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173451 2024-09-13T05:13:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:13:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:13:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:13:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179948+0000", 2024-09-13T05:13:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5119999999999998e-06 2024-09-13T05:13:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179954+0000", 2024-09-13T05:13:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5840000000000002e-06 2024-09-13T05:13:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179958+0000", 2024-09-13T05:13:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.566e-06 2024-09-13T05:13:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245160+0000", 2024-09-13T05:13:04.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065202057999999993 2024-09-13T05:13:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245228+0000", 2024-09-13T05:13:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7257999999999999e-05 2024-09-13T05:13:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245306+0000", 2024-09-13T05:13:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8227999999999997e-05 2024-09-13T05:13:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.380 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173452 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 193536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:13:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.148438521000003, 2024-09-13T05:13:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065505701, 2024-09-13T05:13:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173452 2024-09-13T05:13:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.381 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:13:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:13:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:13:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179965+0000", 2024-09-13T05:13:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.402e-06 2024-09-13T05:13:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179970+0000", 2024-09-13T05:13:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2290000000000002e-06 2024-09-13T05:13:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179974+0000", 2024-09-13T05:13:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5070000000000002e-06 2024-09-13T05:13:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245329+0000", 2024-09-13T05:13:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065354906000000004 2024-09-13T05:13:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245390+0000", 2024-09-13T05:13:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0878999999999998e-05 2024-09-13T05:13:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245468+0000", 2024-09-13T05:13:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8073999999999998e-05 2024-09-13T05:13:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173453 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 198656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:13:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.148422255, 2024-09-13T05:13:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065664343, 2024-09-13T05:13:04.385 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173453 2024-09-13T05:13:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:13:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:13:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179978+0000", 2024-09-13T05:13:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179981+0000", 2024-09-13T05:13:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4140000000000001e-06 2024-09-13T05:13:04.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179986+0000", 2024-09-13T05:13:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3519999999999997e-06 2024-09-13T05:13:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179991+0000", 2024-09-13T05:13:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6739999999999996e-06 2024-09-13T05:13:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245495+0000", 2024-09-13T05:13:04.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065504229999999997 2024-09-13T05:13:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245563+0000", 2024-09-13T05:13:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8119000000000003e-05 2024-09-13T05:13:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245643+0000", 2024-09-13T05:13:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9861e-05 2024-09-13T05:13:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173454 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:13:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.148373868, 2024-09-13T05:13:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065750457999999998, 2024-09-13T05:13:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173454 2024-09-13T05:13:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.390 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:13:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:13:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180026+0000", 2024-09-13T05:13:04.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180030+0000", 2024-09-13T05:13:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3790000000000002e-06 2024-09-13T05:13:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180036+0000", 2024-09-13T05:13:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5889999999999999e-06 2024-09-13T05:13:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180041+0000", 2024-09-13T05:13:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9980000000000003e-06 2024-09-13T05:13:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245667+0000", 2024-09-13T05:13:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065625124000000007 2024-09-13T05:13:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245705+0000", 2024-09-13T05:13:04.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7994000000000002e-05 2024-09-13T05:13:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245778+0000", 2024-09-13T05:13:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2999999999999999e-05 2024-09-13T05:13:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173455 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 212992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:13:04.394 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.148355160000001, 2024-09-13T05:13:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065899773999999994, 2024-09-13T05:13:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173455 2024-09-13T05:13:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:13:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:13:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180045+0000", 2024-09-13T05:13:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180048+0000", 2024-09-13T05:13:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5830000000000001e-06 2024-09-13T05:13:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180054+0000", 2024-09-13T05:13:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.789e-06 2024-09-13T05:13:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180059+0000", 2024-09-13T05:13:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.933e-06 2024-09-13T05:13:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245801+0000", 2024-09-13T05:13:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065742520999999998 2024-09-13T05:13:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245865+0000", 2024-09-13T05:13:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3325999999999996e-05 2024-09-13T05:13:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245946+0000", 2024-09-13T05:13:04.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0964999999999995e-05 2024-09-13T05:13:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173456 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:13:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.148337929, 2024-09-13T05:13:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066035128999999998, 2024-09-13T05:13:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.399 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173456 2024-09-13T05:13:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:13:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:13:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:13:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180065+0000", 2024-09-13T05:13:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4250000000000001e-06 2024-09-13T05:13:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180070+0000", 2024-09-13T05:13:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1749999999999996e-06 2024-09-13T05:13:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180075+0000", 2024-09-13T05:13:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4769999999999997e-06 2024-09-13T05:13:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245969+0000", 2024-09-13T05:13:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065894182999999995 2024-09-13T05:13:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246027+0000", 2024-09-13T05:13:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8165999999999998e-05 2024-09-13T05:13:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246098+0000", 2024-09-13T05:13:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1068999999999993e-05 2024-09-13T05:13:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173458 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:13:04.403 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.148321946000003, 2024-09-13T05:13:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066134732000000002, 2024-09-13T05:13:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173458 2024-09-13T05:13:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:13:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:13:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:13:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180081+0000", 2024-09-13T05:13:04.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4150000000000002e-06 2024-09-13T05:13:04.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180087+0000", 2024-09-13T05:13:04.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5389999999999998e-06 2024-09-13T05:13:04.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180101+0000", 2024-09-13T05:13:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4537e-05 2024-09-13T05:13:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246119+0000", 2024-09-13T05:13:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066017701999999998 2024-09-13T05:13:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246155+0000", 2024-09-13T05:13:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6094999999999999e-05 2024-09-13T05:13:04.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246214+0000", 2024-09-13T05:13:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8789000000000002e-05 2024-09-13T05:13:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173459 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 234496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:13:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.148294423000003, 2024-09-13T05:13:04.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066227460000000002, 2024-09-13T05:13:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173459 2024-09-13T05:13:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:13:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:13:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180106+0000", 2024-09-13T05:13:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180109+0000", 2024-09-13T05:13:04.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2219999999999998e-06 2024-09-13T05:13:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180115+0000", 2024-09-13T05:13:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9190000000000004e-06 2024-09-13T05:13:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180120+0000", 2024-09-13T05:13:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8930000000000004e-06 2024-09-13T05:13:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246236+0000", 2024-09-13T05:13:04.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066115638000000004 2024-09-13T05:13:04.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246273+0000", 2024-09-13T05:13:04.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7083999999999999e-05 2024-09-13T05:13:04.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246334+0000", 2024-09-13T05:13:04.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1183e-05 2024-09-13T05:13:04.412 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.412 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.413 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.413 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173460 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 241664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:04.413 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:13:04.413 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.148276617, 2024-09-13T05:13:04.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066360459999999996, 2024-09-13T05:13:04.413 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.413 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.413 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173460 2024-09-13T05:13:04.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.414 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:13:04.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:13:04.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:13:04.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:04.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180126+0000", 2024-09-13T05:13:04.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3120000000000001e-06 2024-09-13T05:13:04.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180132+0000", 2024-09-13T05:13:04.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.105e-06 2024-09-13T05:13:04.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180137+0000", 2024-09-13T05:13:04.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6829999999999999e-06 2024-09-13T05:13:04.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246365+0000", 2024-09-13T05:13:04.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066227584000000006 2024-09-13T05:13:04.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246413+0000", 2024-09-13T05:13:04.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8479000000000001e-05 2024-09-13T05:13:04.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246485+0000", 2024-09-13T05:13:04.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1600000000000006e-05 2024-09-13T05:13:04.417 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.417 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.417 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.417 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173461 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:04.417 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:13:04.417 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.148257848, 2024-09-13T05:13:04.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066492449999999995, 2024-09-13T05:13:04.418 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.418 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.418 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.418 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.418 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.418 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173461 2024-09-13T05:13:04.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.418 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:13:04.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:13:04.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:13:04.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:04.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180149+0000", 2024-09-13T05:13:04.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7239999999999997e-06 2024-09-13T05:13:04.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180153+0000", 2024-09-13T05:13:04.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7859999999999996e-06 2024-09-13T05:13:04.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180158+0000", 2024-09-13T05:13:04.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0300000000000001e-06 2024-09-13T05:13:04.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246508+0000", 2024-09-13T05:13:04.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066350100999999995 2024-09-13T05:13:04.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246568+0000", 2024-09-13T05:13:04.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9500000000000003e-05 2024-09-13T05:13:04.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246636+0000", 2024-09-13T05:13:04.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7633999999999997e-05 2024-09-13T05:13:04.422 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.422 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.422 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.422 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173462 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 256000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:04.422 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:13:04.422 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.14742502, 2024-09-13T05:13:04.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065773376999999994, 2024-09-13T05:13:04.423 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.423 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.423 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173462 2024-09-13T05:13:04.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.423 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:13:04.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:13:04.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180162+0000", 2024-09-13T05:13:04.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9991865 2024-09-13T05:13:04.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180984+0000", 2024-09-13T05:13:04.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00082184599999999999 2024-09-13T05:13:04.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180994+0000", 2024-09-13T05:13:04.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9000000000000001e-06 2024-09-13T05:13:04.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.181001+0000", 2024-09-13T05:13:04.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.917e-06 2024-09-13T05:13:04.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246653+0000", 2024-09-13T05:13:04.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065651820999999999 2024-09-13T05:13:04.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246698+0000", 2024-09-13T05:13:04.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.473e-05 2024-09-13T05:13:04.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246749+0000", 2024-09-13T05:13:04.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1758999999999997e-05 2024-09-13T05:13:04.427 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.427 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.427 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.427 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.427 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.427 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:04.428 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:13:04.429 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:04.422+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:04.529 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:04.527+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:04.541 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:04.541 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:04.541 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:13:04.541 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:04.551 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:13:04.627 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:13:04.630 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:04.626+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:04.655 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:04.655 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:04.655 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:13:04.655 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:13:04.655 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:04.666 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:13:04.731 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:04.727+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:04.772 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:13:04.785 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:13:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:13:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:13:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136560 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3908608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:13:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.687729078999993, 2024-09-13T05:13:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056148103999999997, 2024-09-13T05:13:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136560 2024-09-13T05:13:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:13:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:13:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095289+0000", 2024-09-13T05:13:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095292+0000", 2024-09-13T05:13:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.802e-06 2024-09-13T05:13:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095318+0000", 2024-09-13T05:13:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5987999999999999e-05 2024-09-13T05:13:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095323+0000", 2024-09-13T05:13:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.006e-06 2024-09-13T05:13:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151316+0000", 2024-09-13T05:13:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055992593 2024-09-13T05:13:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151371+0000", 2024-09-13T05:13:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5532999999999998e-05 2024-09-13T05:13:04.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151438+0000", 2024-09-13T05:13:04.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6557999999999995e-05 2024-09-13T05:13:04.791 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.791 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.791 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136562 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3922944~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:13:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.687691960999999, 2024-09-13T05:13:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056259690000000001, 2024-09-13T05:13:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136562 2024-09-13T05:13:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.793 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:13:04.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:13:04.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:13:04.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:04.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095329+0000", 2024-09-13T05:13:04.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3089999999999998e-06 2024-09-13T05:13:04.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095333+0000", 2024-09-13T05:13:04.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6239999999999999e-06 2024-09-13T05:13:04.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095335+0000", 2024-09-13T05:13:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5660000000000001e-06 2024-09-13T05:13:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151468+0000", 2024-09-13T05:13:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056132608000000001 2024-09-13T05:13:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151519+0000", 2024-09-13T05:13:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1681000000000002e-05 2024-09-13T05:13:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151587+0000", 2024-09-13T05:13:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7200999999999996e-05 2024-09-13T05:13:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136563 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3937280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:13:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.687680538999999, 2024-09-13T05:13:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056393051999999999, 2024-09-13T05:13:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136563 2024-09-13T05:13:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:13:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:13:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:13:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:13:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095340+0000", 2024-09-13T05:13:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.561e-06 2024-09-13T05:13:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095342+0000", 2024-09-13T05:13:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8059999999999999e-06 2024-09-13T05:13:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095345+0000", 2024-09-13T05:13:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:13:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151621+0000", 2024-09-13T05:13:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056275602000000001 2024-09-13T05:13:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151670+0000", 2024-09-13T05:13:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9478000000000003e-05 2024-09-13T05:13:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151731+0000", 2024-09-13T05:13:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1054000000000002e-05 2024-09-13T05:13:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136565 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3951616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:13:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.687670225000005, 2024-09-13T05:13:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056524090999999999, 2024-09-13T05:13:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136565 2024-09-13T05:13:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:13:04.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:13:04.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095348+0000", 2024-09-13T05:13:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:13:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095350+0000", 2024-09-13T05:13:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4479999999999999e-06 2024-09-13T05:13:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095353+0000", 2024-09-13T05:13:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.909e-06 2024-09-13T05:13:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095356+0000", 2024-09-13T05:13:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:13:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151763+0000", 2024-09-13T05:13:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056407813000000001 2024-09-13T05:13:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151812+0000", 2024-09-13T05:13:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8306999999999997e-05 2024-09-13T05:13:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151873+0000", 2024-09-13T05:13:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1064999999999999e-05 2024-09-13T05:13:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.808 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136567 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3965952~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:04.808 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:13:04.808 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.687661199999994, 2024-09-13T05:13:04.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056653907000000003, 2024-09-13T05:13:04.808 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.808 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136567 2024-09-13T05:13:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:13:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:13:04.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095357+0000", 2024-09-13T05:13:04.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:04.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095359+0000", 2024-09-13T05:13:04.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:13:04.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095362+0000", 2024-09-13T05:13:04.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7939999999999998e-06 2024-09-13T05:13:04.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095365+0000", 2024-09-13T05:13:04.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9979999999999999e-06 2024-09-13T05:13:04.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151904+0000", 2024-09-13T05:13:04.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056539308000000003 2024-09-13T05:13:04.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151953+0000", 2024-09-13T05:13:04.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8760000000000001e-05 2024-09-13T05:13:04.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152012+0000", 2024-09-13T05:13:04.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8761999999999997e-05 2024-09-13T05:13:04.813 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.813 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.813 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.813 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136569 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3980288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:04.813 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:13:04.814 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.687625445999998, 2024-09-13T05:13:04.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056771237000000002, 2024-09-13T05:13:04.814 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.814 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.814 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.814 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.814 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.814 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136569 2024-09-13T05:13:04.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.814 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:13:04.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:13:04.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:13:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095395+0000", 2024-09-13T05:13:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8870000000000001e-06 2024-09-13T05:13:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095402+0000", 2024-09-13T05:13:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6290000000000001e-06 2024-09-13T05:13:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095412+0000", 2024-09-13T05:13:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1730000000000001e-06 2024-09-13T05:13:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152044+0000", 2024-09-13T05:13:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056632016 2024-09-13T05:13:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152093+0000", 2024-09-13T05:13:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9570000000000001e-05 2024-09-13T05:13:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152165+0000", 2024-09-13T05:13:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1443e-05 2024-09-13T05:13:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136571 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3994624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:13:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.687604430999997, 2024-09-13T05:13:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056894741999999998, 2024-09-13T05:13:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136571 2024-09-13T05:13:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:13:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:13:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:13:04.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:04.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095418+0000", 2024-09-13T05:13:04.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0210000000000001e-06 2024-09-13T05:13:04.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095422+0000", 2024-09-13T05:13:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5310000000000002e-06 2024-09-13T05:13:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095425+0000", 2024-09-13T05:13:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8880000000000001e-06 2024-09-13T05:13:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152198+0000", 2024-09-13T05:13:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056773563999999999 2024-09-13T05:13:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152249+0000", 2024-09-13T05:13:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1168999999999997e-05 2024-09-13T05:13:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152309+0000", 2024-09-13T05:13:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9821999999999997e-05 2024-09-13T05:13:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136573 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4008960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:13:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.687592203999998, 2024-09-13T05:13:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057045810000000002, 2024-09-13T05:13:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136573 2024-09-13T05:13:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:13:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:13:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095426+0000", 2024-09-13T05:13:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095428+0000", 2024-09-13T05:13:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.593e-06 2024-09-13T05:13:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095431+0000", 2024-09-13T05:13:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9610000000000001e-06 2024-09-13T05:13:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095434+0000", 2024-09-13T05:13:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:13:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152352+0000", 2024-09-13T05:13:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05691881 2024-09-13T05:13:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152401+0000", 2024-09-13T05:13:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8995000000000001e-05 2024-09-13T05:13:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152472+0000", 2024-09-13T05:13:04.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1060000000000001e-05 2024-09-13T05:13:04.832 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.832 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.832 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.832 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136575 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4023296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:04.832 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:13:04.832 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.687162211, 2024-09-13T05:13:04.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056760069000000003, 2024-09-13T05:13:04.833 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.833 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.833 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.833 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.833 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.833 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136575 2024-09-13T05:13:04.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.833 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:13:04.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:13:04.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095437+0000", 2024-09-13T05:13:04.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9995799 2024-09-13T05:13:04.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095861+0000", 2024-09-13T05:13:04.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000424299 2024-09-13T05:13:04.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095869+0000", 2024-09-13T05:13:04.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5020000000000003e-06 2024-09-13T05:13:04.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095875+0000", 2024-09-13T05:13:04.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:13:04.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152502+0000", 2024-09-13T05:13:04.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056626528000000002 2024-09-13T05:13:04.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152556+0000", 2024-09-13T05:13:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4271000000000003e-05 2024-09-13T05:13:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152617+0000", 2024-09-13T05:13:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0896000000000001e-05 2024-09-13T05:13:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136577 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4037632~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:04.837 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:13:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.687060755999994, 2024-09-13T05:13:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056798242999999998, 2024-09-13T05:13:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136577 2024-09-13T05:13:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:13:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:13:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095882+0000", 2024-09-13T05:13:04.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999242 2024-09-13T05:13:04.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095961+0000", 2024-09-13T05:13:04.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8864999999999998e-05 2024-09-13T05:13:04.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095973+0000", 2024-09-13T05:13:04.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2206e-05 2024-09-13T05:13:04.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095978+0000", 2024-09-13T05:13:04.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0629999999999996e-06 2024-09-13T05:13:04.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152646+0000", 2024-09-13T05:13:04.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056668035999999998 2024-09-13T05:13:04.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152695+0000", 2024-09-13T05:13:04.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8634000000000002e-05 2024-09-13T05:13:04.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152756+0000", 2024-09-13T05:13:04.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1315000000000005e-05 2024-09-13T05:13:04.842 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.842 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136579 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4051968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:13:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.686732660999994, 2024-09-13T05:13:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056610869000000001, 2024-09-13T05:13:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.843 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.844 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136579 2024-09-13T05:13:04.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.844 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:13:04.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:13:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095989+0000", 2024-09-13T05:13:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997029 2024-09-13T05:13:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096291+0000", 2024-09-13T05:13:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030221499999999999 2024-09-13T05:13:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096300+0000", 2024-09-13T05:13:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4819999999999994e-06 2024-09-13T05:13:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096306+0000", 2024-09-13T05:13:04.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:13:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152788+0000", 2024-09-13T05:13:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056481625000000001 2024-09-13T05:13:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152837+0000", 2024-09-13T05:13:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9345000000000003e-05 2024-09-13T05:13:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152897+0000", 2024-09-13T05:13:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9892999999999997e-05 2024-09-13T05:13:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136581 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4066304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:13:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.686553833999994, 2024-09-13T05:13:04.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056597091000000002, 2024-09-13T05:13:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136581 2024-09-13T05:13:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:13:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:13:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096312+0000", 2024-09-13T05:13:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998465 2024-09-13T05:13:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096469+0000", 2024-09-13T05:13:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157109 2024-09-13T05:13:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096478+0000", 2024-09-13T05:13:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3260000000000002e-06 2024-09-13T05:13:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096482+0000", 2024-09-13T05:13:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9720000000000003e-06 2024-09-13T05:13:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152933+0000", 2024-09-13T05:13:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056451128000000003 2024-09-13T05:13:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152993+0000", 2024-09-13T05:13:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9947000000000001e-05 2024-09-13T05:13:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153062+0000", 2024-09-13T05:13:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9105999999999999e-05 2024-09-13T05:13:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136583 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4080640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:13:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.686287921000002, 2024-09-13T05:13:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056496609000000003, 2024-09-13T05:13:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136583 2024-09-13T05:13:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:13:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:13:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096485+0000", 2024-09-13T05:13:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997544 2024-09-13T05:13:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096735+0000", 2024-09-13T05:13:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024979899999999998 2024-09-13T05:13:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096742+0000", 2024-09-13T05:13:04.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7139999999999996e-06 2024-09-13T05:13:04.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096747+0000", 2024-09-13T05:13:04.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8709999999999996e-06 2024-09-13T05:13:04.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153099+0000", 2024-09-13T05:13:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056352639000000003 2024-09-13T05:13:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153168+0000", 2024-09-13T05:13:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9029000000000006e-05 2024-09-13T05:13:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153228+0000", 2024-09-13T05:13:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9339999999999998e-05 2024-09-13T05:13:04.858 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136585 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4094976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:13:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.686036454000003, 2024-09-13T05:13:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056396420000000003, 2024-09-13T05:13:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.859 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136585 2024-09-13T05:13:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:13:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:13:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096750+0000", 2024-09-13T05:13:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997673 2024-09-13T05:13:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096986+0000", 2024-09-13T05:13:04.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000236297 2024-09-13T05:13:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096993+0000", 2024-09-13T05:13:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9600000000000003e-06 2024-09-13T05:13:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096999+0000", 2024-09-13T05:13:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:13:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153264+0000", 2024-09-13T05:13:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056264728999999999 2024-09-13T05:13:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153318+0000", 2024-09-13T05:13:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3934000000000002e-05 2024-09-13T05:13:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153379+0000", 2024-09-13T05:13:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1206999999999999e-05 2024-09-13T05:13:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136586 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4109312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:13:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.685835651999994, 2024-09-13T05:13:04.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056374703999999998, 2024-09-13T05:13:04.865 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.865 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.865 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.865 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.865 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.865 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136586 2024-09-13T05:13:04.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.865 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:13:04.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:13:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097004+0000", 2024-09-13T05:13:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998207 2024-09-13T05:13:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097187+0000", 2024-09-13T05:13:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018337900000000001 2024-09-13T05:13:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097198+0000", 2024-09-13T05:13:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348e-05 2024-09-13T05:13:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097202+0000", 2024-09-13T05:13:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.121e-06 2024-09-13T05:13:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153411+0000", 2024-09-13T05:13:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056209510999999997 2024-09-13T05:13:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153464+0000", 2024-09-13T05:13:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2605000000000002e-05 2024-09-13T05:13:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153558+0000", 2024-09-13T05:13:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4017999999999993e-05 2024-09-13T05:13:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.869 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136588 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:13:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.685551469000004, 2024-09-13T05:13:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056274980000000002, 2024-09-13T05:13:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136588 2024-09-13T05:13:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:13:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:13:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097205+0000", 2024-09-13T05:13:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997377 2024-09-13T05:13:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097471+0000", 2024-09-13T05:13:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026628200000000001 2024-09-13T05:13:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097484+0000", 2024-09-13T05:13:04.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2493e-05 2024-09-13T05:13:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097488+0000", 2024-09-13T05:13:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9330000000000003e-06 2024-09-13T05:13:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153600+0000", 2024-09-13T05:13:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056112097 2024-09-13T05:13:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153654+0000", 2024-09-13T05:13:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4126000000000003e-05 2024-09-13T05:13:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153742+0000", 2024-09-13T05:13:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.831e-05 2024-09-13T05:13:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.875 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136589 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4137984~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:04.875 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:13:04.875 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.685412162000006, 2024-09-13T05:13:04.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056293867999999997, 2024-09-13T05:13:04.875 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.875 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136589 2024-09-13T05:13:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:13:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:13:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097491+0000", 2024-09-13T05:13:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998841 2024-09-13T05:13:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097610+0000", 2024-09-13T05:13:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119263 2024-09-13T05:13:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097617+0000", 2024-09-13T05:13:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6490000000000002e-06 2024-09-13T05:13:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097624+0000", 2024-09-13T05:13:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6309999999999997e-06 2024-09-13T05:13:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153779+0000", 2024-09-13T05:13:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056155153999999999 2024-09-13T05:13:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153831+0000", 2024-09-13T05:13:04.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2080000000000003e-05 2024-09-13T05:13:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153901+0000", 2024-09-13T05:13:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9765999999999996e-05 2024-09-13T05:13:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136965 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3366912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:04.880 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:13:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.665443341, 2024-09-13T05:13:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056225403, 2024-09-13T05:13:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136965 2024-09-13T05:13:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:13:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:13:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117575+0000", 2024-09-13T05:13:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117578+0000", 2024-09-13T05:13:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4899999999999999e-06 2024-09-13T05:13:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117583+0000", 2024-09-13T05:13:04.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.074e-06 2024-09-13T05:13:04.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117587+0000", 2024-09-13T05:13:04.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5360000000000003e-06 2024-09-13T05:13:04.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173622+0000", 2024-09-13T05:13:04.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056034527000000001 2024-09-13T05:13:04.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173704+0000", 2024-09-13T05:13:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2137000000000003e-05 2024-09-13T05:13:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173801+0000", 2024-09-13T05:13:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7048999999999999e-05 2024-09-13T05:13:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.885 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136991 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3553280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:13:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.661517563999993, 2024-09-13T05:13:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056330199999999997, 2024-09-13T05:13:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136991 2024-09-13T05:13:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:13:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:13:04.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:13:04.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:04.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121504+0000", 2024-09-13T05:13:04.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7199999999999998e-06 2024-09-13T05:13:04.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121510+0000", 2024-09-13T05:13:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3459999999999999e-06 2024-09-13T05:13:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121515+0000", 2024-09-13T05:13:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.656e-06 2024-09-13T05:13:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177608+0000", 2024-09-13T05:13:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056093267000000002 2024-09-13T05:13:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177717+0000", 2024-09-13T05:13:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010901299999999999 2024-09-13T05:13:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177832+0000", 2024-09-13T05:13:04.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114604 2024-09-13T05:13:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173672 3.9 3:9520c004:::rbd_data.112d7c1bedf7.0000000000000040:29 [read 186368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:13:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.597622938999997, 2024-09-13T05:13:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05682475, 2024-09-13T05:13:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:04.892 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:04.892 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:04.892 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173672 2024-09-13T05:13:04.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.892 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:04.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:04.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:13:04.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:04.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:13:04.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:04.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:04.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185395+0000", 2024-09-13T05:13:04.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:04.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185398+0000", 2024-09-13T05:13:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8260000000000001e-06 2024-09-13T05:13:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185404+0000", 2024-09-13T05:13:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-09-13T05:13:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185408+0000", 2024-09-13T05:13:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5279999999999997e-06 2024-09-13T05:13:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.236213+0000", 2024-09-13T05:13:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050805207999999998 2024-09-13T05:13:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:04.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.236285+0000", 2024-09-13T05:13:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1236999999999996e-05 2024-09-13T05:13:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.242221+0000", 2024-09-13T05:13:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059360050000000003 2024-09-13T05:13:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:04.896 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:04.896 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:04.897 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:13:04.898 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:13:04.899 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:13:04.899 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:13:04.899 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:13:04.899 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:13:04.900 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:04.894+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:04.900 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:13:04.922 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:13:04.924 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:13:04.924 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:13:04.924 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:13:04.924 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:13:04.924 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:13:04.924 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:13:04.924 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:13:04.924 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:13:04.999 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:04.995+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:05.011 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:05.012 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:05.022 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:13:05.100 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:05.095+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:05.125 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:05.125 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:05.135 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:13:05.200 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:05.195+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:05.241 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:05.241 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:05.249 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:13:05.301 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:05.295+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:05.366 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:05.366 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:05.377 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:13:05.402 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:05.398+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:05.478 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:05.479 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:05.489 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:13:05.502 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:05.498+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:05.600 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:05.600 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:05.603 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:05.598+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:05.609 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:13:05.664 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T05:13:05.703 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:05.699+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:05.718 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:05.719 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:05.728 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:13:05.805 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:05.798+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:05.846 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:05.846 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:05.859 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:13:05.906 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:05.902+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:05.974 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:05.975 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:05.985 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:13:06.006 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:06.003+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:06.089 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:06.089 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:06.099 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:13:06.107 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:06.102+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:06.204 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:06.205 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:06.208 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:06.203+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:06.214 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:13:06.310 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:06.307+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:06.319 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:06.319 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:06.329 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:13:06.410 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:06.406+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:06.435 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:06.436 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:06.445 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:13:06.511 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:06.506+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:06.555 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:06.555 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:06.565 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:13:06.612 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:06.606+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:06.672 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:06.673 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:06.682 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:13:06.713 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:06.707+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:06.795 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is unset 2024-09-13T05:13:06.807 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:06.808 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:06.814 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:06.810+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:06.818 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:13:06.916 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:06.911+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:06.924 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:06.924 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:06.936 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:13:06.938 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:13:07.016 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:07.010+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:07.042 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:07.042 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:07.053 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:13:07.077 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:13:07.098 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:13:07.117 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:13:07.117 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:07.114+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:07.136 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:13:07.154 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:07.154 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:07.154 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:13:07.155 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:07.158 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:13:07.164 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:13:07.180 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:13:07.204 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:13:07.218 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:07.214+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:07.230 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:13:07.232 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:13:07.232 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:13:07.232 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:13:07.233 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:13:07.233 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:13:07.233 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:13:07.233 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:13:07.233 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:13:07.288 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:07.288 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:07.288 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:13:07.288 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:13:07.288 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:07.298 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:13:07.319 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:07.315+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:07.410 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:13:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:13:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:13:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:159451 3.1b e117/116 3:d9c87acb:::rbd_data.112dc3abcba6.0000000000000003:head v 117'567, mlcod=0'0)", 2024-09-13T05:13:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:13:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.468622162000003, 2024-09-13T05:13:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064897325000000006, 2024-09-13T05:13:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:13:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:13:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938207+0000", 2024-09-13T05:13:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:13:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972794+0000", 2024-09-13T05:13:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.034587013 2024-09-13T05:13:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972821+0000", 2024-09-13T05:13:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6764e-05 2024-09-13T05:13:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972841+0000", 2024-09-13T05:13:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0191999999999999e-05 2024-09-13T05:13:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972905+0000", 2024-09-13T05:13:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4319000000000005e-05 2024-09-13T05:13:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972927+0000", 2024-09-13T05:13:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1135999999999999e-05 2024-09-13T05:13:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:13:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.002964+0000", 2024-09-13T05:13:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.030037123999999998 2024-09-13T05:13:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.003105+0000", 2024-09-13T05:13:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141614 2024-09-13T05:13:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159495 3.0 3:022f4da1:::rbd_data.112dfd94ee88.00000000000000e4:2a [read 167936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:13:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.393482741, 2024-09-13T05:13:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91926946899999995, 2024-09-13T05:13:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159495 2024-09-13T05:13:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:13:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:13:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013345+0000", 2024-09-13T05:13:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999971 2024-09-13T05:13:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013359+0000", 2024-09-13T05:13:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4752999999999999e-05 2024-09-13T05:13:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013418+0000", 2024-09-13T05:13:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8959000000000003e-05 2024-09-13T05:13:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013439+0000", 2024-09-13T05:13:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0749000000000001e-05 2024-09-13T05:13:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013563+0000", 2024-09-13T05:13:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012349400000000001 2024-09-13T05:13:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013583+0000", 2024-09-13T05:13:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0007e-05 2024-09-13T05:13:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932400+0000", 2024-09-13T05:13:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91881732400000005 2024-09-13T05:13:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932533+0000", 2024-09-13T05:13:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013263700000000001 2024-09-13T05:13:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932617+0000", 2024-09-13T05:13:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4313000000000004e-05 2024-09-13T05:13:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159517 3.0 3:03975f1c:::rbd_data.112dfd94ee88.0000000000000156:2a [read 167936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:13:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.393219027000001, 2024-09-13T05:13:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91962025700000005, 2024-09-13T05:13:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159517 2024-09-13T05:13:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:13:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:13:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013609+0000", 2024-09-13T05:13:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013619+0000", 2024-09-13T05:13:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0077e-05 2024-09-13T05:13:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013638+0000", 2024-09-13T05:13:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8739000000000001e-05 2024-09-13T05:13:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013653+0000", 2024-09-13T05:13:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5446000000000001e-05 2024-09-13T05:13:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016506+0000", 2024-09-13T05:13:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028525619999999999 2024-09-13T05:13:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016521+0000", 2024-09-13T05:13:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5310000000000001e-05 2024-09-13T05:13:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932964+0000", 2024-09-13T05:13:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91644284099999995 2024-09-13T05:13:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933097+0000", 2024-09-13T05:13:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013337599999999999 2024-09-13T05:13:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933231+0000", 2024-09-13T05:13:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133996 2024-09-13T05:13:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159622 3.0 3:03f7a45a:::rbd_data.112dfd94ee88.0000000000000318:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:13:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.391557216000002, 2024-09-13T05:13:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.918245003, 2024-09-13T05:13:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159622 2024-09-13T05:13:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:13:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:13:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015266+0000", 2024-09-13T05:13:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999928 2024-09-13T05:13:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015283+0000", 2024-09-13T05:13:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7309999999999999e-05 2024-09-13T05:13:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015318+0000", 2024-09-13T05:13:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5119e-05 2024-09-13T05:13:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015338+0000", 2024-09-13T05:13:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9259e-05 2024-09-13T05:13:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016558+0000", 2024-09-13T05:13:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012199909999999999 2024-09-13T05:13:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016567+0000", 2024-09-13T05:13:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2459999999999992e-06 2024-09-13T05:13:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933266+0000", 2024-09-13T05:13:07.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91669950300000003 2024-09-13T05:13:07.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:13:07.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015788099999999999 2024-09-13T05:13:07.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933518+0000", 2024-09-13T05:13:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3721000000000006e-05 2024-09-13T05:13:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173445 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 150528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:13:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.226980431000001, 2024-09-13T05:13:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064560905000000002, 2024-09-13T05:13:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173445 2024-09-13T05:13:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:13:07.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:13:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179849+0000", 2024-09-13T05:13:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179860+0000", 2024-09-13T05:13:07.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0419e-05 2024-09-13T05:13:07.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179866+0000", 2024-09-13T05:13:07.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.567e-06 2024-09-13T05:13:07.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179872+0000", 2024-09-13T05:13:07.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1830000000000002e-06 2024-09-13T05:13:07.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244262+0000", 2024-09-13T05:13:07.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064390814000000005 2024-09-13T05:13:07.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244321+0000", 2024-09-13T05:13:07.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8341000000000003e-05 2024-09-13T05:13:07.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244411+0000", 2024-09-13T05:13:07.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9911e-05 2024-09-13T05:13:07.437 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.437 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.437 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.437 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173446 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 157696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:07.437 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:13:07.437 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.226953664, 2024-09-13T05:13:07.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064714007000000004, 2024-09-13T05:13:07.438 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.438 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.438 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.438 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.438 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.438 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173446 2024-09-13T05:13:07.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.438 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:13:07.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:13:07.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179876+0000", 2024-09-13T05:13:07.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:07.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179879+0000", 2024-09-13T05:13:07.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1489999999999998e-06 2024-09-13T05:13:07.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179884+0000", 2024-09-13T05:13:07.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2800000000000003e-06 2024-09-13T05:13:07.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179889+0000", 2024-09-13T05:13:07.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7620000000000003e-06 2024-09-13T05:13:07.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244452+0000", 2024-09-13T05:13:07.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064562943999999997 2024-09-13T05:13:07.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244512+0000", 2024-09-13T05:13:07.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9879e-05 2024-09-13T05:13:07.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244591+0000", 2024-09-13T05:13:07.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8701000000000004e-05 2024-09-13T05:13:07.442 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.442 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.442 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.442 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173447 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 164864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:07.442 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:13:07.442 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.226936916, 2024-09-13T05:13:07.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064866246000000002, 2024-09-13T05:13:07.442 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.443 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.443 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.443 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.443 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.443 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173447 2024-09-13T05:13:07.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.443 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:13:07.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:13:07.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:13:07.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:07.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179895+0000", 2024-09-13T05:13:07.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6910000000000002e-06 2024-09-13T05:13:07.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179901+0000", 2024-09-13T05:13:07.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5149999999999997e-06 2024-09-13T05:13:07.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179905+0000", 2024-09-13T05:13:07.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4170000000000002e-06 2024-09-13T05:13:07.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244615+0000", 2024-09-13T05:13:07.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064709533999999999 2024-09-13T05:13:07.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244665+0000", 2024-09-13T05:13:07.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0283e-05 2024-09-13T05:13:07.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244760+0000", 2024-09-13T05:13:07.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4310999999999999e-05 2024-09-13T05:13:07.447 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.447 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.447 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.447 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173448 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 172032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:07.447 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:13:07.447 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.226921070000003, 2024-09-13T05:13:07.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065022046999999999, 2024-09-13T05:13:07.447 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.447 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.447 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.447 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.448 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173448 2024-09-13T05:13:07.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.448 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:13:07.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:13:07.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:13:07.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:07.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179914+0000", 2024-09-13T05:13:07.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6699999999999999e-06 2024-09-13T05:13:07.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179921+0000", 2024-09-13T05:13:07.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:13:07.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179926+0000", 2024-09-13T05:13:07.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8659999999999997e-06 2024-09-13T05:13:07.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244782+0000", 2024-09-13T05:13:07.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064856570000000002 2024-09-13T05:13:07.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244857+0000", 2024-09-13T05:13:07.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4326999999999995e-05 2024-09-13T05:13:07.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244931+0000", 2024-09-13T05:13:07.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4443999999999994e-05 2024-09-13T05:13:07.451 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.452 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.452 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.452 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173450 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 179200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:07.452 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:13:07.452 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.226900235999999, 2024-09-13T05:13:07.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065192589999999995, 2024-09-13T05:13:07.452 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.452 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.452 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.452 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.453 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.453 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173450 2024-09-13T05:13:07.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.453 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:13:07.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:13:07.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:13:07.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:07.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179932+0000", 2024-09-13T05:13:07.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2529999999999999e-06 2024-09-13T05:13:07.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179937+0000", 2024-09-13T05:13:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4219999999999999e-06 2024-09-13T05:13:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179942+0000", 2024-09-13T05:13:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3250000000000001e-06 2024-09-13T05:13:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244969+0000", 2024-09-13T05:13:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065027794999999999 2024-09-13T05:13:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245048+0000", 2024-09-13T05:13:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8812000000000004e-05 2024-09-13T05:13:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245123+0000", 2024-09-13T05:13:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4342000000000001e-05 2024-09-13T05:13:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.457 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173451 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:07.457 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:13:07.457 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.226884249000001, 2024-09-13T05:13:07.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359814000000002, 2024-09-13T05:13:07.457 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.457 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173451 2024-09-13T05:13:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:13:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:13:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:13:07.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:07.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179948+0000", 2024-09-13T05:13:07.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5119999999999998e-06 2024-09-13T05:13:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179954+0000", 2024-09-13T05:13:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5840000000000002e-06 2024-09-13T05:13:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179958+0000", 2024-09-13T05:13:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.566e-06 2024-09-13T05:13:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245160+0000", 2024-09-13T05:13:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065202057999999993 2024-09-13T05:13:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245228+0000", 2024-09-13T05:13:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7257999999999999e-05 2024-09-13T05:13:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245306+0000", 2024-09-13T05:13:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8227999999999997e-05 2024-09-13T05:13:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.461 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173452 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 193536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:13:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.226867761999998, 2024-09-13T05:13:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065505701, 2024-09-13T05:13:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173452 2024-09-13T05:13:07.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:13:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:13:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:13:07.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:07.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179965+0000", 2024-09-13T05:13:07.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.402e-06 2024-09-13T05:13:07.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179970+0000", 2024-09-13T05:13:07.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2290000000000002e-06 2024-09-13T05:13:07.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179974+0000", 2024-09-13T05:13:07.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5070000000000002e-06 2024-09-13T05:13:07.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245329+0000", 2024-09-13T05:13:07.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065354906000000004 2024-09-13T05:13:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245390+0000", 2024-09-13T05:13:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0878999999999998e-05 2024-09-13T05:13:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245468+0000", 2024-09-13T05:13:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8073999999999998e-05 2024-09-13T05:13:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.466 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173453 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 198656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:13:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.226851496000002, 2024-09-13T05:13:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065664343, 2024-09-13T05:13:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173453 2024-09-13T05:13:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.467 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:13:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:13:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179978+0000", 2024-09-13T05:13:07.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179981+0000", 2024-09-13T05:13:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4140000000000001e-06 2024-09-13T05:13:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179986+0000", 2024-09-13T05:13:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3519999999999997e-06 2024-09-13T05:13:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179991+0000", 2024-09-13T05:13:07.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6739999999999996e-06 2024-09-13T05:13:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245495+0000", 2024-09-13T05:13:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065504229999999997 2024-09-13T05:13:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245563+0000", 2024-09-13T05:13:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8119000000000003e-05 2024-09-13T05:13:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245643+0000", 2024-09-13T05:13:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9861e-05 2024-09-13T05:13:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173454 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:13:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.226803109000002, 2024-09-13T05:13:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065750457999999998, 2024-09-13T05:13:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.472 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.472 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173454 2024-09-13T05:13:07.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.472 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:13:07.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:13:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180026+0000", 2024-09-13T05:13:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180030+0000", 2024-09-13T05:13:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3790000000000002e-06 2024-09-13T05:13:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180036+0000", 2024-09-13T05:13:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5889999999999999e-06 2024-09-13T05:13:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180041+0000", 2024-09-13T05:13:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9980000000000003e-06 2024-09-13T05:13:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245667+0000", 2024-09-13T05:13:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065625124000000007 2024-09-13T05:13:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245705+0000", 2024-09-13T05:13:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7994000000000002e-05 2024-09-13T05:13:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245778+0000", 2024-09-13T05:13:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2999999999999999e-05 2024-09-13T05:13:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.475 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173455 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 212992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:13:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.226784401000003, 2024-09-13T05:13:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065899773999999994, 2024-09-13T05:13:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173455 2024-09-13T05:13:07.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.477 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:13:07.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:13:07.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180045+0000", 2024-09-13T05:13:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180048+0000", 2024-09-13T05:13:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5830000000000001e-06 2024-09-13T05:13:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180054+0000", 2024-09-13T05:13:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.789e-06 2024-09-13T05:13:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180059+0000", 2024-09-13T05:13:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.933e-06 2024-09-13T05:13:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245801+0000", 2024-09-13T05:13:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065742520999999998 2024-09-13T05:13:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245865+0000", 2024-09-13T05:13:07.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3325999999999996e-05 2024-09-13T05:13:07.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245946+0000", 2024-09-13T05:13:07.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0964999999999995e-05 2024-09-13T05:13:07.480 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.480 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.480 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173456 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:13:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.226767170000002, 2024-09-13T05:13:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066035128999999998, 2024-09-13T05:13:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173456 2024-09-13T05:13:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:13:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:13:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:13:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:07.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180065+0000", 2024-09-13T05:13:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4250000000000001e-06 2024-09-13T05:13:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180070+0000", 2024-09-13T05:13:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1749999999999996e-06 2024-09-13T05:13:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180075+0000", 2024-09-13T05:13:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4769999999999997e-06 2024-09-13T05:13:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245969+0000", 2024-09-13T05:13:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065894182999999995 2024-09-13T05:13:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246027+0000", 2024-09-13T05:13:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8165999999999998e-05 2024-09-13T05:13:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246098+0000", 2024-09-13T05:13:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1068999999999993e-05 2024-09-13T05:13:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173458 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:13:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.226751186999998, 2024-09-13T05:13:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066134732000000002, 2024-09-13T05:13:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.485 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173458 2024-09-13T05:13:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:13:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:13:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:13:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180081+0000", 2024-09-13T05:13:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4150000000000002e-06 2024-09-13T05:13:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180087+0000", 2024-09-13T05:13:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5389999999999998e-06 2024-09-13T05:13:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180101+0000", 2024-09-13T05:13:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4537e-05 2024-09-13T05:13:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246119+0000", 2024-09-13T05:13:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066017701999999998 2024-09-13T05:13:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246155+0000", 2024-09-13T05:13:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6094999999999999e-05 2024-09-13T05:13:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246214+0000", 2024-09-13T05:13:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8789000000000002e-05 2024-09-13T05:13:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.489 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173459 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 234496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:13:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.226723663999998, 2024-09-13T05:13:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066227460000000002, 2024-09-13T05:13:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173459 2024-09-13T05:13:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:13:07.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:13:07.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180106+0000", 2024-09-13T05:13:07.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:07.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180109+0000", 2024-09-13T05:13:07.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2219999999999998e-06 2024-09-13T05:13:07.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180115+0000", 2024-09-13T05:13:07.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9190000000000004e-06 2024-09-13T05:13:07.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180120+0000", 2024-09-13T05:13:07.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8930000000000004e-06 2024-09-13T05:13:07.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246236+0000", 2024-09-13T05:13:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066115638000000004 2024-09-13T05:13:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246273+0000", 2024-09-13T05:13:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7083999999999999e-05 2024-09-13T05:13:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246334+0000", 2024-09-13T05:13:07.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1183e-05 2024-09-13T05:13:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173460 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 241664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:13:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.226705858000003, 2024-09-13T05:13:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066360459999999996, 2024-09-13T05:13:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.494 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173460 2024-09-13T05:13:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:13:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:13:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:13:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180126+0000", 2024-09-13T05:13:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3120000000000001e-06 2024-09-13T05:13:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180132+0000", 2024-09-13T05:13:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.105e-06 2024-09-13T05:13:07.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180137+0000", 2024-09-13T05:13:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6829999999999999e-06 2024-09-13T05:13:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246365+0000", 2024-09-13T05:13:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066227584000000006 2024-09-13T05:13:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246413+0000", 2024-09-13T05:13:07.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8479000000000001e-05 2024-09-13T05:13:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246485+0000", 2024-09-13T05:13:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1600000000000006e-05 2024-09-13T05:13:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173461 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:13:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.226687089000002, 2024-09-13T05:13:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066492449999999995, 2024-09-13T05:13:07.498 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173461 2024-09-13T05:13:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:13:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:13:07.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:13:07.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:07.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180149+0000", 2024-09-13T05:13:07.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7239999999999997e-06 2024-09-13T05:13:07.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180153+0000", 2024-09-13T05:13:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7859999999999996e-06 2024-09-13T05:13:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180158+0000", 2024-09-13T05:13:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0300000000000001e-06 2024-09-13T05:13:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246508+0000", 2024-09-13T05:13:07.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066350100999999995 2024-09-13T05:13:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246568+0000", 2024-09-13T05:13:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9500000000000003e-05 2024-09-13T05:13:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246636+0000", 2024-09-13T05:13:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7633999999999997e-05 2024-09-13T05:13:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173462 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 256000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:13:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.225854261000002, 2024-09-13T05:13:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065773376999999994, 2024-09-13T05:13:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173462 2024-09-13T05:13:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:13:07.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:13:07.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180162+0000", 2024-09-13T05:13:07.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9991865 2024-09-13T05:13:07.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180984+0000", 2024-09-13T05:13:07.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00082184599999999999 2024-09-13T05:13:07.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180994+0000", 2024-09-13T05:13:07.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9000000000000001e-06 2024-09-13T05:13:07.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.181001+0000", 2024-09-13T05:13:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.917e-06 2024-09-13T05:13:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246653+0000", 2024-09-13T05:13:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065651820999999999 2024-09-13T05:13:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246698+0000", 2024-09-13T05:13:07.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.473e-05 2024-09-13T05:13:07.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246749+0000", 2024-09-13T05:13:07.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1758999999999997e-05 2024-09-13T05:13:07.507 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.507 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.507 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.507 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.507 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.507 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:07.509 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:13:07.509 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:07.503+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:07.610 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:07.606+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:07.623 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:07.623 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:07.623 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:13:07.623 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:07.633 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:13:07.710 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:07.707+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:07.741 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:07.741 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:07.741 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:13:07.741 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:13:07.741 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:07.751 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:13:07.777 INFO:tasks.thrashosds.thrasher:in_osds: [2, 3, 5, 7, 1, 4] out_osds: [0, 6] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-13T05:13:07.777 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:13:07.777 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-13T05:13:07.777 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-13T05:13:07.777 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-13T05:13:07.777 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-13T05:13:07.811 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:07.806+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:07.870 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:07.870 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:13:07.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:13:07.870 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:13:07.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.871 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136560 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3908608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:07.871 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:13:07.871 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.772319280000005, 2024-09-13T05:13:07.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056148103999999997, 2024-09-13T05:13:07.871 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.871 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.871 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.871 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.871 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.871 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136560 2024-09-13T05:13:07.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.872 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:13:07.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:13:07.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095289+0000", 2024-09-13T05:13:07.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:07.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095292+0000", 2024-09-13T05:13:07.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.802e-06 2024-09-13T05:13:07.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095318+0000", 2024-09-13T05:13:07.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5987999999999999e-05 2024-09-13T05:13:07.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095323+0000", 2024-09-13T05:13:07.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.006e-06 2024-09-13T05:13:07.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151316+0000", 2024-09-13T05:13:07.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055992593 2024-09-13T05:13:07.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151371+0000", 2024-09-13T05:13:07.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5532999999999998e-05 2024-09-13T05:13:07.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151438+0000", 2024-09-13T05:13:07.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6557999999999995e-05 2024-09-13T05:13:07.875 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.875 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.875 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.876 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136562 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3922944~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:07.876 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:13:07.876 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.772282161999996, 2024-09-13T05:13:07.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056259690000000001, 2024-09-13T05:13:07.876 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.876 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.876 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136562 2024-09-13T05:13:07.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.876 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:13:07.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:13:07.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:13:07.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:07.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095329+0000", 2024-09-13T05:13:07.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3089999999999998e-06 2024-09-13T05:13:07.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095333+0000", 2024-09-13T05:13:07.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6239999999999999e-06 2024-09-13T05:13:07.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095335+0000", 2024-09-13T05:13:07.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5660000000000001e-06 2024-09-13T05:13:07.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151468+0000", 2024-09-13T05:13:07.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056132608000000001 2024-09-13T05:13:07.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151519+0000", 2024-09-13T05:13:07.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1681000000000002e-05 2024-09-13T05:13:07.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151587+0000", 2024-09-13T05:13:07.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7200999999999996e-05 2024-09-13T05:13:07.881 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.881 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.881 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.881 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136563 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3937280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:07.881 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:13:07.881 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.772270739999996, 2024-09-13T05:13:07.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056393051999999999, 2024-09-13T05:13:07.881 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.881 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.881 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.881 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.882 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.882 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136563 2024-09-13T05:13:07.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.882 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:13:07.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:13:07.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:13:07.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:13:07.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095340+0000", 2024-09-13T05:13:07.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.561e-06 2024-09-13T05:13:07.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095342+0000", 2024-09-13T05:13:07.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8059999999999999e-06 2024-09-13T05:13:07.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095345+0000", 2024-09-13T05:13:07.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:13:07.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151621+0000", 2024-09-13T05:13:07.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056275602000000001 2024-09-13T05:13:07.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151670+0000", 2024-09-13T05:13:07.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9478000000000003e-05 2024-09-13T05:13:07.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151731+0000", 2024-09-13T05:13:07.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1054000000000002e-05 2024-09-13T05:13:07.887 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.887 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.887 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.888 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136565 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3951616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:07.888 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:13:07.888 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.772260426000003, 2024-09-13T05:13:07.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056524090999999999, 2024-09-13T05:13:07.888 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.888 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.888 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.889 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136565 2024-09-13T05:13:07.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.889 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:13:07.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:13:07.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095348+0000", 2024-09-13T05:13:07.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:13:07.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095350+0000", 2024-09-13T05:13:07.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4479999999999999e-06 2024-09-13T05:13:07.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095353+0000", 2024-09-13T05:13:07.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.909e-06 2024-09-13T05:13:07.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095356+0000", 2024-09-13T05:13:07.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:13:07.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151763+0000", 2024-09-13T05:13:07.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056407813000000001 2024-09-13T05:13:07.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151812+0000", 2024-09-13T05:13:07.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8306999999999997e-05 2024-09-13T05:13:07.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151873+0000", 2024-09-13T05:13:07.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1064999999999999e-05 2024-09-13T05:13:07.895 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.895 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.895 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.895 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136567 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3965952~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:07.896 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:13:07.896 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.772251401000005, 2024-09-13T05:13:07.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056653907000000003, 2024-09-13T05:13:07.896 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.896 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.896 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.896 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.896 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.896 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136567 2024-09-13T05:13:07.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.896 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:13:07.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:13:07.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095357+0000", 2024-09-13T05:13:07.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:07.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095359+0000", 2024-09-13T05:13:07.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:13:07.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095362+0000", 2024-09-13T05:13:07.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7939999999999998e-06 2024-09-13T05:13:07.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095365+0000", 2024-09-13T05:13:07.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9979999999999999e-06 2024-09-13T05:13:07.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151904+0000", 2024-09-13T05:13:07.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056539308000000003 2024-09-13T05:13:07.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151953+0000", 2024-09-13T05:13:07.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8760000000000001e-05 2024-09-13T05:13:07.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152012+0000", 2024-09-13T05:13:07.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8761999999999997e-05 2024-09-13T05:13:07.900 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.900 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.900 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.901 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136569 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3980288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:07.901 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:13:07.901 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.772215646999996, 2024-09-13T05:13:07.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056771237000000002, 2024-09-13T05:13:07.901 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.901 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.901 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136569 2024-09-13T05:13:07.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.902 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:13:07.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:13:07.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:13:07.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:07.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095395+0000", 2024-09-13T05:13:07.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8870000000000001e-06 2024-09-13T05:13:07.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095402+0000", 2024-09-13T05:13:07.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6290000000000001e-06 2024-09-13T05:13:07.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095412+0000", 2024-09-13T05:13:07.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1730000000000001e-06 2024-09-13T05:13:07.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152044+0000", 2024-09-13T05:13:07.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056632016 2024-09-13T05:13:07.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152093+0000", 2024-09-13T05:13:07.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9570000000000001e-05 2024-09-13T05:13:07.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152165+0000", 2024-09-13T05:13:07.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1443e-05 2024-09-13T05:13:07.908 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.908 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.908 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.908 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136571 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3994624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:07.908 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:13:07.908 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.772194631999994, 2024-09-13T05:13:07.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056894741999999998, 2024-09-13T05:13:07.908 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.908 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.908 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.908 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.909 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.909 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136571 2024-09-13T05:13:07.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.909 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:13:07.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:13:07.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:13:07.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:07.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095418+0000", 2024-09-13T05:13:07.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0210000000000001e-06 2024-09-13T05:13:07.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095422+0000", 2024-09-13T05:13:07.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5310000000000002e-06 2024-09-13T05:13:07.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095425+0000", 2024-09-13T05:13:07.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8880000000000001e-06 2024-09-13T05:13:07.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152198+0000", 2024-09-13T05:13:07.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056773563999999999 2024-09-13T05:13:07.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152249+0000", 2024-09-13T05:13:07.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1168999999999997e-05 2024-09-13T05:13:07.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152309+0000", 2024-09-13T05:13:07.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9821999999999997e-05 2024-09-13T05:13:07.912 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.912 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.912 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.913 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136573 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4008960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:07.913 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:13:07.913 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.772182404999995, 2024-09-13T05:13:07.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057045810000000002, 2024-09-13T05:13:07.913 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.913 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.913 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.913 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.913 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.913 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136573 2024-09-13T05:13:07.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.914 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:13:07.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:13:07.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095426+0000", 2024-09-13T05:13:07.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:07.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095428+0000", 2024-09-13T05:13:07.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.593e-06 2024-09-13T05:13:07.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095431+0000", 2024-09-13T05:13:07.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9610000000000001e-06 2024-09-13T05:13:07.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095434+0000", 2024-09-13T05:13:07.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:13:07.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152352+0000", 2024-09-13T05:13:07.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05691881 2024-09-13T05:13:07.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152401+0000", 2024-09-13T05:13:07.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8995000000000001e-05 2024-09-13T05:13:07.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152472+0000", 2024-09-13T05:13:07.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1060000000000001e-05 2024-09-13T05:13:07.917 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.917 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.917 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.918 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136575 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4023296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:07.918 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:13:07.918 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.771752411999998, 2024-09-13T05:13:07.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056760069000000003, 2024-09-13T05:13:07.918 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.918 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.918 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.918 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.918 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.918 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136575 2024-09-13T05:13:07.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.918 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:13:07.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:13:07.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095437+0000", 2024-09-13T05:13:07.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9995799 2024-09-13T05:13:07.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095861+0000", 2024-09-13T05:13:07.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000424299 2024-09-13T05:13:07.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095869+0000", 2024-09-13T05:13:07.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5020000000000003e-06 2024-09-13T05:13:07.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095875+0000", 2024-09-13T05:13:07.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:13:07.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152502+0000", 2024-09-13T05:13:07.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056626528000000002 2024-09-13T05:13:07.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152556+0000", 2024-09-13T05:13:07.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4271000000000003e-05 2024-09-13T05:13:07.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152617+0000", 2024-09-13T05:13:07.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0896000000000001e-05 2024-09-13T05:13:07.922 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.922 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.922 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.922 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136577 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4037632~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:07.922 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:13:07.923 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.771650957000006, 2024-09-13T05:13:07.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056798242999999998, 2024-09-13T05:13:07.923 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.923 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.923 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.923 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.924 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.924 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136577 2024-09-13T05:13:07.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.924 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:13:07.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:13:07.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095882+0000", 2024-09-13T05:13:07.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999242 2024-09-13T05:13:07.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095961+0000", 2024-09-13T05:13:07.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8864999999999998e-05 2024-09-13T05:13:07.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095973+0000", 2024-09-13T05:13:07.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2206e-05 2024-09-13T05:13:07.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095978+0000", 2024-09-13T05:13:07.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0629999999999996e-06 2024-09-13T05:13:07.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152646+0000", 2024-09-13T05:13:07.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056668035999999998 2024-09-13T05:13:07.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152695+0000", 2024-09-13T05:13:07.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8634000000000002e-05 2024-09-13T05:13:07.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152756+0000", 2024-09-13T05:13:07.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1315000000000005e-05 2024-09-13T05:13:07.932 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.933 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.933 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.933 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136579 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4051968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:07.933 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:13:07.934 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.771322862000005, 2024-09-13T05:13:07.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056610869000000001, 2024-09-13T05:13:07.934 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.934 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.935 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.935 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.935 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136579 2024-09-13T05:13:07.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.935 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:13:07.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:13:07.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095989+0000", 2024-09-13T05:13:07.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997029 2024-09-13T05:13:07.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096291+0000", 2024-09-13T05:13:07.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030221499999999999 2024-09-13T05:13:07.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096300+0000", 2024-09-13T05:13:07.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4819999999999994e-06 2024-09-13T05:13:07.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096306+0000", 2024-09-13T05:13:07.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:13:07.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152788+0000", 2024-09-13T05:13:07.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056481625000000001 2024-09-13T05:13:07.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152837+0000", 2024-09-13T05:13:07.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9345000000000003e-05 2024-09-13T05:13:07.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152897+0000", 2024-09-13T05:13:07.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9892999999999997e-05 2024-09-13T05:13:07.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.943 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.944 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136581 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4066304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:07.944 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:13:07.944 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.771144035000006, 2024-09-13T05:13:07.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056597091000000002, 2024-09-13T05:13:07.945 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.945 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.945 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.945 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.945 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.946 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136581 2024-09-13T05:13:07.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.946 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:13:07.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:13:07.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096312+0000", 2024-09-13T05:13:07.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998465 2024-09-13T05:13:07.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096469+0000", 2024-09-13T05:13:07.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157109 2024-09-13T05:13:07.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096478+0000", 2024-09-13T05:13:07.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3260000000000002e-06 2024-09-13T05:13:07.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096482+0000", 2024-09-13T05:13:07.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9720000000000003e-06 2024-09-13T05:13:07.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152933+0000", 2024-09-13T05:13:07.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056451128000000003 2024-09-13T05:13:07.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152993+0000", 2024-09-13T05:13:07.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9947000000000001e-05 2024-09-13T05:13:07.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153062+0000", 2024-09-13T05:13:07.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9105999999999999e-05 2024-09-13T05:13:07.952 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.953 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.953 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.953 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136583 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4080640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:07.953 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:13:07.953 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.770878121999999, 2024-09-13T05:13:07.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056496609000000003, 2024-09-13T05:13:07.953 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.953 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.953 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.953 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.954 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.954 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136583 2024-09-13T05:13:07.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.954 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:13:07.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:13:07.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096485+0000", 2024-09-13T05:13:07.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997544 2024-09-13T05:13:07.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096735+0000", 2024-09-13T05:13:07.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024979899999999998 2024-09-13T05:13:07.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096742+0000", 2024-09-13T05:13:07.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7139999999999996e-06 2024-09-13T05:13:07.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096747+0000", 2024-09-13T05:13:07.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8709999999999996e-06 2024-09-13T05:13:07.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153099+0000", 2024-09-13T05:13:07.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056352639000000003 2024-09-13T05:13:07.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153168+0000", 2024-09-13T05:13:07.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9029000000000006e-05 2024-09-13T05:13:07.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153228+0000", 2024-09-13T05:13:07.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9339999999999998e-05 2024-09-13T05:13:07.958 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.958 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.958 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.958 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136585 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4094976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:07.958 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:13:07.958 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.770626655000001, 2024-09-13T05:13:07.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056396420000000003, 2024-09-13T05:13:07.958 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.958 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.958 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.958 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.958 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.959 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136585 2024-09-13T05:13:07.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.959 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:13:07.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:13:07.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096750+0000", 2024-09-13T05:13:07.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997673 2024-09-13T05:13:07.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096986+0000", 2024-09-13T05:13:07.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000236297 2024-09-13T05:13:07.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096993+0000", 2024-09-13T05:13:07.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9600000000000003e-06 2024-09-13T05:13:07.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096999+0000", 2024-09-13T05:13:07.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:13:07.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153264+0000", 2024-09-13T05:13:07.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056264728999999999 2024-09-13T05:13:07.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153318+0000", 2024-09-13T05:13:07.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3934000000000002e-05 2024-09-13T05:13:07.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153379+0000", 2024-09-13T05:13:07.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1206999999999999e-05 2024-09-13T05:13:07.962 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.962 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.962 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.962 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136586 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4109312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:07.963 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:13:07.963 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.770425853000006, 2024-09-13T05:13:07.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056374703999999998, 2024-09-13T05:13:07.963 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.963 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.963 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136586 2024-09-13T05:13:07.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.963 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:13:07.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:13:07.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097004+0000", 2024-09-13T05:13:07.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998207 2024-09-13T05:13:07.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097187+0000", 2024-09-13T05:13:07.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018337900000000001 2024-09-13T05:13:07.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097198+0000", 2024-09-13T05:13:07.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348e-05 2024-09-13T05:13:07.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097202+0000", 2024-09-13T05:13:07.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.121e-06 2024-09-13T05:13:07.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153411+0000", 2024-09-13T05:13:07.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056209510999999997 2024-09-13T05:13:07.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153464+0000", 2024-09-13T05:13:07.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2605000000000002e-05 2024-09-13T05:13:07.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153558+0000", 2024-09-13T05:13:07.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4017999999999993e-05 2024-09-13T05:13:07.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.967 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.967 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136588 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:07.967 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:13:07.967 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.770141670000001, 2024-09-13T05:13:07.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056274980000000002, 2024-09-13T05:13:07.968 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.968 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.968 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136588 2024-09-13T05:13:07.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.968 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:13:07.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:13:07.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097205+0000", 2024-09-13T05:13:07.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997377 2024-09-13T05:13:07.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097471+0000", 2024-09-13T05:13:07.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026628200000000001 2024-09-13T05:13:07.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097484+0000", 2024-09-13T05:13:07.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2493e-05 2024-09-13T05:13:07.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097488+0000", 2024-09-13T05:13:07.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9330000000000003e-06 2024-09-13T05:13:07.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153600+0000", 2024-09-13T05:13:07.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056112097 2024-09-13T05:13:07.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153654+0000", 2024-09-13T05:13:07.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4126000000000003e-05 2024-09-13T05:13:07.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153742+0000", 2024-09-13T05:13:07.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.831e-05 2024-09-13T05:13:07.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.972 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.972 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136589 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4137984~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:07.972 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:13:07.972 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.770002363000003, 2024-09-13T05:13:07.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056293867999999997, 2024-09-13T05:13:07.973 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.973 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.973 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136589 2024-09-13T05:13:07.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.973 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:13:07.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:13:07.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097491+0000", 2024-09-13T05:13:07.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998841 2024-09-13T05:13:07.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097610+0000", 2024-09-13T05:13:07.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119263 2024-09-13T05:13:07.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097617+0000", 2024-09-13T05:13:07.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6490000000000002e-06 2024-09-13T05:13:07.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097624+0000", 2024-09-13T05:13:07.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6309999999999997e-06 2024-09-13T05:13:07.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153779+0000", 2024-09-13T05:13:07.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056155153999999999 2024-09-13T05:13:07.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153831+0000", 2024-09-13T05:13:07.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2080000000000003e-05 2024-09-13T05:13:07.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153901+0000", 2024-09-13T05:13:07.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9765999999999996e-05 2024-09-13T05:13:07.977 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.977 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.977 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.977 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136965 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3366912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:07.977 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:13:07.977 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.750033541999997, 2024-09-13T05:13:07.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056225403, 2024-09-13T05:13:07.978 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.978 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.978 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.978 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.978 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.978 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136965 2024-09-13T05:13:07.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.978 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:13:07.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:13:07.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117575+0000", 2024-09-13T05:13:07.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:07.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117578+0000", 2024-09-13T05:13:07.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4899999999999999e-06 2024-09-13T05:13:07.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117583+0000", 2024-09-13T05:13:07.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.074e-06 2024-09-13T05:13:07.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117587+0000", 2024-09-13T05:13:07.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5360000000000003e-06 2024-09-13T05:13:07.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173622+0000", 2024-09-13T05:13:07.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056034527000000001 2024-09-13T05:13:07.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173704+0000", 2024-09-13T05:13:07.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2137000000000003e-05 2024-09-13T05:13:07.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173801+0000", 2024-09-13T05:13:07.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7048999999999999e-05 2024-09-13T05:13:07.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.982 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.982 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136991 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3553280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:07.982 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:13:07.982 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.746107765000005, 2024-09-13T05:13:07.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056330199999999997, 2024-09-13T05:13:07.982 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.983 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.983 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136991 2024-09-13T05:13:07.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.983 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:13:07.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:13:07.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:13:07.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:07.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121504+0000", 2024-09-13T05:13:07.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7199999999999998e-06 2024-09-13T05:13:07.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121510+0000", 2024-09-13T05:13:07.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3459999999999999e-06 2024-09-13T05:13:07.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121515+0000", 2024-09-13T05:13:07.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.656e-06 2024-09-13T05:13:07.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177608+0000", 2024-09-13T05:13:07.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056093267000000002 2024-09-13T05:13:07.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177717+0000", 2024-09-13T05:13:07.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010901299999999999 2024-09-13T05:13:07.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177832+0000", 2024-09-13T05:13:07.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114604 2024-09-13T05:13:07.986 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.986 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.987 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.987 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173672 3.9 3:9520c004:::rbd_data.112d7c1bedf7.0000000000000040:29 [read 186368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:07.987 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:13:07.987 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.682213140000002, 2024-09-13T05:13:07.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05682475, 2024-09-13T05:13:07.987 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:07.987 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:07.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:07.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:07.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:07.987 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173672 2024-09-13T05:13:07.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.988 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:07.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:07.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:13:07.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:07.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:13:07.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:07.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:07.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185395+0000", 2024-09-13T05:13:07.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:07.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:07.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185398+0000", 2024-09-13T05:13:07.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8260000000000001e-06 2024-09-13T05:13:07.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:07.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185404+0000", 2024-09-13T05:13:07.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-09-13T05:13:07.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:07.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185408+0000", 2024-09-13T05:13:07.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5279999999999997e-06 2024-09-13T05:13:07.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:07.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.236213+0000", 2024-09-13T05:13:07.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050805207999999998 2024-09-13T05:13:07.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:07.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.236285+0000", 2024-09-13T05:13:07.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1236999999999996e-05 2024-09-13T05:13:07.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:07.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:07.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:07.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.242221+0000", 2024-09-13T05:13:07.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059360050000000003 2024-09-13T05:13:07.991 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.991 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.991 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.991 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:07.991 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:07.992 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:07.993 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:13:07.994 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:07.994 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-13T05:13:07.994 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:07.995 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:07.987+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:08.094 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:08.091+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:08.152 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:08.152 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:08.152 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:13:08.152 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:08.163 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:13:08.195 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:08.190+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:08.267 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:08.268 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:08.268 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:13:08.268 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:13:08.268 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:08.277 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:13:08.296 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:08.291+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:08.390 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:08.391 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:13:08.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:13:08.391 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:13:08.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.391 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:70758 3.2 3:427d0469:::rbd_header.112d8d1317eb:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-13T05:13:08.391 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:13:08.391 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 104.95828042300001, 2024-09-13T05:13:08.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.190313603, 2024-09-13T05:13:08.391 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:08.391 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:08.391 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:08.392 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:08.392 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.392 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70758 2024-09-13T05:13:08.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.392 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:08.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:08.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:13:08.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:08.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:13:08.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:08.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428654+0000", 2024-09-13T05:13:08.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:08.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:08.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428664+0000", 2024-09-13T05:13:08.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0664e-05 2024-09-13T05:13:08.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:08.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428683+0000", 2024-09-13T05:13:08.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8377e-05 2024-09-13T05:13:08.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428691+0000", 2024-09-13T05:13:08.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9400000000000008e-06 2024-09-13T05:13:08.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428789+0000", 2024-09-13T05:13:08.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7165999999999998e-05 2024-09-13T05:13:08.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:08.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428811+0000", 2024-09-13T05:13:08.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1925000000000001e-05 2024-09-13T05:13:08.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.617921+0000", 2024-09-13T05:13:08.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.189110536 2024-09-13T05:13:08.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:08.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618344+0000", 2024-09-13T05:13:08.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042245800000000001 2024-09-13T05:13:08.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:08.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618969+0000", 2024-09-13T05:13:08.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062529299999999996 2024-09-13T05:13:08.396 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.396 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:08.396 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.396 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162381 3.8 3.4e1a3768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:08.397 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:13:08.397 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.878274175999998, 2024-09-13T05:13:08.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.14690313199999999, 2024-09-13T05:13:08.397 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:08.397 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:13:08.397 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:08.397 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:08.397 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.397 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162381 2024-09-13T05:13:08.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.397 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:08.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:08.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:13:08.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:08.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:13:08.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:08.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508659+0000", 2024-09-13T05:13:08.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:13:08.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:08.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508673+0000", 2024-09-13T05:13:08.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4154999999999999e-05 2024-09-13T05:13:08.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:08.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508703+0000", 2024-09-13T05:13:08.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9427000000000001e-05 2024-09-13T05:13:08.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508719+0000", 2024-09-13T05:13:08.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6381000000000001e-05 2024-09-13T05:13:08.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508789+0000", 2024-09-13T05:13:08.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9898000000000001e-05 2024-09-13T05:13:08.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:08.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508799+0000", 2024-09-13T05:13:08.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0066e-05 2024-09-13T05:13:08.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655550+0000", 2024-09-13T05:13:08.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.146750506 2024-09-13T05:13:08.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:08.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655565+0000", 2024-09-13T05:13:08.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4915e-05 2024-09-13T05:13:08.401 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.401 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:08.401 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.402 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162393 3.8 3.fd966c88 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:08.402 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:13:08.402 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.866758101999999, 2024-09-13T05:13:08.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.135657895, 2024-09-13T05:13:08.402 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:08.402 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:13:08.402 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:08.402 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:08.402 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.402 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162393 2024-09-13T05:13:08.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.402 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:08.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:08.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:13:08.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:08.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:13:08.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:08.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520176+0000", 2024-09-13T05:13:08.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:13:08.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:08.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520184+0000", 2024-09-13T05:13:08.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5800000000000003e-06 2024-09-13T05:13:08.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:08.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520199+0000", 2024-09-13T05:13:08.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4481000000000001e-05 2024-09-13T05:13:08.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520209+0000", 2024-09-13T05:13:08.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0327e-05 2024-09-13T05:13:08.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520351+0000", 2024-09-13T05:13:08.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141827 2024-09-13T05:13:08.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:08.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520363+0000", 2024-09-13T05:13:08.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2018000000000001e-05 2024-09-13T05:13:08.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655819+0000", 2024-09-13T05:13:08.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13545665600000001 2024-09-13T05:13:08.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:08.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655835+0000", 2024-09-13T05:13:08.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6135000000000001e-05 2024-09-13T05:13:08.406 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.406 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:08.406 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.407 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162429 3.8 3.6e098f28 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:08.407 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:13:08.407 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.865907493000002, 2024-09-13T05:13:08.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13484765400000001, 2024-09-13T05:13:08.407 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:08.407 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:13:08.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:08.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:08.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.407 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162429 2024-09-13T05:13:08.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.407 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:08.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:08.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:13:08.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:08.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:13:08.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:08.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:13:08.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:08.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:08.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521032+0000", 2024-09-13T05:13:08.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3039999999999998e-06 2024-09-13T05:13:08.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:08.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521041+0000", 2024-09-13T05:13:08.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6880000000000005e-06 2024-09-13T05:13:08.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521047+0000", 2024-09-13T05:13:08.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0100000000000001e-06 2024-09-13T05:13:08.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521601+0000", 2024-09-13T05:13:08.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00055398600000000002 2024-09-13T05:13:08.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:08.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521613+0000", 2024-09-13T05:13:08.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2347000000000001e-05 2024-09-13T05:13:08.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655869+0000", 2024-09-13T05:13:08.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.134255597 2024-09-13T05:13:08.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:08.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655876+0000", 2024-09-13T05:13:08.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2790000000000001e-06 2024-09-13T05:13:08.411 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.411 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:08.411 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.412 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162521 3.8 3.f06bf7c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:08.412 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:13:08.412 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.863505363000002, 2024-09-13T05:13:08.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13247452600000001, 2024-09-13T05:13:08.412 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:08.412 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:13:08.412 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:08.412 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:08.412 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.412 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162521 2024-09-13T05:13:08.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.413 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:08.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:08.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:13:08.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:08.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:13:08.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:08.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:13:08.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:08.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:08.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523433+0000", 2024-09-13T05:13:08.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.128e-06 2024-09-13T05:13:08.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:08.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523440+0000", 2024-09-13T05:13:08.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9990000000000002e-06 2024-09-13T05:13:08.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523446+0000", 2024-09-13T05:13:08.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7869999999999998e-06 2024-09-13T05:13:08.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.528221+0000", 2024-09-13T05:13:08.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047747040000000003 2024-09-13T05:13:08.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:08.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.528237+0000", 2024-09-13T05:13:08.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6042e-05 2024-09-13T05:13:08.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655898+0000", 2024-09-13T05:13:08.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.127661521 2024-09-13T05:13:08.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:08.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655905+0000", 2024-09-13T05:13:08.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7780000000000002e-06 2024-09-13T05:13:08.416 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.416 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:08.416 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.417 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162381 3.8 3:16ec5872:::rbd_data.112dc3abcba6.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:08.417 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:13:08.417 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.853978198, 2024-09-13T05:13:08.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12546553899999999, 2024-09-13T05:13:08.417 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:08.417 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:08.417 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:08.417 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:08.417 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.417 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162381 2024-09-13T05:13:08.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.417 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:08.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:08.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:13:08.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:08.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:13:08.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:08.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532956+0000", 2024-09-13T05:13:08.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:08.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:08.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532964+0000", 2024-09-13T05:13:08.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.072e-06 2024-09-13T05:13:08.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:08.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532976+0000", 2024-09-13T05:13:08.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1355000000000001e-05 2024-09-13T05:13:08.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532984+0000", 2024-09-13T05:13:08.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3440000000000001e-06 2024-09-13T05:13:08.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533432+0000", 2024-09-13T05:13:08.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044773000000000002 2024-09-13T05:13:08.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:08.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533439+0000", 2024-09-13T05:13:08.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9890000000000003e-06 2024-09-13T05:13:08.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655985+0000", 2024-09-13T05:13:08.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122546527 2024-09-13T05:13:08.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:08.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656234+0000", 2024-09-13T05:13:08.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024911300000000003 2024-09-13T05:13:08.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:08.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656378+0000", 2024-09-13T05:13:08.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014417100000000001 2024-09-13T05:13:08.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:08.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657916+0000", 2024-09-13T05:13:08.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001537907 2024-09-13T05:13:08.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:13:08.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658308+0000", 2024-09-13T05:13:08.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039183700000000002 2024-09-13T05:13:08.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:13:08.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658364+0000", 2024-09-13T05:13:08.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5451000000000002e-05 2024-09-13T05:13:08.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:08.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658423+0000", 2024-09-13T05:13:08.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9449e-05 2024-09-13T05:13:08.423 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.424 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:08.424 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.424 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162393 3.8 3:113669bf:::rbd_data.112dfd94ee88.00000000000000bf:2a [read 131072~18432] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:08.424 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:13:08.424 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.853938419000002, 2024-09-13T05:13:08.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124231431, 2024-09-13T05:13:08.424 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:08.424 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:08.424 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:08.424 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:08.424 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.425 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162393 2024-09-13T05:13:08.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.425 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:08.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:08.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:13:08.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:08.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:13:08.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:08.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:13:08.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:08.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:08.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533001+0000", 2024-09-13T05:13:08.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8099999999999999e-06 2024-09-13T05:13:08.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:08.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533007+0000", 2024-09-13T05:13:08.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5849999999999996e-06 2024-09-13T05:13:08.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533012+0000", 2024-09-13T05:13:08.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0320000000000003e-06 2024-09-13T05:13:08.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533459+0000", 2024-09-13T05:13:08.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044646399999999999 2024-09-13T05:13:08.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:08.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533464+0000", 2024-09-13T05:13:08.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9180000000000002e-06 2024-09-13T05:13:08.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656870+0000", 2024-09-13T05:13:08.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123406847 2024-09-13T05:13:08.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:08.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657067+0000", 2024-09-13T05:13:08.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019655599999999999 2024-09-13T05:13:08.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:08.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657229+0000", 2024-09-13T05:13:08.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016175599999999999 2024-09-13T05:13:08.429 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.429 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:08.429 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.429 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162429 3.8 3:14f19076:::rbd_data.112dfd94ee88.0000000000000150:2a [read 131072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:08.429 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:13:08.429 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.853918868999997, 2024-09-13T05:13:08.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124549956, 2024-09-13T05:13:08.429 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:08.430 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:08.430 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:08.430 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:08.430 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.430 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162429 2024-09-13T05:13:08.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.430 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:08.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:08.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:13:08.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:08.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:13:08.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:08.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533016+0000", 2024-09-13T05:13:08.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:08.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:08.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533020+0000", 2024-09-13T05:13:08.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1049999999999999e-06 2024-09-13T05:13:08.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:08.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533025+0000", 2024-09-13T05:13:08.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-09-13T05:13:08.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533030+0000", 2024-09-13T05:13:08.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8999999999999997e-06 2024-09-13T05:13:08.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533481+0000", 2024-09-13T05:13:08.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045080400000000002 2024-09-13T05:13:08.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:08.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533486+0000", 2024-09-13T05:13:08.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3369999999999999e-06 2024-09-13T05:13:08.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657311+0000", 2024-09-13T05:13:08.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123824408 2024-09-13T05:13:08.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:08.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657464+0000", 2024-09-13T05:13:08.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015343900000000001 2024-09-13T05:13:08.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:08.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657567+0000", 2024-09-13T05:13:08.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102568 2024-09-13T05:13:08.434 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.434 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:08.434 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.434 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162521 3.8 3:13efd60f:::rbd_data.112dfd94ee88.000000000000031a:2a [read 131072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:08.434 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:13:08.434 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.853767636000001, 2024-09-13T05:13:08.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124709257, 2024-09-13T05:13:08.435 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:08.435 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:08.435 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:08.435 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:08.435 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.435 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162521 2024-09-13T05:13:08.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.435 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:08.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:08.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:13:08.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:08.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:13:08.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:08.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:13:08.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:08.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:08.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533170+0000", 2024-09-13T05:13:08.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3910000000000001e-06 2024-09-13T05:13:08.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:08.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533176+0000", 2024-09-13T05:13:08.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4029999999999998e-06 2024-09-13T05:13:08.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533180+0000", 2024-09-13T05:13:08.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6999999999999999e-06 2024-09-13T05:13:08.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533659+0000", 2024-09-13T05:13:08.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047839699999999998 2024-09-13T05:13:08.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:08.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533664+0000", 2024-09-13T05:13:08.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7239999999999997e-06 2024-09-13T05:13:08.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657619+0000", 2024-09-13T05:13:08.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123954412 2024-09-13T05:13:08.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:08.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657784+0000", 2024-09-13T05:13:08.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016527499999999999 2024-09-13T05:13:08.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:08.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657877+0000", 2024-09-13T05:13:08.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3280000000000001e-05 2024-09-13T05:13:08.439 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.439 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:08.439 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.439 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162618 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 70656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:08.440 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:13:08.440 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.852462926000001, 2024-09-13T05:13:08.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123752711, 2024-09-13T05:13:08.440 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:08.440 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:08.440 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:08.440 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:08.440 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.440 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162618 2024-09-13T05:13:08.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.440 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:08.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:08.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:13:08.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:08.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:13:08.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:08.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534472+0000", 2024-09-13T05:13:08.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:08.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:08.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534475+0000", 2024-09-13T05:13:08.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2010000000000002e-06 2024-09-13T05:13:08.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:08.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534482+0000", 2024-09-13T05:13:08.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:13:08.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534486+0000", 2024-09-13T05:13:08.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7520000000000004e-06 2024-09-13T05:13:08.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536456+0000", 2024-09-13T05:13:08.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001969527 2024-09-13T05:13:08.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:08.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536462+0000", 2024-09-13T05:13:08.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2750000000000001e-06 2024-09-13T05:13:08.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657939+0000", 2024-09-13T05:13:08.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121476769 2024-09-13T05:13:08.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:08.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658087+0000", 2024-09-13T05:13:08.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014862400000000001 2024-09-13T05:13:08.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:08.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658225+0000", 2024-09-13T05:13:08.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013800999999999999 2024-09-13T05:13:08.444 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.444 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:08.444 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.445 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162620 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 71680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:08.445 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:13:08.445 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.852428801000002, 2024-09-13T05:13:08.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124087688, 2024-09-13T05:13:08.445 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:08.445 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:08.445 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:08.445 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:08.445 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.446 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162620 2024-09-13T05:13:08.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.446 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:08.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:08.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:13:08.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:08.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:13:08.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:08.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:13:08.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:08.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:08.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534509+0000", 2024-09-13T05:13:08.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1270000000000001e-06 2024-09-13T05:13:08.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:08.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534514+0000", 2024-09-13T05:13:08.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8720000000000001e-06 2024-09-13T05:13:08.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534518+0000", 2024-09-13T05:13:08.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5090000000000004e-06 2024-09-13T05:13:08.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536485+0000", 2024-09-13T05:13:08.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019671530000000001 2024-09-13T05:13:08.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:08.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536491+0000", 2024-09-13T05:13:08.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3759999999999999e-06 2024-09-13T05:13:08.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658466+0000", 2024-09-13T05:13:08.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121975466 2024-09-13T05:13:08.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:08.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658522+0000", 2024-09-13T05:13:08.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5668999999999998e-05 2024-09-13T05:13:08.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:08.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658595+0000", 2024-09-13T05:13:08.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2800999999999996e-05 2024-09-13T05:13:08.450 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.450 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:08.450 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.450 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162622 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 72704~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:08.450 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:13:08.450 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.852397834000001, 2024-09-13T05:13:08.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124215569, 2024-09-13T05:13:08.450 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:08.450 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:08.451 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:08.451 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:08.451 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.451 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162622 2024-09-13T05:13:08.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.451 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:08.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:08.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:13:08.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:08.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:13:08.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:08.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534537+0000", 2024-09-13T05:13:08.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:08.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:08.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534540+0000", 2024-09-13T05:13:08.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3740000000000001e-06 2024-09-13T05:13:08.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:08.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534545+0000", 2024-09-13T05:13:08.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4210000000000003e-06 2024-09-13T05:13:08.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534550+0000", 2024-09-13T05:13:08.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3090000000000003e-06 2024-09-13T05:13:08.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536510+0000", 2024-09-13T05:13:08.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019597130000000001 2024-09-13T05:13:08.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:08.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536517+0000", 2024-09-13T05:13:08.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0620000000000003e-06 2024-09-13T05:13:08.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658632+0000", 2024-09-13T05:13:08.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122114373 2024-09-13T05:13:08.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:08.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658686+0000", 2024-09-13T05:13:08.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3882999999999999e-05 2024-09-13T05:13:08.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:08.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658753+0000", 2024-09-13T05:13:08.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7921000000000002e-05 2024-09-13T05:13:08.455 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.456 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:08.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.456 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162623 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 73728~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:08.456 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:13:08.456 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.852381029, 2024-09-13T05:13:08.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124350214, 2024-09-13T05:13:08.456 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:08.456 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:08.456 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:08.456 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:08.456 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.456 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162623 2024-09-13T05:13:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:13:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:13:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534554+0000", 2024-09-13T05:13:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534556+0000", 2024-09-13T05:13:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-13T05:13:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534563+0000", 2024-09-13T05:13:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2890000000000003e-06 2024-09-13T05:13:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534567+0000", 2024-09-13T05:13:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4880000000000001e-06 2024-09-13T05:13:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536538+0000", 2024-09-13T05:13:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019703989999999998 2024-09-13T05:13:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536543+0000", 2024-09-13T05:13:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3920000000000002e-06 2024-09-13T05:13:08.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658773+0000", 2024-09-13T05:13:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122229607 2024-09-13T05:13:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658835+0000", 2024-09-13T05:13:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1954999999999999e-05 2024-09-13T05:13:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:08.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658905+0000", 2024-09-13T05:13:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-09-13T05:13:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162626 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 65536~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:13:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.852329744999999, 2024-09-13T05:13:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124425881, 2024-09-13T05:13:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:08.461 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162626 2024-09-13T05:13:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:13:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:13:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:13:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534611+0000", 2024-09-13T05:13:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5419999999999996e-06 2024-09-13T05:13:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534617+0000", 2024-09-13T05:13:08.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5169999999999999e-06 2024-09-13T05:13:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534622+0000", 2024-09-13T05:13:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9810000000000003e-06 2024-09-13T05:13:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536563+0000", 2024-09-13T05:13:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019410549999999999 2024-09-13T05:13:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536568+0000", 2024-09-13T05:13:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4310000000000002e-06 2024-09-13T05:13:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658922+0000", 2024-09-13T05:13:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122354221 2024-09-13T05:13:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658968+0000", 2024-09-13T05:13:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5221e-05 2024-09-13T05:13:08.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659032+0000", 2024-09-13T05:13:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4256000000000003e-05 2024-09-13T05:13:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162628 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 66560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:13:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.852294794000002, 2024-09-13T05:13:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124532254, 2024-09-13T05:13:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:08.466 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162628 2024-09-13T05:13:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:13:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:13:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:13:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534643+0000", 2024-09-13T05:13:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1890000000000001e-06 2024-09-13T05:13:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534648+0000", 2024-09-13T05:13:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:13:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534652+0000", 2024-09-13T05:13:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4549999999999997e-06 2024-09-13T05:13:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536586+0000", 2024-09-13T05:13:08.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019336049999999999 2024-09-13T05:13:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536591+0000", 2024-09-13T05:13:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3770000000000004e-06 2024-09-13T05:13:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659062+0000", 2024-09-13T05:13:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122470685 2024-09-13T05:13:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:08.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659106+0000", 2024-09-13T05:13:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3856000000000002e-05 2024-09-13T05:13:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659173+0000", 2024-09-13T05:13:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7168000000000005e-05 2024-09-13T05:13:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162630 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 67584~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:13:08.471 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.852261587999998, 2024-09-13T05:13:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12468555100000001, 2024-09-13T05:13:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162630 2024-09-13T05:13:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:13:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:13:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:13:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534676+0000", 2024-09-13T05:13:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4399999999999999e-06 2024-09-13T05:13:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534681+0000", 2024-09-13T05:13:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2349999999999999e-06 2024-09-13T05:13:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534686+0000", 2024-09-13T05:13:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5499999999999996e-06 2024-09-13T05:13:08.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536609+0000", 2024-09-13T05:13:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001923407 2024-09-13T05:13:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536615+0000", 2024-09-13T05:13:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1499999999999998e-06 2024-09-13T05:13:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659233+0000", 2024-09-13T05:13:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122618957 2024-09-13T05:13:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659294+0000", 2024-09-13T05:13:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0251000000000003e-05 2024-09-13T05:13:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659360+0000", 2024-09-13T05:13:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5906000000000002e-05 2024-09-13T05:13:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:08.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162633 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 69632~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:13:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.852153682999997, 2024-09-13T05:13:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124702147, 2024-09-13T05:13:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162633 2024-09-13T05:13:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:08.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:08.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:13:08.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:08.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:13:08.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:08.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:13:08.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:08.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:08.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534784+0000", 2024-09-13T05:13:08.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3300000000000001e-06 2024-09-13T05:13:08.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:08.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534789+0000", 2024-09-13T05:13:08.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4149999999999998e-06 2024-09-13T05:13:08.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534794+0000", 2024-09-13T05:13:08.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5669999999999996e-06 2024-09-13T05:13:08.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536634+0000", 2024-09-13T05:13:08.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001840401 2024-09-13T05:13:08.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:08.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536642+0000", 2024-09-13T05:13:08.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9729999999999997e-06 2024-09-13T05:13:08.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659383+0000", 2024-09-13T05:13:08.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12274112099999999 2024-09-13T05:13:08.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:08.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659424+0000", 2024-09-13T05:13:08.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0936000000000002e-05 2024-09-13T05:13:08.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:08.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659484+0000", 2024-09-13T05:13:08.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9775000000000003e-05 2024-09-13T05:13:08.481 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.482 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:08.482 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.482 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162675 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 68608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:08.482 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:13:08.482 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.852104638999997, 2024-09-13T05:13:08.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124823974, 2024-09-13T05:13:08.482 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:08.482 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:08.482 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:08.482 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:08.482 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.483 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162675 2024-09-13T05:13:08.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.483 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:08.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:08.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:13:08.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:08.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:13:08.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:08.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:13:08.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:08.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:08.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534833+0000", 2024-09-13T05:13:08.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.204e-06 2024-09-13T05:13:08.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:08.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534838+0000", 2024-09-13T05:13:08.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0130000000000001e-06 2024-09-13T05:13:08.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534842+0000", 2024-09-13T05:13:08.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.51e-06 2024-09-13T05:13:08.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536661+0000", 2024-09-13T05:13:08.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018186039999999999 2024-09-13T05:13:08.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:08.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536667+0000", 2024-09-13T05:13:08.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5260000000000001e-06 2024-09-13T05:13:08.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659531+0000", 2024-09-13T05:13:08.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122864403 2024-09-13T05:13:08.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:08.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659583+0000", 2024-09-13T05:13:08.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1564000000000003e-05 2024-09-13T05:13:08.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:08.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659655+0000", 2024-09-13T05:13:08.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2504999999999998e-05 2024-09-13T05:13:08.487 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.487 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:08.487 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.487 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:163257 3.8 3:1136e8de:::rbd_data.112dbd21872d.000000000000003c:28 [read 200704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:08.487 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:13:08.487 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.837089433000003, 2024-09-13T05:13:08.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12163807, 2024-09-13T05:13:08.487 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:08.487 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:08.487 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:08.487 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:08.488 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.488 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 163257 2024-09-13T05:13:08.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.488 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:08.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:08.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:13:08.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:08.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:13:08.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:08.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549846+0000", 2024-09-13T05:13:08.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:08.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:08.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549848+0000", 2024-09-13T05:13:08.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1789999999999998e-06 2024-09-13T05:13:08.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:08.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549854+0000", 2024-09-13T05:13:08.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9050000000000002e-06 2024-09-13T05:13:08.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.549858+0000", 2024-09-13T05:13:08.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3529999999999997e-06 2024-09-13T05:13:08.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.551228+0000", 2024-09-13T05:13:08.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001369227 2024-09-13T05:13:08.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:08.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.551233+0000", 2024-09-13T05:13:08.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5860000000000004e-06 2024-09-13T05:13:08.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671337+0000", 2024-09-13T05:13:08.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.120104265 2024-09-13T05:13:08.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:08.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671425+0000", 2024-09-13T05:13:08.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7810000000000001e-05 2024-09-13T05:13:08.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:08.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.671484+0000", 2024-09-13T05:13:08.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9079000000000001e-05 2024-09-13T05:13:08.492 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.492 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:08.492 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.492 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:170203 3.1e 3:7c9b1cf4:::rbd_header.112dc3abcba6:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128)", 2024-09-13T05:13:08.492 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:13:08.492 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.572125667999998, 2024-09-13T05:13:08.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.79948714899999995, 2024-09-13T05:13:08.493 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:08.493 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:08.493 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:08.493 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:08.493 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.493 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 170203 2024-09-13T05:13:08.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.493 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:08.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:08.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:13:08.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:08.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:13:08.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:08.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:08.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814808+0000", 2024-09-13T05:13:08.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:08.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:08.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814820+0000", 2024-09-13T05:13:08.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.206e-05 2024-09-13T05:13:08.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:08.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814841+0000", 2024-09-13T05:13:08.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1464999999999999e-05 2024-09-13T05:13:08.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814853+0000", 2024-09-13T05:13:08.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1824999999999999e-05 2024-09-13T05:13:08.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814911+0000", 2024-09-13T05:13:08.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8255999999999999e-05 2024-09-13T05:13:08.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:08.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814918+0000", 2024-09-13T05:13:08.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7120000000000003e-06 2024-09-13T05:13:08.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:08.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.611660+0000", 2024-09-13T05:13:08.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.79674180100000003 2024-09-13T05:13:08.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:08.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.611911+0000", 2024-09-13T05:13:08.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025108900000000002 2024-09-13T05:13:08.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-13T05:13:08.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.612726+0000", 2024-09-13T05:13:08.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00081512999999999996 2024-09-13T05:13:08.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:08.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614087+0000", 2024-09-13T05:13:08.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013607560000000001 2024-09-13T05:13:08.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:13:08.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614095+0000", 2024-09-13T05:13:08.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3240000000000003e-06 2024-09-13T05:13:08.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:13:08.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614138+0000", 2024-09-13T05:13:08.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3115000000000003e-05 2024-09-13T05:13:08.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:08.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:08.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:08.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614297+0000", 2024-09-13T05:13:08.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015875399999999999 2024-09-13T05:13:08.498 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.499 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:08.499 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.499 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:08.499 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:08.499 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:08.500 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:13:08.501 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:08.494+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:08.601 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:08.595+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:08.619 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:08.619 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:08.620 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:13:08.620 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:08.629 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:13:08.702 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:08.698+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:08.733 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:08.734 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:08.734 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:13:08.734 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:13:08.734 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:08.743 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:13:08.808 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T05:13:08.810 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:08.806+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:08.866 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:08.866 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:13:08.866 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:13:08.866 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:13:08.866 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.867 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7312 3.13 e159/153 3:ce615828:::rbd_data.112dbd21872d.000000000000000f:28 v 159'1216, mlcod=158'1213)", 2024-09-13T05:13:08.867 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.645274+0000", 2024-09-13T05:13:08.867 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 15.217527500999999, 2024-09-13T05:13:08.867 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0050366250000000003, 2024-09-13T05:13:08.867 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:08.867 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:08.867 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:08.867 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.867 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:08.867 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.645274+0000", 2024-09-13T05:13:08.867 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.867 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.867 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.868 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:08.868 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.645274+0000", 2024-09-13T05:13:08.868 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.868 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.868 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.868 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:08.868 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.645274+0000", 2024-09-13T05:13:08.868 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:08.868 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.868 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.868 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:08.869 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.645280+0000", 2024-09-13T05:13:08.869 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9000000000000003e-06 2024-09-13T05:13:08.869 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.869 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.869 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:08.869 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.645286+0000", 2024-09-13T05:13:08.869 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3149999999999997e-06 2024-09-13T05:13:08.869 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.869 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.869 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.869 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.645291+0000", 2024-09-13T05:13:08.869 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.04e-06 2024-09-13T05:13:08.869 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.870 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.870 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:08.870 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.645370+0000", 2024-09-13T05:13:08.870 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8996000000000001e-05 2024-09-13T05:13:08.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.870 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.870 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:08.870 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.645392+0000", 2024-09-13T05:13:08.870 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2362999999999999e-05 2024-09-13T05:13:08.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.871 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.871 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:08.871 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.650153+0000", 2024-09-13T05:13:08.871 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0047611040000000004 2024-09-13T05:13:08.871 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.871 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.871 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:08.872 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.650311+0000", 2024-09-13T05:13:08.872 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000157362 2024-09-13T05:13:08.872 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.872 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:08.872 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.872 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.872 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.872 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7315 3.13 e159/153 3:cd8e2485:::rbd_data.112dbd21872d.0000000000000251:28 v 159'1218, mlcod=158'1213)", 2024-09-13T05:13:08.872 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.647328+0000", 2024-09-13T05:13:08.872 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 15.215473515999999, 2024-09-13T05:13:08.872 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0051515930000000003, 2024-09-13T05:13:08.872 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:08.872 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:08.873 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:08.873 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.873 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:08.873 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.647328+0000", 2024-09-13T05:13:08.873 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.873 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.873 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.873 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:08.873 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.647328+0000", 2024-09-13T05:13:08.873 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.873 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.873 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.873 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:08.874 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.647327+0000", 2024-09-13T05:13:08.874 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:08.874 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.874 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.874 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:08.874 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.647336+0000", 2024-09-13T05:13:08.874 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8319999999999995e-06 2024-09-13T05:13:08.874 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.874 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.874 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:08.874 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.647351+0000", 2024-09-13T05:13:08.874 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5226e-05 2024-09-13T05:13:08.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.875 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.875 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.875 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.647360+0000", 2024-09-13T05:13:08.875 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2029999999999992e-06 2024-09-13T05:13:08.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.875 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.875 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:08.875 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.647538+0000", 2024-09-13T05:13:08.876 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017795500000000001 2024-09-13T05:13:08.876 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.876 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.876 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:08.876 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.647569+0000", 2024-09-13T05:13:08.877 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1636e-05 2024-09-13T05:13:08.877 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.877 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.877 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:08.877 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.652446+0000", 2024-09-13T05:13:08.877 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0048766629999999998 2024-09-13T05:13:08.877 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.877 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.878 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:08.878 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.652480+0000", 2024-09-13T05:13:08.878 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3927000000000002e-05 2024-09-13T05:13:08.878 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.878 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:08.878 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.878 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.878 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203004 3.1a 3:5a99807b:::rbd_object_map.112dbd21872d:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159)", 2024-09-13T05:13:08.878 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.649669+0000", 2024-09-13T05:13:08.878 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 15.213132236, 2024-09-13T05:13:08.878 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0064520619999999997, 2024-09-13T05:13:08.878 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:08.879 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:08.879 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:08.879 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:08.879 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.879 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203004 2024-09-13T05:13:08.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.879 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:08.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:08.879 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649669+0000", 2024-09-13T05:13:08.879 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:08.879 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649669+0000", 2024-09-13T05:13:08.880 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.880 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.880 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.880 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:08.880 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649668+0000", 2024-09-13T05:13:08.880 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:08.880 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.880 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.880 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:08.880 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649676+0000", 2024-09-13T05:13:08.880 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0020000000000006e-06 2024-09-13T05:13:08.880 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.880 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.881 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:08.881 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649686+0000", 2024-09-13T05:13:08.881 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0702e-05 2024-09-13T05:13:08.881 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.881 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.881 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.881 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649694+0000", 2024-09-13T05:13:08.881 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9370000000000004e-06 2024-09-13T05:13:08.881 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.881 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.881 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:08.881 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.650848+0000", 2024-09-13T05:13:08.882 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0011532020000000001 2024-09-13T05:13:08.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.882 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:08.882 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.650973+0000", 2024-09-13T05:13:08.882 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012510099999999999 2024-09-13T05:13:08.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.882 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:08.882 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.651197+0000", 2024-09-13T05:13:08.882 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00022407899999999999 2024-09-13T05:13:08.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.883 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:08.883 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.653302+0000", 2024-09-13T05:13:08.883 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021053629999999999 2024-09-13T05:13:08.883 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.883 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.883 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:08.883 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655437+0000", 2024-09-13T05:13:08.883 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002135348 2024-09-13T05:13:08.883 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.883 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.883 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:08.884 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655500+0000", 2024-09-13T05:13:08.884 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2453999999999995e-05 2024-09-13T05:13:08.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.884 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.884 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:08.884 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656122+0000", 2024-09-13T05:13:08.884 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00062160299999999998 2024-09-13T05:13:08.884 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.884 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:08.884 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.884 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.884 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.3.0:5114 3.b e159/149 3:d13d0bb6:::rbd_data.112dbd21872d.000000000000000c:28 v 159'614, mlcod=158'611)", 2024-09-13T05:13:08.885 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.655063+0000", 2024-09-13T05:13:08.885 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 15.207739163999999, 2024-09-13T05:13:08.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0057558009999999996, 2024-09-13T05:13:08.885 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:08.885 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:08.885 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:08.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:08.885 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655063+0000", 2024-09-13T05:13:08.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.885 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:08.885 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655063+0000", 2024-09-13T05:13:08.886 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.886 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.886 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.886 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:08.886 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655062+0000", 2024-09-13T05:13:08.886 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:08.886 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.886 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.886 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:08.886 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655070+0000", 2024-09-13T05:13:08.886 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5059999999999995e-06 2024-09-13T05:13:08.886 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.886 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.886 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:08.887 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655092+0000", 2024-09-13T05:13:08.887 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2310000000000002e-05 2024-09-13T05:13:08.887 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.887 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.887 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.887 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655105+0000", 2024-09-13T05:13:08.887 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2432999999999999e-05 2024-09-13T05:13:08.887 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.887 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.887 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:08.887 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655154+0000", 2024-09-13T05:13:08.887 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8673e-05 2024-09-13T05:13:08.887 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.887 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.888 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:08.888 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655171+0000", 2024-09-13T05:13:08.888 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7487999999999999e-05 2024-09-13T05:13:08.888 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.888 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.888 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:08.888 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.660765+0000", 2024-09-13T05:13:08.888 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0055935209999999997 2024-09-13T05:13:08.888 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.888 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.888 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:08.888 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.660818+0000", 2024-09-13T05:13:08.888 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3769e-05 2024-09-13T05:13:08.889 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.889 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:08.889 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.889 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.889 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.889 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7318 3.13 e159/153 3:cf0a521c:::rbd_data.112dbd21872d.0000000000000004:28 v 159'1220, mlcod=159'1216)", 2024-09-13T05:13:08.889 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.655897+0000", 2024-09-13T05:13:08.889 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 15.206904442000001, 2024-09-13T05:13:08.889 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0075974520000000002, 2024-09-13T05:13:08.889 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:08.889 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:08.889 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:08.889 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.889 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:08.890 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655897+0000", 2024-09-13T05:13:08.890 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.890 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.890 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.890 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:08.890 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655897+0000", 2024-09-13T05:13:08.890 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.890 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.890 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.890 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:08.890 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655897+0000", 2024-09-13T05:13:08.890 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:08.890 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.890 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.891 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:08.891 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655906+0000", 2024-09-13T05:13:08.891 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6290000000000005e-06 2024-09-13T05:13:08.891 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.891 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.891 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:08.891 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655916+0000", 2024-09-13T05:13:08.891 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0079e-05 2024-09-13T05:13:08.891 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.891 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.891 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.892 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655923+0000", 2024-09-13T05:13:08.892 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1319999999999996e-06 2024-09-13T05:13:08.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.892 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:08.892 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656023+0000", 2024-09-13T05:13:08.892 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9747000000000006e-05 2024-09-13T05:13:08.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.892 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:08.892 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656042+0000", 2024-09-13T05:13:08.892 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8491999999999998e-05 2024-09-13T05:13:08.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.893 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.893 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:08.893 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.663412+0000", 2024-09-13T05:13:08.893 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0073701959999999999 2024-09-13T05:13:08.893 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.893 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.893 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:08.893 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.663495+0000", 2024-09-13T05:13:08.893 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2923000000000005e-05 2024-09-13T05:13:08.894 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.894 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:08.894 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.894 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.894 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.3.0:5116 3.b e159/149 3:d32d7958:::rbd_data.112dbd21872d.0000000000000001:28 v 159'616, mlcod=158'611)", 2024-09-13T05:13:08.894 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.655899+0000", 2024-09-13T05:13:08.894 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 15.206902759, 2024-09-13T05:13:08.894 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0075096859999999998, 2024-09-13T05:13:08.894 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:08.894 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:08.894 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:08.894 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.895 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:08.895 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655899+0000", 2024-09-13T05:13:08.895 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.895 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:08.895 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655899+0000", 2024-09-13T05:13:08.895 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.895 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:08.895 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655898+0000", 2024-09-13T05:13:08.896 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:08.896 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.896 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.896 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:08.896 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655907+0000", 2024-09-13T05:13:08.896 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5939999999999994e-06 2024-09-13T05:13:08.896 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.896 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.896 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:08.896 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655916+0000", 2024-09-13T05:13:08.897 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9840000000000007e-06 2024-09-13T05:13:08.897 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.897 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.897 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.897 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655923+0000", 2024-09-13T05:13:08.897 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1350000000000003e-06 2024-09-13T05:13:08.897 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.897 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.897 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:08.897 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656059+0000", 2024-09-13T05:13:08.897 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013669999999999999 2024-09-13T05:13:08.897 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.897 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.898 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:08.898 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656079+0000", 2024-09-13T05:13:08.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9293e-05 2024-09-13T05:13:08.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.899 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:08.899 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.663368+0000", 2024-09-13T05:13:08.899 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0072892570000000004 2024-09-13T05:13:08.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.899 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.899 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:08.899 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.663409+0000", 2024-09-13T05:13:08.899 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0614000000000001e-05 2024-09-13T05:13:08.899 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.899 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:08.899 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.899 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.900 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.3.0:5119 3.b e159/149 3:d7928ff2:::rbd_data.112dbd21872d.000000000000003d:28 v 159'618, mlcod=159'614)", 2024-09-13T05:13:08.900 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.664054+0000", 2024-09-13T05:13:08.900 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 15.198748158000001, 2024-09-13T05:13:08.900 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0051301250000000001, 2024-09-13T05:13:08.900 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:08.900 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:08.900 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:08.900 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.900 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:08.900 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.664054+0000", 2024-09-13T05:13:08.900 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.900 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:08.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.664054+0000", 2024-09-13T05:13:08.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:08.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.664053+0000", 2024-09-13T05:13:08.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:08.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:08.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.664062+0000", 2024-09-13T05:13:08.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8629999999999997e-06 2024-09-13T05:13:08.902 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:08.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.664075+0000", 2024-09-13T05:13:08.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3327e-05 2024-09-13T05:13:08.902 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.664081+0000", 2024-09-13T05:13:08.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9529999999999996e-06 2024-09-13T05:13:08.902 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:08.903 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.664121+0000", 2024-09-13T05:13:08.903 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9876999999999998e-05 2024-09-13T05:13:08.903 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.903 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.903 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:08.903 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.664141+0000", 2024-09-13T05:13:08.903 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0428000000000002e-05 2024-09-13T05:13:08.903 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.903 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.903 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:08.903 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.669132+0000", 2024-09-13T05:13:08.903 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0049911249999999999 2024-09-13T05:13:08.903 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.904 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.904 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:08.904 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.669184+0000", 2024-09-13T05:13:08.904 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1400000000000003e-05 2024-09-13T05:13:08.904 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.904 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:08.904 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.904 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.904 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.904 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7323 3.e e159/151 3:742bfecb:::rbd_data.112dbd21872d.0000000000000018:28 v 159'1051, mlcod=157'1046)", 2024-09-13T05:13:08.904 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.668166+0000", 2024-09-13T05:13:08.904 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 15.194635565, 2024-09-13T05:13:08.904 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0065306610000000001, 2024-09-13T05:13:08.904 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:08.905 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:08.905 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:08.905 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.905 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:08.905 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668166+0000", 2024-09-13T05:13:08.905 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.905 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.905 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.905 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:08.905 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668166+0000", 2024-09-13T05:13:08.905 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.905 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.905 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.905 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:08.906 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668165+0000", 2024-09-13T05:13:08.906 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:08.906 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.906 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.906 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:08.906 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668174+0000", 2024-09-13T05:13:08.906 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.3790000000000006e-06 2024-09-13T05:13:08.906 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.906 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.906 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:08.906 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668187+0000", 2024-09-13T05:13:08.906 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3172e-05 2024-09-13T05:13:08.906 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.906 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.907 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.907 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668208+0000", 2024-09-13T05:13:08.907 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0713999999999999e-05 2024-09-13T05:13:08.907 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.907 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.907 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:08.907 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668272+0000", 2024-09-13T05:13:08.907 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4453000000000001e-05 2024-09-13T05:13:08.907 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.907 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.907 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:08.907 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668289+0000", 2024-09-13T05:13:08.907 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7331000000000001e-05 2024-09-13T05:13:08.907 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.908 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.908 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:08.908 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.674630+0000", 2024-09-13T05:13:08.908 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0063409340000000003 2024-09-13T05:13:08.908 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.908 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.908 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:08.908 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.674697+0000", 2024-09-13T05:13:08.908 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6472999999999999e-05 2024-09-13T05:13:08.908 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.908 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:08.908 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.908 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.909 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.909 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7324 3.f e159/150 3:f534c371:::rbd_data.112dbd21872d.0000000000000017:28 v 159'871, mlcod=158'868)", 2024-09-13T05:13:08.909 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.672502+0000", 2024-09-13T05:13:08.909 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 15.190299411, 2024-09-13T05:13:08.909 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.004881753, 2024-09-13T05:13:08.909 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:08.909 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:08.909 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:08.909 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.909 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:08.909 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672502+0000", 2024-09-13T05:13:08.909 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.909 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.910 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.910 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:08.910 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672502+0000", 2024-09-13T05:13:08.910 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.910 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.910 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.910 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:08.910 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672501+0000", 2024-09-13T05:13:08.910 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:08.910 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.910 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.910 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:08.910 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672509+0000", 2024-09-13T05:13:08.910 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8970000000000008e-06 2024-09-13T05:13:08.910 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.911 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:08.911 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672524+0000", 2024-09-13T05:13:08.911 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4558e-05 2024-09-13T05:13:08.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.911 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.911 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672533+0000", 2024-09-13T05:13:08.911 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3000000000000007e-06 2024-09-13T05:13:08.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.912 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:08.912 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672595+0000", 2024-09-13T05:13:08.912 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1750999999999999e-05 2024-09-13T05:13:08.912 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.912 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.912 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:08.912 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672619+0000", 2024-09-13T05:13:08.912 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.472e-05 2024-09-13T05:13:08.912 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.912 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.913 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:08.913 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.677335+0000", 2024-09-13T05:13:08.913 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0047155720000000003 2024-09-13T05:13:08.913 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.913 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.913 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:08.913 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.677384+0000", 2024-09-13T05:13:08.913 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9013e-05 2024-09-13T05:13:08.913 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.913 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:08.913 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.913 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.913 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.913 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203156 3.9 3:9079854c:::rbd_header.112d52e08ead:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e160)", 2024-09-13T05:13:08.914 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:54.685914+0000", 2024-09-13T05:13:08.914 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.176887638, 2024-09-13T05:13:08.914 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0085711250000000006, 2024-09-13T05:13:08.914 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:08.914 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:08.914 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:08.914 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:08.914 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.914 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203156 2024-09-13T05:13:08.914 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.914 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:08.914 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.914 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:08.915 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685914+0000", 2024-09-13T05:13:08.915 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.915 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.915 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.915 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:08.915 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685914+0000", 2024-09-13T05:13:08.915 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.915 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.915 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.915 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:08.915 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685912+0000", 2024-09-13T05:13:08.915 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:08.915 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.915 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.916 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:08.916 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685924+0000", 2024-09-13T05:13:08.916 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1537e-05 2024-09-13T05:13:08.916 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.916 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.916 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:08.916 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685950+0000", 2024-09-13T05:13:08.916 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6781e-05 2024-09-13T05:13:08.916 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.916 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.916 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.916 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685962+0000", 2024-09-13T05:13:08.916 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1953999999999999e-05 2024-09-13T05:13:08.916 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.917 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.917 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:08.917 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.686102+0000", 2024-09-13T05:13:08.917 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013926300000000001 2024-09-13T05:13:08.917 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.917 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.917 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op must wait for map", 2024-09-13T05:13:08.917 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.686115+0000", 2024-09-13T05:13:08.917 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3506000000000001e-05 2024-09-13T05:13:08.917 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.917 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.917 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:08.917 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.689954+0000", 2024-09-13T05:13:08.917 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0038391810000000001 2024-09-13T05:13:08.918 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.918 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.918 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:08.918 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.690104+0000", 2024-09-13T05:13:08.918 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014980500000000001 2024-09-13T05:13:08.918 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.918 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.918 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 2", 2024-09-13T05:13:08.918 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.690674+0000", 2024-09-13T05:13:08.918 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00057014200000000004 2024-09-13T05:13:08.918 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.918 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.918 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:08.918 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.692426+0000", 2024-09-13T05:13:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0017518810000000001 2024-09-13T05:13:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.694360+0000", 2024-09-13T05:13:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0019340819999999999 2024-09-13T05:13:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.694443+0000", 2024-09-13T05:13:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2693000000000003e-05 2024-09-13T05:13:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.919 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:08.920 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.694485+0000", 2024-09-13T05:13:08.920 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2355999999999999e-05 2024-09-13T05:13:08.920 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.920 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:08.920 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.920 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.920 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.920 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203594 3.1 3:82a5a606:::rbd_object_map.112d841a7de:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163)", 2024-09-13T05:13:08.920 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:57.719919+0000", 2024-09-13T05:13:08.920 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 11.14288238, 2024-09-13T05:13:08.920 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0058258199999999998, 2024-09-13T05:13:08.920 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:08.920 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:08.920 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:08.921 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:08.921 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.921 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203594 2024-09-13T05:13:08.921 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.921 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:08.921 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.921 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:08.921 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.719919+0000", 2024-09-13T05:13:08.921 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.921 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.921 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.921 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:08.921 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.719919+0000", 2024-09-13T05:13:08.921 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.922 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.922 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.922 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:08.922 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.719916+0000", 2024-09-13T05:13:08.922 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999967 2024-09-13T05:13:08.922 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.922 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.922 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:08.922 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.719935+0000", 2024-09-13T05:13:08.922 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8637000000000001e-05 2024-09-13T05:13:08.922 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.922 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.922 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:08.923 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.719965+0000", 2024-09-13T05:13:08.923 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0457e-05 2024-09-13T05:13:08.923 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.923 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.923 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.923 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.719981+0000", 2024-09-13T05:13:08.923 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6359e-05 2024-09-13T05:13:08.923 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.923 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.923 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:08.923 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.720066+0000", 2024-09-13T05:13:08.923 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4710999999999996e-05 2024-09-13T05:13:08.924 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.924 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.924 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op must wait for map", 2024-09-13T05:13:08.924 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.720072+0000", 2024-09-13T05:13:08.924 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5300000000000004e-06 2024-09-13T05:13:08.924 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.924 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.924 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:08.924 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.723400+0000", 2024-09-13T05:13:08.924 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033279809999999998 2024-09-13T05:13:08.924 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.924 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.924 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:08.924 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.723530+0000", 2024-09-13T05:13:08.925 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013047300000000001 2024-09-13T05:13:08.925 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.925 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.925 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 3", 2024-09-13T05:13:08.925 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.723708+0000", 2024-09-13T05:13:08.925 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017767400000000001 2024-09-13T05:13:08.925 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.925 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.925 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:08.925 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.725594+0000", 2024-09-13T05:13:08.925 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0018860960000000001 2024-09-13T05:13:08.925 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.925 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.926 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:08.926 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.725617+0000", 2024-09-13T05:13:08.926 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3210999999999999e-05 2024-09-13T05:13:08.926 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.926 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.926 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:08.926 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.725675+0000", 2024-09-13T05:13:08.926 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7899999999999998e-05 2024-09-13T05:13:08.926 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.926 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.926 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:08.926 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.725745+0000", 2024-09-13T05:13:08.926 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0097000000000003e-05 2024-09-13T05:13:08.926 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.927 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:08.927 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.927 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.927 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.927 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203849 3.3 3:c190344a:::rbd_data.112d1f830c0e.0000000000000000:head [delete] snapc 23=[] ondisk+write+known_if_redirected+supports_pool_eio e164)", 2024-09-13T05:13:08.927 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:58.853242+0000", 2024-09-13T05:13:08.927 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 10.009559230000001, 2024-09-13T05:13:08.927 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0070665509999999999, 2024-09-13T05:13:08.927 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:08.927 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:08.927 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:08.927 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:08.927 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.927 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203849 2024-09-13T05:13:08.927 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.928 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:08.928 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.928 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:08.928 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853242+0000", 2024-09-13T05:13:08.928 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.928 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.928 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.928 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:08.928 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853242+0000", 2024-09-13T05:13:08.928 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.928 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.928 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.928 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:08.929 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853240+0000", 2024-09-13T05:13:08.929 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:13:08.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.929 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.929 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:08.929 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853253+0000", 2024-09-13T05:13:08.929 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2330000000000001e-05 2024-09-13T05:13:08.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.929 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.929 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:08.929 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853286+0000", 2024-09-13T05:13:08.929 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3798999999999999e-05 2024-09-13T05:13:08.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.929 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.930 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.930 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853321+0000", 2024-09-13T05:13:08.930 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4749999999999998e-05 2024-09-13T05:13:08.930 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.930 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.930 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:08.930 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853568+0000", 2024-09-13T05:13:08.930 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024706400000000002 2024-09-13T05:13:08.930 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.930 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.930 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:08.930 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853935+0000", 2024-09-13T05:13:08.930 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00036690600000000001 2024-09-13T05:13:08.930 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.931 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.931 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:08.931 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854221+0000", 2024-09-13T05:13:08.931 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00028613100000000002 2024-09-13T05:13:08.931 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.931 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.931 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:08.931 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.859106+0000", 2024-09-13T05:13:08.931 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0048842629999999998 2024-09-13T05:13:08.931 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.931 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.931 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:08.931 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860185+0000", 2024-09-13T05:13:08.931 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0010796740000000001 2024-09-13T05:13:08.932 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.932 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.932 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:08.932 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860252+0000", 2024-09-13T05:13:08.932 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6928999999999996e-05 2024-09-13T05:13:08.932 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.932 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.932 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:08.932 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860309+0000", 2024-09-13T05:13:08.932 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6898999999999999e-05 2024-09-13T05:13:08.932 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.932 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:08.932 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.932 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.933 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.933 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203852 3.1a 3:5af372d9:::rbd_data.112d1f830c0e.0000000000000003:head [delete] snapc 23=[] ondisk+write+known_if_redirected+supports_pool_eio e164)", 2024-09-13T05:13:08.933 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:58.853358+0000", 2024-09-13T05:13:08.933 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 10.009443873, 2024-09-13T05:13:08.933 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0069302069999999999, 2024-09-13T05:13:08.933 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:08.933 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:08.933 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:08.933 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:08.933 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.933 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203852 2024-09-13T05:13:08.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.933 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:08.933 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.934 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:08.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853358+0000", 2024-09-13T05:13:08.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.934 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.934 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:08.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853358+0000", 2024-09-13T05:13:08.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.934 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.934 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:08.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853357+0000", 2024-09-13T05:13:08.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:08.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.935 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.935 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:08.935 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853363+0000", 2024-09-13T05:13:08.935 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6059999999999999e-06 2024-09-13T05:13:08.935 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.935 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.935 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:08.935 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853421+0000", 2024-09-13T05:13:08.935 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8075999999999998e-05 2024-09-13T05:13:08.935 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.935 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.935 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.935 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854643+0000", 2024-09-13T05:13:08.936 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001221904 2024-09-13T05:13:08.936 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.936 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.936 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:08.936 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854777+0000", 2024-09-13T05:13:08.936 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013323100000000001 2024-09-13T05:13:08.936 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.936 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.936 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:08.936 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.855094+0000", 2024-09-13T05:13:08.936 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00031790600000000002 2024-09-13T05:13:08.936 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.936 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.936 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:08.937 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.855378+0000", 2024-09-13T05:13:08.937 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00028385800000000001 2024-09-13T05:13:08.937 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.937 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.937 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:08.937 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.859936+0000", 2024-09-13T05:13:08.937 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0045574450000000002 2024-09-13T05:13:08.937 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.937 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.937 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:08.937 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860199+0000", 2024-09-13T05:13:08.937 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00026360899999999999 2024-09-13T05:13:08.938 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.938 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.938 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:08.938 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860250+0000", 2024-09-13T05:13:08.938 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0625999999999999e-05 2024-09-13T05:13:08.938 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.938 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.938 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:08.938 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860288+0000", 2024-09-13T05:13:08.938 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8028999999999998e-05 2024-09-13T05:13:08.938 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.938 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:08.938 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.938 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.939 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.939 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:203850 3.1c e164/148 3:3f23e81b:::rbd_data.112d1f830c0e.0000000000000001:head v 164'854, mlcod=163'852)", 2024-09-13T05:13:08.939 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:58.854434+0000", 2024-09-13T05:13:08.939 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 10.008367332000001, 2024-09-13T05:13:08.939 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0052183129999999996, 2024-09-13T05:13:08.939 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:08.939 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:08.939 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:08.939 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.939 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:08.939 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854434+0000", 2024-09-13T05:13:08.939 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.939 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.939 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.940 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:08.940 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854434+0000", 2024-09-13T05:13:08.940 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.940 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.940 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.940 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:08.940 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854433+0000", 2024-09-13T05:13:08.940 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:08.940 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.940 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.940 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:08.940 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854451+0000", 2024-09-13T05:13:08.940 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7960000000000001e-05 2024-09-13T05:13:08.941 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.941 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.941 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:08.941 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854497+0000", 2024-09-13T05:13:08.941 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6864999999999999e-05 2024-09-13T05:13:08.941 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.941 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.941 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.941 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854516+0000", 2024-09-13T05:13:08.941 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8462999999999999e-05 2024-09-13T05:13:08.941 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.941 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.941 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:08.941 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854815+0000", 2024-09-13T05:13:08.942 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00029886099999999998 2024-09-13T05:13:08.942 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.942 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.942 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:08.942 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854869+0000", 2024-09-13T05:13:08.942 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4035e-05 2024-09-13T05:13:08.942 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.942 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.942 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:08.942 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.859560+0000", 2024-09-13T05:13:08.942 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0046911440000000004 2024-09-13T05:13:08.942 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.942 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.942 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:08.943 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.859653+0000", 2024-09-13T05:13:08.943 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2814999999999998e-05 2024-09-13T05:13:08.943 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.943 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:08.943 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.943 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:204682 3.1 3:8468e10f:::rbd_data.112db56bb33d.0000000000000003:head [delete] snapc 1f=[] ondisk+write+known_if_redirected+supports_pool_eio e168)", 2024-09-13T05:13:08.943 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:02.885028+0000", 2024-09-13T05:13:08.943 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.9777739189999997, 2024-09-13T05:13:08.943 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0048702870000000001, 2024-09-13T05:13:08.943 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:08.943 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:08.943 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:08.944 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:08.944 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.944 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 204682 2024-09-13T05:13:08.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.944 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:08.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.944 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:08.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.885028+0000", 2024-09-13T05:13:08.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.944 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:08.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.885028+0000", 2024-09-13T05:13:08.945 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.945 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.945 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.945 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:08.945 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.885027+0000", 2024-09-13T05:13:08.945 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:08.945 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.945 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.945 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:08.945 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.885034+0000", 2024-09-13T05:13:08.945 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8129999999999998e-06 2024-09-13T05:13:08.945 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.945 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.945 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:08.946 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.885047+0000", 2024-09-13T05:13:08.946 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3066e-05 2024-09-13T05:13:08.946 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.946 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.946 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.946 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.885057+0000", 2024-09-13T05:13:08.946 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0074e-05 2024-09-13T05:13:08.946 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.946 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.946 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:08.946 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.885153+0000", 2024-09-13T05:13:08.946 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.658e-05 2024-09-13T05:13:08.946 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.946 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.947 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:08.947 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.885231+0000", 2024-09-13T05:13:08.947 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7933000000000001e-05 2024-09-13T05:13:08.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.947 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.947 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 3", 2024-09-13T05:13:08.947 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.885339+0000", 2024-09-13T05:13:08.947 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000108175 2024-09-13T05:13:08.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.947 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.947 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:08.947 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.887579+0000", 2024-09-13T05:13:08.947 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022399529999999998 2024-09-13T05:13:08.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.948 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:08.948 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.889781+0000", 2024-09-13T05:13:08.948 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022018179999999999 2024-09-13T05:13:08.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.948 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:08.948 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.889848+0000", 2024-09-13T05:13:08.948 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6662000000000007e-05 2024-09-13T05:13:08.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.948 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:08.948 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.889898+0000", 2024-09-13T05:13:08.949 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0288999999999999e-05 2024-09-13T05:13:08.949 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.949 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:08.949 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.949 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.949 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.949 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:205619 3.14 3:281c383b:::rbd_data.112d34bb0b84.0000000000000038:head [delete] snapc 1a=[] ondisk+write+known_if_redirected+supports_pool_eio e173)", 2024-09-13T05:13:08.949 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:07.906696+0000", 2024-09-13T05:13:08.949 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.95610527300000003, 2024-09-13T05:13:08.949 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.005250233, 2024-09-13T05:13:08.949 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:08.949 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:08.949 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:08.949 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:08.950 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.950 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 205619 2024-09-13T05:13:08.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.950 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:08.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.950 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:08.950 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906696+0000", 2024-09-13T05:13:08.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.950 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:08.950 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906696+0000", 2024-09-13T05:13:08.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.951 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:08.951 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906694+0000", 2024-09-13T05:13:08.951 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:13:08.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.951 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.951 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:08.951 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906705+0000", 2024-09-13T05:13:08.951 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0907000000000001e-05 2024-09-13T05:13:08.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.951 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.951 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:08.951 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906735+0000", 2024-09-13T05:13:08.951 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9382000000000001e-05 2024-09-13T05:13:08.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.952 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.952 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906752+0000", 2024-09-13T05:13:08.952 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7212000000000001e-05 2024-09-13T05:13:08.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.952 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:08.952 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906949+0000", 2024-09-13T05:13:08.952 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00019728200000000001 2024-09-13T05:13:08.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.953 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:08.953 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.907262+0000", 2024-09-13T05:13:08.953 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00031242299999999999 2024-09-13T05:13:08.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.953 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 7", 2024-09-13T05:13:08.953 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.907528+0000", 2024-09-13T05:13:08.953 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00026672399999999998 2024-09-13T05:13:08.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.953 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:08.953 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.910728+0000", 2024-09-13T05:13:08.953 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0032001260000000002 2024-09-13T05:13:08.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:08.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.911722+0000", 2024-09-13T05:13:08.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00099400599999999997 2024-09-13T05:13:08.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:08.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.911849+0000", 2024-09-13T05:13:08.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000126353 2024-09-13T05:13:08.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.955 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:08.955 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.911947+0000", 2024-09-13T05:13:08.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7965000000000001e-05 2024-09-13T05:13:08.955 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.955 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:08.955 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.955 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.955 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.955 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:205621 3.1b 3:da5cbb91:::rbd_data.112d34bb0b84.0000000000000132:head [delete] snapc 1a=[] ondisk+write+known_if_redirected+supports_pool_eio e173)", 2024-09-13T05:13:08.955 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:07.906781+0000", 2024-09-13T05:13:08.955 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.95602110699999998, 2024-09-13T05:13:08.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0051954330000000002, 2024-09-13T05:13:08.955 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:08.955 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:08.956 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:08.956 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:08.956 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:08.956 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 205621 2024-09-13T05:13:08.956 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.956 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:08.956 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.956 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:08.956 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906781+0000", 2024-09-13T05:13:08.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:08.957 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906781+0000", 2024-09-13T05:13:08.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:08.957 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906779+0000", 2024-09-13T05:13:08.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:08.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:08.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906786+0000", 2024-09-13T05:13:08.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9720000000000003e-06 2024-09-13T05:13:08.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:08.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906800+0000", 2024-09-13T05:13:08.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3268000000000001e-05 2024-09-13T05:13:08.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906809+0000", 2024-09-13T05:13:08.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7170000000000003e-06 2024-09-13T05:13:08.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.959 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:08.959 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.907013+0000", 2024-09-13T05:13:08.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000203616 2024-09-13T05:13:08.959 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.959 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:08.959 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.907261+0000", 2024-09-13T05:13:08.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024787700000000003 2024-09-13T05:13:08.959 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.959 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 7", 2024-09-13T05:13:08.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.907469+0000", 2024-09-13T05:13:08.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020855799999999999 2024-09-13T05:13:08.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:08.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.911287+0000", 2024-09-13T05:13:08.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003818007 2024-09-13T05:13:08.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:08.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.911794+0000", 2024-09-13T05:13:08.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00050637000000000002 2024-09-13T05:13:08.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:08.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.911891+0000", 2024-09-13T05:13:08.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6835000000000004e-05 2024-09-13T05:13:08.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:08.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.911976+0000", 2024-09-13T05:13:08.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5408000000000006e-05 2024-09-13T05:13:08.961 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.961 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:08.961 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.962 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7486 3.13 e174/153 3:cd8ae6b5:::rbd_data.112d667fb7f9.0000000000000061:19 v 174'1266, mlcod=174'1262)", 2024-09-13T05:13:08.962 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:08.810849+0000", 2024-09-13T05:13:08.962 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.051953092999999999, 2024-09-13T05:13:08.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0061914229999999997, 2024-09-13T05:13:08.962 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:08.962 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:08.962 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:08.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:08.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.810849+0000", 2024-09-13T05:13:08.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:08.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.810849+0000", 2024-09-13T05:13:08.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:08.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.810848+0000", 2024-09-13T05:13:08.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:08.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:08.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.810855+0000", 2024-09-13T05:13:08.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.153e-06 2024-09-13T05:13:08.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:08.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.810863+0000", 2024-09-13T05:13:08.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1300000000000001e-06 2024-09-13T05:13:08.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.810870+0000", 2024-09-13T05:13:08.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3940000000000001e-06 2024-09-13T05:13:08.965 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.965 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.965 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:08.965 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.810907+0000", 2024-09-13T05:13:08.965 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7410000000000003e-05 2024-09-13T05:13:08.965 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.965 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.965 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:08.965 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.810925+0000", 2024-09-13T05:13:08.966 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7838000000000001e-05 2024-09-13T05:13:08.966 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.966 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.966 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:08.966 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.817006+0000", 2024-09-13T05:13:08.966 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0060812280000000002 2024-09-13T05:13:08.966 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.966 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.966 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:08.966 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.817040+0000", 2024-09-13T05:13:08.966 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3933999999999997e-05 2024-09-13T05:13:08.966 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.967 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:08.967 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.967 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.967 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7487 3.13 e174/153 3:cba8ba28:::rbd_data.112d667fb7f9.00000000000001c3:19 v 174'1268, mlcod=174'1262)", 2024-09-13T05:13:08.967 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:08.811674+0000", 2024-09-13T05:13:08.967 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.051127282000000003, 2024-09-13T05:13:08.967 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0068301730000000001, 2024-09-13T05:13:08.967 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:08.967 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:08.967 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:08.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:08.968 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811674+0000", 2024-09-13T05:13:08.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.968 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:08.968 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811674+0000", 2024-09-13T05:13:08.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.968 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:08.968 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811674+0000", 2024-09-13T05:13:08.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:08.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.969 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:08.969 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811680+0000", 2024-09-13T05:13:08.969 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6460000000000004e-06 2024-09-13T05:13:08.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.969 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:08.969 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811694+0000", 2024-09-13T05:13:08.969 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4066999999999999e-05 2024-09-13T05:13:08.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.970 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811702+0000", 2024-09-13T05:13:08.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3549999999999999e-06 2024-09-13T05:13:08.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.970 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:08.970 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813840+0000", 2024-09-13T05:13:08.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002138137 2024-09-13T05:13:08.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.970 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:08.970 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813859+0000", 2024-09-13T05:13:08.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9006999999999999e-05 2024-09-13T05:13:08.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.971 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.971 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:08.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.818469+0000", 2024-09-13T05:13:08.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0046097070000000002 2024-09-13T05:13:08.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.971 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.971 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:08.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.818505+0000", 2024-09-13T05:13:08.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6026999999999999e-05 2024-09-13T05:13:08.972 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.972 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:08.972 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.972 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.972 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop_reply(osd.4.0:385 3.1a e174/151 ondisk, result = 0)", 2024-09-13T05:13:08.972 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:08.813470+0000", 2024-09-13T05:13:08.972 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.049332173, 2024-09-13T05:13:08.972 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0060296129999999996, 2024-09-13T05:13:08.972 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:08.973 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:08.973 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:08.973 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:08.973 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813470+0000", 2024-09-13T05:13:08.973 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.973 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:08.973 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813470+0000", 2024-09-13T05:13:08.973 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:08.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.973 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:08.974 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813469+0000", 2024-09-13T05:13:08.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:08.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.974 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:08.974 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813474+0000", 2024-09-13T05:13:08.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2220000000000001e-06 2024-09-13T05:13:08.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.974 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:08.974 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813483+0000", 2024-09-13T05:13:08.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4239999999999993e-06 2024-09-13T05:13:08.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.975 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.975 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:08.975 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813487+0000", 2024-09-13T05:13:08.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5129999999999998e-06 2024-09-13T05:13:08.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.975 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.975 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:08.975 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.819441+0000", 2024-09-13T05:13:08.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0059542969999999999 2024-09-13T05:13:08.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.975 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.975 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:08.975 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.819450+0000", 2024-09-13T05:13:08.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4759999999999998e-06 2024-09-13T05:13:08.976 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:08.976 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:08.976 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:08.976 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.819499+0000", 2024-09-13T05:13:08.976 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9364999999999999e-05 2024-09-13T05:13:08.976 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.976 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:08.976 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.976 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:08.976 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:08.976 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:08.978 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:13:08.978 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:08.974+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:09.079 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:09.075+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:09.090 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:09.090 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:09.090 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:13:09.090 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:09.100 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:13:09.180 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:09.174+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:09.209 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:09.262 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:09.262 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:13:09.262 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:13:09.262 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:09.262 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:13:09.264 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:13:09.309 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:09.306+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:09.376 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:09.377 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:13:09.377 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:13:09.377 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:13:09.377 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.377 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3.bb1d1096 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:13:09.377 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:13:09.377 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 105.428605117, 2024-09-13T05:13:09.377 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68834410099999999, 2024-09-13T05:13:09.377 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:09.377 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:09.377 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:09.377 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:09.378 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:09.378 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:13:09.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.378 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:09.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:09.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:13:09.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:09.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:13:09.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:09.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943719+0000", 2024-09-13T05:13:09.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:13:09.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:09.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943734+0000", 2024-09-13T05:13:09.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4793e-05 2024-09-13T05:13:09.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:09.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943765+0000", 2024-09-13T05:13:09.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0648999999999997e-05 2024-09-13T05:13:09.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.380 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:09.380 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943779+0000", 2024-09-13T05:13:09.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.447e-05 2024-09-13T05:13:09.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.380 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.380 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943872+0000", 2024-09-13T05:13:09.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3304e-05 2024-09-13T05:13:09.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.380 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:09.381 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943884+0000", 2024-09-13T05:13:09.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.167e-05 2024-09-13T05:13:09.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.381 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.381 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632042+0000", 2024-09-13T05:13:09.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68815832600000004 2024-09-13T05:13:09.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.381 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:09.381 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632066+0000", 2024-09-13T05:13:09.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3765999999999999e-05 2024-09-13T05:13:09.381 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.381 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:09.382 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.382 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3.b6bd6256 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:13:09.382 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:13:09.382 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 105.42848061700001, 2024-09-13T05:13:09.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68852592499999998, 2024-09-13T05:13:09.382 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:09.382 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:09.382 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:09.382 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:09.382 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:09.382 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:13:09.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.383 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:09.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:09.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:13:09.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:09.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:13:09.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:09.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943846+0000", 2024-09-13T05:13:09.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:09.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.384 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:09.384 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943852+0000", 2024-09-13T05:13:09.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3820000000000001e-06 2024-09-13T05:13:09.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.384 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:09.384 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943876+0000", 2024-09-13T05:13:09.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3995e-05 2024-09-13T05:13:09.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:09.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943898+0000", 2024-09-13T05:13:09.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1838999999999999e-05 2024-09-13T05:13:09.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946457+0000", 2024-09-13T05:13:09.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025588910000000002 2024-09-13T05:13:09.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:09.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946499+0000", 2024-09-13T05:13:09.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2814e-05 2024-09-13T05:13:09.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632364+0000", 2024-09-13T05:13:09.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68586484999999997 2024-09-13T05:13:09.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:09.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632372+0000", 2024-09-13T05:13:09.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1659999999999994e-06 2024-09-13T05:13:09.386 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.386 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:09.386 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.386 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3:6908b8dd:::rbd_data.112d8d1317eb.000000000000000f:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:13:09.387 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:13:09.387 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 105.39133653899999, 2024-09-13T05:13:09.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65181049499999999, 2024-09-13T05:13:09.387 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:09.387 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:09.387 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:09.387 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:09.387 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:09.387 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:13:09.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.387 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:09.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:09.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:13:09.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.388 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:09.388 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:13:09.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.388 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:09.388 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980989+0000", 2024-09-13T05:13:09.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:09.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:09.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980996+0000", 2024-09-13T05:13:09.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2200000000000003e-06 2024-09-13T05:13:09.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:09.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981011+0000", 2024-09-13T05:13:09.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4997000000000001e-05 2024-09-13T05:13:09.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:09.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981025+0000", 2024-09-13T05:13:09.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3604000000000001e-05 2024-09-13T05:13:09.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981110+0000", 2024-09-13T05:13:09.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4948000000000001e-05 2024-09-13T05:13:09.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:09.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981120+0000", 2024-09-13T05:13:09.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9399999999999997e-06 2024-09-13T05:13:09.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632425+0000", 2024-09-13T05:13:09.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65130460499999998 2024-09-13T05:13:09.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.391 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:09.391 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632587+0000", 2024-09-13T05:13:09.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016199500000000001 2024-09-13T05:13:09.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.391 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:09.391 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632801+0000", 2024-09-13T05:13:09.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021459499999999999 2024-09-13T05:13:09.391 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.391 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:09.391 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.392 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.392 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3:6a46bd6d:::rbd_data.112d8d1317eb.0000000000000010:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:13:09.392 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:13:09.392 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 105.391278883, 2024-09-13T05:13:09.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65213695699999996, 2024-09-13T05:13:09.392 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:09.392 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:09.392 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:09.392 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:09.393 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:09.393 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:13:09.393 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.393 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:09.393 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.393 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:09.393 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:13:09.393 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.393 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.393 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.393 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:09.393 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:13:09.393 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.393 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:09.394 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:13:09.394 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:09.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:09.394 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981052+0000", 2024-09-13T05:13:09.394 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4469999999999999e-06 2024-09-13T05:13:09.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:09.394 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981066+0000", 2024-09-13T05:13:09.394 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3658e-05 2024-09-13T05:13:09.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:09.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981073+0000", 2024-09-13T05:13:09.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:13:09.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981150+0000", 2024-09-13T05:13:09.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7783999999999999e-05 2024-09-13T05:13:09.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:09.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981161+0000", 2024-09-13T05:13:09.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0197000000000001e-05 2024-09-13T05:13:09.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632926+0000", 2024-09-13T05:13:09.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65176517300000003 2024-09-13T05:13:09.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:09.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633081+0000", 2024-09-13T05:13:09.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000155172 2024-09-13T05:13:09.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:09.397 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633185+0000", 2024-09-13T05:13:09.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000104329 2024-09-13T05:13:09.397 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.397 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:09.397 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.397 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:159585 3.1c 3:3afcc414:::rbd_data.112dfd94ee88.00000000000002ca:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:09.397 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:13:09.397 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 62.357960570000003, 2024-09-13T05:13:09.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91717655399999998, 2024-09-13T05:13:09.397 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:09.397 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:09.397 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:09.398 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:09.398 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:09.398 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 159585 2024-09-13T05:13:09.398 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.398 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:09.398 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.398 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:09.398 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:13:09.398 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.398 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.398 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.398 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:09.398 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:13:09.398 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:09.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014366+0000", 2024-09-13T05:13:09.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:09.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:09.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014370+0000", 2024-09-13T05:13:09.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9960000000000004e-06 2024-09-13T05:13:09.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:09.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014379+0000", 2024-09-13T05:13:09.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8550000000000008e-06 2024-09-13T05:13:09.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:09.400 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014386+0000", 2024-09-13T05:13:09.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0140000000000001e-06 2024-09-13T05:13:09.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.400 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014533+0000", 2024-09-13T05:13:09.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000147458 2024-09-13T05:13:09.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:09.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014545+0000", 2024-09-13T05:13:09.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1318000000000001e-05 2024-09-13T05:13:09.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931378+0000", 2024-09-13T05:13:09.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91683292400000005 2024-09-13T05:13:09.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:09.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931495+0000", 2024-09-13T05:13:09.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011726399999999999 2024-09-13T05:13:09.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:09.402 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931543+0000", 2024-09-13T05:13:09.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8183000000000003e-05 2024-09-13T05:13:09.402 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.402 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:09.402 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.402 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160206 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 83968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:09.402 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:13:09.402 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 62.334558172999998, 2024-09-13T05:13:09.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89412730799999995, 2024-09-13T05:13:09.402 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:09.402 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:09.402 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:09.403 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:09.403 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:09.403 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160206 2024-09-13T05:13:09.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.403 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:09.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.403 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:09.403 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:13:09.403 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.403 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:09.403 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:13:09.403 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.404 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:09.404 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037768+0000", 2024-09-13T05:13:09.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:09.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.404 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:09.404 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037774+0000", 2024-09-13T05:13:09.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3600000000000001e-06 2024-09-13T05:13:09.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.404 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:09.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037786+0000", 2024-09-13T05:13:09.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.188e-05 2024-09-13T05:13:09.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.405 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:09.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037793+0000", 2024-09-13T05:13:09.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2749999999999998e-06 2024-09-13T05:13:09.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.405 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:13:09.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0353000000000003e-05 2024-09-13T05:13:09.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:09.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037862+0000", 2024-09-13T05:13:09.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9710000000000004e-06 2024-09-13T05:13:09.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931610+0000", 2024-09-13T05:13:09.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89374846299999999 2024-09-13T05:13:09.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:09.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931815+0000", 2024-09-13T05:13:09.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020516499999999999 2024-09-13T05:13:09.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.407 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.407 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:09.407 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931896+0000", 2024-09-13T05:13:09.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1157999999999998e-05 2024-09-13T05:13:09.407 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.407 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:09.407 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.407 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.407 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160208 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 84992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:09.407 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:13:09.407 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 62.334473434000003, 2024-09-13T05:13:09.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440702299999997, 2024-09-13T05:13:09.408 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:09.408 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:09.408 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:09.408 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:09.408 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:09.408 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160208 2024-09-13T05:13:09.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.408 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:09.408 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.408 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:09.408 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:13:09.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.409 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:09.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:13:09.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.409 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:09.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037853+0000", 2024-09-13T05:13:09.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:09.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.409 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:09.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037858+0000", 2024-09-13T05:13:09.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2179999999999998e-06 2024-09-13T05:13:09.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.410 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:09.410 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037867+0000", 2024-09-13T05:13:09.410 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5699999999999993e-06 2024-09-13T05:13:09.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.410 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:09.410 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037874+0000", 2024-09-13T05:13:09.410 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2810000000000003e-06 2024-09-13T05:13:09.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.410 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037935+0000", 2024-09-13T05:13:09.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1231999999999999e-05 2024-09-13T05:13:09.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:09.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037944+0000", 2024-09-13T05:13:09.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8580000000000006e-06 2024-09-13T05:13:09.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931956+0000", 2024-09-13T05:13:09.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89401158800000002 2024-09-13T05:13:09.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:09.412 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932015+0000", 2024-09-13T05:13:09.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8906999999999997e-05 2024-09-13T05:13:09.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:09.412 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932261+0000", 2024-09-13T05:13:09.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024622799999999997 2024-09-13T05:13:09.412 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.412 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:09.412 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.412 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160210 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 86016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:09.413 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:13:09.413 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 62.334404579999998, 2024-09-13T05:13:09.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89428998299999996, 2024-09-13T05:13:09.413 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:09.413 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:09.413 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:09.413 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:09.413 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:09.413 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160210 2024-09-13T05:13:09.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.413 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:09.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:09.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:13:09.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:09.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:13:09.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:09.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037922+0000", 2024-09-13T05:13:09.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:09.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.415 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:09.415 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037926+0000", 2024-09-13T05:13:09.415 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6550000000000003e-06 2024-09-13T05:13:09.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.415 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:09.415 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037933+0000", 2024-09-13T05:13:09.415 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5409999999999997e-06 2024-09-13T05:13:09.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.415 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:09.415 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037939+0000", 2024-09-13T05:13:09.415 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1940000000000003e-06 2024-09-13T05:13:09.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.416 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.416 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037976+0000", 2024-09-13T05:13:09.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6671000000000002e-05 2024-09-13T05:13:09.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.416 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:09.416 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037982+0000", 2024-09-13T05:13:09.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9669999999999998e-06 2024-09-13T05:13:09.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.416 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.416 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932096+0000", 2024-09-13T05:13:09.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89411465599999995 2024-09-13T05:13:09.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.417 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:09.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932149+0000", 2024-09-13T05:13:09.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3032999999999999e-05 2024-09-13T05:13:09.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.417 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:09.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932213+0000", 2024-09-13T05:13:09.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3165999999999998e-05 2024-09-13T05:13:09.417 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.417 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:09.417 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.418 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160212 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 87040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:09.418 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:13:09.418 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 62.334317458999998, 2024-09-13T05:13:09.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440379699999994, 2024-09-13T05:13:09.418 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:09.418 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:09.418 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:09.418 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:09.418 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:09.418 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160212 2024-09-13T05:13:09.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.419 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:09.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.419 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:09.419 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:13:09.419 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.419 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:09.419 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:13:09.419 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.419 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:09.419 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038009+0000", 2024-09-13T05:13:09.420 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:09.420 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.420 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.420 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:09.420 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038013+0000", 2024-09-13T05:13:09.420 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3950000000000003e-06 2024-09-13T05:13:09.420 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.420 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.420 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:09.420 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038032+0000", 2024-09-13T05:13:09.420 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8513999999999999e-05 2024-09-13T05:13:09.420 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.420 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.421 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:09.421 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038039+0000", 2024-09-13T05:13:09.421 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.985e-06 2024-09-13T05:13:09.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.421 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.421 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.421 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038086+0000", 2024-09-13T05:13:09.421 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7302999999999998e-05 2024-09-13T05:13:09.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.421 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.421 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:09.421 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038090+0000", 2024-09-13T05:13:09.421 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9029999999999997e-06 2024-09-13T05:13:09.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.422 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.422 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932291+0000", 2024-09-13T05:13:09.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89420100199999997 2024-09-13T05:13:09.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.422 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:09.422 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932352+0000", 2024-09-13T05:13:09.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1354999999999998e-05 2024-09-13T05:13:09.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:09.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932414+0000", 2024-09-13T05:13:09.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1037999999999994e-05 2024-09-13T05:13:09.423 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.423 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:09.423 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.423 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160214 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 88064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:09.423 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:13:09.423 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 62.334186393000003, 2024-09-13T05:13:09.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89438890900000001, 2024-09-13T05:13:09.423 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:09.423 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:09.424 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:09.424 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:09.424 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:09.424 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160214 2024-09-13T05:13:09.424 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.424 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:09.424 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.424 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:09.424 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:13:09.425 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.425 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.425 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.425 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:09.425 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:13:09.425 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.425 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.425 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.425 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:09.425 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038140+0000", 2024-09-13T05:13:09.426 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:09.426 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:09.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038145+0000", 2024-09-13T05:13:09.426 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9749999999999998e-06 2024-09-13T05:13:09.426 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:09.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038153+0000", 2024-09-13T05:13:09.427 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1280000000000008e-06 2024-09-13T05:13:09.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:09.427 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038161+0000", 2024-09-13T05:13:09.427 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0339999999999997e-06 2024-09-13T05:13:09.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.427 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038199+0000", 2024-09-13T05:13:09.427 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8269999999999998e-05 2024-09-13T05:13:09.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:09.428 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038204+0000", 2024-09-13T05:13:09.428 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5399999999999997e-06 2024-09-13T05:13:09.428 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.428 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.428 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.428 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932438+0000", 2024-09-13T05:13:09.428 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89423397999999998 2024-09-13T05:13:09.428 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.428 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.428 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:09.428 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932480+0000", 2024-09-13T05:13:09.428 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2392999999999999e-05 2024-09-13T05:13:09.428 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.429 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.429 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:09.429 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932530+0000", 2024-09-13T05:13:09.429 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:13:09.429 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.429 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:09.429 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.429 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.429 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.429 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160305 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 215040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:09.429 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:13:09.429 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 62.329983171000002, 2024-09-13T05:13:09.429 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89028175300000001, 2024-09-13T05:13:09.429 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:09.430 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:09.430 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:09.430 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:09.430 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:09.430 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160305 2024-09-13T05:13:09.430 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.430 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:09.430 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.430 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:09.430 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:13:09.430 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.430 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.430 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.430 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:09.431 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:13:09.431 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.431 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.431 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.431 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:09.431 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042343+0000", 2024-09-13T05:13:09.431 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:09.431 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.431 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.431 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:09.431 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042350+0000", 2024-09-13T05:13:09.431 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3769999999999998e-06 2024-09-13T05:13:09.431 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.431 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.432 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:09.432 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042367+0000", 2024-09-13T05:13:09.432 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.734e-05 2024-09-13T05:13:09.432 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.432 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.432 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:09.432 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042375+0000", 2024-09-13T05:13:09.432 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8469999999999996e-06 2024-09-13T05:13:09.432 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.432 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.432 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.432 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042428+0000", 2024-09-13T05:13:09.432 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3074e-05 2024-09-13T05:13:09.433 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.433 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.433 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:09.433 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042437+0000", 2024-09-13T05:13:09.433 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:13:09.433 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.433 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.433 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.433 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932550+0000", 2024-09-13T05:13:09.433 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89011304300000005 2024-09-13T05:13:09.433 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.433 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.433 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:09.434 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932589+0000", 2024-09-13T05:13:09.434 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9236000000000002e-05 2024-09-13T05:13:09.434 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.434 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.434 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:09.434 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932626+0000", 2024-09-13T05:13:09.434 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6832999999999998e-05 2024-09-13T05:13:09.434 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.434 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:09.434 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.434 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.434 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.434 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160307 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 216064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:09.435 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:13:09.435 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 62.329936732, 2024-09-13T05:13:09.435 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89032630800000001, 2024-09-13T05:13:09.435 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:09.435 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:09.435 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:09.435 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:09.435 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:09.435 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160307 2024-09-13T05:13:09.435 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.435 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:09.435 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.435 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:09.435 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:13:09.436 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.436 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.436 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.436 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:09.436 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:13:09.436 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.436 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.436 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.436 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:09.436 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:13:09.436 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:09.436 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.436 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.437 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:09.437 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042394+0000", 2024-09-13T05:13:09.437 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7900000000000001e-06 2024-09-13T05:13:09.437 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.437 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.437 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:09.437 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042401+0000", 2024-09-13T05:13:09.437 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.267e-06 2024-09-13T05:13:09.437 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.437 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.437 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:09.437 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042406+0000", 2024-09-13T05:13:09.437 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0860000000000001e-06 2024-09-13T05:13:09.437 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.438 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.438 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.438 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042465+0000", 2024-09-13T05:13:09.438 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9441000000000002e-05 2024-09-13T05:13:09.438 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.438 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.438 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:09.438 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042471+0000", 2024-09-13T05:13:09.438 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6640000000000003e-06 2024-09-13T05:13:09.438 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.438 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.438 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.439 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932645+0000", 2024-09-13T05:13:09.439 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89017372900000002 2024-09-13T05:13:09.439 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.439 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.439 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:09.439 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932681+0000", 2024-09-13T05:13:09.439 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5918999999999999e-05 2024-09-13T05:13:09.439 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.440 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.440 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:09.440 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932717+0000", 2024-09-13T05:13:09.440 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6007999999999998e-05 2024-09-13T05:13:09.440 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.440 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:09.440 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.440 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.440 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.440 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160309 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 217088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:09.440 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:13:09.440 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 62.329886473000002, 2024-09-13T05:13:09.440 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89037315900000003, 2024-09-13T05:13:09.440 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:09.441 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:09.441 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:09.441 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:09.441 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:09.441 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160309 2024-09-13T05:13:09.441 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.441 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:09.441 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.441 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:09.441 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:13:09.442 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.442 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.442 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.442 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:09.442 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:13:09.442 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.442 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.442 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.442 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:09.442 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042440+0000", 2024-09-13T05:13:09.442 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:09.442 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.442 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.442 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:09.443 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042444+0000", 2024-09-13T05:13:09.443 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.104e-06 2024-09-13T05:13:09.443 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.443 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.443 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:09.443 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042451+0000", 2024-09-13T05:13:09.443 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.922e-06 2024-09-13T05:13:09.443 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.443 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.443 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:09.443 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042457+0000", 2024-09-13T05:13:09.443 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3979999999999998e-06 2024-09-13T05:13:09.443 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.443 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.443 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.444 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042497+0000", 2024-09-13T05:13:09.444 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0692999999999998e-05 2024-09-13T05:13:09.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.444 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:09.444 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042503+0000", 2024-09-13T05:13:09.444 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.553e-06 2024-09-13T05:13:09.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.444 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.444 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932735+0000", 2024-09-13T05:13:09.444 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89023238699999996 2024-09-13T05:13:09.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.445 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.445 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:09.445 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932771+0000", 2024-09-13T05:13:09.445 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5972000000000001e-05 2024-09-13T05:13:09.445 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.445 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.445 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:09.445 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932814+0000", 2024-09-13T05:13:09.445 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2657000000000002e-05 2024-09-13T05:13:09.445 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.445 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:09.445 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.446 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.446 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.446 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160311 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 218112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:09.446 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:13:09.446 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 62.329860983000003, 2024-09-13T05:13:09.446 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89045284400000002, 2024-09-13T05:13:09.446 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:09.446 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:09.446 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:09.446 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:09.446 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:09.446 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160311 2024-09-13T05:13:09.447 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.447 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:09.447 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.447 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:09.447 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:13:09.447 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.447 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.447 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.447 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:09.447 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:13:09.447 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.448 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.448 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.448 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:09.448 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:13:09.448 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:09.448 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.448 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.448 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:09.448 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042469+0000", 2024-09-13T05:13:09.448 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.456e-06 2024-09-13T05:13:09.448 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.448 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.449 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:09.449 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042475+0000", 2024-09-13T05:13:09.449 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0990000000000004e-06 2024-09-13T05:13:09.449 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.449 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.449 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:09.449 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042481+0000", 2024-09-13T05:13:09.449 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.237e-06 2024-09-13T05:13:09.449 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.449 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.449 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.449 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042527+0000", 2024-09-13T05:13:09.449 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6796999999999999e-05 2024-09-13T05:13:09.450 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.450 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.450 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:09.450 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042533+0000", 2024-09-13T05:13:09.450 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6489999999999996e-06 2024-09-13T05:13:09.450 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.450 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.450 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.450 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932832+0000", 2024-09-13T05:13:09.450 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89029919800000001 2024-09-13T05:13:09.450 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.450 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.450 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:09.451 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932867+0000", 2024-09-13T05:13:09.451 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5049000000000003e-05 2024-09-13T05:13:09.451 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.451 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.451 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:09.451 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932919+0000", 2024-09-13T05:13:09.451 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1780999999999998e-05 2024-09-13T05:13:09.451 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.451 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:09.451 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.451 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.451 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.451 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160313 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 219136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:09.451 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:13:09.452 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 62.329831892000001, 2024-09-13T05:13:09.452 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89064232600000004, 2024-09-13T05:13:09.452 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:09.452 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:09.452 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:09.452 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:09.452 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:09.452 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160313 2024-09-13T05:13:09.452 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.452 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:09.452 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.452 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:09.452 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:13:09.452 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.453 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.453 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.453 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:09.453 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:13:09.453 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.453 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.453 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.453 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:09.453 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:13:09.453 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:09.453 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.453 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.453 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:09.454 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042498+0000", 2024-09-13T05:13:09.454 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.281e-06 2024-09-13T05:13:09.454 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.454 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.454 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:09.454 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042505+0000", 2024-09-13T05:13:09.454 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2699999999999999e-06 2024-09-13T05:13:09.454 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.454 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.454 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:09.454 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042512+0000", 2024-09-13T05:13:09.454 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0330000000000003e-06 2024-09-13T05:13:09.454 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.454 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.455 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.455 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042557+0000", 2024-09-13T05:13:09.455 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4425999999999998e-05 2024-09-13T05:13:09.455 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.455 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.455 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:09.455 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042562+0000", 2024-09-13T05:13:09.455 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3639999999999998e-06 2024-09-13T05:13:09.455 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.455 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.455 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.455 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932987+0000", 2024-09-13T05:13:09.455 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89042472299999997 2024-09-13T05:13:09.455 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.455 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.456 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:09.456 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933062+0000", 2024-09-13T05:13:09.456 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5129999999999994e-05 2024-09-13T05:13:09.456 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.456 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.456 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:09.456 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933138+0000", 2024-09-13T05:13:09.456 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5536000000000003e-05 2024-09-13T05:13:09.456 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.456 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:09.456 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.456 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.456 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.457 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160315 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 220160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:09.457 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:13:09.457 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 62.329800724999998, 2024-09-13T05:13:09.457 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89071820800000001, 2024-09-13T05:13:09.457 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:09.457 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:09.457 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:09.457 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:09.457 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:09.457 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160315 2024-09-13T05:13:09.457 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.458 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:09.458 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.458 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:09.458 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:13:09.458 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.458 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.458 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.458 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:09.458 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:13:09.458 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.458 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.458 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.458 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:09.459 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:13:09.459 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:09.459 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.459 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.459 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:09.459 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042529+0000", 2024-09-13T05:13:09.459 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3639999999999999e-06 2024-09-13T05:13:09.459 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.459 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.459 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:09.459 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042536+0000", 2024-09-13T05:13:09.459 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.866e-06 2024-09-13T05:13:09.459 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.460 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.460 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:09.460 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042541+0000", 2024-09-13T05:13:09.460 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:13:09.460 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.460 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.460 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.460 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042587+0000", 2024-09-13T05:13:09.460 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5735000000000002e-05 2024-09-13T05:13:09.460 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.460 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.460 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:09.460 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042593+0000", 2024-09-13T05:13:09.460 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0719999999999996e-06 2024-09-13T05:13:09.461 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.461 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.461 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.461 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933160+0000", 2024-09-13T05:13:09.461 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89056621000000002 2024-09-13T05:13:09.461 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.461 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.461 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:09.461 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933202+0000", 2024-09-13T05:13:09.461 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2376000000000002e-05 2024-09-13T05:13:09.461 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.461 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.461 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:09.461 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933245+0000", 2024-09-13T05:13:09.462 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2787999999999998e-05 2024-09-13T05:13:09.462 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.462 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:09.462 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.462 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.462 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.462 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160317 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:09.462 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:13:09.462 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 62.329771895999997, 2024-09-13T05:13:09.462 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89082205800000003, 2024-09-13T05:13:09.463 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:09.463 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:09.463 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:09.463 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:09.463 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:09.463 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160317 2024-09-13T05:13:09.463 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.463 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:09.463 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.463 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:09.463 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:13:09.463 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.463 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.463 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.464 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:09.464 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:13:09.464 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.464 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.464 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.464 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:09.464 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:13:09.464 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:09.464 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.464 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.464 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:09.464 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042558+0000", 2024-09-13T05:13:09.464 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1810000000000001e-06 2024-09-13T05:13:09.465 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.465 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.465 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:09.465 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042565+0000", 2024-09-13T05:13:09.465 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9280000000000004e-06 2024-09-13T05:13:09.465 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.465 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.465 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:09.465 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042571+0000", 2024-09-13T05:13:09.465 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7420000000000003e-06 2024-09-13T05:13:09.465 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.465 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.465 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.466 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042616+0000", 2024-09-13T05:13:09.466 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5201999999999999e-05 2024-09-13T05:13:09.466 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.466 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.466 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:09.466 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042622+0000", 2024-09-13T05:13:09.466 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8289999999999996e-06 2024-09-13T05:13:09.466 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.466 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.466 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.466 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933259+0000", 2024-09-13T05:13:09.466 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89063730799999996 2024-09-13T05:13:09.466 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.466 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.467 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:09.467 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933311+0000", 2024-09-13T05:13:09.467 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1910000000000003e-05 2024-09-13T05:13:09.467 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.467 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.467 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:09.467 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933377+0000", 2024-09-13T05:13:09.467 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6396999999999995e-05 2024-09-13T05:13:09.467 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.467 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:09.467 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.467 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.467 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.467 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160319 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 222208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:09.468 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:13:09.468 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 62.329741679999998, 2024-09-13T05:13:09.468 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89087477400000004, 2024-09-13T05:13:09.468 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:09.468 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:09.468 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:09.468 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:09.468 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:09.468 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160319 2024-09-13T05:13:09.468 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.468 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:09.468 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.468 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:09.469 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:13:09.469 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.469 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.469 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.469 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:09.469 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:13:09.469 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.469 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.469 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.469 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:09.469 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042585+0000", 2024-09-13T05:13:09.469 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:09.469 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.469 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.470 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:09.470 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042588+0000", 2024-09-13T05:13:09.470 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9450000000000002e-06 2024-09-13T05:13:09.470 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.470 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.470 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:09.470 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042594+0000", 2024-09-13T05:13:09.470 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0959999999999997e-06 2024-09-13T05:13:09.470 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.470 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.470 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:09.470 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042599+0000", 2024-09-13T05:13:09.470 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0069999999999997e-06 2024-09-13T05:13:09.470 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.471 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.471 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.471 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042642+0000", 2024-09-13T05:13:09.471 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2553999999999999e-05 2024-09-13T05:13:09.471 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.471 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.471 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:09.471 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042647+0000", 2024-09-13T05:13:09.471 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.31e-06 2024-09-13T05:13:09.471 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.471 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.471 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.471 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933387+0000", 2024-09-13T05:13:09.472 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89073982799999996 2024-09-13T05:13:09.472 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.472 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.472 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:09.472 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:13:09.472 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7101000000000003e-05 2024-09-13T05:13:09.472 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.472 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.472 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:09.472 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933460+0000", 2024-09-13T05:13:09.472 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6282999999999998e-05 2024-09-13T05:13:09.472 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.473 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:09.473 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.473 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.473 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.473 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160321 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 223232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:09.473 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:13:09.473 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 62.329712252999997, 2024-09-13T05:13:09.473 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89094616999999998, 2024-09-13T05:13:09.473 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:09.473 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:09.473 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:09.473 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:09.473 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:09.474 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160321 2024-09-13T05:13:09.474 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.474 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:09.474 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.474 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:09.474 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:13:09.474 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.474 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.474 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.474 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:09.474 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:13:09.474 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.474 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.475 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.475 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:09.475 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:13:09.475 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:09.475 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.475 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.475 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:09.475 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042617+0000", 2024-09-13T05:13:09.475 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8329999999999998e-06 2024-09-13T05:13:09.475 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.475 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.475 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:09.475 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042638+0000", 2024-09-13T05:13:09.476 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0908e-05 2024-09-13T05:13:09.476 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.476 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.476 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:09.476 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042644+0000", 2024-09-13T05:13:09.476 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0440000000000001e-06 2024-09-13T05:13:09.476 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.476 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.476 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.476 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042666+0000", 2024-09-13T05:13:09.476 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1256000000000001e-05 2024-09-13T05:13:09.476 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.476 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.477 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:09.477 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042671+0000", 2024-09-13T05:13:09.477 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6250000000000004e-06 2024-09-13T05:13:09.477 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.477 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.477 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.477 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933478+0000", 2024-09-13T05:13:09.477 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89080698800000002 2024-09-13T05:13:09.477 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.477 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.477 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:09.477 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933519+0000", 2024-09-13T05:13:09.477 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0717000000000003e-05 2024-09-13T05:13:09.477 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.478 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.478 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:09.478 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933561+0000", 2024-09-13T05:13:09.478 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2225999999999999e-05 2024-09-13T05:13:09.478 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.478 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:09.478 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.478 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.478 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.478 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:201615 3.1d 3:bb015654:::rbd_data.112d9dba7cdc.000000000000000a:head [delete] snapc 30=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2024-09-13T05:13:09.478 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:13:09.478 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 29.367475471999999, 2024-09-13T05:13:09.478 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.90842926999999996, 2024-09-13T05:13:09.479 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:09.479 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:09.479 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:09.479 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:09.479 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:09.479 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 201615 2024-09-13T05:13:09.479 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.479 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:09.479 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.479 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:09.479 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:13:09.479 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.479 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.479 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.480 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:09.480 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:13:09.480 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:09.480 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.480 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.480 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:09.480 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004850+0000", 2024-09-13T05:13:09.480 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:09.480 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.480 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.480 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:09.480 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004860+0000", 2024-09-13T05:13:09.480 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.927e-06 2024-09-13T05:13:09.480 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.481 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.481 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:09.481 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004882+0000", 2024-09-13T05:13:09.481 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2079999999999999e-05 2024-09-13T05:13:09.481 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.481 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.481 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:09.481 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004897+0000", 2024-09-13T05:13:09.481 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4892000000000001e-05 2024-09-13T05:13:09.481 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.481 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.481 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.481 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.005068+0000", 2024-09-13T05:13:09.481 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017098999999999999 2024-09-13T05:13:09.482 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.482 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.482 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:09.482 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.005081+0000", 2024-09-13T05:13:09.482 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3063e-05 2024-09-13T05:13:09.482 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.482 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.482 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:09.482 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.910925+0000", 2024-09-13T05:13:09.482 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.90584383400000001 2024-09-13T05:13:09.482 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.482 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.482 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:09.482 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.911131+0000", 2024-09-13T05:13:09.482 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020629399999999999 2024-09-13T05:13:09.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.483 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.483 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 4", 2024-09-13T05:13:09.483 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.911313+0000", 2024-09-13T05:13:09.483 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000182175 2024-09-13T05:13:09.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.483 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.483 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:09.483 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913010+0000", 2024-09-13T05:13:09.483 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0016971550000000001 2024-09-13T05:13:09.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.483 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.483 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:09.483 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913212+0000", 2024-09-13T05:13:09.484 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000202237 2024-09-13T05:13:09.484 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.484 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.484 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:09.484 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913253+0000", 2024-09-13T05:13:09.484 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0250999999999998e-05 2024-09-13T05:13:09.484 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:09.484 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:09.484 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:09.484 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913281+0000", 2024-09-13T05:13:09.484 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8314e-05 2024-09-13T05:13:09.484 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.484 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:09.484 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.485 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:09.485 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:09.485 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:09.486 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:13:09.486 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:13:09.486 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:13:09.486 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:13:09.487 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:13:09.487 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:09.483+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:09.498 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:13:09.520 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:13:09.542 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:13:09.566 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:13:09.569 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:13:09.569 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:13:09.569 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:13:09.569 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:13:09.569 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:13:09.569 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:13:09.569 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:13:09.569 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:13:09.587 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:09.583+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:09.591 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:09.591 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:09.601 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:13:09.688 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:09.686+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:09.703 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:09.703 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:09.714 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:13:09.789 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:09.787+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:09.808 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is set 2024-09-13T05:13:09.831 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:09.832 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:09.842 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:13:09.890 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:09.886+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:09.955 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:09.955 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:09.966 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:13:09.991 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:09.986+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:10.073 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:10.074 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:10.083 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:13:10.092 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:10.087+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:10.185 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:10.185 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:10.193 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:10.187+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:10.195 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:13:10.294 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:10.290+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:10.311 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:10.311 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:10.321 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:13:10.394 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:10.390+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:10.428 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:10.428 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:10.438 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:13:10.495 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:10.491+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:10.590 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:10.590 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:10.596 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:10.591+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:10.600 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:13:10.697 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:10.691+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:10.705 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:10.705 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:10.715 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:13:10.799 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:10.795+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:10.826 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:10.826 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:10.837 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:13:10.899 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:10.895+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:10.942 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:10.943 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:10.953 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:13:11.000 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:10.995+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:11.059 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:11.060 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:11.070 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:13:11.101 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:11.095+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:11.175 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:11.176 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:11.185 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:13:11.202 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:11.199+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:11.293 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:11.294 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:11.302 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:11.298+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:11.304 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:13:11.404 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:11.398+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:11.455 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:11.455 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:11.465 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:13:11.509 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:11.506+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:11.566 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:11.567 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:11.576 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:13:11.588 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:13:11.605 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:11.603+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:11.680 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:11.680 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:11.690 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:13:11.726 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:13:11.734 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:11.731+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:11.746 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:13:11.765 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:13:11.785 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:13:11.807 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:13:11.807 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:11.802+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:11.807 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:11.807 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:11.807 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:13:11.807 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:11.817 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:13:11.824 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T05:13:11.835 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:13:11.856 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:13:11.882 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:13:11.885 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:13:11.885 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:13:11.885 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:13:11.885 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:13:11.885 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:13:11.885 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:13:11.886 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:13:11.886 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:13:11.908 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:11.903+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:11.932 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:11.932 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:11.932 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:13:11.932 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:13:11.932 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:11.943 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:13:12.009 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:12.002+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:12.098 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:12.098 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:13:12.098 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:13:12.098 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:13:12.098 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.098 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7312 3.13 e159/153 3:ce615828:::rbd_data.112dbd21872d.000000000000000f:28 v 159'1216, mlcod=158'1213)", 2024-09-13T05:13:12.098 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.645274+0000", 2024-09-13T05:13:12.098 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.448471875999999, 2024-09-13T05:13:12.099 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0050366250000000003, 2024-09-13T05:13:12.099 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.099 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:12.099 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.099 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.099 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.099 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.645274+0000", 2024-09-13T05:13:12.099 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.099 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.099 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.099 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.099 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.645274+0000", 2024-09-13T05:13:12.099 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.099 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.100 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.100 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.100 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.645274+0000", 2024-09-13T05:13:12.100 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:12.100 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.100 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.100 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.100 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.645280+0000", 2024-09-13T05:13:12.100 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9000000000000003e-06 2024-09-13T05:13:12.100 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.100 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.100 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.100 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.645286+0000", 2024-09-13T05:13:12.101 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3149999999999997e-06 2024-09-13T05:13:12.101 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.101 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.101 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.101 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.645291+0000", 2024-09-13T05:13:12.101 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.04e-06 2024-09-13T05:13:12.101 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.101 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.101 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.101 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.645370+0000", 2024-09-13T05:13:12.101 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8996000000000001e-05 2024-09-13T05:13:12.101 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.102 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.102 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.102 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.645392+0000", 2024-09-13T05:13:12.102 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2362999999999999e-05 2024-09-13T05:13:12.102 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.102 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.102 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:12.102 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.650153+0000", 2024-09-13T05:13:12.102 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0047611040000000004 2024-09-13T05:13:12.102 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.102 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.102 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.102 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.650311+0000", 2024-09-13T05:13:12.103 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000157362 2024-09-13T05:13:12.103 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.103 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.103 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.103 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.103 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.103 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7315 3.13 e159/153 3:cd8e2485:::rbd_data.112dbd21872d.0000000000000251:28 v 159'1218, mlcod=158'1213)", 2024-09-13T05:13:12.103 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.647328+0000", 2024-09-13T05:13:12.103 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.446417890999999, 2024-09-13T05:13:12.103 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0051515930000000003, 2024-09-13T05:13:12.103 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.103 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:12.103 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.103 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.104 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.104 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.647328+0000", 2024-09-13T05:13:12.104 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.104 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.104 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.104 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.104 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.647328+0000", 2024-09-13T05:13:12.104 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.104 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.104 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.104 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.104 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.647327+0000", 2024-09-13T05:13:12.104 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:12.105 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.105 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.105 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.105 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.647336+0000", 2024-09-13T05:13:12.105 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8319999999999995e-06 2024-09-13T05:13:12.105 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.105 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.105 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.105 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.647351+0000", 2024-09-13T05:13:12.105 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5226e-05 2024-09-13T05:13:12.105 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.105 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.105 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.105 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.647360+0000", 2024-09-13T05:13:12.106 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2029999999999992e-06 2024-09-13T05:13:12.106 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.106 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.106 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.106 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.647538+0000", 2024-09-13T05:13:12.106 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017795500000000001 2024-09-13T05:13:12.106 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.106 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.106 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.106 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.647569+0000", 2024-09-13T05:13:12.106 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1636e-05 2024-09-13T05:13:12.106 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.106 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.106 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:12.107 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.652446+0000", 2024-09-13T05:13:12.107 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0048766629999999998 2024-09-13T05:13:12.107 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.107 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.107 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.107 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.652480+0000", 2024-09-13T05:13:12.107 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3927000000000002e-05 2024-09-13T05:13:12.107 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.107 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.107 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.107 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.107 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.107 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203004 3.1a 3:5a99807b:::rbd_object_map.112dbd21872d:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159)", 2024-09-13T05:13:12.107 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.649669+0000", 2024-09-13T05:13:12.108 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.444076611, 2024-09-13T05:13:12.108 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0064520619999999997, 2024-09-13T05:13:12.108 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.108 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:12.108 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.108 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.108 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.108 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203004 2024-09-13T05:13:12.108 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.108 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.108 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.108 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.108 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649669+0000", 2024-09-13T05:13:12.109 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.109 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.109 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.109 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.109 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649669+0000", 2024-09-13T05:13:12.109 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.109 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.109 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.109 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.109 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649668+0000", 2024-09-13T05:13:12.109 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:12.109 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.109 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.109 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.110 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649676+0000", 2024-09-13T05:13:12.110 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0020000000000006e-06 2024-09-13T05:13:12.110 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.110 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.110 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.110 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649686+0000", 2024-09-13T05:13:12.110 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0702e-05 2024-09-13T05:13:12.110 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.110 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.110 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.110 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649694+0000", 2024-09-13T05:13:12.110 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9370000000000004e-06 2024-09-13T05:13:12.110 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.110 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.110 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.111 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.650848+0000", 2024-09-13T05:13:12.111 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0011532020000000001 2024-09-13T05:13:12.111 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.111 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.111 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.111 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.650973+0000", 2024-09-13T05:13:12.111 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012510099999999999 2024-09-13T05:13:12.111 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.111 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.111 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:12.111 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.651197+0000", 2024-09-13T05:13:12.111 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00022407899999999999 2024-09-13T05:13:12.111 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.112 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.112 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:12.112 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.653302+0000", 2024-09-13T05:13:12.112 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021053629999999999 2024-09-13T05:13:12.112 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.112 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.112 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:12.112 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655437+0000", 2024-09-13T05:13:12.112 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002135348 2024-09-13T05:13:12.112 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.112 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.112 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:12.112 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655500+0000", 2024-09-13T05:13:12.113 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2453999999999995e-05 2024-09-13T05:13:12.113 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.113 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.113 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.113 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656122+0000", 2024-09-13T05:13:12.113 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00062160299999999998 2024-09-13T05:13:12.113 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.113 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.113 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.113 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.113 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.113 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.3.0:5114 3.b e159/149 3:d13d0bb6:::rbd_data.112dbd21872d.000000000000000c:28 v 159'614, mlcod=158'611)", 2024-09-13T05:13:12.113 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.655063+0000", 2024-09-13T05:13:12.114 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.438683538999999, 2024-09-13T05:13:12.114 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0057558009999999996, 2024-09-13T05:13:12.114 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.114 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:12.114 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.114 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.114 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.114 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655063+0000", 2024-09-13T05:13:12.114 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.114 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.114 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.114 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.114 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655063+0000", 2024-09-13T05:13:12.114 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.115 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.115 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.115 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.115 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655062+0000", 2024-09-13T05:13:12.115 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:12.115 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.115 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.115 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.115 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655070+0000", 2024-09-13T05:13:12.115 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5059999999999995e-06 2024-09-13T05:13:12.115 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.115 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.115 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.116 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655092+0000", 2024-09-13T05:13:12.116 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2310000000000002e-05 2024-09-13T05:13:12.116 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.116 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.116 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.116 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655105+0000", 2024-09-13T05:13:12.116 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2432999999999999e-05 2024-09-13T05:13:12.116 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.116 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.116 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.116 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655154+0000", 2024-09-13T05:13:12.116 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8673e-05 2024-09-13T05:13:12.116 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.117 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.117 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.117 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655171+0000", 2024-09-13T05:13:12.117 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7487999999999999e-05 2024-09-13T05:13:12.117 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.117 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.117 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:12.117 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.660765+0000", 2024-09-13T05:13:12.117 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0055935209999999997 2024-09-13T05:13:12.117 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.117 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.117 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.117 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.660818+0000", 2024-09-13T05:13:12.118 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3769e-05 2024-09-13T05:13:12.118 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.118 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.118 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.118 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.118 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.118 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7318 3.13 e159/153 3:cf0a521c:::rbd_data.112dbd21872d.0000000000000004:28 v 159'1220, mlcod=159'1216)", 2024-09-13T05:13:12.118 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.655897+0000", 2024-09-13T05:13:12.118 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.437848816999999, 2024-09-13T05:13:12.118 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0075974520000000002, 2024-09-13T05:13:12.118 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.118 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:12.118 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.119 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.119 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.119 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655897+0000", 2024-09-13T05:13:12.119 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.119 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.119 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.119 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.119 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655897+0000", 2024-09-13T05:13:12.119 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.119 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.119 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.119 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.119 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655897+0000", 2024-09-13T05:13:12.119 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:12.120 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.120 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.120 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.120 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655906+0000", 2024-09-13T05:13:12.120 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6290000000000005e-06 2024-09-13T05:13:12.120 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.120 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.120 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.120 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655916+0000", 2024-09-13T05:13:12.120 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0079e-05 2024-09-13T05:13:12.120 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.120 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.120 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.120 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655923+0000", 2024-09-13T05:13:12.121 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1319999999999996e-06 2024-09-13T05:13:12.121 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.121 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.121 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.121 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656023+0000", 2024-09-13T05:13:12.121 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9747000000000006e-05 2024-09-13T05:13:12.121 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.121 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.121 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.121 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656042+0000", 2024-09-13T05:13:12.121 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8491999999999998e-05 2024-09-13T05:13:12.121 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.121 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.121 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:12.122 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.663412+0000", 2024-09-13T05:13:12.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0073701959999999999 2024-09-13T05:13:12.122 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.122 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.122 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.122 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.663495+0000", 2024-09-13T05:13:12.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2923000000000005e-05 2024-09-13T05:13:12.122 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.122 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.122 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.122 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.122 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.122 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.3.0:5116 3.b e159/149 3:d32d7958:::rbd_data.112dbd21872d.0000000000000001:28 v 159'616, mlcod=158'611)", 2024-09-13T05:13:12.122 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.655899+0000", 2024-09-13T05:13:12.122 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.437847133999998, 2024-09-13T05:13:12.123 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0075096859999999998, 2024-09-13T05:13:12.123 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.123 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:12.123 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.123 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.123 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.123 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655899+0000", 2024-09-13T05:13:12.123 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.123 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.123 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.123 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.123 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655899+0000", 2024-09-13T05:13:12.123 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.123 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.123 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.124 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.124 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655898+0000", 2024-09-13T05:13:12.124 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:12.124 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.124 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.124 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.124 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655907+0000", 2024-09-13T05:13:12.124 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5939999999999994e-06 2024-09-13T05:13:12.124 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.124 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.124 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.124 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655916+0000", 2024-09-13T05:13:12.124 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9840000000000007e-06 2024-09-13T05:13:12.124 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.125 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.125 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.125 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655923+0000", 2024-09-13T05:13:12.125 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1350000000000003e-06 2024-09-13T05:13:12.125 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.125 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.125 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.125 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656059+0000", 2024-09-13T05:13:12.125 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013669999999999999 2024-09-13T05:13:12.125 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.125 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.125 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.125 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656079+0000", 2024-09-13T05:13:12.126 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9293e-05 2024-09-13T05:13:12.126 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.126 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.126 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:12.126 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.663368+0000", 2024-09-13T05:13:12.126 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0072892570000000004 2024-09-13T05:13:12.126 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.126 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.126 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.126 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.663409+0000", 2024-09-13T05:13:12.126 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0614000000000001e-05 2024-09-13T05:13:12.126 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.126 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.126 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.127 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.127 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.127 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.3.0:5119 3.b e159/149 3:d7928ff2:::rbd_data.112dbd21872d.000000000000003d:28 v 159'618, mlcod=159'614)", 2024-09-13T05:13:12.127 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.664054+0000", 2024-09-13T05:13:12.127 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.429692533000001, 2024-09-13T05:13:12.127 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0051301250000000001, 2024-09-13T05:13:12.127 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.127 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:12.127 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.127 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.127 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.127 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.664054+0000", 2024-09-13T05:13:12.127 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.127 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.128 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.128 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.128 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.664054+0000", 2024-09-13T05:13:12.128 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.128 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.128 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.128 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.128 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.664053+0000", 2024-09-13T05:13:12.128 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:12.128 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.128 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.128 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.128 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.664062+0000", 2024-09-13T05:13:12.129 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8629999999999997e-06 2024-09-13T05:13:12.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.129 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.129 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.129 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.664075+0000", 2024-09-13T05:13:12.129 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3327e-05 2024-09-13T05:13:12.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.129 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.129 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.129 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.664081+0000", 2024-09-13T05:13:12.129 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9529999999999996e-06 2024-09-13T05:13:12.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.129 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.129 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.130 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.664121+0000", 2024-09-13T05:13:12.130 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9876999999999998e-05 2024-09-13T05:13:12.130 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.130 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.130 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.130 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.664141+0000", 2024-09-13T05:13:12.130 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0428000000000002e-05 2024-09-13T05:13:12.130 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.130 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.130 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:12.130 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.669132+0000", 2024-09-13T05:13:12.130 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0049911249999999999 2024-09-13T05:13:12.130 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.131 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.131 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.131 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.669184+0000", 2024-09-13T05:13:12.131 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1400000000000003e-05 2024-09-13T05:13:12.131 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.131 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.131 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.131 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.131 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.131 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7323 3.e e159/151 3:742bfecb:::rbd_data.112dbd21872d.0000000000000018:28 v 159'1051, mlcod=157'1046)", 2024-09-13T05:13:12.131 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.668166+0000", 2024-09-13T05:13:12.131 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.425579939999999, 2024-09-13T05:13:12.131 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0065306610000000001, 2024-09-13T05:13:12.131 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.131 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:12.132 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.132 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.132 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.132 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668166+0000", 2024-09-13T05:13:12.132 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.132 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.132 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.132 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.132 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668166+0000", 2024-09-13T05:13:12.132 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.132 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.132 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.132 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.133 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668165+0000", 2024-09-13T05:13:12.133 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:12.133 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.133 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.133 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.133 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668174+0000", 2024-09-13T05:13:12.133 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.3790000000000006e-06 2024-09-13T05:13:12.133 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.133 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.133 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.133 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668187+0000", 2024-09-13T05:13:12.133 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3172e-05 2024-09-13T05:13:12.133 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.133 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.134 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.134 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668208+0000", 2024-09-13T05:13:12.134 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0713999999999999e-05 2024-09-13T05:13:12.134 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.134 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.134 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.134 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668272+0000", 2024-09-13T05:13:12.134 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4453000000000001e-05 2024-09-13T05:13:12.134 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.134 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.135 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.135 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668289+0000", 2024-09-13T05:13:12.135 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7331000000000001e-05 2024-09-13T05:13:12.135 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.135 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.135 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:12.135 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.674630+0000", 2024-09-13T05:13:12.135 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0063409340000000003 2024-09-13T05:13:12.135 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.135 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.135 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.135 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.674697+0000", 2024-09-13T05:13:12.135 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6472999999999999e-05 2024-09-13T05:13:12.135 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.136 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.136 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.136 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.136 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.136 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7324 3.f e159/150 3:f534c371:::rbd_data.112dbd21872d.0000000000000017:28 v 159'871, mlcod=158'868)", 2024-09-13T05:13:12.136 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.672502+0000", 2024-09-13T05:13:12.136 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.421243786000002, 2024-09-13T05:13:12.136 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.004881753, 2024-09-13T05:13:12.136 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.136 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:12.136 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.136 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.136 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.136 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672502+0000", 2024-09-13T05:13:12.137 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.137 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.137 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.137 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672502+0000", 2024-09-13T05:13:12.137 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.137 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.137 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.137 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672501+0000", 2024-09-13T05:13:12.137 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:12.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.137 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.137 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.138 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672509+0000", 2024-09-13T05:13:12.138 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8970000000000008e-06 2024-09-13T05:13:12.138 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.138 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.138 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.138 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672524+0000", 2024-09-13T05:13:12.138 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4558e-05 2024-09-13T05:13:12.138 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.138 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.138 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.138 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672533+0000", 2024-09-13T05:13:12.138 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3000000000000007e-06 2024-09-13T05:13:12.138 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.138 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.139 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.139 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672595+0000", 2024-09-13T05:13:12.139 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1750999999999999e-05 2024-09-13T05:13:12.139 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.139 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.139 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.139 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.672619+0000", 2024-09-13T05:13:12.139 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.472e-05 2024-09-13T05:13:12.139 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.139 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.139 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:12.139 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.677335+0000", 2024-09-13T05:13:12.139 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0047155720000000003 2024-09-13T05:13:12.139 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.139 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.140 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.140 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.677384+0000", 2024-09-13T05:13:12.140 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9013e-05 2024-09-13T05:13:12.140 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.140 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.140 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.140 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.140 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.140 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203156 3.9 3:9079854c:::rbd_header.112d52e08ead:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e160)", 2024-09-13T05:13:12.140 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:54.685914+0000", 2024-09-13T05:13:12.140 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 17.407832013, 2024-09-13T05:13:12.140 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0085711250000000006, 2024-09-13T05:13:12.140 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.140 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:12.141 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.141 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.141 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.141 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203156 2024-09-13T05:13:12.141 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.141 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.141 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.141 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.141 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685914+0000", 2024-09-13T05:13:12.141 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.141 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.141 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.141 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.141 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685914+0000", 2024-09-13T05:13:12.142 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.142 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.142 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.142 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.142 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685912+0000", 2024-09-13T05:13:12.142 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:12.142 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.142 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.142 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.142 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685924+0000", 2024-09-13T05:13:12.142 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1537e-05 2024-09-13T05:13:12.142 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.142 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.142 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.143 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685950+0000", 2024-09-13T05:13:12.143 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6781e-05 2024-09-13T05:13:12.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.143 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.143 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.143 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685962+0000", 2024-09-13T05:13:12.143 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1953999999999999e-05 2024-09-13T05:13:12.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.143 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.143 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.143 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.686102+0000", 2024-09-13T05:13:12.143 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013926300000000001 2024-09-13T05:13:12.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.143 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.143 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op must wait for map", 2024-09-13T05:13:12.144 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.686115+0000", 2024-09-13T05:13:12.144 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3506000000000001e-05 2024-09-13T05:13:12.144 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.144 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.144 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.144 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.689954+0000", 2024-09-13T05:13:12.144 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0038391810000000001 2024-09-13T05:13:12.144 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.144 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.144 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.144 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.690104+0000", 2024-09-13T05:13:12.144 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014980500000000001 2024-09-13T05:13:12.144 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.145 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.145 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 2", 2024-09-13T05:13:12.145 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.690674+0000", 2024-09-13T05:13:12.145 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00057014200000000004 2024-09-13T05:13:12.145 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.145 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.145 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:12.145 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.692426+0000", 2024-09-13T05:13:12.145 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0017518810000000001 2024-09-13T05:13:12.145 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.145 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.145 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:12.145 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.694360+0000", 2024-09-13T05:13:12.145 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0019340819999999999 2024-09-13T05:13:12.145 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.146 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.146 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:12.146 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.694443+0000", 2024-09-13T05:13:12.146 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2693000000000003e-05 2024-09-13T05:13:12.146 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.146 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.146 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.146 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.694485+0000", 2024-09-13T05:13:12.146 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2355999999999999e-05 2024-09-13T05:13:12.146 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.146 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.146 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.146 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.146 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.147 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203594 3.1 3:82a5a606:::rbd_object_map.112d841a7de:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163)", 2024-09-13T05:13:12.147 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:57.719919+0000", 2024-09-13T05:13:12.147 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.373826755, 2024-09-13T05:13:12.147 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0058258199999999998, 2024-09-13T05:13:12.147 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.147 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:12.147 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.147 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.147 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.147 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203594 2024-09-13T05:13:12.147 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.147 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.147 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.147 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.148 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.719919+0000", 2024-09-13T05:13:12.148 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.148 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.148 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.148 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.719919+0000", 2024-09-13T05:13:12.148 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.148 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.148 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.148 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.719916+0000", 2024-09-13T05:13:12.148 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999967 2024-09-13T05:13:12.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.149 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.149 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.149 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.719935+0000", 2024-09-13T05:13:12.149 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8637000000000001e-05 2024-09-13T05:13:12.149 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.149 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.149 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.149 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.719965+0000", 2024-09-13T05:13:12.149 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0457e-05 2024-09-13T05:13:12.149 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.149 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.149 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.149 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.719981+0000", 2024-09-13T05:13:12.150 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6359e-05 2024-09-13T05:13:12.150 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.150 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.150 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.150 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.720066+0000", 2024-09-13T05:13:12.150 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4710999999999996e-05 2024-09-13T05:13:12.150 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.150 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.150 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op must wait for map", 2024-09-13T05:13:12.150 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.720072+0000", 2024-09-13T05:13:12.150 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5300000000000004e-06 2024-09-13T05:13:12.150 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.150 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.150 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.151 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.723400+0000", 2024-09-13T05:13:12.151 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033279809999999998 2024-09-13T05:13:12.151 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.151 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.151 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.151 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.723530+0000", 2024-09-13T05:13:12.151 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013047300000000001 2024-09-13T05:13:12.151 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.151 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.151 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 3", 2024-09-13T05:13:12.151 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.723708+0000", 2024-09-13T05:13:12.151 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017767400000000001 2024-09-13T05:13:12.151 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.151 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.152 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:12.152 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.725594+0000", 2024-09-13T05:13:12.152 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0018860960000000001 2024-09-13T05:13:12.152 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.152 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.152 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:12.152 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.725617+0000", 2024-09-13T05:13:12.152 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3210999999999999e-05 2024-09-13T05:13:12.152 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.152 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.152 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:12.152 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.725675+0000", 2024-09-13T05:13:12.152 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7899999999999998e-05 2024-09-13T05:13:12.152 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.153 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.153 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.153 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.725745+0000", 2024-09-13T05:13:12.153 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0097000000000003e-05 2024-09-13T05:13:12.153 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.153 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.153 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.153 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.153 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.153 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203849 3.3 3:c190344a:::rbd_data.112d1f830c0e.0000000000000000:head [delete] snapc 23=[] ondisk+write+known_if_redirected+supports_pool_eio e164)", 2024-09-13T05:13:12.153 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:58.853242+0000", 2024-09-13T05:13:12.153 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.240503605000001, 2024-09-13T05:13:12.153 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0070665509999999999, 2024-09-13T05:13:12.153 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.154 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:12.154 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.154 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.154 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.154 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203849 2024-09-13T05:13:12.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.154 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.154 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.154 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.154 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853242+0000", 2024-09-13T05:13:12.154 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.154 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.154 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.154 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853242+0000", 2024-09-13T05:13:12.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853240+0000", 2024-09-13T05:13:12.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:13:12.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853253+0000", 2024-09-13T05:13:12.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2330000000000001e-05 2024-09-13T05:13:12.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853286+0000", 2024-09-13T05:13:12.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3798999999999999e-05 2024-09-13T05:13:12.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.156 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.156 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853321+0000", 2024-09-13T05:13:12.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4749999999999998e-05 2024-09-13T05:13:12.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.156 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.156 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853568+0000", 2024-09-13T05:13:12.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024706400000000002 2024-09-13T05:13:12.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.156 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.156 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.157 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853935+0000", 2024-09-13T05:13:12.157 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00036690600000000001 2024-09-13T05:13:12.157 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.157 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:12.157 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854221+0000", 2024-09-13T05:13:12.157 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00028613100000000002 2024-09-13T05:13:12.157 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.157 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:12.157 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.859106+0000", 2024-09-13T05:13:12.157 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0048842629999999998 2024-09-13T05:13:12.157 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.157 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:12.158 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860185+0000", 2024-09-13T05:13:12.158 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0010796740000000001 2024-09-13T05:13:12.158 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.158 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.158 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:12.158 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860252+0000", 2024-09-13T05:13:12.158 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6928999999999996e-05 2024-09-13T05:13:12.158 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.158 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.158 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.158 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860309+0000", 2024-09-13T05:13:12.158 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6898999999999999e-05 2024-09-13T05:13:12.158 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.158 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.158 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.159 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.159 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203852 3.1a 3:5af372d9:::rbd_data.112d1f830c0e.0000000000000003:head [delete] snapc 23=[] ondisk+write+known_if_redirected+supports_pool_eio e164)", 2024-09-13T05:13:12.159 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:58.853358+0000", 2024-09-13T05:13:12.159 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.240388248, 2024-09-13T05:13:12.159 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0069302069999999999, 2024-09-13T05:13:12.159 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.159 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:12.159 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.159 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.159 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.159 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203852 2024-09-13T05:13:12.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.160 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853358+0000", 2024-09-13T05:13:12.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853358+0000", 2024-09-13T05:13:12.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853357+0000", 2024-09-13T05:13:12.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:12.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.161 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853363+0000", 2024-09-13T05:13:12.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6059999999999999e-06 2024-09-13T05:13:12.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.161 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853421+0000", 2024-09-13T05:13:12.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8075999999999998e-05 2024-09-13T05:13:12.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.161 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854643+0000", 2024-09-13T05:13:12.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001221904 2024-09-13T05:13:12.162 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.162 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.162 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.162 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854777+0000", 2024-09-13T05:13:12.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013323100000000001 2024-09-13T05:13:12.162 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.162 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.162 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.162 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.855094+0000", 2024-09-13T05:13:12.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00031790600000000002 2024-09-13T05:13:12.162 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.162 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.162 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:12.163 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.855378+0000", 2024-09-13T05:13:12.163 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00028385800000000001 2024-09-13T05:13:12.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.163 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:12.163 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.859936+0000", 2024-09-13T05:13:12.163 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0045574450000000002 2024-09-13T05:13:12.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.163 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:12.163 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860199+0000", 2024-09-13T05:13:12.163 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00026360899999999999 2024-09-13T05:13:12.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.163 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:12.164 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860250+0000", 2024-09-13T05:13:12.164 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0625999999999999e-05 2024-09-13T05:13:12.164 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.164 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.164 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.164 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860288+0000", 2024-09-13T05:13:12.164 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8028999999999998e-05 2024-09-13T05:13:12.164 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.164 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.164 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.164 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.164 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.164 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(client.4397.0:203850 3.1c e164/148 3:3f23e81b:::rbd_data.112d1f830c0e.0000000000000001:head v 164'854, mlcod=163'852)", 2024-09-13T05:13:12.164 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:58.854434+0000", 2024-09-13T05:13:12.165 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.239311707000001, 2024-09-13T05:13:12.165 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0052183129999999996, 2024-09-13T05:13:12.165 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.165 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:12.165 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.165 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.165 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854434+0000", 2024-09-13T05:13:12.165 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.165 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.165 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854434+0000", 2024-09-13T05:13:12.165 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.166 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.166 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.166 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854433+0000", 2024-09-13T05:13:12.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:12.166 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.166 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.166 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854451+0000", 2024-09-13T05:13:12.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7960000000000001e-05 2024-09-13T05:13:12.166 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.166 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.166 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854497+0000", 2024-09-13T05:13:12.167 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6864999999999999e-05 2024-09-13T05:13:12.167 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.167 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.167 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854516+0000", 2024-09-13T05:13:12.167 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8462999999999999e-05 2024-09-13T05:13:12.167 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.167 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.167 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854815+0000", 2024-09-13T05:13:12.167 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00029886099999999998 2024-09-13T05:13:12.167 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.167 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.167 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854869+0000", 2024-09-13T05:13:12.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4035e-05 2024-09-13T05:13:12.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.168 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.168 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:12.168 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.859560+0000", 2024-09-13T05:13:12.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0046911440000000004 2024-09-13T05:13:12.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.168 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.168 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.168 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.859653+0000", 2024-09-13T05:13:12.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2814999999999998e-05 2024-09-13T05:13:12.168 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.168 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.169 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.169 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:204682 3.1 3:8468e10f:::rbd_data.112db56bb33d.0000000000000003:head [delete] snapc 1f=[] ondisk+write+known_if_redirected+supports_pool_eio e168)", 2024-09-13T05:13:12.169 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:02.885028+0000", 2024-09-13T05:13:12.169 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.2087182940000005, 2024-09-13T05:13:12.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0048702870000000001, 2024-09-13T05:13:12.169 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.169 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:12.169 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.169 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.169 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.169 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 204682 2024-09-13T05:13:12.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.170 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.885028+0000", 2024-09-13T05:13:12.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.885028+0000", 2024-09-13T05:13:12.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.885027+0000", 2024-09-13T05:13:12.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:12.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.171 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.885034+0000", 2024-09-13T05:13:12.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8129999999999998e-06 2024-09-13T05:13:12.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.171 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.885047+0000", 2024-09-13T05:13:12.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3066e-05 2024-09-13T05:13:12.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.171 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.885057+0000", 2024-09-13T05:13:12.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0074e-05 2024-09-13T05:13:12.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.885153+0000", 2024-09-13T05:13:12.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.658e-05 2024-09-13T05:13:12.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.885231+0000", 2024-09-13T05:13:12.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7933000000000001e-05 2024-09-13T05:13:12.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 3", 2024-09-13T05:13:12.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.885339+0000", 2024-09-13T05:13:12.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000108175 2024-09-13T05:13:12.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:12.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.887579+0000", 2024-09-13T05:13:12.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022399529999999998 2024-09-13T05:13:12.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:12.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.889781+0000", 2024-09-13T05:13:12.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022018179999999999 2024-09-13T05:13:12.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:12.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.889848+0000", 2024-09-13T05:13:12.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6662000000000007e-05 2024-09-13T05:13:12.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:02.889898+0000", 2024-09-13T05:13:12.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0288999999999999e-05 2024-09-13T05:13:12.174 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.174 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.174 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.174 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:205619 3.14 3:281c383b:::rbd_data.112d34bb0b84.0000000000000038:head [delete] snapc 1a=[] ondisk+write+known_if_redirected+supports_pool_eio e173)", 2024-09-13T05:13:12.174 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:07.906696+0000", 2024-09-13T05:13:12.175 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.1870496480000003, 2024-09-13T05:13:12.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.005250233, 2024-09-13T05:13:12.175 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.175 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:12.175 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.175 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.175 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.175 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 205619 2024-09-13T05:13:12.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.175 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.175 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.175 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906696+0000", 2024-09-13T05:13:12.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906696+0000", 2024-09-13T05:13:12.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906694+0000", 2024-09-13T05:13:12.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:13:12.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906705+0000", 2024-09-13T05:13:12.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0907000000000001e-05 2024-09-13T05:13:12.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906735+0000", 2024-09-13T05:13:12.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9382000000000001e-05 2024-09-13T05:13:12.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906752+0000", 2024-09-13T05:13:12.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7212000000000001e-05 2024-09-13T05:13:12.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906949+0000", 2024-09-13T05:13:12.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00019728200000000001 2024-09-13T05:13:12.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.907262+0000", 2024-09-13T05:13:12.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00031242299999999999 2024-09-13T05:13:12.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 7", 2024-09-13T05:13:12.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.907528+0000", 2024-09-13T05:13:12.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00026672399999999998 2024-09-13T05:13:12.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:12.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.910728+0000", 2024-09-13T05:13:12.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0032001260000000002 2024-09-13T05:13:12.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.179 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:12.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.911722+0000", 2024-09-13T05:13:12.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00099400599999999997 2024-09-13T05:13:12.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.179 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:12.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.911849+0000", 2024-09-13T05:13:12.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000126353 2024-09-13T05:13:12.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.179 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.911947+0000", 2024-09-13T05:13:12.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7965000000000001e-05 2024-09-13T05:13:12.180 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.180 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.180 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.180 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:205621 3.1b 3:da5cbb91:::rbd_data.112d34bb0b84.0000000000000132:head [delete] snapc 1a=[] ondisk+write+known_if_redirected+supports_pool_eio e173)", 2024-09-13T05:13:12.180 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:07.906781+0000", 2024-09-13T05:13:12.180 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.1869654819999997, 2024-09-13T05:13:12.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0051954330000000002, 2024-09-13T05:13:12.180 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.180 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:12.180 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.180 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.181 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.181 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 205621 2024-09-13T05:13:12.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.181 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906781+0000", 2024-09-13T05:13:12.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906781+0000", 2024-09-13T05:13:12.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906779+0000", 2024-09-13T05:13:12.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:12.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906786+0000", 2024-09-13T05:13:12.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9720000000000003e-06 2024-09-13T05:13:12.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906800+0000", 2024-09-13T05:13:12.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3268000000000001e-05 2024-09-13T05:13:12.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.906809+0000", 2024-09-13T05:13:12.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7170000000000003e-06 2024-09-13T05:13:12.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.907013+0000", 2024-09-13T05:13:12.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000203616 2024-09-13T05:13:12.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.907261+0000", 2024-09-13T05:13:12.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024787700000000003 2024-09-13T05:13:12.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.184 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 7", 2024-09-13T05:13:12.184 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.907469+0000", 2024-09-13T05:13:12.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020855799999999999 2024-09-13T05:13:12.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.184 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:12.184 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.911287+0000", 2024-09-13T05:13:12.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.003818007 2024-09-13T05:13:12.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.184 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:12.184 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.911794+0000", 2024-09-13T05:13:12.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00050637000000000002 2024-09-13T05:13:12.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:12.185 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.911891+0000", 2024-09-13T05:13:12.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6835000000000004e-05 2024-09-13T05:13:12.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.185 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:07.911976+0000", 2024-09-13T05:13:12.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5408000000000006e-05 2024-09-13T05:13:12.185 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.185 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.185 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.186 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7486 3.13 e174/153 3:cd8ae6b5:::rbd_data.112d667fb7f9.0000000000000061:19 v 174'1266, mlcod=174'1262)", 2024-09-13T05:13:12.186 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:08.810849+0000", 2024-09-13T05:13:12.186 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.2828974679999998, 2024-09-13T05:13:12.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0061914229999999997, 2024-09-13T05:13:12.186 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.186 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:12.186 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.810849+0000", 2024-09-13T05:13:12.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.187 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.810849+0000", 2024-09-13T05:13:12.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.187 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.810848+0000", 2024-09-13T05:13:12.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:12.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.187 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.810855+0000", 2024-09-13T05:13:12.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.153e-06 2024-09-13T05:13:12.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.810863+0000", 2024-09-13T05:13:12.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1300000000000001e-06 2024-09-13T05:13:12.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.810870+0000", 2024-09-13T05:13:12.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3940000000000001e-06 2024-09-13T05:13:12.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.810907+0000", 2024-09-13T05:13:12.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7410000000000003e-05 2024-09-13T05:13:12.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.810925+0000", 2024-09-13T05:13:12.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7838000000000001e-05 2024-09-13T05:13:12.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:12.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.817006+0000", 2024-09-13T05:13:12.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0060812280000000002 2024-09-13T05:13:12.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.817040+0000", 2024-09-13T05:13:12.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3933999999999997e-05 2024-09-13T05:13:12.190 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.190 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.190 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.190 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7487 3.13 e174/153 3:cba8ba28:::rbd_data.112d667fb7f9.00000000000001c3:19 v 174'1268, mlcod=174'1262)", 2024-09-13T05:13:12.190 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:08.811674+0000", 2024-09-13T05:13:12.190 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.2820716569999999, 2024-09-13T05:13:12.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0068301730000000001, 2024-09-13T05:13:12.190 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.190 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:12.190 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811674+0000", 2024-09-13T05:13:12.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811674+0000", 2024-09-13T05:13:12.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811674+0000", 2024-09-13T05:13:12.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:12.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811680+0000", 2024-09-13T05:13:12.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6460000000000004e-06 2024-09-13T05:13:12.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811694+0000", 2024-09-13T05:13:12.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4066999999999999e-05 2024-09-13T05:13:12.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811702+0000", 2024-09-13T05:13:12.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3549999999999999e-06 2024-09-13T05:13:12.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813840+0000", 2024-09-13T05:13:12.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002138137 2024-09-13T05:13:12.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813859+0000", 2024-09-13T05:13:12.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9006999999999999e-05 2024-09-13T05:13:12.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:12.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.818469+0000", 2024-09-13T05:13:12.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0046097070000000002 2024-09-13T05:13:12.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.818505+0000", 2024-09-13T05:13:12.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6026999999999999e-05 2024-09-13T05:13:12.194 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.194 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.194 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.194 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop_reply(osd.4.0:385 3.1a e174/151 ondisk, result = 0)", 2024-09-13T05:13:12.194 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:08.813470+0000", 2024-09-13T05:13:12.194 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 3.2802765479999998, 2024-09-13T05:13:12.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0060296129999999996, 2024-09-13T05:13:12.195 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.195 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:12.195 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.195 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.195 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813470+0000", 2024-09-13T05:13:12.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.195 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813470+0000", 2024-09-13T05:13:12.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.196 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813469+0000", 2024-09-13T05:13:12.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:12.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.196 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813474+0000", 2024-09-13T05:13:12.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2220000000000001e-06 2024-09-13T05:13:12.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.197 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813483+0000", 2024-09-13T05:13:12.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4239999999999993e-06 2024-09-13T05:13:12.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.197 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813487+0000", 2024-09-13T05:13:12.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5129999999999998e-06 2024-09-13T05:13:12.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.197 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.819441+0000", 2024-09-13T05:13:12.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0059542969999999999 2024-09-13T05:13:12.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.198 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.198 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.819450+0000", 2024-09-13T05:13:12.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4759999999999998e-06 2024-09-13T05:13:12.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.198 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.198 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.819499+0000", 2024-09-13T05:13:12.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9364999999999999e-05 2024-09-13T05:13:12.198 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.198 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.198 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.198 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.198 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.199 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:12.200 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:13:12.200 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:12.198+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:12.301 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:12.295+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:12.313 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:12.313 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:12.313 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:13:12.313 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:12.325 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:13:12.402 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:12.399+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:12.428 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:12.428 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:12.428 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:13:12.428 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:13:12.428 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:12.437 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:13:12.503 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:12.498+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:12.598 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:12.598 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:13:12.598 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:13:12.598 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:13:12.598 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.599 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3.bb1d1096 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:13:12.599 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:13:12.599 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 108.65019542100001, 2024-09-13T05:13:12.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68834410099999999, 2024-09-13T05:13:12.599 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.599 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:12.599 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.599 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.599 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.599 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:13:12.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.599 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:13:12.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.600 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:13:12.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.600 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943719+0000", 2024-09-13T05:13:12.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:13:12.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.601 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.601 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.601 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943734+0000", 2024-09-13T05:13:12.601 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4793e-05 2024-09-13T05:13:12.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.601 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.601 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.601 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943765+0000", 2024-09-13T05:13:12.601 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0648999999999997e-05 2024-09-13T05:13:12.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.601 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.601 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.601 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943779+0000", 2024-09-13T05:13:12.601 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.447e-05 2024-09-13T05:13:12.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943872+0000", 2024-09-13T05:13:12.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3304e-05 2024-09-13T05:13:12.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:12.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943884+0000", 2024-09-13T05:13:12.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.167e-05 2024-09-13T05:13:12.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.603 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632042+0000", 2024-09-13T05:13:12.603 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68815832600000004 2024-09-13T05:13:12.603 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.603 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.603 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.603 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632066+0000", 2024-09-13T05:13:12.603 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3765999999999999e-05 2024-09-13T05:13:12.603 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.603 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.603 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.603 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.603 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.603 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3.b6bd6256 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:13:12.604 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:13:12.604 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 108.65007092099999, 2024-09-13T05:13:12.604 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68852592499999998, 2024-09-13T05:13:12.604 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.604 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:12.604 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.604 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.604 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.604 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:13:12.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.604 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.604 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.604 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:13:12.605 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.605 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.605 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:13:12.605 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943846+0000", 2024-09-13T05:13:12.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:12.606 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943852+0000", 2024-09-13T05:13:12.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3820000000000001e-06 2024-09-13T05:13:12.606 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943876+0000", 2024-09-13T05:13:12.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3995e-05 2024-09-13T05:13:12.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.607 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.607 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943898+0000", 2024-09-13T05:13:12.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1838999999999999e-05 2024-09-13T05:13:12.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.607 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.607 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946457+0000", 2024-09-13T05:13:12.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025588910000000002 2024-09-13T05:13:12.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.608 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:12.608 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946499+0000", 2024-09-13T05:13:12.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2814e-05 2024-09-13T05:13:12.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.608 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.608 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632364+0000", 2024-09-13T05:13:12.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68586484999999997 2024-09-13T05:13:12.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.608 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.608 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632372+0000", 2024-09-13T05:13:12.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1659999999999994e-06 2024-09-13T05:13:12.609 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.609 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.609 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.609 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3:6908b8dd:::rbd_data.112d8d1317eb.000000000000000f:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:13:12.609 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:13:12.609 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 108.612926843, 2024-09-13T05:13:12.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65181049499999999, 2024-09-13T05:13:12.609 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.609 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:12.609 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.609 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.610 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.610 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:13:12.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.610 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:13:12.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:13:12.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980989+0000", 2024-09-13T05:13:12.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:12.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980996+0000", 2024-09-13T05:13:12.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2200000000000003e-06 2024-09-13T05:13:12.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.613 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.613 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981011+0000", 2024-09-13T05:13:12.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4997000000000001e-05 2024-09-13T05:13:12.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.613 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.613 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981025+0000", 2024-09-13T05:13:12.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3604000000000001e-05 2024-09-13T05:13:12.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.613 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.613 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981110+0000", 2024-09-13T05:13:12.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4948000000000001e-05 2024-09-13T05:13:12.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:12.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981120+0000", 2024-09-13T05:13:12.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9399999999999997e-06 2024-09-13T05:13:12.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632425+0000", 2024-09-13T05:13:12.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65130460499999998 2024-09-13T05:13:12.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632587+0000", 2024-09-13T05:13:12.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016199500000000001 2024-09-13T05:13:12.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632801+0000", 2024-09-13T05:13:12.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021459499999999999 2024-09-13T05:13:12.615 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.615 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.615 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.615 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3:6a46bd6d:::rbd_data.112d8d1317eb.0000000000000010:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:13:12.615 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:13:12.616 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 108.612869187, 2024-09-13T05:13:12.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65213695699999996, 2024-09-13T05:13:12.616 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.616 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:12.616 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.616 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.616 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.616 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:13:12.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.616 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:13:12.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:13:12.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:13:12.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:12.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981052+0000", 2024-09-13T05:13:12.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4469999999999999e-06 2024-09-13T05:13:12.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.618 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.618 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981066+0000", 2024-09-13T05:13:12.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3658e-05 2024-09-13T05:13:12.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.618 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.618 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981073+0000", 2024-09-13T05:13:12.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:13:12.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.618 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981150+0000", 2024-09-13T05:13:12.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7783999999999999e-05 2024-09-13T05:13:12.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:12.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981161+0000", 2024-09-13T05:13:12.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0197000000000001e-05 2024-09-13T05:13:12.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632926+0000", 2024-09-13T05:13:12.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65176517300000003 2024-09-13T05:13:12.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633081+0000", 2024-09-13T05:13:12.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000155172 2024-09-13T05:13:12.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633185+0000", 2024-09-13T05:13:12.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000104329 2024-09-13T05:13:12.620 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.620 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.620 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.621 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:159585 3.1c 3:3afcc414:::rbd_data.112dfd94ee88.00000000000002ca:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:12.621 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:13:12.621 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 65.579550874000006, 2024-09-13T05:13:12.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91717655399999998, 2024-09-13T05:13:12.621 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.621 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:12.621 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.621 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.621 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.621 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 159585 2024-09-13T05:13:12.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.621 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:13:12.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:13:12.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014366+0000", 2024-09-13T05:13:12.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:12.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014370+0000", 2024-09-13T05:13:12.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9960000000000004e-06 2024-09-13T05:13:12.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014379+0000", 2024-09-13T05:13:12.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8550000000000008e-06 2024-09-13T05:13:12.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014386+0000", 2024-09-13T05:13:12.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0140000000000001e-06 2024-09-13T05:13:12.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014533+0000", 2024-09-13T05:13:12.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000147458 2024-09-13T05:13:12.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:12.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014545+0000", 2024-09-13T05:13:12.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1318000000000001e-05 2024-09-13T05:13:12.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931378+0000", 2024-09-13T05:13:12.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91683292400000005 2024-09-13T05:13:12.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931495+0000", 2024-09-13T05:13:12.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011726399999999999 2024-09-13T05:13:12.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931543+0000", 2024-09-13T05:13:12.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8183000000000003e-05 2024-09-13T05:13:12.625 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.625 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.625 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.626 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.626 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160206 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 83968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:12.626 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:13:12.626 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 65.556148476999994, 2024-09-13T05:13:12.626 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89412730799999995, 2024-09-13T05:13:12.626 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.626 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:12.626 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.626 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.626 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.626 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160206 2024-09-13T05:13:12.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.627 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.627 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.627 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:13:12.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.627 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.627 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:13:12.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.628 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.628 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037768+0000", 2024-09-13T05:13:12.628 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:12.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.628 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.628 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037774+0000", 2024-09-13T05:13:12.628 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3600000000000001e-06 2024-09-13T05:13:12.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.628 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.628 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037786+0000", 2024-09-13T05:13:12.628 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.188e-05 2024-09-13T05:13:12.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.629 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.629 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037793+0000", 2024-09-13T05:13:12.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2749999999999998e-06 2024-09-13T05:13:12.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.629 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.629 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:13:12.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0353000000000003e-05 2024-09-13T05:13:12.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.629 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:12.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037862+0000", 2024-09-13T05:13:12.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9710000000000004e-06 2024-09-13T05:13:12.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.630 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.630 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931610+0000", 2024-09-13T05:13:12.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89374846299999999 2024-09-13T05:13:12.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.630 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.630 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931815+0000", 2024-09-13T05:13:12.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020516499999999999 2024-09-13T05:13:12.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.631 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.631 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.631 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931896+0000", 2024-09-13T05:13:12.631 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1157999999999998e-05 2024-09-13T05:13:12.631 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.631 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.631 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.631 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.631 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160208 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 84992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:12.631 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:13:12.631 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 65.556063738000006, 2024-09-13T05:13:12.631 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440702299999997, 2024-09-13T05:13:12.632 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.632 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:12.632 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.632 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.632 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.632 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160208 2024-09-13T05:13:12.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.632 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.632 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.632 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:13:12.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.633 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.633 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:13:12.633 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.633 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.633 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037853+0000", 2024-09-13T05:13:12.633 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:12.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.633 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.633 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037858+0000", 2024-09-13T05:13:12.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2179999999999998e-06 2024-09-13T05:13:12.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.634 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.634 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037867+0000", 2024-09-13T05:13:12.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5699999999999993e-06 2024-09-13T05:13:12.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.634 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.634 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037874+0000", 2024-09-13T05:13:12.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2810000000000003e-06 2024-09-13T05:13:12.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.635 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.635 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037935+0000", 2024-09-13T05:13:12.635 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1231999999999999e-05 2024-09-13T05:13:12.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.635 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.635 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:12.635 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037944+0000", 2024-09-13T05:13:12.635 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8580000000000006e-06 2024-09-13T05:13:12.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.635 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.635 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.635 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931956+0000", 2024-09-13T05:13:12.635 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89401158800000002 2024-09-13T05:13:12.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.636 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.636 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.636 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932015+0000", 2024-09-13T05:13:12.636 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8906999999999997e-05 2024-09-13T05:13:12.636 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.636 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.636 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.636 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932261+0000", 2024-09-13T05:13:12.636 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024622799999999997 2024-09-13T05:13:12.636 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.636 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.636 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.636 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.636 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.637 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160210 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 86016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:12.637 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:13:12.637 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 65.555994884, 2024-09-13T05:13:12.637 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89428998299999996, 2024-09-13T05:13:12.637 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.637 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:12.637 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.637 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.637 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.637 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160210 2024-09-13T05:13:12.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.637 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.637 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.637 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:13:12.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:13:12.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037922+0000", 2024-09-13T05:13:12.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:12.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.639 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.639 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.639 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037926+0000", 2024-09-13T05:13:12.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6550000000000003e-06 2024-09-13T05:13:12.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.639 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.639 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.639 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037933+0000", 2024-09-13T05:13:12.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5409999999999997e-06 2024-09-13T05:13:12.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.639 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.639 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.639 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037939+0000", 2024-09-13T05:13:12.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1940000000000003e-06 2024-09-13T05:13:12.640 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.640 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.640 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.640 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037976+0000", 2024-09-13T05:13:12.640 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6671000000000002e-05 2024-09-13T05:13:12.640 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.640 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.640 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:12.640 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037982+0000", 2024-09-13T05:13:12.640 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9669999999999998e-06 2024-09-13T05:13:12.640 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.640 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.640 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.640 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932096+0000", 2024-09-13T05:13:12.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89411465599999995 2024-09-13T05:13:12.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932149+0000", 2024-09-13T05:13:12.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3032999999999999e-05 2024-09-13T05:13:12.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932213+0000", 2024-09-13T05:13:12.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3165999999999998e-05 2024-09-13T05:13:12.641 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.641 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.642 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.642 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160212 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 87040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:12.642 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:13:12.642 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 65.555907762999993, 2024-09-13T05:13:12.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440379699999994, 2024-09-13T05:13:12.642 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.642 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:12.642 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.642 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.642 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.642 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160212 2024-09-13T05:13:12.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.643 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.643 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.643 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.643 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:13:12.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.643 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.643 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.643 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.643 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:13:12.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.644 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.644 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.644 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038009+0000", 2024-09-13T05:13:12.644 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:12.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.644 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.644 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.644 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038013+0000", 2024-09-13T05:13:12.644 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3950000000000003e-06 2024-09-13T05:13:12.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.644 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.644 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038032+0000", 2024-09-13T05:13:12.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8513999999999999e-05 2024-09-13T05:13:12.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.645 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038039+0000", 2024-09-13T05:13:12.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.985e-06 2024-09-13T05:13:12.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.645 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038086+0000", 2024-09-13T05:13:12.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7302999999999998e-05 2024-09-13T05:13:12.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.646 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:12.646 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038090+0000", 2024-09-13T05:13:12.646 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9029999999999997e-06 2024-09-13T05:13:12.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.646 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.646 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.646 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932291+0000", 2024-09-13T05:13:12.646 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89420100199999997 2024-09-13T05:13:12.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.646 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.646 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.646 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932352+0000", 2024-09-13T05:13:12.646 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1354999999999998e-05 2024-09-13T05:13:12.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.647 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.647 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932414+0000", 2024-09-13T05:13:12.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1037999999999994e-05 2024-09-13T05:13:12.647 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.647 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.647 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.647 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160214 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 88064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:12.647 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:13:12.647 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 65.555776696999999, 2024-09-13T05:13:12.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89438890900000001, 2024-09-13T05:13:12.648 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.648 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:12.648 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.648 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.648 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.648 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160214 2024-09-13T05:13:12.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.648 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.648 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.648 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.648 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:13:12.648 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.649 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.649 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.649 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:13:12.649 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.649 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.649 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.649 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.649 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038140+0000", 2024-09-13T05:13:12.649 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:12.649 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.649 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.649 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.649 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038145+0000", 2024-09-13T05:13:12.649 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9749999999999998e-06 2024-09-13T05:13:12.650 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.650 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.650 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.650 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038153+0000", 2024-09-13T05:13:12.650 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1280000000000008e-06 2024-09-13T05:13:12.650 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.650 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.650 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.650 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038161+0000", 2024-09-13T05:13:12.650 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0339999999999997e-06 2024-09-13T05:13:12.650 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.650 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.650 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.650 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038199+0000", 2024-09-13T05:13:12.651 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8269999999999998e-05 2024-09-13T05:13:12.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.651 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.651 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:12.651 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038204+0000", 2024-09-13T05:13:12.651 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5399999999999997e-06 2024-09-13T05:13:12.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.651 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.651 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.651 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932438+0000", 2024-09-13T05:13:12.651 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89423397999999998 2024-09-13T05:13:12.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.651 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.651 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.652 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932480+0000", 2024-09-13T05:13:12.652 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2392999999999999e-05 2024-09-13T05:13:12.652 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.652 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.652 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.652 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932530+0000", 2024-09-13T05:13:12.652 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:13:12.652 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.652 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.652 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.652 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.652 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.652 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160305 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 215040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:12.652 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:13:12.653 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 65.551573474999998, 2024-09-13T05:13:12.653 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89028175300000001, 2024-09-13T05:13:12.653 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.653 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:12.653 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.653 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.653 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.653 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160305 2024-09-13T05:13:12.653 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.653 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.653 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.653 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.653 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:13:12.654 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.654 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.654 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.654 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:13:12.654 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.654 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.654 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.654 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042343+0000", 2024-09-13T05:13:12.654 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:12.654 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.654 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.655 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042350+0000", 2024-09-13T05:13:12.655 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3769999999999998e-06 2024-09-13T05:13:12.655 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.655 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.655 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.655 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042367+0000", 2024-09-13T05:13:12.655 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.734e-05 2024-09-13T05:13:12.655 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.655 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.655 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.655 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042375+0000", 2024-09-13T05:13:12.656 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8469999999999996e-06 2024-09-13T05:13:12.656 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.656 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.656 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.656 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042428+0000", 2024-09-13T05:13:12.656 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3074e-05 2024-09-13T05:13:12.656 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.656 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.656 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:12.656 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042437+0000", 2024-09-13T05:13:12.656 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:13:12.656 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.656 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.657 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.657 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932550+0000", 2024-09-13T05:13:12.657 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89011304300000005 2024-09-13T05:13:12.657 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.657 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.657 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.657 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932589+0000", 2024-09-13T05:13:12.657 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9236000000000002e-05 2024-09-13T05:13:12.657 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.657 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.657 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.657 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932626+0000", 2024-09-13T05:13:12.657 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6832999999999998e-05 2024-09-13T05:13:12.657 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.658 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.658 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.658 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.658 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.658 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160307 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 216064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:12.658 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:13:12.658 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 65.551527035999996, 2024-09-13T05:13:12.658 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89032630800000001, 2024-09-13T05:13:12.658 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.658 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:12.658 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.658 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.658 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.659 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160307 2024-09-13T05:13:12.659 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.659 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.659 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.659 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.659 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:13:12.659 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.659 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.659 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.659 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.659 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:13:12.659 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.659 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.659 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.660 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.660 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:13:12.660 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:12.660 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.660 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.660 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.660 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042394+0000", 2024-09-13T05:13:12.660 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7900000000000001e-06 2024-09-13T05:13:12.660 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.660 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.660 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.660 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042401+0000", 2024-09-13T05:13:12.661 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.267e-06 2024-09-13T05:13:12.661 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.661 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.661 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.661 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042406+0000", 2024-09-13T05:13:12.661 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0860000000000001e-06 2024-09-13T05:13:12.661 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.661 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.661 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.661 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042465+0000", 2024-09-13T05:13:12.661 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9441000000000002e-05 2024-09-13T05:13:12.661 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.661 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.661 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:12.662 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042471+0000", 2024-09-13T05:13:12.662 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6640000000000003e-06 2024-09-13T05:13:12.662 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.662 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.662 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.662 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932645+0000", 2024-09-13T05:13:12.662 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89017372900000002 2024-09-13T05:13:12.662 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.662 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.662 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.662 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932681+0000", 2024-09-13T05:13:12.662 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5918999999999999e-05 2024-09-13T05:13:12.662 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.662 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.663 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.663 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932717+0000", 2024-09-13T05:13:12.663 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6007999999999998e-05 2024-09-13T05:13:12.663 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.663 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.663 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.663 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.663 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.663 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160309 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 217088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:12.663 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:13:12.663 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 65.551476777000005, 2024-09-13T05:13:12.663 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89037315900000003, 2024-09-13T05:13:12.664 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.664 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:12.664 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.664 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.664 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.664 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160309 2024-09-13T05:13:12.664 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.664 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.664 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.664 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.664 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:13:12.664 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.665 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.665 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.665 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.665 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:13:12.665 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.665 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.665 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.665 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.665 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042440+0000", 2024-09-13T05:13:12.665 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:12.665 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.665 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.666 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.666 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042444+0000", 2024-09-13T05:13:12.666 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.104e-06 2024-09-13T05:13:12.666 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.666 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.666 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.666 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042451+0000", 2024-09-13T05:13:12.666 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.922e-06 2024-09-13T05:13:12.666 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.666 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.666 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.666 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042457+0000", 2024-09-13T05:13:12.666 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3979999999999998e-06 2024-09-13T05:13:12.666 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.667 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.667 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.667 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042497+0000", 2024-09-13T05:13:12.667 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0692999999999998e-05 2024-09-13T05:13:12.667 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.667 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.667 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:12.667 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042503+0000", 2024-09-13T05:13:12.667 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.553e-06 2024-09-13T05:13:12.667 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.667 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.667 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.667 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932735+0000", 2024-09-13T05:13:12.667 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89023238699999996 2024-09-13T05:13:12.668 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.668 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.668 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.668 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932771+0000", 2024-09-13T05:13:12.668 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5972000000000001e-05 2024-09-13T05:13:12.668 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.668 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.668 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.668 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932814+0000", 2024-09-13T05:13:12.668 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2657000000000002e-05 2024-09-13T05:13:12.668 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.668 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.668 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.669 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.669 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.669 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160311 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 218112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:12.669 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:13:12.669 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 65.551451287000006, 2024-09-13T05:13:12.669 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89045284400000002, 2024-09-13T05:13:12.669 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.669 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:12.669 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.669 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.669 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.669 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160311 2024-09-13T05:13:12.670 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.670 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.670 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.670 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.670 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:13:12.670 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.670 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.670 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.670 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.670 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:13:12.670 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.670 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.670 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.671 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.671 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:13:12.671 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:12.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.671 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.671 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.671 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042469+0000", 2024-09-13T05:13:12.671 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.456e-06 2024-09-13T05:13:12.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.671 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.671 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.671 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042475+0000", 2024-09-13T05:13:12.671 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0990000000000004e-06 2024-09-13T05:13:12.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.672 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.672 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.672 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042481+0000", 2024-09-13T05:13:12.672 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.237e-06 2024-09-13T05:13:12.672 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.672 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.672 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.672 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042527+0000", 2024-09-13T05:13:12.672 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6796999999999999e-05 2024-09-13T05:13:12.672 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.672 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.673 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:12.673 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042533+0000", 2024-09-13T05:13:12.673 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6489999999999996e-06 2024-09-13T05:13:12.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.673 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.673 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.673 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932832+0000", 2024-09-13T05:13:12.673 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89029919800000001 2024-09-13T05:13:12.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.673 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.673 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.673 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932867+0000", 2024-09-13T05:13:12.673 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5049000000000003e-05 2024-09-13T05:13:12.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.674 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.674 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.674 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932919+0000", 2024-09-13T05:13:12.674 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1780999999999998e-05 2024-09-13T05:13:12.674 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.674 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.674 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.674 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.674 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.674 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160313 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 219136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:12.674 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:13:12.674 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 65.551422196000004, 2024-09-13T05:13:12.674 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89064232600000004, 2024-09-13T05:13:12.675 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.675 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:12.675 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.675 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.675 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.675 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160313 2024-09-13T05:13:12.675 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.675 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.675 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.675 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.675 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:13:12.675 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.675 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.676 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.676 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.676 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:13:12.676 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.676 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.676 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.676 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.676 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:13:12.676 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:12.676 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.676 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.676 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.677 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042498+0000", 2024-09-13T05:13:12.677 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.281e-06 2024-09-13T05:13:12.677 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.677 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.677 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.677 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042505+0000", 2024-09-13T05:13:12.677 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2699999999999999e-06 2024-09-13T05:13:12.677 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.677 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.677 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.677 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042512+0000", 2024-09-13T05:13:12.677 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0330000000000003e-06 2024-09-13T05:13:12.678 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.678 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.678 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042557+0000", 2024-09-13T05:13:12.678 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4425999999999998e-05 2024-09-13T05:13:12.678 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.678 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:12.678 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042562+0000", 2024-09-13T05:13:12.678 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3639999999999998e-06 2024-09-13T05:13:12.678 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.679 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.679 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932987+0000", 2024-09-13T05:13:12.679 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89042472299999997 2024-09-13T05:13:12.679 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.679 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.679 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.679 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933062+0000", 2024-09-13T05:13:12.679 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5129999999999994e-05 2024-09-13T05:13:12.679 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.679 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.679 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.679 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933138+0000", 2024-09-13T05:13:12.680 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5536000000000003e-05 2024-09-13T05:13:12.680 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.680 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.680 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.680 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.680 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.680 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160315 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 220160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:12.680 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:13:12.680 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 65.551391029000001, 2024-09-13T05:13:12.680 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89071820800000001, 2024-09-13T05:13:12.680 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.680 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:12.680 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.681 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.681 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.681 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160315 2024-09-13T05:13:12.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.681 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.681 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.681 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:13:12.681 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.681 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.681 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:13:12.681 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.682 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.682 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:13:12.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:12.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.682 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.682 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042529+0000", 2024-09-13T05:13:12.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3639999999999999e-06 2024-09-13T05:13:12.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.682 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.683 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042536+0000", 2024-09-13T05:13:12.683 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.866e-06 2024-09-13T05:13:12.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.683 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.683 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.683 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042541+0000", 2024-09-13T05:13:12.683 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:13:12.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.683 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.683 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.683 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042587+0000", 2024-09-13T05:13:12.683 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5735000000000002e-05 2024-09-13T05:13:12.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.684 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:12.684 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042593+0000", 2024-09-13T05:13:12.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0719999999999996e-06 2024-09-13T05:13:12.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.684 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.684 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933160+0000", 2024-09-13T05:13:12.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89056621000000002 2024-09-13T05:13:12.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.684 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.684 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933202+0000", 2024-09-13T05:13:12.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2376000000000002e-05 2024-09-13T05:13:12.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.685 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.685 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933245+0000", 2024-09-13T05:13:12.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2787999999999998e-05 2024-09-13T05:13:12.685 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.685 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.685 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.685 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160317 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:12.685 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:13:12.686 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 65.5513622, 2024-09-13T05:13:12.686 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89082205800000003, 2024-09-13T05:13:12.686 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.686 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:12.686 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.686 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.686 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.686 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160317 2024-09-13T05:13:12.686 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.686 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.686 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.686 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.686 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:13:12.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:13:12.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:13:12.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:12.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.688 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042558+0000", 2024-09-13T05:13:12.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1810000000000001e-06 2024-09-13T05:13:12.688 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.688 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.688 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.688 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042565+0000", 2024-09-13T05:13:12.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9280000000000004e-06 2024-09-13T05:13:12.688 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.688 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.688 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.688 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042571+0000", 2024-09-13T05:13:12.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7420000000000003e-06 2024-09-13T05:13:12.688 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.689 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.689 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.689 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042616+0000", 2024-09-13T05:13:12.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5201999999999999e-05 2024-09-13T05:13:12.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.689 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.689 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:12.689 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042622+0000", 2024-09-13T05:13:12.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8289999999999996e-06 2024-09-13T05:13:12.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.689 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.689 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.689 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933259+0000", 2024-09-13T05:13:12.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89063730799999996 2024-09-13T05:13:12.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933311+0000", 2024-09-13T05:13:12.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1910000000000003e-05 2024-09-13T05:13:12.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933377+0000", 2024-09-13T05:13:12.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6396999999999995e-05 2024-09-13T05:13:12.690 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.690 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.690 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.691 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160319 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 222208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:12.691 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:13:12.691 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 65.551331984000001, 2024-09-13T05:13:12.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89087477400000004, 2024-09-13T05:13:12.691 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.691 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:12.691 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.691 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.691 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.691 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160319 2024-09-13T05:13:12.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.692 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.692 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.692 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:13:12.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.692 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.692 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:13:12.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042585+0000", 2024-09-13T05:13:12.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:12.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042588+0000", 2024-09-13T05:13:12.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9450000000000002e-06 2024-09-13T05:13:12.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042594+0000", 2024-09-13T05:13:12.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0959999999999997e-06 2024-09-13T05:13:12.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042599+0000", 2024-09-13T05:13:12.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0069999999999997e-06 2024-09-13T05:13:12.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042642+0000", 2024-09-13T05:13:12.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2553999999999999e-05 2024-09-13T05:13:12.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.695 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:12.695 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042647+0000", 2024-09-13T05:13:12.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.31e-06 2024-09-13T05:13:12.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.695 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.695 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933387+0000", 2024-09-13T05:13:12.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89073982799999996 2024-09-13T05:13:12.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.695 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.695 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:13:12.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7101000000000003e-05 2024-09-13T05:13:12.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.696 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.696 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.696 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933460+0000", 2024-09-13T05:13:12.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6282999999999998e-05 2024-09-13T05:13:12.696 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.696 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.696 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.696 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.696 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160321 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 223232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:12.696 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:13:12.696 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 65.551302557, 2024-09-13T05:13:12.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89094616999999998, 2024-09-13T05:13:12.696 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.697 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:12.697 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.697 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.697 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.697 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160321 2024-09-13T05:13:12.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.697 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:13:12.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:13:12.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:13:12.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:12.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042617+0000", 2024-09-13T05:13:12.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8329999999999998e-06 2024-09-13T05:13:12.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.699 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042638+0000", 2024-09-13T05:13:12.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0908e-05 2024-09-13T05:13:12.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.699 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042644+0000", 2024-09-13T05:13:12.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0440000000000001e-06 2024-09-13T05:13:12.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.699 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042666+0000", 2024-09-13T05:13:12.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1256000000000001e-05 2024-09-13T05:13:12.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.700 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:12.700 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042671+0000", 2024-09-13T05:13:12.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6250000000000004e-06 2024-09-13T05:13:12.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.700 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.700 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933478+0000", 2024-09-13T05:13:12.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89080698800000002 2024-09-13T05:13:12.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.700 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.700 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933519+0000", 2024-09-13T05:13:12.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0717000000000003e-05 2024-09-13T05:13:12.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933561+0000", 2024-09-13T05:13:12.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2225999999999999e-05 2024-09-13T05:13:12.701 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.701 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.701 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.701 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:201615 3.1d 3:bb015654:::rbd_data.112d9dba7cdc.000000000000000a:head [delete] snapc 30=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2024-09-13T05:13:12.701 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:13:12.701 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 32.589065775999998, 2024-09-13T05:13:12.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.90842926999999996, 2024-09-13T05:13:12.701 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:12.702 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:12.702 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:12.702 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:12.702 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:12.702 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 201615 2024-09-13T05:13:12.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.702 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:12.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.702 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:12.702 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:13:12.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:12.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:13:12.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:12.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:12.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004850+0000", 2024-09-13T05:13:12.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:12.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:12.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004860+0000", 2024-09-13T05:13:12.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.927e-06 2024-09-13T05:13:12.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:12.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004882+0000", 2024-09-13T05:13:12.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2079999999999999e-05 2024-09-13T05:13:12.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:12.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004897+0000", 2024-09-13T05:13:12.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4892000000000001e-05 2024-09-13T05:13:12.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.005068+0000", 2024-09-13T05:13:12.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017098999999999999 2024-09-13T05:13:12.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:12.705 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.005081+0000", 2024-09-13T05:13:12.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3063e-05 2024-09-13T05:13:12.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:12.705 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.910925+0000", 2024-09-13T05:13:12.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.90584383400000001 2024-09-13T05:13:12.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:12.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.911131+0000", 2024-09-13T05:13:12.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020629399999999999 2024-09-13T05:13:12.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.706 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 4", 2024-09-13T05:13:12.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.911313+0000", 2024-09-13T05:13:12.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000182175 2024-09-13T05:13:12.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:12.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913010+0000", 2024-09-13T05:13:12.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0016971550000000001 2024-09-13T05:13:12.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:12.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913212+0000", 2024-09-13T05:13:12.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000202237 2024-09-13T05:13:12.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:12.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913253+0000", 2024-09-13T05:13:12.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0250999999999998e-05 2024-09-13T05:13:12.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:12.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:12.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:12.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913281+0000", 2024-09-13T05:13:12.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8314e-05 2024-09-13T05:13:12.708 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.708 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.708 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.708 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:12.708 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:12.708 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:12.709 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:13:12.710 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:12.707+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:12.810 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:12.807+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:12.821 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:12.821 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:12.821 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:13:12.821 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:12.830 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:13:12.850 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is set 2024-09-13T05:13:12.911 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:12.907+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:12.996 INFO:tasks.thrashosds.thrasher:in_osds: [2, 3, 5, 7, 1, 4] out_osds: [0, 6] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-13T05:13:12.996 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:13:12.996 INFO:tasks.thrashosds.thrasher:Adding osd 6 2024-09-13T05:13:12.996 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 6 2024-09-13T05:13:13.001 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:13.001 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:13.001 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:13:13.001 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:13:13.001 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:13.011 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:13:13.012 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:13.006+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:13.113 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:13.111+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:13.115 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:13.115 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:13:13.115 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:13:13.115 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:13:13.115 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.115 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29021 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2865152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.115 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:13:13.116 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.06950477300001, 2024-09-13T05:13:13.116 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060927993999999999, 2024-09-13T05:13:13.116 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.116 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:13.116 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.116 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.116 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.116 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29021 2024-09-13T05:13:13.116 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.116 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.117 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.117 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.117 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:13:13.117 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.117 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.117 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.117 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.117 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:13:13.117 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.117 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.117 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.117 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.118 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041763+0000", 2024-09-13T05:13:13.118 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.118 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.118 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.118 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.118 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041766+0000", 2024-09-13T05:13:13.118 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6800000000000002e-06 2024-09-13T05:13:13.118 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.118 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.118 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.118 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041771+0000", 2024-09-13T05:13:13.118 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:13:13.119 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.119 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.119 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.119 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041776+0000", 2024-09-13T05:13:13.119 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8489999999999997e-06 2024-09-13T05:13:13.119 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.119 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.119 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.119 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102513+0000", 2024-09-13T05:13:13.119 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060737102000000001 2024-09-13T05:13:13.119 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.119 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.119 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:13.119 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102597+0000", 2024-09-13T05:13:13.120 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4374000000000002e-05 2024-09-13T05:13:13.120 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.120 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.120 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.120 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102692+0000", 2024-09-13T05:13:13.120 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4436000000000002e-05 2024-09-13T05:13:13.120 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.120 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.120 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.120 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.120 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.120 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29022 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2874368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.121 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:13:13.121 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.06948847300001, 2024-09-13T05:13:13.121 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061135083999999999, 2024-09-13T05:13:13.121 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.121 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:13.121 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.121 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.121 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.121 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29022 2024-09-13T05:13:13.121 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.121 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.121 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.121 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.122 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:13:13.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.122 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.122 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.122 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.122 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:13:13.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.122 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.122 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.122 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.122 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:13:13.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.122 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.122 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.123 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.123 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041782+0000", 2024-09-13T05:13:13.123 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4959999999999999e-06 2024-09-13T05:13:13.123 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.123 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.123 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.123 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041787+0000", 2024-09-13T05:13:13.123 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1240000000000004e-06 2024-09-13T05:13:13.123 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.123 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.123 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.123 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041792+0000", 2024-09-13T05:13:13.123 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9200000000000003e-06 2024-09-13T05:13:13.123 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.124 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.124 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.124 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102738+0000", 2024-09-13T05:13:13.124 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060945581999999998 2024-09-13T05:13:13.124 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.124 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.124 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:13.124 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102821+0000", 2024-09-13T05:13:13.124 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2898999999999994e-05 2024-09-13T05:13:13.124 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.124 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.124 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.124 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102915+0000", 2024-09-13T05:13:13.124 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4523000000000003e-05 2024-09-13T05:13:13.125 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.125 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.125 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.125 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.125 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.125 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29067 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2764800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.125 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:13:13.125 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.06571425600001, 2024-09-13T05:13:13.125 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060816621000000001, 2024-09-13T05:13:13.125 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.125 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:13.126 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.126 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.126 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.126 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29067 2024-09-13T05:13:13.126 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.126 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.126 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.126 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.126 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:13:13.126 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.126 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.126 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.126 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.126 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:13:13.127 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.127 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.127 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.127 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.127 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:13:13.127 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.127 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.127 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.127 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.127 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045557+0000", 2024-09-13T05:13:13.127 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.898e-06 2024-09-13T05:13:13.127 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.127 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.127 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.128 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045575+0000", 2024-09-13T05:13:13.128 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8252000000000001e-05 2024-09-13T05:13:13.128 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.128 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.128 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.128 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045581+0000", 2024-09-13T05:13:13.128 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:13:13.128 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.128 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.128 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.128 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106183+0000", 2024-09-13T05:13:13.128 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060602630999999997 2024-09-13T05:13:13.128 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.129 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.129 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:13.129 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106271+0000", 2024-09-13T05:13:13.129 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7329000000000004e-05 2024-09-13T05:13:13.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.129 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.129 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.129 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106371+0000", 2024-09-13T05:13:13.129 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000100164 2024-09-13T05:13:13.129 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.129 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.129 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.129 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.130 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29068 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2774016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.130 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:13:13.130 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.065683022, 2024-09-13T05:13:13.130 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060994509000000002, 2024-09-13T05:13:13.130 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.130 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:13.130 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.130 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.130 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.130 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29068 2024-09-13T05:13:13.130 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.130 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.130 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.131 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.131 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:13:13.131 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.131 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.131 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.131 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.131 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:13:13.131 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.131 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.131 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.131 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.131 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045585+0000", 2024-09-13T05:13:13.131 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.132 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.132 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.132 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.132 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045588+0000", 2024-09-13T05:13:13.132 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:13:13.132 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.132 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.132 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.132 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045594+0000", 2024-09-13T05:13:13.132 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9329999999999998e-06 2024-09-13T05:13:13.132 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.132 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.132 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.133 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045599+0000", 2024-09-13T05:13:13.133 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3190000000000002e-06 2024-09-13T05:13:13.133 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.133 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.133 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.133 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106399+0000", 2024-09-13T05:13:13.133 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060800361999999997 2024-09-13T05:13:13.133 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.133 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.133 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:13.133 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106489+0000", 2024-09-13T05:13:13.133 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9301000000000004e-05 2024-09-13T05:13:13.133 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.134 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.134 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.134 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106580+0000", 2024-09-13T05:13:13.134 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1314e-05 2024-09-13T05:13:13.134 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.134 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.134 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.134 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.134 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.134 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29069 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2792448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.134 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:13:13.134 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.06566460499999, 2024-09-13T05:13:13.134 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061207599000000001, 2024-09-13T05:13:13.135 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.135 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:13.135 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.135 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.135 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.135 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29069 2024-09-13T05:13:13.135 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.135 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.135 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.135 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.135 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:13:13.136 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.136 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.136 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.136 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.136 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:13:13.136 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.136 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.136 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.136 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.136 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045603+0000", 2024-09-13T05:13:13.136 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.137 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.137 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.137 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045606+0000", 2024-09-13T05:13:13.137 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7300000000000001e-06 2024-09-13T05:13:13.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.137 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.137 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.137 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045612+0000", 2024-09-13T05:13:13.137 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9599999999999997e-06 2024-09-13T05:13:13.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.137 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.137 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.138 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045619+0000", 2024-09-13T05:13:13.138 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6019999999999996e-06 2024-09-13T05:13:13.138 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.138 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.138 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.138 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106619+0000", 2024-09-13T05:13:13.138 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061000029999999997 2024-09-13T05:13:13.138 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.138 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.138 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:13.138 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106713+0000", 2024-09-13T05:13:13.139 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4505000000000004e-05 2024-09-13T05:13:13.139 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.139 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.139 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.139 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106812+0000", 2024-09-13T05:13:13.139 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8264000000000007e-05 2024-09-13T05:13:13.139 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.139 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.139 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.139 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.139 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.139 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29070 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2783232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.139 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:13:13.139 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.06564414600001, 2024-09-13T05:13:13.140 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061389805999999998, 2024-09-13T05:13:13.140 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.140 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:13.140 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.140 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.140 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.140 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29070 2024-09-13T05:13:13.140 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.140 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.140 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.140 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.140 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:13:13.140 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.141 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.141 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.141 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.141 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:13:13.141 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.141 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.141 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.141 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.141 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:13:13.141 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.141 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.141 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.142 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.142 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045627+0000", 2024-09-13T05:13:13.142 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6579999999999998e-06 2024-09-13T05:13:13.142 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.142 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.142 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.142 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045632+0000", 2024-09-13T05:13:13.142 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8449999999999999e-06 2024-09-13T05:13:13.142 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.142 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.142 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.143 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045639+0000", 2024-09-13T05:13:13.143 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:13:13.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.143 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.143 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.143 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106837+0000", 2024-09-13T05:13:13.143 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061198529000000002 2024-09-13T05:13:13.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.143 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.143 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:13.143 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106922+0000", 2024-09-13T05:13:13.143 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4771999999999994e-05 2024-09-13T05:13:13.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.143 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.144 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.144 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107014+0000", 2024-09-13T05:13:13.144 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2009000000000006e-05 2024-09-13T05:13:13.144 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.144 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.144 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.144 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.144 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.144 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29071 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2801664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.144 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:13:13.144 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.06562507000001, 2024-09-13T05:13:13.144 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061582804999999997, 2024-09-13T05:13:13.144 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.144 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:13.144 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.145 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.145 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.145 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29071 2024-09-13T05:13:13.145 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.145 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.145 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.145 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.145 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:13:13.145 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.145 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.145 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.145 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.145 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:13:13.145 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.146 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.146 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.146 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.146 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045643+0000", 2024-09-13T05:13:13.146 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.146 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.146 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.146 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.146 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045646+0000", 2024-09-13T05:13:13.146 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:13:13.146 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.146 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.146 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.146 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045664+0000", 2024-09-13T05:13:13.147 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8408000000000001e-05 2024-09-13T05:13:13.147 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.147 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.147 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.147 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045670+0000", 2024-09-13T05:13:13.147 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7710000000000003e-06 2024-09-13T05:13:13.147 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.147 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.147 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.147 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107048+0000", 2024-09-13T05:13:13.147 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061378438 2024-09-13T05:13:13.147 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.147 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.147 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:13.147 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107134+0000", 2024-09-13T05:13:13.148 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5574000000000004e-05 2024-09-13T05:13:13.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.148 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.148 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.148 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107226+0000", 2024-09-13T05:13:13.148 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2262000000000005e-05 2024-09-13T05:13:13.148 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.148 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.148 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.148 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.148 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29072 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2810880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.148 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:13:13.149 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.065593686, 2024-09-13T05:13:13.149 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061762233999999999, 2024-09-13T05:13:13.149 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.149 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:13.149 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.149 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.149 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.149 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29072 2024-09-13T05:13:13.149 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.149 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.149 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.150 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.150 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:13:13.150 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.150 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.150 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.150 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.150 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:13:13.150 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.150 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.151 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.151 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.151 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045674+0000", 2024-09-13T05:13:13.151 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.151 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.151 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.151 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.151 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045677+0000", 2024-09-13T05:13:13.151 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9679999999999998e-06 2024-09-13T05:13:13.151 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.151 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.151 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.152 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045694+0000", 2024-09-13T05:13:13.152 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6801999999999999e-05 2024-09-13T05:13:13.152 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.152 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.152 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.152 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045700+0000", 2024-09-13T05:13:13.152 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8270000000000003e-06 2024-09-13T05:13:13.152 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.152 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.152 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.152 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107249+0000", 2024-09-13T05:13:13.152 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061549114000000002 2024-09-13T05:13:13.152 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.152 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.153 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:13.153 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107341+0000", 2024-09-13T05:13:13.153 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2390000000000001e-05 2024-09-13T05:13:13.153 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.153 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.153 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.153 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107437+0000", 2024-09-13T05:13:13.153 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5648000000000003e-05 2024-09-13T05:13:13.153 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.153 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.153 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.153 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.153 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.154 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29073 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2820096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.154 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:13:13.154 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.06555170799999, 2024-09-13T05:13:13.154 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061873910999999997, 2024-09-13T05:13:13.154 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.154 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:13.154 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.154 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.154 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.154 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29073 2024-09-13T05:13:13.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.154 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.154 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.154 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:13:13.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:13:13.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045716+0000", 2024-09-13T05:13:13.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.156 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045726+0000", 2024-09-13T05:13:13.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6350000000000001e-06 2024-09-13T05:13:13.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.156 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.156 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045739+0000", 2024-09-13T05:13:13.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3325e-05 2024-09-13T05:13:13.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.156 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.156 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045746+0000", 2024-09-13T05:13:13.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7399999999999998e-06 2024-09-13T05:13:13.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.157 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.157 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107457+0000", 2024-09-13T05:13:13.157 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061711038000000003 2024-09-13T05:13:13.157 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.157 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:13.157 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107522+0000", 2024-09-13T05:13:13.157 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4850000000000004e-05 2024-09-13T05:13:13.157 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.157 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.157 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107591+0000", 2024-09-13T05:13:13.157 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9029999999999995e-05 2024-09-13T05:13:13.158 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.158 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.158 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.158 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.158 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.158 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29074 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2829312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.158 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:13:13.158 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.06551780000001, 2024-09-13T05:13:13.158 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062055459, 2024-09-13T05:13:13.158 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.158 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:13.158 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.158 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.158 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.159 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29074 2024-09-13T05:13:13.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.159 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.159 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.159 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.159 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:13:13.159 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.159 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.159 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.159 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:13:13.159 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.159 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045750+0000", 2024-09-13T05:13:13.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045753+0000", 2024-09-13T05:13:13.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8399999999999999e-06 2024-09-13T05:13:13.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045759+0000", 2024-09-13T05:13:13.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8900000000000004e-06 2024-09-13T05:13:13.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.161 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045764+0000", 2024-09-13T05:13:13.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3850000000000001e-06 2024-09-13T05:13:13.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.161 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107623+0000", 2024-09-13T05:13:13.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061858817000000003 2024-09-13T05:13:13.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.161 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:13.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107710+0000", 2024-09-13T05:13:13.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7127999999999997e-05 2024-09-13T05:13:13.162 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.162 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.162 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.162 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107806+0000", 2024-09-13T05:13:13.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5886999999999999e-05 2024-09-13T05:13:13.162 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.162 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.162 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.162 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.162 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.162 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29075 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2838528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.162 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:13:13.162 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.065499346, 2024-09-13T05:13:13.163 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062188516999999999, 2024-09-13T05:13:13.163 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.163 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:13.163 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.163 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.163 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.163 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29075 2024-09-13T05:13:13.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.163 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.163 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.163 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:13:13.163 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.164 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.164 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.164 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.164 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:13:13.164 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.164 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.164 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.164 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.164 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:13:13.164 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.165 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.165 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045772+0000", 2024-09-13T05:13:13.165 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:13:13.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.165 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.165 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045778+0000", 2024-09-13T05:13:13.165 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9229999999999996e-06 2024-09-13T05:13:13.166 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.166 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.166 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045784+0000", 2024-09-13T05:13:13.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3800000000000002e-06 2024-09-13T05:13:13.166 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.166 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.167 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107823+0000", 2024-09-13T05:13:13.167 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062039331000000003 2024-09-13T05:13:13.167 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.167 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:13.167 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107886+0000", 2024-09-13T05:13:13.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2476000000000003e-05 2024-09-13T05:13:13.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.168 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.168 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.168 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107958+0000", 2024-09-13T05:13:13.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2089999999999996e-05 2024-09-13T05:13:13.168 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.169 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.169 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.169 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29115 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2682880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.169 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:13:13.169 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.06203381899999, 2024-09-13T05:13:13.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060847898999999997, 2024-09-13T05:13:13.170 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.170 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:13.170 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.170 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.170 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.170 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29115 2024-09-13T05:13:13.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.170 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:13:13.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.171 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:13:13.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.171 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049234+0000", 2024-09-13T05:13:13.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.171 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049237+0000", 2024-09-13T05:13:13.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9069999999999999e-06 2024-09-13T05:13:13.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049243+0000", 2024-09-13T05:13:13.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7459999999999997e-06 2024-09-13T05:13:13.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049248+0000", 2024-09-13T05:13:13.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1490000000000002e-06 2024-09-13T05:13:13.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.109945+0000", 2024-09-13T05:13:13.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060697299000000003 2024-09-13T05:13:13.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:13.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110013+0000", 2024-09-13T05:13:13.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8023999999999998e-05 2024-09-13T05:13:13.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110083+0000", 2024-09-13T05:13:13.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9296999999999997e-05 2024-09-13T05:13:13.173 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.174 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.174 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.174 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29116 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2692096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.174 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:13:13.175 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.06201597500001, 2024-09-13T05:13:13.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061040167999999999, 2024-09-13T05:13:13.175 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.175 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:13.175 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.175 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.175 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.176 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29116 2024-09-13T05:13:13.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.176 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:13:13.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:13:13.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049252+0000", 2024-09-13T05:13:13.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049255+0000", 2024-09-13T05:13:13.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7250000000000002e-06 2024-09-13T05:13:13.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049261+0000", 2024-09-13T05:13:13.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.755e-06 2024-09-13T05:13:13.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049266+0000", 2024-09-13T05:13:13.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2100000000000001e-06 2024-09-13T05:13:13.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110115+0000", 2024-09-13T05:13:13.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060849225999999999 2024-09-13T05:13:13.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:13.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110199+0000", 2024-09-13T05:13:13.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4339999999999995e-05 2024-09-13T05:13:13.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.179 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110293+0000", 2024-09-13T05:13:13.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3397e-05 2024-09-13T05:13:13.179 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.179 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.179 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.179 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29117 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2701312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.179 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:13:13.180 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.061998338, 2024-09-13T05:13:13.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.06118527, 2024-09-13T05:13:13.180 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.180 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:13.180 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.180 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.180 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.180 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29117 2024-09-13T05:13:13.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.180 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:13:13.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:13:13.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:13:13.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049273+0000", 2024-09-13T05:13:13.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.757e-06 2024-09-13T05:13:13.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049278+0000", 2024-09-13T05:13:13.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7830000000000004e-06 2024-09-13T05:13:13.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049284+0000", 2024-09-13T05:13:13.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3820000000000003e-06 2024-09-13T05:13:13.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110313+0000", 2024-09-13T05:13:13.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061029682000000002 2024-09-13T05:13:13.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:13.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110383+0000", 2024-09-13T05:13:13.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9406000000000006e-05 2024-09-13T05:13:13.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110456+0000", 2024-09-13T05:13:13.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2750000000000007e-05 2024-09-13T05:13:13.183 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.184 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.184 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.184 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29118 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2710528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.184 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:13:13.184 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.06198042299999, 2024-09-13T05:13:13.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061380698999999997, 2024-09-13T05:13:13.184 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.184 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:13.184 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.184 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.184 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.184 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29118 2024-09-13T05:13:13.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.185 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.185 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:13:13.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.185 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:13:13.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:13:13.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049291+0000", 2024-09-13T05:13:13.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8770000000000002e-06 2024-09-13T05:13:13.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049296+0000", 2024-09-13T05:13:13.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6799999999999998e-06 2024-09-13T05:13:13.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.187 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049302+0000", 2024-09-13T05:13:13.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2769999999999996e-06 2024-09-13T05:13:13.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110488+0000", 2024-09-13T05:13:13.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061186184999999997 2024-09-13T05:13:13.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:13.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110577+0000", 2024-09-13T05:13:13.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9246000000000006e-05 2024-09-13T05:13:13.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110669+0000", 2024-09-13T05:13:13.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1923999999999996e-05 2024-09-13T05:13:13.188 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.188 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.189 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.189 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29119 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2719744~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.189 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:13:13.189 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.061962679, 2024-09-13T05:13:13.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061521165000000003, 2024-09-13T05:13:13.189 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.189 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:13.189 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.189 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.189 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.189 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29119 2024-09-13T05:13:13.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.190 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:13:13.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:13:13.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049305+0000", 2024-09-13T05:13:13.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049308+0000", 2024-09-13T05:13:13.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7070000000000001e-06 2024-09-13T05:13:13.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049316+0000", 2024-09-13T05:13:13.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:13:13.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049322+0000", 2024-09-13T05:13:13.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3199999999999999e-06 2024-09-13T05:13:13.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110690+0000", 2024-09-13T05:13:13.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061368428000000003 2024-09-13T05:13:13.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:13.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110755+0000", 2024-09-13T05:13:13.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4893000000000004e-05 2024-09-13T05:13:13.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110827+0000", 2024-09-13T05:13:13.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2039000000000006e-05 2024-09-13T05:13:13.193 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.193 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.193 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.193 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29120 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2728960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.193 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:13:13.193 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.06194240900001, 2024-09-13T05:13:13.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061718420000000003, 2024-09-13T05:13:13.193 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.193 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:13.194 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.194 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.194 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.194 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29120 2024-09-13T05:13:13.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.194 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:13:13.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:13:13.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.195 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.195 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:13:13.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.195 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.195 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049329+0000", 2024-09-13T05:13:13.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.022e-06 2024-09-13T05:13:13.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.196 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049336+0000", 2024-09-13T05:13:13.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0720000000000002e-06 2024-09-13T05:13:13.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.196 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049341+0000", 2024-09-13T05:13:13.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:13:13.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.196 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110864+0000", 2024-09-13T05:13:13.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061523126999999997 2024-09-13T05:13:13.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:13.197 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110951+0000", 2024-09-13T05:13:13.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6557000000000005e-05 2024-09-13T05:13:13.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.197 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.111045+0000", 2024-09-13T05:13:13.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4043999999999996e-05 2024-09-13T05:13:13.197 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.197 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.197 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.198 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29136 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2876416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.198 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:13:13.198 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.05792698400001, 2024-09-13T05:13:13.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060742995000000001, 2024-09-13T05:13:13.198 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.198 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:13.198 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.198 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.198 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.198 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29136 2024-09-13T05:13:13.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.198 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.199 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.199 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:13:13.199 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.199 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.199 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.199 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.199 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:13:13.199 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.199 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.199 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.199 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.199 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053341+0000", 2024-09-13T05:13:13.199 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.199 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.199 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.200 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.200 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053344+0000", 2024-09-13T05:13:13.200 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:13:13.200 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.200 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.200 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.200 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053350+0000", 2024-09-13T05:13:13.200 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7200000000000003e-06 2024-09-13T05:13:13.200 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.200 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.200 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.200 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053355+0000", 2024-09-13T05:13:13.200 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0150000000000003e-06 2024-09-13T05:13:13.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113909+0000", 2024-09-13T05:13:13.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060554368999999997 2024-09-13T05:13:13.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:13.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113994+0000", 2024-09-13T05:13:13.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4658000000000002e-05 2024-09-13T05:13:13.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114085+0000", 2024-09-13T05:13:13.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0939000000000005e-05 2024-09-13T05:13:13.202 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.202 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.202 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.202 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29166 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2628608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.202 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:13:13.202 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.05790955000001, 2024-09-13T05:13:13.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060883127000000002, 2024-09-13T05:13:13.202 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.202 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:13.202 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.202 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.202 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.203 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29166 2024-09-13T05:13:13.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.203 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.203 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.203 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:13:13.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.203 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.203 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:13:13.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:13:13.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.204 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.204 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053361+0000", 2024-09-13T05:13:13.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:13:13.204 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.204 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.205 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053367+0000", 2024-09-13T05:13:13.205 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7350000000000001e-06 2024-09-13T05:13:13.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.205 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.205 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053372+0000", 2024-09-13T05:13:13.205 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7840000000000003e-06 2024-09-13T05:13:13.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.205 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.205 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114103+0000", 2024-09-13T05:13:13.205 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060730924999999998 2024-09-13T05:13:13.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.206 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:13.206 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114171+0000", 2024-09-13T05:13:13.206 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8021999999999993e-05 2024-09-13T05:13:13.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.206 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.206 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114242+0000", 2024-09-13T05:13:13.206 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1390999999999995e-05 2024-09-13T05:13:13.206 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.206 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.206 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.206 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:165308 3.3 3:c04a6a9a:::rbd_data.112dc3abcba6.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-13T05:13:13.207 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:13:13.207 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.979452264000003, 2024-09-13T05:13:13.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.085530595000000001, 2024-09-13T05:13:13.207 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.207 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:13.207 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.207 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.207 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.207 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 165308 2024-09-13T05:13:13.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.207 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.207 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.207 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:13:13.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.208 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:13:13.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.208 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131814+0000", 2024-09-13T05:13:13.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:13.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.208 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.209 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152479+0000", 2024-09-13T05:13:13.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020664281 2024-09-13T05:13:13.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.209 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.209 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152521+0000", 2024-09-13T05:13:13.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2567000000000001e-05 2024-09-13T05:13:13.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.209 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.209 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152536+0000", 2024-09-13T05:13:13.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4447000000000001e-05 2024-09-13T05:13:13.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.210 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.210 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152607+0000", 2024-09-13T05:13:13.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1687000000000007e-05 2024-09-13T05:13:13.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.210 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.210 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:13.210 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152753+0000", 2024-09-13T05:13:13.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000145861 2024-09-13T05:13:13.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.210 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.210 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:13.210 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.159991+0000", 2024-09-13T05:13:13.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0072373100000000003 2024-09-13T05:13:13.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:13.211 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.208492+0000", 2024-09-13T05:13:13.211 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048501003000000001 2024-09-13T05:13:13.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:13.211 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217224+0000", 2024-09-13T05:13:13.211 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0087320369999999998 2024-09-13T05:13:13.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:13.211 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217277+0000", 2024-09-13T05:13:13.211 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3841000000000002e-05 2024-09-13T05:13:13.212 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.212 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.212 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.212 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217347+0000", 2024-09-13T05:13:13.212 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9529999999999993e-05 2024-09-13T05:13:13.212 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.212 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.212 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.212 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.212 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.212 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:13.213 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:13:13.215 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:13.210+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:13.304 INFO:tasks.ceph.mon.a.smithi120.stderr:2024-09-13T05:13:13.298+0000 7fa8b7b30700 -1 mon.a@0(leader).osd e178 definitely_dead 0 2024-09-13T05:13:13.315 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:13.310+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:13.371 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:13.371 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:13.371 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:13:13.371 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:13.381 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:13:13.416 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:13.410+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:13.485 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:13.485 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:13.485 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:13:13.485 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:13:13.486 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:13.496 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:13:13.517 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:13.511+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:13.607 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:13.607 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:13:13.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:13:13.607 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:13:13.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.608 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.608 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:13:13.608 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.739818254, 2024-09-13T05:13:13.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:13:13.608 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.608 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:13.608 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.608 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.608 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.608 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:13:13.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.608 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:13:13.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:13:13.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:13:13.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:13.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:13:13.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:13:13.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:13:13.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:13:13.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:13:13.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:13:13.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:13:13.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:13:13.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:13.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:13:13.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:13:13.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:13:13.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:13:13.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:13.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:13:13.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:13:13.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:13:13.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:13:13.613 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.613 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.613 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.613 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.613 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:13:13.613 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.73979381800001, 2024-09-13T05:13:13.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:13:13.613 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.613 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:13.613 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.613 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.613 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.614 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:13:13.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.614 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:13:13.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:13:13.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:13:13.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:13.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:13:13.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:13:13.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:13:13.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:13:13.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:13:13.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:13:13.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:13:13.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:13:13.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:13.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:13:13.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:13:13.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:13:13.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:13:13.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:13.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:13:13.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:13:13.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.618 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.618 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:13:13.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:13:13.618 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.618 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.618 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.618 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.618 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:13:13.618 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.73978399200001, 2024-09-13T05:13:13.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:13:13.618 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.618 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:13.619 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.619 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.619 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.619 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:13:13.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.619 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:13:13.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:13:13.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:13:13.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:13.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:13:13.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:13:13.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:13:13.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:13:13.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:13:13.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:13:13.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:13:13.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:13:13.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:13.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:13:13.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:13:13.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:13:13.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:13:13.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:13:13.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:13:13.622 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.623 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.623 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.623 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.623 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:13:13.623 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.739775756, 2024-09-13T05:13:13.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:13:13.623 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.623 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:13.623 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.623 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.623 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.623 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:13:13.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.624 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:13:13.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:13:13.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:13:13.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:13.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:13:13.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:13:13.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:13:13.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:13:13.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.626 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.626 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:13:13.626 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:13:13.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.626 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.626 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.626 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:13:13.626 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:13:13.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.626 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.626 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:13.626 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:13:13.626 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:13:13.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.627 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.627 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:13:13.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:13:13.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.627 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.627 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:13:13.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:13:13.627 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.627 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.627 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.628 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.628 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:13:13.628 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.73975384400001, 2024-09-13T05:13:13.628 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:13:13.628 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.628 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:13.628 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.628 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.628 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.628 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:13:13.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.628 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.629 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.629 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:13:13.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.629 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.629 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:13:13.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.630 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:13:13.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:13.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.630 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.630 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:13:13.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:13:13.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.630 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.630 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:13:13.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:13:13.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.631 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.631 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.631 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:13:13.631 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:13:13.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.631 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.631 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.631 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:13:13.631 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:13:13.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.631 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.631 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:13.631 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:13:13.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:13:13.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.632 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.632 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:13:13.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:13:13.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.632 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.632 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:13:13.633 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:13:13.633 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.633 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.633 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.633 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.633 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:13:13.633 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.73974523999999, 2024-09-13T05:13:13.633 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:13:13.633 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.633 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:13.633 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.634 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.634 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.634 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:13:13.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.634 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.634 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.634 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:13:13.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.634 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.636 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:13:13.636 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.636 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.636 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.637 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.637 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:13:13.637 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:13.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.637 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.637 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.637 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:13:13.637 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:13:13.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.637 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.637 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.637 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:13:13.637 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:13:13.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:13:13.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:13:13.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:13:13.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:13:13.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:13.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:13:13.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:13:13.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.639 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.639 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.639 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:13:13.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:13:13.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.639 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.639 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.639 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:13:13.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:13:13.639 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.639 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.639 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.640 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.640 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.640 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:13:13.640 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.73973554599999, 2024-09-13T05:13:13.640 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:13:13.640 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.640 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:13.640 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.640 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.641 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.641 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:13:13.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.641 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:13:13.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:13:13.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.642 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:13:13.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:13.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.642 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:13:13.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:13:13.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.642 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:13:13.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:13:13.643 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.643 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.643 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.643 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:13:13.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:13:13.643 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.643 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.643 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.643 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:13:13.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:13:13.643 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.643 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.644 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:13.644 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:13:13.644 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:13:13.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.644 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.644 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.644 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:13:13.644 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:13:13.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.644 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.644 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:13:13.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:13:13.645 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.645 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.645 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.645 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.645 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:13:13.645 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.73972643100001, 2024-09-13T05:13:13.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:13:13.645 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.645 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:13.646 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.646 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.646 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.646 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:13:13.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.646 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.646 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.646 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.646 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:13:13.646 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.646 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.646 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.646 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:13:13.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.647 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.647 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:13:13.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:13.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.647 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.647 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:13:13.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:13:13.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.647 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.648 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:13:13.648 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:13:13.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.648 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.648 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.648 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:13:13.648 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:13:13.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.648 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.648 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.648 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:13:13.648 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:13:13.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.649 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.649 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:13.649 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:13:13.650 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:13:13.650 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.650 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.650 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.650 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:13:13.650 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:13:13.650 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.650 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.650 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.651 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:13:13.651 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:13:13.651 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.651 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.651 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.651 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.651 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.651 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:13:13.651 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.73971795200001, 2024-09-13T05:13:13.651 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:13:13.651 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.651 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:13.652 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.652 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.652 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.652 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:13:13.652 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.652 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.652 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.652 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.652 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:13:13.652 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.652 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.652 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.652 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.653 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:13:13.653 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.653 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.653 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.653 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.653 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:13:13.653 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.653 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.653 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.653 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.653 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:13:13.653 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:13:13.653 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.653 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.654 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.654 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:13:13.654 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:13:13.654 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.654 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.654 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:13:13.654 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:13:13.654 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.654 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.654 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:13:13.654 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:13:13.655 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.655 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.655 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:13.655 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:13:13.655 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:13:13.655 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.655 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.655 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.655 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:13:13.655 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:13:13.655 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.655 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.655 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.656 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:13:13.656 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:13:13.656 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.656 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.656 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.656 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.656 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.656 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.656 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:13:13.656 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.73970602700001, 2024-09-13T05:13:13.656 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:13:13.656 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.656 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:13.657 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.657 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.657 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.657 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:13:13.657 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.657 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.657 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.657 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.657 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:13:13.657 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.657 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.657 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.657 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.658 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:13:13.658 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.658 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.658 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.658 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.658 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:13:13.658 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:13.658 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.658 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.658 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.658 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:13:13.658 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:13:13.658 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.659 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.659 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.659 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:13:13.659 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:13:13.659 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.659 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.659 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.659 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:13:13.659 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:13:13.659 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.659 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.659 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.659 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:13:13.659 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:13:13.660 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.660 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.660 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:13.660 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:13:13.660 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:13:13.660 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.660 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.660 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.660 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:13:13.660 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:13:13.660 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.660 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.660 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.660 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:13:13.661 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:13:13.661 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.661 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.661 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.661 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.661 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.661 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.661 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:13:13.661 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.73968443800001, 2024-09-13T05:13:13.661 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:13:13.661 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.661 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:13.661 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.661 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.662 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.662 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:13:13.662 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.662 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.662 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.662 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.662 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:13:13.662 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.662 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.662 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.662 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.662 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:13:13.662 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.663 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.663 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.663 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.663 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:13:13.663 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.663 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.663 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.663 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.663 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:13:13.663 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:13:13.663 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.663 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.663 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.663 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:13:13.664 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:13:13.664 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.664 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.664 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.664 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:13:13.664 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:13:13.664 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.664 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.664 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.664 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:13:13.664 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:13:13.664 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.664 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.665 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:13.665 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:13:13.665 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:13:13.665 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.665 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.665 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.665 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:13:13.665 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:13:13.665 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.665 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.665 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.665 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:13:13.665 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:13:13.666 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.666 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.666 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.666 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.666 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.666 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.666 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:13:13.666 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.73966131, 2024-09-13T05:13:13.666 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:13:13.666 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.666 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:13.666 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.667 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.667 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.667 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:13:13.667 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.667 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.667 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.667 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.667 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:13:13.667 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.667 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.667 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.667 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.667 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:13:13.667 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.668 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.668 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.668 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.668 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:13:13.668 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.668 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.668 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.668 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.668 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:13:13.668 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:13:13.668 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.668 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.668 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.669 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:13:13.669 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:13:13.669 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.669 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.669 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.669 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:13:13.669 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:13:13.669 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.669 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.669 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.669 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:13:13.669 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:13:13.669 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.669 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.670 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:13.670 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:13:13.670 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:13:13.670 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.670 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.670 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.670 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:13:13.670 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:13:13.670 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.670 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.670 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.670 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:13:13.670 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:13:13.671 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.671 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.671 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.671 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.671 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.671 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:13:13.671 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.73964593700001, 2024-09-13T05:13:13.671 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:13:13.671 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.671 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:13.671 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.671 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.671 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.672 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:13:13.672 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.672 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.672 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.672 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.672 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:13:13.672 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.672 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.672 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.672 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.672 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:13:13.672 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.672 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.673 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.673 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.673 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:13:13.673 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.673 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.673 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.673 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:13:13.673 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:13:13.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.673 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.673 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.673 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:13:13.674 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:13:13.674 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.674 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.674 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.674 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:13:13.674 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:13:13.674 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.674 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.674 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.674 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:13:13.674 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:13:13.674 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.674 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.675 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:13.675 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:13:13.675 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:13:13.675 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.675 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.675 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.675 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:13:13.675 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:13:13.675 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.676 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.676 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.676 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:13:13.676 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:13:13.676 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.676 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.676 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.676 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.676 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.676 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.676 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:13:13.676 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.739625469, 2024-09-13T05:13:13.676 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:13:13.677 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.677 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:13.677 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.677 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.677 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.677 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:13:13.677 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.677 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.677 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.678 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.678 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:13:13.678 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.678 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.678 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.678 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:13:13.678 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.678 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.678 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.678 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:13:13.679 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.679 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.679 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.679 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.679 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:13:13.679 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:13:13.679 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.679 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.679 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.679 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:13:13.679 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:13:13.679 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.680 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.680 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.680 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:13:13.680 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:13:13.680 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.680 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.680 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.680 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:13:13.680 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:13:13.680 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.681 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:13.681 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:13:13.681 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:13:13.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.681 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.681 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:13:13.681 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:13:13.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.681 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.682 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:13:13.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:13:13.682 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.682 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.682 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.682 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.682 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:13:13.682 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.73960880800001, 2024-09-13T05:13:13.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:13:13.683 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.683 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:13.683 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.683 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.683 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.683 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:13:13.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.683 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.683 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.683 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.684 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:13:13.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.684 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.684 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:13:13.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.684 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.685 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:13:13.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.685 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.685 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:13:13.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:13:13.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.685 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.686 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:13:13.686 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:13:13.686 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.686 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.686 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.686 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:13:13.686 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:13:13.686 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.686 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.686 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.686 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:13:13.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:13:13.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:13.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:13:13.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:13:13.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:13:13.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:13:13.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.688 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:13:13.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:13:13.688 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.688 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.688 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.688 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.688 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.688 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.688 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:13:13.688 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.739582095, 2024-09-13T05:13:13.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:13:13.688 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.688 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:13.689 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.689 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.689 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.689 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:13:13.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.689 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.689 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.689 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.689 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:13:13.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:13:13.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:13:13.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:13:13.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:13:13.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:13:13.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:13:13.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.692 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.692 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:13:13.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:13:13.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.692 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.692 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:13:13.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:13:13.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.692 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:13.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:13:13.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:13:13.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:13:13.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:13:13.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:13:13.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:13:13.694 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.694 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.694 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.694 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.694 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:13:13.694 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.73956324299999, 2024-09-13T05:13:13.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:13:13.694 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.694 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:13.694 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.694 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.694 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.695 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:13:13.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.695 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.695 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.695 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:13:13.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.695 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.695 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:13:13.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.696 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.696 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.696 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:13:13.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.696 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.696 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.696 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:13:13.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:13:13.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:13:13.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:13:13.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:13:13.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:13:13.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:13:13.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:13:13.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:13.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:13:13.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:13:13.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:13:13.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:13:13.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.699 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:13:13.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:13:13.699 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.699 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.699 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.699 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.699 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:13:13.699 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.73954545699999, 2024-09-13T05:13:13.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:13:13.699 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.699 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:13.700 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.700 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.700 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.700 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:13:13.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.700 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.700 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.700 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:13:13.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.700 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:13:13.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:13:13.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:13:13.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:13:13.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.702 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.702 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:13:13.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:13:13.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.702 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.702 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:13:13.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:13:13.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.702 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.702 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:13:13.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:13:13.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:13.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:13:13.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:13:13.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:13:13.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:13:13.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:13:13.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:13:13.704 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.704 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.704 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.704 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.704 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:13:13.704 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.739510397, 2024-09-13T05:13:13.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:13:13.704 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.704 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:13.704 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.704 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.705 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.705 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:13:13.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.705 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.705 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:13:13.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.705 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:13:13.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.706 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:13:13.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.706 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:13:13.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:13:13.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.706 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:13:13.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:13:13.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:13:13.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:13:13.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:13:13.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:13:13.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:13.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:13:13.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:13:13.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:13:13.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:13:13.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:13:13.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:13:13.708 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.708 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.708 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.709 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:13.709 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:13:13.709 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 156.73949358199999, 2024-09-13T05:13:13.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:13:13.709 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:13.709 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:13.709 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:13.709 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:13.709 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:13.709 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:13:13.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.709 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:13.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:13.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:13:13.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:13.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:13:13.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:13.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:13.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:13:13.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:13.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:13.711 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:13:13.711 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:13:13.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.711 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:13.711 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:13:13.711 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:13:13.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.711 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:13.711 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:13:13.711 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:13:13.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.711 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.711 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:13:13.712 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:13:13.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.712 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.712 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:13.712 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:13:13.712 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:13:13.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.712 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.712 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:13.712 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:13:13.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:13:13.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:13.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:13.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:13.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:13:13.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:13:13.713 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.713 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.713 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.713 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:13.713 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:13.713 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:13.716 INFO:teuthology.orchestra.run.smithi120.stderr:marked in osd.6. 2024-09-13T05:13:13.716 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:13:13.717 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:13.711+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:13.717 INFO:tasks.thrashosds.thrasher:Added osd 6 2024-09-13T05:13:13.816 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:13.810+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:13.873 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:13.873 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:13.873 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:13:13.873 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:13.883 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:13:13.901 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:13:13.917 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:13.911+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:13.986 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:13:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:13:13.986 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:13.995 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:13:14.017 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:14.015+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:14.039 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:13:14.062 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:13:14.082 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:13:14.096 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:14.096 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:14.103 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:13:14.105 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:13:14.118 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:14.115+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:14.127 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:13:14.151 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:13:14.172 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:13:14.194 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:13:14.197 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:13:14.197 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:13:14.197 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:13:14.197 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:13:14.197 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:13:14.197 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:13:14.197 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:13:14.197 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:13:14.210 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:14.211 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:14.219 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:14.215+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:14.220 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:13:14.320 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:14.315+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:14.326 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:14.326 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:14.336 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:13:14.421 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:14.415+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:14.446 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:14.446 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:14.459 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:13:14.522 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:14.519+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:14.569 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:14.569 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:14.579 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:13:14.623 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:14.619+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:14.690 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:14.690 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:14.699 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:13:14.723 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:14.718+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:14.799 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:14.799 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:14.809 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:13:14.824 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:14.819+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:14.863 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T05:13:14.914 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:14.914 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:14.924 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:13:14.925 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:14.919+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:15.025 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:15.025 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:15.026 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:15.023+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:15.035 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:13:15.127 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:15.123+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:15.143 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:15.143 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:15.153 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:13:15.228 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:15.226+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:15.272 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:15.272 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:15.282 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:13:15.329 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:15.323+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:15.391 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:15.391 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:15.401 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:13:15.446 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:15.443+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:15.512 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:15.513 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:15.523 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:13:15.530 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:15.527+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:15.627 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:15.627 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:15.630 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:15.627+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:15.636 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:13:15.656 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is unset 2024-09-13T05:13:15.731 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:15.726+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:15.783 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:15.783 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:15.792 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:13:15.832 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:15.826+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:15.897 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:15.897 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:15.907 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:13:15.933 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:15.927+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:16.013 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:16.013 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:16.022 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:13:16.066 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:16.063+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:16.135 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:16.131+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:16.180 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:16.180 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:16.192 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:13:16.214 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:13:16.238 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:16.235+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:16.309 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:16.309 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:16.319 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:13:16.337 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:16.334+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:16.374 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:13:16.400 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:13:16.421 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:13:16.424 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:16.424 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:16.434 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:13:16.437 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:16.434+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:16.442 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:13:16.462 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:13:16.483 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:13:16.506 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:13:16.530 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:13:16.533 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:13:16.533 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:13:16.533 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:13:16.533 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:13:16.533 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:13:16.533 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:13:16.533 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:13:16.533 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:13:16.537 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:16.534+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:16.542 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:16.542 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:16.542 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:13:16.543 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:13:16.543 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:16.553 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:13:16.639 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:16.634+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:16.666 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:16.666 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:13:16.666 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:13:16.667 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:13:16.667 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.667 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:16.667 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:13:16.667 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 159.79889171100001, 2024-09-13T05:13:16.667 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:13:16.667 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:16.667 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:16.667 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:16.667 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:16.667 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:16.667 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:13:16.667 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.668 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:16.668 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.668 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:16.668 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:13:16.668 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.668 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.669 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.669 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:16.669 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:13:16.669 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.669 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.669 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.669 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:16.669 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:13:16.669 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:16.669 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.669 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.669 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:16.670 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:13:16.670 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:13:16.670 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.670 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.670 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:16.670 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:13:16.670 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:13:16.670 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.670 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.670 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:16.671 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:13:16.671 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:13:16.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.671 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.671 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.671 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:13:16.671 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:13:16.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.672 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.672 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:16.672 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:13:16.672 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:13:16.672 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.672 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.672 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.672 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:13:16.672 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:13:16.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.673 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.673 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:16.673 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:13:16.673 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:13:16.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.673 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.673 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:16.673 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:13:16.673 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:13:16.673 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.673 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:16.674 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.674 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.674 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.674 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:16.674 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:13:16.674 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 159.79886727499999, 2024-09-13T05:13:16.674 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:13:16.674 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:16.674 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:16.674 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:16.674 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:16.674 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:16.674 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:13:16.674 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.675 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:16.675 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.675 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:16.675 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:13:16.675 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.675 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.675 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.675 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:16.675 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:13:16.675 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.675 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.675 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.675 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:16.675 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:13:16.676 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:16.676 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.676 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.676 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:16.676 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:13:16.676 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:13:16.676 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.676 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.676 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:16.676 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:13:16.676 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:13:16.676 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.676 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.677 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:16.677 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:13:16.677 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:13:16.677 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.677 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.677 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.677 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:13:16.677 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:13:16.677 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.677 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.677 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:16.677 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:13:16.677 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:13:16.677 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.678 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.678 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:13:16.678 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:13:16.678 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.678 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:16.678 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:13:16.678 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:13:16.678 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.678 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:16.678 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:13:16.678 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:13:16.679 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.679 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:16.679 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.679 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.679 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.679 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:16.679 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:13:16.679 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 159.798857449, 2024-09-13T05:13:16.679 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:13:16.679 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:16.679 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:16.680 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:16.680 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:16.680 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:16.680 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:13:16.680 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.680 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:16.680 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.680 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:16.680 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:13:16.680 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.680 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.680 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:16.681 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:13:16.681 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.681 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:16.681 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:13:16.681 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:16.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.681 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:16.682 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:13:16.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:13:16.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.682 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:16.682 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:13:16.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:13:16.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.682 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:16.682 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:13:16.683 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:13:16.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.683 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.683 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.683 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:13:16.683 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:13:16.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.683 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.683 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:16.683 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:13:16.683 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:13:16.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.683 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.684 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.684 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:13:16.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:13:16.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.684 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:16.684 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:13:16.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:13:16.684 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.684 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:16.684 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.684 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:16.684 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:13:16.685 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 159.79884921300001, 2024-09-13T05:13:16.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:13:16.685 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:16.685 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:16.685 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:16.685 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:16.685 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:16.685 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:13:16.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.685 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:16.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.686 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:16.686 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:13:16.686 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.686 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.686 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.686 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:16.686 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:13:16.686 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.686 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.686 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:16.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:13:16.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:16.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:16.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:13:16.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:13:16.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:16.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:13:16.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:13:16.688 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.688 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.688 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:16.688 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:13:16.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:13:16.688 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.688 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.688 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.688 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:13:16.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:13:16.688 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.688 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.688 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:13:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:13:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:13:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:13:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:13:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:13:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:13:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 159.79882730099999, 2024-09-13T05:13:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:13:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:13:16.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:13:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:13:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:13:16.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:16.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.692 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:16.692 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:13:16.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:13:16.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.692 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:13:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:13:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:13:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:13:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:13:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:13:16.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:13:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:13:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:13:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:13:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:13:16.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:13:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:13:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 159.798818697, 2024-09-13T05:13:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:13:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:16.695 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:13:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:13:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:13:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.696 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:13:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:13:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:13:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:16.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:13:16.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:13:16.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:16.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:13:16.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:13:16.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:13:16.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:13:16.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:16.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:13:16.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:13:16.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.699 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:13:16.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:13:16.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.699 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:16.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:13:16.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:13:16.699 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.699 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:16.699 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:13:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 159.798809003, 2024-09-13T05:13:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:13:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:13:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.700 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:13:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:13:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:16.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:13:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:13:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:13:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:13:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:13:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:16.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:13:16.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:13:16.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:13:16.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:13:16.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:13:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:13:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:13:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:13:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:16.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:13:16.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:13:16.705 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.708 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:13:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 159.79879988799999, 2024-09-13T05:13:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:13:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:16.709 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:13:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:13:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:13:16.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.711 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:16.711 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:13:16.712 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:16.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.712 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.712 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:16.712 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:13:16.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:13:16.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:16.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:13:16.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:13:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:13:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:13:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:13:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:13:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:13:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:13:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:13:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:13:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:13:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:13:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.715 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:13:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 159.79879140899999, 2024-09-13T05:13:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:13:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:13:16.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:13:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:13:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:16.717 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:13:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:13:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:13:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:13:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:13:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.718 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:13:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:13:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:13:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:13:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:13:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:13:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.719 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:13:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:13:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:13:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:13:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.720 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:13:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 159.79877948399999, 2024-09-13T05:13:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:13:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:13:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:16.721 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:13:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:13:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:13:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.722 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:13:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:13:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:13:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:13:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:13:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:13:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.723 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:13:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:13:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:13:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:13:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:13:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:13:16.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:13:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:13:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:13:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 159.79875789499999, 2024-09-13T05:13:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:13:16.725 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:13:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:13:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.726 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:13:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:13:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:13:16.727 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:13:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:13:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:13:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:13:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:13:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.728 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:13:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:13:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:13:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:13:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:13:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:13:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.729 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:13:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:13:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:13:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 159.79873476700001, 2024-09-13T05:13:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:13:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:16.730 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:13:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:13:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:13:16.731 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:13:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:13:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:13:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:16.732 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:13:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:13:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:13:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:13:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:13:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:13:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:13:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:13:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:13:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:13:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:13:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:13:16.734 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:13:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 159.79871939399999, 2024-09-13T05:13:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:13:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:16.735 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:13:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:13:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:13:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.736 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:13:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:13:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:13:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:13:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:13:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.737 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:13:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:13:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:13:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:13:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:13:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:13:16.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:13:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:13:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:13:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:13:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:13:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 159.79869892599999, 2024-09-13T05:13:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:13:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:13:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.740 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:13:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:13:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:13:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.741 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:13:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:13:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:13:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:13:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:13:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:13:16.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:13:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:13:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:13:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:13:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:13:16.743 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:13:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:13:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:13:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:13:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 159.798682265, 2024-09-13T05:13:16.744 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:13:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:13:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:13:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.745 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:13:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:13:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:13:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:13:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.746 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:13:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:13:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:13:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:13:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:13:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:13:16.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:13:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:13:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:13:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:13:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:16.748 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:13:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:13:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:13:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 159.79865555200001, 2024-09-13T05:13:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:13:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:16.749 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:13:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:13:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:13:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:13:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:13:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:13:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:16.751 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:13:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:13:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:13:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:13:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:13:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:13:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.752 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:13:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:13:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:13:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:13:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:13:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:13:16.753 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:13:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 159.7986367, 2024-09-13T05:13:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:13:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:13:16.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:13:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:13:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.755 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:13:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:13:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:13:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:13:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:13:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:13:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:13:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:13:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:13:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:13:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:13:16.757 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:13:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:13:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:13:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:13:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.758 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:13:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 159.798618914, 2024-09-13T05:13:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:13:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:13:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.759 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:13:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:13:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:13:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:16.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:13:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:13:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:13:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:13:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:13:16.761 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:13:16.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.762 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:13:16.762 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:13:16.762 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.762 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.762 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:13:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:13:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:13:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:13:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:13:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:13:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.763 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:13:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 159.79858385399999, 2024-09-13T05:13:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:13:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:13:16.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:13:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:13:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:16.765 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:13:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:13:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:13:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:13:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:13:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.766 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:13:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:13:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:13:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:13:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:13:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:13:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.767 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:13:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:13:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:13:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:13:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:16.768 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:13:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 159.79856703900001, 2024-09-13T05:13:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:13:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:13:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:13:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:13:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:13:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:13:16.770 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:13:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:13:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:13:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:13:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:13:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.771 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:13:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:13:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:13:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:13:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:13:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:13:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:16.772 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:13:16.773 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:13:16.773 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.773 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:16.773 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.773 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:16.773 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:16.773 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:16.775 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:13:16.775 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:16.771+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:16.876 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:16.871+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:16.903 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:16.903 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:16.903 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:13:16.903 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:16.913 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:13:16.976 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:16.970+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:17.017 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:17.017 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:17.017 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:13:17.017 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:13:17.017 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:17.027 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:13:17.077 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:17.071+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:17.134 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:17.134 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:13:17.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:13:17.134 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [] 2024-09-13T05:13:17.134 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:17.143 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:13:17.178 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:17.174+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:17.262 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:17.262 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:17.262 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:13:17.262 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:17.272 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:13:17.317 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:17.314+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:17.380 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:17.374+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:17.435 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:17.435 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:17.435 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:13:17.435 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:13:17.435 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:17.446 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:13:17.481 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:17.478+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:17.564 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:17.564 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:13:17.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:13:17.564 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:13:17.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.564 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:159451 3.1b e117/116 3:d9c87acb:::rbd_data.112dc3abcba6.0000000000000003:head v 117'567, mlcod=0'0)", 2024-09-13T05:13:17.565 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:13:17.565 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.622466743999993, 2024-09-13T05:13:17.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064897325000000006, 2024-09-13T05:13:17.565 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:17.565 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:17.565 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:17.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:17.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:13:17.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:17.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:13:17.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:17.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938207+0000", 2024-09-13T05:13:17.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:13:17.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:17.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972794+0000", 2024-09-13T05:13:17.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.034587013 2024-09-13T05:13:17.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:17.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972821+0000", 2024-09-13T05:13:17.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6764e-05 2024-09-13T05:13:17.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:17.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972841+0000", 2024-09-13T05:13:17.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0191999999999999e-05 2024-09-13T05:13:17.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:17.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972905+0000", 2024-09-13T05:13:17.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4319000000000005e-05 2024-09-13T05:13:17.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:17.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972927+0000", 2024-09-13T05:13:17.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1135999999999999e-05 2024-09-13T05:13:17.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:13:17.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.002964+0000", 2024-09-13T05:13:17.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.030037123999999998 2024-09-13T05:13:17.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:17.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.003105+0000", 2024-09-13T05:13:17.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141614 2024-09-13T05:13:17.568 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.568 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:17.569 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.569 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159495 3.0 3:022f4da1:::rbd_data.112dfd94ee88.00000000000000e4:2a [read 167936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:17.569 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:13:17.569 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.547327323000005, 2024-09-13T05:13:17.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91926946899999995, 2024-09-13T05:13:17.569 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:17.569 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:17.569 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:17.569 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:17.569 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:17.569 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159495 2024-09-13T05:13:17.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.570 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:17.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:17.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:13:17.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:17.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:13:17.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:17.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013345+0000", 2024-09-13T05:13:17.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999971 2024-09-13T05:13:17.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:17.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013359+0000", 2024-09-13T05:13:17.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4752999999999999e-05 2024-09-13T05:13:17.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:17.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013418+0000", 2024-09-13T05:13:17.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8959000000000003e-05 2024-09-13T05:13:17.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:17.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013439+0000", 2024-09-13T05:13:17.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0749000000000001e-05 2024-09-13T05:13:17.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:17.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013563+0000", 2024-09-13T05:13:17.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012349400000000001 2024-09-13T05:13:17.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:17.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013583+0000", 2024-09-13T05:13:17.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0007e-05 2024-09-13T05:13:17.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:17.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932400+0000", 2024-09-13T05:13:17.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91881732400000005 2024-09-13T05:13:17.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:17.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932533+0000", 2024-09-13T05:13:17.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013263700000000001 2024-09-13T05:13:17.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:17.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932617+0000", 2024-09-13T05:13:17.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4313000000000004e-05 2024-09-13T05:13:17.573 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.574 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:17.574 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.574 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159517 3.0 3:03975f1c:::rbd_data.112dfd94ee88.0000000000000156:2a [read 167936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:17.574 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:13:17.574 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.547063609000006, 2024-09-13T05:13:17.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91962025700000005, 2024-09-13T05:13:17.574 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:17.574 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:17.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:17.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:17.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:17.574 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159517 2024-09-13T05:13:17.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.575 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:17.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:17.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:13:17.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:17.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:13:17.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:17.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013609+0000", 2024-09-13T05:13:17.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:17.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:17.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013619+0000", 2024-09-13T05:13:17.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0077e-05 2024-09-13T05:13:17.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:17.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013638+0000", 2024-09-13T05:13:17.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8739000000000001e-05 2024-09-13T05:13:17.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:17.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013653+0000", 2024-09-13T05:13:17.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5446000000000001e-05 2024-09-13T05:13:17.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:17.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016506+0000", 2024-09-13T05:13:17.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028525619999999999 2024-09-13T05:13:17.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:17.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016521+0000", 2024-09-13T05:13:17.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5310000000000001e-05 2024-09-13T05:13:17.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:17.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932964+0000", 2024-09-13T05:13:17.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91644284099999995 2024-09-13T05:13:17.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:17.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933097+0000", 2024-09-13T05:13:17.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013337599999999999 2024-09-13T05:13:17.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933231+0000", 2024-09-13T05:13:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133996 2024-09-13T05:13:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159622 3.0 3:03f7a45a:::rbd_data.112dfd94ee88.0000000000000318:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:13:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.545401798, 2024-09-13T05:13:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.918245003, 2024-09-13T05:13:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159622 2024-09-13T05:13:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:13:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:13:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015266+0000", 2024-09-13T05:13:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999928 2024-09-13T05:13:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015283+0000", 2024-09-13T05:13:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7309999999999999e-05 2024-09-13T05:13:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015318+0000", 2024-09-13T05:13:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5119e-05 2024-09-13T05:13:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015338+0000", 2024-09-13T05:13:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9259e-05 2024-09-13T05:13:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016558+0000", 2024-09-13T05:13:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012199909999999999 2024-09-13T05:13:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016567+0000", 2024-09-13T05:13:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2459999999999992e-06 2024-09-13T05:13:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933266+0000", 2024-09-13T05:13:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91669950300000003 2024-09-13T05:13:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:13:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015788099999999999 2024-09-13T05:13:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933518+0000", 2024-09-13T05:13:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3721000000000006e-05 2024-09-13T05:13:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173445 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 150528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:13:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.380825012999999, 2024-09-13T05:13:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064560905000000002, 2024-09-13T05:13:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173445 2024-09-13T05:13:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:13:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:13:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179849+0000", 2024-09-13T05:13:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179860+0000", 2024-09-13T05:13:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0419e-05 2024-09-13T05:13:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:17.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179866+0000", 2024-09-13T05:13:17.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.567e-06 2024-09-13T05:13:17.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:17.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179872+0000", 2024-09-13T05:13:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1830000000000002e-06 2024-09-13T05:13:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244262+0000", 2024-09-13T05:13:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064390814000000005 2024-09-13T05:13:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244321+0000", 2024-09-13T05:13:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8341000000000003e-05 2024-09-13T05:13:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244411+0000", 2024-09-13T05:13:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9911e-05 2024-09-13T05:13:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173446 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 157696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:13:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.380798245999998, 2024-09-13T05:13:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064714007000000004, 2024-09-13T05:13:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:17.590 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:17.590 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:17.590 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:17.590 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:17.590 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173446 2024-09-13T05:13:17.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.590 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:17.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:13:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:13:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179876+0000", 2024-09-13T05:13:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179879+0000", 2024-09-13T05:13:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1489999999999998e-06 2024-09-13T05:13:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179884+0000", 2024-09-13T05:13:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2800000000000003e-06 2024-09-13T05:13:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179889+0000", 2024-09-13T05:13:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7620000000000003e-06 2024-09-13T05:13:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244452+0000", 2024-09-13T05:13:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064562943999999997 2024-09-13T05:13:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244512+0000", 2024-09-13T05:13:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9879e-05 2024-09-13T05:13:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:17.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244591+0000", 2024-09-13T05:13:17.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8701000000000004e-05 2024-09-13T05:13:17.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.594 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:17.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.594 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173447 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 164864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:17.594 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:13:17.594 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.380781497999997, 2024-09-13T05:13:17.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064866246000000002, 2024-09-13T05:13:17.595 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:17.595 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:17.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:17.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:17.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:17.595 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173447 2024-09-13T05:13:17.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.595 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:17.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:17.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:13:17.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:17.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:13:17.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:17.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:13:17.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:17.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:17.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179895+0000", 2024-09-13T05:13:17.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6910000000000002e-06 2024-09-13T05:13:17.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:17.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179901+0000", 2024-09-13T05:13:17.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5149999999999997e-06 2024-09-13T05:13:17.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:17.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179905+0000", 2024-09-13T05:13:17.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4170000000000002e-06 2024-09-13T05:13:17.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:17.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244615+0000", 2024-09-13T05:13:17.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064709533999999999 2024-09-13T05:13:17.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:17.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244665+0000", 2024-09-13T05:13:17.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0283e-05 2024-09-13T05:13:17.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:17.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244760+0000", 2024-09-13T05:13:17.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4310999999999999e-05 2024-09-13T05:13:17.598 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.599 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:17.599 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.599 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173448 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 172032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:17.599 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:13:17.599 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.380765652000001, 2024-09-13T05:13:17.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065022046999999999, 2024-09-13T05:13:17.599 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:17.600 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:17.600 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:17.600 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:17.600 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:17.600 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173448 2024-09-13T05:13:17.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.600 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:17.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:17.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:13:17.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:17.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:13:17.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:17.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:13:17.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:17.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:17.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179914+0000", 2024-09-13T05:13:17.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6699999999999999e-06 2024-09-13T05:13:17.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:17.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179921+0000", 2024-09-13T05:13:17.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:13:17.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:17.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179926+0000", 2024-09-13T05:13:17.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8659999999999997e-06 2024-09-13T05:13:17.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:17.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244782+0000", 2024-09-13T05:13:17.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064856570000000002 2024-09-13T05:13:17.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:17.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244857+0000", 2024-09-13T05:13:17.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4326999999999995e-05 2024-09-13T05:13:17.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:17.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244931+0000", 2024-09-13T05:13:17.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4443999999999994e-05 2024-09-13T05:13:17.603 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.604 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:17.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.604 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173450 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 179200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:17.604 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:13:17.604 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.380744817999997, 2024-09-13T05:13:17.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065192589999999995, 2024-09-13T05:13:17.604 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:17.604 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:17.604 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:17.605 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:17.605 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:17.605 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173450 2024-09-13T05:13:17.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.605 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:17.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:17.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:13:17.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:13:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:13:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179932+0000", 2024-09-13T05:13:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2529999999999999e-06 2024-09-13T05:13:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179937+0000", 2024-09-13T05:13:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4219999999999999e-06 2024-09-13T05:13:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179942+0000", 2024-09-13T05:13:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3250000000000001e-06 2024-09-13T05:13:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244969+0000", 2024-09-13T05:13:17.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065027794999999999 2024-09-13T05:13:17.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:17.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245048+0000", 2024-09-13T05:13:17.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8812000000000004e-05 2024-09-13T05:13:17.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:17.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245123+0000", 2024-09-13T05:13:17.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4342000000000001e-05 2024-09-13T05:13:17.608 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.608 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:17.608 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173451 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:13:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.380728830999999, 2024-09-13T05:13:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359814000000002, 2024-09-13T05:13:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173451 2024-09-13T05:13:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:13:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:13:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:13:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179948+0000", 2024-09-13T05:13:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5119999999999998e-06 2024-09-13T05:13:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179954+0000", 2024-09-13T05:13:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5840000000000002e-06 2024-09-13T05:13:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179958+0000", 2024-09-13T05:13:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.566e-06 2024-09-13T05:13:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245160+0000", 2024-09-13T05:13:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065202057999999993 2024-09-13T05:13:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245228+0000", 2024-09-13T05:13:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7257999999999999e-05 2024-09-13T05:13:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245306+0000", 2024-09-13T05:13:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8227999999999997e-05 2024-09-13T05:13:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173452 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 193536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:13:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.380712344000003, 2024-09-13T05:13:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065505701, 2024-09-13T05:13:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173452 2024-09-13T05:13:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:13:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:13:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:13:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179965+0000", 2024-09-13T05:13:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.402e-06 2024-09-13T05:13:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179970+0000", 2024-09-13T05:13:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2290000000000002e-06 2024-09-13T05:13:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179974+0000", 2024-09-13T05:13:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5070000000000002e-06 2024-09-13T05:13:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245329+0000", 2024-09-13T05:13:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065354906000000004 2024-09-13T05:13:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245390+0000", 2024-09-13T05:13:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0878999999999998e-05 2024-09-13T05:13:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245468+0000", 2024-09-13T05:13:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8073999999999998e-05 2024-09-13T05:13:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173453 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 198656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:13:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.380696078, 2024-09-13T05:13:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065664343, 2024-09-13T05:13:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173453 2024-09-13T05:13:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:13:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:13:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179978+0000", 2024-09-13T05:13:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179981+0000", 2024-09-13T05:13:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4140000000000001e-06 2024-09-13T05:13:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179986+0000", 2024-09-13T05:13:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3519999999999997e-06 2024-09-13T05:13:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179991+0000", 2024-09-13T05:13:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6739999999999996e-06 2024-09-13T05:13:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245495+0000", 2024-09-13T05:13:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065504229999999997 2024-09-13T05:13:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245563+0000", 2024-09-13T05:13:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8119000000000003e-05 2024-09-13T05:13:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245643+0000", 2024-09-13T05:13:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9861e-05 2024-09-13T05:13:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173454 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:13:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.380647691, 2024-09-13T05:13:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065750457999999998, 2024-09-13T05:13:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173454 2024-09-13T05:13:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:13:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:13:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180026+0000", 2024-09-13T05:13:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180030+0000", 2024-09-13T05:13:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3790000000000002e-06 2024-09-13T05:13:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180036+0000", 2024-09-13T05:13:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5889999999999999e-06 2024-09-13T05:13:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180041+0000", 2024-09-13T05:13:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9980000000000003e-06 2024-09-13T05:13:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245667+0000", 2024-09-13T05:13:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065625124000000007 2024-09-13T05:13:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245705+0000", 2024-09-13T05:13:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7994000000000002e-05 2024-09-13T05:13:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245778+0000", 2024-09-13T05:13:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2999999999999999e-05 2024-09-13T05:13:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173455 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 212992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:13:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.380628983000001, 2024-09-13T05:13:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065899773999999994, 2024-09-13T05:13:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173455 2024-09-13T05:13:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:13:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:13:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180045+0000", 2024-09-13T05:13:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180048+0000", 2024-09-13T05:13:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5830000000000001e-06 2024-09-13T05:13:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180054+0000", 2024-09-13T05:13:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.789e-06 2024-09-13T05:13:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180059+0000", 2024-09-13T05:13:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.933e-06 2024-09-13T05:13:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245801+0000", 2024-09-13T05:13:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065742520999999998 2024-09-13T05:13:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245865+0000", 2024-09-13T05:13:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3325999999999996e-05 2024-09-13T05:13:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245946+0000", 2024-09-13T05:13:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0964999999999995e-05 2024-09-13T05:13:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173456 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:13:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.380611752, 2024-09-13T05:13:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066035128999999998, 2024-09-13T05:13:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173456 2024-09-13T05:13:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:13:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:13:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:13:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180065+0000", 2024-09-13T05:13:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4250000000000001e-06 2024-09-13T05:13:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180070+0000", 2024-09-13T05:13:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1749999999999996e-06 2024-09-13T05:13:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180075+0000", 2024-09-13T05:13:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4769999999999997e-06 2024-09-13T05:13:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245969+0000", 2024-09-13T05:13:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065894182999999995 2024-09-13T05:13:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246027+0000", 2024-09-13T05:13:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8165999999999998e-05 2024-09-13T05:13:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246098+0000", 2024-09-13T05:13:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1068999999999993e-05 2024-09-13T05:13:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173458 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:13:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.380595769000003, 2024-09-13T05:13:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066134732000000002, 2024-09-13T05:13:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173458 2024-09-13T05:13:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:13:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:13:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:13:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180081+0000", 2024-09-13T05:13:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4150000000000002e-06 2024-09-13T05:13:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180087+0000", 2024-09-13T05:13:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5389999999999998e-06 2024-09-13T05:13:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180101+0000", 2024-09-13T05:13:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4537e-05 2024-09-13T05:13:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246119+0000", 2024-09-13T05:13:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066017701999999998 2024-09-13T05:13:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246155+0000", 2024-09-13T05:13:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6094999999999999e-05 2024-09-13T05:13:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246214+0000", 2024-09-13T05:13:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8789000000000002e-05 2024-09-13T05:13:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173459 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 234496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:13:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.380568246000003, 2024-09-13T05:13:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066227460000000002, 2024-09-13T05:13:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173459 2024-09-13T05:13:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:13:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:13:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180106+0000", 2024-09-13T05:13:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180109+0000", 2024-09-13T05:13:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2219999999999998e-06 2024-09-13T05:13:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180115+0000", 2024-09-13T05:13:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9190000000000004e-06 2024-09-13T05:13:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180120+0000", 2024-09-13T05:13:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8930000000000004e-06 2024-09-13T05:13:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246236+0000", 2024-09-13T05:13:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066115638000000004 2024-09-13T05:13:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246273+0000", 2024-09-13T05:13:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7083999999999999e-05 2024-09-13T05:13:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246334+0000", 2024-09-13T05:13:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1183e-05 2024-09-13T05:13:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173460 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 241664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:13:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.38055044, 2024-09-13T05:13:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066360459999999996, 2024-09-13T05:13:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173460 2024-09-13T05:13:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:13:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:13:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:13:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180126+0000", 2024-09-13T05:13:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3120000000000001e-06 2024-09-13T05:13:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180132+0000", 2024-09-13T05:13:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.105e-06 2024-09-13T05:13:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180137+0000", 2024-09-13T05:13:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6829999999999999e-06 2024-09-13T05:13:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246365+0000", 2024-09-13T05:13:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066227584000000006 2024-09-13T05:13:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246413+0000", 2024-09-13T05:13:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8479000000000001e-05 2024-09-13T05:13:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246485+0000", 2024-09-13T05:13:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1600000000000006e-05 2024-09-13T05:13:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173461 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:13:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.380531671, 2024-09-13T05:13:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066492449999999995, 2024-09-13T05:13:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173461 2024-09-13T05:13:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:13:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:13:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:13:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180149+0000", 2024-09-13T05:13:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7239999999999997e-06 2024-09-13T05:13:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180153+0000", 2024-09-13T05:13:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7859999999999996e-06 2024-09-13T05:13:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180158+0000", 2024-09-13T05:13:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0300000000000001e-06 2024-09-13T05:13:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246508+0000", 2024-09-13T05:13:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066350100999999995 2024-09-13T05:13:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246568+0000", 2024-09-13T05:13:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9500000000000003e-05 2024-09-13T05:13:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246636+0000", 2024-09-13T05:13:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7633999999999997e-05 2024-09-13T05:13:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173462 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 256000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:13:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.379698843, 2024-09-13T05:13:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065773376999999994, 2024-09-13T05:13:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173462 2024-09-13T05:13:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:13:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:13:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180162+0000", 2024-09-13T05:13:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9991865 2024-09-13T05:13:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180984+0000", 2024-09-13T05:13:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00082184599999999999 2024-09-13T05:13:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180994+0000", 2024-09-13T05:13:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9000000000000001e-06 2024-09-13T05:13:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.181001+0000", 2024-09-13T05:13:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.917e-06 2024-09-13T05:13:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246653+0000", 2024-09-13T05:13:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065651820999999999 2024-09-13T05:13:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246698+0000", 2024-09-13T05:13:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.473e-05 2024-09-13T05:13:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246749+0000", 2024-09-13T05:13:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1758999999999997e-05 2024-09-13T05:13:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:17.658 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:17.659 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:13:17.660 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:17.655+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:17.670 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T05:13:17.760 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:17.754+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:17.838 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:17.838 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:17.838 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:13:17.839 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:17.848 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:13:17.893 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:17.890+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:17.954 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:17.954 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:17.954 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:13:17.954 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:13:17.954 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:17.961 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:17.958+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:17.963 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:13:18.062 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:18.059+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:18.078 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:18.078 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:13:18.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:13:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:13:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136560 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3908608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:13:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 84.979795092000003, 2024-09-13T05:13:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056148103999999997, 2024-09-13T05:13:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136560 2024-09-13T05:13:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.079 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:13:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:13:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095289+0000", 2024-09-13T05:13:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095292+0000", 2024-09-13T05:13:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.802e-06 2024-09-13T05:13:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095318+0000", 2024-09-13T05:13:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5987999999999999e-05 2024-09-13T05:13:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095323+0000", 2024-09-13T05:13:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.006e-06 2024-09-13T05:13:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151316+0000", 2024-09-13T05:13:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055992593 2024-09-13T05:13:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151371+0000", 2024-09-13T05:13:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5532999999999998e-05 2024-09-13T05:13:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151438+0000", 2024-09-13T05:13:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6557999999999995e-05 2024-09-13T05:13:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136562 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3922944~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:13:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 84.979757973999995, 2024-09-13T05:13:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056259690000000001, 2024-09-13T05:13:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.083 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136562 2024-09-13T05:13:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:13:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:13:18.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:13:18.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:18.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095329+0000", 2024-09-13T05:13:18.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3089999999999998e-06 2024-09-13T05:13:18.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095333+0000", 2024-09-13T05:13:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6239999999999999e-06 2024-09-13T05:13:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095335+0000", 2024-09-13T05:13:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5660000000000001e-06 2024-09-13T05:13:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151468+0000", 2024-09-13T05:13:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056132608000000001 2024-09-13T05:13:18.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151519+0000", 2024-09-13T05:13:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1681000000000002e-05 2024-09-13T05:13:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151587+0000", 2024-09-13T05:13:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7200999999999996e-05 2024-09-13T05:13:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136563 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3937280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:13:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 84.979746551999995, 2024-09-13T05:13:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056393051999999999, 2024-09-13T05:13:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136563 2024-09-13T05:13:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.089 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:13:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:13:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:13:18.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:13:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095340+0000", 2024-09-13T05:13:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.561e-06 2024-09-13T05:13:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095342+0000", 2024-09-13T05:13:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8059999999999999e-06 2024-09-13T05:13:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095345+0000", 2024-09-13T05:13:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:13:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151621+0000", 2024-09-13T05:13:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056275602000000001 2024-09-13T05:13:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151670+0000", 2024-09-13T05:13:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9478000000000003e-05 2024-09-13T05:13:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151731+0000", 2024-09-13T05:13:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1054000000000002e-05 2024-09-13T05:13:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136565 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3951616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:13:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 84.979736238000001, 2024-09-13T05:13:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056524090999999999, 2024-09-13T05:13:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.093 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136565 2024-09-13T05:13:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:13:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:13:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095348+0000", 2024-09-13T05:13:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:13:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095350+0000", 2024-09-13T05:13:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4479999999999999e-06 2024-09-13T05:13:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095353+0000", 2024-09-13T05:13:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.909e-06 2024-09-13T05:13:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095356+0000", 2024-09-13T05:13:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:13:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151763+0000", 2024-09-13T05:13:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056407813000000001 2024-09-13T05:13:18.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151812+0000", 2024-09-13T05:13:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8306999999999997e-05 2024-09-13T05:13:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151873+0000", 2024-09-13T05:13:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1064999999999999e-05 2024-09-13T05:13:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136567 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3965952~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:13:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 84.979727213000004, 2024-09-13T05:13:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056653907000000003, 2024-09-13T05:13:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136567 2024-09-13T05:13:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:13:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:13:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095357+0000", 2024-09-13T05:13:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:18.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095359+0000", 2024-09-13T05:13:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:13:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095362+0000", 2024-09-13T05:13:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7939999999999998e-06 2024-09-13T05:13:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095365+0000", 2024-09-13T05:13:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9979999999999999e-06 2024-09-13T05:13:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151904+0000", 2024-09-13T05:13:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056539308000000003 2024-09-13T05:13:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151953+0000", 2024-09-13T05:13:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8760000000000001e-05 2024-09-13T05:13:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152012+0000", 2024-09-13T05:13:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8761999999999997e-05 2024-09-13T05:13:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136569 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3980288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:13:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 84.979691458999994, 2024-09-13T05:13:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056771237000000002, 2024-09-13T05:13:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136569 2024-09-13T05:13:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:13:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:13:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:13:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095395+0000", 2024-09-13T05:13:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8870000000000001e-06 2024-09-13T05:13:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095402+0000", 2024-09-13T05:13:18.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6290000000000001e-06 2024-09-13T05:13:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095412+0000", 2024-09-13T05:13:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1730000000000001e-06 2024-09-13T05:13:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152044+0000", 2024-09-13T05:13:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056632016 2024-09-13T05:13:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152093+0000", 2024-09-13T05:13:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9570000000000001e-05 2024-09-13T05:13:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152165+0000", 2024-09-13T05:13:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1443e-05 2024-09-13T05:13:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136571 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3994624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:13:18.106 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 84.979670444000007, 2024-09-13T05:13:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056894741999999998, 2024-09-13T05:13:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136571 2024-09-13T05:13:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:13:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:13:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:13:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095418+0000", 2024-09-13T05:13:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0210000000000001e-06 2024-09-13T05:13:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095422+0000", 2024-09-13T05:13:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5310000000000002e-06 2024-09-13T05:13:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095425+0000", 2024-09-13T05:13:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8880000000000001e-06 2024-09-13T05:13:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152198+0000", 2024-09-13T05:13:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056773563999999999 2024-09-13T05:13:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152249+0000", 2024-09-13T05:13:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1168999999999997e-05 2024-09-13T05:13:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152309+0000", 2024-09-13T05:13:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9821999999999997e-05 2024-09-13T05:13:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.110 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136573 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4008960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:13:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 84.979658216999994, 2024-09-13T05:13:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057045810000000002, 2024-09-13T05:13:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136573 2024-09-13T05:13:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.111 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:13:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:13:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095426+0000", 2024-09-13T05:13:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095428+0000", 2024-09-13T05:13:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.593e-06 2024-09-13T05:13:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095431+0000", 2024-09-13T05:13:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9610000000000001e-06 2024-09-13T05:13:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095434+0000", 2024-09-13T05:13:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:13:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152352+0000", 2024-09-13T05:13:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05691881 2024-09-13T05:13:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152401+0000", 2024-09-13T05:13:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8995000000000001e-05 2024-09-13T05:13:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152472+0000", 2024-09-13T05:13:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1060000000000001e-05 2024-09-13T05:13:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136575 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4023296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:13:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 84.979228223999996, 2024-09-13T05:13:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056760069000000003, 2024-09-13T05:13:18.115 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136575 2024-09-13T05:13:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:13:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:13:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095437+0000", 2024-09-13T05:13:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9995799 2024-09-13T05:13:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095861+0000", 2024-09-13T05:13:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000424299 2024-09-13T05:13:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095869+0000", 2024-09-13T05:13:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5020000000000003e-06 2024-09-13T05:13:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095875+0000", 2024-09-13T05:13:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:13:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152502+0000", 2024-09-13T05:13:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056626528000000002 2024-09-13T05:13:18.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152556+0000", 2024-09-13T05:13:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4271000000000003e-05 2024-09-13T05:13:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152617+0000", 2024-09-13T05:13:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0896000000000001e-05 2024-09-13T05:13:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136577 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4037632~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:13:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 84.979126769000004, 2024-09-13T05:13:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056798242999999998, 2024-09-13T05:13:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136577 2024-09-13T05:13:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:13:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:13:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095882+0000", 2024-09-13T05:13:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999242 2024-09-13T05:13:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095961+0000", 2024-09-13T05:13:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8864999999999998e-05 2024-09-13T05:13:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095973+0000", 2024-09-13T05:13:18.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2206e-05 2024-09-13T05:13:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095978+0000", 2024-09-13T05:13:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0629999999999996e-06 2024-09-13T05:13:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152646+0000", 2024-09-13T05:13:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056668035999999998 2024-09-13T05:13:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152695+0000", 2024-09-13T05:13:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8634000000000002e-05 2024-09-13T05:13:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152756+0000", 2024-09-13T05:13:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1315000000000005e-05 2024-09-13T05:13:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136579 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4051968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:13:18.124 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 84.978798674000004, 2024-09-13T05:13:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056610869000000001, 2024-09-13T05:13:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136579 2024-09-13T05:13:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:13:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:13:18.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095989+0000", 2024-09-13T05:13:18.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997029 2024-09-13T05:13:18.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096291+0000", 2024-09-13T05:13:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030221499999999999 2024-09-13T05:13:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096300+0000", 2024-09-13T05:13:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4819999999999994e-06 2024-09-13T05:13:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096306+0000", 2024-09-13T05:13:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:13:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152788+0000", 2024-09-13T05:13:18.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056481625000000001 2024-09-13T05:13:18.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152837+0000", 2024-09-13T05:13:18.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9345000000000003e-05 2024-09-13T05:13:18.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152897+0000", 2024-09-13T05:13:18.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9892999999999997e-05 2024-09-13T05:13:18.128 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.129 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.129 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.129 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136581 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4066304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:18.129 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:13:18.129 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 84.978619847000004, 2024-09-13T05:13:18.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056597091000000002, 2024-09-13T05:13:18.129 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.129 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.129 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136581 2024-09-13T05:13:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:13:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:13:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096312+0000", 2024-09-13T05:13:18.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998465 2024-09-13T05:13:18.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096469+0000", 2024-09-13T05:13:18.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157109 2024-09-13T05:13:18.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096478+0000", 2024-09-13T05:13:18.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3260000000000002e-06 2024-09-13T05:13:18.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096482+0000", 2024-09-13T05:13:18.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9720000000000003e-06 2024-09-13T05:13:18.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152933+0000", 2024-09-13T05:13:18.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056451128000000003 2024-09-13T05:13:18.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152993+0000", 2024-09-13T05:13:18.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9947000000000001e-05 2024-09-13T05:13:18.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153062+0000", 2024-09-13T05:13:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9105999999999999e-05 2024-09-13T05:13:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136583 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4080640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:13:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 84.978353933999998, 2024-09-13T05:13:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056496609000000003, 2024-09-13T05:13:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136583 2024-09-13T05:13:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:13:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:13:18.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096485+0000", 2024-09-13T05:13:18.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997544 2024-09-13T05:13:18.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096735+0000", 2024-09-13T05:13:18.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024979899999999998 2024-09-13T05:13:18.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096742+0000", 2024-09-13T05:13:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7139999999999996e-06 2024-09-13T05:13:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096747+0000", 2024-09-13T05:13:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8709999999999996e-06 2024-09-13T05:13:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153099+0000", 2024-09-13T05:13:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056352639000000003 2024-09-13T05:13:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153168+0000", 2024-09-13T05:13:18.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9029000000000006e-05 2024-09-13T05:13:18.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153228+0000", 2024-09-13T05:13:18.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9339999999999998e-05 2024-09-13T05:13:18.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.137 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.137 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136585 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4094976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:13:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 84.978102466999999, 2024-09-13T05:13:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056396420000000003, 2024-09-13T05:13:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136585 2024-09-13T05:13:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:13:18.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:13:18.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096750+0000", 2024-09-13T05:13:18.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997673 2024-09-13T05:13:18.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096986+0000", 2024-09-13T05:13:18.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000236297 2024-09-13T05:13:18.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096993+0000", 2024-09-13T05:13:18.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9600000000000003e-06 2024-09-13T05:13:18.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096999+0000", 2024-09-13T05:13:18.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:13:18.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153264+0000", 2024-09-13T05:13:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056264728999999999 2024-09-13T05:13:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153318+0000", 2024-09-13T05:13:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3934000000000002e-05 2024-09-13T05:13:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153379+0000", 2024-09-13T05:13:18.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1206999999999999e-05 2024-09-13T05:13:18.142 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.142 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.142 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.142 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136586 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4109312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:18.142 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:13:18.142 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 84.977901665000005, 2024-09-13T05:13:18.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056374703999999998, 2024-09-13T05:13:18.142 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.142 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.142 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.142 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.143 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.143 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136586 2024-09-13T05:13:18.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.143 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:13:18.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:13:18.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097004+0000", 2024-09-13T05:13:18.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998207 2024-09-13T05:13:18.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097187+0000", 2024-09-13T05:13:18.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018337900000000001 2024-09-13T05:13:18.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097198+0000", 2024-09-13T05:13:18.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348e-05 2024-09-13T05:13:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097202+0000", 2024-09-13T05:13:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.121e-06 2024-09-13T05:13:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153411+0000", 2024-09-13T05:13:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056209510999999997 2024-09-13T05:13:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153464+0000", 2024-09-13T05:13:18.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2605000000000002e-05 2024-09-13T05:13:18.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153558+0000", 2024-09-13T05:13:18.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4017999999999993e-05 2024-09-13T05:13:18.146 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.146 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.146 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.146 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136588 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:18.146 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:13:18.146 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 84.977617481999999, 2024-09-13T05:13:18.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056274980000000002, 2024-09-13T05:13:18.149 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.149 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.149 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136588 2024-09-13T05:13:18.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.149 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:13:18.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:13:18.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097205+0000", 2024-09-13T05:13:18.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997377 2024-09-13T05:13:18.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097471+0000", 2024-09-13T05:13:18.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026628200000000001 2024-09-13T05:13:18.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097484+0000", 2024-09-13T05:13:18.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2493e-05 2024-09-13T05:13:18.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097488+0000", 2024-09-13T05:13:18.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9330000000000003e-06 2024-09-13T05:13:18.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153600+0000", 2024-09-13T05:13:18.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056112097 2024-09-13T05:13:18.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153654+0000", 2024-09-13T05:13:18.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4126000000000003e-05 2024-09-13T05:13:18.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153742+0000", 2024-09-13T05:13:18.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.831e-05 2024-09-13T05:13:18.153 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.153 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.153 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.154 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136589 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4137984~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:18.154 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:13:18.154 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 84.977478175000002, 2024-09-13T05:13:18.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056293867999999997, 2024-09-13T05:13:18.154 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.154 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.154 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.154 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.154 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.154 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136589 2024-09-13T05:13:18.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.155 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:13:18.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:13:18.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097491+0000", 2024-09-13T05:13:18.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998841 2024-09-13T05:13:18.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097610+0000", 2024-09-13T05:13:18.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119263 2024-09-13T05:13:18.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097617+0000", 2024-09-13T05:13:18.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6490000000000002e-06 2024-09-13T05:13:18.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097624+0000", 2024-09-13T05:13:18.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6309999999999997e-06 2024-09-13T05:13:18.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153779+0000", 2024-09-13T05:13:18.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056155153999999999 2024-09-13T05:13:18.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153831+0000", 2024-09-13T05:13:18.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2080000000000003e-05 2024-09-13T05:13:18.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153901+0000", 2024-09-13T05:13:18.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9765999999999996e-05 2024-09-13T05:13:18.158 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.159 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.159 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.159 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136965 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3366912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:18.159 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:13:18.159 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 84.957509353999995, 2024-09-13T05:13:18.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056225403, 2024-09-13T05:13:18.159 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.159 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.159 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.159 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.160 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.160 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136965 2024-09-13T05:13:18.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.160 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:13:18.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:13:18.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117575+0000", 2024-09-13T05:13:18.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:18.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117578+0000", 2024-09-13T05:13:18.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4899999999999999e-06 2024-09-13T05:13:18.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117583+0000", 2024-09-13T05:13:18.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.074e-06 2024-09-13T05:13:18.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117587+0000", 2024-09-13T05:13:18.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5360000000000003e-06 2024-09-13T05:13:18.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173622+0000", 2024-09-13T05:13:18.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056034527000000001 2024-09-13T05:13:18.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173704+0000", 2024-09-13T05:13:18.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2137000000000003e-05 2024-09-13T05:13:18.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173801+0000", 2024-09-13T05:13:18.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7048999999999999e-05 2024-09-13T05:13:18.164 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.164 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.164 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.164 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136991 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3553280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:18.164 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:13:18.164 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 84.953583577000003, 2024-09-13T05:13:18.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056330199999999997, 2024-09-13T05:13:18.165 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.165 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.165 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136991 2024-09-13T05:13:18.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.165 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:13:18.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:13:18.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:13:18.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:18.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121504+0000", 2024-09-13T05:13:18.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7199999999999998e-06 2024-09-13T05:13:18.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121510+0000", 2024-09-13T05:13:18.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3459999999999999e-06 2024-09-13T05:13:18.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121515+0000", 2024-09-13T05:13:18.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.656e-06 2024-09-13T05:13:18.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177608+0000", 2024-09-13T05:13:18.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056093267000000002 2024-09-13T05:13:18.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177717+0000", 2024-09-13T05:13:18.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010901299999999999 2024-09-13T05:13:18.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177832+0000", 2024-09-13T05:13:18.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114604 2024-09-13T05:13:18.169 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.169 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.169 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.169 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173672 3.9 3:9520c004:::rbd_data.112d7c1bedf7.0000000000000040:29 [read 186368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:18.169 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:13:18.170 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.889688952, 2024-09-13T05:13:18.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05682475, 2024-09-13T05:13:18.170 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.170 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.170 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.170 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.170 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.170 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173672 2024-09-13T05:13:18.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.170 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:13:18.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:13:18.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185395+0000", 2024-09-13T05:13:18.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:18.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185398+0000", 2024-09-13T05:13:18.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8260000000000001e-06 2024-09-13T05:13:18.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185404+0000", 2024-09-13T05:13:18.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-09-13T05:13:18.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185408+0000", 2024-09-13T05:13:18.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5279999999999997e-06 2024-09-13T05:13:18.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.236213+0000", 2024-09-13T05:13:18.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050805207999999998 2024-09-13T05:13:18.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.236285+0000", 2024-09-13T05:13:18.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1236999999999996e-05 2024-09-13T05:13:18.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.242221+0000", 2024-09-13T05:13:18.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059360050000000003 2024-09-13T05:13:18.174 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.174 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.174 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.175 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.175 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.175 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:18.176 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:13:18.177 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:18.170+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:18.277 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:18.274+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:18.336 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:18.336 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:18.336 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:13:18.337 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:18.351 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:13:18.401 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:18.398+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:18.459 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:18.459 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:18.460 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:13:18.460 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:13:18.460 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:18.469 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:13:18.480 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:18.474+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:18.546 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:13:18.577 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:18.577 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:13:18.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:13:18.577 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:13:18.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.578 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:70758 3.2 3:427d0469:::rbd_header.112d8d1317eb:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-13T05:13:18.578 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:13:18.578 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 115.145195239, 2024-09-13T05:13:18.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.190313603, 2024-09-13T05:13:18.578 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.578 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.578 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.578 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.578 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.579 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70758 2024-09-13T05:13:18.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.579 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:13:18.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:13:18.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428654+0000", 2024-09-13T05:13:18.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:18.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428664+0000", 2024-09-13T05:13:18.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0664e-05 2024-09-13T05:13:18.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428683+0000", 2024-09-13T05:13:18.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8377e-05 2024-09-13T05:13:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428691+0000", 2024-09-13T05:13:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9400000000000008e-06 2024-09-13T05:13:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428789+0000", 2024-09-13T05:13:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7165999999999998e-05 2024-09-13T05:13:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:18.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428811+0000", 2024-09-13T05:13:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1925000000000001e-05 2024-09-13T05:13:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.617921+0000", 2024-09-13T05:13:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.189110536 2024-09-13T05:13:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618344+0000", 2024-09-13T05:13:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042245800000000001 2024-09-13T05:13:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618969+0000", 2024-09-13T05:13:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062529299999999996 2024-09-13T05:13:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162381 3.8 3.4e1a3768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:13:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.065188992000003, 2024-09-13T05:13:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.14690313199999999, 2024-09-13T05:13:18.584 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:13:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162381 2024-09-13T05:13:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:13:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:13:18.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508659+0000", 2024-09-13T05:13:18.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:13:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508673+0000", 2024-09-13T05:13:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4154999999999999e-05 2024-09-13T05:13:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508703+0000", 2024-09-13T05:13:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9427000000000001e-05 2024-09-13T05:13:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508719+0000", 2024-09-13T05:13:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6381000000000001e-05 2024-09-13T05:13:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508789+0000", 2024-09-13T05:13:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9898000000000001e-05 2024-09-13T05:13:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508799+0000", 2024-09-13T05:13:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0066e-05 2024-09-13T05:13:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655550+0000", 2024-09-13T05:13:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.146750506 2024-09-13T05:13:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655565+0000", 2024-09-13T05:13:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4915e-05 2024-09-13T05:13:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162393 3.8 3.fd966c88 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:18.590 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:13:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.053672918000004, 2024-09-13T05:13:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.135657895, 2024-09-13T05:13:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:13:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162393 2024-09-13T05:13:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:13:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:13:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520176+0000", 2024-09-13T05:13:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:13:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520184+0000", 2024-09-13T05:13:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5800000000000003e-06 2024-09-13T05:13:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520199+0000", 2024-09-13T05:13:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4481000000000001e-05 2024-09-13T05:13:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520209+0000", 2024-09-13T05:13:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0327e-05 2024-09-13T05:13:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520351+0000", 2024-09-13T05:13:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141827 2024-09-13T05:13:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520363+0000", 2024-09-13T05:13:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2018000000000001e-05 2024-09-13T05:13:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655819+0000", 2024-09-13T05:13:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13545665600000001 2024-09-13T05:13:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655835+0000", 2024-09-13T05:13:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6135000000000001e-05 2024-09-13T05:13:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.595 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162429 3.8 3.6e098f28 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:13:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.052822309000007, 2024-09-13T05:13:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13484765400000001, 2024-09-13T05:13:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:13:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162429 2024-09-13T05:13:18.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:13:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:13:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:13:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521032+0000", 2024-09-13T05:13:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3039999999999998e-06 2024-09-13T05:13:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521041+0000", 2024-09-13T05:13:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6880000000000005e-06 2024-09-13T05:13:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521047+0000", 2024-09-13T05:13:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0100000000000001e-06 2024-09-13T05:13:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521601+0000", 2024-09-13T05:13:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00055398600000000002 2024-09-13T05:13:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521613+0000", 2024-09-13T05:13:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2347000000000001e-05 2024-09-13T05:13:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655869+0000", 2024-09-13T05:13:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.134255597 2024-09-13T05:13:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655876+0000", 2024-09-13T05:13:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2790000000000001e-06 2024-09-13T05:13:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162521 3.8 3.f06bf7c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:13:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.050420179, 2024-09-13T05:13:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13247452600000001, 2024-09-13T05:13:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:13:18.601 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162521 2024-09-13T05:13:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:13:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:13:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:13:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523433+0000", 2024-09-13T05:13:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.128e-06 2024-09-13T05:13:18.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523440+0000", 2024-09-13T05:13:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9990000000000002e-06 2024-09-13T05:13:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523446+0000", 2024-09-13T05:13:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7869999999999998e-06 2024-09-13T05:13:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.528221+0000", 2024-09-13T05:13:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047747040000000003 2024-09-13T05:13:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.528237+0000", 2024-09-13T05:13:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6042e-05 2024-09-13T05:13:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655898+0000", 2024-09-13T05:13:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.127661521 2024-09-13T05:13:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655905+0000", 2024-09-13T05:13:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7780000000000002e-06 2024-09-13T05:13:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162381 3.8 3:16ec5872:::rbd_data.112dc3abcba6.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:18.607 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:13:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.040893014000005, 2024-09-13T05:13:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12546553899999999, 2024-09-13T05:13:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162381 2024-09-13T05:13:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:13:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:13:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532956+0000", 2024-09-13T05:13:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532964+0000", 2024-09-13T05:13:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.072e-06 2024-09-13T05:13:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532976+0000", 2024-09-13T05:13:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1355000000000001e-05 2024-09-13T05:13:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532984+0000", 2024-09-13T05:13:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3440000000000001e-06 2024-09-13T05:13:18.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533432+0000", 2024-09-13T05:13:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044773000000000002 2024-09-13T05:13:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533439+0000", 2024-09-13T05:13:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9890000000000003e-06 2024-09-13T05:13:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655985+0000", 2024-09-13T05:13:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122546527 2024-09-13T05:13:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656234+0000", 2024-09-13T05:13:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024911300000000003 2024-09-13T05:13:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656378+0000", 2024-09-13T05:13:18.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014417100000000001 2024-09-13T05:13:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657916+0000", 2024-09-13T05:13:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001537907 2024-09-13T05:13:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:13:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658308+0000", 2024-09-13T05:13:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039183700000000002 2024-09-13T05:13:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:13:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658364+0000", 2024-09-13T05:13:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5451000000000002e-05 2024-09-13T05:13:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658423+0000", 2024-09-13T05:13:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9449e-05 2024-09-13T05:13:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.615 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162393 3.8 3:113669bf:::rbd_data.112dfd94ee88.00000000000000bf:2a [read 131072~18432] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:13:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.040853235, 2024-09-13T05:13:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124231431, 2024-09-13T05:13:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.616 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162393 2024-09-13T05:13:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:13:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:13:18.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:13:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533001+0000", 2024-09-13T05:13:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8099999999999999e-06 2024-09-13T05:13:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533007+0000", 2024-09-13T05:13:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5849999999999996e-06 2024-09-13T05:13:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533012+0000", 2024-09-13T05:13:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0320000000000003e-06 2024-09-13T05:13:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533459+0000", 2024-09-13T05:13:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044646399999999999 2024-09-13T05:13:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533464+0000", 2024-09-13T05:13:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9180000000000002e-06 2024-09-13T05:13:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656870+0000", 2024-09-13T05:13:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123406847 2024-09-13T05:13:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657067+0000", 2024-09-13T05:13:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019655599999999999 2024-09-13T05:13:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657229+0000", 2024-09-13T05:13:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016175599999999999 2024-09-13T05:13:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.621 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162429 3.8 3:14f19076:::rbd_data.112dfd94ee88.0000000000000150:2a [read 131072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:13:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.040833684999996, 2024-09-13T05:13:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124549956, 2024-09-13T05:13:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162429 2024-09-13T05:13:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:13:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:13:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533016+0000", 2024-09-13T05:13:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533020+0000", 2024-09-13T05:13:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1049999999999999e-06 2024-09-13T05:13:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533025+0000", 2024-09-13T05:13:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-09-13T05:13:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533030+0000", 2024-09-13T05:13:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8999999999999997e-06 2024-09-13T05:13:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533481+0000", 2024-09-13T05:13:18.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045080400000000002 2024-09-13T05:13:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533486+0000", 2024-09-13T05:13:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3369999999999999e-06 2024-09-13T05:13:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657311+0000", 2024-09-13T05:13:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123824408 2024-09-13T05:13:18.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657464+0000", 2024-09-13T05:13:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015343900000000001 2024-09-13T05:13:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657567+0000", 2024-09-13T05:13:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102568 2024-09-13T05:13:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162521 3.8 3:13efd60f:::rbd_data.112dfd94ee88.000000000000031a:2a [read 131072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:13:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.040682451999999, 2024-09-13T05:13:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124709257, 2024-09-13T05:13:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162521 2024-09-13T05:13:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:13:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:13:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:13:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533170+0000", 2024-09-13T05:13:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3910000000000001e-06 2024-09-13T05:13:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533176+0000", 2024-09-13T05:13:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4029999999999998e-06 2024-09-13T05:13:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533180+0000", 2024-09-13T05:13:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6999999999999999e-06 2024-09-13T05:13:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533659+0000", 2024-09-13T05:13:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047839699999999998 2024-09-13T05:13:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533664+0000", 2024-09-13T05:13:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7239999999999997e-06 2024-09-13T05:13:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657619+0000", 2024-09-13T05:13:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123954412 2024-09-13T05:13:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657784+0000", 2024-09-13T05:13:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016527499999999999 2024-09-13T05:13:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657877+0000", 2024-09-13T05:13:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3280000000000001e-05 2024-09-13T05:13:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162618 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 70656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:13:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.039377741999999, 2024-09-13T05:13:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123752711, 2024-09-13T05:13:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162618 2024-09-13T05:13:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:13:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:13:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534472+0000", 2024-09-13T05:13:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534475+0000", 2024-09-13T05:13:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2010000000000002e-06 2024-09-13T05:13:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534482+0000", 2024-09-13T05:13:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:13:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534486+0000", 2024-09-13T05:13:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7520000000000004e-06 2024-09-13T05:13:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536456+0000", 2024-09-13T05:13:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001969527 2024-09-13T05:13:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536462+0000", 2024-09-13T05:13:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2750000000000001e-06 2024-09-13T05:13:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657939+0000", 2024-09-13T05:13:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121476769 2024-09-13T05:13:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658087+0000", 2024-09-13T05:13:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014862400000000001 2024-09-13T05:13:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658225+0000", 2024-09-13T05:13:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013800999999999999 2024-09-13T05:13:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162620 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 71680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:13:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.039343617, 2024-09-13T05:13:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124087688, 2024-09-13T05:13:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162620 2024-09-13T05:13:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:13:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:13:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:13:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534509+0000", 2024-09-13T05:13:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1270000000000001e-06 2024-09-13T05:13:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534514+0000", 2024-09-13T05:13:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8720000000000001e-06 2024-09-13T05:13:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534518+0000", 2024-09-13T05:13:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5090000000000004e-06 2024-09-13T05:13:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536485+0000", 2024-09-13T05:13:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019671530000000001 2024-09-13T05:13:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536491+0000", 2024-09-13T05:13:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3759999999999999e-06 2024-09-13T05:13:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658466+0000", 2024-09-13T05:13:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121975466 2024-09-13T05:13:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658522+0000", 2024-09-13T05:13:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5668999999999998e-05 2024-09-13T05:13:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658595+0000", 2024-09-13T05:13:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2800999999999996e-05 2024-09-13T05:13:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162622 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 72704~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:13:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.039312649999999, 2024-09-13T05:13:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124215569, 2024-09-13T05:13:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162622 2024-09-13T05:13:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:13:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:13:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534537+0000", 2024-09-13T05:13:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534540+0000", 2024-09-13T05:13:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3740000000000001e-06 2024-09-13T05:13:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534545+0000", 2024-09-13T05:13:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4210000000000003e-06 2024-09-13T05:13:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534550+0000", 2024-09-13T05:13:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3090000000000003e-06 2024-09-13T05:13:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536510+0000", 2024-09-13T05:13:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019597130000000001 2024-09-13T05:13:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536517+0000", 2024-09-13T05:13:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0620000000000003e-06 2024-09-13T05:13:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658632+0000", 2024-09-13T05:13:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122114373 2024-09-13T05:13:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658686+0000", 2024-09-13T05:13:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3882999999999999e-05 2024-09-13T05:13:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658753+0000", 2024-09-13T05:13:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7921000000000002e-05 2024-09-13T05:13:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162623 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 73728~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:13:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.039295844999998, 2024-09-13T05:13:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124350214, 2024-09-13T05:13:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162623 2024-09-13T05:13:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:13:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:13:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534554+0000", 2024-09-13T05:13:18.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:18.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534556+0000", 2024-09-13T05:13:18.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-13T05:13:18.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534563+0000", 2024-09-13T05:13:18.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2890000000000003e-06 2024-09-13T05:13:18.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534567+0000", 2024-09-13T05:13:18.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4880000000000001e-06 2024-09-13T05:13:18.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536538+0000", 2024-09-13T05:13:18.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019703989999999998 2024-09-13T05:13:18.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:18.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536543+0000", 2024-09-13T05:13:18.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3920000000000002e-06 2024-09-13T05:13:18.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658773+0000", 2024-09-13T05:13:18.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122229607 2024-09-13T05:13:18.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658835+0000", 2024-09-13T05:13:18.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1954999999999999e-05 2024-09-13T05:13:18.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658905+0000", 2024-09-13T05:13:18.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-09-13T05:13:18.661 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.661 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.662 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.662 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162626 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 65536~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:18.662 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:13:18.662 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.039244561000004, 2024-09-13T05:13:18.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124425881, 2024-09-13T05:13:18.662 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.662 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.662 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.662 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162626 2024-09-13T05:13:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:13:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:13:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:13:18.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:18.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534611+0000", 2024-09-13T05:13:18.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5419999999999996e-06 2024-09-13T05:13:18.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534617+0000", 2024-09-13T05:13:18.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5169999999999999e-06 2024-09-13T05:13:18.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534622+0000", 2024-09-13T05:13:18.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9810000000000003e-06 2024-09-13T05:13:18.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536563+0000", 2024-09-13T05:13:18.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019410549999999999 2024-09-13T05:13:18.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:18.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536568+0000", 2024-09-13T05:13:18.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4310000000000002e-06 2024-09-13T05:13:18.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658922+0000", 2024-09-13T05:13:18.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122354221 2024-09-13T05:13:18.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658968+0000", 2024-09-13T05:13:18.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5221e-05 2024-09-13T05:13:18.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659032+0000", 2024-09-13T05:13:18.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4256000000000003e-05 2024-09-13T05:13:18.667 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.667 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.667 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.668 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162628 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 66560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:18.668 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:13:18.668 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.03920961, 2024-09-13T05:13:18.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124532254, 2024-09-13T05:13:18.668 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.668 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.668 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162628 2024-09-13T05:13:18.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.668 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:13:18.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:13:18.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:13:18.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534643+0000", 2024-09-13T05:13:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1890000000000001e-06 2024-09-13T05:13:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534648+0000", 2024-09-13T05:13:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:13:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534652+0000", 2024-09-13T05:13:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4549999999999997e-06 2024-09-13T05:13:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536586+0000", 2024-09-13T05:13:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019336049999999999 2024-09-13T05:13:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536591+0000", 2024-09-13T05:13:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3770000000000004e-06 2024-09-13T05:13:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659062+0000", 2024-09-13T05:13:18.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122470685 2024-09-13T05:13:18.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659106+0000", 2024-09-13T05:13:18.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3856000000000002e-05 2024-09-13T05:13:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659173+0000", 2024-09-13T05:13:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7168000000000005e-05 2024-09-13T05:13:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162630 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 67584~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:13:18.673 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.039176404000003, 2024-09-13T05:13:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12468555100000001, 2024-09-13T05:13:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162630 2024-09-13T05:13:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:13:18.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:13:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:13:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534676+0000", 2024-09-13T05:13:18.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4399999999999999e-06 2024-09-13T05:13:18.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534681+0000", 2024-09-13T05:13:18.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2349999999999999e-06 2024-09-13T05:13:18.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534686+0000", 2024-09-13T05:13:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5499999999999996e-06 2024-09-13T05:13:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536609+0000", 2024-09-13T05:13:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001923407 2024-09-13T05:13:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536615+0000", 2024-09-13T05:13:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1499999999999998e-06 2024-09-13T05:13:18.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659233+0000", 2024-09-13T05:13:18.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122618957 2024-09-13T05:13:18.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659294+0000", 2024-09-13T05:13:18.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0251000000000003e-05 2024-09-13T05:13:18.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659360+0000", 2024-09-13T05:13:18.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5906000000000002e-05 2024-09-13T05:13:18.679 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.679 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.679 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.680 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162633 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 69632~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:18.680 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:13:18.680 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.039068498999995, 2024-09-13T05:13:18.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124702147, 2024-09-13T05:13:18.680 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.680 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162633 2024-09-13T05:13:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:13:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:13:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:13:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534784+0000", 2024-09-13T05:13:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3300000000000001e-06 2024-09-13T05:13:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534789+0000", 2024-09-13T05:13:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4149999999999998e-06 2024-09-13T05:13:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534794+0000", 2024-09-13T05:13:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5669999999999996e-06 2024-09-13T05:13:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536634+0000", 2024-09-13T05:13:18.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001840401 2024-09-13T05:13:18.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:18.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536642+0000", 2024-09-13T05:13:18.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9729999999999997e-06 2024-09-13T05:13:18.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659383+0000", 2024-09-13T05:13:18.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12274112099999999 2024-09-13T05:13:18.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659424+0000", 2024-09-13T05:13:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0936000000000002e-05 2024-09-13T05:13:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659484+0000", 2024-09-13T05:13:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9775000000000003e-05 2024-09-13T05:13:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162675 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 68608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:13:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.039019455000002, 2024-09-13T05:13:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124823974, 2024-09-13T05:13:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162675 2024-09-13T05:13:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.686 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:13:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:13:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:13:18.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534833+0000", 2024-09-13T05:13:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.204e-06 2024-09-13T05:13:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534838+0000", 2024-09-13T05:13:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0130000000000001e-06 2024-09-13T05:13:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534842+0000", 2024-09-13T05:13:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.51e-06 2024-09-13T05:13:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536661+0000", 2024-09-13T05:13:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018186039999999999 2024-09-13T05:13:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536667+0000", 2024-09-13T05:13:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5260000000000001e-06 2024-09-13T05:13:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659531+0000", 2024-09-13T05:13:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122864403 2024-09-13T05:13:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659583+0000", 2024-09-13T05:13:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1564000000000003e-05 2024-09-13T05:13:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659655+0000", 2024-09-13T05:13:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2504999999999998e-05 2024-09-13T05:13:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.691 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.691 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:170203 3.1e 3:7c9b1cf4:::rbd_header.112dc3abcba6:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128)", 2024-09-13T05:13:18.691 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:13:18.691 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.759040484000003, 2024-09-13T05:13:18.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.79948714899999995, 2024-09-13T05:13:18.691 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.692 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:18.692 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.692 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.692 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.692 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 170203 2024-09-13T05:13:18.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.693 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:13:18.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:13:18.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814808+0000", 2024-09-13T05:13:18.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:18.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814820+0000", 2024-09-13T05:13:18.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.206e-05 2024-09-13T05:13:18.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814841+0000", 2024-09-13T05:13:18.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1464999999999999e-05 2024-09-13T05:13:18.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814853+0000", 2024-09-13T05:13:18.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1824999999999999e-05 2024-09-13T05:13:18.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814911+0000", 2024-09-13T05:13:18.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8255999999999999e-05 2024-09-13T05:13:18.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:18.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814918+0000", 2024-09-13T05:13:18.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7120000000000003e-06 2024-09-13T05:13:18.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.611660+0000", 2024-09-13T05:13:18.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.79674180100000003 2024-09-13T05:13:18.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.611911+0000", 2024-09-13T05:13:18.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025108900000000002 2024-09-13T05:13:18.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-13T05:13:18.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.612726+0000", 2024-09-13T05:13:18.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00081512999999999996 2024-09-13T05:13:18.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:18.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614087+0000", 2024-09-13T05:13:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013607560000000001 2024-09-13T05:13:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:13:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614095+0000", 2024-09-13T05:13:18.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3240000000000003e-06 2024-09-13T05:13:18.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:13:18.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614138+0000", 2024-09-13T05:13:18.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3115000000000003e-05 2024-09-13T05:13:18.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614297+0000", 2024-09-13T05:13:18.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015875399999999999 2024-09-13T05:13:18.705 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.705 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:206714 3.1e 3:7a6b822e:::rbd_id.image_client.0-clone15:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e182)", 2024-09-13T05:13:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:13:16.942501+0000", 2024-09-13T05:13:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.631349894, 2024-09-13T05:13:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.93017799199999995, 2024-09-13T05:13:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 206714 2024-09-13T05:13:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942501+0000", 2024-09-13T05:13:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942501+0000", 2024-09-13T05:13:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942498+0000", 2024-09-13T05:13:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:13:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942510+0000", 2024-09-13T05:13:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1564e-05 2024-09-13T05:13:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942531+0000", 2024-09-13T05:13:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1713e-05 2024-09-13T05:13:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942543+0000", 2024-09-13T05:13:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1684e-05 2024-09-13T05:13:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942671+0000", 2024-09-13T05:13:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012764699999999999 2024-09-13T05:13:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942693+0000", 2024-09-13T05:13:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2690000000000001e-05 2024-09-13T05:13:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.867517+0000", 2024-09-13T05:13:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.92482318399999996 2024-09-13T05:13:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.867693+0000", 2024-09-13T05:13:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017623199999999999 2024-09-13T05:13:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:13:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.867788+0000", 2024-09-13T05:13:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5588999999999996e-05 2024-09-13T05:13:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:13:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.869416+0000", 2024-09-13T05:13:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016272750000000001 2024-09-13T05:13:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.872552+0000", 2024-09-13T05:13:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031364850000000001 2024-09-13T05:13:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:13:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.872628+0000", 2024-09-13T05:13:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5871999999999995e-05 2024-09-13T05:13:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.872679+0000", 2024-09-13T05:13:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0630999999999997e-05 2024-09-13T05:13:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:18.715 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:18.717 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:13:18.718 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is unset 2024-09-13T05:13:18.718 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:13:18.718 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:13:18.718 INFO:tasks.thrashosds.thrasher:in_osds: [2, 3, 5, 7, 1, 4, 6] out_osds: [0] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-13T05:13:18.718 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:13:18.719 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-13T05:13:18.719 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-13T05:13:18.719 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-13T05:13:18.719 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-13T05:13:18.720 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:18.711+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:18.734 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:13:18.754 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:13:18.780 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:13:18.802 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:13:18.817 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:18.811+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:18.824 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:13:18.836 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:18.837 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "" 2024-09-13T05:13:18.837 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:18.837 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:18.837 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:18.845 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:13:18.847 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:13:18.847 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:13:18.847 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:13:18.847 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:13:18.848 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:13:18.848 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:13:18.848 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:13:18.848 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:13:18.849 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:13:18.918 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:18.915+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:18.954 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:18.954 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:18.966 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:13:19.019 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:19.014+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:19.117 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:19.117 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:19.120 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:19.115+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:19.127 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:13:19.221 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:19.218+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:19.230 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:19.231 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:19.240 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:13:19.323 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:19.318+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:19.348 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:19.348 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:19.358 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:13:19.423 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:19.419+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:19.464 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:19.465 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:19.474 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:13:19.524 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:19.522+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:19.580 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:19.580 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:19.590 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:13:19.624 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:19.618+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:19.703 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:19.703 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:19.713 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:13:19.725 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:19.719+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:19.826 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:19.827 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:19.827 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:19.823+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:19.836 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:13:19.927 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:19.922+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:19.986 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:19.986 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:19.996 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:13:20.027 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:20.023+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:20.100 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:20.100 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:20.110 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:13:20.158 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:20.155+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:20.219 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:20.219 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:20.229 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:13:20.230 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:20.226+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:20.330 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:20.326+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:20.348 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:20.348 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:20.358 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:13:20.431 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:20.427+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:20.468 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:20.469 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:20.479 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:13:20.532 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:20.527+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:20.585 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:20.586 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:20.595 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:13:20.645 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:20.642+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:20.711 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:20.711 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:20.719 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T05:13:20.722 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:13:20.733 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:20.731+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:20.831 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:20.831 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:20.835 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:20.831+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:20.841 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:13:20.860 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:13:20.935 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:20.930+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:20.943 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:20.943 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:20.953 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:13:20.998 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:13:21.023 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:13:21.036 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:21.031+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:21.042 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:13:21.059 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:13:21.073 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:21.073 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:21.073 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:13:21.074 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:21.079 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:13:21.083 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:13:21.105 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:13:21.137 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:21.134+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:21.141 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:13:21.176 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:13:21.179 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:13:21.179 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:13:21.179 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:13:21.179 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:13:21.179 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:13:21.179 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:13:21.179 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:13:21.179 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:13:21.207 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:21.208 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:21.208 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:13:21.208 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:13:21.208 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:21.218 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:13:21.261 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:21.258+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:21.338 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:21.334+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:21.369 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:21.369 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:13:21.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:13:21.369 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:13:21.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.369 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136560 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3908608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:21.369 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:13:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.271739674000003, 2024-09-13T05:13:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056148103999999997, 2024-09-13T05:13:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136560 2024-09-13T05:13:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:13:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:13:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095289+0000", 2024-09-13T05:13:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095292+0000", 2024-09-13T05:13:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.802e-06 2024-09-13T05:13:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095318+0000", 2024-09-13T05:13:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5987999999999999e-05 2024-09-13T05:13:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095323+0000", 2024-09-13T05:13:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.006e-06 2024-09-13T05:13:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151316+0000", 2024-09-13T05:13:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055992593 2024-09-13T05:13:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151371+0000", 2024-09-13T05:13:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5532999999999998e-05 2024-09-13T05:13:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151438+0000", 2024-09-13T05:13:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6557999999999995e-05 2024-09-13T05:13:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136562 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3922944~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:13:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.271702555999994, 2024-09-13T05:13:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056259690000000001, 2024-09-13T05:13:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136562 2024-09-13T05:13:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:13:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:13:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:13:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095329+0000", 2024-09-13T05:13:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3089999999999998e-06 2024-09-13T05:13:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095333+0000", 2024-09-13T05:13:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6239999999999999e-06 2024-09-13T05:13:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095335+0000", 2024-09-13T05:13:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5660000000000001e-06 2024-09-13T05:13:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151468+0000", 2024-09-13T05:13:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056132608000000001 2024-09-13T05:13:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151519+0000", 2024-09-13T05:13:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1681000000000002e-05 2024-09-13T05:13:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151587+0000", 2024-09-13T05:13:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7200999999999996e-05 2024-09-13T05:13:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.379 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136563 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3937280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:21.379 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:13:21.379 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.271691133999994, 2024-09-13T05:13:21.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056393051999999999, 2024-09-13T05:13:21.379 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.379 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.379 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136563 2024-09-13T05:13:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:13:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:13:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:13:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:13:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095340+0000", 2024-09-13T05:13:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.561e-06 2024-09-13T05:13:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095342+0000", 2024-09-13T05:13:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8059999999999999e-06 2024-09-13T05:13:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095345+0000", 2024-09-13T05:13:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:13:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151621+0000", 2024-09-13T05:13:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056275602000000001 2024-09-13T05:13:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151670+0000", 2024-09-13T05:13:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9478000000000003e-05 2024-09-13T05:13:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151731+0000", 2024-09-13T05:13:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1054000000000002e-05 2024-09-13T05:13:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136565 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3951616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:13:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.27168082, 2024-09-13T05:13:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056524090999999999, 2024-09-13T05:13:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136565 2024-09-13T05:13:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:13:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:13:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095348+0000", 2024-09-13T05:13:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:13:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095350+0000", 2024-09-13T05:13:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4479999999999999e-06 2024-09-13T05:13:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095353+0000", 2024-09-13T05:13:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.909e-06 2024-09-13T05:13:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095356+0000", 2024-09-13T05:13:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:13:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151763+0000", 2024-09-13T05:13:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056407813000000001 2024-09-13T05:13:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151812+0000", 2024-09-13T05:13:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8306999999999997e-05 2024-09-13T05:13:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151873+0000", 2024-09-13T05:13:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1064999999999999e-05 2024-09-13T05:13:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.388 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.388 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136567 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3965952~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:21.388 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:13:21.388 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.271671795000003, 2024-09-13T05:13:21.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056653907000000003, 2024-09-13T05:13:21.388 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.388 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136567 2024-09-13T05:13:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:13:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:13:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095357+0000", 2024-09-13T05:13:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095359+0000", 2024-09-13T05:13:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:13:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095362+0000", 2024-09-13T05:13:21.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7939999999999998e-06 2024-09-13T05:13:21.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095365+0000", 2024-09-13T05:13:21.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9979999999999999e-06 2024-09-13T05:13:21.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151904+0000", 2024-09-13T05:13:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056539308000000003 2024-09-13T05:13:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151953+0000", 2024-09-13T05:13:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8760000000000001e-05 2024-09-13T05:13:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152012+0000", 2024-09-13T05:13:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8761999999999997e-05 2024-09-13T05:13:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136569 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3980288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:13:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.271636040999994, 2024-09-13T05:13:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056771237000000002, 2024-09-13T05:13:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136569 2024-09-13T05:13:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:13:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:13:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:13:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095395+0000", 2024-09-13T05:13:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8870000000000001e-06 2024-09-13T05:13:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095402+0000", 2024-09-13T05:13:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6290000000000001e-06 2024-09-13T05:13:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095412+0000", 2024-09-13T05:13:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1730000000000001e-06 2024-09-13T05:13:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152044+0000", 2024-09-13T05:13:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056632016 2024-09-13T05:13:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152093+0000", 2024-09-13T05:13:21.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9570000000000001e-05 2024-09-13T05:13:21.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152165+0000", 2024-09-13T05:13:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1443e-05 2024-09-13T05:13:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136571 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3994624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:13:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.271615026000006, 2024-09-13T05:13:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056894741999999998, 2024-09-13T05:13:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136571 2024-09-13T05:13:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:13:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:13:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:13:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095418+0000", 2024-09-13T05:13:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0210000000000001e-06 2024-09-13T05:13:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095422+0000", 2024-09-13T05:13:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5310000000000002e-06 2024-09-13T05:13:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095425+0000", 2024-09-13T05:13:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8880000000000001e-06 2024-09-13T05:13:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152198+0000", 2024-09-13T05:13:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056773563999999999 2024-09-13T05:13:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152249+0000", 2024-09-13T05:13:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1168999999999997e-05 2024-09-13T05:13:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152309+0000", 2024-09-13T05:13:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9821999999999997e-05 2024-09-13T05:13:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136573 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4008960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:13:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.271602798999993, 2024-09-13T05:13:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057045810000000002, 2024-09-13T05:13:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136573 2024-09-13T05:13:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:13:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:13:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095426+0000", 2024-09-13T05:13:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095428+0000", 2024-09-13T05:13:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.593e-06 2024-09-13T05:13:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095431+0000", 2024-09-13T05:13:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9610000000000001e-06 2024-09-13T05:13:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095434+0000", 2024-09-13T05:13:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:13:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152352+0000", 2024-09-13T05:13:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05691881 2024-09-13T05:13:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152401+0000", 2024-09-13T05:13:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8995000000000001e-05 2024-09-13T05:13:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152472+0000", 2024-09-13T05:13:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1060000000000001e-05 2024-09-13T05:13:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136575 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4023296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:13:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.271172805999996, 2024-09-13T05:13:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056760069000000003, 2024-09-13T05:13:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136575 2024-09-13T05:13:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:13:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:13:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095437+0000", 2024-09-13T05:13:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9995799 2024-09-13T05:13:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095861+0000", 2024-09-13T05:13:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000424299 2024-09-13T05:13:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095869+0000", 2024-09-13T05:13:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5020000000000003e-06 2024-09-13T05:13:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095875+0000", 2024-09-13T05:13:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:13:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152502+0000", 2024-09-13T05:13:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056626528000000002 2024-09-13T05:13:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152556+0000", 2024-09-13T05:13:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4271000000000003e-05 2024-09-13T05:13:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152617+0000", 2024-09-13T05:13:21.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0896000000000001e-05 2024-09-13T05:13:21.415 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.415 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.415 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.415 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136577 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4037632~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:13:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.271071351000003, 2024-09-13T05:13:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056798242999999998, 2024-09-13T05:13:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136577 2024-09-13T05:13:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:13:21.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:13:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095882+0000", 2024-09-13T05:13:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999242 2024-09-13T05:13:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095961+0000", 2024-09-13T05:13:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8864999999999998e-05 2024-09-13T05:13:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095973+0000", 2024-09-13T05:13:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2206e-05 2024-09-13T05:13:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095978+0000", 2024-09-13T05:13:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0629999999999996e-06 2024-09-13T05:13:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152646+0000", 2024-09-13T05:13:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056668035999999998 2024-09-13T05:13:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152695+0000", 2024-09-13T05:13:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8634000000000002e-05 2024-09-13T05:13:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152756+0000", 2024-09-13T05:13:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1315000000000005e-05 2024-09-13T05:13:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136579 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4051968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:13:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.270743256000003, 2024-09-13T05:13:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056610869000000001, 2024-09-13T05:13:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136579 2024-09-13T05:13:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:13:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:13:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095989+0000", 2024-09-13T05:13:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997029 2024-09-13T05:13:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096291+0000", 2024-09-13T05:13:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030221499999999999 2024-09-13T05:13:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096300+0000", 2024-09-13T05:13:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4819999999999994e-06 2024-09-13T05:13:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096306+0000", 2024-09-13T05:13:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:13:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152788+0000", 2024-09-13T05:13:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056481625000000001 2024-09-13T05:13:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152837+0000", 2024-09-13T05:13:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9345000000000003e-05 2024-09-13T05:13:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152897+0000", 2024-09-13T05:13:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9892999999999997e-05 2024-09-13T05:13:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136581 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4066304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:13:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.270564429000004, 2024-09-13T05:13:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056597091000000002, 2024-09-13T05:13:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136581 2024-09-13T05:13:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:13:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:13:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096312+0000", 2024-09-13T05:13:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998465 2024-09-13T05:13:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096469+0000", 2024-09-13T05:13:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157109 2024-09-13T05:13:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096478+0000", 2024-09-13T05:13:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3260000000000002e-06 2024-09-13T05:13:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096482+0000", 2024-09-13T05:13:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9720000000000003e-06 2024-09-13T05:13:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152933+0000", 2024-09-13T05:13:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056451128000000003 2024-09-13T05:13:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152993+0000", 2024-09-13T05:13:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9947000000000001e-05 2024-09-13T05:13:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153062+0000", 2024-09-13T05:13:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9105999999999999e-05 2024-09-13T05:13:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136583 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4080640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:13:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.270298515999997, 2024-09-13T05:13:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056496609000000003, 2024-09-13T05:13:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136583 2024-09-13T05:13:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:13:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:13:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096485+0000", 2024-09-13T05:13:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997544 2024-09-13T05:13:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096735+0000", 2024-09-13T05:13:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024979899999999998 2024-09-13T05:13:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096742+0000", 2024-09-13T05:13:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7139999999999996e-06 2024-09-13T05:13:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096747+0000", 2024-09-13T05:13:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8709999999999996e-06 2024-09-13T05:13:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153099+0000", 2024-09-13T05:13:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056352639000000003 2024-09-13T05:13:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153168+0000", 2024-09-13T05:13:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9029000000000006e-05 2024-09-13T05:13:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153228+0000", 2024-09-13T05:13:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9339999999999998e-05 2024-09-13T05:13:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136585 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4094976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:13:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.270047048999999, 2024-09-13T05:13:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056396420000000003, 2024-09-13T05:13:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136585 2024-09-13T05:13:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:13:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:13:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096750+0000", 2024-09-13T05:13:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997673 2024-09-13T05:13:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096986+0000", 2024-09-13T05:13:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000236297 2024-09-13T05:13:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096993+0000", 2024-09-13T05:13:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9600000000000003e-06 2024-09-13T05:13:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096999+0000", 2024-09-13T05:13:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:13:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153264+0000", 2024-09-13T05:13:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056264728999999999 2024-09-13T05:13:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153318+0000", 2024-09-13T05:13:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3934000000000002e-05 2024-09-13T05:13:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153379+0000", 2024-09-13T05:13:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1206999999999999e-05 2024-09-13T05:13:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136586 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4109312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:13:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.269846247000004, 2024-09-13T05:13:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056374703999999998, 2024-09-13T05:13:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136586 2024-09-13T05:13:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:13:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:13:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097004+0000", 2024-09-13T05:13:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998207 2024-09-13T05:13:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097187+0000", 2024-09-13T05:13:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018337900000000001 2024-09-13T05:13:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097198+0000", 2024-09-13T05:13:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348e-05 2024-09-13T05:13:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097202+0000", 2024-09-13T05:13:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.121e-06 2024-09-13T05:13:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153411+0000", 2024-09-13T05:13:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056209510999999997 2024-09-13T05:13:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153464+0000", 2024-09-13T05:13:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2605000000000002e-05 2024-09-13T05:13:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153558+0000", 2024-09-13T05:13:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4017999999999993e-05 2024-09-13T05:13:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136588 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:13:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.269562063999999, 2024-09-13T05:13:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056274980000000002, 2024-09-13T05:13:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136588 2024-09-13T05:13:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:13:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:13:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097205+0000", 2024-09-13T05:13:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997377 2024-09-13T05:13:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097471+0000", 2024-09-13T05:13:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026628200000000001 2024-09-13T05:13:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097484+0000", 2024-09-13T05:13:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2493e-05 2024-09-13T05:13:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097488+0000", 2024-09-13T05:13:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9330000000000003e-06 2024-09-13T05:13:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153600+0000", 2024-09-13T05:13:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056112097 2024-09-13T05:13:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153654+0000", 2024-09-13T05:13:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4126000000000003e-05 2024-09-13T05:13:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153742+0000", 2024-09-13T05:13:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.831e-05 2024-09-13T05:13:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136589 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4137984~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:13:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.269422757000001, 2024-09-13T05:13:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056293867999999997, 2024-09-13T05:13:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136589 2024-09-13T05:13:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:13:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:13:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097491+0000", 2024-09-13T05:13:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998841 2024-09-13T05:13:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097610+0000", 2024-09-13T05:13:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119263 2024-09-13T05:13:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097617+0000", 2024-09-13T05:13:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6490000000000002e-06 2024-09-13T05:13:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097624+0000", 2024-09-13T05:13:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6309999999999997e-06 2024-09-13T05:13:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153779+0000", 2024-09-13T05:13:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056155153999999999 2024-09-13T05:13:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153831+0000", 2024-09-13T05:13:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2080000000000003e-05 2024-09-13T05:13:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153901+0000", 2024-09-13T05:13:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9765999999999996e-05 2024-09-13T05:13:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136965 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3366912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:13:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.249453935999995, 2024-09-13T05:13:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056225403, 2024-09-13T05:13:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136965 2024-09-13T05:13:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:13:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:13:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117575+0000", 2024-09-13T05:13:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117578+0000", 2024-09-13T05:13:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4899999999999999e-06 2024-09-13T05:13:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117583+0000", 2024-09-13T05:13:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.074e-06 2024-09-13T05:13:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117587+0000", 2024-09-13T05:13:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5360000000000003e-06 2024-09-13T05:13:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173622+0000", 2024-09-13T05:13:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056034527000000001 2024-09-13T05:13:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173704+0000", 2024-09-13T05:13:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2137000000000003e-05 2024-09-13T05:13:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173801+0000", 2024-09-13T05:13:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7048999999999999e-05 2024-09-13T05:13:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136991 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3553280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:13:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.245528159000003, 2024-09-13T05:13:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056330199999999997, 2024-09-13T05:13:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136991 2024-09-13T05:13:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:13:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:13:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:13:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121504+0000", 2024-09-13T05:13:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7199999999999998e-06 2024-09-13T05:13:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121510+0000", 2024-09-13T05:13:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3459999999999999e-06 2024-09-13T05:13:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121515+0000", 2024-09-13T05:13:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.656e-06 2024-09-13T05:13:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177608+0000", 2024-09-13T05:13:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056093267000000002 2024-09-13T05:13:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177717+0000", 2024-09-13T05:13:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010901299999999999 2024-09-13T05:13:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177832+0000", 2024-09-13T05:13:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114604 2024-09-13T05:13:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173672 3.9 3:9520c004:::rbd_data.112d7c1bedf7.0000000000000040:29 [read 186368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:13:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 56.181633533999999, 2024-09-13T05:13:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05682475, 2024-09-13T05:13:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173672 2024-09-13T05:13:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:13:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:13:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185395+0000", 2024-09-13T05:13:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185398+0000", 2024-09-13T05:13:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8260000000000001e-06 2024-09-13T05:13:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185404+0000", 2024-09-13T05:13:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-09-13T05:13:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185408+0000", 2024-09-13T05:13:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5279999999999997e-06 2024-09-13T05:13:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.236213+0000", 2024-09-13T05:13:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050805207999999998 2024-09-13T05:13:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.236285+0000", 2024-09-13T05:13:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1236999999999996e-05 2024-09-13T05:13:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.242221+0000", 2024-09-13T05:13:21.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059360050000000003 2024-09-13T05:13:21.468 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.468 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.468 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.468 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.468 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.468 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:21.469 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:13:21.470 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:21.466+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:21.570 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:21.566+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:21.625 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:21.625 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:21.625 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:13:21.625 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:21.633 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:13:21.661 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is set 2024-09-13T05:13:21.670 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:21.667+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:21.750 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:21.750 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:21.751 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:13:21.751 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:13:21.751 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:21.761 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:13:21.805 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:21.802+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:21.869 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:13:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:13:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:13:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:70758 3.2 3:427d0469:::rbd_header.112d8d1317eb:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-13T05:13:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:13:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 118.435600721, 2024-09-13T05:13:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.190313603, 2024-09-13T05:13:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70758 2024-09-13T05:13:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:13:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:13:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428654+0000", 2024-09-13T05:13:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428664+0000", 2024-09-13T05:13:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0664e-05 2024-09-13T05:13:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428683+0000", 2024-09-13T05:13:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8377e-05 2024-09-13T05:13:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428691+0000", 2024-09-13T05:13:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9400000000000008e-06 2024-09-13T05:13:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428789+0000", 2024-09-13T05:13:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7165999999999998e-05 2024-09-13T05:13:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428811+0000", 2024-09-13T05:13:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1925000000000001e-05 2024-09-13T05:13:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.617921+0000", 2024-09-13T05:13:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.189110536 2024-09-13T05:13:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618344+0000", 2024-09-13T05:13:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042245800000000001 2024-09-13T05:13:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618969+0000", 2024-09-13T05:13:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062529299999999996 2024-09-13T05:13:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162381 3.8 3.4e1a3768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:13:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.355594474, 2024-09-13T05:13:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.14690313199999999, 2024-09-13T05:13:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:13:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162381 2024-09-13T05:13:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:13:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:13:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508659+0000", 2024-09-13T05:13:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:13:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508673+0000", 2024-09-13T05:13:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4154999999999999e-05 2024-09-13T05:13:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508703+0000", 2024-09-13T05:13:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9427000000000001e-05 2024-09-13T05:13:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508719+0000", 2024-09-13T05:13:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6381000000000001e-05 2024-09-13T05:13:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508789+0000", 2024-09-13T05:13:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9898000000000001e-05 2024-09-13T05:13:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508799+0000", 2024-09-13T05:13:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0066e-05 2024-09-13T05:13:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655550+0000", 2024-09-13T05:13:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.146750506 2024-09-13T05:13:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655565+0000", 2024-09-13T05:13:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4915e-05 2024-09-13T05:13:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162393 3.8 3.fd966c88 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:13:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.344078400000001, 2024-09-13T05:13:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.135657895, 2024-09-13T05:13:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:13:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162393 2024-09-13T05:13:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:13:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:13:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520176+0000", 2024-09-13T05:13:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:13:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520184+0000", 2024-09-13T05:13:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5800000000000003e-06 2024-09-13T05:13:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520199+0000", 2024-09-13T05:13:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4481000000000001e-05 2024-09-13T05:13:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520209+0000", 2024-09-13T05:13:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0327e-05 2024-09-13T05:13:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520351+0000", 2024-09-13T05:13:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141827 2024-09-13T05:13:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520363+0000", 2024-09-13T05:13:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2018000000000001e-05 2024-09-13T05:13:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655819+0000", 2024-09-13T05:13:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13545665600000001 2024-09-13T05:13:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655835+0000", 2024-09-13T05:13:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6135000000000001e-05 2024-09-13T05:13:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162429 3.8 3.6e098f28 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:13:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.343227791000004, 2024-09-13T05:13:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13484765400000001, 2024-09-13T05:13:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:13:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162429 2024-09-13T05:13:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:13:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:13:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:13:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521032+0000", 2024-09-13T05:13:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3039999999999998e-06 2024-09-13T05:13:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521041+0000", 2024-09-13T05:13:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6880000000000005e-06 2024-09-13T05:13:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521047+0000", 2024-09-13T05:13:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0100000000000001e-06 2024-09-13T05:13:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521601+0000", 2024-09-13T05:13:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00055398600000000002 2024-09-13T05:13:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521613+0000", 2024-09-13T05:13:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2347000000000001e-05 2024-09-13T05:13:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655869+0000", 2024-09-13T05:13:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.134255597 2024-09-13T05:13:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655876+0000", 2024-09-13T05:13:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2790000000000001e-06 2024-09-13T05:13:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162521 3.8 3.f06bf7c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:13:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.340825660999997, 2024-09-13T05:13:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13247452600000001, 2024-09-13T05:13:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:13:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162521 2024-09-13T05:13:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:13:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:13:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:13:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523433+0000", 2024-09-13T05:13:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.128e-06 2024-09-13T05:13:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523440+0000", 2024-09-13T05:13:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9990000000000002e-06 2024-09-13T05:13:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523446+0000", 2024-09-13T05:13:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7869999999999998e-06 2024-09-13T05:13:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.528221+0000", 2024-09-13T05:13:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047747040000000003 2024-09-13T05:13:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.528237+0000", 2024-09-13T05:13:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6042e-05 2024-09-13T05:13:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655898+0000", 2024-09-13T05:13:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.127661521 2024-09-13T05:13:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655905+0000", 2024-09-13T05:13:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7780000000000002e-06 2024-09-13T05:13:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162381 3.8 3:16ec5872:::rbd_data.112dc3abcba6.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:13:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.331298496000002, 2024-09-13T05:13:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12546553899999999, 2024-09-13T05:13:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162381 2024-09-13T05:13:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:13:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:13:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532956+0000", 2024-09-13T05:13:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532964+0000", 2024-09-13T05:13:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.072e-06 2024-09-13T05:13:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532976+0000", 2024-09-13T05:13:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1355000000000001e-05 2024-09-13T05:13:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532984+0000", 2024-09-13T05:13:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3440000000000001e-06 2024-09-13T05:13:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533432+0000", 2024-09-13T05:13:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044773000000000002 2024-09-13T05:13:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533439+0000", 2024-09-13T05:13:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9890000000000003e-06 2024-09-13T05:13:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655985+0000", 2024-09-13T05:13:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122546527 2024-09-13T05:13:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656234+0000", 2024-09-13T05:13:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024911300000000003 2024-09-13T05:13:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656378+0000", 2024-09-13T05:13:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014417100000000001 2024-09-13T05:13:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657916+0000", 2024-09-13T05:13:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001537907 2024-09-13T05:13:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:13:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658308+0000", 2024-09-13T05:13:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039183700000000002 2024-09-13T05:13:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:13:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658364+0000", 2024-09-13T05:13:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5451000000000002e-05 2024-09-13T05:13:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658423+0000", 2024-09-13T05:13:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9449e-05 2024-09-13T05:13:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162393 3.8 3:113669bf:::rbd_data.112dfd94ee88.00000000000000bf:2a [read 131072~18432] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:13:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.331258716999997, 2024-09-13T05:13:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124231431, 2024-09-13T05:13:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162393 2024-09-13T05:13:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:13:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:13:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:13:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533001+0000", 2024-09-13T05:13:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8099999999999999e-06 2024-09-13T05:13:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533007+0000", 2024-09-13T05:13:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5849999999999996e-06 2024-09-13T05:13:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533012+0000", 2024-09-13T05:13:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0320000000000003e-06 2024-09-13T05:13:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533459+0000", 2024-09-13T05:13:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044646399999999999 2024-09-13T05:13:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533464+0000", 2024-09-13T05:13:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9180000000000002e-06 2024-09-13T05:13:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656870+0000", 2024-09-13T05:13:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123406847 2024-09-13T05:13:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657067+0000", 2024-09-13T05:13:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019655599999999999 2024-09-13T05:13:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657229+0000", 2024-09-13T05:13:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016175599999999999 2024-09-13T05:13:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162429 3.8 3:14f19076:::rbd_data.112dfd94ee88.0000000000000150:2a [read 131072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:13:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.331239167000007, 2024-09-13T05:13:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124549956, 2024-09-13T05:13:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162429 2024-09-13T05:13:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:13:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:13:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533016+0000", 2024-09-13T05:13:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533020+0000", 2024-09-13T05:13:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1049999999999999e-06 2024-09-13T05:13:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533025+0000", 2024-09-13T05:13:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-09-13T05:13:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533030+0000", 2024-09-13T05:13:21.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8999999999999997e-06 2024-09-13T05:13:21.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533481+0000", 2024-09-13T05:13:21.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045080400000000002 2024-09-13T05:13:21.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:21.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533486+0000", 2024-09-13T05:13:21.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3369999999999999e-06 2024-09-13T05:13:21.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657311+0000", 2024-09-13T05:13:21.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123824408 2024-09-13T05:13:21.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657464+0000", 2024-09-13T05:13:21.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015343900000000001 2024-09-13T05:13:21.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657567+0000", 2024-09-13T05:13:21.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102568 2024-09-13T05:13:21.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.914 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.914 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162521 3.8 3:13efd60f:::rbd_data.112dfd94ee88.000000000000031a:2a [read 131072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:21.914 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:13:21.914 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.331087933999996, 2024-09-13T05:13:21.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124709257, 2024-09-13T05:13:21.914 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.914 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.914 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.914 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.915 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162521 2024-09-13T05:13:21.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.915 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:13:21.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:13:21.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:13:21.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:21.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533170+0000", 2024-09-13T05:13:21.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3910000000000001e-06 2024-09-13T05:13:21.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533176+0000", 2024-09-13T05:13:21.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4029999999999998e-06 2024-09-13T05:13:21.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533180+0000", 2024-09-13T05:13:21.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6999999999999999e-06 2024-09-13T05:13:21.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533659+0000", 2024-09-13T05:13:21.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047839699999999998 2024-09-13T05:13:21.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:21.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533664+0000", 2024-09-13T05:13:21.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7239999999999997e-06 2024-09-13T05:13:21.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657619+0000", 2024-09-13T05:13:21.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123954412 2024-09-13T05:13:21.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657784+0000", 2024-09-13T05:13:21.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016527499999999999 2024-09-13T05:13:21.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657877+0000", 2024-09-13T05:13:21.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3280000000000001e-05 2024-09-13T05:13:21.919 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.919 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.919 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.919 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162618 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 70656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:21.919 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:13:21.919 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.329783223999996, 2024-09-13T05:13:21.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123752711, 2024-09-13T05:13:21.919 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.920 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.920 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.920 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.920 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.920 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162618 2024-09-13T05:13:21.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.920 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:13:21.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:13:21.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534472+0000", 2024-09-13T05:13:21.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:21.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534475+0000", 2024-09-13T05:13:21.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2010000000000002e-06 2024-09-13T05:13:21.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534482+0000", 2024-09-13T05:13:21.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:13:21.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534486+0000", 2024-09-13T05:13:21.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7520000000000004e-06 2024-09-13T05:13:21.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536456+0000", 2024-09-13T05:13:21.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001969527 2024-09-13T05:13:21.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:21.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536462+0000", 2024-09-13T05:13:21.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2750000000000001e-06 2024-09-13T05:13:21.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657939+0000", 2024-09-13T05:13:21.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121476769 2024-09-13T05:13:21.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658087+0000", 2024-09-13T05:13:21.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014862400000000001 2024-09-13T05:13:21.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658225+0000", 2024-09-13T05:13:21.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013800999999999999 2024-09-13T05:13:21.924 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.924 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.924 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.924 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162620 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 71680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:21.924 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:13:21.924 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.329749098999997, 2024-09-13T05:13:21.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124087688, 2024-09-13T05:13:21.925 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.925 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.925 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.925 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.925 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.925 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162620 2024-09-13T05:13:21.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.925 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:13:21.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:13:21.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:13:21.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:21.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534509+0000", 2024-09-13T05:13:21.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1270000000000001e-06 2024-09-13T05:13:21.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534514+0000", 2024-09-13T05:13:21.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8720000000000001e-06 2024-09-13T05:13:21.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534518+0000", 2024-09-13T05:13:21.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5090000000000004e-06 2024-09-13T05:13:21.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536485+0000", 2024-09-13T05:13:21.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019671530000000001 2024-09-13T05:13:21.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:21.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536491+0000", 2024-09-13T05:13:21.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3759999999999999e-06 2024-09-13T05:13:21.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658466+0000", 2024-09-13T05:13:21.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121975466 2024-09-13T05:13:21.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658522+0000", 2024-09-13T05:13:21.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5668999999999998e-05 2024-09-13T05:13:21.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658595+0000", 2024-09-13T05:13:21.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2800999999999996e-05 2024-09-13T05:13:21.930 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.930 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.930 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.930 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162622 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 72704~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:21.930 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:13:21.930 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.329718131999996, 2024-09-13T05:13:21.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124215569, 2024-09-13T05:13:21.930 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.930 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.930 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.930 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.930 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.931 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162622 2024-09-13T05:13:21.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.931 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:13:21.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:13:21.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534537+0000", 2024-09-13T05:13:21.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:21.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534540+0000", 2024-09-13T05:13:21.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3740000000000001e-06 2024-09-13T05:13:21.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534545+0000", 2024-09-13T05:13:21.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4210000000000003e-06 2024-09-13T05:13:21.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534550+0000", 2024-09-13T05:13:21.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3090000000000003e-06 2024-09-13T05:13:21.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536510+0000", 2024-09-13T05:13:21.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019597130000000001 2024-09-13T05:13:21.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:21.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536517+0000", 2024-09-13T05:13:21.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0620000000000003e-06 2024-09-13T05:13:21.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658632+0000", 2024-09-13T05:13:21.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122114373 2024-09-13T05:13:21.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658686+0000", 2024-09-13T05:13:21.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3882999999999999e-05 2024-09-13T05:13:21.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658753+0000", 2024-09-13T05:13:21.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7921000000000002e-05 2024-09-13T05:13:21.935 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.935 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.935 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.935 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162623 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 73728~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:21.935 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:13:21.935 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.329701326999995, 2024-09-13T05:13:21.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124350214, 2024-09-13T05:13:21.935 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.935 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.936 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.936 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.936 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.936 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162623 2024-09-13T05:13:21.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.936 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:13:21.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:13:21.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534554+0000", 2024-09-13T05:13:21.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:21.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534556+0000", 2024-09-13T05:13:21.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-13T05:13:21.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534563+0000", 2024-09-13T05:13:21.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2890000000000003e-06 2024-09-13T05:13:21.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534567+0000", 2024-09-13T05:13:21.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4880000000000001e-06 2024-09-13T05:13:21.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536538+0000", 2024-09-13T05:13:21.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019703989999999998 2024-09-13T05:13:21.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:21.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536543+0000", 2024-09-13T05:13:21.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3920000000000002e-06 2024-09-13T05:13:21.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658773+0000", 2024-09-13T05:13:21.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122229607 2024-09-13T05:13:21.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658835+0000", 2024-09-13T05:13:21.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1954999999999999e-05 2024-09-13T05:13:21.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658905+0000", 2024-09-13T05:13:21.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-09-13T05:13:21.940 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.940 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.940 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.940 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162626 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 65536~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:21.940 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:13:21.940 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.329650043000001, 2024-09-13T05:13:21.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124425881, 2024-09-13T05:13:21.941 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.941 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.941 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.941 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.941 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.941 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162626 2024-09-13T05:13:21.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.941 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:13:21.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:13:21.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:13:21.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:21.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534611+0000", 2024-09-13T05:13:21.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5419999999999996e-06 2024-09-13T05:13:21.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534617+0000", 2024-09-13T05:13:21.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5169999999999999e-06 2024-09-13T05:13:21.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534622+0000", 2024-09-13T05:13:21.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9810000000000003e-06 2024-09-13T05:13:21.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536563+0000", 2024-09-13T05:13:21.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019410549999999999 2024-09-13T05:13:21.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:21.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536568+0000", 2024-09-13T05:13:21.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4310000000000002e-06 2024-09-13T05:13:21.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658922+0000", 2024-09-13T05:13:21.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122354221 2024-09-13T05:13:21.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658968+0000", 2024-09-13T05:13:21.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5221e-05 2024-09-13T05:13:21.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659032+0000", 2024-09-13T05:13:21.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4256000000000003e-05 2024-09-13T05:13:21.945 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.945 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.945 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.945 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162628 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 66560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:21.946 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:13:21.946 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.329615091999997, 2024-09-13T05:13:21.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124532254, 2024-09-13T05:13:21.946 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.946 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.946 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.946 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.946 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.946 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162628 2024-09-13T05:13:21.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.946 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:13:21.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:13:21.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:13:21.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:21.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534643+0000", 2024-09-13T05:13:21.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1890000000000001e-06 2024-09-13T05:13:21.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534648+0000", 2024-09-13T05:13:21.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:13:21.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534652+0000", 2024-09-13T05:13:21.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4549999999999997e-06 2024-09-13T05:13:21.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536586+0000", 2024-09-13T05:13:21.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019336049999999999 2024-09-13T05:13:21.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:21.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536591+0000", 2024-09-13T05:13:21.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3770000000000004e-06 2024-09-13T05:13:21.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659062+0000", 2024-09-13T05:13:21.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122470685 2024-09-13T05:13:21.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659106+0000", 2024-09-13T05:13:21.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3856000000000002e-05 2024-09-13T05:13:21.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659173+0000", 2024-09-13T05:13:21.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7168000000000005e-05 2024-09-13T05:13:21.950 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.950 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.950 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.951 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162630 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 67584~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:21.951 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:13:21.951 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.329581886, 2024-09-13T05:13:21.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12468555100000001, 2024-09-13T05:13:21.951 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.951 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.951 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162630 2024-09-13T05:13:21.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.951 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:13:21.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:13:21.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:13:21.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:21.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534676+0000", 2024-09-13T05:13:21.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4399999999999999e-06 2024-09-13T05:13:21.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534681+0000", 2024-09-13T05:13:21.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2349999999999999e-06 2024-09-13T05:13:21.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534686+0000", 2024-09-13T05:13:21.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5499999999999996e-06 2024-09-13T05:13:21.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536609+0000", 2024-09-13T05:13:21.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001923407 2024-09-13T05:13:21.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:21.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536615+0000", 2024-09-13T05:13:21.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1499999999999998e-06 2024-09-13T05:13:21.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659233+0000", 2024-09-13T05:13:21.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122618957 2024-09-13T05:13:21.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659294+0000", 2024-09-13T05:13:21.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0251000000000003e-05 2024-09-13T05:13:21.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659360+0000", 2024-09-13T05:13:21.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5906000000000002e-05 2024-09-13T05:13:21.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.955 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.956 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.956 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162633 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 69632~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:21.956 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:13:21.956 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.329473981000007, 2024-09-13T05:13:21.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124702147, 2024-09-13T05:13:21.956 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.956 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.956 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162633 2024-09-13T05:13:21.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.957 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:13:21.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:13:21.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:13:21.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:21.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534784+0000", 2024-09-13T05:13:21.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3300000000000001e-06 2024-09-13T05:13:21.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534789+0000", 2024-09-13T05:13:21.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4149999999999998e-06 2024-09-13T05:13:21.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534794+0000", 2024-09-13T05:13:21.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5669999999999996e-06 2024-09-13T05:13:21.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536634+0000", 2024-09-13T05:13:21.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001840401 2024-09-13T05:13:21.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:21.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536642+0000", 2024-09-13T05:13:21.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9729999999999997e-06 2024-09-13T05:13:21.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659383+0000", 2024-09-13T05:13:21.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12274112099999999 2024-09-13T05:13:21.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659424+0000", 2024-09-13T05:13:21.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0936000000000002e-05 2024-09-13T05:13:21.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659484+0000", 2024-09-13T05:13:21.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9775000000000003e-05 2024-09-13T05:13:21.961 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.961 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.961 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.961 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162675 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 68608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:21.961 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:13:21.961 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.329424936999999, 2024-09-13T05:13:21.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124823974, 2024-09-13T05:13:21.961 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.961 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:21.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.962 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162675 2024-09-13T05:13:21.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.962 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:13:21.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:13:21.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:13:21.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:21.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534833+0000", 2024-09-13T05:13:21.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.204e-06 2024-09-13T05:13:21.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534838+0000", 2024-09-13T05:13:21.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0130000000000001e-06 2024-09-13T05:13:21.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534842+0000", 2024-09-13T05:13:21.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.51e-06 2024-09-13T05:13:21.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536661+0000", 2024-09-13T05:13:21.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018186039999999999 2024-09-13T05:13:21.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:21.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536667+0000", 2024-09-13T05:13:21.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5260000000000001e-06 2024-09-13T05:13:21.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659531+0000", 2024-09-13T05:13:21.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122864403 2024-09-13T05:13:21.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659583+0000", 2024-09-13T05:13:21.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1564000000000003e-05 2024-09-13T05:13:21.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659655+0000", 2024-09-13T05:13:21.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2504999999999998e-05 2024-09-13T05:13:21.966 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.966 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.967 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:170203 3.1e 3:7c9b1cf4:::rbd_header.112dc3abcba6:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128)", 2024-09-13T05:13:21.967 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:13:21.967 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.049445966, 2024-09-13T05:13:21.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.79948714899999995, 2024-09-13T05:13:21.967 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.967 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:21.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.967 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 170203 2024-09-13T05:13:21.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.968 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:13:21.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:13:21.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814808+0000", 2024-09-13T05:13:21.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:21.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814820+0000", 2024-09-13T05:13:21.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.206e-05 2024-09-13T05:13:21.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814841+0000", 2024-09-13T05:13:21.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1464999999999999e-05 2024-09-13T05:13:21.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814853+0000", 2024-09-13T05:13:21.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1824999999999999e-05 2024-09-13T05:13:21.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814911+0000", 2024-09-13T05:13:21.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8255999999999999e-05 2024-09-13T05:13:21.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:21.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814918+0000", 2024-09-13T05:13:21.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7120000000000003e-06 2024-09-13T05:13:21.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.611660+0000", 2024-09-13T05:13:21.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.79674180100000003 2024-09-13T05:13:21.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.611911+0000", 2024-09-13T05:13:21.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025108900000000002 2024-09-13T05:13:21.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-13T05:13:21.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.612726+0000", 2024-09-13T05:13:21.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00081512999999999996 2024-09-13T05:13:21.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:21.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614087+0000", 2024-09-13T05:13:21.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013607560000000001 2024-09-13T05:13:21.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:13:21.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614095+0000", 2024-09-13T05:13:21.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3240000000000003e-06 2024-09-13T05:13:21.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:13:21.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614138+0000", 2024-09-13T05:13:21.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3115000000000003e-05 2024-09-13T05:13:21.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614297+0000", 2024-09-13T05:13:21.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015875399999999999 2024-09-13T05:13:21.973 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.973 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.973 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.973 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:206714 3.1e 3:7a6b822e:::rbd_id.image_client.0-clone15:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e182)", 2024-09-13T05:13:21.973 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:13:16.942501+0000", 2024-09-13T05:13:21.974 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.9217553760000001, 2024-09-13T05:13:21.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.93017799199999995, 2024-09-13T05:13:21.974 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:21.974 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:21.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:21.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:21.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:21.974 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 206714 2024-09-13T05:13:21.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.974 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:21.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:21.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942501+0000", 2024-09-13T05:13:21.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:21.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942501+0000", 2024-09-13T05:13:21.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:21.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:21.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942498+0000", 2024-09-13T05:13:21.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:13:21.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:21.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942510+0000", 2024-09-13T05:13:21.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1564e-05 2024-09-13T05:13:21.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:21.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942531+0000", 2024-09-13T05:13:21.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1713e-05 2024-09-13T05:13:21.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:21.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942543+0000", 2024-09-13T05:13:21.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1684e-05 2024-09-13T05:13:21.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942671+0000", 2024-09-13T05:13:21.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012764699999999999 2024-09-13T05:13:21.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:21.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942693+0000", 2024-09-13T05:13:21.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2690000000000001e-05 2024-09-13T05:13:21.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:21.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.867517+0000", 2024-09-13T05:13:21.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.92482318399999996 2024-09-13T05:13:21.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:21.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.867693+0000", 2024-09-13T05:13:21.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017623199999999999 2024-09-13T05:13:21.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:13:21.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.867788+0000", 2024-09-13T05:13:21.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5588999999999996e-05 2024-09-13T05:13:21.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:13:21.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.869416+0000", 2024-09-13T05:13:21.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016272750000000001 2024-09-13T05:13:21.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:21.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.872552+0000", 2024-09-13T05:13:21.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031364850000000001 2024-09-13T05:13:21.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:13:21.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.872628+0000", 2024-09-13T05:13:21.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5871999999999995e-05 2024-09-13T05:13:21.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:21.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:21.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:21.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.872679+0000", 2024-09-13T05:13:21.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0630999999999997e-05 2024-09-13T05:13:21.980 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.980 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.980 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.980 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:21.980 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:21.980 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:21.981 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:13:21.982 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:21.975+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:22.082 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:22.079+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:22.099 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:22.100 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:22.100 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:13:22.100 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:22.110 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:13:22.184 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:22.179+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:22.213 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:22.213 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:22.214 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:13:22.214 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:13:22.214 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:22.223 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:13:22.285 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:22.279+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:22.376 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:22.376 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:13:22.376 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:13:22.376 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:13:22.376 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.376 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203004 3.1a 3:5a99807b:::rbd_object_map.112dbd21872d:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159)", 2024-09-13T05:13:22.376 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.649669+0000", 2024-09-13T05:13:22.377 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.723276193, 2024-09-13T05:13:22.377 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0064520619999999997, 2024-09-13T05:13:22.377 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.377 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:22.377 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.377 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.377 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.377 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203004 2024-09-13T05:13:22.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.378 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649669+0000", 2024-09-13T05:13:22.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649669+0000", 2024-09-13T05:13:22.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649668+0000", 2024-09-13T05:13:22.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:22.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649676+0000", 2024-09-13T05:13:22.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0020000000000006e-06 2024-09-13T05:13:22.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.380 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.380 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649686+0000", 2024-09-13T05:13:22.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0702e-05 2024-09-13T05:13:22.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.380 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.381 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649694+0000", 2024-09-13T05:13:22.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9370000000000004e-06 2024-09-13T05:13:22.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.381 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.381 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.650848+0000", 2024-09-13T05:13:22.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0011532020000000001 2024-09-13T05:13:22.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.650973+0000", 2024-09-13T05:13:22.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012510099999999999 2024-09-13T05:13:22.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:22.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.651197+0000", 2024-09-13T05:13:22.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00022407899999999999 2024-09-13T05:13:22.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:22.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.653302+0000", 2024-09-13T05:13:22.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021053629999999999 2024-09-13T05:13:22.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:22.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655437+0000", 2024-09-13T05:13:22.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002135348 2024-09-13T05:13:22.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:22.384 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655500+0000", 2024-09-13T05:13:22.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2453999999999995e-05 2024-09-13T05:13:22.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.384 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.384 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656122+0000", 2024-09-13T05:13:22.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00062160299999999998 2024-09-13T05:13:22.384 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.384 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.384 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.384 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.3.0:5114 3.b e159/149 3:d13d0bb6:::rbd_data.112dbd21872d.000000000000000c:28 v 159'614, mlcod=158'611)", 2024-09-13T05:13:22.385 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.655063+0000", 2024-09-13T05:13:22.385 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.717883121, 2024-09-13T05:13:22.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0057558009999999996, 2024-09-13T05:13:22.385 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.385 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:22.385 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655063+0000", 2024-09-13T05:13:22.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655063+0000", 2024-09-13T05:13:22.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655062+0000", 2024-09-13T05:13:22.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:22.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655070+0000", 2024-09-13T05:13:22.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5059999999999995e-06 2024-09-13T05:13:22.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655092+0000", 2024-09-13T05:13:22.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2310000000000002e-05 2024-09-13T05:13:22.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655105+0000", 2024-09-13T05:13:22.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2432999999999999e-05 2024-09-13T05:13:22.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.388 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.388 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655154+0000", 2024-09-13T05:13:22.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8673e-05 2024-09-13T05:13:22.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.388 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.388 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655171+0000", 2024-09-13T05:13:22.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7487999999999999e-05 2024-09-13T05:13:22.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:22.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.660765+0000", 2024-09-13T05:13:22.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0055935209999999997 2024-09-13T05:13:22.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.660818+0000", 2024-09-13T05:13:22.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3769e-05 2024-09-13T05:13:22.389 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.389 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.389 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.390 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7318 3.13 e159/153 3:cf0a521c:::rbd_data.112dbd21872d.0000000000000004:28 v 159'1220, mlcod=159'1216)", 2024-09-13T05:13:22.390 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.655897+0000", 2024-09-13T05:13:22.390 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.717048398999999, 2024-09-13T05:13:22.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0075974520000000002, 2024-09-13T05:13:22.390 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.390 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:22.390 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655897+0000", 2024-09-13T05:13:22.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.391 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.391 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655897+0000", 2024-09-13T05:13:22.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.392 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655897+0000", 2024-09-13T05:13:22.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:22.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.392 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.392 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655906+0000", 2024-09-13T05:13:22.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6290000000000005e-06 2024-09-13T05:13:22.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.392 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.392 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655916+0000", 2024-09-13T05:13:22.393 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0079e-05 2024-09-13T05:13:22.393 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.393 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.393 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.393 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655923+0000", 2024-09-13T05:13:22.394 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1319999999999996e-06 2024-09-13T05:13:22.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.394 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656023+0000", 2024-09-13T05:13:22.394 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9747000000000006e-05 2024-09-13T05:13:22.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.394 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656042+0000", 2024-09-13T05:13:22.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8491999999999998e-05 2024-09-13T05:13:22.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:22.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.663412+0000", 2024-09-13T05:13:22.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0073701959999999999 2024-09-13T05:13:22.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.663495+0000", 2024-09-13T05:13:22.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2923000000000005e-05 2024-09-13T05:13:22.395 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.395 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.396 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.396 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.3.0:5116 3.b e159/149 3:d32d7958:::rbd_data.112dbd21872d.0000000000000001:28 v 159'616, mlcod=158'611)", 2024-09-13T05:13:22.396 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.655899+0000", 2024-09-13T05:13:22.396 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.717046715999999, 2024-09-13T05:13:22.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0075096859999999998, 2024-09-13T05:13:22.396 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.396 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:22.396 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655899+0000", 2024-09-13T05:13:22.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.397 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.397 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655899+0000", 2024-09-13T05:13:22.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.397 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655898+0000", 2024-09-13T05:13:22.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:22.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655907+0000", 2024-09-13T05:13:22.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5939999999999994e-06 2024-09-13T05:13:22.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.402 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.402 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655916+0000", 2024-09-13T05:13:22.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9840000000000007e-06 2024-09-13T05:13:22.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.402 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.402 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655923+0000", 2024-09-13T05:13:22.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1350000000000003e-06 2024-09-13T05:13:22.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.402 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.403 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656059+0000", 2024-09-13T05:13:22.403 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013669999999999999 2024-09-13T05:13:22.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.403 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.403 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656079+0000", 2024-09-13T05:13:22.403 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9293e-05 2024-09-13T05:13:22.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.403 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:22.403 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.663368+0000", 2024-09-13T05:13:22.403 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0072892570000000004 2024-09-13T05:13:22.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.404 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.404 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.663409+0000", 2024-09-13T05:13:22.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0614000000000001e-05 2024-09-13T05:13:22.404 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.404 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.404 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.404 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7323 3.e e159/151 3:742bfecb:::rbd_data.112dbd21872d.0000000000000018:28 v 159'1051, mlcod=157'1046)", 2024-09-13T05:13:22.404 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.668166+0000", 2024-09-13T05:13:22.404 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 28.704779521999999, 2024-09-13T05:13:22.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0065306610000000001, 2024-09-13T05:13:22.404 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.405 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:22.405 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.405 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668166+0000", 2024-09-13T05:13:22.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.405 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668166+0000", 2024-09-13T05:13:22.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668165+0000", 2024-09-13T05:13:22.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:22.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668174+0000", 2024-09-13T05:13:22.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.3790000000000006e-06 2024-09-13T05:13:22.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.407 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668187+0000", 2024-09-13T05:13:22.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3172e-05 2024-09-13T05:13:22.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.407 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.407 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.407 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668208+0000", 2024-09-13T05:13:22.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0713999999999999e-05 2024-09-13T05:13:22.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.407 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.407 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.407 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668272+0000", 2024-09-13T05:13:22.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4453000000000001e-05 2024-09-13T05:13:22.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.408 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.408 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.408 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668289+0000", 2024-09-13T05:13:22.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7331000000000001e-05 2024-09-13T05:13:22.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.408 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.408 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:22.408 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.674630+0000", 2024-09-13T05:13:22.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0063409340000000003 2024-09-13T05:13:22.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.408 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.674697+0000", 2024-09-13T05:13:22.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6472999999999999e-05 2024-09-13T05:13:22.409 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.409 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.409 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.409 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.409 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203156 3.9 3:9079854c:::rbd_header.112d52e08ead:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e160)", 2024-09-13T05:13:22.409 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:54.685914+0000", 2024-09-13T05:13:22.409 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 27.687031595000001, 2024-09-13T05:13:22.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0085711250000000006, 2024-09-13T05:13:22.409 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.409 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:22.410 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.410 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.410 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.410 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203156 2024-09-13T05:13:22.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.410 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.410 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.410 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685914+0000", 2024-09-13T05:13:22.410 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.410 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.410 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685914+0000", 2024-09-13T05:13:22.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685912+0000", 2024-09-13T05:13:22.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:22.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685924+0000", 2024-09-13T05:13:22.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1537e-05 2024-09-13T05:13:22.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685950+0000", 2024-09-13T05:13:22.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6781e-05 2024-09-13T05:13:22.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.412 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685962+0000", 2024-09-13T05:13:22.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1953999999999999e-05 2024-09-13T05:13:22.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.412 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.686102+0000", 2024-09-13T05:13:22.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013926300000000001 2024-09-13T05:13:22.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op must wait for map", 2024-09-13T05:13:22.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.686115+0000", 2024-09-13T05:13:22.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3506000000000001e-05 2024-09-13T05:13:22.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.689954+0000", 2024-09-13T05:13:22.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0038391810000000001 2024-09-13T05:13:22.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.690104+0000", 2024-09-13T05:13:22.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014980500000000001 2024-09-13T05:13:22.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 2", 2024-09-13T05:13:22.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.690674+0000", 2024-09-13T05:13:22.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00057014200000000004 2024-09-13T05:13:22.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:22.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.692426+0000", 2024-09-13T05:13:22.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0017518810000000001 2024-09-13T05:13:22.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:22.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.694360+0000", 2024-09-13T05:13:22.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0019340819999999999 2024-09-13T05:13:22.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.415 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:22.415 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.694443+0000", 2024-09-13T05:13:22.415 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2693000000000003e-05 2024-09-13T05:13:22.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.415 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.415 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.694485+0000", 2024-09-13T05:13:22.415 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2355999999999999e-05 2024-09-13T05:13:22.415 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.415 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.415 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.416 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203594 3.1 3:82a5a606:::rbd_object_map.112d841a7de:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163)", 2024-09-13T05:13:22.416 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:57.719919+0000", 2024-09-13T05:13:22.416 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 24.653026337, 2024-09-13T05:13:22.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0058258199999999998, 2024-09-13T05:13:22.416 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.416 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:22.416 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.416 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.416 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.416 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203594 2024-09-13T05:13:22.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.416 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.719919+0000", 2024-09-13T05:13:22.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.417 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.719919+0000", 2024-09-13T05:13:22.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.417 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.719916+0000", 2024-09-13T05:13:22.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999967 2024-09-13T05:13:22.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.719935+0000", 2024-09-13T05:13:22.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8637000000000001e-05 2024-09-13T05:13:22.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.719965+0000", 2024-09-13T05:13:22.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0457e-05 2024-09-13T05:13:22.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.719981+0000", 2024-09-13T05:13:22.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6359e-05 2024-09-13T05:13:22.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.419 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.419 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.720066+0000", 2024-09-13T05:13:22.419 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4710999999999996e-05 2024-09-13T05:13:22.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.419 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op must wait for map", 2024-09-13T05:13:22.419 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.720072+0000", 2024-09-13T05:13:22.419 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5300000000000004e-06 2024-09-13T05:13:22.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.419 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.419 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.723400+0000", 2024-09-13T05:13:22.420 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0033279809999999998 2024-09-13T05:13:22.420 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.420 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.420 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.420 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.723530+0000", 2024-09-13T05:13:22.420 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013047300000000001 2024-09-13T05:13:22.420 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.420 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.420 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 3", 2024-09-13T05:13:22.420 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.723708+0000", 2024-09-13T05:13:22.420 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017767400000000001 2024-09-13T05:13:22.420 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.420 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.420 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:22.421 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.725594+0000", 2024-09-13T05:13:22.421 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0018860960000000001 2024-09-13T05:13:22.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.421 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.421 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:22.421 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.725617+0000", 2024-09-13T05:13:22.421 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3210999999999999e-05 2024-09-13T05:13:22.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.421 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.421 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:22.421 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.725675+0000", 2024-09-13T05:13:22.421 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7899999999999998e-05 2024-09-13T05:13:22.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.421 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.422 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.422 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:57.725745+0000", 2024-09-13T05:13:22.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0097000000000003e-05 2024-09-13T05:13:22.422 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.422 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.422 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.422 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203849 3.3 3:c190344a:::rbd_data.112d1f830c0e.0000000000000000:head [delete] snapc 23=[] ondisk+write+known_if_redirected+supports_pool_eio e164)", 2024-09-13T05:13:22.422 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:58.853242+0000", 2024-09-13T05:13:22.422 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.519703187000001, 2024-09-13T05:13:22.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0070665509999999999, 2024-09-13T05:13:22.422 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.422 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:22.422 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.423 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.423 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.423 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203849 2024-09-13T05:13:22.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.423 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853242+0000", 2024-09-13T05:13:22.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853242+0000", 2024-09-13T05:13:22.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.424 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.424 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.424 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.424 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853240+0000", 2024-09-13T05:13:22.424 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:13:22.424 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.424 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.424 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.424 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853253+0000", 2024-09-13T05:13:22.424 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2330000000000001e-05 2024-09-13T05:13:22.424 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.424 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.424 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.424 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853286+0000", 2024-09-13T05:13:22.425 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3798999999999999e-05 2024-09-13T05:13:22.425 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.425 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.425 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.425 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853321+0000", 2024-09-13T05:13:22.425 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4749999999999998e-05 2024-09-13T05:13:22.425 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.425 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.425 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.425 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853568+0000", 2024-09-13T05:13:22.425 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024706400000000002 2024-09-13T05:13:22.425 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.425 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.425 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853935+0000", 2024-09-13T05:13:22.426 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00036690600000000001 2024-09-13T05:13:22.426 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:22.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854221+0000", 2024-09-13T05:13:22.426 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00028613100000000002 2024-09-13T05:13:22.426 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:22.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.859106+0000", 2024-09-13T05:13:22.426 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0048842629999999998 2024-09-13T05:13:22.426 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:22.427 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860185+0000", 2024-09-13T05:13:22.427 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0010796740000000001 2024-09-13T05:13:22.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:22.427 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860252+0000", 2024-09-13T05:13:22.427 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6928999999999996e-05 2024-09-13T05:13:22.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.427 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860309+0000", 2024-09-13T05:13:22.427 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6898999999999999e-05 2024-09-13T05:13:22.427 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.428 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.428 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.428 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.428 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.428 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203852 3.1a 3:5af372d9:::rbd_data.112d1f830c0e.0000000000000003:head [delete] snapc 23=[] ondisk+write+known_if_redirected+supports_pool_eio e164)", 2024-09-13T05:13:22.428 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:58.853358+0000", 2024-09-13T05:13:22.428 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.519587829999999, 2024-09-13T05:13:22.428 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0069302069999999999, 2024-09-13T05:13:22.428 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.428 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:22.428 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.428 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.428 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.429 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203852 2024-09-13T05:13:22.429 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.429 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.429 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.429 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.429 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853358+0000", 2024-09-13T05:13:22.429 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.429 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.429 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.429 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.429 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853358+0000", 2024-09-13T05:13:22.429 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.429 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.429 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.430 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.430 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853357+0000", 2024-09-13T05:13:22.430 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:22.430 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.430 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.430 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.430 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853363+0000", 2024-09-13T05:13:22.430 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6059999999999999e-06 2024-09-13T05:13:22.430 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.430 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.431 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.431 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853421+0000", 2024-09-13T05:13:22.431 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8075999999999998e-05 2024-09-13T05:13:22.431 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.431 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.431 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.431 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854643+0000", 2024-09-13T05:13:22.431 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001221904 2024-09-13T05:13:22.431 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.431 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.431 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.431 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854777+0000", 2024-09-13T05:13:22.431 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013323100000000001 2024-09-13T05:13:22.432 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.432 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.432 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.432 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.855094+0000", 2024-09-13T05:13:22.432 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00031790600000000002 2024-09-13T05:13:22.432 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.432 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.432 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:22.432 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.855378+0000", 2024-09-13T05:13:22.432 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00028385800000000001 2024-09-13T05:13:22.432 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.432 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.432 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:22.433 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.859936+0000", 2024-09-13T05:13:22.433 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0045574450000000002 2024-09-13T05:13:22.433 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.433 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.433 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:22.433 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860199+0000", 2024-09-13T05:13:22.433 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00026360899999999999 2024-09-13T05:13:22.433 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.433 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.433 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:22.433 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860250+0000", 2024-09-13T05:13:22.433 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0625999999999999e-05 2024-09-13T05:13:22.433 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.433 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.433 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.434 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860288+0000", 2024-09-13T05:13:22.434 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8028999999999998e-05 2024-09-13T05:13:22.434 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.434 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.434 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.434 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.434 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.434 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7486 3.13 e174/153 3:cd8ae6b5:::rbd_data.112d667fb7f9.0000000000000061:19 v 174'1266, mlcod=174'1262)", 2024-09-13T05:13:22.434 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:08.810849+0000", 2024-09-13T05:13:22.434 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.56209705, 2024-09-13T05:13:22.434 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0061914229999999997, 2024-09-13T05:13:22.434 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.434 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:22.434 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.435 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.435 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.435 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.810849+0000", 2024-09-13T05:13:22.435 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.435 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.435 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.435 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.435 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.810849+0000", 2024-09-13T05:13:22.435 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.435 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.435 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.435 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.435 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.810848+0000", 2024-09-13T05:13:22.435 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:22.436 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.436 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.436 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.436 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.810855+0000", 2024-09-13T05:13:22.436 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.153e-06 2024-09-13T05:13:22.436 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.436 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.436 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.436 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.810863+0000", 2024-09-13T05:13:22.436 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1300000000000001e-06 2024-09-13T05:13:22.436 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.436 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.436 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.436 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.810870+0000", 2024-09-13T05:13:22.437 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3940000000000001e-06 2024-09-13T05:13:22.437 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.437 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.437 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.437 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.810907+0000", 2024-09-13T05:13:22.437 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7410000000000003e-05 2024-09-13T05:13:22.437 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.437 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.437 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.437 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.810925+0000", 2024-09-13T05:13:22.437 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7838000000000001e-05 2024-09-13T05:13:22.437 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.437 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.437 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:22.438 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.817006+0000", 2024-09-13T05:13:22.438 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0060812280000000002 2024-09-13T05:13:22.438 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.438 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.438 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.438 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.817040+0000", 2024-09-13T05:13:22.438 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3933999999999997e-05 2024-09-13T05:13:22.438 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.438 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.438 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.438 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.438 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.438 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7487 3.13 e174/153 3:cba8ba28:::rbd_data.112d667fb7f9.00000000000001c3:19 v 174'1268, mlcod=174'1262)", 2024-09-13T05:13:22.438 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:08.811674+0000", 2024-09-13T05:13:22.439 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.561271239, 2024-09-13T05:13:22.439 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0068301730000000001, 2024-09-13T05:13:22.439 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.439 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:22.439 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.439 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.439 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.439 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811674+0000", 2024-09-13T05:13:22.439 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.439 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.439 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.439 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.439 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811674+0000", 2024-09-13T05:13:22.439 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.440 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.440 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.440 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.440 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811674+0000", 2024-09-13T05:13:22.440 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:22.440 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.440 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.440 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.440 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811680+0000", 2024-09-13T05:13:22.440 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6460000000000004e-06 2024-09-13T05:13:22.440 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.440 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.440 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.440 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811694+0000", 2024-09-13T05:13:22.441 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4066999999999999e-05 2024-09-13T05:13:22.441 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.441 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.441 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.441 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811702+0000", 2024-09-13T05:13:22.441 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3549999999999999e-06 2024-09-13T05:13:22.441 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.441 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.441 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.441 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813840+0000", 2024-09-13T05:13:22.441 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002138137 2024-09-13T05:13:22.441 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.441 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.441 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.442 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813859+0000", 2024-09-13T05:13:22.442 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9006999999999999e-05 2024-09-13T05:13:22.442 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.442 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.442 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:22.442 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.818469+0000", 2024-09-13T05:13:22.442 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0046097070000000002 2024-09-13T05:13:22.442 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.442 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.442 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.442 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.818505+0000", 2024-09-13T05:13:22.442 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6026999999999999e-05 2024-09-13T05:13:22.442 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.442 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.442 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.443 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.443 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.443 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop_reply(osd.4.0:385 3.1a e174/151 ondisk, result = 0)", 2024-09-13T05:13:22.443 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:08.813470+0000", 2024-09-13T05:13:22.443 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 13.55947613, 2024-09-13T05:13:22.443 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0060296129999999996, 2024-09-13T05:13:22.443 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.443 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:22.443 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.443 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.443 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.443 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813470+0000", 2024-09-13T05:13:22.443 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.443 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.444 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.444 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813470+0000", 2024-09-13T05:13:22.444 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.444 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.444 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813469+0000", 2024-09-13T05:13:22.444 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:22.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.444 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.444 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813474+0000", 2024-09-13T05:13:22.444 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2220000000000001e-06 2024-09-13T05:13:22.445 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.445 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.445 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.445 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813483+0000", 2024-09-13T05:13:22.445 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4239999999999993e-06 2024-09-13T05:13:22.445 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.445 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.445 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.445 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813487+0000", 2024-09-13T05:13:22.445 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5129999999999998e-06 2024-09-13T05:13:22.445 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.445 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.445 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.445 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.819441+0000", 2024-09-13T05:13:22.446 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0059542969999999999 2024-09-13T05:13:22.446 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.446 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.446 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.446 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.819450+0000", 2024-09-13T05:13:22.446 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4759999999999998e-06 2024-09-13T05:13:22.446 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.446 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.446 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.446 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.819499+0000", 2024-09-13T05:13:22.446 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9364999999999999e-05 2024-09-13T05:13:22.446 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.446 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.446 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.447 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.447 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.447 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:206387 3.9 3:96db6e79:::rbd_data.112d52e13700.000000000000000d:head [delete] snapc 15=[] ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-13T05:13:22.447 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:12.969800+0000", 2024-09-13T05:13:22.447 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.4031451829999995, 2024-09-13T05:13:22.447 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0066299089999999998, 2024-09-13T05:13:22.447 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.447 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:22.447 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.447 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.447 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.447 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 206387 2024-09-13T05:13:22.447 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.447 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.447 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.448 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.448 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.969800+0000", 2024-09-13T05:13:22.448 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.448 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.448 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.448 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.448 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.969800+0000", 2024-09-13T05:13:22.448 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.448 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.448 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.448 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.448 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.969799+0000", 2024-09-13T05:13:22.448 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:22.449 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.449 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.449 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.449 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.969807+0000", 2024-09-13T05:13:22.449 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9999999999999996e-06 2024-09-13T05:13:22.449 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.449 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.449 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.449 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.969832+0000", 2024-09-13T05:13:22.449 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5077000000000001e-05 2024-09-13T05:13:22.449 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.449 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.449 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.449 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.969845+0000", 2024-09-13T05:13:22.450 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2830000000000001e-05 2024-09-13T05:13:22.450 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.450 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.450 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.450 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.969912+0000", 2024-09-13T05:13:22.450 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6853999999999994e-05 2024-09-13T05:13:22.450 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.450 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.450 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.450 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.970078+0000", 2024-09-13T05:13:22.450 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000166317 2024-09-13T05:13:22.450 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.450 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.450 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 2", 2024-09-13T05:13:22.451 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.970219+0000", 2024-09-13T05:13:22.451 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000141077 2024-09-13T05:13:22.451 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.451 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.451 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:22.451 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.972106+0000", 2024-09-13T05:13:22.451 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0018869469999999999 2024-09-13T05:13:22.451 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.451 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.451 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:22.451 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976321+0000", 2024-09-13T05:13:22.451 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0042147850000000004 2024-09-13T05:13:22.451 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.451 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.451 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:22.452 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976381+0000", 2024-09-13T05:13:22.452 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9432999999999998e-05 2024-09-13T05:13:22.452 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.452 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.452 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.452 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976430+0000", 2024-09-13T05:13:22.452 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9874999999999999e-05 2024-09-13T05:13:22.452 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.452 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.452 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.452 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.452 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.452 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:206397 3.1a 3:588be705:::rbd_data.112d52e13700.0000000000000017:head [delete] snapc 15=[] ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-13T05:13:22.452 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:12.976313+0000", 2024-09-13T05:13:22.453 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.3966329179999999, 2024-09-13T05:13:22.453 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0072561070000000004, 2024-09-13T05:13:22.453 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.453 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:22.453 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.453 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.453 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.453 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 206397 2024-09-13T05:13:22.453 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.453 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.453 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.453 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.453 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976313+0000", 2024-09-13T05:13:22.453 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.454 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.454 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.454 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.454 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976313+0000", 2024-09-13T05:13:22.454 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.454 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.454 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.454 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.454 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976310+0000", 2024-09-13T05:13:22.454 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:13:22.454 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.454 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.454 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.454 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976333+0000", 2024-09-13T05:13:22.455 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2212999999999999e-05 2024-09-13T05:13:22.455 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.455 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.455 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.455 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976352+0000", 2024-09-13T05:13:22.455 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9332000000000001e-05 2024-09-13T05:13:22.455 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.455 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.455 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.455 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976366+0000", 2024-09-13T05:13:22.455 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3801999999999999e-05 2024-09-13T05:13:22.455 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.455 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.455 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.455 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976511+0000", 2024-09-13T05:13:22.456 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014525900000000001 2024-09-13T05:13:22.456 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.456 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.456 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.456 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976753+0000", 2024-09-13T05:13:22.456 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024178099999999999 2024-09-13T05:13:22.456 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.456 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.456 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:22.456 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976926+0000", 2024-09-13T05:13:22.456 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000173234 2024-09-13T05:13:22.456 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.456 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.456 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:22.457 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.978566+0000", 2024-09-13T05:13:22.457 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001639691 2024-09-13T05:13:22.457 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.457 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.457 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:22.457 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.983483+0000", 2024-09-13T05:13:22.457 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0049168119999999996 2024-09-13T05:13:22.457 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.457 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.457 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:22.457 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.983532+0000", 2024-09-13T05:13:22.457 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.905e-05 2024-09-13T05:13:22.457 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.457 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.457 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.458 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.983569+0000", 2024-09-13T05:13:22.458 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7211e-05 2024-09-13T05:13:22.458 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.458 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.458 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.458 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.458 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.458 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:206463 3.1b 3:dad20942:::rbd_header.112d7db0ee5a:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e179)", 2024-09-13T05:13:22.458 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:13.644990+0000", 2024-09-13T05:13:22.458 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.7279558149999996, 2024-09-13T05:13:22.458 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010238102000000001, 2024-09-13T05:13:22.458 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.458 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:22.458 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.459 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.459 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.459 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 206463 2024-09-13T05:13:22.459 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.459 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.459 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.459 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.459 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.644990+0000", 2024-09-13T05:13:22.459 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.459 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.459 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.459 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.459 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.644990+0000", 2024-09-13T05:13:22.459 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.460 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.460 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.460 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.460 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.644987+0000", 2024-09-13T05:13:22.460 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:13:22.460 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.460 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.460 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.460 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.645003+0000", 2024-09-13T05:13:22.460 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6322999999999999e-05 2024-09-13T05:13:22.460 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.460 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.460 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.460 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.645029+0000", 2024-09-13T05:13:22.461 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5177e-05 2024-09-13T05:13:22.461 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.461 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.461 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.461 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.645047+0000", 2024-09-13T05:13:22.461 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8281999999999999e-05 2024-09-13T05:13:22.461 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.461 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.461 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.462 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.645284+0000", 2024-09-13T05:13:22.462 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00023681 2024-09-13T05:13:22.462 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.462 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.462 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op must wait for map", 2024-09-13T05:13:22.462 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.645297+0000", 2024-09-13T05:13:22.462 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3509999999999999e-05 2024-09-13T05:13:22.462 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.462 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.462 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.462 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.650969+0000", 2024-09-13T05:13:22.462 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0056719170000000003 2024-09-13T05:13:22.462 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.462 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.463 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.463 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.651072+0000", 2024-09-13T05:13:22.463 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010320200000000001 2024-09-13T05:13:22.463 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.463 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.463 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 7", 2024-09-13T05:13:22.463 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.651487+0000", 2024-09-13T05:13:22.463 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00041497300000000001 2024-09-13T05:13:22.463 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.463 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.463 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:22.463 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.653970+0000", 2024-09-13T05:13:22.463 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002483074 2024-09-13T05:13:22.463 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.463 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.464 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:22.464 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.655150+0000", 2024-09-13T05:13:22.464 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001179963 2024-09-13T05:13:22.464 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.464 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.464 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:22.464 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.655182+0000", 2024-09-13T05:13:22.464 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1531e-05 2024-09-13T05:13:22.464 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.464 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.464 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.464 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.655228+0000", 2024-09-13T05:13:22.464 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6106000000000002e-05 2024-09-13T05:13:22.464 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.465 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.465 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.465 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.465 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.465 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7604 3.13 e182/153 3:cb3c550a:::rbd_data.112d4ee87f83.0000000000000004:13 v 182'1291, mlcod=181'1287)", 2024-09-13T05:13:22.465 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:16.863805+0000", 2024-09-13T05:13:22.465 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.5091404639999997, 2024-09-13T05:13:22.465 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0066902530000000002, 2024-09-13T05:13:22.465 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.465 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:22.465 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.465 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.465 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.465 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.863805+0000", 2024-09-13T05:13:22.466 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.466 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.466 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.466 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.466 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.863805+0000", 2024-09-13T05:13:22.466 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.466 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.466 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.466 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.466 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.863805+0000", 2024-09-13T05:13:22.466 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:22.466 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.466 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.466 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.467 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.863814+0000", 2024-09-13T05:13:22.467 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.037e-06 2024-09-13T05:13:22.467 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.467 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.467 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.467 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.863823+0000", 2024-09-13T05:13:22.467 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7899999999999994e-06 2024-09-13T05:13:22.467 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.467 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.467 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.467 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.863830+0000", 2024-09-13T05:13:22.467 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6529999999999997e-06 2024-09-13T05:13:22.467 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.467 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.467 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.468 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.865683+0000", 2024-09-13T05:13:22.468 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001852991 2024-09-13T05:13:22.468 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.468 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.468 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.468 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.865702+0000", 2024-09-13T05:13:22.468 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8476999999999999e-05 2024-09-13T05:13:22.468 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.468 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.468 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:22.468 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.870460+0000", 2024-09-13T05:13:22.468 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0047586640000000001 2024-09-13T05:13:22.468 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.468 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.469 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.469 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.870495+0000", 2024-09-13T05:13:22.469 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5231000000000002e-05 2024-09-13T05:13:22.469 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.469 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.469 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.469 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.469 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.469 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:206716 3.3 3:c4c92e5a:::rbd_trash:head [call rbd.trash_state_set in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e183)", 2024-09-13T05:13:22.469 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:17.875773+0000", 2024-09-13T05:13:22.469 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.4971725190000003, 2024-09-13T05:13:22.469 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.77872504200000003, 2024-09-13T05:13:22.469 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.469 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:22.470 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.470 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.470 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.470 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 206716 2024-09-13T05:13:22.470 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.470 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.470 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.470 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.470 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:17.875773+0000", 2024-09-13T05:13:22.470 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.470 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.470 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.470 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.470 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:17.875773+0000", 2024-09-13T05:13:22.471 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.471 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.471 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.471 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.471 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:17.875771+0000", 2024-09-13T05:13:22.471 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:22.471 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.471 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.471 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.471 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:17.875782+0000", 2024-09-13T05:13:22.471 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0927000000000001e-05 2024-09-13T05:13:22.471 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.471 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.471 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.472 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:17.875819+0000", 2024-09-13T05:13:22.472 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6950999999999999e-05 2024-09-13T05:13:22.472 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.472 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.472 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.472 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:17.875826+0000", 2024-09-13T05:13:22.472 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3819999999999998e-06 2024-09-13T05:13:22.472 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.472 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.472 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.472 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:17.875889+0000", 2024-09-13T05:13:22.472 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2759e-05 2024-09-13T05:13:22.472 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.472 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.472 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:22.473 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:17.875901+0000", 2024-09-13T05:13:22.473 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.132e-05 2024-09-13T05:13:22.473 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.473 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.473 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.473 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:18.652145+0000", 2024-09-13T05:13:22.473 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.77624458699999999 2024-09-13T05:13:22.473 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.473 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.473 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.473 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:18.652344+0000", 2024-09-13T05:13:22.473 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000199178 2024-09-13T05:13:22.473 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.473 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.474 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 6", 2024-09-13T05:13:22.474 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:18.652613+0000", 2024-09-13T05:13:22.474 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000269125 2024-09-13T05:13:22.474 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.474 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.474 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:22.474 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:18.654358+0000", 2024-09-13T05:13:22.474 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001744616 2024-09-13T05:13:22.474 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.474 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.474 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:22.474 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:18.654405+0000", 2024-09-13T05:13:22.474 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7206999999999997e-05 2024-09-13T05:13:22.474 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.474 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.475 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:22.475 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:18.654452+0000", 2024-09-13T05:13:22.475 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6347999999999997e-05 2024-09-13T05:13:22.475 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.475 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.475 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.475 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:18.654498+0000", 2024-09-13T05:13:22.475 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6638999999999998e-05 2024-09-13T05:13:22.475 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.475 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.475 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.475 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.475 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.475 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.3.0:5427 3.b e187/149 3:d275a035:::rbd_data.112d4ab2162d.000000000000000a:10 v 187'679, mlcod=175'676)", 2024-09-13T05:13:22.476 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:21.651643+0000", 2024-09-13T05:13:22.476 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.72130233300000002, 2024-09-13T05:13:22.476 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0093737390000000007, 2024-09-13T05:13:22.476 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.476 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:22.476 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.476 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.476 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.476 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.651643+0000", 2024-09-13T05:13:22.476 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.476 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.476 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.476 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.477 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.651643+0000", 2024-09-13T05:13:22.477 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.477 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.477 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.477 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.477 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.651642+0000", 2024-09-13T05:13:22.477 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:22.477 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.477 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.477 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.477 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.651661+0000", 2024-09-13T05:13:22.477 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8759000000000001e-05 2024-09-13T05:13:22.477 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.477 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.477 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.478 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.651685+0000", 2024-09-13T05:13:22.478 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4087000000000002e-05 2024-09-13T05:13:22.478 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.478 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.478 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.478 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.651705+0000", 2024-09-13T05:13:22.478 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0319e-05 2024-09-13T05:13:22.478 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.478 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.478 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.478 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.652024+0000", 2024-09-13T05:13:22.478 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00031840999999999998 2024-09-13T05:13:22.478 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.478 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.479 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.479 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.652076+0000", 2024-09-13T05:13:22.479 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1848999999999998e-05 2024-09-13T05:13:22.479 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.479 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.479 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:22.479 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.660976+0000", 2024-09-13T05:13:22.479 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0088998830000000008 2024-09-13T05:13:22.479 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.479 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.479 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.479 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.661017+0000", 2024-09-13T05:13:22.479 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1508000000000003e-05 2024-09-13T05:13:22.480 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.480 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.480 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.480 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.480 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.480 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.3.0:5429 3.b e187/149 3:d27bd02d:::rbd_data.112d4ab2162d.000000000000000f:10 v 187'681, mlcod=175'676)", 2024-09-13T05:13:22.480 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:21.655798+0000", 2024-09-13T05:13:22.480 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.71714749, 2024-09-13T05:13:22.480 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0052547740000000003, 2024-09-13T05:13:22.480 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.480 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:22.480 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.480 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.480 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.481 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.655798+0000", 2024-09-13T05:13:22.481 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.481 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.481 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.481 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.481 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.655798+0000", 2024-09-13T05:13:22.481 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.481 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.481 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.481 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.481 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.655797+0000", 2024-09-13T05:13:22.481 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:22.481 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.482 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.482 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.482 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.655811+0000", 2024-09-13T05:13:22.482 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.448e-05 2024-09-13T05:13:22.482 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.482 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.482 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.482 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.655835+0000", 2024-09-13T05:13:22.482 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3686e-05 2024-09-13T05:13:22.482 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.482 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.482 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.482 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.655888+0000", 2024-09-13T05:13:22.483 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3325999999999997e-05 2024-09-13T05:13:22.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.483 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.483 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.483 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.656043+0000", 2024-09-13T05:13:22.483 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000155363 2024-09-13T05:13:22.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.483 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.483 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.483 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.656095+0000", 2024-09-13T05:13:22.483 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1962000000000002e-05 2024-09-13T05:13:22.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.483 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.483 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:22.484 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.661023+0000", 2024-09-13T05:13:22.484 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0049279429999999997 2024-09-13T05:13:22.484 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.484 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.484 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.484 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.661053+0000", 2024-09-13T05:13:22.484 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9581e-05 2024-09-13T05:13:22.484 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.484 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.484 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.484 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.484 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.484 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:207147 3.1a 3:5d866ee1:::rbd_header.112d4ab2162d:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-13T05:13:22.484 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:21.655963+0000", 2024-09-13T05:13:22.485 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.71698252100000004, 2024-09-13T05:13:22.485 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0096366379999999995, 2024-09-13T05:13:22.485 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.485 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:22.485 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.485 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.485 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.485 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 207147 2024-09-13T05:13:22.485 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.485 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.485 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.485 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.485 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.655963+0000", 2024-09-13T05:13:22.486 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.486 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.486 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.486 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.486 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.655963+0000", 2024-09-13T05:13:22.486 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.486 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.486 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.486 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.486 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.655960+0000", 2024-09-13T05:13:22.486 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:13:22.486 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.486 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.486 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.486 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.655974+0000", 2024-09-13T05:13:22.487 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3774000000000001e-05 2024-09-13T05:13:22.487 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.487 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.487 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.487 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.656003+0000", 2024-09-13T05:13:22.487 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8809000000000001e-05 2024-09-13T05:13:22.487 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.487 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.487 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.487 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.656022+0000", 2024-09-13T05:13:22.487 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8536e-05 2024-09-13T05:13:22.487 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.487 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.488 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.488 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.656120+0000", 2024-09-13T05:13:22.488 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8678000000000006e-05 2024-09-13T05:13:22.488 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.488 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.488 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.488 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.656255+0000", 2024-09-13T05:13:22.488 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000134463 2024-09-13T05:13:22.488 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.488 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.488 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:22.488 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.656700+0000", 2024-09-13T05:13:22.488 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00044488399999999999 2024-09-13T05:13:22.488 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.489 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.489 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:22.489 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.661812+0000", 2024-09-13T05:13:22.489 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0051123430000000001 2024-09-13T05:13:22.489 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.489 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.489 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:22.489 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.665519+0000", 2024-09-13T05:13:22.489 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0037070839999999998 2024-09-13T05:13:22.489 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.489 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.489 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:22.489 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.665566+0000", 2024-09-13T05:13:22.489 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6575e-05 2024-09-13T05:13:22.489 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.490 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.490 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.490 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.665600+0000", 2024-09-13T05:13:22.490 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4162000000000003e-05 2024-09-13T05:13:22.490 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.490 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.490 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.490 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.490 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.490 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:22.492 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:13:22.492 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:22.490+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:22.593 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:22.586+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:22.605 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:22.606 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:22.606 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:13:22.606 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:22.615 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:13:22.693 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:22.690+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:22.728 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:22.729 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:22.729 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:13:22.729 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:13:22.729 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:22.738 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:13:22.794 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:22.791+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:22.851 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:22.851 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:13:22.852 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:13:22.852 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:13:22.852 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.852 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3.bb1d1096 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:13:22.852 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:13:22.852 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 118.904061697, 2024-09-13T05:13:22.852 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68834410099999999, 2024-09-13T05:13:22.852 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.852 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:22.852 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.852 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.852 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.853 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:13:22.853 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.853 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.853 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.853 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.853 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:13:22.853 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.853 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.853 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.853 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.853 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:13:22.853 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.853 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.854 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.854 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.854 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943719+0000", 2024-09-13T05:13:22.854 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:13:22.854 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.854 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.854 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.854 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943734+0000", 2024-09-13T05:13:22.854 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4793e-05 2024-09-13T05:13:22.854 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.854 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.854 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.854 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943765+0000", 2024-09-13T05:13:22.855 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0648999999999997e-05 2024-09-13T05:13:22.855 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.855 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.855 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.855 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943779+0000", 2024-09-13T05:13:22.855 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.447e-05 2024-09-13T05:13:22.855 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.855 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.855 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.855 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943872+0000", 2024-09-13T05:13:22.855 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3304e-05 2024-09-13T05:13:22.855 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.855 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.855 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:22.856 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943884+0000", 2024-09-13T05:13:22.856 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.167e-05 2024-09-13T05:13:22.856 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.856 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.856 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.856 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632042+0000", 2024-09-13T05:13:22.856 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68815832600000004 2024-09-13T05:13:22.856 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.856 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.856 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.856 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632066+0000", 2024-09-13T05:13:22.856 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3765999999999999e-05 2024-09-13T05:13:22.856 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.857 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.857 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.857 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.857 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.857 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3.b6bd6256 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:13:22.857 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:13:22.857 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 118.903937197, 2024-09-13T05:13:22.857 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68852592499999998, 2024-09-13T05:13:22.857 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.857 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:22.857 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.857 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.857 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.858 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:13:22.858 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.858 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.858 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.858 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.858 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:13:22.858 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.858 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.858 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.858 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.858 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:13:22.858 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.859 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.859 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.859 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.859 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943846+0000", 2024-09-13T05:13:22.859 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:22.859 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.859 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.859 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.859 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943852+0000", 2024-09-13T05:13:22.859 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3820000000000001e-06 2024-09-13T05:13:22.860 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.860 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.860 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.860 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943876+0000", 2024-09-13T05:13:22.860 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3995e-05 2024-09-13T05:13:22.860 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.860 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.860 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.860 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943898+0000", 2024-09-13T05:13:22.860 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1838999999999999e-05 2024-09-13T05:13:22.860 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.860 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.860 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.861 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946457+0000", 2024-09-13T05:13:22.861 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025588910000000002 2024-09-13T05:13:22.861 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.861 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.861 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:22.861 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946499+0000", 2024-09-13T05:13:22.861 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2814e-05 2024-09-13T05:13:22.861 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.861 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.862 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.862 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632364+0000", 2024-09-13T05:13:22.862 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68586484999999997 2024-09-13T05:13:22.862 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.862 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.862 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.862 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632372+0000", 2024-09-13T05:13:22.862 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1659999999999994e-06 2024-09-13T05:13:22.862 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.862 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.862 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.862 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.862 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.862 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3:6908b8dd:::rbd_data.112d8d1317eb.000000000000000f:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:13:22.863 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:13:22.863 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 118.86679311899999, 2024-09-13T05:13:22.863 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65181049499999999, 2024-09-13T05:13:22.863 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.863 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:22.863 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.863 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.863 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.863 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:13:22.863 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.864 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.864 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.864 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.864 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:13:22.864 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.864 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.864 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.864 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.864 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:13:22.864 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.864 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.864 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.865 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.865 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980989+0000", 2024-09-13T05:13:22.865 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:22.865 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.865 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.865 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.865 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980996+0000", 2024-09-13T05:13:22.865 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2200000000000003e-06 2024-09-13T05:13:22.866 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.866 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.866 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.866 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981011+0000", 2024-09-13T05:13:22.866 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4997000000000001e-05 2024-09-13T05:13:22.866 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.866 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.866 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.866 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981025+0000", 2024-09-13T05:13:22.866 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3604000000000001e-05 2024-09-13T05:13:22.866 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.866 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.867 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.867 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981110+0000", 2024-09-13T05:13:22.867 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4948000000000001e-05 2024-09-13T05:13:22.867 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.867 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.867 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:22.867 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981120+0000", 2024-09-13T05:13:22.867 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9399999999999997e-06 2024-09-13T05:13:22.867 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.867 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.867 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.868 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632425+0000", 2024-09-13T05:13:22.868 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65130460499999998 2024-09-13T05:13:22.868 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.868 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.868 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.868 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632587+0000", 2024-09-13T05:13:22.868 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016199500000000001 2024-09-13T05:13:22.868 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.868 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.868 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.868 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632801+0000", 2024-09-13T05:13:22.868 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021459499999999999 2024-09-13T05:13:22.868 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.869 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.869 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.869 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.869 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.869 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3:6a46bd6d:::rbd_data.112d8d1317eb.0000000000000010:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:13:22.869 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:13:22.869 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 118.866735463, 2024-09-13T05:13:22.869 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65213695699999996, 2024-09-13T05:13:22.869 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.869 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:22.869 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.869 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.869 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.869 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:13:22.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.870 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.870 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.870 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.870 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:13:22.870 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.870 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.870 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.870 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:13:22.870 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.870 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.870 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.871 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:13:22.871 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:22.871 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.871 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.871 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.871 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981052+0000", 2024-09-13T05:13:22.871 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4469999999999999e-06 2024-09-13T05:13:22.871 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.871 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.871 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.871 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981066+0000", 2024-09-13T05:13:22.871 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3658e-05 2024-09-13T05:13:22.871 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.871 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.872 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.872 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981073+0000", 2024-09-13T05:13:22.872 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:13:22.872 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.872 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.872 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.872 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981150+0000", 2024-09-13T05:13:22.872 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7783999999999999e-05 2024-09-13T05:13:22.873 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.873 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.873 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:22.873 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981161+0000", 2024-09-13T05:13:22.873 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0197000000000001e-05 2024-09-13T05:13:22.873 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.874 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.874 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.874 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632926+0000", 2024-09-13T05:13:22.874 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65176517300000003 2024-09-13T05:13:22.874 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.874 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.874 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.874 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633081+0000", 2024-09-13T05:13:22.874 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000155172 2024-09-13T05:13:22.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.875 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.875 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.875 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633185+0000", 2024-09-13T05:13:22.875 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000104329 2024-09-13T05:13:22.875 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.875 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.875 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.875 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.875 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:159585 3.1c 3:3afcc414:::rbd_data.112dfd94ee88.00000000000002ca:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:22.875 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:13:22.876 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 75.833417150000002, 2024-09-13T05:13:22.876 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91717655399999998, 2024-09-13T05:13:22.876 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.876 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:22.876 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.876 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.876 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.876 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 159585 2024-09-13T05:13:22.876 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.876 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.876 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.876 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.876 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:13:22.876 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.877 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.877 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.877 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.877 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:13:22.877 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.877 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.877 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.877 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.877 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014366+0000", 2024-09-13T05:13:22.877 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:22.877 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.877 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.877 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.877 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014370+0000", 2024-09-13T05:13:22.878 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9960000000000004e-06 2024-09-13T05:13:22.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.878 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.878 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.878 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014379+0000", 2024-09-13T05:13:22.878 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8550000000000008e-06 2024-09-13T05:13:22.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.878 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.878 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.878 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014386+0000", 2024-09-13T05:13:22.878 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0140000000000001e-06 2024-09-13T05:13:22.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.878 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.878 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.879 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014533+0000", 2024-09-13T05:13:22.879 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000147458 2024-09-13T05:13:22.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:22.879 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014545+0000", 2024-09-13T05:13:22.879 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1318000000000001e-05 2024-09-13T05:13:22.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.879 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.879 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931378+0000", 2024-09-13T05:13:22.879 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91683292400000005 2024-09-13T05:13:22.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.879 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.880 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.880 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931495+0000", 2024-09-13T05:13:22.880 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011726399999999999 2024-09-13T05:13:22.880 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.880 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.880 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.880 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931543+0000", 2024-09-13T05:13:22.880 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8183000000000003e-05 2024-09-13T05:13:22.880 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.880 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.880 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.881 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.881 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.881 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160206 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 83968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:22.881 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:13:22.881 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 75.810014753000004, 2024-09-13T05:13:22.881 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89412730799999995, 2024-09-13T05:13:22.881 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.881 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:22.881 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.881 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.881 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.881 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160206 2024-09-13T05:13:22.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.882 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.882 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.882 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:13:22.882 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.882 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.882 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:13:22.882 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.882 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.882 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.883 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037768+0000", 2024-09-13T05:13:22.883 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:22.883 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.883 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.883 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.883 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037774+0000", 2024-09-13T05:13:22.883 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3600000000000001e-06 2024-09-13T05:13:22.883 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.883 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.883 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.883 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037786+0000", 2024-09-13T05:13:22.883 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.188e-05 2024-09-13T05:13:22.883 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.883 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.883 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.884 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037793+0000", 2024-09-13T05:13:22.884 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2749999999999998e-06 2024-09-13T05:13:22.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.884 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.884 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.884 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:13:22.884 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0353000000000003e-05 2024-09-13T05:13:22.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.884 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.884 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:22.884 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037862+0000", 2024-09-13T05:13:22.884 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9710000000000004e-06 2024-09-13T05:13:22.884 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.885 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931610+0000", 2024-09-13T05:13:22.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89374846299999999 2024-09-13T05:13:22.885 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.885 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931815+0000", 2024-09-13T05:13:22.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020516499999999999 2024-09-13T05:13:22.885 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.885 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.885 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.885 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931896+0000", 2024-09-13T05:13:22.885 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1157999999999998e-05 2024-09-13T05:13:22.886 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.886 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.886 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.886 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.886 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.886 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160208 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 84992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:22.886 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:13:22.886 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 75.809930014000003, 2024-09-13T05:13:22.886 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440702299999997, 2024-09-13T05:13:22.886 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.886 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:22.886 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.886 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.886 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.887 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160208 2024-09-13T05:13:22.887 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.887 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.887 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.887 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.887 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:13:22.887 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.887 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.887 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.887 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.887 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:13:22.887 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.887 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.887 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.888 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.888 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037853+0000", 2024-09-13T05:13:22.888 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:22.888 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.888 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.888 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.888 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037858+0000", 2024-09-13T05:13:22.888 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2179999999999998e-06 2024-09-13T05:13:22.888 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.888 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.888 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.889 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037867+0000", 2024-09-13T05:13:22.889 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5699999999999993e-06 2024-09-13T05:13:22.889 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.889 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.889 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.889 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037874+0000", 2024-09-13T05:13:22.889 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2810000000000003e-06 2024-09-13T05:13:22.889 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.889 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.889 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.889 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037935+0000", 2024-09-13T05:13:22.889 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1231999999999999e-05 2024-09-13T05:13:22.889 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.890 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.890 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:22.890 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037944+0000", 2024-09-13T05:13:22.890 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8580000000000006e-06 2024-09-13T05:13:22.890 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.890 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.890 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.890 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931956+0000", 2024-09-13T05:13:22.890 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89401158800000002 2024-09-13T05:13:22.890 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.890 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.890 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.890 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932015+0000", 2024-09-13T05:13:22.890 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8906999999999997e-05 2024-09-13T05:13:22.891 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.891 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.891 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.891 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932261+0000", 2024-09-13T05:13:22.891 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024622799999999997 2024-09-13T05:13:22.891 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.891 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.891 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.891 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.891 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.891 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160210 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 86016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:22.891 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:13:22.891 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 75.809861159999997, 2024-09-13T05:13:22.891 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89428998299999996, 2024-09-13T05:13:22.892 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.892 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:22.892 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.892 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.892 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.892 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160210 2024-09-13T05:13:22.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.892 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.892 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.892 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:13:22.892 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.893 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.893 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.893 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:13:22.893 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.893 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.893 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.893 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.893 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037922+0000", 2024-09-13T05:13:22.893 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:22.893 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.893 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.893 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.893 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037926+0000", 2024-09-13T05:13:22.893 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6550000000000003e-06 2024-09-13T05:13:22.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.894 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.894 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.894 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037933+0000", 2024-09-13T05:13:22.894 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5409999999999997e-06 2024-09-13T05:13:22.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.894 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.894 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.894 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037939+0000", 2024-09-13T05:13:22.894 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1940000000000003e-06 2024-09-13T05:13:22.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.894 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.894 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.894 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037976+0000", 2024-09-13T05:13:22.895 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6671000000000002e-05 2024-09-13T05:13:22.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.895 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:22.895 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037982+0000", 2024-09-13T05:13:22.895 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9669999999999998e-06 2024-09-13T05:13:22.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.895 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.895 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932096+0000", 2024-09-13T05:13:22.895 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89411465599999995 2024-09-13T05:13:22.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.895 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.896 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932149+0000", 2024-09-13T05:13:22.896 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3032999999999999e-05 2024-09-13T05:13:22.896 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.896 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.896 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.896 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932213+0000", 2024-09-13T05:13:22.896 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3165999999999998e-05 2024-09-13T05:13:22.896 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.896 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.896 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.897 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.897 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.897 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160212 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 87040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:22.897 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:13:22.897 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 75.809774039000004, 2024-09-13T05:13:22.897 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440379699999994, 2024-09-13T05:13:22.897 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.897 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:22.897 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.897 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.897 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.897 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160212 2024-09-13T05:13:22.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.898 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.898 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.898 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:13:22.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.898 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.898 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:13:22.898 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.899 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.899 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038009+0000", 2024-09-13T05:13:22.899 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:22.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.899 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.899 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.899 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038013+0000", 2024-09-13T05:13:22.899 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3950000000000003e-06 2024-09-13T05:13:22.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.900 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.900 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.900 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038032+0000", 2024-09-13T05:13:22.900 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8513999999999999e-05 2024-09-13T05:13:22.900 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.900 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.900 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.900 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038039+0000", 2024-09-13T05:13:22.900 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.985e-06 2024-09-13T05:13:22.900 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.900 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.900 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.900 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038086+0000", 2024-09-13T05:13:22.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7302999999999998e-05 2024-09-13T05:13:22.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:22.901 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038090+0000", 2024-09-13T05:13:22.901 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9029999999999997e-06 2024-09-13T05:13:22.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.901 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932291+0000", 2024-09-13T05:13:22.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89420100199999997 2024-09-13T05:13:22.902 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932352+0000", 2024-09-13T05:13:22.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1354999999999998e-05 2024-09-13T05:13:22.902 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.902 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.902 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932414+0000", 2024-09-13T05:13:22.902 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1037999999999994e-05 2024-09-13T05:13:22.902 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.903 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.903 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.903 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.903 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.903 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160214 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 88064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:22.903 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:13:22.903 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 75.809642972999995, 2024-09-13T05:13:22.903 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89438890900000001, 2024-09-13T05:13:22.903 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.903 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:22.904 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.904 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.904 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.904 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160214 2024-09-13T05:13:22.904 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.904 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.904 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.904 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.904 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:13:22.904 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.904 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.904 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.905 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.905 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:13:22.905 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.905 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.905 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.905 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.905 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038140+0000", 2024-09-13T05:13:22.905 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:22.905 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.905 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.906 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.906 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038145+0000", 2024-09-13T05:13:22.906 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9749999999999998e-06 2024-09-13T05:13:22.906 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.906 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.906 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.906 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038153+0000", 2024-09-13T05:13:22.906 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1280000000000008e-06 2024-09-13T05:13:22.906 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.907 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.907 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.907 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038161+0000", 2024-09-13T05:13:22.907 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0339999999999997e-06 2024-09-13T05:13:22.907 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.907 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.907 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.907 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038199+0000", 2024-09-13T05:13:22.907 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8269999999999998e-05 2024-09-13T05:13:22.907 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.907 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.907 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:22.907 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038204+0000", 2024-09-13T05:13:22.907 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5399999999999997e-06 2024-09-13T05:13:22.908 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.908 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.908 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.908 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932438+0000", 2024-09-13T05:13:22.908 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89423397999999998 2024-09-13T05:13:22.908 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.908 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.908 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.908 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932480+0000", 2024-09-13T05:13:22.908 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2392999999999999e-05 2024-09-13T05:13:22.908 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.908 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.908 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.909 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932530+0000", 2024-09-13T05:13:22.909 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:13:22.909 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.909 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.909 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.909 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.909 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.909 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160305 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 215040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:22.909 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:13:22.909 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 75.805439750999994, 2024-09-13T05:13:22.909 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89028175300000001, 2024-09-13T05:13:22.909 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.909 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:22.909 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.910 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.910 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.910 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160305 2024-09-13T05:13:22.910 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.910 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.910 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.910 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.910 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:13:22.910 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.910 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.910 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.910 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.910 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:13:22.911 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.911 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.911 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042343+0000", 2024-09-13T05:13:22.911 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:22.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.911 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.911 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042350+0000", 2024-09-13T05:13:22.911 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3769999999999998e-06 2024-09-13T05:13:22.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.911 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.912 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042367+0000", 2024-09-13T05:13:22.912 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.734e-05 2024-09-13T05:13:22.912 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.912 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.912 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.912 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042375+0000", 2024-09-13T05:13:22.912 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8469999999999996e-06 2024-09-13T05:13:22.912 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.912 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.912 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.912 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042428+0000", 2024-09-13T05:13:22.912 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3074e-05 2024-09-13T05:13:22.912 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.913 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.913 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:22.913 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042437+0000", 2024-09-13T05:13:22.913 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:13:22.913 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.913 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.913 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.913 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932550+0000", 2024-09-13T05:13:22.913 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89011304300000005 2024-09-13T05:13:22.913 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.914 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.914 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.914 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932589+0000", 2024-09-13T05:13:22.914 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9236000000000002e-05 2024-09-13T05:13:22.914 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.914 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.914 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.914 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932626+0000", 2024-09-13T05:13:22.915 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6832999999999998e-05 2024-09-13T05:13:22.915 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.915 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.915 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.915 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.915 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.915 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160307 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 216064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:22.915 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:13:22.915 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 75.805393312000007, 2024-09-13T05:13:22.915 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89032630800000001, 2024-09-13T05:13:22.916 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.916 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:22.916 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.916 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.916 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.916 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160307 2024-09-13T05:13:22.916 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.916 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.916 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.916 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.917 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:13:22.917 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.917 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.917 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.917 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.917 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:13:22.917 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.917 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.917 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.917 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.917 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:13:22.917 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:22.917 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.918 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.918 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.918 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042394+0000", 2024-09-13T05:13:22.918 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7900000000000001e-06 2024-09-13T05:13:22.918 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.918 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.918 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.918 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042401+0000", 2024-09-13T05:13:22.918 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.267e-06 2024-09-13T05:13:22.918 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.918 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.918 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.918 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042406+0000", 2024-09-13T05:13:22.918 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0860000000000001e-06 2024-09-13T05:13:22.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.919 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.919 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.919 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042465+0000", 2024-09-13T05:13:22.919 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9441000000000002e-05 2024-09-13T05:13:22.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.919 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.919 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:22.919 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042471+0000", 2024-09-13T05:13:22.919 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6640000000000003e-06 2024-09-13T05:13:22.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.919 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.919 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.919 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932645+0000", 2024-09-13T05:13:22.920 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89017372900000002 2024-09-13T05:13:22.920 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.920 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.920 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.920 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932681+0000", 2024-09-13T05:13:22.920 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5918999999999999e-05 2024-09-13T05:13:22.920 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.920 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.920 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.920 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932717+0000", 2024-09-13T05:13:22.920 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6007999999999998e-05 2024-09-13T05:13:22.920 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.921 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.921 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.921 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.921 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.921 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160309 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 217088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:22.921 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:13:22.921 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 75.805343053000001, 2024-09-13T05:13:22.921 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89037315900000003, 2024-09-13T05:13:22.921 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.921 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:22.921 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.921 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.921 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.922 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160309 2024-09-13T05:13:22.922 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.922 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.922 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.922 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.922 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:13:22.922 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.922 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.922 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.922 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.922 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:13:22.922 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.922 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.922 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.923 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.923 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042440+0000", 2024-09-13T05:13:22.923 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:22.923 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.923 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.923 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.923 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042444+0000", 2024-09-13T05:13:22.923 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.104e-06 2024-09-13T05:13:22.923 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.923 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.923 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.923 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042451+0000", 2024-09-13T05:13:22.923 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.922e-06 2024-09-13T05:13:22.924 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.924 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.924 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.924 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042457+0000", 2024-09-13T05:13:22.924 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3979999999999998e-06 2024-09-13T05:13:22.924 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.924 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.924 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.924 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042497+0000", 2024-09-13T05:13:22.924 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0692999999999998e-05 2024-09-13T05:13:22.924 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.924 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.924 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:22.924 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042503+0000", 2024-09-13T05:13:22.925 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.553e-06 2024-09-13T05:13:22.925 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.925 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.925 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.925 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932735+0000", 2024-09-13T05:13:22.925 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89023238699999996 2024-09-13T05:13:22.925 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.925 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.925 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.925 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932771+0000", 2024-09-13T05:13:22.925 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5972000000000001e-05 2024-09-13T05:13:22.925 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.925 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.926 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.926 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932814+0000", 2024-09-13T05:13:22.926 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2657000000000002e-05 2024-09-13T05:13:22.926 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.926 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.926 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.926 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.926 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.926 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160311 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 218112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:22.926 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:13:22.927 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 75.805317563000003, 2024-09-13T05:13:22.927 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89045284400000002, 2024-09-13T05:13:22.927 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.927 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:22.927 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.927 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.927 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.927 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160311 2024-09-13T05:13:22.927 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.927 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.927 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.927 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.927 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:13:22.927 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.927 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.928 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.928 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.928 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:13:22.928 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.928 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.928 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.928 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.928 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:13:22.928 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:22.928 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.928 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.928 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.928 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042469+0000", 2024-09-13T05:13:22.928 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.456e-06 2024-09-13T05:13:22.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.929 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.929 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.929 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042475+0000", 2024-09-13T05:13:22.929 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0990000000000004e-06 2024-09-13T05:13:22.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.929 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.929 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.929 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042481+0000", 2024-09-13T05:13:22.929 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.237e-06 2024-09-13T05:13:22.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.929 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.929 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.929 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042527+0000", 2024-09-13T05:13:22.930 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6796999999999999e-05 2024-09-13T05:13:22.930 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.930 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.930 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:22.930 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042533+0000", 2024-09-13T05:13:22.930 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6489999999999996e-06 2024-09-13T05:13:22.930 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.930 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.930 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.930 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932832+0000", 2024-09-13T05:13:22.930 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89029919800000001 2024-09-13T05:13:22.930 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.931 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.931 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.931 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932867+0000", 2024-09-13T05:13:22.931 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5049000000000003e-05 2024-09-13T05:13:22.931 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.931 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.931 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.931 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932919+0000", 2024-09-13T05:13:22.931 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1780999999999998e-05 2024-09-13T05:13:22.931 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.932 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.932 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.932 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.932 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.932 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160313 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 219136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:22.932 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:13:22.932 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 75.805288472000001, 2024-09-13T05:13:22.932 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89064232600000004, 2024-09-13T05:13:22.932 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.932 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:22.932 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.932 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.933 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.933 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160313 2024-09-13T05:13:22.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.933 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.933 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.933 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.933 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:13:22.933 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.933 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.933 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.933 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:13:22.933 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.934 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.934 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:13:22.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:22.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.934 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.934 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.934 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042498+0000", 2024-09-13T05:13:22.934 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.281e-06 2024-09-13T05:13:22.935 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.935 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.935 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.935 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042505+0000", 2024-09-13T05:13:22.935 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2699999999999999e-06 2024-09-13T05:13:22.935 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.935 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.935 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.935 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042512+0000", 2024-09-13T05:13:22.935 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0330000000000003e-06 2024-09-13T05:13:22.935 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.935 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.935 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.935 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042557+0000", 2024-09-13T05:13:22.936 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4425999999999998e-05 2024-09-13T05:13:22.936 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.936 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.936 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:22.936 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042562+0000", 2024-09-13T05:13:22.936 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3639999999999998e-06 2024-09-13T05:13:22.936 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.936 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.936 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.936 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932987+0000", 2024-09-13T05:13:22.936 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89042472299999997 2024-09-13T05:13:22.936 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.936 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.936 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.937 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933062+0000", 2024-09-13T05:13:22.937 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5129999999999994e-05 2024-09-13T05:13:22.937 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.937 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.937 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.937 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933138+0000", 2024-09-13T05:13:22.937 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5536000000000003e-05 2024-09-13T05:13:22.937 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.937 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.937 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.937 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.937 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.937 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160315 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 220160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:22.937 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:13:22.938 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 75.805257304999998, 2024-09-13T05:13:22.938 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89071820800000001, 2024-09-13T05:13:22.938 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.938 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:22.938 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.938 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.938 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.938 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160315 2024-09-13T05:13:22.938 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.938 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.938 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.938 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.938 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:13:22.938 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.939 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.939 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.939 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.939 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:13:22.939 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.939 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.939 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.939 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.939 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:13:22.939 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:22.939 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.939 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.939 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.939 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042529+0000", 2024-09-13T05:13:22.940 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3639999999999999e-06 2024-09-13T05:13:22.940 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.940 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.940 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.940 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042536+0000", 2024-09-13T05:13:22.940 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.866e-06 2024-09-13T05:13:22.940 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.940 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.940 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.940 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042541+0000", 2024-09-13T05:13:22.940 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:13:22.940 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.940 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.940 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.941 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042587+0000", 2024-09-13T05:13:22.941 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5735000000000002e-05 2024-09-13T05:13:22.941 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.941 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.941 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:22.941 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042593+0000", 2024-09-13T05:13:22.941 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0719999999999996e-06 2024-09-13T05:13:22.941 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.941 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.941 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.941 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933160+0000", 2024-09-13T05:13:22.941 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89056621000000002 2024-09-13T05:13:22.941 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.941 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.942 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.942 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933202+0000", 2024-09-13T05:13:22.942 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2376000000000002e-05 2024-09-13T05:13:22.942 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.942 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.942 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.942 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933245+0000", 2024-09-13T05:13:22.942 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2787999999999998e-05 2024-09-13T05:13:22.942 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.942 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.942 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.942 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.942 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.943 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160317 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:22.943 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:13:22.943 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 75.805228475999996, 2024-09-13T05:13:22.943 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89082205800000003, 2024-09-13T05:13:22.943 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.943 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:22.943 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.943 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.943 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.943 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160317 2024-09-13T05:13:22.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.943 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.943 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:13:22.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.944 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:13:22.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.944 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:13:22.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:22.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.945 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.945 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042558+0000", 2024-09-13T05:13:22.945 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1810000000000001e-06 2024-09-13T05:13:22.945 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.945 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.945 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.945 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042565+0000", 2024-09-13T05:13:22.945 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9280000000000004e-06 2024-09-13T05:13:22.945 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.945 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.945 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.945 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042571+0000", 2024-09-13T05:13:22.945 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7420000000000003e-06 2024-09-13T05:13:22.945 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.946 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.946 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.946 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042616+0000", 2024-09-13T05:13:22.946 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5201999999999999e-05 2024-09-13T05:13:22.946 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.946 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.946 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:22.946 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042622+0000", 2024-09-13T05:13:22.946 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8289999999999996e-06 2024-09-13T05:13:22.946 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.946 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.946 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.946 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933259+0000", 2024-09-13T05:13:22.946 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89063730799999996 2024-09-13T05:13:22.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.947 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.947 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.947 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933311+0000", 2024-09-13T05:13:22.947 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1910000000000003e-05 2024-09-13T05:13:22.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.947 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.947 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.947 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933377+0000", 2024-09-13T05:13:22.947 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6396999999999995e-05 2024-09-13T05:13:22.947 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.947 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.947 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.948 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160319 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 222208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:22.948 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:13:22.948 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 75.805198259999997, 2024-09-13T05:13:22.948 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89087477400000004, 2024-09-13T05:13:22.948 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.948 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:22.948 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.948 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.948 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.948 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160319 2024-09-13T05:13:22.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.948 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.949 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.949 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:13:22.949 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.949 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.949 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.949 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.949 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:13:22.949 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.949 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.949 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.949 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.949 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042585+0000", 2024-09-13T05:13:22.949 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:22.949 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.950 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.950 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042588+0000", 2024-09-13T05:13:22.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9450000000000002e-06 2024-09-13T05:13:22.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.950 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.950 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042594+0000", 2024-09-13T05:13:22.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0959999999999997e-06 2024-09-13T05:13:22.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.950 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.950 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042599+0000", 2024-09-13T05:13:22.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0069999999999997e-06 2024-09-13T05:13:22.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.951 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.951 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.951 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042642+0000", 2024-09-13T05:13:22.951 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2553999999999999e-05 2024-09-13T05:13:22.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.951 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.951 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:22.951 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042647+0000", 2024-09-13T05:13:22.951 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.31e-06 2024-09-13T05:13:22.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.951 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.951 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.951 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933387+0000", 2024-09-13T05:13:22.951 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89073982799999996 2024-09-13T05:13:22.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.952 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.952 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:13:22.952 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7101000000000003e-05 2024-09-13T05:13:22.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.952 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.952 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933460+0000", 2024-09-13T05:13:22.952 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6282999999999998e-05 2024-09-13T05:13:22.952 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.952 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.952 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.953 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160321 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 223232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:22.953 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:13:22.953 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 75.805168832999996, 2024-09-13T05:13:22.953 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89094616999999998, 2024-09-13T05:13:22.953 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.953 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:22.953 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.953 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.953 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.953 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160321 2024-09-13T05:13:22.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.954 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:13:22.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:13:22.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:13:22.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:22.955 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.955 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.955 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.955 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042617+0000", 2024-09-13T05:13:22.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8329999999999998e-06 2024-09-13T05:13:22.955 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.955 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.955 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.955 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042638+0000", 2024-09-13T05:13:22.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0908e-05 2024-09-13T05:13:22.955 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.955 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.955 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.956 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042644+0000", 2024-09-13T05:13:22.956 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0440000000000001e-06 2024-09-13T05:13:22.956 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.956 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.956 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.956 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042666+0000", 2024-09-13T05:13:22.956 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1256000000000001e-05 2024-09-13T05:13:22.956 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.956 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.956 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:22.956 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042671+0000", 2024-09-13T05:13:22.956 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6250000000000004e-06 2024-09-13T05:13:22.956 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.956 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.957 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933478+0000", 2024-09-13T05:13:22.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89080698800000002 2024-09-13T05:13:22.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.957 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933519+0000", 2024-09-13T05:13:22.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0717000000000003e-05 2024-09-13T05:13:22.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.957 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933561+0000", 2024-09-13T05:13:22.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2225999999999999e-05 2024-09-13T05:13:22.958 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.958 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.958 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.958 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:201615 3.1d 3:bb015654:::rbd_data.112d9dba7cdc.000000000000000a:head [delete] snapc 30=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2024-09-13T05:13:22.958 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:13:22.958 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 42.842932052000002, 2024-09-13T05:13:22.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.90842926999999996, 2024-09-13T05:13:22.958 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:22.958 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:22.958 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:22.958 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:22.959 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:22.959 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 201615 2024-09-13T05:13:22.959 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.959 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:22.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.959 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:22.959 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:13:22.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.959 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.959 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:22.959 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:13:22.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:22.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:22.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004850+0000", 2024-09-13T05:13:22.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:22.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:22.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004860+0000", 2024-09-13T05:13:22.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.927e-06 2024-09-13T05:13:22.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:22.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004882+0000", 2024-09-13T05:13:22.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2079999999999999e-05 2024-09-13T05:13:22.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:22.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004897+0000", 2024-09-13T05:13:22.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4892000000000001e-05 2024-09-13T05:13:22.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.005068+0000", 2024-09-13T05:13:22.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017098999999999999 2024-09-13T05:13:22.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:22.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.005081+0000", 2024-09-13T05:13:22.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3063e-05 2024-09-13T05:13:22.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:22.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.910925+0000", 2024-09-13T05:13:22.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.90584383400000001 2024-09-13T05:13:22.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:22.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.911131+0000", 2024-09-13T05:13:22.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020629399999999999 2024-09-13T05:13:22.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 4", 2024-09-13T05:13:22.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.911313+0000", 2024-09-13T05:13:22.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000182175 2024-09-13T05:13:22.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:22.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913010+0000", 2024-09-13T05:13:22.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0016971550000000001 2024-09-13T05:13:22.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:22.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913212+0000", 2024-09-13T05:13:22.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000202237 2024-09-13T05:13:22.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:22.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913253+0000", 2024-09-13T05:13:22.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0250999999999998e-05 2024-09-13T05:13:22.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:22.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:22.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:22.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913281+0000", 2024-09-13T05:13:22.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8314e-05 2024-09-13T05:13:22.964 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.964 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.964 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.964 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:22.965 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:22.965 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:22.966 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:13:22.967 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:22.963+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:23.067 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:23.063+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:23.083 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:23.083 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:23.083 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:13:23.083 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:23.093 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:13:23.168 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:23.162+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:23.193 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:13:23.243 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:23.243 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:23.243 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:13:23.243 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:13:23.243 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:23.253 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:13:23.268 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:23.262+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:23.345 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:13:23.362 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:23.362 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:13:23.362 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:13:23.362 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:13:23.362 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.362 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29021 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2865152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:23.362 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:13:23.362 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 166.31622805399999, 2024-09-13T05:13:23.362 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060927993999999999, 2024-09-13T05:13:23.362 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:23.363 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:23.363 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:23.363 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:23.363 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:23.363 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29021 2024-09-13T05:13:23.363 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.363 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:23.363 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.363 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:23.363 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:13:23.363 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.363 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.363 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.363 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:23.364 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:13:23.364 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.364 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.364 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.364 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:23.364 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041763+0000", 2024-09-13T05:13:23.364 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:23.364 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.364 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.364 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:23.364 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041766+0000", 2024-09-13T05:13:23.364 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6800000000000002e-06 2024-09-13T05:13:23.364 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.365 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.365 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:23.365 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041771+0000", 2024-09-13T05:13:23.365 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:13:23.365 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.365 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.365 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:23.365 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041776+0000", 2024-09-13T05:13:23.365 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8489999999999997e-06 2024-09-13T05:13:23.365 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.365 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.365 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:23.365 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102513+0000", 2024-09-13T05:13:23.365 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060737102000000001 2024-09-13T05:13:23.366 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.366 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.366 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:23.366 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102597+0000", 2024-09-13T05:13:23.366 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4374000000000002e-05 2024-09-13T05:13:23.366 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.366 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.366 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:23.366 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102692+0000", 2024-09-13T05:13:23.366 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4436000000000002e-05 2024-09-13T05:13:23.366 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.366 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:23.366 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.366 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.367 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.367 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29022 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2874368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:23.367 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:13:23.367 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 166.31621175399999, 2024-09-13T05:13:23.367 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061135083999999999, 2024-09-13T05:13:23.367 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:23.367 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:23.367 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:23.367 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:23.367 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:23.367 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29022 2024-09-13T05:13:23.367 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.367 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:23.367 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.368 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:23.368 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:13:23.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.368 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.368 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:23.368 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:13:23.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.368 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.368 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:23.368 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:13:23.368 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:23.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.368 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.368 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:23.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041782+0000", 2024-09-13T05:13:23.369 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4959999999999999e-06 2024-09-13T05:13:23.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:23.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041787+0000", 2024-09-13T05:13:23.369 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1240000000000004e-06 2024-09-13T05:13:23.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:23.369 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041792+0000", 2024-09-13T05:13:23.369 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9200000000000003e-06 2024-09-13T05:13:23.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.369 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.369 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:23.370 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102738+0000", 2024-09-13T05:13:23.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060945581999999998 2024-09-13T05:13:23.370 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.370 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.370 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:23.370 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102821+0000", 2024-09-13T05:13:23.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2898999999999994e-05 2024-09-13T05:13:23.370 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.370 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.370 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:23.370 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102915+0000", 2024-09-13T05:13:23.370 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4523000000000003e-05 2024-09-13T05:13:23.370 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.370 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:23.371 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.371 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.371 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.371 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29067 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2764800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:23.371 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:13:23.371 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 166.31243753699999, 2024-09-13T05:13:23.371 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060816621000000001, 2024-09-13T05:13:23.371 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:23.371 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:23.371 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:23.371 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:23.371 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:23.371 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29067 2024-09-13T05:13:23.371 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.372 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:23.372 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.372 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:23.372 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:13:23.372 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.372 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.372 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.372 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:23.372 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:13:23.372 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.372 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.372 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.372 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:23.372 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:13:23.373 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:23.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.373 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.373 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:23.373 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045557+0000", 2024-09-13T05:13:23.373 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.898e-06 2024-09-13T05:13:23.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.373 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.373 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:23.373 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045575+0000", 2024-09-13T05:13:23.373 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8252000000000001e-05 2024-09-13T05:13:23.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.374 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.374 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:23.374 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045581+0000", 2024-09-13T05:13:23.374 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:13:23.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.374 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.374 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:23.374 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106183+0000", 2024-09-13T05:13:23.374 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060602630999999997 2024-09-13T05:13:23.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.374 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.374 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:23.375 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106271+0000", 2024-09-13T05:13:23.375 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7329000000000004e-05 2024-09-13T05:13:23.375 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.375 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.375 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:23.375 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106371+0000", 2024-09-13T05:13:23.375 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000100164 2024-09-13T05:13:23.375 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.375 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:23.375 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.375 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.375 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.375 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29068 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2774016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:23.375 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:13:23.376 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 166.31240630299999, 2024-09-13T05:13:23.376 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060994509000000002, 2024-09-13T05:13:23.376 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:23.376 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:23.376 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:23.376 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:23.376 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:23.376 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29068 2024-09-13T05:13:23.376 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.376 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:23.376 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.376 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:23.376 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:13:23.377 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.377 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.377 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.377 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:23.377 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:13:23.377 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.377 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.377 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.377 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:23.377 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045585+0000", 2024-09-13T05:13:23.377 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:23.377 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.377 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.377 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:23.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045588+0000", 2024-09-13T05:13:23.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:13:23.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:23.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045594+0000", 2024-09-13T05:13:23.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9329999999999998e-06 2024-09-13T05:13:23.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:23.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045599+0000", 2024-09-13T05:13:23.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3190000000000002e-06 2024-09-13T05:13:23.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:23.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106399+0000", 2024-09-13T05:13:23.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060800361999999997 2024-09-13T05:13:23.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:23.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106489+0000", 2024-09-13T05:13:23.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9301000000000004e-05 2024-09-13T05:13:23.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:23.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106580+0000", 2024-09-13T05:13:23.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1314e-05 2024-09-13T05:13:23.379 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.380 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:23.380 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.380 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29069 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2792448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:23.380 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:13:23.380 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 166.31238788600001, 2024-09-13T05:13:23.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061207599000000001, 2024-09-13T05:13:23.380 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:23.380 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:23.380 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:23.380 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:23.380 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:23.381 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29069 2024-09-13T05:13:23.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.381 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:23.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.381 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:23.381 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:13:23.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.381 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:23.381 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:13:23.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:23.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045603+0000", 2024-09-13T05:13:23.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:23.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:23.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045606+0000", 2024-09-13T05:13:23.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7300000000000001e-06 2024-09-13T05:13:23.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:23.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045612+0000", 2024-09-13T05:13:23.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9599999999999997e-06 2024-09-13T05:13:23.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:23.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045619+0000", 2024-09-13T05:13:23.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6019999999999996e-06 2024-09-13T05:13:23.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:23.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106619+0000", 2024-09-13T05:13:23.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061000029999999997 2024-09-13T05:13:23.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:23.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106713+0000", 2024-09-13T05:13:23.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4505000000000004e-05 2024-09-13T05:13:23.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.384 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:23.384 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106812+0000", 2024-09-13T05:13:23.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8264000000000007e-05 2024-09-13T05:13:23.384 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.384 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:23.384 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.384 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29070 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2783232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:23.384 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:13:23.385 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 166.312367427, 2024-09-13T05:13:23.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061389805999999998, 2024-09-13T05:13:23.385 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:23.385 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:23.385 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:23.385 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:23.385 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:23.385 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29070 2024-09-13T05:13:23.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.385 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:23.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:23.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:13:23.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:23.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:13:23.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:23.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:13:23.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:23.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:23.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045627+0000", 2024-09-13T05:13:23.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6579999999999998e-06 2024-09-13T05:13:23.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:23.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045632+0000", 2024-09-13T05:13:23.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8449999999999999e-06 2024-09-13T05:13:23.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:23.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045639+0000", 2024-09-13T05:13:23.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:13:23.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:23.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106837+0000", 2024-09-13T05:13:23.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061198529000000002 2024-09-13T05:13:23.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.388 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:23.388 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106922+0000", 2024-09-13T05:13:23.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4771999999999994e-05 2024-09-13T05:13:23.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.388 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:23.388 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107014+0000", 2024-09-13T05:13:23.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2009000000000006e-05 2024-09-13T05:13:23.388 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.388 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:23.389 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.389 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29071 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2801664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:23.389 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:13:23.389 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 166.312348351, 2024-09-13T05:13:23.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061582804999999997, 2024-09-13T05:13:23.389 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:23.389 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:23.389 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:23.389 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:23.389 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:23.389 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29071 2024-09-13T05:13:23.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.390 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:23.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:23.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:13:23.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:23.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:13:23.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:23.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045643+0000", 2024-09-13T05:13:23.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:23.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.391 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:23.391 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045646+0000", 2024-09-13T05:13:23.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:13:23.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.391 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:23.391 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045664+0000", 2024-09-13T05:13:23.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8408000000000001e-05 2024-09-13T05:13:23.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.391 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:23.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045670+0000", 2024-09-13T05:13:23.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7710000000000003e-06 2024-09-13T05:13:23.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.392 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.392 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:23.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107048+0000", 2024-09-13T05:13:23.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061378438 2024-09-13T05:13:23.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.392 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.392 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:23.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107134+0000", 2024-09-13T05:13:23.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5574000000000004e-05 2024-09-13T05:13:23.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.392 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.393 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:23.393 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107226+0000", 2024-09-13T05:13:23.393 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2262000000000005e-05 2024-09-13T05:13:23.393 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.393 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:23.393 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.393 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.393 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.393 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29072 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2810880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:23.393 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:13:23.393 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 166.31231696699999, 2024-09-13T05:13:23.393 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061762233999999999, 2024-09-13T05:13:23.393 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:23.394 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:23.394 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:23.394 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:23.394 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:23.394 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29072 2024-09-13T05:13:23.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.394 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:23.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:23.394 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:13:23.394 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:23.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:13:23.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:23.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045674+0000", 2024-09-13T05:13:23.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:23.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:23.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045677+0000", 2024-09-13T05:13:23.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9679999999999998e-06 2024-09-13T05:13:23.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:23.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045694+0000", 2024-09-13T05:13:23.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6801999999999999e-05 2024-09-13T05:13:23.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:23.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045700+0000", 2024-09-13T05:13:23.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8270000000000003e-06 2024-09-13T05:13:23.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:23.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107249+0000", 2024-09-13T05:13:23.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061549114000000002 2024-09-13T05:13:23.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.397 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:23.397 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107341+0000", 2024-09-13T05:13:23.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2390000000000001e-05 2024-09-13T05:13:23.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.397 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:23.397 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107437+0000", 2024-09-13T05:13:23.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5648000000000003e-05 2024-09-13T05:13:23.397 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.397 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:23.397 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.398 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.398 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.398 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29073 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2820096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:23.398 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:13:23.398 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 166.312274989, 2024-09-13T05:13:23.398 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061873910999999997, 2024-09-13T05:13:23.398 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:23.398 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:23.398 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:23.398 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:23.398 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:23.398 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29073 2024-09-13T05:13:23.398 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.398 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:23.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:23.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:13:23.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:23.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:13:23.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:23.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045716+0000", 2024-09-13T05:13:23.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:23.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:23.400 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045726+0000", 2024-09-13T05:13:23.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6350000000000001e-06 2024-09-13T05:13:23.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:23.400 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045739+0000", 2024-09-13T05:13:23.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3325e-05 2024-09-13T05:13:23.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:23.400 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045746+0000", 2024-09-13T05:13:23.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7399999999999998e-06 2024-09-13T05:13:23.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:23.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107457+0000", 2024-09-13T05:13:23.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061711038000000003 2024-09-13T05:13:23.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:23.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107522+0000", 2024-09-13T05:13:23.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4850000000000004e-05 2024-09-13T05:13:23.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.402 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:23.402 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107591+0000", 2024-09-13T05:13:23.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9029999999999995e-05 2024-09-13T05:13:23.402 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.402 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:23.402 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.402 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29074 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2829312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:23.402 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:13:23.402 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 166.312241081, 2024-09-13T05:13:23.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062055459, 2024-09-13T05:13:23.402 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:23.402 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:23.403 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:23.403 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:23.403 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:23.403 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29074 2024-09-13T05:13:23.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.403 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:23.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.403 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:23.403 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:13:23.403 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.403 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:23.403 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:13:23.403 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.404 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:23.404 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045750+0000", 2024-09-13T05:13:23.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:23.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.404 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:23.404 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045753+0000", 2024-09-13T05:13:23.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8399999999999999e-06 2024-09-13T05:13:23.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.404 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:23.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045759+0000", 2024-09-13T05:13:23.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8900000000000004e-06 2024-09-13T05:13:23.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.405 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:23.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045764+0000", 2024-09-13T05:13:23.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3850000000000001e-06 2024-09-13T05:13:23.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.405 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:23.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107623+0000", 2024-09-13T05:13:23.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061858817000000003 2024-09-13T05:13:23.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:23.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107710+0000", 2024-09-13T05:13:23.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7127999999999997e-05 2024-09-13T05:13:23.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:23.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107806+0000", 2024-09-13T05:13:23.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5886999999999999e-05 2024-09-13T05:13:23.406 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.406 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:23.406 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.406 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29075 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2838528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:23.407 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:13:23.407 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 166.31222262700001, 2024-09-13T05:13:23.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062188516999999999, 2024-09-13T05:13:23.407 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:23.407 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:23.407 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:23.407 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:23.407 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:23.407 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29075 2024-09-13T05:13:23.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.407 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:23.407 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.407 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:23.407 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:13:23.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.408 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.408 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:23.408 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:13:23.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.408 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.408 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:23.408 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:13:23.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:23.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.408 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.408 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:23.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045772+0000", 2024-09-13T05:13:23.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:13:23.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.409 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:23.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045778+0000", 2024-09-13T05:13:23.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9229999999999996e-06 2024-09-13T05:13:23.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.409 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:23.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045784+0000", 2024-09-13T05:13:23.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3800000000000002e-06 2024-09-13T05:13:23.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.410 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:23.410 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107823+0000", 2024-09-13T05:13:23.410 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062039331000000003 2024-09-13T05:13:23.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.410 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:23.410 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107886+0000", 2024-09-13T05:13:23.410 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2476000000000003e-05 2024-09-13T05:13:23.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.410 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:23.410 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107958+0000", 2024-09-13T05:13:23.410 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2089999999999996e-05 2024-09-13T05:13:23.411 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.411 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:23.411 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.411 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29115 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2682880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:23.411 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:13:23.411 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 166.30875710000001, 2024-09-13T05:13:23.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060847898999999997, 2024-09-13T05:13:23.411 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:23.411 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:23.411 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:23.411 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:23.411 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:23.412 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29115 2024-09-13T05:13:23.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.412 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:23.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:23.412 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:13:23.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:23.412 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:13:23.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.412 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:23.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049234+0000", 2024-09-13T05:13:23.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:23.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:23.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049237+0000", 2024-09-13T05:13:23.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9069999999999999e-06 2024-09-13T05:13:23.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:23.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049243+0000", 2024-09-13T05:13:23.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7459999999999997e-06 2024-09-13T05:13:23.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:23.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049248+0000", 2024-09-13T05:13:23.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1490000000000002e-06 2024-09-13T05:13:23.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:23.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.109945+0000", 2024-09-13T05:13:23.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060697299000000003 2024-09-13T05:13:23.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:23.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110013+0000", 2024-09-13T05:13:23.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8023999999999998e-05 2024-09-13T05:13:23.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.415 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:23.415 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110083+0000", 2024-09-13T05:13:23.415 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9296999999999997e-05 2024-09-13T05:13:23.415 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.415 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:23.415 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.415 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29116 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2692096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:23.416 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:13:23.416 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 166.308739256, 2024-09-13T05:13:23.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061040167999999999, 2024-09-13T05:13:23.416 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:23.416 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:23.416 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:23.416 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:23.416 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:23.416 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29116 2024-09-13T05:13:23.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.416 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:23.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:23.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:13:23.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.417 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:23.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:13:23.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.417 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:23.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049252+0000", 2024-09-13T05:13:23.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:23.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:23.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049255+0000", 2024-09-13T05:13:23.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7250000000000002e-06 2024-09-13T05:13:23.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:23.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049261+0000", 2024-09-13T05:13:23.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.755e-06 2024-09-13T05:13:23.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.419 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:23.419 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049266+0000", 2024-09-13T05:13:23.419 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2100000000000001e-06 2024-09-13T05:13:23.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.419 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:23.419 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110115+0000", 2024-09-13T05:13:23.419 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060849225999999999 2024-09-13T05:13:23.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.419 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:23.420 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110199+0000", 2024-09-13T05:13:23.420 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4339999999999995e-05 2024-09-13T05:13:23.420 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.420 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.420 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:23.420 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110293+0000", 2024-09-13T05:13:23.420 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3397e-05 2024-09-13T05:13:23.420 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.420 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:23.420 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.420 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.420 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.420 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29117 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2701312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:23.420 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:13:23.421 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 166.30872161900001, 2024-09-13T05:13:23.421 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.06118527, 2024-09-13T05:13:23.421 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:23.421 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:23.421 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:23.421 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:23.421 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:23.421 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29117 2024-09-13T05:13:23.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.421 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:23.421 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.421 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:23.421 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:13:23.421 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.422 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:23.422 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:13:23.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.422 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:23.422 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:13:23.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:23.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.422 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:23.422 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049273+0000", 2024-09-13T05:13:23.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.757e-06 2024-09-13T05:13:23.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:23.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049278+0000", 2024-09-13T05:13:23.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7830000000000004e-06 2024-09-13T05:13:23.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:23.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049284+0000", 2024-09-13T05:13:23.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3820000000000003e-06 2024-09-13T05:13:23.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:23.424 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110313+0000", 2024-09-13T05:13:23.424 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061029682000000002 2024-09-13T05:13:23.424 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.424 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.424 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:23.424 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110383+0000", 2024-09-13T05:13:23.424 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9406000000000006e-05 2024-09-13T05:13:23.424 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.424 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.424 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:23.424 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110456+0000", 2024-09-13T05:13:23.424 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2750000000000007e-05 2024-09-13T05:13:23.424 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.425 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:23.425 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.425 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.425 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.425 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29118 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2710528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:23.425 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:13:23.425 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 166.30870370400001, 2024-09-13T05:13:23.425 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061380698999999997, 2024-09-13T05:13:23.425 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:23.425 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:23.425 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:23.425 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:23.425 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:23.425 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29118 2024-09-13T05:13:23.425 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.426 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:23.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:23.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:13:23.426 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.426 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:23.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:13:23.426 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.426 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.426 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:23.426 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:13:23.427 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:23.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:23.427 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049291+0000", 2024-09-13T05:13:23.427 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8770000000000002e-06 2024-09-13T05:13:23.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:23.427 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049296+0000", 2024-09-13T05:13:23.427 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6799999999999998e-06 2024-09-13T05:13:23.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:23.427 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049302+0000", 2024-09-13T05:13:23.428 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2769999999999996e-06 2024-09-13T05:13:23.428 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.428 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.428 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:23.428 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110488+0000", 2024-09-13T05:13:23.428 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061186184999999997 2024-09-13T05:13:23.428 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.428 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.428 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:23.428 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110577+0000", 2024-09-13T05:13:23.428 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9246000000000006e-05 2024-09-13T05:13:23.428 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.428 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.428 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:23.429 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110669+0000", 2024-09-13T05:13:23.429 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1923999999999996e-05 2024-09-13T05:13:23.429 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.429 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:23.429 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.429 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.429 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.429 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29119 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2719744~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:23.429 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:13:23.429 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 166.30868595999999, 2024-09-13T05:13:23.429 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061521165000000003, 2024-09-13T05:13:23.429 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:23.429 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:23.429 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:23.430 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:23.430 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:23.430 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29119 2024-09-13T05:13:23.430 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.430 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:23.430 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.430 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:23.430 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:13:23.430 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.430 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.430 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.430 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:23.430 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:13:23.430 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.431 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.431 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.431 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:23.431 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049305+0000", 2024-09-13T05:13:23.431 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:23.431 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.431 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.431 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:23.431 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049308+0000", 2024-09-13T05:13:23.431 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7070000000000001e-06 2024-09-13T05:13:23.431 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.431 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.431 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:23.431 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049316+0000", 2024-09-13T05:13:23.432 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:13:23.432 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.432 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.432 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:23.432 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049322+0000", 2024-09-13T05:13:23.432 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3199999999999999e-06 2024-09-13T05:13:23.432 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.432 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.432 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:23.432 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110690+0000", 2024-09-13T05:13:23.432 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061368428000000003 2024-09-13T05:13:23.432 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.432 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.432 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:23.433 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110755+0000", 2024-09-13T05:13:23.433 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4893000000000004e-05 2024-09-13T05:13:23.433 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.433 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.433 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:23.433 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110827+0000", 2024-09-13T05:13:23.433 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2039000000000006e-05 2024-09-13T05:13:23.433 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.433 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:23.433 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.433 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.433 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.433 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29120 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2728960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:23.433 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:13:23.434 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 166.30866569, 2024-09-13T05:13:23.434 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061718420000000003, 2024-09-13T05:13:23.434 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:23.434 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:23.434 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:23.434 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:23.434 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:23.434 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29120 2024-09-13T05:13:23.434 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.434 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:23.434 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.434 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:23.434 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:13:23.434 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.435 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.435 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.435 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:23.435 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:13:23.435 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.435 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.435 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.435 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:23.435 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:13:23.435 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:23.435 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.435 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.435 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:23.435 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049329+0000", 2024-09-13T05:13:23.436 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.022e-06 2024-09-13T05:13:23.436 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.436 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.436 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:23.436 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049336+0000", 2024-09-13T05:13:23.436 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0720000000000002e-06 2024-09-13T05:13:23.436 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.436 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.436 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:23.436 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049341+0000", 2024-09-13T05:13:23.436 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:13:23.436 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.436 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.436 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:23.437 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110864+0000", 2024-09-13T05:13:23.437 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061523126999999997 2024-09-13T05:13:23.437 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.437 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.437 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:23.437 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110951+0000", 2024-09-13T05:13:23.437 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6557000000000005e-05 2024-09-13T05:13:23.437 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.437 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.437 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:23.437 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.111045+0000", 2024-09-13T05:13:23.437 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4043999999999996e-05 2024-09-13T05:13:23.437 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.438 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:23.438 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.438 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.438 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.438 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29136 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2876416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:23.438 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:13:23.438 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 166.30465026499999, 2024-09-13T05:13:23.438 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060742995000000001, 2024-09-13T05:13:23.438 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:23.438 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:23.438 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:23.438 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:23.438 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:23.438 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29136 2024-09-13T05:13:23.438 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.439 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:23.439 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.439 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:23.439 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:13:23.439 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.439 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.439 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.439 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:23.439 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:13:23.439 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.439 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.439 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.439 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:23.439 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053341+0000", 2024-09-13T05:13:23.440 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:23.440 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.440 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.440 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:23.440 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053344+0000", 2024-09-13T05:13:23.440 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:13:23.440 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.440 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.440 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:23.440 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053350+0000", 2024-09-13T05:13:23.440 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7200000000000003e-06 2024-09-13T05:13:23.440 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.440 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.441 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:23.441 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053355+0000", 2024-09-13T05:13:23.441 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0150000000000003e-06 2024-09-13T05:13:23.441 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.441 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.441 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:23.441 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113909+0000", 2024-09-13T05:13:23.441 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060554368999999997 2024-09-13T05:13:23.441 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.441 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.441 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:23.441 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113994+0000", 2024-09-13T05:13:23.441 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4658000000000002e-05 2024-09-13T05:13:23.441 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.442 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.442 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:23.442 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114085+0000", 2024-09-13T05:13:23.442 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0939000000000005e-05 2024-09-13T05:13:23.442 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.442 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:23.442 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.442 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.442 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.442 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29166 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2628608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:23.442 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:13:23.442 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 166.30463283099999, 2024-09-13T05:13:23.442 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060883127000000002, 2024-09-13T05:13:23.442 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:23.443 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:23.443 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:23.443 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:23.443 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:23.443 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29166 2024-09-13T05:13:23.443 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.443 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:23.443 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.443 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:23.443 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:13:23.443 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.443 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.443 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.443 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:23.443 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:13:23.444 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.444 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:23.444 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:13:23.444 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:23.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.444 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:23.444 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053361+0000", 2024-09-13T05:13:23.444 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:13:23.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.444 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:23.445 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053367+0000", 2024-09-13T05:13:23.445 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7350000000000001e-06 2024-09-13T05:13:23.445 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.445 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.445 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:23.445 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053372+0000", 2024-09-13T05:13:23.445 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7840000000000003e-06 2024-09-13T05:13:23.445 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.445 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.445 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:23.445 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114103+0000", 2024-09-13T05:13:23.445 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060730924999999998 2024-09-13T05:13:23.445 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.445 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.446 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:23.446 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114171+0000", 2024-09-13T05:13:23.446 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8021999999999993e-05 2024-09-13T05:13:23.446 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.446 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.446 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:23.446 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114242+0000", 2024-09-13T05:13:23.446 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1390999999999995e-05 2024-09-13T05:13:23.446 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.446 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:23.446 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.446 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.446 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.446 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:165308 3.3 3:c04a6a9a:::rbd_data.112dc3abcba6.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-13T05:13:23.447 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:13:23.447 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 67.226175545000004, 2024-09-13T05:13:23.447 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.085530595000000001, 2024-09-13T05:13:23.447 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:23.447 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:23.447 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:23.447 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:23.447 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:23.447 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 165308 2024-09-13T05:13:23.447 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.447 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:23.447 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.447 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:23.447 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:13:23.448 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.448 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.448 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.448 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:23.448 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:13:23.448 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:23.448 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.448 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.448 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:23.448 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131814+0000", 2024-09-13T05:13:23.448 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:23.448 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.448 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.448 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:23.448 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152479+0000", 2024-09-13T05:13:23.449 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020664281 2024-09-13T05:13:23.449 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.449 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.449 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:23.449 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152521+0000", 2024-09-13T05:13:23.449 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2567000000000001e-05 2024-09-13T05:13:23.449 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.449 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.449 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:23.449 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152536+0000", 2024-09-13T05:13:23.449 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4447000000000001e-05 2024-09-13T05:13:23.449 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.449 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.449 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:23.450 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152607+0000", 2024-09-13T05:13:23.450 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1687000000000007e-05 2024-09-13T05:13:23.450 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.450 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.450 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:23.450 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152753+0000", 2024-09-13T05:13:23.450 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000145861 2024-09-13T05:13:23.450 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.450 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.450 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:23.450 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.159991+0000", 2024-09-13T05:13:23.450 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0072373100000000003 2024-09-13T05:13:23.450 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.450 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.450 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:23.451 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.208492+0000", 2024-09-13T05:13:23.451 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048501003000000001 2024-09-13T05:13:23.451 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.451 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.451 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:23.451 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217224+0000", 2024-09-13T05:13:23.451 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0087320369999999998 2024-09-13T05:13:23.451 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.451 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.451 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:23.451 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217277+0000", 2024-09-13T05:13:23.451 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3841000000000002e-05 2024-09-13T05:13:23.452 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:23.452 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:23.452 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:23.452 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217347+0000", 2024-09-13T05:13:23.452 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9529999999999993e-05 2024-09-13T05:13:23.452 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.452 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:23.452 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.452 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:23.452 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:23.452 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:23.454 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:13:23.454 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:13:23.454 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:13:23.454 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:13:23.454 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:13:23.454 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:23.450+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:23.455 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:13:23.472 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:13:23.497 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:13:23.499 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:13:23.500 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:13:23.500 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:13:23.500 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:13:23.500 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:13:23.500 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:13:23.500 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:13:23.500 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:13:23.554 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:23.550+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:23.568 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:23.568 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:23.578 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:13:23.656 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:23.650+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:23.677 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T05:13:23.691 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:23.691 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:23.702 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:13:23.756 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:23.750+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:23.822 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:23.822 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:23.834 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:13:23.847 INFO:tasks.thrashosds.thrasher:in_osds: [2, 3, 5, 7, 1, 4, 6] out_osds: [0] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-13T05:13:23.847 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:13:23.848 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-13T05:13:23.848 INFO:tasks.thrashosds.thrasher:Setting osd 5 primary_affinity to 0.536819 2024-09-13T05:13:23.848 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 0.5368188798829595 2024-09-13T05:13:23.857 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:23.851+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:23.941 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:23.941 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:23.950 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:13:23.958 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:23.954+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:24.048 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:24.048 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:24.057 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:13:24.059 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:24.054+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:24.160 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:24.155+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:24.171 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:24.171 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:24.180 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:13:24.260 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:24.254+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:24.285 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:24.285 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:24.293 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:13:24.361 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:24.354+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:24.401 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:24.401 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:24.410 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:13:24.462 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:24.459+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:24.562 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:24.562 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:24.562 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:24.558+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:24.571 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:13:24.663 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:24.659+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:24.683 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:24.683 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:24.689 INFO:teuthology.orchestra.run.smithi120.stderr:set osd.5 primary-affinity to 0.536819 (8351802) 2024-09-13T05:13:24.689 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is set 2024-09-13T05:13:24.696 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:13:24.764 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:24.758+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:24.794 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:24.794 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:24.804 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:13:24.865 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:24.859+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:24.958 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:24.958 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:24.966 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:24.962+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:24.968 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:13:25.066 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:25.062+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:25.077 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:25.077 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:25.087 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:13:25.167 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:25.162+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:25.238 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:25.239 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:25.248 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:13:25.268 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:25.263+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:25.356 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:25.357 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:25.367 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:13:25.369 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:25.362+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:25.469 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:25.466+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:25.487 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:25.487 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:25.497 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:13:25.513 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:13:25.570 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:25.566+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:25.602 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:25.602 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:25.612 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:13:25.666 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:13:25.672 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:25.666+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:25.689 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:13:25.710 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:13:25.727 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:25.727 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:25.729 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:13:25.737 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:13:25.749 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:13:25.770 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:13:25.772 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:25.766+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:25.790 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:13:25.818 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:13:25.819 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:13:25.820 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:13:25.820 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:13:25.820 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:13:25.820 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:13:25.820 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:13:25.820 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:13:25.820 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:13:25.851 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:25.851 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:25.851 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:13:25.851 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:25.861 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:13:25.873 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:25.870+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:25.968 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:25.968 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:25.968 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:13:25.968 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:13:25.968 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:25.974 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:25.970+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:25.978 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:13:26.075 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:26.070+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:26.084 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:26.085 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:13:26.085 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:13:26.085 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:13:26.085 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.085 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3.bb1d1096 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:13:26.085 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:13:26.085 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 122.13647544200001, 2024-09-13T05:13:26.085 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68834410099999999, 2024-09-13T05:13:26.085 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.085 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:26.085 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.086 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.086 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.086 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:13:26.086 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.086 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.086 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.086 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.086 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:13:26.086 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.086 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.086 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.086 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.086 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:13:26.086 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.087 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.087 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.087 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943719+0000", 2024-09-13T05:13:26.087 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:13:26.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.087 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.087 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.087 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943734+0000", 2024-09-13T05:13:26.087 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4793e-05 2024-09-13T05:13:26.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.087 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.087 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.087 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943765+0000", 2024-09-13T05:13:26.088 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0648999999999997e-05 2024-09-13T05:13:26.088 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.088 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.088 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.088 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943779+0000", 2024-09-13T05:13:26.088 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.447e-05 2024-09-13T05:13:26.088 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.088 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.088 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.088 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943872+0000", 2024-09-13T05:13:26.088 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3304e-05 2024-09-13T05:13:26.088 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.088 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.089 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:26.089 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943884+0000", 2024-09-13T05:13:26.089 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.167e-05 2024-09-13T05:13:26.089 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.089 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.089 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.089 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632042+0000", 2024-09-13T05:13:26.089 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68815832600000004 2024-09-13T05:13:26.089 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.089 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.089 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.089 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632066+0000", 2024-09-13T05:13:26.089 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3765999999999999e-05 2024-09-13T05:13:26.089 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.090 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.090 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.090 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.090 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.090 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3.b6bd6256 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:13:26.090 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:13:26.090 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 122.13635094200001, 2024-09-13T05:13:26.090 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68852592499999998, 2024-09-13T05:13:26.090 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.090 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:26.090 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.090 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.090 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.090 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:13:26.091 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.091 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.091 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.091 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.091 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:13:26.091 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.091 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.091 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.091 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.091 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:13:26.091 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.091 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.091 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.092 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.092 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943846+0000", 2024-09-13T05:13:26.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:26.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.092 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.092 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.092 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943852+0000", 2024-09-13T05:13:26.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3820000000000001e-06 2024-09-13T05:13:26.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.092 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.092 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.092 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943876+0000", 2024-09-13T05:13:26.092 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3995e-05 2024-09-13T05:13:26.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943898+0000", 2024-09-13T05:13:26.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1838999999999999e-05 2024-09-13T05:13:26.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.093 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946457+0000", 2024-09-13T05:13:26.093 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025588910000000002 2024-09-13T05:13:26.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.093 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:26.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946499+0000", 2024-09-13T05:13:26.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2814e-05 2024-09-13T05:13:26.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.094 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632364+0000", 2024-09-13T05:13:26.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68586484999999997 2024-09-13T05:13:26.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.094 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.094 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.094 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632372+0000", 2024-09-13T05:13:26.094 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1659999999999994e-06 2024-09-13T05:13:26.094 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.094 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.095 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.095 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.095 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.095 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3:6908b8dd:::rbd_data.112d8d1317eb.000000000000000f:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:13:26.095 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:13:26.095 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 122.099206864, 2024-09-13T05:13:26.095 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65181049499999999, 2024-09-13T05:13:26.095 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.095 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.095 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.095 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.095 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.095 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:13:26.095 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.096 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.096 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.096 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.096 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:13:26.096 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.096 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.096 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.096 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.096 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980991+0000", 2024-09-13T05:13:26.096 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.096 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.096 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.097 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.097 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980989+0000", 2024-09-13T05:13:26.097 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:26.097 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.097 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.097 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.097 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.980996+0000", 2024-09-13T05:13:26.097 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2200000000000003e-06 2024-09-13T05:13:26.097 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.097 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.097 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.097 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981011+0000", 2024-09-13T05:13:26.097 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4997000000000001e-05 2024-09-13T05:13:26.097 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.098 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.098 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.098 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981025+0000", 2024-09-13T05:13:26.098 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3604000000000001e-05 2024-09-13T05:13:26.098 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.098 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.098 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.098 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981110+0000", 2024-09-13T05:13:26.098 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4948000000000001e-05 2024-09-13T05:13:26.098 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.099 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.099 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:26.099 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981120+0000", 2024-09-13T05:13:26.099 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9399999999999997e-06 2024-09-13T05:13:26.099 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.099 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.099 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.099 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632425+0000", 2024-09-13T05:13:26.099 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65130460499999998 2024-09-13T05:13:26.099 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.100 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.100 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.100 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632587+0000", 2024-09-13T05:13:26.100 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00016199500000000001 2024-09-13T05:13:26.100 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.100 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.100 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.100 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632801+0000", 2024-09-13T05:13:26.100 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021459499999999999 2024-09-13T05:13:26.101 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.101 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.101 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.101 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.101 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.101 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3:6a46bd6d:::rbd_data.112d8d1317eb.0000000000000010:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:13:26.101 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:13:26.101 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 122.099149208, 2024-09-13T05:13:26.101 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65213695699999996, 2024-09-13T05:13:26.101 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.102 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.102 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.102 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.102 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.102 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:13:26.102 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.102 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.102 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.102 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.103 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:13:26.103 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.103 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.103 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.103 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.103 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:13:26.103 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.103 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.103 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.103 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.104 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:13:26.104 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.104 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.104 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.104 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.104 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981052+0000", 2024-09-13T05:13:26.104 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4469999999999999e-06 2024-09-13T05:13:26.104 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.105 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.105 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.105 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981066+0000", 2024-09-13T05:13:26.105 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3658e-05 2024-09-13T05:13:26.105 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.105 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.105 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.105 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981073+0000", 2024-09-13T05:13:26.105 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:13:26.105 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.105 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.106 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.106 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981150+0000", 2024-09-13T05:13:26.106 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7783999999999999e-05 2024-09-13T05:13:26.106 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.106 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.106 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:26.106 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981161+0000", 2024-09-13T05:13:26.106 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0197000000000001e-05 2024-09-13T05:13:26.106 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.106 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.107 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.107 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632926+0000", 2024-09-13T05:13:26.107 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65176517300000003 2024-09-13T05:13:26.107 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.107 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.107 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.107 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633081+0000", 2024-09-13T05:13:26.108 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000155172 2024-09-13T05:13:26.108 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.108 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.108 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.108 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633185+0000", 2024-09-13T05:13:26.108 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000104329 2024-09-13T05:13:26.108 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.108 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.108 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.108 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.108 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.109 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:159585 3.1c 3:3afcc414:::rbd_data.112dfd94ee88.00000000000002ca:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:26.109 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:13:26.109 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 79.065830895000005, 2024-09-13T05:13:26.109 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91717655399999998, 2024-09-13T05:13:26.109 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.109 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.109 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.109 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.109 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.109 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 159585 2024-09-13T05:13:26.110 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.110 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.110 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.110 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.110 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:13:26.110 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.110 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.110 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.110 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.111 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:13:26.111 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.111 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.111 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.111 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.111 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014366+0000", 2024-09-13T05:13:26.111 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.111 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.111 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.111 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.112 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014370+0000", 2024-09-13T05:13:26.112 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9960000000000004e-06 2024-09-13T05:13:26.112 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.112 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.112 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.112 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014379+0000", 2024-09-13T05:13:26.112 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8550000000000008e-06 2024-09-13T05:13:26.112 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.112 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.112 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.113 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014386+0000", 2024-09-13T05:13:26.113 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0140000000000001e-06 2024-09-13T05:13:26.113 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.113 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.114 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.114 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014533+0000", 2024-09-13T05:13:26.114 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000147458 2024-09-13T05:13:26.114 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.114 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.114 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:26.114 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014545+0000", 2024-09-13T05:13:26.114 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1318000000000001e-05 2024-09-13T05:13:26.115 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.116 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.116 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.116 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931378+0000", 2024-09-13T05:13:26.116 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91683292400000005 2024-09-13T05:13:26.116 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.116 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.116 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.116 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931495+0000", 2024-09-13T05:13:26.116 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011726399999999999 2024-09-13T05:13:26.116 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.117 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.117 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.117 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931543+0000", 2024-09-13T05:13:26.117 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8183000000000003e-05 2024-09-13T05:13:26.117 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.117 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.117 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.117 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.117 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.117 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160206 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 83968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:26.117 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:13:26.117 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 79.042428498000007, 2024-09-13T05:13:26.117 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89412730799999995, 2024-09-13T05:13:26.118 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.118 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.118 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.118 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.118 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.118 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160206 2024-09-13T05:13:26.118 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.118 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.118 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.118 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.118 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:13:26.118 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.118 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.118 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.118 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.119 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:13:26.119 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.119 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.119 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.119 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.119 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037768+0000", 2024-09-13T05:13:26.119 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:26.119 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.119 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.119 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.119 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037774+0000", 2024-09-13T05:13:26.119 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3600000000000001e-06 2024-09-13T05:13:26.119 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.120 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.120 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.120 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037786+0000", 2024-09-13T05:13:26.120 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.188e-05 2024-09-13T05:13:26.120 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.120 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.120 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.121 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037793+0000", 2024-09-13T05:13:26.121 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2749999999999998e-06 2024-09-13T05:13:26.121 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.121 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.121 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.122 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:13:26.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0353000000000003e-05 2024-09-13T05:13:26.122 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.122 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.122 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:26.122 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037862+0000", 2024-09-13T05:13:26.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9710000000000004e-06 2024-09-13T05:13:26.123 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.123 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.123 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.123 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931610+0000", 2024-09-13T05:13:26.123 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89374846299999999 2024-09-13T05:13:26.123 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.123 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.124 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.124 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931815+0000", 2024-09-13T05:13:26.124 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020516499999999999 2024-09-13T05:13:26.124 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.124 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.124 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.124 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931896+0000", 2024-09-13T05:13:26.125 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1157999999999998e-05 2024-09-13T05:13:26.125 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.125 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.125 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.125 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.125 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.126 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160208 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 84992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:26.126 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:13:26.126 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 79.042343759000005, 2024-09-13T05:13:26.126 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440702299999997, 2024-09-13T05:13:26.126 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.126 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.127 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.127 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.127 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.127 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160208 2024-09-13T05:13:26.127 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.127 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.127 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.128 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.128 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:13:26.128 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.128 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.128 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.128 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.129 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:13:26.129 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.129 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.129 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.129 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037853+0000", 2024-09-13T05:13:26.129 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:26.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.129 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.129 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.129 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037858+0000", 2024-09-13T05:13:26.129 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2179999999999998e-06 2024-09-13T05:13:26.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.132 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.132 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.132 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037867+0000", 2024-09-13T05:13:26.132 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5699999999999993e-06 2024-09-13T05:13:26.133 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.133 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.133 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.133 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037874+0000", 2024-09-13T05:13:26.133 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2810000000000003e-06 2024-09-13T05:13:26.133 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.133 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.134 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.134 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037935+0000", 2024-09-13T05:13:26.134 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1231999999999999e-05 2024-09-13T05:13:26.134 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.134 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.134 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:26.134 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037944+0000", 2024-09-13T05:13:26.134 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8580000000000006e-06 2024-09-13T05:13:26.134 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.134 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.134 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.134 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931956+0000", 2024-09-13T05:13:26.134 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89401158800000002 2024-09-13T05:13:26.135 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.135 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.135 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.135 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932015+0000", 2024-09-13T05:13:26.135 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8906999999999997e-05 2024-09-13T05:13:26.135 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.135 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.135 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.135 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932261+0000", 2024-09-13T05:13:26.135 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024622799999999997 2024-09-13T05:13:26.135 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.135 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.135 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.136 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.136 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.136 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160210 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 86016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:26.136 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:13:26.136 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 79.042274904999999, 2024-09-13T05:13:26.136 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89428998299999996, 2024-09-13T05:13:26.136 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.136 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.136 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.136 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.137 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.137 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160210 2024-09-13T05:13:26.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.137 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.137 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.137 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.137 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:13:26.137 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.137 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.137 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.138 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:13:26.138 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.138 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.138 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.138 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.138 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037922+0000", 2024-09-13T05:13:26.138 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:26.138 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.138 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.138 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.138 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037926+0000", 2024-09-13T05:13:26.138 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6550000000000003e-06 2024-09-13T05:13:26.138 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.139 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.139 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.139 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037933+0000", 2024-09-13T05:13:26.139 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5409999999999997e-06 2024-09-13T05:13:26.139 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.139 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.139 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.139 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037939+0000", 2024-09-13T05:13:26.139 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1940000000000003e-06 2024-09-13T05:13:26.140 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.140 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.140 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.140 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037976+0000", 2024-09-13T05:13:26.140 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6671000000000002e-05 2024-09-13T05:13:26.140 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.140 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.140 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:26.140 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037982+0000", 2024-09-13T05:13:26.140 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9669999999999998e-06 2024-09-13T05:13:26.140 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.140 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.141 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.141 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932096+0000", 2024-09-13T05:13:26.141 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89411465599999995 2024-09-13T05:13:26.141 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.141 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.141 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.141 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932149+0000", 2024-09-13T05:13:26.141 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3032999999999999e-05 2024-09-13T05:13:26.141 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.141 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.142 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.142 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932213+0000", 2024-09-13T05:13:26.142 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3165999999999998e-05 2024-09-13T05:13:26.142 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.142 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.142 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.142 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.142 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.142 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160212 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 87040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:26.142 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:13:26.142 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 79.042187784000006, 2024-09-13T05:13:26.142 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440379699999994, 2024-09-13T05:13:26.142 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.142 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.143 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.143 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.143 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.143 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160212 2024-09-13T05:13:26.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.143 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.143 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.143 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.143 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:13:26.143 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.143 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.143 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.144 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:13:26.144 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.144 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.144 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.144 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.144 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038009+0000", 2024-09-13T05:13:26.144 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.144 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.144 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.144 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.145 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038013+0000", 2024-09-13T05:13:26.145 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3950000000000003e-06 2024-09-13T05:13:26.145 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.145 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.145 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.145 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038032+0000", 2024-09-13T05:13:26.145 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8513999999999999e-05 2024-09-13T05:13:26.145 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.145 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.145 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.146 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038039+0000", 2024-09-13T05:13:26.146 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.985e-06 2024-09-13T05:13:26.146 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.146 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.146 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.146 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038086+0000", 2024-09-13T05:13:26.146 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7302999999999998e-05 2024-09-13T05:13:26.146 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.146 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.146 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:26.146 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038090+0000", 2024-09-13T05:13:26.146 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9029999999999997e-06 2024-09-13T05:13:26.146 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.147 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.147 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.147 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932291+0000", 2024-09-13T05:13:26.147 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89420100199999997 2024-09-13T05:13:26.147 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.147 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.147 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.147 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932352+0000", 2024-09-13T05:13:26.147 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1354999999999998e-05 2024-09-13T05:13:26.147 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.147 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.147 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.147 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932414+0000", 2024-09-13T05:13:26.148 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1037999999999994e-05 2024-09-13T05:13:26.148 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.148 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.148 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.148 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.148 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160214 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 88064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:26.148 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:13:26.148 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 79.042056717999998, 2024-09-13T05:13:26.148 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89438890900000001, 2024-09-13T05:13:26.148 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.148 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.149 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.149 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.149 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.149 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160214 2024-09-13T05:13:26.149 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.149 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.149 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.149 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.149 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:13:26.149 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.149 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.149 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.149 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.150 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:13:26.150 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.150 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.150 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.150 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.150 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038140+0000", 2024-09-13T05:13:26.150 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:26.150 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.150 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.150 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.150 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038145+0000", 2024-09-13T05:13:26.150 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9749999999999998e-06 2024-09-13T05:13:26.150 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.151 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.151 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.151 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038153+0000", 2024-09-13T05:13:26.151 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1280000000000008e-06 2024-09-13T05:13:26.151 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.151 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.151 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.151 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038161+0000", 2024-09-13T05:13:26.151 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0339999999999997e-06 2024-09-13T05:13:26.151 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.151 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.151 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.152 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038199+0000", 2024-09-13T05:13:26.152 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8269999999999998e-05 2024-09-13T05:13:26.152 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.152 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.152 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:26.152 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038204+0000", 2024-09-13T05:13:26.152 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5399999999999997e-06 2024-09-13T05:13:26.152 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.152 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.152 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.152 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932438+0000", 2024-09-13T05:13:26.152 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89423397999999998 2024-09-13T05:13:26.152 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.152 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.153 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.153 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932480+0000", 2024-09-13T05:13:26.153 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2392999999999999e-05 2024-09-13T05:13:26.153 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.153 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.153 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.153 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932530+0000", 2024-09-13T05:13:26.153 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:13:26.153 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.153 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.153 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.153 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.153 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.153 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160305 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 215040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:26.154 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:13:26.154 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 79.037853495999997, 2024-09-13T05:13:26.154 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89028175300000001, 2024-09-13T05:13:26.154 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.154 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.154 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.154 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.154 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.154 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160305 2024-09-13T05:13:26.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.154 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.154 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:13:26.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:13:26.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042343+0000", 2024-09-13T05:13:26.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:26.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.156 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042350+0000", 2024-09-13T05:13:26.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3769999999999998e-06 2024-09-13T05:13:26.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.156 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.156 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042367+0000", 2024-09-13T05:13:26.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.734e-05 2024-09-13T05:13:26.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.156 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.156 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042375+0000", 2024-09-13T05:13:26.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8469999999999996e-06 2024-09-13T05:13:26.157 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.157 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.157 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042428+0000", 2024-09-13T05:13:26.157 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3074e-05 2024-09-13T05:13:26.157 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.157 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:26.157 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042437+0000", 2024-09-13T05:13:26.157 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:13:26.157 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.157 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.157 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932550+0000", 2024-09-13T05:13:26.157 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89011304300000005 2024-09-13T05:13:26.158 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.158 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.158 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.158 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932589+0000", 2024-09-13T05:13:26.158 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9236000000000002e-05 2024-09-13T05:13:26.158 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.158 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.158 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.158 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932626+0000", 2024-09-13T05:13:26.158 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6832999999999998e-05 2024-09-13T05:13:26.158 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.158 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.158 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.159 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.159 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160307 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 216064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:26.159 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:13:26.159 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 79.037807056999995, 2024-09-13T05:13:26.159 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89032630800000001, 2024-09-13T05:13:26.159 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.159 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.159 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.159 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.159 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.159 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160307 2024-09-13T05:13:26.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.159 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:13:26.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:13:26.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:13:26.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.161 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042394+0000", 2024-09-13T05:13:26.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7900000000000001e-06 2024-09-13T05:13:26.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.161 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042401+0000", 2024-09-13T05:13:26.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.267e-06 2024-09-13T05:13:26.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.161 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042406+0000", 2024-09-13T05:13:26.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0860000000000001e-06 2024-09-13T05:13:26.162 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.162 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.162 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.162 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042465+0000", 2024-09-13T05:13:26.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9441000000000002e-05 2024-09-13T05:13:26.162 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.162 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.162 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:26.162 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042471+0000", 2024-09-13T05:13:26.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6640000000000003e-06 2024-09-13T05:13:26.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.163 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.163 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932645+0000", 2024-09-13T05:13:26.163 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89017372900000002 2024-09-13T05:13:26.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.164 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.164 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.164 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932681+0000", 2024-09-13T05:13:26.164 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5918999999999999e-05 2024-09-13T05:13:26.164 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.164 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.165 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932717+0000", 2024-09-13T05:13:26.165 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6007999999999998e-05 2024-09-13T05:13:26.165 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.165 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.165 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.166 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160309 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 217088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:26.166 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:13:26.166 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 79.037756798000004, 2024-09-13T05:13:26.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89037315900000003, 2024-09-13T05:13:26.166 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.166 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.167 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.167 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.167 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.167 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160309 2024-09-13T05:13:26.167 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.167 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.167 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.167 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:13:26.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.168 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.168 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.168 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:13:26.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042440+0000", 2024-09-13T05:13:26.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042444+0000", 2024-09-13T05:13:26.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.104e-06 2024-09-13T05:13:26.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042451+0000", 2024-09-13T05:13:26.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.922e-06 2024-09-13T05:13:26.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.171 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042457+0000", 2024-09-13T05:13:26.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3979999999999998e-06 2024-09-13T05:13:26.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.171 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.171 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042497+0000", 2024-09-13T05:13:26.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0692999999999998e-05 2024-09-13T05:13:26.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:26.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042503+0000", 2024-09-13T05:13:26.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.553e-06 2024-09-13T05:13:26.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932735+0000", 2024-09-13T05:13:26.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89023238699999996 2024-09-13T05:13:26.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932771+0000", 2024-09-13T05:13:26.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5972000000000001e-05 2024-09-13T05:13:26.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932814+0000", 2024-09-13T05:13:26.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2657000000000002e-05 2024-09-13T05:13:26.173 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.173 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.173 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.173 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160311 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 218112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:26.173 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:13:26.173 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 79.037731308000005, 2024-09-13T05:13:26.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89045284400000002, 2024-09-13T05:13:26.174 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.174 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.174 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.174 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.174 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.174 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160311 2024-09-13T05:13:26.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.174 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.175 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.175 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:13:26.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.175 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.175 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:13:26.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.175 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.175 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:13:26.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042469+0000", 2024-09-13T05:13:26.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.456e-06 2024-09-13T05:13:26.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042475+0000", 2024-09-13T05:13:26.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0990000000000004e-06 2024-09-13T05:13:26.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.176 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.176 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.176 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042481+0000", 2024-09-13T05:13:26.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.237e-06 2024-09-13T05:13:26.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042527+0000", 2024-09-13T05:13:26.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6796999999999999e-05 2024-09-13T05:13:26.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:26.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042533+0000", 2024-09-13T05:13:26.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6489999999999996e-06 2024-09-13T05:13:26.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932832+0000", 2024-09-13T05:13:26.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89029919800000001 2024-09-13T05:13:26.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932867+0000", 2024-09-13T05:13:26.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5049000000000003e-05 2024-09-13T05:13:26.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932919+0000", 2024-09-13T05:13:26.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1780999999999998e-05 2024-09-13T05:13:26.178 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.178 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.179 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.179 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160313 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 219136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:26.179 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:13:26.179 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 79.037702217000003, 2024-09-13T05:13:26.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89064232600000004, 2024-09-13T05:13:26.179 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.179 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.179 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.179 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.179 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.179 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160313 2024-09-13T05:13:26.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.180 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:13:26.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:13:26.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:13:26.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042498+0000", 2024-09-13T05:13:26.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.281e-06 2024-09-13T05:13:26.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.181 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042505+0000", 2024-09-13T05:13:26.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2699999999999999e-06 2024-09-13T05:13:26.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.181 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042512+0000", 2024-09-13T05:13:26.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0330000000000003e-06 2024-09-13T05:13:26.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042557+0000", 2024-09-13T05:13:26.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4425999999999998e-05 2024-09-13T05:13:26.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:26.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042562+0000", 2024-09-13T05:13:26.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3639999999999998e-06 2024-09-13T05:13:26.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932987+0000", 2024-09-13T05:13:26.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89042472299999997 2024-09-13T05:13:26.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933062+0000", 2024-09-13T05:13:26.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5129999999999994e-05 2024-09-13T05:13:26.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933138+0000", 2024-09-13T05:13:26.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5536000000000003e-05 2024-09-13T05:13:26.183 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.183 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.184 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.184 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160315 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 220160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:26.184 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:13:26.184 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 79.03767105, 2024-09-13T05:13:26.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89071820800000001, 2024-09-13T05:13:26.184 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.184 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.184 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.184 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.184 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.184 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160315 2024-09-13T05:13:26.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.185 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.185 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:13:26.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.185 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:13:26.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:13:26.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042529+0000", 2024-09-13T05:13:26.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3639999999999999e-06 2024-09-13T05:13:26.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042536+0000", 2024-09-13T05:13:26.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.866e-06 2024-09-13T05:13:26.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.187 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042541+0000", 2024-09-13T05:13:26.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:13:26.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.187 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042587+0000", 2024-09-13T05:13:26.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5735000000000002e-05 2024-09-13T05:13:26.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:26.187 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042593+0000", 2024-09-13T05:13:26.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0719999999999996e-06 2024-09-13T05:13:26.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933160+0000", 2024-09-13T05:13:26.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89056621000000002 2024-09-13T05:13:26.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933202+0000", 2024-09-13T05:13:26.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2376000000000002e-05 2024-09-13T05:13:26.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933245+0000", 2024-09-13T05:13:26.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2787999999999998e-05 2024-09-13T05:13:26.189 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.189 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.189 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.189 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160317 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:26.189 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:13:26.189 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 79.037642220999999, 2024-09-13T05:13:26.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89082205800000003, 2024-09-13T05:13:26.189 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.189 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.189 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.189 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.189 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.190 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160317 2024-09-13T05:13:26.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.190 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:13:26.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:13:26.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:13:26.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042558+0000", 2024-09-13T05:13:26.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1810000000000001e-06 2024-09-13T05:13:26.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042565+0000", 2024-09-13T05:13:26.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9280000000000004e-06 2024-09-13T05:13:26.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042571+0000", 2024-09-13T05:13:26.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7420000000000003e-06 2024-09-13T05:13:26.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042616+0000", 2024-09-13T05:13:26.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5201999999999999e-05 2024-09-13T05:13:26.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:26.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042622+0000", 2024-09-13T05:13:26.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8289999999999996e-06 2024-09-13T05:13:26.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933259+0000", 2024-09-13T05:13:26.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89063730799999996 2024-09-13T05:13:26.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933311+0000", 2024-09-13T05:13:26.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1910000000000003e-05 2024-09-13T05:13:26.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933377+0000", 2024-09-13T05:13:26.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6396999999999995e-05 2024-09-13T05:13:26.194 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.194 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.194 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.194 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160319 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 222208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:26.194 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:13:26.194 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 79.037612005, 2024-09-13T05:13:26.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89087477400000004, 2024-09-13T05:13:26.195 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.195 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.195 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.195 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.195 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.195 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160319 2024-09-13T05:13:26.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.195 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.195 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.195 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:13:26.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.196 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:13:26.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.196 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042585+0000", 2024-09-13T05:13:26.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.196 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042588+0000", 2024-09-13T05:13:26.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9450000000000002e-06 2024-09-13T05:13:26.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.197 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042594+0000", 2024-09-13T05:13:26.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0959999999999997e-06 2024-09-13T05:13:26.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.197 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042599+0000", 2024-09-13T05:13:26.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0069999999999997e-06 2024-09-13T05:13:26.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.197 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042642+0000", 2024-09-13T05:13:26.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2553999999999999e-05 2024-09-13T05:13:26.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.198 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:26.198 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042647+0000", 2024-09-13T05:13:26.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.31e-06 2024-09-13T05:13:26.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.198 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.198 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933387+0000", 2024-09-13T05:13:26.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89073982799999996 2024-09-13T05:13:26.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.198 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.199 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:13:26.199 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7101000000000003e-05 2024-09-13T05:13:26.199 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.199 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.199 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.199 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933460+0000", 2024-09-13T05:13:26.199 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6282999999999998e-05 2024-09-13T05:13:26.199 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.199 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.199 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.199 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.199 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.199 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160321 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 223232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:26.199 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:13:26.200 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 79.037582577999999, 2024-09-13T05:13:26.200 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89094616999999998, 2024-09-13T05:13:26.200 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.200 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.200 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.200 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.200 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.200 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160321 2024-09-13T05:13:26.200 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.200 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.200 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.200 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.200 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:13:26.200 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:13:26.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:13:26.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.202 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.202 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042617+0000", 2024-09-13T05:13:26.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8329999999999998e-06 2024-09-13T05:13:26.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.202 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.202 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042638+0000", 2024-09-13T05:13:26.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0908e-05 2024-09-13T05:13:26.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.202 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.202 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042644+0000", 2024-09-13T05:13:26.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0440000000000001e-06 2024-09-13T05:13:26.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.203 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.203 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042666+0000", 2024-09-13T05:13:26.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1256000000000001e-05 2024-09-13T05:13:26.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.203 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:26.203 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042671+0000", 2024-09-13T05:13:26.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6250000000000004e-06 2024-09-13T05:13:26.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933478+0000", 2024-09-13T05:13:26.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89080698800000002 2024-09-13T05:13:26.204 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.204 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933519+0000", 2024-09-13T05:13:26.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0717000000000003e-05 2024-09-13T05:13:26.204 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.204 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933561+0000", 2024-09-13T05:13:26.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2225999999999999e-05 2024-09-13T05:13:26.204 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.205 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.205 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.205 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:201615 3.1d 3:bb015654:::rbd_data.112d9dba7cdc.000000000000000a:head [delete] snapc 30=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2024-09-13T05:13:26.205 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:13:26.205 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 46.075345796999997, 2024-09-13T05:13:26.205 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.90842926999999996, 2024-09-13T05:13:26.205 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.205 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:26.206 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.206 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.206 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.206 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 201615 2024-09-13T05:13:26.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.206 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.206 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.206 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:13:26.206 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.206 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.206 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:13:26.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.207 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.207 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004850+0000", 2024-09-13T05:13:26.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:26.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.207 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.207 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004860+0000", 2024-09-13T05:13:26.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.927e-06 2024-09-13T05:13:26.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.208 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004882+0000", 2024-09-13T05:13:26.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2079999999999999e-05 2024-09-13T05:13:26.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.208 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004897+0000", 2024-09-13T05:13:26.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4892000000000001e-05 2024-09-13T05:13:26.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.208 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.005068+0000", 2024-09-13T05:13:26.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017098999999999999 2024-09-13T05:13:26.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.209 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:26.209 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.005081+0000", 2024-09-13T05:13:26.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3063e-05 2024-09-13T05:13:26.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.209 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.209 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.910925+0000", 2024-09-13T05:13:26.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.90584383400000001 2024-09-13T05:13:26.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.210 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.210 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.911131+0000", 2024-09-13T05:13:26.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020629399999999999 2024-09-13T05:13:26.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.210 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.210 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 4", 2024-09-13T05:13:26.210 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.911313+0000", 2024-09-13T05:13:26.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000182175 2024-09-13T05:13:26.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.210 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.210 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:26.210 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913010+0000", 2024-09-13T05:13:26.210 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0016971550000000001 2024-09-13T05:13:26.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:26.211 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913212+0000", 2024-09-13T05:13:26.211 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000202237 2024-09-13T05:13:26.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:26.211 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913253+0000", 2024-09-13T05:13:26.211 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0250999999999998e-05 2024-09-13T05:13:26.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.211 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.211 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.211 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913281+0000", 2024-09-13T05:13:26.212 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8314e-05 2024-09-13T05:13:26.212 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.212 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.212 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.212 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.212 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.212 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:26.213 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:13:26.214 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:26.207+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:26.315 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:26.311+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:26.375 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:26.375 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:26.375 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:13:26.375 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:26.385 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:13:26.437 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:26.431+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:26.491 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:26.491 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:26.491 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:13:26.491 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:13:26.491 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:26.500 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:13:26.516 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:26.511+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:26.608 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:26.608 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:13:26.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:13:26.608 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:13:26.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.608 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29021 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2865152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:26.608 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:13:26.609 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 169.56208275, 2024-09-13T05:13:26.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060927993999999999, 2024-09-13T05:13:26.609 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.609 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.609 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.609 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.609 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.609 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29021 2024-09-13T05:13:26.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.609 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:13:26.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:13:26.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041763+0000", 2024-09-13T05:13:26.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041766+0000", 2024-09-13T05:13:26.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6800000000000002e-06 2024-09-13T05:13:26.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041771+0000", 2024-09-13T05:13:26.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:13:26.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041776+0000", 2024-09-13T05:13:26.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8489999999999997e-06 2024-09-13T05:13:26.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102513+0000", 2024-09-13T05:13:26.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060737102000000001 2024-09-13T05:13:26.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102597+0000", 2024-09-13T05:13:26.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4374000000000002e-05 2024-09-13T05:13:26.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102692+0000", 2024-09-13T05:13:26.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4436000000000002e-05 2024-09-13T05:13:26.613 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.613 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.613 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.613 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29022 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2874368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:26.613 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:13:26.613 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 169.56206645, 2024-09-13T05:13:26.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061135083999999999, 2024-09-13T05:13:26.613 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.613 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.614 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.614 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.614 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.614 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29022 2024-09-13T05:13:26.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.614 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:13:26.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:13:26.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:13:26.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041782+0000", 2024-09-13T05:13:26.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4959999999999999e-06 2024-09-13T05:13:26.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041787+0000", 2024-09-13T05:13:26.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1240000000000004e-06 2024-09-13T05:13:26.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041792+0000", 2024-09-13T05:13:26.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9200000000000003e-06 2024-09-13T05:13:26.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102738+0000", 2024-09-13T05:13:26.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060945581999999998 2024-09-13T05:13:26.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102821+0000", 2024-09-13T05:13:26.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2898999999999994e-05 2024-09-13T05:13:26.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102915+0000", 2024-09-13T05:13:26.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4523000000000003e-05 2024-09-13T05:13:26.617 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.617 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.617 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.618 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29067 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2764800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:26.618 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:13:26.618 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 169.558292233, 2024-09-13T05:13:26.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060816621000000001, 2024-09-13T05:13:26.618 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.618 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.618 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.618 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.618 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.618 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29067 2024-09-13T05:13:26.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.618 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:13:26.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:13:26.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:13:26.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045557+0000", 2024-09-13T05:13:26.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.898e-06 2024-09-13T05:13:26.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045575+0000", 2024-09-13T05:13:26.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8252000000000001e-05 2024-09-13T05:13:26.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045581+0000", 2024-09-13T05:13:26.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:13:26.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106183+0000", 2024-09-13T05:13:26.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060602630999999997 2024-09-13T05:13:26.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106271+0000", 2024-09-13T05:13:26.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7329000000000004e-05 2024-09-13T05:13:26.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106371+0000", 2024-09-13T05:13:26.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000100164 2024-09-13T05:13:26.622 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.622 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.622 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.622 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29068 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2774016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:26.622 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:13:26.622 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 169.558260999, 2024-09-13T05:13:26.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060994509000000002, 2024-09-13T05:13:26.622 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.623 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.623 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.623 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.623 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.623 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29068 2024-09-13T05:13:26.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.623 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:13:26.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:13:26.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045585+0000", 2024-09-13T05:13:26.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045588+0000", 2024-09-13T05:13:26.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:13:26.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045594+0000", 2024-09-13T05:13:26.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9329999999999998e-06 2024-09-13T05:13:26.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045599+0000", 2024-09-13T05:13:26.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3190000000000002e-06 2024-09-13T05:13:26.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106399+0000", 2024-09-13T05:13:26.626 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060800361999999997 2024-09-13T05:13:26.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.626 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.626 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.626 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106489+0000", 2024-09-13T05:13:26.626 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9301000000000004e-05 2024-09-13T05:13:26.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.626 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.626 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.626 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106580+0000", 2024-09-13T05:13:26.626 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1314e-05 2024-09-13T05:13:26.626 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.626 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.626 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.627 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29069 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2792448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:26.627 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:13:26.627 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 169.55824258199999, 2024-09-13T05:13:26.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061207599000000001, 2024-09-13T05:13:26.627 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.627 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.627 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.627 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.627 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.627 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29069 2024-09-13T05:13:26.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.627 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.628 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.628 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:13:26.628 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.628 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.628 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:13:26.628 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.628 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.628 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045603+0000", 2024-09-13T05:13:26.628 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.629 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.629 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045606+0000", 2024-09-13T05:13:26.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7300000000000001e-06 2024-09-13T05:13:26.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.629 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.629 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045612+0000", 2024-09-13T05:13:26.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9599999999999997e-06 2024-09-13T05:13:26.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.629 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.629 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045619+0000", 2024-09-13T05:13:26.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6019999999999996e-06 2024-09-13T05:13:26.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.630 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.630 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106619+0000", 2024-09-13T05:13:26.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061000029999999997 2024-09-13T05:13:26.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.630 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.630 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106713+0000", 2024-09-13T05:13:26.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4505000000000004e-05 2024-09-13T05:13:26.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.630 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.630 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106812+0000", 2024-09-13T05:13:26.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8264000000000007e-05 2024-09-13T05:13:26.631 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.631 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.631 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.631 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.631 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29070 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2783232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:26.631 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:13:26.631 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 169.55822212300001, 2024-09-13T05:13:26.631 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061389805999999998, 2024-09-13T05:13:26.631 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.631 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.631 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.631 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.631 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.631 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29070 2024-09-13T05:13:26.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.632 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.632 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.632 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:13:26.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.632 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.632 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:13:26.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.633 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.633 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:13:26.633 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.633 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.633 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045627+0000", 2024-09-13T05:13:26.633 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6579999999999998e-06 2024-09-13T05:13:26.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.633 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.633 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045632+0000", 2024-09-13T05:13:26.633 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8449999999999999e-06 2024-09-13T05:13:26.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.634 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.634 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045639+0000", 2024-09-13T05:13:26.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:13:26.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.634 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.634 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106837+0000", 2024-09-13T05:13:26.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061198529000000002 2024-09-13T05:13:26.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.634 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.634 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106922+0000", 2024-09-13T05:13:26.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4771999999999994e-05 2024-09-13T05:13:26.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.635 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.635 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.635 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107014+0000", 2024-09-13T05:13:26.635 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2009000000000006e-05 2024-09-13T05:13:26.635 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.635 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.635 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.635 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.635 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29071 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2801664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:26.635 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:13:26.635 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 169.55820304700001, 2024-09-13T05:13:26.635 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061582804999999997, 2024-09-13T05:13:26.635 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.636 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.636 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.636 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.636 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.636 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29071 2024-09-13T05:13:26.636 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.636 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.636 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.636 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.636 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:13:26.636 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.636 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.636 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.636 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.637 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:13:26.637 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.637 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.637 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.637 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045643+0000", 2024-09-13T05:13:26.637 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.637 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.637 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.637 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045646+0000", 2024-09-13T05:13:26.637 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:13:26.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.637 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045664+0000", 2024-09-13T05:13:26.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8408000000000001e-05 2024-09-13T05:13:26.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045670+0000", 2024-09-13T05:13:26.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7710000000000003e-06 2024-09-13T05:13:26.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107048+0000", 2024-09-13T05:13:26.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061378438 2024-09-13T05:13:26.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.639 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.639 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107134+0000", 2024-09-13T05:13:26.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5574000000000004e-05 2024-09-13T05:13:26.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.639 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.639 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.639 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107226+0000", 2024-09-13T05:13:26.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2262000000000005e-05 2024-09-13T05:13:26.639 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.639 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.639 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.639 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.639 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29072 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2810880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:26.640 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:13:26.640 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 169.558171663, 2024-09-13T05:13:26.640 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061762233999999999, 2024-09-13T05:13:26.640 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.640 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.640 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.640 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.640 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.640 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29072 2024-09-13T05:13:26.640 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.640 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.640 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.640 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.640 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:13:26.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:13:26.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045674+0000", 2024-09-13T05:13:26.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045677+0000", 2024-09-13T05:13:26.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9679999999999998e-06 2024-09-13T05:13:26.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.642 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045694+0000", 2024-09-13T05:13:26.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6801999999999999e-05 2024-09-13T05:13:26.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.642 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045700+0000", 2024-09-13T05:13:26.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8270000000000003e-06 2024-09-13T05:13:26.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.643 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.643 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107249+0000", 2024-09-13T05:13:26.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061549114000000002 2024-09-13T05:13:26.643 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.643 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.643 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.643 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107341+0000", 2024-09-13T05:13:26.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2390000000000001e-05 2024-09-13T05:13:26.643 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.643 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.643 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.643 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107437+0000", 2024-09-13T05:13:26.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5648000000000003e-05 2024-09-13T05:13:26.644 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.644 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.644 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.644 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.644 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29073 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2820096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:26.644 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:13:26.644 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 169.55812968500001, 2024-09-13T05:13:26.644 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061873910999999997, 2024-09-13T05:13:26.644 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.644 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.644 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.644 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.644 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.645 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29073 2024-09-13T05:13:26.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.645 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.645 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:13:26.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.645 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:13:26.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.646 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.646 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045716+0000", 2024-09-13T05:13:26.646 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.646 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.646 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.646 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045726+0000", 2024-09-13T05:13:26.646 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6350000000000001e-06 2024-09-13T05:13:26.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.646 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.646 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.646 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045739+0000", 2024-09-13T05:13:26.646 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3325e-05 2024-09-13T05:13:26.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.646 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.647 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.647 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045746+0000", 2024-09-13T05:13:26.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7399999999999998e-06 2024-09-13T05:13:26.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.647 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.647 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107457+0000", 2024-09-13T05:13:26.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061711038000000003 2024-09-13T05:13:26.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.647 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.647 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107522+0000", 2024-09-13T05:13:26.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4850000000000004e-05 2024-09-13T05:13:26.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.648 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.648 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.648 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107591+0000", 2024-09-13T05:13:26.648 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9029999999999995e-05 2024-09-13T05:13:26.648 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.648 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.648 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.648 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.648 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29074 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2829312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:26.648 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:13:26.648 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 169.55809577700001, 2024-09-13T05:13:26.648 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062055459, 2024-09-13T05:13:26.648 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.649 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.649 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.649 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.649 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.649 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29074 2024-09-13T05:13:26.649 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.649 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.649 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.649 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.649 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:13:26.649 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.649 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.649 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.649 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.650 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:13:26.650 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.650 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.650 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.650 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.650 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045750+0000", 2024-09-13T05:13:26.650 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.650 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.650 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.650 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.650 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045753+0000", 2024-09-13T05:13:26.650 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8399999999999999e-06 2024-09-13T05:13:26.650 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.650 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.651 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.651 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045759+0000", 2024-09-13T05:13:26.651 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8900000000000004e-06 2024-09-13T05:13:26.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.651 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.651 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.651 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045764+0000", 2024-09-13T05:13:26.651 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3850000000000001e-06 2024-09-13T05:13:26.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.651 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.651 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.651 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107623+0000", 2024-09-13T05:13:26.651 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061858817000000003 2024-09-13T05:13:26.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.652 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.652 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.652 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107710+0000", 2024-09-13T05:13:26.652 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7127999999999997e-05 2024-09-13T05:13:26.652 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.652 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.652 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.652 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107806+0000", 2024-09-13T05:13:26.652 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5886999999999999e-05 2024-09-13T05:13:26.652 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.652 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.652 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.653 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.653 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.653 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29075 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2838528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:26.653 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:13:26.653 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 169.55807732299999, 2024-09-13T05:13:26.653 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062188516999999999, 2024-09-13T05:13:26.653 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.653 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.653 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.653 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.653 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.653 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29075 2024-09-13T05:13:26.653 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.654 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.654 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.654 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:13:26.654 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.654 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.654 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.654 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:13:26.654 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.654 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.654 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.654 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:13:26.654 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.655 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.655 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.655 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.655 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045772+0000", 2024-09-13T05:13:26.655 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:13:26.655 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.655 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.655 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.655 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045778+0000", 2024-09-13T05:13:26.655 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9229999999999996e-06 2024-09-13T05:13:26.655 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.655 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.655 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.655 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045784+0000", 2024-09-13T05:13:26.656 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3800000000000002e-06 2024-09-13T05:13:26.656 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.656 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.656 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.656 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107823+0000", 2024-09-13T05:13:26.656 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062039331000000003 2024-09-13T05:13:26.656 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.656 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.656 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.656 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107886+0000", 2024-09-13T05:13:26.656 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2476000000000003e-05 2024-09-13T05:13:26.656 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.656 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.656 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.657 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107958+0000", 2024-09-13T05:13:26.657 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2089999999999996e-05 2024-09-13T05:13:26.657 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.657 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.657 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.657 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.657 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.657 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29115 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2682880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:26.657 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:13:26.657 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 169.55461179599999, 2024-09-13T05:13:26.657 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060847898999999997, 2024-09-13T05:13:26.657 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.657 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.657 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.658 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.658 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.658 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29115 2024-09-13T05:13:26.658 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.658 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.658 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.658 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.658 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:13:26.658 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.658 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.658 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.658 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.658 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:13:26.658 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.658 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.659 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.659 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.659 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049234+0000", 2024-09-13T05:13:26.659 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.659 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.659 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.659 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.659 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049237+0000", 2024-09-13T05:13:26.659 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9069999999999999e-06 2024-09-13T05:13:26.659 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.659 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.659 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.659 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049243+0000", 2024-09-13T05:13:26.659 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7459999999999997e-06 2024-09-13T05:13:26.660 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.660 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.660 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.660 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049248+0000", 2024-09-13T05:13:26.660 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1490000000000002e-06 2024-09-13T05:13:26.660 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.660 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.660 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.660 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.109945+0000", 2024-09-13T05:13:26.660 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060697299000000003 2024-09-13T05:13:26.660 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.660 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.660 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.660 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110013+0000", 2024-09-13T05:13:26.660 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8023999999999998e-05 2024-09-13T05:13:26.661 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.661 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.661 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.661 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110083+0000", 2024-09-13T05:13:26.661 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9296999999999997e-05 2024-09-13T05:13:26.661 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.661 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.661 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.661 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.661 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.661 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29116 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2692096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:26.661 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:13:26.661 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 169.554593952, 2024-09-13T05:13:26.661 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061040167999999999, 2024-09-13T05:13:26.662 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.662 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.662 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.662 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.662 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.662 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29116 2024-09-13T05:13:26.662 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.662 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.662 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.662 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.662 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:13:26.662 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.662 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.662 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.663 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.663 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:13:26.663 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.663 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.663 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.663 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.663 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049252+0000", 2024-09-13T05:13:26.663 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.663 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.663 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.663 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.663 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049255+0000", 2024-09-13T05:13:26.663 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7250000000000002e-06 2024-09-13T05:13:26.663 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.664 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.664 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.664 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049261+0000", 2024-09-13T05:13:26.664 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.755e-06 2024-09-13T05:13:26.664 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.664 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.664 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.664 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049266+0000", 2024-09-13T05:13:26.664 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2100000000000001e-06 2024-09-13T05:13:26.664 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.664 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.664 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.664 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110115+0000", 2024-09-13T05:13:26.664 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060849225999999999 2024-09-13T05:13:26.665 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.665 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.665 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.665 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110199+0000", 2024-09-13T05:13:26.665 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4339999999999995e-05 2024-09-13T05:13:26.665 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.665 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.665 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.665 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110293+0000", 2024-09-13T05:13:26.665 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3397e-05 2024-09-13T05:13:26.665 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.665 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.665 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.665 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.666 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.666 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29117 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2701312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:26.666 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:13:26.666 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 169.55457631499999, 2024-09-13T05:13:26.666 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.06118527, 2024-09-13T05:13:26.666 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.666 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.666 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.666 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.666 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.666 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29117 2024-09-13T05:13:26.666 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.666 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.667 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.667 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.667 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:13:26.667 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.667 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.667 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.667 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.667 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:13:26.667 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.667 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.667 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.667 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.667 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:13:26.667 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.668 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.668 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.668 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.668 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049273+0000", 2024-09-13T05:13:26.668 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.757e-06 2024-09-13T05:13:26.668 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.668 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.668 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.668 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049278+0000", 2024-09-13T05:13:26.668 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7830000000000004e-06 2024-09-13T05:13:26.668 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.668 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.668 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.668 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049284+0000", 2024-09-13T05:13:26.669 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3820000000000003e-06 2024-09-13T05:13:26.669 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.669 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.669 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.669 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110313+0000", 2024-09-13T05:13:26.669 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061029682000000002 2024-09-13T05:13:26.669 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.669 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.669 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.669 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110383+0000", 2024-09-13T05:13:26.669 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9406000000000006e-05 2024-09-13T05:13:26.669 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.669 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.669 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.670 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110456+0000", 2024-09-13T05:13:26.670 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2750000000000007e-05 2024-09-13T05:13:26.670 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.670 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.670 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.670 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.670 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.670 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29118 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2710528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:26.670 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:13:26.670 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 169.55455839999999, 2024-09-13T05:13:26.670 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061380698999999997, 2024-09-13T05:13:26.670 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.670 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.670 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.671 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.671 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.671 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29118 2024-09-13T05:13:26.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.671 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.671 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.671 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.671 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:13:26.671 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.671 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.671 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.671 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:13:26.671 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.672 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.672 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.672 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:13:26.672 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.672 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.672 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.672 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.672 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049291+0000", 2024-09-13T05:13:26.672 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8770000000000002e-06 2024-09-13T05:13:26.672 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.672 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.672 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.672 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049296+0000", 2024-09-13T05:13:26.673 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6799999999999998e-06 2024-09-13T05:13:26.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.673 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.673 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.673 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049302+0000", 2024-09-13T05:13:26.673 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2769999999999996e-06 2024-09-13T05:13:26.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.673 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.673 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.673 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110488+0000", 2024-09-13T05:13:26.673 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061186184999999997 2024-09-13T05:13:26.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.673 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.674 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.674 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110577+0000", 2024-09-13T05:13:26.674 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9246000000000006e-05 2024-09-13T05:13:26.674 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.674 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.674 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.674 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110669+0000", 2024-09-13T05:13:26.674 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1923999999999996e-05 2024-09-13T05:13:26.674 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.674 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.674 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.674 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.674 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.674 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29119 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2719744~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:26.674 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:13:26.675 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 169.554540656, 2024-09-13T05:13:26.675 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061521165000000003, 2024-09-13T05:13:26.675 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.675 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.675 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.675 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.675 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.675 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29119 2024-09-13T05:13:26.675 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.675 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.676 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.676 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.676 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:13:26.676 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.676 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.676 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.676 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.676 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:13:26.676 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.676 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.677 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.677 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.677 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049305+0000", 2024-09-13T05:13:26.677 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.677 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.677 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.677 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.677 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049308+0000", 2024-09-13T05:13:26.677 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7070000000000001e-06 2024-09-13T05:13:26.677 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.677 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.677 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.677 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049316+0000", 2024-09-13T05:13:26.677 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:13:26.678 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.678 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.678 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049322+0000", 2024-09-13T05:13:26.678 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3199999999999999e-06 2024-09-13T05:13:26.678 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.678 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.678 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110690+0000", 2024-09-13T05:13:26.678 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061368428000000003 2024-09-13T05:13:26.678 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.678 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.678 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110755+0000", 2024-09-13T05:13:26.679 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4893000000000004e-05 2024-09-13T05:13:26.679 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.679 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.679 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.679 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110827+0000", 2024-09-13T05:13:26.679 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2039000000000006e-05 2024-09-13T05:13:26.679 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.679 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.679 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.679 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.679 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.679 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29120 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2728960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:26.679 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:13:26.679 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 169.55452038600001, 2024-09-13T05:13:26.679 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061718420000000003, 2024-09-13T05:13:26.680 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.680 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.680 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.680 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.680 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.680 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29120 2024-09-13T05:13:26.680 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.680 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.680 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.680 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.680 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:13:26.680 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.680 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.680 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.681 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:13:26.681 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.681 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.681 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:13:26.681 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.681 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.681 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049329+0000", 2024-09-13T05:13:26.681 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.022e-06 2024-09-13T05:13:26.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.682 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.682 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049336+0000", 2024-09-13T05:13:26.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0720000000000002e-06 2024-09-13T05:13:26.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.682 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.682 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049341+0000", 2024-09-13T05:13:26.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:13:26.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.682 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.682 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110864+0000", 2024-09-13T05:13:26.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061523126999999997 2024-09-13T05:13:26.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.683 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.683 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.683 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110951+0000", 2024-09-13T05:13:26.683 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6557000000000005e-05 2024-09-13T05:13:26.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.683 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.683 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.683 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.111045+0000", 2024-09-13T05:13:26.683 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4043999999999996e-05 2024-09-13T05:13:26.683 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.683 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.683 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.684 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29136 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2876416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:26.684 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:13:26.684 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 169.550504961, 2024-09-13T05:13:26.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060742995000000001, 2024-09-13T05:13:26.684 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.684 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.684 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.684 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.684 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.684 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29136 2024-09-13T05:13:26.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.684 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.685 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.685 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:13:26.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.685 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.685 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:13:26.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.685 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.685 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053341+0000", 2024-09-13T05:13:26.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.686 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.686 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.686 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053344+0000", 2024-09-13T05:13:26.686 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:13:26.686 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.686 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.686 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.686 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053350+0000", 2024-09-13T05:13:26.686 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7200000000000003e-06 2024-09-13T05:13:26.686 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.686 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.686 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.686 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053355+0000", 2024-09-13T05:13:26.686 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0150000000000003e-06 2024-09-13T05:13:26.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113909+0000", 2024-09-13T05:13:26.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060554368999999997 2024-09-13T05:13:26.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113994+0000", 2024-09-13T05:13:26.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4658000000000002e-05 2024-09-13T05:13:26.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114085+0000", 2024-09-13T05:13:26.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0939000000000005e-05 2024-09-13T05:13:26.688 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.688 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.688 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.688 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.688 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.688 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29166 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2628608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:26.688 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:13:26.688 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 169.550487527, 2024-09-13T05:13:26.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060883127000000002, 2024-09-13T05:13:26.688 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.688 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:26.688 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.688 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.688 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.689 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29166 2024-09-13T05:13:26.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.689 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.689 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.689 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.689 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:13:26.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.689 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.689 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.689 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:13:26.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.689 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:13:26.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:26.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053361+0000", 2024-09-13T05:13:26.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:13:26.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053367+0000", 2024-09-13T05:13:26.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7350000000000001e-06 2024-09-13T05:13:26.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053372+0000", 2024-09-13T05:13:26.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7840000000000003e-06 2024-09-13T05:13:26.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114103+0000", 2024-09-13T05:13:26.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060730924999999998 2024-09-13T05:13:26.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114171+0000", 2024-09-13T05:13:26.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8021999999999993e-05 2024-09-13T05:13:26.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.692 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.692 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114242+0000", 2024-09-13T05:13:26.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1390999999999995e-05 2024-09-13T05:13:26.692 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.692 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.692 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.692 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.692 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:165308 3.3 3:c04a6a9a:::rbd_data.112dc3abcba6.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-13T05:13:26.692 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:13:26.692 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 70.472030240999999, 2024-09-13T05:13:26.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.085530595000000001, 2024-09-13T05:13:26.693 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:26.693 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:26.693 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:26.693 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:26.693 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:26.693 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 165308 2024-09-13T05:13:26.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.693 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:26.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:26.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:13:26.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:26.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:13:26.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:26.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:26.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131814+0000", 2024-09-13T05:13:26.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:26.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.695 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:26.695 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152479+0000", 2024-09-13T05:13:26.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020664281 2024-09-13T05:13:26.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.695 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:26.695 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152521+0000", 2024-09-13T05:13:26.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2567000000000001e-05 2024-09-13T05:13:26.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.695 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:26.695 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152536+0000", 2024-09-13T05:13:26.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4447000000000001e-05 2024-09-13T05:13:26.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.696 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:26.696 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152607+0000", 2024-09-13T05:13:26.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1687000000000007e-05 2024-09-13T05:13:26.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.696 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.696 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:26.696 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152753+0000", 2024-09-13T05:13:26.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000145861 2024-09-13T05:13:26.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.696 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.696 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:26.696 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.159991+0000", 2024-09-13T05:13:26.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0072373100000000003 2024-09-13T05:13:26.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:26.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.208492+0000", 2024-09-13T05:13:26.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048501003000000001 2024-09-13T05:13:26.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:26.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217224+0000", 2024-09-13T05:13:26.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0087320369999999998 2024-09-13T05:13:26.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:26.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217277+0000", 2024-09-13T05:13:26.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3841000000000002e-05 2024-09-13T05:13:26.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:26.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:26.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:26.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217347+0000", 2024-09-13T05:13:26.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9529999999999993e-05 2024-09-13T05:13:26.698 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.698 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.698 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.698 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:26.698 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:26.698 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:26.700 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:13:26.700 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:26.694+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:26.704 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T05:13:26.801 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:26.794+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:26.860 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:26.860 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:26.860 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:13:26.860 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:26.870 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:13:26.901 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:26.898+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:26.976 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:26.976 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:26.976 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:13:26.977 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:13:26.977 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:26.995 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:13:27.002 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:26.998+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:27.103 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:27.098+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:27.106 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:27.107 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:13:27.107 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:13:27.107 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:13:27.107 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.107 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:27.107 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:13:27.107 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 170.23949153800001, 2024-09-13T05:13:27.107 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:13:27.107 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:27.107 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:27.107 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:27.107 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:27.108 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.108 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:13:27.108 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.108 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:27.108 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.108 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:27.109 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:13:27.109 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.109 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.109 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.109 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:27.109 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:13:27.109 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.109 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.109 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.110 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:27.110 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:13:27.110 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:27.110 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.110 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.110 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:27.110 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:13:27.110 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:13:27.110 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.111 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.111 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:27.111 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:13:27.111 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:13:27.111 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.111 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.111 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.111 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:13:27.111 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:13:27.111 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.111 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.111 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.111 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:13:27.112 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:13:27.112 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.112 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.112 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:27.112 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:13:27.112 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:13:27.112 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.112 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.112 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.112 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:13:27.112 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:13:27.112 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.112 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.112 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:27.113 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:13:27.113 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:13:27.113 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.113 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.113 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:27.113 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:13:27.113 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:13:27.113 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.113 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:27.113 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.113 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.113 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.113 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:27.113 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:13:27.114 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 170.23946710199999, 2024-09-13T05:13:27.114 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:13:27.114 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:27.114 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:27.114 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:27.114 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:27.114 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.114 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:13:27.114 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.114 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:27.114 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.114 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:27.114 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:13:27.114 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.115 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.115 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.115 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:27.115 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:13:27.115 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.115 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.115 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.115 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:27.115 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:13:27.115 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:27.115 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.115 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.115 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:27.115 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:13:27.115 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:13:27.116 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.116 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.116 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:27.116 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:13:27.116 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:13:27.116 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.116 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.116 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.116 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:13:27.117 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:13:27.117 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.117 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.117 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.117 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:13:27.117 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:13:27.117 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.117 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.117 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:27.117 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:13:27.117 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:13:27.117 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.117 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.117 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.118 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:13:27.118 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:13:27.118 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.118 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.118 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:27.118 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:13:27.118 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:13:27.118 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.118 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.118 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:27.118 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:13:27.118 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:13:27.118 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.119 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:27.119 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.119 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.119 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.119 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:27.119 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:13:27.119 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 170.239457276, 2024-09-13T05:13:27.119 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:13:27.119 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:27.119 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:27.119 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:27.120 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:27.120 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.120 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:13:27.120 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.120 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:27.120 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.120 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:27.120 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:13:27.120 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.120 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.120 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.120 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:27.120 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:13:27.120 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.121 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.121 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.121 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:27.121 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:13:27.121 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:27.121 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.121 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.121 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:27.121 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:13:27.121 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:13:27.121 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.121 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.121 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:27.121 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:13:27.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:13:27.122 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.122 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.122 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.122 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:13:27.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:13:27.122 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.122 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.122 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.122 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:13:27.122 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:13:27.122 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.122 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.122 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:27.123 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:13:27.123 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:13:27.123 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.123 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.123 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.123 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:13:27.123 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:13:27.123 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.123 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.123 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:27.123 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:13:27.123 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:13:27.123 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.123 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:27.124 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.124 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.124 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.124 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:27.124 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:13:27.124 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 170.23944904000001, 2024-09-13T05:13:27.124 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:13:27.124 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:27.124 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:27.124 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:27.124 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:27.124 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.124 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:13:27.124 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.125 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:27.125 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.125 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:27.125 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:13:27.125 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.125 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.125 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.125 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:27.126 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:13:27.126 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.126 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.126 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.126 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:27.126 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:13:27.126 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:27.126 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.127 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.127 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:27.127 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:13:27.127 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:13:27.127 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.127 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.127 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:27.128 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:13:27.128 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:13:27.128 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.128 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.128 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.128 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:13:27.128 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:13:27.128 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.128 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.129 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.129 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:13:27.129 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:13:27.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.129 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.129 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:27.129 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:13:27.129 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:13:27.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.129 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.129 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.129 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:13:27.129 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:13:27.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.130 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.130 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:27.130 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:13:27.130 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:13:27.130 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.130 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:27.130 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.130 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.130 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.130 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:27.130 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:13:27.130 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 170.23942712799999, 2024-09-13T05:13:27.130 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:13:27.130 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:27.131 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:27.131 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:27.131 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:27.131 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.131 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:13:27.131 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.131 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:27.131 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.132 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:27.132 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:13:27.132 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.132 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.132 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.132 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:27.132 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:13:27.132 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.133 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.133 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.133 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:27.133 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:13:27.133 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:27.133 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.133 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.133 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:27.133 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:13:27.133 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:13:27.133 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.134 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.134 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:27.134 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:13:27.134 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:13:27.134 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.134 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.134 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.134 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:13:27.134 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:13:27.134 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.134 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.134 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.134 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:13:27.134 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:13:27.135 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.135 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.135 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:27.135 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:13:27.135 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:13:27.135 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.135 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.135 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.135 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:13:27.135 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:13:27.135 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.135 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.135 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:27.135 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:13:27.136 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:13:27.136 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.136 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:27.136 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.136 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.136 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.136 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:27.136 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:13:27.136 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 170.239418524, 2024-09-13T05:13:27.136 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:13:27.136 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:27.136 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:27.136 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:27.136 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:27.137 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.137 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:13:27.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.137 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:27.137 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.137 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:27.137 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:13:27.137 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.137 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.137 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:27.137 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:13:27.137 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.138 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.138 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.138 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:27.138 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:13:27.138 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:27.138 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.138 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.138 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:27.138 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:13:27.138 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:13:27.138 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.138 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.138 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:27.138 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:13:27.139 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:13:27.139 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.139 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.139 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.139 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:13:27.139 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:13:27.139 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.139 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.139 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.139 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:13:27.139 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:13:27.139 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.139 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.140 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:27.140 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:13:27.140 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:13:27.140 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.140 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.140 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.140 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:13:27.140 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:13:27.140 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.140 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.140 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:27.140 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:13:27.140 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:13:27.141 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.141 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:27.141 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.141 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.141 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.141 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:27.141 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:13:27.141 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 170.23940883, 2024-09-13T05:13:27.141 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:13:27.141 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:27.141 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:27.141 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:27.141 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:27.142 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.142 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:13:27.142 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.142 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:27.142 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.142 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:27.142 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:13:27.142 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.142 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.142 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.142 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:27.142 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:13:27.142 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.143 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.143 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:27.143 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:13:27.143 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:27.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.143 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.143 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:27.143 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:13:27.143 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:13:27.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.143 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.143 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:27.144 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:13:27.144 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:13:27.144 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.144 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.144 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.144 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:13:27.144 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:13:27.144 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.144 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.144 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.144 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:13:27.144 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:13:27.144 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.145 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.145 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:27.145 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:13:27.145 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:13:27.145 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.145 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.145 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.145 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:13:27.145 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:13:27.145 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.145 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.145 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:27.146 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:13:27.146 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:13:27.146 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.146 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:27.146 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.146 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.146 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.146 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:27.146 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:13:27.146 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 170.23939971499999, 2024-09-13T05:13:27.146 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:13:27.146 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:27.146 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:27.147 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:27.147 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:27.147 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.147 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:13:27.147 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.147 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:27.147 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.147 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:27.148 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:13:27.148 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.148 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.148 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:27.148 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:13:27.148 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.148 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.148 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:27.148 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:13:27.148 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:27.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.149 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.149 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:27.149 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:13:27.149 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:13:27.149 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.149 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.149 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:27.149 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:13:27.149 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:13:27.149 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.150 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.150 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.150 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:13:27.150 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:13:27.150 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.150 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.150 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.150 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:13:27.150 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:13:27.150 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.150 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.150 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:27.150 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:13:27.150 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:13:27.151 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.151 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.151 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.151 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:13:27.151 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:13:27.151 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.151 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.151 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:27.151 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:13:27.151 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:13:27.151 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.151 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:27.151 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.151 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.152 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.152 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:27.152 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:13:27.152 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 170.23939123599999, 2024-09-13T05:13:27.152 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:13:27.152 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:27.152 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:27.152 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:27.152 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:27.152 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.152 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:13:27.152 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.152 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:27.152 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.153 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:27.153 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:13:27.153 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.153 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.153 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.153 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:27.153 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:13:27.153 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.153 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.153 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.153 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:27.153 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:13:27.153 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:27.153 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.153 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.154 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:27.154 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:13:27.154 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:13:27.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.154 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.154 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:27.154 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:13:27.154 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:13:27.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.154 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.154 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.154 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:13:27.154 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:13:27.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:13:27.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:13:27.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:27.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:13:27.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:13:27.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.155 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.155 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:13:27.155 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:13:27.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.156 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.156 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:27.156 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:13:27.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:13:27.156 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.156 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:27.156 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.156 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.156 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:27.156 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:13:27.156 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 170.23937931099999, 2024-09-13T05:13:27.156 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:13:27.157 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:27.157 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:27.157 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:27.157 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:27.157 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.157 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:13:27.157 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.157 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:27.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.157 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:27.157 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:13:27.157 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.157 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.157 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.158 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:27.158 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:13:27.158 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.158 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.158 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.158 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:27.158 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:13:27.158 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:27.158 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.158 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.158 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:27.158 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:13:27.158 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:13:27.158 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.159 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.159 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:27.159 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:13:27.159 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:13:27.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.159 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.159 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.159 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:13:27.159 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:13:27.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.159 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.159 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.159 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:13:27.159 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:13:27.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:27.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:13:27.160 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:13:27.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.160 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.160 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.160 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:13:27.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:13:27.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.161 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:27.161 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:13:27.161 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:13:27.161 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.161 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:27.161 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.161 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.161 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:27.161 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:13:27.162 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 170.23935772199999, 2024-09-13T05:13:27.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:13:27.162 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:27.162 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:27.162 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:27.162 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:27.162 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.162 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:13:27.162 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.162 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:27.162 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.162 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:27.162 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:13:27.162 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.163 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:27.163 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:13:27.163 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.163 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:27.163 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:13:27.163 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:27.163 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.163 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.163 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:27.163 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:13:27.163 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:13:27.164 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.164 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.164 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:27.164 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:13:27.164 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:13:27.164 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.164 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.164 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.164 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:13:27.164 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:13:27.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.165 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.165 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:13:27.165 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:13:27.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.165 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.165 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:27.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:13:27.165 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:13:27.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.165 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.165 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.165 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:13:27.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:13:27.166 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.166 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:27.166 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:13:27.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:13:27.166 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.166 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:27.166 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.166 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.166 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.166 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:27.166 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:13:27.166 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 170.23933459400001, 2024-09-13T05:13:27.166 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:13:27.167 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:27.167 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:27.167 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:27.167 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:27.167 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.167 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:13:27.167 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.167 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:27.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.167 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:27.167 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:13:27.167 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.167 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.167 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:13:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:13:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:13:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:13:27.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:27.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:13:27.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:13:27.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:13:27.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:13:27.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.169 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.169 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:13:27.169 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:13:27.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:27.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:13:27.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:13:27.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:13:27.170 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:13:27.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.170 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.170 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:27.170 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:13:27.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:13:27.171 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.171 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:27.171 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.171 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.171 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:27.171 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:13:27.171 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 170.23931922099999, 2024-09-13T05:13:27.171 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:13:27.171 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:27.171 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:27.171 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:27.171 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:27.171 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.172 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:13:27.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.172 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:27.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:27.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:13:27.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.172 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:27.172 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:13:27.172 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.172 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.172 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:27.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:13:27.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:27.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:27.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:13:27.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:13:27.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.173 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.173 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:27.173 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:13:27.173 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:13:27.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:13:27.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:13:27.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:13:27.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:13:27.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.174 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:27.174 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:13:27.174 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:13:27.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.175 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.175 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:13:27.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:13:27.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.175 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:27.175 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:13:27.175 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:13:27.175 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.175 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:27.175 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.175 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.175 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.176 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:27.176 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:13:27.176 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 170.23929875300001, 2024-09-13T05:13:27.176 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:13:27.176 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:27.176 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:27.176 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:27.176 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:27.176 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.177 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:13:27.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.177 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:27.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:27.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:13:27.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.177 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:27.177 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:13:27.177 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.177 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:27.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:13:27.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:27.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:27.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:13:27.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:13:27.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.178 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.178 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:27.178 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:13:27.178 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:13:27.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.179 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:13:27.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:13:27.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.179 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:13:27.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:13:27.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.179 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.179 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:27.179 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:13:27.179 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:13:27.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:13:27.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:13:27.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.180 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:27.180 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:13:27.180 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:13:27.180 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.180 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:27.180 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.180 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.181 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:27.181 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:13:27.181 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 170.239282092, 2024-09-13T05:13:27.181 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:13:27.181 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:27.181 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:27.181 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:27.181 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:27.181 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.181 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:13:27.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.181 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:27.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:27.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:13:27.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:27.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:13:27.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.182 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.182 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:27.182 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:13:27.182 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:27.182 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:27.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:13:27.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:13:27.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:27.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:13:27.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:13:27.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.183 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.183 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.183 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:13:27.183 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:13:27.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.184 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.184 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:13:27.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:13:27.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.184 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:27.184 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:13:27.184 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:13:27.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.184 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.184 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.184 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:13:27.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:13:27.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.185 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:27.185 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:13:27.185 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:13:27.185 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.185 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:27.185 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.185 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.185 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:27.185 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:13:27.186 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 170.23925537900001, 2024-09-13T05:13:27.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:13:27.186 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:27.186 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:27.186 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:27.186 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:27.186 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.186 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:13:27.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.186 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:27.186 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.186 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:27.186 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:13:27.186 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:27.187 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:13:27.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:27.187 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:13:27.187 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:27.187 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.187 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.187 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:27.187 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:13:27.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:13:27.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:27.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:13:27.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:13:27.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.188 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.188 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:13:27.188 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:13:27.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.188 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:13:27.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:13:27.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:27.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:13:27.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:13:27.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.189 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.189 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.189 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:13:27.189 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:13:27.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.190 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:27.190 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:13:27.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:13:27.190 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.190 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:27.190 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.190 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.190 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:27.190 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:13:27.190 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 170.239236527, 2024-09-13T05:13:27.190 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:13:27.191 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:27.191 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:27.191 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:27.191 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:27.191 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.191 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:13:27.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.191 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:27.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.191 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:27.191 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:13:27.191 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:27.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:13:27.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:27.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:13:27.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:27.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.192 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.192 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:27.192 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:13:27.192 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:13:27.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:27.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:13:27.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:13:27.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:13:27.193 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:13:27.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.193 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.193 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.193 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:13:27.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:13:27.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:27.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:13:27.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:13:27.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.194 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:13:27.194 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:13:27.194 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.194 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.194 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:27.195 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:13:27.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:13:27.195 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.195 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:27.195 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.195 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.195 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:27.195 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:13:27.195 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 170.239218741, 2024-09-13T05:13:27.195 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:13:27.195 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:27.195 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:27.195 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:27.196 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:27.196 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.196 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:13:27.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.196 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:27.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.196 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:27.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:13:27.196 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.196 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.196 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:27.196 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:13:27.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:27.197 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:13:27.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:27.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:27.197 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:13:27.197 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:13:27.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.197 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.197 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:27.198 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:13:27.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:13:27.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.198 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.198 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:13:27.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:13:27.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.198 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.198 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:13:27.198 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:13:27.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.198 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.199 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:27.199 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:13:27.199 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:13:27.199 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.199 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.199 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.199 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:13:27.199 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:13:27.199 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.199 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.200 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:27.200 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:13:27.200 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:13:27.200 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.200 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:27.200 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.200 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.200 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.200 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:27.200 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:13:27.200 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 170.23918368099999, 2024-09-13T05:13:27.200 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:13:27.200 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:27.200 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:27.201 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:27.201 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:27.201 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.201 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:13:27.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.201 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:27.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:27.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:13:27.201 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.201 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.201 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:27.201 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:13:27.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.202 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:27.202 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:13:27.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:27.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.202 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:27.202 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:13:27.202 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:13:27.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.202 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.202 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:27.203 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:13:27.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:13:27.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.203 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.203 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:13:27.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:13:27.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.203 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.203 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:13:27.203 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:13:27.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.203 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:27.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:13:27.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:13:27.204 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.204 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:13:27.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:13:27.204 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.204 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.204 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:27.204 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:13:27.204 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:13:27.204 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.205 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:27.205 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.205 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.205 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:27.205 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:13:27.205 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 170.23916686600001, 2024-09-13T05:13:27.205 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:13:27.205 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:27.205 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:27.205 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:27.205 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:27.205 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.205 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:13:27.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.206 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:27.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.206 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:27.206 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:13:27.206 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.206 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:27.206 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:13:27.206 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:27.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.206 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:27.206 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:13:27.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:27.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.207 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:27.207 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:13:27.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:13:27.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.207 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:27.207 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:13:27.207 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:13:27.207 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.207 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.207 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.207 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:13:27.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:13:27.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.208 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:13:27.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:13:27.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.208 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:27.208 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:13:27.208 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:13:27.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.208 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.208 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:27.209 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:13:27.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:13:27.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:27.209 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:27.209 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:27.209 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:13:27.209 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:13:27.209 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.209 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:27.209 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.209 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:27.209 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:27.209 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:27.211 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:13:27.211 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:27.207+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:27.312 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:27.306+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:27.329 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:27.329 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:27.329 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:13:27.329 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:27.339 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:13:27.413 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:27.407+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:27.444 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:27.444 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:27.444 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:13:27.444 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:13:27.444 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:27.454 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:13:27.514 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:27.511+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:27.561 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:27.561 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:13:27.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:13:27.561 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [] 2024-09-13T05:13:27.565 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:27.570 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:13:27.615 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:27.610+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:27.670 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:27.670 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:27.670 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:13:27.670 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:27.680 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:13:27.724 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is unset 2024-09-13T05:13:27.724 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:27.718+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:27.817 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:27.815+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:27.823 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:27.823 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:27.823 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:13:27.823 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:13:27.823 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:27.831 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:13:27.833 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:13:27.918 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:27.915+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:27.953 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:27.954 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:13:27.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:13:27.954 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:13:27.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.954 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:159451 3.1b e117/116 3:d9c87acb:::rbd_data.112dc3abcba6.0000000000000003:head v 117'567, mlcod=0'0)", 2024-09-13T05:13:27.954 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:13:27.954 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 81.013232990000006, 2024-09-13T05:13:27.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064897325000000006, 2024-09-13T05:13:27.955 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:27.955 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:27.955 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:27.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:27.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:13:27.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:27.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:13:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938207+0000", 2024-09-13T05:13:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:13:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972794+0000", 2024-09-13T05:13:27.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.034587013 2024-09-13T05:13:27.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:27.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972821+0000", 2024-09-13T05:13:27.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6764e-05 2024-09-13T05:13:27.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972841+0000", 2024-09-13T05:13:27.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0191999999999999e-05 2024-09-13T05:13:27.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:27.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972905+0000", 2024-09-13T05:13:27.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4319000000000005e-05 2024-09-13T05:13:27.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:27.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972927+0000", 2024-09-13T05:13:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1135999999999999e-05 2024-09-13T05:13:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:13:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.002964+0000", 2024-09-13T05:13:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.030037123999999998 2024-09-13T05:13:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.003105+0000", 2024-09-13T05:13:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141614 2024-09-13T05:13:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:27.960 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159495 3.0 3:022f4da1:::rbd_data.112dfd94ee88.00000000000000e4:2a [read 167936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:13:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 80.938093569000003, 2024-09-13T05:13:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91926946899999995, 2024-09-13T05:13:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:27.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.962 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159495 2024-09-13T05:13:27.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.962 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:27.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:27.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:13:27.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:27.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:13:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013345+0000", 2024-09-13T05:13:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999971 2024-09-13T05:13:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013359+0000", 2024-09-13T05:13:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4752999999999999e-05 2024-09-13T05:13:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013418+0000", 2024-09-13T05:13:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8959000000000003e-05 2024-09-13T05:13:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013439+0000", 2024-09-13T05:13:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0749000000000001e-05 2024-09-13T05:13:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013563+0000", 2024-09-13T05:13:27.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012349400000000001 2024-09-13T05:13:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013583+0000", 2024-09-13T05:13:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0007e-05 2024-09-13T05:13:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932400+0000", 2024-09-13T05:13:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91881732400000005 2024-09-13T05:13:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:27.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932533+0000", 2024-09-13T05:13:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013263700000000001 2024-09-13T05:13:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932617+0000", 2024-09-13T05:13:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4313000000000004e-05 2024-09-13T05:13:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159517 3.0 3:03975f1c:::rbd_data.112dfd94ee88.0000000000000156:2a [read 167936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:13:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 80.937829855000004, 2024-09-13T05:13:27.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91962025700000005, 2024-09-13T05:13:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159517 2024-09-13T05:13:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:13:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:13:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013609+0000", 2024-09-13T05:13:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013619+0000", 2024-09-13T05:13:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0077e-05 2024-09-13T05:13:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013638+0000", 2024-09-13T05:13:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8739000000000001e-05 2024-09-13T05:13:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013653+0000", 2024-09-13T05:13:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5446000000000001e-05 2024-09-13T05:13:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016506+0000", 2024-09-13T05:13:27.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028525619999999999 2024-09-13T05:13:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016521+0000", 2024-09-13T05:13:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5310000000000001e-05 2024-09-13T05:13:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932964+0000", 2024-09-13T05:13:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91644284099999995 2024-09-13T05:13:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:27.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933097+0000", 2024-09-13T05:13:27.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013337599999999999 2024-09-13T05:13:27.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933231+0000", 2024-09-13T05:13:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133996 2024-09-13T05:13:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.973 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159622 3.0 3:03f7a45a:::rbd_data.112dfd94ee88.0000000000000318:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:13:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 80.936168043999999, 2024-09-13T05:13:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.918245003, 2024-09-13T05:13:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159622 2024-09-13T05:13:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:13:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:13:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015266+0000", 2024-09-13T05:13:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999928 2024-09-13T05:13:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015283+0000", 2024-09-13T05:13:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7309999999999999e-05 2024-09-13T05:13:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015318+0000", 2024-09-13T05:13:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5119e-05 2024-09-13T05:13:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015338+0000", 2024-09-13T05:13:27.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9259e-05 2024-09-13T05:13:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016558+0000", 2024-09-13T05:13:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012199909999999999 2024-09-13T05:13:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016567+0000", 2024-09-13T05:13:27.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2459999999999992e-06 2024-09-13T05:13:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933266+0000", 2024-09-13T05:13:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91669950300000003 2024-09-13T05:13:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:13:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015788099999999999 2024-09-13T05:13:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:27.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933518+0000", 2024-09-13T05:13:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3721000000000006e-05 2024-09-13T05:13:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173445 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 150528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:13:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.771591258999997, 2024-09-13T05:13:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064560905000000002, 2024-09-13T05:13:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:27.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:27.980 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:27.980 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.980 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173445 2024-09-13T05:13:27.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.980 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:27.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:27.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:13:27.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:13:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179849+0000", 2024-09-13T05:13:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179860+0000", 2024-09-13T05:13:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0419e-05 2024-09-13T05:13:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179866+0000", 2024-09-13T05:13:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.567e-06 2024-09-13T05:13:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179872+0000", 2024-09-13T05:13:27.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1830000000000002e-06 2024-09-13T05:13:27.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:27.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244262+0000", 2024-09-13T05:13:27.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064390814000000005 2024-09-13T05:13:27.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:27.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244321+0000", 2024-09-13T05:13:27.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8341000000000003e-05 2024-09-13T05:13:27.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:27.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244411+0000", 2024-09-13T05:13:27.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9911e-05 2024-09-13T05:13:27.985 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:27.985 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:27.985 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:27.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.985 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173446 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 157696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:27.985 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:13:27.985 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.771564492000003, 2024-09-13T05:13:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064714007000000004, 2024-09-13T05:13:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173446 2024-09-13T05:13:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:13:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:27.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:27.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:13:27.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:27.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:27.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179876+0000", 2024-09-13T05:13:27.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:27.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:27.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179879+0000", 2024-09-13T05:13:27.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1489999999999998e-06 2024-09-13T05:13:27.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:27.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179884+0000", 2024-09-13T05:13:27.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2800000000000003e-06 2024-09-13T05:13:27.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179889+0000", 2024-09-13T05:13:27.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7620000000000003e-06 2024-09-13T05:13:27.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:27.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244452+0000", 2024-09-13T05:13:27.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064562943999999997 2024-09-13T05:13:27.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:27.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244512+0000", 2024-09-13T05:13:27.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9879e-05 2024-09-13T05:13:27.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:27.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244591+0000", 2024-09-13T05:13:27.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8701000000000004e-05 2024-09-13T05:13:27.991 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:27.991 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:27.991 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:27.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.992 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173447 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 164864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:27.992 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:13:27.992 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.771547744000003, 2024-09-13T05:13:27.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064866246000000002, 2024-09-13T05:13:27.992 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:27.992 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:27.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:27.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:27.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.993 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173447 2024-09-13T05:13:27.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.993 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:27.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:13:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:13:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:27.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:13:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179895+0000", 2024-09-13T05:13:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6910000000000002e-06 2024-09-13T05:13:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179901+0000", 2024-09-13T05:13:27.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5149999999999997e-06 2024-09-13T05:13:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179905+0000", 2024-09-13T05:13:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4170000000000002e-06 2024-09-13T05:13:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244615+0000", 2024-09-13T05:13:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064709533999999999 2024-09-13T05:13:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244665+0000", 2024-09-13T05:13:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0283e-05 2024-09-13T05:13:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244760+0000", 2024-09-13T05:13:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4310999999999999e-05 2024-09-13T05:13:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173448 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 172032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:13:27.997 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.771531897999999, 2024-09-13T05:13:27.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065022046999999999, 2024-09-13T05:13:27.998 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:27.998 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:27.998 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:27.998 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:27.998 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:27.998 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173448 2024-09-13T05:13:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:13:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:13:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:27.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:13:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179914+0000", 2024-09-13T05:13:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6699999999999999e-06 2024-09-13T05:13:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:28.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179921+0000", 2024-09-13T05:13:28.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:13:28.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:28.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179926+0000", 2024-09-13T05:13:28.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8659999999999997e-06 2024-09-13T05:13:28.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:28.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244782+0000", 2024-09-13T05:13:28.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064856570000000002 2024-09-13T05:13:28.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:28.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244857+0000", 2024-09-13T05:13:28.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4326999999999995e-05 2024-09-13T05:13:28.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:28.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244931+0000", 2024-09-13T05:13:28.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4443999999999994e-05 2024-09-13T05:13:28.002 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.002 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:28.003 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.003 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173450 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 179200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:28.003 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:13:28.003 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.771511064000002, 2024-09-13T05:13:28.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065192589999999995, 2024-09-13T05:13:28.003 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:28.003 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:28.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:28.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:28.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:28.003 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173450 2024-09-13T05:13:28.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.004 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:28.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:28.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:13:28.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:28.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:28.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:13:28.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:28.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:28.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:13:28.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:28.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:28.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179932+0000", 2024-09-13T05:13:28.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2529999999999999e-06 2024-09-13T05:13:28.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:28.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179937+0000", 2024-09-13T05:13:28.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4219999999999999e-06 2024-09-13T05:13:28.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:28.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179942+0000", 2024-09-13T05:13:28.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3250000000000001e-06 2024-09-13T05:13:28.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:28.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244969+0000", 2024-09-13T05:13:28.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065027794999999999 2024-09-13T05:13:28.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:28.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245048+0000", 2024-09-13T05:13:28.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8812000000000004e-05 2024-09-13T05:13:28.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:28.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245123+0000", 2024-09-13T05:13:28.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4342000000000001e-05 2024-09-13T05:13:28.007 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.007 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:28.007 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.007 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173451 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:28.007 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:13:28.007 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.771495076999997, 2024-09-13T05:13:28.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359814000000002, 2024-09-13T05:13:28.007 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:28.007 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:28.008 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:28.008 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:28.008 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:28.008 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173451 2024-09-13T05:13:28.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.008 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:28.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:28.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:13:28.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:28.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:28.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:13:28.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:28.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:28.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:13:28.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:28.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:28.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179948+0000", 2024-09-13T05:13:28.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5119999999999998e-06 2024-09-13T05:13:28.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:28.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179954+0000", 2024-09-13T05:13:28.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5840000000000002e-06 2024-09-13T05:13:28.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:28.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179958+0000", 2024-09-13T05:13:28.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.566e-06 2024-09-13T05:13:28.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:28.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245160+0000", 2024-09-13T05:13:28.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065202057999999993 2024-09-13T05:13:28.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:28.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245228+0000", 2024-09-13T05:13:28.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7257999999999999e-05 2024-09-13T05:13:28.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:28.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245306+0000", 2024-09-13T05:13:28.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8227999999999997e-05 2024-09-13T05:13:28.011 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.011 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:28.011 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.011 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173452 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 193536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:28.012 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:13:28.012 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.771478590000001, 2024-09-13T05:13:28.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065505701, 2024-09-13T05:13:28.012 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:28.012 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:28.012 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:28.012 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:28.012 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:28.012 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173452 2024-09-13T05:13:28.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.012 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:28.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:28.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:13:28.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:28.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:28.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:13:28.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:28.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:28.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:13:28.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:28.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:28.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179965+0000", 2024-09-13T05:13:28.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.402e-06 2024-09-13T05:13:28.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:28.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179970+0000", 2024-09-13T05:13:28.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2290000000000002e-06 2024-09-13T05:13:28.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:28.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179974+0000", 2024-09-13T05:13:28.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5070000000000002e-06 2024-09-13T05:13:28.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:28.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245329+0000", 2024-09-13T05:13:28.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065354906000000004 2024-09-13T05:13:28.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:28.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245390+0000", 2024-09-13T05:13:28.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0878999999999998e-05 2024-09-13T05:13:28.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:28.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245468+0000", 2024-09-13T05:13:28.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8073999999999998e-05 2024-09-13T05:13:28.015 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.016 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:28.016 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.016 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173453 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 198656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:28.016 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:13:28.016 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.771462323999998, 2024-09-13T05:13:28.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065664343, 2024-09-13T05:13:28.016 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:28.016 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:28.016 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:28.016 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:28.016 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:28.017 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173453 2024-09-13T05:13:28.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.017 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:28.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:28.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:13:28.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:28.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:28.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:13:28.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:28.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:28.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179978+0000", 2024-09-13T05:13:28.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:28.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:28.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179981+0000", 2024-09-13T05:13:28.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4140000000000001e-06 2024-09-13T05:13:28.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:28.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179986+0000", 2024-09-13T05:13:28.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3519999999999997e-06 2024-09-13T05:13:28.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:28.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179991+0000", 2024-09-13T05:13:28.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6739999999999996e-06 2024-09-13T05:13:28.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:28.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245495+0000", 2024-09-13T05:13:28.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065504229999999997 2024-09-13T05:13:28.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:28.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245563+0000", 2024-09-13T05:13:28.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8119000000000003e-05 2024-09-13T05:13:28.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:28.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245643+0000", 2024-09-13T05:13:28.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9861e-05 2024-09-13T05:13:28.020 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.020 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:28.020 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.020 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173454 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:28.020 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:13:28.020 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.771413936999998, 2024-09-13T05:13:28.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065750457999999998, 2024-09-13T05:13:28.021 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:28.021 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:28.021 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:28.021 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:28.021 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:28.021 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173454 2024-09-13T05:13:28.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.021 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:28.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:28.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:13:28.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:28.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:28.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:13:28.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:28.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:28.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180026+0000", 2024-09-13T05:13:28.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:28.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:28.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180030+0000", 2024-09-13T05:13:28.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3790000000000002e-06 2024-09-13T05:13:28.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:28.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180036+0000", 2024-09-13T05:13:28.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5889999999999999e-06 2024-09-13T05:13:28.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:28.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180041+0000", 2024-09-13T05:13:28.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9980000000000003e-06 2024-09-13T05:13:28.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:28.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245667+0000", 2024-09-13T05:13:28.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065625124000000007 2024-09-13T05:13:28.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:28.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245705+0000", 2024-09-13T05:13:28.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7994000000000002e-05 2024-09-13T05:13:28.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:28.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245778+0000", 2024-09-13T05:13:28.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2999999999999999e-05 2024-09-13T05:13:28.024 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.024 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:28.025 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.025 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173455 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 212992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:28.025 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:13:28.025 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.771395228999999, 2024-09-13T05:13:28.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065899773999999994, 2024-09-13T05:13:28.025 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:28.025 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:28.025 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:28.025 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:28.025 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:28.025 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173455 2024-09-13T05:13:28.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.026 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:28.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:28.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:13:28.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:28.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:28.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:13:28.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:28.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:28.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180045+0000", 2024-09-13T05:13:28.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:28.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:28.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180048+0000", 2024-09-13T05:13:28.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5830000000000001e-06 2024-09-13T05:13:28.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:28.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180054+0000", 2024-09-13T05:13:28.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.789e-06 2024-09-13T05:13:28.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:28.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180059+0000", 2024-09-13T05:13:28.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.933e-06 2024-09-13T05:13:28.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:28.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245801+0000", 2024-09-13T05:13:28.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065742520999999998 2024-09-13T05:13:28.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:28.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245865+0000", 2024-09-13T05:13:28.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3325999999999996e-05 2024-09-13T05:13:28.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:28.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245946+0000", 2024-09-13T05:13:28.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0964999999999995e-05 2024-09-13T05:13:28.029 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.029 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:28.029 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.029 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173456 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:28.029 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:13:28.029 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.771377997999998, 2024-09-13T05:13:28.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066035128999999998, 2024-09-13T05:13:28.029 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:28.030 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:28.030 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:28.030 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:28.030 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:28.030 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173456 2024-09-13T05:13:28.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.030 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:28.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:28.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:13:28.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:28.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:28.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:13:28.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:28.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:28.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:13:28.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:28.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:28.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180065+0000", 2024-09-13T05:13:28.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4250000000000001e-06 2024-09-13T05:13:28.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:28.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180070+0000", 2024-09-13T05:13:28.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1749999999999996e-06 2024-09-13T05:13:28.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:28.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180075+0000", 2024-09-13T05:13:28.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4769999999999997e-06 2024-09-13T05:13:28.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:28.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245969+0000", 2024-09-13T05:13:28.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065894182999999995 2024-09-13T05:13:28.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:28.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246027+0000", 2024-09-13T05:13:28.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8165999999999998e-05 2024-09-13T05:13:28.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:28.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246098+0000", 2024-09-13T05:13:28.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1068999999999993e-05 2024-09-13T05:13:28.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.033 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:28.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.033 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173458 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:28.034 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:13:28.034 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.771362015000001, 2024-09-13T05:13:28.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066134732000000002, 2024-09-13T05:13:28.034 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:28.034 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:28.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:28.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:28.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:28.034 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173458 2024-09-13T05:13:28.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.034 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:28.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:28.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:13:28.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:28.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:28.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:13:28.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:28.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:28.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:13:28.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:28.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:28.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180081+0000", 2024-09-13T05:13:28.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4150000000000002e-06 2024-09-13T05:13:28.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:28.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180087+0000", 2024-09-13T05:13:28.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5389999999999998e-06 2024-09-13T05:13:28.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:28.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180101+0000", 2024-09-13T05:13:28.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4537e-05 2024-09-13T05:13:28.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:28.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246119+0000", 2024-09-13T05:13:28.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066017701999999998 2024-09-13T05:13:28.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:28.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246155+0000", 2024-09-13T05:13:28.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6094999999999999e-05 2024-09-13T05:13:28.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:28.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246214+0000", 2024-09-13T05:13:28.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8789000000000002e-05 2024-09-13T05:13:28.038 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.038 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:28.038 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.038 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173459 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 234496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:28.038 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:13:28.038 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.771334492000001, 2024-09-13T05:13:28.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066227460000000002, 2024-09-13T05:13:28.038 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:28.038 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:28.038 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:28.038 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:28.039 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:28.039 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173459 2024-09-13T05:13:28.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.039 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:28.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:28.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:13:28.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:28.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:28.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:13:28.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:28.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:28.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180106+0000", 2024-09-13T05:13:28.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:28.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:28.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180109+0000", 2024-09-13T05:13:28.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2219999999999998e-06 2024-09-13T05:13:28.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:28.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180115+0000", 2024-09-13T05:13:28.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9190000000000004e-06 2024-09-13T05:13:28.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:28.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180120+0000", 2024-09-13T05:13:28.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8930000000000004e-06 2024-09-13T05:13:28.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:28.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246236+0000", 2024-09-13T05:13:28.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066115638000000004 2024-09-13T05:13:28.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:28.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246273+0000", 2024-09-13T05:13:28.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7083999999999999e-05 2024-09-13T05:13:28.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:28.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246334+0000", 2024-09-13T05:13:28.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1183e-05 2024-09-13T05:13:28.042 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.042 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:28.042 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.042 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173460 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 241664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:28.042 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:13:28.042 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.771316685999999, 2024-09-13T05:13:28.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066360459999999996, 2024-09-13T05:13:28.043 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:28.043 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:28.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:28.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:28.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:28.043 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173460 2024-09-13T05:13:28.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.043 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:28.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:28.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:13:28.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:28.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:28.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:13:28.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:28.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:28.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:13:28.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:28.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:28.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180126+0000", 2024-09-13T05:13:28.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3120000000000001e-06 2024-09-13T05:13:28.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:28.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180132+0000", 2024-09-13T05:13:28.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.105e-06 2024-09-13T05:13:28.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:28.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180137+0000", 2024-09-13T05:13:28.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6829999999999999e-06 2024-09-13T05:13:28.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:28.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246365+0000", 2024-09-13T05:13:28.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066227584000000006 2024-09-13T05:13:28.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:28.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246413+0000", 2024-09-13T05:13:28.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8479000000000001e-05 2024-09-13T05:13:28.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:28.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246485+0000", 2024-09-13T05:13:28.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1600000000000006e-05 2024-09-13T05:13:28.046 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.046 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:28.046 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.047 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173461 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:28.047 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:13:28.047 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.771297916999998, 2024-09-13T05:13:28.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066492449999999995, 2024-09-13T05:13:28.047 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:28.047 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:28.047 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:28.047 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:28.047 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:28.047 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173461 2024-09-13T05:13:28.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.047 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:28.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:28.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:13:28.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:28.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:28.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:13:28.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:28.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:28.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:13:28.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:28.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:28.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180149+0000", 2024-09-13T05:13:28.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7239999999999997e-06 2024-09-13T05:13:28.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:28.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180153+0000", 2024-09-13T05:13:28.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7859999999999996e-06 2024-09-13T05:13:28.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:28.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180158+0000", 2024-09-13T05:13:28.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0300000000000001e-06 2024-09-13T05:13:28.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:28.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246508+0000", 2024-09-13T05:13:28.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066350100999999995 2024-09-13T05:13:28.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:28.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246568+0000", 2024-09-13T05:13:28.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9500000000000003e-05 2024-09-13T05:13:28.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:28.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246636+0000", 2024-09-13T05:13:28.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7633999999999997e-05 2024-09-13T05:13:28.051 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.051 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:28.051 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.051 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173462 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 256000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:28.051 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:13:28.051 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.770465088999998, 2024-09-13T05:13:28.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065773376999999994, 2024-09-13T05:13:28.051 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:28.051 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:28.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:28.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:28.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:28.052 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173462 2024-09-13T05:13:28.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.052 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:28.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:28.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:13:28.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:28.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:28.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:13:28.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:28.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:28.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180162+0000", 2024-09-13T05:13:28.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9991865 2024-09-13T05:13:28.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:28.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180984+0000", 2024-09-13T05:13:28.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00082184599999999999 2024-09-13T05:13:28.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:28.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180994+0000", 2024-09-13T05:13:28.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9000000000000001e-06 2024-09-13T05:13:28.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:28.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.181001+0000", 2024-09-13T05:13:28.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.917e-06 2024-09-13T05:13:28.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:28.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246653+0000", 2024-09-13T05:13:28.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065651820999999999 2024-09-13T05:13:28.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:28.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246698+0000", 2024-09-13T05:13:28.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.473e-05 2024-09-13T05:13:28.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:28.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:28.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:28.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246749+0000", 2024-09-13T05:13:28.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1758999999999997e-05 2024-09-13T05:13:28.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.055 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:28.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:28.055 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:28.055 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:28.057 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:13:28.058 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:13:28.058 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:13:28.058 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:13:28.058 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:13:28.059 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:28.051+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:28.061 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:13:28.089 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:13:28.126 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:13:28.158 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:28.155+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:28.162 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:13:28.165 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:13:28.165 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:13:28.165 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:13:28.165 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:13:28.165 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:13:28.165 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:13:28.165 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:13:28.165 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:13:28.189 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:28.189 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:28.199 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:13:28.259 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:28.255+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:28.347 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:28.347 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:28.356 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:13:28.359 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:28.354+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:28.460 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:28.455+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:28.466 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:28.466 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:28.476 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:13:28.561 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:28.558+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:28.580 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:28.581 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:28.590 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:13:28.662 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:28.658+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:28.697 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:28.697 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:28.707 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:13:28.762 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:28.758+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:28.820 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:28.821 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:28.830 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:13:28.873 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:28.870+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:28.948 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:28.948 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:28.959 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:13:28.965 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:28.958+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:29.066 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:29.059+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:29.071 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:29.071 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:29.081 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:13:29.167 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:29.162+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:29.198 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:29.198 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:29.209 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:13:29.267 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:29.263+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:29.319 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:29.319 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:29.329 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:13:29.369 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:29.366+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:29.440 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:29.441 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:29.451 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:13:29.470 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:29.466+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:29.553 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:29.553 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:29.562 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:13:29.571 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:29.567+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:29.665 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:29.665 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:29.672 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:29.666+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:29.675 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:13:29.696 INFO:tasks.thrashosds.thrasher:in_osds: [2, 3, 5, 7, 1, 4, 6] out_osds: [0] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-13T05:13:29.697 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:13:29.697 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-13T05:13:29.697 INFO:tasks.thrashosds.thrasher:Setting osd 5 primary_affinity to 1.000000 2024-09-13T05:13:29.697 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-13T05:13:29.739 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T05:13:29.773 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:29.767+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:29.843 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:29.844 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:29.854 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:13:29.904 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:29.899+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:29.975 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:29.971+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:30.012 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:30.013 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:30.023 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:13:30.076 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:30.071+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:30.124 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:30.124 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:30.133 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:13:30.177 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:30.174+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:30.182 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:13:30.278 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:30.275+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:30.287 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:30.287 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:30.298 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:13:30.329 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:13:30.350 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:13:30.371 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:13:30.380 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:30.375+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:30.394 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:13:30.404 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:30.404 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:30.413 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:13:30.416 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:13:30.441 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:13:30.477 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:13:30.480 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:30.474+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:30.512 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:13:30.515 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:13:30.515 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:13:30.515 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:13:30.515 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:13:30.515 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:13:30.516 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:13:30.516 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:13:30.516 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:13:30.546 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:13:30.546 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:30.556 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:13:30.601 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:30.598+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:30.661 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:13:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:13:30.661 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:30.671 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:13:30.682 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:30.679+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:30.753 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is unset 2024-09-13T05:13:30.757 INFO:teuthology.orchestra.run.smithi120.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-13T05:13:30.783 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:30.778+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:30.783 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:30.783 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:13:30.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:13:30.783 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [] 2024-09-13T05:13:30.784 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:30.793 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:13:30.885 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:30.879+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:30.892 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:30.893 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:30.893 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:13:30.893 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:30.902 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:13:30.985 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:30.982+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:31.005 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:13:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:13:31.006 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:31.015 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:13:31.086 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:31.083+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:31.121 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:31.121 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:13:31.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:13:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:13:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4397.0:159451 3.1b e117/116 3:d9c87acb:::rbd_data.112dc3abcba6.0000000000000003:head v 117'567, mlcod=0'0)", 2024-09-13T05:13:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:13:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 84.179520811000003, 2024-09-13T05:13:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064897325000000006, 2024-09-13T05:13:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:13:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938208+0000", 2024-09-13T05:13:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.938207+0000", 2024-09-13T05:13:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:13:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972794+0000", 2024-09-13T05:13:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.034587013 2024-09-13T05:13:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972821+0000", 2024-09-13T05:13:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6764e-05 2024-09-13T05:13:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972841+0000", 2024-09-13T05:13:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0191999999999999e-05 2024-09-13T05:13:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972905+0000", 2024-09-13T05:13:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4319000000000005e-05 2024-09-13T05:13:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:06.972927+0000", 2024-09-13T05:13:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1135999999999999e-05 2024-09-13T05:13:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:13:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.002964+0000", 2024-09-13T05:13:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.030037123999999998 2024-09-13T05:13:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.003105+0000", 2024-09-13T05:13:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141614 2024-09-13T05:13:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159495 3.0 3:022f4da1:::rbd_data.112dfd94ee88.00000000000000e4:2a [read 167936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:13:31.127 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 84.10438139, 2024-09-13T05:13:31.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91926946899999995, 2024-09-13T05:13:31.127 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.127 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.127 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.127 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.127 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.127 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159495 2024-09-13T05:13:31.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.127 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:13:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013347+0000", 2024-09-13T05:13:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013345+0000", 2024-09-13T05:13:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999971 2024-09-13T05:13:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013359+0000", 2024-09-13T05:13:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4752999999999999e-05 2024-09-13T05:13:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013418+0000", 2024-09-13T05:13:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8959000000000003e-05 2024-09-13T05:13:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013439+0000", 2024-09-13T05:13:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0749000000000001e-05 2024-09-13T05:13:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013563+0000", 2024-09-13T05:13:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012349400000000001 2024-09-13T05:13:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013583+0000", 2024-09-13T05:13:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0007e-05 2024-09-13T05:13:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932400+0000", 2024-09-13T05:13:31.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91881732400000005 2024-09-13T05:13:31.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932533+0000", 2024-09-13T05:13:31.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013263700000000001 2024-09-13T05:13:31.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932617+0000", 2024-09-13T05:13:31.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4313000000000004e-05 2024-09-13T05:13:31.132 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.132 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.132 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.132 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159517 3.0 3:03975f1c:::rbd_data.112dfd94ee88.0000000000000156:2a [read 167936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:31.133 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:13:31.133 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 84.104117676000001, 2024-09-13T05:13:31.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91962025700000005, 2024-09-13T05:13:31.133 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.133 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.133 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.133 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.133 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.133 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159517 2024-09-13T05:13:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:13:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013611+0000", 2024-09-13T05:13:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013609+0000", 2024-09-13T05:13:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013619+0000", 2024-09-13T05:13:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0077e-05 2024-09-13T05:13:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013638+0000", 2024-09-13T05:13:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8739000000000001e-05 2024-09-13T05:13:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.013653+0000", 2024-09-13T05:13:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5446000000000001e-05 2024-09-13T05:13:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016506+0000", 2024-09-13T05:13:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028525619999999999 2024-09-13T05:13:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:31.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016521+0000", 2024-09-13T05:13:31.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5310000000000001e-05 2024-09-13T05:13:31.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.932964+0000", 2024-09-13T05:13:31.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91644284099999995 2024-09-13T05:13:31.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933097+0000", 2024-09-13T05:13:31.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013337599999999999 2024-09-13T05:13:31.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933231+0000", 2024-09-13T05:13:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133996 2024-09-13T05:13:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:159622 3.0 3:03f7a45a:::rbd_data.112dfd94ee88.0000000000000318:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:13:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 84.102455864999996, 2024-09-13T05:13:31.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.918245003, 2024-09-13T05:13:31.140 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.140 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.141 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.141 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.141 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.141 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 159622 2024-09-13T05:13:31.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.141 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:13:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015273+0000", 2024-09-13T05:13:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015266+0000", 2024-09-13T05:13:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999928 2024-09-13T05:13:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015283+0000", 2024-09-13T05:13:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7309999999999999e-05 2024-09-13T05:13:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015318+0000", 2024-09-13T05:13:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5119e-05 2024-09-13T05:13:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.015338+0000", 2024-09-13T05:13:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9259e-05 2024-09-13T05:13:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016558+0000", 2024-09-13T05:13:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012199909999999999 2024-09-13T05:13:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.016567+0000", 2024-09-13T05:13:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2459999999999992e-06 2024-09-13T05:13:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933266+0000", 2024-09-13T05:13:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.91669950300000003 2024-09-13T05:13:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:13:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015788099999999999 2024-09-13T05:13:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:07.933518+0000", 2024-09-13T05:13:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3721000000000006e-05 2024-09-13T05:13:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173445 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 150528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:13:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.937879080000002, 2024-09-13T05:13:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064560905000000002, 2024-09-13T05:13:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173445 2024-09-13T05:13:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:13:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179850+0000", 2024-09-13T05:13:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179849+0000", 2024-09-13T05:13:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179860+0000", 2024-09-13T05:13:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0419e-05 2024-09-13T05:13:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179866+0000", 2024-09-13T05:13:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.567e-06 2024-09-13T05:13:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179872+0000", 2024-09-13T05:13:31.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1830000000000002e-06 2024-09-13T05:13:31.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244262+0000", 2024-09-13T05:13:31.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064390814000000005 2024-09-13T05:13:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244321+0000", 2024-09-13T05:13:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8341000000000003e-05 2024-09-13T05:13:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244411+0000", 2024-09-13T05:13:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9911e-05 2024-09-13T05:13:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173446 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 157696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:13:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.937852312999993, 2024-09-13T05:13:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064714007000000004, 2024-09-13T05:13:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173446 2024-09-13T05:13:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:13:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179877+0000", 2024-09-13T05:13:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179876+0000", 2024-09-13T05:13:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179879+0000", 2024-09-13T05:13:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1489999999999998e-06 2024-09-13T05:13:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179884+0000", 2024-09-13T05:13:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2800000000000003e-06 2024-09-13T05:13:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179889+0000", 2024-09-13T05:13:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7620000000000003e-06 2024-09-13T05:13:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244452+0000", 2024-09-13T05:13:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064562943999999997 2024-09-13T05:13:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244512+0000", 2024-09-13T05:13:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9879e-05 2024-09-13T05:13:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244591+0000", 2024-09-13T05:13:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8701000000000004e-05 2024-09-13T05:13:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173447 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 164864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:13:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.937835565, 2024-09-13T05:13:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064866246000000002, 2024-09-13T05:13:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173447 2024-09-13T05:13:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:13:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:13:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179893+0000", 2024-09-13T05:13:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179895+0000", 2024-09-13T05:13:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6910000000000002e-06 2024-09-13T05:13:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179901+0000", 2024-09-13T05:13:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5149999999999997e-06 2024-09-13T05:13:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179905+0000", 2024-09-13T05:13:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4170000000000002e-06 2024-09-13T05:13:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244615+0000", 2024-09-13T05:13:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064709533999999999 2024-09-13T05:13:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244665+0000", 2024-09-13T05:13:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0283e-05 2024-09-13T05:13:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244760+0000", 2024-09-13T05:13:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4310999999999999e-05 2024-09-13T05:13:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173448 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 172032~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:13:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.937819719000004, 2024-09-13T05:13:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065022046999999999, 2024-09-13T05:13:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173448 2024-09-13T05:13:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:13:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:13:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179909+0000", 2024-09-13T05:13:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179914+0000", 2024-09-13T05:13:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6699999999999999e-06 2024-09-13T05:13:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179921+0000", 2024-09-13T05:13:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:13:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179926+0000", 2024-09-13T05:13:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8659999999999997e-06 2024-09-13T05:13:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244782+0000", 2024-09-13T05:13:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.064856570000000002 2024-09-13T05:13:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244857+0000", 2024-09-13T05:13:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4326999999999995e-05 2024-09-13T05:13:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244931+0000", 2024-09-13T05:13:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4443999999999994e-05 2024-09-13T05:13:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173450 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 179200~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:13:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.937798885000007, 2024-09-13T05:13:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065192589999999995, 2024-09-13T05:13:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173450 2024-09-13T05:13:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:13:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:13:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179930+0000", 2024-09-13T05:13:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179932+0000", 2024-09-13T05:13:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2529999999999999e-06 2024-09-13T05:13:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179937+0000", 2024-09-13T05:13:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4219999999999999e-06 2024-09-13T05:13:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179942+0000", 2024-09-13T05:13:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3250000000000001e-06 2024-09-13T05:13:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.244969+0000", 2024-09-13T05:13:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065027794999999999 2024-09-13T05:13:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245048+0000", 2024-09-13T05:13:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8812000000000004e-05 2024-09-13T05:13:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245123+0000", 2024-09-13T05:13:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4342000000000001e-05 2024-09-13T05:13:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173451 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 186368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:13:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.937782897999995, 2024-09-13T05:13:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065359814000000002, 2024-09-13T05:13:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173451 2024-09-13T05:13:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:13:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:13:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179946+0000", 2024-09-13T05:13:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179948+0000", 2024-09-13T05:13:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5119999999999998e-06 2024-09-13T05:13:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179954+0000", 2024-09-13T05:13:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5840000000000002e-06 2024-09-13T05:13:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179958+0000", 2024-09-13T05:13:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.566e-06 2024-09-13T05:13:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245160+0000", 2024-09-13T05:13:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065202057999999993 2024-09-13T05:13:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245228+0000", 2024-09-13T05:13:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7257999999999999e-05 2024-09-13T05:13:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245306+0000", 2024-09-13T05:13:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8227999999999997e-05 2024-09-13T05:13:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173452 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 193536~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:13:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.937766410999998, 2024-09-13T05:13:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065505701, 2024-09-13T05:13:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173452 2024-09-13T05:13:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:13:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:13:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179962+0000", 2024-09-13T05:13:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179965+0000", 2024-09-13T05:13:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.402e-06 2024-09-13T05:13:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179970+0000", 2024-09-13T05:13:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2290000000000002e-06 2024-09-13T05:13:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179974+0000", 2024-09-13T05:13:31.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5070000000000002e-06 2024-09-13T05:13:31.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245329+0000", 2024-09-13T05:13:31.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065354906000000004 2024-09-13T05:13:31.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245390+0000", 2024-09-13T05:13:31.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0878999999999998e-05 2024-09-13T05:13:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245468+0000", 2024-09-13T05:13:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8073999999999998e-05 2024-09-13T05:13:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173453 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 198656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:13:31.180 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.937750144999995, 2024-09-13T05:13:31.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065664343, 2024-09-13T05:13:31.180 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.180 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.180 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.180 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.180 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.180 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173453 2024-09-13T05:13:31.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:13:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179979+0000", 2024-09-13T05:13:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179978+0000", 2024-09-13T05:13:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179981+0000", 2024-09-13T05:13:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4140000000000001e-06 2024-09-13T05:13:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179986+0000", 2024-09-13T05:13:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3519999999999997e-06 2024-09-13T05:13:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.179991+0000", 2024-09-13T05:13:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6739999999999996e-06 2024-09-13T05:13:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245495+0000", 2024-09-13T05:13:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065504229999999997 2024-09-13T05:13:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245563+0000", 2024-09-13T05:13:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8119000000000003e-05 2024-09-13T05:13:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245643+0000", 2024-09-13T05:13:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9861e-05 2024-09-13T05:13:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173454 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 205824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:13:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.937701758000003, 2024-09-13T05:13:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065750457999999998, 2024-09-13T05:13:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173454 2024-09-13T05:13:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:13:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180027+0000", 2024-09-13T05:13:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180026+0000", 2024-09-13T05:13:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180030+0000", 2024-09-13T05:13:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3790000000000002e-06 2024-09-13T05:13:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180036+0000", 2024-09-13T05:13:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5889999999999999e-06 2024-09-13T05:13:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180041+0000", 2024-09-13T05:13:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9980000000000003e-06 2024-09-13T05:13:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245667+0000", 2024-09-13T05:13:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065625124000000007 2024-09-13T05:13:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245705+0000", 2024-09-13T05:13:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7994000000000002e-05 2024-09-13T05:13:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245778+0000", 2024-09-13T05:13:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2999999999999999e-05 2024-09-13T05:13:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173455 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 212992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:13:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.937683050000004, 2024-09-13T05:13:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065899773999999994, 2024-09-13T05:13:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173455 2024-09-13T05:13:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:13:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180046+0000", 2024-09-13T05:13:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180045+0000", 2024-09-13T05:13:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180048+0000", 2024-09-13T05:13:31.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5830000000000001e-06 2024-09-13T05:13:31.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180054+0000", 2024-09-13T05:13:31.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.789e-06 2024-09-13T05:13:31.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180059+0000", 2024-09-13T05:13:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.933e-06 2024-09-13T05:13:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245801+0000", 2024-09-13T05:13:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065742520999999998 2024-09-13T05:13:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245865+0000", 2024-09-13T05:13:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3325999999999996e-05 2024-09-13T05:13:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245946+0000", 2024-09-13T05:13:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0964999999999995e-05 2024-09-13T05:13:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173456 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 220160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:13:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.937665819000003, 2024-09-13T05:13:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066035128999999998, 2024-09-13T05:13:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173456 2024-09-13T05:13:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:13:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:13:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180063+0000", 2024-09-13T05:13:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180065+0000", 2024-09-13T05:13:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4250000000000001e-06 2024-09-13T05:13:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180070+0000", 2024-09-13T05:13:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1749999999999996e-06 2024-09-13T05:13:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180075+0000", 2024-09-13T05:13:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4769999999999997e-06 2024-09-13T05:13:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.245969+0000", 2024-09-13T05:13:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065894182999999995 2024-09-13T05:13:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246027+0000", 2024-09-13T05:13:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8165999999999998e-05 2024-09-13T05:13:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246098+0000", 2024-09-13T05:13:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1068999999999993e-05 2024-09-13T05:13:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173458 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 227328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:13:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.937649836000006, 2024-09-13T05:13:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066134732000000002, 2024-09-13T05:13:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173458 2024-09-13T05:13:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:13:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:13:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180079+0000", 2024-09-13T05:13:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180081+0000", 2024-09-13T05:13:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4150000000000002e-06 2024-09-13T05:13:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180087+0000", 2024-09-13T05:13:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5389999999999998e-06 2024-09-13T05:13:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180101+0000", 2024-09-13T05:13:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4537e-05 2024-09-13T05:13:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246119+0000", 2024-09-13T05:13:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066017701999999998 2024-09-13T05:13:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246155+0000", 2024-09-13T05:13:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6094999999999999e-05 2024-09-13T05:13:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246214+0000", 2024-09-13T05:13:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8789000000000002e-05 2024-09-13T05:13:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173459 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 234496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:13:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.937622313000006, 2024-09-13T05:13:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066227460000000002, 2024-09-13T05:13:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173459 2024-09-13T05:13:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:13:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180107+0000", 2024-09-13T05:13:31.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180106+0000", 2024-09-13T05:13:31.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:31.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180109+0000", 2024-09-13T05:13:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2219999999999998e-06 2024-09-13T05:13:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180115+0000", 2024-09-13T05:13:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9190000000000004e-06 2024-09-13T05:13:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180120+0000", 2024-09-13T05:13:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8930000000000004e-06 2024-09-13T05:13:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246236+0000", 2024-09-13T05:13:31.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066115638000000004 2024-09-13T05:13:31.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246273+0000", 2024-09-13T05:13:31.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7083999999999999e-05 2024-09-13T05:13:31.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246334+0000", 2024-09-13T05:13:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1183e-05 2024-09-13T05:13:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173460 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 241664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:13:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.937604507000003, 2024-09-13T05:13:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066360459999999996, 2024-09-13T05:13:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.208 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.208 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.208 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.208 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173460 2024-09-13T05:13:31.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.208 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:13:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:13:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180124+0000", 2024-09-13T05:13:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:31.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180126+0000", 2024-09-13T05:13:31.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3120000000000001e-06 2024-09-13T05:13:31.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180132+0000", 2024-09-13T05:13:31.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.105e-06 2024-09-13T05:13:31.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180137+0000", 2024-09-13T05:13:31.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6829999999999999e-06 2024-09-13T05:13:31.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246365+0000", 2024-09-13T05:13:31.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066227584000000006 2024-09-13T05:13:31.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246413+0000", 2024-09-13T05:13:31.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8479000000000001e-05 2024-09-13T05:13:31.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246485+0000", 2024-09-13T05:13:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1600000000000006e-05 2024-09-13T05:13:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173461 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 248832~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:13:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.937585737999996, 2024-09-13T05:13:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066492449999999995, 2024-09-13T05:13:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173461 2024-09-13T05:13:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:13:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:13:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180143+0000", 2024-09-13T05:13:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180149+0000", 2024-09-13T05:13:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7239999999999997e-06 2024-09-13T05:13:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180153+0000", 2024-09-13T05:13:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7859999999999996e-06 2024-09-13T05:13:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180158+0000", 2024-09-13T05:13:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0300000000000001e-06 2024-09-13T05:13:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246508+0000", 2024-09-13T05:13:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.066350100999999995 2024-09-13T05:13:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246568+0000", 2024-09-13T05:13:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9500000000000003e-05 2024-09-13T05:13:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246636+0000", 2024-09-13T05:13:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7633999999999997e-05 2024-09-13T05:13:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173462 3.1a 3:590a36f2:::rbd_data.112d7c1bedf7.000000000000003c:29 [read 256000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:13:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.936752909999996, 2024-09-13T05:13:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065773376999999994, 2024-09-13T05:13:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173462 2024-09-13T05:13:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:13:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180976+0000", 2024-09-13T05:13:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180162+0000", 2024-09-13T05:13:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9991865 2024-09-13T05:13:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180984+0000", 2024-09-13T05:13:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00082184599999999999 2024-09-13T05:13:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.180994+0000", 2024-09-13T05:13:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9000000000000001e-06 2024-09-13T05:13:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.181001+0000", 2024-09-13T05:13:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.917e-06 2024-09-13T05:13:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246653+0000", 2024-09-13T05:13:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.065651820999999999 2024-09-13T05:13:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246698+0000", 2024-09-13T05:13:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.473e-05 2024-09-13T05:13:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.246749+0000", 2024-09-13T05:13:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1758999999999997e-05 2024-09-13T05:13:31.222 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.222 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.222 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.222 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.222 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.222 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:31.224 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:13:31.224 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:31.218+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:31.325 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:31.318+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:31.336 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:13:31.336 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:31.346 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:13:31.426 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:31.423+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:31.449 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:13:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:13:31.454 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:31.459 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:13:31.527 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:31.522+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:31.567 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:13:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:13:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:13:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136560 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3908608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:13:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 98.469754631000001, 2024-09-13T05:13:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056148103999999997, 2024-09-13T05:13:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136560 2024-09-13T05:13:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:13:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:13:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095289+0000", 2024-09-13T05:13:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095292+0000", 2024-09-13T05:13:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.802e-06 2024-09-13T05:13:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095318+0000", 2024-09-13T05:13:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5987999999999999e-05 2024-09-13T05:13:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095323+0000", 2024-09-13T05:13:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.006e-06 2024-09-13T05:13:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151316+0000", 2024-09-13T05:13:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055992593 2024-09-13T05:13:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151371+0000", 2024-09-13T05:13:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5532999999999998e-05 2024-09-13T05:13:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151438+0000", 2024-09-13T05:13:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6557999999999995e-05 2024-09-13T05:13:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136562 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3922944~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:13:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 98.469717513000006, 2024-09-13T05:13:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056259690000000001, 2024-09-13T05:13:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136562 2024-09-13T05:13:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:13:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:13:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:13:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095329+0000", 2024-09-13T05:13:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3089999999999998e-06 2024-09-13T05:13:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095333+0000", 2024-09-13T05:13:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6239999999999999e-06 2024-09-13T05:13:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095335+0000", 2024-09-13T05:13:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5660000000000001e-06 2024-09-13T05:13:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151468+0000", 2024-09-13T05:13:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056132608000000001 2024-09-13T05:13:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151519+0000", 2024-09-13T05:13:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1681000000000002e-05 2024-09-13T05:13:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151587+0000", 2024-09-13T05:13:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7200999999999996e-05 2024-09-13T05:13:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136563 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3937280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:13:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 98.469706091000006, 2024-09-13T05:13:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056393051999999999, 2024-09-13T05:13:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136563 2024-09-13T05:13:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:13:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:13:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:13:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:13:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095340+0000", 2024-09-13T05:13:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.561e-06 2024-09-13T05:13:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095342+0000", 2024-09-13T05:13:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8059999999999999e-06 2024-09-13T05:13:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095345+0000", 2024-09-13T05:13:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:13:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151621+0000", 2024-09-13T05:13:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056275602000000001 2024-09-13T05:13:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151670+0000", 2024-09-13T05:13:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9478000000000003e-05 2024-09-13T05:13:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151731+0000", 2024-09-13T05:13:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1054000000000002e-05 2024-09-13T05:13:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136565 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3951616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:13:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 98.469695776999998, 2024-09-13T05:13:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056524090999999999, 2024-09-13T05:13:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136565 2024-09-13T05:13:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:13:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:13:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095348+0000", 2024-09-13T05:13:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:13:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095350+0000", 2024-09-13T05:13:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4479999999999999e-06 2024-09-13T05:13:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095353+0000", 2024-09-13T05:13:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.909e-06 2024-09-13T05:13:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095356+0000", 2024-09-13T05:13:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:13:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151763+0000", 2024-09-13T05:13:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056407813000000001 2024-09-13T05:13:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151812+0000", 2024-09-13T05:13:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8306999999999997e-05 2024-09-13T05:13:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151873+0000", 2024-09-13T05:13:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1064999999999999e-05 2024-09-13T05:13:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136567 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3965952~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:13:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 98.469686752000001, 2024-09-13T05:13:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056653907000000003, 2024-09-13T05:13:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136567 2024-09-13T05:13:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:13:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:13:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095357+0000", 2024-09-13T05:13:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095359+0000", 2024-09-13T05:13:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:13:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095362+0000", 2024-09-13T05:13:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7939999999999998e-06 2024-09-13T05:13:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095365+0000", 2024-09-13T05:13:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9979999999999999e-06 2024-09-13T05:13:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151904+0000", 2024-09-13T05:13:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056539308000000003 2024-09-13T05:13:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151953+0000", 2024-09-13T05:13:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8760000000000001e-05 2024-09-13T05:13:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152012+0000", 2024-09-13T05:13:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8761999999999997e-05 2024-09-13T05:13:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136569 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3980288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:13:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 98.469650998000006, 2024-09-13T05:13:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056771237000000002, 2024-09-13T05:13:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136569 2024-09-13T05:13:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:13:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:13:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:13:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095395+0000", 2024-09-13T05:13:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8870000000000001e-06 2024-09-13T05:13:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095402+0000", 2024-09-13T05:13:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6290000000000001e-06 2024-09-13T05:13:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095412+0000", 2024-09-13T05:13:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1730000000000001e-06 2024-09-13T05:13:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152044+0000", 2024-09-13T05:13:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056632016 2024-09-13T05:13:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152093+0000", 2024-09-13T05:13:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9570000000000001e-05 2024-09-13T05:13:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152165+0000", 2024-09-13T05:13:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1443e-05 2024-09-13T05:13:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136571 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3994624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:13:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 98.469629983000004, 2024-09-13T05:13:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056894741999999998, 2024-09-13T05:13:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136571 2024-09-13T05:13:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:13:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:13:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:13:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095418+0000", 2024-09-13T05:13:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0210000000000001e-06 2024-09-13T05:13:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095422+0000", 2024-09-13T05:13:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5310000000000002e-06 2024-09-13T05:13:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095425+0000", 2024-09-13T05:13:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8880000000000001e-06 2024-09-13T05:13:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152198+0000", 2024-09-13T05:13:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056773563999999999 2024-09-13T05:13:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152249+0000", 2024-09-13T05:13:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1168999999999997e-05 2024-09-13T05:13:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152309+0000", 2024-09-13T05:13:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9821999999999997e-05 2024-09-13T05:13:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136573 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4008960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:13:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 98.469617756000005, 2024-09-13T05:13:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057045810000000002, 2024-09-13T05:13:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136573 2024-09-13T05:13:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:13:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:13:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095426+0000", 2024-09-13T05:13:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095428+0000", 2024-09-13T05:13:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.593e-06 2024-09-13T05:13:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095431+0000", 2024-09-13T05:13:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9610000000000001e-06 2024-09-13T05:13:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095434+0000", 2024-09-13T05:13:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:13:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152352+0000", 2024-09-13T05:13:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05691881 2024-09-13T05:13:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152401+0000", 2024-09-13T05:13:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8995000000000001e-05 2024-09-13T05:13:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152472+0000", 2024-09-13T05:13:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1060000000000001e-05 2024-09-13T05:13:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136575 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4023296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:13:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 98.469187762999994, 2024-09-13T05:13:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056760069000000003, 2024-09-13T05:13:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136575 2024-09-13T05:13:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:13:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:13:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095437+0000", 2024-09-13T05:13:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9995799 2024-09-13T05:13:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095861+0000", 2024-09-13T05:13:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000424299 2024-09-13T05:13:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095869+0000", 2024-09-13T05:13:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5020000000000003e-06 2024-09-13T05:13:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095875+0000", 2024-09-13T05:13:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:13:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152502+0000", 2024-09-13T05:13:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056626528000000002 2024-09-13T05:13:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152556+0000", 2024-09-13T05:13:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4271000000000003e-05 2024-09-13T05:13:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152617+0000", 2024-09-13T05:13:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0896000000000001e-05 2024-09-13T05:13:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136577 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4037632~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:13:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 98.469086308000001, 2024-09-13T05:13:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056798242999999998, 2024-09-13T05:13:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136577 2024-09-13T05:13:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:13:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:13:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095882+0000", 2024-09-13T05:13:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999242 2024-09-13T05:13:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095961+0000", 2024-09-13T05:13:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8864999999999998e-05 2024-09-13T05:13:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095973+0000", 2024-09-13T05:13:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2206e-05 2024-09-13T05:13:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095978+0000", 2024-09-13T05:13:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0629999999999996e-06 2024-09-13T05:13:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152646+0000", 2024-09-13T05:13:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056668035999999998 2024-09-13T05:13:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152695+0000", 2024-09-13T05:13:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8634000000000002e-05 2024-09-13T05:13:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152756+0000", 2024-09-13T05:13:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1315000000000005e-05 2024-09-13T05:13:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136579 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4051968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:13:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 98.468758213000001, 2024-09-13T05:13:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056610869000000001, 2024-09-13T05:13:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136579 2024-09-13T05:13:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:13:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:13:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095989+0000", 2024-09-13T05:13:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997029 2024-09-13T05:13:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096291+0000", 2024-09-13T05:13:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030221499999999999 2024-09-13T05:13:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096300+0000", 2024-09-13T05:13:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4819999999999994e-06 2024-09-13T05:13:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096306+0000", 2024-09-13T05:13:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:13:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152788+0000", 2024-09-13T05:13:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056481625000000001 2024-09-13T05:13:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152837+0000", 2024-09-13T05:13:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9345000000000003e-05 2024-09-13T05:13:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152897+0000", 2024-09-13T05:13:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9892999999999997e-05 2024-09-13T05:13:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136581 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4066304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:13:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 98.468579386000002, 2024-09-13T05:13:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056597091000000002, 2024-09-13T05:13:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136581 2024-09-13T05:13:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:13:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:13:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096312+0000", 2024-09-13T05:13:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998465 2024-09-13T05:13:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096469+0000", 2024-09-13T05:13:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157109 2024-09-13T05:13:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096478+0000", 2024-09-13T05:13:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3260000000000002e-06 2024-09-13T05:13:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096482+0000", 2024-09-13T05:13:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9720000000000003e-06 2024-09-13T05:13:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152933+0000", 2024-09-13T05:13:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056451128000000003 2024-09-13T05:13:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152993+0000", 2024-09-13T05:13:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9947000000000001e-05 2024-09-13T05:13:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153062+0000", 2024-09-13T05:13:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9105999999999999e-05 2024-09-13T05:13:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136583 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4080640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:13:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 98.468313472999995, 2024-09-13T05:13:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056496609000000003, 2024-09-13T05:13:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136583 2024-09-13T05:13:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:13:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:13:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096485+0000", 2024-09-13T05:13:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997544 2024-09-13T05:13:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096735+0000", 2024-09-13T05:13:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024979899999999998 2024-09-13T05:13:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096742+0000", 2024-09-13T05:13:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7139999999999996e-06 2024-09-13T05:13:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096747+0000", 2024-09-13T05:13:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8709999999999996e-06 2024-09-13T05:13:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153099+0000", 2024-09-13T05:13:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056352639000000003 2024-09-13T05:13:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153168+0000", 2024-09-13T05:13:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9029000000000006e-05 2024-09-13T05:13:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153228+0000", 2024-09-13T05:13:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9339999999999998e-05 2024-09-13T05:13:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136585 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4094976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:13:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 98.468062005999997, 2024-09-13T05:13:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056396420000000003, 2024-09-13T05:13:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136585 2024-09-13T05:13:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:13:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:13:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096750+0000", 2024-09-13T05:13:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997673 2024-09-13T05:13:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096986+0000", 2024-09-13T05:13:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000236297 2024-09-13T05:13:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096993+0000", 2024-09-13T05:13:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9600000000000003e-06 2024-09-13T05:13:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096999+0000", 2024-09-13T05:13:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:13:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153264+0000", 2024-09-13T05:13:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056264728999999999 2024-09-13T05:13:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153318+0000", 2024-09-13T05:13:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3934000000000002e-05 2024-09-13T05:13:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153379+0000", 2024-09-13T05:13:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1206999999999999e-05 2024-09-13T05:13:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136586 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4109312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:13:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 98.467861204000002, 2024-09-13T05:13:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056374703999999998, 2024-09-13T05:13:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136586 2024-09-13T05:13:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:13:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:13:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097004+0000", 2024-09-13T05:13:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998207 2024-09-13T05:13:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097187+0000", 2024-09-13T05:13:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018337900000000001 2024-09-13T05:13:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097198+0000", 2024-09-13T05:13:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348e-05 2024-09-13T05:13:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097202+0000", 2024-09-13T05:13:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.121e-06 2024-09-13T05:13:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153411+0000", 2024-09-13T05:13:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056209510999999997 2024-09-13T05:13:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153464+0000", 2024-09-13T05:13:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2605000000000002e-05 2024-09-13T05:13:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153558+0000", 2024-09-13T05:13:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4017999999999993e-05 2024-09-13T05:13:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136588 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:13:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 98.467577020999997, 2024-09-13T05:13:31.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056274980000000002, 2024-09-13T05:13:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.664 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136588 2024-09-13T05:13:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:13:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:13:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097205+0000", 2024-09-13T05:13:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997377 2024-09-13T05:13:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097471+0000", 2024-09-13T05:13:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026628200000000001 2024-09-13T05:13:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097484+0000", 2024-09-13T05:13:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2493e-05 2024-09-13T05:13:31.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097488+0000", 2024-09-13T05:13:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9330000000000003e-06 2024-09-13T05:13:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153600+0000", 2024-09-13T05:13:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056112097 2024-09-13T05:13:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153654+0000", 2024-09-13T05:13:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4126000000000003e-05 2024-09-13T05:13:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153742+0000", 2024-09-13T05:13:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.831e-05 2024-09-13T05:13:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.669 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136589 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4137984~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:31.670 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:13:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 98.467437713999999, 2024-09-13T05:13:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056293867999999997, 2024-09-13T05:13:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136589 2024-09-13T05:13:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:13:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:13:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097491+0000", 2024-09-13T05:13:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998841 2024-09-13T05:13:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097610+0000", 2024-09-13T05:13:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119263 2024-09-13T05:13:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097617+0000", 2024-09-13T05:13:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6490000000000002e-06 2024-09-13T05:13:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097624+0000", 2024-09-13T05:13:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6309999999999997e-06 2024-09-13T05:13:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153779+0000", 2024-09-13T05:13:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056155153999999999 2024-09-13T05:13:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153831+0000", 2024-09-13T05:13:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2080000000000003e-05 2024-09-13T05:13:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153901+0000", 2024-09-13T05:13:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9765999999999996e-05 2024-09-13T05:13:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.677 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136965 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3366912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:13:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 98.447468893000007, 2024-09-13T05:13:31.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056225403, 2024-09-13T05:13:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.679 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136965 2024-09-13T05:13:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:13:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:13:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117575+0000", 2024-09-13T05:13:31.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117578+0000", 2024-09-13T05:13:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4899999999999999e-06 2024-09-13T05:13:31.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117583+0000", 2024-09-13T05:13:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.074e-06 2024-09-13T05:13:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117587+0000", 2024-09-13T05:13:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5360000000000003e-06 2024-09-13T05:13:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173622+0000", 2024-09-13T05:13:31.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056034527000000001 2024-09-13T05:13:31.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173704+0000", 2024-09-13T05:13:31.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2137000000000003e-05 2024-09-13T05:13:31.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173801+0000", 2024-09-13T05:13:31.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7048999999999999e-05 2024-09-13T05:13:31.687 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.687 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.687 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.688 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136991 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3553280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:31.688 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:13:31.688 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 98.443543116000001, 2024-09-13T05:13:31.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056330199999999997, 2024-09-13T05:13:31.688 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.688 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.688 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.689 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.689 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.689 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136991 2024-09-13T05:13:31.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.689 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:13:31.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:13:31.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:13:31.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:31.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121504+0000", 2024-09-13T05:13:31.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7199999999999998e-06 2024-09-13T05:13:31.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121510+0000", 2024-09-13T05:13:31.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3459999999999999e-06 2024-09-13T05:13:31.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121515+0000", 2024-09-13T05:13:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.656e-06 2024-09-13T05:13:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177608+0000", 2024-09-13T05:13:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056093267000000002 2024-09-13T05:13:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177717+0000", 2024-09-13T05:13:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010901299999999999 2024-09-13T05:13:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177832+0000", 2024-09-13T05:13:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114604 2024-09-13T05:13:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173672 3.9 3:9520c004:::rbd_data.112d7c1bedf7.0000000000000040:29 [read 186368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:31.695 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:13:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 66.379648490999998, 2024-09-13T05:13:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05682475, 2024-09-13T05:13:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173672 2024-09-13T05:13:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:31.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:13:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:13:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185395+0000", 2024-09-13T05:13:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185398+0000", 2024-09-13T05:13:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8260000000000001e-06 2024-09-13T05:13:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185404+0000", 2024-09-13T05:13:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-09-13T05:13:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185408+0000", 2024-09-13T05:13:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5279999999999997e-06 2024-09-13T05:13:31.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.236213+0000", 2024-09-13T05:13:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050805207999999998 2024-09-13T05:13:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.236285+0000", 2024-09-13T05:13:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1236999999999996e-05 2024-09-13T05:13:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.242221+0000", 2024-09-13T05:13:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059360050000000003 2024-09-13T05:13:31.700 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.700 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.700 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.700 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:31.700 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:31.700 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:31.702 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:13:31.702 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:31.698+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:31.802 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:31.799+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:31.854 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:31.854 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:13:31.854 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:31.864 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:13:31.903 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:31.898+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:31.966 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:13:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:13:31.966 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:31.977 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:13:32.004 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:31.999+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:32.105 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:32.099+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:32.135 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:13:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:13:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:13:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:70758 3.2 3:427d0469:::rbd_header.112d8d1317eb:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-13T05:13:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:13:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 128.70290348099999, 2024-09-13T05:13:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.190313603, 2024-09-13T05:13:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70758 2024-09-13T05:13:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:13:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:13:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428654+0000", 2024-09-13T05:13:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428664+0000", 2024-09-13T05:13:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0664e-05 2024-09-13T05:13:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428683+0000", 2024-09-13T05:13:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8377e-05 2024-09-13T05:13:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428691+0000", 2024-09-13T05:13:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9400000000000008e-06 2024-09-13T05:13:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428789+0000", 2024-09-13T05:13:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7165999999999998e-05 2024-09-13T05:13:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428811+0000", 2024-09-13T05:13:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1925000000000001e-05 2024-09-13T05:13:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.617921+0000", 2024-09-13T05:13:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.189110536 2024-09-13T05:13:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618344+0000", 2024-09-13T05:13:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042245800000000001 2024-09-13T05:13:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618969+0000", 2024-09-13T05:13:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062529299999999996 2024-09-13T05:13:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162381 3.8 3.4e1a3768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:13:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.622897234000007, 2024-09-13T05:13:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.14690313199999999, 2024-09-13T05:13:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:13:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162381 2024-09-13T05:13:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:13:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:13:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508659+0000", 2024-09-13T05:13:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:13:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508673+0000", 2024-09-13T05:13:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4154999999999999e-05 2024-09-13T05:13:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508703+0000", 2024-09-13T05:13:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9427000000000001e-05 2024-09-13T05:13:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508719+0000", 2024-09-13T05:13:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6381000000000001e-05 2024-09-13T05:13:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508789+0000", 2024-09-13T05:13:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9898000000000001e-05 2024-09-13T05:13:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508799+0000", 2024-09-13T05:13:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0066e-05 2024-09-13T05:13:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655550+0000", 2024-09-13T05:13:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.146750506 2024-09-13T05:13:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655565+0000", 2024-09-13T05:13:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4915e-05 2024-09-13T05:13:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162393 3.8 3.fd966c88 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:13:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.611381159999993, 2024-09-13T05:13:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.135657895, 2024-09-13T05:13:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:13:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162393 2024-09-13T05:13:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:13:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:13:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520176+0000", 2024-09-13T05:13:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:13:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520184+0000", 2024-09-13T05:13:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5800000000000003e-06 2024-09-13T05:13:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520199+0000", 2024-09-13T05:13:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4481000000000001e-05 2024-09-13T05:13:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520209+0000", 2024-09-13T05:13:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0327e-05 2024-09-13T05:13:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520351+0000", 2024-09-13T05:13:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141827 2024-09-13T05:13:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520363+0000", 2024-09-13T05:13:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2018000000000001e-05 2024-09-13T05:13:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655819+0000", 2024-09-13T05:13:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13545665600000001 2024-09-13T05:13:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655835+0000", 2024-09-13T05:13:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6135000000000001e-05 2024-09-13T05:13:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162429 3.8 3.6e098f28 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:13:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.610530550999997, 2024-09-13T05:13:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13484765400000001, 2024-09-13T05:13:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:13:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162429 2024-09-13T05:13:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:13:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:13:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:13:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521032+0000", 2024-09-13T05:13:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3039999999999998e-06 2024-09-13T05:13:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521041+0000", 2024-09-13T05:13:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6880000000000005e-06 2024-09-13T05:13:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521047+0000", 2024-09-13T05:13:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0100000000000001e-06 2024-09-13T05:13:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521601+0000", 2024-09-13T05:13:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00055398600000000002 2024-09-13T05:13:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521613+0000", 2024-09-13T05:13:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2347000000000001e-05 2024-09-13T05:13:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655869+0000", 2024-09-13T05:13:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.134255597 2024-09-13T05:13:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655876+0000", 2024-09-13T05:13:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2790000000000001e-06 2024-09-13T05:13:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162521 3.8 3.f06bf7c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:13:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.608128421000004, 2024-09-13T05:13:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13247452600000001, 2024-09-13T05:13:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:13:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162521 2024-09-13T05:13:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:13:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:13:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:13:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523433+0000", 2024-09-13T05:13:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.128e-06 2024-09-13T05:13:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523440+0000", 2024-09-13T05:13:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9990000000000002e-06 2024-09-13T05:13:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523446+0000", 2024-09-13T05:13:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7869999999999998e-06 2024-09-13T05:13:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.528221+0000", 2024-09-13T05:13:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047747040000000003 2024-09-13T05:13:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.528237+0000", 2024-09-13T05:13:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6042e-05 2024-09-13T05:13:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655898+0000", 2024-09-13T05:13:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.127661521 2024-09-13T05:13:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655905+0000", 2024-09-13T05:13:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7780000000000002e-06 2024-09-13T05:13:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162381 3.8 3:16ec5872:::rbd_data.112dc3abcba6.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:13:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.598601255999995, 2024-09-13T05:13:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12546553899999999, 2024-09-13T05:13:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162381 2024-09-13T05:13:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:13:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:13:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532956+0000", 2024-09-13T05:13:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532964+0000", 2024-09-13T05:13:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.072e-06 2024-09-13T05:13:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532976+0000", 2024-09-13T05:13:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1355000000000001e-05 2024-09-13T05:13:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532984+0000", 2024-09-13T05:13:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3440000000000001e-06 2024-09-13T05:13:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533432+0000", 2024-09-13T05:13:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044773000000000002 2024-09-13T05:13:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533439+0000", 2024-09-13T05:13:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9890000000000003e-06 2024-09-13T05:13:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655985+0000", 2024-09-13T05:13:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122546527 2024-09-13T05:13:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656234+0000", 2024-09-13T05:13:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024911300000000003 2024-09-13T05:13:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656378+0000", 2024-09-13T05:13:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014417100000000001 2024-09-13T05:13:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657916+0000", 2024-09-13T05:13:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001537907 2024-09-13T05:13:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:13:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658308+0000", 2024-09-13T05:13:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039183700000000002 2024-09-13T05:13:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:13:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658364+0000", 2024-09-13T05:13:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5451000000000002e-05 2024-09-13T05:13:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658423+0000", 2024-09-13T05:13:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9449e-05 2024-09-13T05:13:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162393 3.8 3:113669bf:::rbd_data.112dfd94ee88.00000000000000bf:2a [read 131072~18432] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:13:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.598561477000004, 2024-09-13T05:13:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124231431, 2024-09-13T05:13:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162393 2024-09-13T05:13:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:13:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:13:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:13:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533001+0000", 2024-09-13T05:13:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8099999999999999e-06 2024-09-13T05:13:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533007+0000", 2024-09-13T05:13:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5849999999999996e-06 2024-09-13T05:13:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533012+0000", 2024-09-13T05:13:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0320000000000003e-06 2024-09-13T05:13:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533459+0000", 2024-09-13T05:13:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044646399999999999 2024-09-13T05:13:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533464+0000", 2024-09-13T05:13:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9180000000000002e-06 2024-09-13T05:13:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656870+0000", 2024-09-13T05:13:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123406847 2024-09-13T05:13:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657067+0000", 2024-09-13T05:13:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019655599999999999 2024-09-13T05:13:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657229+0000", 2024-09-13T05:13:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016175599999999999 2024-09-13T05:13:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162429 3.8 3:14f19076:::rbd_data.112dfd94ee88.0000000000000150:2a [read 131072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:13:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.598541926999999, 2024-09-13T05:13:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124549956, 2024-09-13T05:13:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162429 2024-09-13T05:13:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:13:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:13:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533016+0000", 2024-09-13T05:13:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533020+0000", 2024-09-13T05:13:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1049999999999999e-06 2024-09-13T05:13:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533025+0000", 2024-09-13T05:13:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-09-13T05:13:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533030+0000", 2024-09-13T05:13:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8999999999999997e-06 2024-09-13T05:13:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533481+0000", 2024-09-13T05:13:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045080400000000002 2024-09-13T05:13:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533486+0000", 2024-09-13T05:13:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3369999999999999e-06 2024-09-13T05:13:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657311+0000", 2024-09-13T05:13:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123824408 2024-09-13T05:13:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657464+0000", 2024-09-13T05:13:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015343900000000001 2024-09-13T05:13:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657567+0000", 2024-09-13T05:13:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102568 2024-09-13T05:13:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162521 3.8 3:13efd60f:::rbd_data.112dfd94ee88.000000000000031a:2a [read 131072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:13:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.598390694000003, 2024-09-13T05:13:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124709257, 2024-09-13T05:13:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162521 2024-09-13T05:13:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:13:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:13:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:13:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533170+0000", 2024-09-13T05:13:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3910000000000001e-06 2024-09-13T05:13:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533176+0000", 2024-09-13T05:13:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4029999999999998e-06 2024-09-13T05:13:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533180+0000", 2024-09-13T05:13:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6999999999999999e-06 2024-09-13T05:13:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533659+0000", 2024-09-13T05:13:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047839699999999998 2024-09-13T05:13:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533664+0000", 2024-09-13T05:13:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7239999999999997e-06 2024-09-13T05:13:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657619+0000", 2024-09-13T05:13:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123954412 2024-09-13T05:13:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657784+0000", 2024-09-13T05:13:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016527499999999999 2024-09-13T05:13:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657877+0000", 2024-09-13T05:13:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3280000000000001e-05 2024-09-13T05:13:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162618 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 70656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:13:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.597085984000003, 2024-09-13T05:13:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123752711, 2024-09-13T05:13:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162618 2024-09-13T05:13:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:13:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:13:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534472+0000", 2024-09-13T05:13:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534475+0000", 2024-09-13T05:13:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2010000000000002e-06 2024-09-13T05:13:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534482+0000", 2024-09-13T05:13:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:13:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534486+0000", 2024-09-13T05:13:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7520000000000004e-06 2024-09-13T05:13:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536456+0000", 2024-09-13T05:13:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001969527 2024-09-13T05:13:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536462+0000", 2024-09-13T05:13:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2750000000000001e-06 2024-09-13T05:13:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657939+0000", 2024-09-13T05:13:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121476769 2024-09-13T05:13:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658087+0000", 2024-09-13T05:13:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014862400000000001 2024-09-13T05:13:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658225+0000", 2024-09-13T05:13:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013800999999999999 2024-09-13T05:13:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162620 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 71680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:13:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.597051859000004, 2024-09-13T05:13:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124087688, 2024-09-13T05:13:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162620 2024-09-13T05:13:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:13:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:13:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:13:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534509+0000", 2024-09-13T05:13:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1270000000000001e-06 2024-09-13T05:13:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534514+0000", 2024-09-13T05:13:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8720000000000001e-06 2024-09-13T05:13:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534518+0000", 2024-09-13T05:13:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5090000000000004e-06 2024-09-13T05:13:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536485+0000", 2024-09-13T05:13:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019671530000000001 2024-09-13T05:13:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536491+0000", 2024-09-13T05:13:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3759999999999999e-06 2024-09-13T05:13:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658466+0000", 2024-09-13T05:13:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121975466 2024-09-13T05:13:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658522+0000", 2024-09-13T05:13:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5668999999999998e-05 2024-09-13T05:13:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658595+0000", 2024-09-13T05:13:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2800999999999996e-05 2024-09-13T05:13:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162622 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 72704~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:13:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.597020892000003, 2024-09-13T05:13:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124215569, 2024-09-13T05:13:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162622 2024-09-13T05:13:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:13:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:13:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534537+0000", 2024-09-13T05:13:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534540+0000", 2024-09-13T05:13:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3740000000000001e-06 2024-09-13T05:13:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534545+0000", 2024-09-13T05:13:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4210000000000003e-06 2024-09-13T05:13:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534550+0000", 2024-09-13T05:13:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3090000000000003e-06 2024-09-13T05:13:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536510+0000", 2024-09-13T05:13:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019597130000000001 2024-09-13T05:13:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536517+0000", 2024-09-13T05:13:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0620000000000003e-06 2024-09-13T05:13:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658632+0000", 2024-09-13T05:13:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122114373 2024-09-13T05:13:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658686+0000", 2024-09-13T05:13:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3882999999999999e-05 2024-09-13T05:13:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658753+0000", 2024-09-13T05:13:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7921000000000002e-05 2024-09-13T05:13:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162623 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 73728~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:13:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.597004087000002, 2024-09-13T05:13:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124350214, 2024-09-13T05:13:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162623 2024-09-13T05:13:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:13:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:13:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534554+0000", 2024-09-13T05:13:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534556+0000", 2024-09-13T05:13:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-13T05:13:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534563+0000", 2024-09-13T05:13:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2890000000000003e-06 2024-09-13T05:13:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534567+0000", 2024-09-13T05:13:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4880000000000001e-06 2024-09-13T05:13:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536538+0000", 2024-09-13T05:13:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019703989999999998 2024-09-13T05:13:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536543+0000", 2024-09-13T05:13:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3920000000000002e-06 2024-09-13T05:13:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658773+0000", 2024-09-13T05:13:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122229607 2024-09-13T05:13:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658835+0000", 2024-09-13T05:13:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1954999999999999e-05 2024-09-13T05:13:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658905+0000", 2024-09-13T05:13:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-09-13T05:13:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162626 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 65536~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:13:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.596952802999994, 2024-09-13T05:13:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124425881, 2024-09-13T05:13:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162626 2024-09-13T05:13:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:13:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:13:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:13:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534611+0000", 2024-09-13T05:13:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5419999999999996e-06 2024-09-13T05:13:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534617+0000", 2024-09-13T05:13:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5169999999999999e-06 2024-09-13T05:13:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534622+0000", 2024-09-13T05:13:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9810000000000003e-06 2024-09-13T05:13:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536563+0000", 2024-09-13T05:13:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019410549999999999 2024-09-13T05:13:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536568+0000", 2024-09-13T05:13:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4310000000000002e-06 2024-09-13T05:13:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658922+0000", 2024-09-13T05:13:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122354221 2024-09-13T05:13:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658968+0000", 2024-09-13T05:13:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5221e-05 2024-09-13T05:13:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659032+0000", 2024-09-13T05:13:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4256000000000003e-05 2024-09-13T05:13:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162628 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 66560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:13:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.596917852000004, 2024-09-13T05:13:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124532254, 2024-09-13T05:13:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162628 2024-09-13T05:13:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:13:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:13:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:13:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534643+0000", 2024-09-13T05:13:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1890000000000001e-06 2024-09-13T05:13:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534648+0000", 2024-09-13T05:13:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:13:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534652+0000", 2024-09-13T05:13:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4549999999999997e-06 2024-09-13T05:13:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536586+0000", 2024-09-13T05:13:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019336049999999999 2024-09-13T05:13:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536591+0000", 2024-09-13T05:13:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3770000000000004e-06 2024-09-13T05:13:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659062+0000", 2024-09-13T05:13:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122470685 2024-09-13T05:13:32.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659106+0000", 2024-09-13T05:13:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3856000000000002e-05 2024-09-13T05:13:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659173+0000", 2024-09-13T05:13:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7168000000000005e-05 2024-09-13T05:13:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162630 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 67584~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:13:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.596884646000007, 2024-09-13T05:13:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12468555100000001, 2024-09-13T05:13:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162630 2024-09-13T05:13:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:32.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:13:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:13:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:13:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:32.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534676+0000", 2024-09-13T05:13:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4399999999999999e-06 2024-09-13T05:13:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534681+0000", 2024-09-13T05:13:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2349999999999999e-06 2024-09-13T05:13:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534686+0000", 2024-09-13T05:13:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5499999999999996e-06 2024-09-13T05:13:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536609+0000", 2024-09-13T05:13:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001923407 2024-09-13T05:13:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536615+0000", 2024-09-13T05:13:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1499999999999998e-06 2024-09-13T05:13:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659233+0000", 2024-09-13T05:13:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122618957 2024-09-13T05:13:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659294+0000", 2024-09-13T05:13:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0251000000000003e-05 2024-09-13T05:13:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659360+0000", 2024-09-13T05:13:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5906000000000002e-05 2024-09-13T05:13:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.217 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162633 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 69632~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:13:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.596776740999999, 2024-09-13T05:13:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124702147, 2024-09-13T05:13:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162633 2024-09-13T05:13:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.218 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:13:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:13:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:13:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:32.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534784+0000", 2024-09-13T05:13:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3300000000000001e-06 2024-09-13T05:13:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534789+0000", 2024-09-13T05:13:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4149999999999998e-06 2024-09-13T05:13:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534794+0000", 2024-09-13T05:13:32.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5669999999999996e-06 2024-09-13T05:13:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536634+0000", 2024-09-13T05:13:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001840401 2024-09-13T05:13:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536642+0000", 2024-09-13T05:13:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9729999999999997e-06 2024-09-13T05:13:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659383+0000", 2024-09-13T05:13:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12274112099999999 2024-09-13T05:13:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659424+0000", 2024-09-13T05:13:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0936000000000002e-05 2024-09-13T05:13:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659484+0000", 2024-09-13T05:13:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9775000000000003e-05 2024-09-13T05:13:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.222 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162675 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 68608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:13:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 79.596727697000006, 2024-09-13T05:13:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124823974, 2024-09-13T05:13:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162675 2024-09-13T05:13:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.223 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:13:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:13:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:13:32.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534833+0000", 2024-09-13T05:13:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.204e-06 2024-09-13T05:13:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534838+0000", 2024-09-13T05:13:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0130000000000001e-06 2024-09-13T05:13:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534842+0000", 2024-09-13T05:13:32.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.51e-06 2024-09-13T05:13:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536661+0000", 2024-09-13T05:13:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018186039999999999 2024-09-13T05:13:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536667+0000", 2024-09-13T05:13:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5260000000000001e-06 2024-09-13T05:13:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659531+0000", 2024-09-13T05:13:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122864403 2024-09-13T05:13:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659583+0000", 2024-09-13T05:13:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1564000000000003e-05 2024-09-13T05:13:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659655+0000", 2024-09-13T05:13:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2504999999999998e-05 2024-09-13T05:13:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:32.227 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:170203 3.1e 3:7c9b1cf4:::rbd_header.112dc3abcba6:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128)", 2024-09-13T05:13:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:13:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 71.316748726, 2024-09-13T05:13:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.79948714899999995, 2024-09-13T05:13:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 170203 2024-09-13T05:13:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.228 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:13:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:13:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814808+0000", 2024-09-13T05:13:32.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814820+0000", 2024-09-13T05:13:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.206e-05 2024-09-13T05:13:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814841+0000", 2024-09-13T05:13:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1464999999999999e-05 2024-09-13T05:13:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814853+0000", 2024-09-13T05:13:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1824999999999999e-05 2024-09-13T05:13:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814911+0000", 2024-09-13T05:13:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8255999999999999e-05 2024-09-13T05:13:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814918+0000", 2024-09-13T05:13:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7120000000000003e-06 2024-09-13T05:13:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.611660+0000", 2024-09-13T05:13:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.79674180100000003 2024-09-13T05:13:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.611911+0000", 2024-09-13T05:13:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025108900000000002 2024-09-13T05:13:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-13T05:13:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.612726+0000", 2024-09-13T05:13:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00081512999999999996 2024-09-13T05:13:32.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614087+0000", 2024-09-13T05:13:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013607560000000001 2024-09-13T05:13:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:13:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614095+0000", 2024-09-13T05:13:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3240000000000003e-06 2024-09-13T05:13:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:13:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614138+0000", 2024-09-13T05:13:32.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3115000000000003e-05 2024-09-13T05:13:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614297+0000", 2024-09-13T05:13:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015875399999999999 2024-09-13T05:13:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:206714 3.1e 3:7a6b822e:::rbd_id.image_client.0-clone15:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e182)", 2024-09-13T05:13:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:13:16.942501+0000", 2024-09-13T05:13:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.189058136, 2024-09-13T05:13:32.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.93017799199999995, 2024-09-13T05:13:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 206714 2024-09-13T05:13:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:32.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942501+0000", 2024-09-13T05:13:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942501+0000", 2024-09-13T05:13:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942498+0000", 2024-09-13T05:13:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:13:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942510+0000", 2024-09-13T05:13:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1564e-05 2024-09-13T05:13:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942531+0000", 2024-09-13T05:13:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1713e-05 2024-09-13T05:13:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942543+0000", 2024-09-13T05:13:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1684e-05 2024-09-13T05:13:32.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942671+0000", 2024-09-13T05:13:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012764699999999999 2024-09-13T05:13:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942693+0000", 2024-09-13T05:13:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2690000000000001e-05 2024-09-13T05:13:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.867517+0000", 2024-09-13T05:13:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.92482318399999996 2024-09-13T05:13:32.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.867693+0000", 2024-09-13T05:13:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017623199999999999 2024-09-13T05:13:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:13:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.867788+0000", 2024-09-13T05:13:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5588999999999996e-05 2024-09-13T05:13:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:13:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.869416+0000", 2024-09-13T05:13:32.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016272750000000001 2024-09-13T05:13:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.872552+0000", 2024-09-13T05:13:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031364850000000001 2024-09-13T05:13:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:13:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.872628+0000", 2024-09-13T05:13:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5871999999999995e-05 2024-09-13T05:13:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:32.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.872679+0000", 2024-09-13T05:13:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0630999999999997e-05 2024-09-13T05:13:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:32.241 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:32.241 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:32.242 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:13:32.243 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:32.239+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:32.343 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:32.339+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:32.355 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:32.355 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:32.355 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:13:32.355 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:32.366 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:13:32.444 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:32.442+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:32.469 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:32.469 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:32.469 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:13:32.469 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:13:32.469 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:32.482 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:13:32.526 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T05:13:32.545 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:32.539+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:32.594 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:32.594 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:13:32.594 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:13:32.594 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:13:32.595 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.595 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203004 3.1a 3:5a99807b:::rbd_object_map.112dbd21872d:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159)", 2024-09-13T05:13:32.595 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.649669+0000", 2024-09-13T05:13:32.595 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 38.938747988000003, 2024-09-13T05:13:32.595 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0064520619999999997, 2024-09-13T05:13:32.595 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:32.595 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:32.595 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:32.596 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:32.596 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.596 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203004 2024-09-13T05:13:32.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.596 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:32.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:32.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649669+0000", 2024-09-13T05:13:32.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.596 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.596 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:32.596 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649669+0000", 2024-09-13T05:13:32.596 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.597 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.597 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:32.597 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649668+0000", 2024-09-13T05:13:32.597 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:32.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.597 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.597 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:32.597 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649676+0000", 2024-09-13T05:13:32.597 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0020000000000006e-06 2024-09-13T05:13:32.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.597 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.598 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:32.598 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649686+0000", 2024-09-13T05:13:32.598 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0702e-05 2024-09-13T05:13:32.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.598 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.598 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.599 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649694+0000", 2024-09-13T05:13:32.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9370000000000004e-06 2024-09-13T05:13:32.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:32.599 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.650848+0000", 2024-09-13T05:13:32.599 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0011532020000000001 2024-09-13T05:13:32.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.599 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.599 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:32.600 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.650973+0000", 2024-09-13T05:13:32.600 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012510099999999999 2024-09-13T05:13:32.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.601 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:32.601 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.651197+0000", 2024-09-13T05:13:32.601 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00022407899999999999 2024-09-13T05:13:32.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.601 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.601 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:32.601 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.653302+0000", 2024-09-13T05:13:32.601 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021053629999999999 2024-09-13T05:13:32.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.601 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:32.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655437+0000", 2024-09-13T05:13:32.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002135348 2024-09-13T05:13:32.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:32.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655500+0000", 2024-09-13T05:13:32.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2453999999999995e-05 2024-09-13T05:13:32.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.602 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.602 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:32.602 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656122+0000", 2024-09-13T05:13:32.602 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00062160299999999998 2024-09-13T05:13:32.603 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.603 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:32.603 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.603 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.603 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.603 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7318 3.13 e159/153 3:cf0a521c:::rbd_data.112dbd21872d.0000000000000004:28 v 159'1220, mlcod=159'1216)", 2024-09-13T05:13:32.603 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.655897+0000", 2024-09-13T05:13:32.603 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 38.932520193999999, 2024-09-13T05:13:32.603 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0075974520000000002, 2024-09-13T05:13:32.603 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:32.603 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:32.603 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:32.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.604 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:32.604 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655897+0000", 2024-09-13T05:13:32.604 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.604 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:32.604 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655897+0000", 2024-09-13T05:13:32.604 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.604 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.604 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:32.605 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655897+0000", 2024-09-13T05:13:32.605 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:32.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.605 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:32.605 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655906+0000", 2024-09-13T05:13:32.605 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6290000000000005e-06 2024-09-13T05:13:32.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.605 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.605 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:32.605 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655916+0000", 2024-09-13T05:13:32.605 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0079e-05 2024-09-13T05:13:32.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655923+0000", 2024-09-13T05:13:32.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1319999999999996e-06 2024-09-13T05:13:32.606 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:32.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656023+0000", 2024-09-13T05:13:32.606 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9747000000000006e-05 2024-09-13T05:13:32.606 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.606 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.606 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:32.606 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656042+0000", 2024-09-13T05:13:32.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8491999999999998e-05 2024-09-13T05:13:32.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.607 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:32.607 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.663412+0000", 2024-09-13T05:13:32.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0073701959999999999 2024-09-13T05:13:32.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.607 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.607 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:32.607 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.663495+0000", 2024-09-13T05:13:32.607 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2923000000000005e-05 2024-09-13T05:13:32.607 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.608 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:32.608 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.608 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.3.0:5116 3.b e159/149 3:d32d7958:::rbd_data.112dbd21872d.0000000000000001:28 v 159'616, mlcod=158'611)", 2024-09-13T05:13:32.608 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.655899+0000", 2024-09-13T05:13:32.608 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 38.932518510999998, 2024-09-13T05:13:32.608 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0075096859999999998, 2024-09-13T05:13:32.608 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:32.608 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:32.608 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:32.608 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.608 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:32.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655899+0000", 2024-09-13T05:13:32.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:32.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655899+0000", 2024-09-13T05:13:32.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.609 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:32.609 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655898+0000", 2024-09-13T05:13:32.609 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:32.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:32.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655907+0000", 2024-09-13T05:13:32.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5939999999999994e-06 2024-09-13T05:13:32.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.610 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.610 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:32.610 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655916+0000", 2024-09-13T05:13:32.610 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9840000000000007e-06 2024-09-13T05:13:32.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655923+0000", 2024-09-13T05:13:32.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1350000000000003e-06 2024-09-13T05:13:32.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:32.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656059+0000", 2024-09-13T05:13:32.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013669999999999999 2024-09-13T05:13:32.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.611 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.611 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:32.611 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656079+0000", 2024-09-13T05:13:32.611 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9293e-05 2024-09-13T05:13:32.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:32.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.663368+0000", 2024-09-13T05:13:32.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0072892570000000004 2024-09-13T05:13:32.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.612 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.612 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:32.612 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.663409+0000", 2024-09-13T05:13:32.612 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0614000000000001e-05 2024-09-13T05:13:32.612 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.612 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:32.612 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.613 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7323 3.e e159/151 3:742bfecb:::rbd_data.112dbd21872d.0000000000000018:28 v 159'1051, mlcod=157'1046)", 2024-09-13T05:13:32.613 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.668166+0000", 2024-09-13T05:13:32.613 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 38.920251317000002, 2024-09-13T05:13:32.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0065306610000000001, 2024-09-13T05:13:32.613 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:32.613 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:32.613 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:32.613 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.613 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:32.613 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668166+0000", 2024-09-13T05:13:32.613 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:32.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668166+0000", 2024-09-13T05:13:32.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:32.614 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668165+0000", 2024-09-13T05:13:32.614 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:32.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.614 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.614 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:32.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668174+0000", 2024-09-13T05:13:32.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.3790000000000006e-06 2024-09-13T05:13:32.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:32.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668187+0000", 2024-09-13T05:13:32.615 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3172e-05 2024-09-13T05:13:32.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.615 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.615 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.615 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668208+0000", 2024-09-13T05:13:32.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0713999999999999e-05 2024-09-13T05:13:32.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:32.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668272+0000", 2024-09-13T05:13:32.616 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4453000000000001e-05 2024-09-13T05:13:32.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.616 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.616 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:32.616 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668289+0000", 2024-09-13T05:13:32.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7331000000000001e-05 2024-09-13T05:13:32.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:32.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.674630+0000", 2024-09-13T05:13:32.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0063409340000000003 2024-09-13T05:13:32.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.617 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.617 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:32.617 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.674697+0000", 2024-09-13T05:13:32.617 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6472999999999999e-05 2024-09-13T05:13:32.617 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.617 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:32.617 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.618 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.618 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203156 3.9 3:9079854c:::rbd_header.112d52e08ead:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e160)", 2024-09-13T05:13:32.618 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:54.685914+0000", 2024-09-13T05:13:32.618 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 37.90250339, 2024-09-13T05:13:32.618 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0085711250000000006, 2024-09-13T05:13:32.618 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:32.618 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:32.618 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:32.618 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:32.618 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.618 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203156 2024-09-13T05:13:32.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.618 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:32.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:32.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685914+0000", 2024-09-13T05:13:32.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:32.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685914+0000", 2024-09-13T05:13:32.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.619 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.619 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:32.619 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685912+0000", 2024-09-13T05:13:32.619 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:32.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:32.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685924+0000", 2024-09-13T05:13:32.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1537e-05 2024-09-13T05:13:32.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:32.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685950+0000", 2024-09-13T05:13:32.620 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6781e-05 2024-09-13T05:13:32.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.620 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.620 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.620 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685962+0000", 2024-09-13T05:13:32.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1953999999999999e-05 2024-09-13T05:13:32.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:32.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.686102+0000", 2024-09-13T05:13:32.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013926300000000001 2024-09-13T05:13:32.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op must wait for map", 2024-09-13T05:13:32.621 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.686115+0000", 2024-09-13T05:13:32.621 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3506000000000001e-05 2024-09-13T05:13:32.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.621 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.621 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:32.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.689954+0000", 2024-09-13T05:13:32.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0038391810000000001 2024-09-13T05:13:32.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:32.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.690104+0000", 2024-09-13T05:13:32.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014980500000000001 2024-09-13T05:13:32.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.622 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 2", 2024-09-13T05:13:32.622 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.690674+0000", 2024-09-13T05:13:32.622 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00057014200000000004 2024-09-13T05:13:32.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.622 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:32.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.692426+0000", 2024-09-13T05:13:32.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0017518810000000001 2024-09-13T05:13:32.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:32.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.694360+0000", 2024-09-13T05:13:32.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0019340819999999999 2024-09-13T05:13:32.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.623 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:32.623 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.694443+0000", 2024-09-13T05:13:32.623 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2693000000000003e-05 2024-09-13T05:13:32.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.623 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.624 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:32.624 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.694485+0000", 2024-09-13T05:13:32.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2355999999999999e-05 2024-09-13T05:13:32.624 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.624 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:32.624 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.624 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.624 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203849 3.3 3:c190344a:::rbd_data.112d1f830c0e.0000000000000000:head [delete] snapc 23=[] ondisk+write+known_if_redirected+supports_pool_eio e164)", 2024-09-13T05:13:32.624 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:58.853242+0000", 2024-09-13T05:13:32.624 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 33.735174981999997, 2024-09-13T05:13:32.624 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0070665509999999999, 2024-09-13T05:13:32.624 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:32.625 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:32.625 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:32.625 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:32.625 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.625 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203849 2024-09-13T05:13:32.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.625 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:32.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:32.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853242+0000", 2024-09-13T05:13:32.625 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.625 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:32.625 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853242+0000", 2024-09-13T05:13:32.626 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.626 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.626 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:32.626 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853240+0000", 2024-09-13T05:13:32.626 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:13:32.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.626 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.626 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:32.626 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853253+0000", 2024-09-13T05:13:32.626 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2330000000000001e-05 2024-09-13T05:13:32.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.626 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.627 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:32.627 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853286+0000", 2024-09-13T05:13:32.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3798999999999999e-05 2024-09-13T05:13:32.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.627 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.627 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853321+0000", 2024-09-13T05:13:32.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4749999999999998e-05 2024-09-13T05:13:32.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.627 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.627 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:32.627 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853568+0000", 2024-09-13T05:13:32.627 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024706400000000002 2024-09-13T05:13:32.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.628 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:32.628 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853935+0000", 2024-09-13T05:13:32.628 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00036690600000000001 2024-09-13T05:13:32.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.628 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:32.628 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854221+0000", 2024-09-13T05:13:32.628 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00028613100000000002 2024-09-13T05:13:32.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.628 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.628 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:32.628 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.859106+0000", 2024-09-13T05:13:32.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0048842629999999998 2024-09-13T05:13:32.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.629 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:32.629 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860185+0000", 2024-09-13T05:13:32.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0010796740000000001 2024-09-13T05:13:32.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.629 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:32.629 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860252+0000", 2024-09-13T05:13:32.629 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6928999999999996e-05 2024-09-13T05:13:32.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.629 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.630 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:32.630 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860309+0000", 2024-09-13T05:13:32.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6898999999999999e-05 2024-09-13T05:13:32.630 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.630 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:32.630 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.630 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.630 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203852 3.1a 3:5af372d9:::rbd_data.112d1f830c0e.0000000000000003:head [delete] snapc 23=[] ondisk+write+known_if_redirected+supports_pool_eio e164)", 2024-09-13T05:13:32.630 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:58.853358+0000", 2024-09-13T05:13:32.630 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 33.735059624999998, 2024-09-13T05:13:32.630 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0069302069999999999, 2024-09-13T05:13:32.630 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:32.631 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:32.631 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:32.631 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:32.631 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.631 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203852 2024-09-13T05:13:32.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.631 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:32.631 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.631 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:32.631 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853358+0000", 2024-09-13T05:13:32.631 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.631 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.631 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:32.631 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853358+0000", 2024-09-13T05:13:32.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.632 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:32.632 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853357+0000", 2024-09-13T05:13:32.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:32.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.632 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:32.632 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853363+0000", 2024-09-13T05:13:32.632 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6059999999999999e-06 2024-09-13T05:13:32.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.632 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.633 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:32.633 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853421+0000", 2024-09-13T05:13:32.633 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8075999999999998e-05 2024-09-13T05:13:32.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.633 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.633 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854643+0000", 2024-09-13T05:13:32.633 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001221904 2024-09-13T05:13:32.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.633 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:32.633 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854777+0000", 2024-09-13T05:13:32.633 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013323100000000001 2024-09-13T05:13:32.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.634 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:32.634 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.855094+0000", 2024-09-13T05:13:32.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00031790600000000002 2024-09-13T05:13:32.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.634 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:32.634 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.855378+0000", 2024-09-13T05:13:32.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00028385800000000001 2024-09-13T05:13:32.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.634 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.634 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:32.634 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.859936+0000", 2024-09-13T05:13:32.634 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0045574450000000002 2024-09-13T05:13:32.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.635 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.635 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:32.635 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860199+0000", 2024-09-13T05:13:32.635 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00026360899999999999 2024-09-13T05:13:32.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.635 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.635 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:32.635 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860250+0000", 2024-09-13T05:13:32.635 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0625999999999999e-05 2024-09-13T05:13:32.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.635 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.635 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:32.635 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860288+0000", 2024-09-13T05:13:32.635 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8028999999999998e-05 2024-09-13T05:13:32.635 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.636 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:32.636 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.636 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.636 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.636 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7487 3.13 e174/153 3:cba8ba28:::rbd_data.112d667fb7f9.00000000000001c3:19 v 174'1268, mlcod=174'1262)", 2024-09-13T05:13:32.636 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:08.811674+0000", 2024-09-13T05:13:32.636 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 23.776743033999999, 2024-09-13T05:13:32.636 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0068301730000000001, 2024-09-13T05:13:32.636 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:32.636 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:32.636 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:32.636 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.636 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:32.637 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811674+0000", 2024-09-13T05:13:32.637 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.637 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.637 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:32.637 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811674+0000", 2024-09-13T05:13:32.637 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.637 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.637 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:32.637 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811674+0000", 2024-09-13T05:13:32.637 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:32.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.637 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.637 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:32.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811680+0000", 2024-09-13T05:13:32.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6460000000000004e-06 2024-09-13T05:13:32.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:32.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811694+0000", 2024-09-13T05:13:32.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4066999999999999e-05 2024-09-13T05:13:32.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.638 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811702+0000", 2024-09-13T05:13:32.638 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3549999999999999e-06 2024-09-13T05:13:32.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.638 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.638 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:32.639 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813840+0000", 2024-09-13T05:13:32.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002138137 2024-09-13T05:13:32.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.639 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.639 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:32.639 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813859+0000", 2024-09-13T05:13:32.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9006999999999999e-05 2024-09-13T05:13:32.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.639 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.639 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:32.639 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.818469+0000", 2024-09-13T05:13:32.639 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0046097070000000002 2024-09-13T05:13:32.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.639 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.640 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:32.640 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.818505+0000", 2024-09-13T05:13:32.640 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6026999999999999e-05 2024-09-13T05:13:32.640 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.640 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:32.640 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.640 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.640 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.640 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:206387 3.9 3:96db6e79:::rbd_data.112d52e13700.000000000000000d:head [delete] snapc 15=[] ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-13T05:13:32.640 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:12.969800+0000", 2024-09-13T05:13:32.640 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.618616977999999, 2024-09-13T05:13:32.640 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0066299089999999998, 2024-09-13T05:13:32.640 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:32.640 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:32.640 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:32.641 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:32.641 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.641 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 206387 2024-09-13T05:13:32.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.641 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:32.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:32.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.969800+0000", 2024-09-13T05:13:32.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.641 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.641 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:32.641 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.969800+0000", 2024-09-13T05:13:32.641 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.642 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:32.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.969799+0000", 2024-09-13T05:13:32.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:32.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.642 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:32.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.969807+0000", 2024-09-13T05:13:32.642 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9999999999999996e-06 2024-09-13T05:13:32.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.642 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:32.642 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.969832+0000", 2024-09-13T05:13:32.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5077000000000001e-05 2024-09-13T05:13:32.643 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.643 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.643 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.643 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.969845+0000", 2024-09-13T05:13:32.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2830000000000001e-05 2024-09-13T05:13:32.643 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.643 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.643 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:32.643 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.969912+0000", 2024-09-13T05:13:32.643 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6853999999999994e-05 2024-09-13T05:13:32.643 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.643 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.644 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:32.644 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.970078+0000", 2024-09-13T05:13:32.644 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000166317 2024-09-13T05:13:32.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.644 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.644 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 2", 2024-09-13T05:13:32.644 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.970219+0000", 2024-09-13T05:13:32.644 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000141077 2024-09-13T05:13:32.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.644 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.645 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:32.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.972106+0000", 2024-09-13T05:13:32.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0018869469999999999 2024-09-13T05:13:32.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.645 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:32.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976321+0000", 2024-09-13T05:13:32.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0042147850000000004 2024-09-13T05:13:32.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.645 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.645 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:32.645 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976381+0000", 2024-09-13T05:13:32.645 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9432999999999998e-05 2024-09-13T05:13:32.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.646 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.646 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:32.646 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976430+0000", 2024-09-13T05:13:32.646 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9874999999999999e-05 2024-09-13T05:13:32.646 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.646 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:32.646 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.646 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.646 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:206397 3.1a 3:588be705:::rbd_data.112d52e13700.0000000000000017:head [delete] snapc 15=[] ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-13T05:13:32.646 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:12.976313+0000", 2024-09-13T05:13:32.646 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.612104713000001, 2024-09-13T05:13:32.646 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0072561070000000004, 2024-09-13T05:13:32.647 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:32.647 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:32.647 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:32.647 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:32.647 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.647 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 206397 2024-09-13T05:13:32.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.647 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:32.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.647 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:32.647 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976313+0000", 2024-09-13T05:13:32.647 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.648 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.648 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:32.648 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976313+0000", 2024-09-13T05:13:32.648 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.648 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.648 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:32.648 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976310+0000", 2024-09-13T05:13:32.648 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:13:32.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.648 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.648 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:32.649 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976333+0000", 2024-09-13T05:13:32.649 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2212999999999999e-05 2024-09-13T05:13:32.649 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.649 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.649 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:32.649 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976352+0000", 2024-09-13T05:13:32.649 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9332000000000001e-05 2024-09-13T05:13:32.649 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.649 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.649 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.649 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976366+0000", 2024-09-13T05:13:32.649 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3801999999999999e-05 2024-09-13T05:13:32.649 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.650 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.650 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:32.650 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976511+0000", 2024-09-13T05:13:32.650 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014525900000000001 2024-09-13T05:13:32.650 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.650 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.650 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:32.650 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976753+0000", 2024-09-13T05:13:32.650 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024178099999999999 2024-09-13T05:13:32.650 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.650 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.650 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:32.650 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976926+0000", 2024-09-13T05:13:32.650 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000173234 2024-09-13T05:13:32.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.651 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.651 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:32.651 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.978566+0000", 2024-09-13T05:13:32.651 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001639691 2024-09-13T05:13:32.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.651 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.651 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:32.651 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.983483+0000", 2024-09-13T05:13:32.651 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0049168119999999996 2024-09-13T05:13:32.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.651 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.651 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:32.651 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.983532+0000", 2024-09-13T05:13:32.651 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.905e-05 2024-09-13T05:13:32.652 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.652 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.652 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:32.652 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.983569+0000", 2024-09-13T05:13:32.652 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7211e-05 2024-09-13T05:13:32.652 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.652 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:32.652 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.652 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.652 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.652 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:206463 3.1b 3:dad20942:::rbd_header.112d7db0ee5a:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e179)", 2024-09-13T05:13:32.652 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:13.644990+0000", 2024-09-13T05:13:32.652 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.943427610000001, 2024-09-13T05:13:32.653 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010238102000000001, 2024-09-13T05:13:32.653 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:32.653 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:32.653 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:32.653 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:32.653 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.653 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 206463 2024-09-13T05:13:32.653 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.653 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:32.653 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.653 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:32.653 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.644990+0000", 2024-09-13T05:13:32.653 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.654 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.654 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:32.654 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.644990+0000", 2024-09-13T05:13:32.654 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.654 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.654 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:32.654 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.644987+0000", 2024-09-13T05:13:32.654 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:13:32.654 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.654 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:32.655 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.645003+0000", 2024-09-13T05:13:32.655 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6322999999999999e-05 2024-09-13T05:13:32.655 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.655 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.655 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:32.655 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.645029+0000", 2024-09-13T05:13:32.655 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5177e-05 2024-09-13T05:13:32.655 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.655 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.655 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.655 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.645047+0000", 2024-09-13T05:13:32.655 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8281999999999999e-05 2024-09-13T05:13:32.656 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.656 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.656 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:32.656 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.645284+0000", 2024-09-13T05:13:32.656 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00023681 2024-09-13T05:13:32.656 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.656 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.656 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op must wait for map", 2024-09-13T05:13:32.656 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.645297+0000", 2024-09-13T05:13:32.656 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3509999999999999e-05 2024-09-13T05:13:32.656 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.656 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.656 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:32.657 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.650969+0000", 2024-09-13T05:13:32.657 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0056719170000000003 2024-09-13T05:13:32.657 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.657 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.657 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:32.657 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.651072+0000", 2024-09-13T05:13:32.657 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010320200000000001 2024-09-13T05:13:32.657 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.657 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.657 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 7", 2024-09-13T05:13:32.657 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.651487+0000", 2024-09-13T05:13:32.657 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00041497300000000001 2024-09-13T05:13:32.657 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.658 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.658 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:32.658 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.653970+0000", 2024-09-13T05:13:32.658 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002483074 2024-09-13T05:13:32.658 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.658 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.658 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:32.658 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.655150+0000", 2024-09-13T05:13:32.658 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001179963 2024-09-13T05:13:32.659 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.659 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.659 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:32.659 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.655182+0000", 2024-09-13T05:13:32.659 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1531e-05 2024-09-13T05:13:32.659 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.659 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.659 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:32.659 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.655228+0000", 2024-09-13T05:13:32.659 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6106000000000002e-05 2024-09-13T05:13:32.659 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.659 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:32.659 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.659 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.660 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.660 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7604 3.13 e182/153 3:cb3c550a:::rbd_data.112d4ee87f83.0000000000000004:13 v 182'1291, mlcod=181'1287)", 2024-09-13T05:13:32.660 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:16.863805+0000", 2024-09-13T05:13:32.660 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 15.724612259000001, 2024-09-13T05:13:32.660 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0066902530000000002, 2024-09-13T05:13:32.660 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:32.660 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:32.660 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:32.660 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.661 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:32.661 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.863805+0000", 2024-09-13T05:13:32.661 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.661 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.661 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.661 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:32.661 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.863805+0000", 2024-09-13T05:13:32.661 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.661 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.661 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.661 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:32.662 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.863805+0000", 2024-09-13T05:13:32.662 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:32.662 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.662 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.662 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:32.662 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.863814+0000", 2024-09-13T05:13:32.662 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.037e-06 2024-09-13T05:13:32.662 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.662 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.662 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:32.662 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.863823+0000", 2024-09-13T05:13:32.662 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7899999999999994e-06 2024-09-13T05:13:32.663 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.663 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.663 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.663 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.863830+0000", 2024-09-13T05:13:32.663 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6529999999999997e-06 2024-09-13T05:13:32.663 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.663 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.663 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:32.663 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.865683+0000", 2024-09-13T05:13:32.663 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001852991 2024-09-13T05:13:32.663 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.663 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.663 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:32.663 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.865702+0000", 2024-09-13T05:13:32.664 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8476999999999999e-05 2024-09-13T05:13:32.664 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.664 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.664 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:32.664 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.870460+0000", 2024-09-13T05:13:32.664 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0047586640000000001 2024-09-13T05:13:32.664 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.664 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.664 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:32.664 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.870495+0000", 2024-09-13T05:13:32.664 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5231000000000002e-05 2024-09-13T05:13:32.664 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.664 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:32.664 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.665 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.665 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.665 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:206716 3.3 3:c4c92e5a:::rbd_trash:head [call rbd.trash_state_set in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e183)", 2024-09-13T05:13:32.665 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:17.875773+0000", 2024-09-13T05:13:32.665 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.712644314, 2024-09-13T05:13:32.665 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.77872504200000003, 2024-09-13T05:13:32.665 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:32.665 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:32.665 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:32.665 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:32.665 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.665 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 206716 2024-09-13T05:13:32.665 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.666 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:32.666 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.666 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:32.666 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:17.875773+0000", 2024-09-13T05:13:32.666 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.666 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.666 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.666 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:32.666 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:17.875773+0000", 2024-09-13T05:13:32.667 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.667 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.667 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.667 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:32.667 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:17.875771+0000", 2024-09-13T05:13:32.667 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:32.667 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.667 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.667 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:32.667 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:17.875782+0000", 2024-09-13T05:13:32.667 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0927000000000001e-05 2024-09-13T05:13:32.667 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.668 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.668 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:32.668 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:17.875819+0000", 2024-09-13T05:13:32.668 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6950999999999999e-05 2024-09-13T05:13:32.668 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.668 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.668 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.668 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:17.875826+0000", 2024-09-13T05:13:32.668 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3819999999999998e-06 2024-09-13T05:13:32.668 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.668 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.668 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:32.668 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:17.875889+0000", 2024-09-13T05:13:32.668 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2759e-05 2024-09-13T05:13:32.668 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.669 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.669 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:32.669 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:17.875901+0000", 2024-09-13T05:13:32.669 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.132e-05 2024-09-13T05:13:32.669 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.669 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.669 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:32.669 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:18.652145+0000", 2024-09-13T05:13:32.669 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.77624458699999999 2024-09-13T05:13:32.669 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.669 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.669 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:32.669 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:18.652344+0000", 2024-09-13T05:13:32.669 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000199178 2024-09-13T05:13:32.670 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.670 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.670 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 6", 2024-09-13T05:13:32.670 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:18.652613+0000", 2024-09-13T05:13:32.670 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000269125 2024-09-13T05:13:32.670 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.670 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.670 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:32.670 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:18.654358+0000", 2024-09-13T05:13:32.670 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001744616 2024-09-13T05:13:32.670 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.670 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.670 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:32.670 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:18.654405+0000", 2024-09-13T05:13:32.671 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7206999999999997e-05 2024-09-13T05:13:32.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.671 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.671 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:32.671 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:18.654452+0000", 2024-09-13T05:13:32.671 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6347999999999997e-05 2024-09-13T05:13:32.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.671 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.671 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:32.671 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:18.654498+0000", 2024-09-13T05:13:32.671 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6638999999999998e-05 2024-09-13T05:13:32.671 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.671 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:32.671 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.672 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.672 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.3.0:5427 3.b e187/149 3:d275a035:::rbd_data.112d4ab2162d.000000000000000a:10 v 187'679, mlcod=175'676)", 2024-09-13T05:13:32.672 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:21.651643+0000", 2024-09-13T05:13:32.672 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 10.936774128, 2024-09-13T05:13:32.672 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0093737390000000007, 2024-09-13T05:13:32.672 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:32.672 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:32.672 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:32.672 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.672 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:32.672 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.651643+0000", 2024-09-13T05:13:32.672 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.672 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.672 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.673 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:32.673 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.651643+0000", 2024-09-13T05:13:32.673 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.673 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.673 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:32.673 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.651642+0000", 2024-09-13T05:13:32.673 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:32.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.673 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.673 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:32.673 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.651661+0000", 2024-09-13T05:13:32.673 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8759000000000001e-05 2024-09-13T05:13:32.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.674 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.674 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:32.674 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.651685+0000", 2024-09-13T05:13:32.674 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4087000000000002e-05 2024-09-13T05:13:32.674 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.674 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.674 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.674 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.651705+0000", 2024-09-13T05:13:32.674 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0319e-05 2024-09-13T05:13:32.674 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.674 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.674 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:32.675 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.652024+0000", 2024-09-13T05:13:32.675 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00031840999999999998 2024-09-13T05:13:32.675 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.675 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.675 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:32.675 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.652076+0000", 2024-09-13T05:13:32.675 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1848999999999998e-05 2024-09-13T05:13:32.676 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.676 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.676 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:32.676 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.660976+0000", 2024-09-13T05:13:32.676 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0088998830000000008 2024-09-13T05:13:32.676 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.676 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.676 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:32.676 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.661017+0000", 2024-09-13T05:13:32.676 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1508000000000003e-05 2024-09-13T05:13:32.676 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.676 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:32.677 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.677 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.680 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.680 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:207147 3.1a 3:5d866ee1:::rbd_header.112d4ab2162d:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-13T05:13:32.681 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:21.655963+0000", 2024-09-13T05:13:32.681 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 10.932454315999999, 2024-09-13T05:13:32.681 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0096366379999999995, 2024-09-13T05:13:32.681 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:32.681 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:32.681 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:32.681 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:32.681 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.681 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 207147 2024-09-13T05:13:32.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.681 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:32.681 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.681 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:32.681 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.655963+0000", 2024-09-13T05:13:32.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.682 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:32.682 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.655963+0000", 2024-09-13T05:13:32.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.682 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:32.682 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.655960+0000", 2024-09-13T05:13:32.682 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:13:32.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.682 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.682 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:32.683 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.655974+0000", 2024-09-13T05:13:32.683 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3774000000000001e-05 2024-09-13T05:13:32.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.683 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.683 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:32.683 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.656003+0000", 2024-09-13T05:13:32.683 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8809000000000001e-05 2024-09-13T05:13:32.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.683 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.683 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.683 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.656022+0000", 2024-09-13T05:13:32.683 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8536e-05 2024-09-13T05:13:32.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.683 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.684 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:32.684 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.656120+0000", 2024-09-13T05:13:32.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8678000000000006e-05 2024-09-13T05:13:32.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.684 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:32.684 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.656255+0000", 2024-09-13T05:13:32.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000134463 2024-09-13T05:13:32.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.684 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:32.684 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.656700+0000", 2024-09-13T05:13:32.684 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00044488399999999999 2024-09-13T05:13:32.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.685 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:32.685 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.661812+0000", 2024-09-13T05:13:32.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0051123430000000001 2024-09-13T05:13:32.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.685 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:32.685 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.665519+0000", 2024-09-13T05:13:32.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0037070839999999998 2024-09-13T05:13:32.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.685 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:32.685 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.665566+0000", 2024-09-13T05:13:32.685 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6575e-05 2024-09-13T05:13:32.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.685 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.686 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:32.686 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.665600+0000", 2024-09-13T05:13:32.686 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4162000000000003e-05 2024-09-13T05:13:32.686 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.686 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:32.686 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.686 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.686 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.686 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:207961 3.3 3:c18708b2:::rbd_data.112d356d780d.0000000000000006:head [delete] snapc c=[] ondisk+write+known_if_redirected+supports_pool_eio e192)", 2024-09-13T05:13:32.686 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:26.842059+0000", 2024-09-13T05:13:32.686 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.7463581000000001, 2024-09-13T05:13:32.686 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0064721809999999996, 2024-09-13T05:13:32.686 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:32.686 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:32.686 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:32.686 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:32.687 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.687 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 207961 2024-09-13T05:13:32.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.687 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:32.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:32.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.842059+0000", 2024-09-13T05:13:32.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.687 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:32.687 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.842059+0000", 2024-09-13T05:13:32.687 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.687 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.688 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:32.688 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.842056+0000", 2024-09-13T05:13:32.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999962 2024-09-13T05:13:32.688 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.688 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.688 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:32.688 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.842065+0000", 2024-09-13T05:13:32.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4169999999999998e-06 2024-09-13T05:13:32.688 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.688 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.688 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:32.688 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.842080+0000", 2024-09-13T05:13:32.688 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5373999999999999e-05 2024-09-13T05:13:32.688 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.688 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.689 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.689 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.842092+0000", 2024-09-13T05:13:32.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1894e-05 2024-09-13T05:13:32.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.689 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.689 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:32.689 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.843983+0000", 2024-09-13T05:13:32.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0018906350000000001 2024-09-13T05:13:32.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.689 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.689 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:32.689 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.844225+0000", 2024-09-13T05:13:32.689 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024239199999999999 2024-09-13T05:13:32.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.689 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 6", 2024-09-13T05:13:32.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.844476+0000", 2024-09-13T05:13:32.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025110300000000002 2024-09-13T05:13:32.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:32.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.846688+0000", 2024-09-13T05:13:32.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022111600000000002 2024-09-13T05:13:32.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:32.690 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.848425+0000", 2024-09-13T05:13:32.690 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0017371680000000001 2024-09-13T05:13:32.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.690 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.690 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:32.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.848484+0000", 2024-09-13T05:13:32.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9327999999999998e-05 2024-09-13T05:13:32.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.691 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:32.691 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.848532+0000", 2024-09-13T05:13:32.691 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7459000000000001e-05 2024-09-13T05:13:32.691 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.691 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:32.691 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.691 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.691 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.691 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:208126 3.9 3:970b18bb:::rbd_header.112de12546cf:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e193)", 2024-09-13T05:13:32.692 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:27.719589+0000", 2024-09-13T05:13:32.692 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.8688281409999998, 2024-09-13T05:13:32.692 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0071952020000000004, 2024-09-13T05:13:32.692 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:32.692 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:32.692 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:32.692 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:32.692 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.692 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 208126 2024-09-13T05:13:32.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.693 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:32.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:32.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.719589+0000", 2024-09-13T05:13:32.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.693 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:32.693 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.719589+0000", 2024-09-13T05:13:32.693 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.693 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:32.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.719587+0000", 2024-09-13T05:13:32.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:32.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:32.694 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.719599+0000", 2024-09-13T05:13:32.694 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1569000000000001e-05 2024-09-13T05:13:32.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.694 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.694 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:32.695 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.719620+0000", 2024-09-13T05:13:32.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0801e-05 2024-09-13T05:13:32.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.695 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.695 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.719636+0000", 2024-09-13T05:13:32.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6279000000000001e-05 2024-09-13T05:13:32.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.695 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:32.695 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.719731+0000", 2024-09-13T05:13:32.695 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5422999999999998e-05 2024-09-13T05:13:32.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.695 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op must wait for map", 2024-09-13T05:13:32.696 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.719743+0000", 2024-09-13T05:13:32.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1933000000000001e-05 2024-09-13T05:13:32.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.696 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.696 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:32.696 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.723588+0000", 2024-09-13T05:13:32.696 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0038447759999999998 2024-09-13T05:13:32.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.696 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:32.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.723822+0000", 2024-09-13T05:13:32.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00023412300000000001 2024-09-13T05:13:32.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 2", 2024-09-13T05:13:32.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.724748+0000", 2024-09-13T05:13:32.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00092563200000000002 2024-09-13T05:13:32.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.697 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.697 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:32.697 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.726702+0000", 2024-09-13T05:13:32.697 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001953869 2024-09-13T05:13:32.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:32.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.726707+0000", 2024-09-13T05:13:32.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4299999999999997e-06 2024-09-13T05:13:32.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:32.698 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.726748+0000", 2024-09-13T05:13:32.698 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1248999999999998e-05 2024-09-13T05:13:32.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.698 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.698 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:32.699 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.726785+0000", 2024-09-13T05:13:32.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6127999999999997e-05 2024-09-13T05:13:32.699 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.699 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:32.699 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.699 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:208221 3.14 3:28bfe33d:::rbd_data.112de12546cf.0000000000000005:head [delete] snapc b=[] ondisk+write+known_if_redirected+supports_pool_eio e193)", 2024-09-13T05:13:32.699 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:27.852395+0000", 2024-09-13T05:13:32.699 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.7360220079999999, 2024-09-13T05:13:32.699 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0096741420000000002, 2024-09-13T05:13:32.699 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:32.699 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:32.700 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:32.700 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:32.700 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.700 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 208221 2024-09-13T05:13:32.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.700 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:32.700 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.700 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:32.700 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.852395+0000", 2024-09-13T05:13:32.700 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:32.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.852395+0000", 2024-09-13T05:13:32.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.701 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:32.701 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.852393+0000", 2024-09-13T05:13:32.701 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:32.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.701 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.702 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:32.702 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.852421+0000", 2024-09-13T05:13:32.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7294999999999999e-05 2024-09-13T05:13:32.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.702 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:32.702 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.852464+0000", 2024-09-13T05:13:32.702 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3590000000000001e-05 2024-09-13T05:13:32.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.702 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.852486+0000", 2024-09-13T05:13:32.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1529e-05 2024-09-13T05:13:32.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.703 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.703 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:32.703 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.852702+0000", 2024-09-13T05:13:32.703 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021623599999999999 2024-09-13T05:13:32.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:32.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.853044+0000", 2024-09-13T05:13:32.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00034190400000000003 2024-09-13T05:13:32.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.704 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 7", 2024-09-13T05:13:32.704 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.853306+0000", 2024-09-13T05:13:32.704 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000262229 2024-09-13T05:13:32.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:32.705 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.855348+0000", 2024-09-13T05:13:32.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020413850000000002 2024-09-13T05:13:32.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.705 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:32.705 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.861823+0000", 2024-09-13T05:13:32.705 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0064753989999999997 2024-09-13T05:13:32.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.705 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.706 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:32.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.861931+0000", 2024-09-13T05:13:32.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000108125 2024-09-13T05:13:32.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.706 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:32.706 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.862070+0000", 2024-09-13T05:13:32.706 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013847999999999999 2024-09-13T05:13:32.706 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.706 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:32.706 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.706 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.707 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:209100 3.3 3:c6dd2174:::rbd_data.112d265b2a09.0000000000000006:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e197)", 2024-09-13T05:13:32.707 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:31.871799+0000", 2024-09-13T05:13:32.707 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.71661872299999996, 2024-09-13T05:13:32.707 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.006720798, 2024-09-13T05:13:32.707 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:32.707 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:32.707 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:32.707 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:32.707 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.707 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 209100 2024-09-13T05:13:32.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.707 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:32.707 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.707 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:32.707 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.871799+0000", 2024-09-13T05:13:32.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:32.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.871799+0000", 2024-09-13T05:13:32.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:32.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.871796+0000", 2024-09-13T05:13:32.708 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:13:32.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.708 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.708 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:32.708 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.871811+0000", 2024-09-13T05:13:32.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4939999999999999e-05 2024-09-13T05:13:32.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.709 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:32.709 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.871850+0000", 2024-09-13T05:13:32.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8275999999999997e-05 2024-09-13T05:13:32.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.709 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.709 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.871870+0000", 2024-09-13T05:13:32.709 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0720000000000002e-05 2024-09-13T05:13:32.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.709 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.709 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:32.709 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.874434+0000", 2024-09-13T05:13:32.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025637139999999999 2024-09-13T05:13:32.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:32.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.875064+0000", 2024-09-13T05:13:32.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00063018299999999998 2024-09-13T05:13:32.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 6", 2024-09-13T05:13:32.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.875263+0000", 2024-09-13T05:13:32.710 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000198533 2024-09-13T05:13:32.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.710 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:32.710 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.877094+0000", 2024-09-13T05:13:32.711 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0018311009999999999 2024-09-13T05:13:32.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.711 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:32.711 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.878416+0000", 2024-09-13T05:13:32.711 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0013220479999999999 2024-09-13T05:13:32.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.711 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:32.711 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.878476+0000", 2024-09-13T05:13:32.711 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9963999999999997e-05 2024-09-13T05:13:32.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.711 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.712 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:32.712 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.878520+0000", 2024-09-13T05:13:32.712 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3639e-05 2024-09-13T05:13:32.712 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.712 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:32.712 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.712 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.712 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:209101 3.1b 3:ddb2a2f1:::rbd_data.112d265b2a09.0000000000000007:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e197)", 2024-09-13T05:13:32.712 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:31.871905+0000", 2024-09-13T05:13:32.712 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 0.71651260800000005, 2024-09-13T05:13:32.712 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0076996640000000002, 2024-09-13T05:13:32.712 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:32.713 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:32.713 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:32.713 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:32.713 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:32.713 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 209101 2024-09-13T05:13:32.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.713 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:32.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.713 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:32.713 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.871905+0000", 2024-09-13T05:13:32.713 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.713 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:32.714 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.871905+0000", 2024-09-13T05:13:32.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:32.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:32.714 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.871903+0000", 2024-09-13T05:13:32.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:32.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.714 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:32.714 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.871912+0000", 2024-09-13T05:13:32.714 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5699999999999993e-06 2024-09-13T05:13:32.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.714 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.715 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:32.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.871930+0000", 2024-09-13T05:13:32.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8063e-05 2024-09-13T05:13:32.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.715 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:32.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.871944+0000", 2024-09-13T05:13:32.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4082e-05 2024-09-13T05:13:32.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.715 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:32.715 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.873792+0000", 2024-09-13T05:13:32.715 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001848043 2024-09-13T05:13:32.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.715 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.716 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:32.716 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.874044+0000", 2024-09-13T05:13:32.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025172500000000001 2024-09-13T05:13:32.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.716 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.716 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 7", 2024-09-13T05:13:32.716 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.874299+0000", 2024-09-13T05:13:32.716 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025515999999999999 2024-09-13T05:13:32.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.717 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:32.717 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.877084+0000", 2024-09-13T05:13:32.717 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0027854170000000001 2024-09-13T05:13:32.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.717 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:32.717 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.879350+0000", 2024-09-13T05:13:32.717 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00226531 2024-09-13T05:13:32.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.717 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:32.717 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.879429+0000", 2024-09-13T05:13:32.717 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9376999999999996e-05 2024-09-13T05:13:32.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:32.718 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:32.718 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:32.718 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.879605+0000", 2024-09-13T05:13:32.718 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017558 2024-09-13T05:13:32.718 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.718 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:32.718 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.718 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:32.718 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:32.718 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:32.719 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:13:32.720 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:13:32.720 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:13:32.721 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:32.715+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:32.727 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:13:32.749 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:13:32.771 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T05:13:32.775 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:13:32.800 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:13:32.820 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:32.814+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:32.822 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:13:32.844 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:13:32.847 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:13:32.847 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:13:32.847 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:13:32.847 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:13:32.847 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:13:32.847 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:13:32.847 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:13:32.847 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:13:32.856 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:32.856 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:32.867 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:13:32.921 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:32.918+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:32.980 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:32.980 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:32.990 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:13:33.022 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:33.019+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:33.092 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:33.092 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:33.102 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:13:33.150 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:33.147+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:33.210 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:33.210 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:33.219 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:13:33.224 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:33.219+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:33.323 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:33.324 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:33.325 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:33.319+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:33.333 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:13:33.426 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:33.423+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:33.440 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:33.440 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:33.450 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:13:33.527 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:33.522+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:33.559 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:33.559 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:33.569 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:13:33.628 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:33.623+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:33.661 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is set 2024-09-13T05:13:33.687 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:33.687 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:33.697 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:13:33.742 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:33.739+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:33.830 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:33.827+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:33.854 INFO:teuthology.orchestra.run.smithi137.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:33.854 INFO:teuthology.orchestra.run.smithi137.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:33.864 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:13:33.930 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:33.926+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:33.981 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:33.982 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:33.992 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:13:34.031 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:34.026+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:34.104 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:34.104 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:34.114 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:13:34.132 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:34.127+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:34.233 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:34.227+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:34.265 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:34.265 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:34.274 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T05:13:34.334 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:34.331+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:34.385 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:34.385 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:34.394 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T05:13:34.435 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:34.430+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:34.500 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:34.501 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:34.510 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T05:13:34.536 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:34.530+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:34.614 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:34.614 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:34.623 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T05:13:34.665 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:34.662+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:34.738 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-09-13T05:13:34.734+0000 7fb3fc582700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 22317) UID: 0 2024-09-13T05:13:34.775 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:34.775 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:34.787 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T05:13:34.839 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:34.834+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:34.862 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T05:13:34.889 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-13T05:13:34.889 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T05:13:34.899 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T05:13:34.943 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-13T05:13:34.938+0000 7f785838b700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 22158) UID: 0 2024-09-13T05:13:35.009 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0: {} 2024-09-13T05:13:35.027 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1: {} 2024-09-13T05:13:35.041 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-13T05:13:35.038+0000 7fc2511bb700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22160) UID: 0 2024-09-13T05:13:35.046 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2: {} 2024-09-13T05:13:35.050 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:35.051 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:13:35.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:13:35.051 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:13:35.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.051 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136560 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3908608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:35.051 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:13:35.051 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 101.951338154, 2024-09-13T05:13:35.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056148103999999997, 2024-09-13T05:13:35.051 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.051 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.052 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136560 2024-09-13T05:13:35.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.052 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:13:35.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095290+0000", 2024-09-13T05:13:35.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095289+0000", 2024-09-13T05:13:35.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:35.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095292+0000", 2024-09-13T05:13:35.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.802e-06 2024-09-13T05:13:35.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095318+0000", 2024-09-13T05:13:35.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5987999999999999e-05 2024-09-13T05:13:35.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095323+0000", 2024-09-13T05:13:35.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.006e-06 2024-09-13T05:13:35.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151316+0000", 2024-09-13T05:13:35.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.055992593 2024-09-13T05:13:35.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151371+0000", 2024-09-13T05:13:35.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5532999999999998e-05 2024-09-13T05:13:35.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151438+0000", 2024-09-13T05:13:35.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6557999999999995e-05 2024-09-13T05:13:35.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.055 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.055 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136562 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3922944~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:35.055 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:13:35.056 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 101.951301036, 2024-09-13T05:13:35.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056259690000000001, 2024-09-13T05:13:35.056 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.056 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.056 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.056 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.056 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.056 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136562 2024-09-13T05:13:35.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.056 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:13:35.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:13:35.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095327+0000", 2024-09-13T05:13:35.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:35.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095329+0000", 2024-09-13T05:13:35.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3089999999999998e-06 2024-09-13T05:13:35.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095333+0000", 2024-09-13T05:13:35.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6239999999999999e-06 2024-09-13T05:13:35.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095335+0000", 2024-09-13T05:13:35.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5660000000000001e-06 2024-09-13T05:13:35.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151468+0000", 2024-09-13T05:13:35.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056132608000000001 2024-09-13T05:13:35.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151519+0000", 2024-09-13T05:13:35.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1681000000000002e-05 2024-09-13T05:13:35.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151587+0000", 2024-09-13T05:13:35.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7200999999999996e-05 2024-09-13T05:13:35.060 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.060 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.060 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.060 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136563 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3937280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:35.060 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:13:35.060 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 101.951289614, 2024-09-13T05:13:35.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056393051999999999, 2024-09-13T05:13:35.060 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.060 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.061 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136563 2024-09-13T05:13:35.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.061 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:13:35.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:13:35.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095338+0000", 2024-09-13T05:13:35.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:13:35.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095340+0000", 2024-09-13T05:13:35.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.561e-06 2024-09-13T05:13:35.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095342+0000", 2024-09-13T05:13:35.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8059999999999999e-06 2024-09-13T05:13:35.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095345+0000", 2024-09-13T05:13:35.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:13:35.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151621+0000", 2024-09-13T05:13:35.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056275602000000001 2024-09-13T05:13:35.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151670+0000", 2024-09-13T05:13:35.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9478000000000003e-05 2024-09-13T05:13:35.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151731+0000", 2024-09-13T05:13:35.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1054000000000002e-05 2024-09-13T05:13:35.064 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.064 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.064 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.065 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136565 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3951616~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:35.065 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:13:35.065 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 101.9512793, 2024-09-13T05:13:35.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056524090999999999, 2024-09-13T05:13:35.065 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.065 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.065 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.065 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.065 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.065 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136565 2024-09-13T05:13:35.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.065 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:13:35.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095349+0000", 2024-09-13T05:13:35.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095348+0000", 2024-09-13T05:13:35.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-09-13T05:13:35.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095350+0000", 2024-09-13T05:13:35.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4479999999999999e-06 2024-09-13T05:13:35.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095353+0000", 2024-09-13T05:13:35.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.909e-06 2024-09-13T05:13:35.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095356+0000", 2024-09-13T05:13:35.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:13:35.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151763+0000", 2024-09-13T05:13:35.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056407813000000001 2024-09-13T05:13:35.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151812+0000", 2024-09-13T05:13:35.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8306999999999997e-05 2024-09-13T05:13:35.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151873+0000", 2024-09-13T05:13:35.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1064999999999999e-05 2024-09-13T05:13:35.069 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.069 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.069 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.069 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136567 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3965952~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:35.070 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:13:35.070 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 101.951270275, 2024-09-13T05:13:35.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056653907000000003, 2024-09-13T05:13:35.070 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.070 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.070 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.070 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.070 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.070 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136567 2024-09-13T05:13:35.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.070 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:13:35.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095358+0000", 2024-09-13T05:13:35.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095357+0000", 2024-09-13T05:13:35.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:35.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095359+0000", 2024-09-13T05:13:35.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5430000000000001e-06 2024-09-13T05:13:35.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095362+0000", 2024-09-13T05:13:35.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7939999999999998e-06 2024-09-13T05:13:35.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095365+0000", 2024-09-13T05:13:35.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9979999999999999e-06 2024-09-13T05:13:35.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151904+0000", 2024-09-13T05:13:35.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056539308000000003 2024-09-13T05:13:35.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.151953+0000", 2024-09-13T05:13:35.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8760000000000001e-05 2024-09-13T05:13:35.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152012+0000", 2024-09-13T05:13:35.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8761999999999997e-05 2024-09-13T05:13:35.074 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.074 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.074 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.074 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136569 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3980288~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:35.074 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:13:35.074 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 101.951234521, 2024-09-13T05:13:35.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056771237000000002, 2024-09-13T05:13:35.074 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.074 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.075 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.075 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136569 2024-09-13T05:13:35.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.075 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:13:35.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:13:35.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095393+0000", 2024-09-13T05:13:35.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:35.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095395+0000", 2024-09-13T05:13:35.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8870000000000001e-06 2024-09-13T05:13:35.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095402+0000", 2024-09-13T05:13:35.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6290000000000001e-06 2024-09-13T05:13:35.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095412+0000", 2024-09-13T05:13:35.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1730000000000001e-06 2024-09-13T05:13:35.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152044+0000", 2024-09-13T05:13:35.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056632016 2024-09-13T05:13:35.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152093+0000", 2024-09-13T05:13:35.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9570000000000001e-05 2024-09-13T05:13:35.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152165+0000", 2024-09-13T05:13:35.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1443e-05 2024-09-13T05:13:35.078 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.078 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.078 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.078 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136571 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3994624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:35.078 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:13:35.079 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 101.951213506, 2024-09-13T05:13:35.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056894741999999998, 2024-09-13T05:13:35.079 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.079 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.079 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136571 2024-09-13T05:13:35.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.079 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:13:35.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:13:35.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095414+0000", 2024-09-13T05:13:35.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:35.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095418+0000", 2024-09-13T05:13:35.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0210000000000001e-06 2024-09-13T05:13:35.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095422+0000", 2024-09-13T05:13:35.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5310000000000002e-06 2024-09-13T05:13:35.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095425+0000", 2024-09-13T05:13:35.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8880000000000001e-06 2024-09-13T05:13:35.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152198+0000", 2024-09-13T05:13:35.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056773563999999999 2024-09-13T05:13:35.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152249+0000", 2024-09-13T05:13:35.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1168999999999997e-05 2024-09-13T05:13:35.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152309+0000", 2024-09-13T05:13:35.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9821999999999997e-05 2024-09-13T05:13:35.083 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.083 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.083 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.083 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136573 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4008960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:35.083 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:13:35.083 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 101.951201279, 2024-09-13T05:13:35.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.057045810000000002, 2024-09-13T05:13:35.083 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.083 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.084 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136573 2024-09-13T05:13:35.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.085 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:13:35.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095427+0000", 2024-09-13T05:13:35.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095426+0000", 2024-09-13T05:13:35.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:35.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095428+0000", 2024-09-13T05:13:35.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.593e-06 2024-09-13T05:13:35.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095431+0000", 2024-09-13T05:13:35.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9610000000000001e-06 2024-09-13T05:13:35.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095434+0000", 2024-09-13T05:13:35.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-13T05:13:35.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152352+0000", 2024-09-13T05:13:35.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05691881 2024-09-13T05:13:35.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152401+0000", 2024-09-13T05:13:35.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8995000000000001e-05 2024-09-13T05:13:35.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152472+0000", 2024-09-13T05:13:35.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1060000000000001e-05 2024-09-13T05:13:35.088 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.088 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.088 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.088 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136575 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4023296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:35.088 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:13:35.088 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 101.95077128600001, 2024-09-13T05:13:35.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056760069000000003, 2024-09-13T05:13:35.088 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.089 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.089 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.089 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.089 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.089 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136575 2024-09-13T05:13:35.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.089 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:13:35.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095857+0000", 2024-09-13T05:13:35.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095437+0000", 2024-09-13T05:13:35.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9995799 2024-09-13T05:13:35.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095861+0000", 2024-09-13T05:13:35.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000424299 2024-09-13T05:13:35.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095869+0000", 2024-09-13T05:13:35.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5020000000000003e-06 2024-09-13T05:13:35.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095875+0000", 2024-09-13T05:13:35.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:13:35.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152502+0000", 2024-09-13T05:13:35.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056626528000000002 2024-09-13T05:13:35.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152556+0000", 2024-09-13T05:13:35.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4271000000000003e-05 2024-09-13T05:13:35.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152617+0000", 2024-09-13T05:13:35.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0896000000000001e-05 2024-09-13T05:13:35.092 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.092 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.092 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.093 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136577 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4037632~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:35.093 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:13:35.093 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 101.950669831, 2024-09-13T05:13:35.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056798242999999998, 2024-09-13T05:13:35.093 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.093 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.093 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.093 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.093 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.093 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136577 2024-09-13T05:13:35.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.093 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:13:35.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095958+0000", 2024-09-13T05:13:35.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095882+0000", 2024-09-13T05:13:35.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999242 2024-09-13T05:13:35.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095961+0000", 2024-09-13T05:13:35.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8864999999999998e-05 2024-09-13T05:13:35.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095973+0000", 2024-09-13T05:13:35.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2206e-05 2024-09-13T05:13:35.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095978+0000", 2024-09-13T05:13:35.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0629999999999996e-06 2024-09-13T05:13:35.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152646+0000", 2024-09-13T05:13:35.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056668035999999998 2024-09-13T05:13:35.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152695+0000", 2024-09-13T05:13:35.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8634000000000002e-05 2024-09-13T05:13:35.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152756+0000", 2024-09-13T05:13:35.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1315000000000005e-05 2024-09-13T05:13:35.097 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.097 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.097 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.097 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136579 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4051968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:35.097 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:13:35.097 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 101.950341736, 2024-09-13T05:13:35.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056610869000000001, 2024-09-13T05:13:35.097 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.097 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.098 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136579 2024-09-13T05:13:35.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.098 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:13:35.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096286+0000", 2024-09-13T05:13:35.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.095989+0000", 2024-09-13T05:13:35.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997029 2024-09-13T05:13:35.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096291+0000", 2024-09-13T05:13:35.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030221499999999999 2024-09-13T05:13:35.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096300+0000", 2024-09-13T05:13:35.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4819999999999994e-06 2024-09-13T05:13:35.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096306+0000", 2024-09-13T05:13:35.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-09-13T05:13:35.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152788+0000", 2024-09-13T05:13:35.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056481625000000001 2024-09-13T05:13:35.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152837+0000", 2024-09-13T05:13:35.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9345000000000003e-05 2024-09-13T05:13:35.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152897+0000", 2024-09-13T05:13:35.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9892999999999997e-05 2024-09-13T05:13:35.101 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.101 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.101 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.101 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136581 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4066304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:35.102 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:13:35.102 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 101.950162909, 2024-09-13T05:13:35.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056597091000000002, 2024-09-13T05:13:35.102 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.102 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.102 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136581 2024-09-13T05:13:35.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.102 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:13:35.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096465+0000", 2024-09-13T05:13:35.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096312+0000", 2024-09-13T05:13:35.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998465 2024-09-13T05:13:35.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096469+0000", 2024-09-13T05:13:35.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157109 2024-09-13T05:13:35.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096478+0000", 2024-09-13T05:13:35.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3260000000000002e-06 2024-09-13T05:13:35.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096482+0000", 2024-09-13T05:13:35.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9720000000000003e-06 2024-09-13T05:13:35.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152933+0000", 2024-09-13T05:13:35.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056451128000000003 2024-09-13T05:13:35.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.152993+0000", 2024-09-13T05:13:35.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9947000000000001e-05 2024-09-13T05:13:35.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153062+0000", 2024-09-13T05:13:35.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9105999999999999e-05 2024-09-13T05:13:35.105 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.106 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.106 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.106 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136583 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4080640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:35.106 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:13:35.106 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 101.94989699600001, 2024-09-13T05:13:35.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056496609000000003, 2024-09-13T05:13:35.106 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.106 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.106 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.106 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.106 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.107 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136583 2024-09-13T05:13:35.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.107 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:13:35.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096731+0000", 2024-09-13T05:13:35.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096485+0000", 2024-09-13T05:13:35.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997544 2024-09-13T05:13:35.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096735+0000", 2024-09-13T05:13:35.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024979899999999998 2024-09-13T05:13:35.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096742+0000", 2024-09-13T05:13:35.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7139999999999996e-06 2024-09-13T05:13:35.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096747+0000", 2024-09-13T05:13:35.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8709999999999996e-06 2024-09-13T05:13:35.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153099+0000", 2024-09-13T05:13:35.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056352639000000003 2024-09-13T05:13:35.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153168+0000", 2024-09-13T05:13:35.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9029000000000006e-05 2024-09-13T05:13:35.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153228+0000", 2024-09-13T05:13:35.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9339999999999998e-05 2024-09-13T05:13:35.110 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.110 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.110 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.110 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136585 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4094976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:35.110 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:13:35.111 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 101.94964552899999, 2024-09-13T05:13:35.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056396420000000003, 2024-09-13T05:13:35.111 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.111 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.111 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.111 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.111 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.111 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136585 2024-09-13T05:13:35.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.111 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:13:35.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096982+0000", 2024-09-13T05:13:35.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096750+0000", 2024-09-13T05:13:35.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997673 2024-09-13T05:13:35.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096986+0000", 2024-09-13T05:13:35.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000236297 2024-09-13T05:13:35.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096993+0000", 2024-09-13T05:13:35.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9600000000000003e-06 2024-09-13T05:13:35.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.096999+0000", 2024-09-13T05:13:35.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:13:35.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153264+0000", 2024-09-13T05:13:35.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056264728999999999 2024-09-13T05:13:35.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153318+0000", 2024-09-13T05:13:35.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3934000000000002e-05 2024-09-13T05:13:35.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153379+0000", 2024-09-13T05:13:35.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1206999999999999e-05 2024-09-13T05:13:35.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.114 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.115 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136586 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4109312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:35.115 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:13:35.115 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 101.949444727, 2024-09-13T05:13:35.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056374703999999998, 2024-09-13T05:13:35.115 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.115 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.115 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136586 2024-09-13T05:13:35.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.115 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:13:35.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097183+0000", 2024-09-13T05:13:35.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097004+0000", 2024-09-13T05:13:35.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998207 2024-09-13T05:13:35.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097187+0000", 2024-09-13T05:13:35.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018337900000000001 2024-09-13T05:13:35.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097198+0000", 2024-09-13T05:13:35.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0348e-05 2024-09-13T05:13:35.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097202+0000", 2024-09-13T05:13:35.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.121e-06 2024-09-13T05:13:35.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153411+0000", 2024-09-13T05:13:35.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056209510999999997 2024-09-13T05:13:35.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153464+0000", 2024-09-13T05:13:35.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2605000000000002e-05 2024-09-13T05:13:35.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153558+0000", 2024-09-13T05:13:35.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4017999999999993e-05 2024-09-13T05:13:35.119 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.119 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.119 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.119 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136588 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4123648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:35.119 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:13:35.119 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 101.94916054399999, 2024-09-13T05:13:35.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056274980000000002, 2024-09-13T05:13:35.119 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.119 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.119 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.119 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.120 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.120 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136588 2024-09-13T05:13:35.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.120 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:13:35.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097467+0000", 2024-09-13T05:13:35.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097205+0000", 2024-09-13T05:13:35.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9997377 2024-09-13T05:13:35.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097471+0000", 2024-09-13T05:13:35.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026628200000000001 2024-09-13T05:13:35.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097484+0000", 2024-09-13T05:13:35.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2493e-05 2024-09-13T05:13:35.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097488+0000", 2024-09-13T05:13:35.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9330000000000003e-06 2024-09-13T05:13:35.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153600+0000", 2024-09-13T05:13:35.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056112097 2024-09-13T05:13:35.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153654+0000", 2024-09-13T05:13:35.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4126000000000003e-05 2024-09-13T05:13:35.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153742+0000", 2024-09-13T05:13:35.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.831e-05 2024-09-13T05:13:35.123 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.123 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.123 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.123 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136589 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 4137984~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:35.123 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:13:35.124 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 101.949021237, 2024-09-13T05:13:35.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056293867999999997, 2024-09-13T05:13:35.124 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.124 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.124 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.124 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.124 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.124 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136589 2024-09-13T05:13:35.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.124 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:13:35.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097607+0000", 2024-09-13T05:13:35.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097491+0000", 2024-09-13T05:13:35.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9998841 2024-09-13T05:13:35.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097610+0000", 2024-09-13T05:13:35.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119263 2024-09-13T05:13:35.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097617+0000", 2024-09-13T05:13:35.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6490000000000002e-06 2024-09-13T05:13:35.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.097624+0000", 2024-09-13T05:13:35.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6309999999999997e-06 2024-09-13T05:13:35.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153779+0000", 2024-09-13T05:13:35.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056155153999999999 2024-09-13T05:13:35.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153831+0000", 2024-09-13T05:13:35.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2080000000000003e-05 2024-09-13T05:13:35.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.153901+0000", 2024-09-13T05:13:35.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9765999999999996e-05 2024-09-13T05:13:35.127 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.127 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.128 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.128 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136965 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3366912~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:35.128 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:13:35.128 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 101.929052416, 2024-09-13T05:13:35.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056225403, 2024-09-13T05:13:35.128 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.128 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.128 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.128 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.128 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.128 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136965 2024-09-13T05:13:35.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.129 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:13:35.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117576+0000", 2024-09-13T05:13:35.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117575+0000", 2024-09-13T05:13:35.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:35.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117578+0000", 2024-09-13T05:13:35.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4899999999999999e-06 2024-09-13T05:13:35.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117583+0000", 2024-09-13T05:13:35.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.074e-06 2024-09-13T05:13:35.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.117587+0000", 2024-09-13T05:13:35.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5360000000000003e-06 2024-09-13T05:13:35.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173622+0000", 2024-09-13T05:13:35.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056034527000000001 2024-09-13T05:13:35.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173704+0000", 2024-09-13T05:13:35.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2137000000000003e-05 2024-09-13T05:13:35.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.173801+0000", 2024-09-13T05:13:35.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7048999999999999e-05 2024-09-13T05:13:35.132 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.132 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.132 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.132 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:136991 3.1a 3:5efa555d:::rbd_data.112d52e08ead.0000000000000001:27 [read 3553280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-13T05:13:35.132 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:13:35.132 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 101.925126639, 2024-09-13T05:13:35.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056330199999999997, 2024-09-13T05:13:35.133 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.133 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.133 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.133 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.133 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.133 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136991 2024-09-13T05:13:35.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.133 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:13:35.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:13:35.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121501+0000", 2024-09-13T05:13:35.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:35.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121504+0000", 2024-09-13T05:13:35.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7199999999999998e-06 2024-09-13T05:13:35.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121510+0000", 2024-09-13T05:13:35.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3459999999999999e-06 2024-09-13T05:13:35.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.121515+0000", 2024-09-13T05:13:35.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.656e-06 2024-09-13T05:13:35.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177608+0000", 2024-09-13T05:13:35.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.056093267000000002 2024-09-13T05:13:35.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177717+0000", 2024-09-13T05:13:35.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010901299999999999 2024-09-13T05:13:35.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:53.177832+0000", 2024-09-13T05:13:35.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114604 2024-09-13T05:13:35.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.137 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.138 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:173672 3.9 3:9520c004:::rbd_data.112d7c1bedf7.0000000000000040:29 [read 186368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e132)", 2024-09-13T05:13:35.138 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:13:35.138 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.861232013999995, 2024-09-13T05:13:35.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.05682475, 2024-09-13T05:13:35.138 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.138 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.138 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173672 2024-09-13T05:13:35.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.138 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:13:35.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185396+0000", 2024-09-13T05:13:35.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185395+0000", 2024-09-13T05:13:35.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:35.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185398+0000", 2024-09-13T05:13:35.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8260000000000001e-06 2024-09-13T05:13:35.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185404+0000", 2024-09-13T05:13:35.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-09-13T05:13:35.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.185408+0000", 2024-09-13T05:13:35.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5279999999999997e-06 2024-09-13T05:13:35.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.236213+0000", 2024-09-13T05:13:35.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050805207999999998 2024-09-13T05:13:35.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.236285+0000", 2024-09-13T05:13:35.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1236999999999996e-05 2024-09-13T05:13:35.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:25.242221+0000", 2024-09-13T05:13:35.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059360050000000003 2024-09-13T05:13:35.142 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.142 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.142 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.142 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.142 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.142 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:35.144 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T05:13:35.145 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3: {} 2024-09-13T05:13:35.145 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4: {} 2024-09-13T05:13:35.145 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5: {} 2024-09-13T05:13:35.145 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6: {} 2024-09-13T05:13:35.145 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:35.138+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:35.161 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7: {} 2024-09-13T05:13:35.164 INFO:teuthology.orchestra.run.smithi120.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T05:13:35.164 INFO:teuthology.orchestra.run.smithi120.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T05:13:35.164 INFO:teuthology.orchestra.run.smithi120.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T05:13:35.164 INFO:teuthology.orchestra.run.smithi120.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T05:13:35.164 INFO:teuthology.orchestra.run.smithi120.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T05:13:35.164 INFO:teuthology.orchestra.run.smithi120.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T05:13:35.164 INFO:teuthology.orchestra.run.smithi120.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T05:13:35.164 INFO:teuthology.orchestra.run.smithi120.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T05:13:35.245 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-09-13T05:13:35.238+0000 7f17ff2c2700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 22315) UID: 0 2024-09-13T05:13:35.254 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:35.254 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:35.254 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:13:35.254 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:35.264 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T05:13:35.346 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-09-13T05:13:35.342+0000 7f1321fdd700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 22313) UID: 0 2024-09-13T05:13:35.369 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:13:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:13:35.370 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:35.379 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T05:13:35.447 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:35.442+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:35.491 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:35.491 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:13:35.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:13:35.491 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-13T05:13:35.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.491 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:70758 3.2 3:427d0469:::rbd_header.112d8d1317eb:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-09-13T05:13:35.491 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:13:35.491 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 132.05814264700001, 2024-09-13T05:13:35.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.190313603, 2024-09-13T05:13:35.491 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.491 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.492 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.492 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.492 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.492 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70758 2024-09-13T05:13:35.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.492 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:13:35.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428655+0000", 2024-09-13T05:13:35.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428654+0000", 2024-09-13T05:13:35.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:35.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428664+0000", 2024-09-13T05:13:35.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0664e-05 2024-09-13T05:13:35.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428683+0000", 2024-09-13T05:13:35.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8377e-05 2024-09-13T05:13:35.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428691+0000", 2024-09-13T05:13:35.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9400000000000008e-06 2024-09-13T05:13:35.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428789+0000", 2024-09-13T05:13:35.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7165999999999998e-05 2024-09-13T05:13:35.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:35.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.428811+0000", 2024-09-13T05:13:35.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1925000000000001e-05 2024-09-13T05:13:35.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.617921+0000", 2024-09-13T05:13:35.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.189110536 2024-09-13T05:13:35.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618344+0000", 2024-09-13T05:13:35.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042245800000000001 2024-09-13T05:13:35.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:11:23.618969+0000", 2024-09-13T05:13:35.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062529299999999996 2024-09-13T05:13:35.496 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.496 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.496 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.496 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162381 3.8 3.4e1a3768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:35.496 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:13:35.497 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 82.978136399999997, 2024-09-13T05:13:35.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.14690313199999999, 2024-09-13T05:13:35.497 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.497 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:13:35.497 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.497 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.497 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.497 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162381 2024-09-13T05:13:35.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.497 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:13:35.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508662+0000", 2024-09-13T05:13:35.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508659+0000", 2024-09-13T05:13:35.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:13:35.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508673+0000", 2024-09-13T05:13:35.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4154999999999999e-05 2024-09-13T05:13:35.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508703+0000", 2024-09-13T05:13:35.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9427000000000001e-05 2024-09-13T05:13:35.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508719+0000", 2024-09-13T05:13:35.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6381000000000001e-05 2024-09-13T05:13:35.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508789+0000", 2024-09-13T05:13:35.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9898000000000001e-05 2024-09-13T05:13:35.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:35.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.508799+0000", 2024-09-13T05:13:35.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0066e-05 2024-09-13T05:13:35.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655550+0000", 2024-09-13T05:13:35.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.146750506 2024-09-13T05:13:35.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655565+0000", 2024-09-13T05:13:35.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4915e-05 2024-09-13T05:13:35.501 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.501 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.501 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.501 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162393 3.8 3.fd966c88 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:35.501 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:13:35.501 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 82.966620325999997, 2024-09-13T05:13:35.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.135657895, 2024-09-13T05:13:35.501 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.502 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:13:35.502 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.502 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.502 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.502 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162393 2024-09-13T05:13:35.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.502 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:13:35.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520178+0000", 2024-09-13T05:13:35.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520176+0000", 2024-09-13T05:13:35.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-09-13T05:13:35.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520184+0000", 2024-09-13T05:13:35.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5800000000000003e-06 2024-09-13T05:13:35.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520199+0000", 2024-09-13T05:13:35.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4481000000000001e-05 2024-09-13T05:13:35.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520209+0000", 2024-09-13T05:13:35.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0327e-05 2024-09-13T05:13:35.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520351+0000", 2024-09-13T05:13:35.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141827 2024-09-13T05:13:35.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:35.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.520363+0000", 2024-09-13T05:13:35.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2018000000000001e-05 2024-09-13T05:13:35.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655819+0000", 2024-09-13T05:13:35.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13545665600000001 2024-09-13T05:13:35.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655835+0000", 2024-09-13T05:13:35.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6135000000000001e-05 2024-09-13T05:13:35.506 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.506 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.506 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.506 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162429 3.8 3.6e098f28 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:35.506 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:13:35.506 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 82.965769717000001, 2024-09-13T05:13:35.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13484765400000001, 2024-09-13T05:13:35.506 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.506 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:13:35.506 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.507 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.507 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.507 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162429 2024-09-13T05:13:35.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.507 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:13:35.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:13:35.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521028+0000", 2024-09-13T05:13:35.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:35.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521032+0000", 2024-09-13T05:13:35.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3039999999999998e-06 2024-09-13T05:13:35.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521041+0000", 2024-09-13T05:13:35.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6880000000000005e-06 2024-09-13T05:13:35.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521047+0000", 2024-09-13T05:13:35.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0100000000000001e-06 2024-09-13T05:13:35.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521601+0000", 2024-09-13T05:13:35.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00055398600000000002 2024-09-13T05:13:35.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:35.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.521613+0000", 2024-09-13T05:13:35.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2347000000000001e-05 2024-09-13T05:13:35.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655869+0000", 2024-09-13T05:13:35.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.134255597 2024-09-13T05:13:35.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655876+0000", 2024-09-13T05:13:35.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2790000000000001e-06 2024-09-13T05:13:35.510 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.511 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.511 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.511 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162521 3.8 3.f06bf7c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:35.511 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:13:35.511 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 82.963367586999993, 2024-09-13T05:13:35.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13247452600000001, 2024-09-13T05:13:35.511 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.511 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-09-13T05:13:35.511 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.511 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.511 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.511 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162521 2024-09-13T05:13:35.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.512 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:13:35.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:13:35.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523430+0000", 2024-09-13T05:13:35.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:35.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523433+0000", 2024-09-13T05:13:35.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.128e-06 2024-09-13T05:13:35.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523440+0000", 2024-09-13T05:13:35.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9990000000000002e-06 2024-09-13T05:13:35.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.523446+0000", 2024-09-13T05:13:35.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7869999999999998e-06 2024-09-13T05:13:35.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.528221+0000", 2024-09-13T05:13:35.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047747040000000003 2024-09-13T05:13:35.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:35.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.528237+0000", 2024-09-13T05:13:35.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6042e-05 2024-09-13T05:13:35.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655898+0000", 2024-09-13T05:13:35.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.127661521 2024-09-13T05:13:35.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655905+0000", 2024-09-13T05:13:35.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7780000000000002e-06 2024-09-13T05:13:35.516 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.516 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.517 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.517 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162381 3.8 3:16ec5872:::rbd_data.112dc3abcba6.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:35.517 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:13:35.517 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 82.953840421999999, 2024-09-13T05:13:35.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12546553899999999, 2024-09-13T05:13:35.517 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.517 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:35.517 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.517 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.517 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.517 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162381 2024-09-13T05:13:35.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.518 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:13:35.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532957+0000", 2024-09-13T05:13:35.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532956+0000", 2024-09-13T05:13:35.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:35.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532964+0000", 2024-09-13T05:13:35.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.072e-06 2024-09-13T05:13:35.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532976+0000", 2024-09-13T05:13:35.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1355000000000001e-05 2024-09-13T05:13:35.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532984+0000", 2024-09-13T05:13:35.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3440000000000001e-06 2024-09-13T05:13:35.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533432+0000", 2024-09-13T05:13:35.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044773000000000002 2024-09-13T05:13:35.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:35.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533439+0000", 2024-09-13T05:13:35.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9890000000000003e-06 2024-09-13T05:13:35.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.655985+0000", 2024-09-13T05:13:35.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122546527 2024-09-13T05:13:35.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656234+0000", 2024-09-13T05:13:35.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024911300000000003 2024-09-13T05:13:35.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:35.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656378+0000", 2024-09-13T05:13:35.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014417100000000001 2024-09-13T05:13:35.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:35.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657916+0000", 2024-09-13T05:13:35.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001537907 2024-09-13T05:13:35.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:13:35.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658308+0000", 2024-09-13T05:13:35.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039183700000000002 2024-09-13T05:13:35.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:13:35.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658364+0000", 2024-09-13T05:13:35.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5451000000000002e-05 2024-09-13T05:13:35.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658423+0000", 2024-09-13T05:13:35.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9449e-05 2024-09-13T05:13:35.523 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.523 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.523 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.523 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162393 3.8 3:113669bf:::rbd_data.112dfd94ee88.00000000000000bf:2a [read 131072~18432] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:35.523 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:13:35.524 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 82.953800642999994, 2024-09-13T05:13:35.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124231431, 2024-09-13T05:13:35.524 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.524 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.524 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.524 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.524 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.524 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162393 2024-09-13T05:13:35.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.524 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:13:35.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:13:35.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.532997+0000", 2024-09-13T05:13:35.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:35.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533001+0000", 2024-09-13T05:13:35.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8099999999999999e-06 2024-09-13T05:13:35.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533007+0000", 2024-09-13T05:13:35.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5849999999999996e-06 2024-09-13T05:13:35.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533012+0000", 2024-09-13T05:13:35.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0320000000000003e-06 2024-09-13T05:13:35.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533459+0000", 2024-09-13T05:13:35.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044646399999999999 2024-09-13T05:13:35.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:35.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533464+0000", 2024-09-13T05:13:35.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9180000000000002e-06 2024-09-13T05:13:35.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.656870+0000", 2024-09-13T05:13:35.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123406847 2024-09-13T05:13:35.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657067+0000", 2024-09-13T05:13:35.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019655599999999999 2024-09-13T05:13:35.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657229+0000", 2024-09-13T05:13:35.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016175599999999999 2024-09-13T05:13:35.528 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.528 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.528 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.529 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162429 3.8 3:14f19076:::rbd_data.112dfd94ee88.0000000000000150:2a [read 131072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:35.529 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:13:35.529 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 82.953781093000003, 2024-09-13T05:13:35.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124549956, 2024-09-13T05:13:35.529 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.529 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.529 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.529 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.529 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.529 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162429 2024-09-13T05:13:35.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.529 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:13:35.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533017+0000", 2024-09-13T05:13:35.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533016+0000", 2024-09-13T05:13:35.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:35.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533020+0000", 2024-09-13T05:13:35.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1049999999999999e-06 2024-09-13T05:13:35.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533025+0000", 2024-09-13T05:13:35.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-09-13T05:13:35.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533030+0000", 2024-09-13T05:13:35.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8999999999999997e-06 2024-09-13T05:13:35.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533481+0000", 2024-09-13T05:13:35.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045080400000000002 2024-09-13T05:13:35.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:35.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533486+0000", 2024-09-13T05:13:35.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3369999999999999e-06 2024-09-13T05:13:35.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657311+0000", 2024-09-13T05:13:35.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123824408 2024-09-13T05:13:35.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657464+0000", 2024-09-13T05:13:35.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015343900000000001 2024-09-13T05:13:35.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657567+0000", 2024-09-13T05:13:35.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102568 2024-09-13T05:13:35.533 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.533 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.533 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.534 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162521 3.8 3:13efd60f:::rbd_data.112dfd94ee88.000000000000031a:2a [read 131072~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:35.534 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:13:35.534 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 82.953629860000007, 2024-09-13T05:13:35.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124709257, 2024-09-13T05:13:35.534 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.534 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.534 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.534 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.535 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.535 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162521 2024-09-13T05:13:35.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.535 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:13:35.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:13:35.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533168+0000", 2024-09-13T05:13:35.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:35.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533170+0000", 2024-09-13T05:13:35.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3910000000000001e-06 2024-09-13T05:13:35.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533176+0000", 2024-09-13T05:13:35.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4029999999999998e-06 2024-09-13T05:13:35.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533180+0000", 2024-09-13T05:13:35.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6999999999999999e-06 2024-09-13T05:13:35.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533659+0000", 2024-09-13T05:13:35.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047839699999999998 2024-09-13T05:13:35.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:35.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.533664+0000", 2024-09-13T05:13:35.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7239999999999997e-06 2024-09-13T05:13:35.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657619+0000", 2024-09-13T05:13:35.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123954412 2024-09-13T05:13:35.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657784+0000", 2024-09-13T05:13:35.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016527499999999999 2024-09-13T05:13:35.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657877+0000", 2024-09-13T05:13:35.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3280000000000001e-05 2024-09-13T05:13:35.539 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.539 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.540 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.540 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162618 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 70656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:35.540 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:13:35.540 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 82.952325149999993, 2024-09-13T05:13:35.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.123752711, 2024-09-13T05:13:35.540 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.540 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.540 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.540 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.541 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.541 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162618 2024-09-13T05:13:35.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.541 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:13:35.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534473+0000", 2024-09-13T05:13:35.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534472+0000", 2024-09-13T05:13:35.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:35.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534475+0000", 2024-09-13T05:13:35.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2010000000000002e-06 2024-09-13T05:13:35.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534482+0000", 2024-09-13T05:13:35.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:13:35.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534486+0000", 2024-09-13T05:13:35.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7520000000000004e-06 2024-09-13T05:13:35.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536456+0000", 2024-09-13T05:13:35.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001969527 2024-09-13T05:13:35.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:35.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536462+0000", 2024-09-13T05:13:35.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2750000000000001e-06 2024-09-13T05:13:35.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.657939+0000", 2024-09-13T05:13:35.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121476769 2024-09-13T05:13:35.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658087+0000", 2024-09-13T05:13:35.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014862400000000001 2024-09-13T05:13:35.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658225+0000", 2024-09-13T05:13:35.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013800999999999999 2024-09-13T05:13:35.545 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.545 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.545 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.545 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162620 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 71680~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:35.545 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:13:35.545 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 82.952291024999994, 2024-09-13T05:13:35.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124087688, 2024-09-13T05:13:35.545 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.545 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.545 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.546 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.546 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.546 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162620 2024-09-13T05:13:35.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.546 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:13:35.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:13:35.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534507+0000", 2024-09-13T05:13:35.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:35.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534509+0000", 2024-09-13T05:13:35.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1270000000000001e-06 2024-09-13T05:13:35.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534514+0000", 2024-09-13T05:13:35.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8720000000000001e-06 2024-09-13T05:13:35.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534518+0000", 2024-09-13T05:13:35.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5090000000000004e-06 2024-09-13T05:13:35.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536485+0000", 2024-09-13T05:13:35.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019671530000000001 2024-09-13T05:13:35.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:35.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536491+0000", 2024-09-13T05:13:35.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3759999999999999e-06 2024-09-13T05:13:35.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658466+0000", 2024-09-13T05:13:35.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.121975466 2024-09-13T05:13:35.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658522+0000", 2024-09-13T05:13:35.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5668999999999998e-05 2024-09-13T05:13:35.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658595+0000", 2024-09-13T05:13:35.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2800999999999996e-05 2024-09-13T05:13:35.551 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.551 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.551 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.551 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162622 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 72704~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:35.552 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:13:35.552 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 82.952260057999993, 2024-09-13T05:13:35.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124215569, 2024-09-13T05:13:35.552 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.552 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.552 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.552 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.552 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.552 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162622 2024-09-13T05:13:35.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.553 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:13:35.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534538+0000", 2024-09-13T05:13:35.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534537+0000", 2024-09-13T05:13:35.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:35.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534540+0000", 2024-09-13T05:13:35.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3740000000000001e-06 2024-09-13T05:13:35.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534545+0000", 2024-09-13T05:13:35.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4210000000000003e-06 2024-09-13T05:13:35.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534550+0000", 2024-09-13T05:13:35.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3090000000000003e-06 2024-09-13T05:13:35.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536510+0000", 2024-09-13T05:13:35.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019597130000000001 2024-09-13T05:13:35.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:35.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536517+0000", 2024-09-13T05:13:35.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0620000000000003e-06 2024-09-13T05:13:35.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658632+0000", 2024-09-13T05:13:35.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122114373 2024-09-13T05:13:35.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658686+0000", 2024-09-13T05:13:35.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3882999999999999e-05 2024-09-13T05:13:35.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658753+0000", 2024-09-13T05:13:35.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7921000000000002e-05 2024-09-13T05:13:35.557 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.558 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.558 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.558 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162623 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 73728~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:35.558 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:13:35.558 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 82.952243253000006, 2024-09-13T05:13:35.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124350214, 2024-09-13T05:13:35.558 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.558 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.558 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.558 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.558 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.558 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162623 2024-09-13T05:13:35.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.559 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:13:35.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534555+0000", 2024-09-13T05:13:35.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534554+0000", 2024-09-13T05:13:35.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:35.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534556+0000", 2024-09-13T05:13:35.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.221e-06 2024-09-13T05:13:35.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534563+0000", 2024-09-13T05:13:35.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2890000000000003e-06 2024-09-13T05:13:35.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534567+0000", 2024-09-13T05:13:35.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4880000000000001e-06 2024-09-13T05:13:35.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536538+0000", 2024-09-13T05:13:35.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019703989999999998 2024-09-13T05:13:35.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:35.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536543+0000", 2024-09-13T05:13:35.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3920000000000002e-06 2024-09-13T05:13:35.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658773+0000", 2024-09-13T05:13:35.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122229607 2024-09-13T05:13:35.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658835+0000", 2024-09-13T05:13:35.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1954999999999999e-05 2024-09-13T05:13:35.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658905+0000", 2024-09-13T05:13:35.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-09-13T05:13:35.563 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.563 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.563 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.563 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162626 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 65536~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:35.563 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:13:35.563 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 82.952191968999998, 2024-09-13T05:13:35.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124425881, 2024-09-13T05:13:35.563 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.563 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.563 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.563 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.564 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.564 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162626 2024-09-13T05:13:35.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.564 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:13:35.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:13:35.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534606+0000", 2024-09-13T05:13:35.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:35.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534611+0000", 2024-09-13T05:13:35.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5419999999999996e-06 2024-09-13T05:13:35.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534617+0000", 2024-09-13T05:13:35.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5169999999999999e-06 2024-09-13T05:13:35.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534622+0000", 2024-09-13T05:13:35.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9810000000000003e-06 2024-09-13T05:13:35.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536563+0000", 2024-09-13T05:13:35.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019410549999999999 2024-09-13T05:13:35.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:35.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536568+0000", 2024-09-13T05:13:35.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4310000000000002e-06 2024-09-13T05:13:35.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658922+0000", 2024-09-13T05:13:35.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122354221 2024-09-13T05:13:35.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.658968+0000", 2024-09-13T05:13:35.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5221e-05 2024-09-13T05:13:35.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659032+0000", 2024-09-13T05:13:35.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4256000000000003e-05 2024-09-13T05:13:35.568 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.568 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.568 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.568 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162628 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 66560~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:35.568 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:13:35.568 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 82.952157017999994, 2024-09-13T05:13:35.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124532254, 2024-09-13T05:13:35.569 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.569 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.569 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.569 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.569 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.569 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162628 2024-09-13T05:13:35.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.569 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:13:35.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:13:35.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534641+0000", 2024-09-13T05:13:35.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:35.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534643+0000", 2024-09-13T05:13:35.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1890000000000001e-06 2024-09-13T05:13:35.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534648+0000", 2024-09-13T05:13:35.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:13:35.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534652+0000", 2024-09-13T05:13:35.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4549999999999997e-06 2024-09-13T05:13:35.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536586+0000", 2024-09-13T05:13:35.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019336049999999999 2024-09-13T05:13:35.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:35.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536591+0000", 2024-09-13T05:13:35.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3770000000000004e-06 2024-09-13T05:13:35.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659062+0000", 2024-09-13T05:13:35.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122470685 2024-09-13T05:13:35.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659106+0000", 2024-09-13T05:13:35.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3856000000000002e-05 2024-09-13T05:13:35.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659173+0000", 2024-09-13T05:13:35.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7168000000000005e-05 2024-09-13T05:13:35.573 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.573 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.573 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.573 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162630 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 67584~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:35.573 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:13:35.573 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 82.952123811999996, 2024-09-13T05:13:35.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12468555100000001, 2024-09-13T05:13:35.574 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.574 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.574 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162630 2024-09-13T05:13:35.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.574 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:13:35.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:13:35.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534674+0000", 2024-09-13T05:13:35.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:35.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534676+0000", 2024-09-13T05:13:35.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4399999999999999e-06 2024-09-13T05:13:35.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534681+0000", 2024-09-13T05:13:35.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2349999999999999e-06 2024-09-13T05:13:35.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534686+0000", 2024-09-13T05:13:35.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5499999999999996e-06 2024-09-13T05:13:35.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536609+0000", 2024-09-13T05:13:35.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001923407 2024-09-13T05:13:35.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:35.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536615+0000", 2024-09-13T05:13:35.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1499999999999998e-06 2024-09-13T05:13:35.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659233+0000", 2024-09-13T05:13:35.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122618957 2024-09-13T05:13:35.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659294+0000", 2024-09-13T05:13:35.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0251000000000003e-05 2024-09-13T05:13:35.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659360+0000", 2024-09-13T05:13:35.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5906000000000002e-05 2024-09-13T05:13:35.578 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.578 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.578 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.578 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162633 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 69632~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:35.579 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:13:35.579 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 82.952015907000003, 2024-09-13T05:13:35.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124702147, 2024-09-13T05:13:35.579 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.579 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.579 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.579 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.579 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.579 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162633 2024-09-13T05:13:35.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.579 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:13:35.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:13:35.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534782+0000", 2024-09-13T05:13:35.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:35.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534784+0000", 2024-09-13T05:13:35.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3300000000000001e-06 2024-09-13T05:13:35.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534789+0000", 2024-09-13T05:13:35.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4149999999999998e-06 2024-09-13T05:13:35.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534794+0000", 2024-09-13T05:13:35.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5669999999999996e-06 2024-09-13T05:13:35.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536634+0000", 2024-09-13T05:13:35.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001840401 2024-09-13T05:13:35.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:35.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536642+0000", 2024-09-13T05:13:35.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9729999999999997e-06 2024-09-13T05:13:35.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659383+0000", 2024-09-13T05:13:35.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12274112099999999 2024-09-13T05:13:35.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659424+0000", 2024-09-13T05:13:35.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0936000000000002e-05 2024-09-13T05:13:35.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659484+0000", 2024-09-13T05:13:35.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9775000000000003e-05 2024-09-13T05:13:35.583 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.583 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.583 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.584 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:162675 3.8 3:111ad6d9:::rbd_data.112dbd21872d.0000000000000005:28 [read 68608~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T05:13:35.584 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:13:35.584 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 82.951966862999996, 2024-09-13T05:13:35.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124823974, 2024-09-13T05:13:35.584 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.584 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-13T05:13:35.584 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.584 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.584 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.584 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162675 2024-09-13T05:13:35.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.584 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:13:35.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:13:35.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534831+0000", 2024-09-13T05:13:35.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:35.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534833+0000", 2024-09-13T05:13:35.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.204e-06 2024-09-13T05:13:35.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534838+0000", 2024-09-13T05:13:35.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0130000000000001e-06 2024-09-13T05:13:35.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.534842+0000", 2024-09-13T05:13:35.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.51e-06 2024-09-13T05:13:35.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536661+0000", 2024-09-13T05:13:35.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018186039999999999 2024-09-13T05:13:35.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:35.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.536667+0000", 2024-09-13T05:13:35.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5260000000000001e-06 2024-09-13T05:13:35.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659531+0000", 2024-09-13T05:13:35.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.122864403 2024-09-13T05:13:35.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659583+0000", 2024-09-13T05:13:35.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1564000000000003e-05 2024-09-13T05:13:35.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:12.659655+0000", 2024-09-13T05:13:35.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2504999999999998e-05 2024-09-13T05:13:35.588 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.588 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.588 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.589 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:170203 3.1e 3:7c9b1cf4:::rbd_header.112dc3abcba6:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e128)", 2024-09-13T05:13:35.589 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:13:35.589 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.671987892000004, 2024-09-13T05:13:35.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.79948714899999995, 2024-09-13T05:13:35.589 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.589 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:35.589 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.589 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.589 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.589 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 170203 2024-09-13T05:13:35.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.589 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:13:35.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814810+0000", 2024-09-13T05:13:35.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814808+0000", 2024-09-13T05:13:35.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:35.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814820+0000", 2024-09-13T05:13:35.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.206e-05 2024-09-13T05:13:35.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814841+0000", 2024-09-13T05:13:35.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1464999999999999e-05 2024-09-13T05:13:35.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814853+0000", 2024-09-13T05:13:35.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1824999999999999e-05 2024-09-13T05:13:35.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814911+0000", 2024-09-13T05:13:35.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8255999999999999e-05 2024-09-13T05:13:35.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:35.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:20.814918+0000", 2024-09-13T05:13:35.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7120000000000003e-06 2024-09-13T05:13:35.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.611660+0000", 2024-09-13T05:13:35.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.79674180100000003 2024-09-13T05:13:35.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.611911+0000", 2024-09-13T05:13:35.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025108900000000002 2024-09-13T05:13:35.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-13T05:13:35.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.612726+0000", 2024-09-13T05:13:35.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00081512999999999996 2024-09-13T05:13:35.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:35.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614087+0000", 2024-09-13T05:13:35.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013607560000000001 2024-09-13T05:13:35.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:13:35.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614095+0000", 2024-09-13T05:13:35.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3240000000000003e-06 2024-09-13T05:13:35.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:13:35.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614138+0000", 2024-09-13T05:13:35.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3115000000000003e-05 2024-09-13T05:13:35.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:12:21.614297+0000", 2024-09-13T05:13:35.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015875399999999999 2024-09-13T05:13:35.595 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.595 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.595 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.595 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4397.0:206714 3.1e 3:7a6b822e:::rbd_id.image_client.0-clone15:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e182)", 2024-09-13T05:13:35.595 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-13T05:13:16.942501+0000", 2024-09-13T05:13:35.595 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.544297302, 2024-09-13T05:13:35.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.93017799199999995, 2024-09-13T05:13:35.595 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-13T05:13:35.595 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:35.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-13T05:13:35.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4397", 2024-09-13T05:13:35.596 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.596 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 206714 2024-09-13T05:13:35.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.596 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-13T05:13:35.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-13T05:13:35.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942501+0000", 2024-09-13T05:13:35.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-13T05:13:35.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942501+0000", 2024-09-13T05:13:35.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-13T05:13:35.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-13T05:13:35.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942498+0000", 2024-09-13T05:13:35.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999976 2024-09-13T05:13:35.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-13T05:13:35.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942510+0000", 2024-09-13T05:13:35.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1564e-05 2024-09-13T05:13:35.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-13T05:13:35.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942531+0000", 2024-09-13T05:13:35.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1713e-05 2024-09-13T05:13:35.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942543+0000", 2024-09-13T05:13:35.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1684e-05 2024-09-13T05:13:35.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942671+0000", 2024-09-13T05:13:35.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012764699999999999 2024-09-13T05:13:35.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-13T05:13:35.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:16.942693+0000", 2024-09-13T05:13:35.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2690000000000001e-05 2024-09-13T05:13:35.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-13T05:13:35.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.867517+0000", 2024-09-13T05:13:35.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.92482318399999996 2024-09-13T05:13:35.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-13T05:13:35.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.867693+0000", 2024-09-13T05:13:35.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017623199999999999 2024-09-13T05:13:35.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-13T05:13:35.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.867788+0000", 2024-09-13T05:13:35.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5588999999999996e-05 2024-09-13T05:13:35.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-13T05:13:35.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.869416+0000", 2024-09-13T05:13:35.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016272750000000001 2024-09-13T05:13:35.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:35.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.872552+0000", 2024-09-13T05:13:35.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031364850000000001 2024-09-13T05:13:35.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-13T05:13:35.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.872628+0000", 2024-09-13T05:13:35.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5871999999999995e-05 2024-09-13T05:13:35.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-13T05:13:35.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-13T05:13:35.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-13T05:13:35.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-13T05:13:17.872679+0000", 2024-09-13T05:13:35.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0630999999999997e-05 2024-09-13T05:13:35.601 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.601 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.601 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.601 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-13T05:13:35.601 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-13T05:13:35.601 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:35.603 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T05:13:35.603 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-13T05:13:35.602+0000 7febfb0f1700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22156) UID: 0 2024-09-13T05:13:35.674 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T05:13:35.703 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:35.698+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:35.720 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:35.721 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:35.721 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:13:35.721 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:35.731 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T05:13:35.768 INFO:tasks.thrashosds.thrasher:in_osds: [2, 3, 5, 7, 1, 4, 6] out_osds: [0] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-13T05:13:35.768 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T05:13:35.768 INFO:tasks.thrashosds.thrasher:Adding osd 0 2024-09-13T05:13:35.769 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 0 2024-09-13T05:13:35.804 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:35.798+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:35.837 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:35.837 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:35.837 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:13:35.837 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:13:35.837 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:35.847 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T05:13:35.905 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T05:13:35.902+0000 7fad9d108700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36029) UID: 0 2024-09-13T05:13:35.943 INFO:teuthology.orchestra.run.smithi120.stdout:All operations completed A-OK! 2024-09-13T05:13:35.958 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:35.958 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:13:35.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:13:35.958 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:13:35.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.958 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203004 3.1a 3:5a99807b:::rbd_object_map.112dbd21872d:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e159)", 2024-09-13T05:13:35.958 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.649669+0000", 2024-09-13T05:13:35.958 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 42.304588652, 2024-09-13T05:13:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0064520619999999997, 2024-09-13T05:13:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203004 2024-09-13T05:13:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649669+0000", 2024-09-13T05:13:35.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649669+0000", 2024-09-13T05:13:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649668+0000", 2024-09-13T05:13:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649676+0000", 2024-09-13T05:13:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0020000000000006e-06 2024-09-13T05:13:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649686+0000", 2024-09-13T05:13:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0702e-05 2024-09-13T05:13:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.649694+0000", 2024-09-13T05:13:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9370000000000004e-06 2024-09-13T05:13:35.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.650848+0000", 2024-09-13T05:13:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0011532020000000001 2024-09-13T05:13:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.650973+0000", 2024-09-13T05:13:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00012510099999999999 2024-09-13T05:13:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:35.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.651197+0000", 2024-09-13T05:13:35.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00022407899999999999 2024-09-13T05:13:35.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:35.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.653302+0000", 2024-09-13T05:13:35.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021053629999999999 2024-09-13T05:13:35.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:35.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655437+0000", 2024-09-13T05:13:35.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002135348 2024-09-13T05:13:35.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:35.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655500+0000", 2024-09-13T05:13:35.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2453999999999995e-05 2024-09-13T05:13:35.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.964 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:35.964 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656122+0000", 2024-09-13T05:13:35.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00062160299999999998 2024-09-13T05:13:35.964 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:35.964 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:35.964 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:35.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.965 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7318 3.13 e159/153 3:cf0a521c:::rbd_data.112dbd21872d.0000000000000004:28 v 159'1220, mlcod=159'1216)", 2024-09-13T05:13:35.965 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.655897+0000", 2024-09-13T05:13:35.965 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 42.298360858000002, 2024-09-13T05:13:35.965 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0075974520000000002, 2024-09-13T05:13:35.965 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:35.965 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:35.965 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:35.965 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.965 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:35.965 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655897+0000", 2024-09-13T05:13:35.965 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:35.965 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.965 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.966 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:35.966 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655897+0000", 2024-09-13T05:13:35.966 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:35.966 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.966 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.966 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:35.966 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655897+0000", 2024-09-13T05:13:35.966 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:35.966 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.966 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.966 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:35.966 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655906+0000", 2024-09-13T05:13:35.966 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6290000000000005e-06 2024-09-13T05:13:35.966 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:35.967 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655916+0000", 2024-09-13T05:13:35.967 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0079e-05 2024-09-13T05:13:35.967 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.967 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655923+0000", 2024-09-13T05:13:35.967 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1319999999999996e-06 2024-09-13T05:13:35.967 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:35.967 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656023+0000", 2024-09-13T05:13:35.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.9747000000000006e-05 2024-09-13T05:13:35.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.968 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:35.968 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656042+0000", 2024-09-13T05:13:35.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8491999999999998e-05 2024-09-13T05:13:35.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.968 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:35.968 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.663412+0000", 2024-09-13T05:13:35.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0073701959999999999 2024-09-13T05:13:35.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.969 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:35.969 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.663495+0000", 2024-09-13T05:13:35.969 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2923000000000005e-05 2024-09-13T05:13:35.969 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:35.969 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:35.969 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:35.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.969 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.3.0:5116 3.b e159/149 3:d32d7958:::rbd_data.112dbd21872d.0000000000000001:28 v 159'616, mlcod=158'611)", 2024-09-13T05:13:35.969 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.655899+0000", 2024-09-13T05:13:35.969 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 42.298359175000002, 2024-09-13T05:13:35.969 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0075096859999999998, 2024-09-13T05:13:35.969 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:35.970 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:35.970 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:35.970 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:35.970 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655899+0000", 2024-09-13T05:13:35.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:35.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.970 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:35.970 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655899+0000", 2024-09-13T05:13:35.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:35.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.970 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.971 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:35.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655898+0000", 2024-09-13T05:13:35.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:35.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.971 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.971 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:35.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655907+0000", 2024-09-13T05:13:35.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5939999999999994e-06 2024-09-13T05:13:35.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.971 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.971 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:35.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655916+0000", 2024-09-13T05:13:35.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9840000000000007e-06 2024-09-13T05:13:35.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.972 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.972 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.972 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.655923+0000", 2024-09-13T05:13:35.972 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1350000000000003e-06 2024-09-13T05:13:35.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.972 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.972 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:35.972 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656059+0000", 2024-09-13T05:13:35.972 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013669999999999999 2024-09-13T05:13:35.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.972 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.972 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:35.972 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.656079+0000", 2024-09-13T05:13:35.973 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9293e-05 2024-09-13T05:13:35.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.973 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:35.973 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.663368+0000", 2024-09-13T05:13:35.973 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0072892570000000004 2024-09-13T05:13:35.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.973 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:35.973 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.663409+0000", 2024-09-13T05:13:35.973 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0614000000000001e-05 2024-09-13T05:13:35.973 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:35.973 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:35.973 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:35.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.974 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7323 3.e e159/151 3:742bfecb:::rbd_data.112dbd21872d.0000000000000018:28 v 159'1051, mlcod=157'1046)", 2024-09-13T05:13:35.974 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:53.668166+0000", 2024-09-13T05:13:35.974 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 42.286091980999998, 2024-09-13T05:13:35.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0065306610000000001, 2024-09-13T05:13:35.974 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:35.974 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:35.974 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:35.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.974 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:35.974 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668166+0000", 2024-09-13T05:13:35.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:35.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.975 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.975 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:35.975 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668166+0000", 2024-09-13T05:13:35.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:35.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.975 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.975 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:35.975 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668165+0000", 2024-09-13T05:13:35.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:35.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.975 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.975 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:35.975 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668174+0000", 2024-09-13T05:13:35.976 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.3790000000000006e-06 2024-09-13T05:13:35.976 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.976 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.976 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:35.976 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668187+0000", 2024-09-13T05:13:35.976 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3172e-05 2024-09-13T05:13:35.976 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.976 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.976 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.976 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668208+0000", 2024-09-13T05:13:35.976 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0713999999999999e-05 2024-09-13T05:13:35.976 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.976 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.977 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:35.977 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668272+0000", 2024-09-13T05:13:35.977 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4453000000000001e-05 2024-09-13T05:13:35.977 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.977 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.977 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:35.977 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.668289+0000", 2024-09-13T05:13:35.977 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.7331000000000001e-05 2024-09-13T05:13:35.977 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.977 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.977 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:35.977 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.674630+0000", 2024-09-13T05:13:35.977 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0063409340000000003 2024-09-13T05:13:35.977 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.978 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.978 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:35.978 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:53.674697+0000", 2024-09-13T05:13:35.978 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6472999999999999e-05 2024-09-13T05:13:35.978 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:35.978 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:35.978 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:35.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.978 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.978 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203156 3.9 3:9079854c:::rbd_header.112d52e08ead:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e160)", 2024-09-13T05:13:35.978 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:54.685914+0000", 2024-09-13T05:13:35.978 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 41.268344054000003, 2024-09-13T05:13:35.978 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0085711250000000006, 2024-09-13T05:13:35.979 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:35.979 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:35.979 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:35.979 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:35.979 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.979 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203156 2024-09-13T05:13:35.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.979 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:35.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:35.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685914+0000", 2024-09-13T05:13:35.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:35.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.980 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:35.980 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685914+0000", 2024-09-13T05:13:35.980 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:35.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.980 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.980 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:35.980 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685912+0000", 2024-09-13T05:13:35.980 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:35.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.980 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.980 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:35.980 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685924+0000", 2024-09-13T05:13:35.980 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1537e-05 2024-09-13T05:13:35.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.981 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:35.981 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685950+0000", 2024-09-13T05:13:35.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6781e-05 2024-09-13T05:13:35.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.981 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.981 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.685962+0000", 2024-09-13T05:13:35.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1953999999999999e-05 2024-09-13T05:13:35.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.981 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:35.981 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.686102+0000", 2024-09-13T05:13:35.982 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013926300000000001 2024-09-13T05:13:35.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.982 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.982 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op must wait for map", 2024-09-13T05:13:35.982 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.686115+0000", 2024-09-13T05:13:35.982 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3506000000000001e-05 2024-09-13T05:13:35.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.982 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.982 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:35.982 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.689954+0000", 2024-09-13T05:13:35.982 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0038391810000000001 2024-09-13T05:13:35.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:35.983 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.690104+0000", 2024-09-13T05:13:35.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014980500000000001 2024-09-13T05:13:35.983 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 2", 2024-09-13T05:13:35.983 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.690674+0000", 2024-09-13T05:13:35.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00057014200000000004 2024-09-13T05:13:35.983 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:35.983 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.692426+0000", 2024-09-13T05:13:35.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0017518810000000001 2024-09-13T05:13:35.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:35.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.694360+0000", 2024-09-13T05:13:35.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0019340819999999999 2024-09-13T05:13:35.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:35.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.694443+0000", 2024-09-13T05:13:35.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2693000000000003e-05 2024-09-13T05:13:35.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:35.985 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:54.694485+0000", 2024-09-13T05:13:35.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2355999999999999e-05 2024-09-13T05:13:35.985 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:35.985 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:35.985 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:35.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.985 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203849 3.3 3:c190344a:::rbd_data.112d1f830c0e.0000000000000000:head [delete] snapc 23=[] ondisk+write+known_if_redirected+supports_pool_eio e164)", 2024-09-13T05:13:35.985 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:58.853242+0000", 2024-09-13T05:13:35.985 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 37.101015646, 2024-09-13T05:13:35.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0070665509999999999, 2024-09-13T05:13:35.985 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:35.985 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:35.985 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:35.986 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:35.986 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.986 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203849 2024-09-13T05:13:35.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.986 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:35.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:35.986 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853242+0000", 2024-09-13T05:13:35.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:35.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:35.986 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853242+0000", 2024-09-13T05:13:35.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:35.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:35.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853240+0000", 2024-09-13T05:13:35.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:13:35.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:35.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853253+0000", 2024-09-13T05:13:35.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2330000000000001e-05 2024-09-13T05:13:35.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:35.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853286+0000", 2024-09-13T05:13:35.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3798999999999999e-05 2024-09-13T05:13:35.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.988 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.988 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853321+0000", 2024-09-13T05:13:35.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4749999999999998e-05 2024-09-13T05:13:35.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.988 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:35.988 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853568+0000", 2024-09-13T05:13:35.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024706400000000002 2024-09-13T05:13:35.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.988 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:35.988 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853935+0000", 2024-09-13T05:13:35.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00036690600000000001 2024-09-13T05:13:35.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:35.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854221+0000", 2024-09-13T05:13:35.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00028613100000000002 2024-09-13T05:13:35.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:35.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.859106+0000", 2024-09-13T05:13:35.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0048842629999999998 2024-09-13T05:13:35.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:35.990 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860185+0000", 2024-09-13T05:13:35.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0010796740000000001 2024-09-13T05:13:35.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.990 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:35.990 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860252+0000", 2024-09-13T05:13:35.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6928999999999996e-05 2024-09-13T05:13:35.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.990 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:35.990 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860309+0000", 2024-09-13T05:13:35.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6898999999999999e-05 2024-09-13T05:13:35.990 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:35.991 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:35.991 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:35.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.991 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:203852 3.1a 3:5af372d9:::rbd_data.112d1f830c0e.0000000000000003:head [delete] snapc 23=[] ondisk+write+known_if_redirected+supports_pool_eio e164)", 2024-09-13T05:13:35.991 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:58.853358+0000", 2024-09-13T05:13:35.991 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 37.100900289000002, 2024-09-13T05:13:35.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0069302069999999999, 2024-09-13T05:13:35.991 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:35.991 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:35.991 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:35.991 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:35.991 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:35.991 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 203852 2024-09-13T05:13:35.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.992 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:35.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.992 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:35.992 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853358+0000", 2024-09-13T05:13:35.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:35.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.992 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:35.992 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853358+0000", 2024-09-13T05:13:35.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:35.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:35.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853357+0000", 2024-09-13T05:13:35.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:35.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:35.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853363+0000", 2024-09-13T05:13:35.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6059999999999999e-06 2024-09-13T05:13:35.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:35.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.853421+0000", 2024-09-13T05:13:35.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8075999999999998e-05 2024-09-13T05:13:35.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.994 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854643+0000", 2024-09-13T05:13:35.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001221904 2024-09-13T05:13:35.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.994 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:35.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.854777+0000", 2024-09-13T05:13:35.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013323100000000001 2024-09-13T05:13:35.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.994 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:35.995 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.855094+0000", 2024-09-13T05:13:35.995 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00031790600000000002 2024-09-13T05:13:35.995 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.995 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.995 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:35.995 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.855378+0000", 2024-09-13T05:13:35.995 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00028385800000000001 2024-09-13T05:13:35.995 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.995 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.995 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:35.995 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.859936+0000", 2024-09-13T05:13:35.995 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0045574450000000002 2024-09-13T05:13:35.995 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.995 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:35.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860199+0000", 2024-09-13T05:13:35.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00026360899999999999 2024-09-13T05:13:35.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:35.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860250+0000", 2024-09-13T05:13:35.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0625999999999999e-05 2024-09-13T05:13:35.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:35.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:58.860288+0000", 2024-09-13T05:13:35.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8028999999999998e-05 2024-09-13T05:13:35.997 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:35.997 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:35.997 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:35.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.997 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7487 3.13 e174/153 3:cba8ba28:::rbd_data.112d667fb7f9.00000000000001c3:19 v 174'1268, mlcod=174'1262)", 2024-09-13T05:13:35.997 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:08.811674+0000", 2024-09-13T05:13:35.997 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 27.142583697999999, 2024-09-13T05:13:35.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0068301730000000001, 2024-09-13T05:13:35.997 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:35.997 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:35.997 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:35.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:35.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811674+0000", 2024-09-13T05:13:35.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:35.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:35.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811674+0000", 2024-09-13T05:13:35.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:35.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:35.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811674+0000", 2024-09-13T05:13:35.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:35.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:35.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811680+0000", 2024-09-13T05:13:35.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6460000000000004e-06 2024-09-13T05:13:35.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:35.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811694+0000", 2024-09-13T05:13:35.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4066999999999999e-05 2024-09-13T05:13:35.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:35.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:35.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:35.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.811702+0000", 2024-09-13T05:13:35.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3549999999999999e-06 2024-09-13T05:13:36.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.000 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813840+0000", 2024-09-13T05:13:36.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002138137 2024-09-13T05:13:36.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.000 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.813859+0000", 2024-09-13T05:13:36.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9006999999999999e-05 2024-09-13T05:13:36.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.001 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:36.001 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.818469+0000", 2024-09-13T05:13:36.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0046097070000000002 2024-09-13T05:13:36.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.001 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.001 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:08.818505+0000", 2024-09-13T05:13:36.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6026999999999999e-05 2024-09-13T05:13:36.001 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.001 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.001 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.002 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:206387 3.9 3:96db6e79:::rbd_data.112d52e13700.000000000000000d:head [delete] snapc 15=[] ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-13T05:13:36.002 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:12.969800+0000", 2024-09-13T05:13:36.002 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 22.984457641999999, 2024-09-13T05:13:36.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0066299089999999998, 2024-09-13T05:13:36.002 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.002 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:36.002 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.002 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.002 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.002 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 206387 2024-09-13T05:13:36.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.002 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.969800+0000", 2024-09-13T05:13:36.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.969800+0000", 2024-09-13T05:13:36.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.003 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.003 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.969799+0000", 2024-09-13T05:13:36.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:36.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.004 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.004 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.969807+0000", 2024-09-13T05:13:36.004 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9999999999999996e-06 2024-09-13T05:13:36.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.004 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.004 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.969832+0000", 2024-09-13T05:13:36.004 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5077000000000001e-05 2024-09-13T05:13:36.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.004 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.005 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.969845+0000", 2024-09-13T05:13:36.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2830000000000001e-05 2024-09-13T05:13:36.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.005 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.969912+0000", 2024-09-13T05:13:36.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6853999999999994e-05 2024-09-13T05:13:36.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.005 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.970078+0000", 2024-09-13T05:13:36.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000166317 2024-09-13T05:13:36.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 2", 2024-09-13T05:13:36.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.970219+0000", 2024-09-13T05:13:36.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000141077 2024-09-13T05:13:36.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:36.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.972106+0000", 2024-09-13T05:13:36.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0018869469999999999 2024-09-13T05:13:36.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:36.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976321+0000", 2024-09-13T05:13:36.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0042147850000000004 2024-09-13T05:13:36.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:36.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976381+0000", 2024-09-13T05:13:36.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9432999999999998e-05 2024-09-13T05:13:36.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976430+0000", 2024-09-13T05:13:36.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9874999999999999e-05 2024-09-13T05:13:36.007 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.007 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.008 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.008 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:206397 3.1a 3:588be705:::rbd_data.112d52e13700.0000000000000017:head [delete] snapc 15=[] ondisk+write+known_if_redirected+supports_pool_eio e178)", 2024-09-13T05:13:36.008 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:12.976313+0000", 2024-09-13T05:13:36.008 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 22.977945377000001, 2024-09-13T05:13:36.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0072561070000000004, 2024-09-13T05:13:36.008 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.008 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:36.008 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.008 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.008 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.008 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 206397 2024-09-13T05:13:36.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.009 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.009 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.009 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976313+0000", 2024-09-13T05:13:36.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.009 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.009 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976313+0000", 2024-09-13T05:13:36.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.009 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.009 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976310+0000", 2024-09-13T05:13:36.010 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:13:36.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.010 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976333+0000", 2024-09-13T05:13:36.010 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2212999999999999e-05 2024-09-13T05:13:36.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.010 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976352+0000", 2024-09-13T05:13:36.010 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9332000000000001e-05 2024-09-13T05:13:36.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.011 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.011 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976366+0000", 2024-09-13T05:13:36.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3801999999999999e-05 2024-09-13T05:13:36.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.011 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.011 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976511+0000", 2024-09-13T05:13:36.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00014525900000000001 2024-09-13T05:13:36.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.011 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.011 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976753+0000", 2024-09-13T05:13:36.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024178099999999999 2024-09-13T05:13:36.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.012 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:36.012 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.976926+0000", 2024-09-13T05:13:36.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000173234 2024-09-13T05:13:36.012 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.012 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:36.012 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.978566+0000", 2024-09-13T05:13:36.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001639691 2024-09-13T05:13:36.012 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.012 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:36.012 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.983483+0000", 2024-09-13T05:13:36.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0049168119999999996 2024-09-13T05:13:36.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:36.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.983532+0000", 2024-09-13T05:13:36.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.905e-05 2024-09-13T05:13:36.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:12.983569+0000", 2024-09-13T05:13:36.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7211e-05 2024-09-13T05:13:36.013 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.013 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.014 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.014 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:206463 3.1b 3:dad20942:::rbd_header.112d7db0ee5a:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e179)", 2024-09-13T05:13:36.014 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:13.644990+0000", 2024-09-13T05:13:36.014 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 22.309268274000001, 2024-09-13T05:13:36.014 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.010238102000000001, 2024-09-13T05:13:36.014 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.014 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:36.014 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.014 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.014 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.014 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 206463 2024-09-13T05:13:36.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.015 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.644990+0000", 2024-09-13T05:13:36.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.644990+0000", 2024-09-13T05:13:36.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.016 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.644987+0000", 2024-09-13T05:13:36.016 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:13:36.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.016 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.016 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.645003+0000", 2024-09-13T05:13:36.016 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6322999999999999e-05 2024-09-13T05:13:36.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.016 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.016 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.645029+0000", 2024-09-13T05:13:36.016 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5177e-05 2024-09-13T05:13:36.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.017 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.017 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.017 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.645047+0000", 2024-09-13T05:13:36.017 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8281999999999999e-05 2024-09-13T05:13:36.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.017 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.017 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.017 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.645284+0000", 2024-09-13T05:13:36.017 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00023681 2024-09-13T05:13:36.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.017 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.017 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op must wait for map", 2024-09-13T05:13:36.017 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.645297+0000", 2024-09-13T05:13:36.017 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3509999999999999e-05 2024-09-13T05:13:36.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.650969+0000", 2024-09-13T05:13:36.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0056719170000000003 2024-09-13T05:13:36.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.651072+0000", 2024-09-13T05:13:36.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00010320200000000001 2024-09-13T05:13:36.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 7", 2024-09-13T05:13:36.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.651487+0000", 2024-09-13T05:13:36.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00041497300000000001 2024-09-13T05:13:36.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:36.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.653970+0000", 2024-09-13T05:13:36.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002483074 2024-09-13T05:13:36.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:36.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.655150+0000", 2024-09-13T05:13:36.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001179963 2024-09-13T05:13:36.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:36.020 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.655182+0000", 2024-09-13T05:13:36.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1531e-05 2024-09-13T05:13:36.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.020 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.020 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:13.655228+0000", 2024-09-13T05:13:36.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6106000000000002e-05 2024-09-13T05:13:36.020 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.020 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.020 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.020 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.7.0:7604 3.13 e182/153 3:cb3c550a:::rbd_data.112d4ee87f83.0000000000000004:13 v 182'1291, mlcod=181'1287)", 2024-09-13T05:13:36.020 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:16.863805+0000", 2024-09-13T05:13:36.021 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 19.090452923000001, 2024-09-13T05:13:36.021 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0066902530000000002, 2024-09-13T05:13:36.021 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.021 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:36.021 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.021 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.021 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.863805+0000", 2024-09-13T05:13:36.021 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.021 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.021 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.863805+0000", 2024-09-13T05:13:36.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.863805+0000", 2024-09-13T05:13:36.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.863814+0000", 2024-09-13T05:13:36.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.037e-06 2024-09-13T05:13:36.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.863823+0000", 2024-09-13T05:13:36.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.7899999999999994e-06 2024-09-13T05:13:36.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.863830+0000", 2024-09-13T05:13:36.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6529999999999997e-06 2024-09-13T05:13:36.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.865683+0000", 2024-09-13T05:13:36.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001852991 2024-09-13T05:13:36.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.024 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.865702+0000", 2024-09-13T05:13:36.024 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8476999999999999e-05 2024-09-13T05:13:36.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:36.024 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.870460+0000", 2024-09-13T05:13:36.024 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0047586640000000001 2024-09-13T05:13:36.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.025 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:16.870495+0000", 2024-09-13T05:13:36.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5231000000000002e-05 2024-09-13T05:13:36.025 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.025 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.025 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.025 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:206716 3.3 3:c4c92e5a:::rbd_trash:head [call rbd.trash_state_set in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e183)", 2024-09-13T05:13:36.025 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:17.875773+0000", 2024-09-13T05:13:36.025 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 18.078484977999999, 2024-09-13T05:13:36.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.77872504200000003, 2024-09-13T05:13:36.025 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.025 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:36.025 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.026 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.026 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.026 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 206716 2024-09-13T05:13:36.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.026 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.026 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.026 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:17.875773+0000", 2024-09-13T05:13:36.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.026 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.026 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:17.875773+0000", 2024-09-13T05:13:36.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.027 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.027 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:17.875771+0000", 2024-09-13T05:13:36.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:36.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.027 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.027 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:17.875782+0000", 2024-09-13T05:13:36.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0927000000000001e-05 2024-09-13T05:13:36.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.027 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.027 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:17.875819+0000", 2024-09-13T05:13:36.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6950999999999999e-05 2024-09-13T05:13:36.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.028 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:17.875826+0000", 2024-09-13T05:13:36.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3819999999999998e-06 2024-09-13T05:13:36.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.028 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:17.875889+0000", 2024-09-13T05:13:36.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2759e-05 2024-09-13T05:13:36.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:36.028 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:17.875901+0000", 2024-09-13T05:13:36.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.132e-05 2024-09-13T05:13:36.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:18.652145+0000", 2024-09-13T05:13:36.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.77624458699999999 2024-09-13T05:13:36.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:18.652344+0000", 2024-09-13T05:13:36.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000199178 2024-09-13T05:13:36.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.030 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 6", 2024-09-13T05:13:36.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:18.652613+0000", 2024-09-13T05:13:36.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000269125 2024-09-13T05:13:36.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.030 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:36.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:18.654358+0000", 2024-09-13T05:13:36.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001744616 2024-09-13T05:13:36.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.030 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:36.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:18.654405+0000", 2024-09-13T05:13:36.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7206999999999997e-05 2024-09-13T05:13:36.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.031 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:36.031 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:18.654452+0000", 2024-09-13T05:13:36.031 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6347999999999997e-05 2024-09-13T05:13:36.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.031 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.031 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:18.654498+0000", 2024-09-13T05:13:36.031 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6638999999999998e-05 2024-09-13T05:13:36.031 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.031 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.031 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.032 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_repop(osd.3.0:5427 3.b e187/149 3:d275a035:::rbd_data.112d4ab2162d.000000000000000a:10 v 187'679, mlcod=175'676)", 2024-09-13T05:13:36.032 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:21.651643+0000", 2024-09-13T05:13:36.032 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.302614792, 2024-09-13T05:13:36.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0093737390000000007, 2024-09-13T05:13:36.032 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.032 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:36.032 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.032 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.032 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.651643+0000", 2024-09-13T05:13:36.032 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.651643+0000", 2024-09-13T05:13:36.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.033 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.033 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.651642+0000", 2024-09-13T05:13:36.033 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:36.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.651661+0000", 2024-09-13T05:13:36.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8759000000000001e-05 2024-09-13T05:13:36.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.651685+0000", 2024-09-13T05:13:36.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4087000000000002e-05 2024-09-13T05:13:36.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.034 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.034 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.651705+0000", 2024-09-13T05:13:36.034 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0319e-05 2024-09-13T05:13:36.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.035 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.652024+0000", 2024-09-13T05:13:36.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00031840999999999998 2024-09-13T05:13:36.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.035 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.652076+0000", 2024-09-13T05:13:36.035 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1848999999999998e-05 2024-09-13T05:13:36.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.035 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.035 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:36.036 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.660976+0000", 2024-09-13T05:13:36.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0088998830000000008 2024-09-13T05:13:36.036 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.036 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.036 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.036 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.661017+0000", 2024-09-13T05:13:36.036 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1508000000000003e-05 2024-09-13T05:13:36.036 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.036 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.036 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.036 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.036 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.036 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:207147 3.1a 3:5d866ee1:::rbd_header.112d4ab2162d:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e187)", 2024-09-13T05:13:36.037 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:21.655963+0000", 2024-09-13T05:13:36.037 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 14.29829498, 2024-09-13T05:13:36.037 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0096366379999999995, 2024-09-13T05:13:36.037 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.037 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:36.037 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.037 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.037 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.037 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 207147 2024-09-13T05:13:36.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.037 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.037 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.655963+0000", 2024-09-13T05:13:36.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.655963+0000", 2024-09-13T05:13:36.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.038 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.038 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.038 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.655960+0000", 2024-09-13T05:13:36.038 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:13:36.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.655974+0000", 2024-09-13T05:13:36.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3774000000000001e-05 2024-09-13T05:13:36.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.656003+0000", 2024-09-13T05:13:36.039 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8809000000000001e-05 2024-09-13T05:13:36.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.039 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.039 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.039 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.656022+0000", 2024-09-13T05:13:36.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8536e-05 2024-09-13T05:13:36.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.656120+0000", 2024-09-13T05:13:36.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8678000000000006e-05 2024-09-13T05:13:36.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.040 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.040 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.656255+0000", 2024-09-13T05:13:36.040 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000134463 2024-09-13T05:13:36.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.040 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.041 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:36.041 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.656700+0000", 2024-09-13T05:13:36.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00044488399999999999 2024-09-13T05:13:36.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.041 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.041 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:36.041 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.661812+0000", 2024-09-13T05:13:36.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0051123430000000001 2024-09-13T05:13:36.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.041 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.041 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:36.041 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.665519+0000", 2024-09-13T05:13:36.041 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0037070839999999998 2024-09-13T05:13:36.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:36.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.665566+0000", 2024-09-13T05:13:36.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6575e-05 2024-09-13T05:13:36.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.042 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.042 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.042 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:21.665600+0000", 2024-09-13T05:13:36.042 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4162000000000003e-05 2024-09-13T05:13:36.042 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.042 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.042 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.043 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:207961 3.3 3:c18708b2:::rbd_data.112d356d780d.0000000000000006:head [delete] snapc c=[] ondisk+write+known_if_redirected+supports_pool_eio e192)", 2024-09-13T05:13:36.043 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:26.842059+0000", 2024-09-13T05:13:36.043 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 9.1121987640000004, 2024-09-13T05:13:36.043 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0064721809999999996, 2024-09-13T05:13:36.043 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.043 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:36.043 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.043 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.043 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.043 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 207961 2024-09-13T05:13:36.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.043 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.043 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.842059+0000", 2024-09-13T05:13:36.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.842059+0000", 2024-09-13T05:13:36.044 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.044 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.044 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.044 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.842056+0000", 2024-09-13T05:13:36.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999962 2024-09-13T05:13:36.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.842065+0000", 2024-09-13T05:13:36.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4169999999999998e-06 2024-09-13T05:13:36.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.045 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.045 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.842080+0000", 2024-09-13T05:13:36.045 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.5373999999999999e-05 2024-09-13T05:13:36.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.045 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.046 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.046 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.842092+0000", 2024-09-13T05:13:36.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1894e-05 2024-09-13T05:13:36.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.046 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.046 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.843983+0000", 2024-09-13T05:13:36.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0018906350000000001 2024-09-13T05:13:36.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.046 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.046 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.046 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.844225+0000", 2024-09-13T05:13:36.046 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024239199999999999 2024-09-13T05:13:36.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 6", 2024-09-13T05:13:36.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.844476+0000", 2024-09-13T05:13:36.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025110300000000002 2024-09-13T05:13:36.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:36.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.846688+0000", 2024-09-13T05:13:36.047 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022111600000000002 2024-09-13T05:13:36.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.047 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.047 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:36.047 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.848425+0000", 2024-09-13T05:13:36.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0017371680000000001 2024-09-13T05:13:36.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:36.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.848484+0000", 2024-09-13T05:13:36.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9327999999999998e-05 2024-09-13T05:13:36.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.048 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.048 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.048 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:26.848532+0000", 2024-09-13T05:13:36.048 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7459000000000001e-05 2024-09-13T05:13:36.048 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.048 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.049 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.049 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.049 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:208126 3.9 3:970b18bb:::rbd_header.112de12546cf:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e193)", 2024-09-13T05:13:36.049 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:27.719589+0000", 2024-09-13T05:13:36.049 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.2346688050000001, 2024-09-13T05:13:36.049 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0071952020000000004, 2024-09-13T05:13:36.049 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.049 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:36.049 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.049 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.049 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.049 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 208126 2024-09-13T05:13:36.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.050 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.050 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.050 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.050 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.719589+0000", 2024-09-13T05:13:36.050 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.050 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.050 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.050 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.050 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.719589+0000", 2024-09-13T05:13:36.050 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.050 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.050 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.050 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.050 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.719587+0000", 2024-09-13T05:13:36.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:36.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.719599+0000", 2024-09-13T05:13:36.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1569000000000001e-05 2024-09-13T05:13:36.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.051 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.051 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.719620+0000", 2024-09-13T05:13:36.051 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0801e-05 2024-09-13T05:13:36.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.051 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.719636+0000", 2024-09-13T05:13:36.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6279000000000001e-05 2024-09-13T05:13:36.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.719731+0000", 2024-09-13T05:13:36.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5422999999999998e-05 2024-09-13T05:13:36.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.052 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.052 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op must wait for map", 2024-09-13T05:13:36.052 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.719743+0000", 2024-09-13T05:13:36.052 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1933000000000001e-05 2024-09-13T05:13:36.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.053 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.053 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.723588+0000", 2024-09-13T05:13:36.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0038447759999999998 2024-09-13T05:13:36.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.053 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.053 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.723822+0000", 2024-09-13T05:13:36.053 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00023412300000000001 2024-09-13T05:13:36.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.053 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.053 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 2", 2024-09-13T05:13:36.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.724748+0000", 2024-09-13T05:13:36.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00092563200000000002 2024-09-13T05:13:36.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:36.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.726702+0000", 2024-09-13T05:13:36.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001953869 2024-09-13T05:13:36.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.054 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:36.054 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.726707+0000", 2024-09-13T05:13:36.054 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4299999999999997e-06 2024-09-13T05:13:36.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.054 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.055 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:36.055 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.726748+0000", 2024-09-13T05:13:36.055 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1248999999999998e-05 2024-09-13T05:13:36.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.055 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.055 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.726785+0000", 2024-09-13T05:13:36.055 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6127999999999997e-05 2024-09-13T05:13:36.055 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.055 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.055 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.055 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.055 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:208221 3.14 3:28bfe33d:::rbd_data.112de12546cf.0000000000000005:head [delete] snapc b=[] ondisk+write+known_if_redirected+supports_pool_eio e193)", 2024-09-13T05:13:36.056 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:27.852395+0000", 2024-09-13T05:13:36.056 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 8.1018626719999993, 2024-09-13T05:13:36.056 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0096741420000000002, 2024-09-13T05:13:36.056 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.056 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:36.056 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.056 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.056 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.056 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 208221 2024-09-13T05:13:36.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.056 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.056 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.056 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.852395+0000", 2024-09-13T05:13:36.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.852395+0000", 2024-09-13T05:13:36.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.057 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.057 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.057 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.852393+0000", 2024-09-13T05:13:36.057 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:36.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.852421+0000", 2024-09-13T05:13:36.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7294999999999999e-05 2024-09-13T05:13:36.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.852464+0000", 2024-09-13T05:13:36.058 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3590000000000001e-05 2024-09-13T05:13:36.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.058 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.058 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.058 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.852486+0000", 2024-09-13T05:13:36.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1529e-05 2024-09-13T05:13:36.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.059 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.059 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.059 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.852702+0000", 2024-09-13T05:13:36.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021623599999999999 2024-09-13T05:13:36.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.059 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.059 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.059 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.853044+0000", 2024-09-13T05:13:36.059 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00034190400000000003 2024-09-13T05:13:36.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.059 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.060 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 7", 2024-09-13T05:13:36.060 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.853306+0000", 2024-09-13T05:13:36.060 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000262229 2024-09-13T05:13:36.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.060 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.060 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:36.060 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.855348+0000", 2024-09-13T05:13:36.060 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020413850000000002 2024-09-13T05:13:36.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.060 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.060 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:36.060 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.861823+0000", 2024-09-13T05:13:36.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0064753989999999997 2024-09-13T05:13:36.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:36.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.861931+0000", 2024-09-13T05:13:36.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000108125 2024-09-13T05:13:36.061 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.061 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.061 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.061 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:27.862070+0000", 2024-09-13T05:13:36.061 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00013847999999999999 2024-09-13T05:13:36.061 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.061 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.062 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.062 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.062 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:209100 3.3 3:c6dd2174:::rbd_data.112d265b2a09.0000000000000006:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e197)", 2024-09-13T05:13:36.062 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:31.871799+0000", 2024-09-13T05:13:36.062 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.0824593870000001, 2024-09-13T05:13:36.062 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.006720798, 2024-09-13T05:13:36.062 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.062 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:36.062 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.062 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.062 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.062 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 209100 2024-09-13T05:13:36.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.063 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.063 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.063 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.063 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.871799+0000", 2024-09-13T05:13:36.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.063 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.063 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.063 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.871799+0000", 2024-09-13T05:13:36.063 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.063 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.064 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.064 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.871796+0000", 2024-09-13T05:13:36.064 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999976 2024-09-13T05:13:36.064 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.064 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.064 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.064 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.871811+0000", 2024-09-13T05:13:36.064 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4939999999999999e-05 2024-09-13T05:13:36.064 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.064 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.064 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.064 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.871850+0000", 2024-09-13T05:13:36.064 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8275999999999997e-05 2024-09-13T05:13:36.065 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.065 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.065 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.065 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.871870+0000", 2024-09-13T05:13:36.065 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0720000000000002e-05 2024-09-13T05:13:36.065 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.065 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.065 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.065 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.874434+0000", 2024-09-13T05:13:36.065 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025637139999999999 2024-09-13T05:13:36.065 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.065 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.065 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.065 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.875064+0000", 2024-09-13T05:13:36.066 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00063018299999999998 2024-09-13T05:13:36.066 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.066 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.066 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 6", 2024-09-13T05:13:36.066 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.875263+0000", 2024-09-13T05:13:36.066 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000198533 2024-09-13T05:13:36.066 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.066 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.066 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:36.066 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.877094+0000", 2024-09-13T05:13:36.066 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0018311009999999999 2024-09-13T05:13:36.066 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.066 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.067 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:36.067 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.878416+0000", 2024-09-13T05:13:36.067 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0013220479999999999 2024-09-13T05:13:36.067 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.067 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.067 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:36.067 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.878476+0000", 2024-09-13T05:13:36.067 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9963999999999997e-05 2024-09-13T05:13:36.067 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.067 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.067 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.067 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.878520+0000", 2024-09-13T05:13:36.067 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3639e-05 2024-09-13T05:13:36.068 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.068 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.068 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.068 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.068 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.068 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:209101 3.1b 3:ddb2a2f1:::rbd_data.112d265b2a09.0000000000000007:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e197)", 2024-09-13T05:13:36.068 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:31.871905+0000", 2024-09-13T05:13:36.068 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 4.0823532719999998, 2024-09-13T05:13:36.068 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0076996640000000002, 2024-09-13T05:13:36.068 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.068 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:36.068 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.068 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.069 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.069 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 209101 2024-09-13T05:13:36.069 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.069 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.069 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.069 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.069 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.871905+0000", 2024-09-13T05:13:36.069 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.069 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.069 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.069 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.069 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.871905+0000", 2024-09-13T05:13:36.069 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.070 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.070 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.070 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.871903+0000", 2024-09-13T05:13:36.070 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:36.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.070 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.070 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.070 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.871912+0000", 2024-09-13T05:13:36.070 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5699999999999993e-06 2024-09-13T05:13:36.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.070 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.070 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.871930+0000", 2024-09-13T05:13:36.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8063e-05 2024-09-13T05:13:36.071 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.871944+0000", 2024-09-13T05:13:36.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4082e-05 2024-09-13T05:13:36.071 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.071 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.071 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.873792+0000", 2024-09-13T05:13:36.071 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.001848043 2024-09-13T05:13:36.071 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.071 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.072 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.072 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.874044+0000", 2024-09-13T05:13:36.072 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025172500000000001 2024-09-13T05:13:36.072 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.072 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.072 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 7", 2024-09-13T05:13:36.072 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.874299+0000", 2024-09-13T05:13:36.072 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025515999999999999 2024-09-13T05:13:36.072 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.072 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.072 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:36.072 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.877084+0000", 2024-09-13T05:13:36.072 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0027854170000000001 2024-09-13T05:13:36.073 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.073 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.073 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:36.073 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.879350+0000", 2024-09-13T05:13:36.073 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00226531 2024-09-13T05:13:36.073 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.073 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.073 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:36.073 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.879429+0000", 2024-09-13T05:13:36.073 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9376999999999996e-05 2024-09-13T05:13:36.073 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.073 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.073 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.074 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.879605+0000", 2024-09-13T05:13:36.074 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017558 2024-09-13T05:13:36.074 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.074 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.074 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.074 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.074 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.074 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:36.076 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T05:13:36.076 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-09-13T05:13:36.070+0000 7f2bad360700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 22311) UID: 0 2024-09-13T05:13:36.077 DEBUG:teuthology.parallel:result is None 2024-09-13T05:13:36.077 DEBUG:teuthology.run_tasks:Unwinding manager rbd_fsx 2024-09-13T05:13:36.088 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-13T05:13:36.133 INFO:tasks.thrashosds:joining thrashosds 2024-09-13T05:13:36.134 INFO:tasks.ceph.mon.a.smithi120.stderr:2024-09-13T05:13:36.082+0000 7fa8b7b30700 -1 mon.a@0(leader).osd e201 definitely_dead 0 2024-09-13T05:13:36.251 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:36.251 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:36.252 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:13:36.252 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:36.261 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T05:13:36.367 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:36.367 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:36.367 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:13:36.367 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:13:36.367 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:36.376 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T05:13:36.489 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:36.489 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:13:36.489 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:13:36.489 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:13:36.489 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.489 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71071 3.16 3.bb1d1096 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:13:36.490 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:13:36.490 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 132.54107950900001, 2024-09-13T05:13:36.490 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68834410099999999, 2024-09-13T05:13:36.490 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.490 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:36.490 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.490 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.490 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.490 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71071 2024-09-13T05:13:36.490 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.490 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.490 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.490 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.490 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:13:36.491 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.491 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.491 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.491 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.491 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943722+0000", 2024-09-13T05:13:36.491 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.491 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.491 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.491 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.491 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943719+0000", 2024-09-13T05:13:36.491 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999971 2024-09-13T05:13:36.491 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.492 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.492 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.492 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943734+0000", 2024-09-13T05:13:36.492 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4793e-05 2024-09-13T05:13:36.492 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.492 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.492 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.492 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943765+0000", 2024-09-13T05:13:36.492 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.0648999999999997e-05 2024-09-13T05:13:36.492 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.492 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.492 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.493 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943779+0000", 2024-09-13T05:13:36.493 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.447e-05 2024-09-13T05:13:36.493 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.493 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.493 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.493 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943872+0000", 2024-09-13T05:13:36.493 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3304e-05 2024-09-13T05:13:36.493 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.493 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.493 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:36.493 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943884+0000", 2024-09-13T05:13:36.493 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.167e-05 2024-09-13T05:13:36.493 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.494 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.494 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.494 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632042+0000", 2024-09-13T05:13:36.494 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68815832600000004 2024-09-13T05:13:36.494 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.494 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.494 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.494 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632066+0000", 2024-09-13T05:13:36.494 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3765999999999999e-05 2024-09-13T05:13:36.494 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.494 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.494 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.494 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.494 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.494 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3.b6bd6256 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:13:36.495 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:13:36.495 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 132.54095500899999, 2024-09-13T05:13:36.495 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68852592499999998, 2024-09-13T05:13:36.495 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.495 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:36.495 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.495 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.495 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.495 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:13:36.495 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.495 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.495 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.495 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.495 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:13:36.495 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.496 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.496 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.496 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.496 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943847+0000", 2024-09-13T05:13:36.496 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.496 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.496 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.496 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.496 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943846+0000", 2024-09-13T05:13:36.496 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:36.496 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.496 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.496 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.497 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943852+0000", 2024-09-13T05:13:36.497 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3820000000000001e-06 2024-09-13T05:13:36.497 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.497 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.497 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.497 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943876+0000", 2024-09-13T05:13:36.497 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3995e-05 2024-09-13T05:13:36.497 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.497 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.497 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.497 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.943898+0000", 2024-09-13T05:13:36.497 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1838999999999999e-05 2024-09-13T05:13:36.497 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.497 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.498 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.498 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946457+0000", 2024-09-13T05:13:36.498 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0025588910000000002 2024-09-13T05:13:36.498 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.498 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.498 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:36.498 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.946499+0000", 2024-09-13T05:13:36.498 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2814e-05 2024-09-13T05:13:36.498 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.498 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.498 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.498 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632364+0000", 2024-09-13T05:13:36.498 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.68586484999999997 2024-09-13T05:13:36.498 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.499 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.499 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.499 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632372+0000", 2024-09-13T05:13:36.499 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1659999999999994e-06 2024-09-13T05:13:36.499 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.499 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.499 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.499 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.499 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.499 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:71073 3.16 3:6a46bd6d:::rbd_data.112d8d1317eb.0000000000000010:head [sparse-read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e87)", 2024-09-13T05:13:36.499 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:13:36.499 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 132.50375327500001, 2024-09-13T05:13:36.499 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65213695699999996, 2024-09-13T05:13:36.500 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.500 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.500 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.500 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.500 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.500 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 71073 2024-09-13T05:13:36.500 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.500 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.500 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.500 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.500 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:13:36.500 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.500 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.500 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.501 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.501 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:13:36.501 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.501 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.501 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.501 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.501 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981048+0000", 2024-09-13T05:13:36.501 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.501 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.501 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.501 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.501 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981052+0000", 2024-09-13T05:13:36.501 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4469999999999999e-06 2024-09-13T05:13:36.501 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.502 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.502 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.502 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981066+0000", 2024-09-13T05:13:36.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3658e-05 2024-09-13T05:13:36.502 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.502 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.502 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.502 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981073+0000", 2024-09-13T05:13:36.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8159999999999996e-06 2024-09-13T05:13:36.502 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.502 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.502 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.502 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981150+0000", 2024-09-13T05:13:36.502 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.7783999999999999e-05 2024-09-13T05:13:36.503 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.503 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.503 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:36.503 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:23.981161+0000", 2024-09-13T05:13:36.503 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0197000000000001e-05 2024-09-13T05:13:36.503 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.503 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.503 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.503 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.632926+0000", 2024-09-13T05:13:36.503 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.65176517300000003 2024-09-13T05:13:36.503 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.503 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.503 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.503 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633081+0000", 2024-09-13T05:13:36.503 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000155172 2024-09-13T05:13:36.504 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.504 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.504 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.504 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:11:24.633185+0000", 2024-09-13T05:13:36.504 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000104329 2024-09-13T05:13:36.504 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.504 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.504 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.504 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.504 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.504 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:159585 3.1c 3:3afcc414:::rbd_data.112dfd94ee88.00000000000002ca:2a [read 168960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:36.504 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:13:36.504 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 89.470434961999999, 2024-09-13T05:13:36.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91717655399999998, 2024-09-13T05:13:36.505 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.505 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.505 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.505 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.505 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.505 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 159585 2024-09-13T05:13:36.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.505 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.505 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.505 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.505 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:13:36.505 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.506 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.506 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014367+0000", 2024-09-13T05:13:36.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.506 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.506 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.506 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014366+0000", 2024-09-13T05:13:36.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.506 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.506 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.506 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014370+0000", 2024-09-13T05:13:36.506 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9960000000000004e-06 2024-09-13T05:13:36.506 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.507 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.507 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014379+0000", 2024-09-13T05:13:36.507 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8550000000000008e-06 2024-09-13T05:13:36.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.507 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.507 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014386+0000", 2024-09-13T05:13:36.507 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0140000000000001e-06 2024-09-13T05:13:36.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.507 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.507 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.507 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014533+0000", 2024-09-13T05:13:36.507 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000147458 2024-09-13T05:13:36.508 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.508 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.508 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:36.508 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.014545+0000", 2024-09-13T05:13:36.508 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1318000000000001e-05 2024-09-13T05:13:36.508 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.508 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.508 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.508 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931378+0000", 2024-09-13T05:13:36.508 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.91683292400000005 2024-09-13T05:13:36.508 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.508 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.508 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.508 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931495+0000", 2024-09-13T05:13:36.509 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00011726399999999999 2024-09-13T05:13:36.509 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.509 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.509 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.509 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931543+0000", 2024-09-13T05:13:36.509 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8183000000000003e-05 2024-09-13T05:13:36.509 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.509 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.509 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.509 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.509 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.509 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160206 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 83968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:36.509 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:13:36.509 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 89.447032565000001, 2024-09-13T05:13:36.509 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89412730799999995, 2024-09-13T05:13:36.510 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.510 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.510 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.510 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.510 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.510 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160206 2024-09-13T05:13:36.510 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.510 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.510 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.510 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.510 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:13:36.510 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.510 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.510 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.511 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.511 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037769+0000", 2024-09-13T05:13:36.511 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.511 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.511 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.511 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037768+0000", 2024-09-13T05:13:36.511 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:36.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.511 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.511 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.511 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037774+0000", 2024-09-13T05:13:36.511 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3600000000000001e-06 2024-09-13T05:13:36.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.512 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.512 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.512 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037786+0000", 2024-09-13T05:13:36.512 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.188e-05 2024-09-13T05:13:36.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.512 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.512 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.512 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037793+0000", 2024-09-13T05:13:36.512 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2749999999999998e-06 2024-09-13T05:13:36.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.512 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.512 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.512 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:13:36.512 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0353000000000003e-05 2024-09-13T05:13:36.513 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.513 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:36.513 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037862+0000", 2024-09-13T05:13:36.513 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.9710000000000004e-06 2024-09-13T05:13:36.513 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.513 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.513 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931610+0000", 2024-09-13T05:13:36.513 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89374846299999999 2024-09-13T05:13:36.513 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.513 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.513 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931815+0000", 2024-09-13T05:13:36.514 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020516499999999999 2024-09-13T05:13:36.514 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.514 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.514 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.514 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931896+0000", 2024-09-13T05:13:36.514 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1157999999999998e-05 2024-09-13T05:13:36.514 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.514 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.514 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.514 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.514 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.514 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160208 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 84992~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:36.514 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:13:36.514 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 89.446947825999999, 2024-09-13T05:13:36.515 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440702299999997, 2024-09-13T05:13:36.515 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.515 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.515 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.515 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.515 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.515 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160208 2024-09-13T05:13:36.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.515 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.515 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.515 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:13:36.515 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.516 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.516 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.516 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037854+0000", 2024-09-13T05:13:36.516 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.516 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.516 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.516 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.516 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037853+0000", 2024-09-13T05:13:36.516 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:36.516 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.516 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.516 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.516 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037858+0000", 2024-09-13T05:13:36.516 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2179999999999998e-06 2024-09-13T05:13:36.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.517 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.517 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037867+0000", 2024-09-13T05:13:36.517 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5699999999999993e-06 2024-09-13T05:13:36.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.517 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.517 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037874+0000", 2024-09-13T05:13:36.517 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2810000000000003e-06 2024-09-13T05:13:36.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.517 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.517 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037935+0000", 2024-09-13T05:13:36.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1231999999999999e-05 2024-09-13T05:13:36.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.518 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:36.518 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037944+0000", 2024-09-13T05:13:36.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8580000000000006e-06 2024-09-13T05:13:36.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.518 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.518 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.931956+0000", 2024-09-13T05:13:36.518 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89401158800000002 2024-09-13T05:13:36.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.518 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932015+0000", 2024-09-13T05:13:36.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8906999999999997e-05 2024-09-13T05:13:36.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.519 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.519 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932261+0000", 2024-09-13T05:13:36.519 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00024622799999999997 2024-09-13T05:13:36.519 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.519 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.519 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.519 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160210 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 86016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:36.519 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:13:36.520 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 89.446878971999993, 2024-09-13T05:13:36.520 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89428998299999996, 2024-09-13T05:13:36.520 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.520 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.520 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.520 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.520 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.520 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160210 2024-09-13T05:13:36.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.520 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.520 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.520 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:13:36.520 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.521 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.521 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037923+0000", 2024-09-13T05:13:36.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.521 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.521 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037922+0000", 2024-09-13T05:13:36.521 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:36.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.521 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.521 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037926+0000", 2024-09-13T05:13:36.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6550000000000003e-06 2024-09-13T05:13:36.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037933+0000", 2024-09-13T05:13:36.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5409999999999997e-06 2024-09-13T05:13:36.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.522 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037939+0000", 2024-09-13T05:13:36.522 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1940000000000003e-06 2024-09-13T05:13:36.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.522 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037976+0000", 2024-09-13T05:13:36.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6671000000000002e-05 2024-09-13T05:13:36.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.523 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:36.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.037982+0000", 2024-09-13T05:13:36.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9669999999999998e-06 2024-09-13T05:13:36.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.523 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.523 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932096+0000", 2024-09-13T05:13:36.523 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89411465599999995 2024-09-13T05:13:36.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932149+0000", 2024-09-13T05:13:36.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3032999999999999e-05 2024-09-13T05:13:36.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.524 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.524 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932213+0000", 2024-09-13T05:13:36.524 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.3165999999999998e-05 2024-09-13T05:13:36.524 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.524 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.524 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.524 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160212 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 87040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:36.525 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:13:36.525 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 89.446791851, 2024-09-13T05:13:36.525 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89440379699999994, 2024-09-13T05:13:36.525 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.525 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.525 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.525 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.525 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.525 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160212 2024-09-13T05:13:36.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.525 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.525 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.525 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:13:36.525 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.526 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.526 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038010+0000", 2024-09-13T05:13:36.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.526 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.526 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038009+0000", 2024-09-13T05:13:36.526 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.526 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.526 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038013+0000", 2024-09-13T05:13:36.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3950000000000003e-06 2024-09-13T05:13:36.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038032+0000", 2024-09-13T05:13:36.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8513999999999999e-05 2024-09-13T05:13:36.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038039+0000", 2024-09-13T05:13:36.527 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.985e-06 2024-09-13T05:13:36.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.527 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.527 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.527 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038086+0000", 2024-09-13T05:13:36.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7302999999999998e-05 2024-09-13T05:13:36.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.528 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:36.528 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038090+0000", 2024-09-13T05:13:36.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9029999999999997e-06 2024-09-13T05:13:36.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.528 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.528 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932291+0000", 2024-09-13T05:13:36.528 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89420100199999997 2024-09-13T05:13:36.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.528 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.528 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.529 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932352+0000", 2024-09-13T05:13:36.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1354999999999998e-05 2024-09-13T05:13:36.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.529 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.529 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932414+0000", 2024-09-13T05:13:36.529 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.1037999999999994e-05 2024-09-13T05:13:36.529 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.529 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.529 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.529 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160214 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 88064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:36.529 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:13:36.530 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 89.446660785000006, 2024-09-13T05:13:36.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89438890900000001, 2024-09-13T05:13:36.530 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.530 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.530 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.530 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.530 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.530 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160214 2024-09-13T05:13:36.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.530 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.530 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.530 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.530 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:13:36.530 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038141+0000", 2024-09-13T05:13:36.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038140+0000", 2024-09-13T05:13:36.531 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.999999 2024-09-13T05:13:36.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.531 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.531 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.531 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038145+0000", 2024-09-13T05:13:36.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9749999999999998e-06 2024-09-13T05:13:36.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038153+0000", 2024-09-13T05:13:36.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.1280000000000008e-06 2024-09-13T05:13:36.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.532 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038161+0000", 2024-09-13T05:13:36.532 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.0339999999999997e-06 2024-09-13T05:13:36.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.532 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.532 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038199+0000", 2024-09-13T05:13:36.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8269999999999998e-05 2024-09-13T05:13:36.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:36.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.038204+0000", 2024-09-13T05:13:36.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5399999999999997e-06 2024-09-13T05:13:36.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.533 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.533 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.533 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932438+0000", 2024-09-13T05:13:36.533 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89423397999999998 2024-09-13T05:13:36.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932480+0000", 2024-09-13T05:13:36.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2392999999999999e-05 2024-09-13T05:13:36.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.534 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.534 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932530+0000", 2024-09-13T05:13:36.534 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9502999999999997e-05 2024-09-13T05:13:36.534 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.534 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.534 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.534 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160305 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 215040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:36.535 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:13:36.535 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 89.442457563000005, 2024-09-13T05:13:36.535 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89028175300000001, 2024-09-13T05:13:36.535 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.535 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.535 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.535 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.535 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.535 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160305 2024-09-13T05:13:36.535 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.535 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.535 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.535 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.535 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:13:36.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042344+0000", 2024-09-13T05:13:36.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.536 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042343+0000", 2024-09-13T05:13:36.536 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999986 2024-09-13T05:13:36.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.536 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.536 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042350+0000", 2024-09-13T05:13:36.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3769999999999998e-06 2024-09-13T05:13:36.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042367+0000", 2024-09-13T05:13:36.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.734e-05 2024-09-13T05:13:36.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.537 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.537 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042375+0000", 2024-09-13T05:13:36.537 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.8469999999999996e-06 2024-09-13T05:13:36.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.537 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042428+0000", 2024-09-13T05:13:36.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3074e-05 2024-09-13T05:13:36.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:36.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042437+0000", 2024-09-13T05:13:36.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:13:36.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.538 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.538 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.538 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932550+0000", 2024-09-13T05:13:36.538 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89011304300000005 2024-09-13T05:13:36.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.539 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.539 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932589+0000", 2024-09-13T05:13:36.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9236000000000002e-05 2024-09-13T05:13:36.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.539 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.539 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932626+0000", 2024-09-13T05:13:36.539 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6832999999999998e-05 2024-09-13T05:13:36.539 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.539 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.539 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.540 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160307 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 216064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:36.540 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:13:36.540 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 89.442411124000003, 2024-09-13T05:13:36.540 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89032630800000001, 2024-09-13T05:13:36.540 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.540 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.540 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.540 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.540 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.540 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160307 2024-09-13T05:13:36.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.540 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.540 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:13:36.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:13:36.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.541 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.541 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.541 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042390+0000", 2024-09-13T05:13:36.541 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042394+0000", 2024-09-13T05:13:36.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7900000000000001e-06 2024-09-13T05:13:36.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042401+0000", 2024-09-13T05:13:36.542 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.267e-06 2024-09-13T05:13:36.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.542 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.542 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.542 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042406+0000", 2024-09-13T05:13:36.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0860000000000001e-06 2024-09-13T05:13:36.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042465+0000", 2024-09-13T05:13:36.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9441000000000002e-05 2024-09-13T05:13:36.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.543 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:36.543 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042471+0000", 2024-09-13T05:13:36.543 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6640000000000003e-06 2024-09-13T05:13:36.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.543 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.544 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932645+0000", 2024-09-13T05:13:36.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89017372900000002 2024-09-13T05:13:36.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.544 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932681+0000", 2024-09-13T05:13:36.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5918999999999999e-05 2024-09-13T05:13:36.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.544 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.544 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.544 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932717+0000", 2024-09-13T05:13:36.544 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6007999999999998e-05 2024-09-13T05:13:36.544 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.545 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.545 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.545 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.545 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160309 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 217088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:36.545 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:13:36.545 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 89.442360864999998, 2024-09-13T05:13:36.545 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89037315900000003, 2024-09-13T05:13:36.545 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.545 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.545 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.545 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.545 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.545 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160309 2024-09-13T05:13:36.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.546 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:13:36.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.546 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042441+0000", 2024-09-13T05:13:36.546 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.546 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.546 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.546 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042440+0000", 2024-09-13T05:13:36.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042444+0000", 2024-09-13T05:13:36.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.104e-06 2024-09-13T05:13:36.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.547 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.547 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042451+0000", 2024-09-13T05:13:36.547 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.922e-06 2024-09-13T05:13:36.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042457+0000", 2024-09-13T05:13:36.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3979999999999998e-06 2024-09-13T05:13:36.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042497+0000", 2024-09-13T05:13:36.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0692999999999998e-05 2024-09-13T05:13:36.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.548 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.548 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:36.548 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042503+0000", 2024-09-13T05:13:36.548 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.553e-06 2024-09-13T05:13:36.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932735+0000", 2024-09-13T05:13:36.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89023238699999996 2024-09-13T05:13:36.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932771+0000", 2024-09-13T05:13:36.549 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5972000000000001e-05 2024-09-13T05:13:36.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.549 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.549 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.549 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932814+0000", 2024-09-13T05:13:36.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2657000000000002e-05 2024-09-13T05:13:36.550 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.550 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.550 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.550 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.550 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160311 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 218112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:36.550 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:13:36.550 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 89.442335374999999, 2024-09-13T05:13:36.550 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89045284400000002, 2024-09-13T05:13:36.550 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.550 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.550 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.551 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.551 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.551 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160311 2024-09-13T05:13:36.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.551 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:13:36.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.551 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.551 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.551 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:13:36.551 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042466+0000", 2024-09-13T05:13:36.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042469+0000", 2024-09-13T05:13:36.552 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.456e-06 2024-09-13T05:13:36.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.552 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.552 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042475+0000", 2024-09-13T05:13:36.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0990000000000004e-06 2024-09-13T05:13:36.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.553 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.553 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042481+0000", 2024-09-13T05:13:36.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.237e-06 2024-09-13T05:13:36.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.553 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.553 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042527+0000", 2024-09-13T05:13:36.553 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.6796999999999999e-05 2024-09-13T05:13:36.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.553 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.553 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:36.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042533+0000", 2024-09-13T05:13:36.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6489999999999996e-06 2024-09-13T05:13:36.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932832+0000", 2024-09-13T05:13:36.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89029919800000001 2024-09-13T05:13:36.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.554 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.554 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932867+0000", 2024-09-13T05:13:36.554 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5049000000000003e-05 2024-09-13T05:13:36.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.554 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.555 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.555 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932919+0000", 2024-09-13T05:13:36.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1780999999999998e-05 2024-09-13T05:13:36.555 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.555 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.555 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.555 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.555 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160313 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 219136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:36.555 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:13:36.555 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 89.442306283999997, 2024-09-13T05:13:36.555 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89064232600000004, 2024-09-13T05:13:36.555 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.555 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.556 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.556 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.556 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.556 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160313 2024-09-13T05:13:36.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.556 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:13:36.556 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.556 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.556 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.556 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:13:36.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042495+0000", 2024-09-13T05:13:36.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.557 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042498+0000", 2024-09-13T05:13:36.557 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.281e-06 2024-09-13T05:13:36.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.557 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.557 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042505+0000", 2024-09-13T05:13:36.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2699999999999999e-06 2024-09-13T05:13:36.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042512+0000", 2024-09-13T05:13:36.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0330000000000003e-06 2024-09-13T05:13:36.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.558 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042557+0000", 2024-09-13T05:13:36.558 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.4425999999999998e-05 2024-09-13T05:13:36.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.558 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:36.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042562+0000", 2024-09-13T05:13:36.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3639999999999998e-06 2024-09-13T05:13:36.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.932987+0000", 2024-09-13T05:13:36.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89042472299999997 2024-09-13T05:13:36.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.559 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.559 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933062+0000", 2024-09-13T05:13:36.559 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5129999999999994e-05 2024-09-13T05:13:36.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.559 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.560 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.560 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933138+0000", 2024-09-13T05:13:36.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5536000000000003e-05 2024-09-13T05:13:36.560 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.560 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.560 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.560 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.560 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160315 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 220160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:36.560 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:13:36.560 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 89.442275116999994, 2024-09-13T05:13:36.560 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89071820800000001, 2024-09-13T05:13:36.560 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.560 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.561 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.561 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.561 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.561 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160315 2024-09-13T05:13:36.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.561 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:13:36.561 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.561 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.561 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.561 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:13:36.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.562 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042526+0000", 2024-09-13T05:13:36.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.562 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042529+0000", 2024-09-13T05:13:36.562 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3639999999999999e-06 2024-09-13T05:13:36.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.562 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.562 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042536+0000", 2024-09-13T05:13:36.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.866e-06 2024-09-13T05:13:36.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042541+0000", 2024-09-13T05:13:36.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2519999999999999e-06 2024-09-13T05:13:36.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.563 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042587+0000", 2024-09-13T05:13:36.563 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5735000000000002e-05 2024-09-13T05:13:36.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.563 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:36.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042593+0000", 2024-09-13T05:13:36.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0719999999999996e-06 2024-09-13T05:13:36.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933160+0000", 2024-09-13T05:13:36.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89056621000000002 2024-09-13T05:13:36.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.564 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.564 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933202+0000", 2024-09-13T05:13:36.564 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2376000000000002e-05 2024-09-13T05:13:36.564 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.564 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.565 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.565 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933245+0000", 2024-09-13T05:13:36.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2787999999999998e-05 2024-09-13T05:13:36.565 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.565 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.565 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.565 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.565 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160317 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 221184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:36.565 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:13:36.565 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 89.442246288000007, 2024-09-13T05:13:36.565 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89082205800000003, 2024-09-13T05:13:36.565 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.565 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.566 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.566 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.566 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.566 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160317 2024-09-13T05:13:36.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.566 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:13:36.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.566 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.566 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.566 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:13:36.566 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042555+0000", 2024-09-13T05:13:36.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042558+0000", 2024-09-13T05:13:36.567 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1810000000000001e-06 2024-09-13T05:13:36.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.567 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.567 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.567 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042565+0000", 2024-09-13T05:13:36.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9280000000000004e-06 2024-09-13T05:13:36.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042571+0000", 2024-09-13T05:13:36.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7420000000000003e-06 2024-09-13T05:13:36.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.568 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.568 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042616+0000", 2024-09-13T05:13:36.568 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5201999999999999e-05 2024-09-13T05:13:36.568 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.568 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:36.569 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042622+0000", 2024-09-13T05:13:36.569 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8289999999999996e-06 2024-09-13T05:13:36.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.569 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933259+0000", 2024-09-13T05:13:36.569 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89063730799999996 2024-09-13T05:13:36.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.569 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.569 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933311+0000", 2024-09-13T05:13:36.569 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1910000000000003e-05 2024-09-13T05:13:36.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.570 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.570 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933377+0000", 2024-09-13T05:13:36.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6396999999999995e-05 2024-09-13T05:13:36.570 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.570 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.570 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.570 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.570 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160319 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 222208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:36.570 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:13:36.570 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 89.442216071999994, 2024-09-13T05:13:36.570 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89087477400000004, 2024-09-13T05:13:36.571 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.571 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.571 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.571 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.571 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.571 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160319 2024-09-13T05:13:36.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.571 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.571 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.571 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.571 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:13:36.571 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042586+0000", 2024-09-13T05:13:36.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042585+0000", 2024-09-13T05:13:36.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.572 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.572 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042588+0000", 2024-09-13T05:13:36.572 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9450000000000002e-06 2024-09-13T05:13:36.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.573 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.573 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042594+0000", 2024-09-13T05:13:36.573 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0959999999999997e-06 2024-09-13T05:13:36.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.573 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.573 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042599+0000", 2024-09-13T05:13:36.573 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0069999999999997e-06 2024-09-13T05:13:36.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.573 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.573 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042642+0000", 2024-09-13T05:13:36.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2553999999999999e-05 2024-09-13T05:13:36.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.574 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.574 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:36.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042647+0000", 2024-09-13T05:13:36.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.31e-06 2024-09-13T05:13:36.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.574 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.574 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.574 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933387+0000", 2024-09-13T05:13:36.574 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89073982799999996 2024-09-13T05:13:36.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.575 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.575 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933424+0000", 2024-09-13T05:13:36.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.7101000000000003e-05 2024-09-13T05:13:36.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.575 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.575 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.575 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933460+0000", 2024-09-13T05:13:36.575 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6282999999999998e-05 2024-09-13T05:13:36.575 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.575 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.575 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.576 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.576 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:160321 3.1c 3:3f8e4795:::rbd_data.112dbd21872d.0000000000000043:28 [read 223232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117)", 2024-09-13T05:13:36.576 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:13:36.576 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 89.442186645000007, 2024-09-13T05:13:36.576 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89094616999999998, 2024-09-13T05:13:36.576 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.576 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.576 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.576 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.576 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.576 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 160321 2024-09-13T05:13:36.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.576 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.577 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:13:36.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.577 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:13:36.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.577 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.577 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.577 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042615+0000", 2024-09-13T05:13:36.577 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.578 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042617+0000", 2024-09-13T05:13:36.578 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8329999999999998e-06 2024-09-13T05:13:36.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.578 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042638+0000", 2024-09-13T05:13:36.578 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0908e-05 2024-09-13T05:13:36.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.578 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.578 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.578 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042644+0000", 2024-09-13T05:13:36.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0440000000000001e-06 2024-09-13T05:13:36.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042666+0000", 2024-09-13T05:13:36.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1256000000000001e-05 2024-09-13T05:13:36.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:36.579 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.042671+0000", 2024-09-13T05:13:36.579 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6250000000000004e-06 2024-09-13T05:13:36.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.579 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.580 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933478+0000", 2024-09-13T05:13:36.580 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.89080698800000002 2024-09-13T05:13:36.580 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.580 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.580 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.580 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933519+0000", 2024-09-13T05:13:36.580 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0717000000000003e-05 2024-09-13T05:13:36.580 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.580 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.580 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.580 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:07.933561+0000", 2024-09-13T05:13:36.580 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2225999999999999e-05 2024-09-13T05:13:36.580 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.581 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.581 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.581 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.581 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:201615 3.1d 3:bb015654:::rbd_data.112d9dba7cdc.000000000000000a:head [delete] snapc 30=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2024-09-13T05:13:36.581 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:13:36.581 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 56.479949863999998, 2024-09-13T05:13:36.581 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.90842926999999996, 2024-09-13T05:13:36.581 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.581 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:36.581 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.581 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.581 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.581 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 201615 2024-09-13T05:13:36.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.582 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:13:36.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.582 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004852+0000", 2024-09-13T05:13:36.582 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.582 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004850+0000", 2024-09-13T05:13:36.583 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:36.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.583 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004860+0000", 2024-09-13T05:13:36.583 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.927e-06 2024-09-13T05:13:36.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.583 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.583 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.583 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004882+0000", 2024-09-13T05:13:36.583 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.2079999999999999e-05 2024-09-13T05:13:36.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.584 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.584 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.584 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.004897+0000", 2024-09-13T05:13:36.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4892000000000001e-05 2024-09-13T05:13:36.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.584 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.584 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.584 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.005068+0000", 2024-09-13T05:13:36.584 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00017098999999999999 2024-09-13T05:13:36.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.584 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.584 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:36.584 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.005081+0000", 2024-09-13T05:13:36.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3063e-05 2024-09-13T05:13:36.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.585 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.910925+0000", 2024-09-13T05:13:36.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.90584383400000001 2024-09-13T05:13:36.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.585 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.585 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.911131+0000", 2024-09-13T05:13:36.585 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00020629399999999999 2024-09-13T05:13:36.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.585 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 4", 2024-09-13T05:13:36.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.911313+0000", 2024-09-13T05:13:36.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000182175 2024-09-13T05:13:36.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:36.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913010+0000", 2024-09-13T05:13:36.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0016971550000000001 2024-09-13T05:13:36.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.586 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:36.586 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913212+0000", 2024-09-13T05:13:36.586 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000202237 2024-09-13T05:13:36.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.587 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:36.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913253+0000", 2024-09-13T05:13:36.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.0250999999999998e-05 2024-09-13T05:13:36.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.587 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.587 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:40.913281+0000", 2024-09-13T05:13:36.587 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8314e-05 2024-09-13T05:13:36.587 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.587 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.587 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.588 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.588 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:209011 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e196)", 2024-09-13T05:13:36.588 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:13:30.763936+0000", 2024-09-13T05:13:36.588 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 5.720865871, 2024-09-13T05:13:36.588 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.990150262, 2024-09-13T05:13:36.588 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.588 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.588 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.588 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.588 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.588 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 209011 2024-09-13T05:13:36.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.589 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:30.763936+0000", 2024-09-13T05:13:36.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.589 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.589 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:30.763936+0000", 2024-09-13T05:13:36.589 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.589 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:30.763934+0000", 2024-09-13T05:13:36.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:36.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:30.763944+0000", 2024-09-13T05:13:36.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0730000000000001e-05 2024-09-13T05:13:36.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.590 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.590 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:30.763964+0000", 2024-09-13T05:13:36.590 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0061e-05 2024-09-13T05:13:36.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.590 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:30.763973+0000", 2024-09-13T05:13:36.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2740000000000007e-06 2024-09-13T05:13:36.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:30.764039+0000", 2024-09-13T05:13:36.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5773999999999997e-05 2024-09-13T05:13:36.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.591 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.591 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:36.591 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:30.764051+0000", 2024-09-13T05:13:36.591 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.275e-05 2024-09-13T05:13:36.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.592 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.753625+0000", 2024-09-13T05:13:36.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.98957398200000002 2024-09-13T05:13:36.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.592 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.753845+0000", 2024-09-13T05:13:36.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00021982100000000001 2024-09-13T05:13:36.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.592 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.592 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.592 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:13:31.754086+0000", 2024-09-13T05:13:36.592 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000240914 2024-09-13T05:13:36.593 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.593 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.593 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.593 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.593 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.593 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:36.594 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T05:13:36.708 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:36.708 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:36.708 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:13:36.708 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:36.718 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T05:13:36.805 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is set 2024-09-13T05:13:36.806 INFO:teuthology.orchestra.run.smithi120.stderr:marked in osd.0. 2024-09-13T05:13:36.817 INFO:tasks.thrashosds.thrasher:Added osd 0 2024-09-13T05:13:36.828 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:36.828 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:36.828 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:13:36.829 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:13:36.829 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:36.838 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T05:13:36.940 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:36.941 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:13:36.941 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:13:36.941 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:13:36.941 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.941 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29021 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2865152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:36.941 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:13:36.941 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 179.89487155800001, 2024-09-13T05:13:36.942 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060927993999999999, 2024-09-13T05:13:36.942 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.942 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.942 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.942 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.942 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.942 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29021 2024-09-13T05:13:36.942 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.942 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.942 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.942 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.942 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:13:36.942 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.942 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.943 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.943 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041764+0000", 2024-09-13T05:13:36.943 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.943 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.943 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041763+0000", 2024-09-13T05:13:36.943 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.944 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041766+0000", 2024-09-13T05:13:36.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6800000000000002e-06 2024-09-13T05:13:36.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.944 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041771+0000", 2024-09-13T05:13:36.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:13:36.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.944 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.944 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041776+0000", 2024-09-13T05:13:36.944 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.8489999999999997e-06 2024-09-13T05:13:36.945 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.945 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.945 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.945 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102513+0000", 2024-09-13T05:13:36.945 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060737102000000001 2024-09-13T05:13:36.945 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.945 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.945 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.945 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102597+0000", 2024-09-13T05:13:36.945 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4374000000000002e-05 2024-09-13T05:13:36.945 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.945 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.945 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.946 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102692+0000", 2024-09-13T05:13:36.946 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4436000000000002e-05 2024-09-13T05:13:36.946 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.946 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.946 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.946 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.946 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.946 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29022 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2874368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:36.946 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:13:36.946 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 179.89485525800001, 2024-09-13T05:13:36.946 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061135083999999999, 2024-09-13T05:13:36.946 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.946 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.946 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.947 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.947 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.947 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29022 2024-09-13T05:13:36.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.947 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.947 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.947 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.947 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:13:36.947 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.947 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.947 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.947 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:13:36.947 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.948 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.948 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041780+0000", 2024-09-13T05:13:36.948 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.948 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.948 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041782+0000", 2024-09-13T05:13:36.948 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4959999999999999e-06 2024-09-13T05:13:36.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.948 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.948 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041787+0000", 2024-09-13T05:13:36.949 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1240000000000004e-06 2024-09-13T05:13:36.949 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.949 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.949 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.949 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.041792+0000", 2024-09-13T05:13:36.949 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9200000000000003e-06 2024-09-13T05:13:36.949 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.949 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.949 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.949 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102738+0000", 2024-09-13T05:13:36.949 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060945581999999998 2024-09-13T05:13:36.949 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.949 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.949 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.949 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102821+0000", 2024-09-13T05:13:36.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2898999999999994e-05 2024-09-13T05:13:36.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.950 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.950 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.102915+0000", 2024-09-13T05:13:36.950 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4523000000000003e-05 2024-09-13T05:13:36.950 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.950 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.950 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.950 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29067 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2764800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:36.950 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:13:36.951 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 179.89108104100001, 2024-09-13T05:13:36.951 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060816621000000001, 2024-09-13T05:13:36.951 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.951 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.951 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.951 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.951 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.951 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29067 2024-09-13T05:13:36.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.951 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.951 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.951 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.951 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:13:36.952 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.952 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.952 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:13:36.952 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.952 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.952 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045554+0000", 2024-09-13T05:13:36.952 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.953 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.953 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045557+0000", 2024-09-13T05:13:36.953 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.898e-06 2024-09-13T05:13:36.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.953 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.953 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045575+0000", 2024-09-13T05:13:36.953 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8252000000000001e-05 2024-09-13T05:13:36.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.953 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.953 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045581+0000", 2024-09-13T05:13:36.953 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9150000000000001e-06 2024-09-13T05:13:36.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106183+0000", 2024-09-13T05:13:36.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060602630999999997 2024-09-13T05:13:36.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106271+0000", 2024-09-13T05:13:36.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7329000000000004e-05 2024-09-13T05:13:36.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.954 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.954 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106371+0000", 2024-09-13T05:13:36.954 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000100164 2024-09-13T05:13:36.954 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.955 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.955 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.955 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.955 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.955 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29068 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2774016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:36.955 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:13:36.955 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 179.891049807, 2024-09-13T05:13:36.955 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060994509000000002, 2024-09-13T05:13:36.955 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.955 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.955 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.955 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.955 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.955 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29068 2024-09-13T05:13:36.956 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.956 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.956 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.956 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.956 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:13:36.956 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.956 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.956 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.956 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.956 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045586+0000", 2024-09-13T05:13:36.956 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.956 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.956 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.957 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045585+0000", 2024-09-13T05:13:36.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.957 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045588+0000", 2024-09-13T05:13:36.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7669999999999999e-06 2024-09-13T05:13:36.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.957 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.957 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.957 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045594+0000", 2024-09-13T05:13:36.957 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9329999999999998e-06 2024-09-13T05:13:36.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045599+0000", 2024-09-13T05:13:36.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3190000000000002e-06 2024-09-13T05:13:36.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106399+0000", 2024-09-13T05:13:36.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060800361999999997 2024-09-13T05:13:36.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.958 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.958 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.958 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106489+0000", 2024-09-13T05:13:36.958 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9301000000000004e-05 2024-09-13T05:13:36.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.959 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.959 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106580+0000", 2024-09-13T05:13:36.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1314e-05 2024-09-13T05:13:36.959 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.959 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.959 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.959 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.959 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.959 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29069 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2792448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:36.959 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:13:36.959 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 179.89103138999999, 2024-09-13T05:13:36.959 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061207599000000001, 2024-09-13T05:13:36.959 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.960 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.960 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.960 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.960 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.960 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29069 2024-09-13T05:13:36.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.960 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.960 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:13:36.960 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.960 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.960 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.960 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045604+0000", 2024-09-13T05:13:36.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045603+0000", 2024-09-13T05:13:36.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.961 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.961 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.961 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045606+0000", 2024-09-13T05:13:36.961 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7300000000000001e-06 2024-09-13T05:13:36.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045612+0000", 2024-09-13T05:13:36.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.9599999999999997e-06 2024-09-13T05:13:36.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045619+0000", 2024-09-13T05:13:36.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6019999999999996e-06 2024-09-13T05:13:36.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.962 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.962 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.962 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106619+0000", 2024-09-13T05:13:36.962 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061000029999999997 2024-09-13T05:13:36.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106713+0000", 2024-09-13T05:13:36.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4505000000000004e-05 2024-09-13T05:13:36.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.963 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.963 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.963 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106812+0000", 2024-09-13T05:13:36.963 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.8264000000000007e-05 2024-09-13T05:13:36.963 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.964 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.964 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.964 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.964 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29070 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2783232~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:36.964 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:13:36.964 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 179.89101093100001, 2024-09-13T05:13:36.964 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061389805999999998, 2024-09-13T05:13:36.964 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.964 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.964 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.964 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.964 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.964 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29070 2024-09-13T05:13:36.965 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.965 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.965 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.965 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.965 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:13:36.965 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.965 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.965 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.965 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.965 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:13:36.965 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.965 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.965 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.966 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.966 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045624+0000", 2024-09-13T05:13:36.966 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.966 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.966 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.966 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.966 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045627+0000", 2024-09-13T05:13:36.966 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6579999999999998e-06 2024-09-13T05:13:36.966 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.966 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.966 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.966 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045632+0000", 2024-09-13T05:13:36.966 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8449999999999999e-06 2024-09-13T05:13:36.966 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.967 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045639+0000", 2024-09-13T05:13:36.967 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5050000000000004e-06 2024-09-13T05:13:36.967 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.967 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106837+0000", 2024-09-13T05:13:36.967 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061198529000000002 2024-09-13T05:13:36.967 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.967 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.967 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.967 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.106922+0000", 2024-09-13T05:13:36.967 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4771999999999994e-05 2024-09-13T05:13:36.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.968 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.968 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107014+0000", 2024-09-13T05:13:36.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2009000000000006e-05 2024-09-13T05:13:36.968 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.968 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.968 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.968 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.968 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29071 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2801664~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:36.968 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:13:36.968 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 179.89099185500001, 2024-09-13T05:13:36.968 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061582804999999997, 2024-09-13T05:13:36.969 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.969 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.969 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.969 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.969 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.969 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29071 2024-09-13T05:13:36.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.969 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.969 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.969 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:13:36.969 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.969 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.970 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045644+0000", 2024-09-13T05:13:36.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.970 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.970 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045643+0000", 2024-09-13T05:13:36.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.970 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.970 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.970 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045646+0000", 2024-09-13T05:13:36.970 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:13:36.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.971 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.971 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045664+0000", 2024-09-13T05:13:36.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.8408000000000001e-05 2024-09-13T05:13:36.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.971 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.971 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045670+0000", 2024-09-13T05:13:36.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7710000000000003e-06 2024-09-13T05:13:36.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.971 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.971 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.971 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107048+0000", 2024-09-13T05:13:36.971 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061378438 2024-09-13T05:13:36.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.972 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.972 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.972 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107134+0000", 2024-09-13T05:13:36.972 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.5574000000000004e-05 2024-09-13T05:13:36.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.972 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.972 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.972 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107226+0000", 2024-09-13T05:13:36.972 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2262000000000005e-05 2024-09-13T05:13:36.972 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.972 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.972 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.972 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.973 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29072 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2810880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:36.973 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:13:36.973 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 179.890960471, 2024-09-13T05:13:36.973 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061762233999999999, 2024-09-13T05:13:36.973 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.973 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.973 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.973 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.973 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.973 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29072 2024-09-13T05:13:36.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.973 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.973 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.973 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.974 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:13:36.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.974 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.974 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045675+0000", 2024-09-13T05:13:36.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.974 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.974 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045674+0000", 2024-09-13T05:13:36.974 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.974 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.974 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.975 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045677+0000", 2024-09-13T05:13:36.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9679999999999998e-06 2024-09-13T05:13:36.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.975 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.975 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.975 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045694+0000", 2024-09-13T05:13:36.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.6801999999999999e-05 2024-09-13T05:13:36.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.975 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.975 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.975 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045700+0000", 2024-09-13T05:13:36.975 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8270000000000003e-06 2024-09-13T05:13:36.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.976 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.976 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.976 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107249+0000", 2024-09-13T05:13:36.976 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061549114000000002 2024-09-13T05:13:36.976 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.976 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.976 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.976 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107341+0000", 2024-09-13T05:13:36.976 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.2390000000000001e-05 2024-09-13T05:13:36.976 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.976 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.976 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.976 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107437+0000", 2024-09-13T05:13:36.976 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5648000000000003e-05 2024-09-13T05:13:36.977 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.977 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.977 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.977 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.977 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.977 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29073 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2820096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:36.977 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:13:36.977 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 179.89091849299999, 2024-09-13T05:13:36.977 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061873910999999997, 2024-09-13T05:13:36.977 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.977 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.977 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.977 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.977 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.978 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29073 2024-09-13T05:13:36.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.978 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.978 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.978 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.978 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:13:36.978 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.978 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.978 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.978 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045717+0000", 2024-09-13T05:13:36.978 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.978 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045716+0000", 2024-09-13T05:13:36.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045726+0000", 2024-09-13T05:13:36.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.6350000000000001e-06 2024-09-13T05:13:36.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.979 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.979 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045739+0000", 2024-09-13T05:13:36.979 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3325e-05 2024-09-13T05:13:36.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.979 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.980 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.980 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045746+0000", 2024-09-13T05:13:36.980 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.7399999999999998e-06 2024-09-13T05:13:36.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.980 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.980 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.980 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107457+0000", 2024-09-13T05:13:36.980 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061711038000000003 2024-09-13T05:13:36.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.980 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.980 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.980 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107522+0000", 2024-09-13T05:13:36.980 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4850000000000004e-05 2024-09-13T05:13:36.980 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.981 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.981 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107591+0000", 2024-09-13T05:13:36.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9029999999999995e-05 2024-09-13T05:13:36.981 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.981 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.981 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.981 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.981 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29074 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2829312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:36.981 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:13:36.981 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 179.89088458500001, 2024-09-13T05:13:36.981 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062055459, 2024-09-13T05:13:36.981 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.981 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.982 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.982 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.982 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.982 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29074 2024-09-13T05:13:36.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.982 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.982 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.982 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.982 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:13:36.982 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.982 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.982 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.982 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045751+0000", 2024-09-13T05:13:36.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.983 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.983 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045750+0000", 2024-09-13T05:13:36.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.983 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.983 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045753+0000", 2024-09-13T05:13:36.983 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8399999999999999e-06 2024-09-13T05:13:36.983 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.983 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.983 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045759+0000", 2024-09-13T05:13:36.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8900000000000004e-06 2024-09-13T05:13:36.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045764+0000", 2024-09-13T05:13:36.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3850000000000001e-06 2024-09-13T05:13:36.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.984 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.984 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.984 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107623+0000", 2024-09-13T05:13:36.984 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061858817000000003 2024-09-13T05:13:36.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.985 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.985 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107710+0000", 2024-09-13T05:13:36.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7127999999999997e-05 2024-09-13T05:13:36.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.985 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.985 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.985 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107806+0000", 2024-09-13T05:13:36.985 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.5886999999999999e-05 2024-09-13T05:13:36.985 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.985 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.985 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.986 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29075 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2838528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:36.986 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:13:36.986 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 179.890866131, 2024-09-13T05:13:36.986 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062188516999999999, 2024-09-13T05:13:36.986 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.986 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.986 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.986 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.986 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.986 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29075 2024-09-13T05:13:36.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.986 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.986 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.986 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:13:36.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:13:36.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.987 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.987 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045769+0000", 2024-09-13T05:13:36.987 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.987 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.988 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.988 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045772+0000", 2024-09-13T05:13:36.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7970000000000001e-06 2024-09-13T05:13:36.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.988 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.988 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045778+0000", 2024-09-13T05:13:36.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9229999999999996e-06 2024-09-13T05:13:36.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.988 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.988 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.988 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.045784+0000", 2024-09-13T05:13:36.988 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3800000000000002e-06 2024-09-13T05:13:36.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107823+0000", 2024-09-13T05:13:36.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.062039331000000003 2024-09-13T05:13:36.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107886+0000", 2024-09-13T05:13:36.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2476000000000003e-05 2024-09-13T05:13:36.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.989 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.989 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.989 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.107958+0000", 2024-09-13T05:13:36.989 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2089999999999996e-05 2024-09-13T05:13:36.990 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.990 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.990 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.990 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.990 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29115 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2682880~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:36.990 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:13:36.990 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 179.88740060399999, 2024-09-13T05:13:36.990 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060847898999999997, 2024-09-13T05:13:36.990 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.990 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.990 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.990 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.990 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.991 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29115 2024-09-13T05:13:36.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.991 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.991 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.991 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:13:36.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.991 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.991 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049235+0000", 2024-09-13T05:13:36.991 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.991 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.991 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.992 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049234+0000", 2024-09-13T05:13:36.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.992 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.992 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049237+0000", 2024-09-13T05:13:36.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.9069999999999999e-06 2024-09-13T05:13:36.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.992 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.992 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.992 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049243+0000", 2024-09-13T05:13:36.992 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7459999999999997e-06 2024-09-13T05:13:36.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049248+0000", 2024-09-13T05:13:36.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1490000000000002e-06 2024-09-13T05:13:36.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.109945+0000", 2024-09-13T05:13:36.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060697299000000003 2024-09-13T05:13:36.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.993 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.993 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.993 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110013+0000", 2024-09-13T05:13:36.993 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8023999999999998e-05 2024-09-13T05:13:36.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.994 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.994 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110083+0000", 2024-09-13T05:13:36.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9296999999999997e-05 2024-09-13T05:13:36.994 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.994 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.994 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.994 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.994 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29116 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2692096~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:36.994 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:13:36.994 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 179.88738276000001, 2024-09-13T05:13:36.994 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061040167999999999, 2024-09-13T05:13:36.994 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.995 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.995 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.995 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.995 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.995 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29116 2024-09-13T05:13:36.995 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.995 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.995 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.995 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.995 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:13:36.995 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.995 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.995 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.995 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:36.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049253+0000", 2024-09-13T05:13:36.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:36.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:36.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049252+0000", 2024-09-13T05:13:36.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:36.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.996 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:36.996 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049255+0000", 2024-09-13T05:13:36.996 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7250000000000002e-06 2024-09-13T05:13:36.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.996 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:36.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049261+0000", 2024-09-13T05:13:36.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.755e-06 2024-09-13T05:13:36.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:36.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049266+0000", 2024-09-13T05:13:36.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2100000000000001e-06 2024-09-13T05:13:36.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.997 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.997 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:36.997 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110115+0000", 2024-09-13T05:13:36.997 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060849225999999999 2024-09-13T05:13:36.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:36.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110199+0000", 2024-09-13T05:13:36.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4339999999999995e-05 2024-09-13T05:13:36.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.998 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:36.998 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110293+0000", 2024-09-13T05:13:36.998 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.3397e-05 2024-09-13T05:13:36.998 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.998 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:36.998 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:36.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.998 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.999 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29117 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2701312~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:36.999 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:13:36.999 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 179.887365123, 2024-09-13T05:13:36.999 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.06118527, 2024-09-13T05:13:36.999 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:36.999 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:36.999 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:36.999 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:36.999 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:36.999 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29117 2024-09-13T05:13:36.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:36.999 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:36.999 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:36.999 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:36.999 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:13:37.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.000 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:13:37.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.000 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.000 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049270+0000", 2024-09-13T05:13:37.000 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:37.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.000 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.001 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.001 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049273+0000", 2024-09-13T05:13:37.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.757e-06 2024-09-13T05:13:37.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.001 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.001 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049278+0000", 2024-09-13T05:13:37.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7830000000000004e-06 2024-09-13T05:13:37.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.001 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.001 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049284+0000", 2024-09-13T05:13:37.001 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3820000000000003e-06 2024-09-13T05:13:37.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.001 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110313+0000", 2024-09-13T05:13:37.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061029682000000002 2024-09-13T05:13:37.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:37.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110383+0000", 2024-09-13T05:13:37.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9406000000000006e-05 2024-09-13T05:13:37.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.002 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.002 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.002 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110456+0000", 2024-09-13T05:13:37.002 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2750000000000007e-05 2024-09-13T05:13:37.002 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.003 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.003 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.003 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.003 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29118 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2710528~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.003 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:13:37.003 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 179.88734720799999, 2024-09-13T05:13:37.003 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061380698999999997, 2024-09-13T05:13:37.003 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.003 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:37.003 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.003 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.003 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.003 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29118 2024-09-13T05:13:37.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.004 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.004 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.004 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:13:37.004 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.004 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.004 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:13:37.004 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.004 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.004 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049288+0000", 2024-09-13T05:13:37.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:37.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.005 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049291+0000", 2024-09-13T05:13:37.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8770000000000002e-06 2024-09-13T05:13:37.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.005 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.005 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049296+0000", 2024-09-13T05:13:37.005 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.6799999999999998e-06 2024-09-13T05:13:37.005 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.005 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049302+0000", 2024-09-13T05:13:37.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2769999999999996e-06 2024-09-13T05:13:37.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110488+0000", 2024-09-13T05:13:37.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061186184999999997 2024-09-13T05:13:37.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.006 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.006 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:37.006 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110577+0000", 2024-09-13T05:13:37.006 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9246000000000006e-05 2024-09-13T05:13:37.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.007 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.007 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110669+0000", 2024-09-13T05:13:37.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.1923999999999996e-05 2024-09-13T05:13:37.007 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.007 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.007 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.007 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.007 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29119 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2719744~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.007 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:13:37.007 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 179.887329464, 2024-09-13T05:13:37.007 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061521165000000003, 2024-09-13T05:13:37.007 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.008 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:37.008 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.008 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.008 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.008 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29119 2024-09-13T05:13:37.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.008 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.008 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.008 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:13:37.008 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.008 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.008 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.009 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049306+0000", 2024-09-13T05:13:37.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.009 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.009 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049305+0000", 2024-09-13T05:13:37.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:37.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.009 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.009 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049308+0000", 2024-09-13T05:13:37.009 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7070000000000001e-06 2024-09-13T05:13:37.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.009 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.010 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049316+0000", 2024-09-13T05:13:37.010 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.2670000000000006e-06 2024-09-13T05:13:37.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.010 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.010 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049322+0000", 2024-09-13T05:13:37.010 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3199999999999999e-06 2024-09-13T05:13:37.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.010 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.011 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.011 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110690+0000", 2024-09-13T05:13:37.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061368428000000003 2024-09-13T05:13:37.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.011 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:37.011 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110755+0000", 2024-09-13T05:13:37.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.4893000000000004e-05 2024-09-13T05:13:37.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.011 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.011 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.011 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110827+0000", 2024-09-13T05:13:37.011 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.2039000000000006e-05 2024-09-13T05:13:37.012 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.012 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.012 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.012 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.012 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29120 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2728960~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.012 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:13:37.012 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 179.88730919400001, 2024-09-13T05:13:37.012 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061718420000000003, 2024-09-13T05:13:37.012 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.012 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:37.012 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.012 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.013 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.013 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29120 2024-09-13T05:13:37.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.013 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:13:37.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.013 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.013 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.013 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:13:37.013 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.014 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.014 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049326+0000", 2024-09-13T05:13:37.014 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:37.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.014 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.014 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049329+0000", 2024-09-13T05:13:37.014 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.022e-06 2024-09-13T05:13:37.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.014 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.014 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.014 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049336+0000", 2024-09-13T05:13:37.014 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0720000000000002e-06 2024-09-13T05:13:37.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.049341+0000", 2024-09-13T05:13:37.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0799999999999996e-06 2024-09-13T05:13:37.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110864+0000", 2024-09-13T05:13:37.015 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.061523126999999997 2024-09-13T05:13:37.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.015 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.015 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:37.015 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.110951+0000", 2024-09-13T05:13:37.016 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6557000000000005e-05 2024-09-13T05:13:37.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.016 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.016 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.111045+0000", 2024-09-13T05:13:37.016 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.4043999999999996e-05 2024-09-13T05:13:37.016 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.016 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.016 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.016 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29136 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2876416~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.016 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:13:37.017 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 179.88329376900001, 2024-09-13T05:13:37.017 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060742995000000001, 2024-09-13T05:13:37.017 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.017 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:37.017 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.017 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.017 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.017 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29136 2024-09-13T05:13:37.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.017 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.017 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.017 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.017 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:13:37.017 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053342+0000", 2024-09-13T05:13:37.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053341+0000", 2024-09-13T05:13:37.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:37.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.018 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.018 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053344+0000", 2024-09-13T05:13:37.018 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7949999999999999e-06 2024-09-13T05:13:37.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053350+0000", 2024-09-13T05:13:37.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7200000000000003e-06 2024-09-13T05:13:37.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053355+0000", 2024-09-13T05:13:37.019 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.0150000000000003e-06 2024-09-13T05:13:37.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.019 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.019 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113909+0000", 2024-09-13T05:13:37.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060554368999999997 2024-09-13T05:13:37.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.020 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:37.020 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.113994+0000", 2024-09-13T05:13:37.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.4658000000000002e-05 2024-09-13T05:13:37.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.020 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.020 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114085+0000", 2024-09-13T05:13:37.020 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0939000000000005e-05 2024-09-13T05:13:37.020 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.020 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.020 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.021 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:29166 3.a 3:555bc7cc:::rbd_data.112db57f3a18.0000000000000002:a [read 2628608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.021 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:13:37.021 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 179.88327633500001, 2024-09-13T05:13:37.021 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060883127000000002, 2024-09-13T05:13:37.021 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.021 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:37.021 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.021 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.021 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.021 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 29166 2024-09-13T05:13:37.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.021 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:13:37.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:13:37.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.022 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.022 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053359+0000", 2024-09-13T05:13:37.022 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:37.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053361+0000", 2024-09-13T05:13:37.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7650000000000002e-06 2024-09-13T05:13:37.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053367+0000", 2024-09-13T05:13:37.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7350000000000001e-06 2024-09-13T05:13:37.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.023 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.023 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.053372+0000", 2024-09-13T05:13:37.023 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.7840000000000003e-06 2024-09-13T05:13:37.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.024 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114103+0000", 2024-09-13T05:13:37.024 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.060730924999999998 2024-09-13T05:13:37.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:37.024 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114171+0000", 2024-09-13T05:13:37.024 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8021999999999993e-05 2024-09-13T05:13:37.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.024 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.024 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.114242+0000", 2024-09-13T05:13:37.024 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1390999999999995e-05 2024-09-13T05:13:37.025 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.025 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.025 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.025 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:165308 3.3 3:c04a6a9a:::rbd_data.112dc3abcba6.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-13T05:13:37.025 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:13:37.025 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 80.804819049000002, 2024-09-13T05:13:37.025 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.085530595000000001, 2024-09-13T05:13:37.025 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.025 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T05:13:37.025 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.025 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.025 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.026 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 165308 2024-09-13T05:13:37.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.026 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.026 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.026 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:13:37.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.026 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.026 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131816+0000", 2024-09-13T05:13:37.026 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.027 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.027 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.131814+0000", 2024-09-13T05:13:37.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999981 2024-09-13T05:13:37.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.027 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.027 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152479+0000", 2024-09-13T05:13:37.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.020664281 2024-09-13T05:13:37.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.027 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.027 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152521+0000", 2024-09-13T05:13:37.027 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2567000000000001e-05 2024-09-13T05:13:37.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.028 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152536+0000", 2024-09-13T05:13:37.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.4447000000000001e-05 2024-09-13T05:13:37.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.028 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152607+0000", 2024-09-13T05:13:37.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1687000000000007e-05 2024-09-13T05:13:37.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.028 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:37.028 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.152753+0000", 2024-09-13T05:13:37.028 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000145861 2024-09-13T05:13:37.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for subops from 1", 2024-09-13T05:13:37.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.159991+0000", 2024-09-13T05:13:37.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0072373100000000003 2024-09-13T05:13:37.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "op_commit", 2024-09-13T05:13:37.029 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.208492+0000", 2024-09-13T05:13:37.029 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.048501003000000001 2024-09-13T05:13:37.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.029 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "sub_op_commit_rec", 2024-09-13T05:13:37.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217224+0000", 2024-09-13T05:13:37.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0087320369999999998 2024-09-13T05:13:37.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.030 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "commit_sent", 2024-09-13T05:13:37.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217277+0000", 2024-09-13T05:13:37.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3841000000000002e-05 2024-09-13T05:13:37.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.030 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.030 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:12:16.217347+0000", 2024-09-13T05:13:37.030 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.9529999999999993e-05 2024-09-13T05:13:37.030 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.030 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.030 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.031 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.031 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.031 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:37.032 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T05:13:37.144 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:37.145 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:37.145 INFO:teuthology.orchestra.run.smithi137.stdout: "num_ops": 0 2024-09-13T05:13:37.145 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:37.154 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T05:13:37.261 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:37.262 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [], 2024-09-13T05:13:37.262 INFO:teuthology.orchestra.run.smithi137.stdout: "complaint_time": 30, 2024-09-13T05:13:37.262 INFO:teuthology.orchestra.run.smithi137.stdout: "num_blocked_ops": 0 2024-09-13T05:13:37.262 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:37.271 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T05:13:37.377 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-13T05:13:37.377 INFO:teuthology.orchestra.run.smithi137.stdout: "size": 20, 2024-09-13T05:13:37.377 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 600, 2024-09-13T05:13:37.377 INFO:teuthology.orchestra.run.smithi137.stdout: "ops": [ 2024-09-13T05:13:37.377 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.377 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28148 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2686976~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.377 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:13:37.378 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 180.50936023099999, 2024-09-13T05:13:37.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.037887209, 2024-09-13T05:13:37.378 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.378 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:37.378 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.378 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.378 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.378 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28148 2024-09-13T05:13:37.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.378 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.378 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.378 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.378 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:13:37.378 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:13:37.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.379 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.379 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.379 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863349+0000", 2024-09-13T05:13:37.379 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:37.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.380 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.380 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863353+0000", 2024-09-13T05:13:37.380 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9450000000000003e-06 2024-09-13T05:13:37.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.380 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.380 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.380 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863356+0000", 2024-09-13T05:13:37.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.96e-06 2024-09-13T05:13:37.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.381 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.381 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863359+0000", 2024-09-13T05:13:37.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4600000000000002e-06 2024-09-13T05:13:37.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.381 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.381 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865434+0000", 2024-09-13T05:13:37.381 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020749330000000002 2024-09-13T05:13:37.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.381 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:37.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865437+0000", 2024-09-13T05:13:37.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3529999999999999e-06 2024-09-13T05:13:37.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.900925+0000", 2024-09-13T05:13:37.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0354881570000001 2024-09-13T05:13:37.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.382 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.382 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:37.382 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901048+0000", 2024-09-13T05:13:37.382 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000123349 2024-09-13T05:13:37.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.383 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.383 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901237+0000", 2024-09-13T05:13:37.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00018825999999999999 2024-09-13T05:13:37.383 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.383 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.383 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.383 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.383 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28149 3.6 3:66d6ee50:::rbd_data.112db57f3a18.0000000000000000:a [read 2696192~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.383 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:13:37.383 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 180.509335795, 2024-09-13T05:13:37.383 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382536149999999, 2024-09-13T05:13:37.383 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.384 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "started", 2024-09-13T05:13:37.384 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.384 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.384 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.384 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28149 2024-09-13T05:13:37.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.384 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.384 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.384 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:13:37.384 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.384 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.384 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.384 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:13:37.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863374+0000", 2024-09-13T05:13:37.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:37.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.385 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863375+0000", 2024-09-13T05:13:37.385 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3960000000000001e-06 2024-09-13T05:13:37.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.385 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.385 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863378+0000", 2024-09-13T05:13:37.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.8040000000000002e-06 2024-09-13T05:13:37.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863382+0000", 2024-09-13T05:13:37.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8369999999999999e-06 2024-09-13T05:13:37.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.386 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.386 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865465+0000", 2024-09-13T05:13:37.386 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0020835229999999999 2024-09-13T05:13:37.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.386 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:37.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865474+0000", 2024-09-13T05:13:37.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.9239999999999996e-06 2024-09-13T05:13:37.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901264+0000", 2024-09-13T05:13:37.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0357894670000001 2024-09-13T05:13:37.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.387 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "started", 2024-09-13T05:13:37.387 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901371+0000", 2024-09-13T05:13:37.387 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.000107407 2024-09-13T05:13:37.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.387 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.388 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.388 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901628+0000", 2024-09-13T05:13:37.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.00025647000000000002 2024-09-13T05:13:37.388 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.388 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.388 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.388 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.388 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28150 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.388 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:13:37.388 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 180.509325969, 2024-09-13T05:13:37.388 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0382825259999999, 2024-09-13T05:13:37.388 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.388 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:37.389 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.389 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.389 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.389 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28150 2024-09-13T05:13:37.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.389 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:13:37.389 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.389 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.389 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.389 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:13:37.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863384+0000", 2024-09-13T05:13:37.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:37.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863385+0000", 2024-09-13T05:13:37.390 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.2500000000000001e-06 2024-09-13T05:13:37.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.390 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.390 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.390 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863388+0000", 2024-09-13T05:13:37.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.7269999999999999e-06 2024-09-13T05:13:37.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.391 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.391 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863390+0000", 2024-09-13T05:13:37.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5289999999999998e-06 2024-09-13T05:13:37.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.391 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.391 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865503+0000", 2024-09-13T05:13:37.391 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021124799999999999 2024-09-13T05:13:37.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.391 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.391 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:37.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865506+0000", 2024-09-13T05:13:37.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.4460000000000001e-06 2024-09-13T05:13:37.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.392 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.392 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901656+0000", 2024-09-13T05:13:37.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036149948 2024-09-13T05:13:37.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.392 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.392 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.392 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901666+0000", 2024-09-13T05:13:37.392 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0353000000000001e-05 2024-09-13T05:13:37.392 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.393 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.393 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.393 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.393 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.393 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28151 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.393 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:13:37.393 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 180.50931773299999, 2024-09-13T05:13:37.393 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383007230000001, 2024-09-13T05:13:37.393 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.393 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:37.393 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.393 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.393 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.393 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28151 2024-09-13T05:13:37.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.394 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.394 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:13:37.394 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.394 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:13:37.394 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.394 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863392+0000", 2024-09-13T05:13:37.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:37.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863393+0000", 2024-09-13T05:13:37.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.232e-06 2024-09-13T05:13:37.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.395 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863396+0000", 2024-09-13T05:13:37.395 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.666e-06 2024-09-13T05:13:37.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.395 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863398+0000", 2024-09-13T05:13:37.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5299999999999999e-06 2024-09-13T05:13:37.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865538+0000", 2024-09-13T05:13:37.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021395630000000001 2024-09-13T05:13:37.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.396 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:37.396 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865547+0000", 2024-09-13T05:13:37.396 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7709999999999995e-06 2024-09-13T05:13:37.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.397 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.397 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901686+0000", 2024-09-13T05:13:37.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036139573 2024-09-13T05:13:37.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.397 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.397 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901693+0000", 2024-09-13T05:13:37.397 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5980000000000002e-06 2024-09-13T05:13:37.397 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.397 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.397 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.397 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28152 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.398 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:13:37.398 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 180.50929582099999, 2024-09-13T05:13:37.398 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383044159999999, 2024-09-13T05:13:37.398 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.398 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:37.398 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.398 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.398 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.398 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28152 2024-09-13T05:13:37.398 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.398 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.398 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.398 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.398 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:13:37.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:13:37.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863414+0000", 2024-09-13T05:13:37.399 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:37.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.399 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.399 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863415+0000", 2024-09-13T05:13:37.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.28e-06 2024-09-13T05:13:37.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.400 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863418+0000", 2024-09-13T05:13:37.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.847e-06 2024-09-13T05:13:37.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.400 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863420+0000", 2024-09-13T05:13:37.400 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6410000000000002e-06 2024-09-13T05:13:37.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.400 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865572+0000", 2024-09-13T05:13:37.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021520179999999999 2024-09-13T05:13:37.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:37.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865576+0000", 2024-09-13T05:13:37.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.3009999999999998e-06 2024-09-13T05:13:37.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.401 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.401 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901712+0000", 2024-09-13T05:13:37.401 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361359910000001 2024-09-13T05:13:37.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.402 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.402 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901718+0000", 2024-09-13T05:13:37.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.5509999999999996e-06 2024-09-13T05:13:37.402 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.402 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.402 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.402 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28153 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.402 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:13:37.402 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 180.50928721700001, 2024-09-13T05:13:37.402 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038317291, 2024-09-13T05:13:37.402 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.403 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:37.403 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.403 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.403 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.403 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28153 2024-09-13T05:13:37.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.403 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.403 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.403 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:13:37.403 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.403 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.403 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:13:37.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.404 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.404 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863422+0000", 2024-09-13T05:13:37.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:37.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.404 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.404 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863424+0000", 2024-09-13T05:13:37.404 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.3400000000000001e-06 2024-09-13T05:13:37.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.404 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863427+0000", 2024-09-13T05:13:37.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.8489999999999999e-06 2024-09-13T05:13:37.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.405 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863430+0000", 2024-09-13T05:13:37.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5490000000000001e-06 2024-09-13T05:13:37.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.405 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.405 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865590+0000", 2024-09-13T05:13:37.405 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021600669999999999 2024-09-13T05:13:37.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:37.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865593+0000", 2024-09-13T05:13:37.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.174e-06 2024-09-13T05:13:37.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901736+0000", 2024-09-13T05:13:37.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361430009999999 2024-09-13T05:13:37.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.406 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.406 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901740+0000", 2024-09-13T05:13:37.406 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5190000000000001e-06 2024-09-13T05:13:37.407 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.407 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.407 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.407 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.407 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28154 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.407 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:13:37.407 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 180.50927752300001, 2024-09-13T05:13:37.407 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383215939999999, 2024-09-13T05:13:37.407 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.407 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:37.407 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.407 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.407 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.408 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28154 2024-09-13T05:13:37.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.408 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.408 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.408 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.408 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:13:37.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.408 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.408 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.408 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:13:37.408 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.409 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863432+0000", 2024-09-13T05:13:37.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:37.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.409 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863433+0000", 2024-09-13T05:13:37.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.305e-06 2024-09-13T05:13:37.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.409 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.409 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.409 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863436+0000", 2024-09-13T05:13:37.409 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5150000000000001e-06 2024-09-13T05:13:37.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.410 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.410 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863438+0000", 2024-09-13T05:13:37.410 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5320000000000001e-06 2024-09-13T05:13:37.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.410 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.410 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865623+0000", 2024-09-13T05:13:37.410 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0021846040000000001 2024-09-13T05:13:37.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.410 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.410 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:37.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865632+0000", 2024-09-13T05:13:37.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8449999999999992e-06 2024-09-13T05:13:37.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901750+0000", 2024-09-13T05:13:37.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361183119999999 2024-09-13T05:13:37.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.411 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.411 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.411 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901754+0000", 2024-09-13T05:13:37.411 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.6969999999999999e-06 2024-09-13T05:13:37.411 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.411 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.412 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.412 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.412 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28155 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.412 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:13:37.412 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 180.509268408, 2024-09-13T05:13:37.412 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03832659, 2024-09-13T05:13:37.412 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.412 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:37.412 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.412 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.412 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.412 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28155 2024-09-13T05:13:37.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.412 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:13:37.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:13:37.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.413 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.413 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.413 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863441+0000", 2024-09-13T05:13:37.413 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:37.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863442+0000", 2024-09-13T05:13:37.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.215e-06 2024-09-13T05:13:37.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863445+0000", 2024-09-13T05:13:37.414 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.6390000000000001e-06 2024-09-13T05:13:37.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.414 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.414 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.414 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863448+0000", 2024-09-13T05:13:37.415 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.5770000000000001e-06 2024-09-13T05:13:37.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.415 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.415 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865660+0000", 2024-09-13T05:13:37.415 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002212262 2024-09-13T05:13:37.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.415 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:37.415 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865663+0000", 2024-09-13T05:13:37.415 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5860000000000001e-06 2024-09-13T05:13:37.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.415 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.415 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.415 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901764+0000", 2024-09-13T05:13:37.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0361009510000001 2024-09-13T05:13:37.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.416 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.416 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901768+0000", 2024-09-13T05:13:37.416 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.5760000000000002e-06 2024-09-13T05:13:37.416 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.416 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.416 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.416 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28156 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.416 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:13:37.416 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 180.509259929, 2024-09-13T05:13:37.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383521579999999, 2024-09-13T05:13:37.417 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.417 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:37.417 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.417 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.417 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.417 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28156 2024-09-13T05:13:37.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.417 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.417 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.417 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.417 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:13:37.417 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863450+0000", 2024-09-13T05:13:37.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863449+0000", 2024-09-13T05:13:37.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:37.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.418 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.418 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.418 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863451+0000", 2024-09-13T05:13:37.418 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.9640000000000002e-06 2024-09-13T05:13:37.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.419 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.419 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863456+0000", 2024-09-13T05:13:37.419 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.9450000000000001e-06 2024-09-13T05:13:37.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.419 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.419 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863460+0000", 2024-09-13T05:13:37.419 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2200000000000001e-06 2024-09-13T05:13:37.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.419 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.419 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.419 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865693+0000", 2024-09-13T05:13:37.420 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002233489 2024-09-13T05:13:37.420 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.420 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.420 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:37.420 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865702+0000", 2024-09-13T05:13:37.420 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.6370000000000005e-06 2024-09-13T05:13:37.420 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.420 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.420 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.420 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901791+0000", 2024-09-13T05:13:37.420 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360889179999999 2024-09-13T05:13:37.420 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.420 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.420 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.421 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901802+0000", 2024-09-13T05:13:37.421 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1267000000000001e-05 2024-09-13T05:13:37.421 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.421 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.421 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.421 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.421 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28157 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.421 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:13:37.421 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 180.509248004, 2024-09-13T05:13:37.421 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383674430000001, 2024-09-13T05:13:37.421 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.421 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:37.421 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.422 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.422 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.422 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28157 2024-09-13T05:13:37.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.422 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.422 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.422 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:13:37.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.422 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.422 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863462+0000", 2024-09-13T05:13:37.422 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863461+0000", 2024-09-13T05:13:37.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967296 2024-09-13T05:13:37.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863463+0000", 2024-09-13T05:13:37.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.406e-06 2024-09-13T05:13:37.423 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.423 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.423 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.423 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863467+0000", 2024-09-13T05:13:37.423 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.873e-06 2024-09-13T05:13:37.424 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.424 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.424 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.424 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863471+0000", 2024-09-13T05:13:37.424 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.9040000000000002e-06 2024-09-13T05:13:37.424 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.424 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.424 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.424 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865728+0000", 2024-09-13T05:13:37.424 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022574769999999999 2024-09-13T05:13:37.424 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.424 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.424 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:37.425 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865731+0000", 2024-09-13T05:13:37.425 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.1439999999999999e-06 2024-09-13T05:13:37.425 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.425 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.425 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.425 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901823+0000", 2024-09-13T05:13:37.425 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036092123 2024-09-13T05:13:37.425 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.425 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.425 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.425 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901829+0000", 2024-09-13T05:13:37.425 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.733e-06 2024-09-13T05:13:37.425 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.425 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.426 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.426 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.426 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.426 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28158 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.426 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:13:37.426 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 180.509226415, 2024-09-13T05:13:37.426 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383665369999999, 2024-09-13T05:13:37.426 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.426 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:37.426 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.426 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.426 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.426 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28158 2024-09-13T05:13:37.426 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.426 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.427 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:13:37.427 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.427 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:13:37.427 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.427 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.427 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.427 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863483+0000", 2024-09-13T05:13:37.427 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:37.428 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.428 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.428 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.428 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863485+0000", 2024-09-13T05:13:37.428 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.368e-06 2024-09-13T05:13:37.428 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.428 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.428 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.428 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863491+0000", 2024-09-13T05:13:37.428 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.259e-06 2024-09-13T05:13:37.428 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.428 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.428 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.428 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863496+0000", 2024-09-13T05:13:37.429 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3730000000000001e-06 2024-09-13T05:13:37.429 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.429 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.429 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.429 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865773+0000", 2024-09-13T05:13:37.429 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022772780000000002 2024-09-13T05:13:37.429 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.429 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.429 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:37.429 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865782+0000", 2024-09-13T05:13:37.429 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.0559999999999994e-06 2024-09-13T05:13:37.429 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.429 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.429 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.430 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901844+0000", 2024-09-13T05:13:37.430 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036061788 2024-09-13T05:13:37.430 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.430 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.430 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.430 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901850+0000", 2024-09-13T05:13:37.430 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7450000000000001e-06 2024-09-13T05:13:37.430 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.430 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.430 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.430 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.430 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.430 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28159 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.430 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:13:37.431 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 180.50920328699999, 2024-09-13T05:13:37.431 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038366492, 2024-09-13T05:13:37.431 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.431 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:37.431 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.431 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.431 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.431 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28159 2024-09-13T05:13:37.431 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.431 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.431 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.431 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.431 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:13:37.431 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.432 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.432 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.432 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.432 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:13:37.432 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.432 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.432 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.432 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.432 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863506+0000", 2024-09-13T05:13:37.432 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:37.432 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.432 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.432 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.433 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863508+0000", 2024-09-13T05:13:37.433 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1720000000000001e-06 2024-09-13T05:13:37.433 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.433 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.433 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.433 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863513+0000", 2024-09-13T05:13:37.433 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1850000000000003e-06 2024-09-13T05:13:37.433 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.433 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.433 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.433 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863518+0000", 2024-09-13T05:13:37.433 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5029999999999999e-06 2024-09-13T05:13:37.433 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.433 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.434 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.434 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865808+0000", 2024-09-13T05:13:37.434 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0022901050000000002 2024-09-13T05:13:37.434 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.434 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.434 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:37.434 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865811+0000", 2024-09-13T05:13:37.434 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.366e-06 2024-09-13T05:13:37.434 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.434 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.434 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.434 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901868+0000", 2024-09-13T05:13:37.434 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360562630000001 2024-09-13T05:13:37.435 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.435 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.435 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.435 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901873+0000", 2024-09-13T05:13:37.435 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2700000000000004e-06 2024-09-13T05:13:37.435 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.435 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.435 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.435 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.435 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.435 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28160 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.435 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:13:37.435 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 180.50918791399999, 2024-09-13T05:13:37.436 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383712410000001, 2024-09-13T05:13:37.436 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.436 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:37.436 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.436 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.436 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.436 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28160 2024-09-13T05:13:37.436 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.436 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.436 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.436 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.436 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:13:37.436 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.436 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.437 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.437 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.437 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863522+0000", 2024-09-13T05:13:37.437 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.437 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.437 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.437 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.437 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863521+0000", 2024-09-13T05:13:37.437 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:37.437 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.437 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.437 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.437 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863527+0000", 2024-09-13T05:13:37.437 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.8599999999999998e-06 2024-09-13T05:13:37.438 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.438 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.438 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.438 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863533+0000", 2024-09-13T05:13:37.438 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.4960000000000004e-06 2024-09-13T05:13:37.438 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.438 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.438 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.438 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863538+0000", 2024-09-13T05:13:37.438 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.1410000000000004e-06 2024-09-13T05:13:37.438 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.438 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.438 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.438 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865843+0000", 2024-09-13T05:13:37.438 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023047469999999998 2024-09-13T05:13:37.439 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.439 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.439 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:37.439 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865850+0000", 2024-09-13T05:13:37.439 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.1380000000000001e-06 2024-09-13T05:13:37.439 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.439 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.439 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.439 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901887+0000", 2024-09-13T05:13:37.439 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036037393 2024-09-13T05:13:37.439 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.439 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.439 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.440 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901893+0000", 2024-09-13T05:13:37.440 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7960000000000001e-06 2024-09-13T05:13:37.440 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.440 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.440 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.440 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.440 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.440 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28161 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.440 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:13:37.440 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 180.50916744599999, 2024-09-13T05:13:37.440 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383762990000001, 2024-09-13T05:13:37.440 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.440 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:37.440 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.441 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.441 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.441 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28161 2024-09-13T05:13:37.441 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.441 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.441 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.441 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.441 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:13:37.441 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.441 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.441 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.441 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.442 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:13:37.442 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.442 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.442 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.442 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.442 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863542+0000", 2024-09-13T05:13:37.442 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:37.442 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.442 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.442 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.442 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863544+0000", 2024-09-13T05:13:37.442 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.1619999999999998e-06 2024-09-13T05:13:37.442 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.443 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.443 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.443 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863549+0000", 2024-09-13T05:13:37.443 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.412e-06 2024-09-13T05:13:37.443 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.443 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.443 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.443 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863555+0000", 2024-09-13T05:13:37.443 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.5940000000000001e-06 2024-09-13T05:13:37.443 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.443 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.443 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.443 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865876+0000", 2024-09-13T05:13:37.443 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002321282 2024-09-13T05:13:37.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.444 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:37.444 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865883+0000", 2024-09-13T05:13:37.444 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6039999999999998e-06 2024-09-13T05:13:37.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.444 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.444 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901911+0000", 2024-09-13T05:13:37.444 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.03602807 2024-09-13T05:13:37.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.444 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.444 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.445 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901919+0000", 2024-09-13T05:13:37.445 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.5179999999999998e-06 2024-09-13T05:13:37.445 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.445 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.445 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.445 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.445 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.445 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28162 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.445 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:13:37.445 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 180.509150785, 2024-09-13T05:13:37.445 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038383882, 2024-09-13T05:13:37.445 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.445 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:37.446 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.446 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.446 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.446 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28162 2024-09-13T05:13:37.446 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.446 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.446 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.446 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.446 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:13:37.446 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.446 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.446 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.446 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.446 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:13:37.447 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.447 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.447 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.447 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.447 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863559+0000", 2024-09-13T05:13:37.447 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:37.447 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.447 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.447 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.447 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863565+0000", 2024-09-13T05:13:37.447 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.2709999999999998e-06 2024-09-13T05:13:37.447 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.447 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.447 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.447 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863576+0000", 2024-09-13T05:13:37.448 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0654e-05 2024-09-13T05:13:37.448 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.448 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.448 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.448 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863581+0000", 2024-09-13T05:13:37.448 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.3449999999999996e-06 2024-09-13T05:13:37.448 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.448 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.448 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.448 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865912+0000", 2024-09-13T05:13:37.448 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002330777 2024-09-13T05:13:37.448 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.448 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.449 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:37.449 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865932+0000", 2024-09-13T05:13:37.449 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.0225999999999999e-05 2024-09-13T05:13:37.449 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.449 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.449 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.449 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901935+0000", 2024-09-13T05:13:37.449 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360033479999999 2024-09-13T05:13:37.449 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.449 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.449 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.450 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901943+0000", 2024-09-13T05:13:37.450 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.6009999999999997e-06 2024-09-13T05:13:37.450 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.450 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.450 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.450 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.450 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.450 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28163 3.6 3.a776b66 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.450 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:13:37.450 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 180.50912407199999, 2024-09-13T05:13:37.450 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038382183, 2024-09-13T05:13:37.450 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.450 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:37.450 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.451 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.451 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.451 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28163 2024-09-13T05:13:37.451 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.451 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.451 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.451 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.451 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:13:37.451 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.451 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.451 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.451 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.451 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863586+0000", 2024-09-13T05:13:37.451 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.452 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.452 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.452 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.452 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863585+0000", 2024-09-13T05:13:37.452 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:37.452 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.452 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.452 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.452 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863588+0000", 2024-09-13T05:13:37.452 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.3209999999999999e-06 2024-09-13T05:13:37.452 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.452 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.452 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.453 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863595+0000", 2024-09-13T05:13:37.453 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0190000000000001e-06 2024-09-13T05:13:37.453 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.453 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.453 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.453 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863600+0000", 2024-09-13T05:13:37.453 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7019999999999998e-06 2024-09-13T05:13:37.453 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.453 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.453 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.453 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865957+0000", 2024-09-13T05:13:37.453 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.002356351 2024-09-13T05:13:37.453 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.453 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.454 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:37.454 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865962+0000", 2024-09-13T05:13:37.454 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2320000000000001e-06 2024-09-13T05:13:37.454 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.454 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.454 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.454 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901960+0000", 2024-09-13T05:13:37.454 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359986299999999 2024-09-13T05:13:37.454 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.454 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.454 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.454 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901968+0000", 2024-09-13T05:13:37.454 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.3289999999999996e-06 2024-09-13T05:13:37.454 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.455 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.455 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.455 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.455 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.455 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28164 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.455 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:13:37.455 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 180.50910522000001, 2024-09-13T05:13:37.455 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0383858770000001, 2024-09-13T05:13:37.455 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.455 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:37.455 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.455 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.455 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.455 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28164 2024-09-13T05:13:37.456 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.456 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.456 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.456 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.456 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:13:37.456 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.456 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.456 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.456 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.456 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:13:37.456 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.456 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.456 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.456 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.457 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863604+0000", 2024-09-13T05:13:37.457 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:37.457 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.457 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.457 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.457 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863606+0000", 2024-09-13T05:13:37.457 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.4449999999999999e-06 2024-09-13T05:13:37.457 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.457 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.457 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.457 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863612+0000", 2024-09-13T05:13:37.457 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.7939999999999999e-06 2024-09-13T05:13:37.457 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.457 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.458 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.458 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863617+0000", 2024-09-13T05:13:37.458 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.3669999999999999e-06 2024-09-13T05:13:37.458 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.458 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.458 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.458 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.865991+0000", 2024-09-13T05:13:37.458 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023748929999999999 2024-09-13T05:13:37.458 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.458 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.458 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:37.458 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866000+0000", 2024-09-13T05:13:37.458 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.7919999999999998e-06 2024-09-13T05:13:37.459 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.459 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.459 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.459 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901984+0000", 2024-09-13T05:13:37.459 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.035983466 2024-09-13T05:13:37.459 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.459 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.459 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.459 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.901990+0000", 2024-09-13T05:13:37.459 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.6640000000000001e-06 2024-09-13T05:13:37.459 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.459 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.459 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.459 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.460 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.460 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28165 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.460 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:13:37.460 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 180.50908743400001, 2024-09-13T05:13:37.460 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.038394177, 2024-09-13T05:13:37.460 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.460 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:37.460 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.460 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.460 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.460 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28165 2024-09-13T05:13:37.460 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.460 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.460 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.460 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.461 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:13:37.461 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.461 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.461 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.461 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.461 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:13:37.461 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.461 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.461 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.461 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.461 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863622+0000", 2024-09-13T05:13:37.461 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:37.461 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.461 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.462 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.462 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863624+0000", 2024-09-13T05:13:37.462 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.328e-06 2024-09-13T05:13:37.462 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.462 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.462 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.462 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863630+0000", 2024-09-13T05:13:37.462 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 5.2530000000000004e-06 2024-09-13T05:13:37.462 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.462 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.462 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.462 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863634+0000", 2024-09-13T05:13:37.462 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.1150000000000004e-06 2024-09-13T05:13:37.462 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.463 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.463 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.463 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866024+0000", 2024-09-13T05:13:37.463 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023902620000000002 2024-09-13T05:13:37.463 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.463 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.463 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:37.463 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866027+0000", 2024-09-13T05:13:37.463 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.2310000000000001e-06 2024-09-13T05:13:37.463 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.463 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.463 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.463 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902007+0000", 2024-09-13T05:13:37.463 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0359794769999999 2024-09-13T05:13:37.464 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.464 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.464 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.464 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902016+0000", 2024-09-13T05:13:37.464 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 9.842e-06 2024-09-13T05:13:37.464 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.464 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.464 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.464 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.464 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.464 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28166 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.464 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:13:37.464 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 180.50905237399999, 2024-09-13T05:13:37.465 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384638260000001, 2024-09-13T05:13:37.465 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.465 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:37.465 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.465 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.465 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.465 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28166 2024-09-13T05:13:37.465 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.465 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.465 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.465 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.465 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:13:37.465 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.465 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.465 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.466 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.466 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:13:37.466 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.466 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.466 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.466 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.466 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863657+0000", 2024-09-13T05:13:37.466 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:37.466 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.466 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.466 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.466 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863660+0000", 2024-09-13T05:13:37.466 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.655e-06 2024-09-13T05:13:37.467 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.467 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.467 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.467 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863666+0000", 2024-09-13T05:13:37.467 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.0970000000000002e-06 2024-09-13T05:13:37.467 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.467 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.467 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.467 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863670+0000", 2024-09-13T05:13:37.467 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.5199999999999999e-06 2024-09-13T05:13:37.467 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.467 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.467 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.467 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866057+0000", 2024-09-13T05:13:37.468 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0023866820000000002 2024-09-13T05:13:37.468 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.468 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.468 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:37.468 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866066+0000", 2024-09-13T05:13:37.468 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 8.8899999999999996e-06 2024-09-13T05:13:37.468 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.468 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.468 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.468 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902110+0000", 2024-09-13T05:13:37.468 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.036044019 2024-09-13T05:13:37.468 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.468 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.468 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.468 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902121+0000", 2024-09-13T05:13:37.469 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.1381e-05 2024-09-13T05:13:37.469 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.469 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.469 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.469 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.469 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.469 INFO:teuthology.orchestra.run.smithi137.stdout: "description": "osd_op(client.4397.0:28167 3.6 3.a776b66 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e46)", 2024-09-13T05:13:37.469 INFO:teuthology.orchestra.run.smithi137.stdout: "initiated_at": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:13:37.469 INFO:teuthology.orchestra.run.smithi137.stdout: "age": 180.50903555900001, 2024-09-13T05:13:37.469 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0384768069999999, 2024-09-13T05:13:37.469 INFO:teuthology.orchestra.run.smithi137.stdout: "type_data": { 2024-09-13T05:13:37.469 INFO:teuthology.orchestra.run.smithi137.stdout: "flag_point": "reached pg", 2024-09-13T05:13:37.469 INFO:teuthology.orchestra.run.smithi137.stdout: "client_info": { 2024-09-13T05:13:37.469 INFO:teuthology.orchestra.run.smithi137.stdout: "client": "client.4397", 2024-09-13T05:13:37.470 INFO:teuthology.orchestra.run.smithi137.stdout: "client_addr": "172.21.15.120:0/447504351", 2024-09-13T05:13:37.470 INFO:teuthology.orchestra.run.smithi137.stdout: "tid": 28167 2024-09-13T05:13:37.470 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.470 INFO:teuthology.orchestra.run.smithi137.stdout: "events": [ 2024-09-13T05:13:37.470 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.470 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "initiated", 2024-09-13T05:13:37.470 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:13:37.470 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.470 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.470 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.470 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "throttled", 2024-09-13T05:13:37.470 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:13:37.470 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0 2024-09-13T05:13:37.470 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "header_read", 2024-09-13T05:13:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863674+0000", 2024-09-13T05:13:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4294967295.9999995 2024-09-13T05:13:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "all_read", 2024-09-13T05:13:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863676+0000", 2024-09-13T05:13:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 2.057e-06 2024-09-13T05:13:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "dispatched", 2024-09-13T05:13:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863683+0000", 2024-09-13T05:13:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 6.8220000000000001e-06 2024-09-13T05:13:37.472 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.472 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.472 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "queued_for_pg", 2024-09-13T05:13:37.472 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.863687+0000", 2024-09-13T05:13:37.472 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 4.2919999999999997e-06 2024-09-13T05:13:37.472 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.472 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.472 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.472 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866089+0000", 2024-09-13T05:13:37.472 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 0.0024025000000000001 2024-09-13T05:13:37.472 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.472 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.472 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "waiting for peered", 2024-09-13T05:13:37.472 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:36.866093+0000", 2024-09-13T05:13:37.473 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 3.286e-06 2024-09-13T05:13:37.473 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.473 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.473 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "reached_pg", 2024-09-13T05:13:37.473 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902144+0000", 2024-09-13T05:13:37.473 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 1.0360510869999999 2024-09-13T05:13:37.473 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-13T05:13:37.473 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-09-13T05:13:37.473 INFO:teuthology.orchestra.run.smithi137.stdout: "event": "done", 2024-09-13T05:13:37.473 INFO:teuthology.orchestra.run.smithi137.stdout: "time": "2024-09-13T05:10:37.902151+0000", 2024-09-13T05:13:37.473 INFO:teuthology.orchestra.run.smithi137.stdout: "duration": 7.0949999999999998e-06 2024-09-13T05:13:37.473 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.473 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.473 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.474 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-13T05:13:37.474 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-13T05:13:37.474 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-13T05:13:37.475 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T05:13:37.592 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:37.592 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:37.592 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-13T05:13:37.592 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:37.602 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T05:13:37.713 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:37.713 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-13T05:13:37.713 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-13T05:13:37.713 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-13T05:13:37.713 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:37.722 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T05:13:37.830 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:13:37.830 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-13T05:13:37.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-13T05:13:37.831 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [] 2024-09-13T05:13:37.831 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:13:38.819 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T05:13:39.842 INFO:teuthology.orchestra.run.smithi120.stderr:noscrub is unset 2024-09-13T05:13:39.855 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T05:13:40.852 INFO:teuthology.orchestra.run.smithi120.stderr:nodeep-scrub is unset 2024-09-13T05:13:41.819 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-13T05:13:41.958 INFO:teuthology.orchestra.run.smithi120.stdout:mon.a: {} 2024-09-13T05:13:41.971 INFO:teuthology.orchestra.run.smithi120.stdout:mon.b: {} 2024-09-13T05:13:41.986 INFO:teuthology.orchestra.run.smithi120.stdout:mon.c: {} 2024-09-13T05:13:41.988 INFO:teuthology.orchestra.run.smithi120.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-13T05:13:41.988 INFO:teuthology.orchestra.run.smithi120.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-13T05:13:41.988 INFO:teuthology.orchestra.run.smithi120.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-13T05:13:42.003 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-13T05:13:42.868 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.1 to 1 (10000) 2024-09-13T05:13:42.884 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-13T05:13:43.664 INFO:teuthology.orchestra.run.smithi120.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-13T05:13:43.678 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-13T05:13:44.661 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.2 to 1 (10000) 2024-09-13T05:13:44.673 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-13T05:13:45.673 INFO:teuthology.orchestra.run.smithi120.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-13T05:13:45.685 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-13T05:13:46.670 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.3 to 1 (10000) 2024-09-13T05:13:46.682 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-13T05:13:47.892 INFO:teuthology.orchestra.run.smithi120.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-13T05:13:47.905 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-13T05:13:48.664 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.4 to 1 (10000) 2024-09-13T05:13:48.677 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-13T05:13:49.911 INFO:teuthology.orchestra.run.smithi120.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-13T05:13:49.924 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-13T05:13:50.928 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.5 to 1 (10000) 2024-09-13T05:13:50.941 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-13T05:13:51.930 INFO:teuthology.orchestra.run.smithi120.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-13T05:13:51.944 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-13T05:13:52.936 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.6 to 1 (10000) 2024-09-13T05:13:52.948 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-13T05:13:53.944 INFO:teuthology.orchestra.run.smithi120.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-13T05:13:53.961 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-13T05:13:54.958 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.7 to 1 (10000) 2024-09-13T05:13:54.971 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-13T05:13:55.963 INFO:teuthology.orchestra.run.smithi120.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-13T05:13:55.977 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-13T05:13:56.983 INFO:teuthology.orchestra.run.smithi120.stderr:reweighted osd.0 to 1 (10000) 2024-09-13T05:13:56.997 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-13T05:13:57.991 INFO:teuthology.orchestra.run.smithi120.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-13T05:13:58.007 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-13T05:13:58.007 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-13T05:13:58.007 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-13T05:13:58.007 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-13T05:13:58.007 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T05:13:58.008 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T05:13:58.327 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:13:58.328 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":223,"fsid":"0a3759da-62bd-4704-8a4a-7c20eb3fc816","created":"2024-09-13T05:09:38.849186+0000","modified":"2024-09-13T05:13:57.972710+0000","last_up_change":"2024-09-13T05:12:13.640614+0000","last_in_change":"2024-09-13T05:13:36.781567+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T05:09:52.225455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T05:09:57.858552+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-13T05:10:07.742110+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":93,"snap_epoch":201,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b304ec03-bb00-4b13-bf2d-71017b8a70a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":105,"up_from":124,"up_thru":211,"down_at":106,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":367697828},{"type":"v1","addr":"172.21.15.120:6801","nonce":367697828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":367697828},{"type":"v1","addr":"172.21.15.120:6803","nonce":367697828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":367697828},{"type":"v1","addr":"172.21.15.120:6807","nonce":367697828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":367697828},{"type":"v1","addr":"172.21.15.120:6805","nonce":367697828}]},"public_addr":"172.21.15.120:6801/367697828","cluster_addr":"172.21.15.120:6803/367697828","heartbeat_back_addr":"172.21.15.120:6807/367697828","heartbeat_front_addr":"172.21.15.120:6805/367697828","state":["exists","up"]},{"osd":1,"uuid":"c09e84f3-3a70-46a4-b67b-c9bb52c887b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1023532100},{"type":"v1","addr":"172.21.15.120:6809","nonce":1023532100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1023532100},{"type":"v1","addr":"172.21.15.120:6811","nonce":1023532100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1023532100},{"type":"v1","addr":"172.21.15.120:6815","nonce":1023532100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1023532100},{"type":"v1","addr":"172.21.15.120:6813","nonce":1023532100}]},"public_addr":"172.21.15.120:6809/1023532100","cluster_addr":"172.21.15.120:6811/1023532100","heartbeat_back_addr":"172.21.15.120:6815/1023532100","heartbeat_front_addr":"172.21.15.120:6813/1023532100","state":["exists","up"]},{"osd":2,"uuid":"3c2a0458-369c-4dac-90a3-fb20cb70d53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":592498012},{"type":"v1","addr":"172.21.15.120:6817","nonce":592498012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":592498012},{"type":"v1","addr":"172.21.15.120:6819","nonce":592498012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":592498012},{"type":"v1","addr":"172.21.15.120:6823","nonce":592498012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":592498012},{"type":"v1","addr":"172.21.15.120:6821","nonce":592498012}]},"public_addr":"172.21.15.120:6817/592498012","cluster_addr":"172.21.15.120:6819/592498012","heartbeat_back_addr":"172.21.15.120:6823/592498012","heartbeat_front_addr":"172.21.15.120:6821/592498012","state":["exists","up"]},{"osd":3,"uuid":"edce3757-5e9d-4221-a1f1-3f356bb5218b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1939753938},{"type":"v1","addr":"172.21.15.120:6825","nonce":1939753938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1939753938},{"type":"v1","addr":"172.21.15.120:6827","nonce":1939753938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1939753938},{"type":"v1","addr":"172.21.15.120:6831","nonce":1939753938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1939753938},{"type":"v1","addr":"172.21.15.120:6829","nonce":1939753938}]},"public_addr":"172.21.15.120:6825/1939753938","cluster_addr":"172.21.15.120:6827/1939753938","heartbeat_back_addr":"172.21.15.120:6831/1939753938","heartbeat_front_addr":"172.21.15.120:6829/1939753938","state":["exists","up"]},{"osd":4,"uuid":"5fe378d2-578f-41ea-980a-4673a8b376df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3005075615},{"type":"v1","addr":"172.21.15.137:6825","nonce":3005075615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3005075615},{"type":"v1","addr":"172.21.15.137:6827","nonce":3005075615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3005075615},{"type":"v1","addr":"172.21.15.137:6831","nonce":3005075615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3005075615},{"type":"v1","addr":"172.21.15.137:6829","nonce":3005075615}]},"public_addr":"172.21.15.137:6825/3005075615","cluster_addr":"172.21.15.137:6827/3005075615","heartbeat_back_addr":"172.21.15.137:6831/3005075615","heartbeat_front_addr":"172.21.15.137:6829/3005075615","state":["exists","up"]},{"osd":5,"uuid":"6e6f7499-ae9e-4cb1-9db7-4d9f8fd9b257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1108177522},{"type":"v1","addr":"172.21.15.137:6801","nonce":1108177522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1108177522},{"type":"v1","addr":"172.21.15.137:6803","nonce":1108177522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1108177522},{"type":"v1","addr":"172.21.15.137:6807","nonce":1108177522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1108177522},{"type":"v1","addr":"172.21.15.137:6805","nonce":1108177522}]},"public_addr":"172.21.15.137:6801/1108177522","cluster_addr":"172.21.15.137:6803/1108177522","heartbeat_back_addr":"172.21.15.137:6807/1108177522","heartbeat_front_addr":"172.21.15.137:6805/1108177522","state":["exists","up"]},{"osd":6,"uuid":"e4c519e5-5df4-4d55-b12e-fbcfb1b0555c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2667039053},{"type":"v1","addr":"172.21.15.137:6817","nonce":2667039053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2667039053},{"type":"v1","addr":"172.21.15.137:6819","nonce":2667039053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2667039053},{"type":"v1","addr":"172.21.15.137:6823","nonce":2667039053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2667039053},{"type":"v1","addr":"172.21.15.137:6821","nonce":2667039053}]},"public_addr":"172.21.15.137:6817/2667039053","cluster_addr":"172.21.15.137:6819/2667039053","heartbeat_back_addr":"172.21.15.137:6823/2667039053","heartbeat_front_addr":"172.21.15.137:6821/2667039053","state":["exists","up"]},{"osd":7,"uuid":"914648c2-7a6c-4e66-811d-936e250638db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":993764921},{"type":"v1","addr":"172.21.15.137:6809","nonce":993764921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":993764921},{"type":"v1","addr":"172.21.15.137:6811","nonce":993764921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":993764921},{"type":"v1","addr":"172.21.15.137:6815","nonce":993764921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":993764921},{"type":"v1","addr":"172.21.15.137:6813","nonce":993764921}]},"public_addr":"172.21.15.137:6809/993764921","cluster_addr":"172.21.15.137:6811/993764921","heartbeat_back_addr":"172.21.15.137:6815/993764921","heartbeat_front_addr":"172.21.15.137:6813/993764921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:46.914820+0000","dead_epoch":106},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.326286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.147193+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.478655+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.388938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.127175+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.187286+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:46.962119+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.2","osds":[6,7]},{"pgid":"3.a","osds":[3,2]},{"pgid":"3.1d","osds":[0,7]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T05:13:58.342 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T05:13:58.343 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T05:13:58.650 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:13:58.651 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":223,"fsid":"0a3759da-62bd-4704-8a4a-7c20eb3fc816","created":"2024-09-13T05:09:38.849186+0000","modified":"2024-09-13T05:13:57.972710+0000","last_up_change":"2024-09-13T05:12:13.640614+0000","last_in_change":"2024-09-13T05:13:36.781567+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T05:09:52.225455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T05:09:57.858552+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-13T05:10:07.742110+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":93,"snap_epoch":201,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b304ec03-bb00-4b13-bf2d-71017b8a70a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":105,"up_from":124,"up_thru":211,"down_at":106,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":367697828},{"type":"v1","addr":"172.21.15.120:6801","nonce":367697828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":367697828},{"type":"v1","addr":"172.21.15.120:6803","nonce":367697828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":367697828},{"type":"v1","addr":"172.21.15.120:6807","nonce":367697828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":367697828},{"type":"v1","addr":"172.21.15.120:6805","nonce":367697828}]},"public_addr":"172.21.15.120:6801/367697828","cluster_addr":"172.21.15.120:6803/367697828","heartbeat_back_addr":"172.21.15.120:6807/367697828","heartbeat_front_addr":"172.21.15.120:6805/367697828","state":["exists","up"]},{"osd":1,"uuid":"c09e84f3-3a70-46a4-b67b-c9bb52c887b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1023532100},{"type":"v1","addr":"172.21.15.120:6809","nonce":1023532100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1023532100},{"type":"v1","addr":"172.21.15.120:6811","nonce":1023532100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1023532100},{"type":"v1","addr":"172.21.15.120:6815","nonce":1023532100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1023532100},{"type":"v1","addr":"172.21.15.120:6813","nonce":1023532100}]},"public_addr":"172.21.15.120:6809/1023532100","cluster_addr":"172.21.15.120:6811/1023532100","heartbeat_back_addr":"172.21.15.120:6815/1023532100","heartbeat_front_addr":"172.21.15.120:6813/1023532100","state":["exists","up"]},{"osd":2,"uuid":"3c2a0458-369c-4dac-90a3-fb20cb70d53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":592498012},{"type":"v1","addr":"172.21.15.120:6817","nonce":592498012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":592498012},{"type":"v1","addr":"172.21.15.120:6819","nonce":592498012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":592498012},{"type":"v1","addr":"172.21.15.120:6823","nonce":592498012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":592498012},{"type":"v1","addr":"172.21.15.120:6821","nonce":592498012}]},"public_addr":"172.21.15.120:6817/592498012","cluster_addr":"172.21.15.120:6819/592498012","heartbeat_back_addr":"172.21.15.120:6823/592498012","heartbeat_front_addr":"172.21.15.120:6821/592498012","state":["exists","up"]},{"osd":3,"uuid":"edce3757-5e9d-4221-a1f1-3f356bb5218b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1939753938},{"type":"v1","addr":"172.21.15.120:6825","nonce":1939753938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1939753938},{"type":"v1","addr":"172.21.15.120:6827","nonce":1939753938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1939753938},{"type":"v1","addr":"172.21.15.120:6831","nonce":1939753938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1939753938},{"type":"v1","addr":"172.21.15.120:6829","nonce":1939753938}]},"public_addr":"172.21.15.120:6825/1939753938","cluster_addr":"172.21.15.120:6827/1939753938","heartbeat_back_addr":"172.21.15.120:6831/1939753938","heartbeat_front_addr":"172.21.15.120:6829/1939753938","state":["exists","up"]},{"osd":4,"uuid":"5fe378d2-578f-41ea-980a-4673a8b376df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3005075615},{"type":"v1","addr":"172.21.15.137:6825","nonce":3005075615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3005075615},{"type":"v1","addr":"172.21.15.137:6827","nonce":3005075615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3005075615},{"type":"v1","addr":"172.21.15.137:6831","nonce":3005075615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3005075615},{"type":"v1","addr":"172.21.15.137:6829","nonce":3005075615}]},"public_addr":"172.21.15.137:6825/3005075615","cluster_addr":"172.21.15.137:6827/3005075615","heartbeat_back_addr":"172.21.15.137:6831/3005075615","heartbeat_front_addr":"172.21.15.137:6829/3005075615","state":["exists","up"]},{"osd":5,"uuid":"6e6f7499-ae9e-4cb1-9db7-4d9f8fd9b257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1108177522},{"type":"v1","addr":"172.21.15.137:6801","nonce":1108177522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1108177522},{"type":"v1","addr":"172.21.15.137:6803","nonce":1108177522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1108177522},{"type":"v1","addr":"172.21.15.137:6807","nonce":1108177522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1108177522},{"type":"v1","addr":"172.21.15.137:6805","nonce":1108177522}]},"public_addr":"172.21.15.137:6801/1108177522","cluster_addr":"172.21.15.137:6803/1108177522","heartbeat_back_addr":"172.21.15.137:6807/1108177522","heartbeat_front_addr":"172.21.15.137:6805/1108177522","state":["exists","up"]},{"osd":6,"uuid":"e4c519e5-5df4-4d55-b12e-fbcfb1b0555c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2667039053},{"type":"v1","addr":"172.21.15.137:6817","nonce":2667039053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2667039053},{"type":"v1","addr":"172.21.15.137:6819","nonce":2667039053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2667039053},{"type":"v1","addr":"172.21.15.137:6823","nonce":2667039053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2667039053},{"type":"v1","addr":"172.21.15.137:6821","nonce":2667039053}]},"public_addr":"172.21.15.137:6817/2667039053","cluster_addr":"172.21.15.137:6819/2667039053","heartbeat_back_addr":"172.21.15.137:6823/2667039053","heartbeat_front_addr":"172.21.15.137:6821/2667039053","state":["exists","up"]},{"osd":7,"uuid":"914648c2-7a6c-4e66-811d-936e250638db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":993764921},{"type":"v1","addr":"172.21.15.137:6809","nonce":993764921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":993764921},{"type":"v1","addr":"172.21.15.137:6811","nonce":993764921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":993764921},{"type":"v1","addr":"172.21.15.137:6815","nonce":993764921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":993764921},{"type":"v1","addr":"172.21.15.137:6813","nonce":993764921}]},"public_addr":"172.21.15.137:6809/993764921","cluster_addr":"172.21.15.137:6811/993764921","heartbeat_back_addr":"172.21.15.137:6815/993764921","heartbeat_front_addr":"172.21.15.137:6813/993764921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:46.914820+0000","dead_epoch":106},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.326286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.147193+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.478655+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.388938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.127175+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.187286+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:46.962119+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.2","osds":[6,7]},{"pgid":"3.a","osds":[3,2]},{"pgid":"3.1d","osds":[0,7]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T05:13:58.669 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T05:13:58.669 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T05:13:58.670 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T05:13:58.670 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T05:13:58.671 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-13T05:13:58.671 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-13T05:13:58.672 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-13T05:13:58.672 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-13T05:13:58.872 INFO:teuthology.orchestra.run.smithi120.stdout:55834574902 2024-09-13T05:13:58.873 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T05:13:58.874 INFO:teuthology.orchestra.run.smithi120.stdout:55834574903 2024-09-13T05:13:58.875 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T05:13:58.885 INFO:teuthology.orchestra.run.smithi120.stdout:55834574900 2024-09-13T05:13:58.885 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T05:13:58.889 INFO:teuthology.orchestra.run.smithi120.stdout:55834574902 2024-09-13T05:13:58.889 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T05:13:58.899 INFO:teuthology.orchestra.run.smithi120.stdout:55834574901 2024-09-13T05:13:58.899 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T05:13:58.912 INFO:teuthology.orchestra.run.smithi120.stdout:55834574903 2024-09-13T05:13:58.913 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T05:13:58.918 INFO:teuthology.orchestra.run.smithi120.stdout:55834574901 2024-09-13T05:13:58.918 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T05:13:58.929 INFO:teuthology.orchestra.run.smithi120.stdout:532575944729 2024-09-13T05:13:58.930 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T05:13:59.322 INFO:teuthology.orchestra.run.smithi120.stdout:55834574901 2024-09-13T05:13:59.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574902 got 55834574901 for osd.5 2024-09-13T05:13:59.357 INFO:teuthology.orchestra.run.smithi120.stdout:55834574902 2024-09-13T05:13:59.368 INFO:teuthology.orchestra.run.smithi120.stdout:55834574899 2024-09-13T05:13:59.374 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574903 got 55834574902 for osd.7 2024-09-13T05:13:59.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574900 got 55834574899 for osd.2 2024-09-13T05:13:59.389 INFO:teuthology.orchestra.run.smithi120.stdout:55834574901 2024-09-13T05:13:59.406 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574902 got 55834574901 for osd.3 2024-09-13T05:13:59.406 INFO:teuthology.orchestra.run.smithi120.stdout:55834574900 2024-09-13T05:13:59.406 INFO:teuthology.orchestra.run.smithi120.stdout:55834574902 2024-09-13T05:13:59.415 INFO:teuthology.orchestra.run.smithi120.stdout:55834574900 2024-09-13T05:13:59.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574901 got 55834574900 for osd.6 2024-09-13T05:13:59.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574903 got 55834574902 for osd.4 2024-09-13T05:13:59.426 INFO:teuthology.orchestra.run.smithi120.stdout:532575944727 2024-09-13T05:13:59.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574901 got 55834574900 for osd.1 2024-09-13T05:13:59.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 532575944729 got 532575944727 for osd.0 2024-09-13T05:14:00.341 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T05:14:00.375 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T05:14:00.386 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T05:14:00.407 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T05:14:00.425 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T05:14:00.426 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T05:14:00.429 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T05:14:00.439 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T05:14:00.783 INFO:teuthology.orchestra.run.smithi120.stdout:55834574901 2024-09-13T05:14:00.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574902 got 55834574901 for osd.5 2024-09-13T05:14:00.832 INFO:teuthology.orchestra.run.smithi120.stdout:55834574902 2024-09-13T05:14:00.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574903 got 55834574902 for osd.7 2024-09-13T05:14:00.852 INFO:teuthology.orchestra.run.smithi120.stdout:55834574899 2024-09-13T05:14:00.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574900 got 55834574899 for osd.2 2024-09-13T05:14:00.905 INFO:teuthology.orchestra.run.smithi120.stdout:55834574901 2024-09-13T05:14:00.912 INFO:teuthology.orchestra.run.smithi120.stdout:55834574902 2024-09-13T05:14:00.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574902 got 55834574901 for osd.3 2024-09-13T05:14:00.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574903 got 55834574902 for osd.4 2024-09-13T05:14:00.925 INFO:teuthology.orchestra.run.smithi120.stdout:55834574900 2024-09-13T05:14:00.925 INFO:teuthology.orchestra.run.smithi120.stdout:532575944727 2024-09-13T05:14:00.926 INFO:teuthology.orchestra.run.smithi120.stdout:55834574900 2024-09-13T05:14:00.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 532575944729 got 532575944727 for osd.0 2024-09-13T05:14:00.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574901 got 55834574900 for osd.6 2024-09-13T05:14:00.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574901 got 55834574900 for osd.1 2024-09-13T05:14:01.802 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T05:14:01.850 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T05:14:01.866 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T05:14:01.924 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T05:14:01.925 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T05:14:01.941 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T05:14:01.942 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T05:14:01.943 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T05:14:02.256 INFO:teuthology.orchestra.run.smithi120.stdout:55834574902 2024-09-13T05:14:02.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574902 got 55834574902 for osd.5 2024-09-13T05:14:02.277 DEBUG:teuthology.parallel:result is None 2024-09-13T05:14:02.319 INFO:teuthology.orchestra.run.smithi120.stdout:55834574904 2024-09-13T05:14:02.333 INFO:teuthology.orchestra.run.smithi120.stdout:55834574901 2024-09-13T05:14:02.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574903 got 55834574904 for osd.7 2024-09-13T05:14:02.337 DEBUG:teuthology.parallel:result is None 2024-09-13T05:14:02.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574900 got 55834574901 for osd.2 2024-09-13T05:14:02.349 DEBUG:teuthology.parallel:result is None 2024-09-13T05:14:02.352 INFO:teuthology.orchestra.run.smithi120.stdout:55834574903 2024-09-13T05:14:02.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574902 got 55834574903 for osd.3 2024-09-13T05:14:02.364 DEBUG:teuthology.parallel:result is None 2024-09-13T05:14:02.396 INFO:teuthology.orchestra.run.smithi120.stdout:55834574904 2024-09-13T05:14:02.410 INFO:teuthology.orchestra.run.smithi120.stdout:55834574902 2024-09-13T05:14:02.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574903 got 55834574904 for osd.4 2024-09-13T05:14:02.414 DEBUG:teuthology.parallel:result is None 2024-09-13T05:14:02.420 INFO:teuthology.orchestra.run.smithi120.stdout:532575944729 2024-09-13T05:14:02.423 INFO:teuthology.orchestra.run.smithi120.stdout:55834574902 2024-09-13T05:14:02.427 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574901 got 55834574902 for osd.1 2024-09-13T05:14:02.427 DEBUG:teuthology.parallel:result is None 2024-09-13T05:14:02.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 532575944729 got 532575944729 for osd.0 2024-09-13T05:14:02.436 DEBUG:teuthology.parallel:result is None 2024-09-13T05:14:02.442 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574901 got 55834574902 for osd.6 2024-09-13T05:14:02.442 DEBUG:teuthology.parallel:result is None 2024-09-13T05:14:02.442 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-13T05:14:02.443 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:14:02.733 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:14:02.737 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:14:02.750 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":342,"stamp":"2024-09-13T05:14:02.232662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":1626,"num_object_clones":0,"num_object_copies":3252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1626,"num_whiteouts":1618,"num_read":258530,"num_read_kb":631930,"num_write":28651,"num_write_kb":535083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11035,"num_bytes_recovered":282471423,"num_keys_recovered":906,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27195,"ondisk_log_size":27195,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":523704,"kb_used_data":22264,"kb_used_omap":18,"kb_used_meta":501293,"kb_avail":754451016,"statfs":{"total":773094113280,"available":772557840384,"internally_reserved":0,"allocated":22798336,"data_stored":11647732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18816,"internal_metadata":513324672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.281729"},"pg_stats":[{"pgid":"3.1f","version":"201'697","reported_seq":3851,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751296+0000","last_change":"2024-09-13T05:13:41.861132+0000","last_active":"2024-09-13T05:13:57.751296+0000","last_peered":"2024-09-13T05:13:57.751296+0000","last_clean":"2024-09-13T05:13:57.751296+0000","last_became_active":"2024-09-13T05:13:41.857384+0000","last_became_peered":"2024-09-13T05:13:41.857384+0000","last_unstale":"2024-09-13T05:13:57.751296+0000","last_undegraded":"2024-09-13T05:13:57.751296+0000","last_fullsized":"2024-09-13T05:13:57.751296+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:49.750308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024323220000000002,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":4120,"num_read_kb":8764,"num_write":717,"num_write_kb":5986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":222,"num_bytes_recovered":297202,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"200'638","reported_seq":10844,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820478+0000","last_change":"2024-09-13T05:13:35.800144+0000","last_active":"2024-09-13T05:13:57.820478+0000","last_peered":"2024-09-13T05:13:57.820478+0000","last_clean":"2024-09-13T05:13:57.820478+0000","last_became_active":"2024-09-13T05:13:17.865448+0000","last_became_peered":"2024-09-13T05:13:17.865448+0000","last_unstale":"2024-09-13T05:13:57.820478+0000","last_undegraded":"2024-09-13T05:13:57.820478+0000","last_fullsized":"2024-09-13T05:13:57.820478+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:53.868009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001429893,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":51,"num_read":10597,"num_read_kb":9513,"num_write":519,"num_write_kb":4499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":4028965,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"198'807","reported_seq":4506,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751152+0000","last_change":"2024-09-13T05:13:43.666248+0000","last_active":"2024-09-13T05:13:57.751152+0000","last_peered":"2024-09-13T05:13:57.751152+0000","last_clean":"2024-09-13T05:13:57.751152+0000","last_became_active":"2024-09-13T05:13:43.661570+0000","last_became_peered":"2024-09-13T05:13:43.661570+0000","last_unstale":"2024-09-13T05:13:57.751152+0000","last_undegraded":"2024-09-13T05:13:57.751152+0000","last_fullsized":"2024-09-13T05:13:57.751152+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:36.817036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025226720000000001,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":4533,"num_read_kb":14391,"num_write":805,"num_write_kb":18480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":591,"num_bytes_recovered":7610600,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"201'977","reported_seq":6576,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975516+0000","last_change":"2024-09-13T05:13:35.786861+0000","last_active":"2024-09-13T05:13:56.975516+0000","last_peered":"2024-09-13T05:13:56.975516+0000","last_clean":"2024-09-13T05:13:56.975516+0000","last_became_active":"2024-09-13T05:13:31.750484+0000","last_became_peered":"2024-09-13T05:13:31.750484+0000","last_unstale":"2024-09-13T05:13:56.975516+0000","last_undegraded":"2024-09-13T05:13:56.975516+0000","last_fullsized":"2024-09-13T05:13:56.975516+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":977,"log_dups_size":0,"ondisk_log_size":977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:00:07.341842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020042060000000001,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":42,"num_read":7151,"num_read_kb":23958,"num_write":1100,"num_write_kb":15871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":371,"num_bytes_recovered":9523896,"num_keys_recovered":208,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"201'877","reported_seq":4692,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751289+0000","last_change":"2024-09-13T05:13:45.669557+0000","last_active":"2024-09-13T05:13:57.751289+0000","last_peered":"2024-09-13T05:13:57.751289+0000","last_clean":"2024-09-13T05:13:57.751289+0000","last_became_active":"2024-09-13T05:13:45.664962+0000","last_became_peered":"2024-09-13T05:13:45.664962+0000","last_unstale":"2024-09-13T05:13:57.751289+0000","last_undegraded":"2024-09-13T05:13:57.751289+0000","last_fullsized":"2024-09-13T05:13:57.751289+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:45.796036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019293209999999999,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":57,"num_read":5360,"num_read_kb":16535,"num_write":962,"num_write_kb":43436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":614,"num_bytes_recovered":12868860,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"198'1987","reported_seq":21127,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.976514+0000","last_change":"2024-09-13T05:13:35.787845+0000","last_active":"2024-09-13T05:13:56.976514+0000","last_peered":"2024-09-13T05:13:56.976514+0000","last_clean":"2024-09-13T05:13:56.976514+0000","last_became_active":"2024-09-13T05:12:46.652272+0000","last_became_peered":"2024-09-13T05:12:46.652272+0000","last_unstale":"2024-09-13T05:13:56.976514+0000","last_undegraded":"2024-09-13T05:13:56.976514+0000","last_fullsized":"2024-09-13T05:13:56.976514+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1987,"log_dups_size":0,"ondisk_log_size":1987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:54.915675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028053240000000001,"stat_sum":{"num_bytes":19,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":48,"num_read":27228,"num_read_kb":30157,"num_write":3057,"num_write_kb":13192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":478,"num_bytes_recovered":9711059,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"199'934","reported_seq":12697,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979127+0000","last_change":"2024-09-13T05:13:35.786448+0000","last_active":"2024-09-13T05:13:56.979127+0000","last_peered":"2024-09-13T05:13:56.979127+0000","last_clean":"2024-09-13T05:13:56.979127+0000","last_became_active":"2024-09-13T05:12:09.626312+0000","last_became_peered":"2024-09-13T05:12:09.626312+0000","last_unstale":"2024-09-13T05:13:56.979127+0000","last_undegraded":"2024-09-13T05:13:56.979127+0000","last_fullsized":"2024-09-13T05:13:56.979127+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:47.900796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000937213,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":14225,"num_read_kb":23139,"num_write":1021,"num_write_kb":7466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":3365202,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"201'711","reported_seq":5951,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820144+0000","last_change":"2024-09-13T05:13:45.671796+0000","last_active":"2024-09-13T05:13:57.820144+0000","last_peered":"2024-09-13T05:13:57.820144+0000","last_clean":"2024-09-13T05:13:57.820144+0000","last_became_active":"2024-09-13T05:13:45.668572+0000","last_became_peered":"2024-09-13T05:13:45.668572+0000","last_unstale":"2024-09-13T05:13:57.820144+0000","last_undegraded":"2024-09-13T05:13:57.820144+0000","last_fullsized":"2024-09-13T05:13:57.820144+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:04:22.859063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000878607,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":54,"num_read":4887,"num_read_kb":27058,"num_write":681,"num_write_kb":24614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":417,"num_bytes_recovered":11847558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"201'721","reported_seq":4577,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751303+0000","last_change":"2024-09-13T05:13:40.856558+0000","last_active":"2024-09-13T05:13:57.751303+0000","last_peered":"2024-09-13T05:13:57.751303+0000","last_clean":"2024-09-13T05:13:57.751303+0000","last_became_active":"2024-09-13T05:13:40.852807+0000","last_became_peered":"2024-09-13T05:13:40.852807+0000","last_unstale":"2024-09-13T05:13:57.751303+0000","last_undegraded":"2024-09-13T05:13:57.751303+0000","last_fullsized":"2024-09-13T05:13:57.751303+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:00.702995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031554529999999999,"stat_sum":{"num_bytes":0,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":58,"num_read":6742,"num_read_kb":11740,"num_write":569,"num_write_kb":4140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":212,"num_bytes_recovered":37802,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"201'562","reported_seq":9656,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975731+0000","last_change":"2024-09-13T05:13:35.789392+0000","last_active":"2024-09-13T05:13:56.975731+0000","last_peered":"2024-09-13T05:13:56.975731+0000","last_clean":"2024-09-13T05:13:56.975731+0000","last_became_active":"2024-09-13T05:11:24.631079+0000","last_became_peered":"2024-09-13T05:11:24.631079+0000","last_unstale":"2024-09-13T05:13:56.975731+0000","last_undegraded":"2024-09-13T05:13:56.975731+0000","last_fullsized":"2024-09-13T05:13:56.975731+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:29.182802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023449740000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":9259,"num_read_kb":15708,"num_write":427,"num_write_kb":4479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":4743569,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"200'648","reported_seq":13518,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.251065+0000","last_change":"2024-09-13T05:13:35.792438+0000","last_active":"2024-09-13T05:13:58.251065+0000","last_peered":"2024-09-13T05:13:58.251065+0000","last_clean":"2024-09-13T05:13:58.251065+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:13:58.251065+0000","last_undegraded":"2024-09-13T05:13:58.251065+0000","last_fullsized":"2024-09-13T05:13:58.251065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:40.457636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001651455,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":49,"num_read":13660,"num_read_kb":13906,"num_write":593,"num_write_kb":23553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"201'594","reported_seq":8351,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.976850+0000","last_change":"2024-09-13T05:13:35.786854+0000","last_active":"2024-09-13T05:13:56.976850+0000","last_peered":"2024-09-13T05:13:56.976850+0000","last_clean":"2024-09-13T05:13:56.976850+0000","last_became_active":"2024-09-13T05:12:45.651071+0000","last_became_peered":"2024-09-13T05:12:45.651071+0000","last_unstale":"2024-09-13T05:13:56.976850+0000","last_undegraded":"2024-09-13T05:13:56.976850+0000","last_fullsized":"2024-09-13T05:13:56.976850+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:25.056987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001813283,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":48,"num_read":7291,"num_read_kb":29056,"num_write":470,"num_write_kb":7007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":364,"num_bytes_recovered":7851183,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.864933+0000","last_change":"2024-09-13T05:13:14.651362+0000","last_active":"2024-09-13T05:13:57.864933+0000","last_peered":"2024-09-13T05:13:57.864933+0000","last_clean":"2024-09-13T05:13:57.864933+0000","last_became_active":"2024-09-13T05:13:14.650955+0000","last_became_peered":"2024-09-13T05:13:14.650955+0000","last_unstale":"2024-09-13T05:13:57.864933+0000","last_undegraded":"2024-09-13T05:13:57.864933+0000","last_fullsized":"2024-09-13T05:13:57.864933+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:44:17.395077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"201'728","reported_seq":9060,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751212+0000","last_change":"2024-09-13T05:13:41.858754+0000","last_active":"2024-09-13T05:13:57.751212+0000","last_peered":"2024-09-13T05:13:57.751212+0000","last_clean":"2024-09-13T05:13:57.751212+0000","last_became_active":"2024-09-13T05:13:41.854863+0000","last_became_peered":"2024-09-13T05:13:41.854863+0000","last_unstale":"2024-09-13T05:13:57.751212+0000","last_undegraded":"2024-09-13T05:13:57.751212+0000","last_fullsized":"2024-09-13T05:13:57.751212+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:49.909033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013617600000000001,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":49,"num_read":8371,"num_read_kb":18309,"num_write":603,"num_write_kb":8603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":704,"num_bytes_recovered":23835437,"num_keys_recovered":90,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":142,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979608+0000","last_change":"2024-09-13T05:13:14.651407+0000","last_active":"2024-09-13T05:13:56.979608+0000","last_peered":"2024-09-13T05:13:56.979608+0000","last_clean":"2024-09-13T05:13:56.979608+0000","last_became_active":"2024-09-13T05:13:14.651157+0000","last_became_peered":"2024-09-13T05:13:14.651157+0000","last_unstale":"2024-09-13T05:13:56.979608+0000","last_undegraded":"2024-09-13T05:13:56.979608+0000","last_fullsized":"2024-09-13T05:13:56.979608+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:31.908741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"201'599","reported_seq":6019,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820420+0000","last_change":"2024-09-13T05:13:35.801562+0000","last_active":"2024-09-13T05:13:57.820420+0000","last_peered":"2024-09-13T05:13:57.820420+0000","last_clean":"2024-09-13T05:13:57.820420+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:13:57.820420+0000","last_undegraded":"2024-09-13T05:13:57.820420+0000","last_fullsized":"2024-09-13T05:13:57.820420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:37.976147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025976440000000001,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":54,"num_read":5378,"num_read_kb":14806,"num_write":465,"num_write_kb":5134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":251,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.251242+0000","last_change":"2024-09-13T05:13:37.804238+0000","last_active":"2024-09-13T05:13:58.251242+0000","last_peered":"2024-09-13T05:13:58.251242+0000","last_clean":"2024-09-13T05:13:58.251242+0000","last_became_active":"2024-09-13T05:13:37.803889+0000","last_became_peered":"2024-09-13T05:13:37.803889+0000","last_unstale":"2024-09-13T05:13:58.251242+0000","last_undegraded":"2024-09-13T05:13:58.251242+0000","last_fullsized":"2024-09-13T05:13:58.251242+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:54.936748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"198'711","reported_seq":1872,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979508+0000","last_change":"2024-09-13T05:13:35.787000+0000","last_active":"2024-09-13T05:13:56.979508+0000","last_peered":"2024-09-13T05:13:56.979508+0000","last_clean":"2024-09-13T05:13:56.979508+0000","last_became_active":"2024-09-13T05:12:09.627485+0000","last_became_peered":"2024-09-13T05:12:09.627485+0000","last_unstale":"2024-09-13T05:13:56.979508+0000","last_undegraded":"2024-09-13T05:13:56.979508+0000","last_fullsized":"2024-09-13T05:13:56.979508+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:54.694847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001363632,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":1702,"num_read_kb":4638,"num_write":789,"num_write_kb":10312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":352,"num_bytes_recovered":5263836,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":126,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979264+0000","last_change":"2024-09-13T05:13:37.803930+0000","last_active":"2024-09-13T05:13:56.979264+0000","last_peered":"2024-09-13T05:13:56.979264+0000","last_clean":"2024-09-13T05:13:56.979264+0000","last_became_active":"2024-09-13T05:13:37.803639+0000","last_became_peered":"2024-09-13T05:13:37.803639+0000","last_unstale":"2024-09-13T05:13:56.979264+0000","last_undegraded":"2024-09-13T05:13:56.979264+0000","last_fullsized":"2024-09-13T05:13:56.979264+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:50.699304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"198'734","reported_seq":5793,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975799+0000","last_change":"2024-09-13T05:13:35.789140+0000","last_active":"2024-09-13T05:13:56.975799+0000","last_peered":"2024-09-13T05:13:56.975799+0000","last_clean":"2024-09-13T05:13:56.975799+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:13:56.975799+0000","last_undegraded":"2024-09-13T05:13:56.975799+0000","last_fullsized":"2024-09-13T05:13:56.975799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":734,"log_dups_size":0,"ondisk_log_size":734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:40.372741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035228970000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":7406,"num_read_kb":59728,"num_write":628,"num_write_kb":55671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"201'1134","reported_seq":5748,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.976900+0000","last_change":"2024-09-13T05:13:46.667441+0000","last_active":"2024-09-13T05:13:56.976900+0000","last_peered":"2024-09-13T05:13:56.976900+0000","last_clean":"2024-09-13T05:13:56.976900+0000","last_became_active":"2024-09-13T05:13:46.664160+0000","last_became_peered":"2024-09-13T05:13:46.664160+0000","last_unstale":"2024-09-13T05:13:56.976900+0000","last_undegraded":"2024-09-13T05:13:56.976900+0000","last_fullsized":"2024-09-13T05:13:56.976900+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1134,"log_dups_size":0,"ondisk_log_size":1134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:20:03.815805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026890410000000001,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":56,"num_read":4911,"num_read_kb":30667,"num_write":1235,"num_write_kb":50371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":996,"num_bytes_recovered":31453269,"num_keys_recovered":34,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":247,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975430+0000","last_change":"2024-09-13T05:13:31.749856+0000","last_active":"2024-09-13T05:13:56.975430+0000","last_peered":"2024-09-13T05:13:56.975430+0000","last_clean":"2024-09-13T05:13:56.975430+0000","last_became_active":"2024-09-13T05:13:31.749063+0000","last_became_peered":"2024-09-13T05:13:31.749063+0000","last_unstale":"2024-09-13T05:13:56.975430+0000","last_undegraded":"2024-09-13T05:13:56.975430+0000","last_fullsized":"2024-09-13T05:13:56.975430+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:17.847170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"199'797","reported_seq":1779,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979233+0000","last_change":"2024-09-13T05:13:35.786564+0000","last_active":"2024-09-13T05:13:56.979233+0000","last_peered":"2024-09-13T05:13:56.979233+0000","last_clean":"2024-09-13T05:13:56.979233+0000","last_became_active":"2024-09-13T05:12:07.930334+0000","last_became_peered":"2024-09-13T05:12:07.930334+0000","last_unstale":"2024-09-13T05:13:56.979233+0000","last_undegraded":"2024-09-13T05:13:56.979233+0000","last_fullsized":"2024-09-13T05:13:56.979233+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:23:46.175271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096036500000000003,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":55,"num_read":2051,"num_read_kb":3594,"num_write":735,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":1243867,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":219,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.115026+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:13:58.115026+0000","last_peered":"2024-09-13T05:13:58.115026+0000","last_clean":"2024-09-13T05:13:58.115026+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:13:58.115026+0000","last_undegraded":"2024-09-13T05:13:58.115026+0000","last_fullsized":"2024-09-13T05:13:58.115026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"198'1016","reported_seq":5307,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.750988+0000","last_change":"2024-09-13T05:13:46.668732+0000","last_active":"2024-09-13T05:13:57.750988+0000","last_peered":"2024-09-13T05:13:57.750988+0000","last_clean":"2024-09-13T05:13:57.750988+0000","last_became_active":"2024-09-13T05:13:46.663849+0000","last_became_peered":"2024-09-13T05:13:46.663849+0000","last_unstale":"2024-09-13T05:13:57.750988+0000","last_undegraded":"2024-09-13T05:13:57.750988+0000","last_fullsized":"2024-09-13T05:13:57.750988+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1016,"log_dups_size":0,"ondisk_log_size":1016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:36:07.224847+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0078035550000000002,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":6441,"num_read_kb":19916,"num_write":1291,"num_write_kb":12451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":408,"num_bytes_recovered":8416446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.939824+0000","last_change":"2024-09-13T05:12:03.636279+0000","last_active":"2024-09-13T05:13:58.939824+0000","last_peered":"2024-09-13T05:13:58.939824+0000","last_clean":"2024-09-13T05:13:58.939824+0000","last_became_active":"2024-09-13T05:12:03.635929+0000","last_became_peered":"2024-09-13T05:12:03.635929+0000","last_unstale":"2024-09-13T05:13:58.939824+0000","last_undegraded":"2024-09-13T05:13:58.939824+0000","last_fullsized":"2024-09-13T05:13:58.939824+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:58:02.386056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"200'711","reported_seq":3664,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.864873+0000","last_change":"2024-09-13T05:13:35.815133+0000","last_active":"2024-09-13T05:13:57.864873+0000","last_peered":"2024-09-13T05:13:57.864873+0000","last_clean":"2024-09-13T05:13:57.864873+0000","last_became_active":"2024-09-13T05:13:18.651382+0000","last_became_peered":"2024-09-13T05:13:18.651382+0000","last_unstale":"2024-09-13T05:13:57.864873+0000","last_undegraded":"2024-09-13T05:13:57.864873+0000","last_fullsized":"2024-09-13T05:13:57.864873+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:44:13.973468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000842029,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":50,"num_read":5402,"num_read_kb":12408,"num_write":632,"num_write_kb":8370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":367,"num_bytes_recovered":3415864,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":221,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975452+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:13:56.975452+0000","last_peered":"2024-09-13T05:13:56.975452+0000","last_clean":"2024-09-13T05:13:56.975452+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:13:56.975452+0000","last_undegraded":"2024-09-13T05:13:56.975452+0000","last_fullsized":"2024-09-13T05:13:56.975452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":452,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250550+0000","last_change":"2024-09-13T05:13:41.857857+0000","last_active":"2024-09-13T05:13:58.250550+0000","last_peered":"2024-09-13T05:13:58.250550+0000","last_clean":"2024-09-13T05:13:58.250550+0000","last_became_active":"2024-09-13T05:13:41.857228+0000","last_became_peered":"2024-09-13T05:13:41.857228+0000","last_unstale":"2024-09-13T05:13:58.250550+0000","last_undegraded":"2024-09-13T05:13:58.250550+0000","last_fullsized":"2024-09-13T05:13:58.250550+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:29:01.675153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"198'658","reported_seq":17226,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820161+0000","last_change":"2024-09-13T05:13:35.799434+0000","last_active":"2024-09-13T05:13:57.820161+0000","last_peered":"2024-09-13T05:13:57.820161+0000","last_clean":"2024-09-13T05:13:57.820161+0000","last_became_active":"2024-09-13T05:12:12.653214+0000","last_became_peered":"2024-09-13T05:12:12.653214+0000","last_unstale":"2024-09-13T05:13:57.820161+0000","last_undegraded":"2024-09-13T05:13:57.820161+0000","last_fullsized":"2024-09-13T05:13:57.820161+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:11.574280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090748800000000002,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":57,"num_read":16644,"num_read_kb":16716,"num_write":498,"num_write_kb":27916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":2876772,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"201'901","reported_seq":9211,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.976432+0000","last_change":"2024-09-13T05:13:35.786479+0000","last_active":"2024-09-13T05:13:56.976432+0000","last_peered":"2024-09-13T05:13:56.976432+0000","last_clean":"2024-09-13T05:13:56.976432+0000","last_became_active":"2024-09-13T05:12:41.912780+0000","last_became_peered":"2024-09-13T05:12:41.912780+0000","last_unstale":"2024-09-13T05:13:56.976432+0000","last_undegraded":"2024-09-13T05:13:56.976432+0000","last_fullsized":"2024-09-13T05:13:56.976432+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:02:12.915400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018089219999999999,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":11722,"num_read_kb":25826,"num_write":890,"num_write_kb":20361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":5657687,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"201'835","reported_seq":11180,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820239+0000","last_change":"2024-09-13T05:13:35.802137+0000","last_active":"2024-09-13T05:13:57.820239+0000","last_peered":"2024-09-13T05:13:57.820239+0000","last_clean":"2024-09-13T05:13:57.820239+0000","last_became_active":"2024-09-13T05:10:47.939220+0000","last_became_peered":"2024-09-13T05:10:47.939220+0000","last_unstale":"2024-09-13T05:13:57.820239+0000","last_undegraded":"2024-09-13T05:13:57.820239+0000","last_fullsized":"2024-09-13T05:13:57.820239+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:59.693041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032813690000000001,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":52,"num_read":11243,"num_read_kb":19806,"num_write":773,"num_write_kb":9910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":59,"num_bytes_recovered":6203954,"num_keys_recovered":18,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"199'703","reported_seq":8005,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820257+0000","last_change":"2024-09-13T05:13:44.661351+0000","last_active":"2024-09-13T05:13:57.820257+0000","last_peered":"2024-09-13T05:13:57.820257+0000","last_clean":"2024-09-13T05:13:57.820257+0000","last_became_active":"2024-09-13T05:13:44.659181+0000","last_became_peered":"2024-09-13T05:13:44.659181+0000","last_unstale":"2024-09-13T05:13:57.820257+0000","last_undegraded":"2024-09-13T05:13:57.820257+0000","last_fullsized":"2024-09-13T05:13:57.820257+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:29:22.812081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001538939,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":7215,"num_read_kb":12852,"num_write":549,"num_write_kb":8612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":652,"num_bytes_recovered":7231372,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"200'703","reported_seq":2681,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975613+0000","last_change":"2024-09-13T05:13:35.787823+0000","last_active":"2024-09-13T05:13:56.975613+0000","last_peered":"2024-09-13T05:13:56.975613+0000","last_clean":"2024-09-13T05:13:56.975613+0000","last_became_active":"2024-09-13T05:13:31.750969+0000","last_became_peered":"2024-09-13T05:13:31.750969+0000","last_unstale":"2024-09-13T05:13:56.975613+0000","last_undegraded":"2024-09-13T05:13:56.975613+0000","last_fullsized":"2024-09-13T05:13:56.975613+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:18:46.179667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026184060000000002,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":45,"num_read":2965,"num_read_kb":14716,"num_write":786,"num_write_kb":19816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"201'861","reported_seq":4748,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.251070+0000","last_change":"2024-09-13T05:13:35.793375+0000","last_active":"2024-09-13T05:13:58.251070+0000","last_peered":"2024-09-13T05:13:58.251070+0000","last_clean":"2024-09-13T05:13:58.251070+0000","last_became_active":"2024-09-13T05:11:23.616962+0000","last_became_peered":"2024-09-13T05:11:23.616962+0000","last_unstale":"2024-09-13T05:13:58.251070+0000","last_undegraded":"2024-09-13T05:13:58.251070+0000","last_fullsized":"2024-09-13T05:13:58.251070+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:19.035337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024761649999999998,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":5259,"num_read_kb":15611,"num_write":930,"num_write_kb":9177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":12781016,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"201'1180","reported_seq":9596,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250997+0000","last_change":"2024-09-13T05:13:35.793562+0000","last_active":"2024-09-13T05:13:58.250997+0000","last_peered":"2024-09-13T05:13:58.250997+0000","last_clean":"2024-09-13T05:13:58.250997+0000","last_became_active":"2024-09-13T05:12:46.655973+0000","last_became_peered":"2024-09-13T05:12:46.655973+0000","last_unstale":"2024-09-13T05:13:58.250997+0000","last_undegraded":"2024-09-13T05:13:58.250997+0000","last_fullsized":"2024-09-13T05:13:58.250997+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1180,"log_dups_size":0,"ondisk_log_size":1180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:05:32.995650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022750969999999998,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":57,"num_read":10231,"num_read_kb":11540,"num_write":1521,"num_write_kb":6908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":612,"num_bytes_recovered":16479322,"num_keys_recovered":78,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"198'950","reported_seq":7301,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250601+0000","last_change":"2024-09-13T05:13:35.793996+0000","last_active":"2024-09-13T05:13:58.250601+0000","last_peered":"2024-09-13T05:13:58.250601+0000","last_clean":"2024-09-13T05:13:58.250601+0000","last_became_active":"2024-09-13T05:12:45.651313+0000","last_became_peered":"2024-09-13T05:12:45.651313+0000","last_unstale":"2024-09-13T05:13:58.250601+0000","last_undegraded":"2024-09-13T05:13:58.250601+0000","last_fullsized":"2024-09-13T05:13:58.250601+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":950,"log_dups_size":0,"ondisk_log_size":950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:07:00.462818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026155729999999999,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":7680,"num_read_kb":14250,"num_write":1094,"num_write_kb":7822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":7824116,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"201'725","reported_seq":4200,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.864831+0000","last_change":"2024-09-13T05:13:42.869654+0000","last_active":"2024-09-13T05:13:57.864831+0000","last_peered":"2024-09-13T05:13:57.864831+0000","last_clean":"2024-09-13T05:13:57.864831+0000","last_became_active":"2024-09-13T05:13:42.865327+0000","last_became_peered":"2024-09-13T05:13:42.865327+0000","last_unstale":"2024-09-13T05:13:57.864831+0000","last_undegraded":"2024-09-13T05:13:57.864831+0000","last_fullsized":"2024-09-13T05:13:57.864831+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:55.609658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070392800000000004,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":3644,"num_read_kb":16917,"num_write":678,"num_write_kb":24247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":802,"num_bytes_recovered":33560838,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"201'537","reported_seq":9641,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250723+0000","last_change":"2024-09-13T05:13:35.792570+0000","last_active":"2024-09-13T05:13:58.250723+0000","last_peered":"2024-09-13T05:13:58.250723+0000","last_clean":"2024-09-13T05:13:58.250723+0000","last_became_active":"2024-09-13T05:12:42.936456+0000","last_became_peered":"2024-09-13T05:12:42.936456+0000","last_unstale":"2024-09-13T05:13:58.250723+0000","last_undegraded":"2024-09-13T05:13:58.250723+0000","last_fullsized":"2024-09-13T05:13:58.250723+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:23.680853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018319619999999999,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":8115,"num_read_kb":13498,"num_write":403,"num_write_kb":21128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":380,"num_bytes_recovered":20462375,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"199'1090","reported_seq":6462,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.750976+0000","last_change":"2024-09-13T05:13:46.671045+0000","last_active":"2024-09-13T05:13:57.750976+0000","last_peered":"2024-09-13T05:13:57.750976+0000","last_clean":"2024-09-13T05:13:57.750976+0000","last_became_active":"2024-09-13T05:13:46.665575+0000","last_became_peered":"2024-09-13T05:13:46.665575+0000","last_unstale":"2024-09-13T05:13:57.750976+0000","last_undegraded":"2024-09-13T05:13:57.750976+0000","last_fullsized":"2024-09-13T05:13:57.750976+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1090,"log_dups_size":0,"ondisk_log_size":1090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:12:46.891233+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.006060307,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":9137,"num_read_kb":27013,"num_write":1266,"num_write_kb":8578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":633324,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"201'1349","reported_seq":5470,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250971+0000","last_change":"2024-09-13T05:13:35.791602+0000","last_active":"2024-09-13T05:13:58.250971+0000","last_peered":"2024-09-13T05:13:58.250971+0000","last_clean":"2024-09-13T05:13:58.250971+0000","last_became_active":"2024-09-13T05:12:48.638127+0000","last_became_peered":"2024-09-13T05:12:48.638127+0000","last_unstale":"2024-09-13T05:13:58.250971+0000","last_undegraded":"2024-09-13T05:13:58.250971+0000","last_fullsized":"2024-09-13T05:13:58.250971+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1349,"log_dups_size":0,"ondisk_log_size":1349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:33:48.012842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001070477,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":7844,"num_read_kb":55094,"num_write":1803,"num_write_kb":40168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":20884522,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":1622,"num_object_clones":0,"num_object_copies":3244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1622,"num_whiteouts":1618,"num_read":258414,"num_read_kb":631830,"num_write":28490,"num_write_kb":532665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11025,"num_bytes_recovered":280109913,"num_keys_recovered":906,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3756,"internal_metadata":0},"log_size":27075,"ondisk_log_size":27075,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106524,"kb_used_data":3216,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94265316,"statfs":{"total":96636764160,"available":96527683584,"internally_reserved":0,"allocated":3293184,"data_stored":1898733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":105773515},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:13 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.83599999999999997}]},{"osd":1,"last update":"Fri Sep 13 05:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.80700000000000005,"15min":0.81899999999999995},"min":{"1min":0.54300000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.83199999999999996,"15min":0.80500000000000005},"min":{"1min":0.48799999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.61499999999999999}]},{"osd":2,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.84899999999999998,"15min":0.85399999999999998},"min":{"1min":0.67600000000000005,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1519999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.056,"5min":0.90200000000000002,"15min":0.81499999999999995},"min":{"1min":0.94399999999999995,"5min":0.433,"15min":0.433},"max":{"1min":1.262,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.262}]},{"osd":3,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.98199999999999998,"15min":0.90500000000000003},"min":{"1min":0.54000000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2749999999999999,"5min":12.663,"15min":12.663},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.90000000000000002,"15min":0.90400000000000003},"min":{"1min":0.73199999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1799999999999999,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81100000000000005,"15min":0.77900000000000003},"min":{"1min":0.58699999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.365,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.91000000000000003,"15min":0.92500000000000004},"min":{"1min":0.48999999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.216,"5min":2.02,"15min":2.02},"last":0.876}]},{"osd":5,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.95799999999999996,"15min":0.95199999999999996},"min":{"1min":0.63900000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.246,"5min":1.655,"15min":1.655},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.96399999999999997,"15min":0.95099999999999996},"min":{"1min":0.66100000000000003,"5min":0.499,"15min":0.499},"max":{"1min":1.306,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.1919999999999999}]},{"osd":6,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93300000000000005,"15min":0.91900000000000004},"min":{"1min":0.76200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.381,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.042,"15min":1.038},"min":{"1min":0.76900000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3240000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.1100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59992,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311848,"statfs":{"total":96636764160,"available":96575332352,"internally_reserved":0,"allocated":2699264,"data_stored":1308365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58718663},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":1.0609999999999999}]},{"osd":1,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.85399999999999998,"15min":0.873},"min":{"1min":0.51900000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82399999999999995,"15min":0.85499999999999998},"min":{"1min":0.46500000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.3009999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.97999999999999998}]},{"osd":2,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.79500000000000004,"15min":0.77600000000000002},"min":{"1min":0.58299999999999996,"5min":0.312,"15min":0.312},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.93799999999999994,"15min":0.96599999999999997},"min":{"1min":0.42499999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.383,"5min":1.49,"15min":1.49},"last":1.0249999999999999}]},{"osd":3,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90700000000000003,"15min":0.93799999999999994},"min":{"1min":0.65800000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.5489999999999999,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.93000000000000005,"15min":0.93500000000000005},"min":{"1min":0.80400000000000005,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":1.143}]},{"osd":4,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.93899999999999995,"15min":0.95999999999999996},"min":{"1min":0.47399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.456,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.173},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.95299999999999996,"15min":0.98699999999999999},"min":{"1min":0.55500000000000005,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.274,"5min":2.056,"15min":2.056},"last":1.1080000000000001}]},{"osd":5,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.68300000000000005,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.0800000000000001,"15min":1.0980000000000001},"min":{"1min":0.69899999999999995,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.246}]},{"osd":7,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0620000000000001,"15min":1.101},"min":{"1min":0.748,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3120000000000001,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.0740000000000001,"15min":1.0820000000000001},"min":{"1min":0.82099999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.383}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82148,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":79486,"kb_avail":94289692,"statfs":{"total":96636764160,"available":96552644608,"internally_reserved":0,"allocated":2703360,"data_stored":1308384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":81394118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.65900000000000003}]},{"osd":1,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.83599999999999997,"15min":0.872},"min":{"1min":0.53700000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1619999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.75},{"interface":"front","average":{"1min":0.873,"5min":0.86399999999999999,"15min":0.90900000000000003},"min":{"1min":0.61299999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.145,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.86799999999999999}]},{"osd":2,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.81699999999999995,"15min":0.84499999999999997},"min":{"1min":0.40600000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1519999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.90000000000000002,"15min":0.89800000000000002},"min":{"1min":0.59999999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.96899999999999997}]},{"osd":3,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.85499999999999998,"15min":0.91100000000000003},"min":{"1min":0.58299999999999996,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1180000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.93200000000000005,"15min":1.0009999999999999},"min":{"1min":0.64900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.294,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.0980000000000001}]},{"osd":4,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.878,"15min":0.94499999999999995},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1830000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.016,"15min":1.0920000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.333,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.048}]},{"osd":6,"last update":"Fri Sep 13 05:13:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.94099999999999995,"15min":0.95399999999999996},"min":{"1min":0.58199999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4950000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.1879999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.99199999999999999,"15min":1.034},"min":{"1min":0.45600000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.236,"5min":1.528,"15min":1.528},"last":1.1399999999999999}]},{"osd":7,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0620000000000001,"15min":1.1639999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.244,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.101,"15min":1.1559999999999999},"min":{"1min":0.47399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.4590000000000001,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.236}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37856,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94333984,"statfs":{"total":96636764160,"available":96597999616,"internally_reserved":0,"allocated":2703360,"data_stored":1308384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.76500000000000001}]},{"osd":1,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.745,"15min":0.751},"min":{"1min":0.433,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0940000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.85899999999999999,"15min":0.91500000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0009999999999999,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.67900000000000005}]},{"osd":2,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.94499999999999995,"15min":0.98199999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.109,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":1.0269999999999999,"15min":1.079},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1930000000000001,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.79900000000000004}]},{"osd":3,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.91400000000000003,"15min":0.91500000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1639999999999999,"5min":4.0609999999999999,"15min":4.0609999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.88500000000000001,"15min":0.91400000000000003},"min":{"1min":0.64200000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1539999999999999,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.72899999999999998}]},{"osd":5,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.871,"15min":0.88700000000000001},"min":{"1min":0.53100000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.012,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":1.0660000000000001,"15min":1.1499999999999999},"min":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.133,"5min":3.871,"15min":3.871},"last":0.97599999999999998}]},{"osd":6,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.0669999999999999,"15min":1.1339999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.149,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.94299999999999995,"15min":0.95699999999999996},"min":{"1min":0.61399999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.254,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.82799999999999996}]},{"osd":7,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.1000000000000001,"15min":1.153},"min":{"1min":0.61099999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.238,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.081,"15min":1.1000000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.3460000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.89700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64100,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":61438,"kb_avail":94307740,"statfs":{"total":96636764160,"available":96571125760,"internally_reserved":0,"allocated":2699264,"data_stored":1308365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":62912968},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.71599999999999997}]},{"osd":1,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64500000000000002,"15min":0.65800000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.67600000000000005,"15min":0.71599999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.0069999999999999,"5min":1.125,"15min":1.125},"last":0.755}]},{"osd":2,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.72199999999999998,"15min":0.73799999999999999},"min":{"1min":0.39000000000000001,"5min":0.377,"15min":0.377},"max":{"1min":1.2330000000000001,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.78600000000000003,"15min":0.83599999999999997},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.113,"5min":1.573,"15min":1.573},"last":0.78500000000000003}]},{"osd":4,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.85399999999999998,"15min":0.89500000000000002},"min":{"1min":0.55100000000000005,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.88800000000000001,"15min":0.92600000000000005},"min":{"1min":0.49099999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.196,"5min":1.764,"15min":1.764},"last":0.89600000000000002}]},{"osd":5,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.94599999999999995,"15min":1.004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2390000000000001,"5min":2.157,"15min":2.157},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.92700000000000005,"15min":0.98299999999999998},"min":{"1min":0.68400000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.633,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.0940000000000001}]},{"osd":6,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.94099999999999995,"15min":0.97899999999999998},"min":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.375,"5min":1.976,"15min":1.976},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":1.02,"15min":1.089},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4970000000000001,"5min":2.012,"15min":2.012},"last":1.0580000000000001}]},{"osd":7,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.028,"15min":1.077},"min":{"1min":0.57899999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.6679999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.198},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0609999999999999,"15min":1.101},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7170000000000001,"5min":1.875,"15min":1.875},"last":1.157}]}]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65756,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306084,"statfs":{"total":96636764160,"available":96569430016,"internally_reserved":0,"allocated":2699264,"data_stored":1308365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.60399999999999998}]},{"osd":1,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64800000000000002,"15min":0.66800000000000004},"min":{"1min":0.40200000000000002,"5min":0.246,"15min":0.246},"max":{"1min":1.081,"5min":1.554,"15min":1.554},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64200000000000002,"15min":0.65400000000000003},"min":{"1min":0.40100000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0780000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.79400000000000004}]},{"osd":3,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67000000000000004,"15min":0.624},"min":{"1min":0.38300000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.002,"5min":6.6070000000000002,"15min":6.6070000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69499999999999995,"15min":0.66700000000000004},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.014,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.746}]},{"osd":4,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.82299999999999995,"15min":0.78300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.464,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.464},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.90700000000000003,"15min":0.89800000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":1.3380000000000001}]},{"osd":5,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.878,"15min":0.89400000000000002},"min":{"1min":0.48999999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.1099999999999999,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.028},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.89700000000000002,"15min":0.872},"min":{"1min":0.52400000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3500000000000001,"5min":1.51,"15min":1.51},"last":0.93899999999999995}]},{"osd":6,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90300000000000002,"15min":0.879},"min":{"1min":0.54200000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94699999999999995,"15min":0.94799999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3300000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.2270000000000001}]},{"osd":7,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0109999999999999,"15min":1.0289999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3680000000000001,"5min":1.867,"15min":1.867},"last":1.115},{"interface":"front","average":{"1min":1.038,"5min":0.97499999999999998,"15min":0.97599999999999998},"min":{"1min":0.52000000000000002,"5min":0.496,"15min":0.496},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":1.1819999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60000,"kb_used_data":2644,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311840,"statfs":{"total":96636764160,"available":96575324160,"internally_reserved":0,"allocated":2707456,"data_stored":1308403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.66400000000000003,"15min":0.61599999999999999},"min":{"1min":0.39400000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.98899999999999999,"5min":5.952,"15min":5.952},"last":0.623},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66300000000000003,"15min":0.68999999999999995},"min":{"1min":0.45900000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86499999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72699999999999998,"15min":0.76700000000000002},"min":{"1min":0.42099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.127,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71399999999999997,"15min":0.747},"min":{"1min":0.47399999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.026,"5min":1.887,"15min":1.887},"last":0.80300000000000005}]},{"osd":4,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.86899999999999999,"15min":0.91400000000000003},"min":{"1min":0.66400000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0329999999999999,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0740000000000001,"5min":0.92200000000000004,"15min":0.94399999999999995},"min":{"1min":0.78700000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.4750000000000001,"5min":1.724,"15min":1.724},"last":1.0609999999999999}]},{"osd":5,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.89700000000000002,"15min":0.92400000000000004},"min":{"1min":0.69799999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.752},{"interface":"front","average":{"1min":1.0609999999999999,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.76800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.008}]},{"osd":6,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.94999999999999996,"15min":1},"min":{"1min":0.67500000000000004,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.4239999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.109,"5min":1.0029999999999999,"15min":1.0149999999999999},"min":{"1min":0.74399999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.625,"5min":1.873,"15min":1.873},"last":1.109}]},{"osd":7,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.996,"15min":1.018},"min":{"1min":0.80900000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.877},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.046,"15min":1.0409999999999999},"min":{"1min":0.91700000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.401,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.0840000000000001}]}]},{"osd":0,"up_from":124,"seq":532575944729,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47328,"kb_used_data":3216,"kb_used_omap":7,"kb_used_meta":44088,"kb_avail":94324512,"statfs":{"total":96636764160,"available":96588300288,"internally_reserved":0,"allocated":3293184,"data_stored":1898733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7666,"internal_metadata":45146638},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.51800000000000002}]},{"osd":2,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.46400000000000002}]},{"osd":3,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.121}]},{"osd":4,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":3.2330000000000001,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":1.147}]},{"osd":5,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.87}]},{"osd":6,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":1.0580000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3756,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:14:02.754 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:14:03.046 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:14:03.048 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:14:03.060 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":342,"stamp":"2024-09-13T05:14:02.232662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":1626,"num_object_clones":0,"num_object_copies":3252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1626,"num_whiteouts":1618,"num_read":258530,"num_read_kb":631930,"num_write":28651,"num_write_kb":535083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11035,"num_bytes_recovered":282471423,"num_keys_recovered":906,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27195,"ondisk_log_size":27195,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":523704,"kb_used_data":22264,"kb_used_omap":18,"kb_used_meta":501293,"kb_avail":754451016,"statfs":{"total":773094113280,"available":772557840384,"internally_reserved":0,"allocated":22798336,"data_stored":11647732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18816,"internal_metadata":513324672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.281729"},"pg_stats":[{"pgid":"3.1f","version":"201'697","reported_seq":3851,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751296+0000","last_change":"2024-09-13T05:13:41.861132+0000","last_active":"2024-09-13T05:13:57.751296+0000","last_peered":"2024-09-13T05:13:57.751296+0000","last_clean":"2024-09-13T05:13:57.751296+0000","last_became_active":"2024-09-13T05:13:41.857384+0000","last_became_peered":"2024-09-13T05:13:41.857384+0000","last_unstale":"2024-09-13T05:13:57.751296+0000","last_undegraded":"2024-09-13T05:13:57.751296+0000","last_fullsized":"2024-09-13T05:13:57.751296+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:49.750308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024323220000000002,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":4120,"num_read_kb":8764,"num_write":717,"num_write_kb":5986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":222,"num_bytes_recovered":297202,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"200'638","reported_seq":10844,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820478+0000","last_change":"2024-09-13T05:13:35.800144+0000","last_active":"2024-09-13T05:13:57.820478+0000","last_peered":"2024-09-13T05:13:57.820478+0000","last_clean":"2024-09-13T05:13:57.820478+0000","last_became_active":"2024-09-13T05:13:17.865448+0000","last_became_peered":"2024-09-13T05:13:17.865448+0000","last_unstale":"2024-09-13T05:13:57.820478+0000","last_undegraded":"2024-09-13T05:13:57.820478+0000","last_fullsized":"2024-09-13T05:13:57.820478+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:53.868009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001429893,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":51,"num_read":10597,"num_read_kb":9513,"num_write":519,"num_write_kb":4499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":4028965,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"198'807","reported_seq":4506,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751152+0000","last_change":"2024-09-13T05:13:43.666248+0000","last_active":"2024-09-13T05:13:57.751152+0000","last_peered":"2024-09-13T05:13:57.751152+0000","last_clean":"2024-09-13T05:13:57.751152+0000","last_became_active":"2024-09-13T05:13:43.661570+0000","last_became_peered":"2024-09-13T05:13:43.661570+0000","last_unstale":"2024-09-13T05:13:57.751152+0000","last_undegraded":"2024-09-13T05:13:57.751152+0000","last_fullsized":"2024-09-13T05:13:57.751152+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:36.817036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025226720000000001,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":4533,"num_read_kb":14391,"num_write":805,"num_write_kb":18480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":591,"num_bytes_recovered":7610600,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"201'977","reported_seq":6576,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975516+0000","last_change":"2024-09-13T05:13:35.786861+0000","last_active":"2024-09-13T05:13:56.975516+0000","last_peered":"2024-09-13T05:13:56.975516+0000","last_clean":"2024-09-13T05:13:56.975516+0000","last_became_active":"2024-09-13T05:13:31.750484+0000","last_became_peered":"2024-09-13T05:13:31.750484+0000","last_unstale":"2024-09-13T05:13:56.975516+0000","last_undegraded":"2024-09-13T05:13:56.975516+0000","last_fullsized":"2024-09-13T05:13:56.975516+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":977,"log_dups_size":0,"ondisk_log_size":977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:00:07.341842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020042060000000001,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":42,"num_read":7151,"num_read_kb":23958,"num_write":1100,"num_write_kb":15871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":371,"num_bytes_recovered":9523896,"num_keys_recovered":208,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"201'877","reported_seq":4692,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751289+0000","last_change":"2024-09-13T05:13:45.669557+0000","last_active":"2024-09-13T05:13:57.751289+0000","last_peered":"2024-09-13T05:13:57.751289+0000","last_clean":"2024-09-13T05:13:57.751289+0000","last_became_active":"2024-09-13T05:13:45.664962+0000","last_became_peered":"2024-09-13T05:13:45.664962+0000","last_unstale":"2024-09-13T05:13:57.751289+0000","last_undegraded":"2024-09-13T05:13:57.751289+0000","last_fullsized":"2024-09-13T05:13:57.751289+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:45.796036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019293209999999999,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":57,"num_read":5360,"num_read_kb":16535,"num_write":962,"num_write_kb":43436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":614,"num_bytes_recovered":12868860,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"198'1987","reported_seq":21127,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.976514+0000","last_change":"2024-09-13T05:13:35.787845+0000","last_active":"2024-09-13T05:13:56.976514+0000","last_peered":"2024-09-13T05:13:56.976514+0000","last_clean":"2024-09-13T05:13:56.976514+0000","last_became_active":"2024-09-13T05:12:46.652272+0000","last_became_peered":"2024-09-13T05:12:46.652272+0000","last_unstale":"2024-09-13T05:13:56.976514+0000","last_undegraded":"2024-09-13T05:13:56.976514+0000","last_fullsized":"2024-09-13T05:13:56.976514+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1987,"log_dups_size":0,"ondisk_log_size":1987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:54.915675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028053240000000001,"stat_sum":{"num_bytes":19,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":48,"num_read":27228,"num_read_kb":30157,"num_write":3057,"num_write_kb":13192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":478,"num_bytes_recovered":9711059,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"199'934","reported_seq":12697,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979127+0000","last_change":"2024-09-13T05:13:35.786448+0000","last_active":"2024-09-13T05:13:56.979127+0000","last_peered":"2024-09-13T05:13:56.979127+0000","last_clean":"2024-09-13T05:13:56.979127+0000","last_became_active":"2024-09-13T05:12:09.626312+0000","last_became_peered":"2024-09-13T05:12:09.626312+0000","last_unstale":"2024-09-13T05:13:56.979127+0000","last_undegraded":"2024-09-13T05:13:56.979127+0000","last_fullsized":"2024-09-13T05:13:56.979127+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:47.900796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000937213,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":14225,"num_read_kb":23139,"num_write":1021,"num_write_kb":7466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":3365202,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"201'711","reported_seq":5951,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820144+0000","last_change":"2024-09-13T05:13:45.671796+0000","last_active":"2024-09-13T05:13:57.820144+0000","last_peered":"2024-09-13T05:13:57.820144+0000","last_clean":"2024-09-13T05:13:57.820144+0000","last_became_active":"2024-09-13T05:13:45.668572+0000","last_became_peered":"2024-09-13T05:13:45.668572+0000","last_unstale":"2024-09-13T05:13:57.820144+0000","last_undegraded":"2024-09-13T05:13:57.820144+0000","last_fullsized":"2024-09-13T05:13:57.820144+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:04:22.859063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000878607,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":54,"num_read":4887,"num_read_kb":27058,"num_write":681,"num_write_kb":24614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":417,"num_bytes_recovered":11847558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"201'721","reported_seq":4577,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751303+0000","last_change":"2024-09-13T05:13:40.856558+0000","last_active":"2024-09-13T05:13:57.751303+0000","last_peered":"2024-09-13T05:13:57.751303+0000","last_clean":"2024-09-13T05:13:57.751303+0000","last_became_active":"2024-09-13T05:13:40.852807+0000","last_became_peered":"2024-09-13T05:13:40.852807+0000","last_unstale":"2024-09-13T05:13:57.751303+0000","last_undegraded":"2024-09-13T05:13:57.751303+0000","last_fullsized":"2024-09-13T05:13:57.751303+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:00.702995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031554529999999999,"stat_sum":{"num_bytes":0,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":58,"num_read":6742,"num_read_kb":11740,"num_write":569,"num_write_kb":4140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":212,"num_bytes_recovered":37802,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"201'562","reported_seq":9656,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975731+0000","last_change":"2024-09-13T05:13:35.789392+0000","last_active":"2024-09-13T05:13:56.975731+0000","last_peered":"2024-09-13T05:13:56.975731+0000","last_clean":"2024-09-13T05:13:56.975731+0000","last_became_active":"2024-09-13T05:11:24.631079+0000","last_became_peered":"2024-09-13T05:11:24.631079+0000","last_unstale":"2024-09-13T05:13:56.975731+0000","last_undegraded":"2024-09-13T05:13:56.975731+0000","last_fullsized":"2024-09-13T05:13:56.975731+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:29.182802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023449740000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":9259,"num_read_kb":15708,"num_write":427,"num_write_kb":4479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":4743569,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"200'648","reported_seq":13518,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.251065+0000","last_change":"2024-09-13T05:13:35.792438+0000","last_active":"2024-09-13T05:13:58.251065+0000","last_peered":"2024-09-13T05:13:58.251065+0000","last_clean":"2024-09-13T05:13:58.251065+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:13:58.251065+0000","last_undegraded":"2024-09-13T05:13:58.251065+0000","last_fullsized":"2024-09-13T05:13:58.251065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:40.457636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001651455,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":49,"num_read":13660,"num_read_kb":13906,"num_write":593,"num_write_kb":23553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"201'594","reported_seq":8351,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.976850+0000","last_change":"2024-09-13T05:13:35.786854+0000","last_active":"2024-09-13T05:13:56.976850+0000","last_peered":"2024-09-13T05:13:56.976850+0000","last_clean":"2024-09-13T05:13:56.976850+0000","last_became_active":"2024-09-13T05:12:45.651071+0000","last_became_peered":"2024-09-13T05:12:45.651071+0000","last_unstale":"2024-09-13T05:13:56.976850+0000","last_undegraded":"2024-09-13T05:13:56.976850+0000","last_fullsized":"2024-09-13T05:13:56.976850+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:25.056987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001813283,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":48,"num_read":7291,"num_read_kb":29056,"num_write":470,"num_write_kb":7007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":364,"num_bytes_recovered":7851183,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.864933+0000","last_change":"2024-09-13T05:13:14.651362+0000","last_active":"2024-09-13T05:13:57.864933+0000","last_peered":"2024-09-13T05:13:57.864933+0000","last_clean":"2024-09-13T05:13:57.864933+0000","last_became_active":"2024-09-13T05:13:14.650955+0000","last_became_peered":"2024-09-13T05:13:14.650955+0000","last_unstale":"2024-09-13T05:13:57.864933+0000","last_undegraded":"2024-09-13T05:13:57.864933+0000","last_fullsized":"2024-09-13T05:13:57.864933+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:44:17.395077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"201'728","reported_seq":9060,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751212+0000","last_change":"2024-09-13T05:13:41.858754+0000","last_active":"2024-09-13T05:13:57.751212+0000","last_peered":"2024-09-13T05:13:57.751212+0000","last_clean":"2024-09-13T05:13:57.751212+0000","last_became_active":"2024-09-13T05:13:41.854863+0000","last_became_peered":"2024-09-13T05:13:41.854863+0000","last_unstale":"2024-09-13T05:13:57.751212+0000","last_undegraded":"2024-09-13T05:13:57.751212+0000","last_fullsized":"2024-09-13T05:13:57.751212+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:49.909033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013617600000000001,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":49,"num_read":8371,"num_read_kb":18309,"num_write":603,"num_write_kb":8603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":704,"num_bytes_recovered":23835437,"num_keys_recovered":90,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":142,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979608+0000","last_change":"2024-09-13T05:13:14.651407+0000","last_active":"2024-09-13T05:13:56.979608+0000","last_peered":"2024-09-13T05:13:56.979608+0000","last_clean":"2024-09-13T05:13:56.979608+0000","last_became_active":"2024-09-13T05:13:14.651157+0000","last_became_peered":"2024-09-13T05:13:14.651157+0000","last_unstale":"2024-09-13T05:13:56.979608+0000","last_undegraded":"2024-09-13T05:13:56.979608+0000","last_fullsized":"2024-09-13T05:13:56.979608+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:31.908741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"201'599","reported_seq":6019,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820420+0000","last_change":"2024-09-13T05:13:35.801562+0000","last_active":"2024-09-13T05:13:57.820420+0000","last_peered":"2024-09-13T05:13:57.820420+0000","last_clean":"2024-09-13T05:13:57.820420+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:13:57.820420+0000","last_undegraded":"2024-09-13T05:13:57.820420+0000","last_fullsized":"2024-09-13T05:13:57.820420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:37.976147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025976440000000001,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":54,"num_read":5378,"num_read_kb":14806,"num_write":465,"num_write_kb":5134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":251,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.251242+0000","last_change":"2024-09-13T05:13:37.804238+0000","last_active":"2024-09-13T05:13:58.251242+0000","last_peered":"2024-09-13T05:13:58.251242+0000","last_clean":"2024-09-13T05:13:58.251242+0000","last_became_active":"2024-09-13T05:13:37.803889+0000","last_became_peered":"2024-09-13T05:13:37.803889+0000","last_unstale":"2024-09-13T05:13:58.251242+0000","last_undegraded":"2024-09-13T05:13:58.251242+0000","last_fullsized":"2024-09-13T05:13:58.251242+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:54.936748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"198'711","reported_seq":1872,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979508+0000","last_change":"2024-09-13T05:13:35.787000+0000","last_active":"2024-09-13T05:13:56.979508+0000","last_peered":"2024-09-13T05:13:56.979508+0000","last_clean":"2024-09-13T05:13:56.979508+0000","last_became_active":"2024-09-13T05:12:09.627485+0000","last_became_peered":"2024-09-13T05:12:09.627485+0000","last_unstale":"2024-09-13T05:13:56.979508+0000","last_undegraded":"2024-09-13T05:13:56.979508+0000","last_fullsized":"2024-09-13T05:13:56.979508+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:54.694847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001363632,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":1702,"num_read_kb":4638,"num_write":789,"num_write_kb":10312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":352,"num_bytes_recovered":5263836,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":126,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979264+0000","last_change":"2024-09-13T05:13:37.803930+0000","last_active":"2024-09-13T05:13:56.979264+0000","last_peered":"2024-09-13T05:13:56.979264+0000","last_clean":"2024-09-13T05:13:56.979264+0000","last_became_active":"2024-09-13T05:13:37.803639+0000","last_became_peered":"2024-09-13T05:13:37.803639+0000","last_unstale":"2024-09-13T05:13:56.979264+0000","last_undegraded":"2024-09-13T05:13:56.979264+0000","last_fullsized":"2024-09-13T05:13:56.979264+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:50.699304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"198'734","reported_seq":5793,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975799+0000","last_change":"2024-09-13T05:13:35.789140+0000","last_active":"2024-09-13T05:13:56.975799+0000","last_peered":"2024-09-13T05:13:56.975799+0000","last_clean":"2024-09-13T05:13:56.975799+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:13:56.975799+0000","last_undegraded":"2024-09-13T05:13:56.975799+0000","last_fullsized":"2024-09-13T05:13:56.975799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":734,"log_dups_size":0,"ondisk_log_size":734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:40.372741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035228970000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":7406,"num_read_kb":59728,"num_write":628,"num_write_kb":55671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"201'1134","reported_seq":5748,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.976900+0000","last_change":"2024-09-13T05:13:46.667441+0000","last_active":"2024-09-13T05:13:56.976900+0000","last_peered":"2024-09-13T05:13:56.976900+0000","last_clean":"2024-09-13T05:13:56.976900+0000","last_became_active":"2024-09-13T05:13:46.664160+0000","last_became_peered":"2024-09-13T05:13:46.664160+0000","last_unstale":"2024-09-13T05:13:56.976900+0000","last_undegraded":"2024-09-13T05:13:56.976900+0000","last_fullsized":"2024-09-13T05:13:56.976900+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1134,"log_dups_size":0,"ondisk_log_size":1134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:20:03.815805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026890410000000001,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":56,"num_read":4911,"num_read_kb":30667,"num_write":1235,"num_write_kb":50371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":996,"num_bytes_recovered":31453269,"num_keys_recovered":34,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":247,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975430+0000","last_change":"2024-09-13T05:13:31.749856+0000","last_active":"2024-09-13T05:13:56.975430+0000","last_peered":"2024-09-13T05:13:56.975430+0000","last_clean":"2024-09-13T05:13:56.975430+0000","last_became_active":"2024-09-13T05:13:31.749063+0000","last_became_peered":"2024-09-13T05:13:31.749063+0000","last_unstale":"2024-09-13T05:13:56.975430+0000","last_undegraded":"2024-09-13T05:13:56.975430+0000","last_fullsized":"2024-09-13T05:13:56.975430+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:17.847170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"199'797","reported_seq":1779,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979233+0000","last_change":"2024-09-13T05:13:35.786564+0000","last_active":"2024-09-13T05:13:56.979233+0000","last_peered":"2024-09-13T05:13:56.979233+0000","last_clean":"2024-09-13T05:13:56.979233+0000","last_became_active":"2024-09-13T05:12:07.930334+0000","last_became_peered":"2024-09-13T05:12:07.930334+0000","last_unstale":"2024-09-13T05:13:56.979233+0000","last_undegraded":"2024-09-13T05:13:56.979233+0000","last_fullsized":"2024-09-13T05:13:56.979233+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:23:46.175271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096036500000000003,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":55,"num_read":2051,"num_read_kb":3594,"num_write":735,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":1243867,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":219,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.115026+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:13:58.115026+0000","last_peered":"2024-09-13T05:13:58.115026+0000","last_clean":"2024-09-13T05:13:58.115026+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:13:58.115026+0000","last_undegraded":"2024-09-13T05:13:58.115026+0000","last_fullsized":"2024-09-13T05:13:58.115026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"198'1016","reported_seq":5307,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.750988+0000","last_change":"2024-09-13T05:13:46.668732+0000","last_active":"2024-09-13T05:13:57.750988+0000","last_peered":"2024-09-13T05:13:57.750988+0000","last_clean":"2024-09-13T05:13:57.750988+0000","last_became_active":"2024-09-13T05:13:46.663849+0000","last_became_peered":"2024-09-13T05:13:46.663849+0000","last_unstale":"2024-09-13T05:13:57.750988+0000","last_undegraded":"2024-09-13T05:13:57.750988+0000","last_fullsized":"2024-09-13T05:13:57.750988+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1016,"log_dups_size":0,"ondisk_log_size":1016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:36:07.224847+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0078035550000000002,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":6441,"num_read_kb":19916,"num_write":1291,"num_write_kb":12451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":408,"num_bytes_recovered":8416446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.939824+0000","last_change":"2024-09-13T05:12:03.636279+0000","last_active":"2024-09-13T05:13:58.939824+0000","last_peered":"2024-09-13T05:13:58.939824+0000","last_clean":"2024-09-13T05:13:58.939824+0000","last_became_active":"2024-09-13T05:12:03.635929+0000","last_became_peered":"2024-09-13T05:12:03.635929+0000","last_unstale":"2024-09-13T05:13:58.939824+0000","last_undegraded":"2024-09-13T05:13:58.939824+0000","last_fullsized":"2024-09-13T05:13:58.939824+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:58:02.386056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"200'711","reported_seq":3664,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.864873+0000","last_change":"2024-09-13T05:13:35.815133+0000","last_active":"2024-09-13T05:13:57.864873+0000","last_peered":"2024-09-13T05:13:57.864873+0000","last_clean":"2024-09-13T05:13:57.864873+0000","last_became_active":"2024-09-13T05:13:18.651382+0000","last_became_peered":"2024-09-13T05:13:18.651382+0000","last_unstale":"2024-09-13T05:13:57.864873+0000","last_undegraded":"2024-09-13T05:13:57.864873+0000","last_fullsized":"2024-09-13T05:13:57.864873+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:44:13.973468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000842029,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":50,"num_read":5402,"num_read_kb":12408,"num_write":632,"num_write_kb":8370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":367,"num_bytes_recovered":3415864,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":221,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975452+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:13:56.975452+0000","last_peered":"2024-09-13T05:13:56.975452+0000","last_clean":"2024-09-13T05:13:56.975452+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:13:56.975452+0000","last_undegraded":"2024-09-13T05:13:56.975452+0000","last_fullsized":"2024-09-13T05:13:56.975452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":452,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250550+0000","last_change":"2024-09-13T05:13:41.857857+0000","last_active":"2024-09-13T05:13:58.250550+0000","last_peered":"2024-09-13T05:13:58.250550+0000","last_clean":"2024-09-13T05:13:58.250550+0000","last_became_active":"2024-09-13T05:13:41.857228+0000","last_became_peered":"2024-09-13T05:13:41.857228+0000","last_unstale":"2024-09-13T05:13:58.250550+0000","last_undegraded":"2024-09-13T05:13:58.250550+0000","last_fullsized":"2024-09-13T05:13:58.250550+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:29:01.675153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"198'658","reported_seq":17226,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820161+0000","last_change":"2024-09-13T05:13:35.799434+0000","last_active":"2024-09-13T05:13:57.820161+0000","last_peered":"2024-09-13T05:13:57.820161+0000","last_clean":"2024-09-13T05:13:57.820161+0000","last_became_active":"2024-09-13T05:12:12.653214+0000","last_became_peered":"2024-09-13T05:12:12.653214+0000","last_unstale":"2024-09-13T05:13:57.820161+0000","last_undegraded":"2024-09-13T05:13:57.820161+0000","last_fullsized":"2024-09-13T05:13:57.820161+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:11.574280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090748800000000002,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":57,"num_read":16644,"num_read_kb":16716,"num_write":498,"num_write_kb":27916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":2876772,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"201'901","reported_seq":9211,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.976432+0000","last_change":"2024-09-13T05:13:35.786479+0000","last_active":"2024-09-13T05:13:56.976432+0000","last_peered":"2024-09-13T05:13:56.976432+0000","last_clean":"2024-09-13T05:13:56.976432+0000","last_became_active":"2024-09-13T05:12:41.912780+0000","last_became_peered":"2024-09-13T05:12:41.912780+0000","last_unstale":"2024-09-13T05:13:56.976432+0000","last_undegraded":"2024-09-13T05:13:56.976432+0000","last_fullsized":"2024-09-13T05:13:56.976432+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:02:12.915400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018089219999999999,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":11722,"num_read_kb":25826,"num_write":890,"num_write_kb":20361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":5657687,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"201'835","reported_seq":11180,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820239+0000","last_change":"2024-09-13T05:13:35.802137+0000","last_active":"2024-09-13T05:13:57.820239+0000","last_peered":"2024-09-13T05:13:57.820239+0000","last_clean":"2024-09-13T05:13:57.820239+0000","last_became_active":"2024-09-13T05:10:47.939220+0000","last_became_peered":"2024-09-13T05:10:47.939220+0000","last_unstale":"2024-09-13T05:13:57.820239+0000","last_undegraded":"2024-09-13T05:13:57.820239+0000","last_fullsized":"2024-09-13T05:13:57.820239+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:59.693041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032813690000000001,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":52,"num_read":11243,"num_read_kb":19806,"num_write":773,"num_write_kb":9910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":59,"num_bytes_recovered":6203954,"num_keys_recovered":18,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"199'703","reported_seq":8005,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820257+0000","last_change":"2024-09-13T05:13:44.661351+0000","last_active":"2024-09-13T05:13:57.820257+0000","last_peered":"2024-09-13T05:13:57.820257+0000","last_clean":"2024-09-13T05:13:57.820257+0000","last_became_active":"2024-09-13T05:13:44.659181+0000","last_became_peered":"2024-09-13T05:13:44.659181+0000","last_unstale":"2024-09-13T05:13:57.820257+0000","last_undegraded":"2024-09-13T05:13:57.820257+0000","last_fullsized":"2024-09-13T05:13:57.820257+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:29:22.812081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001538939,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":7215,"num_read_kb":12852,"num_write":549,"num_write_kb":8612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":652,"num_bytes_recovered":7231372,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"200'703","reported_seq":2681,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975613+0000","last_change":"2024-09-13T05:13:35.787823+0000","last_active":"2024-09-13T05:13:56.975613+0000","last_peered":"2024-09-13T05:13:56.975613+0000","last_clean":"2024-09-13T05:13:56.975613+0000","last_became_active":"2024-09-13T05:13:31.750969+0000","last_became_peered":"2024-09-13T05:13:31.750969+0000","last_unstale":"2024-09-13T05:13:56.975613+0000","last_undegraded":"2024-09-13T05:13:56.975613+0000","last_fullsized":"2024-09-13T05:13:56.975613+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:18:46.179667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026184060000000002,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":45,"num_read":2965,"num_read_kb":14716,"num_write":786,"num_write_kb":19816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"201'861","reported_seq":4748,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.251070+0000","last_change":"2024-09-13T05:13:35.793375+0000","last_active":"2024-09-13T05:13:58.251070+0000","last_peered":"2024-09-13T05:13:58.251070+0000","last_clean":"2024-09-13T05:13:58.251070+0000","last_became_active":"2024-09-13T05:11:23.616962+0000","last_became_peered":"2024-09-13T05:11:23.616962+0000","last_unstale":"2024-09-13T05:13:58.251070+0000","last_undegraded":"2024-09-13T05:13:58.251070+0000","last_fullsized":"2024-09-13T05:13:58.251070+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:19.035337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024761649999999998,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":5259,"num_read_kb":15611,"num_write":930,"num_write_kb":9177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":12781016,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"201'1180","reported_seq":9596,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250997+0000","last_change":"2024-09-13T05:13:35.793562+0000","last_active":"2024-09-13T05:13:58.250997+0000","last_peered":"2024-09-13T05:13:58.250997+0000","last_clean":"2024-09-13T05:13:58.250997+0000","last_became_active":"2024-09-13T05:12:46.655973+0000","last_became_peered":"2024-09-13T05:12:46.655973+0000","last_unstale":"2024-09-13T05:13:58.250997+0000","last_undegraded":"2024-09-13T05:13:58.250997+0000","last_fullsized":"2024-09-13T05:13:58.250997+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1180,"log_dups_size":0,"ondisk_log_size":1180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:05:32.995650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022750969999999998,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":57,"num_read":10231,"num_read_kb":11540,"num_write":1521,"num_write_kb":6908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":612,"num_bytes_recovered":16479322,"num_keys_recovered":78,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"198'950","reported_seq":7301,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250601+0000","last_change":"2024-09-13T05:13:35.793996+0000","last_active":"2024-09-13T05:13:58.250601+0000","last_peered":"2024-09-13T05:13:58.250601+0000","last_clean":"2024-09-13T05:13:58.250601+0000","last_became_active":"2024-09-13T05:12:45.651313+0000","last_became_peered":"2024-09-13T05:12:45.651313+0000","last_unstale":"2024-09-13T05:13:58.250601+0000","last_undegraded":"2024-09-13T05:13:58.250601+0000","last_fullsized":"2024-09-13T05:13:58.250601+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":950,"log_dups_size":0,"ondisk_log_size":950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:07:00.462818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026155729999999999,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":7680,"num_read_kb":14250,"num_write":1094,"num_write_kb":7822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":7824116,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"201'725","reported_seq":4200,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.864831+0000","last_change":"2024-09-13T05:13:42.869654+0000","last_active":"2024-09-13T05:13:57.864831+0000","last_peered":"2024-09-13T05:13:57.864831+0000","last_clean":"2024-09-13T05:13:57.864831+0000","last_became_active":"2024-09-13T05:13:42.865327+0000","last_became_peered":"2024-09-13T05:13:42.865327+0000","last_unstale":"2024-09-13T05:13:57.864831+0000","last_undegraded":"2024-09-13T05:13:57.864831+0000","last_fullsized":"2024-09-13T05:13:57.864831+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:55.609658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070392800000000004,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":3644,"num_read_kb":16917,"num_write":678,"num_write_kb":24247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":802,"num_bytes_recovered":33560838,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"201'537","reported_seq":9641,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250723+0000","last_change":"2024-09-13T05:13:35.792570+0000","last_active":"2024-09-13T05:13:58.250723+0000","last_peered":"2024-09-13T05:13:58.250723+0000","last_clean":"2024-09-13T05:13:58.250723+0000","last_became_active":"2024-09-13T05:12:42.936456+0000","last_became_peered":"2024-09-13T05:12:42.936456+0000","last_unstale":"2024-09-13T05:13:58.250723+0000","last_undegraded":"2024-09-13T05:13:58.250723+0000","last_fullsized":"2024-09-13T05:13:58.250723+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:23.680853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018319619999999999,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":8115,"num_read_kb":13498,"num_write":403,"num_write_kb":21128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":380,"num_bytes_recovered":20462375,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"199'1090","reported_seq":6462,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.750976+0000","last_change":"2024-09-13T05:13:46.671045+0000","last_active":"2024-09-13T05:13:57.750976+0000","last_peered":"2024-09-13T05:13:57.750976+0000","last_clean":"2024-09-13T05:13:57.750976+0000","last_became_active":"2024-09-13T05:13:46.665575+0000","last_became_peered":"2024-09-13T05:13:46.665575+0000","last_unstale":"2024-09-13T05:13:57.750976+0000","last_undegraded":"2024-09-13T05:13:57.750976+0000","last_fullsized":"2024-09-13T05:13:57.750976+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1090,"log_dups_size":0,"ondisk_log_size":1090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:12:46.891233+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.006060307,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":9137,"num_read_kb":27013,"num_write":1266,"num_write_kb":8578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":633324,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"201'1349","reported_seq":5470,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250971+0000","last_change":"2024-09-13T05:13:35.791602+0000","last_active":"2024-09-13T05:13:58.250971+0000","last_peered":"2024-09-13T05:13:58.250971+0000","last_clean":"2024-09-13T05:13:58.250971+0000","last_became_active":"2024-09-13T05:12:48.638127+0000","last_became_peered":"2024-09-13T05:12:48.638127+0000","last_unstale":"2024-09-13T05:13:58.250971+0000","last_undegraded":"2024-09-13T05:13:58.250971+0000","last_fullsized":"2024-09-13T05:13:58.250971+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1349,"log_dups_size":0,"ondisk_log_size":1349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:33:48.012842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001070477,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":7844,"num_read_kb":55094,"num_write":1803,"num_write_kb":40168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":20884522,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":1622,"num_object_clones":0,"num_object_copies":3244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1622,"num_whiteouts":1618,"num_read":258414,"num_read_kb":631830,"num_write":28490,"num_write_kb":532665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11025,"num_bytes_recovered":280109913,"num_keys_recovered":906,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3756,"internal_metadata":0},"log_size":27075,"ondisk_log_size":27075,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106524,"kb_used_data":3216,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94265316,"statfs":{"total":96636764160,"available":96527683584,"internally_reserved":0,"allocated":3293184,"data_stored":1898733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":105773515},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:13 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.83599999999999997}]},{"osd":1,"last update":"Fri Sep 13 05:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.80700000000000005,"15min":0.81899999999999995},"min":{"1min":0.54300000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.83199999999999996,"15min":0.80500000000000005},"min":{"1min":0.48799999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.61499999999999999}]},{"osd":2,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.84899999999999998,"15min":0.85399999999999998},"min":{"1min":0.67600000000000005,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1519999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.056,"5min":0.90200000000000002,"15min":0.81499999999999995},"min":{"1min":0.94399999999999995,"5min":0.433,"15min":0.433},"max":{"1min":1.262,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.262}]},{"osd":3,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.98199999999999998,"15min":0.90500000000000003},"min":{"1min":0.54000000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2749999999999999,"5min":12.663,"15min":12.663},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.90000000000000002,"15min":0.90400000000000003},"min":{"1min":0.73199999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1799999999999999,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81100000000000005,"15min":0.77900000000000003},"min":{"1min":0.58699999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.365,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.91000000000000003,"15min":0.92500000000000004},"min":{"1min":0.48999999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.216,"5min":2.02,"15min":2.02},"last":0.876}]},{"osd":5,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.95799999999999996,"15min":0.95199999999999996},"min":{"1min":0.63900000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.246,"5min":1.655,"15min":1.655},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.96399999999999997,"15min":0.95099999999999996},"min":{"1min":0.66100000000000003,"5min":0.499,"15min":0.499},"max":{"1min":1.306,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.1919999999999999}]},{"osd":6,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93300000000000005,"15min":0.91900000000000004},"min":{"1min":0.76200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.381,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.042,"15min":1.038},"min":{"1min":0.76900000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3240000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.1100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59992,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311848,"statfs":{"total":96636764160,"available":96575332352,"internally_reserved":0,"allocated":2699264,"data_stored":1308365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58718663},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":1.0609999999999999}]},{"osd":1,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.85399999999999998,"15min":0.873},"min":{"1min":0.51900000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82399999999999995,"15min":0.85499999999999998},"min":{"1min":0.46500000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.3009999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.97999999999999998}]},{"osd":2,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.79500000000000004,"15min":0.77600000000000002},"min":{"1min":0.58299999999999996,"5min":0.312,"15min":0.312},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.93799999999999994,"15min":0.96599999999999997},"min":{"1min":0.42499999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.383,"5min":1.49,"15min":1.49},"last":1.0249999999999999}]},{"osd":3,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90700000000000003,"15min":0.93799999999999994},"min":{"1min":0.65800000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.5489999999999999,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.93000000000000005,"15min":0.93500000000000005},"min":{"1min":0.80400000000000005,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":1.143}]},{"osd":4,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.93899999999999995,"15min":0.95999999999999996},"min":{"1min":0.47399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.456,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.173},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.95299999999999996,"15min":0.98699999999999999},"min":{"1min":0.55500000000000005,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.274,"5min":2.056,"15min":2.056},"last":1.1080000000000001}]},{"osd":5,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.68300000000000005,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.0800000000000001,"15min":1.0980000000000001},"min":{"1min":0.69899999999999995,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.246}]},{"osd":7,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0620000000000001,"15min":1.101},"min":{"1min":0.748,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3120000000000001,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.0740000000000001,"15min":1.0820000000000001},"min":{"1min":0.82099999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.383}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82148,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":79486,"kb_avail":94289692,"statfs":{"total":96636764160,"available":96552644608,"internally_reserved":0,"allocated":2703360,"data_stored":1308384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":81394118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.65900000000000003}]},{"osd":1,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.83599999999999997,"15min":0.872},"min":{"1min":0.53700000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1619999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.75},{"interface":"front","average":{"1min":0.873,"5min":0.86399999999999999,"15min":0.90900000000000003},"min":{"1min":0.61299999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.145,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.86799999999999999}]},{"osd":2,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.81699999999999995,"15min":0.84499999999999997},"min":{"1min":0.40600000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1519999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.90000000000000002,"15min":0.89800000000000002},"min":{"1min":0.59999999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.96899999999999997}]},{"osd":3,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.85499999999999998,"15min":0.91100000000000003},"min":{"1min":0.58299999999999996,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1180000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.93200000000000005,"15min":1.0009999999999999},"min":{"1min":0.64900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.294,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.0980000000000001}]},{"osd":4,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.878,"15min":0.94499999999999995},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1830000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.016,"15min":1.0920000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.333,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.048}]},{"osd":6,"last update":"Fri Sep 13 05:13:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.94099999999999995,"15min":0.95399999999999996},"min":{"1min":0.58199999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4950000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.1879999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.99199999999999999,"15min":1.034},"min":{"1min":0.45600000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.236,"5min":1.528,"15min":1.528},"last":1.1399999999999999}]},{"osd":7,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0620000000000001,"15min":1.1639999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.244,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.101,"15min":1.1559999999999999},"min":{"1min":0.47399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.4590000000000001,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.236}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37856,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94333984,"statfs":{"total":96636764160,"available":96597999616,"internally_reserved":0,"allocated":2703360,"data_stored":1308384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.76500000000000001}]},{"osd":1,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.745,"15min":0.751},"min":{"1min":0.433,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0940000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.85899999999999999,"15min":0.91500000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0009999999999999,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.67900000000000005}]},{"osd":2,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.94499999999999995,"15min":0.98199999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.109,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":1.0269999999999999,"15min":1.079},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1930000000000001,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.79900000000000004}]},{"osd":3,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.91400000000000003,"15min":0.91500000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1639999999999999,"5min":4.0609999999999999,"15min":4.0609999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.88500000000000001,"15min":0.91400000000000003},"min":{"1min":0.64200000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1539999999999999,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.72899999999999998}]},{"osd":5,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.871,"15min":0.88700000000000001},"min":{"1min":0.53100000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.012,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":1.0660000000000001,"15min":1.1499999999999999},"min":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.133,"5min":3.871,"15min":3.871},"last":0.97599999999999998}]},{"osd":6,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.0669999999999999,"15min":1.1339999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.149,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.94299999999999995,"15min":0.95699999999999996},"min":{"1min":0.61399999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.254,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.82799999999999996}]},{"osd":7,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.1000000000000001,"15min":1.153},"min":{"1min":0.61099999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.238,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.081,"15min":1.1000000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.3460000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.89700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64100,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":61438,"kb_avail":94307740,"statfs":{"total":96636764160,"available":96571125760,"internally_reserved":0,"allocated":2699264,"data_stored":1308365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":62912968},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.71599999999999997}]},{"osd":1,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64500000000000002,"15min":0.65800000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.67600000000000005,"15min":0.71599999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.0069999999999999,"5min":1.125,"15min":1.125},"last":0.755}]},{"osd":2,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.72199999999999998,"15min":0.73799999999999999},"min":{"1min":0.39000000000000001,"5min":0.377,"15min":0.377},"max":{"1min":1.2330000000000001,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.78600000000000003,"15min":0.83599999999999997},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.113,"5min":1.573,"15min":1.573},"last":0.78500000000000003}]},{"osd":4,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.85399999999999998,"15min":0.89500000000000002},"min":{"1min":0.55100000000000005,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.88800000000000001,"15min":0.92600000000000005},"min":{"1min":0.49099999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.196,"5min":1.764,"15min":1.764},"last":0.89600000000000002}]},{"osd":5,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.94599999999999995,"15min":1.004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2390000000000001,"5min":2.157,"15min":2.157},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.92700000000000005,"15min":0.98299999999999998},"min":{"1min":0.68400000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.633,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.0940000000000001}]},{"osd":6,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.94099999999999995,"15min":0.97899999999999998},"min":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.375,"5min":1.976,"15min":1.976},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":1.02,"15min":1.089},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4970000000000001,"5min":2.012,"15min":2.012},"last":1.0580000000000001}]},{"osd":7,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.028,"15min":1.077},"min":{"1min":0.57899999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.6679999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.198},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0609999999999999,"15min":1.101},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7170000000000001,"5min":1.875,"15min":1.875},"last":1.157}]}]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65756,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306084,"statfs":{"total":96636764160,"available":96569430016,"internally_reserved":0,"allocated":2699264,"data_stored":1308365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.60399999999999998}]},{"osd":1,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64800000000000002,"15min":0.66800000000000004},"min":{"1min":0.40200000000000002,"5min":0.246,"15min":0.246},"max":{"1min":1.081,"5min":1.554,"15min":1.554},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64200000000000002,"15min":0.65400000000000003},"min":{"1min":0.40100000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0780000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.79400000000000004}]},{"osd":3,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67000000000000004,"15min":0.624},"min":{"1min":0.38300000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.002,"5min":6.6070000000000002,"15min":6.6070000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69499999999999995,"15min":0.66700000000000004},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.014,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.746}]},{"osd":4,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.82299999999999995,"15min":0.78300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.464,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.464},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.90700000000000003,"15min":0.89800000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":1.3380000000000001}]},{"osd":5,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.878,"15min":0.89400000000000002},"min":{"1min":0.48999999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.1099999999999999,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.028},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.89700000000000002,"15min":0.872},"min":{"1min":0.52400000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3500000000000001,"5min":1.51,"15min":1.51},"last":0.93899999999999995}]},{"osd":6,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90300000000000002,"15min":0.879},"min":{"1min":0.54200000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94699999999999995,"15min":0.94799999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3300000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.2270000000000001}]},{"osd":7,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0109999999999999,"15min":1.0289999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3680000000000001,"5min":1.867,"15min":1.867},"last":1.115},{"interface":"front","average":{"1min":1.038,"5min":0.97499999999999998,"15min":0.97599999999999998},"min":{"1min":0.52000000000000002,"5min":0.496,"15min":0.496},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":1.1819999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60000,"kb_used_data":2644,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311840,"statfs":{"total":96636764160,"available":96575324160,"internally_reserved":0,"allocated":2707456,"data_stored":1308403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.66400000000000003,"15min":0.61599999999999999},"min":{"1min":0.39400000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.98899999999999999,"5min":5.952,"15min":5.952},"last":0.623},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66300000000000003,"15min":0.68999999999999995},"min":{"1min":0.45900000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86499999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72699999999999998,"15min":0.76700000000000002},"min":{"1min":0.42099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.127,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71399999999999997,"15min":0.747},"min":{"1min":0.47399999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.026,"5min":1.887,"15min":1.887},"last":0.80300000000000005}]},{"osd":4,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.86899999999999999,"15min":0.91400000000000003},"min":{"1min":0.66400000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0329999999999999,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0740000000000001,"5min":0.92200000000000004,"15min":0.94399999999999995},"min":{"1min":0.78700000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.4750000000000001,"5min":1.724,"15min":1.724},"last":1.0609999999999999}]},{"osd":5,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.89700000000000002,"15min":0.92400000000000004},"min":{"1min":0.69799999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.752},{"interface":"front","average":{"1min":1.0609999999999999,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.76800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.008}]},{"osd":6,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.94999999999999996,"15min":1},"min":{"1min":0.67500000000000004,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.4239999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.109,"5min":1.0029999999999999,"15min":1.0149999999999999},"min":{"1min":0.74399999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.625,"5min":1.873,"15min":1.873},"last":1.109}]},{"osd":7,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.996,"15min":1.018},"min":{"1min":0.80900000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.877},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.046,"15min":1.0409999999999999},"min":{"1min":0.91700000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.401,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.0840000000000001}]}]},{"osd":0,"up_from":124,"seq":532575944729,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47328,"kb_used_data":3216,"kb_used_omap":7,"kb_used_meta":44088,"kb_avail":94324512,"statfs":{"total":96636764160,"available":96588300288,"internally_reserved":0,"allocated":3293184,"data_stored":1898733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7666,"internal_metadata":45146638},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.51800000000000002}]},{"osd":2,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.46400000000000002}]},{"osd":3,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.121}]},{"osd":4,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":3.2330000000000001,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":1.147}]},{"osd":5,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.87}]},{"osd":6,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":1.0580000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3756,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:14:03.063 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-13T05:14:03.064 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-13T05:14:03.368 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T05:14:03.381 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T05:14:03.381 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:14:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:14:03.694 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:14:03.707 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":342,"stamp":"2024-09-13T05:14:02.232662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":1626,"num_object_clones":0,"num_object_copies":3252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1626,"num_whiteouts":1618,"num_read":258530,"num_read_kb":631930,"num_write":28651,"num_write_kb":535083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11035,"num_bytes_recovered":282471423,"num_keys_recovered":906,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27195,"ondisk_log_size":27195,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":523704,"kb_used_data":22264,"kb_used_omap":18,"kb_used_meta":501293,"kb_avail":754451016,"statfs":{"total":773094113280,"available":772557840384,"internally_reserved":0,"allocated":22798336,"data_stored":11647732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18816,"internal_metadata":513324672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.281729"},"pg_stats":[{"pgid":"3.1f","version":"201'697","reported_seq":3851,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751296+0000","last_change":"2024-09-13T05:13:41.861132+0000","last_active":"2024-09-13T05:13:57.751296+0000","last_peered":"2024-09-13T05:13:57.751296+0000","last_clean":"2024-09-13T05:13:57.751296+0000","last_became_active":"2024-09-13T05:13:41.857384+0000","last_became_peered":"2024-09-13T05:13:41.857384+0000","last_unstale":"2024-09-13T05:13:57.751296+0000","last_undegraded":"2024-09-13T05:13:57.751296+0000","last_fullsized":"2024-09-13T05:13:57.751296+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:49.750308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024323220000000002,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":4120,"num_read_kb":8764,"num_write":717,"num_write_kb":5986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":222,"num_bytes_recovered":297202,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"200'638","reported_seq":10844,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820478+0000","last_change":"2024-09-13T05:13:35.800144+0000","last_active":"2024-09-13T05:13:57.820478+0000","last_peered":"2024-09-13T05:13:57.820478+0000","last_clean":"2024-09-13T05:13:57.820478+0000","last_became_active":"2024-09-13T05:13:17.865448+0000","last_became_peered":"2024-09-13T05:13:17.865448+0000","last_unstale":"2024-09-13T05:13:57.820478+0000","last_undegraded":"2024-09-13T05:13:57.820478+0000","last_fullsized":"2024-09-13T05:13:57.820478+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:53.868009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001429893,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":51,"num_read":10597,"num_read_kb":9513,"num_write":519,"num_write_kb":4499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":4028965,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"198'807","reported_seq":4506,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751152+0000","last_change":"2024-09-13T05:13:43.666248+0000","last_active":"2024-09-13T05:13:57.751152+0000","last_peered":"2024-09-13T05:13:57.751152+0000","last_clean":"2024-09-13T05:13:57.751152+0000","last_became_active":"2024-09-13T05:13:43.661570+0000","last_became_peered":"2024-09-13T05:13:43.661570+0000","last_unstale":"2024-09-13T05:13:57.751152+0000","last_undegraded":"2024-09-13T05:13:57.751152+0000","last_fullsized":"2024-09-13T05:13:57.751152+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:36.817036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025226720000000001,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":4533,"num_read_kb":14391,"num_write":805,"num_write_kb":18480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":591,"num_bytes_recovered":7610600,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"201'977","reported_seq":6576,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975516+0000","last_change":"2024-09-13T05:13:35.786861+0000","last_active":"2024-09-13T05:13:56.975516+0000","last_peered":"2024-09-13T05:13:56.975516+0000","last_clean":"2024-09-13T05:13:56.975516+0000","last_became_active":"2024-09-13T05:13:31.750484+0000","last_became_peered":"2024-09-13T05:13:31.750484+0000","last_unstale":"2024-09-13T05:13:56.975516+0000","last_undegraded":"2024-09-13T05:13:56.975516+0000","last_fullsized":"2024-09-13T05:13:56.975516+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":977,"log_dups_size":0,"ondisk_log_size":977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:00:07.341842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020042060000000001,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":42,"num_read":7151,"num_read_kb":23958,"num_write":1100,"num_write_kb":15871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":371,"num_bytes_recovered":9523896,"num_keys_recovered":208,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"201'877","reported_seq":4692,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751289+0000","last_change":"2024-09-13T05:13:45.669557+0000","last_active":"2024-09-13T05:13:57.751289+0000","last_peered":"2024-09-13T05:13:57.751289+0000","last_clean":"2024-09-13T05:13:57.751289+0000","last_became_active":"2024-09-13T05:13:45.664962+0000","last_became_peered":"2024-09-13T05:13:45.664962+0000","last_unstale":"2024-09-13T05:13:57.751289+0000","last_undegraded":"2024-09-13T05:13:57.751289+0000","last_fullsized":"2024-09-13T05:13:57.751289+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:45.796036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019293209999999999,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":57,"num_read":5360,"num_read_kb":16535,"num_write":962,"num_write_kb":43436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":614,"num_bytes_recovered":12868860,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"198'1987","reported_seq":21127,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.976514+0000","last_change":"2024-09-13T05:13:35.787845+0000","last_active":"2024-09-13T05:13:56.976514+0000","last_peered":"2024-09-13T05:13:56.976514+0000","last_clean":"2024-09-13T05:13:56.976514+0000","last_became_active":"2024-09-13T05:12:46.652272+0000","last_became_peered":"2024-09-13T05:12:46.652272+0000","last_unstale":"2024-09-13T05:13:56.976514+0000","last_undegraded":"2024-09-13T05:13:56.976514+0000","last_fullsized":"2024-09-13T05:13:56.976514+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1987,"log_dups_size":0,"ondisk_log_size":1987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:54.915675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028053240000000001,"stat_sum":{"num_bytes":19,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":48,"num_read":27228,"num_read_kb":30157,"num_write":3057,"num_write_kb":13192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":478,"num_bytes_recovered":9711059,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"199'934","reported_seq":12697,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979127+0000","last_change":"2024-09-13T05:13:35.786448+0000","last_active":"2024-09-13T05:13:56.979127+0000","last_peered":"2024-09-13T05:13:56.979127+0000","last_clean":"2024-09-13T05:13:56.979127+0000","last_became_active":"2024-09-13T05:12:09.626312+0000","last_became_peered":"2024-09-13T05:12:09.626312+0000","last_unstale":"2024-09-13T05:13:56.979127+0000","last_undegraded":"2024-09-13T05:13:56.979127+0000","last_fullsized":"2024-09-13T05:13:56.979127+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:47.900796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000937213,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":14225,"num_read_kb":23139,"num_write":1021,"num_write_kb":7466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":3365202,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"201'711","reported_seq":5951,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820144+0000","last_change":"2024-09-13T05:13:45.671796+0000","last_active":"2024-09-13T05:13:57.820144+0000","last_peered":"2024-09-13T05:13:57.820144+0000","last_clean":"2024-09-13T05:13:57.820144+0000","last_became_active":"2024-09-13T05:13:45.668572+0000","last_became_peered":"2024-09-13T05:13:45.668572+0000","last_unstale":"2024-09-13T05:13:57.820144+0000","last_undegraded":"2024-09-13T05:13:57.820144+0000","last_fullsized":"2024-09-13T05:13:57.820144+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:04:22.859063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000878607,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":54,"num_read":4887,"num_read_kb":27058,"num_write":681,"num_write_kb":24614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":417,"num_bytes_recovered":11847558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"201'721","reported_seq":4577,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751303+0000","last_change":"2024-09-13T05:13:40.856558+0000","last_active":"2024-09-13T05:13:57.751303+0000","last_peered":"2024-09-13T05:13:57.751303+0000","last_clean":"2024-09-13T05:13:57.751303+0000","last_became_active":"2024-09-13T05:13:40.852807+0000","last_became_peered":"2024-09-13T05:13:40.852807+0000","last_unstale":"2024-09-13T05:13:57.751303+0000","last_undegraded":"2024-09-13T05:13:57.751303+0000","last_fullsized":"2024-09-13T05:13:57.751303+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:00.702995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031554529999999999,"stat_sum":{"num_bytes":0,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":58,"num_read":6742,"num_read_kb":11740,"num_write":569,"num_write_kb":4140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":212,"num_bytes_recovered":37802,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"201'562","reported_seq":9656,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975731+0000","last_change":"2024-09-13T05:13:35.789392+0000","last_active":"2024-09-13T05:13:56.975731+0000","last_peered":"2024-09-13T05:13:56.975731+0000","last_clean":"2024-09-13T05:13:56.975731+0000","last_became_active":"2024-09-13T05:11:24.631079+0000","last_became_peered":"2024-09-13T05:11:24.631079+0000","last_unstale":"2024-09-13T05:13:56.975731+0000","last_undegraded":"2024-09-13T05:13:56.975731+0000","last_fullsized":"2024-09-13T05:13:56.975731+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:29.182802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023449740000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":9259,"num_read_kb":15708,"num_write":427,"num_write_kb":4479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":4743569,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"200'648","reported_seq":13518,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.251065+0000","last_change":"2024-09-13T05:13:35.792438+0000","last_active":"2024-09-13T05:13:58.251065+0000","last_peered":"2024-09-13T05:13:58.251065+0000","last_clean":"2024-09-13T05:13:58.251065+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:13:58.251065+0000","last_undegraded":"2024-09-13T05:13:58.251065+0000","last_fullsized":"2024-09-13T05:13:58.251065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:40.457636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001651455,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":49,"num_read":13660,"num_read_kb":13906,"num_write":593,"num_write_kb":23553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"201'594","reported_seq":8351,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.976850+0000","last_change":"2024-09-13T05:13:35.786854+0000","last_active":"2024-09-13T05:13:56.976850+0000","last_peered":"2024-09-13T05:13:56.976850+0000","last_clean":"2024-09-13T05:13:56.976850+0000","last_became_active":"2024-09-13T05:12:45.651071+0000","last_became_peered":"2024-09-13T05:12:45.651071+0000","last_unstale":"2024-09-13T05:13:56.976850+0000","last_undegraded":"2024-09-13T05:13:56.976850+0000","last_fullsized":"2024-09-13T05:13:56.976850+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:25.056987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001813283,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":48,"num_read":7291,"num_read_kb":29056,"num_write":470,"num_write_kb":7007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":364,"num_bytes_recovered":7851183,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.864933+0000","last_change":"2024-09-13T05:13:14.651362+0000","last_active":"2024-09-13T05:13:57.864933+0000","last_peered":"2024-09-13T05:13:57.864933+0000","last_clean":"2024-09-13T05:13:57.864933+0000","last_became_active":"2024-09-13T05:13:14.650955+0000","last_became_peered":"2024-09-13T05:13:14.650955+0000","last_unstale":"2024-09-13T05:13:57.864933+0000","last_undegraded":"2024-09-13T05:13:57.864933+0000","last_fullsized":"2024-09-13T05:13:57.864933+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:44:17.395077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"201'728","reported_seq":9060,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751212+0000","last_change":"2024-09-13T05:13:41.858754+0000","last_active":"2024-09-13T05:13:57.751212+0000","last_peered":"2024-09-13T05:13:57.751212+0000","last_clean":"2024-09-13T05:13:57.751212+0000","last_became_active":"2024-09-13T05:13:41.854863+0000","last_became_peered":"2024-09-13T05:13:41.854863+0000","last_unstale":"2024-09-13T05:13:57.751212+0000","last_undegraded":"2024-09-13T05:13:57.751212+0000","last_fullsized":"2024-09-13T05:13:57.751212+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:49.909033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013617600000000001,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":49,"num_read":8371,"num_read_kb":18309,"num_write":603,"num_write_kb":8603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":704,"num_bytes_recovered":23835437,"num_keys_recovered":90,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":142,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979608+0000","last_change":"2024-09-13T05:13:14.651407+0000","last_active":"2024-09-13T05:13:56.979608+0000","last_peered":"2024-09-13T05:13:56.979608+0000","last_clean":"2024-09-13T05:13:56.979608+0000","last_became_active":"2024-09-13T05:13:14.651157+0000","last_became_peered":"2024-09-13T05:13:14.651157+0000","last_unstale":"2024-09-13T05:13:56.979608+0000","last_undegraded":"2024-09-13T05:13:56.979608+0000","last_fullsized":"2024-09-13T05:13:56.979608+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:31.908741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"201'599","reported_seq":6019,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820420+0000","last_change":"2024-09-13T05:13:35.801562+0000","last_active":"2024-09-13T05:13:57.820420+0000","last_peered":"2024-09-13T05:13:57.820420+0000","last_clean":"2024-09-13T05:13:57.820420+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:13:57.820420+0000","last_undegraded":"2024-09-13T05:13:57.820420+0000","last_fullsized":"2024-09-13T05:13:57.820420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:37.976147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025976440000000001,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":54,"num_read":5378,"num_read_kb":14806,"num_write":465,"num_write_kb":5134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":251,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.251242+0000","last_change":"2024-09-13T05:13:37.804238+0000","last_active":"2024-09-13T05:13:58.251242+0000","last_peered":"2024-09-13T05:13:58.251242+0000","last_clean":"2024-09-13T05:13:58.251242+0000","last_became_active":"2024-09-13T05:13:37.803889+0000","last_became_peered":"2024-09-13T05:13:37.803889+0000","last_unstale":"2024-09-13T05:13:58.251242+0000","last_undegraded":"2024-09-13T05:13:58.251242+0000","last_fullsized":"2024-09-13T05:13:58.251242+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:54.936748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"198'711","reported_seq":1872,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979508+0000","last_change":"2024-09-13T05:13:35.787000+0000","last_active":"2024-09-13T05:13:56.979508+0000","last_peered":"2024-09-13T05:13:56.979508+0000","last_clean":"2024-09-13T05:13:56.979508+0000","last_became_active":"2024-09-13T05:12:09.627485+0000","last_became_peered":"2024-09-13T05:12:09.627485+0000","last_unstale":"2024-09-13T05:13:56.979508+0000","last_undegraded":"2024-09-13T05:13:56.979508+0000","last_fullsized":"2024-09-13T05:13:56.979508+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:54.694847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001363632,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":1702,"num_read_kb":4638,"num_write":789,"num_write_kb":10312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":352,"num_bytes_recovered":5263836,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":126,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979264+0000","last_change":"2024-09-13T05:13:37.803930+0000","last_active":"2024-09-13T05:13:56.979264+0000","last_peered":"2024-09-13T05:13:56.979264+0000","last_clean":"2024-09-13T05:13:56.979264+0000","last_became_active":"2024-09-13T05:13:37.803639+0000","last_became_peered":"2024-09-13T05:13:37.803639+0000","last_unstale":"2024-09-13T05:13:56.979264+0000","last_undegraded":"2024-09-13T05:13:56.979264+0000","last_fullsized":"2024-09-13T05:13:56.979264+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:50.699304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"198'734","reported_seq":5793,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975799+0000","last_change":"2024-09-13T05:13:35.789140+0000","last_active":"2024-09-13T05:13:56.975799+0000","last_peered":"2024-09-13T05:13:56.975799+0000","last_clean":"2024-09-13T05:13:56.975799+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:13:56.975799+0000","last_undegraded":"2024-09-13T05:13:56.975799+0000","last_fullsized":"2024-09-13T05:13:56.975799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":734,"log_dups_size":0,"ondisk_log_size":734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:40.372741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035228970000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":7406,"num_read_kb":59728,"num_write":628,"num_write_kb":55671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"201'1134","reported_seq":5748,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.976900+0000","last_change":"2024-09-13T05:13:46.667441+0000","last_active":"2024-09-13T05:13:56.976900+0000","last_peered":"2024-09-13T05:13:56.976900+0000","last_clean":"2024-09-13T05:13:56.976900+0000","last_became_active":"2024-09-13T05:13:46.664160+0000","last_became_peered":"2024-09-13T05:13:46.664160+0000","last_unstale":"2024-09-13T05:13:56.976900+0000","last_undegraded":"2024-09-13T05:13:56.976900+0000","last_fullsized":"2024-09-13T05:13:56.976900+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1134,"log_dups_size":0,"ondisk_log_size":1134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:20:03.815805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026890410000000001,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":56,"num_read":4911,"num_read_kb":30667,"num_write":1235,"num_write_kb":50371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":996,"num_bytes_recovered":31453269,"num_keys_recovered":34,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":247,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975430+0000","last_change":"2024-09-13T05:13:31.749856+0000","last_active":"2024-09-13T05:13:56.975430+0000","last_peered":"2024-09-13T05:13:56.975430+0000","last_clean":"2024-09-13T05:13:56.975430+0000","last_became_active":"2024-09-13T05:13:31.749063+0000","last_became_peered":"2024-09-13T05:13:31.749063+0000","last_unstale":"2024-09-13T05:13:56.975430+0000","last_undegraded":"2024-09-13T05:13:56.975430+0000","last_fullsized":"2024-09-13T05:13:56.975430+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:17.847170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"199'797","reported_seq":1779,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979233+0000","last_change":"2024-09-13T05:13:35.786564+0000","last_active":"2024-09-13T05:13:56.979233+0000","last_peered":"2024-09-13T05:13:56.979233+0000","last_clean":"2024-09-13T05:13:56.979233+0000","last_became_active":"2024-09-13T05:12:07.930334+0000","last_became_peered":"2024-09-13T05:12:07.930334+0000","last_unstale":"2024-09-13T05:13:56.979233+0000","last_undegraded":"2024-09-13T05:13:56.979233+0000","last_fullsized":"2024-09-13T05:13:56.979233+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:23:46.175271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096036500000000003,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":55,"num_read":2051,"num_read_kb":3594,"num_write":735,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":1243867,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":219,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.115026+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:13:58.115026+0000","last_peered":"2024-09-13T05:13:58.115026+0000","last_clean":"2024-09-13T05:13:58.115026+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:13:58.115026+0000","last_undegraded":"2024-09-13T05:13:58.115026+0000","last_fullsized":"2024-09-13T05:13:58.115026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"198'1016","reported_seq":5307,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.750988+0000","last_change":"2024-09-13T05:13:46.668732+0000","last_active":"2024-09-13T05:13:57.750988+0000","last_peered":"2024-09-13T05:13:57.750988+0000","last_clean":"2024-09-13T05:13:57.750988+0000","last_became_active":"2024-09-13T05:13:46.663849+0000","last_became_peered":"2024-09-13T05:13:46.663849+0000","last_unstale":"2024-09-13T05:13:57.750988+0000","last_undegraded":"2024-09-13T05:13:57.750988+0000","last_fullsized":"2024-09-13T05:13:57.750988+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1016,"log_dups_size":0,"ondisk_log_size":1016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:36:07.224847+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0078035550000000002,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":6441,"num_read_kb":19916,"num_write":1291,"num_write_kb":12451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":408,"num_bytes_recovered":8416446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.939824+0000","last_change":"2024-09-13T05:12:03.636279+0000","last_active":"2024-09-13T05:13:58.939824+0000","last_peered":"2024-09-13T05:13:58.939824+0000","last_clean":"2024-09-13T05:13:58.939824+0000","last_became_active":"2024-09-13T05:12:03.635929+0000","last_became_peered":"2024-09-13T05:12:03.635929+0000","last_unstale":"2024-09-13T05:13:58.939824+0000","last_undegraded":"2024-09-13T05:13:58.939824+0000","last_fullsized":"2024-09-13T05:13:58.939824+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:58:02.386056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"200'711","reported_seq":3664,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.864873+0000","last_change":"2024-09-13T05:13:35.815133+0000","last_active":"2024-09-13T05:13:57.864873+0000","last_peered":"2024-09-13T05:13:57.864873+0000","last_clean":"2024-09-13T05:13:57.864873+0000","last_became_active":"2024-09-13T05:13:18.651382+0000","last_became_peered":"2024-09-13T05:13:18.651382+0000","last_unstale":"2024-09-13T05:13:57.864873+0000","last_undegraded":"2024-09-13T05:13:57.864873+0000","last_fullsized":"2024-09-13T05:13:57.864873+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:44:13.973468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000842029,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":50,"num_read":5402,"num_read_kb":12408,"num_write":632,"num_write_kb":8370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":367,"num_bytes_recovered":3415864,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":221,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975452+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:13:56.975452+0000","last_peered":"2024-09-13T05:13:56.975452+0000","last_clean":"2024-09-13T05:13:56.975452+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:13:56.975452+0000","last_undegraded":"2024-09-13T05:13:56.975452+0000","last_fullsized":"2024-09-13T05:13:56.975452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":452,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250550+0000","last_change":"2024-09-13T05:13:41.857857+0000","last_active":"2024-09-13T05:13:58.250550+0000","last_peered":"2024-09-13T05:13:58.250550+0000","last_clean":"2024-09-13T05:13:58.250550+0000","last_became_active":"2024-09-13T05:13:41.857228+0000","last_became_peered":"2024-09-13T05:13:41.857228+0000","last_unstale":"2024-09-13T05:13:58.250550+0000","last_undegraded":"2024-09-13T05:13:58.250550+0000","last_fullsized":"2024-09-13T05:13:58.250550+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:29:01.675153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"198'658","reported_seq":17226,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820161+0000","last_change":"2024-09-13T05:13:35.799434+0000","last_active":"2024-09-13T05:13:57.820161+0000","last_peered":"2024-09-13T05:13:57.820161+0000","last_clean":"2024-09-13T05:13:57.820161+0000","last_became_active":"2024-09-13T05:12:12.653214+0000","last_became_peered":"2024-09-13T05:12:12.653214+0000","last_unstale":"2024-09-13T05:13:57.820161+0000","last_undegraded":"2024-09-13T05:13:57.820161+0000","last_fullsized":"2024-09-13T05:13:57.820161+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:11.574280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090748800000000002,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":57,"num_read":16644,"num_read_kb":16716,"num_write":498,"num_write_kb":27916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":2876772,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"201'901","reported_seq":9211,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.976432+0000","last_change":"2024-09-13T05:13:35.786479+0000","last_active":"2024-09-13T05:13:56.976432+0000","last_peered":"2024-09-13T05:13:56.976432+0000","last_clean":"2024-09-13T05:13:56.976432+0000","last_became_active":"2024-09-13T05:12:41.912780+0000","last_became_peered":"2024-09-13T05:12:41.912780+0000","last_unstale":"2024-09-13T05:13:56.976432+0000","last_undegraded":"2024-09-13T05:13:56.976432+0000","last_fullsized":"2024-09-13T05:13:56.976432+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:02:12.915400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018089219999999999,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":11722,"num_read_kb":25826,"num_write":890,"num_write_kb":20361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":5657687,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"201'835","reported_seq":11180,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820239+0000","last_change":"2024-09-13T05:13:35.802137+0000","last_active":"2024-09-13T05:13:57.820239+0000","last_peered":"2024-09-13T05:13:57.820239+0000","last_clean":"2024-09-13T05:13:57.820239+0000","last_became_active":"2024-09-13T05:10:47.939220+0000","last_became_peered":"2024-09-13T05:10:47.939220+0000","last_unstale":"2024-09-13T05:13:57.820239+0000","last_undegraded":"2024-09-13T05:13:57.820239+0000","last_fullsized":"2024-09-13T05:13:57.820239+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:59.693041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032813690000000001,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":52,"num_read":11243,"num_read_kb":19806,"num_write":773,"num_write_kb":9910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":59,"num_bytes_recovered":6203954,"num_keys_recovered":18,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"199'703","reported_seq":8005,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820257+0000","last_change":"2024-09-13T05:13:44.661351+0000","last_active":"2024-09-13T05:13:57.820257+0000","last_peered":"2024-09-13T05:13:57.820257+0000","last_clean":"2024-09-13T05:13:57.820257+0000","last_became_active":"2024-09-13T05:13:44.659181+0000","last_became_peered":"2024-09-13T05:13:44.659181+0000","last_unstale":"2024-09-13T05:13:57.820257+0000","last_undegraded":"2024-09-13T05:13:57.820257+0000","last_fullsized":"2024-09-13T05:13:57.820257+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:29:22.812081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001538939,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":7215,"num_read_kb":12852,"num_write":549,"num_write_kb":8612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":652,"num_bytes_recovered":7231372,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"200'703","reported_seq":2681,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975613+0000","last_change":"2024-09-13T05:13:35.787823+0000","last_active":"2024-09-13T05:13:56.975613+0000","last_peered":"2024-09-13T05:13:56.975613+0000","last_clean":"2024-09-13T05:13:56.975613+0000","last_became_active":"2024-09-13T05:13:31.750969+0000","last_became_peered":"2024-09-13T05:13:31.750969+0000","last_unstale":"2024-09-13T05:13:56.975613+0000","last_undegraded":"2024-09-13T05:13:56.975613+0000","last_fullsized":"2024-09-13T05:13:56.975613+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:18:46.179667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026184060000000002,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":45,"num_read":2965,"num_read_kb":14716,"num_write":786,"num_write_kb":19816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"201'861","reported_seq":4748,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.251070+0000","last_change":"2024-09-13T05:13:35.793375+0000","last_active":"2024-09-13T05:13:58.251070+0000","last_peered":"2024-09-13T05:13:58.251070+0000","last_clean":"2024-09-13T05:13:58.251070+0000","last_became_active":"2024-09-13T05:11:23.616962+0000","last_became_peered":"2024-09-13T05:11:23.616962+0000","last_unstale":"2024-09-13T05:13:58.251070+0000","last_undegraded":"2024-09-13T05:13:58.251070+0000","last_fullsized":"2024-09-13T05:13:58.251070+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:19.035337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024761649999999998,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":5259,"num_read_kb":15611,"num_write":930,"num_write_kb":9177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":12781016,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"201'1180","reported_seq":9596,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250997+0000","last_change":"2024-09-13T05:13:35.793562+0000","last_active":"2024-09-13T05:13:58.250997+0000","last_peered":"2024-09-13T05:13:58.250997+0000","last_clean":"2024-09-13T05:13:58.250997+0000","last_became_active":"2024-09-13T05:12:46.655973+0000","last_became_peered":"2024-09-13T05:12:46.655973+0000","last_unstale":"2024-09-13T05:13:58.250997+0000","last_undegraded":"2024-09-13T05:13:58.250997+0000","last_fullsized":"2024-09-13T05:13:58.250997+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1180,"log_dups_size":0,"ondisk_log_size":1180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:05:32.995650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022750969999999998,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":57,"num_read":10231,"num_read_kb":11540,"num_write":1521,"num_write_kb":6908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":612,"num_bytes_recovered":16479322,"num_keys_recovered":78,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"198'950","reported_seq":7301,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250601+0000","last_change":"2024-09-13T05:13:35.793996+0000","last_active":"2024-09-13T05:13:58.250601+0000","last_peered":"2024-09-13T05:13:58.250601+0000","last_clean":"2024-09-13T05:13:58.250601+0000","last_became_active":"2024-09-13T05:12:45.651313+0000","last_became_peered":"2024-09-13T05:12:45.651313+0000","last_unstale":"2024-09-13T05:13:58.250601+0000","last_undegraded":"2024-09-13T05:13:58.250601+0000","last_fullsized":"2024-09-13T05:13:58.250601+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":950,"log_dups_size":0,"ondisk_log_size":950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:07:00.462818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026155729999999999,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":7680,"num_read_kb":14250,"num_write":1094,"num_write_kb":7822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":7824116,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"201'725","reported_seq":4200,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.864831+0000","last_change":"2024-09-13T05:13:42.869654+0000","last_active":"2024-09-13T05:13:57.864831+0000","last_peered":"2024-09-13T05:13:57.864831+0000","last_clean":"2024-09-13T05:13:57.864831+0000","last_became_active":"2024-09-13T05:13:42.865327+0000","last_became_peered":"2024-09-13T05:13:42.865327+0000","last_unstale":"2024-09-13T05:13:57.864831+0000","last_undegraded":"2024-09-13T05:13:57.864831+0000","last_fullsized":"2024-09-13T05:13:57.864831+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:55.609658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070392800000000004,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":3644,"num_read_kb":16917,"num_write":678,"num_write_kb":24247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":802,"num_bytes_recovered":33560838,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"201'537","reported_seq":9641,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250723+0000","last_change":"2024-09-13T05:13:35.792570+0000","last_active":"2024-09-13T05:13:58.250723+0000","last_peered":"2024-09-13T05:13:58.250723+0000","last_clean":"2024-09-13T05:13:58.250723+0000","last_became_active":"2024-09-13T05:12:42.936456+0000","last_became_peered":"2024-09-13T05:12:42.936456+0000","last_unstale":"2024-09-13T05:13:58.250723+0000","last_undegraded":"2024-09-13T05:13:58.250723+0000","last_fullsized":"2024-09-13T05:13:58.250723+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:23.680853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018319619999999999,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":8115,"num_read_kb":13498,"num_write":403,"num_write_kb":21128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":380,"num_bytes_recovered":20462375,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"199'1090","reported_seq":6462,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.750976+0000","last_change":"2024-09-13T05:13:46.671045+0000","last_active":"2024-09-13T05:13:57.750976+0000","last_peered":"2024-09-13T05:13:57.750976+0000","last_clean":"2024-09-13T05:13:57.750976+0000","last_became_active":"2024-09-13T05:13:46.665575+0000","last_became_peered":"2024-09-13T05:13:46.665575+0000","last_unstale":"2024-09-13T05:13:57.750976+0000","last_undegraded":"2024-09-13T05:13:57.750976+0000","last_fullsized":"2024-09-13T05:13:57.750976+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1090,"log_dups_size":0,"ondisk_log_size":1090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:12:46.891233+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.006060307,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":9137,"num_read_kb":27013,"num_write":1266,"num_write_kb":8578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":633324,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"201'1349","reported_seq":5470,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250971+0000","last_change":"2024-09-13T05:13:35.791602+0000","last_active":"2024-09-13T05:13:58.250971+0000","last_peered":"2024-09-13T05:13:58.250971+0000","last_clean":"2024-09-13T05:13:58.250971+0000","last_became_active":"2024-09-13T05:12:48.638127+0000","last_became_peered":"2024-09-13T05:12:48.638127+0000","last_unstale":"2024-09-13T05:13:58.250971+0000","last_undegraded":"2024-09-13T05:13:58.250971+0000","last_fullsized":"2024-09-13T05:13:58.250971+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1349,"log_dups_size":0,"ondisk_log_size":1349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:33:48.012842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001070477,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":7844,"num_read_kb":55094,"num_write":1803,"num_write_kb":40168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":20884522,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":1622,"num_object_clones":0,"num_object_copies":3244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1622,"num_whiteouts":1618,"num_read":258414,"num_read_kb":631830,"num_write":28490,"num_write_kb":532665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11025,"num_bytes_recovered":280109913,"num_keys_recovered":906,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3756,"internal_metadata":0},"log_size":27075,"ondisk_log_size":27075,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106524,"kb_used_data":3216,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94265316,"statfs":{"total":96636764160,"available":96527683584,"internally_reserved":0,"allocated":3293184,"data_stored":1898733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":105773515},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:13 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.83599999999999997}]},{"osd":1,"last update":"Fri Sep 13 05:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.80700000000000005,"15min":0.81899999999999995},"min":{"1min":0.54300000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.83199999999999996,"15min":0.80500000000000005},"min":{"1min":0.48799999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.61499999999999999}]},{"osd":2,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.84899999999999998,"15min":0.85399999999999998},"min":{"1min":0.67600000000000005,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1519999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.056,"5min":0.90200000000000002,"15min":0.81499999999999995},"min":{"1min":0.94399999999999995,"5min":0.433,"15min":0.433},"max":{"1min":1.262,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.262}]},{"osd":3,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.98199999999999998,"15min":0.90500000000000003},"min":{"1min":0.54000000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2749999999999999,"5min":12.663,"15min":12.663},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.90000000000000002,"15min":0.90400000000000003},"min":{"1min":0.73199999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1799999999999999,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81100000000000005,"15min":0.77900000000000003},"min":{"1min":0.58699999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.365,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.91000000000000003,"15min":0.92500000000000004},"min":{"1min":0.48999999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.216,"5min":2.02,"15min":2.02},"last":0.876}]},{"osd":5,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.95799999999999996,"15min":0.95199999999999996},"min":{"1min":0.63900000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.246,"5min":1.655,"15min":1.655},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.96399999999999997,"15min":0.95099999999999996},"min":{"1min":0.66100000000000003,"5min":0.499,"15min":0.499},"max":{"1min":1.306,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.1919999999999999}]},{"osd":6,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93300000000000005,"15min":0.91900000000000004},"min":{"1min":0.76200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.381,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.042,"15min":1.038},"min":{"1min":0.76900000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3240000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.1100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59992,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311848,"statfs":{"total":96636764160,"available":96575332352,"internally_reserved":0,"allocated":2699264,"data_stored":1308365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58718663},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":1.0609999999999999}]},{"osd":1,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.85399999999999998,"15min":0.873},"min":{"1min":0.51900000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82399999999999995,"15min":0.85499999999999998},"min":{"1min":0.46500000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.3009999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.97999999999999998}]},{"osd":2,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.79500000000000004,"15min":0.77600000000000002},"min":{"1min":0.58299999999999996,"5min":0.312,"15min":0.312},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.93799999999999994,"15min":0.96599999999999997},"min":{"1min":0.42499999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.383,"5min":1.49,"15min":1.49},"last":1.0249999999999999}]},{"osd":3,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90700000000000003,"15min":0.93799999999999994},"min":{"1min":0.65800000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.5489999999999999,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.93000000000000005,"15min":0.93500000000000005},"min":{"1min":0.80400000000000005,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":1.143}]},{"osd":4,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.93899999999999995,"15min":0.95999999999999996},"min":{"1min":0.47399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.456,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.173},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.95299999999999996,"15min":0.98699999999999999},"min":{"1min":0.55500000000000005,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.274,"5min":2.056,"15min":2.056},"last":1.1080000000000001}]},{"osd":5,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.68300000000000005,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.0800000000000001,"15min":1.0980000000000001},"min":{"1min":0.69899999999999995,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.246}]},{"osd":7,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0620000000000001,"15min":1.101},"min":{"1min":0.748,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3120000000000001,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.0740000000000001,"15min":1.0820000000000001},"min":{"1min":0.82099999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.383}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82148,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":79486,"kb_avail":94289692,"statfs":{"total":96636764160,"available":96552644608,"internally_reserved":0,"allocated":2703360,"data_stored":1308384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":81394118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.65900000000000003}]},{"osd":1,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.83599999999999997,"15min":0.872},"min":{"1min":0.53700000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1619999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.75},{"interface":"front","average":{"1min":0.873,"5min":0.86399999999999999,"15min":0.90900000000000003},"min":{"1min":0.61299999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.145,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.86799999999999999}]},{"osd":2,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.81699999999999995,"15min":0.84499999999999997},"min":{"1min":0.40600000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1519999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.90000000000000002,"15min":0.89800000000000002},"min":{"1min":0.59999999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.96899999999999997}]},{"osd":3,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.85499999999999998,"15min":0.91100000000000003},"min":{"1min":0.58299999999999996,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1180000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.93200000000000005,"15min":1.0009999999999999},"min":{"1min":0.64900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.294,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.0980000000000001}]},{"osd":4,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.878,"15min":0.94499999999999995},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1830000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.016,"15min":1.0920000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.333,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.048}]},{"osd":6,"last update":"Fri Sep 13 05:13:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.94099999999999995,"15min":0.95399999999999996},"min":{"1min":0.58199999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4950000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.1879999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.99199999999999999,"15min":1.034},"min":{"1min":0.45600000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.236,"5min":1.528,"15min":1.528},"last":1.1399999999999999}]},{"osd":7,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0620000000000001,"15min":1.1639999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.244,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.101,"15min":1.1559999999999999},"min":{"1min":0.47399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.4590000000000001,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.236}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37856,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94333984,"statfs":{"total":96636764160,"available":96597999616,"internally_reserved":0,"allocated":2703360,"data_stored":1308384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.76500000000000001}]},{"osd":1,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.745,"15min":0.751},"min":{"1min":0.433,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0940000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.85899999999999999,"15min":0.91500000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0009999999999999,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.67900000000000005}]},{"osd":2,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.94499999999999995,"15min":0.98199999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.109,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":1.0269999999999999,"15min":1.079},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1930000000000001,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.79900000000000004}]},{"osd":3,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.91400000000000003,"15min":0.91500000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1639999999999999,"5min":4.0609999999999999,"15min":4.0609999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.88500000000000001,"15min":0.91400000000000003},"min":{"1min":0.64200000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1539999999999999,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.72899999999999998}]},{"osd":5,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.871,"15min":0.88700000000000001},"min":{"1min":0.53100000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.012,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":1.0660000000000001,"15min":1.1499999999999999},"min":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.133,"5min":3.871,"15min":3.871},"last":0.97599999999999998}]},{"osd":6,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.0669999999999999,"15min":1.1339999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.149,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.94299999999999995,"15min":0.95699999999999996},"min":{"1min":0.61399999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.254,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.82799999999999996}]},{"osd":7,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.1000000000000001,"15min":1.153},"min":{"1min":0.61099999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.238,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.081,"15min":1.1000000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.3460000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.89700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64100,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":61438,"kb_avail":94307740,"statfs":{"total":96636764160,"available":96571125760,"internally_reserved":0,"allocated":2699264,"data_stored":1308365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":62912968},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.71599999999999997}]},{"osd":1,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64500000000000002,"15min":0.65800000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.67600000000000005,"15min":0.71599999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.0069999999999999,"5min":1.125,"15min":1.125},"last":0.755}]},{"osd":2,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.72199999999999998,"15min":0.73799999999999999},"min":{"1min":0.39000000000000001,"5min":0.377,"15min":0.377},"max":{"1min":1.2330000000000001,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.78600000000000003,"15min":0.83599999999999997},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.113,"5min":1.573,"15min":1.573},"last":0.78500000000000003}]},{"osd":4,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.85399999999999998,"15min":0.89500000000000002},"min":{"1min":0.55100000000000005,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.88800000000000001,"15min":0.92600000000000005},"min":{"1min":0.49099999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.196,"5min":1.764,"15min":1.764},"last":0.89600000000000002}]},{"osd":5,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.94599999999999995,"15min":1.004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2390000000000001,"5min":2.157,"15min":2.157},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.92700000000000005,"15min":0.98299999999999998},"min":{"1min":0.68400000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.633,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.0940000000000001}]},{"osd":6,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.94099999999999995,"15min":0.97899999999999998},"min":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.375,"5min":1.976,"15min":1.976},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":1.02,"15min":1.089},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4970000000000001,"5min":2.012,"15min":2.012},"last":1.0580000000000001}]},{"osd":7,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.028,"15min":1.077},"min":{"1min":0.57899999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.6679999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.198},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0609999999999999,"15min":1.101},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7170000000000001,"5min":1.875,"15min":1.875},"last":1.157}]}]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65756,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306084,"statfs":{"total":96636764160,"available":96569430016,"internally_reserved":0,"allocated":2699264,"data_stored":1308365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.60399999999999998}]},{"osd":1,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64800000000000002,"15min":0.66800000000000004},"min":{"1min":0.40200000000000002,"5min":0.246,"15min":0.246},"max":{"1min":1.081,"5min":1.554,"15min":1.554},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64200000000000002,"15min":0.65400000000000003},"min":{"1min":0.40100000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0780000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.79400000000000004}]},{"osd":3,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67000000000000004,"15min":0.624},"min":{"1min":0.38300000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.002,"5min":6.6070000000000002,"15min":6.6070000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69499999999999995,"15min":0.66700000000000004},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.014,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.746}]},{"osd":4,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.82299999999999995,"15min":0.78300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.464,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.464},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.90700000000000003,"15min":0.89800000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":1.3380000000000001}]},{"osd":5,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.878,"15min":0.89400000000000002},"min":{"1min":0.48999999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.1099999999999999,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.028},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.89700000000000002,"15min":0.872},"min":{"1min":0.52400000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3500000000000001,"5min":1.51,"15min":1.51},"last":0.93899999999999995}]},{"osd":6,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90300000000000002,"15min":0.879},"min":{"1min":0.54200000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94699999999999995,"15min":0.94799999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3300000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.2270000000000001}]},{"osd":7,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0109999999999999,"15min":1.0289999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3680000000000001,"5min":1.867,"15min":1.867},"last":1.115},{"interface":"front","average":{"1min":1.038,"5min":0.97499999999999998,"15min":0.97599999999999998},"min":{"1min":0.52000000000000002,"5min":0.496,"15min":0.496},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":1.1819999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60000,"kb_used_data":2644,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311840,"statfs":{"total":96636764160,"available":96575324160,"internally_reserved":0,"allocated":2707456,"data_stored":1308403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.66400000000000003,"15min":0.61599999999999999},"min":{"1min":0.39400000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.98899999999999999,"5min":5.952,"15min":5.952},"last":0.623},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66300000000000003,"15min":0.68999999999999995},"min":{"1min":0.45900000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86499999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72699999999999998,"15min":0.76700000000000002},"min":{"1min":0.42099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.127,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71399999999999997,"15min":0.747},"min":{"1min":0.47399999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.026,"5min":1.887,"15min":1.887},"last":0.80300000000000005}]},{"osd":4,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.86899999999999999,"15min":0.91400000000000003},"min":{"1min":0.66400000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0329999999999999,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0740000000000001,"5min":0.92200000000000004,"15min":0.94399999999999995},"min":{"1min":0.78700000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.4750000000000001,"5min":1.724,"15min":1.724},"last":1.0609999999999999}]},{"osd":5,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.89700000000000002,"15min":0.92400000000000004},"min":{"1min":0.69799999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.752},{"interface":"front","average":{"1min":1.0609999999999999,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.76800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.008}]},{"osd":6,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.94999999999999996,"15min":1},"min":{"1min":0.67500000000000004,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.4239999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.109,"5min":1.0029999999999999,"15min":1.0149999999999999},"min":{"1min":0.74399999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.625,"5min":1.873,"15min":1.873},"last":1.109}]},{"osd":7,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.996,"15min":1.018},"min":{"1min":0.80900000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.877},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.046,"15min":1.0409999999999999},"min":{"1min":0.91700000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.401,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.0840000000000001}]}]},{"osd":0,"up_from":124,"seq":532575944729,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47328,"kb_used_data":3216,"kb_used_omap":7,"kb_used_meta":44088,"kb_avail":94324512,"statfs":{"total":96636764160,"available":96588300288,"internally_reserved":0,"allocated":3293184,"data_stored":1898733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7666,"internal_metadata":45146638},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.51800000000000002}]},{"osd":2,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.46400000000000002}]},{"osd":3,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.121}]},{"osd":4,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":3.2330000000000001,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":1.147}]},{"osd":5,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.87}]},{"osd":6,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":1.0580000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3756,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:14:03.710 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:14:04.002 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:14:04.005 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:14:04.016 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":342,"stamp":"2024-09-13T05:14:02.232662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":1626,"num_object_clones":0,"num_object_copies":3252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1626,"num_whiteouts":1618,"num_read":258530,"num_read_kb":631930,"num_write":28651,"num_write_kb":535083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11035,"num_bytes_recovered":282471423,"num_keys_recovered":906,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27195,"ondisk_log_size":27195,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":523704,"kb_used_data":22264,"kb_used_omap":18,"kb_used_meta":501293,"kb_avail":754451016,"statfs":{"total":773094113280,"available":772557840384,"internally_reserved":0,"allocated":22798336,"data_stored":11647732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18816,"internal_metadata":513324672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.281729"},"pg_stats":[{"pgid":"3.1f","version":"201'697","reported_seq":3851,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751296+0000","last_change":"2024-09-13T05:13:41.861132+0000","last_active":"2024-09-13T05:13:57.751296+0000","last_peered":"2024-09-13T05:13:57.751296+0000","last_clean":"2024-09-13T05:13:57.751296+0000","last_became_active":"2024-09-13T05:13:41.857384+0000","last_became_peered":"2024-09-13T05:13:41.857384+0000","last_unstale":"2024-09-13T05:13:57.751296+0000","last_undegraded":"2024-09-13T05:13:57.751296+0000","last_fullsized":"2024-09-13T05:13:57.751296+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:49.750308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024323220000000002,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":4120,"num_read_kb":8764,"num_write":717,"num_write_kb":5986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":222,"num_bytes_recovered":297202,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"200'638","reported_seq":10844,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820478+0000","last_change":"2024-09-13T05:13:35.800144+0000","last_active":"2024-09-13T05:13:57.820478+0000","last_peered":"2024-09-13T05:13:57.820478+0000","last_clean":"2024-09-13T05:13:57.820478+0000","last_became_active":"2024-09-13T05:13:17.865448+0000","last_became_peered":"2024-09-13T05:13:17.865448+0000","last_unstale":"2024-09-13T05:13:57.820478+0000","last_undegraded":"2024-09-13T05:13:57.820478+0000","last_fullsized":"2024-09-13T05:13:57.820478+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:53.868009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001429893,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":51,"num_read":10597,"num_read_kb":9513,"num_write":519,"num_write_kb":4499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":4028965,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"198'807","reported_seq":4506,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751152+0000","last_change":"2024-09-13T05:13:43.666248+0000","last_active":"2024-09-13T05:13:57.751152+0000","last_peered":"2024-09-13T05:13:57.751152+0000","last_clean":"2024-09-13T05:13:57.751152+0000","last_became_active":"2024-09-13T05:13:43.661570+0000","last_became_peered":"2024-09-13T05:13:43.661570+0000","last_unstale":"2024-09-13T05:13:57.751152+0000","last_undegraded":"2024-09-13T05:13:57.751152+0000","last_fullsized":"2024-09-13T05:13:57.751152+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:36.817036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025226720000000001,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":4533,"num_read_kb":14391,"num_write":805,"num_write_kb":18480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":591,"num_bytes_recovered":7610600,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"201'977","reported_seq":6576,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975516+0000","last_change":"2024-09-13T05:13:35.786861+0000","last_active":"2024-09-13T05:13:56.975516+0000","last_peered":"2024-09-13T05:13:56.975516+0000","last_clean":"2024-09-13T05:13:56.975516+0000","last_became_active":"2024-09-13T05:13:31.750484+0000","last_became_peered":"2024-09-13T05:13:31.750484+0000","last_unstale":"2024-09-13T05:13:56.975516+0000","last_undegraded":"2024-09-13T05:13:56.975516+0000","last_fullsized":"2024-09-13T05:13:56.975516+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":977,"log_dups_size":0,"ondisk_log_size":977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:00:07.341842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020042060000000001,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":42,"num_read":7151,"num_read_kb":23958,"num_write":1100,"num_write_kb":15871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":371,"num_bytes_recovered":9523896,"num_keys_recovered":208,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"201'877","reported_seq":4692,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751289+0000","last_change":"2024-09-13T05:13:45.669557+0000","last_active":"2024-09-13T05:13:57.751289+0000","last_peered":"2024-09-13T05:13:57.751289+0000","last_clean":"2024-09-13T05:13:57.751289+0000","last_became_active":"2024-09-13T05:13:45.664962+0000","last_became_peered":"2024-09-13T05:13:45.664962+0000","last_unstale":"2024-09-13T05:13:57.751289+0000","last_undegraded":"2024-09-13T05:13:57.751289+0000","last_fullsized":"2024-09-13T05:13:57.751289+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:45.796036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019293209999999999,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":57,"num_read":5360,"num_read_kb":16535,"num_write":962,"num_write_kb":43436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":614,"num_bytes_recovered":12868860,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"198'1987","reported_seq":21127,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.976514+0000","last_change":"2024-09-13T05:13:35.787845+0000","last_active":"2024-09-13T05:13:56.976514+0000","last_peered":"2024-09-13T05:13:56.976514+0000","last_clean":"2024-09-13T05:13:56.976514+0000","last_became_active":"2024-09-13T05:12:46.652272+0000","last_became_peered":"2024-09-13T05:12:46.652272+0000","last_unstale":"2024-09-13T05:13:56.976514+0000","last_undegraded":"2024-09-13T05:13:56.976514+0000","last_fullsized":"2024-09-13T05:13:56.976514+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1987,"log_dups_size":0,"ondisk_log_size":1987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:54.915675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028053240000000001,"stat_sum":{"num_bytes":19,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":48,"num_read":27228,"num_read_kb":30157,"num_write":3057,"num_write_kb":13192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":478,"num_bytes_recovered":9711059,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"199'934","reported_seq":12697,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979127+0000","last_change":"2024-09-13T05:13:35.786448+0000","last_active":"2024-09-13T05:13:56.979127+0000","last_peered":"2024-09-13T05:13:56.979127+0000","last_clean":"2024-09-13T05:13:56.979127+0000","last_became_active":"2024-09-13T05:12:09.626312+0000","last_became_peered":"2024-09-13T05:12:09.626312+0000","last_unstale":"2024-09-13T05:13:56.979127+0000","last_undegraded":"2024-09-13T05:13:56.979127+0000","last_fullsized":"2024-09-13T05:13:56.979127+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:47.900796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000937213,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":14225,"num_read_kb":23139,"num_write":1021,"num_write_kb":7466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":3365202,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"201'711","reported_seq":5951,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820144+0000","last_change":"2024-09-13T05:13:45.671796+0000","last_active":"2024-09-13T05:13:57.820144+0000","last_peered":"2024-09-13T05:13:57.820144+0000","last_clean":"2024-09-13T05:13:57.820144+0000","last_became_active":"2024-09-13T05:13:45.668572+0000","last_became_peered":"2024-09-13T05:13:45.668572+0000","last_unstale":"2024-09-13T05:13:57.820144+0000","last_undegraded":"2024-09-13T05:13:57.820144+0000","last_fullsized":"2024-09-13T05:13:57.820144+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:04:22.859063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000878607,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":54,"num_read":4887,"num_read_kb":27058,"num_write":681,"num_write_kb":24614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":417,"num_bytes_recovered":11847558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"201'721","reported_seq":4577,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751303+0000","last_change":"2024-09-13T05:13:40.856558+0000","last_active":"2024-09-13T05:13:57.751303+0000","last_peered":"2024-09-13T05:13:57.751303+0000","last_clean":"2024-09-13T05:13:57.751303+0000","last_became_active":"2024-09-13T05:13:40.852807+0000","last_became_peered":"2024-09-13T05:13:40.852807+0000","last_unstale":"2024-09-13T05:13:57.751303+0000","last_undegraded":"2024-09-13T05:13:57.751303+0000","last_fullsized":"2024-09-13T05:13:57.751303+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:00.702995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031554529999999999,"stat_sum":{"num_bytes":0,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":58,"num_read":6742,"num_read_kb":11740,"num_write":569,"num_write_kb":4140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":212,"num_bytes_recovered":37802,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"201'562","reported_seq":9656,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975731+0000","last_change":"2024-09-13T05:13:35.789392+0000","last_active":"2024-09-13T05:13:56.975731+0000","last_peered":"2024-09-13T05:13:56.975731+0000","last_clean":"2024-09-13T05:13:56.975731+0000","last_became_active":"2024-09-13T05:11:24.631079+0000","last_became_peered":"2024-09-13T05:11:24.631079+0000","last_unstale":"2024-09-13T05:13:56.975731+0000","last_undegraded":"2024-09-13T05:13:56.975731+0000","last_fullsized":"2024-09-13T05:13:56.975731+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:29.182802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023449740000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":9259,"num_read_kb":15708,"num_write":427,"num_write_kb":4479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":4743569,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"200'648","reported_seq":13518,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.251065+0000","last_change":"2024-09-13T05:13:35.792438+0000","last_active":"2024-09-13T05:13:58.251065+0000","last_peered":"2024-09-13T05:13:58.251065+0000","last_clean":"2024-09-13T05:13:58.251065+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:13:58.251065+0000","last_undegraded":"2024-09-13T05:13:58.251065+0000","last_fullsized":"2024-09-13T05:13:58.251065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:40.457636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001651455,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":49,"num_read":13660,"num_read_kb":13906,"num_write":593,"num_write_kb":23553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"201'594","reported_seq":8351,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.976850+0000","last_change":"2024-09-13T05:13:35.786854+0000","last_active":"2024-09-13T05:13:56.976850+0000","last_peered":"2024-09-13T05:13:56.976850+0000","last_clean":"2024-09-13T05:13:56.976850+0000","last_became_active":"2024-09-13T05:12:45.651071+0000","last_became_peered":"2024-09-13T05:12:45.651071+0000","last_unstale":"2024-09-13T05:13:56.976850+0000","last_undegraded":"2024-09-13T05:13:56.976850+0000","last_fullsized":"2024-09-13T05:13:56.976850+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:25.056987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001813283,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":48,"num_read":7291,"num_read_kb":29056,"num_write":470,"num_write_kb":7007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":364,"num_bytes_recovered":7851183,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.864933+0000","last_change":"2024-09-13T05:13:14.651362+0000","last_active":"2024-09-13T05:13:57.864933+0000","last_peered":"2024-09-13T05:13:57.864933+0000","last_clean":"2024-09-13T05:13:57.864933+0000","last_became_active":"2024-09-13T05:13:14.650955+0000","last_became_peered":"2024-09-13T05:13:14.650955+0000","last_unstale":"2024-09-13T05:13:57.864933+0000","last_undegraded":"2024-09-13T05:13:57.864933+0000","last_fullsized":"2024-09-13T05:13:57.864933+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:44:17.395077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"201'728","reported_seq":9060,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751212+0000","last_change":"2024-09-13T05:13:41.858754+0000","last_active":"2024-09-13T05:13:57.751212+0000","last_peered":"2024-09-13T05:13:57.751212+0000","last_clean":"2024-09-13T05:13:57.751212+0000","last_became_active":"2024-09-13T05:13:41.854863+0000","last_became_peered":"2024-09-13T05:13:41.854863+0000","last_unstale":"2024-09-13T05:13:57.751212+0000","last_undegraded":"2024-09-13T05:13:57.751212+0000","last_fullsized":"2024-09-13T05:13:57.751212+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:49.909033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013617600000000001,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":49,"num_read":8371,"num_read_kb":18309,"num_write":603,"num_write_kb":8603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":704,"num_bytes_recovered":23835437,"num_keys_recovered":90,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":142,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979608+0000","last_change":"2024-09-13T05:13:14.651407+0000","last_active":"2024-09-13T05:13:56.979608+0000","last_peered":"2024-09-13T05:13:56.979608+0000","last_clean":"2024-09-13T05:13:56.979608+0000","last_became_active":"2024-09-13T05:13:14.651157+0000","last_became_peered":"2024-09-13T05:13:14.651157+0000","last_unstale":"2024-09-13T05:13:56.979608+0000","last_undegraded":"2024-09-13T05:13:56.979608+0000","last_fullsized":"2024-09-13T05:13:56.979608+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:31.908741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"201'599","reported_seq":6019,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820420+0000","last_change":"2024-09-13T05:13:35.801562+0000","last_active":"2024-09-13T05:13:57.820420+0000","last_peered":"2024-09-13T05:13:57.820420+0000","last_clean":"2024-09-13T05:13:57.820420+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:13:57.820420+0000","last_undegraded":"2024-09-13T05:13:57.820420+0000","last_fullsized":"2024-09-13T05:13:57.820420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:37.976147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025976440000000001,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":54,"num_read":5378,"num_read_kb":14806,"num_write":465,"num_write_kb":5134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":251,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.251242+0000","last_change":"2024-09-13T05:13:37.804238+0000","last_active":"2024-09-13T05:13:58.251242+0000","last_peered":"2024-09-13T05:13:58.251242+0000","last_clean":"2024-09-13T05:13:58.251242+0000","last_became_active":"2024-09-13T05:13:37.803889+0000","last_became_peered":"2024-09-13T05:13:37.803889+0000","last_unstale":"2024-09-13T05:13:58.251242+0000","last_undegraded":"2024-09-13T05:13:58.251242+0000","last_fullsized":"2024-09-13T05:13:58.251242+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:54.936748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"198'711","reported_seq":1872,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979508+0000","last_change":"2024-09-13T05:13:35.787000+0000","last_active":"2024-09-13T05:13:56.979508+0000","last_peered":"2024-09-13T05:13:56.979508+0000","last_clean":"2024-09-13T05:13:56.979508+0000","last_became_active":"2024-09-13T05:12:09.627485+0000","last_became_peered":"2024-09-13T05:12:09.627485+0000","last_unstale":"2024-09-13T05:13:56.979508+0000","last_undegraded":"2024-09-13T05:13:56.979508+0000","last_fullsized":"2024-09-13T05:13:56.979508+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:54.694847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001363632,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":1702,"num_read_kb":4638,"num_write":789,"num_write_kb":10312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":352,"num_bytes_recovered":5263836,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":126,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979264+0000","last_change":"2024-09-13T05:13:37.803930+0000","last_active":"2024-09-13T05:13:56.979264+0000","last_peered":"2024-09-13T05:13:56.979264+0000","last_clean":"2024-09-13T05:13:56.979264+0000","last_became_active":"2024-09-13T05:13:37.803639+0000","last_became_peered":"2024-09-13T05:13:37.803639+0000","last_unstale":"2024-09-13T05:13:56.979264+0000","last_undegraded":"2024-09-13T05:13:56.979264+0000","last_fullsized":"2024-09-13T05:13:56.979264+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:50.699304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"198'734","reported_seq":5793,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975799+0000","last_change":"2024-09-13T05:13:35.789140+0000","last_active":"2024-09-13T05:13:56.975799+0000","last_peered":"2024-09-13T05:13:56.975799+0000","last_clean":"2024-09-13T05:13:56.975799+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:13:56.975799+0000","last_undegraded":"2024-09-13T05:13:56.975799+0000","last_fullsized":"2024-09-13T05:13:56.975799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":734,"log_dups_size":0,"ondisk_log_size":734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:40.372741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035228970000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":7406,"num_read_kb":59728,"num_write":628,"num_write_kb":55671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"201'1134","reported_seq":5748,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.976900+0000","last_change":"2024-09-13T05:13:46.667441+0000","last_active":"2024-09-13T05:13:56.976900+0000","last_peered":"2024-09-13T05:13:56.976900+0000","last_clean":"2024-09-13T05:13:56.976900+0000","last_became_active":"2024-09-13T05:13:46.664160+0000","last_became_peered":"2024-09-13T05:13:46.664160+0000","last_unstale":"2024-09-13T05:13:56.976900+0000","last_undegraded":"2024-09-13T05:13:56.976900+0000","last_fullsized":"2024-09-13T05:13:56.976900+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1134,"log_dups_size":0,"ondisk_log_size":1134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:20:03.815805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026890410000000001,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":56,"num_read":4911,"num_read_kb":30667,"num_write":1235,"num_write_kb":50371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":996,"num_bytes_recovered":31453269,"num_keys_recovered":34,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":247,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975430+0000","last_change":"2024-09-13T05:13:31.749856+0000","last_active":"2024-09-13T05:13:56.975430+0000","last_peered":"2024-09-13T05:13:56.975430+0000","last_clean":"2024-09-13T05:13:56.975430+0000","last_became_active":"2024-09-13T05:13:31.749063+0000","last_became_peered":"2024-09-13T05:13:31.749063+0000","last_unstale":"2024-09-13T05:13:56.975430+0000","last_undegraded":"2024-09-13T05:13:56.975430+0000","last_fullsized":"2024-09-13T05:13:56.975430+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:17.847170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"199'797","reported_seq":1779,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979233+0000","last_change":"2024-09-13T05:13:35.786564+0000","last_active":"2024-09-13T05:13:56.979233+0000","last_peered":"2024-09-13T05:13:56.979233+0000","last_clean":"2024-09-13T05:13:56.979233+0000","last_became_active":"2024-09-13T05:12:07.930334+0000","last_became_peered":"2024-09-13T05:12:07.930334+0000","last_unstale":"2024-09-13T05:13:56.979233+0000","last_undegraded":"2024-09-13T05:13:56.979233+0000","last_fullsized":"2024-09-13T05:13:56.979233+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:23:46.175271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096036500000000003,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":55,"num_read":2051,"num_read_kb":3594,"num_write":735,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":1243867,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":219,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.115026+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:13:58.115026+0000","last_peered":"2024-09-13T05:13:58.115026+0000","last_clean":"2024-09-13T05:13:58.115026+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:13:58.115026+0000","last_undegraded":"2024-09-13T05:13:58.115026+0000","last_fullsized":"2024-09-13T05:13:58.115026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"198'1016","reported_seq":5307,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.750988+0000","last_change":"2024-09-13T05:13:46.668732+0000","last_active":"2024-09-13T05:13:57.750988+0000","last_peered":"2024-09-13T05:13:57.750988+0000","last_clean":"2024-09-13T05:13:57.750988+0000","last_became_active":"2024-09-13T05:13:46.663849+0000","last_became_peered":"2024-09-13T05:13:46.663849+0000","last_unstale":"2024-09-13T05:13:57.750988+0000","last_undegraded":"2024-09-13T05:13:57.750988+0000","last_fullsized":"2024-09-13T05:13:57.750988+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1016,"log_dups_size":0,"ondisk_log_size":1016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:36:07.224847+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0078035550000000002,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":6441,"num_read_kb":19916,"num_write":1291,"num_write_kb":12451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":408,"num_bytes_recovered":8416446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.939824+0000","last_change":"2024-09-13T05:12:03.636279+0000","last_active":"2024-09-13T05:13:58.939824+0000","last_peered":"2024-09-13T05:13:58.939824+0000","last_clean":"2024-09-13T05:13:58.939824+0000","last_became_active":"2024-09-13T05:12:03.635929+0000","last_became_peered":"2024-09-13T05:12:03.635929+0000","last_unstale":"2024-09-13T05:13:58.939824+0000","last_undegraded":"2024-09-13T05:13:58.939824+0000","last_fullsized":"2024-09-13T05:13:58.939824+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:58:02.386056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"200'711","reported_seq":3664,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.864873+0000","last_change":"2024-09-13T05:13:35.815133+0000","last_active":"2024-09-13T05:13:57.864873+0000","last_peered":"2024-09-13T05:13:57.864873+0000","last_clean":"2024-09-13T05:13:57.864873+0000","last_became_active":"2024-09-13T05:13:18.651382+0000","last_became_peered":"2024-09-13T05:13:18.651382+0000","last_unstale":"2024-09-13T05:13:57.864873+0000","last_undegraded":"2024-09-13T05:13:57.864873+0000","last_fullsized":"2024-09-13T05:13:57.864873+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:44:13.973468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000842029,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":50,"num_read":5402,"num_read_kb":12408,"num_write":632,"num_write_kb":8370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":367,"num_bytes_recovered":3415864,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":221,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975452+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:13:56.975452+0000","last_peered":"2024-09-13T05:13:56.975452+0000","last_clean":"2024-09-13T05:13:56.975452+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:13:56.975452+0000","last_undegraded":"2024-09-13T05:13:56.975452+0000","last_fullsized":"2024-09-13T05:13:56.975452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":452,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250550+0000","last_change":"2024-09-13T05:13:41.857857+0000","last_active":"2024-09-13T05:13:58.250550+0000","last_peered":"2024-09-13T05:13:58.250550+0000","last_clean":"2024-09-13T05:13:58.250550+0000","last_became_active":"2024-09-13T05:13:41.857228+0000","last_became_peered":"2024-09-13T05:13:41.857228+0000","last_unstale":"2024-09-13T05:13:58.250550+0000","last_undegraded":"2024-09-13T05:13:58.250550+0000","last_fullsized":"2024-09-13T05:13:58.250550+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:29:01.675153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"198'658","reported_seq":17226,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820161+0000","last_change":"2024-09-13T05:13:35.799434+0000","last_active":"2024-09-13T05:13:57.820161+0000","last_peered":"2024-09-13T05:13:57.820161+0000","last_clean":"2024-09-13T05:13:57.820161+0000","last_became_active":"2024-09-13T05:12:12.653214+0000","last_became_peered":"2024-09-13T05:12:12.653214+0000","last_unstale":"2024-09-13T05:13:57.820161+0000","last_undegraded":"2024-09-13T05:13:57.820161+0000","last_fullsized":"2024-09-13T05:13:57.820161+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:11.574280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090748800000000002,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":57,"num_read":16644,"num_read_kb":16716,"num_write":498,"num_write_kb":27916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":2876772,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"201'901","reported_seq":9211,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.976432+0000","last_change":"2024-09-13T05:13:35.786479+0000","last_active":"2024-09-13T05:13:56.976432+0000","last_peered":"2024-09-13T05:13:56.976432+0000","last_clean":"2024-09-13T05:13:56.976432+0000","last_became_active":"2024-09-13T05:12:41.912780+0000","last_became_peered":"2024-09-13T05:12:41.912780+0000","last_unstale":"2024-09-13T05:13:56.976432+0000","last_undegraded":"2024-09-13T05:13:56.976432+0000","last_fullsized":"2024-09-13T05:13:56.976432+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:02:12.915400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018089219999999999,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":11722,"num_read_kb":25826,"num_write":890,"num_write_kb":20361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":5657687,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"201'835","reported_seq":11180,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820239+0000","last_change":"2024-09-13T05:13:35.802137+0000","last_active":"2024-09-13T05:13:57.820239+0000","last_peered":"2024-09-13T05:13:57.820239+0000","last_clean":"2024-09-13T05:13:57.820239+0000","last_became_active":"2024-09-13T05:10:47.939220+0000","last_became_peered":"2024-09-13T05:10:47.939220+0000","last_unstale":"2024-09-13T05:13:57.820239+0000","last_undegraded":"2024-09-13T05:13:57.820239+0000","last_fullsized":"2024-09-13T05:13:57.820239+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:59.693041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032813690000000001,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":52,"num_read":11243,"num_read_kb":19806,"num_write":773,"num_write_kb":9910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":59,"num_bytes_recovered":6203954,"num_keys_recovered":18,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"199'703","reported_seq":8005,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820257+0000","last_change":"2024-09-13T05:13:44.661351+0000","last_active":"2024-09-13T05:13:57.820257+0000","last_peered":"2024-09-13T05:13:57.820257+0000","last_clean":"2024-09-13T05:13:57.820257+0000","last_became_active":"2024-09-13T05:13:44.659181+0000","last_became_peered":"2024-09-13T05:13:44.659181+0000","last_unstale":"2024-09-13T05:13:57.820257+0000","last_undegraded":"2024-09-13T05:13:57.820257+0000","last_fullsized":"2024-09-13T05:13:57.820257+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:29:22.812081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001538939,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":7215,"num_read_kb":12852,"num_write":549,"num_write_kb":8612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":652,"num_bytes_recovered":7231372,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"200'703","reported_seq":2681,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975613+0000","last_change":"2024-09-13T05:13:35.787823+0000","last_active":"2024-09-13T05:13:56.975613+0000","last_peered":"2024-09-13T05:13:56.975613+0000","last_clean":"2024-09-13T05:13:56.975613+0000","last_became_active":"2024-09-13T05:13:31.750969+0000","last_became_peered":"2024-09-13T05:13:31.750969+0000","last_unstale":"2024-09-13T05:13:56.975613+0000","last_undegraded":"2024-09-13T05:13:56.975613+0000","last_fullsized":"2024-09-13T05:13:56.975613+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:18:46.179667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026184060000000002,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":45,"num_read":2965,"num_read_kb":14716,"num_write":786,"num_write_kb":19816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"201'861","reported_seq":4748,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.251070+0000","last_change":"2024-09-13T05:13:35.793375+0000","last_active":"2024-09-13T05:13:58.251070+0000","last_peered":"2024-09-13T05:13:58.251070+0000","last_clean":"2024-09-13T05:13:58.251070+0000","last_became_active":"2024-09-13T05:11:23.616962+0000","last_became_peered":"2024-09-13T05:11:23.616962+0000","last_unstale":"2024-09-13T05:13:58.251070+0000","last_undegraded":"2024-09-13T05:13:58.251070+0000","last_fullsized":"2024-09-13T05:13:58.251070+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:19.035337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024761649999999998,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":5259,"num_read_kb":15611,"num_write":930,"num_write_kb":9177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":12781016,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"201'1180","reported_seq":9596,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250997+0000","last_change":"2024-09-13T05:13:35.793562+0000","last_active":"2024-09-13T05:13:58.250997+0000","last_peered":"2024-09-13T05:13:58.250997+0000","last_clean":"2024-09-13T05:13:58.250997+0000","last_became_active":"2024-09-13T05:12:46.655973+0000","last_became_peered":"2024-09-13T05:12:46.655973+0000","last_unstale":"2024-09-13T05:13:58.250997+0000","last_undegraded":"2024-09-13T05:13:58.250997+0000","last_fullsized":"2024-09-13T05:13:58.250997+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1180,"log_dups_size":0,"ondisk_log_size":1180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:05:32.995650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022750969999999998,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":57,"num_read":10231,"num_read_kb":11540,"num_write":1521,"num_write_kb":6908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":612,"num_bytes_recovered":16479322,"num_keys_recovered":78,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"198'950","reported_seq":7301,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250601+0000","last_change":"2024-09-13T05:13:35.793996+0000","last_active":"2024-09-13T05:13:58.250601+0000","last_peered":"2024-09-13T05:13:58.250601+0000","last_clean":"2024-09-13T05:13:58.250601+0000","last_became_active":"2024-09-13T05:12:45.651313+0000","last_became_peered":"2024-09-13T05:12:45.651313+0000","last_unstale":"2024-09-13T05:13:58.250601+0000","last_undegraded":"2024-09-13T05:13:58.250601+0000","last_fullsized":"2024-09-13T05:13:58.250601+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":950,"log_dups_size":0,"ondisk_log_size":950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:07:00.462818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026155729999999999,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":7680,"num_read_kb":14250,"num_write":1094,"num_write_kb":7822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":7824116,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"201'725","reported_seq":4200,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.864831+0000","last_change":"2024-09-13T05:13:42.869654+0000","last_active":"2024-09-13T05:13:57.864831+0000","last_peered":"2024-09-13T05:13:57.864831+0000","last_clean":"2024-09-13T05:13:57.864831+0000","last_became_active":"2024-09-13T05:13:42.865327+0000","last_became_peered":"2024-09-13T05:13:42.865327+0000","last_unstale":"2024-09-13T05:13:57.864831+0000","last_undegraded":"2024-09-13T05:13:57.864831+0000","last_fullsized":"2024-09-13T05:13:57.864831+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:55.609658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070392800000000004,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":3644,"num_read_kb":16917,"num_write":678,"num_write_kb":24247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":802,"num_bytes_recovered":33560838,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"201'537","reported_seq":9641,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250723+0000","last_change":"2024-09-13T05:13:35.792570+0000","last_active":"2024-09-13T05:13:58.250723+0000","last_peered":"2024-09-13T05:13:58.250723+0000","last_clean":"2024-09-13T05:13:58.250723+0000","last_became_active":"2024-09-13T05:12:42.936456+0000","last_became_peered":"2024-09-13T05:12:42.936456+0000","last_unstale":"2024-09-13T05:13:58.250723+0000","last_undegraded":"2024-09-13T05:13:58.250723+0000","last_fullsized":"2024-09-13T05:13:58.250723+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:23.680853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018319619999999999,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":8115,"num_read_kb":13498,"num_write":403,"num_write_kb":21128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":380,"num_bytes_recovered":20462375,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"199'1090","reported_seq":6462,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.750976+0000","last_change":"2024-09-13T05:13:46.671045+0000","last_active":"2024-09-13T05:13:57.750976+0000","last_peered":"2024-09-13T05:13:57.750976+0000","last_clean":"2024-09-13T05:13:57.750976+0000","last_became_active":"2024-09-13T05:13:46.665575+0000","last_became_peered":"2024-09-13T05:13:46.665575+0000","last_unstale":"2024-09-13T05:13:57.750976+0000","last_undegraded":"2024-09-13T05:13:57.750976+0000","last_fullsized":"2024-09-13T05:13:57.750976+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1090,"log_dups_size":0,"ondisk_log_size":1090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:12:46.891233+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.006060307,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":9137,"num_read_kb":27013,"num_write":1266,"num_write_kb":8578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":633324,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"201'1349","reported_seq":5470,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250971+0000","last_change":"2024-09-13T05:13:35.791602+0000","last_active":"2024-09-13T05:13:58.250971+0000","last_peered":"2024-09-13T05:13:58.250971+0000","last_clean":"2024-09-13T05:13:58.250971+0000","last_became_active":"2024-09-13T05:12:48.638127+0000","last_became_peered":"2024-09-13T05:12:48.638127+0000","last_unstale":"2024-09-13T05:13:58.250971+0000","last_undegraded":"2024-09-13T05:13:58.250971+0000","last_fullsized":"2024-09-13T05:13:58.250971+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1349,"log_dups_size":0,"ondisk_log_size":1349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:33:48.012842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001070477,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":7844,"num_read_kb":55094,"num_write":1803,"num_write_kb":40168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":20884522,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":1622,"num_object_clones":0,"num_object_copies":3244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1622,"num_whiteouts":1618,"num_read":258414,"num_read_kb":631830,"num_write":28490,"num_write_kb":532665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11025,"num_bytes_recovered":280109913,"num_keys_recovered":906,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3756,"internal_metadata":0},"log_size":27075,"ondisk_log_size":27075,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106524,"kb_used_data":3216,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94265316,"statfs":{"total":96636764160,"available":96527683584,"internally_reserved":0,"allocated":3293184,"data_stored":1898733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":105773515},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:13 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.83599999999999997}]},{"osd":1,"last update":"Fri Sep 13 05:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.80700000000000005,"15min":0.81899999999999995},"min":{"1min":0.54300000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.83199999999999996,"15min":0.80500000000000005},"min":{"1min":0.48799999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.61499999999999999}]},{"osd":2,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.84899999999999998,"15min":0.85399999999999998},"min":{"1min":0.67600000000000005,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1519999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.056,"5min":0.90200000000000002,"15min":0.81499999999999995},"min":{"1min":0.94399999999999995,"5min":0.433,"15min":0.433},"max":{"1min":1.262,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.262}]},{"osd":3,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.98199999999999998,"15min":0.90500000000000003},"min":{"1min":0.54000000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2749999999999999,"5min":12.663,"15min":12.663},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.90000000000000002,"15min":0.90400000000000003},"min":{"1min":0.73199999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1799999999999999,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81100000000000005,"15min":0.77900000000000003},"min":{"1min":0.58699999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.365,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.91000000000000003,"15min":0.92500000000000004},"min":{"1min":0.48999999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.216,"5min":2.02,"15min":2.02},"last":0.876}]},{"osd":5,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.95799999999999996,"15min":0.95199999999999996},"min":{"1min":0.63900000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.246,"5min":1.655,"15min":1.655},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.96399999999999997,"15min":0.95099999999999996},"min":{"1min":0.66100000000000003,"5min":0.499,"15min":0.499},"max":{"1min":1.306,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.1919999999999999}]},{"osd":6,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93300000000000005,"15min":0.91900000000000004},"min":{"1min":0.76200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.381,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.042,"15min":1.038},"min":{"1min":0.76900000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3240000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.1100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59992,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311848,"statfs":{"total":96636764160,"available":96575332352,"internally_reserved":0,"allocated":2699264,"data_stored":1308365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58718663},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":1.0609999999999999}]},{"osd":1,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.85399999999999998,"15min":0.873},"min":{"1min":0.51900000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82399999999999995,"15min":0.85499999999999998},"min":{"1min":0.46500000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.3009999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.97999999999999998}]},{"osd":2,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.79500000000000004,"15min":0.77600000000000002},"min":{"1min":0.58299999999999996,"5min":0.312,"15min":0.312},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.93799999999999994,"15min":0.96599999999999997},"min":{"1min":0.42499999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.383,"5min":1.49,"15min":1.49},"last":1.0249999999999999}]},{"osd":3,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90700000000000003,"15min":0.93799999999999994},"min":{"1min":0.65800000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.5489999999999999,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.93000000000000005,"15min":0.93500000000000005},"min":{"1min":0.80400000000000005,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":1.143}]},{"osd":4,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.93899999999999995,"15min":0.95999999999999996},"min":{"1min":0.47399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.456,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.173},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.95299999999999996,"15min":0.98699999999999999},"min":{"1min":0.55500000000000005,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.274,"5min":2.056,"15min":2.056},"last":1.1080000000000001}]},{"osd":5,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.68300000000000005,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.0800000000000001,"15min":1.0980000000000001},"min":{"1min":0.69899999999999995,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.246}]},{"osd":7,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0620000000000001,"15min":1.101},"min":{"1min":0.748,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3120000000000001,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.0740000000000001,"15min":1.0820000000000001},"min":{"1min":0.82099999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.383}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82148,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":79486,"kb_avail":94289692,"statfs":{"total":96636764160,"available":96552644608,"internally_reserved":0,"allocated":2703360,"data_stored":1308384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":81394118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.65900000000000003}]},{"osd":1,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.83599999999999997,"15min":0.872},"min":{"1min":0.53700000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1619999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.75},{"interface":"front","average":{"1min":0.873,"5min":0.86399999999999999,"15min":0.90900000000000003},"min":{"1min":0.61299999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.145,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.86799999999999999}]},{"osd":2,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.81699999999999995,"15min":0.84499999999999997},"min":{"1min":0.40600000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1519999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.90000000000000002,"15min":0.89800000000000002},"min":{"1min":0.59999999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.96899999999999997}]},{"osd":3,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.85499999999999998,"15min":0.91100000000000003},"min":{"1min":0.58299999999999996,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1180000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.93200000000000005,"15min":1.0009999999999999},"min":{"1min":0.64900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.294,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.0980000000000001}]},{"osd":4,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.878,"15min":0.94499999999999995},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1830000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.016,"15min":1.0920000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.333,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.048}]},{"osd":6,"last update":"Fri Sep 13 05:13:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.94099999999999995,"15min":0.95399999999999996},"min":{"1min":0.58199999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4950000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.1879999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.99199999999999999,"15min":1.034},"min":{"1min":0.45600000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.236,"5min":1.528,"15min":1.528},"last":1.1399999999999999}]},{"osd":7,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0620000000000001,"15min":1.1639999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.244,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.101,"15min":1.1559999999999999},"min":{"1min":0.47399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.4590000000000001,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.236}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37856,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94333984,"statfs":{"total":96636764160,"available":96597999616,"internally_reserved":0,"allocated":2703360,"data_stored":1308384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.76500000000000001}]},{"osd":1,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.745,"15min":0.751},"min":{"1min":0.433,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0940000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.85899999999999999,"15min":0.91500000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0009999999999999,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.67900000000000005}]},{"osd":2,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.94499999999999995,"15min":0.98199999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.109,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":1.0269999999999999,"15min":1.079},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1930000000000001,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.79900000000000004}]},{"osd":3,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.91400000000000003,"15min":0.91500000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1639999999999999,"5min":4.0609999999999999,"15min":4.0609999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.88500000000000001,"15min":0.91400000000000003},"min":{"1min":0.64200000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1539999999999999,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.72899999999999998}]},{"osd":5,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.871,"15min":0.88700000000000001},"min":{"1min":0.53100000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.012,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":1.0660000000000001,"15min":1.1499999999999999},"min":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.133,"5min":3.871,"15min":3.871},"last":0.97599999999999998}]},{"osd":6,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.0669999999999999,"15min":1.1339999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.149,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.94299999999999995,"15min":0.95699999999999996},"min":{"1min":0.61399999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.254,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.82799999999999996}]},{"osd":7,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.1000000000000001,"15min":1.153},"min":{"1min":0.61099999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.238,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.081,"15min":1.1000000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.3460000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.89700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64100,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":61438,"kb_avail":94307740,"statfs":{"total":96636764160,"available":96571125760,"internally_reserved":0,"allocated":2699264,"data_stored":1308365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":62912968},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.71599999999999997}]},{"osd":1,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64500000000000002,"15min":0.65800000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.67600000000000005,"15min":0.71599999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.0069999999999999,"5min":1.125,"15min":1.125},"last":0.755}]},{"osd":2,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.72199999999999998,"15min":0.73799999999999999},"min":{"1min":0.39000000000000001,"5min":0.377,"15min":0.377},"max":{"1min":1.2330000000000001,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.78600000000000003,"15min":0.83599999999999997},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.113,"5min":1.573,"15min":1.573},"last":0.78500000000000003}]},{"osd":4,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.85399999999999998,"15min":0.89500000000000002},"min":{"1min":0.55100000000000005,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.88800000000000001,"15min":0.92600000000000005},"min":{"1min":0.49099999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.196,"5min":1.764,"15min":1.764},"last":0.89600000000000002}]},{"osd":5,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.94599999999999995,"15min":1.004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2390000000000001,"5min":2.157,"15min":2.157},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.92700000000000005,"15min":0.98299999999999998},"min":{"1min":0.68400000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.633,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.0940000000000001}]},{"osd":6,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.94099999999999995,"15min":0.97899999999999998},"min":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.375,"5min":1.976,"15min":1.976},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":1.02,"15min":1.089},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4970000000000001,"5min":2.012,"15min":2.012},"last":1.0580000000000001}]},{"osd":7,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.028,"15min":1.077},"min":{"1min":0.57899999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.6679999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.198},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0609999999999999,"15min":1.101},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7170000000000001,"5min":1.875,"15min":1.875},"last":1.157}]}]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65756,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306084,"statfs":{"total":96636764160,"available":96569430016,"internally_reserved":0,"allocated":2699264,"data_stored":1308365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.60399999999999998}]},{"osd":1,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64800000000000002,"15min":0.66800000000000004},"min":{"1min":0.40200000000000002,"5min":0.246,"15min":0.246},"max":{"1min":1.081,"5min":1.554,"15min":1.554},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64200000000000002,"15min":0.65400000000000003},"min":{"1min":0.40100000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0780000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.79400000000000004}]},{"osd":3,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67000000000000004,"15min":0.624},"min":{"1min":0.38300000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.002,"5min":6.6070000000000002,"15min":6.6070000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69499999999999995,"15min":0.66700000000000004},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.014,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.746}]},{"osd":4,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.82299999999999995,"15min":0.78300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.464,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.464},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.90700000000000003,"15min":0.89800000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":1.3380000000000001}]},{"osd":5,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.878,"15min":0.89400000000000002},"min":{"1min":0.48999999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.1099999999999999,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.028},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.89700000000000002,"15min":0.872},"min":{"1min":0.52400000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3500000000000001,"5min":1.51,"15min":1.51},"last":0.93899999999999995}]},{"osd":6,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90300000000000002,"15min":0.879},"min":{"1min":0.54200000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94699999999999995,"15min":0.94799999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3300000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.2270000000000001}]},{"osd":7,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0109999999999999,"15min":1.0289999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3680000000000001,"5min":1.867,"15min":1.867},"last":1.115},{"interface":"front","average":{"1min":1.038,"5min":0.97499999999999998,"15min":0.97599999999999998},"min":{"1min":0.52000000000000002,"5min":0.496,"15min":0.496},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":1.1819999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60000,"kb_used_data":2644,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311840,"statfs":{"total":96636764160,"available":96575324160,"internally_reserved":0,"allocated":2707456,"data_stored":1308403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.66400000000000003,"15min":0.61599999999999999},"min":{"1min":0.39400000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.98899999999999999,"5min":5.952,"15min":5.952},"last":0.623},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66300000000000003,"15min":0.68999999999999995},"min":{"1min":0.45900000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86499999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72699999999999998,"15min":0.76700000000000002},"min":{"1min":0.42099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.127,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71399999999999997,"15min":0.747},"min":{"1min":0.47399999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.026,"5min":1.887,"15min":1.887},"last":0.80300000000000005}]},{"osd":4,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.86899999999999999,"15min":0.91400000000000003},"min":{"1min":0.66400000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0329999999999999,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0740000000000001,"5min":0.92200000000000004,"15min":0.94399999999999995},"min":{"1min":0.78700000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.4750000000000001,"5min":1.724,"15min":1.724},"last":1.0609999999999999}]},{"osd":5,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.89700000000000002,"15min":0.92400000000000004},"min":{"1min":0.69799999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.752},{"interface":"front","average":{"1min":1.0609999999999999,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.76800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.008}]},{"osd":6,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.94999999999999996,"15min":1},"min":{"1min":0.67500000000000004,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.4239999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.109,"5min":1.0029999999999999,"15min":1.0149999999999999},"min":{"1min":0.74399999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.625,"5min":1.873,"15min":1.873},"last":1.109}]},{"osd":7,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.996,"15min":1.018},"min":{"1min":0.80900000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.877},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.046,"15min":1.0409999999999999},"min":{"1min":0.91700000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.401,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.0840000000000001}]}]},{"osd":0,"up_from":124,"seq":532575944729,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47328,"kb_used_data":3216,"kb_used_omap":7,"kb_used_meta":44088,"kb_avail":94324512,"statfs":{"total":96636764160,"available":96588300288,"internally_reserved":0,"allocated":3293184,"data_stored":1898733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7666,"internal_metadata":45146638},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.51800000000000002}]},{"osd":2,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.46400000000000002}]},{"osd":3,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.121}]},{"osd":4,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":3.2330000000000001,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":1.147}]},{"osd":5,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.87}]},{"osd":6,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":1.0580000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3756,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:14:04.019 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T05:14:04.019 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:14:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:14:04.327 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:14:04.342 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-09-13T05:14:04.233393+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":1626,"num_object_clones":0,"num_object_copies":3252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1626,"num_whiteouts":1618,"num_read":258530,"num_read_kb":631930,"num_write":28651,"num_write_kb":535083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11035,"num_bytes_recovered":282471423,"num_keys_recovered":906,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27195,"ondisk_log_size":27195,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":523704,"kb_used_data":22264,"kb_used_omap":18,"kb_used_meta":501293,"kb_avail":754451016,"statfs":{"total":773094113280,"available":772557840384,"internally_reserved":0,"allocated":22798336,"data_stored":11647732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18816,"internal_metadata":513324672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002578"},"pg_stats":[{"pgid":"3.1f","version":"201'697","reported_seq":3851,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751296+0000","last_change":"2024-09-13T05:13:41.861132+0000","last_active":"2024-09-13T05:13:57.751296+0000","last_peered":"2024-09-13T05:13:57.751296+0000","last_clean":"2024-09-13T05:13:57.751296+0000","last_became_active":"2024-09-13T05:13:41.857384+0000","last_became_peered":"2024-09-13T05:13:41.857384+0000","last_unstale":"2024-09-13T05:13:57.751296+0000","last_undegraded":"2024-09-13T05:13:57.751296+0000","last_fullsized":"2024-09-13T05:13:57.751296+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:49.750308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024323220000000002,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":4120,"num_read_kb":8764,"num_write":717,"num_write_kb":5986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":222,"num_bytes_recovered":297202,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"200'638","reported_seq":10844,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820478+0000","last_change":"2024-09-13T05:13:35.800144+0000","last_active":"2024-09-13T05:13:57.820478+0000","last_peered":"2024-09-13T05:13:57.820478+0000","last_clean":"2024-09-13T05:13:57.820478+0000","last_became_active":"2024-09-13T05:13:17.865448+0000","last_became_peered":"2024-09-13T05:13:17.865448+0000","last_unstale":"2024-09-13T05:13:57.820478+0000","last_undegraded":"2024-09-13T05:13:57.820478+0000","last_fullsized":"2024-09-13T05:13:57.820478+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:53.868009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001429893,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":51,"num_read":10597,"num_read_kb":9513,"num_write":519,"num_write_kb":4499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":4028965,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"198'807","reported_seq":4506,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751152+0000","last_change":"2024-09-13T05:13:43.666248+0000","last_active":"2024-09-13T05:13:57.751152+0000","last_peered":"2024-09-13T05:13:57.751152+0000","last_clean":"2024-09-13T05:13:57.751152+0000","last_became_active":"2024-09-13T05:13:43.661570+0000","last_became_peered":"2024-09-13T05:13:43.661570+0000","last_unstale":"2024-09-13T05:13:57.751152+0000","last_undegraded":"2024-09-13T05:13:57.751152+0000","last_fullsized":"2024-09-13T05:13:57.751152+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:36.817036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025226720000000001,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":4533,"num_read_kb":14391,"num_write":805,"num_write_kb":18480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":591,"num_bytes_recovered":7610600,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"201'977","reported_seq":6576,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975516+0000","last_change":"2024-09-13T05:13:35.786861+0000","last_active":"2024-09-13T05:13:56.975516+0000","last_peered":"2024-09-13T05:13:56.975516+0000","last_clean":"2024-09-13T05:13:56.975516+0000","last_became_active":"2024-09-13T05:13:31.750484+0000","last_became_peered":"2024-09-13T05:13:31.750484+0000","last_unstale":"2024-09-13T05:13:56.975516+0000","last_undegraded":"2024-09-13T05:13:56.975516+0000","last_fullsized":"2024-09-13T05:13:56.975516+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":977,"log_dups_size":0,"ondisk_log_size":977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:00:07.341842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020042060000000001,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":42,"num_read":7151,"num_read_kb":23958,"num_write":1100,"num_write_kb":15871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":371,"num_bytes_recovered":9523896,"num_keys_recovered":208,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"201'877","reported_seq":4692,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751289+0000","last_change":"2024-09-13T05:13:45.669557+0000","last_active":"2024-09-13T05:13:57.751289+0000","last_peered":"2024-09-13T05:13:57.751289+0000","last_clean":"2024-09-13T05:13:57.751289+0000","last_became_active":"2024-09-13T05:13:45.664962+0000","last_became_peered":"2024-09-13T05:13:45.664962+0000","last_unstale":"2024-09-13T05:13:57.751289+0000","last_undegraded":"2024-09-13T05:13:57.751289+0000","last_fullsized":"2024-09-13T05:13:57.751289+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:45.796036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019293209999999999,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":57,"num_read":5360,"num_read_kb":16535,"num_write":962,"num_write_kb":43436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":614,"num_bytes_recovered":12868860,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"198'1987","reported_seq":21127,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.976514+0000","last_change":"2024-09-13T05:13:35.787845+0000","last_active":"2024-09-13T05:13:56.976514+0000","last_peered":"2024-09-13T05:13:56.976514+0000","last_clean":"2024-09-13T05:13:56.976514+0000","last_became_active":"2024-09-13T05:12:46.652272+0000","last_became_peered":"2024-09-13T05:12:46.652272+0000","last_unstale":"2024-09-13T05:13:56.976514+0000","last_undegraded":"2024-09-13T05:13:56.976514+0000","last_fullsized":"2024-09-13T05:13:56.976514+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1987,"log_dups_size":0,"ondisk_log_size":1987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:54.915675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028053240000000001,"stat_sum":{"num_bytes":19,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":48,"num_read":27228,"num_read_kb":30157,"num_write":3057,"num_write_kb":13192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":478,"num_bytes_recovered":9711059,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"199'934","reported_seq":12697,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979127+0000","last_change":"2024-09-13T05:13:35.786448+0000","last_active":"2024-09-13T05:13:56.979127+0000","last_peered":"2024-09-13T05:13:56.979127+0000","last_clean":"2024-09-13T05:13:56.979127+0000","last_became_active":"2024-09-13T05:12:09.626312+0000","last_became_peered":"2024-09-13T05:12:09.626312+0000","last_unstale":"2024-09-13T05:13:56.979127+0000","last_undegraded":"2024-09-13T05:13:56.979127+0000","last_fullsized":"2024-09-13T05:13:56.979127+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:47.900796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000937213,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":14225,"num_read_kb":23139,"num_write":1021,"num_write_kb":7466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":3365202,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"201'711","reported_seq":5951,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820144+0000","last_change":"2024-09-13T05:13:45.671796+0000","last_active":"2024-09-13T05:13:57.820144+0000","last_peered":"2024-09-13T05:13:57.820144+0000","last_clean":"2024-09-13T05:13:57.820144+0000","last_became_active":"2024-09-13T05:13:45.668572+0000","last_became_peered":"2024-09-13T05:13:45.668572+0000","last_unstale":"2024-09-13T05:13:57.820144+0000","last_undegraded":"2024-09-13T05:13:57.820144+0000","last_fullsized":"2024-09-13T05:13:57.820144+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:04:22.859063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000878607,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":54,"num_read":4887,"num_read_kb":27058,"num_write":681,"num_write_kb":24614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":417,"num_bytes_recovered":11847558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"201'721","reported_seq":4577,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751303+0000","last_change":"2024-09-13T05:13:40.856558+0000","last_active":"2024-09-13T05:13:57.751303+0000","last_peered":"2024-09-13T05:13:57.751303+0000","last_clean":"2024-09-13T05:13:57.751303+0000","last_became_active":"2024-09-13T05:13:40.852807+0000","last_became_peered":"2024-09-13T05:13:40.852807+0000","last_unstale":"2024-09-13T05:13:57.751303+0000","last_undegraded":"2024-09-13T05:13:57.751303+0000","last_fullsized":"2024-09-13T05:13:57.751303+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:00.702995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031554529999999999,"stat_sum":{"num_bytes":0,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":58,"num_read":6742,"num_read_kb":11740,"num_write":569,"num_write_kb":4140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":212,"num_bytes_recovered":37802,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"201'562","reported_seq":9656,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975731+0000","last_change":"2024-09-13T05:13:35.789392+0000","last_active":"2024-09-13T05:13:56.975731+0000","last_peered":"2024-09-13T05:13:56.975731+0000","last_clean":"2024-09-13T05:13:56.975731+0000","last_became_active":"2024-09-13T05:11:24.631079+0000","last_became_peered":"2024-09-13T05:11:24.631079+0000","last_unstale":"2024-09-13T05:13:56.975731+0000","last_undegraded":"2024-09-13T05:13:56.975731+0000","last_fullsized":"2024-09-13T05:13:56.975731+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:29.182802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023449740000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":9259,"num_read_kb":15708,"num_write":427,"num_write_kb":4479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":4743569,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"200'648","reported_seq":13518,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.251065+0000","last_change":"2024-09-13T05:13:35.792438+0000","last_active":"2024-09-13T05:13:58.251065+0000","last_peered":"2024-09-13T05:13:58.251065+0000","last_clean":"2024-09-13T05:13:58.251065+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:13:58.251065+0000","last_undegraded":"2024-09-13T05:13:58.251065+0000","last_fullsized":"2024-09-13T05:13:58.251065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:40.457636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001651455,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":49,"num_read":13660,"num_read_kb":13906,"num_write":593,"num_write_kb":23553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"201'594","reported_seq":8351,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.976850+0000","last_change":"2024-09-13T05:13:35.786854+0000","last_active":"2024-09-13T05:13:56.976850+0000","last_peered":"2024-09-13T05:13:56.976850+0000","last_clean":"2024-09-13T05:13:56.976850+0000","last_became_active":"2024-09-13T05:12:45.651071+0000","last_became_peered":"2024-09-13T05:12:45.651071+0000","last_unstale":"2024-09-13T05:13:56.976850+0000","last_undegraded":"2024-09-13T05:13:56.976850+0000","last_fullsized":"2024-09-13T05:13:56.976850+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:25.056987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001813283,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":48,"num_read":7291,"num_read_kb":29056,"num_write":470,"num_write_kb":7007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":364,"num_bytes_recovered":7851183,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.864933+0000","last_change":"2024-09-13T05:13:14.651362+0000","last_active":"2024-09-13T05:13:57.864933+0000","last_peered":"2024-09-13T05:13:57.864933+0000","last_clean":"2024-09-13T05:13:57.864933+0000","last_became_active":"2024-09-13T05:13:14.650955+0000","last_became_peered":"2024-09-13T05:13:14.650955+0000","last_unstale":"2024-09-13T05:13:57.864933+0000","last_undegraded":"2024-09-13T05:13:57.864933+0000","last_fullsized":"2024-09-13T05:13:57.864933+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:44:17.395077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"201'728","reported_seq":9060,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751212+0000","last_change":"2024-09-13T05:13:41.858754+0000","last_active":"2024-09-13T05:13:57.751212+0000","last_peered":"2024-09-13T05:13:57.751212+0000","last_clean":"2024-09-13T05:13:57.751212+0000","last_became_active":"2024-09-13T05:13:41.854863+0000","last_became_peered":"2024-09-13T05:13:41.854863+0000","last_unstale":"2024-09-13T05:13:57.751212+0000","last_undegraded":"2024-09-13T05:13:57.751212+0000","last_fullsized":"2024-09-13T05:13:57.751212+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:49.909033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013617600000000001,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":49,"num_read":8371,"num_read_kb":18309,"num_write":603,"num_write_kb":8603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":704,"num_bytes_recovered":23835437,"num_keys_recovered":90,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":142,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979608+0000","last_change":"2024-09-13T05:13:14.651407+0000","last_active":"2024-09-13T05:13:56.979608+0000","last_peered":"2024-09-13T05:13:56.979608+0000","last_clean":"2024-09-13T05:13:56.979608+0000","last_became_active":"2024-09-13T05:13:14.651157+0000","last_became_peered":"2024-09-13T05:13:14.651157+0000","last_unstale":"2024-09-13T05:13:56.979608+0000","last_undegraded":"2024-09-13T05:13:56.979608+0000","last_fullsized":"2024-09-13T05:13:56.979608+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:31.908741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"201'599","reported_seq":6019,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820420+0000","last_change":"2024-09-13T05:13:35.801562+0000","last_active":"2024-09-13T05:13:57.820420+0000","last_peered":"2024-09-13T05:13:57.820420+0000","last_clean":"2024-09-13T05:13:57.820420+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:13:57.820420+0000","last_undegraded":"2024-09-13T05:13:57.820420+0000","last_fullsized":"2024-09-13T05:13:57.820420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:37.976147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025976440000000001,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":54,"num_read":5378,"num_read_kb":14806,"num_write":465,"num_write_kb":5134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":251,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.251242+0000","last_change":"2024-09-13T05:13:37.804238+0000","last_active":"2024-09-13T05:13:58.251242+0000","last_peered":"2024-09-13T05:13:58.251242+0000","last_clean":"2024-09-13T05:13:58.251242+0000","last_became_active":"2024-09-13T05:13:37.803889+0000","last_became_peered":"2024-09-13T05:13:37.803889+0000","last_unstale":"2024-09-13T05:13:58.251242+0000","last_undegraded":"2024-09-13T05:13:58.251242+0000","last_fullsized":"2024-09-13T05:13:58.251242+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:54.936748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"198'711","reported_seq":1872,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979508+0000","last_change":"2024-09-13T05:13:35.787000+0000","last_active":"2024-09-13T05:13:56.979508+0000","last_peered":"2024-09-13T05:13:56.979508+0000","last_clean":"2024-09-13T05:13:56.979508+0000","last_became_active":"2024-09-13T05:12:09.627485+0000","last_became_peered":"2024-09-13T05:12:09.627485+0000","last_unstale":"2024-09-13T05:13:56.979508+0000","last_undegraded":"2024-09-13T05:13:56.979508+0000","last_fullsized":"2024-09-13T05:13:56.979508+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:54.694847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001363632,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":1702,"num_read_kb":4638,"num_write":789,"num_write_kb":10312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":352,"num_bytes_recovered":5263836,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":126,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979264+0000","last_change":"2024-09-13T05:13:37.803930+0000","last_active":"2024-09-13T05:13:56.979264+0000","last_peered":"2024-09-13T05:13:56.979264+0000","last_clean":"2024-09-13T05:13:56.979264+0000","last_became_active":"2024-09-13T05:13:37.803639+0000","last_became_peered":"2024-09-13T05:13:37.803639+0000","last_unstale":"2024-09-13T05:13:56.979264+0000","last_undegraded":"2024-09-13T05:13:56.979264+0000","last_fullsized":"2024-09-13T05:13:56.979264+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:50.699304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"198'734","reported_seq":5793,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975799+0000","last_change":"2024-09-13T05:13:35.789140+0000","last_active":"2024-09-13T05:13:56.975799+0000","last_peered":"2024-09-13T05:13:56.975799+0000","last_clean":"2024-09-13T05:13:56.975799+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:13:56.975799+0000","last_undegraded":"2024-09-13T05:13:56.975799+0000","last_fullsized":"2024-09-13T05:13:56.975799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":734,"log_dups_size":0,"ondisk_log_size":734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:40.372741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035228970000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":7406,"num_read_kb":59728,"num_write":628,"num_write_kb":55671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"201'1134","reported_seq":5748,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.976900+0000","last_change":"2024-09-13T05:13:46.667441+0000","last_active":"2024-09-13T05:13:56.976900+0000","last_peered":"2024-09-13T05:13:56.976900+0000","last_clean":"2024-09-13T05:13:56.976900+0000","last_became_active":"2024-09-13T05:13:46.664160+0000","last_became_peered":"2024-09-13T05:13:46.664160+0000","last_unstale":"2024-09-13T05:13:56.976900+0000","last_undegraded":"2024-09-13T05:13:56.976900+0000","last_fullsized":"2024-09-13T05:13:56.976900+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1134,"log_dups_size":0,"ondisk_log_size":1134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:20:03.815805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026890410000000001,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":56,"num_read":4911,"num_read_kb":30667,"num_write":1235,"num_write_kb":50371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":996,"num_bytes_recovered":31453269,"num_keys_recovered":34,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":247,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975430+0000","last_change":"2024-09-13T05:13:31.749856+0000","last_active":"2024-09-13T05:13:56.975430+0000","last_peered":"2024-09-13T05:13:56.975430+0000","last_clean":"2024-09-13T05:13:56.975430+0000","last_became_active":"2024-09-13T05:13:31.749063+0000","last_became_peered":"2024-09-13T05:13:31.749063+0000","last_unstale":"2024-09-13T05:13:56.975430+0000","last_undegraded":"2024-09-13T05:13:56.975430+0000","last_fullsized":"2024-09-13T05:13:56.975430+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:17.847170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"199'797","reported_seq":1779,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.979233+0000","last_change":"2024-09-13T05:13:35.786564+0000","last_active":"2024-09-13T05:13:56.979233+0000","last_peered":"2024-09-13T05:13:56.979233+0000","last_clean":"2024-09-13T05:13:56.979233+0000","last_became_active":"2024-09-13T05:12:07.930334+0000","last_became_peered":"2024-09-13T05:12:07.930334+0000","last_unstale":"2024-09-13T05:13:56.979233+0000","last_undegraded":"2024-09-13T05:13:56.979233+0000","last_fullsized":"2024-09-13T05:13:56.979233+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:23:46.175271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096036500000000003,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":55,"num_read":2051,"num_read_kb":3594,"num_write":735,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":1243867,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":219,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.115026+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:13:58.115026+0000","last_peered":"2024-09-13T05:13:58.115026+0000","last_clean":"2024-09-13T05:13:58.115026+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:13:58.115026+0000","last_undegraded":"2024-09-13T05:13:58.115026+0000","last_fullsized":"2024-09-13T05:13:58.115026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"198'1016","reported_seq":5307,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.750988+0000","last_change":"2024-09-13T05:13:46.668732+0000","last_active":"2024-09-13T05:13:57.750988+0000","last_peered":"2024-09-13T05:13:57.750988+0000","last_clean":"2024-09-13T05:13:57.750988+0000","last_became_active":"2024-09-13T05:13:46.663849+0000","last_became_peered":"2024-09-13T05:13:46.663849+0000","last_unstale":"2024-09-13T05:13:57.750988+0000","last_undegraded":"2024-09-13T05:13:57.750988+0000","last_fullsized":"2024-09-13T05:13:57.750988+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1016,"log_dups_size":0,"ondisk_log_size":1016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:36:07.224847+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0078035550000000002,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":6441,"num_read_kb":19916,"num_write":1291,"num_write_kb":12451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":408,"num_bytes_recovered":8416446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.939824+0000","last_change":"2024-09-13T05:12:03.636279+0000","last_active":"2024-09-13T05:13:58.939824+0000","last_peered":"2024-09-13T05:13:58.939824+0000","last_clean":"2024-09-13T05:13:58.939824+0000","last_became_active":"2024-09-13T05:12:03.635929+0000","last_became_peered":"2024-09-13T05:12:03.635929+0000","last_unstale":"2024-09-13T05:13:58.939824+0000","last_undegraded":"2024-09-13T05:13:58.939824+0000","last_fullsized":"2024-09-13T05:13:58.939824+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:58:02.386056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"200'711","reported_seq":3664,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.864873+0000","last_change":"2024-09-13T05:13:35.815133+0000","last_active":"2024-09-13T05:13:57.864873+0000","last_peered":"2024-09-13T05:13:57.864873+0000","last_clean":"2024-09-13T05:13:57.864873+0000","last_became_active":"2024-09-13T05:13:18.651382+0000","last_became_peered":"2024-09-13T05:13:18.651382+0000","last_unstale":"2024-09-13T05:13:57.864873+0000","last_undegraded":"2024-09-13T05:13:57.864873+0000","last_fullsized":"2024-09-13T05:13:57.864873+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:44:13.973468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000842029,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":50,"num_read":5402,"num_read_kb":12408,"num_write":632,"num_write_kb":8370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":367,"num_bytes_recovered":3415864,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":221,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975452+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:13:56.975452+0000","last_peered":"2024-09-13T05:13:56.975452+0000","last_clean":"2024-09-13T05:13:56.975452+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:13:56.975452+0000","last_undegraded":"2024-09-13T05:13:56.975452+0000","last_fullsized":"2024-09-13T05:13:56.975452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":452,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250550+0000","last_change":"2024-09-13T05:13:41.857857+0000","last_active":"2024-09-13T05:13:58.250550+0000","last_peered":"2024-09-13T05:13:58.250550+0000","last_clean":"2024-09-13T05:13:58.250550+0000","last_became_active":"2024-09-13T05:13:41.857228+0000","last_became_peered":"2024-09-13T05:13:41.857228+0000","last_unstale":"2024-09-13T05:13:58.250550+0000","last_undegraded":"2024-09-13T05:13:58.250550+0000","last_fullsized":"2024-09-13T05:13:58.250550+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:29:01.675153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"198'658","reported_seq":17226,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820161+0000","last_change":"2024-09-13T05:13:35.799434+0000","last_active":"2024-09-13T05:13:57.820161+0000","last_peered":"2024-09-13T05:13:57.820161+0000","last_clean":"2024-09-13T05:13:57.820161+0000","last_became_active":"2024-09-13T05:12:12.653214+0000","last_became_peered":"2024-09-13T05:12:12.653214+0000","last_unstale":"2024-09-13T05:13:57.820161+0000","last_undegraded":"2024-09-13T05:13:57.820161+0000","last_fullsized":"2024-09-13T05:13:57.820161+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:11.574280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090748800000000002,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":57,"num_read":16644,"num_read_kb":16716,"num_write":498,"num_write_kb":27916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":2876772,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"201'901","reported_seq":9211,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.976432+0000","last_change":"2024-09-13T05:13:35.786479+0000","last_active":"2024-09-13T05:13:56.976432+0000","last_peered":"2024-09-13T05:13:56.976432+0000","last_clean":"2024-09-13T05:13:56.976432+0000","last_became_active":"2024-09-13T05:12:41.912780+0000","last_became_peered":"2024-09-13T05:12:41.912780+0000","last_unstale":"2024-09-13T05:13:56.976432+0000","last_undegraded":"2024-09-13T05:13:56.976432+0000","last_fullsized":"2024-09-13T05:13:56.976432+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:02:12.915400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018089219999999999,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":11722,"num_read_kb":25826,"num_write":890,"num_write_kb":20361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":5657687,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"201'835","reported_seq":11180,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820239+0000","last_change":"2024-09-13T05:13:35.802137+0000","last_active":"2024-09-13T05:13:57.820239+0000","last_peered":"2024-09-13T05:13:57.820239+0000","last_clean":"2024-09-13T05:13:57.820239+0000","last_became_active":"2024-09-13T05:10:47.939220+0000","last_became_peered":"2024-09-13T05:10:47.939220+0000","last_unstale":"2024-09-13T05:13:57.820239+0000","last_undegraded":"2024-09-13T05:13:57.820239+0000","last_fullsized":"2024-09-13T05:13:57.820239+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:59.693041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032813690000000001,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":52,"num_read":11243,"num_read_kb":19806,"num_write":773,"num_write_kb":9910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":59,"num_bytes_recovered":6203954,"num_keys_recovered":18,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"199'703","reported_seq":8005,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820257+0000","last_change":"2024-09-13T05:13:44.661351+0000","last_active":"2024-09-13T05:13:57.820257+0000","last_peered":"2024-09-13T05:13:57.820257+0000","last_clean":"2024-09-13T05:13:57.820257+0000","last_became_active":"2024-09-13T05:13:44.659181+0000","last_became_peered":"2024-09-13T05:13:44.659181+0000","last_unstale":"2024-09-13T05:13:57.820257+0000","last_undegraded":"2024-09-13T05:13:57.820257+0000","last_fullsized":"2024-09-13T05:13:57.820257+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:29:22.812081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001538939,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":7215,"num_read_kb":12852,"num_write":549,"num_write_kb":8612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":652,"num_bytes_recovered":7231372,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"200'703","reported_seq":2681,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975613+0000","last_change":"2024-09-13T05:13:35.787823+0000","last_active":"2024-09-13T05:13:56.975613+0000","last_peered":"2024-09-13T05:13:56.975613+0000","last_clean":"2024-09-13T05:13:56.975613+0000","last_became_active":"2024-09-13T05:13:31.750969+0000","last_became_peered":"2024-09-13T05:13:31.750969+0000","last_unstale":"2024-09-13T05:13:56.975613+0000","last_undegraded":"2024-09-13T05:13:56.975613+0000","last_fullsized":"2024-09-13T05:13:56.975613+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:18:46.179667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026184060000000002,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":45,"num_read":2965,"num_read_kb":14716,"num_write":786,"num_write_kb":19816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"201'861","reported_seq":4748,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.251070+0000","last_change":"2024-09-13T05:13:35.793375+0000","last_active":"2024-09-13T05:13:58.251070+0000","last_peered":"2024-09-13T05:13:58.251070+0000","last_clean":"2024-09-13T05:13:58.251070+0000","last_became_active":"2024-09-13T05:11:23.616962+0000","last_became_peered":"2024-09-13T05:11:23.616962+0000","last_unstale":"2024-09-13T05:13:58.251070+0000","last_undegraded":"2024-09-13T05:13:58.251070+0000","last_fullsized":"2024-09-13T05:13:58.251070+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:19.035337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024761649999999998,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":5259,"num_read_kb":15611,"num_write":930,"num_write_kb":9177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":12781016,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"201'1180","reported_seq":9596,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250997+0000","last_change":"2024-09-13T05:13:35.793562+0000","last_active":"2024-09-13T05:13:58.250997+0000","last_peered":"2024-09-13T05:13:58.250997+0000","last_clean":"2024-09-13T05:13:58.250997+0000","last_became_active":"2024-09-13T05:12:46.655973+0000","last_became_peered":"2024-09-13T05:12:46.655973+0000","last_unstale":"2024-09-13T05:13:58.250997+0000","last_undegraded":"2024-09-13T05:13:58.250997+0000","last_fullsized":"2024-09-13T05:13:58.250997+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1180,"log_dups_size":0,"ondisk_log_size":1180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:05:32.995650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022750969999999998,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":57,"num_read":10231,"num_read_kb":11540,"num_write":1521,"num_write_kb":6908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":612,"num_bytes_recovered":16479322,"num_keys_recovered":78,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"198'950","reported_seq":7301,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250601+0000","last_change":"2024-09-13T05:13:35.793996+0000","last_active":"2024-09-13T05:13:58.250601+0000","last_peered":"2024-09-13T05:13:58.250601+0000","last_clean":"2024-09-13T05:13:58.250601+0000","last_became_active":"2024-09-13T05:12:45.651313+0000","last_became_peered":"2024-09-13T05:12:45.651313+0000","last_unstale":"2024-09-13T05:13:58.250601+0000","last_undegraded":"2024-09-13T05:13:58.250601+0000","last_fullsized":"2024-09-13T05:13:58.250601+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":950,"log_dups_size":0,"ondisk_log_size":950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:07:00.462818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026155729999999999,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":7680,"num_read_kb":14250,"num_write":1094,"num_write_kb":7822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":7824116,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"201'725","reported_seq":4200,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.864831+0000","last_change":"2024-09-13T05:13:42.869654+0000","last_active":"2024-09-13T05:13:57.864831+0000","last_peered":"2024-09-13T05:13:57.864831+0000","last_clean":"2024-09-13T05:13:57.864831+0000","last_became_active":"2024-09-13T05:13:42.865327+0000","last_became_peered":"2024-09-13T05:13:42.865327+0000","last_unstale":"2024-09-13T05:13:57.864831+0000","last_undegraded":"2024-09-13T05:13:57.864831+0000","last_fullsized":"2024-09-13T05:13:57.864831+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:55.609658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070392800000000004,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":3644,"num_read_kb":16917,"num_write":678,"num_write_kb":24247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":802,"num_bytes_recovered":33560838,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"201'537","reported_seq":9641,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250723+0000","last_change":"2024-09-13T05:13:35.792570+0000","last_active":"2024-09-13T05:13:58.250723+0000","last_peered":"2024-09-13T05:13:58.250723+0000","last_clean":"2024-09-13T05:13:58.250723+0000","last_became_active":"2024-09-13T05:12:42.936456+0000","last_became_peered":"2024-09-13T05:12:42.936456+0000","last_unstale":"2024-09-13T05:13:58.250723+0000","last_undegraded":"2024-09-13T05:13:58.250723+0000","last_fullsized":"2024-09-13T05:13:58.250723+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:23.680853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018319619999999999,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":8115,"num_read_kb":13498,"num_write":403,"num_write_kb":21128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":380,"num_bytes_recovered":20462375,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"199'1090","reported_seq":6462,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.750976+0000","last_change":"2024-09-13T05:13:46.671045+0000","last_active":"2024-09-13T05:13:57.750976+0000","last_peered":"2024-09-13T05:13:57.750976+0000","last_clean":"2024-09-13T05:13:57.750976+0000","last_became_active":"2024-09-13T05:13:46.665575+0000","last_became_peered":"2024-09-13T05:13:46.665575+0000","last_unstale":"2024-09-13T05:13:57.750976+0000","last_undegraded":"2024-09-13T05:13:57.750976+0000","last_fullsized":"2024-09-13T05:13:57.750976+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1090,"log_dups_size":0,"ondisk_log_size":1090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:12:46.891233+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.006060307,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":9137,"num_read_kb":27013,"num_write":1266,"num_write_kb":8578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":633324,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"201'1349","reported_seq":5470,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250971+0000","last_change":"2024-09-13T05:13:35.791602+0000","last_active":"2024-09-13T05:13:58.250971+0000","last_peered":"2024-09-13T05:13:58.250971+0000","last_clean":"2024-09-13T05:13:58.250971+0000","last_became_active":"2024-09-13T05:12:48.638127+0000","last_became_peered":"2024-09-13T05:12:48.638127+0000","last_unstale":"2024-09-13T05:13:58.250971+0000","last_undegraded":"2024-09-13T05:13:58.250971+0000","last_fullsized":"2024-09-13T05:13:58.250971+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1349,"log_dups_size":0,"ondisk_log_size":1349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:33:48.012842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001070477,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":7844,"num_read_kb":55094,"num_write":1803,"num_write_kb":40168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":20884522,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":1622,"num_object_clones":0,"num_object_copies":3244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1622,"num_whiteouts":1618,"num_read":258414,"num_read_kb":631830,"num_write":28490,"num_write_kb":532665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11025,"num_bytes_recovered":280109913,"num_keys_recovered":906,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3756,"internal_metadata":0},"log_size":27075,"ondisk_log_size":27075,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106524,"kb_used_data":3216,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94265316,"statfs":{"total":96636764160,"available":96527683584,"internally_reserved":0,"allocated":3293184,"data_stored":1898733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":105773515},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:13 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.83599999999999997}]},{"osd":1,"last update":"Fri Sep 13 05:12:59 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.80700000000000005,"15min":0.81899999999999995},"min":{"1min":0.54300000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.83199999999999996,"15min":0.80500000000000005},"min":{"1min":0.48799999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.61499999999999999}]},{"osd":2,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.84899999999999998,"15min":0.85399999999999998},"min":{"1min":0.67600000000000005,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1519999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.056,"5min":0.90200000000000002,"15min":0.81499999999999995},"min":{"1min":0.94399999999999995,"5min":0.433,"15min":0.433},"max":{"1min":1.262,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.262}]},{"osd":3,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.98199999999999998,"15min":0.90500000000000003},"min":{"1min":0.54000000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2749999999999999,"5min":12.663,"15min":12.663},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.90000000000000002,"15min":0.90400000000000003},"min":{"1min":0.73199999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1799999999999999,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81100000000000005,"15min":0.77900000000000003},"min":{"1min":0.58699999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.365,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.91000000000000003,"15min":0.92500000000000004},"min":{"1min":0.48999999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.216,"5min":2.02,"15min":2.02},"last":0.876}]},{"osd":5,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.95799999999999996,"15min":0.95199999999999996},"min":{"1min":0.63900000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.246,"5min":1.655,"15min":1.655},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.96399999999999997,"15min":0.95099999999999996},"min":{"1min":0.66100000000000003,"5min":0.499,"15min":0.499},"max":{"1min":1.306,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.1919999999999999}]},{"osd":6,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93300000000000005,"15min":0.91900000000000004},"min":{"1min":0.76200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.381,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.042,"15min":1.038},"min":{"1min":0.76900000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3240000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.1100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59992,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311848,"statfs":{"total":96636764160,"available":96575332352,"internally_reserved":0,"allocated":2699264,"data_stored":1308365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58718663},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":1.0609999999999999}]},{"osd":1,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.85399999999999998,"15min":0.873},"min":{"1min":0.51900000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82399999999999995,"15min":0.85499999999999998},"min":{"1min":0.46500000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.3009999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.97999999999999998}]},{"osd":2,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.79500000000000004,"15min":0.77600000000000002},"min":{"1min":0.58299999999999996,"5min":0.312,"15min":0.312},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.93799999999999994,"15min":0.96599999999999997},"min":{"1min":0.42499999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.383,"5min":1.49,"15min":1.49},"last":1.0249999999999999}]},{"osd":3,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90700000000000003,"15min":0.93799999999999994},"min":{"1min":0.65800000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.5489999999999999,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.93000000000000005,"15min":0.93500000000000005},"min":{"1min":0.80400000000000005,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":1.143}]},{"osd":4,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.93899999999999995,"15min":0.95999999999999996},"min":{"1min":0.47399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.456,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.173},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.95299999999999996,"15min":0.98699999999999999},"min":{"1min":0.55500000000000005,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.274,"5min":2.056,"15min":2.056},"last":1.1080000000000001}]},{"osd":5,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.68300000000000005,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.0800000000000001,"15min":1.0980000000000001},"min":{"1min":0.69899999999999995,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.246}]},{"osd":7,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0620000000000001,"15min":1.101},"min":{"1min":0.748,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3120000000000001,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.0740000000000001,"15min":1.0820000000000001},"min":{"1min":0.82099999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.383}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82148,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":79486,"kb_avail":94289692,"statfs":{"total":96636764160,"available":96552644608,"internally_reserved":0,"allocated":2703360,"data_stored":1308384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":81394118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.65900000000000003}]},{"osd":1,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.83599999999999997,"15min":0.872},"min":{"1min":0.53700000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1619999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.75},{"interface":"front","average":{"1min":0.873,"5min":0.86399999999999999,"15min":0.90900000000000003},"min":{"1min":0.61299999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.145,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.86799999999999999}]},{"osd":2,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.81699999999999995,"15min":0.84499999999999997},"min":{"1min":0.40600000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1519999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.90000000000000002,"15min":0.89800000000000002},"min":{"1min":0.59999999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.96899999999999997}]},{"osd":3,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.85499999999999998,"15min":0.91100000000000003},"min":{"1min":0.58299999999999996,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1180000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.93200000000000005,"15min":1.0009999999999999},"min":{"1min":0.64900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.294,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.0980000000000001}]},{"osd":4,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.878,"15min":0.94499999999999995},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1830000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.016,"15min":1.0920000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.333,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.048}]},{"osd":6,"last update":"Fri Sep 13 05:13:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.94099999999999995,"15min":0.95399999999999996},"min":{"1min":0.58199999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4950000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.1879999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.99199999999999999,"15min":1.034},"min":{"1min":0.45600000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.236,"5min":1.528,"15min":1.528},"last":1.1399999999999999}]},{"osd":7,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0620000000000001,"15min":1.1639999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.244,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.101,"15min":1.1559999999999999},"min":{"1min":0.47399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.4590000000000001,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.236}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37856,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94333984,"statfs":{"total":96636764160,"available":96597999616,"internally_reserved":0,"allocated":2703360,"data_stored":1308384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.76500000000000001}]},{"osd":1,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.745,"15min":0.751},"min":{"1min":0.433,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0940000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.85899999999999999,"15min":0.91500000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0009999999999999,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.67900000000000005}]},{"osd":2,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.94499999999999995,"15min":0.98199999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.109,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":1.0269999999999999,"15min":1.079},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1930000000000001,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.79900000000000004}]},{"osd":3,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.91400000000000003,"15min":0.91500000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1639999999999999,"5min":4.0609999999999999,"15min":4.0609999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.88500000000000001,"15min":0.91400000000000003},"min":{"1min":0.64200000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1539999999999999,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.72899999999999998}]},{"osd":5,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.871,"15min":0.88700000000000001},"min":{"1min":0.53100000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.012,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":1.0660000000000001,"15min":1.1499999999999999},"min":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.133,"5min":3.871,"15min":3.871},"last":0.97599999999999998}]},{"osd":6,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.0669999999999999,"15min":1.1339999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.149,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.94299999999999995,"15min":0.95699999999999996},"min":{"1min":0.61399999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.254,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.82799999999999996}]},{"osd":7,"last update":"Fri Sep 13 05:12:57 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.1000000000000001,"15min":1.153},"min":{"1min":0.61099999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.238,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.081,"15min":1.1000000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.3460000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.89700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64100,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":61438,"kb_avail":94307740,"statfs":{"total":96636764160,"available":96571125760,"internally_reserved":0,"allocated":2699264,"data_stored":1308365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":62912968},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.71599999999999997}]},{"osd":1,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64500000000000002,"15min":0.65800000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.67600000000000005,"15min":0.71599999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.0069999999999999,"5min":1.125,"15min":1.125},"last":0.755}]},{"osd":2,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.72199999999999998,"15min":0.73799999999999999},"min":{"1min":0.39000000000000001,"5min":0.377,"15min":0.377},"max":{"1min":1.2330000000000001,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.78600000000000003,"15min":0.83599999999999997},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.113,"5min":1.573,"15min":1.573},"last":0.78500000000000003}]},{"osd":4,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.85399999999999998,"15min":0.89500000000000002},"min":{"1min":0.55100000000000005,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.88800000000000001,"15min":0.92600000000000005},"min":{"1min":0.49099999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.196,"5min":1.764,"15min":1.764},"last":0.89600000000000002}]},{"osd":5,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.94599999999999995,"15min":1.004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2390000000000001,"5min":2.157,"15min":2.157},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.92700000000000005,"15min":0.98299999999999998},"min":{"1min":0.68400000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.633,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.0940000000000001}]},{"osd":6,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.94099999999999995,"15min":0.97899999999999998},"min":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.375,"5min":1.976,"15min":1.976},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":1.02,"15min":1.089},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4970000000000001,"5min":2.012,"15min":2.012},"last":1.0580000000000001}]},{"osd":7,"last update":"Fri Sep 13 05:13:01 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.028,"15min":1.077},"min":{"1min":0.57899999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.6679999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.198},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0609999999999999,"15min":1.101},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7170000000000001,"5min":1.875,"15min":1.875},"last":1.157}]}]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65756,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306084,"statfs":{"total":96636764160,"available":96569430016,"internally_reserved":0,"allocated":2699264,"data_stored":1308365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.55800000000000005}]},{"osd":1,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64800000000000002,"15min":0.66800000000000004},"min":{"1min":0.40200000000000002,"5min":0.246,"15min":0.246},"max":{"1min":1.081,"5min":1.554,"15min":1.554},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64200000000000002,"15min":0.65400000000000003},"min":{"1min":0.40100000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0780000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.79400000000000004}]},{"osd":3,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67000000000000004,"15min":0.624},"min":{"1min":0.38300000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.002,"5min":6.6070000000000002,"15min":6.6070000000000002},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69499999999999995,"15min":0.66700000000000004},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.014,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.82899999999999996}]},{"osd":4,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.82299999999999995,"15min":0.78300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.464,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.343},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.90700000000000003,"15min":0.89800000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":0.99199999999999999}]},{"osd":5,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.878,"15min":0.89400000000000002},"min":{"1min":0.48999999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.1099999999999999,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.89700000000000002,"15min":0.872},"min":{"1min":0.52400000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3500000000000001,"5min":1.51,"15min":1.51},"last":1.2909999999999999}]},{"osd":6,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90300000000000002,"15min":0.879},"min":{"1min":0.54200000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.381},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94699999999999995,"15min":0.94799999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3300000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.2490000000000001}]},{"osd":7,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0109999999999999,"15min":1.0289999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3680000000000001,"5min":1.867,"15min":1.867},"last":1.417},{"interface":"front","average":{"1min":1.038,"5min":0.97499999999999998,"15min":0.97599999999999998},"min":{"1min":0.52000000000000002,"5min":0.496,"15min":0.496},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":1.0669999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60000,"kb_used_data":2644,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311840,"statfs":{"total":96636764160,"available":96575324160,"internally_reserved":0,"allocated":2707456,"data_stored":1308403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.66400000000000003,"15min":0.61599999999999999},"min":{"1min":0.39400000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.98899999999999999,"5min":5.952,"15min":5.952},"last":0.623},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66300000000000003,"15min":0.68999999999999995},"min":{"1min":0.45900000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86499999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72699999999999998,"15min":0.76700000000000002},"min":{"1min":0.42099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.127,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71399999999999997,"15min":0.747},"min":{"1min":0.47399999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.026,"5min":1.887,"15min":1.887},"last":0.80300000000000005}]},{"osd":4,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.86899999999999999,"15min":0.91400000000000003},"min":{"1min":0.66400000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0329999999999999,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0740000000000001,"5min":0.92200000000000004,"15min":0.94399999999999995},"min":{"1min":0.78700000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.4750000000000001,"5min":1.724,"15min":1.724},"last":1.0609999999999999}]},{"osd":5,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.89700000000000002,"15min":0.92400000000000004},"min":{"1min":0.69799999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.752},{"interface":"front","average":{"1min":1.0609999999999999,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.76800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.008}]},{"osd":6,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.94999999999999996,"15min":1},"min":{"1min":0.67500000000000004,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.4239999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.109,"5min":1.0029999999999999,"15min":1.0149999999999999},"min":{"1min":0.74399999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.625,"5min":1.873,"15min":1.873},"last":1.109}]},{"osd":7,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.996,"15min":1.018},"min":{"1min":0.80900000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.877},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.046,"15min":1.0409999999999999},"min":{"1min":0.91700000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.401,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.0840000000000001}]}]},{"osd":0,"up_from":124,"seq":532575944730,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47328,"kb_used_data":3216,"kb_used_omap":7,"kb_used_meta":44088,"kb_avail":94324512,"statfs":{"total":96636764160,"available":96588300288,"internally_reserved":0,"allocated":3293184,"data_stored":1898733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7666,"internal_metadata":45146638},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.66100000000000003}]},{"osd":2,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.57999999999999996}]},{"osd":3,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.72199999999999998}]},{"osd":4,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":3.2330000000000001,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":0.93500000000000005}]},{"osd":5,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.98099999999999998}]},{"osd":6,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.88},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.1020000000000001}]},{"osd":7,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":1.1679999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3756,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:14:04.345 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T05:14:04.638 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:14:04.638 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":223,"fsid":"0a3759da-62bd-4704-8a4a-7c20eb3fc816","created":"2024-09-13T05:09:38.849186+0000","modified":"2024-09-13T05:13:57.972710+0000","last_up_change":"2024-09-13T05:12:13.640614+0000","last_in_change":"2024-09-13T05:13:36.781567+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T05:09:52.225455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T05:09:57.858552+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-13T05:10:07.742110+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":93,"snap_epoch":201,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b304ec03-bb00-4b13-bf2d-71017b8a70a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":105,"up_from":124,"up_thru":211,"down_at":106,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":367697828},{"type":"v1","addr":"172.21.15.120:6801","nonce":367697828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":367697828},{"type":"v1","addr":"172.21.15.120:6803","nonce":367697828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":367697828},{"type":"v1","addr":"172.21.15.120:6807","nonce":367697828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":367697828},{"type":"v1","addr":"172.21.15.120:6805","nonce":367697828}]},"public_addr":"172.21.15.120:6801/367697828","cluster_addr":"172.21.15.120:6803/367697828","heartbeat_back_addr":"172.21.15.120:6807/367697828","heartbeat_front_addr":"172.21.15.120:6805/367697828","state":["exists","up"]},{"osd":1,"uuid":"c09e84f3-3a70-46a4-b67b-c9bb52c887b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1023532100},{"type":"v1","addr":"172.21.15.120:6809","nonce":1023532100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1023532100},{"type":"v1","addr":"172.21.15.120:6811","nonce":1023532100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1023532100},{"type":"v1","addr":"172.21.15.120:6815","nonce":1023532100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1023532100},{"type":"v1","addr":"172.21.15.120:6813","nonce":1023532100}]},"public_addr":"172.21.15.120:6809/1023532100","cluster_addr":"172.21.15.120:6811/1023532100","heartbeat_back_addr":"172.21.15.120:6815/1023532100","heartbeat_front_addr":"172.21.15.120:6813/1023532100","state":["exists","up"]},{"osd":2,"uuid":"3c2a0458-369c-4dac-90a3-fb20cb70d53f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":592498012},{"type":"v1","addr":"172.21.15.120:6817","nonce":592498012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":592498012},{"type":"v1","addr":"172.21.15.120:6819","nonce":592498012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":592498012},{"type":"v1","addr":"172.21.15.120:6823","nonce":592498012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":592498012},{"type":"v1","addr":"172.21.15.120:6821","nonce":592498012}]},"public_addr":"172.21.15.120:6817/592498012","cluster_addr":"172.21.15.120:6819/592498012","heartbeat_back_addr":"172.21.15.120:6823/592498012","heartbeat_front_addr":"172.21.15.120:6821/592498012","state":["exists","up"]},{"osd":3,"uuid":"edce3757-5e9d-4221-a1f1-3f356bb5218b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1939753938},{"type":"v1","addr":"172.21.15.120:6825","nonce":1939753938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1939753938},{"type":"v1","addr":"172.21.15.120:6827","nonce":1939753938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1939753938},{"type":"v1","addr":"172.21.15.120:6831","nonce":1939753938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1939753938},{"type":"v1","addr":"172.21.15.120:6829","nonce":1939753938}]},"public_addr":"172.21.15.120:6825/1939753938","cluster_addr":"172.21.15.120:6827/1939753938","heartbeat_back_addr":"172.21.15.120:6831/1939753938","heartbeat_front_addr":"172.21.15.120:6829/1939753938","state":["exists","up"]},{"osd":4,"uuid":"5fe378d2-578f-41ea-980a-4673a8b376df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":3005075615},{"type":"v1","addr":"172.21.15.137:6825","nonce":3005075615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":3005075615},{"type":"v1","addr":"172.21.15.137:6827","nonce":3005075615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":3005075615},{"type":"v1","addr":"172.21.15.137:6831","nonce":3005075615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":3005075615},{"type":"v1","addr":"172.21.15.137:6829","nonce":3005075615}]},"public_addr":"172.21.15.137:6825/3005075615","cluster_addr":"172.21.15.137:6827/3005075615","heartbeat_back_addr":"172.21.15.137:6831/3005075615","heartbeat_front_addr":"172.21.15.137:6829/3005075615","state":["exists","up"]},{"osd":5,"uuid":"6e6f7499-ae9e-4cb1-9db7-4d9f8fd9b257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":1108177522},{"type":"v1","addr":"172.21.15.137:6801","nonce":1108177522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":1108177522},{"type":"v1","addr":"172.21.15.137:6803","nonce":1108177522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1108177522},{"type":"v1","addr":"172.21.15.137:6807","nonce":1108177522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":1108177522},{"type":"v1","addr":"172.21.15.137:6805","nonce":1108177522}]},"public_addr":"172.21.15.137:6801/1108177522","cluster_addr":"172.21.15.137:6803/1108177522","heartbeat_back_addr":"172.21.15.137:6807/1108177522","heartbeat_front_addr":"172.21.15.137:6805/1108177522","state":["exists","up"]},{"osd":6,"uuid":"e4c519e5-5df4-4d55-b12e-fbcfb1b0555c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":207,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2667039053},{"type":"v1","addr":"172.21.15.137:6817","nonce":2667039053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2667039053},{"type":"v1","addr":"172.21.15.137:6819","nonce":2667039053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2667039053},{"type":"v1","addr":"172.21.15.137:6823","nonce":2667039053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2667039053},{"type":"v1","addr":"172.21.15.137:6821","nonce":2667039053}]},"public_addr":"172.21.15.137:6817/2667039053","cluster_addr":"172.21.15.137:6819/2667039053","heartbeat_back_addr":"172.21.15.137:6823/2667039053","heartbeat_front_addr":"172.21.15.137:6821/2667039053","state":["exists","up"]},{"osd":7,"uuid":"914648c2-7a6c-4e66-811d-936e250638db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":993764921},{"type":"v1","addr":"172.21.15.137:6809","nonce":993764921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":993764921},{"type":"v1","addr":"172.21.15.137:6811","nonce":993764921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":993764921},{"type":"v1","addr":"172.21.15.137:6815","nonce":993764921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":993764921},{"type":"v1","addr":"172.21.15.137:6813","nonce":993764921}]},"public_addr":"172.21.15.137:6809/993764921","cluster_addr":"172.21.15.137:6811/993764921","heartbeat_back_addr":"172.21.15.137:6815/993764921","heartbeat_front_addr":"172.21.15.137:6813/993764921","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:46.914820+0000","dead_epoch":106},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.326286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.147193+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.478655+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.388938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.127175+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:47.187286+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T05:09:46.962119+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.2","osds":[6,7]},{"pgid":"3.a","osds":[3,2]},{"pgid":"3.1d","osds":[0,7]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T05:14:05.654 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T05:14:05.655 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T05:14:05.818 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:14:05.818 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T05:14:05.818 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:14:05.832 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T05:14:06.133 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T05:14:06.147 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T05:14:06.148 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T05:14:06.297 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:14:06.297 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T05:14:06.297 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:14:06.309 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T05:14:06.614 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T05:14:06.624 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T05:14:06.624 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T05:14:06.782 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:14:06.782 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T05:14:06.782 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:14:06.795 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T05:14:07.106 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T05:14:07.121 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T05:14:07.121 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T05:14:07.273 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:14:07.273 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T05:14:07.273 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:14:07.286 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T05:14:07.595 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T05:14:07.606 INFO:tasks.ceph:Scrubbing osd.4 2024-09-13T05:14:07.606 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-13T05:14:07.765 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:14:07.765 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T05:14:07.765 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:14:07.779 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-13T05:14:08.072 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 4 to deep-scrub 2024-09-13T05:14:08.082 INFO:tasks.ceph:Scrubbing osd.5 2024-09-13T05:14:08.082 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-13T05:14:08.234 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:14:08.234 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T05:14:08.235 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:14:08.247 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-13T05:14:08.557 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 5 to deep-scrub 2024-09-13T05:14:08.568 INFO:tasks.ceph:Scrubbing osd.6 2024-09-13T05:14:08.568 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-13T05:14:08.723 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:14:08.723 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T05:14:08.723 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:14:08.736 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-13T05:14:09.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T05:14:09.045+0000 7f9cc172b700 0 --2- 172.21.15.120:0/2024070943 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9cbc13d710 0x7f9cbc13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-13T05:14:09.249 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 6 to deep-scrub 2024-09-13T05:14:09.261 INFO:tasks.ceph:Scrubbing osd.7 2024-09-13T05:14:09.261 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-13T05:14:09.411 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T05:14:09.412 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T05:14:09.412 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T05:14:09.425 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-13T05:14:09.745 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 7 to deep-scrub 2024-09-13T05:14:09.755 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:14:10.060 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:14:10.062 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:14:10.073 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2024-09-13T05:14:08.234461+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":1626,"num_object_clones":0,"num_object_copies":3252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1626,"num_whiteouts":1618,"num_read":258530,"num_read_kb":631930,"num_write":28651,"num_write_kb":535083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11035,"num_bytes_recovered":282471423,"num_keys_recovered":906,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27242,"ondisk_log_size":27242,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":523704,"kb_used_data":22264,"kb_used_omap":18,"kb_used_meta":501293,"kb_avail":754451016,"statfs":{"total":773094113280,"available":772557840384,"internally_reserved":0,"allocated":22798336,"data_stored":11647732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18816,"internal_metadata":513324672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.255142"},"pg_stats":[{"pgid":"3.1f","version":"201'697","reported_seq":3851,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751296+0000","last_change":"2024-09-13T05:13:41.861132+0000","last_active":"2024-09-13T05:13:57.751296+0000","last_peered":"2024-09-13T05:13:57.751296+0000","last_clean":"2024-09-13T05:13:57.751296+0000","last_became_active":"2024-09-13T05:13:41.857384+0000","last_became_peered":"2024-09-13T05:13:41.857384+0000","last_unstale":"2024-09-13T05:13:57.751296+0000","last_undegraded":"2024-09-13T05:13:57.751296+0000","last_fullsized":"2024-09-13T05:13:57.751296+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:49.750308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024323220000000002,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":4120,"num_read_kb":8764,"num_write":717,"num_write_kb":5986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":222,"num_bytes_recovered":297202,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"200'638","reported_seq":10844,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820478+0000","last_change":"2024-09-13T05:13:35.800144+0000","last_active":"2024-09-13T05:13:57.820478+0000","last_peered":"2024-09-13T05:13:57.820478+0000","last_clean":"2024-09-13T05:13:57.820478+0000","last_became_active":"2024-09-13T05:13:17.865448+0000","last_became_peered":"2024-09-13T05:13:17.865448+0000","last_unstale":"2024-09-13T05:13:57.820478+0000","last_undegraded":"2024-09-13T05:13:57.820478+0000","last_fullsized":"2024-09-13T05:13:57.820478+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:53.868009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001429893,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":51,"num_read":10597,"num_read_kb":9513,"num_write":519,"num_write_kb":4499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":4028965,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"198'807","reported_seq":4506,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751152+0000","last_change":"2024-09-13T05:13:43.666248+0000","last_active":"2024-09-13T05:13:57.751152+0000","last_peered":"2024-09-13T05:13:57.751152+0000","last_clean":"2024-09-13T05:13:57.751152+0000","last_became_active":"2024-09-13T05:13:43.661570+0000","last_became_peered":"2024-09-13T05:13:43.661570+0000","last_unstale":"2024-09-13T05:13:57.751152+0000","last_undegraded":"2024-09-13T05:13:57.751152+0000","last_fullsized":"2024-09-13T05:13:57.751152+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:36.817036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025226720000000001,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":4533,"num_read_kb":14391,"num_write":805,"num_write_kb":18480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":591,"num_bytes_recovered":7610600,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"201'977","reported_seq":6576,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975516+0000","last_change":"2024-09-13T05:13:35.786861+0000","last_active":"2024-09-13T05:13:56.975516+0000","last_peered":"2024-09-13T05:13:56.975516+0000","last_clean":"2024-09-13T05:13:56.975516+0000","last_became_active":"2024-09-13T05:13:31.750484+0000","last_became_peered":"2024-09-13T05:13:31.750484+0000","last_unstale":"2024-09-13T05:13:56.975516+0000","last_undegraded":"2024-09-13T05:13:56.975516+0000","last_fullsized":"2024-09-13T05:13:56.975516+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":977,"log_dups_size":0,"ondisk_log_size":977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:00:07.341842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020042060000000001,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":42,"num_read":7151,"num_read_kb":23958,"num_write":1100,"num_write_kb":15871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":371,"num_bytes_recovered":9523896,"num_keys_recovered":208,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"201'877","reported_seq":4692,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751289+0000","last_change":"2024-09-13T05:13:45.669557+0000","last_active":"2024-09-13T05:13:57.751289+0000","last_peered":"2024-09-13T05:13:57.751289+0000","last_clean":"2024-09-13T05:13:57.751289+0000","last_became_active":"2024-09-13T05:13:45.664962+0000","last_became_peered":"2024-09-13T05:13:45.664962+0000","last_unstale":"2024-09-13T05:13:57.751289+0000","last_undegraded":"2024-09-13T05:13:57.751289+0000","last_fullsized":"2024-09-13T05:13:57.751289+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:45.796036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019293209999999999,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":57,"num_read":5360,"num_read_kb":16535,"num_write":962,"num_write_kb":43436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":614,"num_bytes_recovered":12868860,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"198'1987","reported_seq":21127,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.976514+0000","last_change":"2024-09-13T05:13:35.787845+0000","last_active":"2024-09-13T05:13:56.976514+0000","last_peered":"2024-09-13T05:13:56.976514+0000","last_clean":"2024-09-13T05:13:56.976514+0000","last_became_active":"2024-09-13T05:12:46.652272+0000","last_became_peered":"2024-09-13T05:12:46.652272+0000","last_unstale":"2024-09-13T05:13:56.976514+0000","last_undegraded":"2024-09-13T05:13:56.976514+0000","last_fullsized":"2024-09-13T05:13:56.976514+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1987,"log_dups_size":0,"ondisk_log_size":1987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:54.915675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028053240000000001,"stat_sum":{"num_bytes":19,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":48,"num_read":27228,"num_read_kb":30157,"num_write":3057,"num_write_kb":13192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":478,"num_bytes_recovered":9711059,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"199'934","reported_seq":12698,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:13:59.530189+0000","last_change":"2024-09-13T05:13:35.786448+0000","last_active":"2024-09-13T05:13:59.530189+0000","last_peered":"2024-09-13T05:13:59.530189+0000","last_clean":"2024-09-13T05:13:59.530189+0000","last_became_active":"2024-09-13T05:12:09.626312+0000","last_became_peered":"2024-09-13T05:12:09.626312+0000","last_unstale":"2024-09-13T05:13:59.530189+0000","last_undegraded":"2024-09-13T05:13:59.530189+0000","last_fullsized":"2024-09-13T05:13:59.530189+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000937213,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":14225,"num_read_kb":23139,"num_write":1021,"num_write_kb":7466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":3365202,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"201'711","reported_seq":5951,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820144+0000","last_change":"2024-09-13T05:13:45.671796+0000","last_active":"2024-09-13T05:13:57.820144+0000","last_peered":"2024-09-13T05:13:57.820144+0000","last_clean":"2024-09-13T05:13:57.820144+0000","last_became_active":"2024-09-13T05:13:45.668572+0000","last_became_peered":"2024-09-13T05:13:45.668572+0000","last_unstale":"2024-09-13T05:13:57.820144+0000","last_undegraded":"2024-09-13T05:13:57.820144+0000","last_fullsized":"2024-09-13T05:13:57.820144+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:04:22.859063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000878607,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":54,"num_read":4887,"num_read_kb":27058,"num_write":681,"num_write_kb":24614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":417,"num_bytes_recovered":11847558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"201'721","reported_seq":4577,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751303+0000","last_change":"2024-09-13T05:13:40.856558+0000","last_active":"2024-09-13T05:13:57.751303+0000","last_peered":"2024-09-13T05:13:57.751303+0000","last_clean":"2024-09-13T05:13:57.751303+0000","last_became_active":"2024-09-13T05:13:40.852807+0000","last_became_peered":"2024-09-13T05:13:40.852807+0000","last_unstale":"2024-09-13T05:13:57.751303+0000","last_undegraded":"2024-09-13T05:13:57.751303+0000","last_fullsized":"2024-09-13T05:13:57.751303+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:00.702995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031554529999999999,"stat_sum":{"num_bytes":0,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":58,"num_read":6742,"num_read_kb":11740,"num_write":569,"num_write_kb":4140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":212,"num_bytes_recovered":37802,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"201'562","reported_seq":9656,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975731+0000","last_change":"2024-09-13T05:13:35.789392+0000","last_active":"2024-09-13T05:13:56.975731+0000","last_peered":"2024-09-13T05:13:56.975731+0000","last_clean":"2024-09-13T05:13:56.975731+0000","last_became_active":"2024-09-13T05:11:24.631079+0000","last_became_peered":"2024-09-13T05:11:24.631079+0000","last_unstale":"2024-09-13T05:13:56.975731+0000","last_undegraded":"2024-09-13T05:13:56.975731+0000","last_fullsized":"2024-09-13T05:13:56.975731+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:29.182802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023449740000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":9259,"num_read_kb":15708,"num_write":427,"num_write_kb":4479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":4743569,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"200'648","reported_seq":13518,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.251065+0000","last_change":"2024-09-13T05:13:35.792438+0000","last_active":"2024-09-13T05:13:58.251065+0000","last_peered":"2024-09-13T05:13:58.251065+0000","last_clean":"2024-09-13T05:13:58.251065+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:13:58.251065+0000","last_undegraded":"2024-09-13T05:13:58.251065+0000","last_fullsized":"2024-09-13T05:13:58.251065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:40.457636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001651455,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":49,"num_read":13660,"num_read_kb":13906,"num_write":593,"num_write_kb":23553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"201'594","reported_seq":8351,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.976850+0000","last_change":"2024-09-13T05:13:35.786854+0000","last_active":"2024-09-13T05:13:56.976850+0000","last_peered":"2024-09-13T05:13:56.976850+0000","last_clean":"2024-09-13T05:13:56.976850+0000","last_became_active":"2024-09-13T05:12:45.651071+0000","last_became_peered":"2024-09-13T05:12:45.651071+0000","last_unstale":"2024-09-13T05:13:56.976850+0000","last_undegraded":"2024-09-13T05:13:56.976850+0000","last_fullsized":"2024-09-13T05:13:56.976850+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:25.056987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001813283,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":48,"num_read":7291,"num_read_kb":29056,"num_write":470,"num_write_kb":7007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":364,"num_bytes_recovered":7851183,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.864933+0000","last_change":"2024-09-13T05:13:14.651362+0000","last_active":"2024-09-13T05:13:57.864933+0000","last_peered":"2024-09-13T05:13:57.864933+0000","last_clean":"2024-09-13T05:13:57.864933+0000","last_became_active":"2024-09-13T05:13:14.650955+0000","last_became_peered":"2024-09-13T05:13:14.650955+0000","last_unstale":"2024-09-13T05:13:57.864933+0000","last_undegraded":"2024-09-13T05:13:57.864933+0000","last_fullsized":"2024-09-13T05:13:57.864933+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:44:17.395077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"201'728","reported_seq":9060,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.751212+0000","last_change":"2024-09-13T05:13:41.858754+0000","last_active":"2024-09-13T05:13:57.751212+0000","last_peered":"2024-09-13T05:13:57.751212+0000","last_clean":"2024-09-13T05:13:57.751212+0000","last_became_active":"2024-09-13T05:13:41.854863+0000","last_became_peered":"2024-09-13T05:13:41.854863+0000","last_unstale":"2024-09-13T05:13:57.751212+0000","last_undegraded":"2024-09-13T05:13:57.751212+0000","last_fullsized":"2024-09-13T05:13:57.751212+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:49.909033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013617600000000001,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":49,"num_read":8371,"num_read_kb":18309,"num_write":603,"num_write_kb":8603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":704,"num_bytes_recovered":23835437,"num_keys_recovered":90,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":143,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:13:59.530208+0000","last_change":"2024-09-13T05:13:14.651407+0000","last_active":"2024-09-13T05:13:59.530208+0000","last_peered":"2024-09-13T05:13:59.530208+0000","last_clean":"2024-09-13T05:13:59.530208+0000","last_became_active":"2024-09-13T05:13:14.651157+0000","last_became_peered":"2024-09-13T05:13:14.651157+0000","last_unstale":"2024-09-13T05:13:59.530208+0000","last_undegraded":"2024-09-13T05:13:59.530208+0000","last_fullsized":"2024-09-13T05:13:59.530208+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"201'599","reported_seq":6019,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820420+0000","last_change":"2024-09-13T05:13:35.801562+0000","last_active":"2024-09-13T05:13:57.820420+0000","last_peered":"2024-09-13T05:13:57.820420+0000","last_clean":"2024-09-13T05:13:57.820420+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:13:57.820420+0000","last_undegraded":"2024-09-13T05:13:57.820420+0000","last_fullsized":"2024-09-13T05:13:57.820420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:36:37.976147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025976440000000001,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":54,"num_read":5378,"num_read_kb":14806,"num_write":465,"num_write_kb":5134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":251,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.251242+0000","last_change":"2024-09-13T05:13:37.804238+0000","last_active":"2024-09-13T05:13:58.251242+0000","last_peered":"2024-09-13T05:13:58.251242+0000","last_clean":"2024-09-13T05:13:58.251242+0000","last_became_active":"2024-09-13T05:13:37.803889+0000","last_became_peered":"2024-09-13T05:13:37.803889+0000","last_unstale":"2024-09-13T05:13:58.251242+0000","last_undegraded":"2024-09-13T05:13:58.251242+0000","last_fullsized":"2024-09-13T05:13:58.251242+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:54.936748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"223'758","reported_seq":1933,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:06.888029+0000","last_change":"2024-09-13T05:14:06.888225+0000","last_active":"2024-09-13T05:14:06.888029+0000","last_peered":"2024-09-13T05:14:06.888029+0000","last_clean":"2024-09-13T05:14:06.888029+0000","last_became_active":"2024-09-13T05:12:09.627485+0000","last_became_peered":"2024-09-13T05:12:09.627485+0000","last_unstale":"2024-09-13T05:14:06.888029+0000","last_undegraded":"2024-09-13T05:14:06.888029+0000","last_fullsized":"2024-09-13T05:14:06.888029+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'758","last_scrub_stamp":"2024-09-13T05:14:06.887992+0000","last_deep_scrub":"223'758","last_deep_scrub_stamp":"2024-09-13T05:14:06.887992+0000","last_clean_scrub_stamp":"2024-09-13T05:14:06.887992+0000","objects_scrubbed":47,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:40:15.437641+0000","scrub_duration":0.049205615000000001,"objects_trimmed":0,"snaptrim_duration":0.001363632,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":1702,"num_read_kb":4638,"num_write":789,"num_write_kb":10312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":352,"num_bytes_recovered":5263836,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":127,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:13:59.530195+0000","last_change":"2024-09-13T05:13:37.803930+0000","last_active":"2024-09-13T05:13:59.530195+0000","last_peered":"2024-09-13T05:13:59.530195+0000","last_clean":"2024-09-13T05:13:59.530195+0000","last_became_active":"2024-09-13T05:13:37.803639+0000","last_became_peered":"2024-09-13T05:13:37.803639+0000","last_unstale":"2024-09-13T05:13:59.530195+0000","last_undegraded":"2024-09-13T05:13:59.530195+0000","last_fullsized":"2024-09-13T05:13:59.530195+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"198'734","reported_seq":5793,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975799+0000","last_change":"2024-09-13T05:13:35.789140+0000","last_active":"2024-09-13T05:13:56.975799+0000","last_peered":"2024-09-13T05:13:56.975799+0000","last_clean":"2024-09-13T05:13:56.975799+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:13:56.975799+0000","last_undegraded":"2024-09-13T05:13:56.975799+0000","last_fullsized":"2024-09-13T05:13:56.975799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":734,"log_dups_size":0,"ondisk_log_size":734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:40.372741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035228970000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":7406,"num_read_kb":59728,"num_write":628,"num_write_kb":55671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"201'1134","reported_seq":5748,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.976900+0000","last_change":"2024-09-13T05:13:46.667441+0000","last_active":"2024-09-13T05:13:56.976900+0000","last_peered":"2024-09-13T05:13:56.976900+0000","last_clean":"2024-09-13T05:13:56.976900+0000","last_became_active":"2024-09-13T05:13:46.664160+0000","last_became_peered":"2024-09-13T05:13:46.664160+0000","last_unstale":"2024-09-13T05:13:56.976900+0000","last_undegraded":"2024-09-13T05:13:56.976900+0000","last_fullsized":"2024-09-13T05:13:56.976900+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1134,"log_dups_size":0,"ondisk_log_size":1134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:20:03.815805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026890410000000001,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":56,"num_read":4911,"num_read_kb":30667,"num_write":1235,"num_write_kb":50371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":996,"num_bytes_recovered":31453269,"num_keys_recovered":34,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":247,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975430+0000","last_change":"2024-09-13T05:13:31.749856+0000","last_active":"2024-09-13T05:13:56.975430+0000","last_peered":"2024-09-13T05:13:56.975430+0000","last_clean":"2024-09-13T05:13:56.975430+0000","last_became_active":"2024-09-13T05:13:31.749063+0000","last_became_peered":"2024-09-13T05:13:31.749063+0000","last_unstale":"2024-09-13T05:13:56.975430+0000","last_undegraded":"2024-09-13T05:13:56.975430+0000","last_fullsized":"2024-09-13T05:13:56.975430+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:17.847170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"199'797","reported_seq":1781,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:06.609926+0000","last_change":"2024-09-13T05:13:35.786564+0000","last_active":"2024-09-13T05:14:06.609926+0000","last_peered":"2024-09-13T05:14:06.609926+0000","last_clean":"2024-09-13T05:14:06.609926+0000","last_became_active":"2024-09-13T05:12:07.930334+0000","last_became_peered":"2024-09-13T05:12:07.930334+0000","last_unstale":"2024-09-13T05:14:06.609926+0000","last_undegraded":"2024-09-13T05:14:06.609926+0000","last_fullsized":"2024-09-13T05:14:06.609926+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096036500000000003,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":55,"num_read":2051,"num_read_kb":3594,"num_write":735,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":1243867,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":219,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.115026+0000","last_change":"2024-09-13T05:10:01.384329+0000","last_active":"2024-09-13T05:13:58.115026+0000","last_peered":"2024-09-13T05:13:58.115026+0000","last_clean":"2024-09-13T05:13:58.115026+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:13:58.115026+0000","last_undegraded":"2024-09-13T05:13:58.115026+0000","last_fullsized":"2024-09-13T05:13:58.115026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:14:08.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"198'1016","reported_seq":5307,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.750988+0000","last_change":"2024-09-13T05:13:46.668732+0000","last_active":"2024-09-13T05:13:57.750988+0000","last_peered":"2024-09-13T05:13:57.750988+0000","last_clean":"2024-09-13T05:13:57.750988+0000","last_became_active":"2024-09-13T05:13:46.663849+0000","last_became_peered":"2024-09-13T05:13:46.663849+0000","last_unstale":"2024-09-13T05:13:57.750988+0000","last_undegraded":"2024-09-13T05:13:57.750988+0000","last_fullsized":"2024-09-13T05:13:57.750988+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1016,"log_dups_size":0,"ondisk_log_size":1016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:36:07.224847+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0078035550000000002,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":6441,"num_read_kb":19916,"num_write":1291,"num_write_kb":12451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":408,"num_bytes_recovered":8416446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.939824+0000","last_change":"2024-09-13T05:12:03.636279+0000","last_active":"2024-09-13T05:13:58.939824+0000","last_peered":"2024-09-13T05:13:58.939824+0000","last_clean":"2024-09-13T05:13:58.939824+0000","last_became_active":"2024-09-13T05:12:03.635929+0000","last_became_peered":"2024-09-13T05:12:03.635929+0000","last_unstale":"2024-09-13T05:13:58.939824+0000","last_undegraded":"2024-09-13T05:13:58.939824+0000","last_fullsized":"2024-09-13T05:13:58.939824+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:58:02.386056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"200'711","reported_seq":3664,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.864873+0000","last_change":"2024-09-13T05:13:35.815133+0000","last_active":"2024-09-13T05:13:57.864873+0000","last_peered":"2024-09-13T05:13:57.864873+0000","last_clean":"2024-09-13T05:13:57.864873+0000","last_became_active":"2024-09-13T05:13:18.651382+0000","last_became_peered":"2024-09-13T05:13:18.651382+0000","last_unstale":"2024-09-13T05:13:57.864873+0000","last_undegraded":"2024-09-13T05:13:57.864873+0000","last_fullsized":"2024-09-13T05:13:57.864873+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:44:13.973468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000842029,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":50,"num_read":5402,"num_read_kb":12408,"num_write":632,"num_write_kb":8370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":367,"num_bytes_recovered":3415864,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":221,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975452+0000","last_change":"2024-09-13T05:10:01.392404+0000","last_active":"2024-09-13T05:13:56.975452+0000","last_peered":"2024-09-13T05:13:56.975452+0000","last_clean":"2024-09-13T05:13:56.975452+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:13:56.975452+0000","last_undegraded":"2024-09-13T05:13:56.975452+0000","last_fullsized":"2024-09-13T05:13:56.975452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:34.914444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":452,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250550+0000","last_change":"2024-09-13T05:13:41.857857+0000","last_active":"2024-09-13T05:13:58.250550+0000","last_peered":"2024-09-13T05:13:58.250550+0000","last_clean":"2024-09-13T05:13:58.250550+0000","last_became_active":"2024-09-13T05:13:41.857228+0000","last_became_peered":"2024-09-13T05:13:41.857228+0000","last_unstale":"2024-09-13T05:13:58.250550+0000","last_undegraded":"2024-09-13T05:13:58.250550+0000","last_fullsized":"2024-09-13T05:13:58.250550+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:52.295894+0000","last_clean_scrub_stamp":"2024-09-13T05:09:52.295894+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:29:01.675153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"198'658","reported_seq":17226,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820161+0000","last_change":"2024-09-13T05:13:35.799434+0000","last_active":"2024-09-13T05:13:57.820161+0000","last_peered":"2024-09-13T05:13:57.820161+0000","last_clean":"2024-09-13T05:13:57.820161+0000","last_became_active":"2024-09-13T05:12:12.653214+0000","last_became_peered":"2024-09-13T05:12:12.653214+0000","last_unstale":"2024-09-13T05:13:57.820161+0000","last_undegraded":"2024-09-13T05:13:57.820161+0000","last_fullsized":"2024-09-13T05:13:57.820161+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:24:11.574280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090748800000000002,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":57,"num_read":16644,"num_read_kb":16716,"num_write":498,"num_write_kb":27916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":2876772,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"201'901","reported_seq":9211,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.976432+0000","last_change":"2024-09-13T05:13:35.786479+0000","last_active":"2024-09-13T05:13:56.976432+0000","last_peered":"2024-09-13T05:13:56.976432+0000","last_clean":"2024-09-13T05:13:56.976432+0000","last_became_active":"2024-09-13T05:12:41.912780+0000","last_became_peered":"2024-09-13T05:12:41.912780+0000","last_unstale":"2024-09-13T05:13:56.976432+0000","last_undegraded":"2024-09-13T05:13:56.976432+0000","last_fullsized":"2024-09-13T05:13:56.976432+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:02:12.915400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018089219999999999,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":11722,"num_read_kb":25826,"num_write":890,"num_write_kb":20361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":5657687,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"201'835","reported_seq":11180,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820239+0000","last_change":"2024-09-13T05:13:35.802137+0000","last_active":"2024-09-13T05:13:57.820239+0000","last_peered":"2024-09-13T05:13:57.820239+0000","last_clean":"2024-09-13T05:13:57.820239+0000","last_became_active":"2024-09-13T05:10:47.939220+0000","last_became_peered":"2024-09-13T05:10:47.939220+0000","last_unstale":"2024-09-13T05:13:57.820239+0000","last_undegraded":"2024-09-13T05:13:57.820239+0000","last_fullsized":"2024-09-13T05:13:57.820239+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:59.693041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032813690000000001,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":52,"num_read":11243,"num_read_kb":19806,"num_write":773,"num_write_kb":9910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":59,"num_bytes_recovered":6203954,"num_keys_recovered":18,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"199'703","reported_seq":8005,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.820257+0000","last_change":"2024-09-13T05:13:44.661351+0000","last_active":"2024-09-13T05:13:57.820257+0000","last_peered":"2024-09-13T05:13:57.820257+0000","last_clean":"2024-09-13T05:13:57.820257+0000","last_became_active":"2024-09-13T05:13:44.659181+0000","last_became_peered":"2024-09-13T05:13:44.659181+0000","last_unstale":"2024-09-13T05:13:57.820257+0000","last_undegraded":"2024-09-13T05:13:57.820257+0000","last_fullsized":"2024-09-13T05:13:57.820257+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:29:22.812081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001538939,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":7215,"num_read_kb":12852,"num_write":549,"num_write_kb":8612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":652,"num_bytes_recovered":7231372,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"200'703","reported_seq":2681,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:56.975613+0000","last_change":"2024-09-13T05:13:35.787823+0000","last_active":"2024-09-13T05:13:56.975613+0000","last_peered":"2024-09-13T05:13:56.975613+0000","last_clean":"2024-09-13T05:13:56.975613+0000","last_became_active":"2024-09-13T05:13:31.750969+0000","last_became_peered":"2024-09-13T05:13:31.750969+0000","last_unstale":"2024-09-13T05:13:56.975613+0000","last_undegraded":"2024-09-13T05:13:56.975613+0000","last_fullsized":"2024-09-13T05:13:56.975613+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:18:46.179667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026184060000000002,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":45,"num_read":2965,"num_read_kb":14716,"num_write":786,"num_write_kb":19816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"201'861","reported_seq":4748,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.251070+0000","last_change":"2024-09-13T05:13:35.793375+0000","last_active":"2024-09-13T05:13:58.251070+0000","last_peered":"2024-09-13T05:13:58.251070+0000","last_clean":"2024-09-13T05:13:58.251070+0000","last_became_active":"2024-09-13T05:11:23.616962+0000","last_became_peered":"2024-09-13T05:11:23.616962+0000","last_unstale":"2024-09-13T05:13:58.251070+0000","last_undegraded":"2024-09-13T05:13:58.251070+0000","last_fullsized":"2024-09-13T05:13:58.251070+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:19.035337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024761649999999998,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":5259,"num_read_kb":15611,"num_write":930,"num_write_kb":9177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":12781016,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"201'1180","reported_seq":9596,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250997+0000","last_change":"2024-09-13T05:13:35.793562+0000","last_active":"2024-09-13T05:13:58.250997+0000","last_peered":"2024-09-13T05:13:58.250997+0000","last_clean":"2024-09-13T05:13:58.250997+0000","last_became_active":"2024-09-13T05:12:46.655973+0000","last_became_peered":"2024-09-13T05:12:46.655973+0000","last_unstale":"2024-09-13T05:13:58.250997+0000","last_undegraded":"2024-09-13T05:13:58.250997+0000","last_fullsized":"2024-09-13T05:13:58.250997+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1180,"log_dups_size":0,"ondisk_log_size":1180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:05:32.995650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022750969999999998,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":57,"num_read":10231,"num_read_kb":11540,"num_write":1521,"num_write_kb":6908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":612,"num_bytes_recovered":16479322,"num_keys_recovered":78,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"198'950","reported_seq":7301,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250601+0000","last_change":"2024-09-13T05:13:35.793996+0000","last_active":"2024-09-13T05:13:58.250601+0000","last_peered":"2024-09-13T05:13:58.250601+0000","last_clean":"2024-09-13T05:13:58.250601+0000","last_became_active":"2024-09-13T05:12:45.651313+0000","last_became_peered":"2024-09-13T05:12:45.651313+0000","last_unstale":"2024-09-13T05:13:58.250601+0000","last_undegraded":"2024-09-13T05:13:58.250601+0000","last_fullsized":"2024-09-13T05:13:58.250601+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":950,"log_dups_size":0,"ondisk_log_size":950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:07:00.462818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026155729999999999,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":7680,"num_read_kb":14250,"num_write":1094,"num_write_kb":7822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":7824116,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"201'725","reported_seq":4200,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.864831+0000","last_change":"2024-09-13T05:13:42.869654+0000","last_active":"2024-09-13T05:13:57.864831+0000","last_peered":"2024-09-13T05:13:57.864831+0000","last_clean":"2024-09-13T05:13:57.864831+0000","last_became_active":"2024-09-13T05:13:42.865327+0000","last_became_peered":"2024-09-13T05:13:42.865327+0000","last_unstale":"2024-09-13T05:13:57.864831+0000","last_undegraded":"2024-09-13T05:13:57.864831+0000","last_fullsized":"2024-09-13T05:13:57.864831+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:55.609658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070392800000000004,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":3644,"num_read_kb":16917,"num_write":678,"num_write_kb":24247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":802,"num_bytes_recovered":33560838,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"201'537","reported_seq":9641,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250723+0000","last_change":"2024-09-13T05:13:35.792570+0000","last_active":"2024-09-13T05:13:58.250723+0000","last_peered":"2024-09-13T05:13:58.250723+0000","last_clean":"2024-09-13T05:13:58.250723+0000","last_became_active":"2024-09-13T05:12:42.936456+0000","last_became_peered":"2024-09-13T05:12:42.936456+0000","last_unstale":"2024-09-13T05:13:58.250723+0000","last_undegraded":"2024-09-13T05:13:58.250723+0000","last_fullsized":"2024-09-13T05:13:58.250723+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:23.680853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018319619999999999,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":8115,"num_read_kb":13498,"num_write":403,"num_write_kb":21128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":380,"num_bytes_recovered":20462375,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"199'1090","reported_seq":6462,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.750976+0000","last_change":"2024-09-13T05:13:46.671045+0000","last_active":"2024-09-13T05:13:57.750976+0000","last_peered":"2024-09-13T05:13:57.750976+0000","last_clean":"2024-09-13T05:13:57.750976+0000","last_became_active":"2024-09-13T05:13:46.665575+0000","last_became_peered":"2024-09-13T05:13:46.665575+0000","last_unstale":"2024-09-13T05:13:57.750976+0000","last_undegraded":"2024-09-13T05:13:57.750976+0000","last_fullsized":"2024-09-13T05:13:57.750976+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1090,"log_dups_size":0,"ondisk_log_size":1090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:12:46.891233+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.006060307,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":9137,"num_read_kb":27013,"num_write":1266,"num_write_kb":8578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":633324,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"201'1349","reported_seq":5470,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.250971+0000","last_change":"2024-09-13T05:13:35.791602+0000","last_active":"2024-09-13T05:13:58.250971+0000","last_peered":"2024-09-13T05:13:58.250971+0000","last_clean":"2024-09-13T05:13:58.250971+0000","last_became_active":"2024-09-13T05:12:48.638127+0000","last_became_peered":"2024-09-13T05:12:48.638127+0000","last_unstale":"2024-09-13T05:13:58.250971+0000","last_undegraded":"2024-09-13T05:13:58.250971+0000","last_fullsized":"2024-09-13T05:13:58.250971+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1349,"log_dups_size":0,"ondisk_log_size":1349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:33:48.012842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001070477,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":7844,"num_read_kb":55094,"num_write":1803,"num_write_kb":40168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":20884522,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":1622,"num_object_clones":0,"num_object_copies":3244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1622,"num_whiteouts":1618,"num_read":258414,"num_read_kb":631830,"num_write":28490,"num_write_kb":532665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11025,"num_bytes_recovered":280109913,"num_keys_recovered":906,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3756,"internal_metadata":0},"log_size":27122,"ondisk_log_size":27122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106524,"kb_used_data":3216,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94265316,"statfs":{"total":96636764160,"available":96527683584,"internally_reserved":0,"allocated":3293184,"data_stored":1898733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":105773515},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:13 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.0009999999999999}]},{"osd":1,"last update":"Fri Sep 13 05:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.82999999999999996,"15min":0.82599999999999996},"min":{"1min":0.63400000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1419999999999999,"5min":1.238,"15min":1.238},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.85399999999999998,"15min":0.81200000000000006},"min":{"1min":0.61499999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.196,"5min":1.982,"15min":1.982},"last":0.82699999999999996}]},{"osd":2,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.84899999999999998,"15min":0.85399999999999998},"min":{"1min":0.67600000000000005,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1519999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.056,"5min":0.90200000000000002,"15min":0.81499999999999995},"min":{"1min":0.94399999999999995,"5min":0.433,"15min":0.433},"max":{"1min":1.262,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.1259999999999999}]},{"osd":3,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.98199999999999998,"15min":0.90500000000000003},"min":{"1min":0.54000000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2749999999999999,"5min":12.663,"15min":12.663},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.90000000000000002,"15min":0.90400000000000003},"min":{"1min":0.73199999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1799999999999999,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.1719999999999999}]},{"osd":4,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81100000000000005,"15min":0.77900000000000003},"min":{"1min":0.58699999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.365,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.91000000000000003,"15min":0.92500000000000004},"min":{"1min":0.48999999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.216,"5min":2.02,"15min":2.02},"last":0.75}]},{"osd":5,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.95799999999999996,"15min":0.95199999999999996},"min":{"1min":0.63900000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.246,"5min":1.655,"15min":1.655},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.96399999999999997,"15min":0.95099999999999996},"min":{"1min":0.66100000000000003,"5min":0.499,"15min":0.499},"max":{"1min":1.306,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.95799999999999996}]},{"osd":6,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93300000000000005,"15min":0.91900000000000004},"min":{"1min":0.76200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.381,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.05},{"interface":"front","average":{"1min":1.002,"5min":1.042,"15min":1.038},"min":{"1min":0.76900000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3240000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.80500000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59992,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311848,"statfs":{"total":96636764160,"available":96575332352,"internally_reserved":0,"allocated":2699264,"data_stored":1308365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58718663},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.79100000000000004}]},{"osd":1,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.85399999999999998,"15min":0.873},"min":{"1min":0.51900000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.754},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82399999999999995,"15min":0.85499999999999998},"min":{"1min":0.46500000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.3009999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.90000000000000002}]},{"osd":2,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.79500000000000004,"15min":0.77600000000000002},"min":{"1min":0.58299999999999996,"5min":0.312,"15min":0.312},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.93799999999999994,"15min":0.96599999999999997},"min":{"1min":0.42499999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.383,"5min":1.49,"15min":1.49},"last":0.85699999999999998}]},{"osd":3,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90700000000000003,"15min":0.93799999999999994},"min":{"1min":0.65800000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.5489999999999999,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.93000000000000005,"15min":0.93500000000000005},"min":{"1min":0.80400000000000005,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.624}]},{"osd":4,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.93899999999999995,"15min":0.95999999999999996},"min":{"1min":0.47399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.456,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.95299999999999996,"15min":0.98699999999999999},"min":{"1min":0.55500000000000005,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.274,"5min":2.056,"15min":2.056},"last":0.82799999999999996}]},{"osd":5,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.68300000000000005,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.877},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.0800000000000001,"15min":1.0980000000000001},"min":{"1min":0.69899999999999995,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.04}]},{"osd":7,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0620000000000001,"15min":1.101},"min":{"1min":0.748,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3120000000000001,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.0740000000000001,"15min":1.0820000000000001},"min":{"1min":0.82099999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.085}]}]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82148,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":79486,"kb_avail":94289692,"statfs":{"total":96636764160,"available":96552644608,"internally_reserved":0,"allocated":2703360,"data_stored":1308384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":81394118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.623}]},{"osd":1,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.83599999999999997,"15min":0.872},"min":{"1min":0.53700000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1619999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.089},{"interface":"front","average":{"1min":0.873,"5min":0.86399999999999999,"15min":0.90900000000000003},"min":{"1min":0.61299999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.145,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.91700000000000004}]},{"osd":2,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.81699999999999995,"15min":0.84499999999999997},"min":{"1min":0.40600000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1519999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.90000000000000002,"15min":0.89800000000000002},"min":{"1min":0.59999999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.85099999999999998}]},{"osd":3,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.85499999999999998,"15min":0.91100000000000003},"min":{"1min":0.58299999999999996,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1180000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.93200000000000005,"15min":1.0009999999999999},"min":{"1min":0.64900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.294,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.96399999999999997}]},{"osd":4,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.878,"15min":0.94499999999999995},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1830000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.016,"15min":1.0920000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.333,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.88300000000000001}]},{"osd":6,"last update":"Fri Sep 13 05:13:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.94099999999999995,"15min":0.95399999999999996},"min":{"1min":0.58199999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4950000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.012},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.99199999999999999,"15min":1.034},"min":{"1min":0.45600000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.236,"5min":1.528,"15min":1.528},"last":0.81200000000000006}]},{"osd":7,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0620000000000001,"15min":1.1639999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.244,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.101,"15min":1.1559999999999999},"min":{"1min":0.47399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.4590000000000001,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.141}]}]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37856,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94333984,"statfs":{"total":96636764160,"available":96597999616,"internally_reserved":0,"allocated":2703360,"data_stored":1308384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.95199999999999996}]},{"osd":1,"last update":"Fri Sep 13 05:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.748,"15min":0.752},"min":{"1min":0.41499999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.27,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.82699999999999996,"15min":0.90500000000000003},"min":{"1min":0.59099999999999997,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.73899999999999999}]},{"osd":2,"last update":"Fri Sep 13 05:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.91300000000000003,"15min":0.97099999999999997},"min":{"1min":0.51400000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.3109999999999999,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":1.1759999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.98599999999999999,"15min":1.0649999999999999},"min":{"1min":0.55600000000000005,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1890000000000001,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.92700000000000005}]},{"osd":3,"last update":"Fri Sep 13 05:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.90200000000000002,"15min":0.91100000000000003},"min":{"1min":0.628,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1279999999999999,"5min":4.0609999999999999,"15min":4.0609999999999999},"last":1.135},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.86799999999999999,"15min":0.90800000000000003},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1739999999999999,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.99399999999999999}]},{"osd":5,"last update":"Fri Sep 13 05:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.86199999999999999,"15min":0.88400000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.181,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.94199999999999995,"5min":1.016,"15min":1.133},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4179999999999999,"5min":3.871,"15min":3.871},"last":1.0389999999999999}]},{"osd":6,"last update":"Fri Sep 13 05:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.03,"15min":1.1220000000000001},"min":{"1min":0.57299999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4890000000000001,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.93999999999999995,"15min":0.95599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3240000000000001,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.097}]},{"osd":7,"last update":"Fri Sep 13 05:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.077,"15min":1.145},"min":{"1min":0.67700000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4670000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.077,"15min":1.099},"min":{"1min":0.70599999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.5660000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.151}]}]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64100,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":61438,"kb_avail":94307740,"statfs":{"total":96636764160,"available":96571125760,"internally_reserved":0,"allocated":2699264,"data_stored":1308365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":62912968},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.50900000000000001}]},{"osd":1,"last update":"Fri Sep 13 05:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.65300000000000002,"15min":0.66100000000000003},"min":{"1min":0.42999999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.095,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.66900000000000004,"15min":0.71399999999999997},"min":{"1min":0.43099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.63300000000000001}]},{"osd":2,"last update":"Fri Sep 13 05:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71499999999999997,"15min":0.73599999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1779999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.78400000000000003,"15min":0.83599999999999997},"min":{"1min":0.52600000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.145,"5min":1.573,"15min":1.573},"last":0.67700000000000005}]},{"osd":4,"last update":"Fri Sep 13 05:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.84699999999999998,"15min":0.89300000000000002},"min":{"1min":0.44500000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.2589999999999999,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.89800000000000002,"15min":0.92900000000000005},"min":{"1min":0.72199999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.27,"5min":1.764,"15min":1.764},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Sep 13 05:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.91900000000000004,"15min":0.995},"min":{"1min":0.69799999999999995,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.153,"5min":2.157,"15min":2.157},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.91500000000000004,"15min":0.97899999999999998},"min":{"1min":0.501,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.552,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.0580000000000001}]},{"osd":6,"last update":"Fri Sep 13 05:14:03 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.94499999999999995,"15min":0.98099999999999998},"min":{"1min":0.65400000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6559999999999999,"5min":1.976,"15min":1.976},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.97999999999999998,"15min":1.0760000000000001},"min":{"1min":0.625,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.141,"5min":2.012,"15min":2.012},"last":0.82099999999999995}]},{"osd":7,"last update":"Fri Sep 13 05:14:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.012,"15min":1.0720000000000001},"min":{"1min":0.59699999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.6319999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.0580000000000001,"15min":1.1000000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.673,"5min":1.875,"15min":1.875},"last":1.1919999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65756,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306084,"statfs":{"total":96636764160,"available":96569430016,"internally_reserved":0,"allocated":2699264,"data_stored":1308365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.55800000000000005}]},{"osd":1,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64800000000000002,"15min":0.66800000000000004},"min":{"1min":0.40200000000000002,"5min":0.246,"15min":0.246},"max":{"1min":1.081,"5min":1.554,"15min":1.554},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64200000000000002,"15min":0.65400000000000003},"min":{"1min":0.40100000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0780000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.79400000000000004}]},{"osd":3,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67000000000000004,"15min":0.624},"min":{"1min":0.38300000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.002,"5min":6.6070000000000002,"15min":6.6070000000000002},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69499999999999995,"15min":0.66700000000000004},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.014,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.82899999999999996}]},{"osd":4,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.82299999999999995,"15min":0.78300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.464,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.343},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.90700000000000003,"15min":0.89800000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":0.99199999999999999}]},{"osd":5,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.878,"15min":0.89400000000000002},"min":{"1min":0.48999999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.1099999999999999,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.89700000000000002,"15min":0.872},"min":{"1min":0.52400000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3500000000000001,"5min":1.51,"15min":1.51},"last":1.2909999999999999}]},{"osd":6,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90300000000000002,"15min":0.879},"min":{"1min":0.54200000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.381},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94699999999999995,"15min":0.94799999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3300000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.2490000000000001}]},{"osd":7,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0109999999999999,"15min":1.0289999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3680000000000001,"5min":1.867,"15min":1.867},"last":1.417},{"interface":"front","average":{"1min":1.038,"5min":0.97499999999999998,"15min":0.97599999999999998},"min":{"1min":0.52000000000000002,"5min":0.496,"15min":0.496},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":1.0669999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60000,"kb_used_data":2644,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311840,"statfs":{"total":96636764160,"available":96575324160,"internally_reserved":0,"allocated":2707456,"data_stored":1308403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:13:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.59299999999999997}]},{"osd":2,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.66400000000000003,"15min":0.61599999999999999},"min":{"1min":0.39400000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.98899999999999999,"5min":5.952,"15min":5.952},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66300000000000003,"15min":0.68999999999999995},"min":{"1min":0.45900000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86499999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.62}]},{"osd":3,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72699999999999998,"15min":0.76700000000000002},"min":{"1min":0.42099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.127,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71399999999999997,"15min":0.747},"min":{"1min":0.47399999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.026,"5min":1.887,"15min":1.887},"last":0.93899999999999995}]},{"osd":4,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.86899999999999999,"15min":0.91400000000000003},"min":{"1min":0.66400000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0329999999999999,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":0.92200000000000004,"15min":0.94399999999999995},"min":{"1min":0.78700000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.4750000000000001,"5min":1.724,"15min":1.724},"last":0.88400000000000001}]},{"osd":5,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.89700000000000002,"15min":0.92400000000000004},"min":{"1min":0.69799999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.0609999999999999,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.76800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.96799999999999997}]},{"osd":6,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.94999999999999996,"15min":1},"min":{"1min":0.67500000000000004,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.4239999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.109,"5min":1.0029999999999999,"15min":1.0149999999999999},"min":{"1min":0.74399999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.625,"5min":1.873,"15min":1.873},"last":1.2070000000000001}]},{"osd":7,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.996,"15min":1.018},"min":{"1min":0.80900000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.046,"15min":1.0409999999999999},"min":{"1min":0.91700000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.401,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.2450000000000001}]}]},{"osd":0,"up_from":124,"seq":532575944730,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47328,"kb_used_data":3216,"kb_used_omap":7,"kb_used_meta":44088,"kb_avail":94324512,"statfs":{"total":96636764160,"available":96588300288,"internally_reserved":0,"allocated":3293184,"data_stored":1898733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7666,"internal_metadata":45146638},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.66100000000000003}]},{"osd":2,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.57999999999999996}]},{"osd":3,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.72199999999999998}]},{"osd":4,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":3.2330000000000001,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":0.93500000000000005}]},{"osd":5,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.98099999999999998}]},{"osd":6,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.88},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.1020000000000001}]},{"osd":7,"last update":"Fri Sep 13 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":1.1679999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3756,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:14:10.080 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.080 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.081 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.081 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.081 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.081 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.081 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.081 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.082 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.082 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.082 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.082 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.082 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T05:09:58.346979+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=9, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.082 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.082 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T05:09:58.346979+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=9, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.083 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.083 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T05:09:58.346979+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=9, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.083 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T05:09:58.346979+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=9, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.083 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.083 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.084 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T05:09:58.346979+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=9, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.084 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.084 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T05:09:58.346979+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=9, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.084 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.084 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T05:09:58.346979+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=9, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.084 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.084 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T05:09:58.346979+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=9, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.084 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T05:09:52.295894+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=9, tm_sec=52, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.085 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.085 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.085 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.085 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.085 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.085 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.085 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.085 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.085 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.085 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.086 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.086 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:10.086 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T05:14:30.087 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:14:31.236 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:14:31.242 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:14:31.259 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":356,"stamp":"2024-09-13T05:14:30.241668+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":1626,"num_object_clones":0,"num_object_copies":3252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1626,"num_whiteouts":1618,"num_read":258530,"num_read_kb":631930,"num_write":28651,"num_write_kb":535083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11035,"num_bytes_recovered":282471423,"num_keys_recovered":906,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28514,"ondisk_log_size":28514,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":474488,"kb_used_data":22264,"kb_used_omap":18,"kb_used_meta":452141,"kb_avail":754500232,"statfs":{"total":773094113280,"available":772608237568,"internally_reserved":0,"allocated":22798336,"data_stored":11647732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18816,"internal_metadata":462993024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004032"},"pg_stats":[{"pgid":"3.1f","version":"223'738","reported_seq":3906,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:13.604631+0000","last_change":"2024-09-13T05:14:13.604888+0000","last_active":"2024-09-13T05:14:13.604631+0000","last_peered":"2024-09-13T05:14:13.604631+0000","last_clean":"2024-09-13T05:14:13.604631+0000","last_became_active":"2024-09-13T05:13:41.857384+0000","last_became_peered":"2024-09-13T05:13:41.857384+0000","last_unstale":"2024-09-13T05:14:13.604631+0000","last_undegraded":"2024-09-13T05:14:13.604631+0000","last_fullsized":"2024-09-13T05:14:13.604631+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'738","last_scrub_stamp":"2024-09-13T05:14:13.604577+0000","last_deep_scrub":"223'738","last_deep_scrub_stamp":"2024-09-13T05:14:13.604577+0000","last_clean_scrub_stamp":"2024-09-13T05:14:13.604577+0000","objects_scrubbed":41,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:17:31.646997+0000","scrub_duration":0.044701229000000002,"objects_trimmed":0,"snaptrim_duration":0.0024323220000000002,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":4120,"num_read_kb":8764,"num_write":717,"num_write_kb":5986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":222,"num_bytes_recovered":297202,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"223'689","reported_seq":10912,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:17.986168+0000","last_change":"2024-09-13T05:14:17.986326+0000","last_active":"2024-09-13T05:14:17.986168+0000","last_peered":"2024-09-13T05:14:17.986168+0000","last_clean":"2024-09-13T05:14:17.986168+0000","last_became_active":"2024-09-13T05:13:17.865448+0000","last_became_peered":"2024-09-13T05:13:17.865448+0000","last_unstale":"2024-09-13T05:14:17.986168+0000","last_undegraded":"2024-09-13T05:14:17.986168+0000","last_fullsized":"2024-09-13T05:14:17.986168+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'689","last_scrub_stamp":"2024-09-13T05:14:17.986123+0000","last_deep_scrub":"223'689","last_deep_scrub_stamp":"2024-09-13T05:14:17.986123+0000","last_clean_scrub_stamp":"2024-09-13T05:14:17.986123+0000","objects_scrubbed":51,"log_size":689,"log_dups_size":0,"ondisk_log_size":689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:16:57.669189+0000","scrub_duration":0.056225597000000002,"objects_trimmed":0,"snaptrim_duration":0.001429893,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":51,"num_read":10597,"num_read_kb":9513,"num_write":519,"num_write_kb":4499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":4028965,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"223'859","reported_seq":4574,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:07.693432+0000","last_change":"2024-09-13T05:14:07.693640+0000","last_active":"2024-09-13T05:14:07.693432+0000","last_peered":"2024-09-13T05:14:07.693432+0000","last_clean":"2024-09-13T05:14:07.693432+0000","last_became_active":"2024-09-13T05:13:43.661570+0000","last_became_peered":"2024-09-13T05:13:43.661570+0000","last_unstale":"2024-09-13T05:14:07.693432+0000","last_undegraded":"2024-09-13T05:14:07.693432+0000","last_fullsized":"2024-09-13T05:14:07.693432+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'859","last_scrub_stamp":"2024-09-13T05:14:07.693381+0000","last_deep_scrub":"223'859","last_deep_scrub_stamp":"2024-09-13T05:14:07.693381+0000","last_clean_scrub_stamp":"2024-09-13T05:14:07.693381+0000","objects_scrubbed":52,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:23:56.109192+0000","scrub_duration":0.061720059000000001,"objects_trimmed":0,"snaptrim_duration":0.0025226720000000001,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":4533,"num_read_kb":14391,"num_write":805,"num_write_kb":18480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":591,"num_bytes_recovered":7610600,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"201'977","reported_seq":6577,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.981918+0000","last_change":"2024-09-13T05:13:35.786861+0000","last_active":"2024-09-13T05:13:57.981918+0000","last_peered":"2024-09-13T05:13:57.981918+0000","last_clean":"2024-09-13T05:13:57.981918+0000","last_became_active":"2024-09-13T05:13:31.750484+0000","last_became_peered":"2024-09-13T05:13:31.750484+0000","last_unstale":"2024-09-13T05:13:57.981918+0000","last_undegraded":"2024-09-13T05:13:57.981918+0000","last_fullsized":"2024-09-13T05:13:57.981918+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":977,"log_dups_size":0,"ondisk_log_size":977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020042060000000001,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":42,"num_read":7151,"num_read_kb":23958,"num_write":1100,"num_write_kb":15871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":371,"num_bytes_recovered":9523896,"num_keys_recovered":208,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"223'934","reported_seq":4765,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:09.740726+0000","last_change":"2024-09-13T05:14:09.740870+0000","last_active":"2024-09-13T05:14:09.740726+0000","last_peered":"2024-09-13T05:14:09.740726+0000","last_clean":"2024-09-13T05:14:09.740726+0000","last_became_active":"2024-09-13T05:13:45.664962+0000","last_became_peered":"2024-09-13T05:13:45.664962+0000","last_unstale":"2024-09-13T05:14:09.740726+0000","last_undegraded":"2024-09-13T05:14:09.740726+0000","last_fullsized":"2024-09-13T05:14:09.740726+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'934","last_scrub_stamp":"2024-09-13T05:14:09.740704+0000","last_deep_scrub":"223'934","last_deep_scrub_stamp":"2024-09-13T05:14:09.740704+0000","last_clean_scrub_stamp":"2024-09-13T05:14:09.740704+0000","objects_scrubbed":57,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:28:06.244212+0000","scrub_duration":0.068483028000000001,"objects_trimmed":0,"snaptrim_duration":0.0019293209999999999,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":57,"num_read":5360,"num_read_kb":16535,"num_write":962,"num_write_kb":43436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":614,"num_bytes_recovered":12868860,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"223'2036","reported_seq":21190,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:13.077917+0000","last_change":"2024-09-13T05:14:13.078132+0000","last_active":"2024-09-13T05:14:13.077917+0000","last_peered":"2024-09-13T05:14:13.077917+0000","last_clean":"2024-09-13T05:14:13.077917+0000","last_became_active":"2024-09-13T05:12:46.652272+0000","last_became_peered":"2024-09-13T05:12:46.652272+0000","last_unstale":"2024-09-13T05:14:13.077917+0000","last_undegraded":"2024-09-13T05:14:13.077917+0000","last_fullsized":"2024-09-13T05:14:13.077917+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'2036","last_scrub_stamp":"2024-09-13T05:14:13.077884+0000","last_deep_scrub":"223'2036","last_deep_scrub_stamp":"2024-09-13T05:14:13.077884+0000","last_clean_scrub_stamp":"2024-09-13T05:14:13.077884+0000","objects_scrubbed":49,"log_size":2036,"log_dups_size":0,"ondisk_log_size":2036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:27:23.234042+0000","scrub_duration":0.068612376000000003,"objects_trimmed":0,"snaptrim_duration":0.0028053240000000001,"stat_sum":{"num_bytes":19,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":48,"num_read":27228,"num_read_kb":30157,"num_write":3057,"num_write_kb":13192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":478,"num_bytes_recovered":9711059,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"223'986","reported_seq":12765,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:08.869161+0000","last_change":"2024-09-13T05:14:08.869263+0000","last_active":"2024-09-13T05:14:08.869161+0000","last_peered":"2024-09-13T05:14:08.869161+0000","last_clean":"2024-09-13T05:14:08.869161+0000","last_became_active":"2024-09-13T05:12:09.626312+0000","last_became_peered":"2024-09-13T05:12:09.626312+0000","last_unstale":"2024-09-13T05:14:08.869161+0000","last_undegraded":"2024-09-13T05:14:08.869161+0000","last_fullsized":"2024-09-13T05:14:08.869161+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'986","last_scrub_stamp":"2024-09-13T05:14:08.869141+0000","last_deep_scrub":"223'986","last_deep_scrub_stamp":"2024-09-13T05:14:08.869141+0000","last_clean_scrub_stamp":"2024-09-13T05:14:08.869141+0000","objects_scrubbed":52,"log_size":986,"log_dups_size":0,"ondisk_log_size":986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:11:09.817990+0000","scrub_duration":0.055005330999999998,"objects_trimmed":0,"snaptrim_duration":0.000937213,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":14225,"num_read_kb":23139,"num_write":1021,"num_write_kb":7466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":3365202,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"223'765","reported_seq":6021,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:19.014652+0000","last_change":"2024-09-13T05:14:19.014817+0000","last_active":"2024-09-13T05:14:19.014652+0000","last_peered":"2024-09-13T05:14:19.014652+0000","last_clean":"2024-09-13T05:14:19.014652+0000","last_became_active":"2024-09-13T05:13:45.668572+0000","last_became_peered":"2024-09-13T05:13:45.668572+0000","last_unstale":"2024-09-13T05:14:19.014652+0000","last_undegraded":"2024-09-13T05:14:19.014652+0000","last_fullsized":"2024-09-13T05:14:19.014652+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'765","last_scrub_stamp":"2024-09-13T05:14:19.014603+0000","last_deep_scrub":"223'765","last_deep_scrub_stamp":"2024-09-13T05:14:19.014603+0000","last_clean_scrub_stamp":"2024-09-13T05:14:19.014603+0000","objects_scrubbed":54,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:56:23.751827+0000","scrub_duration":0.056466835,"objects_trimmed":0,"snaptrim_duration":0.000878607,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":54,"num_read":4887,"num_read_kb":27058,"num_write":681,"num_write_kb":24614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":417,"num_bytes_recovered":11847558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"223'779","reported_seq":4651,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:15.584478+0000","last_change":"2024-09-13T05:14:15.584618+0000","last_active":"2024-09-13T05:14:15.584478+0000","last_peered":"2024-09-13T05:14:15.584478+0000","last_clean":"2024-09-13T05:14:15.584478+0000","last_became_active":"2024-09-13T05:13:40.852807+0000","last_became_peered":"2024-09-13T05:13:40.852807+0000","last_unstale":"2024-09-13T05:14:15.584478+0000","last_undegraded":"2024-09-13T05:14:15.584478+0000","last_fullsized":"2024-09-13T05:14:15.584478+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'779","last_scrub_stamp":"2024-09-13T05:14:15.584457+0000","last_deep_scrub":"223'779","last_deep_scrub_stamp":"2024-09-13T05:14:15.584457+0000","last_clean_scrub_stamp":"2024-09-13T05:14:15.584457+0000","objects_scrubbed":58,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:14:36.022386+0000","scrub_duration":0.059938457000000001,"objects_trimmed":0,"snaptrim_duration":0.0031554529999999999,"stat_sum":{"num_bytes":0,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":58,"num_read":6742,"num_read_kb":11740,"num_write":569,"num_write_kb":4140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":212,"num_bytes_recovered":37802,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"223'603","reported_seq":9711,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:26.454775+0000","last_change":"2024-09-13T05:14:26.454985+0000","last_active":"2024-09-13T05:14:26.454775+0000","last_peered":"2024-09-13T05:14:26.454775+0000","last_clean":"2024-09-13T05:14:26.454775+0000","last_became_active":"2024-09-13T05:11:24.631079+0000","last_became_peered":"2024-09-13T05:11:24.631079+0000","last_unstale":"2024-09-13T05:14:26.454775+0000","last_undegraded":"2024-09-13T05:14:26.454775+0000","last_fullsized":"2024-09-13T05:14:26.454775+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'603","last_scrub_stamp":"2024-09-13T05:14:26.454745+0000","last_deep_scrub":"223'603","last_deep_scrub_stamp":"2024-09-13T05:14:26.454745+0000","last_clean_scrub_stamp":"2024-09-13T05:14:26.454745+0000","objects_scrubbed":41,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:52:34.270735+0000","scrub_duration":0.039290741999999997,"objects_trimmed":0,"snaptrim_duration":0.0023449740000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":9259,"num_read_kb":15708,"num_write":427,"num_write_kb":4479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":4743569,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"200'648","reported_seq":13519,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.940176+0000","last_change":"2024-09-13T05:13:35.792438+0000","last_active":"2024-09-13T05:13:58.940176+0000","last_peered":"2024-09-13T05:13:58.940176+0000","last_clean":"2024-09-13T05:13:58.940176+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:13:58.940176+0000","last_undegraded":"2024-09-13T05:13:58.940176+0000","last_fullsized":"2024-09-13T05:13:58.940176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001651455,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":49,"num_read":13660,"num_read_kb":13906,"num_write":593,"num_write_kb":23553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"223'642","reported_seq":8413,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:12.019313+0000","last_change":"2024-09-13T05:14:12.019493+0000","last_active":"2024-09-13T05:14:12.019313+0000","last_peered":"2024-09-13T05:14:12.019313+0000","last_clean":"2024-09-13T05:14:12.019313+0000","last_became_active":"2024-09-13T05:12:45.651071+0000","last_became_peered":"2024-09-13T05:12:45.651071+0000","last_unstale":"2024-09-13T05:14:12.019313+0000","last_undegraded":"2024-09-13T05:14:12.019313+0000","last_fullsized":"2024-09-13T05:14:12.019313+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'642","last_scrub_stamp":"2024-09-13T05:14:12.019281+0000","last_deep_scrub":"223'642","last_deep_scrub_stamp":"2024-09-13T05:14:12.019281+0000","last_clean_scrub_stamp":"2024-09-13T05:14:12.019281+0000","objects_scrubbed":48,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:41:25.191485+0000","scrub_duration":0.047093986999999997,"objects_trimmed":0,"snaptrim_duration":0.001813283,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":48,"num_read":7291,"num_read_kb":29056,"num_write":470,"num_write_kb":7007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":364,"num_bytes_recovered":7851183,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:17.041576+0000","last_change":"2024-09-13T05:14:17.041891+0000","last_active":"2024-09-13T05:14:17.041576+0000","last_peered":"2024-09-13T05:14:17.041576+0000","last_clean":"2024-09-13T05:14:17.041576+0000","last_became_active":"2024-09-13T05:13:14.650955+0000","last_became_peered":"2024-09-13T05:13:14.650955+0000","last_unstale":"2024-09-13T05:14:17.041576+0000","last_undegraded":"2024-09-13T05:14:17.041576+0000","last_fullsized":"2024-09-13T05:14:17.041576+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:14:17.041527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:14:17.041527+0000","last_clean_scrub_stamp":"2024-09-13T05:14:17.041527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:18:55.276964+0000","scrub_duration":0.0033014730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"223'777","reported_seq":9124,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:08.713435+0000","last_change":"2024-09-13T05:14:08.713592+0000","last_active":"2024-09-13T05:14:08.713435+0000","last_peered":"2024-09-13T05:14:08.713435+0000","last_clean":"2024-09-13T05:14:08.713435+0000","last_became_active":"2024-09-13T05:13:41.854863+0000","last_became_peered":"2024-09-13T05:13:41.854863+0000","last_unstale":"2024-09-13T05:14:08.713435+0000","last_undegraded":"2024-09-13T05:14:08.713435+0000","last_fullsized":"2024-09-13T05:14:08.713435+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'777","last_scrub_stamp":"2024-09-13T05:14:08.713411+0000","last_deep_scrub":"223'777","last_deep_scrub_stamp":"2024-09-13T05:14:08.713411+0000","last_clean_scrub_stamp":"2024-09-13T05:14:08.713411+0000","objects_scrubbed":49,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:55:48.828924+0000","scrub_duration":0.045022053999999999,"objects_trimmed":0,"snaptrim_duration":0.0013617600000000001,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":49,"num_read":8371,"num_read_kb":18309,"num_write":603,"num_write_kb":8603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":704,"num_bytes_recovered":23835437,"num_keys_recovered":90,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":155,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:13.799096+0000","last_change":"2024-09-13T05:14:13.799096+0000","last_active":"2024-09-13T05:14:13.799096+0000","last_peered":"2024-09-13T05:14:13.799096+0000","last_clean":"2024-09-13T05:14:13.799096+0000","last_became_active":"2024-09-13T05:13:14.651157+0000","last_became_peered":"2024-09-13T05:13:14.651157+0000","last_unstale":"2024-09-13T05:14:13.799096+0000","last_undegraded":"2024-09-13T05:14:13.799096+0000","last_fullsized":"2024-09-13T05:14:13.799096+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:14:13.798640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:14:13.798640+0000","last_clean_scrub_stamp":"2024-09-13T05:14:13.798640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:18:28.752060+0000","scrub_duration":0.0038287320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"223'653","reported_seq":6089,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:11.815937+0000","last_change":"2024-09-13T05:14:11.816061+0000","last_active":"2024-09-13T05:14:11.815937+0000","last_peered":"2024-09-13T05:14:11.815937+0000","last_clean":"2024-09-13T05:14:11.815937+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:14:11.815937+0000","last_undegraded":"2024-09-13T05:14:11.815937+0000","last_fullsized":"2024-09-13T05:14:11.815937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'653","last_scrub_stamp":"2024-09-13T05:14:11.815911+0000","last_deep_scrub":"223'653","last_deep_scrub_stamp":"2024-09-13T05:14:11.815911+0000","last_clean_scrub_stamp":"2024-09-13T05:14:11.815911+0000","objects_scrubbed":54,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:22:38.495549+0000","scrub_duration":0.055111746000000003,"objects_trimmed":0,"snaptrim_duration":0.0025976440000000001,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":54,"num_read":5378,"num_read_kb":14806,"num_write":465,"num_write_kb":5134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":264,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:12.443899+0000","last_change":"2024-09-13T05:14:12.444162+0000","last_active":"2024-09-13T05:14:12.443899+0000","last_peered":"2024-09-13T05:14:12.443899+0000","last_clean":"2024-09-13T05:14:12.443899+0000","last_became_active":"2024-09-13T05:13:37.803889+0000","last_became_peered":"2024-09-13T05:13:37.803889+0000","last_unstale":"2024-09-13T05:14:12.443899+0000","last_undegraded":"2024-09-13T05:14:12.443899+0000","last_fullsized":"2024-09-13T05:14:12.443899+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:14:12.443854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:14:12.443854+0000","last_clean_scrub_stamp":"2024-09-13T05:14:12.443854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:04:31.876721+0000","scrub_duration":0.0033538589999999998,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"223'758","reported_seq":1934,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:06.888225+0000","last_change":"2024-09-13T05:14:06.888225+0000","last_active":"2024-09-13T05:14:06.888225+0000","last_peered":"2024-09-13T05:14:06.888225+0000","last_clean":"2024-09-13T05:14:06.888225+0000","last_became_active":"2024-09-13T05:12:09.627485+0000","last_became_peered":"2024-09-13T05:12:09.627485+0000","last_unstale":"2024-09-13T05:14:06.888225+0000","last_undegraded":"2024-09-13T05:14:06.888225+0000","last_fullsized":"2024-09-13T05:14:06.888225+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'758","last_scrub_stamp":"2024-09-13T05:14:06.887992+0000","last_deep_scrub":"223'758","last_deep_scrub_stamp":"2024-09-13T05:14:06.887992+0000","last_clean_scrub_stamp":"2024-09-13T05:14:06.887992+0000","objects_scrubbed":47,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:40:15.437641+0000","scrub_duration":0.049205615000000001,"objects_trimmed":0,"snaptrim_duration":0.001363632,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":1702,"num_read_kb":4638,"num_write":789,"num_write_kb":10312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":352,"num_bytes_recovered":5263836,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:14.790166+0000","last_change":"2024-09-13T05:14:14.790508+0000","last_active":"2024-09-13T05:14:14.790166+0000","last_peered":"2024-09-13T05:14:14.790166+0000","last_clean":"2024-09-13T05:14:14.790166+0000","last_became_active":"2024-09-13T05:13:37.803639+0000","last_became_peered":"2024-09-13T05:13:37.803639+0000","last_unstale":"2024-09-13T05:14:14.790166+0000","last_undegraded":"2024-09-13T05:14:14.790166+0000","last_fullsized":"2024-09-13T05:14:14.790166+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:14:14.790073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:14:14.790073+0000","last_clean_scrub_stamp":"2024-09-13T05:14:14.790073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:18:01.197298+0000","scrub_duration":0.0030052,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"223'775","reported_seq":5849,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:13.366756+0000","last_change":"2024-09-13T05:14:13.366756+0000","last_active":"2024-09-13T05:14:13.366756+0000","last_peered":"2024-09-13T05:14:13.366756+0000","last_clean":"2024-09-13T05:14:13.366756+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:14:13.366756+0000","last_undegraded":"2024-09-13T05:14:13.366756+0000","last_fullsized":"2024-09-13T05:14:13.366756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'775","last_scrub_stamp":"2024-09-13T05:14:13.366571+0000","last_deep_scrub":"223'775","last_deep_scrub_stamp":"2024-09-13T05:14:13.366571+0000","last_clean_scrub_stamp":"2024-09-13T05:14:13.366571+0000","objects_scrubbed":41,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:10:01.918944+0000","scrub_duration":0.051205701999999999,"objects_trimmed":0,"snaptrim_duration":0.0035228970000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":7406,"num_read_kb":59728,"num_write":628,"num_write_kb":55671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"223'1191","reported_seq":5821,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:10.061979+0000","last_change":"2024-09-13T05:14:10.062098+0000","last_active":"2024-09-13T05:14:10.061979+0000","last_peered":"2024-09-13T05:14:10.061979+0000","last_clean":"2024-09-13T05:14:10.061979+0000","last_became_active":"2024-09-13T05:13:46.664160+0000","last_became_peered":"2024-09-13T05:13:46.664160+0000","last_unstale":"2024-09-13T05:14:10.061979+0000","last_undegraded":"2024-09-13T05:14:10.061979+0000","last_fullsized":"2024-09-13T05:14:10.061979+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'1191","last_scrub_stamp":"2024-09-13T05:14:10.061959+0000","last_deep_scrub":"223'1191","last_deep_scrub_stamp":"2024-09-13T05:14:10.061959+0000","last_clean_scrub_stamp":"2024-09-13T05:14:10.061959+0000","objects_scrubbed":57,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:33.526323+0000","scrub_duration":0.057549841999999997,"objects_trimmed":0,"snaptrim_duration":0.0026890410000000001,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":56,"num_read":4911,"num_read_kb":30667,"num_write":1235,"num_write_kb":50371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":996,"num_bytes_recovered":31453269,"num_keys_recovered":34,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":249,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:08.552100+0000","last_change":"2024-09-13T05:13:31.749856+0000","last_active":"2024-09-13T05:14:08.552100+0000","last_peered":"2024-09-13T05:14:08.552100+0000","last_clean":"2024-09-13T05:14:08.552100+0000","last_became_active":"2024-09-13T05:13:31.749063+0000","last_became_peered":"2024-09-13T05:13:31.749063+0000","last_unstale":"2024-09-13T05:14:08.552100+0000","last_undegraded":"2024-09-13T05:14:08.552100+0000","last_fullsized":"2024-09-13T05:14:08.552100+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:09:58.346979+0000","last_clean_scrub_stamp":"2024-09-13T05:09:58.346979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"223'852","reported_seq":1851,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:07.915202+0000","last_change":"2024-09-13T05:14:07.915357+0000","last_active":"2024-09-13T05:14:07.915202+0000","last_peered":"2024-09-13T05:14:07.915202+0000","last_clean":"2024-09-13T05:14:07.915202+0000","last_became_active":"2024-09-13T05:12:07.930334+0000","last_became_peered":"2024-09-13T05:12:07.930334+0000","last_unstale":"2024-09-13T05:14:07.915202+0000","last_undegraded":"2024-09-13T05:14:07.915202+0000","last_fullsized":"2024-09-13T05:14:07.915202+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'852","last_scrub_stamp":"2024-09-13T05:14:07.915158+0000","last_deep_scrub":"223'852","last_deep_scrub_stamp":"2024-09-13T05:14:07.915158+0000","last_clean_scrub_stamp":"2024-09-13T05:14:07.915158+0000","objects_scrubbed":55,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:18:40.380605+0000","scrub_duration":0.052184530999999999,"objects_trimmed":0,"snaptrim_duration":0.00096036500000000003,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":55,"num_read":2051,"num_read_kb":3594,"num_write":735,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":1243867,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":232,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:08.329149+0000","last_change":"2024-09-13T05:14:08.329149+0000","last_active":"2024-09-13T05:14:08.329149+0000","last_peered":"2024-09-13T05:14:08.329149+0000","last_clean":"2024-09-13T05:14:08.329149+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:14:08.329149+0000","last_undegraded":"2024-09-13T05:14:08.329149+0000","last_fullsized":"2024-09-13T05:14:08.329149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:14:08.328836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:14:08.328836+0000","last_clean_scrub_stamp":"2024-09-13T05:14:08.328836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:45.203439+0000","scrub_duration":0.0029189179999999999,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"223'1058","reported_seq":5363,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:16.600624+0000","last_change":"2024-09-13T05:14:16.600750+0000","last_active":"2024-09-13T05:14:16.600624+0000","last_peered":"2024-09-13T05:14:16.600624+0000","last_clean":"2024-09-13T05:14:16.600624+0000","last_became_active":"2024-09-13T05:13:46.663849+0000","last_became_peered":"2024-09-13T05:13:46.663849+0000","last_unstale":"2024-09-13T05:14:16.600624+0000","last_undegraded":"2024-09-13T05:14:16.600624+0000","last_fullsized":"2024-09-13T05:14:16.600624+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'1058","last_scrub_stamp":"2024-09-13T05:14:16.600601+0000","last_deep_scrub":"223'1058","last_deep_scrub_stamp":"2024-09-13T05:14:16.600601+0000","last_clean_scrub_stamp":"2024-09-13T05:14:16.600601+0000","objects_scrubbed":42,"log_size":1058,"log_dups_size":0,"ondisk_log_size":1058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:13.826887+0000","scrub_duration":0.052010413999999998,"objects_trimmed":2,"snaptrim_duration":0.0078035550000000002,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":6441,"num_read_kb":19916,"num_write":1291,"num_write_kb":12451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":408,"num_bytes_recovered":8416446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":256,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:11.396819+0000","last_change":"2024-09-13T05:14:11.397184+0000","last_active":"2024-09-13T05:14:11.396819+0000","last_peered":"2024-09-13T05:14:11.396819+0000","last_clean":"2024-09-13T05:14:11.396819+0000","last_became_active":"2024-09-13T05:12:03.635929+0000","last_became_peered":"2024-09-13T05:12:03.635929+0000","last_unstale":"2024-09-13T05:14:11.396819+0000","last_undegraded":"2024-09-13T05:14:11.396819+0000","last_fullsized":"2024-09-13T05:14:11.396819+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:14:11.396772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:14:11.396772+0000","last_clean_scrub_stamp":"2024-09-13T05:14:11.396772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:20:03.843383+0000","scrub_duration":0.0032135219999999999,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"223'761","reported_seq":3730,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:19.038794+0000","last_change":"2024-09-13T05:14:19.038929+0000","last_active":"2024-09-13T05:14:19.038794+0000","last_peered":"2024-09-13T05:14:19.038794+0000","last_clean":"2024-09-13T05:14:19.038794+0000","last_became_active":"2024-09-13T05:13:18.651382+0000","last_became_peered":"2024-09-13T05:13:18.651382+0000","last_unstale":"2024-09-13T05:14:19.038794+0000","last_undegraded":"2024-09-13T05:14:19.038794+0000","last_fullsized":"2024-09-13T05:14:19.038794+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'761","last_scrub_stamp":"2024-09-13T05:14:19.038766+0000","last_deep_scrub":"223'761","last_deep_scrub_stamp":"2024-09-13T05:14:19.038766+0000","last_clean_scrub_stamp":"2024-09-13T05:14:19.038766+0000","objects_scrubbed":50,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:17:49.259978+0000","scrub_duration":0.049302779999999997,"objects_trimmed":0,"snaptrim_duration":0.000842029,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":50,"num_read":5402,"num_read_kb":12408,"num_write":632,"num_write_kb":8370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":367,"num_bytes_recovered":3415864,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"223'2","reported_seq":235,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:10.417574+0000","last_change":"2024-09-13T05:14:10.417574+0000","last_active":"2024-09-13T05:14:10.417574+0000","last_peered":"2024-09-13T05:14:10.417574+0000","last_clean":"2024-09-13T05:14:10.417574+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:14:10.417574+0000","last_undegraded":"2024-09-13T05:14:10.417574+0000","last_fullsized":"2024-09-13T05:14:10.417574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'2","last_scrub_stamp":"2024-09-13T05:14:10.417246+0000","last_deep_scrub":"223'2","last_deep_scrub_stamp":"2024-09-13T05:14:10.417246+0000","last_clean_scrub_stamp":"2024-09-13T05:14:10.417246+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:58:29.663144+0000","scrub_duration":0.0059471239999999998,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"223'119","reported_seq":466,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:10.387793+0000","last_change":"2024-09-13T05:14:10.388077+0000","last_active":"2024-09-13T05:14:10.387793+0000","last_peered":"2024-09-13T05:14:10.387793+0000","last_clean":"2024-09-13T05:14:10.387793+0000","last_became_active":"2024-09-13T05:13:41.857228+0000","last_became_peered":"2024-09-13T05:13:41.857228+0000","last_unstale":"2024-09-13T05:14:10.387793+0000","last_undegraded":"2024-09-13T05:14:10.387793+0000","last_fullsized":"2024-09-13T05:14:10.387793+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'119","last_scrub_stamp":"2024-09-13T05:14:10.387681+0000","last_deep_scrub":"223'119","last_deep_scrub_stamp":"2024-09-13T05:14:10.387681+0000","last_clean_scrub_stamp":"2024-09-13T05:14:10.387681+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:50.066569+0000","scrub_duration":0.0099498769999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"223'715","reported_seq":17299,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:09.893700+0000","last_change":"2024-09-13T05:14:09.893811+0000","last_active":"2024-09-13T05:14:09.893700+0000","last_peered":"2024-09-13T05:14:09.893700+0000","last_clean":"2024-09-13T05:14:09.893700+0000","last_became_active":"2024-09-13T05:12:12.653214+0000","last_became_peered":"2024-09-13T05:12:12.653214+0000","last_unstale":"2024-09-13T05:14:09.893700+0000","last_undegraded":"2024-09-13T05:14:09.893700+0000","last_fullsized":"2024-09-13T05:14:09.893700+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'715","last_scrub_stamp":"2024-09-13T05:14:09.893680+0000","last_deep_scrub":"223'715","last_deep_scrub_stamp":"2024-09-13T05:14:09.893680+0000","last_clean_scrub_stamp":"2024-09-13T05:14:09.893680+0000","objects_scrubbed":57,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:32:19.071750+0000","scrub_duration":0.048042416999999997,"objects_trimmed":0,"snaptrim_duration":0.00090748800000000002,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":57,"num_read":16644,"num_read_kb":16716,"num_write":498,"num_write_kb":27916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":2876772,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"223'943","reported_seq":9267,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:14.034774+0000","last_change":"2024-09-13T05:14:14.034921+0000","last_active":"2024-09-13T05:14:14.034774+0000","last_peered":"2024-09-13T05:14:14.034774+0000","last_clean":"2024-09-13T05:14:14.034774+0000","last_became_active":"2024-09-13T05:12:41.912780+0000","last_became_peered":"2024-09-13T05:12:41.912780+0000","last_unstale":"2024-09-13T05:14:14.034774+0000","last_undegraded":"2024-09-13T05:14:14.034774+0000","last_fullsized":"2024-09-13T05:14:14.034774+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'943","last_scrub_stamp":"2024-09-13T05:14:14.034751+0000","last_deep_scrub":"223'943","last_deep_scrub_stamp":"2024-09-13T05:14:14.034751+0000","last_clean_scrub_stamp":"2024-09-13T05:14:14.034751+0000","objects_scrubbed":42,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:25:22.775334+0000","scrub_duration":0.049265241000000001,"objects_trimmed":0,"snaptrim_duration":0.0018089219999999999,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":11722,"num_read_kb":25826,"num_write":890,"num_write_kb":20361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":5657687,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"223'888","reported_seq":11249,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:24.047601+0000","last_change":"2024-09-13T05:14:24.047715+0000","last_active":"2024-09-13T05:14:24.047601+0000","last_peered":"2024-09-13T05:14:24.047601+0000","last_clean":"2024-09-13T05:14:24.047601+0000","last_became_active":"2024-09-13T05:10:47.939220+0000","last_became_peered":"2024-09-13T05:10:47.939220+0000","last_unstale":"2024-09-13T05:14:24.047601+0000","last_undegraded":"2024-09-13T05:14:24.047601+0000","last_fullsized":"2024-09-13T05:14:24.047601+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'888","last_scrub_stamp":"2024-09-13T05:14:24.047576+0000","last_deep_scrub":"223'888","last_deep_scrub_stamp":"2024-09-13T05:14:24.047576+0000","last_clean_scrub_stamp":"2024-09-13T05:14:24.047576+0000","objects_scrubbed":53,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:23.995245+0000","scrub_duration":0.056922042999999999,"objects_trimmed":0,"snaptrim_duration":0.0032813690000000001,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":52,"num_read":11243,"num_read_kb":19806,"num_write":773,"num_write_kb":9910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":59,"num_bytes_recovered":6203954,"num_keys_recovered":18,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"223'755","reported_seq":8074,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:16.952359+0000","last_change":"2024-09-13T05:14:16.952498+0000","last_active":"2024-09-13T05:14:16.952359+0000","last_peered":"2024-09-13T05:14:16.952359+0000","last_clean":"2024-09-13T05:14:16.952359+0000","last_became_active":"2024-09-13T05:13:44.659181+0000","last_became_peered":"2024-09-13T05:13:44.659181+0000","last_unstale":"2024-09-13T05:14:16.952359+0000","last_undegraded":"2024-09-13T05:14:16.952359+0000","last_fullsized":"2024-09-13T05:14:16.952359+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'755","last_scrub_stamp":"2024-09-13T05:14:16.952336+0000","last_deep_scrub":"223'755","last_deep_scrub_stamp":"2024-09-13T05:14:16.952336+0000","last_clean_scrub_stamp":"2024-09-13T05:14:16.952336+0000","objects_scrubbed":52,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:55:44.610374+0000","scrub_duration":0.058258270000000001,"objects_trimmed":0,"snaptrim_duration":0.001538939,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":7215,"num_read_kb":12852,"num_write":549,"num_write_kb":8612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":652,"num_bytes_recovered":7231372,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"200'703","reported_seq":2682,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:13:57.981918+0000","last_change":"2024-09-13T05:13:35.787823+0000","last_active":"2024-09-13T05:13:57.981918+0000","last_peered":"2024-09-13T05:13:57.981918+0000","last_clean":"2024-09-13T05:13:57.981918+0000","last_became_active":"2024-09-13T05:13:31.750969+0000","last_became_peered":"2024-09-13T05:13:31.750969+0000","last_unstale":"2024-09-13T05:13:57.981918+0000","last_undegraded":"2024-09-13T05:13:57.981918+0000","last_fullsized":"2024-09-13T05:13:57.981918+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026184060000000002,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":45,"num_read":2965,"num_read_kb":14716,"num_write":786,"num_write_kb":19816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"223'908","reported_seq":4809,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:20.495521+0000","last_change":"2024-09-13T05:14:20.495695+0000","last_active":"2024-09-13T05:14:20.495521+0000","last_peered":"2024-09-13T05:14:20.495521+0000","last_clean":"2024-09-13T05:14:20.495521+0000","last_became_active":"2024-09-13T05:11:23.616962+0000","last_became_peered":"2024-09-13T05:11:23.616962+0000","last_unstale":"2024-09-13T05:14:20.495521+0000","last_undegraded":"2024-09-13T05:14:20.495521+0000","last_fullsized":"2024-09-13T05:14:20.495521+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'908","last_scrub_stamp":"2024-09-13T05:14:20.495498+0000","last_deep_scrub":"223'908","last_deep_scrub_stamp":"2024-09-13T05:14:20.495498+0000","last_clean_scrub_stamp":"2024-09-13T05:14:20.495498+0000","objects_scrubbed":47,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:21:40.990911+0000","scrub_duration":0.054461117000000003,"objects_trimmed":0,"snaptrim_duration":0.0024761649999999998,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":5259,"num_read_kb":15611,"num_write":930,"num_write_kb":9177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":12781016,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"201'1180","reported_seq":9597,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.939698+0000","last_change":"2024-09-13T05:13:35.793562+0000","last_active":"2024-09-13T05:13:58.939698+0000","last_peered":"2024-09-13T05:13:58.939698+0000","last_clean":"2024-09-13T05:13:58.939698+0000","last_became_active":"2024-09-13T05:12:46.655973+0000","last_became_peered":"2024-09-13T05:12:46.655973+0000","last_unstale":"2024-09-13T05:13:58.939698+0000","last_undegraded":"2024-09-13T05:13:58.939698+0000","last_fullsized":"2024-09-13T05:13:58.939698+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1180,"log_dups_size":0,"ondisk_log_size":1180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022750969999999998,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":57,"num_read":10231,"num_read_kb":11540,"num_write":1521,"num_write_kb":6908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":612,"num_bytes_recovered":16479322,"num_keys_recovered":78,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"198'950","reported_seq":7302,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.940462+0000","last_change":"2024-09-13T05:13:35.793996+0000","last_active":"2024-09-13T05:13:58.940462+0000","last_peered":"2024-09-13T05:13:58.940462+0000","last_clean":"2024-09-13T05:13:58.940462+0000","last_became_active":"2024-09-13T05:12:45.651313+0000","last_became_peered":"2024-09-13T05:12:45.651313+0000","last_unstale":"2024-09-13T05:13:58.940462+0000","last_undegraded":"2024-09-13T05:13:58.940462+0000","last_fullsized":"2024-09-13T05:13:58.940462+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":950,"log_dups_size":0,"ondisk_log_size":950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026155729999999999,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":7680,"num_read_kb":14250,"num_write":1094,"num_write_kb":7822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":7824116,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"223'785","reported_seq":4276,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:24.081932+0000","last_change":"2024-09-13T05:14:24.082063+0000","last_active":"2024-09-13T05:14:24.081932+0000","last_peered":"2024-09-13T05:14:24.081932+0000","last_clean":"2024-09-13T05:14:24.081932+0000","last_became_active":"2024-09-13T05:13:42.865327+0000","last_became_peered":"2024-09-13T05:13:42.865327+0000","last_unstale":"2024-09-13T05:14:24.081932+0000","last_undegraded":"2024-09-13T05:14:24.081932+0000","last_fullsized":"2024-09-13T05:14:24.081932+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'785","last_scrub_stamp":"2024-09-13T05:14:24.081912+0000","last_deep_scrub":"223'785","last_deep_scrub_stamp":"2024-09-13T05:14:24.081912+0000","last_clean_scrub_stamp":"2024-09-13T05:14:24.081912+0000","objects_scrubbed":60,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:26:54.259365+0000","scrub_duration":0.059603250000000003,"objects_trimmed":0,"snaptrim_duration":0.00070392800000000004,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":3644,"num_read_kb":16917,"num_write":678,"num_write_kb":24247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":802,"num_bytes_recovered":33560838,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"223'597","reported_seq":9717,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:18.528572+0000","last_change":"2024-09-13T05:14:18.528717+0000","last_active":"2024-09-13T05:14:18.528572+0000","last_peered":"2024-09-13T05:14:18.528572+0000","last_clean":"2024-09-13T05:14:18.528572+0000","last_became_active":"2024-09-13T05:12:42.936456+0000","last_became_peered":"2024-09-13T05:12:42.936456+0000","last_unstale":"2024-09-13T05:14:18.528572+0000","last_undegraded":"2024-09-13T05:14:18.528572+0000","last_fullsized":"2024-09-13T05:14:18.528572+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'597","last_scrub_stamp":"2024-09-13T05:14:18.528547+0000","last_deep_scrub":"223'597","last_deep_scrub_stamp":"2024-09-13T05:14:18.528547+0000","last_clean_scrub_stamp":"2024-09-13T05:14:18.528547+0000","objects_scrubbed":60,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:30:39.124458+0000","scrub_duration":0.062744953000000006,"objects_trimmed":0,"snaptrim_duration":0.0018319619999999999,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":8115,"num_read_kb":13498,"num_write":403,"num_write_kb":21128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":380,"num_bytes_recovered":20462375,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"223'1137","reported_seq":6523,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:18.589939+0000","last_change":"2024-09-13T05:14:18.590071+0000","last_active":"2024-09-13T05:14:18.589939+0000","last_peered":"2024-09-13T05:14:18.589939+0000","last_clean":"2024-09-13T05:14:18.589939+0000","last_became_active":"2024-09-13T05:13:46.665575+0000","last_became_peered":"2024-09-13T05:13:46.665575+0000","last_unstale":"2024-09-13T05:14:18.589939+0000","last_undegraded":"2024-09-13T05:14:18.589939+0000","last_fullsized":"2024-09-13T05:14:18.589939+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'1137","last_scrub_stamp":"2024-09-13T05:14:18.589914+0000","last_deep_scrub":"223'1137","last_deep_scrub_stamp":"2024-09-13T05:14:18.589914+0000","last_clean_scrub_stamp":"2024-09-13T05:14:18.589914+0000","objects_scrubbed":47,"log_size":1137,"log_dups_size":0,"ondisk_log_size":1137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:19:54.372122+0000","scrub_duration":0.050029977000000003,"objects_trimmed":2,"snaptrim_duration":0.006060307,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":9137,"num_read_kb":27013,"num_write":1266,"num_write_kb":8578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":633324,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"201'1349","reported_seq":5471,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:13:58.940074+0000","last_change":"2024-09-13T05:13:35.791602+0000","last_active":"2024-09-13T05:13:58.940074+0000","last_peered":"2024-09-13T05:13:58.940074+0000","last_clean":"2024-09-13T05:13:58.940074+0000","last_became_active":"2024-09-13T05:12:48.638127+0000","last_became_peered":"2024-09-13T05:12:48.638127+0000","last_unstale":"2024-09-13T05:13:58.940074+0000","last_undegraded":"2024-09-13T05:13:58.940074+0000","last_fullsized":"2024-09-13T05:13:58.940074+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:10:08.610646+0000","last_clean_scrub_stamp":"2024-09-13T05:10:08.610646+0000","objects_scrubbed":0,"log_size":1349,"log_dups_size":0,"ondisk_log_size":1349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001070477,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":7844,"num_read_kb":55094,"num_write":1803,"num_write_kb":40168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":20884522,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":1622,"num_object_clones":0,"num_object_copies":3244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1622,"num_whiteouts":1618,"num_read":258414,"num_read_kb":631830,"num_write":28490,"num_write_kb":532665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11025,"num_bytes_recovered":280109913,"num_keys_recovered":906,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3756,"internal_metadata":0},"log_size":28391,"ondisk_log_size":28391,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574909,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110616,"kb_used_data":3216,"kb_used_omap":1,"kb_used_meta":107390,"kb_avail":94261224,"statfs":{"total":96636764160,"available":96523493376,"internally_reserved":0,"allocated":3293184,"data_stored":1898733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":109967819},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:14:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77400000000000002,"15min":0.78200000000000003},"min":{"1min":0.53900000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.054,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":1.044},{"interface":"front","average":{"1min":0.877,"5min":0.86299999999999999,"15min":0.86099999999999999},"min":{"1min":0.57799999999999996,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.84499999999999997}]},{"osd":1,"last update":"Fri Sep 13 05:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.82999999999999996,"15min":0.82599999999999996},"min":{"1min":0.63400000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1419999999999999,"5min":1.238,"15min":1.238},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.85399999999999998,"15min":0.81200000000000006},"min":{"1min":0.61499999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.196,"5min":1.982,"15min":1.982},"last":1.145}]},{"osd":2,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.84899999999999998,"15min":0.85399999999999998},"min":{"1min":0.67600000000000005,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1519999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.056,"5min":0.90200000000000002,"15min":0.81499999999999995},"min":{"1min":0.94399999999999995,"5min":0.433,"15min":0.433},"max":{"1min":1.262,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.93100000000000005}]},{"osd":3,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.98199999999999998,"15min":0.90500000000000003},"min":{"1min":0.54000000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2749999999999999,"5min":12.663,"15min":12.663},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.90000000000000002,"15min":0.90400000000000003},"min":{"1min":0.73199999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1799999999999999,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.0009999999999999}]},{"osd":4,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81100000000000005,"15min":0.77900000000000003},"min":{"1min":0.58699999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.365,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.746},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.91000000000000003,"15min":0.92500000000000004},"min":{"1min":0.48999999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.216,"5min":2.02,"15min":2.02},"last":0.88300000000000001}]},{"osd":5,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.95799999999999996,"15min":0.95199999999999996},"min":{"1min":0.63900000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.246,"5min":1.655,"15min":1.655},"last":1.2050000000000001},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.96399999999999997,"15min":0.95099999999999996},"min":{"1min":0.66100000000000003,"5min":0.499,"15min":0.499},"max":{"1min":1.306,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.1220000000000001}]},{"osd":6,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93300000000000005,"15min":0.91900000000000004},"min":{"1min":0.76200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.381,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.042,"15min":1.038},"min":{"1min":0.76900000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3240000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.171}]}]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59988,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311852,"statfs":{"total":96636764160,"available":96575336448,"internally_reserved":0,"allocated":2699264,"data_stored":1308365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58718663},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:14:20 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.83999999999999997,"15min":0.84299999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1639999999999999,"5min":1.359,"15min":1.359},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.76800000000000002,"15min":0.76200000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.91300000000000003}]},{"osd":1,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.85399999999999998,"15min":0.873},"min":{"1min":0.51900000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82399999999999995,"15min":0.85499999999999998},"min":{"1min":0.46500000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.3009999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.72699999999999998}]},{"osd":2,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.79500000000000004,"15min":0.77600000000000002},"min":{"1min":0.58299999999999996,"5min":0.312,"15min":0.312},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.93799999999999994,"15min":0.96599999999999997},"min":{"1min":0.42499999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.383,"5min":1.49,"15min":1.49},"last":0.93799999999999994}]},{"osd":3,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90700000000000003,"15min":0.93799999999999994},"min":{"1min":0.65800000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.5489999999999999,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.93000000000000005,"15min":0.93500000000000005},"min":{"1min":0.80400000000000005,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.752}]},{"osd":4,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.93899999999999995,"15min":0.95999999999999996},"min":{"1min":0.47399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.456,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.95299999999999996,"15min":0.98699999999999999},"min":{"1min":0.55500000000000005,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.274,"5min":2.056,"15min":2.056},"last":0.81599999999999995}]},{"osd":5,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.68300000000000005,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.01},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.0800000000000001,"15min":1.0980000000000001},"min":{"1min":0.69899999999999995,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":0.86899999999999999}]},{"osd":7,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0620000000000001,"15min":1.101},"min":{"1min":0.748,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3120000000000001,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.0740000000000001,"15min":1.0820000000000001},"min":{"1min":0.82099999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.103}]}]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65752,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306088,"statfs":{"total":96636764160,"available":96569434112,"internally_reserved":0,"allocated":2703360,"data_stored":1308384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:14:19 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.72999999999999998,"15min":0.71399999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.753,"15min":0.753},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.53300000000000003}]},{"osd":1,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.83599999999999997,"15min":0.872},"min":{"1min":0.53700000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1619999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.873,"5min":0.86399999999999999,"15min":0.90900000000000003},"min":{"1min":0.61299999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.145,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.86799999999999999}]},{"osd":2,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.81699999999999995,"15min":0.84499999999999997},"min":{"1min":0.40600000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1519999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.90000000000000002,"15min":0.89800000000000002},"min":{"1min":0.59999999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.087}]},{"osd":3,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.85499999999999998,"15min":0.91100000000000003},"min":{"1min":0.58299999999999996,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1180000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.93200000000000005,"15min":1.0009999999999999},"min":{"1min":0.64900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.294,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.0149999999999999}]},{"osd":4,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.878,"15min":0.94499999999999995},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1830000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.016,"15min":1.0920000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.333,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.0569999999999999}]},{"osd":6,"last update":"Fri Sep 13 05:14:07 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.94899999999999995,"15min":0.95699999999999996},"min":{"1min":0.42499999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3879999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.98199999999999998,"15min":1.0309999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.95499999999999996}]},{"osd":7,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0620000000000001,"15min":1.1639999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.244,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.101,"15min":1.1559999999999999},"min":{"1min":0.47399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.4590000000000001,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.1359999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41944,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94329896,"statfs":{"total":96636764160,"available":96593813504,"internally_reserved":0,"allocated":2703360,"data_stored":1308384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:14:20 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.76000000000000001,"15min":0.74399999999999999},"min":{"1min":0.48899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.85899999999999999,"15min":0.83999999999999997},"min":{"1min":0.74399999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.0609999999999999}]},{"osd":1,"last update":"Fri Sep 13 05:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.748,"15min":0.752},"min":{"1min":0.41499999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.27,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.82699999999999996,"15min":0.90500000000000003},"min":{"1min":0.59099999999999997,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.73599999999999999}]},{"osd":2,"last update":"Fri Sep 13 05:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.91300000000000003,"15min":0.97099999999999997},"min":{"1min":0.51400000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.3109999999999999,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":1.133},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.98599999999999999,"15min":1.0649999999999999},"min":{"1min":0.55600000000000005,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1890000000000001,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.88200000000000001}]},{"osd":3,"last update":"Fri Sep 13 05:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.90200000000000002,"15min":0.91100000000000003},"min":{"1min":0.628,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1279999999999999,"5min":4.0609999999999999,"15min":4.0609999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.86799999999999999,"15min":0.90800000000000003},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1739999999999999,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.155}]},{"osd":5,"last update":"Fri Sep 13 05:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.86199999999999999,"15min":0.88400000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.181,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.94199999999999995,"5min":1.016,"15min":1.133},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4179999999999999,"5min":3.871,"15min":3.871},"last":0.97499999999999998}]},{"osd":6,"last update":"Fri Sep 13 05:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.03,"15min":1.1220000000000001},"min":{"1min":0.57299999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4890000000000001,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":1.038},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.93999999999999995,"15min":0.95599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3240000000000001,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.008}]},{"osd":7,"last update":"Fri Sep 13 05:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.077,"15min":1.145},"min":{"1min":0.67700000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4670000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.181},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.077,"15min":1.099},"min":{"1min":0.70599999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.5660000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.0920000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574908,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47700,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324140,"statfs":{"total":96636764160,"available":96587919360,"internally_reserved":0,"allocated":2699264,"data_stored":1308365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:14:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.316,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.85399999999999998,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.68000000000000005,"15min":0.66500000000000004},"min":{"1min":0.50900000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.1459999999999999,"5min":1.353,"15min":1.353},"last":1.087}]},{"osd":1,"last update":"Fri Sep 13 05:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.65300000000000002,"15min":0.66100000000000003},"min":{"1min":0.42999999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.095,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.66900000000000004,"15min":0.71399999999999997},"min":{"1min":0.43099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.2430000000000001}]},{"osd":2,"last update":"Fri Sep 13 05:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71499999999999997,"15min":0.73599999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1779999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.78400000000000003,"15min":0.83599999999999997},"min":{"1min":0.52600000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.145,"5min":1.573,"15min":1.573},"last":1.1699999999999999}]},{"osd":4,"last update":"Fri Sep 13 05:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.84699999999999998,"15min":0.89300000000000002},"min":{"1min":0.44500000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.2589999999999999,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.89800000000000002,"15min":0.92900000000000005},"min":{"1min":0.72199999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.27,"5min":1.764,"15min":1.764},"last":1.306}]},{"osd":5,"last update":"Fri Sep 13 05:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.91900000000000004,"15min":0.995},"min":{"1min":0.69799999999999995,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.153,"5min":2.157,"15min":2.157},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.91500000000000004,"15min":0.97899999999999998},"min":{"1min":0.501,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.552,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.1259999999999999}]},{"osd":6,"last update":"Fri Sep 13 05:14:03 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.94499999999999995,"15min":0.98099999999999998},"min":{"1min":0.65400000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6559999999999999,"5min":1.976,"15min":1.976},"last":1.6639999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.97999999999999998,"15min":1.0760000000000001},"min":{"1min":0.625,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.141,"5min":2.012,"15min":2.012},"last":1.026}]},{"osd":7,"last update":"Fri Sep 13 05:14:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.012,"15min":1.0720000000000001},"min":{"1min":0.59699999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.6319999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.0580000000000001,"15min":1.1000000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.673,"5min":1.875,"15min":1.875},"last":1.2}]}]},{"osd":2,"up_from":13,"seq":55834574907,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69844,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94301996,"statfs":{"total":96636764160,"available":96565243904,"internally_reserved":0,"allocated":2699264,"data_stored":1308365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:14:20 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.63600000000000001,"15min":0.63700000000000001},"min":{"1min":0.33100000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.004,"5min":1.087,"15min":1.087},"last":0.84799999999999998}]},{"osd":1,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64800000000000002,"15min":0.66800000000000004},"min":{"1min":0.40200000000000002,"5min":0.246,"15min":0.246},"max":{"1min":1.081,"5min":1.554,"15min":1.554},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64200000000000002,"15min":0.65400000000000003},"min":{"1min":0.40100000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0780000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.75700000000000001}]},{"osd":3,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67000000000000004,"15min":0.624},"min":{"1min":0.38300000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.002,"5min":6.6070000000000002,"15min":6.6070000000000002},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69499999999999995,"15min":0.66700000000000004},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.014,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.82299999999999995,"15min":0.78300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.464,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.90700000000000003,"15min":0.89800000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":0.93200000000000005}]},{"osd":5,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.878,"15min":0.89400000000000002},"min":{"1min":0.48999999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.1099999999999999,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.137},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.89700000000000002,"15min":0.872},"min":{"1min":0.52400000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3500000000000001,"5min":1.51,"15min":1.51},"last":1.0860000000000001}]},{"osd":6,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90300000000000002,"15min":0.879},"min":{"1min":0.54200000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.998},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94699999999999995,"15min":0.94799999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3300000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.95399999999999996}]},{"osd":7,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0109999999999999,"15min":1.0289999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3680000000000001,"5min":1.867,"15min":1.867},"last":1.105},{"interface":"front","average":{"1min":1.038,"5min":0.97499999999999998,"15min":0.97599999999999998},"min":{"1min":0.52000000000000002,"5min":0.496,"15min":0.496},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.97799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47708,"kb_used_data":2644,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324132,"statfs":{"total":96636764160,"available":96587911168,"internally_reserved":0,"allocated":2707456,"data_stored":1308403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.59699999999999998,"15min":0.58699999999999997},"min":{"1min":0.42299999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.629}]},{"osd":2,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.66400000000000003,"15min":0.61599999999999999},"min":{"1min":0.39400000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.98899999999999999,"5min":5.952,"15min":5.952},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66300000000000003,"15min":0.68999999999999995},"min":{"1min":0.45900000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86499999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.67000000000000004}]},{"osd":3,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72699999999999998,"15min":0.76700000000000002},"min":{"1min":0.42099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.127,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71399999999999997,"15min":0.747},"min":{"1min":0.47399999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.026,"5min":1.887,"15min":1.887},"last":0.74199999999999999}]},{"osd":4,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.86899999999999999,"15min":0.91400000000000003},"min":{"1min":0.66400000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0329999999999999,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.0740000000000001,"5min":0.92200000000000004,"15min":0.94399999999999995},"min":{"1min":0.78700000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.4750000000000001,"5min":1.724,"15min":1.724},"last":1.1399999999999999}]},{"osd":5,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.89700000000000002,"15min":0.92400000000000004},"min":{"1min":0.69799999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.76800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.2390000000000001}]},{"osd":6,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.94999999999999996,"15min":1},"min":{"1min":0.67500000000000004,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.4239999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.879},{"interface":"front","average":{"1min":1.109,"5min":1.0029999999999999,"15min":1.0149999999999999},"min":{"1min":0.74399999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.625,"5min":1.873,"15min":1.873},"last":1.089}]},{"osd":7,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.996,"15min":1.018},"min":{"1min":0.80900000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.046,"15min":1.0409999999999999},"min":{"1min":0.91700000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.401,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.3440000000000001}]}]},{"osd":0,"up_from":124,"seq":532575944735,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30936,"kb_used_data":3216,"kb_used_omap":7,"kb_used_meta":27704,"kb_avail":94340904,"statfs":{"total":96636764160,"available":96605085696,"internally_reserved":0,"allocated":3293184,"data_stored":1898733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7666,"internal_metadata":28369422},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 05:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.32200000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.96299999999999997,"5min":1.472,"15min":1.472},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73999999999999999,"15min":0.748},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.296,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.73999999999999999}]},{"osd":2,"last update":"Fri Sep 13 05:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.35199999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.92200000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.77800000000000002,"15min":0.80600000000000005},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.091,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.61899999999999999}]},{"osd":3,"last update":"Fri Sep 13 05:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.70699999999999996,"15min":0.70299999999999996},"min":{"1min":0.40699999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.2669999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.87,"5min":0.85099999999999998,"15min":0.84799999999999998},"min":{"1min":0.46000000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.228,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.81999999999999995}]},{"osd":4,"last update":"Fri Sep 13 05:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.93400000000000005,"15min":0.94899999999999995},"min":{"1min":0.56899999999999995,"5min":0.498,"15min":0.498},"max":{"1min":1.1859999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.91300000000000003,"15min":0.91100000000000003},"min":{"1min":0.57199999999999995,"5min":0.496,"15min":0.496},"max":{"1min":1.2709999999999999,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":0.78600000000000003}]},{"osd":5,"last update":"Fri Sep 13 05:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.82299999999999995,"15min":0.80700000000000005},"min":{"1min":0.66600000000000004,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0149999999999999,"15min":1.0129999999999999},"min":{"1min":0.71899999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.0700000000000001}]},{"osd":6,"last update":"Fri Sep 13 05:14:21 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.1100000000000001,"15min":1.1339999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.3999999999999999,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.87}]},{"osd":7,"last update":"Fri Sep 13 05:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.161,"15min":1.1890000000000001},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.323,"5min":1.901,"15min":1.901},"last":1.04},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0549999999999999,"15min":1.0609999999999999},"min":{"1min":0.628,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.339,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.92900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3756,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:14:31.323 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:31.323 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:31.323 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T05:09:58.346979+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=9, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:31.324 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:31.324 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:31.324 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:31.324 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T05:10:08.610646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=10, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=5, tm_min=14, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T05:14:31.324 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T05:14:51.325 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T05:14:51.643 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T05:14:51.647 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T05:14:51.661 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":366,"stamp":"2024-09-13T05:14:50.248101+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":1626,"num_object_clones":0,"num_object_copies":3252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1626,"num_whiteouts":1618,"num_read":258530,"num_read_kb":631930,"num_write":28651,"num_write_kb":535083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11035,"num_bytes_recovered":282471423,"num_keys_recovered":906,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28821,"ondisk_log_size":28821,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":474488,"kb_used_data":22264,"kb_used_omap":18,"kb_used_meta":452141,"kb_avail":754500232,"statfs":{"total":773094113280,"available":772608237568,"internally_reserved":0,"allocated":22798336,"data_stored":11647732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18816,"internal_metadata":462993024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003896"},"pg_stats":[{"pgid":"3.1f","version":"223'738","reported_seq":3906,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:13.604631+0000","last_change":"2024-09-13T05:14:13.604888+0000","last_active":"2024-09-13T05:14:13.604631+0000","last_peered":"2024-09-13T05:14:13.604631+0000","last_clean":"2024-09-13T05:14:13.604631+0000","last_became_active":"2024-09-13T05:13:41.857384+0000","last_became_peered":"2024-09-13T05:13:41.857384+0000","last_unstale":"2024-09-13T05:14:13.604631+0000","last_undegraded":"2024-09-13T05:14:13.604631+0000","last_fullsized":"2024-09-13T05:14:13.604631+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'738","last_scrub_stamp":"2024-09-13T05:14:13.604577+0000","last_deep_scrub":"223'738","last_deep_scrub_stamp":"2024-09-13T05:14:13.604577+0000","last_clean_scrub_stamp":"2024-09-13T05:14:13.604577+0000","objects_scrubbed":41,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:17:31.646997+0000","scrub_duration":0.044701229000000002,"objects_trimmed":0,"snaptrim_duration":0.0024323220000000002,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":4120,"num_read_kb":8764,"num_write":717,"num_write_kb":5986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":222,"num_bytes_recovered":297202,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"223'689","reported_seq":10912,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:17.986168+0000","last_change":"2024-09-13T05:14:17.986326+0000","last_active":"2024-09-13T05:14:17.986168+0000","last_peered":"2024-09-13T05:14:17.986168+0000","last_clean":"2024-09-13T05:14:17.986168+0000","last_became_active":"2024-09-13T05:13:17.865448+0000","last_became_peered":"2024-09-13T05:13:17.865448+0000","last_unstale":"2024-09-13T05:14:17.986168+0000","last_undegraded":"2024-09-13T05:14:17.986168+0000","last_fullsized":"2024-09-13T05:14:17.986168+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'689","last_scrub_stamp":"2024-09-13T05:14:17.986123+0000","last_deep_scrub":"223'689","last_deep_scrub_stamp":"2024-09-13T05:14:17.986123+0000","last_clean_scrub_stamp":"2024-09-13T05:14:17.986123+0000","objects_scrubbed":51,"log_size":689,"log_dups_size":0,"ondisk_log_size":689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:16:57.669189+0000","scrub_duration":0.056225597000000002,"objects_trimmed":0,"snaptrim_duration":0.001429893,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":51,"num_read":10597,"num_read_kb":9513,"num_write":519,"num_write_kb":4499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":4028965,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"223'859","reported_seq":4574,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:07.693432+0000","last_change":"2024-09-13T05:14:07.693640+0000","last_active":"2024-09-13T05:14:07.693432+0000","last_peered":"2024-09-13T05:14:07.693432+0000","last_clean":"2024-09-13T05:14:07.693432+0000","last_became_active":"2024-09-13T05:13:43.661570+0000","last_became_peered":"2024-09-13T05:13:43.661570+0000","last_unstale":"2024-09-13T05:14:07.693432+0000","last_undegraded":"2024-09-13T05:14:07.693432+0000","last_fullsized":"2024-09-13T05:14:07.693432+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'859","last_scrub_stamp":"2024-09-13T05:14:07.693381+0000","last_deep_scrub":"223'859","last_deep_scrub_stamp":"2024-09-13T05:14:07.693381+0000","last_clean_scrub_stamp":"2024-09-13T05:14:07.693381+0000","objects_scrubbed":52,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:23:56.109192+0000","scrub_duration":0.061720059000000001,"objects_trimmed":0,"snaptrim_duration":0.0025226720000000001,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":4533,"num_read_kb":14391,"num_write":805,"num_write_kb":18480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":591,"num_bytes_recovered":7610600,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"223'1020","reported_seq":6633,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:32.443028+0000","last_change":"2024-09-13T05:14:32.443173+0000","last_active":"2024-09-13T05:14:32.443028+0000","last_peered":"2024-09-13T05:14:32.443028+0000","last_clean":"2024-09-13T05:14:32.443028+0000","last_became_active":"2024-09-13T05:13:31.750484+0000","last_became_peered":"2024-09-13T05:13:31.750484+0000","last_unstale":"2024-09-13T05:14:32.443028+0000","last_undegraded":"2024-09-13T05:14:32.443028+0000","last_fullsized":"2024-09-13T05:14:32.443028+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'1020","last_scrub_stamp":"2024-09-13T05:14:32.443007+0000","last_deep_scrub":"223'1020","last_deep_scrub_stamp":"2024-09-13T05:14:32.443007+0000","last_clean_scrub_stamp":"2024-09-13T05:14:32.443007+0000","objects_scrubbed":43,"log_size":1020,"log_dups_size":0,"ondisk_log_size":1020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:29:43.652983+0000","scrub_duration":0.048454384000000003,"objects_trimmed":0,"snaptrim_duration":0.0020042060000000001,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":42,"num_read":7151,"num_read_kb":23958,"num_write":1100,"num_write_kb":15871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":371,"num_bytes_recovered":9523896,"num_keys_recovered":208,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"223'934","reported_seq":4765,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:09.740726+0000","last_change":"2024-09-13T05:14:09.740870+0000","last_active":"2024-09-13T05:14:09.740726+0000","last_peered":"2024-09-13T05:14:09.740726+0000","last_clean":"2024-09-13T05:14:09.740726+0000","last_became_active":"2024-09-13T05:13:45.664962+0000","last_became_peered":"2024-09-13T05:13:45.664962+0000","last_unstale":"2024-09-13T05:14:09.740726+0000","last_undegraded":"2024-09-13T05:14:09.740726+0000","last_fullsized":"2024-09-13T05:14:09.740726+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'934","last_scrub_stamp":"2024-09-13T05:14:09.740704+0000","last_deep_scrub":"223'934","last_deep_scrub_stamp":"2024-09-13T05:14:09.740704+0000","last_clean_scrub_stamp":"2024-09-13T05:14:09.740704+0000","objects_scrubbed":57,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:28:06.244212+0000","scrub_duration":0.068483028000000001,"objects_trimmed":0,"snaptrim_duration":0.0019293209999999999,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":57,"num_read":5360,"num_read_kb":16535,"num_write":962,"num_write_kb":43436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":614,"num_bytes_recovered":12868860,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"223'2036","reported_seq":21190,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:13.077917+0000","last_change":"2024-09-13T05:14:13.078132+0000","last_active":"2024-09-13T05:14:13.077917+0000","last_peered":"2024-09-13T05:14:13.077917+0000","last_clean":"2024-09-13T05:14:13.077917+0000","last_became_active":"2024-09-13T05:12:46.652272+0000","last_became_peered":"2024-09-13T05:12:46.652272+0000","last_unstale":"2024-09-13T05:14:13.077917+0000","last_undegraded":"2024-09-13T05:14:13.077917+0000","last_fullsized":"2024-09-13T05:14:13.077917+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'2036","last_scrub_stamp":"2024-09-13T05:14:13.077884+0000","last_deep_scrub":"223'2036","last_deep_scrub_stamp":"2024-09-13T05:14:13.077884+0000","last_clean_scrub_stamp":"2024-09-13T05:14:13.077884+0000","objects_scrubbed":49,"log_size":2036,"log_dups_size":0,"ondisk_log_size":2036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:27:23.234042+0000","scrub_duration":0.068612376000000003,"objects_trimmed":0,"snaptrim_duration":0.0028053240000000001,"stat_sum":{"num_bytes":19,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":48,"num_read":27228,"num_read_kb":30157,"num_write":3057,"num_write_kb":13192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":478,"num_bytes_recovered":9711059,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"223'986","reported_seq":12766,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:08.869263+0000","last_change":"2024-09-13T05:14:08.869263+0000","last_active":"2024-09-13T05:14:08.869263+0000","last_peered":"2024-09-13T05:14:08.869263+0000","last_clean":"2024-09-13T05:14:08.869263+0000","last_became_active":"2024-09-13T05:12:09.626312+0000","last_became_peered":"2024-09-13T05:12:09.626312+0000","last_unstale":"2024-09-13T05:14:08.869263+0000","last_undegraded":"2024-09-13T05:14:08.869263+0000","last_fullsized":"2024-09-13T05:14:08.869263+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'986","last_scrub_stamp":"2024-09-13T05:14:08.869141+0000","last_deep_scrub":"223'986","last_deep_scrub_stamp":"2024-09-13T05:14:08.869141+0000","last_clean_scrub_stamp":"2024-09-13T05:14:08.869141+0000","objects_scrubbed":52,"log_size":986,"log_dups_size":0,"ondisk_log_size":986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:11:09.817990+0000","scrub_duration":0.055005330999999998,"objects_trimmed":0,"snaptrim_duration":0.000937213,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":14225,"num_read_kb":23139,"num_write":1021,"num_write_kb":7466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":3365202,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"223'765","reported_seq":6021,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:19.014652+0000","last_change":"2024-09-13T05:14:19.014817+0000","last_active":"2024-09-13T05:14:19.014652+0000","last_peered":"2024-09-13T05:14:19.014652+0000","last_clean":"2024-09-13T05:14:19.014652+0000","last_became_active":"2024-09-13T05:13:45.668572+0000","last_became_peered":"2024-09-13T05:13:45.668572+0000","last_unstale":"2024-09-13T05:14:19.014652+0000","last_undegraded":"2024-09-13T05:14:19.014652+0000","last_fullsized":"2024-09-13T05:14:19.014652+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'765","last_scrub_stamp":"2024-09-13T05:14:19.014603+0000","last_deep_scrub":"223'765","last_deep_scrub_stamp":"2024-09-13T05:14:19.014603+0000","last_clean_scrub_stamp":"2024-09-13T05:14:19.014603+0000","objects_scrubbed":54,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:56:23.751827+0000","scrub_duration":0.056466835,"objects_trimmed":0,"snaptrim_duration":0.000878607,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":54,"num_read":4887,"num_read_kb":27058,"num_write":681,"num_write_kb":24614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":417,"num_bytes_recovered":11847558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"223'779","reported_seq":4651,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:15.584478+0000","last_change":"2024-09-13T05:14:15.584618+0000","last_active":"2024-09-13T05:14:15.584478+0000","last_peered":"2024-09-13T05:14:15.584478+0000","last_clean":"2024-09-13T05:14:15.584478+0000","last_became_active":"2024-09-13T05:13:40.852807+0000","last_became_peered":"2024-09-13T05:13:40.852807+0000","last_unstale":"2024-09-13T05:14:15.584478+0000","last_undegraded":"2024-09-13T05:14:15.584478+0000","last_fullsized":"2024-09-13T05:14:15.584478+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'779","last_scrub_stamp":"2024-09-13T05:14:15.584457+0000","last_deep_scrub":"223'779","last_deep_scrub_stamp":"2024-09-13T05:14:15.584457+0000","last_clean_scrub_stamp":"2024-09-13T05:14:15.584457+0000","objects_scrubbed":58,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:14:36.022386+0000","scrub_duration":0.059938457000000001,"objects_trimmed":0,"snaptrim_duration":0.0031554529999999999,"stat_sum":{"num_bytes":0,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":58,"num_read":6742,"num_read_kb":11740,"num_write":569,"num_write_kb":4140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":212,"num_bytes_recovered":37802,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"223'603","reported_seq":9711,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:26.454775+0000","last_change":"2024-09-13T05:14:26.454985+0000","last_active":"2024-09-13T05:14:26.454775+0000","last_peered":"2024-09-13T05:14:26.454775+0000","last_clean":"2024-09-13T05:14:26.454775+0000","last_became_active":"2024-09-13T05:11:24.631079+0000","last_became_peered":"2024-09-13T05:11:24.631079+0000","last_unstale":"2024-09-13T05:14:26.454775+0000","last_undegraded":"2024-09-13T05:14:26.454775+0000","last_fullsized":"2024-09-13T05:14:26.454775+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'603","last_scrub_stamp":"2024-09-13T05:14:26.454745+0000","last_deep_scrub":"223'603","last_deep_scrub_stamp":"2024-09-13T05:14:26.454745+0000","last_clean_scrub_stamp":"2024-09-13T05:14:26.454745+0000","objects_scrubbed":41,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:52:34.270735+0000","scrub_duration":0.039290741999999997,"objects_trimmed":0,"snaptrim_duration":0.0023449740000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":9259,"num_read_kb":15708,"num_write":427,"num_write_kb":4479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":4743569,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"223'697","reported_seq":13581,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:30.508748+0000","last_change":"2024-09-13T05:14:30.508893+0000","last_active":"2024-09-13T05:14:30.508748+0000","last_peered":"2024-09-13T05:14:30.508748+0000","last_clean":"2024-09-13T05:14:30.508748+0000","last_became_active":"2024-09-13T05:10:09.646541+0000","last_became_peered":"2024-09-13T05:10:09.646541+0000","last_unstale":"2024-09-13T05:14:30.508748+0000","last_undegraded":"2024-09-13T05:14:30.508748+0000","last_fullsized":"2024-09-13T05:14:30.508748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'697","last_scrub_stamp":"2024-09-13T05:14:30.508722+0000","last_deep_scrub":"223'697","last_deep_scrub_stamp":"2024-09-13T05:14:30.508722+0000","last_clean_scrub_stamp":"2024-09-13T05:14:30.508722+0000","objects_scrubbed":49,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:23:37.651656+0000","scrub_duration":0.045403757000000003,"objects_trimmed":0,"snaptrim_duration":0.001651455,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":49,"num_read":13660,"num_read_kb":13906,"num_write":593,"num_write_kb":23553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"223'642","reported_seq":8413,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:12.019313+0000","last_change":"2024-09-13T05:14:12.019493+0000","last_active":"2024-09-13T05:14:12.019313+0000","last_peered":"2024-09-13T05:14:12.019313+0000","last_clean":"2024-09-13T05:14:12.019313+0000","last_became_active":"2024-09-13T05:12:45.651071+0000","last_became_peered":"2024-09-13T05:12:45.651071+0000","last_unstale":"2024-09-13T05:14:12.019313+0000","last_undegraded":"2024-09-13T05:14:12.019313+0000","last_fullsized":"2024-09-13T05:14:12.019313+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'642","last_scrub_stamp":"2024-09-13T05:14:12.019281+0000","last_deep_scrub":"223'642","last_deep_scrub_stamp":"2024-09-13T05:14:12.019281+0000","last_clean_scrub_stamp":"2024-09-13T05:14:12.019281+0000","objects_scrubbed":48,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:41:25.191485+0000","scrub_duration":0.047093986999999997,"objects_trimmed":0,"snaptrim_duration":0.001813283,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":48,"num_read":7291,"num_read_kb":29056,"num_write":470,"num_write_kb":7007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":364,"num_bytes_recovered":7851183,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:17.041576+0000","last_change":"2024-09-13T05:14:17.041891+0000","last_active":"2024-09-13T05:14:17.041576+0000","last_peered":"2024-09-13T05:14:17.041576+0000","last_clean":"2024-09-13T05:14:17.041576+0000","last_became_active":"2024-09-13T05:13:14.650955+0000","last_became_peered":"2024-09-13T05:13:14.650955+0000","last_unstale":"2024-09-13T05:14:17.041576+0000","last_undegraded":"2024-09-13T05:14:17.041576+0000","last_fullsized":"2024-09-13T05:14:17.041576+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:14:17.041527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:14:17.041527+0000","last_clean_scrub_stamp":"2024-09-13T05:14:17.041527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:18:55.276964+0000","scrub_duration":0.0033014730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"223'777","reported_seq":9124,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:08.713435+0000","last_change":"2024-09-13T05:14:08.713592+0000","last_active":"2024-09-13T05:14:08.713435+0000","last_peered":"2024-09-13T05:14:08.713435+0000","last_clean":"2024-09-13T05:14:08.713435+0000","last_became_active":"2024-09-13T05:13:41.854863+0000","last_became_peered":"2024-09-13T05:13:41.854863+0000","last_unstale":"2024-09-13T05:14:08.713435+0000","last_undegraded":"2024-09-13T05:14:08.713435+0000","last_fullsized":"2024-09-13T05:14:08.713435+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'777","last_scrub_stamp":"2024-09-13T05:14:08.713411+0000","last_deep_scrub":"223'777","last_deep_scrub_stamp":"2024-09-13T05:14:08.713411+0000","last_clean_scrub_stamp":"2024-09-13T05:14:08.713411+0000","objects_scrubbed":49,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:55:48.828924+0000","scrub_duration":0.045022053999999999,"objects_trimmed":0,"snaptrim_duration":0.0013617600000000001,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":49,"num_read":8371,"num_read_kb":18309,"num_write":603,"num_write_kb":8603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":704,"num_bytes_recovered":23835437,"num_keys_recovered":90,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":155,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:13.799096+0000","last_change":"2024-09-13T05:14:13.799096+0000","last_active":"2024-09-13T05:14:13.799096+0000","last_peered":"2024-09-13T05:14:13.799096+0000","last_clean":"2024-09-13T05:14:13.799096+0000","last_became_active":"2024-09-13T05:13:14.651157+0000","last_became_peered":"2024-09-13T05:13:14.651157+0000","last_unstale":"2024-09-13T05:14:13.799096+0000","last_undegraded":"2024-09-13T05:14:13.799096+0000","last_fullsized":"2024-09-13T05:14:13.799096+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:14:13.798640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:14:13.798640+0000","last_clean_scrub_stamp":"2024-09-13T05:14:13.798640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:18:28.752060+0000","scrub_duration":0.0038287320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"223'653","reported_seq":6090,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:11.816061+0000","last_change":"2024-09-13T05:14:11.816061+0000","last_active":"2024-09-13T05:14:11.816061+0000","last_peered":"2024-09-13T05:14:11.816061+0000","last_clean":"2024-09-13T05:14:11.816061+0000","last_became_active":"2024-09-13T05:10:09.645876+0000","last_became_peered":"2024-09-13T05:10:09.645876+0000","last_unstale":"2024-09-13T05:14:11.816061+0000","last_undegraded":"2024-09-13T05:14:11.816061+0000","last_fullsized":"2024-09-13T05:14:11.816061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'653","last_scrub_stamp":"2024-09-13T05:14:11.815911+0000","last_deep_scrub":"223'653","last_deep_scrub_stamp":"2024-09-13T05:14:11.815911+0000","last_clean_scrub_stamp":"2024-09-13T05:14:11.815911+0000","objects_scrubbed":54,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:22:38.495549+0000","scrub_duration":0.055111746000000003,"objects_trimmed":0,"snaptrim_duration":0.0025976440000000001,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":54,"num_read":5378,"num_read_kb":14806,"num_write":465,"num_write_kb":5134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":264,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:12.443899+0000","last_change":"2024-09-13T05:14:12.444162+0000","last_active":"2024-09-13T05:14:12.443899+0000","last_peered":"2024-09-13T05:14:12.443899+0000","last_clean":"2024-09-13T05:14:12.443899+0000","last_became_active":"2024-09-13T05:13:37.803889+0000","last_became_peered":"2024-09-13T05:13:37.803889+0000","last_unstale":"2024-09-13T05:14:12.443899+0000","last_undegraded":"2024-09-13T05:14:12.443899+0000","last_fullsized":"2024-09-13T05:14:12.443899+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:14:12.443854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:14:12.443854+0000","last_clean_scrub_stamp":"2024-09-13T05:14:12.443854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:04:31.876721+0000","scrub_duration":0.0033538589999999998,"objects_trimmed":0,"snaptrim_duration":0.00055634499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"223'758","reported_seq":1934,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:06.888225+0000","last_change":"2024-09-13T05:14:06.888225+0000","last_active":"2024-09-13T05:14:06.888225+0000","last_peered":"2024-09-13T05:14:06.888225+0000","last_clean":"2024-09-13T05:14:06.888225+0000","last_became_active":"2024-09-13T05:12:09.627485+0000","last_became_peered":"2024-09-13T05:12:09.627485+0000","last_unstale":"2024-09-13T05:14:06.888225+0000","last_undegraded":"2024-09-13T05:14:06.888225+0000","last_fullsized":"2024-09-13T05:14:06.888225+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'758","last_scrub_stamp":"2024-09-13T05:14:06.887992+0000","last_deep_scrub":"223'758","last_deep_scrub_stamp":"2024-09-13T05:14:06.887992+0000","last_clean_scrub_stamp":"2024-09-13T05:14:06.887992+0000","objects_scrubbed":47,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:40:15.437641+0000","scrub_duration":0.049205615000000001,"objects_trimmed":0,"snaptrim_duration":0.001363632,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":1702,"num_read_kb":4638,"num_write":789,"num_write_kb":10312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":352,"num_bytes_recovered":5263836,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:14.790166+0000","last_change":"2024-09-13T05:14:14.790508+0000","last_active":"2024-09-13T05:14:14.790166+0000","last_peered":"2024-09-13T05:14:14.790166+0000","last_clean":"2024-09-13T05:14:14.790166+0000","last_became_active":"2024-09-13T05:13:37.803639+0000","last_became_peered":"2024-09-13T05:13:37.803639+0000","last_unstale":"2024-09-13T05:14:14.790166+0000","last_undegraded":"2024-09-13T05:14:14.790166+0000","last_fullsized":"2024-09-13T05:14:14.790166+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:14:14.790073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:14:14.790073+0000","last_clean_scrub_stamp":"2024-09-13T05:14:14.790073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:18:01.197298+0000","scrub_duration":0.0030052,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"223'775","reported_seq":5849,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:13.366756+0000","last_change":"2024-09-13T05:14:13.366756+0000","last_active":"2024-09-13T05:14:13.366756+0000","last_peered":"2024-09-13T05:14:13.366756+0000","last_clean":"2024-09-13T05:14:13.366756+0000","last_became_active":"2024-09-13T05:10:09.646295+0000","last_became_peered":"2024-09-13T05:10:09.646295+0000","last_unstale":"2024-09-13T05:14:13.366756+0000","last_undegraded":"2024-09-13T05:14:13.366756+0000","last_fullsized":"2024-09-13T05:14:13.366756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'775","last_scrub_stamp":"2024-09-13T05:14:13.366571+0000","last_deep_scrub":"223'775","last_deep_scrub_stamp":"2024-09-13T05:14:13.366571+0000","last_clean_scrub_stamp":"2024-09-13T05:14:13.366571+0000","objects_scrubbed":41,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:10:01.918944+0000","scrub_duration":0.051205701999999999,"objects_trimmed":0,"snaptrim_duration":0.0035228970000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":7406,"num_read_kb":59728,"num_write":628,"num_write_kb":55671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"223'1191","reported_seq":5822,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:10.062098+0000","last_change":"2024-09-13T05:14:10.062098+0000","last_active":"2024-09-13T05:14:10.062098+0000","last_peered":"2024-09-13T05:14:10.062098+0000","last_clean":"2024-09-13T05:14:10.062098+0000","last_became_active":"2024-09-13T05:13:46.664160+0000","last_became_peered":"2024-09-13T05:13:46.664160+0000","last_unstale":"2024-09-13T05:14:10.062098+0000","last_undegraded":"2024-09-13T05:14:10.062098+0000","last_fullsized":"2024-09-13T05:14:10.062098+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'1191","last_scrub_stamp":"2024-09-13T05:14:10.061959+0000","last_deep_scrub":"223'1191","last_deep_scrub_stamp":"2024-09-13T05:14:10.061959+0000","last_clean_scrub_stamp":"2024-09-13T05:14:10.061959+0000","objects_scrubbed":57,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:33.526323+0000","scrub_duration":0.057549841999999997,"objects_trimmed":0,"snaptrim_duration":0.0026890410000000001,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":56,"num_read":4911,"num_read_kb":30667,"num_write":1235,"num_write_kb":50371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":996,"num_bytes_recovered":31453269,"num_keys_recovered":34,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"223'3","reported_seq":261,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:29.387979+0000","last_change":"2024-09-13T05:14:29.388292+0000","last_active":"2024-09-13T05:14:29.387979+0000","last_peered":"2024-09-13T05:14:29.387979+0000","last_clean":"2024-09-13T05:14:29.387979+0000","last_became_active":"2024-09-13T05:13:31.749063+0000","last_became_peered":"2024-09-13T05:13:31.749063+0000","last_unstale":"2024-09-13T05:14:29.387979+0000","last_undegraded":"2024-09-13T05:14:29.387979+0000","last_fullsized":"2024-09-13T05:14:29.387979+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'3","last_scrub_stamp":"2024-09-13T05:14:29.387877+0000","last_deep_scrub":"223'3","last_deep_scrub_stamp":"2024-09-13T05:14:29.387877+0000","last_clean_scrub_stamp":"2024-09-13T05:14:29.387877+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:55:57.942477+0000","scrub_duration":0.0068659519999999998,"objects_trimmed":0,"snaptrim_duration":0.0012276699999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"223'852","reported_seq":1851,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:07.915202+0000","last_change":"2024-09-13T05:14:07.915357+0000","last_active":"2024-09-13T05:14:07.915202+0000","last_peered":"2024-09-13T05:14:07.915202+0000","last_clean":"2024-09-13T05:14:07.915202+0000","last_became_active":"2024-09-13T05:12:07.930334+0000","last_became_peered":"2024-09-13T05:12:07.930334+0000","last_unstale":"2024-09-13T05:14:07.915202+0000","last_undegraded":"2024-09-13T05:14:07.915202+0000","last_fullsized":"2024-09-13T05:14:07.915202+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'852","last_scrub_stamp":"2024-09-13T05:14:07.915158+0000","last_deep_scrub":"223'852","last_deep_scrub_stamp":"2024-09-13T05:14:07.915158+0000","last_clean_scrub_stamp":"2024-09-13T05:14:07.915158+0000","objects_scrubbed":55,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:18:40.380605+0000","scrub_duration":0.052184530999999999,"objects_trimmed":0,"snaptrim_duration":0.00096036500000000003,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":55,"num_read":2051,"num_read_kb":3594,"num_write":735,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":1243867,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":232,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:08.329149+0000","last_change":"2024-09-13T05:14:08.329149+0000","last_active":"2024-09-13T05:14:08.329149+0000","last_peered":"2024-09-13T05:14:08.329149+0000","last_clean":"2024-09-13T05:14:08.329149+0000","last_became_active":"2024-09-13T05:09:59.558171+0000","last_became_peered":"2024-09-13T05:09:59.558171+0000","last_unstale":"2024-09-13T05:14:08.329149+0000","last_undegraded":"2024-09-13T05:14:08.329149+0000","last_fullsized":"2024-09-13T05:14:08.329149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:14:08.328836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:14:08.328836+0000","last_clean_scrub_stamp":"2024-09-13T05:14:08.328836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:45.203439+0000","scrub_duration":0.0029189179999999999,"objects_trimmed":0,"snaptrim_duration":0.00081062199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"223'1058","reported_seq":5363,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:16.600624+0000","last_change":"2024-09-13T05:14:16.600750+0000","last_active":"2024-09-13T05:14:16.600624+0000","last_peered":"2024-09-13T05:14:16.600624+0000","last_clean":"2024-09-13T05:14:16.600624+0000","last_became_active":"2024-09-13T05:13:46.663849+0000","last_became_peered":"2024-09-13T05:13:46.663849+0000","last_unstale":"2024-09-13T05:14:16.600624+0000","last_undegraded":"2024-09-13T05:14:16.600624+0000","last_fullsized":"2024-09-13T05:14:16.600624+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'1058","last_scrub_stamp":"2024-09-13T05:14:16.600601+0000","last_deep_scrub":"223'1058","last_deep_scrub_stamp":"2024-09-13T05:14:16.600601+0000","last_clean_scrub_stamp":"2024-09-13T05:14:16.600601+0000","objects_scrubbed":42,"log_size":1058,"log_dups_size":0,"ondisk_log_size":1058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:13.826887+0000","scrub_duration":0.052010413999999998,"objects_trimmed":2,"snaptrim_duration":0.0078035550000000002,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":6441,"num_read_kb":19916,"num_write":1291,"num_write_kb":12451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":408,"num_bytes_recovered":8416446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":256,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:11.396819+0000","last_change":"2024-09-13T05:14:11.397184+0000","last_active":"2024-09-13T05:14:11.396819+0000","last_peered":"2024-09-13T05:14:11.396819+0000","last_clean":"2024-09-13T05:14:11.396819+0000","last_became_active":"2024-09-13T05:12:03.635929+0000","last_became_peered":"2024-09-13T05:12:03.635929+0000","last_unstale":"2024-09-13T05:14:11.396819+0000","last_undegraded":"2024-09-13T05:14:11.396819+0000","last_fullsized":"2024-09-13T05:14:11.396819+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T05:14:11.396772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T05:14:11.396772+0000","last_clean_scrub_stamp":"2024-09-13T05:14:11.396772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:20:03.843383+0000","scrub_duration":0.0032135219999999999,"objects_trimmed":0,"snaptrim_duration":0.00064316700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"223'761","reported_seq":3730,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:19.038794+0000","last_change":"2024-09-13T05:14:19.038929+0000","last_active":"2024-09-13T05:14:19.038794+0000","last_peered":"2024-09-13T05:14:19.038794+0000","last_clean":"2024-09-13T05:14:19.038794+0000","last_became_active":"2024-09-13T05:13:18.651382+0000","last_became_peered":"2024-09-13T05:13:18.651382+0000","last_unstale":"2024-09-13T05:14:19.038794+0000","last_undegraded":"2024-09-13T05:14:19.038794+0000","last_fullsized":"2024-09-13T05:14:19.038794+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'761","last_scrub_stamp":"2024-09-13T05:14:19.038766+0000","last_deep_scrub":"223'761","last_deep_scrub_stamp":"2024-09-13T05:14:19.038766+0000","last_clean_scrub_stamp":"2024-09-13T05:14:19.038766+0000","objects_scrubbed":50,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:17:49.259978+0000","scrub_duration":0.049302779999999997,"objects_trimmed":0,"snaptrim_duration":0.000842029,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":50,"num_read":5402,"num_read_kb":12408,"num_write":632,"num_write_kb":8370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":367,"num_bytes_recovered":3415864,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"223'2","reported_seq":235,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:10.417574+0000","last_change":"2024-09-13T05:14:10.417574+0000","last_active":"2024-09-13T05:14:10.417574+0000","last_peered":"2024-09-13T05:14:10.417574+0000","last_clean":"2024-09-13T05:14:10.417574+0000","last_became_active":"2024-09-13T05:09:59.372024+0000","last_became_peered":"2024-09-13T05:09:59.372024+0000","last_unstale":"2024-09-13T05:14:10.417574+0000","last_undegraded":"2024-09-13T05:14:10.417574+0000","last_fullsized":"2024-09-13T05:14:10.417574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'2","last_scrub_stamp":"2024-09-13T05:14:10.417246+0000","last_deep_scrub":"223'2","last_deep_scrub_stamp":"2024-09-13T05:14:10.417246+0000","last_clean_scrub_stamp":"2024-09-13T05:14:10.417246+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:58:29.663144+0000","scrub_duration":0.0059471239999999998,"objects_trimmed":0,"snaptrim_duration":0.00078257000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"223'119","reported_seq":466,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:10.387793+0000","last_change":"2024-09-13T05:14:10.388077+0000","last_active":"2024-09-13T05:14:10.387793+0000","last_peered":"2024-09-13T05:14:10.387793+0000","last_clean":"2024-09-13T05:14:10.387793+0000","last_became_active":"2024-09-13T05:13:41.857228+0000","last_became_peered":"2024-09-13T05:13:41.857228+0000","last_unstale":"2024-09-13T05:14:10.387793+0000","last_undegraded":"2024-09-13T05:14:10.387793+0000","last_fullsized":"2024-09-13T05:14:10.387793+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'119","last_scrub_stamp":"2024-09-13T05:14:10.387681+0000","last_deep_scrub":"223'119","last_deep_scrub_stamp":"2024-09-13T05:14:10.387681+0000","last_clean_scrub_stamp":"2024-09-13T05:14:10.387681+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:50.066569+0000","scrub_duration":0.0099498769999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"223'715","reported_seq":17300,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:09.893811+0000","last_change":"2024-09-13T05:14:09.893811+0000","last_active":"2024-09-13T05:14:09.893811+0000","last_peered":"2024-09-13T05:14:09.893811+0000","last_clean":"2024-09-13T05:14:09.893811+0000","last_became_active":"2024-09-13T05:12:12.653214+0000","last_became_peered":"2024-09-13T05:12:12.653214+0000","last_unstale":"2024-09-13T05:14:09.893811+0000","last_undegraded":"2024-09-13T05:14:09.893811+0000","last_fullsized":"2024-09-13T05:14:09.893811+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'715","last_scrub_stamp":"2024-09-13T05:14:09.893680+0000","last_deep_scrub":"223'715","last_deep_scrub_stamp":"2024-09-13T05:14:09.893680+0000","last_clean_scrub_stamp":"2024-09-13T05:14:09.893680+0000","objects_scrubbed":57,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:32:19.071750+0000","scrub_duration":0.048042416999999997,"objects_trimmed":0,"snaptrim_duration":0.00090748800000000002,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":57,"num_read":16644,"num_read_kb":16716,"num_write":498,"num_write_kb":27916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":2876772,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"223'943","reported_seq":9268,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:14.034921+0000","last_change":"2024-09-13T05:14:14.034921+0000","last_active":"2024-09-13T05:14:14.034921+0000","last_peered":"2024-09-13T05:14:14.034921+0000","last_clean":"2024-09-13T05:14:14.034921+0000","last_became_active":"2024-09-13T05:12:41.912780+0000","last_became_peered":"2024-09-13T05:12:41.912780+0000","last_unstale":"2024-09-13T05:14:14.034921+0000","last_undegraded":"2024-09-13T05:14:14.034921+0000","last_fullsized":"2024-09-13T05:14:14.034921+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'943","last_scrub_stamp":"2024-09-13T05:14:14.034751+0000","last_deep_scrub":"223'943","last_deep_scrub_stamp":"2024-09-13T05:14:14.034751+0000","last_clean_scrub_stamp":"2024-09-13T05:14:14.034751+0000","objects_scrubbed":42,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:25:22.775334+0000","scrub_duration":0.049265241000000001,"objects_trimmed":0,"snaptrim_duration":0.0018089219999999999,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":11722,"num_read_kb":25826,"num_write":890,"num_write_kb":20361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":5657687,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"223'888","reported_seq":11249,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:24.047601+0000","last_change":"2024-09-13T05:14:24.047715+0000","last_active":"2024-09-13T05:14:24.047601+0000","last_peered":"2024-09-13T05:14:24.047601+0000","last_clean":"2024-09-13T05:14:24.047601+0000","last_became_active":"2024-09-13T05:10:47.939220+0000","last_became_peered":"2024-09-13T05:10:47.939220+0000","last_unstale":"2024-09-13T05:14:24.047601+0000","last_undegraded":"2024-09-13T05:14:24.047601+0000","last_fullsized":"2024-09-13T05:14:24.047601+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'888","last_scrub_stamp":"2024-09-13T05:14:24.047576+0000","last_deep_scrub":"223'888","last_deep_scrub_stamp":"2024-09-13T05:14:24.047576+0000","last_clean_scrub_stamp":"2024-09-13T05:14:24.047576+0000","objects_scrubbed":53,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:12:23.995245+0000","scrub_duration":0.056922042999999999,"objects_trimmed":0,"snaptrim_duration":0.0032813690000000001,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":52,"num_read":11243,"num_read_kb":19806,"num_write":773,"num_write_kb":9910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":59,"num_bytes_recovered":6203954,"num_keys_recovered":18,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"223'755","reported_seq":8074,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:16.952359+0000","last_change":"2024-09-13T05:14:16.952498+0000","last_active":"2024-09-13T05:14:16.952359+0000","last_peered":"2024-09-13T05:14:16.952359+0000","last_clean":"2024-09-13T05:14:16.952359+0000","last_became_active":"2024-09-13T05:13:44.659181+0000","last_became_peered":"2024-09-13T05:13:44.659181+0000","last_unstale":"2024-09-13T05:14:16.952359+0000","last_undegraded":"2024-09-13T05:14:16.952359+0000","last_fullsized":"2024-09-13T05:14:16.952359+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'755","last_scrub_stamp":"2024-09-13T05:14:16.952336+0000","last_deep_scrub":"223'755","last_deep_scrub_stamp":"2024-09-13T05:14:16.952336+0000","last_clean_scrub_stamp":"2024-09-13T05:14:16.952336+0000","objects_scrubbed":52,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:55:44.610374+0000","scrub_duration":0.058258270000000001,"objects_trimmed":0,"snaptrim_duration":0.001538939,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":7215,"num_read_kb":12852,"num_write":549,"num_write_kb":8612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":652,"num_bytes_recovered":7231372,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"223'748","reported_seq":2741,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:31.403095+0000","last_change":"2024-09-13T05:14:31.403095+0000","last_active":"2024-09-13T05:14:31.403095+0000","last_peered":"2024-09-13T05:14:31.403095+0000","last_clean":"2024-09-13T05:14:31.403095+0000","last_became_active":"2024-09-13T05:13:31.750969+0000","last_became_peered":"2024-09-13T05:13:31.750969+0000","last_unstale":"2024-09-13T05:14:31.403095+0000","last_undegraded":"2024-09-13T05:14:31.403095+0000","last_fullsized":"2024-09-13T05:14:31.403095+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'748","last_scrub_stamp":"2024-09-13T05:14:31.402931+0000","last_deep_scrub":"223'748","last_deep_scrub_stamp":"2024-09-13T05:14:31.402931+0000","last_clean_scrub_stamp":"2024-09-13T05:14:31.402931+0000","objects_scrubbed":45,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:29:53.145752+0000","scrub_duration":0.049196993000000001,"objects_trimmed":0,"snaptrim_duration":0.0026184060000000002,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":45,"num_read":2965,"num_read_kb":14716,"num_write":786,"num_write_kb":19816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"223'908","reported_seq":4810,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:20.495695+0000","last_change":"2024-09-13T05:14:20.495695+0000","last_active":"2024-09-13T05:14:20.495695+0000","last_peered":"2024-09-13T05:14:20.495695+0000","last_clean":"2024-09-13T05:14:20.495695+0000","last_became_active":"2024-09-13T05:11:23.616962+0000","last_became_peered":"2024-09-13T05:11:23.616962+0000","last_unstale":"2024-09-13T05:14:20.495695+0000","last_undegraded":"2024-09-13T05:14:20.495695+0000","last_fullsized":"2024-09-13T05:14:20.495695+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'908","last_scrub_stamp":"2024-09-13T05:14:20.495498+0000","last_deep_scrub":"223'908","last_deep_scrub_stamp":"2024-09-13T05:14:20.495498+0000","last_clean_scrub_stamp":"2024-09-13T05:14:20.495498+0000","objects_scrubbed":47,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:21:40.990911+0000","scrub_duration":0.054461117000000003,"objects_trimmed":0,"snaptrim_duration":0.0024761649999999998,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":5259,"num_read_kb":15611,"num_write":930,"num_write_kb":9177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":12781016,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"223'1237","reported_seq":9670,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:37.480581+0000","last_change":"2024-09-13T05:14:37.480581+0000","last_active":"2024-09-13T05:14:37.480581+0000","last_peered":"2024-09-13T05:14:37.480581+0000","last_clean":"2024-09-13T05:14:37.480581+0000","last_became_active":"2024-09-13T05:12:46.655973+0000","last_became_peered":"2024-09-13T05:12:46.655973+0000","last_unstale":"2024-09-13T05:14:37.480581+0000","last_undegraded":"2024-09-13T05:14:37.480581+0000","last_fullsized":"2024-09-13T05:14:37.480581+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'1237","last_scrub_stamp":"2024-09-13T05:14:37.480387+0000","last_deep_scrub":"223'1237","last_deep_scrub_stamp":"2024-09-13T05:14:37.480387+0000","last_clean_scrub_stamp":"2024-09-13T05:14:37.480387+0000","objects_scrubbed":57,"log_size":1237,"log_dups_size":0,"ondisk_log_size":1237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:10:12.608510+0000","scrub_duration":0.065882240999999994,"objects_trimmed":0,"snaptrim_duration":0.0022750969999999998,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":57,"num_read":10231,"num_read_kb":11540,"num_write":1521,"num_write_kb":6908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":612,"num_bytes_recovered":16479322,"num_keys_recovered":78,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"223'1010","reported_seq":7378,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:42.567902+0000","last_change":"2024-09-13T05:14:42.568010+0000","last_active":"2024-09-13T05:14:42.567902+0000","last_peered":"2024-09-13T05:14:42.567902+0000","last_clean":"2024-09-13T05:14:42.567902+0000","last_became_active":"2024-09-13T05:12:45.651313+0000","last_became_peered":"2024-09-13T05:12:45.651313+0000","last_unstale":"2024-09-13T05:14:42.567902+0000","last_undegraded":"2024-09-13T05:14:42.567902+0000","last_fullsized":"2024-09-13T05:14:42.567902+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'1010","last_scrub_stamp":"2024-09-13T05:14:42.567883+0000","last_deep_scrub":"223'1010","last_deep_scrub_stamp":"2024-09-13T05:14:42.567883+0000","last_clean_scrub_stamp":"2024-09-13T05:14:42.567883+0000","objects_scrubbed":60,"log_size":1010,"log_dups_size":0,"ondisk_log_size":1010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:07:04.451063+0000","scrub_duration":0.071333287999999995,"objects_trimmed":0,"snaptrim_duration":0.0026155729999999999,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":7680,"num_read_kb":14250,"num_write":1094,"num_write_kb":7822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":7824116,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"223'785","reported_seq":4276,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:24.081932+0000","last_change":"2024-09-13T05:14:24.082063+0000","last_active":"2024-09-13T05:14:24.081932+0000","last_peered":"2024-09-13T05:14:24.081932+0000","last_clean":"2024-09-13T05:14:24.081932+0000","last_became_active":"2024-09-13T05:13:42.865327+0000","last_became_peered":"2024-09-13T05:13:42.865327+0000","last_unstale":"2024-09-13T05:14:24.081932+0000","last_undegraded":"2024-09-13T05:14:24.081932+0000","last_fullsized":"2024-09-13T05:14:24.081932+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'785","last_scrub_stamp":"2024-09-13T05:14:24.081912+0000","last_deep_scrub":"223'785","last_deep_scrub_stamp":"2024-09-13T05:14:24.081912+0000","last_clean_scrub_stamp":"2024-09-13T05:14:24.081912+0000","objects_scrubbed":60,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:26:54.259365+0000","scrub_duration":0.059603250000000003,"objects_trimmed":0,"snaptrim_duration":0.00070392800000000004,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":3644,"num_read_kb":16917,"num_write":678,"num_write_kb":24247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":802,"num_bytes_recovered":33560838,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"223'597","reported_seq":9717,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:18.528572+0000","last_change":"2024-09-13T05:14:18.528717+0000","last_active":"2024-09-13T05:14:18.528572+0000","last_peered":"2024-09-13T05:14:18.528572+0000","last_clean":"2024-09-13T05:14:18.528572+0000","last_became_active":"2024-09-13T05:12:42.936456+0000","last_became_peered":"2024-09-13T05:12:42.936456+0000","last_unstale":"2024-09-13T05:14:18.528572+0000","last_undegraded":"2024-09-13T05:14:18.528572+0000","last_fullsized":"2024-09-13T05:14:18.528572+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'597","last_scrub_stamp":"2024-09-13T05:14:18.528547+0000","last_deep_scrub":"223'597","last_deep_scrub_stamp":"2024-09-13T05:14:18.528547+0000","last_clean_scrub_stamp":"2024-09-13T05:14:18.528547+0000","objects_scrubbed":60,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:30:39.124458+0000","scrub_duration":0.062744953000000006,"objects_trimmed":0,"snaptrim_duration":0.0018319619999999999,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":8115,"num_read_kb":13498,"num_write":403,"num_write_kb":21128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":380,"num_bytes_recovered":20462375,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"223'1137","reported_seq":6523,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:18.589939+0000","last_change":"2024-09-13T05:14:18.590071+0000","last_active":"2024-09-13T05:14:18.589939+0000","last_peered":"2024-09-13T05:14:18.589939+0000","last_clean":"2024-09-13T05:14:18.589939+0000","last_became_active":"2024-09-13T05:13:46.665575+0000","last_became_peered":"2024-09-13T05:13:46.665575+0000","last_unstale":"2024-09-13T05:14:18.589939+0000","last_undegraded":"2024-09-13T05:14:18.589939+0000","last_fullsized":"2024-09-13T05:14:18.589939+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'1137","last_scrub_stamp":"2024-09-13T05:14:18.589914+0000","last_deep_scrub":"223'1137","last_deep_scrub_stamp":"2024-09-13T05:14:18.589914+0000","last_clean_scrub_stamp":"2024-09-13T05:14:18.589914+0000","objects_scrubbed":47,"log_size":1137,"log_dups_size":0,"ondisk_log_size":1137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:19:54.372122+0000","scrub_duration":0.050029977000000003,"objects_trimmed":2,"snaptrim_duration":0.006060307,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":9137,"num_read_kb":27013,"num_write":1266,"num_write_kb":8578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":633324,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"223'1401","reported_seq":5538,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-13T05:14:28.533859+0000","last_change":"2024-09-13T05:14:28.534001+0000","last_active":"2024-09-13T05:14:28.533859+0000","last_peered":"2024-09-13T05:14:28.533859+0000","last_clean":"2024-09-13T05:14:28.533859+0000","last_became_active":"2024-09-13T05:12:48.638127+0000","last_became_peered":"2024-09-13T05:12:48.638127+0000","last_unstale":"2024-09-13T05:14:28.533859+0000","last_undegraded":"2024-09-13T05:14:28.533859+0000","last_fullsized":"2024-09-13T05:14:28.533859+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'1401","last_scrub_stamp":"2024-09-13T05:14:28.533828+0000","last_deep_scrub":"223'1401","last_deep_scrub_stamp":"2024-09-13T05:14:28.533828+0000","last_clean_scrub_stamp":"2024-09-13T05:14:28.533828+0000","objects_scrubbed":52,"log_size":1401,"log_dups_size":0,"ondisk_log_size":1401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:47:52.564980+0000","scrub_duration":0.061363016999999999,"objects_trimmed":0,"snaptrim_duration":0.001070477,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":7844,"num_read_kb":55094,"num_write":1803,"num_write_kb":40168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":20884522,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":1622,"num_object_clones":0,"num_object_copies":3244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1622,"num_whiteouts":1618,"num_read":258414,"num_read_kb":631830,"num_write":28490,"num_write_kb":532665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11025,"num_bytes_recovered":280109913,"num_keys_recovered":906,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3756,"internal_metadata":0},"log_size":28697,"ondisk_log_size":28697,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574913,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110616,"kb_used_data":3216,"kb_used_omap":1,"kb_used_meta":107390,"kb_avail":94261224,"statfs":{"total":96636764160,"available":96523493376,"internally_reserved":0,"allocated":3293184,"data_stored":1898733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":109967819},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:14:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77400000000000002,"15min":0.78200000000000003},"min":{"1min":0.53900000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.054,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.877,"5min":0.86299999999999999,"15min":0.86099999999999999},"min":{"1min":0.57799999999999996,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":1.0409999999999999}]},{"osd":1,"last update":"Fri Sep 13 05:14:04 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.82999999999999996,"15min":0.82599999999999996},"min":{"1min":0.63400000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1419999999999999,"5min":1.238,"15min":1.238},"last":1.085},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.85399999999999998,"15min":0.81200000000000006},"min":{"1min":0.61499999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.196,"5min":1.982,"15min":1.982},"last":1.1579999999999999}]},{"osd":2,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.84899999999999998,"15min":0.85399999999999998},"min":{"1min":0.67600000000000005,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1519999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.056,"5min":0.90200000000000002,"15min":0.81499999999999995},"min":{"1min":0.94399999999999995,"5min":0.433,"15min":0.433},"max":{"1min":1.262,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.1040000000000001}]},{"osd":3,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.98199999999999998,"15min":0.90500000000000003},"min":{"1min":0.54000000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2749999999999999,"5min":12.663,"15min":12.663},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.90000000000000002,"15min":0.90400000000000003},"min":{"1min":0.73199999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1799999999999999,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.86499999999999999}]},{"osd":4,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81100000000000005,"15min":0.77900000000000003},"min":{"1min":0.58699999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.365,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.91000000000000003,"15min":0.92500000000000004},"min":{"1min":0.48999999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.216,"5min":2.02,"15min":2.02},"last":0.80700000000000005}]},{"osd":5,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.95799999999999996,"15min":0.95199999999999996},"min":{"1min":0.63900000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.246,"5min":1.655,"15min":1.655},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.96399999999999997,"15min":0.95099999999999996},"min":{"1min":0.66100000000000003,"5min":0.499,"15min":0.499},"max":{"1min":1.306,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.92400000000000004}]},{"osd":6,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93300000000000005,"15min":0.91900000000000004},"min":{"1min":0.76200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.381,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.002,"5min":1.042,"15min":1.038},"min":{"1min":0.76900000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3240000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.89600000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59988,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311852,"statfs":{"total":96636764160,"available":96575336448,"internally_reserved":0,"allocated":2699264,"data_stored":1308365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58718663},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:14:20 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.83999999999999997,"15min":0.84299999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1639999999999999,"5min":1.359,"15min":1.359},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.76800000000000002,"15min":0.76200000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":1.2270000000000001}]},{"osd":1,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.85399999999999998,"15min":0.873},"min":{"1min":0.51900000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82399999999999995,"15min":0.85499999999999998},"min":{"1min":0.46500000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.3009999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.73199999999999998}]},{"osd":2,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.79500000000000004,"15min":0.77600000000000002},"min":{"1min":0.58299999999999996,"5min":0.312,"15min":0.312},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":1.101},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.93799999999999994,"15min":0.96599999999999997},"min":{"1min":0.42499999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.383,"5min":1.49,"15min":1.49},"last":0.70099999999999996}]},{"osd":3,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90700000000000003,"15min":0.93799999999999994},"min":{"1min":0.65800000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.5489999999999999,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.93000000000000005,"15min":0.93500000000000005},"min":{"1min":0.80400000000000005,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":1.274}]},{"osd":4,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.93899999999999995,"15min":0.95999999999999996},"min":{"1min":0.47399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.456,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.95299999999999996,"15min":0.98699999999999999},"min":{"1min":0.55500000000000005,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.274,"5min":2.056,"15min":2.056},"last":0.82299999999999995}]},{"osd":5,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.68300000000000005,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.173},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.0800000000000001,"15min":1.0980000000000001},"min":{"1min":0.69899999999999995,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.087}]},{"osd":7,"last update":"Fri Sep 13 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0620000000000001,"15min":1.101},"min":{"1min":0.748,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3120000000000001,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.0740000000000001,"15min":1.0820000000000001},"min":{"1min":0.82099999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.131}]}]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65752,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306088,"statfs":{"total":96636764160,"available":96569434112,"internally_reserved":0,"allocated":2703360,"data_stored":1308384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:14:19 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.72999999999999998,"15min":0.71399999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.753,"15min":0.753},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.55400000000000005}]},{"osd":1,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.83599999999999997,"15min":0.872},"min":{"1min":0.53700000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1619999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.873,"5min":0.86399999999999999,"15min":0.90900000000000003},"min":{"1min":0.61299999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.145,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.80000000000000004}]},{"osd":2,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.81699999999999995,"15min":0.84499999999999997},"min":{"1min":0.40600000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1519999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.90000000000000002,"15min":0.89800000000000002},"min":{"1min":0.59999999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.94799999999999995}]},{"osd":3,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.85499999999999998,"15min":0.91100000000000003},"min":{"1min":0.58299999999999996,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1180000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.93200000000000005,"15min":1.0009999999999999},"min":{"1min":0.64900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.294,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.622}]},{"osd":4,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.878,"15min":0.94499999999999995},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1830000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.016,"15min":1.0920000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.333,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.75800000000000001}]},{"osd":6,"last update":"Fri Sep 13 05:14:07 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.94899999999999995,"15min":0.95699999999999996},"min":{"1min":0.42499999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3879999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.98199999999999998,"15min":1.0309999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.90300000000000002}]},{"osd":7,"last update":"Fri Sep 13 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0620000000000001,"15min":1.1639999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.244,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.101,"15min":1.1559999999999999},"min":{"1min":0.47399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.4590000000000001,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.006}]}]},{"osd":4,"up_from":13,"seq":55834574913,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41944,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94329896,"statfs":{"total":96636764160,"available":96593813504,"internally_reserved":0,"allocated":2703360,"data_stored":1308384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:14:20 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.76000000000000001,"15min":0.74399999999999999},"min":{"1min":0.48899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.85899999999999999,"15min":0.83999999999999997},"min":{"1min":0.74399999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.85799999999999998}]},{"osd":1,"last update":"Fri Sep 13 05:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.748,"15min":0.752},"min":{"1min":0.41499999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.27,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.82699999999999996,"15min":0.90500000000000003},"min":{"1min":0.59099999999999997,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.73299999999999998}]},{"osd":2,"last update":"Fri Sep 13 05:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.91300000000000003,"15min":0.97099999999999997},"min":{"1min":0.51400000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.3109999999999999,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.98599999999999999,"15min":1.0649999999999999},"min":{"1min":0.55600000000000005,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1890000000000001,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.90700000000000003}]},{"osd":3,"last update":"Fri Sep 13 05:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.90200000000000002,"15min":0.91100000000000003},"min":{"1min":0.628,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1279999999999999,"5min":4.0609999999999999,"15min":4.0609999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.86799999999999999,"15min":0.90800000000000003},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1739999999999999,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.087}]},{"osd":5,"last update":"Fri Sep 13 05:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.86199999999999999,"15min":0.88400000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.181,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.94199999999999995,"5min":1.016,"15min":1.133},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4179999999999999,"5min":3.871,"15min":3.871},"last":0.81699999999999995}]},{"osd":6,"last update":"Fri Sep 13 05:14:02 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.03,"15min":1.1220000000000001},"min":{"1min":0.57299999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4890000000000001,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.93999999999999995,"15min":0.95599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3240000000000001,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":1.1439999999999999}]},{"osd":7,"last update":"Fri Sep 13 05:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.077,"15min":1.145},"min":{"1min":0.67700000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4670000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.077,"15min":1.099},"min":{"1min":0.70599999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.5660000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.234}]}]},{"osd":3,"up_from":13,"seq":55834574912,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47700,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324140,"statfs":{"total":96636764160,"available":96587919360,"internally_reserved":0,"allocated":2699264,"data_stored":1308365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:14:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.316,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.85399999999999998,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.68000000000000005,"15min":0.66500000000000004},"min":{"1min":0.50900000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.1459999999999999,"5min":1.353,"15min":1.353},"last":0.91700000000000004}]},{"osd":1,"last update":"Fri Sep 13 05:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.65300000000000002,"15min":0.66100000000000003},"min":{"1min":0.42999999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.095,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.66900000000000004,"15min":0.71399999999999997},"min":{"1min":0.43099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.78100000000000003}]},{"osd":2,"last update":"Fri Sep 13 05:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71499999999999997,"15min":0.73599999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1779999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.78400000000000003,"15min":0.83599999999999997},"min":{"1min":0.52600000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.145,"5min":1.573,"15min":1.573},"last":1.091}]},{"osd":4,"last update":"Fri Sep 13 05:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.84699999999999998,"15min":0.89300000000000002},"min":{"1min":0.44500000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.2589999999999999,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.89800000000000002,"15min":0.92900000000000005},"min":{"1min":0.72199999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.27,"5min":1.764,"15min":1.764},"last":0.98799999999999999}]},{"osd":5,"last update":"Fri Sep 13 05:14:03 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.91900000000000004,"15min":0.995},"min":{"1min":0.69799999999999995,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.153,"5min":2.157,"15min":2.157},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.91500000000000004,"15min":0.97899999999999998},"min":{"1min":0.501,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.552,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.81999999999999995}]},{"osd":6,"last update":"Fri Sep 13 05:14:03 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.94499999999999995,"15min":0.98099999999999998},"min":{"1min":0.65400000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6559999999999999,"5min":1.976,"15min":1.976},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.97999999999999998,"15min":1.0760000000000001},"min":{"1min":0.625,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.141,"5min":2.012,"15min":2.012},"last":1.02}]},{"osd":7,"last update":"Fri Sep 13 05:14:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.012,"15min":1.0720000000000001},"min":{"1min":0.59699999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.6319999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.105,"5min":1.0580000000000001,"15min":1.1000000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.673,"5min":1.875,"15min":1.875},"last":0.94199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69844,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94301996,"statfs":{"total":96636764160,"available":96565243904,"internally_reserved":0,"allocated":2699264,"data_stored":1308365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:14:20 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.63600000000000001,"15min":0.63700000000000001},"min":{"1min":0.33100000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.004,"5min":1.087,"15min":1.087},"last":0.747}]},{"osd":1,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64800000000000002,"15min":0.66800000000000004},"min":{"1min":0.40200000000000002,"5min":0.246,"15min":0.246},"max":{"1min":1.081,"5min":1.554,"15min":1.554},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64200000000000002,"15min":0.65400000000000003},"min":{"1min":0.40100000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0780000000000001,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.82599999999999996}]},{"osd":3,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67000000000000004,"15min":0.624},"min":{"1min":0.38300000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.002,"5min":6.6070000000000002,"15min":6.6070000000000002},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69499999999999995,"15min":0.66700000000000004},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.014,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.86199999999999999}]},{"osd":4,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.82299999999999995,"15min":0.78300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.464,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.90700000000000003,"15min":0.89800000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":1.117}]},{"osd":5,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.878,"15min":0.89400000000000002},"min":{"1min":0.48999999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.1099999999999999,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.026},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.89700000000000002,"15min":0.872},"min":{"1min":0.52400000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3500000000000001,"5min":1.51,"15min":1.51},"last":1.3080000000000001}]},{"osd":6,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90300000000000002,"15min":0.879},"min":{"1min":0.54200000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.361},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94699999999999995,"15min":0.94799999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3300000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.0609999999999999}]},{"osd":7,"last update":"Fri Sep 13 05:13:58 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0109999999999999,"15min":1.0289999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3680000000000001,"5min":1.867,"15min":1.867},"last":1.151},{"interface":"front","average":{"1min":1.038,"5min":0.97499999999999998,"15min":0.97599999999999998},"min":{"1min":0.52000000000000002,"5min":0.496,"15min":0.496},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":1.1930000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47708,"kb_used_data":2644,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324132,"statfs":{"total":96636764160,"available":96587911168,"internally_reserved":0,"allocated":2707456,"data_stored":1308403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 05:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.59699999999999998,"15min":0.58699999999999997},"min":{"1min":0.42299999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.68100000000000005}]},{"osd":2,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.66400000000000003,"15min":0.61599999999999999},"min":{"1min":0.39400000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.98899999999999999,"5min":5.952,"15min":5.952},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66300000000000003,"15min":0.68999999999999995},"min":{"1min":0.45900000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86499999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.623}]},{"osd":3,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72699999999999998,"15min":0.76700000000000002},"min":{"1min":0.42099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.127,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71399999999999997,"15min":0.747},"min":{"1min":0.47399999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.026,"5min":1.887,"15min":1.887},"last":0.92000000000000004}]},{"osd":4,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.86899999999999999,"15min":0.91400000000000003},"min":{"1min":0.66400000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0329999999999999,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.0740000000000001,"5min":0.92200000000000004,"15min":0.94399999999999995},"min":{"1min":0.78700000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.4750000000000001,"5min":1.724,"15min":1.724},"last":0.95499999999999996}]},{"osd":5,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.89700000000000002,"15min":0.92400000000000004},"min":{"1min":0.69799999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.0609999999999999,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.76800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.0469999999999999}]},{"osd":6,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.94999999999999996,"15min":1},"min":{"1min":0.67500000000000004,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.4239999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.109,"5min":1.0029999999999999,"15min":1.0149999999999999},"min":{"1min":0.74399999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.625,"5min":1.873,"15min":1.873},"last":1.127}]},{"osd":7,"last update":"Fri Sep 13 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.996,"15min":1.018},"min":{"1min":0.80900000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.032},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.046,"15min":1.0409999999999999},"min":{"1min":0.91700000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.401,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.1619999999999999}]}]},{"osd":0,"up_from":124,"seq":532575944739,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30936,"kb_used_data":3216,"kb_used_omap":7,"kb_used_meta":27704,"kb_avail":94340904,"statfs":{"total":96636764160,"available":96605085696,"internally_reserved":0,"allocated":3293184,"data_stored":1898733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7666,"internal_metadata":28369422},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 05:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.32200000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.96299999999999997,"5min":1.472,"15min":1.472},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73999999999999999,"15min":0.748},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.296,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Sep 13 05:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.35199999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.92200000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.77800000000000002,"15min":0.80600000000000005},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.091,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.81599999999999995}]},{"osd":3,"last update":"Fri Sep 13 05:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.70699999999999996,"15min":0.70299999999999996},"min":{"1min":0.40699999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.2669999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.87,"5min":0.85099999999999998,"15min":0.84799999999999998},"min":{"1min":0.46000000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.228,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.94499999999999995}]},{"osd":4,"last update":"Fri Sep 13 05:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.93400000000000005,"15min":0.94899999999999995},"min":{"1min":0.56899999999999995,"5min":0.498,"15min":0.498},"max":{"1min":1.1859999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.91300000000000003,"15min":0.91100000000000003},"min":{"1min":0.57199999999999995,"5min":0.496,"15min":0.496},"max":{"1min":1.2709999999999999,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":0.79100000000000004}]},{"osd":5,"last update":"Fri Sep 13 05:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.82299999999999995,"15min":0.80700000000000005},"min":{"1min":0.66600000000000004,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0149999999999999,"15min":1.0129999999999999},"min":{"1min":0.71899999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.84399999999999997}]},{"osd":6,"last update":"Fri Sep 13 05:14:21 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.1100000000000001,"15min":1.1339999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.3999999999999999,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.88200000000000001}]},{"osd":7,"last update":"Fri Sep 13 05:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.161,"15min":1.1890000000000001},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.323,"5min":1.901,"15min":1.901},"last":1.006},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0549999999999999,"15min":1.0609999999999999},"min":{"1min":0.628,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.339,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":1.0660000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3756,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T05:14:51.665 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T05:14:51.994 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T05:14:51.994 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T05:14:51.994 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T05:14:51.994 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T05:14:55.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-13T05:14:58.096 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T05:14:58.097 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T05:14:58.097 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T05:14:58.183 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T05:14:58.184 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T05:14:58.184 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T05:15:01.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-13T05:15:01.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-13T05:15:04.285 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T05:15:04.286 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T05:15:04.286 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T05:15:04.372 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T05:15:04.373 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-13T05:15:04.373 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T05:15:07.788 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-13T05:15:07.788 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-13T05:15:10.475 INFO:tasks.ceph.osd.4:Stopped 2024-09-13T05:15:10.476 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-13T05:15:10.476 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T05:15:10.563 INFO:tasks.ceph.osd.5:Stopped 2024-09-13T05:15:10.563 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-13T05:15:10.563 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T05:15:10.661 INFO:tasks.ceph.osd.6:Stopped 2024-09-13T05:15:10.662 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-13T05:15:10.662 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T05:15:13.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-13T05:15:13.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-13T05:15:16.763 INFO:tasks.ceph.osd.7:Stopped 2024-09-13T05:15:16.764 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T05:15:16.764 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-13T05:15:16.764 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T05:15:16.795 INFO:tasks.ceph.mgr.y:Stopped 2024-09-13T05:15:16.795 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T05:15:16.795 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T05:15:16.831 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T05:15:16.831 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T05:15:16.831 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T05:15:16.831 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T05:15:16.865 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T05:15:16.866 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T05:15:16.866 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T05:15:16.905 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T05:15:16.905 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T05:15:16.906 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T05:15:16.948 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T05:15:16.948 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T05:15:16.948 DEBUG:teuthology.orchestra.run.smithi120:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2024-09-13T05:15:16.969 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-13T05:15:16.970 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T05:15:17.264 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-13T05:15:17.265 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T05:15:17.615 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-13T05:15:17.615 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T05:15:17.818 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-13T05:15:17.818 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T05:15:18.016 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-13T05:15:18.016 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-13T05:15:18.264 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-13T05:15:18.265 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-13T05:15:18.294 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-13T05:15:18.483 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-13T05:15:18.484 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-13T05:15:18.604 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-13T05:15:18.604 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-13T05:15:18.752 INFO:tasks.ceph:Archiving mon data... 2024-09-13T05:15:18.753 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900849/data/mon.a.tgz 2024-09-13T05:15:18.753 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-09-13T05:15:18.760 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.4ob6866Jfl 2024-09-13T05:15:18.760 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.4ob6866Jfl 2024-09-13T05:15:18.918 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.4ob6866Jfl 2024-09-13T05:15:18.941 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.4ob6866Jfl is 473KB 2024-09-13T05:15:19.007 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.4ob6866Jfl 2024-09-13T05:15:19.014 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900849/data/mon.c.tgz 2024-09-13T05:15:19.014 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-09-13T05:15:19.020 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.02nz2nxh4z 2024-09-13T05:15:19.020 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.02nz2nxh4z 2024-09-13T05:15:19.174 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.02nz2nxh4z 2024-09-13T05:15:19.197 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.02nz2nxh4z is 637KB 2024-09-13T05:15:19.267 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.02nz2nxh4z 2024-09-13T05:15:19.274 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900849/data/mon.b.tgz 2024-09-13T05:15:19.274 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-09-13T05:15:19.281 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.ltque3KJhd 2024-09-13T05:15:19.281 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ltque3KJhd 2024-09-13T05:15:19.474 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.ltque3KJhd 2024-09-13T05:15:19.496 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.ltque3KJhd is 637KB 2024-09-13T05:15:19.564 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.ltque3KJhd 2024-09-13T05:15:19.571 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T05:15:19.572 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T05:15:19.574 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T05:15:19.588 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-13T05:15:19.588 DEBUG:teuthology.orchestra.run.smithi120:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T05:15:19.630 DEBUG:teuthology.orchestra.run.smithi137:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T05:15:19.663 INFO:teuthology.orchestra.run.smithi137.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T05:15:19.664 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T05:15:19.670 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T05:15:19.672 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900849/remote/smithi120/crash 2024-09-13T05:15:19.672 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T05:15:19.690 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900849/remote/smithi137/crash 2024-09-13T05:15:19.691 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T05:15:19.707 INFO:tasks.ceph:Compressing logs... 2024-09-13T05:15:19.707 DEBUG:teuthology.orchestra.run.smithi120:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T05:15:19.710 DEBUG:teuthology.orchestra.run.smithi137:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T05:15:35.627 INFO:tasks.ceph:Archiving logs... 2024-09-13T05:15:35.627 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900849/remote/smithi120/log 2024-09-13T05:15:35.629 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T05:15:37.596 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900849/remote/smithi137/log 2024-09-13T05:15:37.597 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T05:15:39.313 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T05:15:39.323 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T05:15:39.323 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T05:15:39.325 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T05:15:39.418 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T05:15:39.427 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T05:15:39.427 DEBUG:teuthology.orchestra.run.smithi120:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T05:15:39.430 DEBUG:teuthology.orchestra.run.smithi137:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T05:15:39.449 INFO:teuthology.orchestra.run.smithi120.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T05:15:39.449 INFO:teuthology.orchestra.run.smithi120.stdout:============================================================================== 2024-09-13T05:15:39.449 INFO:teuthology.orchestra.run.smithi120.stdout:+hv01.front.sepi 67.205.162.81 3 u 48 64 377 0.072 0.068 0.129 2024-09-13T05:15:39.449 INFO:teuthology.orchestra.run.smithi120.stdout:+hv02.front.sepi 63.231.80.2 3 u 51 64 377 0.082 1.183 0.126 2024-09-13T05:15:39.450 INFO:teuthology.orchestra.run.smithi120.stdout:*hv03.front.sepi 74.6.168.72 3 u 53 64 377 0.099 0.213 0.111 2024-09-13T05:15:39.450 INFO:teuthology.orchestra.run.smithi120.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T05:15:39.453 INFO:teuthology.orchestra.run.smithi137.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T05:15:39.453 INFO:teuthology.orchestra.run.smithi137.stdout:============================================================================== 2024-09-13T05:15:39.453 INFO:teuthology.orchestra.run.smithi137.stdout: hv01.front.sepi 67.205.162.81 3 u 48 64 377 0.090 0.316 0.741 2024-09-13T05:15:39.453 INFO:teuthology.orchestra.run.smithi137.stdout: hv02.front.sepi 63.231.80.2 3 u 52 64 377 0.078 0.215 1.180 2024-09-13T05:15:39.453 INFO:teuthology.orchestra.run.smithi137.stdout:*hv03.front.sepi 74.6.168.72 3 u 57 64 377 0.070 -0.063 0.680 2024-09-13T05:15:39.453 INFO:teuthology.orchestra.run.smithi137.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T05:15:39.454 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T05:15:39.466 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T05:15:39.467 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T05:15:39.493 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T05:15:39.525 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T05:15:39.559 INFO:teuthology.task.internal:Duration was 855.100875 seconds 2024-09-13T05:15:39.560 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T05:15:39.593 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T05:15:39.593 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T05:15:39.596 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T05:15:39.649 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T05:15:39.649 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi120.front.sepia.ceph.com 2024-09-13T05:15:39.650 DEBUG:teuthology.orchestra.run.smithi120:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T05:15:39.661 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi137.front.sepia.ceph.com 2024-09-13T05:15:39.662 DEBUG:teuthology.orchestra.run.smithi137:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T05:15:39.675 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T05:15:39.675 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T05:15:39.678 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T05:15:39.718 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T05:15:39.719 DEBUG:teuthology.orchestra.run.smithi120:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T05:15:39.762 DEBUG:teuthology.orchestra.run.smithi137:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T05:15:39.846 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T05:15:39.856 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T05:15:39.856 DEBUG:teuthology.orchestra.run.smithi120:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T05:15:39.870 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T05:15:39.885 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T05:15:39.919 DEBUG:teuthology.orchestra.run.smithi120:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T05:15:39.922 DEBUG:teuthology.orchestra.run.smithi137:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T05:15:39.934 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = core 2024-09-13T05:15:39.935 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = core 2024-09-13T05:15:39.962 DEBUG:teuthology.orchestra.run.smithi120:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T05:15:40.005 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T05:15:40.006 DEBUG:teuthology.orchestra.run.smithi137:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T05:15:40.012 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T05:15:40.013 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T05:15:40.022 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T05:15:40.023 DEBUG:teuthology.misc:Transferring archived files from smithi120:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900849/remote/smithi120 2024-09-13T05:15:40.023 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T05:15:40.065 DEBUG:teuthology.misc:Transferring archived files from smithi137:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900849/remote/smithi137 2024-09-13T05:15:40.065 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T05:15:40.091 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T05:15:40.091 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T05:15:40.098 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T05:15:40.104 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T05:15:40.117 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T05:15:40.117 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T05:15:40.141 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T05:15:40.141 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T05:15:40.144 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T05:15:40.149 INFO:teuthology.orchestra.run.smithi120.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 05:15 /home/ubuntu/cephtest 2024-09-13T05:15:40.152 INFO:teuthology.orchestra.run.smithi137.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 05:15 /home/ubuntu/cephtest 2024-09-13T05:15:40.154 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T05:15:40.174 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T05:15:40.237 INFO:teuthology.run:Summary data: description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/rbd_fsx_copy_on_read} duration: 855.1008751392365 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-13T05:15:40.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T05:15:40.328 INFO:teuthology.run:pass